2023-12-19T17:34:18.945 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-19T17:34:18.946 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} --archive /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202 --name vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/orig.config.yaml 2023-12-19T17:34:18.997 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T17:34:19.099 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202 branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} email: vshankar@redhat.com first_in_suite: false job_id: '7497202' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - bad backtrace - object missing on disk - error reading table object - error reading sessionmap - unmatched fragstat - unmatched rstat - was unreadable, recreating it now - Scrub error on inode - Metadata damage detected - inconsistent rstat on inode - Error recovering journal sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e owner: scheduled_vshankar@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 430 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e sleep_before_teardown: 0 subset: 301/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi045.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_data_scan teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-19_13:22:41 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-19T17:34:19.100 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa; will attempt to use it 2023-12-19T17:34:19.100 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks 2023-12-19T17:34:19.101 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-19T17:34:19.102 INFO:teuthology.task.internal:Checking packages... 2023-12-19T17:34:19.128 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '568df92b7e50b2108bce4c77c393ff294d6a5e5e' 2023-12-19T17:34:19.129 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-19T17:34:19.129 INFO:teuthology.packaging:ref: None 2023-12-19T17:34:19.129 INFO:teuthology.packaging:tag: None 2023-12-19T17:34:19.129 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T17:34:19.129 INFO:teuthology.packaging:sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T17:34:19.129 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-19T17:34:19.374 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-132-g568df92b-1focal 2023-12-19T17:34:19.375 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-19T17:34:19.387 INFO:teuthology.task.internal:no buildpackages task found 2023-12-19T17:34:19.387 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-19T17:34:19.419 INFO:teuthology.task.internal:Saving configuration 2023-12-19T17:34:19.438 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-19T17:34:19.452 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T17:34:19.488 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 17:28:18.502995', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-19T17:34:19.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 17:28:18.504699', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-12-19T17:34:19.520 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-19T17:34:19.532 INFO:teuthology.task.internal:roles: ubuntu@smithi045.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-19T17:34:19.532 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-19T17:34:19.532 INFO:teuthology.run_tasks:Running task console_log... 2023-12-19T17:34:19.637 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3749499b80>, signals=[15]) 2023-12-19T17:34:19.637 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-19T17:34:19.646 INFO:teuthology.task.internal:Opening connections... 2023-12-19T17:34:19.647 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:34:19.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:34:19.712 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:34:19.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:34:19.770 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-19T17:34:19.782 DEBUG:teuthology.orchestra.run.smithi045:> uname -m 2023-12-19T17:34:19.795 INFO:teuthology.orchestra.run.smithi045.stdout:x86_64 2023-12-19T17:34:19.795 DEBUG:teuthology.orchestra.run.smithi045:> cat /etc/os-release 2023-12-19T17:34:19.843 INFO:teuthology.orchestra.run.smithi045.stdout:NAME="Ubuntu" 2023-12-19T17:34:19.843 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-19T17:34:19.843 INFO:teuthology.orchestra.run.smithi045.stdout:ID=ubuntu 2023-12-19T17:34:19.843 INFO:teuthology.orchestra.run.smithi045.stdout:ID_LIKE=debian 2023-12-19T17:34:19.843 INFO:teuthology.orchestra.run.smithi045.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_ID="20.04" 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:VERSION_CODENAME=focal 2023-12-19T17:34:19.844 INFO:teuthology.orchestra.run.smithi045.stdout:UBUNTU_CODENAME=focal 2023-12-19T17:34:19.845 INFO:teuthology.lock.ops:Updating smithi045.front.sepia.ceph.com on lock server 2023-12-19T17:34:19.880 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2023-12-19T17:34:19.887 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2023-12-19T17:34:19.887 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="Ubuntu" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:ID=ubuntu 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE=debian 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="20.04" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_CODENAME=focal 2023-12-19T17:34:19.936 INFO:teuthology.orchestra.run.smithi073.stdout:UBUNTU_CODENAME=focal 2023-12-19T17:34:19.937 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2023-12-19T17:34:19.979 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-19T17:34:19.994 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-19T17:34:20.027 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-19T17:34:20.027 DEBUG:teuthology.orchestra.run.smithi045:> test '!' -e /home/ubuntu/cephtest 2023-12-19T17:34:20.030 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2023-12-19T17:34:20.035 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-19T17:34:20.064 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-19T17:34:20.064 DEBUG:teuthology.orchestra.run.smithi045:> test -z $(ls -A /var/lib/ceph) 2023-12-19T17:34:20.066 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2023-12-19T17:34:20.084 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-19T17:34:20.161 INFO:teuthology.run_tasks:Running task kernel... 2023-12-19T17:34:20.181 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-19T17:34:20.181 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-19T17:34:20.182 DEBUG:teuthology.orchestra.run.smithi045:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T17:34:20.182 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-19T17:34:20.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:34:20.188 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:34:20.188 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T17:34:20.188 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-12-19T17:34:20.189 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:34:20.189 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:34:20.189 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-19T17:34:20.190 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-12-19T17:34:20.195 INFO:teuthology.orchestra.run.smithi045.stdout:5.4.0-124-generic 2023-12-19T17:34:20.196 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:34:20.196 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T17:34:20.196 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:34:20.207 INFO:teuthology.orchestra.run.smithi073.stdout:5.4.0-124-generic 2023-12-19T17:34:20.208 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-124-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:34:20.208 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-19T17:34:20.208 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:34:20.342 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-12-19T17:34:20.342 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T17:34:20.351 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-12-19T17:34:20.351 DEBUG:teuthology.orchestra.run.smithi073:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-19T17:34:20.361 INFO:teuthology.orchestra.run.smithi045.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-12-19T17:34:20.371 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 0: cd: /lib/firmware/updates: No such file or directory 2023-12-19T17:34:20.471 INFO:teuthology.orchestra.run.smithi073.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T17:34:20.473 DEBUG:teuthology.orchestra.run.smithi073:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T17:34:20.483 INFO:teuthology.orchestra.run.smithi045.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-19T17:34:20.485 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-19T17:34:20.543 DEBUG:teuthology.orchestra.run.smithi073:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T17:34:20.558 DEBUG:teuthology.orchestra.run.smithi045:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-19T17:34:20.559 DEBUG:teuthology.orchestra.run.smithi073:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T17:34:20.574 DEBUG:teuthology.orchestra.run.smithi045:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-19T17:35:13.576 INFO:teuthology.orchestra.run.smithi073.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T17:35:13.576 INFO:teuthology.orchestra.run.smithi073.stderr: * [new branch] main -> origin/main 2023-12-19T17:35:13.630 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T17:35:13.631 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T17:35:13.633 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T17:35:13.634 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T17:35:13.636 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T17:35:13.637 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T17:35:13.638 INFO:teuthology.orchestra.run.smithi073.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T17:35:15.690 INFO:teuthology.orchestra.run.smithi045.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-19T17:35:15.691 INFO:teuthology.orchestra.run.smithi045.stderr: * [new branch] main -> origin/main 2023-12-19T17:35:15.752 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190312 -> 20190312 2023-12-19T17:35:15.752 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190416 -> 20190416 2023-12-19T17:35:15.752 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190514 -> 20190514 2023-12-19T17:35:15.753 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190618 -> 20190618 2023-12-19T17:35:15.753 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190717 -> 20190717 2023-12-19T17:35:15.753 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190815 -> 20190815 2023-12-19T17:35:15.754 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20190923 -> 20190923 2023-12-19T17:35:15.754 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191022 -> 20191022 2023-12-19T17:35:15.754 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20191215 -> 20191215 2023-12-19T17:35:15.754 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200122 -> 20200122 2023-12-19T17:35:15.754 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200316 -> 20200316 2023-12-19T17:35:15.755 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200421 -> 20200421 2023-12-19T17:35:15.755 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200519 -> 20200519 2023-12-19T17:35:15.755 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200619 -> 20200619 2023-12-19T17:35:15.755 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200721 -> 20200721 2023-12-19T17:35:15.755 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200817 -> 20200817 2023-12-19T17:35:15.755 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20200918 -> 20200918 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201022 -> 20201022 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201118 -> 20201118 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20201218 -> 20201218 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210208 -> 20210208 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210315 -> 20210315 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210511 -> 20210511 2023-12-19T17:35:15.756 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210716 -> 20210716 2023-12-19T17:35:15.757 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210818 -> 20210818 2023-12-19T17:35:15.757 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20210919 -> 20210919 2023-12-19T17:35:15.758 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211027 -> 20211027 2023-12-19T17:35:15.758 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20211216 -> 20211216 2023-12-19T17:35:15.758 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220209 -> 20220209 2023-12-19T17:35:15.758 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220310 -> 20220310 2023-12-19T17:35:15.758 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220411 -> 20220411 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220509 -> 20220509 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220610 -> 20220610 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220708 -> 20220708 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220815 -> 20220815 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20220913 -> 20220913 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221012 -> 20221012 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221109 -> 20221109 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20221214 -> 20221214 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230117 -> 20230117 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230210 -> 20230210 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230310 -> 20230310 2023-12-19T17:35:15.760 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230404 -> 20230404 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230515 -> 20230515 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230625 -> 20230625 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230804 -> 20230804 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20230919 -> 20230919 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231030 -> 20231030 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231111 -> 20231111 2023-12-19T17:35:15.761 INFO:teuthology.orchestra.run.smithi045.stderr: * [new tag] 20231211 -> 20231211 2023-12-19T17:35:17.589 INFO:teuthology.orchestra.run.smithi073.stderr:Updating files: 51% (1682/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 65% (2129/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2659/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T17:35:17.594 INFO:teuthology.orchestra.run.smithi073.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T17:35:17.611 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-19T17:35:17.612 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:35:17.841 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T17:35:17.841 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T17:35:17.844 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi073.front.sepia.ceph.com to complete... 2023-12-19T17:35:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19 17:35:19 URL:https://3.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38928782/38928782] -> "/tmp/linux-image.deb" [1] 2023-12-19T17:35:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:FINISHED --2023-12-19 17:35:19-- 2023-12-19T17:35:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:Total wall clock time: 1.6s 2023-12-19T17:35:19.506 INFO:teuthology.orchestra.run.smithi073.stderr:Downloaded: 1 files, 37M in 1.4s (25.9 MB/s) 2023-12-19T17:35:19.510 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-19T17:35:19.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T17:35:19.799 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T17:35:19.919 INFO:teuthology.orchestra.run.smithi045.stderr:Updating files: 49% (1604/3256) Updating files: 50% (1628/3256) Updating files: 51% (1661/3256) Updating files: 52% (1694/3256) Updating files: 53% (1726/3256) Updating files: 54% (1759/3256) Updating files: 55% (1791/3256) Updating files: 56% (1824/3256) Updating files: 57% (1856/3256) Updating files: 58% (1889/3256) Updating files: 59% (1922/3256) Updating files: 60% (1954/3256) Updating files: 61% (1987/3256) Updating files: 62% (2019/3256) Updating files: 63% (2052/3256) Updating files: 64% (2084/3256) Updating files: 65% (2117/3256) Updating files: 66% (2149/3256) Updating files: 67% (2182/3256) Updating files: 68% (2215/3256) Updating files: 69% (2247/3256) Updating files: 70% (2280/3256) Updating files: 71% (2312/3256) Updating files: 72% (2345/3256) Updating files: 73% (2377/3256) Updating files: 74% (2410/3256) Updating files: 75% (2442/3256) Updating files: 76% (2475/3256) Updating files: 77% (2508/3256) Updating files: 78% (2540/3256) Updating files: 79% (2573/3256) Updating files: 80% (2605/3256) Updating files: 81% (2638/3256) Updating files: 81% (2647/3256) Updating files: 82% (2670/3256) Updating files: 83% (2703/3256) Updating files: 84% (2736/3256) Updating files: 85% (2768/3256) Updating files: 86% (2801/3256) Updating files: 87% (2833/3256) Updating files: 88% (2866/3256) Updating files: 89% (2898/3256) Updating files: 90% (2931/3256) Updating files: 91% (2963/3256) Updating files: 92% (2996/3256) Updating files: 93% (3029/3256) Updating files: 93% (3048/3256) Updating files: 94% (3061/3256) Updating files: 95% (3094/3256) Updating files: 96% (3126/3256) Updating files: 97% (3159/3256) Updating files: 98% (3191/3256) Updating files: 99% (3224/3256) Updating files: 100% (3256/3256) Updating files: 100% (3256/3256), done. 2023-12-19T17:35:19.924 INFO:teuthology.orchestra.run.smithi045.stdout:HEAD is now at c156e6be Merge branch 'robot/pr-0-1702625169' into 'main' 2023-12-19T17:35:19.942 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-19T17:35:19.943 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-19T17:35:20.097 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-19T17:35:20.097 DEBUG:teuthology.orchestra.run.smithi045:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-19T17:35:20.100 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-12-19T17:35:21.572 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-12-19T17:35:21.576 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T17:35:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19 17:35:21 URL:https://3.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/focal/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38928782/38928782] -> "/tmp/linux-image.deb" [1] 2023-12-19T17:35:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:FINISHED --2023-12-19 17:35:21-- 2023-12-19T17:35:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:Total wall clock time: 1.5s 2023-12-19T17:35:21.590 INFO:teuthology.orchestra.run.smithi045.stderr:Downloaded: 1 files, 37M in 1.4s (27.5 MB/s) 2023-12-19T17:35:21.593 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-19T17:35:21.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo dpkg -i /tmp/linux-image.deb 2023-12-19T17:35:21.843 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T17:35:21.886 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-19T17:35:23.627 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... 104373 files and directories currently installed.) 2023-12-19T17:35:23.632 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-19T17:35:23.986 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T17:35:24.935 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T17:35:25.053 INFO:teuthology.orchestra.run.smithi073.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T17:35:26.920 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-19T17:35:27.043 INFO:teuthology.orchestra.run.smithi045.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T17:35:51.284 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2023-12-19T17:35:51.302 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T17:35:51.327 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-12-19T17:35:51.768 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T17:35:51.792 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T17:35:52.264 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-19T17:35:52.278 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-19T17:35:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-12-19T17:35:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T17:35:53.577 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-12-19T17:35:53.904 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T17:35:53.944 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.047 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-12-19T17:35:54.231 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T17:35:54.241 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./ 2023-12-19T17:35:54.241 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./boot/ 2023-12-19T17:35:54.241 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:50 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.256 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:50 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.257 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:50 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/postinst.d/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/postrm.d/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/preinst.d/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/prerm.d/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T17:35:54.281 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T17:35:54.282 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T17:35:54.283 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T17:35:54.284 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T17:35:54.284 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T17:35:54.284 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T17:35:54.284 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T17:35:54.345 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-19T17:35:54.360 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-19T17:35:54.369 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T17:35:54.369 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T17:35:54.370 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T17:35:54.371 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T17:35:54.372 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T17:35:54.373 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T17:35:54.374 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T17:35:54.375 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T17:35:54.376 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T17:35:54.376 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T17:35:54.376 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T17:35:54.376 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T17:35:54.376 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T17:35:54.376 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T17:35:54.377 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T17:35:54.377 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T17:35:54.377 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T17:35:54.377 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T17:35:54.377 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T17:35:54.377 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T17:35:54.378 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T17:35:54.379 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T17:35:54.380 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T17:35:54.381 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T17:35:54.381 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T17:35:54.381 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T17:35:54.381 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T17:35:54.381 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T17:35:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T17:35:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T17:35:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T17:35:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T17:35:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T17:35:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T17:35:54.383 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T17:35:54.384 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T17:35:54.385 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T17:35:54.386 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T17:35:54.387 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T17:35:54.388 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T17:35:54.389 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T17:35:54.390 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T17:35:54.391 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T17:35:54.392 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T17:35:54.393 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T17:35:54.394 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T17:35:54.395 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T17:35:54.396 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T17:35:54.397 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T17:35:54.398 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T17:35:54.399 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T17:35:54.400 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T17:35:54.401 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T17:35:54.402 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T17:35:54.403 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T17:35:54.404 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T17:35:54.405 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T17:35:54.406 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T17:35:54.407 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T17:35:54.408 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T17:35:54.409 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T17:35:54.410 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T17:35:54.411 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T17:35:54.412 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T17:35:54.413 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T17:35:54.414 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T17:35:54.415 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T17:35:54.416 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T17:35:54.417 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T17:35:54.418 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T17:35:54.419 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T17:35:54.420 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T17:35:54.421 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T17:35:54.422 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T17:35:54.423 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T17:35:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T17:35:54.425 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T17:35:54.426 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T17:35:54.427 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T17:35:54.428 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T17:35:54.429 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T17:35:54.430 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T17:35:54.431 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T17:35:54.432 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T17:35:54.433 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T17:35:54.434 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T17:35:54.435 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T17:35:54.436 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T17:35:54.437 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T17:35:54.438 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T17:35:54.439 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T17:35:54.440 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T17:35:54.573 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T17:35:54.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T17:35:54.574 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T17:35:54.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T17:35:54.574 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T17:35:54.574 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T17:35:54.574 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T17:35:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T17:35:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T17:35:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T17:35:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T17:35:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T17:35:54.575 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T17:35:54.576 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T17:35:54.577 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T17:35:54.578 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T17:35:54.578 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T17:35:54.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T17:35:54.578 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T17:35:54.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T17:35:54.578 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T17:35:54.579 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T17:35:54.580 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T17:35:54.581 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T17:35:54.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T17:35:54.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T17:35:54.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T17:35:54.581 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T17:35:54.581 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T17:35:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T17:35:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T17:35:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T17:35:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T17:35:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T17:35:54.582 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T17:35:54.583 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T17:35:54.584 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T17:35:54.585 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T17:35:54.586 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T17:35:54.587 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T17:35:54.588 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T17:35:54.589 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T17:35:54.590 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T17:35:54.591 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T17:35:54.592 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T17:35:54.593 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T17:35:54.594 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T17:35:54.595 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T17:35:54.596 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T17:35:54.597 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T17:35:54.598 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T17:35:54.599 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T17:35:54.600 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T17:35:54.601 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T17:35:54.602 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T17:35:54.603 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T17:35:54.604 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T17:35:54.605 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T17:35:54.606 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T17:35:54.607 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T17:35:54.608 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T17:35:54.609 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T17:35:54.610 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T17:35:54.611 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T17:35:54.612 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T17:35:54.613 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T17:35:54.614 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T17:35:54.615 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T17:35:54.616 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T17:35:54.617 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T17:35:54.618 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T17:35:54.619 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T17:35:54.620 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T17:35:54.621 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T17:35:54.622 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T17:35:54.623 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T17:35:54.624 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T17:35:54.625 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T17:35:54.626 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T17:35:54.627 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T17:35:54.628 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T17:35:54.629 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T17:35:54.630 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T17:35:54.631 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T17:35:54.632 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T17:35:54.633 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T17:35:54.634 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T17:35:54.635 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T17:35:54.636 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T17:35:54.637 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T17:35:54.638 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T17:35:54.639 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T17:35:54.640 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T17:35:54.641 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T17:35:54.642 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T17:35:54.643 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T17:35:54.644 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T17:35:54.645 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T17:35:54.646 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T17:35:54.647 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T17:35:54.648 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T17:35:54.649 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T17:35:54.650 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T17:35:54.651 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T17:35:54.652 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T17:35:54.653 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T17:35:54.654 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T17:35:54.655 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T17:35:54.656 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T17:35:54.657 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T17:35:54.658 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T17:35:54.659 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T17:35:54.660 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T17:35:54.661 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T17:35:54.662 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T17:35:54.663 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T17:35:54.664 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T17:35:54.665 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T17:35:54.666 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T17:35:54.667 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T17:35:54.668 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T17:35:54.669 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T17:35:54.670 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T17:35:54.671 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T17:35:54.672 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T17:35:54.673 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T17:35:54.674 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T17:35:54.675 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T17:35:54.676 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T17:35:54.677 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T17:35:54.678 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T17:35:54.679 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T17:35:54.680 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T17:35:54.681 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T17:35:54.682 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T17:35:54.683 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T17:35:54.684 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T17:35:54.685 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T17:35:54.686 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T17:35:54.687 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 210 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 879 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T17:35:54.688 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/ 2023-12-19T17:35:54.689 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/share/ 2023-12-19T17:35:54.689 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/share/doc/ 2023-12-19T17:35:54.689 INFO:teuthology.orchestra.run.smithi073.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T17:35:54.689 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 170 2023-12-08 17:50 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T17:35:54.689 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r-- root/root 691 2023-12-08 17:50 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T17:35:54.690 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.690 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.690 DEBUG:teuthology.orchestra.run.smithi073:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T17:35:54.698 INFO:teuthology.orchestra.run.smithi073.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-19T17:35:54.699 INFO:teuthology.orchestra.run.smithi073.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-19T17:35:54.699 INFO:teuthology.orchestra.run.smithi073.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-19T17:35:54.699 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T17:35:54.699 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T17:35:54.699 DEBUG:teuthology.orchestra.run.smithi073:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T17:35:54.702 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi073.front.sepia.ceph.com to complete... 2023-12-19T17:35:55.378 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub' 2023-12-19T17:35:55.384 INFO:teuthology.orchestra.run.smithi073.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T17:35:55.401 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2023-12-19T17:35:55.729 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T17:35:55.741 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.190 INFO:teuthology.orchestra.run.smithi073.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-19T17:35:56.202 INFO:teuthology.orchestra.run.smithi073.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-19T17:35:56.203 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-12-19T17:35:56.426 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-deb -c /tmp/linux-image.deb 2023-12-19T17:35:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./ 2023-12-19T17:35:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./boot/ 2023-12-19T17:35:56.435 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:50 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.451 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:50 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.452 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:50 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/postinst.d/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/postrm.d/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/preinst.d/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./etc/kernel/prerm.d/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-19T17:35:56.474 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-19T17:35:56.475 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-19T17:35:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-19T17:35:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-19T17:35:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-19T17:35:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-19T17:35:56.477 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-19T17:35:56.478 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-19T17:35:56.479 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-19T17:35:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-19T17:35:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-19T17:35:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-19T17:35:56.491 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-19T17:35:56.492 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-19T17:35:56.493 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-19T17:35:56.494 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-19T17:35:56.495 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-19T17:35:56.496 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-19T17:35:56.497 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-19T17:35:56.498 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-19T17:35:56.499 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-19T17:35:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-19T17:35:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-19T17:35:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-19T17:35:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-19T17:35:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-19T17:35:56.500 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-19T17:35:56.533 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-19T17:35:56.534 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-19T17:35:56.535 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-19T17:35:56.536 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-19T17:35:56.537 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-19T17:35:56.538 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-19T17:35:56.539 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-19T17:35:56.540 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-19T17:35:56.541 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-19T17:35:56.542 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-19T17:35:56.543 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-19T17:35:56.544 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-19T17:35:56.545 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-19T17:35:56.546 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-19T17:35:56.547 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-19T17:35:56.548 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-19T17:35:56.549 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-19T17:35:56.550 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-19T17:35:56.551 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-19T17:35:56.552 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-19T17:35:56.553 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-19T17:35:56.554 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-19T17:35:56.555 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-19T17:35:56.556 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-19T17:35:56.557 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-19T17:35:56.558 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-19T17:35:56.559 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-19T17:35:56.560 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-19T17:35:56.561 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-19T17:35:56.562 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-19T17:35:56.563 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-19T17:35:56.564 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-19T17:35:56.565 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-19T17:35:56.566 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-19T17:35:56.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-19T17:35:56.566 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-19T17:35:56.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-19T17:35:56.566 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-19T17:35:56.566 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-19T17:35:56.591 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-19T17:35:56.592 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-19T17:35:56.593 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-19T17:35:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-19T17:35:56.595 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-19T17:35:56.596 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-19T17:35:56.597 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-19T17:35:56.598 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-19T17:35:56.599 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-19T17:35:56.600 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-19T17:35:56.601 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-19T17:35:56.602 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-19T17:35:56.603 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-19T17:35:56.604 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-19T17:35:56.605 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-19T17:35:56.606 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-19T17:35:56.607 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-19T17:35:56.608 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-19T17:35:56.609 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-19T17:35:56.610 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-19T17:35:56.611 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-19T17:35:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-19T17:35:56.613 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-19T17:35:56.614 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-19T17:35:56.615 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-19T17:35:56.616 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-19T17:35:56.617 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-19T17:35:56.618 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-19T17:35:56.619 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-19T17:35:56.668 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-19T17:35:56.669 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-19T17:35:56.670 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-19T17:35:56.671 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-19T17:35:56.672 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-19T17:35:56.673 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-19T17:35:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-19T17:35:56.675 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-19T17:35:56.676 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-19T17:35:56.677 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-19T17:35:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-19T17:35:56.679 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-19T17:35:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-19T17:35:56.681 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-19T17:35:56.682 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-19T17:35:56.683 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-19T17:35:56.684 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-19T17:35:56.685 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-19T17:35:56.686 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-19T17:35:56.687 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-19T17:35:56.688 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-19T17:35:56.689 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-19T17:35:56.690 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-19T17:35:56.691 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-19T17:35:56.692 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-19T17:35:56.693 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-19T17:35:56.694 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-19T17:35:56.695 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-19T17:35:56.696 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-19T17:35:56.697 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-19T17:35:56.698 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-19T17:35:56.699 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-19T17:35:56.700 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-19T17:35:56.701 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-19T17:35:56.702 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-19T17:35:56.703 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-19T17:35:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-19T17:35:56.705 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-19T17:35:56.706 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-19T17:35:56.707 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-19T17:35:56.708 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-19T17:35:56.709 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-19T17:35:56.710 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-19T17:35:56.711 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-19T17:35:56.712 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-19T17:35:56.713 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-19T17:35:56.714 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-19T17:35:56.715 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-19T17:35:56.741 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-19T17:35:56.742 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-19T17:35:56.743 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-19T17:35:56.744 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-19T17:35:56.745 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-19T17:35:56.746 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-19T17:35:56.747 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-19T17:35:56.748 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-19T17:35:56.749 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-19T17:35:56.750 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-19T17:35:56.751 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-19T17:35:56.752 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-19T17:35:56.753 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-19T17:35:56.754 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-19T17:35:56.755 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-19T17:35:56.756 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-19T17:35:56.757 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-19T17:35:56.758 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-19T17:35:56.759 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-19T17:35:56.760 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-19T17:35:56.761 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-19T17:35:56.762 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-19T17:35:56.763 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-19T17:35:56.764 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-19T17:35:56.765 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-19T17:35:56.766 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-19T17:35:56.767 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-19T17:35:56.768 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-19T17:35:56.769 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-19T17:35:56.770 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-19T17:35:56.771 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-19T17:35:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-19T17:35:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-19T17:35:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-19T17:35:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-19T17:35:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-19T17:35:56.785 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-19T17:35:56.786 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-19T17:35:56.787 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-19T17:35:56.788 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-19T17:35:56.789 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-19T17:35:56.790 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-19T17:35:56.791 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-19T17:35:56.792 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-19T17:35:56.793 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-19T17:35:56.794 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-19T17:35:56.795 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-19T17:35:56.796 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-19T17:35:56.797 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-19T17:35:56.798 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 210 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 879 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:50 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/ 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/share/ 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/share/doc/ 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:drwxr-xr-x root/root 0 2023-12-08 17:50 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 170 2023-12-08 17:50 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-19T17:35:56.799 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-r--r-- root/root 691 2023-12-08 17:50 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-19T17:35:56.800 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.800 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.800 DEBUG:teuthology.orchestra.run.smithi045:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-19T17:35:56.838 INFO:teuthology.orchestra.run.smithi045.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-19T17:35:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-19T17:35:56.838 INFO:teuthology.orchestra.run.smithi045.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-1168b92c-82ac-47e1-87d9-5d77414c7738' { 2023-12-19T17:35:56.839 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-19T17:35:56.839 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-19T17:35:56.839 DEBUG:teuthology.orchestra.run.smithi045:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-19T17:35:56.841 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi045.front.sepia.ceph.com to complete... 2023-12-19T17:35:56.961 INFO:teuthology.orchestra.run.smithi073.stderr:done 2023-12-19T17:35:57.497 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub' 2023-12-19T17:35:57.508 INFO:teuthology.orchestra.run.smithi045.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-19T17:35:57.518 INFO:teuthology.orchestra.run.smithi045.stderr:Generating grub configuration file ... 2023-12-19T17:35:57.802 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-19T17:35:57.814 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-19T17:35:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-12-19T17:35:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-12-19T17:35:58.994 INFO:teuthology.orchestra.run.smithi045.stderr:done 2023-12-19T17:36:28.113 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-19T17:36:28.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T17:36:28.114 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:36:30.112 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-19T17:36:30.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-19T17:36:30.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:36:46.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-19T17:36:48.657 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.45 2023-12-19T17:36:55.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T17:36:55.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:36:57.660 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-19T17:36:57.661 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:36:58.705 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.73 2023-12-19T17:37:10.717 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T17:37:10.718 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:37:43.419 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-12-19T17:37:44.692 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T17:37:44.692 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-19T17:37:44.692 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2023-12-19T17:37:44.709 INFO:teuthology.orchestra.run.smithi073.stdout:6.6.0-gcd68252d7b4d 2023-12-19T17:37:44.709 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T17:37:44.709 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T17:37:44.709 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T17:37:45.711 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-19T17:37:45.711 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-19T17:37:45.819 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2023-12-19T17:37:45.883 DEBUG:teuthology.parallel:result is None 2023-12-19T17:37:57.671 DEBUG:teuthology.orchestra.remote:timed out 2023-12-19T17:38:09.673 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-19T17:38:09.674 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:38:09.948 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-19T17:38:10.677 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-19T17:38:10.677 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-19T17:38:10.678 DEBUG:teuthology.orchestra.run.smithi045:> uname -r 2023-12-19T17:38:10.743 INFO:teuthology.orchestra.run.smithi045.stdout:6.6.0-gcd68252d7b4d 2023-12-19T17:38:10.744 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-19T17:38:10.744 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-19T17:38:10.744 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-19T17:38:11.745 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-19T17:38:11.745 DEBUG:teuthology.orchestra.run.smithi045:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-19T17:38:11.866 INFO:teuthology.orchestra.run.smithi045.stdout:ttyS1 2023-12-19T17:38:11.915 DEBUG:teuthology.parallel:result is None 2023-12-19T17:38:11.915 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-19T17:38:11.923 INFO:teuthology.task.internal:Creating test directory... 2023-12-19T17:38:11.923 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T17:38:11.930 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-19T17:38:11.948 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-19T17:38:11.962 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-19T17:38:11.997 INFO:teuthology.task.internal:Creating archive directory... 2023-12-19T17:38:11.997 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T17:38:12.005 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-19T17:38:12.042 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-19T17:38:12.049 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-19T17:38:12.049 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T17:38:12.072 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-19T17:38:12.109 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T17:38:12.131 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T17:38:12.144 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T17:38:12.173 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-19T17:38:12.177 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-19T17:38:12.184 INFO:teuthology.task.internal:Configuring sudo... 2023-12-19T17:38:12.184 DEBUG:teuthology.orchestra.run.smithi045:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T17:38:12.192 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-19T17:38:12.226 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-19T17:38:12.236 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-19T17:38:12.236 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T17:38:12.280 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-19T17:38:12.302 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T17:38:12.358 DEBUG:teuthology.orchestra.run.smithi045:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T17:38:12.420 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:38:12.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T17:38:12.511 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-19T17:38:12.532 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-19T17:38:12.592 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:38:12.592 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-19T17:38:12.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo service rsyslog restart 2023-12-19T17:38:12.684 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2023-12-19T17:38:12.856 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-19T17:38:12.864 INFO:teuthology.task.internal:Starting timer... 2023-12-19T17:38:12.864 INFO:teuthology.run_tasks:Running task pcp... 2023-12-19T17:38:12.918 INFO:teuthology.run_tasks:Running task selinux... 2023-12-19T17:38:12.962 DEBUG:teuthology.task.selinux:Excluding smithi045: OS 'ubuntu' does not support SELinux 2023-12-19T17:38:12.962 DEBUG:teuthology.task.selinux:Excluding smithi073: OS 'ubuntu' does not support SELinux 2023-12-19T17:38:12.962 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-19T17:38:12.963 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-19T17:38:12.963 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-19T17:38:12.963 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-19T17:38:12.996 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-19T17:38:12.996 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-19T17:38:13.016 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-19T17:38:13.017 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi045.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-19T17:46:26.711 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi045.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2023-12-19T17:46:26.712 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-19T17:46:26.713 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi045.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:46:26.841 DEBUG:teuthology.orchestra.run.smithi045:> true 2023-12-19T17:46:27.087 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi045.front.sepia.ceph.com' 2023-12-19T17:46:27.087 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T17:46:27.088 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-19T17:46:27.217 DEBUG:teuthology.orchestra.run.smithi073:> true 2023-12-19T17:46:27.443 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2023-12-19T17:46:27.443 INFO:teuthology.run_tasks:Running task clock... 2023-12-19T17:46:27.460 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-19T17:46:27.461 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T17:46:27.461 DEBUG:teuthology.orchestra.run.smithi045:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T17:46:27.469 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-19T17:46:27.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T17:46:27.545 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-19T17:46:27.545 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Command line: ntpd -gq 2023-12-19T17:46:27.546 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: proto: precision = 0.057 usec (-24) 2023-12-19T17:46:27.546 INFO:teuthology.orchestra.run.smithi045.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T17:46:27.546 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T17:46:27.547 INFO:teuthology.orchestra.run.smithi045.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listen normally on 3 ens1f0 172.21.15.45:123 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listen normally on 4 lo [::1]:123 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:febd:12be%4]:123 2023-12-19T17:46:27.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:27 ntpd[23399]: Listening on routing socket on fd #22 for interface updates 2023-12-19T17:46:27.565 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-12-19T17:46:27.565 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Command line: ntpd -gq 2023-12-19T17:46:27.566 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: proto: precision = 0.046 usec (-24) 2023-12-19T17:46:27.566 INFO:teuthology.orchestra.run.smithi073.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T17:46:27.567 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-19T17:46:27.567 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: restrict ::: KOD does nothing without LIMITED. 2023-12-19T17:46:27.567 INFO:teuthology.orchestra.run.smithi073.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listen and drop on 0 v6wildcard [::]:123 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listen normally on 2 lo 127.0.0.1:123 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listen normally on 3 enp3s0f1 172.21.15.73:123 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listen normally on 4 lo [::1]:123 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce7d%5]:123 2023-12-19T17:46:27.568 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:27 ntpd[23443]: Listening on routing socket on fd #22 for interface updates 2023-12-19T17:46:28.545 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:28 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.546 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:28 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:28.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:28.569 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:28 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:30.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:30 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:30.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:30.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:30 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:32.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:32.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:32 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:32.568 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:32 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.549 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:34.550 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.551 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.551 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:34.551 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:34.551 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.551 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.551 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:34.552 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:34 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.566 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stdout:19 Dec 17:46:34 ntpd[23443]: ntpd: time slew -0.000145 s 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stdout:ntpd: time slew -0.000145s 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T17:46:34.567 INFO:teuthology.orchestra.run.smithi073.stderr:19 Dec 17:46:34 ntpd[23443]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T17:46:34.706 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T17:46:34.706 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2023-12-19T17:46:34.707 INFO:teuthology.orchestra.run.smithi073.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:34.707 INFO:teuthology.orchestra.run.smithi073.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:34.707 INFO:teuthology.orchestra.run.smithi073.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:34.707 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: can't open /var/log/ntpstats/rawstats.20231219: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-19T17:46:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: can't open /var/log/ntpstats/peerstats.20231219: Permission denied 2023-12-19T17:46:36.548 INFO:teuthology.orchestra.run.smithi045.stdout:19 Dec 17:46:36 ntpd[23399]: ntpd: time slew +0.000946 s 2023-12-19T17:46:36.548 INFO:teuthology.orchestra.run.smithi045.stdout:ntpd: time slew +0.000946s 2023-12-19T17:46:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-19T17:46:36.548 INFO:teuthology.orchestra.run.smithi045.stderr:19 Dec 17:46:36 ntpd[23399]: can't open /var/log/ntpstats/loopstats.20231219: Permission denied 2023-12-19T17:46:36.704 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T17:46:36.704 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-12-19T17:46:36.704 INFO:teuthology.orchestra.run.smithi045.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:36.704 INFO:teuthology.orchestra.run.smithi045.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:36.705 INFO:teuthology.orchestra.run.smithi045.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:36.705 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-12-19T17:46:36.706 INFO:teuthology.run_tasks:Running task install... 2023-12-19T17:46:36.714 DEBUG:teuthology.task.install:project ceph 2023-12-19T17:46:36.714 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}} 2023-12-19T17:46:36.714 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'} 2023-12-19T17:46:36.714 INFO:teuthology.task.install:Using flavor: default 2023-12-19T17:46:36.721 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-19T17:46:36.721 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-19T17:46:36.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-key list | grep Ceph 2023-12-19T17:46:36.722 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-key list | grep Ceph 2023-12-19T17:46:36.958 INFO:teuthology.orchestra.run.smithi073.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-19T17:46:36.961 INFO:teuthology.orchestra.run.smithi045.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-12-19T17:46:37.100 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T17:46:37.100 INFO:teuthology.orchestra.run.smithi073.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T17:46:37.102 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T17:46:37.102 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T17:46:37.103 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T17:46:37.118 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-19T17:46:37.118 INFO:teuthology.orchestra.run.smithi045.stdout:uid [ unknown] Ceph.com (release key) 2023-12-19T17:46:37.118 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-19T17:46:37.118 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-19T17:46:37.118 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T17:46:37.261 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default/ 2023-12-19T17:46:37.261 INFO:teuthology.task.install.deb:Package version is 18.2.1-132-g568df92b-1focal 2023-12-19T17:46:37.343 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default/ 2023-12-19T17:46:37.343 INFO:teuthology.task.install.deb:Package version is 18.2.1-132-g568df92b-1focal 2023-12-19T17:46:37.397 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:46:37.397 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T17:46:37.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo apt-get update 2023-12-19T17:46:37.464 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:46:37.464 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-19T17:46:37.505 DEBUG:teuthology.orchestra.run.smithi045:> sudo apt-get update 2023-12-19T17:46:37.748 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-19T17:46:37.765 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal InRelease 2023-12-19T17:46:37.780 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-19T17:46:37.780 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-19T17:46:37.781 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:3 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-12-19T17:46:37.787 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-19T17:46:37.797 INFO:teuthology.orchestra.run.smithi045.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-19T17:46:37.812 INFO:teuthology.orchestra.run.smithi073.stdout:Ign:4 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal Release.gpg 2023-12-19T17:46:37.821 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal InRelease 2023-12-19T17:46:37.821 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2023-12-19T17:46:37.834 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-19T17:46:37.843 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-12-19T17:46:37.868 INFO:teuthology.orchestra.run.smithi045.stdout:Ign:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal Release.gpg 2023-12-19T17:46:37.879 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main i386 Packages [3,410 B] 2023-12-19T17:46:37.890 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2023-12-19T17:46:37.903 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-12-19T17:46:37.937 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main i386 Packages [3,410 B] 2023-12-19T17:46:37.985 INFO:teuthology.orchestra.run.smithi073.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-12-19T17:46:39.131 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 28.4 kB in 1s (20.9 kB/s) 2023-12-19T17:46:39.231 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 28.4 kB in 1s (20.6 kB/s) 2023-12-19T17:46:40.371 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-12-19T17:46:40.416 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-132-g568df92b-1focal cephadm=18.2.1-132-g568df92b-1focal ceph-mds=18.2.1-132-g568df92b-1focal ceph-mgr=18.2.1-132-g568df92b-1focal ceph-common=18.2.1-132-g568df92b-1focal ceph-fuse=18.2.1-132-g568df92b-1focal ceph-test=18.2.1-132-g568df92b-1focal ceph-volume=18.2.1-132-g568df92b-1focal radosgw=18.2.1-132-g568df92b-1focal python3-rados=18.2.1-132-g568df92b-1focal python3-rgw=18.2.1-132-g568df92b-1focal python3-cephfs=18.2.1-132-g568df92b-1focal python3-rbd=18.2.1-132-g568df92b-1focal libcephfs2=18.2.1-132-g568df92b-1focal libcephfs-dev=18.2.1-132-g568df92b-1focal librados2=18.2.1-132-g568df92b-1focal librbd1=18.2.1-132-g568df92b-1focal rbd-fuse=18.2.1-132-g568df92b-1focal python3-cephfs=18.2.1-132-g568df92b-1focal cephfs-shell=18.2.1-132-g568df92b-1focal cephfs-top=18.2.1-132-g568df92b-1focal cephfs-mirror=18.2.1-132-g568df92b-1focal 2023-12-19T17:46:40.516 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-12-19T17:46:40.539 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-12-19T17:46:40.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.1-132-g568df92b-1focal cephadm=18.2.1-132-g568df92b-1focal ceph-mds=18.2.1-132-g568df92b-1focal ceph-mgr=18.2.1-132-g568df92b-1focal ceph-common=18.2.1-132-g568df92b-1focal ceph-fuse=18.2.1-132-g568df92b-1focal ceph-test=18.2.1-132-g568df92b-1focal ceph-volume=18.2.1-132-g568df92b-1focal radosgw=18.2.1-132-g568df92b-1focal python3-rados=18.2.1-132-g568df92b-1focal python3-rgw=18.2.1-132-g568df92b-1focal python3-cephfs=18.2.1-132-g568df92b-1focal python3-rbd=18.2.1-132-g568df92b-1focal libcephfs2=18.2.1-132-g568df92b-1focal libcephfs-dev=18.2.1-132-g568df92b-1focal librados2=18.2.1-132-g568df92b-1focal librbd1=18.2.1-132-g568df92b-1focal rbd-fuse=18.2.1-132-g568df92b-1focal python3-cephfs=18.2.1-132-g568df92b-1focal cephfs-shell=18.2.1-132-g568df92b-1focal cephfs-top=18.2.1-132-g568df92b-1focal cephfs-mirror=18.2.1-132-g568df92b-1focal 2023-12-19T17:46:40.689 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-12-19T17:46:40.749 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-12-19T17:46:40.749 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-12-19T17:46:40.895 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-12-19T17:46:40.896 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-12-19T17:46:40.940 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T17:46:40.941 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-19T17:46:40.941 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T17:46:40.941 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-12-19T17:46:40.941 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T17:46:40.942 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-19T17:46:40.942 INFO:teuthology.orchestra.run.smithi073.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-19T17:46:40.942 INFO:teuthology.orchestra.run.smithi073.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-19T17:46:40.942 INFO:teuthology.orchestra.run.smithi073.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T17:46:40.943 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-19T17:46:40.944 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout:Recommended packages: 2023-12-19T17:46:40.945 INFO:teuthology.orchestra.run.smithi073.stdout: btrfs-tools 2023-12-19T17:46:41.087 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-12-19T17:46:41.089 INFO:teuthology.orchestra.run.smithi045.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common python3-cherrypy3 python3-cmd2 python3-colorama 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-12-19T17:46:41.090 INFO:teuthology.orchestra.run.smithi045.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1-modules python3-pyinotify python3-pyperclip python3-pytest 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n socat xmlstarlet 2023-12-19T17:46:41.091 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout:Recommended packages: 2023-12-19T17:46:41.092 INFO:teuthology.orchestra.run.smithi045.stdout: btrfs-tools 2023-12-19T17:46:41.153 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-12-19T17:46:41.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T17:46:41.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T17:46:41.153 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T17:46:41.153 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-12-19T17:46:41.153 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-12-19T17:46:41.154 INFO:teuthology.orchestra.run.smithi073.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-19T17:46:41.154 INFO:teuthology.orchestra.run.smithi073.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-12-19T17:46:41.154 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-12-19T17:46:41.154 INFO:teuthology.orchestra.run.smithi073.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T17:46:41.155 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-19T17:46:41.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-19T17:46:41.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-19T17:46:41.156 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-19T17:46:41.156 INFO:teuthology.orchestra.run.smithi073.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-12-19T17:46:41.156 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2023-12-19T17:46:41.156 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 librbd1 2023-12-19T17:46:41.309 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-12-19T17:46:41.309 INFO:teuthology.orchestra.run.smithi045.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-19T17:46:41.310 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-19T17:46:41.310 INFO:teuthology.orchestra.run.smithi045.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-19T17:46:41.310 INFO:teuthology.orchestra.run.smithi045.stdout: cephfs-mirror cephfs-shell cephfs-top fonts-mathjax jq libcephfs-dev 2023-12-19T17:46:41.310 INFO:teuthology.orchestra.run.smithi045.stdout: libcephfs2 libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc 2023-12-19T17:46:41.310 INFO:teuthology.orchestra.run.smithi045.stdout: libjs-underscore liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 2023-12-19T17:46:41.310 INFO:teuthology.orchestra.run.smithi045.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: libradosstriper1 librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: nvme-cli python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cmd2 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-colorama python3-cryptography python3-decorator python3-google-auth 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2023-12-19T17:46:41.311 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyperclip 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-pytest python3-rados python3-rbd python3-repoze.lru 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-scipy python3-simplegeneric python3-simplejson 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-12-19T17:46:41.312 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-12-19T17:46:41.313 INFO:teuthology.orchestra.run.smithi045.stdout: librados2 librbd1 2023-12-19T17:46:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:2 upgraded, 116 newly installed, 0 to remove and 262 not upgraded. 2023-12-19T17:46:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 208 MB of archives. 2023-12-19T17:46:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 1,030 MB of additional disk space will be used. 2023-12-19T17:46:41.333 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.1-132-g568df92b-1focal [3,441 kB] 2023-12-19T17:46:41.370 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-12-19T17:46:41.455 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-19T17:46:41.493 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-12-19T17:46:41.531 INFO:teuthology.orchestra.run.smithi045.stdout:2 upgraded, 116 newly installed, 0 to remove and 262 not upgraded. 2023-12-19T17:46:41.532 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 208 MB of archives. 2023-12-19T17:46:41.532 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 1,030 MB of additional disk space will be used. 2023-12-19T17:46:41.532 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyperclip all 1.7.0-1 [10.5 kB] 2023-12-19T17:46:41.550 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.1-132-g568df92b-1focal [4,002 kB] 2023-12-19T17:46:41.588 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.1-132-g568df92b-1focal [3,441 kB] 2023-12-19T17:46:41.616 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-12-19T17:46:41.631 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-19T17:46:41.654 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cmd2 all 0.8.5-2.1 [49.6 kB] 2023-12-19T17:46:41.676 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.1-132-g568df92b-1focal [739 kB] 2023-12-19T17:46:41.701 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.1-132-g568df92b-1focal [387 kB] 2023-12-19T17:46:41.713 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.1-132-g568df92b-1focal [31.9 kB] 2023-12-19T17:46:41.714 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.1-132-g568df92b-1focal [200 kB] 2023-12-19T17:46:41.721 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.1-132-g568df92b-1focal [60.3 kB] 2023-12-19T17:46:41.722 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.1-132-g568df92b-1focal [365 kB] 2023-12-19T17:46:41.734 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.1-132-g568df92b-1focal [6,588 kB] 2023-12-19T17:46:41.764 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-19T17:46:41.782 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-19T17:46:41.792 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-12-19T17:46:41.844 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-19T17:46:41.925 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-12-19T17:46:41.943 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-12-19T17:46:41.965 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.1-132-g568df92b-1focal [113 kB] 2023-12-19T17:46:41.967 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.1-132-g568df92b-1focal [477 kB] 2023-12-19T17:46:41.981 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.1-132-g568df92b-1focal [25.2 MB] 2023-12-19T17:46:42.004 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-12-19T17:46:42.044 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-19T17:46:42.051 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-19T17:46:42.078 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-19T17:46:42.087 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-19T17:46:42.205 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-12-19T17:46:42.212 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-12-19T17:46:42.239 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-12-19T17:46:42.247 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-12-19T17:46:42.250 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-19T17:46:42.412 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-12-19T17:46:42.618 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-19T17:46:42.639 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-19T17:46:42.785 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-12-19T17:46:42.805 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-12-19T17:46:42.817 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-19T17:46:42.830 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-19T17:46:42.854 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.1-132-g568df92b-1focal [11.0 MB] 2023-12-19T17:46:42.863 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-19T17:46:42.869 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-19T17:46:42.871 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-19T17:46:42.874 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-19T17:46:42.883 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T17:46:42.885 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-19T17:46:42.983 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-12-19T17:46:42.992 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-12-19T17:46:43.028 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-12-19T17:46:43.033 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-12-19T17:46:43.036 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-12-19T17:46:43.038 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-12-19T17:46:43.048 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-19T17:46:43.049 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-12-19T17:46:43.050 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-19T17:46:43.215 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-12-19T17:46:43.231 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.1-132-g568df92b-1focal [234 kB] 2023-12-19T17:46:43.234 INFO:teuthology.orchestra.run.smithi073.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.1-132-g568df92b-1focal [147 kB] 2023-12-19T17:46:43.238 INFO:teuthology.orchestra.run.smithi073.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.1-132-g568df92b-1focal [1,565 kB] 2023-12-19T17:46:43.293 INFO:teuthology.orchestra.run.smithi073.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.1-132-g568df92b-1focal [9,403 kB] 2023-12-19T17:46:43.393 INFO:teuthology.orchestra.run.smithi073.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-19T17:46:43.416 INFO:teuthology.orchestra.run.smithi073.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-19T17:46:43.484 INFO:teuthology.orchestra.run.smithi073.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-19T17:46:43.546 INFO:teuthology.orchestra.run.smithi073.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-19T17:46:43.553 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-12-19T17:46:43.555 INFO:teuthology.orchestra.run.smithi073.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-19T17:46:43.577 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-12-19T17:46:43.622 INFO:teuthology.orchestra.run.smithi073.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.1-132-g568df92b-1focal [31.3 MB] 2023-12-19T17:46:43.647 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-12-19T17:46:43.675 INFO:teuthology.orchestra.run.smithi073.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-19T17:46:43.676 INFO:teuthology.orchestra.run.smithi073.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-19T17:46:43.679 INFO:teuthology.orchestra.run.smithi073.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-19T17:46:43.683 INFO:teuthology.orchestra.run.smithi073.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-19T17:46:43.695 INFO:teuthology.orchestra.run.smithi073.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-19T17:46:43.710 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-12-19T17:46:43.720 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-12-19T17:46:43.838 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-12-19T17:46:43.838 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-12-19T17:46:43.842 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-12-19T17:46:43.847 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-12-19T17:46:43.858 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-12-19T17:46:43.881 INFO:teuthology.orchestra.run.smithi073.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2023-12-19T17:46:44.044 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.2 [211 kB] 2023-12-19T17:46:44.137 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.1-132-g568df92b-1focal [4,002 kB] 2023-12-19T17:46:44.336 INFO:teuthology.orchestra.run.smithi073.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-19T17:46:44.347 INFO:teuthology.orchestra.run.smithi073.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-12-19T17:46:44.394 INFO:teuthology.orchestra.run.smithi073.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-19T17:46:44.437 INFO:teuthology.orchestra.run.smithi073.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-19T17:46:44.446 INFO:teuthology.orchestra.run.smithi073.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-19T17:46:44.452 INFO:teuthology.orchestra.run.smithi073.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-19T17:46:44.462 INFO:teuthology.orchestra.run.smithi073.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-19T17:46:44.467 INFO:teuthology.orchestra.run.smithi073.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-19T17:46:44.484 INFO:teuthology.orchestra.run.smithi073.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-19T17:46:44.486 INFO:teuthology.orchestra.run.smithi073.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-19T17:46:44.494 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-12-19T17:46:44.507 INFO:teuthology.orchestra.run.smithi045.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2023-12-19T17:46:44.553 INFO:teuthology.orchestra.run.smithi045.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-12-19T17:46:44.597 INFO:teuthology.orchestra.run.smithi045.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-12-19T17:46:44.605 INFO:teuthology.orchestra.run.smithi045.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-12-19T17:46:44.611 INFO:teuthology.orchestra.run.smithi045.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-12-19T17:46:44.621 INFO:teuthology.orchestra.run.smithi045.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-12-19T17:46:44.626 INFO:teuthology.orchestra.run.smithi045.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-12-19T17:46:44.643 INFO:teuthology.orchestra.run.smithi045.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-12-19T17:46:44.644 INFO:teuthology.orchestra.run.smithi045.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-12-19T17:46:44.656 INFO:teuthology.orchestra.run.smithi073.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-19T17:46:44.710 INFO:teuthology.orchestra.run.smithi073.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.1-132-g568df92b-1focal [13.7 kB] 2023-12-19T17:46:44.710 INFO:teuthology.orchestra.run.smithi073.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.1-132-g568df92b-1focal [847 kB] 2023-12-19T17:46:44.725 INFO:teuthology.orchestra.run.smithi073.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.1-132-g568df92b-1focal [2,310 kB] 2023-12-19T17:46:44.808 INFO:teuthology.orchestra.run.smithi073.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.1-132-g568df92b-1focal [234 kB] 2023-12-19T17:46:44.814 INFO:teuthology.orchestra.run.smithi073.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.1-132-g568df92b-1focal [136 kB] 2023-12-19T17:46:44.815 INFO:teuthology.orchestra.run.smithi045.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-12-19T17:46:44.819 INFO:teuthology.orchestra.run.smithi073.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.1-132-g568df92b-1focal [1,832 kB] 2023-12-19T17:46:44.883 INFO:teuthology.orchestra.run.smithi073.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.1-132-g568df92b-1focal [7,894 kB] 2023-12-19T17:46:45.087 INFO:teuthology.orchestra.run.smithi073.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T17:46:45.091 INFO:teuthology.orchestra.run.smithi073.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-19T17:46:45.124 INFO:teuthology.orchestra.run.smithi073.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-19T17:46:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.1-132-g568df92b-1focal [13.8 kB] 2023-12-19T17:46:45.157 INFO:teuthology.orchestra.run.smithi073.stdout:Get:75 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.1-132-g568df92b-1focal [50.1 MB] 2023-12-19T17:46:45.174 INFO:teuthology.orchestra.run.smithi073.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-19T17:46:45.204 INFO:teuthology.orchestra.run.smithi073.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-19T17:46:45.207 INFO:teuthology.orchestra.run.smithi073.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-19T17:46:45.216 INFO:teuthology.orchestra.run.smithi073.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-19T17:46:45.241 INFO:teuthology.orchestra.run.smithi045.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-19T17:46:45.244 INFO:teuthology.orchestra.run.smithi045.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-12-19T17:46:45.277 INFO:teuthology.orchestra.run.smithi045.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-12-19T17:46:45.329 INFO:teuthology.orchestra.run.smithi045.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-12-19T17:46:45.357 INFO:teuthology.orchestra.run.smithi045.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-12-19T17:46:45.361 INFO:teuthology.orchestra.run.smithi045.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-12-19T17:46:45.371 INFO:teuthology.orchestra.run.smithi045.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-12-19T17:46:45.680 INFO:teuthology.orchestra.run.smithi073.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-19T17:46:45.755 INFO:teuthology.orchestra.run.smithi073.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-19T17:46:45.757 INFO:teuthology.orchestra.run.smithi073.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-19T17:46:45.855 INFO:teuthology.orchestra.run.smithi045.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-12-19T17:46:45.913 INFO:teuthology.orchestra.run.smithi045.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-12-19T17:46:45.915 INFO:teuthology.orchestra.run.smithi045.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-12-19T17:46:45.972 INFO:teuthology.orchestra.run.smithi073.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-19T17:46:46.056 INFO:teuthology.orchestra.run.smithi073.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-19T17:46:46.117 INFO:teuthology.orchestra.run.smithi045.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-12-19T17:46:46.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-19T17:46:46.202 INFO:teuthology.orchestra.run.smithi045.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-12-19T17:46:46.244 INFO:teuthology.orchestra.run.smithi073.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-19T17:46:46.271 INFO:teuthology.orchestra.run.smithi073.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-19T17:46:46.308 INFO:teuthology.orchestra.run.smithi073.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-19T17:46:46.322 INFO:teuthology.orchestra.run.smithi073.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-19T17:46:46.326 INFO:teuthology.orchestra.run.smithi045.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-12-19T17:46:46.373 INFO:teuthology.orchestra.run.smithi073.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-19T17:46:46.381 INFO:teuthology.orchestra.run.smithi073.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-19T17:46:46.388 INFO:teuthology.orchestra.run.smithi045.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-12-19T17:46:46.395 INFO:teuthology.orchestra.run.smithi073.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-19T17:46:46.414 INFO:teuthology.orchestra.run.smithi045.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-12-19T17:46:46.452 INFO:teuthology.orchestra.run.smithi045.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-12-19T17:46:46.466 INFO:teuthology.orchestra.run.smithi045.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-12-19T17:46:46.475 INFO:teuthology.orchestra.run.smithi073.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-19T17:46:46.516 INFO:teuthology.orchestra.run.smithi045.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-12-19T17:46:46.525 INFO:teuthology.orchestra.run.smithi045.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-12-19T17:46:46.538 INFO:teuthology.orchestra.run.smithi045.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-12-19T17:46:46.618 INFO:teuthology.orchestra.run.smithi045.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-12-19T17:46:46.665 INFO:teuthology.orchestra.run.smithi073.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-19T17:46:46.808 INFO:teuthology.orchestra.run.smithi045.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-12-19T17:46:46.894 INFO:teuthology.orchestra.run.smithi073.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.1-132-g568df92b-1focal [119 kB] 2023-12-19T17:46:46.894 INFO:teuthology.orchestra.run.smithi073.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.1-132-g568df92b-1focal [266 kB] 2023-12-19T17:46:46.897 INFO:teuthology.orchestra.run.smithi073.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.1-132-g568df92b-1focal [33.0 kB] 2023-12-19T17:46:46.897 INFO:teuthology.orchestra.run.smithi073.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.1-132-g568df92b-1focal [22.6 kB] 2023-12-19T17:46:46.898 INFO:teuthology.orchestra.run.smithi073.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.1-132-g568df92b-1focal [37.3 kB] 2023-12-19T17:46:46.899 INFO:teuthology.orchestra.run.smithi073.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.1-132-g568df92b-1focal [13.4 MB] 2023-12-19T17:46:46.944 INFO:teuthology.orchestra.run.smithi045.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.1-132-g568df92b-1focal [739 kB] 2023-12-19T17:46:47.045 INFO:teuthology.orchestra.run.smithi073.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-19T17:46:47.072 INFO:teuthology.orchestra.run.smithi073.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-19T17:46:47.192 INFO:teuthology.orchestra.run.smithi045.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-12-19T17:46:47.219 INFO:teuthology.orchestra.run.smithi045.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-12-19T17:46:47.224 INFO:teuthology.orchestra.run.smithi073.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-19T17:46:47.281 INFO:teuthology.orchestra.run.smithi073.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-12-19T17:46:47.286 INFO:teuthology.orchestra.run.smithi073.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-19T17:46:47.355 INFO:teuthology.orchestra.run.smithi073.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.1-132-g568df92b-1focal [107 kB] 2023-12-19T17:46:47.372 INFO:teuthology.orchestra.run.smithi045.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-12-19T17:46:47.377 INFO:teuthology.orchestra.run.smithi045.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.1-132-g568df92b-1focal [387 kB] 2023-12-19T17:46:47.430 INFO:teuthology.orchestra.run.smithi045.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-colorama all 0.4.3-1build1 [23.9 kB] 2023-12-19T17:46:47.434 INFO:teuthology.orchestra.run.smithi045.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-12-19T17:46:47.453 INFO:teuthology.orchestra.run.smithi073.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-19T17:46:47.462 INFO:teuthology.orchestra.run.smithi073.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-12-19T17:46:47.470 INFO:teuthology.orchestra.run.smithi073.stdout:Get:109 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-19T17:46:47.479 INFO:teuthology.orchestra.run.smithi045.stdout:Get:77 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.1-132-g568df92b-1focal [31.9 kB] 2023-12-19T17:46:47.503 INFO:teuthology.orchestra.run.smithi045.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.1-132-g568df92b-1focal [200 kB] 2023-12-19T17:46:47.550 INFO:teuthology.orchestra.run.smithi045.stdout:Get:79 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.1-132-g568df92b-1focal [60.3 kB] 2023-12-19T17:46:47.560 INFO:teuthology.orchestra.run.smithi045.stdout:Get:80 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.1-132-g568df92b-1focal [365 kB] 2023-12-19T17:46:47.601 INFO:teuthology.orchestra.run.smithi045.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-12-19T17:46:47.610 INFO:teuthology.orchestra.run.smithi045.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2023-12-19T17:46:47.614 INFO:teuthology.orchestra.run.smithi073.stdout:Get:110 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-19T17:46:47.614 INFO:teuthology.orchestra.run.smithi073.stdout:Get:111 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-19T17:46:47.619 INFO:teuthology.orchestra.run.smithi045.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-12-19T17:46:47.686 INFO:teuthology.orchestra.run.smithi045.stdout:Get:84 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.1-132-g568df92b-1focal [6,588 kB] 2023-12-19T17:46:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-12-19T17:46:47.779 INFO:teuthology.orchestra.run.smithi073.stdout:Get:112 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-19T17:46:47.791 INFO:teuthology.orchestra.run.smithi045.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-12-19T17:46:47.956 INFO:teuthology.orchestra.run.smithi045.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-12-19T17:46:48.119 INFO:teuthology.orchestra.run.smithi073.stdout:Get:113 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-19T17:46:48.299 INFO:teuthology.orchestra.run.smithi045.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-12-19T17:46:48.491 INFO:teuthology.orchestra.run.smithi073.stdout:Get:114 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T17:46:48.495 INFO:teuthology.orchestra.run.smithi073.stdout:Get:115 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-19T17:46:48.506 INFO:teuthology.orchestra.run.smithi073.stdout:Get:116 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-19T17:46:48.507 INFO:teuthology.orchestra.run.smithi073.stdout:Get:117 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-19T17:46:48.511 INFO:teuthology.orchestra.run.smithi073.stdout:Get:118 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-19T17:46:48.664 INFO:teuthology.orchestra.run.smithi045.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-19T17:46:48.668 INFO:teuthology.orchestra.run.smithi045.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-12-19T17:46:48.679 INFO:teuthology.orchestra.run.smithi045.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-12-19T17:46:48.682 INFO:teuthology.orchestra.run.smithi045.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-12-19T17:46:48.685 INFO:teuthology.orchestra.run.smithi045.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-12-19T17:46:49.530 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 208 MB in 7s (28.0 MB/s) 2023-12-19T17:46:49.694 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T17:46:49.762 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-12-19T17:46:49.765 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-12-19T17:46:49.818 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-12-19T17:46:50.163 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T17:46:50.182 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-19T17:46:50.221 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-19T17:46:50.558 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T17:46:50.578 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-12-19T17:46:50.607 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-12-19T17:46:50.611 INFO:teuthology.orchestra.run.smithi045.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.1-132-g568df92b-1focal [113 kB] 2023-12-19T17:46:50.642 INFO:teuthology.orchestra.run.smithi045.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.1-132-g568df92b-1focal [477 kB] 2023-12-19T17:46:50.741 INFO:teuthology.orchestra.run.smithi045.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.1-132-g568df92b-1focal [25.2 MB] 2023-12-19T17:46:51.019 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-19T17:46:51.040 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-19T17:46:51.119 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-19T17:46:51.740 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T17:46:51.758 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-19T17:46:51.823 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-19T17:46:52.110 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T17:46:52.126 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-19T17:46:52.159 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-19T17:46:52.663 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T17:46:52.684 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-19T17:46:52.735 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:46:53.283 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T17:46:53.305 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-19T17:46:53.349 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:46:53.761 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T17:46:53.783 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-19T17:46:53.827 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:46:54.231 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-19T17:46:54.249 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-19T17:46:54.289 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-19T17:46:54.532 INFO:teuthology.orchestra.run.smithi045.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.1-132-g568df92b-1focal [11.0 MB] 2023-12-19T17:46:54.737 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../010-librbd1_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:46:54.860 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librbd1 (18.2.1-132-g568df92b-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-19T17:46:55.482 INFO:teuthology.orchestra.run.smithi045.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.1-132-g568df92b-1focal [234 kB] 2023-12-19T17:46:55.505 INFO:teuthology.orchestra.run.smithi045.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.1-132-g568df92b-1focal [147 kB] 2023-12-19T17:46:55.511 INFO:teuthology.orchestra.run.smithi045.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.1-132-g568df92b-1focal [1,565 kB] 2023-12-19T17:46:55.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../011-librados2_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:46:55.642 INFO:teuthology.orchestra.run.smithi045.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.1-132-g568df92b-1focal [9,403 kB] 2023-12-19T17:46:55.756 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librados2 (18.2.1-132-g568df92b-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-19T17:46:56.294 INFO:teuthology.orchestra.run.smithi045.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.1-132-g568df92b-1focal [31.3 MB] 2023-12-19T17:46:56.543 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T17:46:56.563 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../012-libcephfs2_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:46:56.601 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:46:56.979 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rados. 2023-12-19T17:46:56.999 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../013-python3-rados_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:46:57.037 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rados (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:46:57.440 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T17:46:57.460 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:46:57.498 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-argparse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:46:57.785 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T17:46:57.805 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../015-python3-cephfs_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:46:57.883 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cephfs (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:46:57.959 INFO:teuthology.orchestra.run.smithi045.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.1-132-g568df92b-1focal [13.7 kB] 2023-12-19T17:46:57.959 INFO:teuthology.orchestra.run.smithi045.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.1-132-g568df92b-1focal [847 kB] 2023-12-19T17:46:57.995 INFO:teuthology.orchestra.run.smithi045.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.1-132-g568df92b-1focal [2,310 kB] 2023-12-19T17:46:58.092 INFO:teuthology.orchestra.run.smithi045.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.1-132-g568df92b-1focal [234 kB] 2023-12-19T17:46:58.098 INFO:teuthology.orchestra.run.smithi045.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.1-132-g568df92b-1focal [136 kB] 2023-12-19T17:46:58.105 INFO:teuthology.orchestra.run.smithi045.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.1-132-g568df92b-1focal [1,832 kB] 2023-12-19T17:46:58.180 INFO:teuthology.orchestra.run.smithi045.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.1-132-g568df92b-1focal [7,894 kB] 2023-12-19T17:46:58.237 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T17:46:58.258 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:46:58.295 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:46:58.497 INFO:teuthology.orchestra.run.smithi045.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.1-132-g568df92b-1focal [13.8 kB] 2023-12-19T17:46:58.497 INFO:teuthology.orchestra.run.smithi045.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.1-132-g568df92b-1focal [50.1 MB] 2023-12-19T17:46:58.674 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T17:46:58.692 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-12-19T17:46:58.732 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-19T17:46:59.035 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T17:46:59.055 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../018-python3-rbd_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:46:59.092 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rbd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:46:59.496 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-19T17:46:59.514 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-19T17:46:59.554 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-19T17:46:59.966 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-19T17:46:59.985 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-19T17:47:00.023 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-19T17:47:00.200 INFO:teuthology.orchestra.run.smithi045.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.1-132-g568df92b-1focal [119 kB] 2023-12-19T17:47:00.201 INFO:teuthology.orchestra.run.smithi045.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephfs-mirror amd64 18.2.1-132-g568df92b-1focal [266 kB] 2023-12-19T17:47:00.203 INFO:teuthology.orchestra.run.smithi045.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephfs-shell all 18.2.1-132-g568df92b-1focal [33.0 kB] 2023-12-19T17:47:00.204 INFO:teuthology.orchestra.run.smithi045.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 cephfs-top all 18.2.1-132-g568df92b-1focal [22.6 kB] 2023-12-19T17:47:00.204 INFO:teuthology.orchestra.run.smithi045.stdout:Get:116 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.1-132-g568df92b-1focal [37.3 kB] 2023-12-19T17:47:00.205 INFO:teuthology.orchestra.run.smithi045.stdout:Get:117 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.1-132-g568df92b-1focal [13.4 MB] 2023-12-19T17:47:00.418 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T17:47:00.439 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-19T17:47:00.476 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-19T17:47:00.642 INFO:teuthology.orchestra.run.smithi045.stdout:Get:118 https://2.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.1-132-g568df92b-1focal [107 kB] 2023-12-19T17:47:00.872 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package librgw2. 2023-12-19T17:47:00.892 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../022-librgw2_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:00.930 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking librgw2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:01.596 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 208 MB in 19s (10.8 MB/s) 2023-12-19T17:47:01.781 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-19T17:47:01.852 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 107756 files and directories currently installed.) 2023-12-19T17:47:01.856 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../000-python3-pyperclip_1.7.0-1_all.deb ... 2023-12-19T17:47:01.891 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T17:47:01.900 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyperclip (1.7.0-1) ... 2023-12-19T17:47:01.911 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../023-python3-rgw_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:01.948 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:02.270 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-19T17:47:02.288 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../001-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-12-19T17:47:02.328 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-19T17:47:02.360 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liboath0. 2023-12-19T17:47:02.378 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-19T17:47:02.418 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-19T17:47:02.714 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cmd2. 2023-12-19T17:47:02.734 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../002-python3-cmd2_0.8.5-2.1_all.deb ... 2023-12-19T17:47:02.771 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T17:47:02.772 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cmd2 (0.8.5-2.1) ... 2023-12-19T17:47:02.792 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../025-libradosstriper1_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:02.821 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libradosstriper1 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:03.167 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-12-19T17:47:03.190 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../003-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-12-19T17:47:03.259 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-19T17:47:03.342 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-common. 2023-12-19T17:47:03.361 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../026-ceph-common_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:03.399 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:03.688 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-19T17:47:03.707 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-12-19T17:47:03.746 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-19T17:47:04.125 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-19T17:47:04.143 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../005-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-12-19T17:47:04.198 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-19T17:47:04.961 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-19T17:47:04.974 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../006-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-19T17:47:05.042 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:47:05.665 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-19T17:47:05.684 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../007-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-19T17:47:05.723 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:47:05.989 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-base. 2023-12-19T17:47:06.006 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../027-ceph-base_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:06.068 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-base (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:06.151 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-19T17:47:06.171 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../008-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-12-19T17:47:06.209 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:47:06.646 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-12-19T17:47:06.664 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../009-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-12-19T17:47:06.704 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-19T17:47:07.154 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../010-librbd1_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:07.274 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librbd1 (18.2.1-132-g568df92b-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-19T17:47:07.560 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T17:47:07.578 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-19T17:47:07.618 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-19T17:47:08.022 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T17:47:08.034 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../011-librados2_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:08.044 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-12-19T17:47:08.088 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-19T17:47:08.187 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librados2 (18.2.1-132-g568df92b-1focal) over (15.2.17-0ubuntu0.20.04.5) ... 2023-12-19T17:47:08.450 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T17:47:08.469 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-12-19T17:47:08.508 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-19T17:47:08.844 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T17:47:08.865 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-19T17:47:08.902 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-19T17:47:09.000 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs2. 2023-12-19T17:47:09.022 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../012-libcephfs2_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:09.066 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:09.274 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-mako. 2023-12-19T17:47:09.294 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-19T17:47:09.332 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-19T17:47:09.478 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rados. 2023-12-19T17:47:09.498 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../013-python3-rados_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:09.536 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rados (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:09.728 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T17:47:09.749 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T17:47:09.794 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T17:47:09.947 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-19T17:47:09.967 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:10.005 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-argparse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:10.130 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T17:47:10.153 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-19T17:47:10.221 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-19T17:47:10.291 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cephfs. 2023-12-19T17:47:10.312 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../015-python3-cephfs_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:10.349 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cephfs (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:10.517 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webob. 2023-12-19T17:47:10.538 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-19T17:47:10.583 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-19T17:47:10.786 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-19T17:47:10.805 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../016-python3-ceph-common_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:10.844 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:10.919 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-19T17:47:10.940 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-19T17:47:10.977 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-19T17:47:11.214 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-prettytable. 2023-12-19T17:47:11.231 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../017-python3-prettytable_0.7.2-5_all.deb ... 2023-12-19T17:47:11.264 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-12-19T17:47:11.322 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bs4. 2023-12-19T17:47:11.342 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-12-19T17:47:11.380 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-19T17:47:11.542 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rbd. 2023-12-19T17:47:11.559 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../018-python3-rbd_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:11.600 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rbd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:11.800 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T17:47:11.822 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-19T17:47:11.871 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-19T17:47:11.936 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-12-19T17:47:11.957 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../019-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-12-19T17:47:11.994 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-19T17:47:12.423 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-12-19T17:47:12.440 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../020-librabbitmq4_0.10.0-1_amd64.deb ... 2023-12-19T17:47:12.480 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-12-19T17:47:12.859 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-19T17:47:12.879 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../021-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-12-19T17:47:12.917 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-19T17:47:13.053 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T17:47:13.066 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-12-19T17:47:13.103 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-19T17:47:13.354 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package librgw2. 2023-12-19T17:47:13.374 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../022-librgw2_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:13.397 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-paste. 2023-12-19T17:47:13.410 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-19T17:47:13.439 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-19T17:47:13.445 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking librgw2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:13.818 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T17:47:13.840 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-19T17:47:13.876 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-19T17:47:14.246 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T17:47:14.265 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-19T17:47:14.303 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-19T17:47:14.398 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rgw. 2023-12-19T17:47:14.420 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../023-python3-rgw_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:14.649 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T17:47:14.666 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-12-19T17:47:14.715 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-19T17:47:15.093 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T17:47:15.110 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-19T17:47:15.151 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-19T17:47:15.181 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:15.584 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liboath0. 2023-12-19T17:47:15.604 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../024-liboath0_2.6.1-1.3_amd64.deb ... 2023-12-19T17:47:15.631 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T17:47:15.642 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-12-19T17:47:15.652 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-19T17:47:15.689 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-19T17:47:16.004 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libradosstriper1. 2023-12-19T17:47:16.027 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../025-libradosstriper1_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:16.051 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T17:47:16.070 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:16.070 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libradosstriper1 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:16.108 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-modules-core (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:16.580 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T17:47:16.600 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:16.607 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-common. 2023-12-19T17:47:16.627 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../026-ceph-common_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:16.638 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:16.673 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:17.025 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cryptography. 2023-12-19T17:47:17.042 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2023-12-19T17:47:17.083 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-19T17:47:17.570 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T17:47:17.593 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-19T17:47:17.636 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-19T17:47:18.049 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T17:47:18.068 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../050-ceph-mgr_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:18.106 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:18.626 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T17:47:18.646 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../051-ceph-mon_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:18.709 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mon (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:19.280 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-base. 2023-12-19T17:47:19.296 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../027-ceph-base_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:19.404 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-base (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:19.996 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T17:47:20.017 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../052-ceph-osd_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:20.087 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-osd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:20.853 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-19T17:47:20.871 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../028-python3-cherrypy3_8.9.1-6_all.deb ... 2023-12-19T17:47:20.908 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-12-19T17:47:21.271 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-natsort. 2023-12-19T17:47:21.288 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../029-python3-natsort_7.0.1-1_all.deb ... 2023-12-19T17:47:21.329 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-12-19T17:47:21.699 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-logutils. 2023-12-19T17:47:21.716 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../030-python3-logutils_0.3.3-7_all.deb ... 2023-12-19T17:47:21.757 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-12-19T17:47:22.127 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-19T17:47:22.147 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../031-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-12-19T17:47:22.184 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-12-19T17:47:22.571 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-mako. 2023-12-19T17:47:22.592 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../032-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-12-19T17:47:22.646 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-19T17:47:23.041 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-19T17:47:23.062 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../033-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-19T17:47:23.099 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-19T17:47:23.156 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph. 2023-12-19T17:47:23.175 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../053-ceph_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:23.241 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:23.462 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-19T17:47:23.481 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../034-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-12-19T17:47:23.520 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-12-19T17:47:23.627 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T17:47:23.647 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../054-ceph-fuse_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:23.684 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:23.889 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webob. 2023-12-19T17:47:23.909 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../035-python3-webob_1%3a1.8.5-2_all.deb ... 2023-12-19T17:47:23.947 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-12-19T17:47:24.138 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T17:47:24.156 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../055-ceph-mds_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:24.196 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mds (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:24.317 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-soupsieve. 2023-12-19T17:47:24.337 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../036-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-12-19T17:47:24.374 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-19T17:47:24.745 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bs4. 2023-12-19T17:47:24.766 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../037-python3-bs4_4.8.2-1_all.deb ... 2023-12-19T17:47:24.791 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephadm. 2023-12-19T17:47:24.811 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-12-19T17:47:24.811 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../056-cephadm_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:24.849 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:25.202 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T17:47:25.222 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-12-19T17:47:25.248 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-waitress. 2023-12-19T17:47:25.269 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../038-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-12-19T17:47:25.276 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-12-19T17:47:25.313 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-19T17:47:25.671 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T17:47:25.691 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-12-19T17:47:25.718 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-tempita. 2023-12-19T17:47:25.738 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../039-python3-tempita_0.5.2-6_all.deb ... 2023-12-19T17:47:25.746 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-19T17:47:25.776 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-12-19T17:47:26.108 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T17:47:26.128 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:26.138 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-paste. 2023-12-19T17:47:26.158 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../040-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-12-19T17:47:26.190 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:26.195 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-12-19T17:47:26.561 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T17:47:26.582 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-19T17:47:26.608 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-19T17:47:26.630 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../041-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-12-19T17:47:26.643 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-19T17:47:26.674 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-12-19T17:47:26.963 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-jwt. 2023-12-19T17:47:26.984 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-19T17:47:27.021 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-19T17:47:27.044 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-19T17:47:27.067 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../042-python3-pastedeploy_2.1.0-1_all.deb ... 2023-12-19T17:47:27.135 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-12-19T17:47:27.398 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-attr. 2023-12-19T17:47:27.417 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-12-19T17:47:27.456 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-19T17:47:27.522 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webtest. 2023-12-19T17:47:27.541 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../043-python3-webtest_2.0.32-2_all.deb ... 2023-12-19T17:47:27.580 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-12-19T17:47:27.851 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T17:47:27.872 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-12-19T17:47:27.908 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-19T17:47:27.975 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pecan. 2023-12-19T17:47:27.995 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../044-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-12-19T17:47:28.033 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-12-19T17:47:28.270 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-py. 2023-12-19T17:47:28.290 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-19T17:47:28.328 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-19T17:47:28.657 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-19T17:47:28.678 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../045-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-12-19T17:47:28.715 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-19T17:47:28.715 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-19T17:47:28.736 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-19T17:47:28.781 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-19T17:47:29.077 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-19T17:47:29.095 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../046-ceph-mgr-modules-core_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:29.135 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-modules-core (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:29.151 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-packaging. 2023-12-19T17:47:29.172 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-12-19T17:47:29.217 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-19T17:47:29.553 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T17:47:29.573 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-19T17:47:29.574 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-12-19T17:47:29.595 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../047-libsqlite3-mod-ceph_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:29.619 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-19T17:47:29.639 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libsqlite3-mod-ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:29.999 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T17:47:30.017 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T17:47:30.026 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cryptography. 2023-12-19T17:47:30.046 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../048-python3-cryptography_2.8-3ubuntu0.2_amd64.deb ... 2023-12-19T17:47:30.056 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T17:47:30.117 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-19T17:47:30.343 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-underscore. 2023-12-19T17:47:30.362 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-19T17:47:30.425 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-19T17:47:30.571 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-openssl. 2023-12-19T17:47:30.592 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../049-python3-openssl_19.0.0-1build1_all.deb ... 2023-12-19T17:47:30.629 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-12-19T17:47:30.737 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-19T17:47:30.758 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-19T17:47:30.804 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-19T17:47:31.042 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr. 2023-12-19T17:47:31.062 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../050-ceph-mgr_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:31.099 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:31.169 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-routes. 2023-12-19T17:47:31.186 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-12-19T17:47:31.226 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-19T17:47:31.646 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T17:47:31.653 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mon. 2023-12-19T17:47:31.664 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:31.672 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../051-ceph-mon_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:31.704 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-dashboard (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:31.711 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mon (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:32.482 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-decorator. 2023-12-19T17:47:32.501 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-19T17:47:32.540 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-19T17:47:32.902 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-19T17:47:32.918 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-19T17:47:32.959 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-19T17:47:33.074 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-osd. 2023-12-19T17:47:33.089 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../052-ceph-osd_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:33.139 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-osd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:33.312 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-scipy. 2023-12-19T17:47:33.333 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-19T17:47:33.370 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-19T17:47:34.838 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-19T17:47:34.860 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-19T17:47:34.904 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-19T17:47:35.542 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T17:47:35.561 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-12-19T17:47:35.599 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-19T17:47:36.028 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T17:47:36.046 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-19T17:47:36.069 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph. 2023-12-19T17:47:36.085 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-19T17:47:36.087 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../053-ceph_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:36.125 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:36.520 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-fuse. 2023-12-19T17:47:36.542 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../054-ceph-fuse_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:36.611 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:36.962 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T17:47:36.982 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:37.019 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:37.090 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mds. 2023-12-19T17:47:37.112 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../055-ceph-mds_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:37.156 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mds (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:37.726 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephadm. 2023-12-19T17:47:37.744 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../056-cephadm_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:37.784 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:38.137 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-19T17:47:38.158 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../057-python3-asyncssh_1.12.2-1_all.deb ... 2023-12-19T17:47:38.203 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2023-12-19T17:47:38.280 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T17:47:38.294 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-12-19T17:47:38.338 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-19T17:47:38.624 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jinja2. 2023-12-19T17:47:38.644 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../058-python3-jinja2_2.10.1-2_all.deb ... 2023-12-19T17:47:38.681 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-12-19T17:47:38.794 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T17:47:38.813 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-19T17:47:38.885 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-19T17:47:39.076 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-19T17:47:39.099 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../059-ceph-mgr-cephadm_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:39.175 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:39.265 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T17:47:39.285 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-19T17:47:39.356 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-19T17:47:39.588 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-19T17:47:39.609 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../060-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-12-19T17:47:39.654 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-19T17:47:39.711 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T17:47:39.730 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-12-19T17:47:39.769 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-19T17:47:39.999 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-jwt. 2023-12-19T17:47:40.016 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../061-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-12-19T17:47:40.056 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-19T17:47:40.131 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T17:47:40.152 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-12-19T17:47:40.189 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-19T17:47:40.435 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-attr. 2023-12-19T17:47:40.455 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../062-python3-attr_19.3.0-2_all.deb ... 2023-12-19T17:47:40.493 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-12-19T17:47:40.560 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-blinker. 2023-12-19T17:47:40.580 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-19T17:47:40.625 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-19T17:47:40.871 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pluggy. 2023-12-19T17:47:40.891 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../063-python3-pluggy_0.13.0-2_all.deb ... 2023-12-19T17:47:40.929 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-12-19T17:47:41.004 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-19T17:47:41.022 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-19T17:47:41.061 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-19T17:47:41.324 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-py. 2023-12-19T17:47:41.343 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../064-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-12-19T17:47:41.407 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-12-19T17:47:41.474 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T17:47:41.494 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-19T17:47:41.531 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-19T17:47:41.794 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-atomicwrites. 2023-12-19T17:47:41.813 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../065-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-12-19T17:47:41.852 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-12-19T17:47:41.919 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T17:47:41.941 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-19T17:47:41.984 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-19T17:47:42.239 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-packaging. 2023-12-19T17:47:42.260 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../066-python3-packaging_20.3-1_all.deb ... 2023-12-19T17:47:42.304 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-packaging (20.3-1) ... 2023-12-19T17:47:42.338 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T17:47:42.361 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-19T17:47:42.404 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-19T17:47:42.687 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pytest. 2023-12-19T17:47:42.707 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../067-python3-pytest_4.6.9-1_all.deb ... 2023-12-19T17:47:42.745 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-12-19T17:47:43.020 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T17:47:43.042 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:43.109 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:43.166 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-19T17:47:43.187 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../068-python3-repoze.lru_0.7-2_all.deb ... 2023-12-19T17:47:43.265 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-19T17:47:43.471 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T17:47:43.494 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-12-19T17:47:43.552 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-underscore. 2023-12-19T17:47:43.569 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-19T17:47:43.572 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../069-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-12-19T17:47:43.634 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-19T17:47:43.912 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-12-19T17:47:43.932 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../070-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-12-19T17:47:43.949 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T17:47:43.969 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:47:44.002 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-19T17:47:44.006 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:47:44.318 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package jq. 2023-12-19T17:47:44.341 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:47:44.384 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:47:44.406 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-routes. 2023-12-19T17:47:44.427 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../071-python3-routes_2.4.1-2_all.deb ... 2023-12-19T17:47:44.472 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-12-19T17:47:44.704 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package socat. 2023-12-19T17:47:44.726 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-12-19T17:47:44.770 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-19T17:47:44.858 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-19T17:47:44.872 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../072-ceph-mgr-dashboard_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:44.917 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-dashboard (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:45.132 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T17:47:45.153 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-19T17:47:45.198 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-19T17:47:45.513 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-decorator. 2023-12-19T17:47:45.534 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../073-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-12-19T17:47:45.579 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-12-19T17:47:45.620 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-test. 2023-12-19T17:47:45.641 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../096-ceph-test_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:45.685 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-test (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:45.916 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-12-19T17:47:45.934 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../074-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-12-19T17:47:45.974 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-19T17:47:46.319 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-scipy. 2023-12-19T17:47:46.339 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../075-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-12-19T17:47:46.384 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-12-19T17:47:47.919 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-12-19T17:47:47.941 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../076-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-12-19T17:47:47.985 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-19T17:47:48.589 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-joblib. 2023-12-19T17:47:48.610 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../077-python3-joblib_0.14.0-3_all.deb ... 2023-12-19T17:47:48.655 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-12-19T17:47:49.085 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-sklearn. 2023-12-19T17:47:49.105 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../078-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-12-19T17:47:49.142 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-19T17:47:49.910 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-19T17:47:49.929 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../079-ceph-mgr-diskprediction-local_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:49.932 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T17:47:49.950 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../097-ceph-volume_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:49.967 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:49.990 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ceph-volume (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:50.414 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T17:47:50.434 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:50.471 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-mirror (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:50.850 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T17:47:50.873 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-12-19T17:47:50.916 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-12-19T17:47:51.228 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T17:47:51.250 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../100-cephfs-shell_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:51.254 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-cachetools. 2023-12-19T17:47:51.272 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../080-python3-cachetools_4.0.0-1_all.deb ... 2023-12-19T17:47:51.294 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-shell (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:51.312 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-12-19T17:47:51.605 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T17:47:51.626 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../101-cephfs-top_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:51.663 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking cephfs-top (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:51.786 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-19T17:47:51.807 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../081-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-12-19T17:47:51.854 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-12-19T17:47:51.924 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-19T17:47:51.937 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-19T17:47:51.982 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:47:52.232 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-19T17:47:52.249 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../082-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-12-19T17:47:52.323 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-19T17:47:52.582 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T17:47:52.603 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:52.647 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libcephfs-dev (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:52.710 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-rsa. 2023-12-19T17:47:52.731 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../083-python3-rsa_4.0-3_all.deb ... 2023-12-19T17:47:52.768 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-rsa (4.0-3) ... 2023-12-19T17:47:53.109 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T17:47:53.130 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-19T17:47:53.138 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-google-auth. 2023-12-19T17:47:53.159 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../084-python3-google-auth_1.5.1-2_all.deb ... 2023-12-19T17:47:53.203 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-19T17:47:53.204 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-12-19T17:47:53.580 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T17:47:53.583 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-blinker. 2023-12-19T17:47:53.602 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-12-19T17:47:53.604 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../085-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-12-19T17:47:53.647 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-12-19T17:47:53.657 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-19T17:47:54.036 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-oauthlib. 2023-12-19T17:47:54.058 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../086-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-12-19T17:47:54.103 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-19T17:47:54.358 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-19T17:47:54.382 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-19T17:47:54.424 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:47:54.473 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-19T17:47:54.496 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../087-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-12-19T17:47:54.556 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-19T17:47:54.943 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-websocket. 2023-12-19T17:47:54.966 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../088-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-12-19T17:47:55.009 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-12-19T17:47:55.404 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-19T17:47:55.428 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../089-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-12-19T17:47:55.470 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-12-19T17:47:56.151 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-19T17:47:56.172 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../090-ceph-mgr-k8sevents_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:47:56.217 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-mgr-k8sevents (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:56.520 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-19T17:47:56.544 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-19T17:47:56.586 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-19T17:47:56.612 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-19T17:47:56.636 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../091-libonig5_6.9.4-1_amd64.deb ... 2023-12-19T17:47:56.678 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-12-19T17:47:57.006 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-webencodings. 2023-12-19T17:47:57.028 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-19T17:47:57.072 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-19T17:47:57.082 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-19T17:47:57.104 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../092-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:47:57.173 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:47:57.434 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-html5lib. 2023-12-19T17:47:57.453 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-12-19T17:47:57.468 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package jq. 2023-12-19T17:47:57.489 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../093-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:47:57.491 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-19T17:47:57.534 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:47:57.813 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package socat. 2023-12-19T17:47:57.836 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../094-socat_1.7.3.3-2_amd64.deb ... 2023-12-19T17:47:57.878 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-19T17:47:57.896 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-19T17:47:57.921 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking socat (1.7.3.3-2) ... 2023-12-19T17:47:57.935 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-19T17:47:58.325 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package xmlstarlet. 2023-12-19T17:47:58.344 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../095-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-12-19T17:47:58.383 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-12-19T17:47:58.440 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T17:47:58.461 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T17:47:58.522 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T17:47:58.812 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-test. 2023-12-19T17:47:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../096-ceph-test_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:47:58.870 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-test (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:47:58.909 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T17:47:58.930 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-19T17:47:58.983 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-19T17:47:59.404 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T17:47:59.425 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-19T17:47:59.469 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-19T17:47:59.840 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T17:47:59.862 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-19T17:47:59.905 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-19T17:48:00.250 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T17:48:00.274 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-19T17:48:00.316 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-19T17:48:01.104 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package radosgw. 2023-12-19T17:48:01.127 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../116-radosgw_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:48:01.195 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking radosgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:02.615 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T17:48:02.638 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../117-rbd-fuse_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:48:02.681 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking rbd-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:03.042 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-19T17:48:03.267 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ceph-volume. 2023-12-19T17:48:03.289 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../097-ceph-volume_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:48:03.325 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ceph-volume (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:03.419 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-19T17:48:03.570 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-19T17:48:03.705 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-19T17:48:03.763 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-19T17:48:03.784 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../098-cephfs-mirror_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:48:03.837 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-mirror (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:03.967 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:04.245 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-colorama. 2023-12-19T17:48:04.266 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../099-python3-colorama_0.4.3-1build1_all.deb ... 2023-12-19T17:48:04.311 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-colorama (0.4.3-1build1) ... 2023-12-19T17:48:04.622 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-shell. 2023-12-19T17:48:04.636 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../100-cephfs-shell_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:48:04.665 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user cephadm....done 2023-12-19T17:48:04.680 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-shell (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:04.854 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:48:04.992 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package cephfs-top. 2023-12-19T17:48:05.010 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../101-cephfs-top_18.2.1-132-g568df92b-1focal_all.deb ... 2023-12-19T17:48:05.013 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-19T17:48:05.050 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking cephfs-top (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:05.361 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package fonts-mathjax. 2023-12-19T17:48:05.384 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../102-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-19T17:48:05.427 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:48:05.474 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T17:48:05.850 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:48:05.976 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-19T17:48:05.981 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-19T17:48:06.004 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../103-libcephfs-dev_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:48:06.091 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libcephfs-dev (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:06.102 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-19T17:48:06.495 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-19T17:48:06.860 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package nvme-cli. 2023-12-19T17:48:06.877 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../104-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-12-19T17:48:06.957 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-12-19T17:48:06.997 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-19T17:48:07.348 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-19T17:48:07.365 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-19T17:48:07.387 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../105-python-asyncssh-doc_1.12.2-1_all.deb ... 2023-12-19T17:48:07.431 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2023-12-19T17:48:07.733 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-12-19T17:48:07.866 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libjs-mathjax. 2023-12-19T17:48:07.887 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../106-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-12-19T17:48:07.964 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:48:08.084 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-19T17:48:08.468 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-19T17:48:08.828 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-argparse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:09.179 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-19T17:48:09.305 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-12-19T17:48:09.648 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-19T17:48:09.999 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-19T17:48:10.138 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python-natsort-doc. 2023-12-19T17:48:10.160 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../107-python-natsort-doc_7.0.1-1_all.deb ... 2023-12-19T17:48:10.229 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-12-19T17:48:10.375 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-19T17:48:10.526 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-19T17:48:10.607 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-webencodings. 2023-12-19T17:48:10.625 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../108-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-12-19T17:48:10.665 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-19T17:48:11.010 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-19T17:48:11.035 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-html5lib. 2023-12-19T17:48:11.052 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../109-python3-html5lib_1.0.1-2_all.deb ... 2023-12-19T17:48:11.092 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-12-19T17:48:11.370 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-19T17:48:11.555 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-12-19T17:48:11.575 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../110-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-12-19T17:48:11.620 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-19T17:48:11.741 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-19T17:48:12.116 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pastescript. 2023-12-19T17:48:12.133 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../111-python3-pastescript_2.0.2-4_all.deb ... 2023-12-19T17:48:12.173 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-19T17:48:12.175 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-19T17:48:12.543 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-19T17:48:12.552 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-psutil. 2023-12-19T17:48:12.575 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../112-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-12-19T17:48:12.618 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-12-19T17:48:12.969 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-19T17:48:13.014 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-19T17:48:13.035 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../113-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-12-19T17:48:13.079 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-19T17:48:13.337 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-19T17:48:13.466 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package python3-simplejson. 2023-12-19T17:48:13.488 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../114-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-12-19T17:48:13.557 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-19T17:48:13.713 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-19T17:48:13.872 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-19T17:48:13.893 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-19T17:48:13.916 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-12-19T17:48:13.959 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-19T17:48:13.998 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-19T17:48:14.375 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-19T17:48:14.747 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package radosgw. 2023-12-19T17:48:14.768 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../116-radosgw_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:48:14.813 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking radosgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:14.851 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-12-19T17:48:15.219 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-19T17:48:15.662 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-19T17:48:16.116 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-19T17:48:16.216 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package rbd-fuse. 2023-12-19T17:48:16.237 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../117-rbd-fuse_18.2.1-132-g568df92b-1focal_amd64.deb ... 2023-12-19T17:48:16.242 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:16.328 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking rbd-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:16.644 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:48:16.702 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-attr (19.3.0-2) ... 2023-12-19T17:48:16.786 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-19T17:48:17.088 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-12-19T17:48:17.213 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-12-19T17:48:17.221 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-19T17:48:17.339 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-12-19T17:48:17.347 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-19T17:48:17.473 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-19T17:48:17.607 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:17.866 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-19T17:48:18.250 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:48:18.331 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user cephadm....done 2023-12-19T17:48:18.376 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-19T17:48:18.522 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:48:18.535 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-19T17:48:18.681 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-12-19T17:48:18.964 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-19T17:48:19.116 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-19T17:48:19.315 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-19T17:48:19.492 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-12-19T17:48:19.635 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-12-19T17:48:19.699 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-19T17:48:19.794 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-12-19T17:48:19.850 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T17:48:20.193 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-19T17:48:20.196 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-12-19T17:48:20.578 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-19T17:48:20.681 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-12-19T17:48:20.954 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-19T17:48:21.049 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-12-19T17:48:21.311 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-19T17:48:21.409 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-colorama (0.4.3-1build1) ... 2023-12-19T17:48:21.665 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-19T17:48:21.785 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-12-19T17:48:21.792 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-19T17:48:22.128 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-12-19T17:48:22.183 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-19T17:48:22.497 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-argparse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:22.635 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-19T17:48:22.761 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-19T17:48:22.887 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-19T17:48:22.900 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-12-19T17:48:23.059 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyperclip (1.7.0-1) ... 2023-12-19T17:48:23.288 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-19T17:48:23.410 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-12-19T17:48:23.648 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-19T17:48:23.769 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-12-19T17:48:24.146 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-12-19T17:48:24.272 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-12-19T17:48:24.731 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-12-19T17:48:25.124 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-12-19T17:48:25.453 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:48:25.492 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-12-19T17:48:25.573 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-19T17:48:25.985 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-12-19T17:48:26.025 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-19T17:48:26.344 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-12-19T17:48:26.401 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-19T17:48:26.753 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-12-19T17:48:26.760 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:48:26.911 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-19T17:48:27.138 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-packaging (20.3-1) ... 2023-12-19T17:48:27.321 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-19T17:48:27.523 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-12-19T17:48:27.650 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-12-19T17:48:27.748 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-12-19T17:48:27.810 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-12-19T17:48:28.186 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-12-19T17:48:28.241 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-19T17:48:28.675 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-19T17:48:28.687 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cmd2 (0.8.5-2.1) ... 2023-12-19T17:48:29.064 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-12-19T17:48:29.515 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cryptography (2.8-3ubuntu0.2) ... 2023-12-19T17:48:29.956 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-19T17:48:29.958 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up socat (1.7.3.3-2) ... 2023-12-19T17:48:30.115 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-19T17:48:30.117 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:30.242 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:48:30.367 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-19T17:48:30.528 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:48:30.671 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-12-19T17:48:30.744 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-19T17:48:30.870 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-19T17:48:31.181 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-12-19T17:48:31.229 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-19T17:48:31.307 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-12-19T17:48:31.433 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-12-19T17:48:31.589 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T17:48:31.809 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-12-19T17:48:31.990 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-19T17:48:32.202 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:48:32.370 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-12-19T17:48:32.459 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librados2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:32.496 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-12-19T17:48:32.687 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-12-19T17:48:32.813 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librgw2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:32.915 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-12-19T17:48:32.990 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libsqlite3-mod-ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:33.116 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:33.242 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-19T17:48:33.265 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-12-19T17:48:33.602 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libradosstriper1 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:33.633 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-12-19T17:48:33.728 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-19T17:48:33.782 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-19T17:48:34.096 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up librbd1 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:34.169 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-12-19T17:48:34.222 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-modules-core (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:34.390 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:34.562 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-12-19T17:48:34.653 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T17:48:34.653 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T17:48:34.954 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-12-19T17:48:35.374 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-12-19T17:48:35.533 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libcephfs-dev (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:35.659 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rados (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:35.740 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-12-19T17:48:35.819 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-top (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:35.866 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-12-19T17:48:35.945 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-19T17:48:36.267 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-12-19T17:48:36.760 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-12-19T17:48:36.889 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-12-19T17:48:37.012 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-12-19T17:48:37.116 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rbd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:37.283 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up rbd-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:37.409 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-rgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:37.535 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up python3-cephfs (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:37.655 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-12-19T17:48:37.703 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-shell (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:37.829 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:38.023 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-12-19T17:48:38.435 INFO:teuthology.orchestra.run.smithi073.stdout:Adding group ceph....done 2023-12-19T17:48:38.909 INFO:teuthology.orchestra.run.smithi073.stdout:Adding system user ceph....done 2023-12-19T17:48:39.156 INFO:teuthology.orchestra.run.smithi073.stdout:Setting system user ceph properties....done 2023-12-19T17:48:39.197 INFO:teuthology.orchestra.run.smithi073.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T17:48:39.410 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T17:48:39.912 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:48:39.966 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T17:48:40.088 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-12-19T17:48:40.564 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-12-19T17:48:40.948 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up cephfs-mirror (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:40.957 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-12-19T17:48:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T17:48:41.209 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T17:48:41.317 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-12-19T17:48:41.442 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-12-19T17:48:41.919 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-12-19T17:48:42.033 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-test (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:42.158 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up radosgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:42.337 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2023-12-19T17:48:42.806 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-12-19T17:48:42.901 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T17:48:42.901 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T17:48:43.223 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-12-19T17:48:43.760 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-base (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:44.269 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T17:48:44.504 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-12-19T17:48:44.630 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-12-19T17:48:44.756 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-12-19T17:48:44.915 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rsa (4.0-3) ... 2023-12-19T17:48:45.179 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mds (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:45.274 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-12-19T17:48:45.400 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-12-19T17:48:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T17:48:45.464 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T17:48:45.768 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-12-19T17:48:46.119 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-19T17:48:46.298 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:46.521 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-12-19T17:48:46.572 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T17:48:46.572 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T17:48:46.956 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librados2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:47.201 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2023-12-19T17:48:47.327 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librgw2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:47.399 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-osd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:47.493 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libsqlite3-mod-ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:47.638 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs2 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:47.763 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-routes (2.4.1-2) ... 2023-12-19T17:48:48.157 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libradosstriper1 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:48.215 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T17:48:48.215 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T17:48:48.324 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-12-19T17:48:48.710 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up librbd1 (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:48.835 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-modules-core (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:48.963 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:49.050 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-k8sevents (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:49.176 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:49.253 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T17:48:49.253 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-19T17:48:49.352 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mon (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:49.619 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T17:48:49.619 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T17:48:50.173 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libcephfs-dev (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:50.299 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rados (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:50.425 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-top (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:50.512 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:50.584 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-12-19T17:48:50.697 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:50.823 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-mgr-dashboard (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:50.983 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ceph-volume (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:51.436 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-19T17:48:51.646 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-19T17:48:51.746 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rbd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:51.872 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up rbd-fuse (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:52.023 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-rgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:52.141 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up python3-cephfs (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:52.147 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-19T17:48:52.267 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-shell (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:52.434 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-common (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:53.174 INFO:teuthology.orchestra.run.smithi045.stdout:Adding group ceph....done 2023-12-19T17:48:53.650 INFO:teuthology.orchestra.run.smithi045.stdout:Adding system user ceph....done 2023-12-19T17:48:53.896 INFO:teuthology.orchestra.run.smithi045.stdout:Setting system user ceph properties....done 2023-12-19T17:48:53.930 INFO:teuthology.orchestra.run.smithi045.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-19T17:48:54.147 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-19T17:48:54.665 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-19T17:48:55.603 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up cephfs-mirror (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:55.899 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T17:48:55.899 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-19T17:48:56.704 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-test (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:56.872 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up radosgw (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:57.450 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-19T17:48:57.582 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T17:48:57.582 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-19T17:48:58.253 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T17:48:58.257 DEBUG:teuthology.orchestra.run.smithi073:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T17:48:58.382 INFO:teuthology.orchestra.run.smithi073.stdout:Reading package lists... 2023-12-19T17:48:58.415 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-base (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:48:58.596 INFO:teuthology.orchestra.run.smithi073.stdout:Building dependency tree... 2023-12-19T17:48:58.596 INFO:teuthology.orchestra.run.smithi073.stdout:Reading state information... 2023-12-19T17:48:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-12-19T17:48:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:flex is already the newest version (2.6.4-6.2). 2023-12-19T17:48:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-12-19T17:48:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-12-19T17:48:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-12-19T17:48:58.797 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T17:48:58.798 INFO:teuthology.orchestra.run.smithi073.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-19T17:48:58.798 INFO:teuthology.orchestra.run.smithi073.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T17:48:58.798 INFO:teuthology.orchestra.run.smithi073.stdout:The following additional packages will be installed: 2023-12-19T17:48:58.799 INFO:teuthology.orchestra.run.smithi073.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-12-19T17:48:58.799 INFO:teuthology.orchestra.run.smithi073.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-12-19T17:48:58.799 INFO:teuthology.orchestra.run.smithi073.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-12-19T17:48:58.799 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-12-19T17:48:58.799 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch-data wpasupplicant 2023-12-19T17:48:58.799 INFO:teuthology.orchestra.run.smithi073.stdout:Suggested packages: 2023-12-19T17:48:58.800 INFO:teuthology.orchestra.run.smithi073.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-12-19T17:48:58.800 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-12-19T17:48:58.800 INFO:teuthology.orchestra.run.smithi073.stdout: libengine-pkcs11-openssl 2023-12-19T17:48:58.902 INFO:teuthology.orchestra.run.smithi073.stdout:The following NEW packages will be installed: 2023-12-19T17:48:58.902 INFO:teuthology.orchestra.run.smithi073.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-12-19T17:48:58.903 INFO:teuthology.orchestra.run.smithi073.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-12-19T17:48:58.903 INFO:teuthology.orchestra.run.smithi073.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-12-19T17:48:58.903 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-12-19T17:48:58.903 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-12-19T17:48:58.903 INFO:teuthology.orchestra.run.smithi073.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T17:48:58.904 INFO:teuthology.orchestra.run.smithi073.stdout:The following packages will be upgraded: 2023-12-19T17:48:58.905 INFO:teuthology.orchestra.run.smithi073.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-12-19T17:48:58.940 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-19T17:48:58.996 INFO:teuthology.orchestra.run.smithi073.stdout:6 upgraded, 31 newly installed, 0 to remove and 256 not upgraded. 2023-12-19T17:48:58.997 INFO:teuthology.orchestra.run.smithi073.stdout:Need to get 25.3 MB of archives. 2023-12-19T17:48:58.997 INFO:teuthology.orchestra.run.smithi073.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-12-19T17:48:58.997 INFO:teuthology.orchestra.run.smithi073.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-12-19T17:48:59.154 INFO:teuthology.orchestra.run.smithi073.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-12-19T17:48:59.155 INFO:teuthology.orchestra.run.smithi073.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-12-19T17:48:59.158 INFO:teuthology.orchestra.run.smithi073.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-12-19T17:48:59.167 INFO:teuthology.orchestra.run.smithi073.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-12-19T17:48:59.169 INFO:teuthology.orchestra.run.smithi073.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-12-19T17:48:59.185 INFO:teuthology.orchestra.run.smithi073.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-12-19T17:48:59.186 INFO:teuthology.orchestra.run.smithi073.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-12-19T17:48:59.187 INFO:teuthology.orchestra.run.smithi073.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-12-19T17:48:59.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-12-19T17:48:59.189 INFO:teuthology.orchestra.run.smithi073.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2023-12-19T17:48:59.192 INFO:teuthology.orchestra.run.smithi073.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-12-19T17:48:59.194 INFO:teuthology.orchestra.run.smithi073.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-12-19T17:48:59.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-12-19T17:48:59.196 INFO:teuthology.orchestra.run.smithi073.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-12-19T17:48:59.212 INFO:teuthology.orchestra.run.smithi073.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-12-19T17:48:59.213 INFO:teuthology.orchestra.run.smithi073.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-12-19T17:48:59.222 INFO:teuthology.orchestra.run.smithi073.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.17-0ubuntu0.20.04.1 [116 kB] 2023-12-19T17:48:59.224 INFO:teuthology.orchestra.run.smithi073.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-12-19T17:48:59.232 INFO:teuthology.orchestra.run.smithi073.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-12-19T17:48:59.232 INFO:teuthology.orchestra.run.smithi073.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-12-19T17:48:59.249 INFO:teuthology.orchestra.run.smithi073.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-12-19T17:48:59.249 INFO:teuthology.orchestra.run.smithi073.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-12-19T17:48:59.258 INFO:teuthology.orchestra.run.smithi073.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-12-19T17:48:59.271 INFO:teuthology.orchestra.run.smithi073.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-12-19T17:48:59.295 INFO:teuthology.orchestra.run.smithi073.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-12-19T17:48:59.298 INFO:teuthology.orchestra.run.smithi073.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-12-19T17:48:59.302 INFO:teuthology.orchestra.run.smithi073.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-12-19T17:48:59.302 INFO:teuthology.orchestra.run.smithi073.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-12-19T17:48:59.302 INFO:teuthology.orchestra.run.smithi073.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.17-0ubuntu0.20.04.1 [1,053 kB] 2023-12-19T17:48:59.317 INFO:teuthology.orchestra.run.smithi073.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-12-19T17:48:59.320 INFO:teuthology.orchestra.run.smithi073.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.17-0ubuntu0.20.04.1 [13.5 MB] 2023-12-19T17:48:59.488 INFO:teuthology.orchestra.run.smithi073.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-12-19T17:48:59.488 INFO:teuthology.orchestra.run.smithi073.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-12-19T17:48:59.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-12-19T17:48:59.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-12-19T17:48:59.489 INFO:teuthology.orchestra.run.smithi073.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-12-19T17:48:59.817 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mds (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:00.048 INFO:teuthology.orchestra.run.smithi073.stdout:Preconfiguring packages ... 2023-12-19T17:49:00.108 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T17:49:00.108 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-19T17:49:00.283 INFO:teuthology.orchestra.run.smithi073.stdout:Fetched 25.3 MB in 1s (44.0 MB/s) 2023-12-19T17:49:00.977 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:01.014 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118810 files and directories currently installed.) 2023-12-19T17:49:01.017 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-19T17:49:01.205 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-19T17:49:01.282 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T17:49:01.282 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-19T17:49:02.127 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-osd (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:02.895 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-12-19T17:49:02.924 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T17:49:02.924 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-19T17:49:03.813 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-k8sevents (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:03.939 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-diskprediction-local (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:04.082 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mon (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:04.382 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T17:49:04.382 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-19T17:49:04.920 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118810 files and directories currently installed.) 2023-12-19T17:49:04.924 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-19T17:49:05.103 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-19T17:49:05.232 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-cephadm (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:05.434 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:05.559 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-mgr-dashboard (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:05.581 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-19T17:49:05.727 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ceph-volume (18.2.1-132-g568df92b-1focal) ... 2023-12-19T17:49:05.751 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-19T17:49:06.197 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-19T17:49:06.320 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-19T17:49:06.356 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-19T17:49:06.845 INFO:teuthology.orchestra.run.smithi073.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118810 files and directories currently installed.) 2023-12-19T17:49:06.848 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-19T17:49:06.874 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-19T17:49:07.011 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-19T17:49:07.527 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-19T17:49:07.658 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-19T17:49:08.194 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-19T17:49:08.321 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-12-19T17:49:08.892 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T17:49:08.912 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-12-19T17:49:08.950 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-12-19T17:49:09.320 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package dump. 2023-12-19T17:49:09.341 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-12-19T17:49:09.395 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking dump (0.4b46-6) ... 2023-12-19T17:49:09.724 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package indent. 2023-12-19T17:49:09.745 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:09.815 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-19T17:49:10.168 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T17:49:10.189 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-12-19T17:49:10.226 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-12-19T17:49:10.639 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T17:49:10.661 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2023-12-19T17:49:10.729 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-19T17:49:11.025 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T17:49:11.043 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-19T17:49:11.083 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:49:11.588 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T17:49:11.609 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:11.654 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:49:11.991 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T17:49:12.014 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:12.057 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:49:12.297 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-12-19T17:49:12.444 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T17:49:12.465 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:12.510 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:12.905 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T17:49:12.923 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-12-19T17:49:12.963 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-19T17:49:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T17:49:13.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-19T17:49:13.198 INFO:teuthology.orchestra.run.smithi045.stdout:Reading package lists... 2023-12-19T17:49:13.366 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T17:49:13.390 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-19T17:49:13.418 INFO:teuthology.orchestra.run.smithi045.stdout:Building dependency tree... 2023-12-19T17:49:13.419 INFO:teuthology.orchestra.run.smithi045.stdout:Reading state information... 2023-12-19T17:49:13.432 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:13.640 INFO:teuthology.orchestra.run.smithi045.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2023-12-19T17:49:13.640 INFO:teuthology.orchestra.run.smithi045.stdout:flex is already the newest version (2.6.4-6.2). 2023-12-19T17:49:13.640 INFO:teuthology.orchestra.run.smithi045.stdout:iproute2 is already the newest version (5.5.0-1ubuntu1). 2023-12-19T17:49:13.640 INFO:teuthology.orchestra.run.smithi045.stdout:libtool-bin is already the newest version (2.4.6-14). 2023-12-19T17:49:13.640 INFO:teuthology.orchestra.run.smithi045.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2023-12-19T17:49:13.640 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages were automatically installed and are no longer required: 2023-12-19T17:49:13.641 INFO:teuthology.orchestra.run.smithi045.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-12-19T17:49:13.641 INFO:teuthology.orchestra.run.smithi045.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-19T17:49:13.641 INFO:teuthology.orchestra.run.smithi045.stdout:The following additional packages will be installed: 2023-12-19T17:49:13.642 INFO:teuthology.orchestra.run.smithi045.stdout: libbluetooth3 libdw1 libelf1 liblzo2-2 libmbim-glib4 libmbim-proxy 2023-12-19T17:49:13.642 INFO:teuthology.orchestra.run.smithi045.stdout: libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl1.1 2023-12-19T17:49:13.642 INFO:teuthology.orchestra.run.smithi045.stdout: libteamdctl0 libuuid1 modemmanager network-manager-pptp postgresql-12 2023-12-19T17:49:13.642 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-client-12 postgresql-client-common ppp pptp-linux usb-modeswitch 2023-12-19T17:49:13.642 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch-data wpasupplicant 2023-12-19T17:49:13.644 INFO:teuthology.orchestra.run.smithi045.stdout:Suggested packages: 2023-12-19T17:49:13.644 INFO:teuthology.orchestra.run.smithi045.stdout: indent-doc libssl-doc avahi-autoipd libteam-utils postgresql-doc 2023-12-19T17:49:13.644 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-doc-12 libjson-perl comgt wvdial util-linux-locales wpagui 2023-12-19T17:49:13.644 INFO:teuthology.orchestra.run.smithi045.stdout: libengine-pkcs11-openssl 2023-12-19T17:49:13.752 INFO:teuthology.orchestra.run.smithi045.stdout:The following NEW packages will be installed: 2023-12-19T17:49:13.752 INFO:teuthology.orchestra.run.smithi045.stdout: dump indent libaio-dev libbluetooth3 libelf-dev liblzo2-2 libmbim-glib4 2023-12-19T17:49:13.753 INFO:teuthology.orchestra.run.smithi045.stdout: libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy 2023-12-19T17:49:13.753 INFO:teuthology.orchestra.run.smithi045.stdout: libssl-dev libteamdctl0 modemmanager network-manager network-manager-pptp 2023-12-19T17:49:13.753 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql postgresql-12 postgresql-client postgresql-client-12 2023-12-19T17:49:13.753 INFO:teuthology.orchestra.run.smithi045.stdout: postgresql-client-common postgresql-common postgresql-contrib ppp pptp-linux 2023-12-19T17:49:13.754 INFO:teuthology.orchestra.run.smithi045.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-19T17:49:13.754 INFO:teuthology.orchestra.run.smithi045.stdout:The following packages will be upgraded: 2023-12-19T17:49:13.755 INFO:teuthology.orchestra.run.smithi045.stdout: libdw1 libelf1 libssl1.1 libuuid1 util-linux uuid-dev 2023-12-19T17:49:13.886 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T17:49:13.910 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../14-libpq5_12.17-0ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:13.952 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libpq5:amd64 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:13.952 INFO:teuthology.orchestra.run.smithi045.stdout:6 upgraded, 31 newly installed, 0 to remove and 256 not upgraded. 2023-12-19T17:49:13.952 INFO:teuthology.orchestra.run.smithi045.stdout:Need to get 25.3 MB of archives. 2023-12-19T17:49:13.953 INFO:teuthology.orchestra.run.smithi045.stdout:After this operation, 79.9 MB of additional disk space will be used. 2023-12-19T17:49:13.953 INFO:teuthology.orchestra.run.smithi045.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 util-linux amd64 2.34-0.1ubuntu9.4 [1,021 kB] 2023-12-19T17:49:14.372 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T17:49:14.393 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:14.438 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:49:14.606 INFO:teuthology.orchestra.run.smithi045.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.4 [33.6 kB] 2023-12-19T17:49:14.608 INFO:teuthology.orchestra.run.smithi045.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.4 [20.0 kB] 2023-12-19T17:49:14.610 INFO:teuthology.orchestra.run.smithi045.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2023-12-19T17:49:14.622 INFO:teuthology.orchestra.run.smithi045.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2023-12-19T17:49:14.625 INFO:teuthology.orchestra.run.smithi045.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.20 [1,321 kB] 2023-12-19T17:49:14.725 INFO:teuthology.orchestra.run.smithi045.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 liblzo2-2 amd64 2.10-2 [50.8 kB] 2023-12-19T17:49:14.726 INFO:teuthology.orchestra.run.smithi045.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 dump amd64 0.4b46-6 [130 kB] 2023-12-19T17:49:14.733 INFO:teuthology.orchestra.run.smithi045.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 indent amd64 2.2.12-1ubuntu0.20.04.1 [86.6 kB] 2023-12-19T17:49:14.739 INFO:teuthology.orchestra.run.smithi045.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2023-12-19T17:49:14.739 INFO:teuthology.orchestra.run.smithi045.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libbluetooth3 amd64 5.53-0ubuntu3.7 [60.7 kB] 2023-12-19T17:49:14.825 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T17:49:14.846 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:14.891 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:49:14.907 INFO:teuthology.orchestra.run.smithi045.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2023-12-19T17:49:15.180 INFO:teuthology.orchestra.run.smithi045.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-glib4 amd64 1.26.2-1~ubuntu20.04.1 [123 kB] 2023-12-19T17:49:15.185 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T17:49:15.205 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-19T17:49:15.243 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-19T17:49:15.320 INFO:teuthology.orchestra.run.smithi045.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmbim-proxy amd64 1.26.2-1~ubuntu20.04.1 [6,012 B] 2023-12-19T17:49:15.325 INFO:teuthology.orchestra.run.smithi045.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libmm-glib0 amd64 1.18.6-1~ubuntu20.04.1 [203 kB] 2023-12-19T17:49:15.428 INFO:teuthology.orchestra.run.smithi045.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 libndp0 amd64 1.7-0ubuntu1 [10.9 kB] 2023-12-19T17:49:15.432 INFO:teuthology.orchestra.run.smithi045.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libnm0 amd64 1.22.10-1ubuntu2.3 [370 kB] 2023-12-19T17:49:15.512 INFO:teuthology.orchestra.run.smithi045.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpq5 amd64 12.17-0ubuntu0.20.04.1 [116 kB] 2023-12-19T17:49:15.529 INFO:teuthology.orchestra.run.smithi045.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-glib5 amd64 1.30.4-1~ubuntu20.04.1 [642 kB] 2023-12-19T17:49:15.596 INFO:teuthology.orchestra.run.smithi045.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libqmi-proxy amd64 1.30.4-1~ubuntu20.04.1 [5,908 B] 2023-12-19T17:49:15.597 INFO:teuthology.orchestra.run.smithi045.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.20 [1,584 kB] 2023-12-19T17:49:15.682 INFO:teuthology.orchestra.run.smithi045.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 libteamdctl0 amd64 1.30-1 [11.8 kB] 2023-12-19T17:49:15.831 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T17:49:15.845 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-12-19T17:49:15.846 INFO:teuthology.orchestra.run.smithi045.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 modemmanager amd64 1.18.6-1~ubuntu20.04.1 [895 kB] 2023-12-19T17:49:15.928 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-12-19T17:49:16.351 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package modemmanager. 2023-12-19T17:49:16.373 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:16.452 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:16.479 INFO:teuthology.orchestra.run.smithi045.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 wpasupplicant amd64 2:2.9-1ubuntu4.3 [1,183 kB] 2023-12-19T17:49:16.579 INFO:teuthology.orchestra.run.smithi045.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 network-manager amd64 1.22.10-1ubuntu2.3 [1,855 kB] 2023-12-19T17:49:16.668 INFO:teuthology.orchestra.run.smithi045.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 ppp amd64 2.4.7-2+4.1ubuntu5.1 [328 kB] 2023-12-19T17:49:16.677 INFO:teuthology.orchestra.run.smithi045.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 pptp-linux amd64 1.10.0-1build1 [42.0 kB] 2023-12-19T17:49:16.678 INFO:teuthology.orchestra.run.smithi045.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 network-manager-pptp amd64 1.2.8-2 [30.1 kB] 2023-12-19T17:49:16.679 INFO:teuthology.orchestra.run.smithi045.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-common all 214ubuntu0.1 [28.2 kB] 2023-12-19T17:49:16.680 INFO:teuthology.orchestra.run.smithi045.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client-12 amd64 12.17-0ubuntu0.20.04.1 [1,053 kB] 2023-12-19T17:49:16.713 INFO:teuthology.orchestra.run.smithi045.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-common all 214ubuntu0.1 [169 kB] 2023-12-19T17:49:16.717 INFO:teuthology.orchestra.run.smithi045.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-12 amd64 12.17-0ubuntu0.20.04.1 [13.5 MB] 2023-12-19T17:49:17.091 INFO:teuthology.orchestra.run.smithi045.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql all 12+214ubuntu0.1 [3,924 B] 2023-12-19T17:49:17.132 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T17:49:17.151 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-12-19T17:49:17.190 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-19T17:49:17.256 INFO:teuthology.orchestra.run.smithi045.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-client all 12+214ubuntu0.1 [3,940 B] 2023-12-19T17:49:17.339 INFO:teuthology.orchestra.run.smithi045.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 postgresql-contrib all 12+214ubuntu0.1 [3,932 B] 2023-12-19T17:49:17.339 INFO:teuthology.orchestra.run.smithi045.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch-data all 20191128-3 [32.3 kB] 2023-12-19T17:49:17.455 INFO:teuthology.orchestra.run.smithi045.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 usb-modeswitch amd64 2.5.2+repack0-2ubuntu3 [53.1 kB] 2023-12-19T17:49:17.771 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager. 2023-12-19T17:49:17.790 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-19T17:49:17.876 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:18.135 INFO:teuthology.orchestra.run.smithi045.stdout:Preconfiguring packages ... 2023-12-19T17:49:18.381 INFO:teuthology.orchestra.run.smithi045.stdout:Fetched 25.3 MB in 4s (6,687 kB/s) 2023-12-19T17:49:18.711 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package ppp. 2023-12-19T17:49:18.733 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-12-19T17:49:18.764 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118810 files and directories currently installed.) 2023-12-19T17:49:18.768 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../util-linux_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-19T17:49:18.976 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking util-linux (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-19T17:49:19.211 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-19T17:49:19.650 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T17:49:19.670 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-12-19T17:49:19.708 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-12-19T17:49:20.154 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T17:49:20.175 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-12-19T17:49:20.258 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-12-19T17:49:20.615 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T17:49:20.616 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up util-linux (2.34-0.1ubuntu9.4) ... 2023-12-19T17:49:20.635 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-12-19T17:49:20.673 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-12-19T17:49:21.061 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client-12. 2023-12-19T17:49:21.082 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../26-postgresql-client-12_12.17-0ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:21.127 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:21.816 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T17:49:21.838 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-12-19T17:49:21.916 INFO:teuthology.orchestra.run.smithi073.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T17:49:21.943 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-12-19T17:49:22.482 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-12. 2023-12-19T17:49:22.502 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../28-postgresql-12_12.17-0ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:22.547 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:22.691 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118810 files and directories currently installed.) 2023-12-19T17:49:22.697 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-19T17:49:22.827 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-19T17:49:23.351 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.4_amd64.deb ... 2023-12-19T17:49:23.751 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.4) over (2.34-0.1ubuntu9.3) ... 2023-12-19T17:49:24.144 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql. 2023-12-19T17:49:24.157 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-19T17:49:24.166 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-12-19T17:49:24.210 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-12-19T17:49:24.512 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T17:49:24.534 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-12-19T17:49:24.570 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-12-19T17:49:24.653 INFO:teuthology.orchestra.run.smithi045.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 118810 files and directories currently installed.) 2023-12-19T17:49:24.656 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../00-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-19T17:49:24.817 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-19T17:49:24.883 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T17:49:24.905 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-12-19T17:49:24.950 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-12-19T17:49:25.252 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T17:49:25.275 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-12-19T17:49:25.318 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-12-19T17:49:25.344 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../01-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-19T17:49:25.522 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2023-12-19T17:49:25.738 INFO:teuthology.orchestra.run.smithi073.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T17:49:25.758 INFO:teuthology.orchestra.run.smithi073.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-12-19T17:49:25.819 INFO:teuthology.orchestra.run.smithi073.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-19T17:49:26.081 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../02-libssl1.1_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-19T17:49:26.170 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-12-19T17:49:26.235 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.20) over (1.1.1f-1ubuntu2.16) ... 2023-12-19T17:49:26.452 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-19T17:49:26.806 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-19T17:49:26.828 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../03-liblzo2-2_2.10-2_amd64.deb ... 2023-12-19T17:49:26.829 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libpq5:amd64 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:26.872 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking liblzo2-2:amd64 (2.10-2) ... 2023-12-19T17:49:26.963 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-12-19T17:49:27.089 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-12-19T17:49:27.240 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-19T17:49:27.283 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package dump. 2023-12-19T17:49:27.305 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../04-dump_0.4b46-6_amd64.deb ... 2023-12-19T17:49:27.391 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking dump (0.4b46-6) ... 2023-12-19T17:49:27.678 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T17:49:27.678 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T17:49:27.753 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package indent. 2023-12-19T17:49:27.774 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../05-indent_2.2.12-1ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:27.811 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-19T17:49:28.173 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-19T17:49:28.195 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../06-libaio-dev_0.3.112-5_amd64.deb ... 2023-12-19T17:49:28.239 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2023-12-19T17:49:28.593 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-19T17:49:28.610 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:28.615 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../07-libbluetooth3_5.53-0ubuntu3.7_amd64.deb ... 2023-12-19T17:49:28.667 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-19T17:49:28.987 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-19T17:49:29.009 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../08-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2023-12-19T17:49:29.053 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:49:29.439 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-19T17:49:29.453 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../09-libmbim-glib4_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:29.497 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:49:29.808 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-19T17:49:29.822 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../10-libmbim-proxy_1.26.2-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:29.866 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:49:30.278 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-19T17:49:30.298 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../11-libmm-glib0_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:30.335 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:30.725 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T17:49:30.788 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-19T17:49:30.812 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../12-libndp0_1.7-0ubuntu1_amd64.deb ... 2023-12-19T17:49:30.840 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-19T17:49:30.855 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-19T17:49:30.991 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-12-19T17:49:31.117 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-12-19T17:49:31.275 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-19T17:49:31.297 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../13-libnm0_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-19T17:49:31.341 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:31.794 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-19T17:49:31.808 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../14-libpq5_12.17-0ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:31.851 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libpq5:amd64 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:32.288 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-19T17:49:32.309 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../15-libqmi-glib5_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:32.354 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:49:32.724 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-19T17:49:32.742 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../16-libqmi-proxy_1.30.4-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:32.782 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:49:33.093 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-19T17:49:33.116 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../17-libssl-dev_1.1.1f-1ubuntu2.20_amd64.deb ... 2023-12-19T17:49:33.138 INFO:teuthology.orchestra.run.smithi073.stdout:Adding user postgres to group ssl-cert 2023-12-19T17:49:33.159 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-19T17:49:33.490 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:33.491 INFO:teuthology.orchestra.run.smithi073.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T17:49:33.755 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-19T17:49:33.777 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../18-libteamdctl0_1.30-1_amd64.deb ... 2023-12-19T17:49:33.820 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking libteamdctl0:amd64 (1.30-1) ... 2023-12-19T17:49:33.968 INFO:teuthology.orchestra.run.smithi073.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T17:49:33.969 INFO:teuthology.orchestra.run.smithi073.stdout:Removing obsolete dictionary files: 2023-12-19T17:49:34.240 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package modemmanager. 2023-12-19T17:49:34.263 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../19-modemmanager_1.18.6-1~ubuntu20.04.1_amd64.deb ... 2023-12-19T17:49:34.331 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:34.552 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T17:49:35.038 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package wpasupplicant. 2023-12-19T17:49:35.060 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../20-wpasupplicant_2%3a2.9-1ubuntu4.3_amd64.deb ... 2023-12-19T17:49:35.129 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-19T17:49:35.734 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager. 2023-12-19T17:49:35.756 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../21-network-manager_1.22.10-1ubuntu2.3_amd64.deb ... 2023-12-19T17:49:35.846 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:36.027 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-19T17:49:36.153 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-12-19T17:49:36.279 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:36.434 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-19T17:49:36.699 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package ppp. 2023-12-19T17:49:36.722 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../22-ppp_2.4.7-2+4.1ubuntu5.1_amd64.deb ... 2023-12-19T17:49:37.207 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-19T17:49:37.662 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package pptp-linux. 2023-12-19T17:49:37.681 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../23-pptp-linux_1.10.0-1build1_amd64.deb ... 2023-12-19T17:49:37.686 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-12-19T17:49:37.743 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking pptp-linux (1.10.0-1build1) ... 2023-12-19T17:49:38.127 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up dump (0.4b46-6) ... 2023-12-19T17:49:38.173 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-19T17:49:38.193 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../24-network-manager-pptp_1.2.8-2_amd64.deb ... 2023-12-19T17:49:38.235 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T17:49:38.273 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking network-manager-pptp (1.2.8-2) ... 2023-12-19T17:49:38.312 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:38.438 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-19T17:49:38.564 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-19T17:49:38.660 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-19T17:49:38.682 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../25-postgresql-client-common_214ubuntu0.1_all.deb ... 2023-12-19T17:49:38.724 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-19T17:49:38.726 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-common (214ubuntu0.1) ... 2023-12-19T17:49:38.908 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-19T17:49:39.034 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:39.098 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client-12. 2023-12-19T17:49:39.118 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../26-postgresql-client-12_12.17-0ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:39.163 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:39.560 INFO:teuthology.orchestra.run.smithi073.stdout:Creating new PostgreSQL cluster 12/main ... 2023-12-19T17:49:39.597 INFO:teuthology.orchestra.run.smithi073.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-12-19T17:49:39.673 INFO:teuthology.orchestra.run.smithi073.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T17:49:39.673 INFO:teuthology.orchestra.run.smithi073.stdout:This user must also own the server process. 2023-12-19T17:49:39.673 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:39.673 INFO:teuthology.orchestra.run.smithi073.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T17:49:39.673 INFO:teuthology.orchestra.run.smithi073.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T17:49:39.674 INFO:teuthology.orchestra.run.smithi073.stdout:The default text search configuration will be set to "english". 2023-12-19T17:49:39.674 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:39.674 INFO:teuthology.orchestra.run.smithi073.stdout:Data page checksums are disabled. 2023-12-19T17:49:39.674 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:39.674 INFO:teuthology.orchestra.run.smithi073.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-12-19T17:49:39.677 INFO:teuthology.orchestra.run.smithi073.stdout:creating subdirectories ... ok 2023-12-19T17:49:39.677 INFO:teuthology.orchestra.run.smithi073.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T17:49:39.712 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default max_connections ... 100 2023-12-19T17:49:39.757 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default shared_buffers ... 128MB 2023-12-19T17:49:39.782 INFO:teuthology.orchestra.run.smithi073.stdout:selecting default time zone ... Etc/UTC 2023-12-19T17:49:39.782 INFO:teuthology.orchestra.run.smithi073.stdout:creating configuration files ... ok 2023-12-19T17:49:39.843 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-common. 2023-12-19T17:49:39.862 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../27-postgresql-common_214ubuntu0.1_all.deb ... 2023-12-19T17:49:39.936 INFO:teuthology.orchestra.run.smithi045.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-19T17:49:39.962 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-common (214ubuntu0.1) ... 2023-12-19T17:49:39.965 INFO:teuthology.orchestra.run.smithi073.stdout:running bootstrap script ... ok 2023-12-19T17:49:40.524 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-12. 2023-12-19T17:49:40.545 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../28-postgresql-12_12.17-0ubuntu0.20.04.1_amd64.deb ... 2023-12-19T17:49:40.586 INFO:teuthology.orchestra.run.smithi073.stdout:performing post-bootstrap initialization ... ok 2023-12-19T17:49:40.598 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:syncing data to disk ... ok 2023-12-19T17:49:41.146 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:41.146 INFO:teuthology.orchestra.run.smithi073.stdout:Success. You can now start the database server using: 2023-12-19T17:49:41.146 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:41.146 INFO:teuthology.orchestra.run.smithi073.stdout: pg_ctlcluster 12 main start 2023-12-19T17:49:41.146 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:41.690 INFO:teuthology.orchestra.run.smithi073.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-12-19T17:49:41.690 INFO:teuthology.orchestra.run.smithi073.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-12-19T17:49:41.878 INFO:teuthology.orchestra.run.smithi073.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T17:49:42.284 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql. 2023-12-19T17:49:42.309 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../29-postgresql_12+214ubuntu0.1_all.deb ... 2023-12-19T17:49:42.351 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql (12+214ubuntu0.1) ... 2023-12-19T17:49:42.653 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-client. 2023-12-19T17:49:42.676 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../30-postgresql-client_12+214ubuntu0.1_all.deb ... 2023-12-19T17:49:42.720 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-client (12+214ubuntu0.1) ... 2023-12-19T17:49:43.030 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-19T17:49:43.050 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../31-postgresql-contrib_12+214ubuntu0.1_all.deb ... 2023-12-19T17:49:43.088 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking postgresql-contrib (12+214ubuntu0.1) ... 2023-12-19T17:49:43.407 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-19T17:49:43.427 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../32-usb-modeswitch-data_20191128-3_all.deb ... 2023-12-19T17:49:43.465 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch-data (20191128-3) ... 2023-12-19T17:49:43.927 INFO:teuthology.orchestra.run.smithi045.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-19T17:49:43.949 INFO:teuthology.orchestra.run.smithi045.stdout:Preparing to unpack .../33-usb-modeswitch_2.5.2+repack0-2ubuntu3_amd64.deb ... 2023-12-19T17:49:44.017 INFO:teuthology.orchestra.run.smithi045.stdout:Unpacking usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-19T17:49:45.133 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-common (214ubuntu0.1) ... 2023-12-19T17:49:45.382 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-19T17:49:45.525 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:49:45.659 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:49:45.775 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libpq5:amd64 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:45.819 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-12-19T17:49:45.901 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up liblzo2-2:amd64 (2.10-2) ... 2023-12-19T17:49:45.987 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:49:46.052 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2023-12-19T17:49:46.113 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-12-19T17:49:46.170 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up wpasupplicant (2:2.9-1ubuntu4.3) ... 2023-12-19T17:49:46.264 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:46.643 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T17:49:46.643 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-19T17:49:47.486 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:47.487 INFO:teuthology.orchestra.run.smithi073.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T17:49:47.487 INFO:teuthology.orchestra.run.smithi073.stdout:which means they are currently configured by ifupdown: 2023-12-19T17:49:47.487 INFO:teuthology.orchestra.run.smithi073.stdout:- enp3s0f1 2023-12-19T17:49:47.487 INFO:teuthology.orchestra.run.smithi073.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T17:49:47.487 INFO:teuthology.orchestra.run.smithi073.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T17:49:47.487 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:49:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:47.736 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T17:49:48.321 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T17:49:49.271 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T17:49:49.780 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-19T17:49:49.903 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.4) ... 2023-12-19T17:49:50.028 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libteamdctl0:amd64 (1.30-1) ... 2023-12-19T17:49:50.154 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-common (214ubuntu0.1) ... 2023-12-19T17:49:50.258 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:49:50.409 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-12-19T17:49:50.578 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:49:50.704 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-12-19T17:49:50.829 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-12-19T17:49:50.980 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:49:51.115 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:49:51.241 INFO:teuthology.orchestra.run.smithi073.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:51.494 INFO:teuthology.orchestra.run.smithi045.stdout:Adding user postgres to group ssl-cert 2023-12-19T17:49:51.576 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T17:49:51.576 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T17:49:51.911 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:49:51.912 INFO:teuthology.orchestra.run.smithi045.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-19T17:49:52.431 INFO:teuthology.orchestra.run.smithi045.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-19T17:49:52.431 INFO:teuthology.orchestra.run.smithi045.stdout:Removing obsolete dictionary files: 2023-12-19T17:49:52.568 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-19T17:49:52.669 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T17:49:52.829 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-19T17:49:52.989 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-19T17:49:53.023 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-19T17:49:53.515 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-19T17:49:54.472 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.20) ... 2023-12-19T17:49:54.598 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch-data (20191128-3) ... 2023-12-19T17:49:54.766 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libnm0:amd64 (1.22.10-1ubuntu2.3) ... 2023-12-19T17:49:54.891 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up ppp (2.4.7-2+4.1ubuntu5.1) ... 2023-12-19T17:49:56.220 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/pppd-dns.service -> /lib/systemd/system/pppd-dns.service. 2023-12-19T17:49:56.674 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up dump (0.4b46-6) ... 2023-12-19T17:49:56.783 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-19T17:49:56.850 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmm-glib0:amd64 (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:49:57.001 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libbluetooth3:amd64 (5.53-0ubuntu3.7) ... 2023-12-19T17:49:57.127 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up indent (2.2.12-1ubuntu0.20.04.1) ... 2023-12-19T17:49:57.278 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up usb-modeswitch (2.5.2+repack0-2ubuntu3) ... 2023-12-19T17:49:57.471 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libndp0:amd64 (1.7-0ubuntu1) ... 2023-12-19T17:49:57.638 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-12 (12.17-0ubuntu0.20.04.1) ... 2023-12-19T17:49:58.178 INFO:teuthology.orchestra.run.smithi045.stdout:Creating new PostgreSQL cluster 12/main ... 2023-12-19T17:49:58.220 INFO:teuthology.orchestra.run.smithi045.stdout:/usr/lib/postgresql/12/bin/initdb -D /var/lib/postgresql/12/main --auth-local peer --auth-host md5 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:This user must also own the server process. 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:The database cluster will be initialized with locale "en_US". 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:The default text search configuration will be set to "english". 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:Data page checksums are disabled. 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:49:58.298 INFO:teuthology.orchestra.run.smithi045.stdout:fixing permissions on existing directory /var/lib/postgresql/12/main ... ok 2023-12-19T17:49:58.302 INFO:teuthology.orchestra.run.smithi045.stdout:creating subdirectories ... ok 2023-12-19T17:49:58.302 INFO:teuthology.orchestra.run.smithi045.stdout:selecting dynamic shared memory implementation ... posix 2023-12-19T17:49:58.339 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default max_connections ... 100 2023-12-19T17:49:58.387 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default shared_buffers ... 128MB 2023-12-19T17:49:58.413 INFO:teuthology.orchestra.run.smithi045.stdout:selecting default time zone ... Etc/UTC 2023-12-19T17:49:58.414 INFO:teuthology.orchestra.run.smithi045.stdout:creating configuration files ... ok 2023-12-19T17:49:58.604 INFO:teuthology.orchestra.run.smithi045.stdout:running bootstrap script ... ok 2023-12-19T17:49:59.228 INFO:teuthology.orchestra.run.smithi045.stdout:performing post-bootstrap initialization ... ok 2023-12-19T17:49:59.752 INFO:teuthology.orchestra.run.smithi045.stdout:syncing data to disk ... ok 2023-12-19T17:49:59.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:49:59.752 INFO:teuthology.orchestra.run.smithi045.stdout:Success. You can now start the database server using: 2023-12-19T17:49:59.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:49:59.752 INFO:teuthology.orchestra.run.smithi045.stdout: pg_ctlcluster 12 main start 2023-12-19T17:49:59.752 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:00.327 INFO:teuthology.orchestra.run.smithi045.stdout:Ver Cluster Port Status Owner Data directory Log file 2023-12-19T17:50:00.327 INFO:teuthology.orchestra.run.smithi045.stdout:12 main 5432 down postgres /var/lib/postgresql/12/main /var/log/postgresql/postgresql-12-main.log 2023-12-19T17:50:00.534 INFO:teuthology.orchestra.run.smithi045.stdout:update-alternatives: using /usr/share/postgresql/12/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-19T17:50:04.221 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:50:04.380 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-glib4:amd64 (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:50:04.506 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up pptp-linux (1.10.0-1build1) ... 2023-12-19T17:50:04.707 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:50:04.833 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-client (12+214ubuntu0.1) ... 2023-12-19T17:50:05.059 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager (1.22.10-1ubuntu2.3) ... 2023-12-19T17:50:06.257 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:06.257 INFO:teuthology.orchestra.run.smithi045.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-19T17:50:06.257 INFO:teuthology.orchestra.run.smithi045.stdout:which means they are currently configured by ifupdown: 2023-12-19T17:50:06.258 INFO:teuthology.orchestra.run.smithi045.stdout:- ens1f0 2023-12-19T17:50:06.258 INFO:teuthology.orchestra.run.smithi045.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-19T17:50:06.258 INFO:teuthology.orchestra.run.smithi045.stdout:remove their configuration from /etc/network/interfaces. 2023-12-19T17:50:06.258 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:06.501 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-19T17:50:07.074 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-19T17:50:07.252 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-19T17:50:07.360 INFO:teuthology.orchestra.run.smithi073.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-19T17:50:08.034 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-19T17:50:08.567 INFO:teuthology.orchestra.run.smithi073.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T17:50:08.576 DEBUG:teuthology.parallel:result is None 2023-12-19T17:50:08.937 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libmbim-proxy (1.26.2-1~ubuntu20.04.1) ... 2023-12-19T17:50:09.105 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up network-manager-pptp (1.2.8-2) ... 2023-12-19T17:50:09.273 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2023-12-19T17:50:09.398 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql-contrib (12+214ubuntu0.1) ... 2023-12-19T17:50:09.549 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up postgresql (12+214ubuntu0.1) ... 2023-12-19T17:50:09.675 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-glib5:amd64 (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:50:09.834 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up libqmi-proxy (1.30.4-1~ubuntu20.04.1) ... 2023-12-19T17:50:09.960 INFO:teuthology.orchestra.run.smithi045.stdout:Setting up modemmanager (1.18.6-1~ubuntu20.04.1) ... 2023-12-19T17:50:10.287 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T17:50:10.287 INFO:teuthology.orchestra.run.smithi045.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-19T17:50:11.363 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for mime-support (3.64ubuntu1) ... 2023-12-19T17:50:11.481 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-19T17:50:11.615 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-12-19T17:50:11.808 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-12-19T17:50:12.308 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-12-19T17:50:26.279 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for dbus (1.12.16-2ubuntu2.2) ... 2023-12-19T17:50:26.429 INFO:teuthology.orchestra.run.smithi045.stdout:Processing triggers for install-info (6.7.0.dfsg.2-5) ... 2023-12-19T17:50:27.673 INFO:teuthology.orchestra.run.smithi045.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-19T17:50:27.682 DEBUG:teuthology.parallel:result is None 2023-12-19T17:50:27.682 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T17:50:27.960 DEBUG:teuthology.orchestra.run.smithi045:> dpkg-query -W -f '${Version}' ceph 2023-12-19T17:50:28.001 INFO:teuthology.orchestra.run.smithi045.stdout:18.2.1-132-g568df92b-1focal 2023-12-19T17:50:28.002 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132-g568df92b-1focal 2023-12-19T17:50:28.002 INFO:teuthology.task.install:The correct ceph version 18.2.1-132-g568df92b-1focal is installed. 2023-12-19T17:50:28.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-19T17:50:28.234 DEBUG:teuthology.orchestra.run.smithi073:> dpkg-query -W -f '${Version}' ceph 2023-12-19T17:50:28.271 INFO:teuthology.orchestra.run.smithi073.stdout:18.2.1-132-g568df92b-1focal 2023-12-19T17:50:28.271 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132-g568df92b-1focal 2023-12-19T17:50:28.271 INFO:teuthology.task.install:The correct ceph version 18.2.1-132-g568df92b-1focal is installed. 2023-12-19T17:50:28.273 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-19T17:50:28.273 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:28.273 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T17:50:28.307 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:28.308 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-19T17:50:28.349 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-19T17:50:28.349 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:28.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T17:50:28.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T17:50:28.465 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:28.466 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2023-12-19T17:50:28.503 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-19T17:50:28.584 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-19T17:50:28.584 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:28.584 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T17:50:28.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T17:50:28.696 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:28.696 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-19T17:50:28.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-19T17:50:28.808 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-19T17:50:28.808 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:28.808 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T17:50:28.845 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T17:50:28.921 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:28.921 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2023-12-19T17:50:28.955 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-19T17:50:29.029 INFO:teuthology.run_tasks:Running task ceph... 2023-12-19T17:50:29.089 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-19T17:50:29.090 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 777 /var/log/ceph 2023-12-19T17:50:29.096 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /var/log/ceph 2023-12-19T17:50:29.132 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-19T17:50:29.132 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T17:50:29.173 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-19T17:50:29.210 INFO:tasks.ceph:Creating extra log directories... 2023-12-19T17:50:29.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T17:50:29.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-19T17:50:29.294 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-19T17:50:29.294 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-19T17:50:29.294 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-19T17:50:29.294 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:29.294 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T17:50:29.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:29.476 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:29.476 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-19T17:50:29.494 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:29.635 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-19T17:50:29.635 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-19T17:50:29.635 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7497202', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 430, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'sleep_before_teardown': 0, 'subset': '301/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi045.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi073.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'bad backtrace', 'object missing on disk', 'error reading table object', 'error reading sessionmap', 'unmatched fragstat', 'unmatched rstat', 'was unreadable, recreating it now', 'Scrub error on inode', 'Metadata damage detected', 'inconsistent rstat on inode', 'Error recovering journal'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_data_scan']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-19_13:22:41', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-19T17:50:29.636 DEBUG:teuthology.orchestra.run.smithi045:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T17:50:29.643 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-19T17:50:29.663 DEBUG:teuthology.orchestra.run.smithi045:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T17:50:29.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m0777 -- /var/run/ceph 2023-12-19T17:50:29.759 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:29.759 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T17:50:29.807 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T17:50:29.807 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_1 2023-12-19T17:50:29.870 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 495 Links: 1 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-19 17:44:30.861146735 +0000 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-19 17:44:30.369143322 +0000 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-19 17:44:30.369143322 +0000 2023-12-19T17:50:29.871 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-19T17:50:29.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T17:50:29.948 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-19T17:50:29.948 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-19T17:50:29.948 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000437488 s, 1.2 MB/s 2023-12-19T17:50:29.952 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T17:50:30.020 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_2 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 502 Links: 1 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-19 17:44:31.165148683 +0000 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-19 17:44:31.161148660 +0000 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-19 17:44:31.161148660 +0000 2023-12-19T17:50:30.085 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-19T17:50:30.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T17:50:30.166 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-19T17:50:30.166 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-19T17:50:30.166 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000590475 s, 867 kB/s 2023-12-19T17:50:30.166 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T17:50:30.233 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_3 2023-12-19T17:50:30.300 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 508 Links: 1 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-19 17:44:31.909153101 +0000 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-19 17:44:31.905153078 +0000 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-19 17:44:31.905153078 +0000 2023-12-19T17:50:30.301 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-19T17:50:30.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T17:50:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-19T17:50:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-19T17:50:30.376 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000401988 s, 1.3 MB/s 2023-12-19T17:50:30.378 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T17:50:30.448 DEBUG:teuthology.orchestra.run.smithi045:> stat /dev/vg_nvme/lv_4 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout:Device: 5h/5d Inode: 514 Links: 1 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout:Access: 2023-12-19 17:44:33.189158518 +0000 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout:Modify: 2023-12-19 17:44:32.685156346 +0000 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout:Change: 2023-12-19 17:44:32.685156346 +0000 2023-12-19T17:50:30.513 INFO:teuthology.orchestra.run.smithi045.stdout: Birth: - 2023-12-19T17:50:30.513 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T17:50:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records in 2023-12-19T17:50:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:1+0 records out 2023-12-19T17:50:30.588 INFO:teuthology.orchestra.run.smithi045.stderr:512 bytes copied, 0.000597338 s, 857 kB/s 2023-12-19T17:50:30.590 DEBUG:teuthology.orchestra.run.smithi045:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T17:50:30.661 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:30.661 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:30.662 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2023-12-19T17:50:30.678 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-19T17:50:30.678 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2023-12-19T17:50:30.742 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-19T17:50:30.742 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:30.742 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 496 Links: 1 2023-12-19T17:50:30.742 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:30.742 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 17:44:29.120260300 +0000 2023-12-19T17:50:30.742 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 17:44:29.116260349 +0000 2023-12-19T17:50:30.743 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 17:44:29.116260349 +0000 2023-12-19T17:50:30.743 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-12-19T17:50:30.743 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-19T17:50:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T17:50:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T17:50:30.819 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000705531 s, 726 kB/s 2023-12-19T17:50:30.821 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-19T17:50:30.889 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2023-12-19T17:50:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-19T17:50:30.958 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:30.958 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 501 Links: 1 2023-12-19T17:50:30.958 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:30.958 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 17:44:30.412244300 +0000 2023-12-19T17:50:30.959 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 17:44:29.920250648 +0000 2023-12-19T17:50:30.959 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 17:44:29.920250648 +0000 2023-12-19T17:50:30.959 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-12-19T17:50:30.959 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-19T17:50:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T17:50:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T17:50:31.033 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000686362 s, 746 kB/s 2023-12-19T17:50:31.035 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-19T17:50:31.100 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2023-12-19T17:50:31.164 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-19T17:50:31.164 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:31.165 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 508 Links: 1 2023-12-19T17:50:31.165 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:31.165 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 17:44:31.196234250 +0000 2023-12-19T17:50:31.165 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 17:44:30.708240432 +0000 2023-12-19T17:50:31.165 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 17:44:30.708240432 +0000 2023-12-19T17:50:31.165 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-12-19T17:50:31.165 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-19T17:50:31.239 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T17:50:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T17:50:31.240 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000620967 s, 825 kB/s 2023-12-19T17:50:31.242 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-19T17:50:31.310 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 512 Links: 1 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2023-12-19 17:44:31.964224983 +0000 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2023-12-19 17:44:31.500230581 +0000 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2023-12-19 17:44:31.500230581 +0000 2023-12-19T17:50:31.374 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: - 2023-12-19T17:50:31.375 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-19T17:50:31.449 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2023-12-19T17:50:31.449 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2023-12-19T17:50:31.450 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000570072 s, 898 kB/s 2023-12-19T17:50:31.451 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-19T17:50:31.516 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:31.516 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T17:50:31.517 INFO:tasks.ceph:Generating config... 2023-12-19T17:50:31.518 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-19T17:50:31.518 INFO:tasks.ceph:[client] debug client = 20 2023-12-19T17:50:31.518 INFO:tasks.ceph:[client] debug ms = 1 2023-12-19T17:50:31.518 INFO:tasks.ceph:[client] pid file = 2023-12-19T17:50:31.518 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-19T17:50:31.518 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-19T17:50:31.518 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-19T17:50:31.518 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-19T17:50:31.518 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-19T17:50:31.518 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-19T17:50:31.519 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-19T17:50:31.519 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-19T17:50:31.519 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-19T17:50:31.519 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-19T17:50:31.519 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-19T17:50:31.520 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-19T17:50:31.521 INFO:tasks.ceph:Setting up mon.a... 2023-12-19T17:50:31.521 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-19T17:50:31.596 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.keyring 2023-12-19T17:50:31.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-19T17:50:31.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T17:50:31.728 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.45'), ('mon.b', '172.21.15.73'), ('mon.c', '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]')] 2023-12-19T17:50:31.728 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-19T17:50:31.729 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:31.729 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T17:50:31.797 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.45 --add b 172.21.15.73 --addv c '[v2:172.21.15.73:3301,v1:172.21.15.73:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:31.912 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:31.912 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: generated fsid 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:50:31.912 INFO:teuthology.orchestra.run.smithi045.stdout:setting min_mon_release = pacific 2023-12-19T17:50:31.912 INFO:teuthology.orchestra.run.smithi045.stdout:epoch 0 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:fsid 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:last_changed 2023-12-19T17:50:31.912012+0000 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:created 2023-12-19T17:50:31.912012+0000 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:min_mon_release 16 (pacific) 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:election_strategy: 1 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:0: [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] mon.a 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.b 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:2: [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] mon.c 2023-12-19T17:50:31.913 INFO:teuthology.orchestra.run.smithi045.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-19T17:50:31.916 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-19T17:50:31.934 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4e717d5b-4367-4aa1-b211-e8194442f374... 2023-12-19T17:50:31.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:50:31.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:50:32.061 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T17:50:32.061 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T17:50:32.061 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:50:32.061 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.062 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T17:50:32.063 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T17:50:32.064 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T17:50:32.065 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T17:50:32.066 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T17:50:32.067 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T17:50:32.068 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:50:32.069 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T17:50:32.070 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = True 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:50:32.071 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T17:50:32.072 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.073 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.074 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T17:50:32.075 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T17:50:32.076 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T17:50:32.077 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:50:32.078 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:50:32.079 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T17:50:32.080 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T17:50:32.081 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:50:32.082 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T17:50:32.083 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = True 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:50:32.084 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:50:32.095 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-19T17:50:32.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-19T17:50:32.221 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-19T17:50:32.221 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:32.222 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-19T17:50:32.241 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:32.241 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-19T17:50:32.301 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:50:32.301 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:32.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T17:50:32.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T17:50:32.405 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:50:32.405 DEBUG:teuthology.orchestra.run.smithi045:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:32.469 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:50:32.469 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:32.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-19T17:50:32.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-19T17:50:32.532 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:50:32.532 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:32.590 INFO:tasks.ceph:Setting up mon nodes... 2023-12-19T17:50:32.591 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-19T17:50:32.591 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T17:50:32.694 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-19T17:50:32.702 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T17:50:32.797 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-19T17:50:32.818 INFO:tasks.ceph:Setting up mds nodes... 2023-12-19T17:50:32.818 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T17:50:32.925 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-19T17:50:32.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-19T17:50:32.966 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T17:50:33.105 INFO:teuthology.orchestra.run.smithi045.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-19T17:50:33.112 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-19T17:50:33.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T17:50:33.249 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-19T17:50:33.256 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-19T17:50:33.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T17:50:33.438 INFO:teuthology.orchestra.run.smithi073.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-19T17:50:33.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-19T17:50:33.478 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-19T17:50:33.479 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-19T17:50:33.559 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-19T17:50:33.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-19T17:50:33.668 INFO:teuthology.orchestra.run.smithi045.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-19T17:50:33.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-19T17:50:33.776 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-19T17:50:33.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-19T17:50:33.879 INFO:teuthology.orchestra.run.smithi073.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-19T17:50:33.916 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-19T17:50:33.917 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi045.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi073.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-19T17:50:33.917 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-19T17:50:33.955 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:33.956 INFO:tasks.ceph:role: osd.0 2023-12-19T17:50:33.956 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:50:33.956 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:34.068 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:34.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-19T17:50:34.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-19T17:50:34.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-19T17:50:34.183 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:34.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:34.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-19T17:50:34.265 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:34.265 INFO:tasks.ceph:role: osd.1 2023-12-19T17:50:34.265 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:50:34.265 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:34.377 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:34.378 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:34.378 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:34.378 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:34.382 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-19T17:50:34.382 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-19T17:50:34.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-19T17:50:34.491 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:34.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:34.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-19T17:50:34.573 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:34.573 INFO:tasks.ceph:role: osd.2 2023-12-19T17:50:34.573 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:50:34.573 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:34.688 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:34.689 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:34.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-19T17:50:34.692 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-19T17:50:34.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-19T17:50:34.801 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:34.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:34.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-19T17:50:34.883 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:34.883 INFO:tasks.ceph:role: osd.3 2023-12-19T17:50:34.884 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:50:34.884 DEBUG:teuthology.orchestra.run.smithi045:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout: = reflink=1 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:34.995 INFO:teuthology.orchestra.run.smithi045.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:34.996 INFO:teuthology.orchestra.run.smithi045.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:34.996 INFO:teuthology.orchestra.run.smithi045.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:35.001 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi045.front.sepia.ceph.com -o noatime 2023-12-19T17:50:35.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-19T17:50:35.043 DEBUG:teuthology.orchestra.run.smithi045:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-19T17:50:35.118 INFO:teuthology.orchestra.run.smithi045.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:35.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:35.119 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:35.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:35.299+0000 7f106ec58700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-19T17:50:35.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:35.299+0000 7f106ec58700 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-19T17:50:35.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:35.299+0000 7f106ec58700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T17:50:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:35.299+0000 7f106ec58700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T17:50:35.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:35.299+0000 7f106ec58700 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-19T17:50:35.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:35.303+0000 7f106ec58700 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-19T17:50:38.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-19T17:50:38.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:38.511+0000 7f3aa4a37700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-19T17:50:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:38.511+0000 7f3aa4a37700 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-19T17:50:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:38.511+0000 7f3aa4a37700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T17:50:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:38.511+0000 7f3aa4a37700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T17:50:38.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:38.511+0000 7f3aa4a37700 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-19T17:50:38.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:38.515+0000 7f3aa4a37700 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-19T17:50:41.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-19T17:50:41.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:41.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:41.767+0000 7ff7474e0700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-19T17:50:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:41.767+0000 7ff7474e0700 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-19T17:50:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:41.767+0000 7ff7474e0700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T17:50:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:41.767+0000 7ff7474e0700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T17:50:41.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:41.767+0000 7ff7474e0700 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-19T17:50:41.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:41.767+0000 7ff7474e0700 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-19T17:50:44.847 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-19T17:50:44.887 DEBUG:teuthology.orchestra.run.smithi045:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:45.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:45.019+0000 7f636a8b8700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-19T17:50:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:45.019+0000 7f636a8b8700 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-19T17:50:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:45.019+0000 7f636a8b8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T17:50:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:45.019+0000 7f636a8b8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T17:50:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:45.019+0000 7f636a8b8700 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-19T17:50:45.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:50:45.023+0000 7f636a8b8700 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-19T17:50:48.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-19T17:50:48.135 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-19T17:50:48.174 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:48.174 INFO:tasks.ceph:role: osd.4 2023-12-19T17:50:48.174 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:50:48.174 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-19T17:50:48.786 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:48.786 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:48.787 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:48.791 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T17:50:48.791 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-19T17:50:48.926 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-19T17:50:48.946 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:48.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:48.947 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-19T17:50:49.025 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:49.025 INFO:tasks.ceph:role: osd.5 2023-12-19T17:50:49.025 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:50:49.025 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-19T17:50:49.545 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:49.546 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:49.552 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T17:50:49.552 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-19T17:50:49.632 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-19T17:50:49.652 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:49.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:49.653 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-19T17:50:49.727 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:49.727 INFO:tasks.ceph:role: osd.6 2023-12-19T17:50:49.728 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:50:49.728 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-19T17:50:50.302 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:50.302 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:50.302 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:50.302 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-12-19T17:50:50.303 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:50.303 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:50.303 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:50.303 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:50.303 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:50.303 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:50.309 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T17:50:50.309 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-19T17:50:50.449 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-19T17:50:50.473 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:50.474 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:50.474 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-19T17:50:50.553 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-19T17:50:50.553 INFO:tasks.ceph:role: osd.7 2023-12-19T17:50:50.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:50:50.553 DEBUG:teuthology.orchestra.run.smithi073:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-19T17:50:51.147 INFO:teuthology.orchestra.run.smithi073.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout: = reflink=1 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout: = sunit=0 swidth=0 blks 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-19T17:50:51.148 INFO:teuthology.orchestra.run.smithi073.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-19T17:50:51.154 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi073.front.sepia.ceph.com -o noatime 2023-12-19T17:50:51.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-19T17:50:51.280 DEBUG:teuthology.orchestra.run.smithi073:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-19T17:50:51.302 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: /sbin/restorecon: command not found 2023-12-19T17:50:51.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:50:51.304 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:51.459 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:51.454+0000 7fdb4c6ae700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-19T17:50:51.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:51.458+0000 7fdb4c6ae700 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-19T17:50:51.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:51.458+0000 7fdb4c6ae700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T17:50:51.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:51.458+0000 7fdb4c6ae700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T17:50:51.462 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:51.458+0000 7fdb4c6ae700 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-19T17:50:51.466 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:51.462+0000 7fdb4c6ae700 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-19T17:50:54.540 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-19T17:50:54.577 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:54.706 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:54.702+0000 7f0c221c6700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-19T17:50:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:54.702+0000 7f0c221c6700 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-19T17:50:54.707 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:54.702+0000 7f0c221c6700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T17:50:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:54.702+0000 7f0c221c6700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T17:50:54.708 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:54.702+0000 7f0c221c6700 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-19T17:50:54.709 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:54.706+0000 7f0c221c6700 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-19T17:50:57.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-19T17:50:57.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:50:57.935 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:57.930+0000 7fca29cdc700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-19T17:50:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:57.930+0000 7fca29cdc700 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-19T17:50:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:57.930+0000 7fca29cdc700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T17:50:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:57.930+0000 7fca29cdc700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T17:50:57.936 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:57.930+0000 7fca29cdc700 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-19T17:50:57.938 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:50:57.934+0000 7fca29cdc700 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-19T17:50:59.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:50:59.645 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:51:00.998 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-19T17:51:01.034 DEBUG:teuthology.orchestra.run.smithi073:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:51:01.164 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:01.158+0000 7f81a9066700 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-19T17:51:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:01.162+0000 7f81a9066700 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-19T17:51:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:01.162+0000 7f81a9066700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T17:51:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:01.162+0000 7f81a9066700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T17:51:01.165 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:01.162+0000 7f81a9066700 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-19T17:51:01.167 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:01.162+0000 7f81a9066700 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-19T17:51:04.265 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-19T17:51:04.297 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-19T17:51:04.297 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.297 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-19T17:51:04.335 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.335 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-19T17:51:04.416 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-19T17:51:04.494 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-19T17:51:04.574 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.574 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-19T17:51:04.656 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-19T17:51:04.732 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:04.732 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-19T17:51:04.809 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:04.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-19T17:51:04.845 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:04.845 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-19T17:51:04.925 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:04.925 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-19T17:51:05.004 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:05.004 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-19T17:51:05.085 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:05.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-19T17:51:05.166 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:05.167 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-19T17:51:05.248 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:05.248 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-19T17:51:05.326 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:05.326 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-19T17:51:05.340 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:05.340 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-19T17:51:05.399 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:05.399 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-19T17:51:05.419 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:05.419 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-19T17:51:05.480 INFO:tasks.ceph:Adding keys to all mons... 2023-12-19T17:51:05.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T17:51:05.488 DEBUG:teuthology.orchestra.run.smithi073:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.y] 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q== 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A== 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA== 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.0] 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg== 2023-12-19T17:51:05.533 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.1] 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA== 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.2] 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w== 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.3] 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ== 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr.x] 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA== 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg== 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ== 2023-12-19T17:51:05.534 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.4] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.5] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.6] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[osd.7] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[client.0] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[client.2] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[client.1] 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A== 2023-12-19T17:51:05.535 INFO:teuthology.orchestra.run.smithi045.stdout:[client.3] 2023-12-19T17:51:05.536 INFO:teuthology.orchestra.run.smithi045.stdout: key = AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ== 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.y] 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q== 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A== 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA== 2023-12-19T17:51:05.556 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.0] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.1] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.2] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.3] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr.x] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ== 2023-12-19T17:51:05.557 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.4] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.5] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.6] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[osd.7] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[client.0] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[client.2] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[client.1] 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A== 2023-12-19T17:51:05.558 INFO:teuthology.orchestra.run.smithi073.stdout:[client.3] 2023-12-19T17:51:05.559 INFO:teuthology.orchestra.run.smithi073.stdout: key = AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ== 2023-12-19T17:51:05.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T17:51:05.589 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T17:51:05.703 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:05.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:05.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:05.807 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:05.900 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:05.907 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:05.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.002 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.104 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.191 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T17:51:06.289 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-19T17:51:06.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:06.384 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:06.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:06.487 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-19T17:51:06.587 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.595 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.682 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.773 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.868 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-19T17:51:06.963 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:06.971 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.155 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.161 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.252 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.258 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-19T17:51:07.349 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-19T17:51:07.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-19T17:51:07.383 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T17:51:07.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-19T17:51:07.575 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-19T17:51:07.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T17:51:07.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-19T17:51:07.816 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-19T17:51:07.892 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-19T17:51:08.040 DEBUG:teuthology.orchestra.run.smithi073:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-19T17:51:08.073 DEBUG:teuthology.orchestra.run.smithi045:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:51:08.080 DEBUG:teuthology.orchestra.run.smithi073:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-19T17:51:08.133 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-19T17:51:08.134 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-19T17:51:08.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-19T17:51:08.142 INFO:tasks.ceph.mon.a:Started 2023-12-19T17:51:08.142 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-19T17:51:08.142 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-19T17:51:08.183 INFO:tasks.ceph.mon.b:Started 2023-12-19T17:51:08.183 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-19T17:51:08.184 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-19T17:51:08.188 INFO:tasks.ceph.mon.c:Started 2023-12-19T17:51:08.188 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-19T17:51:08.189 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-19T17:51:08.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-19T17:51:08.196 INFO:tasks.ceph.mgr.y:Started 2023-12-19T17:51:08.196 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-19T17:51:08.196 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-19T17:51:08.202 INFO:tasks.ceph.mgr.x:Started 2023-12-19T17:51:08.202 INFO:tasks.ceph:Setting crush tunables to default 2023-12-19T17:51:08.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph osd crush tunables default 2023-12-19T17:51:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.374+0000 7f5f3f59e700 1 Processor -- start 2023-12-19T17:51:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.374+0000 7f5f3f59e700 1 -- start start 2023-12-19T17:51:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.374+0000 7f5f3f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.374+0000 7f5f3f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.374+0000 7f5f3f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f40071d60 con 0x7f5f400713d0 2023-12-19T17:51:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f400b1f20 con 0x7f5f400b3a30 2023-12-19T17:51:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400b28f0 con 0x7f5f4015cf00 2023-12-19T17:51:08.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48080/0 (socket says 172.21.15.45:48080) 2023-12-19T17:51:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 learned_addr learned my addr 172.21.15.45:0/2803959361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T17:51:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T17:51:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:08.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:08.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.378+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T17:51:08.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.582+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-19T17:51:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-19T17:51:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:08.986+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-19T17:51:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:09.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-19T17:51:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T17:51:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-19T17:51:09.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T17:51:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:09.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:09.790+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-19T17:51:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f400b23b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f400b23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:11.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 msgr2=0x7f5f400acff0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:11.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.73:3300/0 conn(0x7f5f400b3a30 0x7f5f400acff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:11.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 -- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 msgr2=0x7f5f40071820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:11.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 --2- 172.21.15.45:0/2803959361 >> v2:172.21.15.45:3300/0 conn(0x7f5f400713d0 0x7f5f40071820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:11.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 -- 172.21.15.45:0/2803959361 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f400ad8b0 con 0x7f5f28003710 2023-12-19T17:51:11.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:11.378+0000 7f5f2ffff700 1 -- 172.21.15.45:0/2803959361 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f2800c0f0 con 0x7f5f280073a0 2023-12-19T17:51:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2315274657 0 0) 0x7f5f400ad8b0 con 0x7f5f28003710 2023-12-19T17:51:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f200035d0 con 0x7f5f28003710 2023-12-19T17:51:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3732360222 0 0) 0x7f5f200035d0 con 0x7f5f28003710 2023-12-19T17:51:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 >> v1:172.21.15.73:6789/0 conn(0x7f5f280073a0 legacy=0x7f5f28009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f2800d2f0 con 0x7f5f28003710 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f5f3000c5c0 con 0x7f5f28003710 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 >> v1:172.21.15.45:6789/0 conn(0x7f5f28003710 legacy=0x7f5f28005b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/2803959361 reap_dead start 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20003aa0 0x7f5f20003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f20004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20004fb0 0x7f5f2000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f20005740 con 0x7f5f20004fb0 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2000bf70 con 0x7f5f20003aa0 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2000c100 con 0x7f5f4015cf00 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20003aa0 0x7f5f20003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.554+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20004fb0 0x7f5f2000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f20004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f20004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-19T17:51:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f20004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f20004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f20004870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 msgr2=0x7f5f20004870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f20004870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20004fb0 msgr2=0x7f5f2000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20004fb0 0x7f5f2000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3e59c700 1 -- 172.21.15.45:0/2803959361 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f200035d0 con 0x7f5f20003aa0 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20003aa0 0x7f5f20003ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5f30006f80 tx=0x7f5f200058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6264f2d619731f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.558+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30014cd0 con 0x7f5f20003aa0 2023-12-19T17:51:13.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.562+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3000c040 con 0x7f5f20003aa0 2023-12-19T17:51:13.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.562+0000 7f5f3d59a700 1 -- 172.21.15.45:0/2803959361 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f30005c80 con 0x7f5f20003aa0 2023-12-19T17:51:13.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 -- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20003aa0 msgr2=0x7f5f20003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20003aa0 0x7f5f20003ea0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5f30006f80 tx=0x7f5f200058a0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 -- 172.21.15.45:0/2803959361 shutdown_connections 2023-12-19T17:51:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f20004fb0 0x7f5f2000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f4015cf00 0x7f5f20004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/2803959361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20003aa0 0x7f5f20003ea0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 -- 172.21.15.45:0/2803959361 >> 172.21.15.45:0/2803959361 conn(0x7f5f400cf5a0 msgr2=0x7f5f40070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 -- 172.21.15.45:0/2803959361 shutdown_connections 2023-12-19T17:51:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.566+0000 7f5f3f59e700 1 -- 172.21.15.45:0/2803959361 wait complete. 2023-12-19T17:51:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 Processor -- start 2023-12-19T17:51:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 -- start start 2023-12-19T17:51:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20004fb0 0x7f5f400cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 0x7f5f401481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 0x7f5f401f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cbc30 con 0x7f5f4015cf00 2023-12-19T17:51:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cb020 con 0x7f5f20004fb0 2023-12-19T17:51:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f400cb300 con 0x7f5f400cd2b0 2023-12-19T17:51:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 0x7f5f401481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20004fb0 0x7f5f400cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 0x7f5f401481f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37970/0 (socket says 172.21.15.45:37970) 2023-12-19T17:51:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/693466751 learned_addr learned my addr 172.21.15.45:0/693466751 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.570+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 0x7f5f401f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 msgr2=0x7f5f401f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3ed9d700 1 -- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 msgr2=0x7f5f401f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 msgr2=0x7f5f401f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 0x7f5f401f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3ed9d700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 0x7f5f401f5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 0x7f5f401f5870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20004fb0 msgr2=0x7f5f400cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20004fb0 0x7f5f400cc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3dd9b700 1 -- 172.21.15.45:0/693466751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f400cb5e0 con 0x7f5f4015cf00 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3e59c700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20004fb0 0x7f5f400cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3dd9b700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 0x7f5f401481f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5f34012350 tx=0x7f5f34012660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34012e50 con 0x7f5f4015cf00 2023-12-19T17:51:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f3400c040 con 0x7f5f4015cf00 2023-12-19T17:51:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f34026630 con 0x7f5f4015cf00 2023-12-19T17:51:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f400cb8c0 con 0x7f5f4015cf00 2023-12-19T17:51:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f400cacb0 con 0x7f5f4015cf00 2023-12-19T17:51:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5f34026a90 con 0x7f5f4015cf00 2023-12-19T17:51:13.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5f3402e3e0 con 0x7f5f4015cf00 2023-12-19T17:51:13.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.574+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f400cbda0 con 0x7f5f4015cf00 2023-12-19T17:51:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.582+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f5f3400f040 con 0x7f5f4015cf00 2023-12-19T17:51:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.654+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5f4004ed30 con 0x7f5f4015cf00 2023-12-19T17:51:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f2effd700 1 -- 172.21.15.45:0/693466751 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5f3402f430 con 0x7f5f4015cf00 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 msgr2=0x7f5f401481f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 0x7f5f401481f0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5f34012350 tx=0x7f5f34012660 comp rx=0 tx=0).stop 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 shutdown_connections 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5f400cd2b0 0x7f5f401f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5f4015cf00 0x7f5f401481f0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 --2- 172.21.15.45:0/693466751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5f20004fb0 0x7f5f400cc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.662+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 >> 172.21.15.45:0/693466751 conn(0x7f5f20003aa0 msgr2=0x7f5f4006ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:13.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.666+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 shutdown_connections 2023-12-19T17:51:13.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:13.666+0000 7f5f3f59e700 1 -- 172.21.15.45:0/693466751 wait complete. 2023-12-19T17:51:13.669 INFO:teuthology.orchestra.run.smithi045.stderr:adjusted tunables profile to default 2023-12-19T17:51:13.690 INFO:tasks.ceph:check_enable_crimson: False 2023-12-19T17:51:13.691 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-19T17:51:13.691 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:13.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-19T17:51:13.727 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:13.727 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-19T17:51:13.808 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:13.808 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-19T17:51:13.825 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:13.822+0000 7f9d765bf2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T17:51:13.859 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:13.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-19T17:51:13.937 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:13.937 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-19T17:51:13.972 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:13.972 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-19T17:51:14.054 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:14.054 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-19T17:51:14.129 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:51:14.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-19T17:51:14.208 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new ee1fa291-3a20-4fbb-94cc-30753db3a968 0 2023-12-19T17:51:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.410+0000 7f548ccfa700 1 Processor -- start 2023-12-19T17:51:14.415 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.410+0000 7f548ccfa700 1 -- start start 2023-12-19T17:51:14.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548ccfa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54881626c0 0x7f54881619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.418 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548ccfa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f548806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548ccfa700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54880b1d20 con 0x7f54880b2490 2023-12-19T17:51:14.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548ccfa700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f548806ec50 con 0x7f54881626c0 2023-12-19T17:51:14.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548ccfa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54880b2c00 con 0x7f548806dd70 2023-12-19T17:51:14.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54881626c0 0x7f54881619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.419 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54881626c0 0x7f54881619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53684/0 (socket says 172.21.15.73:53684) 2023-12-19T17:51:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 -- 172.21.15.73:0/3987733844 learned_addr learned my addr 172.21.15.73:0/3987733844 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f5486d9d700 1 --2- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f548806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.420 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 -- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 msgr2=0x7f548806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 --2- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f548806f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 -- 172.21.15.73:0/3987733844 >> v1:172.21.15.45:6789/0 conn(0x7f54880b2490 legacy=0x7f548806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 -- 172.21.15.73:0/3987733844 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54880b2ee0 con 0x7f54881626c0 2023-12-19T17:51:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.414+0000 7f548659c700 1 --2- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54881626c0 0x7f54881619b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5478009910 tx=0x7f5478009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2167a0162ee02dec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:14.421 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f5485d9b700 1 -- 172.21.15.73:0/3987733844 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547800ba60 con 0x7f54881626c0 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f5485d9b700 1 -- 172.21.15.73:0/3987733844 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547800bbc0 con 0x7f54881626c0 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f5485d9b700 1 -- 172.21.15.73:0/3987733844 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478009e60 con 0x7f54881626c0 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 -- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54881626c0 msgr2=0x7f54881619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54881626c0 0x7f54881619b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5478009910 tx=0x7f5478009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 -- 172.21.15.73:0/3987733844 shutdown_connections 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f548806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3987733844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54881626c0 0x7f54881619b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.422 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 -- 172.21.15.73:0/3987733844 >> 172.21.15.73:0/3987733844 conn(0x7f5488071990 msgr2=0x7f54880b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 -- 172.21.15.73:0/3987733844 shutdown_connections 2023-12-19T17:51:14.423 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 -- 172.21.15.73:0/3987733844 wait complete. 2023-12-19T17:51:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 Processor -- start 2023-12-19T17:51:14.424 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.418+0000 7f548ccfa700 1 -- start start 2023-12-19T17:51:14.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f54881609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 0x7f5488146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54881626c0 0x7f548815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.426 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548814a5a0 con 0x7f54881626c0 2023-12-19T17:51:14.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548815e000 con 0x7f54880b2490 2023-12-19T17:51:14.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5488160ef0 con 0x7f548806dd70 2023-12-19T17:51:14.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 0x7f5488146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f54881609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 0x7f5488146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53700/0 (socket says 172.21.15.73:53700) 2023-12-19T17:51:14.427 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 -- 172.21.15.73:0/3676491643 learned_addr learned my addr 172.21.15.73:0/3676491643 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548659c700 1 -- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 msgr2=0x7f54881609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-19T17:51:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548659c700 1 -- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 msgr2=0x7f54881609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548659c700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f54881609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:14.429 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f5486d9d700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54881626c0 0x7f548815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548659c700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f54881609b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 -- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 msgr2=0x7f54881609b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f54881609b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 -- 172.21.15.73:0/3676491643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54881626c0 msgr2=0x7f548815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54881626c0 0x7f548815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 -- 172.21.15.73:0/3676491643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478009570 con 0x7f54880b2490 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547dd9b700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 0x7f5488146c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f547000c530 tx=0x7f547000c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700052d0 con 0x7f54880b2490 2023-12-19T17:51:14.430 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470005430 con 0x7f54880b2490 2023-12-19T17:51:14.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54700055a0 con 0x7f54880b2490 2023-12-19T17:51:14.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f548814a2c0 con 0x7f54880b2490 2023-12-19T17:51:14.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5470003be0 con 0x7f54880b2490 2023-12-19T17:51:14.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54881479c0 con 0x7f54880b2490 2023-12-19T17:51:14.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.422+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f54700118d0 con 0x7f54880b2490 2023-12-19T17:51:14.431 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.426+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5488147540 con 0x7f54880b2490 2023-12-19T17:51:14.433 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.430+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f5488147540 con 0x7f54880b2490 2023-12-19T17:51:14.525 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.518+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ee1fa291-3a20-4fbb-94cc-30753db3a968", "id": 0} v 0) v1 -- 0x7f548804ed30 con 0x7f54880b2490 2023-12-19T17:51:14.567 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f547f7fe700 1 -- 172.21.15.73:0/3676491643 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ee1fa291-3a20-4fbb-94cc-30753db3a968", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5470017070 con 0x7f54880b2490 2023-12-19T17:51:14.567 INFO:teuthology.orchestra.run.smithi073.stdout:0 2023-12-19T17:51:14.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 msgr2=0x7f5488146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 0x7f5488146c90 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f547000c530 tx=0x7f547000c840 comp rx=0 tx=0).stop 2023-12-19T17:51:14.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 shutdown_connections 2023-12-19T17:51:14.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54881626c0 0x7f548815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54880b2490 0x7f5488146c90 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.568 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 --2- 172.21.15.73:0/3676491643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f548806dd70 0x7f54881609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 >> 172.21.15.73:0/3676491643 conn(0x7f5488071990 msgr2=0x7f548806f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 shutdown_connections 2023-12-19T17:51:14.569 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.562+0000 7f548ccfa700 1 -- 172.21.15.73:0/3676491643 wait complete. 2023-12-19T17:51:14.585 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 453ae780-7763-4368-92f5-3f568c783a8c 1 2023-12-19T17:51:14.623 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:14.618+0000 7f746344d2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-19T17:51:14.660 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:14.658+0000 7f9d765bf2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T17:51:14.751 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.746+0000 7f4691590700 1 Processor -- start 2023-12-19T17:51:14.752 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.746+0000 7f4691590700 1 -- start start 2023-12-19T17:51:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4691590700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f468c071f30 0x7f468c0cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4691590700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f468c0cebd0 0x7f468c06b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4691590700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f468c0cccc0 con 0x7f468c06b560 2023-12-19T17:51:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4691590700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c06b9d0 con 0x7f468c0cebd0 2023-12-19T17:51:14.754 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4691590700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f468c0cbe60 con 0x7f468c071f30 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f468c071f30 0x7f468c0cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f468c071f30 0x7f468c0cb920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53708/0 (socket says 172.21.15.73:53708) 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 -- 172.21.15.73:0/1905788564 learned_addr learned my addr 172.21.15.73:0/1905788564 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468a7fc700 1 --2- 172.21.15.73:0/1905788564 >> v2:172.21.15.45:3300/0 conn(0x7f468c0cebd0 0x7f468c06b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 -- 172.21.15.73:0/1905788564 >> v2:172.21.15.45:3300/0 conn(0x7f468c0cebd0 msgr2=0x7f468c06b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 --2- 172.21.15.73:0/1905788564 >> v2:172.21.15.45:3300/0 conn(0x7f468c0cebd0 0x7f468c06b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.755 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 -- 172.21.15.73:0/1905788564 >> v1:172.21.15.45:6789/0 conn(0x7f468c06b560 legacy=0x7f468c160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:14.756 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 -- 172.21.15.73:0/1905788564 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468c0cc0b0 con 0x7f468c071f30 2023-12-19T17:51:14.756 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:14.754+0000 7f9d765bf2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T17:51:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f468affd700 1 --2- 172.21.15.73:0/1905788564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c071f30 0x7f468c0cb920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f467c009910 tx=0x7f467c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c67ab1b02c5dbf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4689ffb700 1 -- 172.21.15.73:0/1905788564 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c00ba20 con 0x7f468c071f30 2023-12-19T17:51:14.757 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4689ffb700 1 -- 172.21.15.73:0/1905788564 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c00bb80 con 0x7f468c071f30 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.750+0000 7f4689ffb700 1 -- 172.21.15.73:0/1905788564 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c009e60 con 0x7f468c071f30 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 -- 172.21.15.73:0/1905788564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c071f30 msgr2=0x7f468c0cb920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 --2- 172.21.15.73:0/1905788564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c071f30 0x7f468c0cb920 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f467c009910 tx=0x7f467c009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 -- 172.21.15.73:0/1905788564 shutdown_connections 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 --2- 172.21.15.73:0/1905788564 >> v2:172.21.15.45:3300/0 conn(0x7f468c0cebd0 0x7f468c06b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 --2- 172.21.15.73:0/1905788564 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c071f30 0x7f468c0cb920 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 -- 172.21.15.73:0/1905788564 >> 172.21.15.73:0/1905788564 conn(0x7f468c0cd6e0 msgr2=0x7f468c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 -- 172.21.15.73:0/1905788564 shutdown_connections 2023-12-19T17:51:14.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.754+0000 7f4691590700 1 -- 172.21.15.73:0/1905788564 wait complete. 2023-12-19T17:51:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 Processor -- start 2023-12-19T17:51:14.761 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 -- start start 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 0x7f468c0aba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c071f30 0x7f468c152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 0x7f468c0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1f2ac0 con 0x7f468c071f30 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1f2da0 con 0x7f468c06b560 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f4691590700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468c1f3080 con 0x7f468c0cebd0 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 0x7f468c0aba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 0x7f468c0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 0x7f468c0aba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53710/0 (socket says 172.21.15.73:53710) 2023-12-19T17:51:14.764 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 -- 172.21.15.73:0/3490028497 learned_addr learned my addr 172.21.15.73:0/3490028497 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:14.765 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468a7fc700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c071f30 0x7f468c152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468b7fe700 1 -- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 msgr2=0x7f468c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468b7fe700 1 -- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 msgr2=0x7f468c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468b7fe700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 0x7f468c0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468b7fe700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 0x7f468c0af000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 -- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 msgr2=0x7f468c0af000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 0x7f468c0af000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 -- 172.21.15.73:0/3490028497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c071f30 msgr2=0x7f468c152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c071f30 0x7f468c152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.758+0000 7f468affd700 1 -- 172.21.15.73:0/3490028497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f467c009570 con 0x7f468c06b560 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f468affd700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 0x7f468c0aba00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f468c0cbfa0 tx=0x7f467c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:14.766 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c004310 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f467c01f070 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f467c0036c0 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f468c1f3360 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c153530 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f467c021030 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f467c01a8f0 con 0x7f468c06b560 2023-12-19T17:51:14.767 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.762+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c0d0620 con 0x7f468c06b560 2023-12-19T17:51:14.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.766+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f467c015020 con 0x7f468c06b560 2023-12-19T17:51:14.859 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.854+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "453ae780-7763-4368-92f5-3f568c783a8c", "id": 1} v 0) v1 -- 0x7f468c04ed30 con 0x7f468c06b560 2023-12-19T17:51:14.869 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f46737fe700 1 -- 172.21.15.73:0/3490028497 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "453ae780-7763-4368-92f5-3f568c783a8c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f467c01a450 con 0x7f468c06b560 2023-12-19T17:51:14.870 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T17:51:14.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 msgr2=0x7f468c0aba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:14.871 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 0x7f468c0aba00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f468c0cbfa0 tx=0x7f467c004770 comp rx=0 tx=0).stop 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 shutdown_connections 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f468c0cebd0 0x7f468c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f468c071f30 0x7f468c152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 --2- 172.21.15.73:0/3490028497 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f468c06b560 0x7f468c0aba00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 >> 172.21.15.73:0/3490028497 conn(0x7f468c0cd6e0 msgr2=0x7f468c0b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 shutdown_connections 2023-12-19T17:51:14.872 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:14.866+0000 7f4691590700 1 -- 172.21.15.73:0/3490028497 wait complete. 2023-12-19T17:51:14.890 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new d2e0237f-98c1-4226-a6d5-86853685c5fb 2 2023-12-19T17:51:14.956 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:14.954+0000 7f9d765bf2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T17:51:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9927700 1 Processor -- start 2023-12-19T17:51:15.102 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9927700 1 -- start start 2023-12-19T17:51:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9927700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7feca40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9927700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca415d300 con 0x7feca40b8580 2023-12-19T17:51:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9927700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca40d1550 con 0x7feca40cdfd0 2023-12-19T17:51:15.104 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9927700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca40d1830 con 0x7feca415cf20 2023-12-19T17:51:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9126700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7feca40cdfd0 0x7feca40b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57492/0 (socket says 172.21.15.73:57492) 2023-12-19T17:51:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca9126700 1 -- 172.21.15.73:0/2859635083 learned_addr learned my addr 172.21.15.73:0/2859635083 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T17:51:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.098+0000 7feca8925700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7feca40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.106 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca8925700 1 -- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 msgr2=0x7feca40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca8925700 1 -- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 msgr2=0x7feca40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca8925700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7feca40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3050481031 0 0) 0x7feca40d1550 con 0x7feca40cdfd0 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec940035d0 con 0x7feca40cdfd0 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca8925700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7feca40d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185908419 0 0) 0x7feca415d300 con 0x7feca40b8580 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feca40d1550 con 0x7feca40b8580 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131784292 0 0) 0x7fec940035d0 con 0x7feca40cdfd0 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 msgr2=0x7feca40d0c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7feca40d0c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 >> v1:172.21.15.45:6789/0 conn(0x7feca40b8580 legacy=0x7feca40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.107 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40d1b10 con 0x7feca40cdfd0 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fec9c0019f0 con 0x7feca40cdfd0 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 >> v1:172.21.15.73:6789/0 conn(0x7feca40cdfd0 legacy=0x7feca40b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec94003bb0 0x7fec94003f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec94004870 0x7fec94004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7fec94005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40d1830 con 0x7fec94004870 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9400bae0 con 0x7fec94003bb0 2023-12-19T17:51:15.108 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec9400bc70 con 0x7feca415cf20 2023-12-19T17:51:15.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7fec94005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca8925700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec94003bb0 0x7fec94003f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca3fff700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec94004870 0x7fec94004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 -- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec94003bb0 msgr2=0x7fec94003f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:15.109 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec94003bb0 0x7fec94003f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 -- 172.21.15.73:0/2859635083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec94004870 msgr2=0x7fec94004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec94004870 0x7fec94004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 -- 172.21.15.73:0/2859635083 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940035d0 con 0x7feca415cf20 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca9126700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7fec94005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feca40cd520 tx=0x7fec940058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea98038919c3e35f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c00da80 con 0x7feca415cf20 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c00dbe0 con 0x7feca415cf20 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.102+0000 7feca37fe700 1 -- 172.21.15.73:0/2859635083 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c015420 con 0x7feca415cf20 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 -- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 msgr2=0x7fec94005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 --2- 172.21.15.73:0/2859635083 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca415cf20 0x7fec94005230 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feca40cd520 tx=0x7fec940058a0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9126700 1 -- 172.21.15.73:0/2859635083 reap_dead start 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 -- 172.21.15.73:0/2859635083 shutdown_connections 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 -- 172.21.15.73:0/2859635083 >> 172.21.15.73:0/2859635083 conn(0x7feca40b4670 msgr2=0x7feca40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 -- 172.21.15.73:0/2859635083 shutdown_connections 2023-12-19T17:51:15.110 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 -- 172.21.15.73:0/2859635083 wait complete. 2023-12-19T17:51:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 Processor -- start 2023-12-19T17:51:15.112 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.106+0000 7feca9927700 1 -- start start 2023-12-19T17:51:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 0x7feca41594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feca40b1440 0x7feca415a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40cad60 con 0x7feca40b1440 2023-12-19T17:51:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca40ca0e0 con 0x7feca415cf20 2023-12-19T17:51:15.115 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca40ca3c0 con 0x7feca40c9c50 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 0x7feca41594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39658/0 (socket says 172.21.15.73:39658) 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 0x7feca41594a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53740/0 (socket says 172.21.15.73:53740) 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 -- 172.21.15.73:0/4259790708 learned_addr learned my addr 172.21.15.73:0/4259790708 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 -- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 msgr2=0x7feca40b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 -- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 msgr2=0x7feca40b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:15.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9126700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feca40b1440 0x7feca415a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca3fff700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 -- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 msgr2=0x7feca40b0f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 -- 172.21.15.73:0/4259790708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feca40b1440 msgr2=0x7feca415a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feca40b1440 0x7feca415a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 -- 172.21.15.73:0/4259790708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca40ca6a0 con 0x7feca415cf20 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca8925700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 0x7feca41594a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec980115b0 tx=0x7fec98011970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9800c070 con 0x7feca415cf20 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec98015870 con 0x7feca415cf20 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca40ca980 con 0x7feca415cf20 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98015c20 con 0x7feca415cf20 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca415a840 con 0x7feca415cf20 2023-12-19T17:51:15.118 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.110+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fec9801e450 con 0x7feca415cf20 2023-12-19T17:51:15.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.114+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7fec9801eb20 con 0x7feca415cf20 2023-12-19T17:51:15.119 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.114+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca406fc10 con 0x7feca415cf20 2023-12-19T17:51:15.121 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.118+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fec98023060 con 0x7feca415cf20 2023-12-19T17:51:15.202 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.198+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2e0237f-98c1-4226-a6d5-86853685c5fb", "id": 2} v 0) v1 -- 0x7feca404ed30 con 0x7feca415cf20 2023-12-19T17:51:15.213 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca17fa700 1 -- 172.21.15.73:0/4259790708 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2e0237f-98c1-4226-a6d5-86853685c5fb", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fec9802c020 con 0x7feca415cf20 2023-12-19T17:51:15.213 INFO:teuthology.orchestra.run.smithi073.stdout:2 2023-12-19T17:51:15.214 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 msgr2=0x7feca41594a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 0x7feca41594a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec980115b0 tx=0x7fec98011970 comp rx=0 tx=0).stop 2023-12-19T17:51:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 shutdown_connections 2023-12-19T17:51:15.215 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feca40b1440 0x7feca415a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feca40c9c50 0x7feca40b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 --2- 172.21.15.73:0/4259790708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feca415cf20 0x7feca41594a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 >> 172.21.15.73:0/4259790708 conn(0x7feca40b4670 msgr2=0x7feca40cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 shutdown_connections 2023-12-19T17:51:15.216 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.210+0000 7feca9927700 1 -- 172.21.15.73:0/4259790708 wait complete. 2023-12-19T17:51:15.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 72d07e49-11da-4b3b-8604-ed9fa8c7c140 3 2023-12-19T17:51:15.243 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:15.242+0000 7f9d765bf2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T17:51:15.329 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:15.326+0000 7f9d765bf2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T17:51:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.386+0000 7f6d6359e700 1 Processor -- start 2023-12-19T17:51:15.390 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.386+0000 7f6d6359e700 1 -- start start 2023-12-19T17:51:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.386+0000 7f6d6359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d640ce990 0x7f6d6415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6415c020 con 0x7f6d640cf730 2023-12-19T17:51:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d640ced70 con 0x7f6d6415e6e0 2023-12-19T17:51:15.393 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6415b0f0 con 0x7f6d640ce990 2023-12-19T17:51:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6259c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6d640ce990 0x7f6d6415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d61d9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6d6415e6e0 0x7f6d640cf020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57508/0 (socket says 172.21.15.73:57508) 2023-12-19T17:51:15.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d61d9b700 1 -- 172.21.15.73:0/1505924853 learned_addr learned my addr 172.21.15.73:0/1505924853 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6159a700 1 -- 172.21.15.73:0/1505924853 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969209856 0 0) 0x7f6d640ced70 con 0x7f6d6415e6e0 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6159a700 1 -- 172.21.15.73:0/1505924853 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d4c0035d0 con 0x7f6d6415e6e0 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6259c700 1 -- 172.21.15.73:0/1505924853 >> v1:172.21.15.73:6789/0 conn(0x7f6d6415e6e0 legacy=0x7f6d640cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6259c700 1 -- 172.21.15.73:0/1505924853 >> v1:172.21.15.45:6789/0 conn(0x7f6d640cf730 legacy=0x7f6d6406f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6259c700 1 -- 172.21.15.73:0/1505924853 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6415f130 con 0x7f6d640ce990 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6259c700 1 --2- 172.21.15.73:0/1505924853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640ce990 0x7f6d6415bae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009850 tx=0x7f6d54009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=152295e0ceb1cd5f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:15.395 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6159a700 1 -- 172.21.15.73:0/1505924853 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54011830 con 0x7f6d640ce990 2023-12-19T17:51:15.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6159a700 1 -- 172.21.15.73:0/1505924853 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54011990 con 0x7f6d640ce990 2023-12-19T17:51:15.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6159a700 1 -- 172.21.15.73:0/1505924853 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54011d40 con 0x7f6d640ce990 2023-12-19T17:51:15.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- 172.21.15.73:0/1505924853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640ce990 msgr2=0x7f6d6415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.396 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 --2- 172.21.15.73:0/1505924853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640ce990 0x7f6d6415bae0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6d54009850 tx=0x7f6d54009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- 172.21.15.73:0/1505924853 shutdown_connections 2023-12-19T17:51:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 --2- 172.21.15.73:0/1505924853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640ce990 0x7f6d6415bae0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- 172.21.15.73:0/1505924853 >> 172.21.15.73:0/1505924853 conn(0x7f6d6406a010 msgr2=0x7f6d6406a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- 172.21.15.73:0/1505924853 shutdown_connections 2023-12-19T17:51:15.397 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.390+0000 7f6d6359e700 1 -- 172.21.15.73:0/1505924853 wait complete. 2023-12-19T17:51:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.394+0000 7f6d6359e700 1 Processor -- start 2023-12-19T17:51:15.399 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.394+0000 7f6d6359e700 1 -- start start 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 0x7f6d64152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 0x7f6d64152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6415e6e0 0x7f6d641573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d640b0f10 con 0x7f6d6415e6e0 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64158420 con 0x7f6d640cf730 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d64156b20 con 0x7f6d640ce990 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 0x7f6d64152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 0x7f6d64152110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53764/0 (socket says 172.21.15.73:53764) 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 0x7f6d64152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 -- 172.21.15.73:0/1043155399 learned_addr learned my addr 172.21.15.73:0/1043155399 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d62d9d700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6415e6e0 0x7f6d641573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6259c700 1 -- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 msgr2=0x7f6d64152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6259c700 1 -- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 msgr2=0x7f6d64152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6259c700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 0x7f6d64152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6259c700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 0x7f6d64152bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 -- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 msgr2=0x7f6d64152bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 0x7f6d64152bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 -- 172.21.15.73:0/1043155399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6415e6e0 msgr2=0x7f6d641573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6415e6e0 0x7f6d641573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 -- 172.21.15.73:0/1043155399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d540094b0 con 0x7f6d640cf730 2023-12-19T17:51:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d61d9b700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 0x7f6d64152110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800c700 tx=0x7f6d5800cac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58005d90 con 0x7f6d640cf730 2023-12-19T17:51:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d580070d0 con 0x7f6d640cf730 2023-12-19T17:51:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d64156e00 con 0x7f6d640cf730 2023-12-19T17:51:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d58007480 con 0x7f6d640cf730 2023-12-19T17:51:15.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d64159440 con 0x7f6d640cf730 2023-12-19T17:51:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6d5801c440 con 0x7f6d640cf730 2023-12-19T17:51:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.398+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6d58012890 con 0x7f6d640cf730 2023-12-19T17:51:15.405 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.402+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d64067260 con 0x7f6d640cf730 2023-12-19T17:51:15.408 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.402+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f6d58017070 con 0x7f6d640cf730 2023-12-19T17:51:15.460 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:15.454+0000 7f746344d2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-19T17:51:15.486 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.482+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "72d07e49-11da-4b3b-8604-ed9fa8c7c140", "id": 3} v 0) v1 -- 0x7f6d6404ed30 con 0x7f6d640cf730 2023-12-19T17:51:15.496 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.490+0000 7f6d52ffd700 1 -- 172.21.15.73:0/1043155399 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "72d07e49-11da-4b3b-8604-ed9fa8c7c140", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d58012ce0 con 0x7f6d640cf730 2023-12-19T17:51:15.496 INFO:teuthology.orchestra.run.smithi073.stdout:3 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 msgr2=0x7f6d64152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 0x7f6d64152110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6d5800c700 tx=0x7f6d5800cac0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 shutdown_connections 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d6415e6e0 0x7f6d641573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d640cf730 0x7f6d64152110 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 --2- 172.21.15.73:0/1043155399 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d640ce990 0x7f6d64152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 >> 172.21.15.73:0/1043155399 conn(0x7f6d6406a010 msgr2=0x7f6d6415a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 shutdown_connections 2023-12-19T17:51:15.498 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.494+0000 7f6d6359e700 1 -- 172.21.15.73:0/1043155399 wait complete. 2023-12-19T17:51:15.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc 4 2023-12-19T17:51:15.539 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:15.534+0000 7f746344d2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-19T17:51:15.593 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:15.590+0000 7f9d765bf2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T17:51:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.674+0000 7fa97f59e700 1 Processor -- start 2023-12-19T17:51:15.679 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.674+0000 7fa97f59e700 1 -- start start 2023-12-19T17:51:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 0x7fa9800b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9800cd940 0x7fa9800cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98006f4a0 con 0x7fa980160970 2023-12-19T17:51:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa980070370 con 0x7fa9800cd940 2023-12-19T17:51:15.682 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98006f6f0 con 0x7fa98015ccf0 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa975d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9800cd940 0x7fa9800cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97e59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 0x7fa9800b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97ed9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa980160970 0x7fa980160dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57520/0 (socket says 172.21.15.73:57520) 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97ed9d700 1 -- 172.21.15.73:0/618138214 learned_addr learned my addr 172.21.15.73:0/618138214 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97e59c700 1 -- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 msgr2=0x7fa9800b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97e59c700 1 -- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 msgr2=0x7fa9800b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97e59c700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 0x7fa9800b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:15.683 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97e59c700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 0x7fa9800b8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa975d9b700 1 -- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 msgr2=0x7fa9800b8520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa975d9b700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 0x7fa9800b8520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa975d9b700 1 -- 172.21.15.73:0/618138214 >> v1:172.21.15.73:6789/0 conn(0x7fa980160970 legacy=0x7fa980160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97dd9b700 1 -- 172.21.15.73:0/618138214 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683354595 0 0) 0x7fa98006f4a0 con 0x7fa980160970 2023-12-19T17:51:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa975d9b700 1 -- 172.21.15.73:0/618138214 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98006f9d0 con 0x7fa9800cd940 2023-12-19T17:51:15.684 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa975d9b700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9800cd940 0x7fa9800cdda0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa968009850 tx=0x7fa968009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d26513fb8a74e180 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97dd9b700 1 -- 172.21.15.73:0/618138214 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968011830 con 0x7fa9800cd940 2023-12-19T17:51:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97dd9b700 1 -- 172.21.15.73:0/618138214 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa968011990 con 0x7fa9800cd940 2023-12-19T17:51:15.685 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.678+0000 7fa97dd9b700 1 -- 172.21.15.73:0/618138214 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa968011d20 con 0x7fa9800cd940 2023-12-19T17:51:15.685 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:15.682+0000 7f9d765bf2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 -- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9800cd940 msgr2=0x7fa9800cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9800cd940 0x7fa9800cdda0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa968009850 tx=0x7fa968009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 -- 172.21.15.73:0/618138214 shutdown_connections 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9800cd940 0x7fa9800cdda0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 --2- 172.21.15.73:0/618138214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa98015ccf0 0x7fa9800b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 -- 172.21.15.73:0/618138214 >> 172.21.15.73:0/618138214 conn(0x7fa9800b46f0 msgr2=0x7fa9800b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 -- 172.21.15.73:0/618138214 shutdown_connections 2023-12-19T17:51:15.686 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.682+0000 7fa97f59e700 1 -- 172.21.15.73:0/618138214 wait complete. 2023-12-19T17:51:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 Processor -- start 2023-12-19T17:51:15.689 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 -- start start 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 0x7fa9800cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98015ccf0 0x7fa98014ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 0x7fa9800ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800cb230 con 0x7fa98015ccf0 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98015a5c0 con 0x7fa980160970 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801e5ae0 con 0x7fa9800cd940 2023-12-19T17:51:15.692 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 0x7fa9800ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97e59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 0x7fa9800cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 0x7fa9800ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53780/0 (socket says 172.21.15.73:53780) 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 -- 172.21.15.73:0/1181297476 learned_addr learned my addr 172.21.15.73:0/1181297476 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa975d9b700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98015ccf0 0x7fa98014ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97e59c700 1 -- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 msgr2=0x7fa9800cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97e59c700 1 -- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 msgr2=0x7fa9800cc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97e59c700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 0x7fa9800cc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97e59c700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 0x7fa9800cc5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 -- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 msgr2=0x7fa9800cc5f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 0x7fa9800cc5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 -- 172.21.15.73:0/1181297476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98015ccf0 msgr2=0x7fa98014ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98015ccf0 0x7fa98014ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 -- 172.21.15.73:0/1181297476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9680094b0 con 0x7fa980160970 2023-12-19T17:51:15.693 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97ed9d700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 0x7fa9800ca350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa97800cca0 tx=0x7fa97800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:15.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97800ac20 con 0x7fa980160970 2023-12-19T17:51:15.694 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97800ad80 con 0x7fa980160970 2023-12-19T17:51:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98015a810 con 0x7fa980160970 2023-12-19T17:51:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa978007310 con 0x7fa980160970 2023-12-19T17:51:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.686+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98015add0 con 0x7fa980160970 2023-12-19T17:51:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.690+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa978007770 con 0x7fa980160970 2023-12-19T17:51:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.690+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa97801b360 con 0x7fa980160970 2023-12-19T17:51:15.695 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.690+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98004ed30 con 0x7fa980160970 2023-12-19T17:51:15.698 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.694+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fa978018070 con 0x7fa980160970 2023-12-19T17:51:15.722 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:15.718+0000 7f746344d2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-19T17:51:15.775 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.770+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc", "id": 4} v 0) v1 -- 0x7fa9801e5c20 con 0x7fa980160970 2023-12-19T17:51:15.783 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa9777fe700 1 -- 172.21.15.73:0/1181297476 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa978012400 con 0x7fa980160970 2023-12-19T17:51:15.783 INFO:teuthology.orchestra.run.smithi073.stdout:4 2023-12-19T17:51:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 msgr2=0x7fa9800ca350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 0x7fa9800ca350 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fa97800cca0 tx=0x7fa97800a060 comp rx=0 tx=0).stop 2023-12-19T17:51:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 shutdown_connections 2023-12-19T17:51:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa980160970 0x7fa9800ca350 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa98015ccf0 0x7fa98014ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.784 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 --2- 172.21.15.73:0/1181297476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9800cd940 0x7fa9800cc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:15.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 >> 172.21.15.73:0/1181297476 conn(0x7fa9800b46f0 msgr2=0x7fa98015d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:15.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 shutdown_connections 2023-12-19T17:51:15.785 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:15.778+0000 7fa97f59e700 1 -- 172.21.15.73:0/1181297476 wait complete. 2023-12-19T17:51:15.786 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:15.782+0000 7f9d765bf2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T17:51:15.803 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new f2cc4960-3c95-4886-ab16-0f5938ec61aa 5 2023-12-19T17:51:16.006 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:16.002+0000 7f746344d2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-19T17:51:16.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.010+0000 7f78a3a37700 1 Processor -- start 2023-12-19T17:51:16.016 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.010+0000 7f78a3a37700 1 -- start start 2023-12-19T17:51:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f789c0b12d0 0x7f789c0b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c0b0730 con 0x7f789c15e9d0 2023-12-19T17:51:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c15ee40 con 0x7f789c15ad80 2023-12-19T17:51:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c0b6c20 con 0x7f789c0b12d0 2023-12-19T17:51:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f789c0b12d0 0x7f789c0b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.017 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f789c0b12d0 0x7f789c0b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53796/0 (socket says 172.21.15.73:53796) 2023-12-19T17:51:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 -- 172.21.15.73:0/2690093572 learned_addr learned my addr 172.21.15.73:0/2690093572 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:16.018 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 -- 172.21.15.73:0/2690093572 >> v1:172.21.15.73:6789/0 conn(0x7f789c15ad80 legacy=0x7f789c0cefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 -- 172.21.15.73:0/2690093572 >> v1:172.21.15.45:6789/0 conn(0x7f789c15e9d0 legacy=0x7f789c0b0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 -- 172.21.15.73:0/2690093572 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c15f0d0 con 0x7f789c0b12d0 2023-12-19T17:51:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a1fd4700 1 --2- 172.21.15.73:0/2690093572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c0b66e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7894009e80 tx=0x7f789400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db622d4fa7947aa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f7893fff700 1 -- 172.21.15.73:0/2690093572 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789400e070 con 0x7f789c0b12d0 2023-12-19T17:51:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f7893fff700 1 -- 172.21.15.73:0/2690093572 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7894003a40 con 0x7f789c0b12d0 2023-12-19T17:51:16.019 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f7893fff700 1 -- 172.21.15.73:0/2690093572 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7894003df0 con 0x7f789c0b12d0 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- 172.21.15.73:0/2690093572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 msgr2=0x7f789c0b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 --2- 172.21.15.73:0/2690093572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c0b66e0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7894009e80 tx=0x7f789400b330 comp rx=0 tx=0).stop 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- 172.21.15.73:0/2690093572 shutdown_connections 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 --2- 172.21.15.73:0/2690093572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c0b66e0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- 172.21.15.73:0/2690093572 >> 172.21.15.73:0/2690093572 conn(0x7f789c0cda70 msgr2=0x7f789c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- 172.21.15.73:0/2690093572 shutdown_connections 2023-12-19T17:51:16.020 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.014+0000 7f78a3a37700 1 -- 172.21.15.73:0/2690093572 wait complete. 2023-12-19T17:51:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 Processor -- start 2023-12-19T17:51:16.021 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 -- start start 2023-12-19T17:51:16.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c1584c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 0x7f789c0b4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f789c15e9d0 0x7f789c0c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.023 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0b5cf0 con 0x7f789c15e9d0 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c158a00 con 0x7f789c0b12d0 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f789c0b50e0 con 0x7f789c15ad80 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c1584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c1584c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53810/0 (socket says 172.21.15.73:53810) 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 -- 172.21.15.73:0/1436966921 learned_addr learned my addr 172.21.15.73:0/1436966921 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a1fd4700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f789c15e9d0 0x7f789c0c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.024 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a0fd2700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 0x7f789c0b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a0fd2700 1 -- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 msgr2=0x7f789c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a0fd2700 1 -- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 msgr2=0x7f789c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a0fd2700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 0x7f789c0b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 -- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 msgr2=0x7f789c0b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a0fd2700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 0x7f789c0b4700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 0x7f789c0b4700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 -- 172.21.15.73:0/1436966921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f789c15e9d0 msgr2=0x7f789c0c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f789c15e9d0 0x7f789c0c93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 -- 172.21.15.73:0/1436966921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7894009b30 con 0x7f789c0b12d0 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a17d3700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c1584c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f789800c500 tx=0x7f789800c810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980052d0 con 0x7f789c0b12d0 2023-12-19T17:51:16.026 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.018+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c0b53c0 con 0x7f789c0b12d0 2023-12-19T17:51:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.022+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898005430 con 0x7f789c0b12d0 2023-12-19T17:51:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.022+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78980055a0 con 0x7f789c0b12d0 2023-12-19T17:51:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.022+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c0b5980 con 0x7f789c0b12d0 2023-12-19T17:51:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.022+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f78980039a0 con 0x7f789c0b12d0 2023-12-19T17:51:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.022+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f7898011c20 con 0x7f789c0b12d0 2023-12-19T17:51:16.027 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.022+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c0b5b40 con 0x7f789c0b12d0 2023-12-19T17:51:16.030 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.026+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f7898020060 con 0x7f789c0b12d0 2023-12-19T17:51:16.086 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:16.082+0000 7f746344d2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-19T17:51:16.105 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.102+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f2cc4960-3c95-4886-ab16-0f5938ec61aa", "id": 5} v 0) v1 -- 0x7f789c04ed30 con 0x7f789c0b12d0 2023-12-19T17:51:16.114 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f7891ffb700 1 -- 172.21.15.73:0/1436966921 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f2cc4960-3c95-4886-ab16-0f5938ec61aa", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7898011e30 con 0x7f789c0b12d0 2023-12-19T17:51:16.115 INFO:teuthology.orchestra.run.smithi073.stdout:5 2023-12-19T17:51:16.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 msgr2=0x7f789c1584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c1584c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f789800c500 tx=0x7f789800c810 comp rx=0 tx=0).stop 2023-12-19T17:51:16.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 shutdown_connections 2023-12-19T17:51:16.116 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f789c15e9d0 0x7f789c0c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f789c15ad80 0x7f789c0b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 --2- 172.21.15.73:0/1436966921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f789c0b12d0 0x7f789c1584c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 >> 172.21.15.73:0/1436966921 conn(0x7f789c0cda70 msgr2=0x7f789c0cde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:16.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 shutdown_connections 2023-12-19T17:51:16.117 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.110+0000 7f78a3a37700 1 -- 172.21.15.73:0/1436966921 wait complete. 2023-12-19T17:51:16.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 65d94490-acb5-4505-a14a-cf9bb597ab69 6 2023-12-19T17:51:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 Processor -- start 2023-12-19T17:51:16.297 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 -- start start 2023-12-19T17:51:16.300 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6a1c15d090 0x7f6a1c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6a1c0cff40 0x7f6a1c0b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0d10e0 con 0x7f6a1c0cdff0 2023-12-19T17:51:16.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0b6040 con 0x7f6a1c15d090 2023-12-19T17:51:16.301 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.294+0000 7f6a22bdf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c0d13c0 con 0x7f6a1c0cff40 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1bfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f6a1c0cdff0 0x7f6a1c0cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57526/0 (socket says 172.21.15.73:57526) 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1bfff700 1 -- 172.21.15.73:0/1568993953 learned_addr learned my addr 172.21.15.73:0/1568993953 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2117c700 1 --2- 172.21.15.73:0/1568993953 >> v2:172.21.15.73:3300/0 conn(0x7f6a1c0cff40 0x7f6a1c0b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2097b700 1 --2- 172.21.15.73:0/1568993953 >> v2:172.21.15.45:3300/0 conn(0x7f6a1c15d090 0x7f6a1c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1b7fe700 1 -- 172.21.15.73:0/1568993953 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163771696 0 0) 0x7f6a1c0d10e0 con 0x7f6a1c0cdff0 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1b7fe700 1 -- 172.21.15.73:0/1568993953 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a040035d0 con 0x7f6a1c0cdff0 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2117c700 1 -- 172.21.15.73:0/1568993953 >> v2:172.21.15.45:3300/0 conn(0x7f6a1c15d090 msgr2=0x7f6a1c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:16.302 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2117c700 1 --2- 172.21.15.73:0/1568993953 >> v2:172.21.15.45:3300/0 conn(0x7f6a1c15d090 0x7f6a1c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2117c700 1 -- 172.21.15.73:0/1568993953 >> v1:172.21.15.73:6789/0 conn(0x7f6a1c0cdff0 legacy=0x7f6a1c0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2117c700 1 -- 172.21.15.73:0/1568993953 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0d16a0 con 0x7f6a1c0cff40 2023-12-19T17:51:16.303 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a2117c700 1 --2- 172.21.15.73:0/1568993953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c0cff40 0x7f6a1c0b6490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0b6180 tx=0x7f6a1400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f2a2b9cd6821a8ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1b7fe700 1 -- 172.21.15.73:0/1568993953 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14016070 con 0x7f6a1c0cff40 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1b7fe700 1 -- 172.21.15.73:0/1568993953 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a1400baf0 con 0x7f6a1c0cff40 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a1b7fe700 1 -- 172.21.15.73:0/1568993953 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1400e070 con 0x7f6a1c0cff40 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 -- 172.21.15.73:0/1568993953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c0cff40 msgr2=0x7f6a1c0b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/1568993953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c0cff40 0x7f6a1c0b6490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c0b6180 tx=0x7f6a1400b330 comp rx=0 tx=0).stop 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 -- 172.21.15.73:0/1568993953 shutdown_connections 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/1568993953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c0cff40 0x7f6a1c0b6490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/1568993953 >> v2:172.21.15.45:3300/0 conn(0x7f6a1c15d090 0x7f6a1c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 -- 172.21.15.73:0/1568993953 >> 172.21.15.73:0/1568993953 conn(0x7f6a1c0b4b90 msgr2=0x7f6a1c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 -- 172.21.15.73:0/1568993953 shutdown_connections 2023-12-19T17:51:16.304 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.298+0000 7f6a22bdf700 1 -- 172.21.15.73:0/1568993953 wait complete. 2023-12-19T17:51:16.305 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:16.302+0000 7f9d765bf2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T17:51:16.305 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 Processor -- start 2023-12-19T17:51:16.306 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 -- start start 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0cdff0 0x7f6a1c0cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c15d090 0x7f6a1c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0ccd70 con 0x7f6a1c0cdff0 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c9570 con 0x7f6a1c15d090 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a22bdf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c0c9850 con 0x7f6a1c0cff40 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39694/0 (socket says 172.21.15.73:39694) 2023-12-19T17:51:16.308 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 -- 172.21.15.73:0/3913940567 learned_addr learned my addr 172.21.15.73:0/3913940567 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a2097b700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0cdff0 0x7f6a1c0cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a2117c700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c15d090 0x7f6a1c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 -- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 msgr2=0x7f6a1c1f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 -- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 msgr2=0x7f6a1c1f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a1bfff700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a2117c700 1 -- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 msgr2=0x7f6a1c1f5000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a2117c700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a2117c700 1 -- 172.21.15.73:0/3913940567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0cdff0 msgr2=0x7f6a1c0cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.302+0000 7f6a2117c700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0cdff0 0x7f6a1c0cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a2117c700 1 -- 172.21.15.73:0/3913940567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a14009a70 con 0x7f6a1c15d090 2023-12-19T17:51:16.310 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a2117c700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c15d090 0x7f6a1c157380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6a14015000 tx=0x7f6a14004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a14016040 con 0x7f6a1c15d090 2023-12-19T17:51:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a14004930 con 0x7f6a1c15d090 2023-12-19T17:51:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c0c9ff0 con 0x7f6a1c15d090 2023-12-19T17:51:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a1401b660 con 0x7f6a1c15d090 2023-12-19T17:51:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c0ca5b0 con 0x7f6a1c15d090 2023-12-19T17:51:16.311 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a1401bac0 con 0x7f6a1c15d090 2023-12-19T17:51:16.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6a14012430 con 0x7f6a1c15d090 2023-12-19T17:51:16.312 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.306+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c0ca7a0 con 0x7f6a1c15d090 2023-12-19T17:51:16.315 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.310+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f6a14021070 con 0x7f6a1c15d090 2023-12-19T17:51:16.334 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:16.330+0000 7f746344d2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-19T17:51:16.394 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.390+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "65d94490-acb5-4505-a14a-cf9bb597ab69", "id": 6} v 0) v1 -- 0x7f6a1c04ed30 con 0x7f6a1c15d090 2023-12-19T17:51:16.402 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a197fa700 1 -- 172.21.15.73:0/3913940567 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "65d94490-acb5-4505-a14a-cf9bb597ab69", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a14026450 con 0x7f6a1c15d090 2023-12-19T17:51:16.402 INFO:teuthology.orchestra.run.smithi073.stdout:6 2023-12-19T17:51:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c15d090 msgr2=0x7f6a1c157380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c15d090 0x7f6a1c157380 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6a14015000 tx=0x7f6a14004af0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 shutdown_connections 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a1c15d090 0x7f6a1c157380 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6a1c0cff40 0x7f6a1c1f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 --2- 172.21.15.73:0/3913940567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6a1c0cdff0 0x7f6a1c0cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 >> 172.21.15.73:0/3913940567 conn(0x7f6a1c0b4b90 msgr2=0x7f6a1c15bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 shutdown_connections 2023-12-19T17:51:16.404 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.398+0000 7f6a22bdf700 1 -- 172.21.15.73:0/3913940567 wait complete. 2023-12-19T17:51:16.427 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --cluster ceph osd new 08d75aaa-2503-4a4a-8992-e38f8e8556ee 7 2023-12-19T17:51:16.428 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:16.422+0000 7f746344d2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-19T17:51:16.487 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:16.486+0000 7f9d765bf2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T17:51:16.527 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:16.522+0000 7f746344d2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-19T17:51:16.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.590+0000 7f609945d700 1 Processor -- start 2023-12-19T17:51:16.596 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.590+0000 7f609945d700 1 -- start start 2023-12-19T17:51:16.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f609945d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f60940713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f609945d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6094071d70 con 0x7f6094071910 2023-12-19T17:51:16.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f609945d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60940b1b80 con 0x7f60940cba10 2023-12-19T17:51:16.598 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f609945d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60941447c0 con 0x7f60941443e0 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6098c5c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f60940cba10 0x7f60940b2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.73:57536/0 (socket says 172.21.15.73:57536) 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6098c5c700 1 -- 172.21.15.73:0/2376558699 learned_addr learned my addr 172.21.15.73:0/2376558699 (peer_addr_for_me v1:172.21.15.73:0/0) 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6093fff700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f60940713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6093fff700 1 -- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 msgr2=0x7f60940713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6093fff700 1 -- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 msgr2=0x7f60940713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6093fff700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f60940713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6093fff700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f60940713d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910195769 0 0) 0x7f6094071d70 con 0x7f6094071910 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f607c0035d0 con 0x7f6094071910 2023-12-19T17:51:16.599 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400712904 0 0) 0x7f60940b1b80 con 0x7f60940cba10 2023-12-19T17:51:16.600 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6094071d70 con 0x7f60940cba10 2023-12-19T17:51:16.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2562459177 0 0) 0x7f6094071d70 con 0x7f60940cba10 2023-12-19T17:51:16.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 msgr2=0x7f60940713d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:16.601 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f60940713d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 >> v1:172.21.15.45:6789/0 conn(0x7f6094071910 legacy=0x7f60940cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940b1830 con 0x7f60940cba10 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f608c001a40 con 0x7f60940cba10 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 >> v1:172.21.15.73:6789/0 conn(0x7f60940cba10 legacy=0x7f60940b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c004c10 0x7f607c005010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f607c003810 0x7f607c003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f607c0041d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60941447c0 con 0x7f607c004c10 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607c00bb30 con 0x7f607c003810 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607c00bcf0 con 0x7f60941443e0 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f60937fe700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f607c003810 0x7f607c003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6098c5c700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f607c0041d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.602 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f6093fff700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c004c10 0x7f607c005010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f60937fe700 1 -- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 msgr2=0x7f607c0041d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f60937fe700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941443e0 0x7f607c0041d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f60937fe700 1 -- 172.21.15.73:0/2376558699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c004c10 msgr2=0x7f607c005010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f60937fe700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f607c004c10 0x7f607c005010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.594+0000 7f60937fe700 1 -- 172.21.15.73:0/2376558699 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6094071d70 con 0x7f607c003810 2023-12-19T17:51:16.603 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f60937fe700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f607c003810 0x7f607c003c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6088001990 tx=0x7f607c0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f873a6a97fbaba7b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60880052d0 con 0x7f607c003810 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6088005450 con 0x7f607c003810 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f6092ffd700 1 -- 172.21.15.73:0/2376558699 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60880038e0 con 0x7f607c003810 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f609945d700 1 -- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f607c003810 msgr2=0x7f607c003c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f609945d700 1 --2- 172.21.15.73:0/2376558699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f607c003810 0x7f607c003c90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6088001990 tx=0x7f607c0058a0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f6098c5c700 1 -- 172.21.15.73:0/2376558699 reap_dead start 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f609945d700 1 -- 172.21.15.73:0/2376558699 shutdown_connections 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f609945d700 1 -- 172.21.15.73:0/2376558699 >> 172.21.15.73:0/2376558699 conn(0x7f60940cf5a0 msgr2=0x7f6094070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:16.604 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f609945d700 1 -- 172.21.15.73:0/2376558699 shutdown_connections 2023-12-19T17:51:16.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.598+0000 7f609945d700 1 -- 172.21.15.73:0/2376558699 wait complete. 2023-12-19T17:51:16.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 Processor -- start 2023-12-19T17:51:16.605 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 -- start start 2023-12-19T17:51:16.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 0x7f609415d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609415d610 0x7f609413bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:16.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f609415da90 con 0x7f609415d610 2023-12-19T17:51:16.608 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60940a88b0 con 0x7f609413e120 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60940a79d0 con 0x7f60941efab0 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 0x7f609415d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6093fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 0x7f609415d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:53840/0 (socket says 172.21.15.73:53840) 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6093fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.73:39704/0 (socket says 172.21.15.73:39704) 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 -- 172.21.15.73:0/2066079734 learned_addr learned my addr 172.21.15.73:0/2066079734 (peer_addr_for_me v2:172.21.15.73:0/0) 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6098c5c700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609415d610 0x7f609413bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6093fff700 1 -- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 msgr2=0x7f60940a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6093fff700 1 -- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 msgr2=0x7f60940a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6093fff700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6093fff700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 -- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 msgr2=0x7f60940a7490 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:16.609 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 -- 172.21.15.73:0/2066079734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609415d610 msgr2=0x7f609413bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609415d610 0x7f609413bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 -- 172.21.15.73:0/2066079734 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60940a7ca0 con 0x7f609413e120 2023-12-19T17:51:16.610 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f60937fe700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 0x7f609415d0d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f607c00bcc0 tx=0x7f60880012d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6088001440 con 0x7f609413e120 2023-12-19T17:51:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f608800c650 con 0x7f609413e120 2023-12-19T17:51:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f608800ca00 con 0x7f609413e120 2023-12-19T17:51:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.602+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60940a7f80 con 0x7f609413e120 2023-12-19T17:51:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.606+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60940a8540 con 0x7f609413e120 2023-12-19T17:51:16.611 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.606+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6088019070 con 0x7f609413e120 2023-12-19T17:51:16.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.606+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f608800ce60 con 0x7f609413e120 2023-12-19T17:51:16.612 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.606+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f609404ed30 con 0x7f609413e120 2023-12-19T17:51:16.614 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.610+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f608802b020 con 0x7f609413e120 2023-12-19T17:51:16.758 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.754+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd new", "uuid": "08d75aaa-2503-4a4a-8992-e38f8e8556ee", "id": 7} v 0) v1 -- 0x7f60940b0ce0 con 0x7f609413e120 2023-12-19T17:51:16.768 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.762+0000 7f6090ff9700 1 -- 172.21.15.73:0/2066079734 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "08d75aaa-2503-4a4a-8992-e38f8e8556ee", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6088021070 con 0x7f609413e120 2023-12-19T17:51:16.768 INFO:teuthology.orchestra.run.smithi073.stdout:7 2023-12-19T17:51:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 msgr2=0x7f609415d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:16.770 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 0x7f609415d0d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f607c00bcc0 tx=0x7f60880012d0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 shutdown_connections 2023-12-19T17:51:16.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f609415d610 0x7f609413bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f609413e120 0x7f609415d0d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.771 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 --2- 172.21.15.73:0/2066079734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60941efab0 0x7f60940a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:16.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 >> 172.21.15.73:0/2066079734 conn(0x7f607c003810 msgr2=0x7f609406df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:16.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 shutdown_connections 2023-12-19T17:51:16.772 INFO:teuthology.orchestra.run.smithi073.stderr:2023-12-19T17:51:16.766+0000 7f609945d700 1 -- 172.21.15.73:0/2066079734 wait complete. 2023-12-19T17:51:16.792 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-19T17:51:16.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-19T17:51:16.798 INFO:tasks.ceph.osd.0:Started 2023-12-19T17:51:16.799 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-19T17:51:16.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-19T17:51:16.804 INFO:tasks.ceph.osd.1:Started 2023-12-19T17:51:16.804 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-19T17:51:16.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-19T17:51:16.809 INFO:tasks.ceph.osd.2:Started 2023-12-19T17:51:16.809 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-19T17:51:16.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-19T17:51:16.816 INFO:tasks.ceph.osd.3:Started 2023-12-19T17:51:16.816 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-19T17:51:16.817 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-19T17:51:16.823 INFO:tasks.ceph.osd.4:Started 2023-12-19T17:51:16.823 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-19T17:51:16.824 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-19T17:51:16.828 INFO:tasks.ceph.osd.5:Started 2023-12-19T17:51:16.828 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-19T17:51:16.828 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-19T17:51:16.832 INFO:tasks.ceph.osd.6:Started 2023-12-19T17:51:16.832 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-19T17:51:16.833 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-19T17:51:16.838 INFO:tasks.ceph.osd.7:Started 2023-12-19T17:51:16.838 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:16.965 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:16.962+0000 7f9d765bf2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T17:51:17.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 Processor -- start 2023-12-19T17:51:17.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 -- start start 2023-12-19T17:51:17.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 0x7feba406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:17.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feba406efd0 0x7feba40cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:17.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feba40ae1e0 con 0x7feba415ab50 2023-12-19T17:51:17.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feba415af30 con 0x7feba406efd0 2023-12-19T17:51:17.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.026+0000 7feba893c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40cd010 con 0x7feba415e260 2023-12-19T17:51:17.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feba415ab50 0x7feba40adad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56450/0 (socket says 172.21.15.45:56450) 2023-12-19T17:51:17.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feb99d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 0x7feba406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:17.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba259c700 1 -- 172.21.15.45:0/1828393319 learned_addr learned my addr 172.21.15.45:0/1828393319 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:17.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba2d9d700 1 --2- 172.21.15.45:0/1828393319 >> v2:172.21.15.73:3300/0 conn(0x7feba406efd0 0x7feba40cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:17.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feb99d9b700 1 -- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 msgr2=0x7feba406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-19T17:51:17.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feb99d9b700 1 -- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 msgr2=0x7feba406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:17.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feb99d9b700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 0x7feba406ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:17.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feb99d9b700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 0x7feba406ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba2d9d700 1 -- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 msgr2=0x7feba406ea90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba2d9d700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 0x7feba406ea90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba2d9d700 1 -- 172.21.15.45:0/1828393319 >> v1:172.21.15.45:6789/0 conn(0x7feba415ab50 legacy=0x7feba40adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba2d9d700 1 -- 172.21.15.45:0/1828393319 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba40cd2f0 con 0x7feba406efd0 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba1d9b700 1 -- 172.21.15.45:0/1828393319 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3920384888 0 0) 0x7feb94001490 con 0x7feba415ab50 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba2d9d700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba406efd0 0x7feba40cddd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009840 tx=0x7feb9c009b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3eba19b9dcf66168 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba1d9b700 1 -- 172.21.15.45:0/1828393319 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c005ea0 con 0x7feba406efd0 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba1d9b700 1 -- 172.21.15.45:0/1828393319 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9c006030 con 0x7feba406efd0 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba1d9b700 1 -- 172.21.15.45:0/1828393319 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9c0063c0 con 0x7feba406efd0 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 -- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba406efd0 msgr2=0x7feba40cddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba406efd0 0x7feba40cddd0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7feb9c009840 tx=0x7feb9c009b50 comp rx=0 tx=0).stop 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 -- 172.21.15.45:0/1828393319 shutdown_connections 2023-12-19T17:51:17.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba406efd0 0x7feba40cddd0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 --2- 172.21.15.45:0/1828393319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415e260 0x7feba406ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 -- 172.21.15.45:0/1828393319 >> 172.21.15.45:0/1828393319 conn(0x7feba40cba40 msgr2=0x7feba40ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:17.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 -- 172.21.15.45:0/1828393319 shutdown_connections 2023-12-19T17:51:17.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.030+0000 7feba893c700 1 -- 172.21.15.45:0/1828393319 wait complete. 2023-12-19T17:51:17.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 Processor -- start 2023-12-19T17:51:17.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 -- start start 2023-12-19T17:51:17.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 0x7feba40ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:17.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 0x7feba41f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:17.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba415e260 0x7feba41f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:17.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40acf30 con 0x7feba406efd0 2023-12-19T17:51:17.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feba40ac320 con 0x7feba415e260 2023-12-19T17:51:17.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feba40ac600 con 0x7feba415ab50 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 0x7feba40ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 0x7feba40ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38034/0 (socket says 172.21.15.45:38034) 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 -- 172.21.15.45:0/1316415879 learned_addr learned my addr 172.21.15.45:0/1316415879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb99d9b700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 0x7feba41f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba2d9d700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba415e260 0x7feba41f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb99d9b700 1 -- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 msgr2=0x7feba41f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb99d9b700 1 -- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 msgr2=0x7feba41f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb99d9b700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 0x7feba41f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb99d9b700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 0x7feba41f2130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 -- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 msgr2=0x7feba41f2130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 0x7feba41f2130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 -- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba415e260 msgr2=0x7feba41f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba415e260 0x7feba41f2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 -- 172.21.15.45:0/1316415879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb9c0094a0 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba259c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 0x7feba40ab8a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb9400cc20 tx=0x7feb9400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9400ac20 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9400ad80 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb94007310 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.034+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feba40ac8e0 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.038+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feba414ec30 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.038+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feb94007770 con 0x7feba406efd0 2023-12-19T17:51:17.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.038+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7feb94007a20 con 0x7feba406efd0 2023-12-19T17:51:17.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.038+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feba40703c0 con 0x7feba406efd0 2023-12-19T17:51:17.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.042+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7feb94018070 con 0x7feba406efd0 2023-12-19T17:51:17.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.106+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feba404ed30 con 0x7feba406efd0 2023-12-19T17:51:17.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.106+0000 7feb9b7fe700 1 -- 172.21.15.45:0/1316415879 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7feba40ae1e0 con 0x7feba406efd0 2023-12-19T17:51:17.110 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:17.110 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":10,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:16.760094+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 msgr2=0x7feba40ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 0x7feba40ab8a0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feb9400cc20 tx=0x7feb9400a060 comp rx=0 tx=0).stop 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 shutdown_connections 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feba415e260 0x7feba41f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feba415ab50 0x7feba41f2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 --2- 172.21.15.45:0/1316415879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feba406efd0 0x7feba40ab8a0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 >> 172.21.15.45:0/1316415879 conn(0x7feba40cba40 msgr2=0x7feba406cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 shutdown_connections 2023-12-19T17:51:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:17.110+0000 7feba893c700 1 -- 172.21.15.45:0/1316415879 wait complete. 2023-12-19T17:51:17.133 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-19T17:51:17.133 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-19T17:51:17.149 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:17.142+0000 7f746344d2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-19T17:51:17.204 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:17.202+0000 7f9d765bf2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T17:51:17.305 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:17.302+0000 7f9d765bf2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T17:51:17.329 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:17.326+0000 7f746344d2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-19T17:51:17.380 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:17.378+0000 7f9d765bf2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T17:51:17.464 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-19T17:51:17.462+0000 7f6ffd25a700 -1 Falling back to public interface 2023-12-19T17:51:17.473 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-19T17:51:17.470+0000 7f7379ddb700 -1 Falling back to public interface 2023-12-19T17:51:17.487 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-12-19T17:51:17.482+0000 7fe489571700 -1 Falling back to public interface 2023-12-19T17:51:17.488 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-12-19T17:51:17.482+0000 7fb3a3745700 -1 Falling back to public interface 2023-12-19T17:51:17.489 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-19T17:51:17.486+0000 7f2a7e76f700 -1 Falling back to public interface 2023-12-19T17:51:17.498 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-12-19T17:51:17.494+0000 7fb00c9fb700 -1 Falling back to public interface 2023-12-19T17:51:17.500 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-19T17:51:17.498+0000 7f2ceda39700 -1 Falling back to public interface 2023-12-19T17:51:17.523 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-12-19T17:51:17.518+0000 7f1333e47700 -1 Falling back to public interface 2023-12-19T17:51:17.777 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:17.774+0000 7f746344d2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-19T17:51:17.939 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:18.029 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:18.022+0000 7f746344d2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-19T17:51:18.094 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.090+0000 7fd1a749f700 1 Processor -- start 2023-12-19T17:51:18.095 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.090+0000 7fd1a749f700 1 -- start start 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a749f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a0070d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a749f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1a00ad600 0x7fd1a00ada90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a749f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a0071270 con 0x7fd1a015afc0 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a749f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a00adfd0 con 0x7fd1a00ad600 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a749f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a006d3e0 con 0x7fd1a00708d0 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a6c9e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd1a00ad600 0x7fd1a00ada90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a649d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd1a015afc0 0x7fd1a006e130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:53484/0 (socket says 172.21.15.45:53484) 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a649d700 1 -- 172.21.15.45:0/320084544 learned_addr learned my addr 172.21.15.45:0/320084544 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a5c9c700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a0070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a5c9c700 1 -- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 msgr2=0x7fd1a0070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a5c9c700 1 -- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 msgr2=0x7fd1a0070d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a5c9c700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a0070d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:18.099 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a5c9c700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a0070d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a6c9e700 1 -- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 msgr2=0x7fd1a0070d30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a6c9e700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a0070d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a6c9e700 1 -- 172.21.15.45:0/320084544 >> v1:172.21.15.73:6789/0 conn(0x7fd1a015afc0 legacy=0x7fd1a006e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a6c9e700 1 -- 172.21.15.45:0/320084544 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a006d650 con 0x7fd1a00ad600 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a549b700 1 -- 172.21.15.45:0/320084544 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3284213696 0 0) 0x7fd1a0071270 con 0x7fd1a015afc0 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a6c9e700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a00ada90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd198009d90 tx=0x7fd19800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba2c1d2263bd0e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a549b700 1 -- 172.21.15.45:0/320084544 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800e070 con 0x7fd1a00ad600 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a549b700 1 -- 172.21.15.45:0/320084544 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd19800bbd0 con 0x7fd1a00ad600 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.094+0000 7fd1a549b700 1 -- 172.21.15.45:0/320084544 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198012430 con 0x7fd1a00ad600 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 -- 172.21.15.45:0/320084544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 msgr2=0x7fd1a00ada90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:18.100 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a00ada90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd198009d90 tx=0x7fd19800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:18.101 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 -- 172.21.15.45:0/320084544 shutdown_connections 2023-12-19T17:51:18.101 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a00ada90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.101 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 --2- 172.21.15.45:0/320084544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a0070d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.101 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 -- 172.21.15.45:0/320084544 >> 172.21.15.45:0/320084544 conn(0x7fd1a00cea60 msgr2=0x7fd1a00cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:18.101 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 -- 172.21.15.45:0/320084544 shutdown_connections 2023-12-19T17:51:18.101 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 -- 172.21.15.45:0/320084544 wait complete. 2023-12-19T17:51:18.102 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 Processor -- start 2023-12-19T17:51:18.102 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.098+0000 7fd1a749f700 1 -- start start 2023-12-19T17:51:18.103 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a014db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:18.103 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a0152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1a015afc0 0x7fd1a01531c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a01f3820 con 0x7fd1a00ad600 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a0153700 con 0x7fd1a015afc0 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a014e070 con 0x7fd1a00708d0 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a0152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a0152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38048/0 (socket says 172.21.15.45:38048) 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 -- 172.21.15.45:0/385858695 learned_addr learned my addr 172.21.15.45:0/385858695 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:18.104 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a649d700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a014db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:18.105 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a649d700 1 -- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 msgr2=0x7fd1a014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a649d700 1 -- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 msgr2=0x7fd1a014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 -- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 msgr2=0x7fd1a014db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a649d700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a014db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a649d700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a014db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a6c9e700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1a015afc0 0x7fd1a01531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a014db30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 -- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1a015afc0 msgr2=0x7fd1a01531c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1a015afc0 0x7fd1a01531c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 -- 172.21.15.45:0/385858695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd198009a70 con 0x7fd1a00ad600 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a5c9c700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a0152c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd19000e810 tx=0x7fd19000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190013610 con 0x7fd1a00ad600 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd190013770 con 0x7fd1a00ad600 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a014e4f0 con 0x7fd1a00ad600 2023-12-19T17:51:18.106 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190013b20 con 0x7fd1a00ad600 2023-12-19T17:51:18.107 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a01f3d50 con 0x7fd1a00ad600 2023-12-19T17:51:18.107 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd19001c450 con 0x7fd1a00ad600 2023-12-19T17:51:18.107 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.102+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fd190012b30 con 0x7fd1a00ad600 2023-12-19T17:51:18.107 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.106+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a01e38e0 con 0x7fd1a00ad600 2023-12-19T17:51:18.110 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.106+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fd190021060 con 0x7fd1a00ad600 2023-12-19T17:51:18.134 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:18.130+0000 7f746344d2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-19T17:51:18.185 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.182+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a0067760 con 0x7fd1a00ad600 2023-12-19T17:51:18.186 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.182+0000 7fd196ffd700 1 -- 172.21.15.45:0/385858695 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd19002b090 con 0x7fd1a00ad600 2023-12-19T17:51:18.186 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-19T17:51:18.186 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":10,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:16.760094+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:18.187 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 msgr2=0x7fd1a0152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a0152c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd19000e810 tx=0x7fd19000ebd0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 shutdown_connections 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1a015afc0 0x7fd1a01531c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1a00ad600 0x7fd1a0152c80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 --2- 172.21.15.45:0/385858695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1a00708d0 0x7fd1a014db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 >> 172.21.15.45:0/385858695 conn(0x7fd1a00cea60 msgr2=0x7fd1a00cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 shutdown_connections 2023-12-19T17:51:18.188 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:18.186+0000 7fd1a749f700 1 -- 172.21.15.45:0/385858695 wait complete. 2023-12-19T17:51:18.202 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T17:51:18.224 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:18.218+0000 7f746344d2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-19T17:51:18.282 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:18.278+0000 7f9d765bf2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T17:51:18.379 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:18.378+0000 7f9d765bf2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T17:51:18.556 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:18.554+0000 7f9d765bf2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T17:51:18.650 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:18.646+0000 7f9d765bf2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T17:51:18.757 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:18.754+0000 7f9d765bf2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T17:51:18.993 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:18.990+0000 7f9d765bf2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T17:51:19.099 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.094+0000 7f746344d2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-19T17:51:19.188 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.182+0000 7f746344d2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-19T17:51:19.275 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:19.274+0000 7f9d765bf2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T17:51:19.363 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.358+0000 7f746344d2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-19T17:51:19.448 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.442+0000 7f746344d2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-19T17:51:19.542 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.538+0000 7f746344d2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-19T17:51:19.756 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.750+0000 7f746344d2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-19T17:51:20.003 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:19.998+0000 7f746344d2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-19T17:51:20.163 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:20.162+0000 7f9d765bf2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T17:51:20.900 INFO:tasks.ceph.mgr.x.smithi073.stderr:2023-12-19T17:51:20.894+0000 7f746344d2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-19T17:51:21.199 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:21.198+0000 7f9d5d63f700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-19T17:51:21.199 INFO:tasks.ceph.mgr.y.smithi045.stderr:2023-12-19T17:51:21.198+0000 7f9d5d63f700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-19T17:51:21.232 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-12-19T17:51:21.226+0000 7fe489571700 -1 osd.7 0 log_to_monitors true 2023-12-19T17:51:21.285 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-12-19T17:51:21.278+0000 7fb3a3745700 -1 osd.4 0 log_to_monitors true 2023-12-19T17:51:21.416 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-12-19T17:51:21.410+0000 7fb00c9fb700 -1 osd.6 0 log_to_monitors true 2023-12-19T17:51:21.426 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-19T17:51:21.422+0000 7f6ffd25a700 -1 osd.1 0 log_to_monitors true 2023-12-19T17:51:21.495 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-19T17:51:21.494+0000 7f7379ddb700 -1 osd.0 0 log_to_monitors true 2023-12-19T17:51:21.516 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-12-19T17:51:21.510+0000 7f1333e47700 -1 osd.5 0 log_to_monitors true 2023-12-19T17:51:21.531 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-19T17:51:21.530+0000 7f2a7e76f700 -1 osd.3 0 log_to_monitors true 2023-12-19T17:51:21.565 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-19T17:51:21.562+0000 7f2ceda39700 -1 osd.2 0 log_to_monitors true 2023-12-19T17:51:25.010 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:25.105 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-19T17:51:25.102+0000 7f7375c1a700 -1 osd.0 0 waiting for initial osdmap 2023-12-19T17:51:25.128 INFO:tasks.ceph.osd.0.smithi045.stderr:2023-12-19T17:51:25.126+0000 7f736d5f0700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.175 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-19T17:51:25.174+0000 7f2a7a5ae700 -1 osd.3 0 waiting for initial osdmap 2023-12-19T17:51:25.186 INFO:tasks.ceph.osd.3.smithi045.stderr:2023-12-19T17:51:25.182+0000 7f2a71ff0700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.190 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-19T17:51:25.190+0000 7f2ce9878700 -1 osd.2 0 waiting for initial osdmap 2023-12-19T17:51:25.198 INFO:tasks.ceph.osd.2.smithi045.stderr:2023-12-19T17:51:25.194+0000 7f2ce11f0700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.206 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-19T17:51:25.202+0000 7f6ff9a20700 -1 osd.1 0 waiting for initial osdmap 2023-12-19T17:51:25.207 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 Processor -- start 2023-12-19T17:51:25.208 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 -- start start 2023-12-19T17:51:25.209 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f934015cfa0 0x7f93400d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:25.209 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93400ce2b0 0x7f93400b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:25.210 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93400d2a90 con 0x7f93400b8a10 2023-12-19T17:51:25.210 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93400d19f0 con 0x7f93400ce2b0 2023-12-19T17:51:25.210 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93400d1cd0 con 0x7f934015cfa0 2023-12-19T17:51:25.210 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93400ce2b0 0x7f93400b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:25.210 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93400ce2b0 0x7f93400b5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42824/0 (socket says 172.21.15.45:42824) 2023-12-19T17:51:25.210 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.206+0000 7f933ed9d700 1 -- 172.21.15.45:0/4112684216 learned_addr learned my addr 172.21.15.45:0/4112684216 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:25.211 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933ed9d700 1 -- 172.21.15.45:0/4112684216 >> v2:172.21.15.73:3300/0 conn(0x7f934015cfa0 msgr2=0x7f93400d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:25.211 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933ed9d700 1 --2- 172.21.15.45:0/4112684216 >> v2:172.21.15.73:3300/0 conn(0x7f934015cfa0 0x7f93400d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.211 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933ed9d700 1 -- 172.21.15.45:0/4112684216 >> v1:172.21.15.73:6789/0 conn(0x7f93400b8a10 legacy=0x7f93400cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:25.211 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933ed9d700 1 -- 172.21.15.45:0/4112684216 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400d1fb0 con 0x7f93400ce2b0 2023-12-19T17:51:25.211 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933ed9d700 1 --2- 172.21.15.45:0/4112684216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400b5f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f934008ae50 tx=0x7f933800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3b572446c1ac52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:25.212 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933d59a700 1 -- 172.21.15.45:0/4112684216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800e070 con 0x7f93400ce2b0 2023-12-19T17:51:25.212 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933d59a700 1 -- 172.21.15.45:0/4112684216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800b950 con 0x7f93400ce2b0 2023-12-19T17:51:25.212 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933d59a700 1 -- 172.21.15.45:0/4112684216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933800bd00 con 0x7f93400ce2b0 2023-12-19T17:51:25.212 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 -- 172.21.15.45:0/4112684216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 msgr2=0x7f93400b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:25.212 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 --2- 172.21.15.45:0/4112684216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400b5f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f934008ae50 tx=0x7f933800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:25.213 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 -- 172.21.15.45:0/4112684216 shutdown_connections 2023-12-19T17:51:25.213 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 --2- 172.21.15.45:0/4112684216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400b5f00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.213 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 --2- 172.21.15.45:0/4112684216 >> v2:172.21.15.73:3300/0 conn(0x7f934015cfa0 0x7f93400d11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.213 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 -- 172.21.15.45:0/4112684216 >> 172.21.15.45:0/4112684216 conn(0x7f93400cf850 msgr2=0x7f93400cfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:25.213 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 -- 172.21.15.45:0/4112684216 shutdown_connections 2023-12-19T17:51:25.213 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f933f59e700 1 -- 172.21.15.45:0/4112684216 wait complete. 2023-12-19T17:51:25.215 INFO:tasks.ceph.osd.1.smithi045.stderr:2023-12-19T17:51:25.210+0000 7f6ff09f0700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.216 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 Processor -- start 2023-12-19T17:51:25.216 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 -- start start 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93400b8a10 0x7f93401f1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f934015cfa0 0x7f9340158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f934013b860 con 0x7f93400ce2b0 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93400ca1b0 con 0x7f93400b8a10 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93400c8560 con 0x7f934015cfa0 2023-12-19T17:51:25.218 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:25.219 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933e59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93400b8a10 0x7f93401f1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:25.219 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42832/0 (socket says 172.21.15.45:42832) 2023-12-19T17:51:25.219 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933dd9b700 1 -- 172.21.15.45:0/1251289861 learned_addr learned my addr 172.21.15.45:0/1251289861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:25.219 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.214+0000 7f933ed9d700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f934015cfa0 0x7f9340158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933dd9b700 1 -- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f934015cfa0 msgr2=0x7f9340158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933dd9b700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f934015cfa0 0x7f9340158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933dd9b700 1 -- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93400b8a10 msgr2=0x7f93401f1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933dd9b700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93400b8a10 0x7f93401f1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933dd9b700 1 -- 172.21.15.45:0/1251289861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9338009b30 con 0x7f93400ce2b0 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933dd9b700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400cca50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f933400b4d0 tx=0x7f933400b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933400bea0 con 0x7f93400ce2b0 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9334011850 con 0x7f93400ce2b0 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9334011c00 con 0x7f93400ce2b0 2023-12-19T17:51:25.220 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f934013ac50 con 0x7f93400ce2b0 2023-12-19T17:51:25.221 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f934013b210 con 0x7f93400ce2b0 2023-12-19T17:51:25.221 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93400c6fd0 con 0x7f93400ce2b0 2023-12-19T17:51:25.222 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.218+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 4) v1 ==== 85172+0+0 (secure 0 0 0) 0x7f933401a400 con 0x7f93400ce2b0 2023-12-19T17:51:25.223 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.222+0000 7f932effd700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9320065a40 0x7f9320067f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:25.223 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.222+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f93340821f0 con 0x7f93400ce2b0 2023-12-19T17:51:25.224 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.222+0000 7f933e59c700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9320065a40 0x7f9320067f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:25.224 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.222+0000 7f933e59c700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9320065a40 0x7f9320067f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9330009ac0 tx=0x7f93300091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:25.228 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.226+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f93400c6fd0 con 0x7f93400ce2b0 2023-12-19T17:51:25.411 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.410+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93400c6fd0 con 0x7f93400ce2b0 2023-12-19T17:51:25.412 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.410+0000 7f932effd700 1 -- 172.21.15.45:0/1251289861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f93400c6fd0 con 0x7f93400ce2b0 2023-12-19T17:51:25.412 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-19T17:51:25.412 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":12,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:23.240573+0000","last_up_change":"0.000000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:25.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9320065a40 msgr2=0x7f9320067f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:25.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9320065a40 0x7f9320067f00 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9330009ac0 tx=0x7f93300091c0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 msgr2=0x7f93400cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:25.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400cca50 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f933400b4d0 tx=0x7f933400b7e0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 shutdown_connections 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9320065a40 0x7f9320067f00 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f934015cfa0 0x7f9340158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93400ce2b0 0x7f93400cca50 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 --2- 172.21.15.45:0/1251289861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93400b8a10 0x7f93401f1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 >> 172.21.15.45:0/1251289861 conn(0x7f93400cf850 msgr2=0x7f93400b5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 shutdown_connections 2023-12-19T17:51:25.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:25.414+0000 7f933f59e700 1 -- 172.21.15.45:0/1251289861 wait complete. 2023-12-19T17:51:25.432 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-19T17:51:25.618 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-12-19T17:51:25.613+0000 7fe4853b0700 -1 osd.7 0 waiting for initial osdmap 2023-12-19T17:51:25.625 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-12-19T17:51:25.613+0000 7f132fc86700 -1 osd.5 0 waiting for initial osdmap 2023-12-19T17:51:25.629 INFO:tasks.ceph.osd.7.smithi073.stderr:2023-12-19T17:51:25.621+0000 7fe47cdf0700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.633 INFO:tasks.ceph.osd.5.smithi073.stderr:2023-12-19T17:51:25.625+0000 7f13275f0700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.748 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-12-19T17:51:25.741+0000 7fb39ff0b700 -1 osd.4 0 waiting for initial osdmap 2023-12-19T17:51:25.759 INFO:tasks.ceph.osd.4.smithi073.stderr:2023-12-19T17:51:25.753+0000 7fb396ff0700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:25.778 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-12-19T17:51:25.773+0000 7fb00883a700 -1 osd.6 0 waiting for initial osdmap 2023-12-19T17:51:25.790 INFO:tasks.ceph.osd.6.smithi073.stderr:2023-12-19T17:51:25.785+0000 7fb0001f0700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-19T17:51:29.738 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:51:29.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:51:32.238 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:32.398 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.394+0000 7f38f63bc700 1 Processor -- start 2023-12-19T17:51:32.399 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f63bc700 1 -- start start 2023-12-19T17:51:32.400 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f63bc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38f01649e0 0x7f38f00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.400 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f63bc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f38f00718a0 0x7f38f00ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.400 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f63bc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38f00cd720 con 0x7f38f00cd2d0 2023-12-19T17:51:32.401 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f63bc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00ca050 con 0x7f38f00718a0 2023-12-19T17:51:32.401 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f63bc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38f00ca330 con 0x7f38f01649e0 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f5bbb700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f38f00cd2d0 0x7f38f00ad500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41868/0 (socket says 172.21.15.45:41868) 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f5bbb700 1 -- 172.21.15.45:0/1700352953 learned_addr learned my addr 172.21.15.45:0/1700352953 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f4bb9700 1 --2- 172.21.15.45:0/1700352953 >> v2:172.21.15.45:3300/0 conn(0x7f38f00718a0 0x7f38f00ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1700352953 >> v2:172.21.15.73:3300/0 conn(0x7f38f01649e0 0x7f38f00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553056642 0 0) 0x7f38e8001490 con 0x7f38f00cd2d0 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38dc0035d0 con 0x7f38f00cd2d0 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2686631892 0 0) 0x7f38dc0035d0 con 0x7f38f00cd2d0 2023-12-19T17:51:32.403 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 >> v2:172.21.15.73:3300/0 conn(0x7f38f01649e0 msgr2=0x7f38f00c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 --2- 172.21.15.45:0/1700352953 >> v2:172.21.15.73:3300/0 conn(0x7f38f01649e0 0x7f38f00c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 >> v2:172.21.15.45:3300/0 conn(0x7f38f00718a0 msgr2=0x7f38f00ccd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 --2- 172.21.15.45:0/1700352953 >> v2:172.21.15.45:3300/0 conn(0x7f38f00718a0 0x7f38f00ccd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f00ca610 con 0x7f38f00cd2d0 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f38e8001b80 con 0x7f38f00cd2d0 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 >> v1:172.21.15.45:6789/0 conn(0x7f38f00cd2d0 legacy=0x7f38f00ad500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc003a70 0x7f38dc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc004870 0x7f38dc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc005230 0x7f38dc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00ca050 con 0x7f38dc003a70 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.398+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f00ca330 con 0x7f38dc004870 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc00c0d0 con 0x7f38dc005230 2023-12-19T17:51:32.404 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc003a70 0x7f38dc003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.406 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f5bbb700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc005230 0x7f38dc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.406 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f4bb9700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc004870 0x7f38dc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 -- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc005230 msgr2=0x7f38dc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc005230 0x7f38dc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 -- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc004870 msgr2=0x7f38dc004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc004870 0x7f38dc004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 -- 172.21.15.45:0/1700352953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0035d0 con 0x7f38dc003a70 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f5bbb700 1 -- 172.21.15.45:0/1700352953 reap_dead start 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f4bb9700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc004870 0x7f38dc004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc003a70 0x7f38dc003e90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009b70 tx=0x7f38dc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad52a706655f5a5b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00e6c0 con 0x7f38dc003a70 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38ec00e820 con 0x7f38dc003a70 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38e7fff700 1 -- 172.21.15.45:0/1700352953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38ec00ebb0 con 0x7f38dc003a70 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 -- 172.21.15.45:0/1700352953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc003a70 msgr2=0x7f38dc003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc003a70 0x7f38dc003e90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38ec009b70 tx=0x7f38dc0058a0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 -- 172.21.15.45:0/1700352953 shutdown_connections 2023-12-19T17:51:32.407 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1700352953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc003a70 0x7f38dc003e90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.408 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 -- 172.21.15.45:0/1700352953 >> 172.21.15.45:0/1700352953 conn(0x7f38f00cea60 msgr2=0x7f38f00cee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:32.408 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 -- 172.21.15.45:0/1700352953 shutdown_connections 2023-12-19T17:51:32.408 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.402+0000 7f38f63bc700 1 -- 172.21.15.45:0/1700352953 wait complete. 2023-12-19T17:51:32.409 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.406+0000 7f38f63bc700 1 Processor -- start 2023-12-19T17:51:32.410 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.406+0000 7f38f63bc700 1 -- start start 2023-12-19T17:51:32.412 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc003a70 0x7f38f015e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.412 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38f015f790 0x7f38f014cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.412 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 0x7f38f00c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.412 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f015f300 con 0x7f38f015fe60 2023-12-19T17:51:32.412 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0161010 con 0x7f38dc003a70 2023-12-19T17:51:32.413 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f015e6f0 con 0x7f38f015f790 2023-12-19T17:51:32.413 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 0x7f38f00c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.413 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 0x7f38f00c6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41544/0 (socket says 172.21.15.45:41544) 2023-12-19T17:51:32.413 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 -- 172.21.15.45:0/1304819516 learned_addr learned my addr 172.21.15.45:0/1304819516 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:32.413 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc003a70 0x7f38f015e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.413 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f4bb9700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38f015f790 0x7f38f014cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 -- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38f015f790 msgr2=0x7f38f014cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38f015f790 0x7f38f014cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 -- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc003a70 msgr2=0x7f38f015e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc003a70 0x7f38f015e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 -- 172.21.15.45:0/1304819516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f015e9d0 con 0x7f38f015fe60 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f5bbb700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 0x7f38f00c6ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38e8000f80 tx=0x7f38e8007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800e830 con 0x7f38f015fe60 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e800e9b0 con 0x7f38f015fe60 2023-12-19T17:51:32.414 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e800ed60 con 0x7f38f015fe60 2023-12-19T17:51:32.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.410+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f015ecb0 con 0x7f38f015fe60 2023-12-19T17:51:32.415 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.414+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f014d2f0 con 0x7f38f015fe60 2023-12-19T17:51:32.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.414+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f0067760 con 0x7f38f015fe60 2023-12-19T17:51:32.416 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.414+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f38e801d460 con 0x7f38f015fe60 2023-12-19T17:51:32.418 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.414+0000 7f38e5ffb700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38d4065ad0 0x7f38d4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.418 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.414+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f38e8082da0 con 0x7f38f015fe60 2023-12-19T17:51:32.418 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.414+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38d4065ad0 0x7f38d4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.419 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.418+0000 7f38f53ba700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38d4065ad0 0x7f38d4067f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0090b0 tx=0x7f38ec01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:32.424 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.422+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f38e8050ab0 con 0x7f38f015fe60 2023-12-19T17:51:32.602 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.598+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38f00cd720 con 0x7f38f015fe60 2023-12-19T17:51:32.603 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38e5ffb700 1 -- 172.21.15.45:0/1304819516 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7f38f00cd720 con 0x7f38f015fe60 2023-12-19T17:51:32.604 INFO:teuthology.misc.health.smithi045.stdout: 2023-12-19T17:51:32.604 INFO:teuthology.misc.health.smithi045.stdout:{"epoch":16,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:29.139115+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:32.606 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38d4065ad0 msgr2=0x7f38d4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.606 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38d4065ad0 0x7f38d4067f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0090b0 tx=0x7f38ec01f040 comp rx=0 tx=0).stop 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 msgr2=0x7f38f00c6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 0x7f38f00c6ee0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38e8000f80 tx=0x7f38e8007aa0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 shutdown_connections 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38d4065ad0 0x7f38d4067f90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38f015fe60 0x7f38f00c6ee0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38f015f790 0x7f38f014cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 --2- 172.21.15.45:0/1304819516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc003a70 0x7f38f015e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.602+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 >> 172.21.15.45:0/1304819516 conn(0x7f38f00cea60 msgr2=0x7f38f00c47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.606+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 shutdown_connections 2023-12-19T17:51:32.607 INFO:teuthology.misc.health.smithi045.stderr:2023-12-19T17:51:32.606+0000 7f38f63bc700 1 -- 172.21.15.45:0/1304819516 wait complete. 2023-12-19T17:51:32.627 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-19T17:51:32.627 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-19T17:51:32.627 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T17:51:32.627 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T17:51:32.634 INFO:tasks.ceph.mds.a:Started 2023-12-19T17:51:32.634 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T17:51:32.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T17:51:32.638 INFO:tasks.ceph.mds.c:Started 2023-12-19T17:51:32.638 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T17:51:32.639 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T17:51:32.646 INFO:tasks.ceph.mds.b:Started 2023-12-19T17:51:32.646 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T17:51:32.646 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T17:51:32.651 INFO:tasks.ceph.mds.d:Started 2023-12-19T17:51:32.651 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-19T17:51:32.651 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:32.742 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:51:32.745 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:51:32.768 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:51:32.768 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T17:51:32.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.802+0000 7fd52ffff700 1 Processor -- start 2023-12-19T17:51:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.802+0000 7fd52ffff700 1 -- start start 2023-12-19T17:51:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd53006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5300c4120 0x7fd5300c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52ffff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5300c3e20 con 0x7fd530159590 2023-12-19T17:51:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52ffff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5300cadb0 con 0x7fd5300c4120 2023-12-19T17:51:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5300c4aa0 con 0x7fd5301591b0 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5300c4120 0x7fd5300c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5300c4120 0x7fd5300c4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41566/0 (socket says 172.21.15.45:41566) 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 -- 172.21.15.45:0/4282576106 learned_addr learned my addr 172.21.15.45:0/4282576106 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52effd700 1 --2- 172.21.15.45:0/4282576106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd53006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 -- 172.21.15.45:0/4282576106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 msgr2=0x7fd53006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 --2- 172.21.15.45:0/4282576106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd53006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 -- 172.21.15.45:0/4282576106 >> v1:172.21.15.45:6789/0 conn(0x7fd530159590 legacy=0x7fd5300c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 -- 172.21.15.45:0/4282576106 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300ca7f0 con 0x7fd5300c4120 2023-12-19T17:51:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52f7fe700 1 --2- 172.21.15.45:0/4282576106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd5300c4560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd528009e50 tx=0x7fd52800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a7dc8aae60cd570 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:32.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.806+0000 7fd52e7fc700 1 -- 172.21.15.45:0/4282576106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52800bbc0 con 0x7fd5300c4120 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52e7fc700 1 -- 172.21.15.45:0/4282576106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52800bd20 con 0x7fd5300c4120 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52e7fc700 1 -- 172.21.15.45:0/4282576106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5280106c0 con 0x7fd5300c4120 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 -- 172.21.15.45:0/4282576106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 msgr2=0x7fd5300c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 --2- 172.21.15.45:0/4282576106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd5300c4560 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd528009e50 tx=0x7fd52800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 -- 172.21.15.45:0/4282576106 shutdown_connections 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 --2- 172.21.15.45:0/4282576106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd5300c4560 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 --2- 172.21.15.45:0/4282576106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd53006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 -- 172.21.15.45:0/4282576106 >> 172.21.15.45:0/4282576106 conn(0x7fd5300cb900 msgr2=0x7fd5300b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 -- 172.21.15.45:0/4282576106 shutdown_connections 2023-12-19T17:51:32.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 -- 172.21.15.45:0/4282576106 wait complete. 2023-12-19T17:51:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 Processor -- start 2023-12-19T17:51:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.810+0000 7fd52ffff700 1 -- start start 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd53014e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd530149790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53015b550 0x7fd53015ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53015bf40 con 0x7fd5300c4120 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53014fb40 con 0x7fd53015b550 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5301495f0 con 0x7fd5301591b0 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd53014e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd53014e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41574/0 (socket says 172.21.15.45:41574) 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 -- 172.21.15.45:0/2859625540 learned_addr learned my addr 172.21.15.45:0/2859625540 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd5267fc700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd530149790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52f7fe700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53015b550 0x7fd53015ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 -- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 msgr2=0x7fd530149790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd530149790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 -- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53015b550 msgr2=0x7fd53015ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53015b550 0x7fd53015ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 -- 172.21.15.45:0/2859625540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd528009b30 con 0x7fd5300c4120 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52effd700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd53014e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd52000e840 tx=0x7fd52000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520013610 con 0x7fd5300c4120 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd520013770 con 0x7fd5300c4120 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd520013b20 con 0x7fd5300c4120 2023-12-19T17:51:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd530150060 con 0x7fd5300c4120 2023-12-19T17:51:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd530150530 con 0x7fd5300c4120 2023-12-19T17:51:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.814+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd530156b80 con 0x7fd5300c4120 2023-12-19T17:51:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.818+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd520013c80 con 0x7fd5300c4120 2023-12-19T17:51:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.818+0000 7fd527fff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd510065ad0 0x7fd510067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.818+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd520082a10 con 0x7fd5300c4120 2023-12-19T17:51:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.818+0000 7fd5267fc700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd510065ad0 0x7fd510067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.818+0000 7fd5267fc700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd510065ad0 0x7fd510067f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd5301f9db0 tx=0x7fd518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:32.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:32.826+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd520050730 con 0x7fd5300c4120 2023-12-19T17:51:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.002+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd530067760 con 0x7fd5300c4120 2023-12-19T17:51:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.002+0000 7fd527fff700 1 -- 172.21.15.45:0/2859625540 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7fd520053d50 con 0x7fd5300c4120 2023-12-19T17:51:33.004 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:33.004 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:29.139115+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd510065ad0 msgr2=0x7fd510067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd510065ad0 0x7fd510067f90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd5301f9db0 tx=0x7fd518009040 comp rx=0 tx=0).stop 2023-12-19T17:51:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 msgr2=0x7fd53014e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd53014e770 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd52000e840 tx=0x7fd52000eb50 comp rx=0 tx=0).stop 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 shutdown_connections 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd510065ad0 0x7fd510067f90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53015b550 0x7fd53015ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5301591b0 0x7fd530149790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 --2- 172.21.15.45:0/2859625540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5300c4120 0x7fd53014e770 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 >> 172.21.15.45:0/2859625540 conn(0x7fd5300cb900 msgr2=0x7fd530154670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 shutdown_connections 2023-12-19T17:51:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.006+0000 7fd52ffff700 1 -- 172.21.15.45:0/2859625540 wait complete. 2023-12-19T17:51:33.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:51:33.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:51:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 Processor -- start 2023-12-19T17:51:33.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 -- start start 2023-12-19T17:51:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f136415cf20 0x7f13640d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640cdfd0 0x7f13640b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136415d300 con 0x7f13640b8580 2023-12-19T17:51:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640d1550 con 0x7f136415cf20 2023-12-19T17:51:33.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f13692fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640d1830 con 0x7f13640cdfd0 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f1363fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f136415cf20 0x7f13640d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f1363fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f136415cf20 0x7f13640d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:60646/0 (socket says 172.21.15.45:60646) 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f1363fff700 1 -- 172.21.15.45:0/2510117306 learned_addr learned my addr 172.21.15.45:0/2510117306 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.210+0000 7f1368afb700 1 --2- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640cdfd0 0x7f13640b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1363fff700 1 -- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640cdfd0 msgr2=0x7f13640b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1363fff700 1 --2- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640cdfd0 0x7f13640b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1363fff700 1 -- 172.21.15.45:0/2510117306 >> v1:172.21.15.45:6789/0 conn(0x7f13640b8580 legacy=0x7f13640cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1363fff700 1 -- 172.21.15.45:0/2510117306 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640d1b10 con 0x7f136415cf20 2023-12-19T17:51:33.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1363fff700 1 --2- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f136415cf20 0x7f13640d0c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1354009910 tx=0x7f1354009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ebbf4c9f09977c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1362ffd700 1 -- 172.21.15.45:0/2510117306 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135400ba60 con 0x7f136415cf20 2023-12-19T17:51:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1362ffd700 1 -- 172.21.15.45:0/2510117306 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135400bbc0 con 0x7f136415cf20 2023-12-19T17:51:33.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f1362ffd700 1 -- 172.21.15.45:0/2510117306 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354009e60 con 0x7f136415cf20 2023-12-19T17:51:33.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 -- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f136415cf20 msgr2=0x7f13640d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 --2- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f136415cf20 0x7f13640d0c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1354009910 tx=0x7f1354009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 -- 172.21.15.45:0/2510117306 shutdown_connections 2023-12-19T17:51:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 --2- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640cdfd0 0x7f13640b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 --2- 172.21.15.45:0/2510117306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f136415cf20 0x7f13640d0c50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 -- 172.21.15.45:0/2510117306 >> 172.21.15.45:0/2510117306 conn(0x7f13640b4670 msgr2=0x7f13640b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 -- 172.21.15.45:0/2510117306 shutdown_connections 2023-12-19T17:51:33.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.214+0000 7f13692fc700 1 -- 172.21.15.45:0/2510117306 wait complete. 2023-12-19T17:51:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.218+0000 7f13692fc700 1 Processor -- start 2023-12-19T17:51:33.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 -- start start 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640b8580 0x7f136415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13640cdfd0 0x7f136415ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 0x7f1364156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13641604c0 con 0x7f136415cf20 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136415f090 con 0x7f13640cdfd0 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136415f370 con 0x7f13640b8580 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 0x7f1364156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 0x7f1364156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41588/0 (socket says 172.21.15.45:41588) 2023-12-19T17:51:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 -- 172.21.15.45:0/2654822736 learned_addr learned my addr 172.21.15.45:0/2654822736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13637fe700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13640cdfd0 0x7f136415ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1363fff700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640b8580 0x7f136415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 -- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640b8580 msgr2=0x7f136415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640b8580 0x7f136415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 -- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13640cdfd0 msgr2=0x7f136415ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13640cdfd0 0x7f136415ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 -- 172.21.15.45:0/2654822736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354009570 con 0x7f136415cf20 2023-12-19T17:51:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13637fe700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13640cdfd0 0x7f136415ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1368afb700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 0x7f1364156180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f135c007de0 tx=0x7f135c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c00ed30 con 0x7f136415cf20 2023-12-19T17:51:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c014420 con 0x7f136415cf20 2023-12-19T17:51:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136415f650 con 0x7f136415cf20 2023-12-19T17:51:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.222+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c0147d0 con 0x7f136415cf20 2023-12-19T17:51:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.226+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136415fc10 con 0x7f136415cf20 2023-12-19T17:51:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.226+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136404ed30 con 0x7f136415cf20 2023-12-19T17:51:33.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.226+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f135c014930 con 0x7f136415cf20 2023-12-19T17:51:33.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.230+0000 7f1360ff9700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1350065ad0 0x7f1350067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.230+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f135c0835c0 con 0x7f136415cf20 2023-12-19T17:51:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.230+0000 7f1363fff700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1350065ad0 0x7f1350067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.230+0000 7f1363fff700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1350065ad0 0x7f1350067f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1354000c00 tx=0x7f1354008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.234+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f135c051240 con 0x7f136415cf20 2023-12-19T17:51:33.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.414+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f136406f050 con 0x7f136415cf20 2023-12-19T17:51:33.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f1360ff9700 1 -- 172.21.15.45:0/2654822736 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f135c054860 con 0x7f136415cf20 2023-12-19T17:51:33.418 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:51:33.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1350065ad0 msgr2=0x7f1350067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1350065ad0 0x7f1350067f90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1354000c00 tx=0x7f1354008030 comp rx=0 tx=0).stop 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 msgr2=0x7f1364156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 0x7f1364156180 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f135c007de0 tx=0x7f135c00e3c0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 shutdown_connections 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1350065ad0 0x7f1350067f90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f136415cf20 0x7f1364156180 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13640cdfd0 0x7f136415ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 --2- 172.21.15.45:0/2654822736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13640b8580 0x7f136415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 >> 172.21.15.45:0/2654822736 conn(0x7f13640b4670 msgr2=0x7f136406f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 shutdown_connections 2023-12-19T17:51:33.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.418+0000 7f13692fc700 1 -- 172.21.15.45:0/2654822736 wait complete. 2023-12-19T17:51:33.446 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:51:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.634+0000 7f9e57116700 1 Processor -- start 2023-12-19T17:51:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.634+0000 7f9e57116700 1 -- start start 2023-12-19T17:51:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e57116700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e5006a720 0x7f9e500cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e57116700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e50160ac0 con 0x7f9e5015cda0 2023-12-19T17:51:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e57116700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e50161640 con 0x7f9e5015d180 2023-12-19T17:51:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e57116700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e50160d10 con 0x7f9e5006a720 2023-12-19T17:51:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e56114700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9e5015cda0 0x7f9e5006a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41908/0 (socket says 172.21.15.45:41908) 2023-12-19T17:51:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e56114700 1 -- 172.21.15.45:0/3297807075 learned_addr learned my addr 172.21.15.45:0/3297807075 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55913700 1 --2- 172.21.15.45:0/3297807075 >> v2:172.21.15.73:3300/0 conn(0x7f9e5006a720 0x7f9e500cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2057122261 0 0) 0x7f9e50160ac0 con 0x7f9e5015cda0 2023-12-19T17:51:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e3c0035d0 con 0x7f9e5015cda0 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3873413809 0 0) 0x7f9e3c0035d0 con 0x7f9e5015cda0 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 >> v2:172.21.15.73:3300/0 conn(0x7f9e5006a720 msgr2=0x7f9e500cb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 --2- 172.21.15.45:0/3297807075 >> v2:172.21.15.73:3300/0 conn(0x7f9e5006a720 0x7f9e500cb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 >> v1:172.21.15.73:6789/0 conn(0x7f9e5015d180 legacy=0x7f9e500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50160ff0 con 0x7f9e5015cda0 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f9e4c001670 con 0x7f9e5015cda0 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 >> v1:172.21.15.45:6789/0 conn(0x7f9e5015cda0 legacy=0x7f9e5006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c003a70 0x7f9e3c003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c004870 0x7f9e3c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e3c005230 0x7f9e3c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50160d10 con 0x7f9e3c005230 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c00c130 con 0x7f9e3c003a70 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c00c2f0 con 0x7f9e3c004870 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e56915700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e3c005230 0x7f9e3c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e55913700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c004870 0x7f9e3c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.638+0000 7f9e56114700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c003a70 0x7f9e3c003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 -- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c004870 msgr2=0x7f9e3c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c004870 0x7f9e3c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 -- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c003a70 msgr2=0x7f9e3c003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c003a70 0x7f9e3c003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 -- 172.21.15.45:0/3297807075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c0035d0 con 0x7f9e3c005230 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56114700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e3c003a70 0x7f9e3c003e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 -- 172.21.15.45:0/3297807075 reap_dead start 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e56915700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e3c005230 0x7f9e3c00ba30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e501615f0 tx=0x7f9e3c0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf9adfaba36dba0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48001db0 con 0x7f9e3c005230 2023-12-19T17:51:33.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4800cc70 con 0x7f9e3c005230 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e55112700 1 -- 172.21.15.45:0/3297807075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e48003a20 con 0x7f9e3c005230 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 -- 172.21.15.45:0/3297807075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e3c005230 msgr2=0x7f9e3c00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e3c005230 0x7f9e3c00ba30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9e501615f0 tx=0x7f9e3c0058a0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 -- 172.21.15.45:0/3297807075 shutdown_connections 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 --2- 172.21.15.45:0/3297807075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e3c005230 0x7f9e3c00ba30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 -- 172.21.15.45:0/3297807075 >> 172.21.15.45:0/3297807075 conn(0x7f9e500cf960 msgr2=0x7f9e500cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 -- 172.21.15.45:0/3297807075 shutdown_connections 2023-12-19T17:51:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.642+0000 7f9e57116700 1 -- 172.21.15.45:0/3297807075 wait complete. 2023-12-19T17:51:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 Processor -- start 2023-12-19T17:51:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 -- start start 2023-12-19T17:51:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c005230 0x7f9e5014bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 0x7f9e500c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e5014cc90 0x7f9e5015edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e5014c2d0 con 0x7f9e5014c810 2023-12-19T17:51:33.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e50149610 con 0x7f9e5014cc90 2023-12-19T17:51:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.646+0000 7f9e57116700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e501498f0 con 0x7f9e3c005230 2023-12-19T17:51:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 0x7f9e500c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 0x7f9e500c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41602/0 (socket says 172.21.15.45:41602) 2023-12-19T17:51:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 -- 172.21.15.45:0/2380174840 learned_addr learned my addr 172.21.15.45:0/2380174840 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e56915700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e5014cc90 0x7f9e5015edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e56114700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c005230 0x7f9e5014bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 -- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c005230 msgr2=0x7f9e5014bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c005230 0x7f9e5014bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 -- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e5014cc90 msgr2=0x7f9e5015edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e5014cc90 0x7f9e5015edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 -- 172.21.15.45:0/2380174840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e50149bd0 con 0x7f9e5014c810 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e55913700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 0x7f9e500c5eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e400119b0 tx=0x7f9e40011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e40011e50 con 0x7f9e5014c810 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e4000f940 con 0x7f9e5014c810 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e50149eb0 con 0x7f9e5014c810 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e4000fcd0 con 0x7f9e5014c810 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e50149320 con 0x7f9e5014c810 2023-12-19T17:51:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.650+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e50067760 con 0x7f9e5014c810 2023-12-19T17:51:33.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.654+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e40014440 con 0x7f9e5014c810 2023-12-19T17:51:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.654+0000 7f9e46ffd700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e34065ad0 0x7f9e34067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.654+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9e400834e0 con 0x7f9e5014c810 2023-12-19T17:51:33.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.654+0000 7f9e56114700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e34065ad0 0x7f9e34067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:33.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.654+0000 7f9e56114700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e34065ad0 0x7f9e34067f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c000ff0 tx=0x7f9e4c007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:33.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.658+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9e40051150 con 0x7f9e5014c810 2023-12-19T17:51:33.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.878+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9e5006fb30 con 0x7f9e5014c810 2023-12-19T17:51:33.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.878+0000 7f9e46ffd700 1 -- 172.21.15.45:0/2380174840 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3522 (secure 0 0 0) 0x7f9e40054770 con 0x7f9e5014c810 2023-12-19T17:51:33.882 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:33.882 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":54167,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-19T17:51:33.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e34065ad0 msgr2=0x7f9e34067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e34065ad0 0x7f9e34067f90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c000ff0 tx=0x7f9e4c007040 comp rx=0 tx=0).stop 2023-12-19T17:51:33.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 msgr2=0x7f9e500c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:33.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 0x7f9e500c5eb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9e400119b0 tx=0x7f9e40011cc0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 shutdown_connections 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e34065ad0 0x7f9e34067f90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e5014cc90 0x7f9e5015edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e5014c810 0x7f9e500c5eb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 --2- 172.21.15.45:0/2380174840 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e3c005230 0x7f9e5014bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 >> 172.21.15.45:0/2380174840 conn(0x7f9e500cf960 msgr2=0x7f9e500ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 shutdown_connections 2023-12-19T17:51:33.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:33.882+0000 7f9e57116700 1 -- 172.21.15.45:0/2380174840 wait complete. 2023-12-19T17:51:33.886 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 3 2023-12-19T17:51:33.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:34.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.098+0000 7fc789bf9700 1 Processor -- start 2023-12-19T17:51:34.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc789bf9700 1 -- start start 2023-12-19T17:51:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc789bf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7840cd480 0x7fc78406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc789bf9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78406cbb0 con 0x7fc78415af30 2023-12-19T17:51:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc789bf9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc78406fa10 con 0x7fc78415ab50 2023-12-19T17:51:34.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc789bf9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc78406fcf0 con 0x7fc7840cd480 2023-12-19T17:51:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc783fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc78415af30 0x7fc78406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41910/0 (socket says 172.21.15.45:41910) 2023-12-19T17:51:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc783fff700 1 -- 172.21.15.45:0/488115039 learned_addr learned my addr 172.21.15.45:0/488115039 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:34.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.102+0000 7fc782ffd700 1 --2- 172.21.15.45:0/488115039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7840cd480 0x7fc78406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc7827fc700 1 -- 172.21.15.45:0/488115039 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1474652986 0 0) 0x7fc78406cbb0 con 0x7fc78415af30 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc7827fc700 1 -- 172.21.15.45:0/488115039 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7700035d0 con 0x7fc78415af30 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc7827fc700 1 -- 172.21.15.45:0/488115039 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1651991141 0 0) 0x7fc78406fa10 con 0x7fc78415ab50 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc782ffd700 1 -- 172.21.15.45:0/488115039 >> v1:172.21.15.73:6789/0 conn(0x7fc78415ab50 legacy=0x7fc7840ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc782ffd700 1 -- 172.21.15.45:0/488115039 >> v1:172.21.15.45:6789/0 conn(0x7fc78415af30 legacy=0x7fc78406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc782ffd700 1 -- 172.21.15.45:0/488115039 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc78406ffd0 con 0x7fc7840cd480 2023-12-19T17:51:34.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc782ffd700 1 --2- 172.21.15.45:0/488115039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7840cd480 0x7fc78406d090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009880 tx=0x7fc76c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=489400ceb733383c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc7827fc700 1 -- 172.21.15.45:0/488115039 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c011830 con 0x7fc7840cd480 2023-12-19T17:51:34.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc7827fc700 1 -- 172.21.15.45:0/488115039 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76c011990 con 0x7fc7840cd480 2023-12-19T17:51:34.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc7827fc700 1 -- 172.21.15.45:0/488115039 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76c011d20 con 0x7fc7840cd480 2023-12-19T17:51:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 -- 172.21.15.45:0/488115039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7840cd480 msgr2=0x7fc78406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 --2- 172.21.15.45:0/488115039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7840cd480 0x7fc78406d090 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc76c009880 tx=0x7fc76c009b90 comp rx=0 tx=0).stop 2023-12-19T17:51:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 -- 172.21.15.45:0/488115039 shutdown_connections 2023-12-19T17:51:34.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 --2- 172.21.15.45:0/488115039 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc7840cd480 0x7fc78406d090 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 -- 172.21.15.45:0/488115039 >> 172.21.15.45:0/488115039 conn(0x7fc7840cba40 msgr2=0x7fc7840ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:34.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 -- 172.21.15.45:0/488115039 shutdown_connections 2023-12-19T17:51:34.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.106+0000 7fc789bf9700 1 -- 172.21.15.45:0/488115039 wait complete. 2023-12-19T17:51:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 Processor -- start 2023-12-19T17:51:34.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 -- start start 2023-12-19T17:51:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 0x7fc784154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc78415ab50 0x7fc7840af380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc78415af30 0x7fc7840af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840c65a0 con 0x7fc78415af30 2023-12-19T17:51:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc784150a90 con 0x7fc7840cd480 2023-12-19T17:51:34.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc789bf9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7840c5c00 con 0x7fc78415ab50 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc783fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc78415af30 0x7fc7840af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 0x7fc784154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 0x7fc784154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:60686/0 (socket says 172.21.15.45:60686) 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 -- 172.21.15.45:0/1671180971 learned_addr learned my addr 172.21.15.45:0/1671180971 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc782ffd700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc78415ab50 0x7fc7840af380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 -- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc78415ab50 msgr2=0x7fc7840af380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc78415ab50 0x7fc7840af380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 -- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc78415af30 msgr2=0x7fc7840af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc78415af30 0x7fc7840af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc7837fe700 1 -- 172.21.15.45:0/1671180971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c0094b0 con 0x7fc7840cd480 2023-12-19T17:51:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.110+0000 7fc783fff700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc78415af30 0x7fc7840af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:34.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc7837fe700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 0x7fc784154a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7740011e0 tx=0x7fc77400ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7740054e0 con 0x7fc7840cd480 2023-12-19T17:51:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7740036a0 con 0x7fc7840cd480 2023-12-19T17:51:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7840c5ee0 con 0x7fc7840cd480 2023-12-19T17:51:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774003a50 con 0x7fc7840cd480 2023-12-19T17:51:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7840c69c0 con 0x7fc7840cd480 2023-12-19T17:51:34.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc78404ed30 con 0x7fc7840cd480 2023-12-19T17:51:34.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.114+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc774003bb0 con 0x7fc7840cd480 2023-12-19T17:51:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.118+0000 7fc77bfff700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc764065b50 0x7fc764068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.118+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7740822a0 con 0x7fc7840cd480 2023-12-19T17:51:34.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.118+0000 7fc782ffd700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc764065b50 0x7fc764068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.118+0000 7fc782ffd700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc764065b50 0x7fc764068010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0090b0 tx=0x7fc76c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.126+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc77404ff90 con 0x7fc7840cd480 2023-12-19T17:51:34.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.306+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7840c6b50 con 0x7fc7840cd480 2023-12-19T17:51:34.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.310+0000 7fc77bfff700 1 -- 172.21.15.45:0/1671180971 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12334 (secure 0 0 0) 0x7fc774003e60 con 0x7fc7840cd480 2023-12-19T17:51:34.315 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:34.315 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:29.139115+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc764065b50 msgr2=0x7fc764068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc764065b50 0x7fc764068010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0090b0 tx=0x7fc76c01c040 comp rx=0 tx=0).stop 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 msgr2=0x7fc784154a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 0x7fc784154a40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc7740011e0 tx=0x7fc77400ca30 comp rx=0 tx=0).stop 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 shutdown_connections 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc764065b50 0x7fc764068010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc78415af30 0x7fc7840af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc78415ab50 0x7fc7840af380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 --2- 172.21.15.45:0/1671180971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7840cd480 0x7fc784154a40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 >> 172.21.15.45:0/1671180971 conn(0x7fc7840cba40 msgr2=0x7fc7841577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 shutdown_connections 2023-12-19T17:51:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.318+0000 7fc789bf9700 1 -- 172.21.15.45:0/1671180971 wait complete. 2023-12-19T17:51:34.345 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:51:34.345 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:51:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.526+0000 7f47a8c76700 1 Processor -- start 2023-12-19T17:51:34.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.526+0000 7f47a8c76700 1 -- start start 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47a40b8580 0x7f47a40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f47a40d25f0 0x7f47a40cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a415d300 con 0x7f47a415cf20 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40d1360 con 0x7f47a40b8580 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a40d1550 con 0x7f47a40d25f0 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47a40b8580 0x7f47a40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47a40b8580 0x7f47a40cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41630/0 (socket says 172.21.15.45:41630) 2023-12-19T17:51:34.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1465987696 learned_addr learned my addr 172.21.15.45:0/1465987696 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:34.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a3fff700 1 --2- 172.21.15.45:0/1465987696 >> v2:172.21.15.73:3300/0 conn(0x7f47a40d25f0 0x7f47a40cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1465987696 >> v2:172.21.15.73:3300/0 conn(0x7f47a40d25f0 msgr2=0x7f47a40cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:34.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 --2- 172.21.15.45:0/1465987696 >> v2:172.21.15.73:3300/0 conn(0x7f47a40d25f0 0x7f47a40cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1465987696 >> v1:172.21.15.73:6789/0 conn(0x7f47a415cf20 legacy=0x7f47a40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1465987696 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40d1830 con 0x7f47a40b8580 2023-12-19T17:51:34.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a3fff700 1 --2- 172.21.15.45:0/1465987696 >> v2:172.21.15.73:3300/0 conn(0x7f47a40d25f0 0x7f47a40cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:51:34.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a2ffd700 1 --2- 172.21.15.45:0/1465987696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40b8580 0x7f47a40cd8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47a40cd160 tx=0x7f4790009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4894c77b1e6e0a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a27fc700 1 -- 172.21.15.45:0/1465987696 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000b8a0 con 0x7f47a40b8580 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a27fc700 1 -- 172.21.15.45:0/1465987696 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479000ba00 con 0x7f47a40b8580 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a27fc700 1 -- 172.21.15.45:0/1465987696 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479000bd90 con 0x7f47a40b8580 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- 172.21.15.45:0/1465987696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40b8580 msgr2=0x7f47a40cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1465987696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40b8580 0x7f47a40cd8c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47a40cd160 tx=0x7f4790009bf0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- 172.21.15.45:0/1465987696 shutdown_connections 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1465987696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40b8580 0x7f47a40cd8c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1465987696 >> v2:172.21.15.73:3300/0 conn(0x7f47a40d25f0 0x7f47a40cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- 172.21.15.45:0/1465987696 >> 172.21.15.45:0/1465987696 conn(0x7f47a40b4670 msgr2=0x7f47a40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- 172.21.15.45:0/1465987696 shutdown_connections 2023-12-19T17:51:34.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.530+0000 7f47a8c76700 1 -- 172.21.15.45:0/1465987696 wait complete. 2023-12-19T17:51:34.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.534+0000 7f47a8c76700 1 Processor -- start 2023-12-19T17:51:34.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.534+0000 7f47a8c76700 1 -- start start 2023-12-19T17:51:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47a40b8580 0x7f47a40b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 0x7f47a415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a415cf20 0x7f47a41f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41f6f30 con 0x7f47a40d25f0 2023-12-19T17:51:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a41f7210 con 0x7f47a415cf20 2023-12-19T17:51:34.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a415d670 con 0x7f47a40b8580 2023-12-19T17:51:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 0x7f47a415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 0x7f47a415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41638/0 (socket says 172.21.15.45:41638) 2023-12-19T17:51:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1223177746 learned_addr learned my addr 172.21.15.45:0/1223177746 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:34.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a3fff700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a415cf20 0x7f47a41f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a37fe700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47a40b8580 0x7f47a40b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47a40b8580 msgr2=0x7f47a40b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47a40b8580 0x7f47a40b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a415cf20 msgr2=0x7f47a41f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a415cf20 0x7f47a41f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 -- 172.21.15.45:0/1223177746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4790009570 con 0x7f47a40d25f0 2023-12-19T17:51:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a2ffd700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 0x7f47a415de70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4790000c00 tx=0x7f4790004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47900038c0 con 0x7f47a40d25f0 2023-12-19T17:51:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479001e070 con 0x7f47a40d25f0 2023-12-19T17:51:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4790003c80 con 0x7f47a40d25f0 2023-12-19T17:51:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a415d950 con 0x7f47a40d25f0 2023-12-19T17:51:34.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.538+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a40b3de0 con 0x7f47a40d25f0 2023-12-19T17:51:34.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.542+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a404ed30 con 0x7f47a40d25f0 2023-12-19T17:51:34.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.542+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4790011420 con 0x7f47a40d25f0 2023-12-19T17:51:34.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.542+0000 7f479bfff700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f478c065ad0 0x7f478c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.546+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4790020070 con 0x7f47a40d25f0 2023-12-19T17:51:34.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.546+0000 7f47a37fe700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f478c065ad0 0x7f478c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.546+0000 7f47a37fe700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f478c065ad0 0x7f478c067f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47940018a0 tx=0x7f4794009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.550+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4790052320 con 0x7f47a40d25f0 2023-12-19T17:51:34.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.734+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f47a415d490 con 0x7f47a40d25f0 2023-12-19T17:51:34.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.734+0000 7f479bfff700 1 -- 172.21.15.45:0/1223177746 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4790055940 con 0x7f47a40d25f0 2023-12-19T17:51:34.738 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:51:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f478c065ad0 msgr2=0x7f478c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f478c065ad0 0x7f478c067f90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f47940018a0 tx=0x7f4794009040 comp rx=0 tx=0).stop 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 msgr2=0x7f47a415de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 0x7f47a415de70 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4790000c00 tx=0x7f4790004770 comp rx=0 tx=0).stop 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 shutdown_connections 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f478c065ad0 0x7f478c067f90 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47a415cf20 0x7f47a41f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47a40d25f0 0x7f47a415de70 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 --2- 172.21.15.45:0/1223177746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47a40b8580 0x7f47a40b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 >> 172.21.15.45:0/1223177746 conn(0x7f47a40b4670 msgr2=0x7f47a415c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:34.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 shutdown_connections 2023-12-19T17:51:34.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.738+0000 7f47a8c76700 1 -- 172.21.15.45:0/1223177746 wait complete. 2023-12-19T17:51:34.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T17:51:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.934+0000 7f9556f12700 1 Processor -- start 2023-12-19T17:51:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.934+0000 7f9556f12700 1 -- start start 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95500d12e0 0x7f95500d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95500b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95500ce530 con 0x7f95500cd6b0 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95500d1c80 con 0x7f95500d12e0 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95500d1ec0 con 0x7f95500b6260 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95500d12e0 0x7f95500d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9554cae700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f95500cd6b0 0x7f95500cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41918/0 (socket says 172.21.15.45:41918) 2023-12-19T17:51:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9554cae700 1 -- 172.21.15.45:0/2884678734 learned_addr learned my addr 172.21.15.45:0/2884678734 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f95554af700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95500b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954ffff700 1 -- 172.21.15.45:0/2884678734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 msgr2=0x7f95500b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954ffff700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95500b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954ffff700 1 -- 172.21.15.45:0/2884678734 >> v1:172.21.15.45:6789/0 conn(0x7f95500cd6b0 legacy=0x7f95500cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954ffff700 1 -- 172.21.15.45:0/2884678734 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500d21a0 con 0x7f95500d12e0 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f95554af700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95500b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954ffff700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500d12e0 0x7f95500d1740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f953c009850 tx=0x7f953c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2283b93b61df700 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954f7fe700 1 -- 172.21.15.45:0/2884678734 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c011830 con 0x7f95500d12e0 2023-12-19T17:51:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954f7fe700 1 -- 172.21.15.45:0/2884678734 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f953c011990 con 0x7f95500d12e0 2023-12-19T17:51:34.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f954f7fe700 1 -- 172.21.15.45:0/2884678734 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f953c011d20 con 0x7f95500d12e0 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 -- 172.21.15.45:0/2884678734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500d12e0 msgr2=0x7f95500d1740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.938+0000 7f9556f12700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500d12e0 0x7f95500d1740 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f953c009850 tx=0x7f953c009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 -- 172.21.15.45:0/2884678734 shutdown_connections 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95500b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 --2- 172.21.15.45:0/2884678734 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500d12e0 0x7f95500d1740 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 -- 172.21.15.45:0/2884678734 >> 172.21.15.45:0/2884678734 conn(0x7f95500d2e50 msgr2=0x7f95500d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 -- 172.21.15.45:0/2884678734 shutdown_connections 2023-12-19T17:51:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 -- 172.21.15.45:0/2884678734 wait complete. 2023-12-19T17:51:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 Processor -- start 2023-12-19T17:51:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.942+0000 7f9556f12700 1 -- start start 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95501580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500cd6b0 0x7f955015fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955014e070 0x7f955006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95500caf10 con 0x7f95500cd6b0 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95501585e0 con 0x7f955014e070 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9550157440 con 0x7f95500b6260 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f954ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500cd6b0 0x7f955015fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95501580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95501580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:44266/0 (socket says 172.21.15.45:44266) 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 -- 172.21.15.45:0/1454227251 learned_addr learned my addr 172.21.15.45:0/1454227251 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f954ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500cd6b0 0x7f955015fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41644/0 (socket says 172.21.15.45:41644) 2023-12-19T17:51:34.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f95554af700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955014e070 0x7f955006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 -- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955014e070 msgr2=0x7f955006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955014e070 0x7f955006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 -- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500cd6b0 msgr2=0x7f955015fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500cd6b0 0x7f955015fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 -- 172.21.15.45:0/1454227251 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f953c0094b0 con 0x7f95500b6260 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9554cae700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95501580a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9544001eb0 tx=0x7f954400c7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544005d90 con 0x7f95500b6260 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95440070d0 con 0x7f95500b6260 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95500ca290 con 0x7f95500b6260 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9544007440 con 0x7f95500b6260 2023-12-19T17:51:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.946+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95500ca850 con 0x7f95500b6260 2023-12-19T17:51:34.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.950+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95500d2740 con 0x7f95500b6260 2023-12-19T17:51:34.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.950+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95440075a0 con 0x7f95500b6260 2023-12-19T17:51:34.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.954+0000 7f954d7fa700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9534065ad0 0x7f9534067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:34.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.954+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9544082100 con 0x7f95500b6260 2023-12-19T17:51:34.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.954+0000 7f954ffff700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9534065ad0 0x7f9534067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:34.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.954+0000 7f954ffff700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9534065ad0 0x7f9534067f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95500b8840 tx=0x7f953c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:34.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:34.966+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f95500d2740 con 0x7f95500b6260 2023-12-19T17:51:35.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.142+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f95500d2740 con 0x7f95500b6260 2023-12-19T17:51:35.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.146+0000 7f954d7fa700 1 -- 172.21.15.45:0/1454227251 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f95500d2740 con 0x7f95500b6260 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:51:35.148 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-19T17:51:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9534065ad0 msgr2=0x7f9534067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9534065ad0 0x7f9534067f90 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f95500b8840 tx=0x7f953c008030 comp rx=0 tx=0).stop 2023-12-19T17:51:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 msgr2=0x7f95501580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:35.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95501580a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9544001eb0 tx=0x7f954400c7b0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 shutdown_connections 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9534065ad0 0x7f9534067f90 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955014e070 0x7f955006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95500cd6b0 0x7f955015fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 --2- 172.21.15.45:0/1454227251 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95500b6260 0x7f95501580a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 >> 172.21.15.45:0/1454227251 conn(0x7f95500d2e50 msgr2=0x7f95500ce930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 shutdown_connections 2023-12-19T17:51:35.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.150+0000 7f9556f12700 1 -- 172.21.15.45:0/1454227251 wait complete. 2023-12-19T17:51:35.175 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T17:51:35.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T17:51:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.362+0000 7fc8433ce700 1 Processor -- start 2023-12-19T17:51:35.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.362+0000 7fc8433ce700 1 -- start start 2023-12-19T17:51:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8433ce700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc83c159d20 0x7fc83c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8433ce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c9740 0x7fc83c0c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8433ce700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83c0ccba0 con 0x7fc83c0c4df0 2023-12-19T17:51:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8433ce700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc83c15a100 con 0x7fc83c159d20 2023-12-19T17:51:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8433ce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c5220 con 0x7fc83c0c9740 2023-12-19T17:51:35.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc83c159d20 0x7fc83c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc83c159d20 0x7fc83c06eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41646/0 (socket says 172.21.15.45:41646) 2023-12-19T17:51:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 -- 172.21.15.45:0/154050125 learned_addr learned my addr 172.21.15.45:0/154050125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc841bcb700 1 --2- 172.21.15.45:0/154050125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c9740 0x7fc83c0c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 -- 172.21.15.45:0/154050125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c9740 msgr2=0x7fc83c0c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:35.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 --2- 172.21.15.45:0/154050125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c9740 0x7fc83c0c48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 -- 172.21.15.45:0/154050125 >> v1:172.21.15.73:6789/0 conn(0x7fc83c0c4df0 legacy=0x7fc83c15d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 -- 172.21.15.45:0/154050125 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c0700a0 con 0x7fc83c159d20 2023-12-19T17:51:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8423cc700 1 --2- 172.21.15.45:0/154050125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c159d20 0x7fc83c06eeb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc838009910 tx=0x7fc838009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae07dc1654231e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8413ca700 1 -- 172.21.15.45:0/154050125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011830 con 0x7fc83c159d20 2023-12-19T17:51:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8413ca700 1 -- 172.21.15.45:0/154050125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838011990 con 0x7fc83c159d20 2023-12-19T17:51:35.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.366+0000 7fc8413ca700 1 -- 172.21.15.45:0/154050125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011d40 con 0x7fc83c159d20 2023-12-19T17:51:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 -- 172.21.15.45:0/154050125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c159d20 msgr2=0x7fc83c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:35.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 --2- 172.21.15.45:0/154050125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c159d20 0x7fc83c06eeb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc838009910 tx=0x7fc838009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 -- 172.21.15.45:0/154050125 shutdown_connections 2023-12-19T17:51:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 --2- 172.21.15.45:0/154050125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c9740 0x7fc83c0c48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 --2- 172.21.15.45:0/154050125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c159d20 0x7fc83c06eeb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 -- 172.21.15.45:0/154050125 >> 172.21.15.45:0/154050125 conn(0x7fc83c0cecd0 msgr2=0x7fc83c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 -- 172.21.15.45:0/154050125 shutdown_connections 2023-12-19T17:51:35.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.370+0000 7fc8433ce700 1 -- 172.21.15.45:0/154050125 wait complete. 2023-12-19T17:51:35.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 Processor -- start 2023-12-19T17:51:35.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 -- start start 2023-12-19T17:51:35.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c4df0 0x7fc83c152810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 0x7fc83c153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc83c159d20 0x7fc83c0cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c38f0 con 0x7fc83c0c9740 2023-12-19T17:51:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c3bd0 con 0x7fc83c159d20 2023-12-19T17:51:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8433ce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc83c0c3eb0 con 0x7fc83c0c4df0 2023-12-19T17:51:35.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc841bcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 0x7fc83c153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc841bcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 0x7fc83c153260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41658/0 (socket says 172.21.15.45:41658) 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc841bcb700 1 -- 172.21.15.45:0/49717694 learned_addr learned my addr 172.21.15.45:0/49717694 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc8423cc700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c4df0 0x7fc83c152810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.374+0000 7fc842bcd700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc83c159d20 0x7fc83c0cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc841bcb700 1 -- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c4df0 msgr2=0x7fc83c152810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc841bcb700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c4df0 0x7fc83c152810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc841bcb700 1 -- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc83c159d20 msgr2=0x7fc83c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc841bcb700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc83c159d20 0x7fc83c0cd030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc841bcb700 1 -- 172.21.15.45:0/49717694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc838009570 con 0x7fc83c0c9740 2023-12-19T17:51:35.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc841bcb700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 0x7fc83c153260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e9a0 tx=0x7fc82c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c009720 con 0x7fc83c0c9740 2023-12-19T17:51:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c00c690 con 0x7fc83c0c9740 2023-12-19T17:51:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ca40 con 0x7fc83c0c9740 2023-12-19T17:51:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc83c0c4190 con 0x7fc83c0c9740 2023-12-19T17:51:35.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc83c0cd570 con 0x7fc83c0c9740 2023-12-19T17:51:35.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.378+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83c04ed30 con 0x7fc83c0c9740 2023-12-19T17:51:35.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.382+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc82c00cba0 con 0x7fc83c0c9740 2023-12-19T17:51:35.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.382+0000 7fc832ffd700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc820065ad0 0x7fc820067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:35.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.382+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc82c082e40 con 0x7fc83c0c9740 2023-12-19T17:51:35.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.382+0000 7fc8423cc700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc820065ad0 0x7fc820067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:35.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.386+0000 7fc8423cc700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc820065ad0 0x7fc820067f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc838000c00 tx=0x7fc838008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:35.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.390+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc82c050ab0 con 0x7fc83c0c9740 2023-12-19T17:51:35.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:35.570+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc83c155040 con 0x7fc83c0c9740 2023-12-19T17:51:36.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.326+0000 7fc832ffd700 1 -- 172.21.15.45:0/49717694 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc82c0170b0 con 0x7fc83c0c9740 2023-12-19T17:51:36.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc820065ad0 msgr2=0x7fc820067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:36.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc820065ad0 0x7fc820067f90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc838000c00 tx=0x7fc838008030 comp rx=0 tx=0).stop 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 msgr2=0x7fc83c153260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 0x7fc83c153260 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e9a0 tx=0x7fc82c00ecb0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 shutdown_connections 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc820065ad0 0x7fc820067f90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc83c159d20 0x7fc83c0cd030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc83c0c9740 0x7fc83c153260 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00e9a0 tx=0x7fc82c00ecb0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 --2- 172.21.15.45:0/49717694 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc83c0c4df0 0x7fc83c152810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 >> 172.21.15.45:0/49717694 conn(0x7fc83c0cecd0 msgr2=0x7fc83c06df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:36.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 shutdown_connections 2023-12-19T17:51:36.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.334+0000 7fc8433ce700 1 -- 172.21.15.45:0/49717694 wait complete. 2023-12-19T17:51:36.341 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-19T17:51:36.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-19T17:51:36.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.538+0000 7f08d72ae700 1 Processor -- start 2023-12-19T17:51:36.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.538+0000 7f08d72ae700 1 -- start start 2023-12-19T17:51:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d015d0b0 0x7f08d00b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f08d0161290 0x7f08d00d16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08d00b5dd0 con 0x7f08d00b8b90 2023-12-19T17:51:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08d00d1240 con 0x7f08d0161290 2023-12-19T17:51:36.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d015d490 con 0x7f08d015d0b0 2023-12-19T17:51:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d4849700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f08d00b8b90 0x7f08d0160b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41930/0 (socket says 172.21.15.45:41930) 2023-12-19T17:51:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d4849700 1 -- 172.21.15.45:0/2579328447 learned_addr learned my addr 172.21.15.45:0/2579328447 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d504a700 1 --2- 172.21.15.45:0/2579328447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d015d0b0 0x7f08d00b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:36.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d584b700 1 --2- 172.21.15.45:0/2579328447 >> v2:172.21.15.73:3300/0 conn(0x7f08d0161290 0x7f08d00d16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08c7fff700 1 -- 172.21.15.45:0/2579328447 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155753437 0 0) 0x7f08d00b5dd0 con 0x7f08d00b8b90 2023-12-19T17:51:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08c7fff700 1 -- 172.21.15.45:0/2579328447 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08bc0035d0 con 0x7f08d00b8b90 2023-12-19T17:51:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d504a700 1 -- 172.21.15.45:0/2579328447 >> v2:172.21.15.73:3300/0 conn(0x7f08d0161290 msgr2=0x7f08d00d16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d504a700 1 --2- 172.21.15.45:0/2579328447 >> v2:172.21.15.73:3300/0 conn(0x7f08d0161290 0x7f08d00d16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d504a700 1 -- 172.21.15.45:0/2579328447 >> v1:172.21.15.45:6789/0 conn(0x7f08d00b8b90 legacy=0x7f08d0160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:36.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d504a700 1 -- 172.21.15.45:0/2579328447 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d006fb40 con 0x7f08d015d0b0 2023-12-19T17:51:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d504a700 1 --2- 172.21.15.45:0/2579328447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d015d0b0 0x7f08d00b8650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009850 tx=0x7f08cc009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=426fd1a4ec9b11cb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08c7fff700 1 -- 172.21.15.45:0/2579328447 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc011830 con 0x7f08d015d0b0 2023-12-19T17:51:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08c7fff700 1 -- 172.21.15.45:0/2579328447 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08cc011990 con 0x7f08d015d0b0 2023-12-19T17:51:36.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08c7fff700 1 -- 172.21.15.45:0/2579328447 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08cc011d40 con 0x7f08d015d0b0 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 -- 172.21.15.45:0/2579328447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d015d0b0 msgr2=0x7f08d00b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.542+0000 7f08d72ae700 1 --2- 172.21.15.45:0/2579328447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d015d0b0 0x7f08d00b8650 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f08cc009850 tx=0x7f08cc009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- 172.21.15.45:0/2579328447 shutdown_connections 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 --2- 172.21.15.45:0/2579328447 >> v2:172.21.15.73:3300/0 conn(0x7f08d0161290 0x7f08d00d16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 --2- 172.21.15.45:0/2579328447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d015d0b0 0x7f08d00b8650 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- 172.21.15.45:0/2579328447 >> 172.21.15.45:0/2579328447 conn(0x7f08d00d2e10 msgr2=0x7f08d00d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- 172.21.15.45:0/2579328447 shutdown_connections 2023-12-19T17:51:36.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- 172.21.15.45:0/2579328447 wait complete. 2023-12-19T17:51:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 Processor -- start 2023-12-19T17:51:36.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- start start 2023-12-19T17:51:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d00b8b90 0x7f08d0159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d015d0b0 0x7f08d00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 0x7f08d00b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d00cadb0 con 0x7f08d0161290 2023-12-19T17:51:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08d0159ac0 con 0x7f08d015d0b0 2023-12-19T17:51:36.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.546+0000 7f08d72ae700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08d015db60 con 0x7f08d00b8b90 2023-12-19T17:51:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 0x7f08d00b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 0x7f08d00b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41660/0 (socket says 172.21.15.45:41660) 2023-12-19T17:51:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 -- 172.21.15.45:0/3621079338 learned_addr learned my addr 172.21.15.45:0/3621079338 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:36.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d504a700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d00b8b90 0x7f08d0159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d4849700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d015d0b0 0x7f08d00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 -- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d00b8b90 msgr2=0x7f08d0159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d00b8b90 0x7f08d0159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 -- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d015d0b0 msgr2=0x7f08d00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d015d0b0 0x7f08d00c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 -- 172.21.15.45:0/3621079338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0094b0 con 0x7f08d0161290 2023-12-19T17:51:36.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d4849700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d015d0b0 0x7f08d00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:51:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d584b700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 0x7f08d00b3670 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f08c800efc0 tx=0x7f08c800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8009b20 con 0x7f08d0161290 2023-12-19T17:51:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c800f040 con 0x7f08d0161290 2023-12-19T17:51:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08d015de40 con 0x7f08d0161290 2023-12-19T17:51:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c8009e50 con 0x7f08d0161290 2023-12-19T17:51:36.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08d015e400 con 0x7f08d0161290 2023-12-19T17:51:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.550+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08d00caf20 con 0x7f08d0161290 2023-12-19T17:51:36.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.554+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f08c8014480 con 0x7f08d0161290 2023-12-19T17:51:36.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.554+0000 7f08c5ffb700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f08b4065ad0 0x7f08b4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.554+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f08c8083af0 con 0x7f08d0161290 2023-12-19T17:51:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.554+0000 7f08d504a700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f08b4065ad0 0x7f08b4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:36.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.558+0000 7f08d504a700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f08b4065ad0 0x7f08b4067f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0090b0 tx=0x7f08cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:36.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.562+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f08c8051680 con 0x7f08d0161290 2023-12-19T17:51:36.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:36.738+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f08d004ed30 con 0x7f08d0161290 2023-12-19T17:51:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.338+0000 7f08c5ffb700 1 -- 172.21.15.45:0/3621079338 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f08c80180d0 con 0x7f08d0161290 2023-12-19T17:51:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.346+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f08b4065ad0 msgr2=0x7f08b4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.346+0000 7f08d72ae700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f08b4065ad0 0x7f08b4067f90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0090b0 tx=0x7f08cc008030 comp rx=0 tx=0).stop 2023-12-19T17:51:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.346+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 msgr2=0x7f08d00b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.346+0000 7f08d72ae700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 0x7f08d00b3670 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f08c800efc0 tx=0x7f08c800c3a0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 shutdown_connections 2023-12-19T17:51:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f08b4065ad0 0x7f08b4067f90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08d0161290 0x7f08d00b3670 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f08d015d0b0 0x7f08d00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 --2- 172.21.15.45:0/3621079338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f08d00b8b90 0x7f08d0159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 >> 172.21.15.45:0/3621079338 conn(0x7f08d00d2e10 msgr2=0x7f08d00b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:37.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.350+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 shutdown_connections 2023-12-19T17:51:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.354+0000 7f08d72ae700 1 -- 172.21.15.45:0/3621079338 wait complete. 2023-12-19T17:51:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-19T17:51:37.387 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T17:51:37.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.574+0000 7f55ddc08700 1 Processor -- start 2023-12-19T17:51:37.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.574+0000 7f55ddc08700 1 -- start start 2023-12-19T17:51:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55ddc08700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55d815cf20 0x7f55d80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55ddc08700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f55d80b8580 0x7f55d80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:37.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55ddc08700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55d815d300 con 0x7f55d80d25f0 2023-12-19T17:51:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55ddc08700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d80d1550 con 0x7f55d815cf20 2023-12-19T17:51:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55ddc08700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55d80d1830 con 0x7f55d80b8580 2023-12-19T17:51:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55dcc06700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f55d815cf20 0x7f55d80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:37.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55dd407700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f55d80d25f0 0x7f55d806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41942/0 (socket says 172.21.15.45:41942) 2023-12-19T17:51:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55dd407700 1 -- 172.21.15.45:0/442998311 learned_addr learned my addr 172.21.15.45:0/442998311 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d7fff700 1 --2- 172.21.15.45:0/442998311 >> v2:172.21.15.73:3300/0 conn(0x7f55d80b8580 0x7f55d80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d77fe700 1 -- 172.21.15.45:0/442998311 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2184073510 0 0) 0x7f55d815d300 con 0x7f55d80d25f0 2023-12-19T17:51:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d77fe700 1 -- 172.21.15.45:0/442998311 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55c80035d0 con 0x7f55d80d25f0 2023-12-19T17:51:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d7fff700 1 -- 172.21.15.45:0/442998311 >> v2:172.21.15.45:3300/0 conn(0x7f55d815cf20 msgr2=0x7f55d80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:37.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d7fff700 1 --2- 172.21.15.45:0/442998311 >> v2:172.21.15.45:3300/0 conn(0x7f55d815cf20 0x7f55d80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d7fff700 1 -- 172.21.15.45:0/442998311 >> v1:172.21.15.45:6789/0 conn(0x7f55d80d25f0 legacy=0x7f55d806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.578+0000 7f55d7fff700 1 -- 172.21.15.45:0/442998311 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d80d1b10 con 0x7f55d80b8580 2023-12-19T17:51:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55d7fff700 1 --2- 172.21.15.45:0/442998311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d80cd8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55d80ce9d0 tx=0x7f55c4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab563c5aa7d27e99 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55d77fe700 1 -- 172.21.15.45:0/442998311 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4011830 con 0x7f55d80b8580 2023-12-19T17:51:37.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55d77fe700 1 -- 172.21.15.45:0/442998311 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c4011990 con 0x7f55d80b8580 2023-12-19T17:51:37.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55d77fe700 1 -- 172.21.15.45:0/442998311 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4011d00 con 0x7f55d80b8580 2023-12-19T17:51:37.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 -- 172.21.15.45:0/442998311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 msgr2=0x7f55d80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 --2- 172.21.15.45:0/442998311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d80cd8c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f55d80ce9d0 tx=0x7f55c4009b30 comp rx=0 tx=0).stop 2023-12-19T17:51:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 -- 172.21.15.45:0/442998311 shutdown_connections 2023-12-19T17:51:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 --2- 172.21.15.45:0/442998311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d80cd8c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 --2- 172.21.15.45:0/442998311 >> v2:172.21.15.45:3300/0 conn(0x7f55d815cf20 0x7f55d80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 -- 172.21.15.45:0/442998311 >> 172.21.15.45:0/442998311 conn(0x7f55d80b4670 msgr2=0x7f55d80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:37.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 -- 172.21.15.45:0/442998311 shutdown_connections 2023-12-19T17:51:37.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.582+0000 7f55ddc08700 1 -- 172.21.15.45:0/442998311 wait complete. 2023-12-19T17:51:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.586+0000 7f55ddc08700 1 Processor -- start 2023-12-19T17:51:37.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.586+0000 7f55ddc08700 1 -- start start 2023-12-19T17:51:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d815d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 0x7f55d81593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55d815cf20 0x7f55d80b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d815da30 con 0x7f55d80d25f0 2023-12-19T17:51:37.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d815dce0 con 0x7f55d80b8580 2023-12-19T17:51:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d815dfc0 con 0x7f55d815cf20 2023-12-19T17:51:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 0x7f55d81593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 0x7f55d81593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41682/0 (socket says 172.21.15.45:41682) 2023-12-19T17:51:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 -- 172.21.15.45:0/2107494495 learned_addr learned my addr 172.21.15.45:0/2107494495 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:37.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55dd407700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55d815cf20 0x7f55d80b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55dcc06700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d815d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 -- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55d815cf20 msgr2=0x7f55d80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55d815cf20 0x7f55d80b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 -- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 msgr2=0x7f55d815d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d815d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 -- 172.21.15.45:0/2107494495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40094b0 con 0x7f55d80d25f0 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55dcc06700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:37.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d7fff700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 0x7f55d81593a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55c4014040 tx=0x7f55c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c4004590 con 0x7f55d80d25f0 2023-12-19T17:51:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c401e070 con 0x7f55d80d25f0 2023-12-19T17:51:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d815e2a0 con 0x7f55d80d25f0 2023-12-19T17:51:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c40038c0 con 0x7f55d80d25f0 2023-12-19T17:51:37.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.590+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d815e860 con 0x7f55d80d25f0 2023-12-19T17:51:37.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.594+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d815ea50 con 0x7f55d80d25f0 2023-12-19T17:51:37.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.594+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f55c4003a20 con 0x7f55d80d25f0 2023-12-19T17:51:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.598+0000 7f55d57fa700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55bc065ad0 0x7f55bc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.598+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f55c4083ee0 con 0x7f55d80d25f0 2023-12-19T17:51:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.598+0000 7f55dcc06700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55bc065ad0 0x7f55bc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:37.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.598+0000 7f55dcc06700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55bc065ad0 0x7f55bc067f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55d80b3ae0 tx=0x7f55cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.602+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f55c40518f0 con 0x7f55d80d25f0 2023-12-19T17:51:37.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.818+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f55d804ed30 con 0x7f55d80d25f0 2023-12-19T17:51:37.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.830+0000 7f55d57fa700 1 -- 172.21.15.45:0/2107494495 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f55c40200c0 con 0x7f55d80d25f0 2023-12-19T17:51:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55bc065ad0 msgr2=0x7f55bc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55bc065ad0 0x7f55bc067f90 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f55d80b3ae0 tx=0x7f55cc008040 comp rx=0 tx=0).stop 2023-12-19T17:51:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 msgr2=0x7f55d81593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 0x7f55d81593a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55c4014040 tx=0x7f55c4004770 comp rx=0 tx=0).stop 2023-12-19T17:51:37.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 shutdown_connections 2023-12-19T17:51:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55bc065ad0 0x7f55bc067f90 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55d815cf20 0x7f55d80b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f55d80d25f0 0x7f55d81593a0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f55c4014040 tx=0x7f55c4004770 comp rx=0 tx=0).stop 2023-12-19T17:51:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 --2- 172.21.15.45:0/2107494495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55d80b8580 0x7f55d815d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:37.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 >> 172.21.15.45:0/2107494495 conn(0x7f55d80b4670 msgr2=0x7f55d80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 shutdown_connections 2023-12-19T17:51:37.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:37.838+0000 7f55ddc08700 1 -- 172.21.15.45:0/2107494495 wait complete. 2023-12-19T17:51:37.847 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 2 and data pool 3 2023-12-19T17:51:37.875 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-19T17:51:37.876 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-19T17:51:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.050+0000 7f85ea15d700 1 Processor -- start 2023-12-19T17:51:38.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.050+0000 7f85ea15d700 1 -- start start 2023-12-19T17:51:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85ea15d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e415d160 0x7f85e40cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85ea15d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f85e40cd0b0 0x7f85e40b1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85ea15d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85e40ccc20 con 0x7f85e40cba70 2023-12-19T17:51:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85ea15d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85e415d540 con 0x7f85e40cd0b0 2023-12-19T17:51:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85ea15d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40cc010 con 0x7f85e415d160 2023-12-19T17:51:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e995c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85e40cba70 0x7f85e4070300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41944/0 (socket says 172.21.15.45:41944) 2023-12-19T17:51:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e995c700 1 -- 172.21.15.45:0/3768417588 learned_addr learned my addr 172.21.15.45:0/3768417588 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e915b700 1 --2- 172.21.15.45:0/3768417588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e415d160 0x7f85e40cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e895a700 1 --2- 172.21.15.45:0/3768417588 >> v2:172.21.15.73:3300/0 conn(0x7f85e40cd0b0 0x7f85e40b1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e915b700 1 -- 172.21.15.45:0/3768417588 >> v2:172.21.15.73:3300/0 conn(0x7f85e40cd0b0 msgr2=0x7f85e40b1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e915b700 1 --2- 172.21.15.45:0/3768417588 >> v2:172.21.15.73:3300/0 conn(0x7f85e40cd0b0 0x7f85e40b1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e915b700 1 -- 172.21.15.45:0/3768417588 >> v1:172.21.15.45:6789/0 conn(0x7f85e40cba70 legacy=0x7f85e4070300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e915b700 1 -- 172.21.15.45:0/3768417588 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e40cc2f0 con 0x7f85e415d160 2023-12-19T17:51:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85dbfff700 1 -- 172.21.15.45:0/3768417588 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130726672 0 0) 0x7f85e40ccc20 con 0x7f85e40cba70 2023-12-19T17:51:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85e915b700 1 --2- 172.21.15.45:0/3768417588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e415d160 0x7f85e40cb530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009850 tx=0x7f85e0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e9b083d6e089dcb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.054+0000 7f85dbfff700 1 -- 172.21.15.45:0/3768417588 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011830 con 0x7f85e415d160 2023-12-19T17:51:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85dbfff700 1 -- 172.21.15.45:0/3768417588 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e0011990 con 0x7f85e415d160 2023-12-19T17:51:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85dbfff700 1 -- 172.21.15.45:0/3768417588 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011d40 con 0x7f85e415d160 2023-12-19T17:51:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 -- 172.21.15.45:0/3768417588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e415d160 msgr2=0x7f85e40cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 --2- 172.21.15.45:0/3768417588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e415d160 0x7f85e40cb530 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009850 tx=0x7f85e0009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 -- 172.21.15.45:0/3768417588 shutdown_connections 2023-12-19T17:51:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 --2- 172.21.15.45:0/3768417588 >> v2:172.21.15.73:3300/0 conn(0x7f85e40cd0b0 0x7f85e40b1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 --2- 172.21.15.45:0/3768417588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e415d160 0x7f85e40cb530 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 -- 172.21.15.45:0/3768417588 >> 172.21.15.45:0/3768417588 conn(0x7f85e40b25f0 msgr2=0x7f85e40b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 -- 172.21.15.45:0/3768417588 shutdown_connections 2023-12-19T17:51:38.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.058+0000 7f85ea15d700 1 -- 172.21.15.45:0/3768417588 wait complete. 2023-12-19T17:51:38.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 Processor -- start 2023-12-19T17:51:38.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 -- start start 2023-12-19T17:51:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e40cba70 0x7f85e40ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40cd0b0 0x7f85e41f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 0x7f85e41f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c6840 con 0x7f85e415d160 2023-12-19T17:51:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40b6340 con 0x7f85e40cd0b0 2023-12-19T17:51:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85ea15d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e40c6a90 con 0x7f85e40cba70 2023-12-19T17:51:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85e995c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 0x7f85e41f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85e995c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 0x7f85e41f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41692/0 (socket says 172.21.15.45:41692) 2023-12-19T17:51:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85e995c700 1 -- 172.21.15.45:0/933106208 learned_addr learned my addr 172.21.15.45:0/933106208 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.062+0000 7f85e915b700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e40cba70 0x7f85e40ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e895a700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40cd0b0 0x7f85e41f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e995c700 1 -- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e40cba70 msgr2=0x7f85e40ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e995c700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e40cba70 0x7f85e40ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e995c700 1 -- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40cd0b0 msgr2=0x7f85e41f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e995c700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40cd0b0 0x7f85e41f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e995c700 1 -- 172.21.15.45:0/933106208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e00094b0 con 0x7f85e415d160 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e915b700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e40cba70 0x7f85e40ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e895a700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40cd0b0 0x7f85e41f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85e995c700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 0x7f85e41f62b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85dc002230 tx=0x7f85dc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc00ac20 con 0x7f85e415d160 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85dc00ada0 con 0x7f85e415d160 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e40c6d70 con 0x7f85e415d160 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc007310 con 0x7f85e415d160 2023-12-19T17:51:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e40c7570 con 0x7f85e415d160 2023-12-19T17:51:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.066+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85e40c7290 con 0x7f85e415d160 2023-12-19T17:51:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.070+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85dc007470 con 0x7f85e415d160 2023-12-19T17:51:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.070+0000 7f85d9ffb700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85c8065ad0 0x7f85c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.070+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85dc082d60 con 0x7f85e415d160 2023-12-19T17:51:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.070+0000 7f85e915b700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85c8065ad0 0x7f85c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:38.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.074+0000 7f85e915b700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85c8065ad0 0x7f85c8067f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85e00090b0 tx=0x7f85e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:38.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.078+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f85e40c7290 con 0x7f85e415d160 2023-12-19T17:51:38.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.270+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f85e40c7290 con 0x7f85e415d160 2023-12-19T17:51:38.771 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:51:38.769+0000 7f2d0ebeb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:51:38.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.838+0000 7f85d9ffb700 1 -- 172.21.15.45:0/933106208 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f85e40c7290 con 0x7f85e415d160 2023-12-19T17:51:38.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85c8065ad0 msgr2=0x7f85c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:38.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85c8065ad0 0x7f85c8067f90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f85e00090b0 tx=0x7f85e001c040 comp rx=0 tx=0).stop 2023-12-19T17:51:38.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 msgr2=0x7f85e41f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:38.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 0x7f85e41f62b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f85dc002230 tx=0x7f85dc00a060 comp rx=0 tx=0).stop 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 shutdown_connections 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85c8065ad0 0x7f85c8067f90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85e415d160 0x7f85e41f62b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85e40cd0b0 0x7f85e41f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 --2- 172.21.15.45:0/933106208 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85e40cba70 0x7f85e40ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 >> 172.21.15.45:0/933106208 conn(0x7f85e40b25f0 msgr2=0x7f85e40719d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 shutdown_connections 2023-12-19T17:51:38.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:38.846+0000 7f85ea15d700 1 -- 172.21.15.45:0/933106208 wait complete. 2023-12-19T17:51:38.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T17:51:39.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 Processor -- start 2023-12-19T17:51:39.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 -- start start 2023-12-19T17:51:39.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee415ab90 0x7efee40c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:39.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efee40701b0 0x7efee40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:39.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efee40cc430 con 0x7efee40c5ba0 2023-12-19T17:51:39.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efee415af70 con 0x7efee40701b0 2023-12-19T17:51:39.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.050+0000 7efee3fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee40b2a50 con 0x7efee415ab90 2023-12-19T17:51:39.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efedbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efee40c5ba0 0x7efee406faa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40114/0 (socket says 172.21.15.45:40114) 2023-12-19T17:51:39.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efedbfff700 1 -- 172.21.15.45:0/2562062957 learned_addr learned my addr 172.21.15.45:0/2562062957 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:39.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee37fe700 1 --2- 172.21.15.45:0/2562062957 >> v2:172.21.15.73:3300/0 conn(0x7efee40701b0 0x7efee40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:39.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee2ffd700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee415ab90 0x7efee40c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:39.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee27fc700 1 -- 172.21.15.45:0/2562062957 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568064761 0 0) 0x7efee40cc430 con 0x7efee40c5ba0 2023-12-19T17:51:39.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee27fc700 1 -- 172.21.15.45:0/2562062957 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efed00035d0 con 0x7efee40c5ba0 2023-12-19T17:51:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee37fe700 1 -- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee415ab90 msgr2=0x7efee40c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee37fe700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee415ab90 0x7efee40c86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee37fe700 1 -- 172.21.15.45:0/2562062957 >> v1:172.21.15.45:6789/0 conn(0x7efee40c5ba0 legacy=0x7efee406faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee27fc700 1 -- 172.21.15.45:0/2562062957 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 137666858 0 0) 0x7efed00035d0 con 0x7efee40c5ba0 2023-12-19T17:51:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee37fe700 1 -- 172.21.15.45:0/2562062957 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efee40b2cf0 con 0x7efee40701b0 2023-12-19T17:51:39.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee2ffd700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee415ab90 0x7efee40c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee37fe700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee40cc8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efedc009dc0 tx=0x7efedc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351a6443daf20b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee27fc700 1 -- 172.21.15.45:0/2562062957 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc00e070 con 0x7efee40701b0 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee27fc700 1 -- 172.21.15.45:0/2562062957 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc003a40 con 0x7efee40701b0 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.054+0000 7efee27fc700 1 -- 172.21.15.45:0/2562062957 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efecc001670 con 0x7efee40701b0 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 -- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 msgr2=0x7efee40cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee40cc8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efedc009dc0 tx=0x7efedc00b330 comp rx=0 tx=0).stop 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 -- 172.21.15.45:0/2562062957 shutdown_connections 2023-12-19T17:51:39.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee40cc8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 --2- 172.21.15.45:0/2562062957 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee415ab90 0x7efee40c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 -- 172.21.15.45:0/2562062957 >> 172.21.15.45:0/2562062957 conn(0x7efee40cb970 msgr2=0x7efee4070d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 -- 172.21.15.45:0/2562062957 shutdown_connections 2023-12-19T17:51:39.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 -- 172.21.15.45:0/2562062957 wait complete. 2023-12-19T17:51:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 Processor -- start 2023-12-19T17:51:39.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.058+0000 7efee3fff700 1 -- start start 2023-12-19T17:51:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee41468e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee40c5ba0 0x7efee41f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 0x7efee4155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee4154350 con 0x7efee415ab90 2023-12-19T17:51:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efee41f5bc0 con 0x7efee40701b0 2023-12-19T17:51:39.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efee41545a0 con 0x7efee40c5ba0 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 0x7efee4155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 0x7efee4155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41000/0 (socket says 172.21.15.45:41000) 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 -- 172.21.15.45:0/3179005681 learned_addr learned my addr 172.21.15.45:0/3179005681 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee2ffd700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee41468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efedbfff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee40c5ba0 0x7efee41f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 -- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee40c5ba0 msgr2=0x7efee41f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee40c5ba0 0x7efee41f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 -- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 msgr2=0x7efee41468e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee41468e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 -- 172.21.15.45:0/3179005681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efedc009a70 con 0x7efee415ab90 2023-12-19T17:51:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efedbfff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee40c5ba0 0x7efee41f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee37fe700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 0x7efee4155360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efedc015040 tx=0x7efedc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc0045c0 con 0x7efee415ab90 2023-12-19T17:51:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efee4154880 con 0x7efee415ab90 2023-12-19T17:51:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efedc004720 con 0x7efee415ab90 2023-12-19T17:51:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efedc009410 con 0x7efee415ab90 2023-12-19T17:51:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.062+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efee4154e40 con 0x7efee415ab90 2023-12-19T17:51:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.066+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efee4067760 con 0x7efee415ab90 2023-12-19T17:51:39.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.066+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efedc012450 con 0x7efee415ab90 2023-12-19T17:51:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.070+0000 7efee0ff9700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efec4065ad0 0x7efec4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.070+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7efedc0848f0 con 0x7efee415ab90 2023-12-19T17:51:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.070+0000 7efee2ffd700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efec4065ad0 0x7efec4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.070+0000 7efee2ffd700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efec4065ad0 0x7efec4067f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efed40044b0 tx=0x7efed4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.074+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efedc055bd0 con 0x7efee415ab90 2023-12-19T17:51:39.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:39.254+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efee4070d30 con 0x7efee415ab90 2023-12-19T17:51:40.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.858+0000 7efee0ff9700 1 -- 172.21.15.45:0/3179005681 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7efedc055760 con 0x7efee415ab90 2023-12-19T17:51:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efec4065ad0 msgr2=0x7efec4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efec4065ad0 0x7efec4067f90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efed40044b0 tx=0x7efed4008040 comp rx=0 tx=0).stop 2023-12-19T17:51:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 msgr2=0x7efee4155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:40.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 0x7efee4155360 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7efedc015040 tx=0x7efedc004af0 comp rx=0 tx=0).stop 2023-12-19T17:51:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 shutdown_connections 2023-12-19T17:51:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efec4065ad0 0x7efec4067f90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efee415ab90 0x7efee4155360 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efee40c5ba0 0x7efee41f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:40.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 --2- 172.21.15.45:0/3179005681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efee40701b0 0x7efee41468e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:40.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.866+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 >> 172.21.15.45:0/3179005681 conn(0x7efee40cb970 msgr2=0x7efee4071250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:40.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.870+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 shutdown_connections 2023-12-19T17:51:40.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:40.870+0000 7efee3fff700 1 -- 172.21.15.45:0/3179005681 wait complete. 2023-12-19T17:51:40.875 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' created 2023-12-19T17:51:40.894 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-19T17:51:41.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.070+0000 7faa90d84700 1 Processor -- start 2023-12-19T17:51:41.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.070+0000 7faa90d84700 1 -- start start 2023-12-19T17:51:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa90d84700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa8c15ccb0 0x7faa8c0b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:41.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa90d84700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c0d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa90d84700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa8c0d15b0 con 0x7faa8c0d0e40 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa90d84700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c0d2b90 con 0x7faa8c15ccb0 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa90d84700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0d1890 con 0x7faa8c15d090 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa8b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faa8c15ccb0 0x7faa8c0b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa8affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c0d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa8affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c0d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:33992/0 (socket says 172.21.15.45:33992) 2023-12-19T17:51:41.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.074+0000 7faa8affd700 1 -- 172.21.15.45:0/469468859 learned_addr learned my addr 172.21.15.45:0/469468859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8affd700 1 -- 172.21.15.45:0/469468859 >> v2:172.21.15.45:3300/0 conn(0x7faa8c15ccb0 msgr2=0x7faa8c0b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8affd700 1 --2- 172.21.15.45:0/469468859 >> v2:172.21.15.45:3300/0 conn(0x7faa8c15ccb0 0x7faa8c0b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8affd700 1 -- 172.21.15.45:0/469468859 >> v1:172.21.15.45:6789/0 conn(0x7faa8c0d0e40 legacy=0x7faa8c070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8affd700 1 -- 172.21.15.45:0/469468859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c0d1b70 con 0x7faa8c15d090 2023-12-19T17:51:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8a7fc700 1 -- 172.21.15.45:0/469468859 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257473614 0 0) 0x7faa8c0d15b0 con 0x7faa8c0d0e40 2023-12-19T17:51:41.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8affd700 1 --2- 172.21.15.45:0/469468859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c0d2650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa80009910 tx=0x7faa80009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70651ac7b9ef8fb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:41.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8a7fc700 1 -- 172.21.15.45:0/469468859 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011830 con 0x7faa8c15d090 2023-12-19T17:51:41.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8a7fc700 1 -- 172.21.15.45:0/469468859 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa80011990 con 0x7faa8c15d090 2023-12-19T17:51:41.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa8a7fc700 1 -- 172.21.15.45:0/469468859 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80011d40 con 0x7faa8c15d090 2023-12-19T17:51:41.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 -- 172.21.15.45:0/469468859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 msgr2=0x7faa8c0d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 --2- 172.21.15.45:0/469468859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c0d2650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7faa80009910 tx=0x7faa80009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 -- 172.21.15.45:0/469468859 shutdown_connections 2023-12-19T17:51:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 --2- 172.21.15.45:0/469468859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c0d2650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 --2- 172.21.15.45:0/469468859 >> v2:172.21.15.45:3300/0 conn(0x7faa8c15ccb0 0x7faa8c0b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 -- 172.21.15.45:0/469468859 >> 172.21.15.45:0/469468859 conn(0x7faa8c0d2f50 msgr2=0x7faa8c0d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 -- 172.21.15.45:0/469468859 shutdown_connections 2023-12-19T17:51:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.078+0000 7faa90d84700 1 -- 172.21.15.45:0/469468859 wait complete. 2023-12-19T17:51:41.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 Processor -- start 2023-12-19T17:51:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 -- start start 2023-12-19T17:51:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa8c0d0e40 0x7faa8c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 0x7faa8c1434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c143a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0c92b0 con 0x7faa8c15ccb0 2023-12-19T17:51:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0c7cd0 con 0x7faa8c0d0e40 2023-12-19T17:51:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa90d84700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0c7fb0 con 0x7faa8c15d090 2023-12-19T17:51:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 0x7faa8c1434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 0x7faa8c1434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41016/0 (socket says 172.21.15.45:41016) 2023-12-19T17:51:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 -- 172.21.15.45:0/4099925107 learned_addr learned my addr 172.21.15.45:0/4099925107 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8bfff700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c143a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8b7fe700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa8c0d0e40 0x7faa8c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 -- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 msgr2=0x7faa8c143a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c143a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 -- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa8c0d0e40 msgr2=0x7faa8c0c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa8c0d0e40 0x7faa8c0c8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.082+0000 7faa8affd700 1 -- 172.21.15.45:0/4099925107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa80009570 con 0x7faa8c15ccb0 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa8affd700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 0x7faa8c1434e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa80014040 tx=0x7faa80004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000b970 con 0x7faa8c15ccb0 2023-12-19T17:51:41.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa8001e070 con 0x7faa8c15ccb0 2023-12-19T17:51:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8000bd30 con 0x7faa8c15ccb0 2023-12-19T17:51:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c0c8290 con 0x7faa8c15ccb0 2023-12-19T17:51:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c0c8850 con 0x7faa8c15ccb0 2023-12-19T17:51:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.086+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c067c10 con 0x7faa8c15ccb0 2023-12-19T17:51:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.090+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa8001a420 con 0x7faa8c15ccb0 2023-12-19T17:51:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.090+0000 7faa73fff700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa78065b20 0x7faa78067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.090+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7faa800843f0 con 0x7faa8c15ccb0 2023-12-19T17:51:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.090+0000 7faa8b7fe700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa78065b20 0x7faa78067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.094+0000 7faa8b7fe700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa78065b20 0x7faa78067fe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009b80 tx=0x7faa7c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.098+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faa80051b50 con 0x7faa8c15ccb0 2023-12-19T17:51:41.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.286+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7faa8c04ed30 con 0x7faa8c15ccb0 2023-12-19T17:51:41.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.862+0000 7faa73fff700 1 -- 172.21.15.45:0/4099925107 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7faa80006da0 con 0x7faa8c15ccb0 2023-12-19T17:51:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.874+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa78065b20 msgr2=0x7faa78067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.874+0000 7faa90d84700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa78065b20 0x7faa78067fe0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009b80 tx=0x7faa7c008040 comp rx=0 tx=0).stop 2023-12-19T17:51:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.874+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 msgr2=0x7faa8c1434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.874+0000 7faa90d84700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 0x7faa8c1434e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faa80014040 tx=0x7faa80004770 comp rx=0 tx=0).stop 2023-12-19T17:51:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 shutdown_connections 2023-12-19T17:51:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa78065b20 0x7faa78067fe0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa8c15d090 0x7faa8c143a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa8c15ccb0 0x7faa8c1434e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 --2- 172.21.15.45:0/4099925107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa8c0d0e40 0x7faa8c0c8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:41.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 >> 172.21.15.45:0/4099925107 conn(0x7faa8c0d2f50 msgr2=0x7faa8c1587e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 shutdown_connections 2023-12-19T17:51:41.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:41.878+0000 7faa90d84700 1 -- 172.21.15.45:0/4099925107 wait complete. 2023-12-19T17:51:41.887 INFO:teuthology.orchestra.run.smithi045.stderr:set pool 4 allow_ec_overwrites to true 2023-12-19T17:51:41.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-19T17:51:42.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.094+0000 7f6da25a0700 1 Processor -- start 2023-12-19T17:51:42.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.094+0000 7f6da25a0700 1 -- start start 2023-12-19T17:51:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da25a0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da25a0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c070d20 con 0x7f6d9c0cf2e0 2023-12-19T17:51:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da25a0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9c0af190 con 0x7f6d9c0cfa70 2023-12-19T17:51:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da25a0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c15e200 con 0x7f6d9c0cff00 2023-12-19T17:51:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6d9bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6d9c0cf2e0 0x7f6d9c0ccdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40130/0 (socket says 172.21.15.45:40130) 2023-12-19T17:51:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6d9bfff700 1 -- 172.21.15.45:0/3293519405 learned_addr learned my addr 172.21.15.45:0/3293519405 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da0b3d700 1 --2- 172.21.15.45:0/3293519405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da0b3d700 1 -- 172.21.15.45:0/3293519405 >> v1:172.21.15.73:6789/0 conn(0x7f6d9c0cfa70 legacy=0x7f6d9c0700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da0b3d700 1 -- 172.21.15.45:0/3293519405 >> v1:172.21.15.45:6789/0 conn(0x7f6d9c0cf2e0 legacy=0x7f6d9c0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da0b3d700 1 -- 172.21.15.45:0/3293519405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9c15e4e0 con 0x7f6d9c0cff00 2023-12-19T17:51:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.098+0000 7f6da0b3d700 1 --2- 172.21.15.45:0/3293519405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0707e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009880 tx=0x7f6d8c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91118755e757d6b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6d9affd700 1 -- 172.21.15.45:0/3293519405 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c011830 con 0x7f6d9c0cff00 2023-12-19T17:51:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6d9affd700 1 -- 172.21.15.45:0/3293519405 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c011990 con 0x7f6d9c0cff00 2023-12-19T17:51:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6d9affd700 1 -- 172.21.15.45:0/3293519405 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c011d20 con 0x7f6d9c0cff00 2023-12-19T17:51:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 -- 172.21.15.45:0/3293519405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 msgr2=0x7f6d9c0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 --2- 172.21.15.45:0/3293519405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0707e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c009880 tx=0x7f6d8c009b90 comp rx=0 tx=0).stop 2023-12-19T17:51:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 -- 172.21.15.45:0/3293519405 shutdown_connections 2023-12-19T17:51:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 --2- 172.21.15.45:0/3293519405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0707e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 -- 172.21.15.45:0/3293519405 >> 172.21.15.45:0/3293519405 conn(0x7f6d9c06a010 msgr2=0x7f6d9c06a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 -- 172.21.15.45:0/3293519405 shutdown_connections 2023-12-19T17:51:42.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.102+0000 7f6da25a0700 1 -- 172.21.15.45:0/3293519405 wait complete. 2023-12-19T17:51:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 Processor -- start 2023-12-19T17:51:42.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 -- start start 2023-12-19T17:51:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d9c0cf2e0 0x7f6d9c14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d9c0cfa70 0x7f6d9c0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c159c60 con 0x7f6d9c0cf2e0 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c159f40 con 0x7f6d9c0cfa70 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da25a0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9c15a220 con 0x7f6d9c0cff00 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6d9b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d9c0cfa70 0x7f6d9c0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6d9bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d9c0cf2e0 0x7f6d9c14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da0b3d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6d9b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d9c0cfa70 0x7f6d9c0b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33574/0 (socket says 172.21.15.45:33574) 2023-12-19T17:51:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6d9b7fe700 1 -- 172.21.15.45:0/1367919591 learned_addr learned my addr 172.21.15.45:0/1367919591 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da0b3d700 1 -- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d9c0cfa70 msgr2=0x7f6d9c0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da0b3d700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d9c0cfa70 0x7f6d9c0b0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da0b3d700 1 -- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d9c0cf2e0 msgr2=0x7f6d9c14a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da0b3d700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d9c0cf2e0 0x7f6d9c14a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6da0b3d700 1 -- 172.21.15.45:0/1367919591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d8c0094b0 con 0x7f6d9c0cff00 2023-12-19T17:51:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.106+0000 7f6d9bfff700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d9c0cf2e0 0x7f6d9c14a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6da0b3d700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0c8d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c016000 tx=0x7f6d8c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:42.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c004480 con 0x7f6d9c0cff00 2023-12-19T17:51:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8c01f070 con 0x7f6d9c0cff00 2023-12-19T17:51:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8c003900 con 0x7f6d9c0cff00 2023-12-19T17:51:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d9c15a500 con 0x7f6d9c0cff00 2023-12-19T17:51:42.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d9c14adf0 con 0x7f6d9c0cff00 2023-12-19T17:51:42.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.110+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d9c15aa20 con 0x7f6d9c0cff00 2023-12-19T17:51:42.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.114+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6d8c021030 con 0x7f6d9c0cff00 2023-12-19T17:51:42.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.114+0000 7f6d98ff9700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6d7c065ad0 0x7f6d7c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.114+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f6d8c0844d0 con 0x7f6d9c0cff00 2023-12-19T17:51:42.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.114+0000 7f6d9bfff700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6d7c065ad0 0x7f6d7c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.114+0000 7f6d9bfff700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6d7c065ad0 0x7f6d7c067f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d94005cb0 tx=0x7f6d94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:42.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.122+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6d9c15aa20 con 0x7f6d9c0cff00 2023-12-19T17:51:42.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.342+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f6d9c15aa20 con 0x7f6d9c0cff00 2023-12-19T17:51:42.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6d98ff9700 1 -- 172.21.15.45:0/1367919591 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7f6d9c15aa20 con 0x7f6d9c0cff00 2023-12-19T17:51:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6d7c065ad0 msgr2=0x7f6d7c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6d7c065ad0 0x7f6d7c067f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d94005cb0 tx=0x7f6d94009040 comp rx=0 tx=0).stop 2023-12-19T17:51:42.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 msgr2=0x7f6d9c0c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0c8d80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c016000 tx=0x7f6d8c004770 comp rx=0 tx=0).stop 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 shutdown_connections 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6d7c065ad0 0x7f6d7c067f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6d9c0cff00 0x7f6d9c0c8d80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d9c0cfa70 0x7f6d9c0b0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 --2- 172.21.15.45:0/1367919591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6d9c0cf2e0 0x7f6d9c14a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.358+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 >> 172.21.15.45:0/1367919591 conn(0x7f6d9c06a010 msgr2=0x7f6d9c0ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.362+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 shutdown_connections 2023-12-19T17:51:42.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.362+0000 7f6da25a0700 1 -- 172.21.15.45:0/1367919591 wait complete. 2023-12-19T17:51:42.364 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 4 to fsmap 2023-12-19T17:51:42.386 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:51:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f46661f9700 1 Processor -- start 2023-12-19T17:51:42.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f46661f9700 1 -- start start 2023-12-19T17:51:42.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f46661f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46600cddd0 0x7f46600ce200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f46661f9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46600ae1e0 con 0x7f466015e260 2023-12-19T17:51:42.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f46661f9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f466015af30 con 0x7f466015ab50 2023-12-19T17:51:42.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f46661f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600ce740 con 0x7f46600cddd0 2023-12-19T17:51:42.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f4657fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f466015e260 0x7f466006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40134/0 (socket says 172.21.15.45:40134) 2023-12-19T17:51:42.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f4657fff700 1 -- 172.21.15.45:0/1913102785 learned_addr learned my addr 172.21.15.45:0/1913102785 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:42.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.574+0000 7f465ffff700 1 --2- 172.21.15.45:0/1913102785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46600cddd0 0x7f46600ce200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465effd700 1 -- 172.21.15.45:0/1913102785 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731859111 0 0) 0x7f466015af30 con 0x7f466015ab50 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465effd700 1 -- 172.21.15.45:0/1913102785 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f464c0035d0 con 0x7f466015ab50 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465effd700 1 -- 172.21.15.45:0/1913102785 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3005031023 0 0) 0x7f4648001110 con 0x7f466015e260 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465ffff700 1 -- 172.21.15.45:0/1913102785 >> v1:172.21.15.73:6789/0 conn(0x7f466015ab50 legacy=0x7f46600adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465ffff700 1 -- 172.21.15.45:0/1913102785 >> v1:172.21.15.45:6789/0 conn(0x7f466015e260 legacy=0x7f466006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465ffff700 1 -- 172.21.15.45:0/1913102785 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46600cd010 con 0x7f46600cddd0 2023-12-19T17:51:42.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465ffff700 1 --2- 172.21.15.45:0/1913102785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46600cddd0 0x7f46600ce200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4658009dc0 tx=0x7f465800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ecc24e97de6db4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465effd700 1 -- 172.21.15.45:0/1913102785 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800e070 con 0x7f46600cddd0 2023-12-19T17:51:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465effd700 1 -- 172.21.15.45:0/1913102785 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465800bb20 con 0x7f46600cddd0 2023-12-19T17:51:42.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f465effd700 1 -- 172.21.15.45:0/1913102785 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465800bed0 con 0x7f46600cddd0 2023-12-19T17:51:42.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 -- 172.21.15.45:0/1913102785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46600cddd0 msgr2=0x7f46600ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 --2- 172.21.15.45:0/1913102785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46600cddd0 0x7f46600ce200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4658009dc0 tx=0x7f465800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 -- 172.21.15.45:0/1913102785 shutdown_connections 2023-12-19T17:51:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 --2- 172.21.15.45:0/1913102785 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46600cddd0 0x7f46600ce200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 -- 172.21.15.45:0/1913102785 >> 172.21.15.45:0/1913102785 conn(0x7f46600cba40 msgr2=0x7f46600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 -- 172.21.15.45:0/1913102785 shutdown_connections 2023-12-19T17:51:42.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.578+0000 7f46661f9700 1 -- 172.21.15.45:0/1913102785 wait complete. 2023-12-19T17:51:42.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 Processor -- start 2023-12-19T17:51:42.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 -- start start 2023-12-19T17:51:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46600cddd0 0x7f46600ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f466015ab50 0x7f466015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 0x7f4660149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600ae070 con 0x7f466015e260 2023-12-19T17:51:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600ad4f0 con 0x7f46600cddd0 2023-12-19T17:51:42.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f46661f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600ad7d0 con 0x7f466015ab50 2023-12-19T17:51:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f465ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 0x7f4660149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f465ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 0x7f4660149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41042/0 (socket says 172.21.15.45:41042) 2023-12-19T17:51:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f465ffff700 1 -- 172.21.15.45:0/1971520023 learned_addr learned my addr 172.21.15.45:0/1971520023 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.582+0000 7f465f7fe700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46600cddd0 0x7f46600ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f4657fff700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f466015ab50 0x7f466015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465ffff700 1 -- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f466015ab50 msgr2=0x7f466015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465ffff700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f466015ab50 0x7f466015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465ffff700 1 -- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46600cddd0 msgr2=0x7f46600ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465ffff700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46600cddd0 0x7f46600ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465ffff700 1 -- 172.21.15.45:0/1971520023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4658009a70 con 0x7f466015e260 2023-12-19T17:51:42.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465ffff700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 0x7f4660149870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4658009f30 tx=0x7f4658004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465801b810 con 0x7f466015e260 2023-12-19T17:51:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4658020070 con 0x7f466015e260 2023-12-19T17:51:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46600adab0 con 0x7f466015e260 2023-12-19T17:51:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465801bbf0 con 0x7f466015e260 2023-12-19T17:51:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4660155a20 con 0x7f466015e260 2023-12-19T17:51:42.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.586+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466004ed30 con 0x7f466015e260 2023-12-19T17:51:42.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.590+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f465801bd50 con 0x7f466015e260 2023-12-19T17:51:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.590+0000 7f465cff9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4640065ad0 0x7f4640067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.590+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4658022070 con 0x7f466015e260 2023-12-19T17:51:42.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.590+0000 7f465f7fe700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4640065ad0 0x7f4640067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:42.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.594+0000 7f465f7fe700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4640065ad0 0x7f4640067f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4650001010 tx=0x7f4650009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:42.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.598+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f46580532b0 con 0x7f466015e260 2023-12-19T17:51:42.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.810+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46600ce460 con 0x7f466015e260 2023-12-19T17:51:42.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.814+0000 7f465cff9700 1 -- 172.21.15.45:0/1971520023 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f46580568d0 con 0x7f466015e260 2023-12-19T17:51:42.816 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:42.816 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:51:42.348657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-19T17:51:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4640065ad0 msgr2=0x7f4640067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4640065ad0 0x7f4640067f90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4650001010 tx=0x7f4650009040 comp rx=0 tx=0).stop 2023-12-19T17:51:42.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 msgr2=0x7f4660149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 0x7f4660149870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4658009f30 tx=0x7f4658004b40 comp rx=0 tx=0).stop 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 shutdown_connections 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4640065ad0 0x7f4640067f90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f466015e260 0x7f4660149870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f466015ab50 0x7f466015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 --2- 172.21.15.45:0/1971520023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46600cddd0 0x7f46600ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:42.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 >> 172.21.15.45:0/1971520023 conn(0x7f46600cba40 msgr2=0x7f466006ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 shutdown_connections 2023-12-19T17:51:42.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:42.818+0000 7f46661f9700 1 -- 172.21.15.45:0/1971520023 wait complete. 2023-12-19T17:51:42.822 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2023-12-19T17:51:42.844 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.042+0000 7fd812a16700 1 Processor -- start 2023-12-19T17:51:43.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.042+0000 7fd812a16700 1 -- start start 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd812a16700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c0b8c70 0x7fd80c0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd812a16700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd80c0d29f0 0x7fd80c070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd812a16700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c0d2560 con 0x7fd80c15d140 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd812a16700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0d1680 con 0x7fd80c0d29f0 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd812a16700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c0d1950 con 0x7fd80c0b8c70 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd80bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd80c15d140 0x7fd80c0d0f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40142/0 (socket says 172.21.15.45:40142) 2023-12-19T17:51:43.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd80bfff700 1 -- 172.21.15.45:0/707782440 learned_addr learned my addr 172.21.15.45:0/707782440 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:43.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd8037fe700 1 --2- 172.21.15.45:0/707782440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c0b8c70 0x7fd80c0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd810fb3700 1 --2- 172.21.15.45:0/707782440 >> v2:172.21.15.73:3300/0 conn(0x7fd80c0d29f0 0x7fd80c070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd80b7fe700 1 -- 172.21.15.45:0/707782440 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2263781655 0 0) 0x7fd80c0d2560 con 0x7fd80c15d140 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd80b7fe700 1 -- 172.21.15.45:0/707782440 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec0035d0 con 0x7fd80c15d140 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd8037fe700 1 -- 172.21.15.45:0/707782440 >> v2:172.21.15.73:3300/0 conn(0x7fd80c0d29f0 msgr2=0x7fd80c070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd8037fe700 1 --2- 172.21.15.45:0/707782440 >> v2:172.21.15.73:3300/0 conn(0x7fd80c0d29f0 0x7fd80c070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd8037fe700 1 -- 172.21.15.45:0/707782440 >> v1:172.21.15.45:6789/0 conn(0x7fd80c15d140 legacy=0x7fd80c0d0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd8037fe700 1 -- 172.21.15.45:0/707782440 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c0d1c30 con 0x7fd80c0b8c70 2023-12-19T17:51:43.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.046+0000 7fd810fb3700 1 --2- 172.21.15.45:0/707782440 >> v2:172.21.15.73:3300/0 conn(0x7fd80c0d29f0 0x7fd80c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:43.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd8037fe700 1 --2- 172.21.15.45:0/707782440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c0b8c70 0x7fd80c0707e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009850 tx=0x7fd7f4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6b191d58cf826fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd80b7fe700 1 -- 172.21.15.45:0/707782440 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4011830 con 0x7fd80c0b8c70 2023-12-19T17:51:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd80b7fe700 1 -- 172.21.15.45:0/707782440 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f4011990 con 0x7fd80c0b8c70 2023-12-19T17:51:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd80b7fe700 1 -- 172.21.15.45:0/707782440 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4011d40 con 0x7fd80c0b8c70 2023-12-19T17:51:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 -- 172.21.15.45:0/707782440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c0b8c70 msgr2=0x7fd80c0707e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 --2- 172.21.15.45:0/707782440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c0b8c70 0x7fd80c0707e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4009850 tx=0x7fd7f4009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 -- 172.21.15.45:0/707782440 shutdown_connections 2023-12-19T17:51:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 --2- 172.21.15.45:0/707782440 >> v2:172.21.15.73:3300/0 conn(0x7fd80c0d29f0 0x7fd80c070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 --2- 172.21.15.45:0/707782440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c0b8c70 0x7fd80c0707e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 -- 172.21.15.45:0/707782440 >> 172.21.15.45:0/707782440 conn(0x7fd80c0d2ec0 msgr2=0x7fd80c0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 -- 172.21.15.45:0/707782440 shutdown_connections 2023-12-19T17:51:43.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.050+0000 7fd812a16700 1 -- 172.21.15.45:0/707782440 wait complete. 2023-12-19T17:51:43.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 Processor -- start 2023-12-19T17:51:43.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 -- start start 2023-12-19T17:51:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 0x7fd80c14a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c15d140 0x7fd80c153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd80c15e450 0x7fd80c1e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c14ac30 con 0x7fd80c0d29f0 2023-12-19T17:51:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c154650 con 0x7fd80c15e450 2023-12-19T17:51:43.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd812a16700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c154930 con 0x7fd80c15d140 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd80bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 0x7fd80c14a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd80bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 0x7fd80c14a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41054/0 (socket says 172.21.15.45:41054) 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd80bfff700 1 -- 172.21.15.45:0/109609701 learned_addr learned my addr 172.21.15.45:0/109609701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd8037fe700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c15d140 0x7fd80c153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd810fb3700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd80c15e450 0x7fd80c1e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd8037fe700 1 -- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd80c15e450 msgr2=0x7fd80c1e6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd8037fe700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd80c15e450 0x7fd80c1e6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd8037fe700 1 -- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 msgr2=0x7fd80c14a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd8037fe700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 0x7fd80c14a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd8037fe700 1 -- 172.21.15.45:0/109609701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804009a70 con 0x7fd80c15d140 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.054+0000 7fd80bfff700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 0x7fd80c14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd8037fe700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c15d140 0x7fd80c153d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4016000 tx=0x7fd7f4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f40044d0 con 0x7fd80c15d140 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f40036c0 con 0x7fd80c15d140 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f4003a50 con 0x7fd80c15d140 2023-12-19T17:51:43.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f40094b0 con 0x7fd80c15d140 2023-12-19T17:51:43.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c154ef0 con 0x7fd80c15d140 2023-12-19T17:51:43.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.058+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c04ed30 con 0x7fd80c15d140 2023-12-19T17:51:43.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.062+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7f4003bb0 con 0x7fd80c15d140 2023-12-19T17:51:43.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.062+0000 7fd8097fa700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7f0065ad0 0x7fd7f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.062+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7f4021030 con 0x7fd80c15d140 2023-12-19T17:51:43.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.062+0000 7fd80bfff700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7f0065ad0 0x7fd7f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.062+0000 7fd80bfff700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7f0065ad0 0x7fd7f0067f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0011e0 tx=0x7fd7fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.070+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd7f4052560 con 0x7fd80c15d140 2023-12-19T17:51:43.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.246+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd80c154a70 con 0x7fd80c15d140 2023-12-19T17:51:43.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.250+0000 7fd8097fa700 1 -- 172.21.15.45:0/109609701 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7fd80c154a70 con 0x7fd80c15d140 2023-12-19T17:51:43.254 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:43.254 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7f0065ad0 msgr2=0x7fd7f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7f0065ad0 0x7fd7f0067f90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc0011e0 tx=0x7fd7fc009040 comp rx=0 tx=0).stop 2023-12-19T17:51:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c15d140 msgr2=0x7fd80c153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c15d140 0x7fd80c153d20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd7f4016000 tx=0x7fd7f4004770 comp rx=0 tx=0).stop 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 shutdown_connections 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7f0065ad0 0x7fd7f0067f90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd80c15e450 0x7fd80c1e6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd80c15d140 0x7fd80c153d20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 --2- 172.21.15.45:0/109609701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd80c0d29f0 0x7fd80c14a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.254+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 >> 172.21.15.45:0/109609701 conn(0x7fd80c0d2ec0 msgr2=0x7fd80c0b5ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.258+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 shutdown_connections 2023-12-19T17:51:43.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.258+0000 7fd812a16700 1 -- 172.21.15.45:0/109609701 wait complete. 2023-12-19T17:51:43.281 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 Processor -- start 2023-12-19T17:51:43.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 -- start start 2023-12-19T17:51:43.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f22ac0b8560 0x7f22ac0d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac0cd910 0x7f22ac0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22ac0d2070 con 0x7f22ac15cfe0 2023-12-19T17:51:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22ac0ce2e0 con 0x7f22ac0b8560 2023-12-19T17:51:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b3439700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0d1460 con 0x7f22ac0cd910 2023-12-19T17:51:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b1c36700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f22ac0b8560 0x7f22ac0d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b2c38700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac0cd910 0x7f22ac0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b2437700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f22ac15cfe0 0x7f22ac0d0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34182/0 (socket says 172.21.15.45:34182) 2023-12-19T17:51:43.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b2437700 1 -- 172.21.15.45:0/3073261274 learned_addr learned my addr 172.21.15.45:0/3073261274 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b1435700 1 -- 172.21.15.45:0/3073261274 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3197886644 0 0) 0x7f22ac0d2070 con 0x7f22ac15cfe0 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.462+0000 7f22b1435700 1 -- 172.21.15.45:0/3073261274 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22980035d0 con 0x7f22ac15cfe0 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b2c38700 1 -- 172.21.15.45:0/3073261274 >> v2:172.21.15.73:3300/0 conn(0x7f22ac0b8560 msgr2=0x7f22ac0d2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b2c38700 1 --2- 172.21.15.45:0/3073261274 >> v2:172.21.15.73:3300/0 conn(0x7f22ac0b8560 0x7f22ac0d2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b2c38700 1 -- 172.21.15.45:0/3073261274 >> v1:172.21.15.73:6789/0 conn(0x7f22ac15cfe0 legacy=0x7f22ac0d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b2c38700 1 -- 172.21.15.45:0/3073261274 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ac0d1740 con 0x7f22ac0cd910 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b1c36700 1 --2- 172.21.15.45:0/3073261274 >> v2:172.21.15.73:3300/0 conn(0x7f22ac0b8560 0x7f22ac0d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:43.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b2c38700 1 --2- 172.21.15.45:0/3073261274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac0cd910 0x7f22ac0cdda0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009d90 tx=0x7f22a400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba0037f1e0b3cdef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b1435700 1 -- 172.21.15.45:0/3073261274 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a400e070 con 0x7f22ac0cd910 2023-12-19T17:51:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b1435700 1 -- 172.21.15.45:0/3073261274 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a400bb20 con 0x7f22ac0cd910 2023-12-19T17:51:43.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b1435700 1 -- 172.21.15.45:0/3073261274 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a4012430 con 0x7f22ac0cd910 2023-12-19T17:51:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 -- 172.21.15.45:0/3073261274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac0cd910 msgr2=0x7f22ac0cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 --2- 172.21.15.45:0/3073261274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac0cd910 0x7f22ac0cdda0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f22a4009d90 tx=0x7f22a400b330 comp rx=0 tx=0).stop 2023-12-19T17:51:43.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 -- 172.21.15.45:0/3073261274 shutdown_connections 2023-12-19T17:51:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 --2- 172.21.15.45:0/3073261274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac0cd910 0x7f22ac0cdda0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 --2- 172.21.15.45:0/3073261274 >> v2:172.21.15.73:3300/0 conn(0x7f22ac0b8560 0x7f22ac0d2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 -- 172.21.15.45:0/3073261274 >> 172.21.15.45:0/3073261274 conn(0x7f22ac0b46c0 msgr2=0x7f22ac0b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 -- 172.21.15.45:0/3073261274 shutdown_connections 2023-12-19T17:51:43.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.466+0000 7f22b3439700 1 -- 172.21.15.45:0/3073261274 wait complete. 2023-12-19T17:51:43.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 Processor -- start 2023-12-19T17:51:43.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 -- start start 2023-12-19T17:51:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 0x7f22ac1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ac0cd910 0x7f22ac0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac15cfe0 0x7f22ac0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0ca0e0 con 0x7f22ac0b8560 2023-12-19T17:51:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac151600 con 0x7f22ac0cd910 2023-12-19T17:51:43.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b3439700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22ac0c7ef0 con 0x7f22ac15cfe0 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 0x7f22ac1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 0x7f22ac1510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41062/0 (socket says 172.21.15.45:41062) 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 -- 172.21.15.45:0/135343926 learned_addr learned my addr 172.21.15.45:0/135343926 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b1c36700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ac0cd910 0x7f22ac0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2c38700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac15cfe0 0x7f22ac0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 -- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac15cfe0 msgr2=0x7f22ac0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac15cfe0 0x7f22ac0c8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 -- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ac0cd910 msgr2=0x7f22ac0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ac0cd910 0x7f22ac0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.470+0000 7f22b2437700 1 -- 172.21.15.45:0/135343926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f229c0094b0 con 0x7f22ac0b8560 2023-12-19T17:51:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22b2437700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 0x7f22ac1510c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c500 tx=0x7f22a800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8005d90 con 0x7f22ac0b8560 2023-12-19T17:51:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22a80070d0 con 0x7f22ac0b8560 2023-12-19T17:51:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22a4009a70 con 0x7f22ac0b8560 2023-12-19T17:51:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22a8007480 con 0x7f22ac0b8560 2023-12-19T17:51:43.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22ac0c7930 con 0x7f22ac0b8560 2023-12-19T17:51:43.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.474+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22ac067760 con 0x7f22ac0b8560 2023-12-19T17:51:43.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.478+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f22a80075e0 con 0x7f22ac0b8560 2023-12-19T17:51:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.478+0000 7f22a2ffd700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2290065b00 0x7f2290067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.478+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f22a8082850 con 0x7f22ac0b8560 2023-12-19T17:51:43.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.478+0000 7f22b1c36700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2290065b00 0x7f2290067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.482+0000 7f22b1c36700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2290065b00 0x7f2290067fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0ce9c0 tx=0x7f229c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.486+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f22a804ff20 con 0x7f22ac0b8560 2023-12-19T17:51:43.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.666+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22ac0cdfa0 con 0x7f22ac0b8560 2023-12-19T17:51:43.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.670+0000 7f22a2ffd700 1 -- 172.21.15.45:0/135343926 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f22a8053540 con 0x7f22ac0b8560 2023-12-19T17:51:43.672 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:43.673 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2290065b00 msgr2=0x7f2290067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2290065b00 0x7f2290067fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0ce9c0 tx=0x7f229c009240 comp rx=0 tx=0).stop 2023-12-19T17:51:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 msgr2=0x7f22ac1510c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 0x7f22ac1510c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f22a800c500 tx=0x7f22a800c810 comp rx=0 tx=0).stop 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 shutdown_connections 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2290065b00 0x7f2290067fc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f22ac15cfe0 0x7f22ac0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f22ac0cd910 0x7f22ac0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 --2- 172.21.15.45:0/135343926 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f22ac0b8560 0x7f22ac1510c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 >> 172.21.15.45:0/135343926 conn(0x7f22ac0b46c0 msgr2=0x7f22ac0b1840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 shutdown_connections 2023-12-19T17:51:43.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.674+0000 7f22b3439700 1 -- 172.21.15.45:0/135343926 wait complete. 2023-12-19T17:51:43.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:51:43.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.902+0000 7f50869c3700 1 Processor -- start 2023-12-19T17:51:43.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.902+0000 7f50869c3700 1 -- start start 2023-12-19T17:51:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.902+0000 7f50869c3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f508015d030 0x7f50800cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.902+0000 7f50869c3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5080160a20 0x7f5080160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50800cb770 con 0x7f50800cb2e0 2023-12-19T17:51:43.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50800cf850 con 0x7f508015d030 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5080161370 con 0x7f5080160a20 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50851c0700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f50800cb2e0 0x7f50800cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40144/0 (socket says 172.21.15.45:40144) 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50851c0700 1 -- 172.21.15.45:0/2383882097 learned_addr learned my addr 172.21.15.45:0/2383882097 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50861c2700 1 --2- 172.21.15.45:0/2383882097 >> v2:172.21.15.73:3300/0 conn(0x7f5080160a20 0x7f5080160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50859c1700 1 --2- 172.21.15.45:0/2383882097 >> v2:172.21.15.45:3300/0 conn(0x7f508015d030 0x7f50800cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50849bf700 1 -- 172.21.15.45:0/2383882097 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2161686449 0 0) 0x7f50800cb770 con 0x7f50800cb2e0 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50849bf700 1 -- 172.21.15.45:0/2383882097 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f506c0035d0 con 0x7f50800cb2e0 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50861c2700 1 -- 172.21.15.45:0/2383882097 >> v2:172.21.15.45:3300/0 conn(0x7f508015d030 msgr2=0x7f50800cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50861c2700 1 --2- 172.21.15.45:0/2383882097 >> v2:172.21.15.45:3300/0 conn(0x7f508015d030 0x7f50800cca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50861c2700 1 -- 172.21.15.45:0/2383882097 >> v1:172.21.15.45:6789/0 conn(0x7f50800cb2e0 legacy=0x7f50800cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50861c2700 1 -- 172.21.15.45:0/2383882097 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50800cb9c0 con 0x7f5080160a20 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50861c2700 1 --2- 172.21.15.45:0/2383882097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5080160a20 0x7f5080160e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50800cfe80 tx=0x7f507800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=582f6911c07c038 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50849bf700 1 -- 172.21.15.45:0/2383882097 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507800e070 con 0x7f5080160a20 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50849bf700 1 -- 172.21.15.45:0/2383882097 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507800bb20 con 0x7f5080160a20 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50849bf700 1 -- 172.21.15.45:0/2383882097 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507800be90 con 0x7f5080160a20 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- 172.21.15.45:0/2383882097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5080160a20 msgr2=0x7f5080160e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 --2- 172.21.15.45:0/2383882097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5080160a20 0x7f5080160e30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50800cfe80 tx=0x7f507800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- 172.21.15.45:0/2383882097 shutdown_connections 2023-12-19T17:51:43.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 --2- 172.21.15.45:0/2383882097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5080160a20 0x7f5080160e30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 --2- 172.21.15.45:0/2383882097 >> v2:172.21.15.45:3300/0 conn(0x7f508015d030 0x7f50800cca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- 172.21.15.45:0/2383882097 >> 172.21.15.45:0/2383882097 conn(0x7f50800b2540 msgr2=0x7f50800b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- 172.21.15.45:0/2383882097 shutdown_connections 2023-12-19T17:51:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.906+0000 7f50869c3700 1 -- 172.21.15.45:0/2383882097 wait complete. 2023-12-19T17:51:43.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 Processor -- start 2023-12-19T17:51:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 -- start start 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 0x7f5080157fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015d030 0x7f50801596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5080160a20 0x7f5080159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5080158520 con 0x7f50800cb2e0 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50801f3400 con 0x7f508015d030 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50869c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50801f3120 con 0x7f5080160a20 2023-12-19T17:51:43.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50859c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 0x7f5080157fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50859c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 0x7f5080157fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41072/0 (socket says 172.21.15.45:41072) 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50859c1700 1 -- 172.21.15.45:0/2737137999 learned_addr learned my addr 172.21.15.45:0/2737137999 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50851c0700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015d030 0x7f50801596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.910+0000 7f50861c2700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5080160a20 0x7f5080159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50859c1700 1 -- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5080160a20 msgr2=0x7f5080159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50859c1700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5080160a20 0x7f5080159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50859c1700 1 -- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015d030 msgr2=0x7f50801596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:43.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50859c1700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015d030 0x7f50801596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:43.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50859c1700 1 -- 172.21.15.45:0/2737137999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078009a70 con 0x7f50800cb2e0 2023-12-19T17:51:43.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50859c1700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 0x7f5080157fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e840 tx=0x7f507c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0095a0 con 0x7f50800cb2e0 2023-12-19T17:51:43.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507c013680 con 0x7f50800cb2e0 2023-12-19T17:51:43.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50800c45d0 con 0x7f50800cb2e0 2023-12-19T17:51:43.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507c0139f0 con 0x7f50800cb2e0 2023-12-19T17:51:43.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50800c4b90 con 0x7f50800cb2e0 2023-12-19T17:51:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.914+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50800c4410 con 0x7f50800cb2e0 2023-12-19T17:51:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.918+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f507c013b50 con 0x7f50800cb2e0 2023-12-19T17:51:43.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.918+0000 7f50767fc700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5064065ad0 0x7f5064067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:43.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.918+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f507c083310 con 0x7f50800cb2e0 2023-12-19T17:51:43.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.918+0000 7f50851c0700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5064065ad0 0x7f5064067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.918+0000 7f50851c0700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5064065ad0 0x7f5064067f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5080070cc0 tx=0x7f5070007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:43.922+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f507c050940 con 0x7f50800cb2e0 2023-12-19T17:51:44.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.134+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5080067760 con 0x7f50800cb2e0 2023-12-19T17:51:44.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.134+0000 7f50767fc700 1 -- 172.21.15.45:0/2737137999 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f507c05a070 con 0x7f50800cb2e0 2023-12-19T17:51:44.138 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:44.139 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:51:42.348657+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5064065ad0 msgr2=0x7f5064067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5064065ad0 0x7f5064067f90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5080070cc0 tx=0x7f5070007de0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 msgr2=0x7f5080157fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 0x7f5080157fe0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f507c00e840 tx=0x7f507c00eb50 comp rx=0 tx=0).stop 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 shutdown_connections 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5064065ad0 0x7f5064067f90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5080160a20 0x7f5080159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f508015d030 0x7f50801596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 --2- 172.21.15.45:0/2737137999 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50800cb2e0 0x7f5080157fe0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 >> 172.21.15.45:0/2737137999 conn(0x7f50800b2540 msgr2=0x7f508015aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:44.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 shutdown_connections 2023-12-19T17:51:44.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.138+0000 7f50869c3700 1 -- 172.21.15.45:0/2737137999 wait complete. 2023-12-19T17:51:44.144 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 6 2023-12-19T17:51:44.162 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.330+0000 7f75c1327700 1 Processor -- start 2023-12-19T17:51:44.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.330+0000 7f75c1327700 1 -- start start 2023-12-19T17:51:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75bc06ea90 0x7f75bc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0b6df0 con 0x7f75bc0b6250 2023-12-19T17:51:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0d1820 con 0x7f75bc06ea90 2023-12-19T17:51:44.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc0d1b00 con 0x7f75bc0b88b0 2023-12-19T17:51:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75bc06ea90 0x7f75bc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f75bc06ea90 0x7f75bc0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41076/0 (socket says 172.21.15.45:41076) 2023-12-19T17:51:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 -- 172.21.15.45:0/2128903074 learned_addr learned my addr 172.21.15.45:0/2128903074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c0b26700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f75bc0b6250 0x7f75bc0b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40158/0 (socket says 172.21.15.45:40158) 2023-12-19T17:51:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 -- 172.21.15.45:0/2128903074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 msgr2=0x7f75bc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:44.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 --2- 172.21.15.45:0/2128903074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 -- 172.21.15.45:0/2128903074 >> v1:172.21.15.45:6789/0 conn(0x7f75bc0b6250 legacy=0x7f75bc0b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 -- 172.21.15.45:0/2128903074 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0d1de0 con 0x7f75bc06ea90 2023-12-19T17:51:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bbfff700 1 --2- 172.21.15.45:0/2128903074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc0d0f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009910 tx=0x7f75ac009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6846f4c473c50182 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bb7fe700 1 -- 172.21.15.45:0/2128903074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac00ba60 con 0x7f75bc06ea90 2023-12-19T17:51:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bb7fe700 1 -- 172.21.15.45:0/2128903074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac00bbc0 con 0x7f75bc06ea90 2023-12-19T17:51:44.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75bb7fe700 1 -- 172.21.15.45:0/2128903074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac009e60 con 0x7f75bc06ea90 2023-12-19T17:51:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 -- 172.21.15.45:0/2128903074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 msgr2=0x7f75bc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.334+0000 7f75c1327700 1 --2- 172.21.15.45:0/2128903074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc0d0f20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f75ac009910 tx=0x7f75ac009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 -- 172.21.15.45:0/2128903074 shutdown_connections 2023-12-19T17:51:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 --2- 172.21.15.45:0/2128903074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 --2- 172.21.15.45:0/2128903074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc0d0f20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 -- 172.21.15.45:0/2128903074 >> 172.21.15.45:0/2128903074 conn(0x7f75bc0b46d0 msgr2=0x7f75bc0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 -- 172.21.15.45:0/2128903074 shutdown_connections 2023-12-19T17:51:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 -- 172.21.15.45:0/2128903074 wait complete. 2023-12-19T17:51:44.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 Processor -- start 2023-12-19T17:51:44.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.338+0000 7f75c1327700 1 -- start start 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc1f5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75bc0b6250 0x7f75bc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15fbf0 con 0x7f75bc06ea90 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15efe0 con 0x7f75bc0b6250 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc15f2c0 con 0x7f75bc0b88b0 2023-12-19T17:51:44.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc1f5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc1f5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41088/0 (socket says 172.21.15.45:41088) 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 -- 172.21.15.45:0/3999751464 learned_addr learned my addr 172.21.15.45:0/3999751464 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75b37fe700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75bc0b6250 0x7f75bc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c0b26700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 -- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 msgr2=0x7f75bc0c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 -- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75bc0b6250 msgr2=0x7f75bc0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75bc0b6250 0x7f75bc0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 -- 172.21.15.45:0/3999751464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75ac009570 con 0x7f75bc06ea90 2023-12-19T17:51:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75bbfff700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc1f5d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75ac014040 tx=0x7f75ac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0036c0 con 0x7f75bc06ea90 2023-12-19T17:51:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac01e070 con 0x7f75bc06ea90 2023-12-19T17:51:44.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc15f5a0 con 0x7f75bc06ea90 2023-12-19T17:51:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac003a60 con 0x7f75bc06ea90 2023-12-19T17:51:44.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.342+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc14f390 con 0x7f75bc06ea90 2023-12-19T17:51:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.346+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc067760 con 0x7f75bc06ea90 2023-12-19T17:51:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.346+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f75ac003bc0 con 0x7f75bc06ea90 2023-12-19T17:51:44.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.346+0000 7f75b97fa700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f759c065b00 0x7f759c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.350+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75ac020070 con 0x7f75bc06ea90 2023-12-19T17:51:44.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.350+0000 7f75b37fe700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f759c065b00 0x7f759c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:44.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.350+0000 7f75b37fe700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f759c065b00 0x7f759c067fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75a4006fd0 tx=0x7f75a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.354+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f75ac0520a0 con 0x7f75bc06ea90 2023-12-19T17:51:44.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.534+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75bc0b4490 con 0x7f75bc06ea90 2023-12-19T17:51:44.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.538+0000 7f75b97fa700 1 -- 172.21.15.45:0/3999751464 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f75ac0556c0 con 0x7f75bc06ea90 2023-12-19T17:51:44.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:44.540 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:44.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f759c065b00 msgr2=0x7f759c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f759c065b00 0x7f759c067fc0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f75a4006fd0 tx=0x7f75a4008040 comp rx=0 tx=0).stop 2023-12-19T17:51:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 msgr2=0x7f75bc1f5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc1f5d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75ac014040 tx=0x7f75ac004770 comp rx=0 tx=0).stop 2023-12-19T17:51:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 shutdown_connections 2023-12-19T17:51:44.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f759c065b00 0x7f759c067fc0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f75bc0b88b0 0x7f75bc0c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f75bc0b6250 0x7f75bc0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 --2- 172.21.15.45:0/3999751464 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f75bc06ea90 0x7f75bc1f5d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 >> 172.21.15.45:0/3999751464 conn(0x7f75bc0b46d0 msgr2=0x7f75bc06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 shutdown_connections 2023-12-19T17:51:44.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:44.542+0000 7f75c1327700 1 -- 172.21.15.45:0/3999751464 wait complete. 2023-12-19T17:51:44.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:51:37.822341+0000', 'modified': '2023-12-19T17:51:42.348657+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 54167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_54167': {'gid': 54167, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6835/3913672139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6833', 'nonce': 3913672139}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3913672139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-19T17:51:44.969 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:51:44.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T17:51:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.146+0000 7f51ace5d700 1 Processor -- start 2023-12-19T17:51:45.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.146+0000 7f51ace5d700 1 -- start start 2023-12-19T17:51:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51ace5d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51a806cad0 0x7f51a815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51ace5d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a806f0a0 con 0x7f51a80af720 2023-12-19T17:51:45.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51ace5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51a806ea90 con 0x7f51a815ae20 2023-12-19T17:51:45.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51ace5d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51a80c3f60 con 0x7f51a806cad0 2023-12-19T17:51:45.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51a6ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51a806cad0 0x7f51a815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51a77fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f51a815ae20 0x7f51a80c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34190/0 (socket says 172.21.15.45:34190) 2023-12-19T17:51:45.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.150+0000 7f51a77fe700 1 -- 172.21.15.45:0/3947420754 learned_addr learned my addr 172.21.15.45:0/3947420754 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a67fc700 1 -- 172.21.15.45:0/3947420754 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 462549772 0 0) 0x7f51a806ea90 con 0x7f51a815ae20 2023-12-19T17:51:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a67fc700 1 -- 172.21.15.45:0/3947420754 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51900035d0 con 0x7f51a815ae20 2023-12-19T17:51:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a6ffd700 1 -- 172.21.15.45:0/3947420754 >> v1:172.21.15.73:6789/0 conn(0x7f51a815ae20 legacy=0x7f51a80c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a6ffd700 1 -- 172.21.15.45:0/3947420754 >> v1:172.21.15.45:6789/0 conn(0x7f51a80af720 legacy=0x7f51a806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a6ffd700 1 -- 172.21.15.45:0/3947420754 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51a80c4240 con 0x7f51a806cad0 2023-12-19T17:51:45.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/3947420754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a815be40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f519c009850 tx=0x7f519c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95cafac52b01f2c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a67fc700 1 -- 172.21.15.45:0/3947420754 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c011830 con 0x7f51a806cad0 2023-12-19T17:51:45.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a67fc700 1 -- 172.21.15.45:0/3947420754 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c011990 con 0x7f51a806cad0 2023-12-19T17:51:45.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51a67fc700 1 -- 172.21.15.45:0/3947420754 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c011d40 con 0x7f51a806cad0 2023-12-19T17:51:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51ace5d700 1 -- 172.21.15.45:0/3947420754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 msgr2=0x7f51a815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51ace5d700 1 --2- 172.21.15.45:0/3947420754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a815be40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f519c009850 tx=0x7f519c009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51ace5d700 1 -- 172.21.15.45:0/3947420754 shutdown_connections 2023-12-19T17:51:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51ace5d700 1 --2- 172.21.15.45:0/3947420754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a815be40 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51ace5d700 1 -- 172.21.15.45:0/3947420754 >> 172.21.15.45:0/3947420754 conn(0x7f51a80cb900 msgr2=0x7f51a80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.154+0000 7f51ace5d700 1 -- 172.21.15.45:0/3947420754 shutdown_connections 2023-12-19T17:51:45.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.158+0000 7f51ace5d700 1 -- 172.21.15.45:0/3947420754 wait complete. 2023-12-19T17:51:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.158+0000 7f51ace5d700 1 Processor -- start 2023-12-19T17:51:45.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.158+0000 7f51ace5d700 1 -- start start 2023-12-19T17:51:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a81556b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 0x7f51a80b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51a815ae20 0x7f51a815e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a8155bf0 con 0x7f51a80af720 2023-12-19T17:51:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80b2210 con 0x7f51a806cad0 2023-12-19T17:51:45.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51a80b1600 con 0x7f51a815ae20 2023-12-19T17:51:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 0x7f51a80b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 0x7f51a80b3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41096/0 (socket says 172.21.15.45:41096) 2023-12-19T17:51:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 -- 172.21.15.45:0/856234017 learned_addr learned my addr 172.21.15.45:0/856234017 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a77fe700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a81556b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a7fff700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51a815ae20 0x7f51a815e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 -- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51a815ae20 msgr2=0x7f51a815e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51a815ae20 0x7f51a815e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 -- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 msgr2=0x7f51a81556b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a81556b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 -- 172.21.15.45:0/856234017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0094b0 con 0x7f51a80af720 2023-12-19T17:51:45.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 0x7f51a80b3000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f519c000c00 tx=0x7f519c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f518ffff700 1 -- 172.21.15.45:0/856234017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c01a990 con 0x7f51a80af720 2023-12-19T17:51:45.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f518ffff700 1 -- 172.21.15.45:0/856234017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c01f070 con 0x7f51a80af720 2023-12-19T17:51:45.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f518ffff700 1 -- 172.21.15.45:0/856234017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c01ad30 con 0x7f51a80af720 2023-12-19T17:51:45.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51a80b18e0 con 0x7f51a80af720 2023-12-19T17:51:45.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.162+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80b1ea0 con 0x7f51a80af720 2023-12-19T17:51:45.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.166+0000 7f518ffff700 1 -- 172.21.15.45:0/856234017 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f519c02e430 con 0x7f51a80af720 2023-12-19T17:51:45.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.170+0000 7f518ffff700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5194065b00 0x7f5194067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.170+0000 7f518ffff700 1 -- 172.21.15.45:0/856234017 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f519c084420 con 0x7f51a80af720 2023-12-19T17:51:45.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.170+0000 7f51a77fe700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5194065b00 0x7f5194067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.170+0000 7f51b1351740 1 Processor -- start 2023-12-19T17:51:45.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.170+0000 7f51b1351740 1 -- start start 2023-12-19T17:51:45.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.170+0000 7f51a77fe700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5194065b00 0x7f5194067fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5198007fd0 tx=0x7f5198007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1f79ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4920 0x1f7a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1f7a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eed5b0 con 0x1fa4390 2023-12-19T17:51:45.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eead40 con 0x1fa4920 2023-12-19T17:51:45.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ee6630 con 0x1f798c0 2023-12-19T17:51:45.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1f7a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1f79ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1f7a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41112/0 (socket says 172.21.15.45:41112) 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4920 0x1f7a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a7fff700 1 -- 172.21.15.45:0/958275527 learned_addr learned my addr 172.21.15.45:0/958275527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 -- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 msgr2=0x1f79ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1f79ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 -- 172.21.15.45:0/958275527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 msgr2=0x1f7a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1f7a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 -- 172.21.15.45:0/958275527 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1d59960 con 0x1fa4920 2023-12-19T17:51:45.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4920 0x1f7a1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f519c051ca0 tx=0x7f519c055100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b680c078a46e69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f518d7fa700 1 -- 172.21.15.45:0/958275527 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c055ea0 con 0x1fa4920 2023-12-19T17:51:45.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f518d7fa700 1 -- 172.21.15.45:0/958275527 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0557a0 con 0x1fa4920 2023-12-19T17:51:45.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f518d7fa700 1 -- 172.21.15.45:0/958275527 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c0595d0 con 0x1fa4920 2023-12-19T17:51:45.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 -- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4920 msgr2=0x1f7a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.174+0000 7f51b1351740 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4920 0x1f7a1e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f519c051ca0 tx=0x7f519c055100 comp rx=0 tx=0).stop 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- 172.21.15.45:0/958275527 shutdown_connections 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1f7a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4920 0x1f7a1e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 --2- 172.21.15.45:0/958275527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1f79ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- 172.21.15.45:0/958275527 >> 172.21.15.45:0/958275527 conn(0x1d0e4d0 msgr2=0x1f7fc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- 172.21.15.45:0/958275527 shutdown_connections 2023-12-19T17:51:45.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- 172.21.15.45:0/958275527 wait complete. 2023-12-19T17:51:45.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- start start 2023-12-19T17:51:45.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 Processor -- start 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 0x1fa73a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fa4390 0x1fa8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fc1890 0x1fa31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea3c80 con 0x1f798c0 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1ea9b00 con 0x1fc1890 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1d92aa0 con 0x1fa4390 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51b1351740 10 client.0 _ll_register_callbacks cb 0x1edff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51a77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 0x1fa73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51a77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 0x1fa73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41118/0 (socket says 172.21.15.45:41118) 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51a77fe700 1 -- 172.21.15.45:0/2284137264 learned_addr learned my addr 172.21.15.45:0/2284137264 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51a7fff700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fc1890 0x1fa31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.178+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fa4390 0x1fa8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a7fff700 1 -- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fa4390 msgr2=0x1fa8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a7fff700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fa4390 0x1fa8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a7fff700 1 -- 172.21.15.45:0/2284137264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 msgr2=0x1fa73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a7fff700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 0x1fa73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a7fff700 1 -- 172.21.15.45:0/2284137264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51a80b1ea0 con 0x1fc1890 2023-12-19T17:51:45.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a77fe700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 0x1fa73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:45.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51a7fff700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fc1890 0x1fa31c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51a0012cb0 tx=0x7f51a0002010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=377b06f27e1ed5ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51867fc700 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2023-12-19T17:51:45.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51867fc700 1 -- 172.21.15.45:0/2284137264 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51a0003c30 con 0x1fc1890 2023-12-19T17:51:45.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51867fc700 1 -- 172.21.15.45:0/2284137264 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51a0003d90 con 0x1fc1890 2023-12-19T17:51:45.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1edf6b0 con 0x1fc1890 2023-12-19T17:51:45.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51867fc700 1 -- 172.21.15.45:0/2284137264 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51a0010730 con 0x1fc1890 2023-12-19T17:51:45.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 10 client.4405 fetch_fsmap learned FSMap version 6 2023-12-19T17:51:45.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1eac770 con 0x1fc1890 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51867fc700 1 -- 172.21.15.45:0/2284137264 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1edf6b0 con 0x1fc1890 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51867fc700 1 -- 172.21.15.45:0/2284137264 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f51a0010890 con 0x1fc1890 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 10 client.4405 fetch_fsmap finished waiting for FSMap version 6 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 10 client.4405 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 20 client.4405 populate_metadata read hostname 'smithi045' 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd79c0 0x1fd9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 4 client.4405 mds_command: new command op to 54167 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.182+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 --> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ea1a00 con 0x1fd79c0 2023-12-19T17:51:45.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51a77fe700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd79c0 0x1fd9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51a77fe700 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd79c0 0x1fd9db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbb866d5a013f07 server_cookie=9586f9954abe0aa3 in_seq=0 out_seq=0 2023-12-19T17:51:45.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51867fc700 10 client.4405 ms_handle_connect on v2:172.21.15.73:6833/3913672139 2023-12-19T17:51:45.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51867fc700 1 -- 172.21.15.45:0/2284137264 <== mds.0 v2:172.21.15.73:6833/3913672139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1ea1a00 con 0x1fd79c0 2023-12-19T17:51:45.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51867fc700 10 client.4405 handle_command_reply: tid=0 2023-12-19T17:51:45.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 client.4405 shutdown 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fc1890 msgr2=0x1fa31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fc1890 0x1fa31c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f51a0012cb0 tx=0x7f51a0002010 comp rx=0 tx=0).stop 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 shutdown_connections 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd79c0 0x1fd9db0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fc1890 0x1fa31c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fa4390 0x1fa8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 --2- 172.21.15.45:0/2284137264 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1f798c0 0x1fa73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 >> 172.21.15.45:0/2284137264 conn(0x1d0e4d0 msgr2=0x1f7c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51867fc700 0 client.4405 ms_handle_reset on v2:172.21.15.73:6833/3913672139 2023-12-19T17:51:45.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 shutdown_connections 2023-12-19T17:51:45.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.186+0000 7f51b1351740 1 -- 172.21.15.45:0/2284137264 wait complete. 2023-12-19T17:51:45.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.190+0000 7f51b1351740 20 client.4405 trim_cache size 0 max 16384 2023-12-19T17:51:45.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 Processor -- start 2023-12-19T17:51:45.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 -- start start 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1fa5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4390 0x1fa6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fc1890 0x1fd5860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1eb0a40 con 0x1fc1890 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fc0ca0 con 0x1fa4390 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eae760 con 0x1f798c0 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fc1890 0x1fd5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a6ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4390 0x1fa6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fc1890 0x1fd5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41120/0 (socket says 172.21.15.45:41120) 2023-12-19T17:51:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a7fff700 1 -- 172.21.15.45:0/2175754028 learned_addr learned my addr 172.21.15.45:0/2175754028 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a77fe700 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1fa5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a6ffd700 1 -- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 msgr2=0x1fa5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1fa5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a6ffd700 1 -- 172.21.15.45:0/2175754028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fc1890 msgr2=0x1fd5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fc1890 0x1fd5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.210+0000 7f51a6ffd700 1 -- 172.21.15.45:0/2175754028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1e929a0 con 0x1fa4390 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4390 0x1fa6000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f519c082650 tx=0x7f519c01d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b59ecd99431fc25c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f518dffb700 1 -- 172.21.15.45:0/2175754028 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c01ae90 con 0x1fa4390 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f518dffb700 1 -- 172.21.15.45:0/2175754028 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c080070 con 0x1fa4390 2023-12-19T17:51:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f518dffb700 1 -- 172.21.15.45:0/2175754028 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c055ea0 con 0x1fa4390 2023-12-19T17:51:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 -- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4390 msgr2=0x1fa6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4390 0x1fa6000 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f519c082650 tx=0x7f519c01d000 comp rx=0 tx=0).stop 2023-12-19T17:51:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 -- 172.21.15.45:0/2175754028 shutdown_connections 2023-12-19T17:51:45.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fc1890 0x1fd5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1fa4390 0x1fa6000 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 --2- 172.21.15.45:0/2175754028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1f798c0 0x1fa5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 -- 172.21.15.45:0/2175754028 >> 172.21.15.45:0/2175754028 conn(0x1d0e4d0 msgr2=0x1fa2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 -- 172.21.15.45:0/2175754028 shutdown_connections 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 -- 172.21.15.45:0/2175754028 wait complete. 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 -- start start 2023-12-19T17:51:45.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.214+0000 7f51b1351740 1 Processor -- start 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1f798c0 0x1fdb950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1fd9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fc1890 0x1fd9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fc34c0 con 0x1fa4390 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1fda1e0 con 0x1f798c0 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1fa6a00 con 0x1fc1890 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 10 client.0 _ll_register_callbacks cb 0x1e1fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:51:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1fd9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1fd9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41128/0 (socket says 172.21.15.45:41128) 2023-12-19T17:51:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 -- 172.21.15.45:0/546311665 learned_addr learned my addr 172.21.15.45:0/546311665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a77fe700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1f798c0 0x1fdb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fc1890 0x1fd9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 -- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fc1890 msgr2=0x1fd9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fc1890 0x1fd9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 -- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1f798c0 msgr2=0x1fdb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1f798c0 0x1fdb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 -- 172.21.15.45:0/546311665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1d59960 con 0x1fa4390 2023-12-19T17:51:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a77fe700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1f798c0 0x1fdb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51a6ffd700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1fd9760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f519c051ca0 tx=0x7f519c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529e38e3d8da7940 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51867fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:51:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51867fc700 1 -- 172.21.15.45:0/546311665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519c01ae90 con 0x1fa4390 2023-12-19T17:51:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51867fc700 1 -- 172.21.15.45:0/546311665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f519c055ea0 con 0x1fa4390 2023-12-19T17:51:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f519c0557a0 con 0x1fa4390 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51867fc700 1 -- 172.21.15.45:0/546311665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7f519c05d780 con 0x1fa4390 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 10 client.4422 fetch_fsmap learned FSMap version 6 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x1e86c70 con 0x1fa4390 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51867fc700 1 -- 172.21.15.45:0/546311665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519c0557a0 con 0x1fa4390 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51867fc700 1 -- 172.21.15.45:0/546311665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 6) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f519c02c060 con 0x1fa4390 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 10 client.4422 fetch_fsmap finished waiting for FSMap version 6 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 10 client.4422 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 20 client.4422 populate_metadata read hostname 'smithi045' 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.218+0000 7f51b1351740 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd8240 0x1fd8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 4 client.4422 mds_command: new command op to 54167 tid=0[{"prefix": "status"}] 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 --> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1d65460 con 0x1fd8240 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51a77fe700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd8240 0x1fd8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51a77fe700 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd8240 0x1fd8620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71f1667d773b95e6 server_cookie=ac772ac2d556e377 in_seq=0 out_seq=0 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51867fc700 10 client.4422 ms_handle_connect on v2:172.21.15.73:6833/3913672139 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51867fc700 1 -- 172.21.15.45:0/546311665 <== mds.0 v2:172.21.15.73:6833/3913672139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x1d65460 con 0x1fd8240 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51867fc700 10 client.4422 handle_command_reply: tid=0 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 client.4422 shutdown 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 msgr2=0x1fd9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1fd9760 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f519c051ca0 tx=0x7f519c011e30 comp rx=0 tx=0).stop 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 shutdown_connections 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x1fd8240 0x1fd8620 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1fc1890 0x1fd9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1fa4390 0x1fd9760 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 --2- 172.21.15.45:0/546311665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1f798c0 0x1fdb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51867fc700 0 client.4422 ms_handle_reset on v2:172.21.15.73:6833/3913672139 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 >> 172.21.15.45:0/546311665 conn(0x1d0e4d0 msgr2=0x1f7fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 shutdown_connections 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 1 -- 172.21.15.45:0/546311665 wait complete. 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.222+0000 7f51b1351740 20 client.4422 trim_cache size 0 max 16384 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 54167, 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 7.3942768650000001, 2023-12-19T17:51:45.229 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 6, 2023-12-19T17:51:45.230 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 24, 2023-12-19T17:51:45.230 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 23, 2023-12-19T17:51:45.230 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 12.450963639999999 2023-12-19T17:51:45.230 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5194065b00 msgr2=0x7f5194067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5194065b00 0x7f5194067fc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5198007fd0 tx=0x7f5198007de0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 msgr2=0x7f51a80b3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 0x7f51a80b3000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f519c000c00 tx=0x7f519c004770 comp rx=0 tx=0).stop 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 shutdown_connections 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5194065b00 0x7f5194067fc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51a815ae20 0x7f51a815e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51a80af720 0x7f51a80b3000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 --2- 172.21.15.45:0/856234017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51a806cad0 0x7f51a81556b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 >> 172.21.15.45:0/856234017 conn(0x7f51a80cb900 msgr2=0x7f51a80aebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 shutdown_connections 2023-12-19T17:51:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.226+0000 7f51ace5d700 1 -- 172.21.15.45:0/856234017 wait complete. 2023-12-19T17:51:45.250 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T17:51:45.250 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:45.250 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:51:45.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb2dc3700 1 Processor -- start 2023-12-19T17:51:45.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb2dc3700 1 -- start start 2023-12-19T17:51:45.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb2dc3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eac161530 0x7f2eac06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb2dc3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac06e310 con 0x7f2eac0c3920 2023-12-19T17:51:45.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb2dc3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2eac161990 con 0x7f2eac15cff0 2023-12-19T17:51:45.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb2dc3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2eac15d3d0 con 0x7f2eac161530 2023-12-19T17:51:45.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb15c0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eac161530 0x7f2eac06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb15c0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2eac161530 0x7f2eac06ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41134/0 (socket says 172.21.15.45:41134) 2023-12-19T17:51:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb15c0700 1 -- 172.21.15.45:0/2187881762 learned_addr learned my addr 172.21.15.45:0/2187881762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.430+0000 7f2eb25c2700 1 --1- 172.21.15.45:0/2187881762 >> v1:172.21.15.45:6789/0 conn(0x7f2eac0c3920 0x7f2eac06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40172/0 (socket says 172.21.15.45:40172) 2023-12-19T17:51:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb15c0700 1 -- 172.21.15.45:0/2187881762 >> v1:172.21.15.73:6789/0 conn(0x7f2eac15cff0 legacy=0x7f2eac0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb15c0700 1 -- 172.21.15.45:0/2187881762 >> v1:172.21.15.45:6789/0 conn(0x7f2eac0c3920 legacy=0x7f2eac06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb15c0700 1 -- 172.21.15.45:0/2187881762 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0ca6f0 con 0x7f2eac161530 2023-12-19T17:51:45.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb15c0700 1 --2- 172.21.15.45:0/2187881762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac161530 0x7f2eac06ddd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009910 tx=0x7f2e9c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d34bdb4d65297621 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb0dbf700 1 -- 172.21.15.45:0/2187881762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00ba60 con 0x7f2eac161530 2023-12-19T17:51:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb0dbf700 1 -- 172.21.15.45:0/2187881762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9c00bbc0 con 0x7f2eac161530 2023-12-19T17:51:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb0dbf700 1 -- 172.21.15.45:0/2187881762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c009e60 con 0x7f2eac161530 2023-12-19T17:51:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/2187881762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac161530 msgr2=0x7f2eac06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/2187881762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac161530 0x7f2eac06ddd0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009910 tx=0x7f2e9c009c20 comp rx=0 tx=0).stop 2023-12-19T17:51:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/2187881762 shutdown_connections 2023-12-19T17:51:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/2187881762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac161530 0x7f2eac06ddd0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/2187881762 >> 172.21.15.45:0/2187881762 conn(0x7f2eac0cb900 msgr2=0x7f2eac0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/2187881762 shutdown_connections 2023-12-19T17:51:45.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.434+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/2187881762 wait complete. 2023-12-19T17:51:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.438+0000 7f2eb2dc3700 1 Processor -- start 2023-12-19T17:51:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.438+0000 7f2eb2dc3700 1 -- start start 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 0x7f2eac1f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2eac15cff0 0x7f2eac159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2eac161530 0x7f2eac0b3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac1f6c70 con 0x7f2eac0c3920 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac158f90 con 0x7f2eac15cff0 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eac159270 con 0x7f2eac161530 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 0x7f2eac1f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 0x7f2eac1f1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41140/0 (socket says 172.21.15.45:41140) 2023-12-19T17:51:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 -- 172.21.15.45:0/262363439 learned_addr learned my addr 172.21.15.45:0/262363439 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb15c0700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2eac15cff0 0x7f2eac159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb25c2700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2eac161530 0x7f2eac0b3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 -- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2eac161530 msgr2=0x7f2eac0b3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2eac161530 0x7f2eac0b3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 -- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2eac15cff0 msgr2=0x7f2eac159d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2eac15cff0 0x7f2eac159d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 -- 172.21.15.45:0/262363439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c009570 con 0x7f2eac0c3920 2023-12-19T17:51:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb25c2700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2eac161530 0x7f2eac0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb1dc1700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 0x7f2eac1f1fb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800c500 tx=0x7f2ea800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80052d0 con 0x7f2eac0c3920 2023-12-19T17:51:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea8005430 con 0x7f2eac0c3920 2023-12-19T17:51:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80055a0 con 0x7f2eac0c3920 2023-12-19T17:51:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eac159550 con 0x7f2eac0c3920 2023-12-19T17:51:45.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.442+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eac1f24f0 con 0x7f2eac0c3920 2023-12-19T17:51:45.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.446+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eac067760 con 0x7f2eac0c3920 2023-12-19T17:51:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.446+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ea80038e0 con 0x7f2eac0c3920 2023-12-19T17:51:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.450+0000 7f2ea27fc700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2e90065ad0 0x7f2e90067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.450+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ea80828b0 con 0x7f2eac0c3920 2023-12-19T17:51:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.450+0000 7f2eb15c0700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2e90065ad0 0x7f2e90067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:45.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.450+0000 7f2eb15c0700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2e90065ad0 0x7f2e90067f90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c006f80 tx=0x7f2e9c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:45.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.454+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2ea804ff70 con 0x7f2eac0c3920 2023-12-19T17:51:45.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.662+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2eac0b1170 con 0x7f2eac0c3920 2023-12-19T17:51:45.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.662+0000 7f2ea27fc700 1 -- 172.21.15.45:0/262363439 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2ea8053590 con 0x7f2eac0c3920 2023-12-19T17:51:45.666 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T17:51:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2e90065ad0 msgr2=0x7f2e90067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2e90065ad0 0x7f2e90067f90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c006f80 tx=0x7f2e9c008030 comp rx=0 tx=0).stop 2023-12-19T17:51:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 msgr2=0x7f2eac1f1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 0x7f2eac1f1fb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2ea800c500 tx=0x7f2ea800c810 comp rx=0 tx=0).stop 2023-12-19T17:51:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 shutdown_connections 2023-12-19T17:51:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2e90065ad0 0x7f2e90067f90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2eac161530 0x7f2eac0b3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2eac15cff0 0x7f2eac159d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 --2- 172.21.15.45:0/262363439 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2eac0c3920 0x7f2eac1f1fb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 >> 172.21.15.45:0/262363439 conn(0x7f2eac0cb900 msgr2=0x7f2eac0cdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 shutdown_connections 2023-12-19T17:51:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:45.666+0000 7f2eb2dc3700 1 -- 172.21.15.45:0/262363439 wait complete. 2023-12-19T17:51:45.689 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-19T17:51:45.689 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:51:45.689 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:51:45.690 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-19T17:51:45.690 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:45.690 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-19T17:51:45.690 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:51:45.690 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:51:45.690 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-19T17:51:45.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:45.690 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:51:45.707 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42359sec preferred_lft 42359sec 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:51:45.708 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:51:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:51:45.709 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:51:45.710 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T17:51:45.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T17:51:45.710 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:51:45.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:45.874 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:51:45.903 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:51:45.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:45.907 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:51:45.997 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:51:45.997 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:51:45.997 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:51:45.997 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:51:45.997 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:51:45.997 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:51:45.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:45.998 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:51:45.998 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:51:45.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:51:45.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:51:45.999 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:51:45.999 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:51:46.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:46.136 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:51:46.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:46.156 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-19T17:51:46.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:46.219 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:51:46.219 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:51:46.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-19T17:51:46.219 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-19T17:51:46.219 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:51:46.336 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-19T17:51:46.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-19T17:51:46.337 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:51:46.524 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:46.524 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:51:46.524 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:51:46.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:51:46.524 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T17:51:46.524 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:51:46.589 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-19T17:51:46.590 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:51:46.590 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:46.605 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-19T17:51:46.606 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:51:46.606 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:46.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:51:46.743 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:51:46.743 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:51:46.821 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:51:46.823 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:51:46.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:46.824 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:51:46.884 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:51:46.884 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-19T17:51:46.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:51:46.970 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:51:46.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:51:47.048 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:51:47.050 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:51:47.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:47.051 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:51:47.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:2023-12-19T17:51:47.082+0000 7f1a0b798640 -1 init, newargv = 0x56080c91b040 newargc=15 2023-12-19T17:51:47.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[41170]: starting ceph client 2023-12-19T17:51:47.102 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:51:47.102 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:51:47.103 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.admin")) 2023-12-19T17:51:47.104 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:51:47.104 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[41170]: starting fuse 2023-12-19T17:51:47.268 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.admin.41170.asok 2023-12-19T17:51:47.451 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41170.asok 2023-12-19T17:51:47.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:47.452 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41170.asok status 2023-12-19T17:51:47.657 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "admin", 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "41170", 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4437, 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:51:47.658 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4437 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 226924858 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 226924858 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:51:47.659 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4437 192.168.0.1:0/226924858", 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/226924858", 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 6, 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 24, 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:51:47.660 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:51:47.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:47.673 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:51:47.673 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:47.694 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:51:47.694 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:47.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:47.694 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:47.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:47.775 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-19T17:51:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:# file: . 2023-12-19T17:51:47.882 INFO:teuthology.orchestra.run.smithi045.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-19T17:51:47.882 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:47.883 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:47.883 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:51:47.900 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 Processor -- start 2023-12-19T17:51:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 -- start start 2023-12-19T17:51:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a006ea90 0x7f73a00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f73a00b88b0 0x7f73a00b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f73a00b6250 0x7f73a00b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00d1820 con 0x7f73a00b88b0 2023-12-19T17:51:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a00d1b00 con 0x7f73a00b6250 2023-12-19T17:51:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.130+0000 7f73a54fa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00d1de0 con 0x7f73a006ea90 2023-12-19T17:51:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f73a00b88b0 0x7f73a00b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f73a00b88b0 0x7f73a00b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41148/0 (socket says 172.21.15.45:41148) 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 -- 172.21.15.45:0/4078302726 learned_addr learned my addr 172.21.15.45:0/4078302726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f739f7fe700 1 --2- 172.21.15.45:0/4078302726 >> v2:172.21.15.73:3300/0 conn(0x7f73a00b6250 0x7f73a00b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f739effd700 1 --2- 172.21.15.45:0/4078302726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a006ea90 0x7f73a00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 -- 172.21.15.45:0/4078302726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a006ea90 msgr2=0x7f73a00d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 --2- 172.21.15.45:0/4078302726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a006ea90 0x7f73a00d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 -- 172.21.15.45:0/4078302726 >> v2:172.21.15.73:3300/0 conn(0x7f73a00b6250 msgr2=0x7f73a00b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 --2- 172.21.15.45:0/4078302726 >> v2:172.21.15.73:3300/0 conn(0x7f73a00b6250 0x7f73a00b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 -- 172.21.15.45:0/4078302726 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a00d20c0 con 0x7f73a00b88b0 2023-12-19T17:51:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f7397fff700 1 --2- 172.21.15.45:0/4078302726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00b5d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73a00cd5f0 tx=0x7f7388009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b38905fd071553 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f739e7fc700 1 -- 172.21.15.45:0/4078302726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800b8a0 con 0x7f73a00b88b0 2023-12-19T17:51:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f739e7fc700 1 -- 172.21.15.45:0/4078302726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f738800ba00 con 0x7f73a00b88b0 2023-12-19T17:51:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f739e7fc700 1 -- 172.21.15.45:0/4078302726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738800bd90 con 0x7f73a00b88b0 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 -- 172.21.15.45:0/4078302726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 msgr2=0x7f73a00b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 --2- 172.21.15.45:0/4078302726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00b5d10 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f73a00cd5f0 tx=0x7f7388009bf0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 -- 172.21.15.45:0/4078302726 shutdown_connections 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 --2- 172.21.15.45:0/4078302726 >> v2:172.21.15.73:3300/0 conn(0x7f73a00b6250 0x7f73a00b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 --2- 172.21.15.45:0/4078302726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00b5d10 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 --2- 172.21.15.45:0/4078302726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a006ea90 0x7f73a00d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 -- 172.21.15.45:0/4078302726 >> 172.21.15.45:0/4078302726 conn(0x7f73a00b46d0 msgr2=0x7f73a00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 -- 172.21.15.45:0/4078302726 shutdown_connections 2023-12-19T17:51:48.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.134+0000 7f73a54fa700 1 -- 172.21.15.45:0/4078302726 wait complete. 2023-12-19T17:51:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 Processor -- start 2023-12-19T17:51:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 -- start start 2023-12-19T17:51:48.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73a006ea90 0x7f73a0150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a00b6250 0x7f73a01f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00c6710 con 0x7f73a00b88b0 2023-12-19T17:51:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00c6960 con 0x7f73a006ea90 2023-12-19T17:51:48.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f73a54fa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a00c6c40 con 0x7f73a00b6250 2023-12-19T17:51:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f739f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f739f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00cb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41156/0 (socket says 172.21.15.45:41156) 2023-12-19T17:51:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.138+0000 7f739f7fe700 1 -- 172.21.15.45:0/2048769162 learned_addr learned my addr 172.21.15.45:0/2048769162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f7397fff700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a00b6250 0x7f73a01f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739effd700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73a006ea90 0x7f73a0150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739f7fe700 1 -- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a00b6250 msgr2=0x7f73a01f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739f7fe700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a00b6250 0x7f73a01f2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739f7fe700 1 -- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73a006ea90 msgr2=0x7f73a0150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739f7fe700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73a006ea90 0x7f73a0150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739f7fe700 1 -- 172.21.15.45:0/2048769162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7388009570 con 0x7f73a00b88b0 2023-12-19T17:51:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f739f7fe700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00cb4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7398007e40 tx=0x7f739800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739800ed30 con 0x7f73a00b88b0 2023-12-19T17:51:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7398014420 con 0x7f73a00b88b0 2023-12-19T17:51:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a015d330 con 0x7f73a00b88b0 2023-12-19T17:51:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73980147d0 con 0x7f73a00b88b0 2023-12-19T17:51:48.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a00c7200 con 0x7f73a00b88b0 2023-12-19T17:51:48.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.142+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a0067760 con 0x7f73a00b88b0 2023-12-19T17:51:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.146+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7398014930 con 0x7f73a00b88b0 2023-12-19T17:51:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.146+0000 7f73977fe700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7380065ad0 0x7f7380067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.146+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7398083b60 con 0x7f73a00b88b0 2023-12-19T17:51:48.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.146+0000 7f739effd700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7380065ad0 0x7f7380067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.150+0000 7f739effd700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7380065ad0 0x7f7380067f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7390004610 tx=0x7f7390008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.154+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7398051220 con 0x7f73a00b88b0 2023-12-19T17:51:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.338+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73a0066080 con 0x7f73a00b88b0 2023-12-19T17:51:48.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.342+0000 7f73977fe700 1 -- 172.21.15.45:0/2048769162 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f7398054840 con 0x7f73a00b88b0 2023-12-19T17:51:48.345 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:48.345 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7380065ad0 msgr2=0x7f7380067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7380065ad0 0x7f7380067f90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7390004610 tx=0x7f7390008040 comp rx=0 tx=0).stop 2023-12-19T17:51:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 msgr2=0x7f73a00cb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00cb4f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7398007e40 tx=0x7f739800e3c0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 shutdown_connections 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7380065ad0 0x7f7380067f90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73a00b88b0 0x7f73a00cb4f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f73a00b6250 0x7f73a01f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 --2- 172.21.15.45:0/2048769162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73a006ea90 0x7f73a0150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 >> 172.21.15.45:0/2048769162 conn(0x7f73a00b46d0 msgr2=0x7f73a00b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 shutdown_connections 2023-12-19T17:51:48.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.346+0000 7f73a54fa700 1 -- 172.21.15.45:0/2048769162 wait complete. 2023-12-19T17:51:48.373 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:51:48.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:51:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.554+0000 7f7306c76700 1 Processor -- start 2023-12-19T17:51:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.554+0000 7f7306c76700 1 -- start start 2023-12-19T17:51:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7306c76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f730015ab70 0x7f73000b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7306c76700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73000ce8e0 con 0x7f730015ee10 2023-12-19T17:51:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7306c76700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730015af50 con 0x7f73000b11b0 2023-12-19T17:51:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7306c76700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73000b16c0 con 0x7f730015ab70 2023-12-19T17:51:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7305c74700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f730015ab70 0x7f73000b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7306475700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f730015ee10 0x7f73000ced70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40174/0 (socket says 172.21.15.45:40174) 2023-12-19T17:51:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.558+0000 7f7306475700 1 -- 172.21.15.45:0/2472726468 learned_addr learned my addr 172.21.15.45:0/2472726468 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2378797706 0 0) 0x7f73000ce8e0 con 0x7f730015ee10 2023-12-19T17:51:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72ec0035d0 con 0x7f730015ee10 2023-12-19T17:51:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592367882 0 0) 0x7f730015af50 con 0x7f73000b11b0 2023-12-19T17:51:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73000ce8e0 con 0x7f73000b11b0 2023-12-19T17:51:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7305c74700 1 -- 172.21.15.45:0/2472726468 >> v1:172.21.15.73:6789/0 conn(0x7f73000b11b0 legacy=0x7f730015e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7305c74700 1 -- 172.21.15.45:0/2472726468 >> v1:172.21.15.45:6789/0 conn(0x7f730015ee10 legacy=0x7f73000ced70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7305c74700 1 -- 172.21.15.45:0/2472726468 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73000b19a0 con 0x7f730015ab70 2023-12-19T17:51:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7305c74700 1 --2- 172.21.15.45:0/2472726468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730015ab70 0x7f73000b0c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009850 tx=0x7f72fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b460f423c10d4f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc011830 con 0x7f730015ab70 2023-12-19T17:51:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72fc011990 con 0x7f730015ab70 2023-12-19T17:51:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7304c72700 1 -- 172.21.15.45:0/2472726468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72fc011d40 con 0x7f730015ab70 2023-12-19T17:51:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 -- 172.21.15.45:0/2472726468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730015ab70 msgr2=0x7f73000b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 --2- 172.21.15.45:0/2472726468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730015ab70 0x7f73000b0c70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f72fc009850 tx=0x7f72fc009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 -- 172.21.15.45:0/2472726468 shutdown_connections 2023-12-19T17:51:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 --2- 172.21.15.45:0/2472726468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f730015ab70 0x7f73000b0c70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 -- 172.21.15.45:0/2472726468 >> 172.21.15.45:0/2472726468 conn(0x7f73000b2560 msgr2=0x7f73000b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 -- 172.21.15.45:0/2472726468 shutdown_connections 2023-12-19T17:51:48.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.562+0000 7f7306c76700 1 -- 172.21.15.45:0/2472726468 wait complete. 2023-12-19T17:51:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 Processor -- start 2023-12-19T17:51:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 -- start start 2023-12-19T17:51:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73000b11b0 0x7f7300159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f730015ee10 0x7f73000ac2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 0x7f73000c8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73000acca0 con 0x7f73000ac820 2023-12-19T17:51:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730015cca0 con 0x7f73000b11b0 2023-12-19T17:51:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306c76700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730015c370 con 0x7f730015ee10 2023-12-19T17:51:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 0x7f73000c8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 0x7f73000c8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41176/0 (socket says 172.21.15.45:41176) 2023-12-19T17:51:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 -- 172.21.15.45:0/1361523851 learned_addr learned my addr 172.21.15.45:0/1361523851 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7305c74700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73000b11b0 0x7f7300159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7305473700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f730015ee10 0x7f73000ac2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 -- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f730015ee10 msgr2=0x7f73000ac2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f730015ee10 0x7f73000ac2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 -- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73000b11b0 msgr2=0x7f7300159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73000b11b0 0x7f7300159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7306475700 1 -- 172.21.15.45:0/1361523851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc0094b0 con 0x7f73000ac820 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.566+0000 7f7305c74700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73000b11b0 0x7f7300159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:48.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f7306475700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 0x7f73000c8c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f72f800caa0 tx=0x7f72f800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007480 con 0x7f73000ac820 2023-12-19T17:51:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f8007600 con 0x7f73000ac820 2023-12-19T17:51:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f80079b0 con 0x7f73000ac820 2023-12-19T17:51:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730015c650 con 0x7f73000ac820 2023-12-19T17:51:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730015a3f0 con 0x7f73000ac820 2023-12-19T17:51:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.570+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f730015ce30 con 0x7f73000ac820 2023-12-19T17:51:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.574+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f72f801b3b0 con 0x7f73000ac820 2023-12-19T17:51:48.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.574+0000 7f72f67fc700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72e4065b00 0x7f72e4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.574+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72f8082dc0 con 0x7f73000ac820 2023-12-19T17:51:48.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.574+0000 7f7305c74700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72e4065b00 0x7f72e4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.574+0000 7f7305c74700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72e4065b00 0x7f72e4067fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73000d1990 tx=0x7f72fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.578+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f72f80503f0 con 0x7f73000ac820 2023-12-19T17:51:48.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.758+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f730004ed30 con 0x7f73000ac820 2023-12-19T17:51:48.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.758+0000 7f72f67fc700 1 -- 172.21.15.45:0/1361523851 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f72f80170a0 con 0x7f73000ac820 2023-12-19T17:51:48.761 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72e4065b00 msgr2=0x7f72e4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72e4065b00 0x7f72e4067fc0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f73000d1990 tx=0x7f72fc008030 comp rx=0 tx=0).stop 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 msgr2=0x7f73000c8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 0x7f73000c8c20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f72f800caa0 tx=0x7f72f800cad0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 shutdown_connections 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72e4065b00 0x7f72e4067fc0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f73000ac820 0x7f73000c8c20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f730015ee10 0x7f73000ac2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 --2- 172.21.15.45:0/1361523851 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73000b11b0 0x7f7300159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 >> 172.21.15.45:0/1361523851 conn(0x7f73000b2560 msgr2=0x7f730006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 shutdown_connections 2023-12-19T17:51:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.762+0000 7f7306c76700 1 -- 172.21.15.45:0/1361523851 wait complete. 2023-12-19T17:51:48.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:51:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.982+0000 7f2252358700 1 Processor -- start 2023-12-19T17:51:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.982+0000 7f2252358700 1 -- start start 2023-12-19T17:51:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2252358700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f224c1443e0 0x7f224c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2252358700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c071910 0x7f224c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2252358700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c071d70 con 0x7f224c0cb840 2023-12-19T17:51:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2252358700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f224c0b1b80 con 0x7f224c1443e0 2023-12-19T17:51:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2252358700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1447c0 con 0x7f224c071910 2023-12-19T17:51:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2251356700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f224c1443e0 0x7f224c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2250b55700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c071910 0x7f224c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2251b57700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f224c0cb840 0x7f224c15e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:52754/0 (socket says 172.21.15.45:52754) 2023-12-19T17:51:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2251b57700 1 -- 172.21.15.45:0/2820632845 learned_addr learned my addr 172.21.15.45:0/2820632845 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2250b55700 1 -- 172.21.15.45:0/2820632845 >> v2:172.21.15.45:3300/0 conn(0x7f224c1443e0 msgr2=0x7f224c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2250b55700 1 --2- 172.21.15.45:0/2820632845 >> v2:172.21.15.45:3300/0 conn(0x7f224c1443e0 0x7f224c0713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2250b55700 1 -- 172.21.15.45:0/2820632845 >> v1:172.21.15.73:6789/0 conn(0x7f224c0cb840 legacy=0x7f224c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2250b55700 1 -- 172.21.15.45:0/2820632845 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c0b1830 con 0x7f224c071910 2023-12-19T17:51:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2250b55700 1 --2- 172.21.15.45:0/2820632845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c071910 0x7f224c0cb300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f223c009850 tx=0x7f223c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bba55b73dbac02c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2243fff700 1 -- 172.21.15.45:0/2820632845 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c011830 con 0x7f224c071910 2023-12-19T17:51:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2243fff700 1 -- 172.21.15.45:0/2820632845 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c011990 con 0x7f224c071910 2023-12-19T17:51:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.986+0000 7f2243fff700 1 -- 172.21.15.45:0/2820632845 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223c011d40 con 0x7f224c071910 2023-12-19T17:51:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 -- 172.21.15.45:0/2820632845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c071910 msgr2=0x7f224c0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 --2- 172.21.15.45:0/2820632845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c071910 0x7f224c0cb300 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f223c009850 tx=0x7f223c009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 -- 172.21.15.45:0/2820632845 shutdown_connections 2023-12-19T17:51:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 --2- 172.21.15.45:0/2820632845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c071910 0x7f224c0cb300 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 --2- 172.21.15.45:0/2820632845 >> v2:172.21.15.45:3300/0 conn(0x7f224c1443e0 0x7f224c0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 -- 172.21.15.45:0/2820632845 >> 172.21.15.45:0/2820632845 conn(0x7f224c0cf5a0 msgr2=0x7f224c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 -- 172.21.15.45:0/2820632845 shutdown_connections 2023-12-19T17:51:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.990+0000 7f2252358700 1 -- 172.21.15.45:0/2820632845 wait complete. 2023-12-19T17:51:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 Processor -- start 2023-12-19T17:51:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 -- start start 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 0x7f224c1efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1443e0 0x7f224c0a8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c1effa0 0x7f224c0a9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1326a0 con 0x7f224c0cb840 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0a9a60 con 0x7f224c1443e0 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2252358700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0a9d40 con 0x7f224c1effa0 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2251356700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 0x7f224c1efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2251356700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 0x7f224c1efa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36188/0 (socket says 172.21.15.45:36188) 2023-12-19T17:51:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2251356700 1 -- 172.21.15.45:0/1273820183 learned_addr learned my addr 172.21.15.45:0/1273820183 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2250b55700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1443e0 0x7f224c0a8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.994+0000 7f2251b57700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c1effa0 0x7f224c0a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2251356700 1 -- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c1effa0 msgr2=0x7f224c0a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2251356700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c1effa0 0x7f224c0a9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2251356700 1 -- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1443e0 msgr2=0x7f224c0a8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2251356700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1443e0 0x7f224c0a8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2251356700 1 -- 172.21.15.45:0/1273820183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c0094b0 con 0x7f224c0cb840 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2250b55700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1443e0 0x7f224c0a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2251356700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 0x7f224c1efa60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f224800e9b0 tx=0x7f224800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2248009710 con 0x7f224c0cb840 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f224800ee50 con 0x7f224c0cb840 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f224800ca50 con 0x7f224c0cb840 2023-12-19T17:51:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224c131fe0 con 0x7f224c0cb840 2023-12-19T17:51:49.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c138330 con 0x7f224c0cb840 2023-12-19T17:51:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:48.998+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c04ed30 con 0x7f224c0cb840 2023-12-19T17:51:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.002+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f224800cbb0 con 0x7f224c0cb840 2023-12-19T17:51:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.006+0000 7f2241ffb700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2230065ad0 0x7f2230067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.006+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2248083420 con 0x7f224c0cb840 2023-12-19T17:51:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.006+0000 7f2250b55700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2230065ad0 0x7f2230067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.006+0000 7f2250b55700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2230065ad0 0x7f2230067f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f223c0090b0 tx=0x7f223c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.010+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2248050ae0 con 0x7f224c0cb840 2023-12-19T17:51:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.194+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f224c0b0ce0 con 0x7f224c0cb840 2023-12-19T17:51:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.194+0000 7f2241ffb700 1 -- 172.21.15.45:0/1273820183 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f224800ce60 con 0x7f224c0cb840 2023-12-19T17:51:49.196 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:51:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2230065ad0 msgr2=0x7f2230067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2230065ad0 0x7f2230067f90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f223c0090b0 tx=0x7f223c01c040 comp rx=0 tx=0).stop 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 msgr2=0x7f224c1efa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 0x7f224c1efa60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f224800e9b0 tx=0x7f224800ecc0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 shutdown_connections 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2230065ad0 0x7f2230067f90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f224c1effa0 0x7f224c0a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f224c1443e0 0x7f224c0a8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 --2- 172.21.15.45:0/1273820183 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f224c0cb840 0x7f224c1efa60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 >> 172.21.15.45:0/1273820183 conn(0x7f224c071910 msgr2=0x7f224c0b3100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 shutdown_connections 2023-12-19T17:51:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.198+0000 7f2252358700 1 -- 172.21.15.45:0/1273820183 wait complete. 2023-12-19T17:51:49.224 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:51:49.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9071c51700 1 Processor -- start 2023-12-19T17:51:49.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9071c51700 1 -- start start 2023-12-19T17:51:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9071c51700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f906c0d0a50 0x7f906c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9071c51700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c0d01e0 con 0x7f906c15d090 2023-12-19T17:51:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9071c51700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f906c0d10e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9071c51700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f906c0b6040 con 0x7f906c0d0a50 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f906b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f906c15d090 0x7f906c0cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45140/0 (socket says 172.21.15.45:45140) 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f906b7fe700 1 -- 172.21.15.45:0/1587699731 learned_addr learned my addr 172.21.15.45:0/1587699731 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f9062ffd700 1 --2- 172.21.15.45:0/1587699731 >> v2:172.21.15.45:3300/0 conn(0x7f906c0d0a50 0x7f906c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.406+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944522709 0 0) 0x7f905c001110 con 0x7f906c15d090 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90580035d0 con 0x7f906c15d090 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 572385173 0 0) 0x7f906c0d10e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f905c001110 con 0x7f906c0cfd70 2023-12-19T17:51:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9062ffd700 1 -- 172.21.15.45:0/1587699731 >> v1:172.21.15.73:6789/0 conn(0x7f906c0cfd70 legacy=0x7f906c0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9062ffd700 1 -- 172.21.15.45:0/1587699731 >> v1:172.21.15.45:6789/0 conn(0x7f906c15d090 legacy=0x7f906c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9062ffd700 1 -- 172.21.15.45:0/1587699731 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f906c0d13c0 con 0x7f906c0d0a50 2023-12-19T17:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9062ffd700 1 --2- 172.21.15.45:0/1587699731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d0a50 0x7f906c0cf830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9054009d90 tx=0x7f905400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7993a5fa329eeedd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905400e070 con 0x7f906c0d0a50 2023-12-19T17:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905400bb20 con 0x7f906c0d0a50 2023-12-19T17:51:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f906affd700 1 -- 172.21.15.45:0/1587699731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9054012430 con 0x7f906c0d0a50 2023-12-19T17:51:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 -- 172.21.15.45:0/1587699731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d0a50 msgr2=0x7f906c0cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 --2- 172.21.15.45:0/1587699731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d0a50 0x7f906c0cf830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9054009d90 tx=0x7f905400b330 comp rx=0 tx=0).stop 2023-12-19T17:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 -- 172.21.15.45:0/1587699731 shutdown_connections 2023-12-19T17:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 --2- 172.21.15.45:0/1587699731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0d0a50 0x7f906c0cf830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 -- 172.21.15.45:0/1587699731 >> 172.21.15.45:0/1587699731 conn(0x7f906c0b4b90 msgr2=0x7f906c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 -- 172.21.15.45:0/1587699731 shutdown_connections 2023-12-19T17:51:49.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.410+0000 7f9071c51700 1 -- 172.21.15.45:0/1587699731 wait complete. 2023-12-19T17:51:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.414+0000 7f9071c51700 1 Processor -- start 2023-12-19T17:51:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.414+0000 7f9071c51700 1 -- start start 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 0x7f906c0b2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f906c0d0a50 0x7f906c150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f906c15d090 0x7f906c0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c15f060 con 0x7f906c0cfd70 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906c15f340 con 0x7f906c0d0a50 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f906c15f620 con 0x7f906c15d090 2023-12-19T17:51:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 0x7f906c0b2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 0x7f906c0b2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36200/0 (socket says 172.21.15.45:36200) 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 -- 172.21.15.45:0/2604356658 learned_addr learned my addr 172.21.15.45:0/2604356658 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9062ffd700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f906c0d0a50 0x7f906c150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906bfff700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f906c15d090 0x7f906c0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 -- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f906c15d090 msgr2=0x7f906c0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f906c15d090 0x7f906c0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 -- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f906c0d0a50 msgr2=0x7f906c150280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f906c0d0a50 0x7f906c150280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 -- 172.21.15.45:0/2604356658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9054009a70 con 0x7f906c0cfd70 2023-12-19T17:51:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9062ffd700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f906c0d0a50 0x7f906c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f906b7fe700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 0x7f906c0b2db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f905c00c7b0 tx=0x7f905c00cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c005d90 con 0x7f906c0cfd70 2023-12-19T17:51:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f905c007070 con 0x7f906c0cfd70 2023-12-19T17:51:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906c15f900 con 0x7f906c0cfd70 2023-12-19T17:51:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f905c0073e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.418+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906c1546e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.422+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f906c154930 con 0x7f906c0cfd70 2023-12-19T17:51:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.422+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f905c007540 con 0x7f906c0cfd70 2023-12-19T17:51:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.422+0000 7f9068ff9700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f904c065b00 0x7f904c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.422+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f905c0826e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.422+0000 7f9062ffd700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f904c065b00 0x7f904c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.426+0000 7f9062ffd700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f904c065b00 0x7f904c067fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9054014040 tx=0x7f905401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.430+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f905c04fe70 con 0x7f906c0cfd70 2023-12-19T17:51:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.606+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f906c0d01e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.606+0000 7f9068ff9700 1 -- 172.21.15.45:0/2604356658 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f906c0d01e0 con 0x7f906c0cfd70 2023-12-19T17:51:49.609 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:51:49.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f904c065b00 msgr2=0x7f904c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f904c065b00 0x7f904c067fc0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f9054014040 tx=0x7f905401d040 comp rx=0 tx=0).stop 2023-12-19T17:51:49.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 msgr2=0x7f906c0b2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 0x7f906c0b2db0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f905c00c7b0 tx=0x7f905c00cb70 comp rx=0 tx=0).stop 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 shutdown_connections 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f904c065b00 0x7f904c067fc0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f906c15d090 0x7f906c0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f906c0d0a50 0x7f906c150280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 --2- 172.21.15.45:0/2604356658 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f906c0cfd70 0x7f906c0b2db0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 >> 172.21.15.45:0/2604356658 conn(0x7f906c0b4b90 msgr2=0x7f906c15b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 shutdown_connections 2023-12-19T17:51:49.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.610+0000 7f9071c51700 1 -- 172.21.15.45:0/2604356658 wait complete. 2023-12-19T17:51:49.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:51:49.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.814+0000 7eff13157700 1 Processor -- start 2023-12-19T17:51:49.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.814+0000 7eff13157700 1 -- start start 2023-12-19T17:51:49.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.814+0000 7eff13157700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff0c15afa0 0x7eff0c0cb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.814+0000 7eff13157700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c15b380 con 0x7eff0c0d0180 2023-12-19T17:51:49.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.814+0000 7eff13157700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0cc280 con 0x7eff0c0cc4f0 2023-12-19T17:51:49.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.814+0000 7eff13157700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0cb670 con 0x7eff0c15afa0 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff116f4700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff0c0d0180 0x7eff0c0b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45146/0 (socket says 172.21.15.45:45146) 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff116f4700 1 -- 172.21.15.45:0/1446504382 learned_addr learned my addr 172.21.15.45:0/1446504382 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff10ef3700 1 --2- 172.21.15.45:0/1446504382 >> v2:172.21.15.45:3300/0 conn(0x7eff0c15afa0 0x7eff0c0cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748819196 0 0) 0x7eff0c15b380 con 0x7eff0c0d0180 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efefc0035d0 con 0x7eff0c0d0180 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966041774 0 0) 0x7eff0c0cc280 con 0x7eff0c0cc4f0 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff0c15b380 con 0x7eff0c0cc4f0 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff10ef3700 1 -- 172.21.15.45:0/1446504382 >> v1:172.21.15.73:6789/0 conn(0x7eff0c0cc4f0 legacy=0x7eff0c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff10ef3700 1 -- 172.21.15.45:0/1446504382 >> v1:172.21.15.45:6789/0 conn(0x7eff0c0d0180 legacy=0x7eff0c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff10ef3700 1 -- 172.21.15.45:0/1446504382 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0cb950 con 0x7eff0c15afa0 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff10ef3700 1 --2- 172.21.15.45:0/1446504382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c0cb090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff00009850 tx=0x7eff00009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff9e3f81de471c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00011830 con 0x7eff0c15afa0 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff00011990 con 0x7eff0c15afa0 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff0b7fe700 1 -- 172.21.15.45:0/1446504382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff00011d40 con 0x7eff0c15afa0 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 -- 172.21.15.45:0/1446504382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 msgr2=0x7eff0c0cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 --2- 172.21.15.45:0/1446504382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c0cb090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7eff00009850 tx=0x7eff00009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 -- 172.21.15.45:0/1446504382 shutdown_connections 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 --2- 172.21.15.45:0/1446504382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c0cb090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 -- 172.21.15.45:0/1446504382 >> 172.21.15.45:0/1446504382 conn(0x7eff0c06a010 msgr2=0x7eff0c06a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:49.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 -- 172.21.15.45:0/1446504382 shutdown_connections 2023-12-19T17:51:49.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.818+0000 7eff13157700 1 -- 172.21.15.45:0/1446504382 wait complete. 2023-12-19T17:51:49.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.822+0000 7eff13157700 1 Processor -- start 2023-12-19T17:51:49.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.822+0000 7eff13157700 1 -- start start 2023-12-19T17:51:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0c0cc4f0 0x7eff0c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff0c0d0180 0x7eff0c0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c1f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c15b5d0 con 0x7eff0c15afa0 2023-12-19T17:51:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1f3140 con 0x7eff0c0cc4f0 2023-12-19T17:51:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c0cdd70 con 0x7eff0c0d0180 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c1f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c1f2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36222/0 (socket says 172.21.15.45:36222) 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 -- 172.21.15.45:0/1706751799 learned_addr learned my addr 172.21.15.45:0/1706751799 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff10ef3700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0c0cc4f0 0x7eff0c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff0bfff700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff0c0d0180 0x7eff0c0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 -- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff0c0d0180 msgr2=0x7eff0c0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff0c0d0180 0x7eff0c0aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 -- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0c0cc4f0 msgr2=0x7eff0c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:49.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0c0cc4f0 0x7eff0c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:49.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 -- 172.21.15.45:0/1706751799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000094b0 con 0x7eff0c15afa0 2023-12-19T17:51:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff116f4700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c1f2c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff0400caa0 tx=0x7eff0400cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04007480 con 0x7eff0c15afa0 2023-12-19T17:51:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff040075e0 con 0x7eff0c15afa0 2023-12-19T17:51:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c0ce050 con 0x7eff0c15afa0 2023-12-19T17:51:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04007970 con 0x7eff0c15afa0 2023-12-19T17:51:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.826+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c0ce610 con 0x7eff0c15afa0 2023-12-19T17:51:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.830+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c04ed30 con 0x7eff0c15afa0 2023-12-19T17:51:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.830+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff0401b3b0 con 0x7eff0c15afa0 2023-12-19T17:51:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.834+0000 7eff097fa700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efef0065b00 0x7efef0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.834+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7eff04082da0 con 0x7eff0c15afa0 2023-12-19T17:51:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.834+0000 7eff10ef3700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efef0065b00 0x7efef0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.834+0000 7eff10ef3700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efef0065b00 0x7efef0067fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff000090b0 tx=0x7eff00008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:49.838+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff040503d0 con 0x7eff0c15afa0 2023-12-19T17:51:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.022+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7eff0c0c3000 con 0x7eff0c15afa0 2023-12-19T17:51:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff097fa700 1 -- 172.21.15.45:0/1706751799 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7eff040170a0 con 0x7eff0c15afa0 2023-12-19T17:51:50.027 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:51:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efef0065b00 msgr2=0x7efef0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efef0065b00 0x7efef0067fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff000090b0 tx=0x7eff00008030 comp rx=0 tx=0).stop 2023-12-19T17:51:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 msgr2=0x7eff0c1f2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c1f2c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7eff0400caa0 tx=0x7eff0400cad0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 shutdown_connections 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efef0065b00 0x7efef0067fc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff0c15afa0 0x7eff0c1f2c00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff0c0d0180 0x7eff0c0aed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 --2- 172.21.15.45:0/1706751799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff0c0cc4f0 0x7eff0c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 >> 172.21.15.45:0/1706751799 conn(0x7eff0c06a010 msgr2=0x7eff0c0b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 shutdown_connections 2023-12-19T17:51:50.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.026+0000 7eff13157700 1 -- 172.21.15.45:0/1706751799 wait complete. 2023-12-19T17:51:50.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:51:50.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.226+0000 7f070b35d700 1 Processor -- start 2023-12-19T17:51:50.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.226+0000 7f070b35d700 1 -- start start 2023-12-19T17:51:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070b35d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f07040b88b0 0x7f070406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070b35d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f070406f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070b35d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07040d1820 con 0x7f070406ea90 2023-12-19T17:51:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070b35d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07040d1630 con 0x7f07040b88b0 2023-12-19T17:51:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070b35d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07040d1b00 con 0x7f070406f3b0 2023-12-19T17:51:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070ab5c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f070406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070a35b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f070406ea90 0x7f07040d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:52772/0 (socket says 172.21.15.45:52772) 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070ab5c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f070406f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:47306/0 (socket says 172.21.15.45:47306) 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f070a35b700 1 -- 172.21.15.45:0/3416446712 learned_addr learned my addr 172.21.15.45:0/3416446712 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.230+0000 7f0709b5a700 1 --2- 172.21.15.45:0/3416446712 >> v2:172.21.15.73:3300/0 conn(0x7f07040b88b0 0x7f070406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f0709359700 1 -- 172.21.15.45:0/3416446712 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874919319 0 0) 0x7f07040d1820 con 0x7f070406ea90 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070ab5c700 1 -- 172.21.15.45:0/3416446712 >> v2:172.21.15.73:3300/0 conn(0x7f07040b88b0 msgr2=0x7f070406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070ab5c700 1 --2- 172.21.15.45:0/3416446712 >> v2:172.21.15.73:3300/0 conn(0x7f07040b88b0 0x7f070406ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070ab5c700 1 -- 172.21.15.45:0/3416446712 >> v1:172.21.15.73:6789/0 conn(0x7f070406ea90 legacy=0x7f07040d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070ab5c700 1 -- 172.21.15.45:0/3416446712 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07040d1de0 con 0x7f070406f3b0 2023-12-19T17:51:50.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070ab5c700 1 --2- 172.21.15.45:0/3416446712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f070406f840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009d90 tx=0x7f06fc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=714785a6d812d3b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:50.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f0709359700 1 -- 172.21.15.45:0/3416446712 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc00e070 con 0x7f070406f3b0 2023-12-19T17:51:50.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f0709359700 1 -- 172.21.15.45:0/3416446712 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06fc00bb20 con 0x7f070406f3b0 2023-12-19T17:51:50.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f0709359700 1 -- 172.21.15.45:0/3416446712 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06fc012430 con 0x7f070406f3b0 2023-12-19T17:51:50.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 -- 172.21.15.45:0/3416446712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 msgr2=0x7f070406f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 --2- 172.21.15.45:0/3416446712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f070406f840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f06fc009d90 tx=0x7f06fc00b330 comp rx=0 tx=0).stop 2023-12-19T17:51:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 -- 172.21.15.45:0/3416446712 shutdown_connections 2023-12-19T17:51:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 --2- 172.21.15.45:0/3416446712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f070406f840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 --2- 172.21.15.45:0/3416446712 >> v2:172.21.15.73:3300/0 conn(0x7f07040b88b0 0x7f070406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 -- 172.21.15.45:0/3416446712 >> 172.21.15.45:0/3416446712 conn(0x7f07040b46d0 msgr2=0x7f07040b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 -- 172.21.15.45:0/3416446712 shutdown_connections 2023-12-19T17:51:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.234+0000 7f070b35d700 1 -- 172.21.15.45:0/3416446712 wait complete. 2023-12-19T17:51:50.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 Processor -- start 2023-12-19T17:51:50.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 -- start start 2023-12-19T17:51:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 0x7f070414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f07040c8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07040b88b0 0x7f07041f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070414f610 con 0x7f070406ea90 2023-12-19T17:51:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070414fe00 con 0x7f07040b88b0 2023-12-19T17:51:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070b35d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07041500e0 con 0x7f070406f3b0 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 0x7f070414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 0x7f070414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36226/0 (socket says 172.21.15.45:36226) 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 -- 172.21.15.45:0/1693845469 learned_addr learned my addr 172.21.15.45:0/1693845469 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f0709b5a700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f07040c8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070ab5c700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07040b88b0 0x7f07041f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 -- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 msgr2=0x7f07040c8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f07040c8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 -- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07040b88b0 msgr2=0x7f07041f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07040b88b0 0x7f07041f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 -- 172.21.15.45:0/1693845469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc009a70 con 0x7f070406ea90 2023-12-19T17:51:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f070a35b700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 0x7f070414f0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f070000c4e0 tx=0x7f070000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.238+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700004ca0 con 0x7f070406ea90 2023-12-19T17:51:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.242+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700004e20 con 0x7f070406ea90 2023-12-19T17:51:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.242+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07041503c0 con 0x7f070406ea90 2023-12-19T17:51:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.242+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0700007310 con 0x7f070406ea90 2023-12-19T17:51:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.242+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0704150980 con 0x7f070406ea90 2023-12-19T17:51:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.242+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0704067760 con 0x7f070406ea90 2023-12-19T17:51:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.242+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0700007470 con 0x7f070406ea90 2023-12-19T17:51:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.246+0000 7f06faffd700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f06e8065ad0 0x7f06e8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.246+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0700083090 con 0x7f070406ea90 2023-12-19T17:51:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.246+0000 7f0709b5a700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f06e8065ad0 0x7f06e8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.246+0000 7f0709b5a700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f06e8065ad0 0x7f06e8067f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0704152cb0 tx=0x7f06f4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:50.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.250+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f07000506c0 con 0x7f070406ea90 2023-12-19T17:51:50.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.514+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f07040d2090 con 0x7f070406ea90 2023-12-19T17:51:50.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.514+0000 7f06faffd700 1 -- 172.21.15.45:0/1693845469 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0700007720 con 0x7f070406ea90 2023-12-19T17:51:50.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.514+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f06e8065ad0 msgr2=0x7f06e8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f06e8065ad0 0x7f06e8067f90 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0704152cb0 tx=0x7f06f4009240 comp rx=0 tx=0).stop 2023-12-19T17:51:50.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 msgr2=0x7f070414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 0x7f070414f0d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f070000c4e0 tx=0x7f070000c7f0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 shutdown_connections 2023-12-19T17:51:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f06e8065ad0 0x7f06e8067f90 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07040b88b0 0x7f07041f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f070406f3b0 0x7f07040c8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 --2- 172.21.15.45:0/1693845469 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f070406ea90 0x7f070414f0d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 >> 172.21.15.45:0/1693845469 conn(0x7f07040b46d0 msgr2=0x7f0704070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 shutdown_connections 2023-12-19T17:51:50.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.518+0000 7f070b35d700 1 -- 172.21.15.45:0/1693845469 wait complete. 2023-12-19T17:51:50.521 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:51:50.539 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:51:50.540 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:51:50.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:50.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 Processor -- start 2023-12-19T17:51:50.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 -- start start 2023-12-19T17:51:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ea006ea90 0x7f1ea00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ea006fe80 0x7f1ea00b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ea00d1820 con 0x7f1ea00b88b0 2023-12-19T17:51:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea00d1b00 con 0x7f1ea006ea90 2023-12-19T17:51:50.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.786+0000 7f1ea522f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ea00d1de0 con 0x7f1ea006fe80 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ea006ea90 0x7f1ea00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1ea006ea90 0x7f1ea00d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36234/0 (socket says 172.21.15.45:36234) 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 -- 172.21.15.45:0/1969897474 learned_addr learned my addr 172.21.15.45:0/1969897474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1ea4a2e700 1 --2- 172.21.15.45:0/1969897474 >> v2:172.21.15.73:3300/0 conn(0x7f1ea006fe80 0x7f1ea00b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 -- 172.21.15.45:0/1969897474 >> v2:172.21.15.73:3300/0 conn(0x7f1ea006fe80 msgr2=0x7f1ea00b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 --2- 172.21.15.45:0/1969897474 >> v2:172.21.15.73:3300/0 conn(0x7f1ea006fe80 0x7f1ea00b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 -- 172.21.15.45:0/1969897474 >> v1:172.21.15.73:6789/0 conn(0x7f1ea00b88b0 legacy=0x7f1ea00b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 -- 172.21.15.45:0/1969897474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ea00d20c0 con 0x7f1ea006ea90 2023-12-19T17:51:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9ffff700 1 --2- 172.21.15.45:0/1969897474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea006ea90 0x7f1ea00d0f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ea008bc60 tx=0x7f1e90009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57313b0b657353dc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9effd700 1 -- 172.21.15.45:0/1969897474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90011830 con 0x7f1ea006ea90 2023-12-19T17:51:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9effd700 1 -- 172.21.15.45:0/1969897474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90011990 con 0x7f1ea006ea90 2023-12-19T17:51:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1e9effd700 1 -- 172.21.15.45:0/1969897474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e90011d20 con 0x7f1ea006ea90 2023-12-19T17:51:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1ea522f700 1 -- 172.21.15.45:0/1969897474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea006ea90 msgr2=0x7f1ea00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.790+0000 7f1ea522f700 1 --2- 172.21.15.45:0/1969897474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea006ea90 0x7f1ea00d0f20 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1ea008bc60 tx=0x7f1e90009bf0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 -- 172.21.15.45:0/1969897474 shutdown_connections 2023-12-19T17:51:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 --2- 172.21.15.45:0/1969897474 >> v2:172.21.15.73:3300/0 conn(0x7f1ea006fe80 0x7f1ea00b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 --2- 172.21.15.45:0/1969897474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea006ea90 0x7f1ea00d0f20 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 -- 172.21.15.45:0/1969897474 >> 172.21.15.45:0/1969897474 conn(0x7f1ea00b46d0 msgr2=0x7f1ea00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 -- 172.21.15.45:0/1969897474 shutdown_connections 2023-12-19T17:51:50.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 -- 172.21.15.45:0/1969897474 wait complete. 2023-12-19T17:51:50.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.794+0000 7f1ea522f700 1 Processor -- start 2023-12-19T17:51:50.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 -- start start 2023-12-19T17:51:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ea006ea90 0x7f1ea00b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea006fe80 0x7f1ea00c8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 0x7f1ea01f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea0148c40 con 0x7f1ea00b88b0 2023-12-19T17:51:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea014b220 con 0x7f1ea006fe80 2023-12-19T17:51:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea522f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ea014b500 con 0x7f1ea006ea90 2023-12-19T17:51:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 0x7f1ea01f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 0x7f1ea01f4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36246/0 (socket says 172.21.15.45:36246) 2023-12-19T17:51:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 -- 172.21.15.45:0/2574558572 learned_addr learned my addr 172.21.15.45:0/2574558572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1e9ffff700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ea006ea90 0x7f1ea00b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1e9f7fe700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea006fe80 0x7f1ea00c8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 -- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ea006ea90 msgr2=0x7f1ea00b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ea006ea90 0x7f1ea00b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 -- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea006fe80 msgr2=0x7f1ea00c8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea006fe80 0x7f1ea00c8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.798+0000 7f1ea4a2e700 1 -- 172.21.15.45:0/2574558572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e90009570 con 0x7f1ea00b88b0 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1ea4a2e700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 0x7f1ea01f4eb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800efc0 tx=0x7f1e9800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98009ba0 con 0x7f1ea00b88b0 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e9800f040 con 0x7f1ea00b88b0 2023-12-19T17:51:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ea014b7e0 con 0x7f1ea00b88b0 2023-12-19T17:51:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e98014480 con 0x7f1ea00b88b0 2023-12-19T17:51:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ea00b3820 con 0x7f1ea00b88b0 2023-12-19T17:51:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.802+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ea0067760 con 0x7f1ea00b88b0 2023-12-19T17:51:50.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.806+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1e980145e0 con 0x7f1ea00b88b0 2023-12-19T17:51:50.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.806+0000 7f1e9cff9700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1e8c065b20 0x7f1e8c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.806+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1e98083f60 con 0x7f1ea00b88b0 2023-12-19T17:51:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.806+0000 7f1e9ffff700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1e8c065b20 0x7f1e8c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.810+0000 7f1e9ffff700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1e8c065b20 0x7f1e8c067fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000c00 tx=0x7f1e90008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.814+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1e980516a0 con 0x7f1ea00b88b0 2023-12-19T17:51:50.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.994+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ea00ce580 con 0x7f1ea00b88b0 2023-12-19T17:51:51.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:50.998+0000 7f1e9cff9700 1 -- 172.21.15.45:0/2574558572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f1e98018090 con 0x7f1ea00b88b0 2023-12-19T17:51:51.002 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:51.002 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:51.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1e8c065b20 msgr2=0x7f1e8c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1e8c065b20 0x7f1e8c067fe0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000c00 tx=0x7f1e90008030 comp rx=0 tx=0).stop 2023-12-19T17:51:51.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 msgr2=0x7f1ea01f4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 0x7f1ea01f4eb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1e9800efc0 tx=0x7f1e9800c3a0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 shutdown_connections 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1e8c065b20 0x7f1e8c067fe0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ea00b88b0 0x7f1ea01f4eb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ea006fe80 0x7f1ea00c8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 --2- 172.21.15.45:0/2574558572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ea006ea90 0x7f1ea00b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 >> 172.21.15.45:0/2574558572 conn(0x7f1ea00b46d0 msgr2=0x7f1ea00b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:51.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 shutdown_connections 2023-12-19T17:51:51.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.002+0000 7f1ea522f700 1 -- 172.21.15.45:0/2574558572 wait complete. 2023-12-19T17:51:51.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:51:51.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:51:51.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.218+0000 7f6f26fe8700 1 Processor -- start 2023-12-19T17:51:51.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.218+0000 7f6f26fe8700 1 -- start start 2023-12-19T17:51:51.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f26fe8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f200d2690 0x7f6f200cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f26fe8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200d2200 con 0x7f6f2015d220 2023-12-19T17:51:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f26fe8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f200d1920 con 0x7f6f200d0e30 2023-12-19T17:51:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f26fe8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f200d2aa0 con 0x7f6f200d2690 2023-12-19T17:51:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f257e5700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f2015d220 0x7f6f2006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45150/0 (socket says 172.21.15.45:45150) 2023-12-19T17:51:51.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f257e5700 1 -- 172.21.15.45:0/711431901 learned_addr learned my addr 172.21.15.45:0/711431901 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f267e7700 1 --2- 172.21.15.45:0/711431901 >> v2:172.21.15.73:3300/0 conn(0x7f6f200d2690 0x7f6f200cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2986049747 0 0) 0x7f6f200d2200 con 0x7f6f2015d220 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f0c0035d0 con 0x7f6f2015d220 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443605966 0 0) 0x7f6f200d1920 con 0x7f6f200d0e30 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f200d2200 con 0x7f6f200d0e30 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f267e7700 1 -- 172.21.15.45:0/711431901 >> v1:172.21.15.73:6789/0 conn(0x7f6f200d0e30 legacy=0x7f6f200d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f267e7700 1 -- 172.21.15.45:0/711431901 >> v1:172.21.15.45:6789/0 conn(0x7f6f2015d220 legacy=0x7f6f2006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f267e7700 1 -- 172.21.15.45:0/711431901 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f20070210 con 0x7f6f200d2690 2023-12-19T17:51:51.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.222+0000 7f6f267e7700 1 --2- 172.21.15.45:0/711431901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200d2690 0x7f6f200cd4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009d90 tx=0x7f6f1800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eb7536490ace67c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:51.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1800e070 con 0x7f6f200d2690 2023-12-19T17:51:51.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1800bb20 con 0x7f6f200d2690 2023-12-19T17:51:51.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f24fe4700 1 -- 172.21.15.45:0/711431901 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f18012430 con 0x7f6f200d2690 2023-12-19T17:51:51.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 -- 172.21.15.45:0/711431901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200d2690 msgr2=0x7f6f200cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/711431901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200d2690 0x7f6f200cd4b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009d90 tx=0x7f6f1800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 -- 172.21.15.45:0/711431901 shutdown_connections 2023-12-19T17:51:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/711431901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f200d2690 0x7f6f200cd4b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 -- 172.21.15.45:0/711431901 >> 172.21.15.45:0/711431901 conn(0x7f6f200b46d0 msgr2=0x7f6f200b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 -- 172.21.15.45:0/711431901 shutdown_connections 2023-12-19T17:51:51.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.226+0000 7f6f26fe8700 1 -- 172.21.15.45:0/711431901 wait complete. 2023-12-19T17:51:51.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 Processor -- start 2023-12-19T17:51:51.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 -- start start 2023-12-19T17:51:51.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f200d0e30 0x7f6f2015fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 0x7f6f2015e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2015d220 0x7f6f20149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2015fa60 con 0x7f6f200d2690 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2015ee50 con 0x7f6f2015d220 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f26fe8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2015f130 con 0x7f6f200d0e30 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 0x7f6f2015e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 0x7f6f2015e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36262/0 (socket says 172.21.15.45:36262) 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 -- 172.21.15.45:0/2665667267 learned_addr learned my addr 172.21.15.45:0/2665667267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f25fe6700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f200d0e30 0x7f6f2015fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f267e7700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2015d220 0x7f6f20149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 -- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f200d0e30 msgr2=0x7f6f2015fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f200d0e30 0x7f6f2015fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 -- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2015d220 msgr2=0x7f6f20149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2015d220 0x7f6f20149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 -- 172.21.15.45:0/2665667267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009a70 con 0x7f6f200d2690 2023-12-19T17:51:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f267e7700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2015d220 0x7f6f20149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.230+0000 7f6f257e5700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 0x7f6f2015e490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c4d0 tx=0x7f6f1000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.234+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10005d90 con 0x7f6f200d2690 2023-12-19T17:51:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.234+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f100070d0 con 0x7f6f200d2690 2023-12-19T17:51:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.234+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10007440 con 0x7f6f200d2690 2023-12-19T17:51:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.234+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2015f410 con 0x7f6f200d2690 2023-12-19T17:51:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.234+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f20160430 con 0x7f6f200d2690 2023-12-19T17:51:51.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.234+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20072a90 con 0x7f6f200d2690 2023-12-19T17:51:51.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.238+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f100075a0 con 0x7f6f200d2690 2023-12-19T17:51:51.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.238+0000 7f6f167fc700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f04065ad0 0x7f6f04067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.238+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f10082780 con 0x7f6f200d2690 2023-12-19T17:51:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.238+0000 7f6f25fe6700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f04065ad0 0x7f6f04067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.238+0000 7f6f25fe6700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f04065ad0 0x7f6f04067f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0011e0 tx=0x7f6f1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:51.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.246+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f1004fef0 con 0x7f6f200d2690 2023-12-19T17:51:51.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.422+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f2004ed30 con 0x7f6f200d2690 2023-12-19T17:51:51.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.422+0000 7f6f167fc700 1 -- 172.21.15.45:0/2665667267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f10053510 con 0x7f6f200d2690 2023-12-19T17:51:51.426 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f04065ad0 msgr2=0x7f6f04067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f04065ad0 0x7f6f04067f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0011e0 tx=0x7f6f1c009040 comp rx=0 tx=0).stop 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 msgr2=0x7f6f2015e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 0x7f6f2015e490 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000c4d0 tx=0x7f6f1000c7e0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 shutdown_connections 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f04065ad0 0x7f6f04067f90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f2015d220 0x7f6f20149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f200d2690 0x7f6f2015e490 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 --2- 172.21.15.45:0/2665667267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f200d0e30 0x7f6f2015fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 >> 172.21.15.45:0/2665667267 conn(0x7f6f200b46d0 msgr2=0x7f6f200b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 shutdown_connections 2023-12-19T17:51:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.426+0000 7f6f26fe8700 1 -- 172.21.15.45:0/2665667267 wait complete. 2023-12-19T17:51:51.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:51:51.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 Processor -- start 2023-12-19T17:51:51.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 -- start start 2023-12-19T17:51:51.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb0815ccf0 0x7fcb080b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb080cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb08160970 0x7fcb08160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb08070370 con 0x7fcb0815ccf0 2023-12-19T17:51:51.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb0806f4a0 con 0x7fcb08160970 2023-12-19T17:51:51.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb0806f6f0 con 0x7fcb080cd940 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb0815ccf0 0x7fcb080b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcb0815ccf0 0x7fcb080b8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36268/0 (socket says 172.21.15.45:36268) 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.638+0000 7fcb0659c700 1 -- 172.21.15.45:0/3365352218 learned_addr learned my addr 172.21.15.45:0/3365352218 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb06d9d700 1 --2- 172.21.15.45:0/3365352218 >> v2:172.21.15.73:3300/0 conn(0x7fcb08160970 0x7fcb08160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb05d9b700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb080cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0659c700 1 -- 172.21.15.45:0/3365352218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 msgr2=0x7fcb080cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0659c700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb080cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0659c700 1 -- 172.21.15.45:0/3365352218 >> v2:172.21.15.73:3300/0 conn(0x7fcb08160970 msgr2=0x7fcb08160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0659c700 1 --2- 172.21.15.45:0/3365352218 >> v2:172.21.15.73:3300/0 conn(0x7fcb08160970 0x7fcb08160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0659c700 1 -- 172.21.15.45:0/3365352218 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb0806f9d0 con 0x7fcb0815ccf0 2023-12-19T17:51:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb05d9b700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb080cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0659c700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb080b8520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb080b2600 tx=0x7fcaf8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcb7f676f04f964a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0559a700 1 -- 172.21.15.45:0/3365352218 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800b8a0 con 0x7fcb0815ccf0 2023-12-19T17:51:51.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0559a700 1 -- 172.21.15.45:0/3365352218 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaf800ba00 con 0x7fcb0815ccf0 2023-12-19T17:51:51.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0559a700 1 -- 172.21.15.45:0/3365352218 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaf800bd90 con 0x7fcb0815ccf0 2023-12-19T17:51:51.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 -- 172.21.15.45:0/3365352218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 msgr2=0x7fcb080b8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb080b8520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcb080b2600 tx=0x7fcaf8009bf0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 -- 172.21.15.45:0/3365352218 shutdown_connections 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 --2- 172.21.15.45:0/3365352218 >> v2:172.21.15.73:3300/0 conn(0x7fcb08160970 0x7fcb08160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb080cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 --2- 172.21.15.45:0/3365352218 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb080b8520 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 -- 172.21.15.45:0/3365352218 >> 172.21.15.45:0/3365352218 conn(0x7fcb080b46f0 msgr2=0x7fcb080b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 -- 172.21.15.45:0/3365352218 shutdown_connections 2023-12-19T17:51:51.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.642+0000 7fcb0759e700 1 -- 172.21.15.45:0/3365352218 wait complete. 2023-12-19T17:51:51.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.646+0000 7fcb0759e700 1 Processor -- start 2023-12-19T17:51:51.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.646+0000 7fcb0759e700 1 -- start start 2023-12-19T17:51:51.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb081e7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb081575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb08160970 0x7fcb08157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08158e30 con 0x7fcb0815ccf0 2023-12-19T17:51:51.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb081581b0 con 0x7fcb08160970 2023-12-19T17:51:51.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb08158490 con 0x7fcb080cd940 2023-12-19T17:51:51.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb081575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb081575f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36274/0 (socket says 172.21.15.45:36274) 2023-12-19T17:51:51.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 -- 172.21.15.45:0/1963650102 learned_addr learned my addr 172.21.15.45:0/1963650102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:51.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb06d9d700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb08160970 0x7fcb08157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb0659c700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb081e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 -- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 msgr2=0x7fcb081e7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb081e7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 -- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb08160970 msgr2=0x7fcb08157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb08160970 0x7fcb08157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 -- 172.21.15.45:0/1963650102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaf8009570 con 0x7fcb0815ccf0 2023-12-19T17:51:51.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcb05d9b700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb081575f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e760 tx=0x7fcafc00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:51.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.650+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc00c070 con 0x7fcb0815ccf0 2023-12-19T17:51:51.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.654+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc004250 con 0x7fcb0815ccf0 2023-12-19T17:51:51.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.654+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb08158770 con 0x7fcb0815ccf0 2023-12-19T17:51:51.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.654+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcafc0036c0 con 0x7fcb0815ccf0 2023-12-19T17:51:51.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.654+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb081517a0 con 0x7fcb0815ccf0 2023-12-19T17:51:51.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.654+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb08158f70 con 0x7fcb0815ccf0 2023-12-19T17:51:51.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.654+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcafc003820 con 0x7fcb0815ccf0 2023-12-19T17:51:51.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.658+0000 7fcaf6ffd700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcae8065ad0 0x7fcae8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:51.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.658+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcafc0831c0 con 0x7fcb0815ccf0 2023-12-19T17:51:51.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.658+0000 7fcb0659c700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcae8065ad0 0x7fcae8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:51.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.658+0000 7fcb0659c700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcae8065ad0 0x7fcae8067f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8000c00 tx=0x7fcaf8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:51.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.666+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcb08158f70 con 0x7fcb0815ccf0 2023-12-19T17:51:51.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.842+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb08158f70 con 0x7fcb0815ccf0 2023-12-19T17:51:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.842+0000 7fcaf6ffd700 1 -- 172.21.15.45:0/1963650102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb08158f70 con 0x7fcb0815ccf0 2023-12-19T17:51:51.845 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcae8065ad0 msgr2=0x7fcae8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcae8065ad0 0x7fcae8067f90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcaf8000c00 tx=0x7fcaf8008030 comp rx=0 tx=0).stop 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 msgr2=0x7fcb081575f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb081575f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00e760 tx=0x7fcafc00ea70 comp rx=0 tx=0).stop 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 shutdown_connections 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcae8065ad0 0x7fcae8067f90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb08160970 0x7fcb08157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb0815ccf0 0x7fcb081575f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 --2- 172.21.15.45:0/1963650102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb080cd940 0x7fcb081e7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 >> 172.21.15.45:0/1963650102 conn(0x7fcb080b46f0 msgr2=0x7fcb0815d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 shutdown_connections 2023-12-19T17:51:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:51.846+0000 7fcb0759e700 1 -- 172.21.15.45:0/1963650102 wait complete. 2023-12-19T17:51:51.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:51:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.066+0000 7f9598842700 1 Processor -- start 2023-12-19T17:51:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.066+0000 7f9598842700 1 -- start start 2023-12-19T17:51:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9598842700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95941443e0 0x7f95940713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9598842700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9594071d70 con 0x7f9594071910 2023-12-19T17:51:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9598842700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95940cbe40 con 0x7f95940cba10 2023-12-19T17:51:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9598842700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95940b1b80 con 0x7f95941443e0 2023-12-19T17:51:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9592d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95941443e0 0x7f95940713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f958bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9594071910 0x7f95940cb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45166/0 (socket says 172.21.15.45:45166) 2023-12-19T17:51:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f958bfff700 1 -- 172.21.15.45:0/608315169 learned_addr learned my addr 172.21.15.45:0/608315169 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9592d9d700 1 -- 172.21.15.45:0/608315169 >> v1:172.21.15.73:6789/0 conn(0x7f95940cba10 legacy=0x7f95940b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9592d9d700 1 -- 172.21.15.45:0/608315169 >> v1:172.21.15.45:6789/0 conn(0x7f9594071910 legacy=0x7f95940cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f959259c700 1 -- 172.21.15.45:0/608315169 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231907140 0 0) 0x7f9594071d70 con 0x7f9594071910 2023-12-19T17:51:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9592d9d700 1 -- 172.21.15.45:0/608315169 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95941447c0 con 0x7f95941443e0 2023-12-19T17:51:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f9592d9d700 1 --2- 172.21.15.45:0/608315169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95941443e0 0x7f95940713d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9584009840 tx=0x7f9584009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20800996ea23136 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f959259c700 1 -- 172.21.15.45:0/608315169 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9584005e50 con 0x7f95941443e0 2023-12-19T17:51:52.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f959259c700 1 -- 172.21.15.45:0/608315169 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9584006030 con 0x7f95941443e0 2023-12-19T17:51:52.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.070+0000 7f959259c700 1 -- 172.21.15.45:0/608315169 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95840063c0 con 0x7f95941443e0 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 -- 172.21.15.45:0/608315169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95941443e0 msgr2=0x7f95940713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 --2- 172.21.15.45:0/608315169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95941443e0 0x7f95940713d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9584009840 tx=0x7f9584009b50 comp rx=0 tx=0).stop 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 -- 172.21.15.45:0/608315169 shutdown_connections 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 --2- 172.21.15.45:0/608315169 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95941443e0 0x7f95940713d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 -- 172.21.15.45:0/608315169 >> 172.21.15.45:0/608315169 conn(0x7f95940cf5a0 msgr2=0x7f9594070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 -- 172.21.15.45:0/608315169 shutdown_connections 2023-12-19T17:51:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 -- 172.21.15.45:0/608315169 wait complete. 2023-12-19T17:51:52.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 Processor -- start 2023-12-19T17:51:52.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.074+0000 7f9598842700 1 -- start start 2023-12-19T17:51:52.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940cba10 0x7f959413a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95941443e0 0x7f95940b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 0x7f95940b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95941f6300 con 0x7f9594152060 2023-12-19T17:51:52.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95941f65e0 con 0x7f95940cba10 2023-12-19T17:51:52.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95941f68c0 con 0x7f95941443e0 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 0x7f95940b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 0x7f95940b2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36292/0 (socket says 172.21.15.45:36292) 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 -- 172.21.15.45:0/1862820567 learned_addr learned my addr 172.21.15.45:0/1862820567 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9592d9d700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940cba10 0x7f959413a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f958bfff700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95941443e0 0x7f95940b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 -- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95941443e0 msgr2=0x7f95940b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95941443e0 0x7f95940b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 -- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940cba10 msgr2=0x7f959413a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940cba10 0x7f959413a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 -- 172.21.15.45:0/1862820567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9584009450 con 0x7f9594152060 2023-12-19T17:51:52.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f959359e700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 0x7f95940b2f60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f958c00cb90 tx=0x7f958c00cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c003c70 con 0x7f9594152060 2023-12-19T17:51:52.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c003df0 con 0x7f9594152060 2023-12-19T17:51:52.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95941f6ba0 con 0x7f9594152060 2023-12-19T17:51:52.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c00aae0 con 0x7f9594152060 2023-12-19T17:51:52.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.078+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9594152840 con 0x7f9594152060 2023-12-19T17:51:52.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.082+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f959413b420 con 0x7f9594152060 2023-12-19T17:51:52.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.082+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f958c00ac40 con 0x7f9594152060 2023-12-19T17:51:52.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.086+0000 7f958b7fe700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9574065ad0 0x7f9574067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.086+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f958c083510 con 0x7f9594152060 2023-12-19T17:51:52.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.086+0000 7f9592d9d700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9574065ad0 0x7f9574067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.086+0000 7f9592d9d700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9574065ad0 0x7f9574067f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9584013040 tx=0x7f9584008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.090+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f959413b420 con 0x7f9594152060 2023-12-19T17:51:52.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.270+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f959413b420 con 0x7f9594152060 2023-12-19T17:51:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.270+0000 7f958b7fe700 1 -- 172.21.15.45:0/1862820567 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f959413b420 con 0x7f9594152060 2023-12-19T17:51:52.273 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9574065ad0 msgr2=0x7f9574067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9574065ad0 0x7f9574067f90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9584013040 tx=0x7f9584008070 comp rx=0 tx=0).stop 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 msgr2=0x7f95940b2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 0x7f95940b2f60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f958c00cb90 tx=0x7f958c00cea0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 shutdown_connections 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9574065ad0 0x7f9574067f90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9594152060 0x7f95940b2f60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f95941443e0 0x7f95940b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 --2- 172.21.15.45:0/1862820567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940cba10 0x7f959413a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 >> 172.21.15.45:0/1862820567 conn(0x7f9594071910 msgr2=0x7f95940b2010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 shutdown_connections 2023-12-19T17:51:52.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.274+0000 7f9598842700 1 -- 172.21.15.45:0/1862820567 wait complete. 2023-12-19T17:51:52.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:51:52.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.474+0000 7f8615313700 1 Processor -- start 2023-12-19T17:51:52.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.474+0000 7f8615313700 1 -- start start 2023-12-19T17:51:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f8615313700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f86100b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f8615313700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86100b5f70 0x7f86100b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f8615313700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86100b5260 con 0x7f861015d0a0 2023-12-19T17:51:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f8615313700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86100d1960 con 0x7f86100b5f70 2023-12-19T17:51:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f8615313700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86100d1c40 con 0x7f86100b48c0 2023-12-19T17:51:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f86067fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f86100b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f860effd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f861015d0a0 0x7f86100d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:52796/0 (socket says 172.21.15.45:52796) 2023-12-19T17:51:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f860effd700 1 -- 172.21.15.45:0/1729181548 learned_addr learned my addr 172.21.15.45:0/1729181548 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f860f7fe700 1 --2- 172.21.15.45:0/1729181548 >> v2:172.21.15.73:3300/0 conn(0x7f86100b5f70 0x7f86100b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f86067fc700 1 -- 172.21.15.45:0/1729181548 >> v2:172.21.15.73:3300/0 conn(0x7f86100b5f70 msgr2=0x7f86100b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f86067fc700 1 --2- 172.21.15.45:0/1729181548 >> v2:172.21.15.73:3300/0 conn(0x7f86100b5f70 0x7f86100b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f86067fc700 1 -- 172.21.15.45:0/1729181548 >> v1:172.21.15.73:6789/0 conn(0x7f861015d0a0 legacy=0x7f86100d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f86067fc700 1 -- 172.21.15.45:0/1729181548 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86100d1f20 con 0x7f86100b48c0 2023-12-19T17:51:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f86067fc700 1 --2- 172.21.15.45:0/1729181548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f86100b4d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009850 tx=0x7f85f8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46cb7b7d1703f859 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f860e7fc700 1 -- 172.21.15.45:0/1729181548 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8011830 con 0x7f86100b48c0 2023-12-19T17:51:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f860e7fc700 1 -- 172.21.15.45:0/1729181548 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f8011990 con 0x7f86100b48c0 2023-12-19T17:51:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.478+0000 7f860e7fc700 1 -- 172.21.15.45:0/1729181548 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f8011d40 con 0x7f86100b48c0 2023-12-19T17:51:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 -- 172.21.15.45:0/1729181548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 msgr2=0x7f86100b4d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 --2- 172.21.15.45:0/1729181548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f86100b4d20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f85f8009850 tx=0x7f85f8009b60 comp rx=0 tx=0).stop 2023-12-19T17:51:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 -- 172.21.15.45:0/1729181548 shutdown_connections 2023-12-19T17:51:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 --2- 172.21.15.45:0/1729181548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f86100b4d20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 --2- 172.21.15.45:0/1729181548 >> v2:172.21.15.73:3300/0 conn(0x7f86100b5f70 0x7f86100b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 -- 172.21.15.45:0/1729181548 >> 172.21.15.45:0/1729181548 conn(0x7f86100cf8c0 msgr2=0x7f86100cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:52.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 -- 172.21.15.45:0/1729181548 shutdown_connections 2023-12-19T17:51:52.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 -- 172.21.15.45:0/1729181548 wait complete. 2023-12-19T17:51:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.482+0000 7f8615313700 1 Processor -- start 2023-12-19T17:51:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 -- start start 2023-12-19T17:51:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f861015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86100b5f70 0x7f861015f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 0x7f86101e8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861015db00 con 0x7f861015d0a0 2023-12-19T17:51:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861015f980 con 0x7f86100b5f70 2023-12-19T17:51:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8615313700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8610151be0 con 0x7f86100b48c0 2023-12-19T17:51:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 0x7f86101e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 0x7f86101e8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36294/0 (socket says 172.21.15.45:36294) 2023-12-19T17:51:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 -- 172.21.15.45:0/379276508 learned_addr learned my addr 172.21.15.45:0/379276508 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f86067fc700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86100b5f70 0x7f861015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860effd700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f861015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 -- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 msgr2=0x7f861015d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f861015d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 -- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86100b5f70 msgr2=0x7f861015f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86100b5f70 0x7f861015f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 -- 172.21.15.45:0/379276508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80094b0 con 0x7f861015d0a0 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f86067fc700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86100b5f70 0x7f861015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:51:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f860f7fe700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 0x7f86101e8660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f860800eb60 tx=0x7f860800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.486+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8608009740 con 0x7f861015d0a0 2023-12-19T17:51:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.490+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8608009e00 con 0x7f861015d0a0 2023-12-19T17:51:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.490+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8610151ec0 con 0x7f861015d0a0 2023-12-19T17:51:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.490+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860800ca70 con 0x7f861015d0a0 2023-12-19T17:51:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.490+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8610152480 con 0x7f861015d0a0 2023-12-19T17:51:52.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.490+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861004ed30 con 0x7f861015d0a0 2023-12-19T17:51:52.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.490+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f860800cbd0 con 0x7f861015d0a0 2023-12-19T17:51:52.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.494+0000 7f8607fff700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85f0065ad0 0x7f85f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.494+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86080833e0 con 0x7f861015d0a0 2023-12-19T17:51:52.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.494+0000 7f860effd700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85f0065ad0 0x7f85f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.494+0000 7f860effd700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85f0065ad0 0x7f85f0067f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8600005cb0 tx=0x7f8600009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.498+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8608050aa0 con 0x7f861015d0a0 2023-12-19T17:51:52.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.674+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86100b8a80 con 0x7f861015d0a0 2023-12-19T17:51:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.678+0000 7f8607fff700 1 -- 172.21.15.45:0/379276508 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f86080540c0 con 0x7f861015d0a0 2023-12-19T17:51:52.680 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85f0065ad0 msgr2=0x7f85f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85f0065ad0 0x7f85f0067f90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8600005cb0 tx=0x7f8600009040 comp rx=0 tx=0).stop 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 msgr2=0x7f86101e8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 0x7f86101e8660 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f860800eb60 tx=0x7f860800ee70 comp rx=0 tx=0).stop 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 shutdown_connections 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f85f0065ad0 0x7f85f0067f90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f861015d0a0 0x7f86101e8660 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86100b5f70 0x7f861015f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 --2- 172.21.15.45:0/379276508 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86100b48c0 0x7f861015d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 >> 172.21.15.45:0/379276508 conn(0x7f86100cf8c0 msgr2=0x7f861015c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 shutdown_connections 2023-12-19T17:51:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.682+0000 7f8615313700 1 -- 172.21.15.45:0/379276508 wait complete. 2023-12-19T17:51:52.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:51:52.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.886+0000 7f0f8759e700 1 Processor -- start 2023-12-19T17:51:52.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.886+0000 7f0f8759e700 1 -- start start 2023-12-19T17:51:52.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f8806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f8806f3b0 0x7f0f8806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f880d1820 con 0x7f0f8806ea90 2023-12-19T17:51:52.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f880d1630 con 0x7f0f8806f3b0 2023-12-19T17:51:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880d1b00 con 0x7f0f880b88b0 2023-12-19T17:51:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f86d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f8806f3b0 0x7f0f8806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8659c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0f8806ea90 0x7f0f880d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:52810/0 (socket says 172.21.15.45:52810) 2023-12-19T17:51:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8659c700 1 -- 172.21.15.45:0/388570234 learned_addr learned my addr 172.21.15.45:0/388570234 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f85d9b700 1 --2- 172.21.15.45:0/388570234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f8806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f86d9d700 1 -- 172.21.15.45:0/388570234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 msgr2=0x7f0f8806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f86d9d700 1 --2- 172.21.15.45:0/388570234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f8806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f86d9d700 1 -- 172.21.15.45:0/388570234 >> v1:172.21.15.73:6789/0 conn(0x7f0f8806ea90 legacy=0x7f0f880d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f86d9d700 1 -- 172.21.15.45:0/388570234 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f880d1de0 con 0x7f0f8806f3b0 2023-12-19T17:51:52.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.890+0000 7f0f8559a700 1 -- 172.21.15.45:0/388570234 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747302720 0 0) 0x7f0f880d1820 con 0x7f0f8806ea90 2023-12-19T17:51:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f86d9d700 1 --2- 172.21.15.45:0/388570234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f8806f840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f8000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec7276326b95c6c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8559a700 1 -- 172.21.15.45:0/388570234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8000e070 con 0x7f0f8806f3b0 2023-12-19T17:51:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8559a700 1 -- 172.21.15.45:0/388570234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8000bb20 con 0x7f0f8806f3b0 2023-12-19T17:51:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8559a700 1 -- 172.21.15.45:0/388570234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f80012430 con 0x7f0f8806f3b0 2023-12-19T17:51:52.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 -- 172.21.15.45:0/388570234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 msgr2=0x7f0f8806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 --2- 172.21.15.45:0/388570234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f8806f840 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f80009d90 tx=0x7f0f8000b330 comp rx=0 tx=0).stop 2023-12-19T17:51:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 -- 172.21.15.45:0/388570234 shutdown_connections 2023-12-19T17:51:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 --2- 172.21.15.45:0/388570234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f8806f840 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 --2- 172.21.15.45:0/388570234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f8806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 -- 172.21.15.45:0/388570234 >> 172.21.15.45:0/388570234 conn(0x7f0f880b46d0 msgr2=0x7f0f880b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 -- 172.21.15.45:0/388570234 shutdown_connections 2023-12-19T17:51:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.894+0000 7f0f8759e700 1 -- 172.21.15.45:0/388570234 wait complete. 2023-12-19T17:51:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 Processor -- start 2023-12-19T17:51:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 -- start start 2023-12-19T17:51:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f8806ea90 0x7f0f8815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f880b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f880b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f881f32f0 con 0x7f0f8806f3b0 2023-12-19T17:51:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880c8650 con 0x7f0f8806ea90 2023-12-19T17:51:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f880c8930 con 0x7f0f880b88b0 2023-12-19T17:51:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f880b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f85d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f880b0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:36326/0 (socket says 172.21.15.45:36326) 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f85d9b700 1 -- 172.21.15.45:0/2745546988 learned_addr learned my addr 172.21.15.45:0/2745546988 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f8659c700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f8806ea90 0x7f0f8815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.898+0000 7f0f86d9d700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f880b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f85d9b700 1 -- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 msgr2=0x7f0f880b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f85d9b700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f880b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f85d9b700 1 -- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f8806ea90 msgr2=0x7f0f8815d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f85d9b700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f8806ea90 0x7f0f8815d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f85d9b700 1 -- 172.21.15.45:0/2745546988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f80009a70 con 0x7f0f8806f3b0 2023-12-19T17:51:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f85d9b700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f880b0630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e840 tx=0x7f0f7c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0095a0 con 0x7f0f8806f3b0 2023-12-19T17:51:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7c013680 con 0x7f0f8806f3b0 2023-12-19T17:51:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7c0139f0 con 0x7f0f8806f3b0 2023-12-19T17:51:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f880c8c10 con 0x7f0f8806f3b0 2023-12-19T17:51:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8815d960 con 0x7f0f8806f3b0 2023-12-19T17:51:52.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.902+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f8815db50 con 0x7f0f8806f3b0 2023-12-19T17:51:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.906+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f7c013b50 con 0x7f0f8806f3b0 2023-12-19T17:51:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.906+0000 7f0f76ffd700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f68065ad0 0x7f0f68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.906+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f7c083340 con 0x7f0f8806f3b0 2023-12-19T17:51:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.910+0000 7f0f8659c700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f68065ad0 0x7f0f68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:52.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.910+0000 7f0f8659c700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f68065ad0 0x7f0f68067f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f78000f60 tx=0x7f0f78007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:52.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:52.914+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f7c050970 con 0x7f0f8806f3b0 2023-12-19T17:51:53.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.106+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0f88067760 con 0x7f0f8806f3b0 2023-12-19T17:51:53.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.106+0000 7f0f76ffd700 1 -- 172.21.15.45:0/2745546988 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0f7c053f90 con 0x7f0f8806f3b0 2023-12-19T17:51:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.110+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f68065ad0 msgr2=0x7f0f68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.110+0000 7f0f8759e700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f68065ad0 0x7f0f68067f90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0f78000f60 tx=0x7f0f78007e90 comp rx=0 tx=0).stop 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.110+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 msgr2=0x7f0f880b0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.110+0000 7f0f8759e700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f880b0630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0f7c00e840 tx=0x7f0f7c00eb50 comp rx=0 tx=0).stop 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 shutdown_connections 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f68065ad0 0x7f0f68067f90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f880b88b0 0x7f0f880b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f8806f3b0 0x7f0f880b0630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 --2- 172.21.15.45:0/2745546988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f8806ea90 0x7f0f8815d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 >> 172.21.15.45:0/2745546988 conn(0x7f0f880b46d0 msgr2=0x7f0f88071500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 shutdown_connections 2023-12-19T17:51:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:53.114+0000 7f0f8759e700 1 -- 172.21.15.45:0/2745546988 wait complete. 2023-12-19T17:51:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:51:53.137 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:51:53.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:53.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-19T17:51:53.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi045.stderr:ceph-fuse[41170]: fuse finished with error 0 and tester_r 0 2023-12-19T17:51:53.261 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:51:59.363 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:51:59.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:51:59.363 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-19T17:51:59.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:51:59.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.614+0000 7f86cf59e700 1 Processor -- start 2023-12-19T17:51:59.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.614+0000 7f86cf59e700 1 -- start start 2023-12-19T17:51:59.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cf59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86d015ae20 0x7f86d015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:59.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cf59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d00af720 0x7f86d00afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cf59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86d006f0a0 con 0x7f86d006cad0 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cf59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86d00b0110 con 0x7f86d015ae20 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cf59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d006ea90 con 0x7f86d00af720 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86c5d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f86d006cad0 0x7f86d00c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59156/0 (socket says 172.21.15.45:59156) 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86c5d9b700 1 -- 172.21.15.45:0/1108298577 learned_addr learned my addr 172.21.15.45:0/1108298577 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86ce59c700 1 --2- 172.21.15.45:0/1108298577 >> v2:172.21.15.73:3300/0 conn(0x7f86d015ae20 0x7f86d015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86ced9d700 1 --2- 172.21.15.45:0/1108298577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d00af720 0x7f86d00afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cdd9b700 1 -- 172.21.15.45:0/1108298577 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2350355841 0 0) 0x7f86d006f0a0 con 0x7f86d006cad0 2023-12-19T17:51:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86cdd9b700 1 -- 172.21.15.45:0/1108298577 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86bc0035d0 con 0x7f86d006cad0 2023-12-19T17:51:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86ced9d700 1 -- 172.21.15.45:0/1108298577 >> v2:172.21.15.73:3300/0 conn(0x7f86d015ae20 msgr2=0x7f86d015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:51:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86ced9d700 1 --2- 172.21.15.45:0/1108298577 >> v2:172.21.15.73:3300/0 conn(0x7f86d015ae20 0x7f86d015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86ced9d700 1 -- 172.21.15.45:0/1108298577 >> v1:172.21.15.45:6789/0 conn(0x7f86d006cad0 legacy=0x7f86d00c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.618+0000 7f86ced9d700 1 -- 172.21.15.45:0/1108298577 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d00c3f60 con 0x7f86d00af720 2023-12-19T17:51:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86ced9d700 1 --2- 172.21.15.45:0/1108298577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d00af720 0x7f86d00afbd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009d90 tx=0x7f86c800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c387d5538770bdb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cdd9b700 1 -- 172.21.15.45:0/1108298577 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c800e070 con 0x7f86d00af720 2023-12-19T17:51:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cdd9b700 1 -- 172.21.15.45:0/1108298577 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c800bb20 con 0x7f86d00af720 2023-12-19T17:51:59.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cdd9b700 1 -- 172.21.15.45:0/1108298577 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c8012430 con 0x7f86d00af720 2023-12-19T17:51:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 -- 172.21.15.45:0/1108298577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d00af720 msgr2=0x7f86d00afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:59.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1108298577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d00af720 0x7f86d00afbd0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86c8009d90 tx=0x7f86c800b330 comp rx=0 tx=0).stop 2023-12-19T17:51:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 -- 172.21.15.45:0/1108298577 shutdown_connections 2023-12-19T17:51:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1108298577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d00af720 0x7f86d00afbd0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1108298577 >> v2:172.21.15.73:3300/0 conn(0x7f86d015ae20 0x7f86d015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 -- 172.21.15.45:0/1108298577 >> 172.21.15.45:0/1108298577 conn(0x7f86d00cb900 msgr2=0x7f86d00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 -- 172.21.15.45:0/1108298577 shutdown_connections 2023-12-19T17:51:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.622+0000 7f86cf59e700 1 -- 172.21.15.45:0/1108298577 wait complete. 2023-12-19T17:51:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 Processor -- start 2023-12-19T17:51:59.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 -- start start 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d006cad0 0x7f86d014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 0x7f86d00ca1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d015ae20 0x7f86d015d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00af1b0 con 0x7f86d00af720 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00ca820 con 0x7f86d006cad0 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86cf59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86d00cab00 con 0x7f86d015ae20 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86c5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 0x7f86d00ca1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86c5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 0x7f86d00ca1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37752/0 (socket says 172.21.15.45:37752) 2023-12-19T17:51:59.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86c5d9b700 1 -- 172.21.15.45:0/1779726880 learned_addr learned my addr 172.21.15.45:0/1779726880 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:51:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86ced9d700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d015ae20 0x7f86d015d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:59.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.626+0000 7f86ce59c700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d006cad0 0x7f86d014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c5d9b700 1 -- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d015ae20 msgr2=0x7f86d015d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c5d9b700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d015ae20 0x7f86d015d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c5d9b700 1 -- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d006cad0 msgr2=0x7f86d014b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c5d9b700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d006cad0 0x7f86d014b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c5d9b700 1 -- 172.21.15.45:0/1779726880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8009a70 con 0x7f86d00af720 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86ce59c700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d006cad0 0x7f86d014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c5d9b700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 0x7f86d00ca1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005930 tx=0x7f86c000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0005d90 con 0x7f86d00af720 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00070d0 con 0x7f86d00af720 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d00cade0 con 0x7f86d00af720 2023-12-19T17:51:59.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0007480 con 0x7f86d00af720 2023-12-19T17:51:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d00c9190 con 0x7f86d00af720 2023-12-19T17:51:59.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.630+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d00c9380 con 0x7f86d00af720 2023-12-19T17:51:59.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.634+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f86c00075e0 con 0x7f86d00af720 2023-12-19T17:51:59.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.634+0000 7f86c77fe700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f86b0065ad0 0x7f86b0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:51:59.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.634+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f86c0082a60 con 0x7f86d00af720 2023-12-19T17:51:59.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.634+0000 7f86ce59c700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f86b0065ad0 0x7f86b0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:51:59.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.638+0000 7f86ce59c700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f86b0065ad0 0x7f86b0067f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ba0 tx=0x7f86b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:51:59.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.642+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f86c0050000 con 0x7f86d00af720 2023-12-19T17:51:59.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.818+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86d0067760 con 0x7f86d00af720 2023-12-19T17:51:59.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.822+0000 7f86c77fe700 1 -- 172.21.15.45:0/1779726880 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f86c0017070 con 0x7f86d00af720 2023-12-19T17:51:59.826 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:51:59.826 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:51:59.827 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:51:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f86b0065ad0 msgr2=0x7f86b0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:59.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f86b0065ad0 0x7f86b0067f90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ba0 tx=0x7f86b8008040 comp rx=0 tx=0).stop 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 msgr2=0x7f86d00ca1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 0x7f86d00ca1d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f86c0005930 tx=0x7f86c000c9e0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 shutdown_connections 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f86b0065ad0 0x7f86b0067f90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86d015ae20 0x7f86d015d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f86d00af720 0x7f86d00ca1d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 --2- 172.21.15.45:0/1779726880 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86d006cad0 0x7f86d014b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 >> 172.21.15.45:0/1779726880 conn(0x7f86d00cb900 msgr2=0x7f86d00cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 shutdown_connections 2023-12-19T17:51:59.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:51:59.826+0000 7f86cf59e700 1 -- 172.21.15.45:0/1779726880 wait complete. 2023-12-19T17:51:59.835 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:51:59.853 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:00.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.114+0000 7faca0a0a700 1 Processor -- start 2023-12-19T17:52:00.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.114+0000 7faca0a0a700 1 -- start start 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7faca0a0a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac9c15ab50 0x7fac9c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7faca0a0a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fac9c06e0a0 0x7fac9c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7faca0a0a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac9c06cbb0 con 0x7fac9c15af30 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7faca0a0a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c06fa10 con 0x7fac9c15ab50 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7faca0a0a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac9c06fcf0 con 0x7fac9c06e0a0 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac9c15ab50 0x7fac9c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac9c15ab50 0x7fac9c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37758/0 (socket says 172.21.15.45:37758) 2023-12-19T17:52:00.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 -- 172.21.15.45:0/2807562573 learned_addr learned my addr 172.21.15.45:0/2807562573 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9ad9d700 1 --2- 172.21.15.45:0/2807562573 >> v2:172.21.15.73:3300/0 conn(0x7fac9c06e0a0 0x7fac9c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 -- 172.21.15.45:0/2807562573 >> v2:172.21.15.73:3300/0 conn(0x7fac9c06e0a0 msgr2=0x7fac9c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 --2- 172.21.15.45:0/2807562573 >> v2:172.21.15.73:3300/0 conn(0x7fac9c06e0a0 0x7fac9c0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 -- 172.21.15.45:0/2807562573 >> v1:172.21.15.73:6789/0 conn(0x7fac9c15af30 legacy=0x7fac9c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 -- 172.21.15.45:0/2807562573 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac9c06ffd0 con 0x7fac9c15ab50 2023-12-19T17:52:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac9a59c700 1 --2- 172.21.15.45:0/2807562573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c15ab50 0x7fac9c0ccd70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0cf250 tx=0x7fac8c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9240373ba2d5cb42 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac99d9b700 1 -- 172.21.15.45:0/2807562573 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00b8a0 con 0x7fac9c15ab50 2023-12-19T17:52:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac99d9b700 1 -- 172.21.15.45:0/2807562573 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c00ba00 con 0x7fac9c15ab50 2023-12-19T17:52:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.118+0000 7fac99d9b700 1 -- 172.21.15.45:0/2807562573 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00bd90 con 0x7fac9c15ab50 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 -- 172.21.15.45:0/2807562573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c15ab50 msgr2=0x7fac9c0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 --2- 172.21.15.45:0/2807562573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c15ab50 0x7fac9c0ccd70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0cf250 tx=0x7fac8c009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 -- 172.21.15.45:0/2807562573 shutdown_connections 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 --2- 172.21.15.45:0/2807562573 >> v2:172.21.15.73:3300/0 conn(0x7fac9c06e0a0 0x7fac9c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 --2- 172.21.15.45:0/2807562573 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c15ab50 0x7fac9c0ccd70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 -- 172.21.15.45:0/2807562573 >> 172.21.15.45:0/2807562573 conn(0x7fac9c0cba40 msgr2=0x7fac9c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 -- 172.21.15.45:0/2807562573 shutdown_connections 2023-12-19T17:52:00.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 -- 172.21.15.45:0/2807562573 wait complete. 2023-12-19T17:52:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 Processor -- start 2023-12-19T17:52:00.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.122+0000 7faca0a0a700 1 -- start start 2023-12-19T17:52:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 0x7fac9c0c7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac9c15ab50 0x7fac9c159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac9c15af30 0x7fac9c1531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0c7f70 con 0x7fac9c06e0a0 2023-12-19T17:52:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0c6990 con 0x7fac9c15af30 2023-12-19T17:52:00.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9c0c6c70 con 0x7fac9c15ab50 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 0x7fac9c0c7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 0x7fac9c0c7a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37762/0 (socket says 172.21.15.45:37762) 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 -- 172.21.15.45:0/4243227952 learned_addr learned my addr 172.21.15.45:0/4243227952 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac91d9b700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac9c15ab50 0x7fac9c159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9ad9d700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac9c15af30 0x7fac9c1531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 -- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac9c15ab50 msgr2=0x7fac9c159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac9c15ab50 0x7fac9c159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 -- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac9c15af30 msgr2=0x7fac9c1531a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac9c15af30 0x7fac9c1531a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 -- 172.21.15.45:0/4243227952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c009570 con 0x7fac9c06e0a0 2023-12-19T17:52:00.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9ad9d700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac9c15af30 0x7fac9c1531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac9a59c700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 0x7fac9c0c7a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0b1660 tx=0x7fac8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0038c0 con 0x7fac9c06e0a0 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac8c01f070 con 0x7fac9c06e0a0 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac9c0c6f50 con 0x7fac9c06e0a0 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac8c003c60 con 0x7fac9c06e0a0 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.126+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac9c0c7510 con 0x7fac9c06e0a0 2023-12-19T17:52:00.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.130+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac9c0c80e0 con 0x7fac9c06e0a0 2023-12-19T17:52:00.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.130+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac8c026480 con 0x7fac9c06e0a0 2023-12-19T17:52:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.130+0000 7fac937fe700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac7c065ad0 0x7fac7c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.130+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac8c021070 con 0x7fac9c06e0a0 2023-12-19T17:52:00.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.130+0000 7fac91d9b700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac7c065ad0 0x7fac7c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.134+0000 7fac91d9b700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac7c065ad0 0x7fac7c067f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0c5460 tx=0x7fac84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:00.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.138+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac8c0526d0 con 0x7fac9c06e0a0 2023-12-19T17:52:00.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.314+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac9c04ed30 con 0x7fac9c06e0a0 2023-12-19T17:52:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.318+0000 7fac937fe700 1 -- 172.21.15.45:0/4243227952 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7fac8c055cf0 con 0x7fac9c06e0a0 2023-12-19T17:52:00.321 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:00.321 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac7c065ad0 msgr2=0x7fac7c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac7c065ad0 0x7fac7c067f90 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0c5460 tx=0x7fac84009040 comp rx=0 tx=0).stop 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 msgr2=0x7fac9c0c7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 0x7fac9c0c7a30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fac9c0b1660 tx=0x7fac8c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 shutdown_connections 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac7c065ad0 0x7fac7c067f90 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac9c15af30 0x7fac9c1531a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac9c15ab50 0x7fac9c159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 --2- 172.21.15.45:0/4243227952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac9c06e0a0 0x7fac9c0c7a30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 >> 172.21.15.45:0/4243227952 conn(0x7fac9c0cba40 msgr2=0x7fac9c0ca3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 shutdown_connections 2023-12-19T17:52:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.322+0000 7faca0a0a700 1 -- 172.21.15.45:0/4243227952 wait complete. 2023-12-19T17:52:00.351 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T17:52:00.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.542+0000 7fa43edd5700 1 Processor -- start 2023-12-19T17:52:00.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.542+0000 7fa43edd5700 1 -- start start 2023-12-19T17:52:00.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43edd5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4380b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43edd5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa4380713d0 0x7fa438071820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43edd5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa438071d60 con 0x7fa4380b3a30 2023-12-19T17:52:00.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43edd5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4380b1f20 con 0x7fa4380713d0 2023-12-19T17:52:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43edd5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4380b28f0 con 0x7fa43815cf00 2023-12-19T17:52:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43d5d2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa4380b3a30 0x7fa4380acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59166/0 (socket says 172.21.15.45:59166) 2023-12-19T17:52:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43ddd3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4380b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43d5d2700 1 -- 172.21.15.45:0/1218202280 learned_addr learned my addr 172.21.15.45:0/1218202280 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43e5d4700 1 --2- 172.21.15.45:0/1218202280 >> v2:172.21.15.73:3300/0 conn(0x7fa4380713d0 0x7fa438071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43e5d4700 1 -- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 msgr2=0x7fa4380b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:00.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43e5d4700 1 --2- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4380b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43e5d4700 1 -- 172.21.15.45:0/1218202280 >> v1:172.21.15.45:6789/0 conn(0x7fa4380b3a30 legacy=0x7fa4380acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43e5d4700 1 -- 172.21.15.45:0/1218202280 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4380ad8b0 con 0x7fa4380713d0 2023-12-19T17:52:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43e5d4700 1 --2- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380713d0 0x7fa438071820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa430009d90 tx=0x7fa43000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d908c472b913115b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43cdd1700 1 -- 172.21.15.45:0/1218202280 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43000e070 con 0x7fa4380713d0 2023-12-19T17:52:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43cdd1700 1 -- 172.21.15.45:0/1218202280 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43000bb20 con 0x7fa4380713d0 2023-12-19T17:52:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.546+0000 7fa43cdd1700 1 -- 172.21.15.45:0/1218202280 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430012430 con 0x7fa4380713d0 2023-12-19T17:52:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 -- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380713d0 msgr2=0x7fa438071820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 --2- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380713d0 0x7fa438071820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa430009d90 tx=0x7fa43000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 -- 172.21.15.45:0/1218202280 shutdown_connections 2023-12-19T17:52:00.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 --2- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380713d0 0x7fa438071820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 --2- 172.21.15.45:0/1218202280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4380b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 -- 172.21.15.45:0/1218202280 >> 172.21.15.45:0/1218202280 conn(0x7fa4380cf5a0 msgr2=0x7fa438070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:00.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 -- 172.21.15.45:0/1218202280 shutdown_connections 2023-12-19T17:52:00.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.550+0000 7fa43edd5700 1 -- 172.21.15.45:0/1218202280 wait complete. 2023-12-19T17:52:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 Processor -- start 2023-12-19T17:52:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 -- start start 2023-12-19T17:52:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b3a30 0x7fa43815e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4381516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 0x7fa4381522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43815e450 con 0x7fa438151e40 2023-12-19T17:52:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa438151bf0 con 0x7fa4380b3a30 2023-12-19T17:52:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43edd5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43815fe60 con 0x7fa43815cf00 2023-12-19T17:52:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 0x7fa4381522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 0x7fa4381522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37766/0 (socket says 172.21.15.45:37766) 2023-12-19T17:52:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 -- 172.21.15.45:0/3125136097 learned_addr learned my addr 172.21.15.45:0/3125136097 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43ddd3700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b3a30 0x7fa43815e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43d5d2700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4381516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 -- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 msgr2=0x7fa4381516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4381516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 -- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b3a30 msgr2=0x7fa43815e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b3a30 0x7fa43815e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.554+0000 7fa43e5d4700 1 -- 172.21.15.45:0/3125136097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009a70 con 0x7fa438151e40 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa43e5d4700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 0x7fa4381522c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa43000b370 tx=0x7fa430004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430012430 con 0x7fa438151e40 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430020070 con 0x7fa438151e40 2023-12-19T17:52:00.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa438160140 con 0x7fa438151e40 2023-12-19T17:52:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430004040 con 0x7fa438151e40 2023-12-19T17:52:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43815e070 con 0x7fa438151e40 2023-12-19T17:52:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.558+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43804ed30 con 0x7fa438151e40 2023-12-19T17:52:00.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.562+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa4300041a0 con 0x7fa438151e40 2023-12-19T17:52:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.562+0000 7fa42e7fc700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa41c065ad0 0x7fa41c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.562+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa430022070 con 0x7fa438151e40 2023-12-19T17:52:00.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.562+0000 7fa43ddd3700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa41c065ad0 0x7fa41c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:00.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.562+0000 7fa43ddd3700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa41c065ad0 0x7fa41c067f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa43806ccb0 tx=0x7fa4340091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.566+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa430052860 con 0x7fa438151e40 2023-12-19T17:52:00.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:00.786+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa438158440 con 0x7fa438151e40 2023-12-19T17:52:01.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.378+0000 7fa42e7fc700 1 -- 172.21.15.45:0/3125136097 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa43002c0b0 con 0x7fa438151e40 2023-12-19T17:52:01.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa41c065ad0 msgr2=0x7fa41c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:01.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa41c065ad0 0x7fa41c067f90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa43806ccb0 tx=0x7fa4340091c0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 msgr2=0x7fa4381522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:01.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 0x7fa4381522c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa43000b370 tx=0x7fa430004b40 comp rx=0 tx=0).stop 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 shutdown_connections 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa41c065ad0 0x7fa41c067f90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa438151e40 0x7fa4381522c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43815cf00 0x7fa4381516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 --2- 172.21.15.45:0/3125136097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4380b3a30 0x7fa43815e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 >> 172.21.15.45:0/3125136097 conn(0x7fa4380713d0 msgr2=0x7fa43806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 shutdown_connections 2023-12-19T17:52:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.382+0000 7fa43edd5700 1 -- 172.21.15.45:0/3125136097 wait complete. 2023-12-19T17:52:01.409 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-19T17:52:01.409 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T17:52:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 Processor -- start 2023-12-19T17:52:01.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 -- start start 2023-12-19T17:52:01.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9c815d1d0 0x7ff9c80b6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c80d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9c80cdb90 0x7ff9c80ce000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c80ce540 con 0x7ff9c80cdb90 2023-12-19T17:52:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c806ea90 con 0x7ff9c815d1d0 2023-12-19T17:52:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9cd789700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80d2a80 con 0x7ff9c80d1fc0 2023-12-19T17:52:01.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9c80cdb90 0x7ff9c80ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c6ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9c815d1d0 0x7ff9c80b6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9bffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c80d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff9c80cdb90 0x7ff9c80ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37776/0 (socket says 172.21.15.45:37776) 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 -- 172.21.15.45:0/969994258 learned_addr learned my addr 172.21.15.45:0/969994258 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 -- 172.21.15.45:0/969994258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 msgr2=0x7ff9c80d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 --2- 172.21.15.45:0/969994258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c80d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 -- 172.21.15.45:0/969994258 >> v2:172.21.15.73:3300/0 conn(0x7ff9c815d1d0 msgr2=0x7ff9c80b6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.598+0000 7ff9c77fe700 1 --2- 172.21.15.45:0/969994258 >> v2:172.21.15.73:3300/0 conn(0x7ff9c815d1d0 0x7ff9c80b6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9c77fe700 1 -- 172.21.15.45:0/969994258 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c806ece0 con 0x7ff9c80cdb90 2023-12-19T17:52:01.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9c77fe700 1 --2- 172.21.15.45:0/969994258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c80cdb90 0x7ff9c80ce000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8072d80 tx=0x7ff9c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e082eaa9e42104 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9c67fc700 1 -- 172.21.15.45:0/969994258 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000e070 con 0x7ff9c80cdb90 2023-12-19T17:52:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9c67fc700 1 -- 172.21.15.45:0/969994258 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c000b910 con 0x7ff9c80cdb90 2023-12-19T17:52:01.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9c67fc700 1 -- 172.21.15.45:0/969994258 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c000bcc0 con 0x7ff9c80cdb90 2023-12-19T17:52:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 -- 172.21.15.45:0/969994258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c80cdb90 msgr2=0x7ff9c80ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 --2- 172.21.15.45:0/969994258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c80cdb90 0x7ff9c80ce000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8072d80 tx=0x7ff9c000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:01.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 -- 172.21.15.45:0/969994258 shutdown_connections 2023-12-19T17:52:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 --2- 172.21.15.45:0/969994258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c80cdb90 0x7ff9c80ce000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 --2- 172.21.15.45:0/969994258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c80d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 --2- 172.21.15.45:0/969994258 >> v2:172.21.15.73:3300/0 conn(0x7ff9c815d1d0 0x7ff9c80b6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 -- 172.21.15.45:0/969994258 >> 172.21.15.45:0/969994258 conn(0x7ff9c80d2e50 msgr2=0x7ff9c80d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 -- 172.21.15.45:0/969994258 shutdown_connections 2023-12-19T17:52:01.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.602+0000 7ff9cd789700 1 -- 172.21.15.45:0/969994258 wait complete. 2023-12-19T17:52:01.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 Processor -- start 2023-12-19T17:52:01.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 -- start start 2023-12-19T17:52:01.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9c80cdb90 0x7ff9c8157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 0x7ff9c80ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c80ca290 con 0x7ff9c815d1d0 2023-12-19T17:52:01.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8159a60 con 0x7ff9c80cdb90 2023-12-19T17:52:01.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.606+0000 7ff9cd789700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c8159d40 con 0x7ff9c80d1fc0 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 0x7ff9c80ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 0x7ff9c80ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37778/0 (socket says 172.21.15.45:37778) 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 -- 172.21.15.45:0/713418855 learned_addr learned my addr 172.21.15.45:0/713418855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c6ffd700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9c80cdb90 0x7ff9c8157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9bffff700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 -- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 msgr2=0x7ff9c815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c815bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 -- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9c80cdb90 msgr2=0x7ff9c8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9c80cdb90 0x7ff9c8157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:01.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 -- 172.21.15.45:0/713418855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c0009b30 con 0x7ff9c815d1d0 2023-12-19T17:52:01.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9c77fe700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 0x7ff9c80ca720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8071d20 tx=0x7ff9c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:01.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c00099b0 con 0x7ff9c815d1d0 2023-12-19T17:52:01.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9c000ce80 con 0x7ff9c815d1d0 2023-12-19T17:52:01.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0004490 con 0x7ff9c815d1d0 2023-12-19T17:52:01.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c815a020 con 0x7ff9c815d1d0 2023-12-19T17:52:01.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c8158220 con 0x7ff9c815d1d0 2023-12-19T17:52:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.610+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c80b7eb0 con 0x7ff9c815d1d0 2023-12-19T17:52:01.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.614+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff9c00045f0 con 0x7ff9c815d1d0 2023-12-19T17:52:01.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.614+0000 7ff9bf7fe700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff9a8065ad0 0x7ff9a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:01.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.614+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff9c0084500 con 0x7ff9c815d1d0 2023-12-19T17:52:01.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.614+0000 7ff9c6ffd700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff9a8065ad0 0x7ff9a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.614+0000 7ff9c6ffd700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff9a8065ad0 0x7ff9a8067f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009ad0 tx=0x7ff9b8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.622+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9c0051c90 con 0x7ff9c815d1d0 2023-12-19T17:52:01.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:01.834+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff9c804ed30 con 0x7ff9c815d1d0 2023-12-19T17:52:02.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.394+0000 7ff9bf7fe700 1 -- 172.21.15.45:0/713418855 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff9c00048a0 con 0x7ff9c815d1d0 2023-12-19T17:52:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff9a8065ad0 msgr2=0x7ff9a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff9a8065ad0 0x7ff9a8067f90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff9b8009ad0 tx=0x7ff9b8009240 comp rx=0 tx=0).stop 2023-12-19T17:52:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 msgr2=0x7ff9c80ca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 0x7ff9c80ca720 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8071d20 tx=0x7ff9c0004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 shutdown_connections 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff9a8065ad0 0x7ff9a8067f90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff9c815d1d0 0x7ff9c80ca720 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff9c80d1fc0 0x7ff9c815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 --2- 172.21.15.45:0/713418855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9c80cdb90 0x7ff9c8157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 >> 172.21.15.45:0/713418855 conn(0x7ff9c80d2e50 msgr2=0x7ff9c80b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 shutdown_connections 2023-12-19T17:52:02.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.398+0000 7ff9cd789700 1 -- 172.21.15.45:0/713418855 wait complete. 2023-12-19T17:52:02.426 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T17:52:02.426 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:52:02.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.606+0000 7ff22abb7700 1 Processor -- start 2023-12-19T17:52:02.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.610+0000 7ff22abb7700 1 -- start start 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.610+0000 7ff22abb7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2241615a0 0x7ff2240c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.610+0000 7ff22abb7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2240af720 0x7ff2240afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2240b00a0 con 0x7ff2241611c0 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff224070340 con 0x7ff2240af720 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240c3f90 con 0x7ff2241615a0 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff229bb5700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff2241611c0 0x7ff22406d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59182/0 (socket says 172.21.15.45:59182) 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff229bb5700 1 -- 172.21.15.45:0/3066560103 learned_addr learned my addr 172.21.15.45:0/3066560103 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:02.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22a3b6700 1 --2- 172.21.15.45:0/3066560103 >> v2:172.21.15.45:3300/0 conn(0x7ff2240af720 0x7ff2240afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff2293b4700 1 --2- 172.21.15.45:0/3066560103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2241615a0 0x7ff2240c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff228bb3700 1 -- 172.21.15.45:0/3066560103 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 367274303 0 0) 0x7ff2240b00a0 con 0x7ff2241611c0 2023-12-19T17:52:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff228bb3700 1 -- 172.21.15.45:0/3066560103 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2100035d0 con 0x7ff2241611c0 2023-12-19T17:52:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22a3b6700 1 -- 172.21.15.45:0/3066560103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2241615a0 msgr2=0x7ff2240c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22a3b6700 1 --2- 172.21.15.45:0/3066560103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2241615a0 0x7ff2240c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22a3b6700 1 -- 172.21.15.45:0/3066560103 >> v1:172.21.15.45:6789/0 conn(0x7ff2241611c0 legacy=0x7ff22406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22a3b6700 1 -- 172.21.15.45:0/3066560103 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2240c4270 con 0x7ff2240af720 2023-12-19T17:52:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22a3b6700 1 --2- 172.21.15.45:0/3066560103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2240af720 0x7ff2240afb60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009d90 tx=0x7ff21c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32882770c78af0cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff228bb3700 1 -- 172.21.15.45:0/3066560103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c00e070 con 0x7ff2240af720 2023-12-19T17:52:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff228bb3700 1 -- 172.21.15.45:0/3066560103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21c00bb20 con 0x7ff2240af720 2023-12-19T17:52:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff228bb3700 1 -- 172.21.15.45:0/3066560103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21c012430 con 0x7ff2240af720 2023-12-19T17:52:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- 172.21.15.45:0/3066560103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2240af720 msgr2=0x7ff2240afb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 --2- 172.21.15.45:0/3066560103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2240af720 0x7ff2240afb60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff21c009d90 tx=0x7ff21c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- 172.21.15.45:0/3066560103 shutdown_connections 2023-12-19T17:52:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 --2- 172.21.15.45:0/3066560103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2240af720 0x7ff2240afb60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 --2- 172.21.15.45:0/3066560103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2241615a0 0x7ff2240c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- 172.21.15.45:0/3066560103 >> 172.21.15.45:0/3066560103 conn(0x7ff2240cb900 msgr2=0x7ff2240b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.614+0000 7ff22abb7700 1 -- 172.21.15.45:0/3066560103 shutdown_connections 2023-12-19T17:52:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.618+0000 7ff22abb7700 1 -- 172.21.15.45:0/3066560103 wait complete. 2023-12-19T17:52:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.618+0000 7ff22abb7700 1 Processor -- start 2023-12-19T17:52:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 -- start start 2023-12-19T17:52:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2240af720 0x7ff2240b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 0x7ff22415b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2241615a0 0x7ff2240c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff224162eb0 con 0x7ff2241611c0 2023-12-19T17:52:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240c7330 con 0x7ff2241615a0 2023-12-19T17:52:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2240c7610 con 0x7ff2240af720 2023-12-19T17:52:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 0x7ff22415b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 0x7ff22415b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37804/0 (socket says 172.21.15.45:37804) 2023-12-19T17:52:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 -- 172.21.15.45:0/170241274 learned_addr learned my addr 172.21.15.45:0/170241274 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff229bb5700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2240af720 0x7ff2240b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22a3b6700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2241615a0 0x7ff2240c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 -- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2240af720 msgr2=0x7ff2240b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2240af720 0x7ff2240b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 -- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2241615a0 msgr2=0x7ff2240c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2241615a0 0x7ff2240c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 -- 172.21.15.45:0/170241274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c009a70 con 0x7ff2241611c0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff2293b4700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 0x7ff22415b3b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d800 tx=0x7ff21400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2140125f0 con 0x7ff2241611c0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff214012750 con 0x7ff2241611c0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2240c78f0 con 0x7ff2241611c0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff214012ac0 con 0x7ff2241611c0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.622+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff22415b8f0 con 0x7ff2241611c0 2023-12-19T17:52:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.626+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2240c7ae0 con 0x7ff2241611c0 2023-12-19T17:52:02.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.626+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff214012c20 con 0x7ff2241611c0 2023-12-19T17:52:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.630+0000 7ff21a7fc700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff208065ad0 0x7ff208067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.630+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff214083530 con 0x7ff2241611c0 2023-12-19T17:52:02.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.630+0000 7ff229bb5700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff208065ad0 0x7ff208067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:02.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.630+0000 7ff229bb5700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff208065ad0 0x7ff208067f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff220007fd0 tx=0x7ff220007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:02.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.634+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff214050bf0 con 0x7ff2241611c0 2023-12-19T17:52:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.846+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff22406e760 con 0x7ff2241611c0 2023-12-19T17:52:02.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.846+0000 7ff21a7fc700 1 -- 172.21.15.45:0/170241274 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7ff214054210 con 0x7ff2241611c0 2023-12-19T17:52:02.850 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:02.850 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff208065ad0 msgr2=0x7ff208067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff208065ad0 0x7ff208067f90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff220007fd0 tx=0x7ff220007de0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 msgr2=0x7ff22415b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 0x7ff22415b3b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff21400d800 tx=0x7ff21400db10 comp rx=0 tx=0).stop 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 shutdown_connections 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff208065ad0 0x7ff208067f90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2241615a0 0x7ff2240c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2241611c0 0x7ff22415b3b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 --2- 172.21.15.45:0/170241274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2240af720 0x7ff2240b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 >> 172.21.15.45:0/170241274 conn(0x7ff2240cb900 msgr2=0x7ff2240b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 shutdown_connections 2023-12-19T17:52:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:02.850+0000 7ff22abb7700 1 -- 172.21.15.45:0/170241274 wait complete. 2023-12-19T17:52:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:52:02.873 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.050+0000 7f1ad759e700 1 Processor -- start 2023-12-19T17:52:03.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.050+0000 7f1ad759e700 1 -- start start 2023-12-19T17:52:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad806f0a0 con 0x7f1ad806cad0 2023-12-19T17:52:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ad806ea90 con 0x7f1ad80af720 2023-12-19T17:52:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80c3f60 con 0x7f1ad815ae20 2023-12-19T17:52:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1acdd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1ad806cad0 0x7f1ad80c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59190/0 (socket says 172.21.15.45:59190) 2023-12-19T17:52:03.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1acdd9b700 1 -- 172.21.15.45:0/1588577253 learned_addr learned my addr 172.21.15.45:0/1588577253 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad659c700 1 --2- 172.21.15.45:0/1588577253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad5d9b700 1 -- 172.21.15.45:0/1588577253 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859080130 0 0) 0x7f1ad806f0a0 con 0x7f1ad806cad0 2023-12-19T17:52:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad5d9b700 1 -- 172.21.15.45:0/1588577253 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ac40035d0 con 0x7f1ad806cad0 2023-12-19T17:52:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad659c700 1 -- 172.21.15.45:0/1588577253 >> v1:172.21.15.73:6789/0 conn(0x7f1ad80af720 legacy=0x7f1ad806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad659c700 1 -- 172.21.15.45:0/1588577253 >> v1:172.21.15.45:6789/0 conn(0x7f1ad806cad0 legacy=0x7f1ad80c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad5d9b700 1 -- 172.21.15.45:0/1588577253 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035202493 0 0) 0x7f1ad806ea90 con 0x7f1ad80af720 2023-12-19T17:52:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad659c700 1 -- 172.21.15.45:0/1588577253 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad80c4240 con 0x7f1ad815ae20 2023-12-19T17:52:03.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad659c700 1 --2- 172.21.15.45:0/1588577253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad815be40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009880 tx=0x7f1ac8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=691c1ab1c3ca3fde server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad5d9b700 1 -- 172.21.15.45:0/1588577253 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8011830 con 0x7f1ad815ae20 2023-12-19T17:52:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad5d9b700 1 -- 172.21.15.45:0/1588577253 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac8011990 con 0x7f1ad815ae20 2023-12-19T17:52:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.054+0000 7f1ad5d9b700 1 -- 172.21.15.45:0/1588577253 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac8011d20 con 0x7f1ad815ae20 2023-12-19T17:52:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 -- 172.21.15.45:0/1588577253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 msgr2=0x7f1ad815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 --2- 172.21.15.45:0/1588577253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad815be40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1ac8009880 tx=0x7f1ac8009b90 comp rx=0 tx=0).stop 2023-12-19T17:52:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 -- 172.21.15.45:0/1588577253 shutdown_connections 2023-12-19T17:52:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 --2- 172.21.15.45:0/1588577253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad815be40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 -- 172.21.15.45:0/1588577253 >> 172.21.15.45:0/1588577253 conn(0x7f1ad80cb900 msgr2=0x7f1ad80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 -- 172.21.15.45:0/1588577253 shutdown_connections 2023-12-19T17:52:03.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 -- 172.21.15.45:0/1588577253 wait complete. 2023-12-19T17:52:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.058+0000 7f1ad759e700 1 Processor -- start 2023-12-19T17:52:03.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 -- start start 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ad806cad0 0x7f1ad8154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 0x7f1ad80c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad80c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80b3180 con 0x7f1ad80af720 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80b2500 con 0x7f1ad806cad0 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad80b27e0 con 0x7f1ad815ae20 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 0x7f1ad80c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 0x7f1ad80c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37806/0 (socket says 172.21.15.45:37806) 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 -- 172.21.15.45:0/3759569531 learned_addr learned my addr 172.21.15.45:0/3759569531 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad659c700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ad806cad0 0x7f1ad8154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad6d9d700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad80c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 -- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 msgr2=0x7f1ad80c5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad80c5dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 -- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ad806cad0 msgr2=0x7f1ad8154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ad806cad0 0x7f1ad8154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 -- 172.21.15.45:0/3759569531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80094b0 con 0x7f1ad80af720 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acdd9b700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 0x7f1ad80c5890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00010e0 tx=0x7f1ac000c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0005d90 con 0x7f1ad80af720 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00070d0 con 0x7f1ad80af720 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ad80b2ac0 con 0x7f1ad80af720 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.062+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0007460 con 0x7f1ad80af720 2023-12-19T17:52:03.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.066+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ad8154780 con 0x7f1ad80af720 2023-12-19T17:52:03.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.066+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ad80b32c0 con 0x7f1ad80af720 2023-12-19T17:52:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.066+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ac00075c0 con 0x7f1ad80af720 2023-12-19T17:52:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.070+0000 7f1acf7fe700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ab8065ad0 0x7f1ab8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.070+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ac00827b0 con 0x7f1ad80af720 2023-12-19T17:52:03.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.070+0000 7f1ad659c700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ab8065ad0 0x7f1ab8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.070+0000 7f1ad659c700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ab8065ad0 0x7f1ab8067f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80090b0 tx=0x7f1ac801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.074+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ad80b32c0 con 0x7f1ad80af720 2023-12-19T17:52:03.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.258+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ad80b32c0 con 0x7f1ad80af720 2023-12-19T17:52:03.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1acf7fe700 1 -- 172.21.15.45:0/3759569531 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f1ad80b32c0 con 0x7f1ad80af720 2023-12-19T17:52:03.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:03.263 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ab8065ad0 msgr2=0x7f1ab8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ab8065ad0 0x7f1ab8067f90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1ac80090b0 tx=0x7f1ac801c040 comp rx=0 tx=0).stop 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 msgr2=0x7f1ad80c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 0x7f1ad80c5890 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1ac00010e0 tx=0x7f1ac000c7d0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 shutdown_connections 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ab8065ad0 0x7f1ab8067f90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ad815ae20 0x7f1ad80c5dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ad80af720 0x7f1ad80c5890 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 --2- 172.21.15.45:0/3759569531 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ad806cad0 0x7f1ad8154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 >> 172.21.15.45:0/3759569531 conn(0x7f1ad80cb900 msgr2=0x7f1ad80cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:03.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 shutdown_connections 2023-12-19T17:52:03.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.262+0000 7f1ad759e700 1 -- 172.21.15.45:0/3759569531 wait complete. 2023-12-19T17:52:03.291 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T17:52:03.292 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:52:03.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.470+0000 7fa7f2ae4700 1 Processor -- start 2023-12-19T17:52:03.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.470+0000 7fa7f2ae4700 1 -- start start 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f2ae4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7ec0b88b0 0x7fa7ec06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f2ae4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec0d1820 con 0x7fa7ec06ea90 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f2ae4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ec0d1b00 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f2ae4700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ec0d1630 con 0x7fa7ec0b88b0 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f1ae2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa7ec06ea90 0x7fa7ec0d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59192/0 (socket says 172.21.15.45:59192) 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f12e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7ec0b88b0 0x7fa7ec06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f1ae2700 1 -- 172.21.15.45:0/2961555090 learned_addr learned my addr 172.21.15.45:0/2961555090 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f12e1700 1 -- 172.21.15.45:0/2961555090 >> v1:172.21.15.73:6789/0 conn(0x7fa7ec06f3b0 legacy=0x7fa7ec06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f12e1700 1 -- 172.21.15.45:0/2961555090 >> v1:172.21.15.45:6789/0 conn(0x7fa7ec06ea90 legacy=0x7fa7ec0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f12e1700 1 -- 172.21.15.45:0/2961555090 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec0d1de0 con 0x7fa7ec0b88b0 2023-12-19T17:52:03.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.474+0000 7fa7f12e1700 1 --2- 172.21.15.45:0/2961555090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec06ee70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009850 tx=0x7fa7dc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf82169eed541c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f0ae0700 1 -- 172.21.15.45:0/2961555090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc011830 con 0x7fa7ec0b88b0 2023-12-19T17:52:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f0ae0700 1 -- 172.21.15.45:0/2961555090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc011990 con 0x7fa7ec0b88b0 2023-12-19T17:52:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f0ae0700 1 -- 172.21.15.45:0/2961555090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc011d20 con 0x7fa7ec0b88b0 2023-12-19T17:52:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/2961555090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec0b88b0 msgr2=0x7fa7ec06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/2961555090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec06ee70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fa7dc009850 tx=0x7fa7dc009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/2961555090 shutdown_connections 2023-12-19T17:52:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/2961555090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec06ee70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/2961555090 >> 172.21.15.45:0/2961555090 conn(0x7fa7ec0b46d0 msgr2=0x7fa7ec0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/2961555090 shutdown_connections 2023-12-19T17:52:03.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/2961555090 wait complete. 2023-12-19T17:52:03.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 Processor -- start 2023-12-19T17:52:03.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.478+0000 7fa7f2ae4700 1 -- start start 2023-12-19T17:52:03.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7ec06ea90 0x7fa7ec14a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 0x7fa7ec0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c90f0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0c9580 con 0x7fa7ec0b88b0 2023-12-19T17:52:03.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ec0cc1e0 con 0x7fa7ec06ea90 2023-12-19T17:52:03.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 0x7fa7ec0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 0x7fa7ec0c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37822/0 (socket says 172.21.15.45:37822) 2023-12-19T17:52:03.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 -- 172.21.15.45:0/857524838 learned_addr learned my addr 172.21.15.45:0/857524838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:03.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f22e3700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f1ae2700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7ec06ea90 0x7fa7ec14a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 -- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7ec06ea90 msgr2=0x7fa7ec14a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7ec06ea90 0x7fa7ec14a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 -- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0b88b0 msgr2=0x7fa7ec0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 -- 172.21.15.45:0/857524838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc0094b0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f1ae2700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7ec06ea90 0x7fa7ec14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f12e1700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 0x7fa7ec0c6710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec072a40 tx=0x7fa7dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc004500 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7dc0036c0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7ec0c8aa0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7dc003a70 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.482+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ec14aec0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.486+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ec0c92a0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.486+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa7dc003bd0 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.486+0000 7fa7e27fc700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa7d0065b00 0x7fa7d0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.486+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa7dc021030 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.490+0000 7fa7f1ae2700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa7d0065b00 0x7fa7d0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.490+0000 7fa7f1ae2700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa7d0065b00 0x7fa7d0067fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8005930 tx=0x7fa7e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.494+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa7dc052770 con 0x7fa7ec06f3b0 2023-12-19T17:52:03.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.666+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa7ec0d23a0 con 0x7fa7d0065b00 2023-12-19T17:52:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.682+0000 7fa7e27fc700 1 -- 172.21.15.45:0/857524838 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345125 (secure 0 0 0) 0x7fa7e8005980 con 0x7fa7d0065b00 2023-12-19T17:52:03.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa7d0065b00 msgr2=0x7fa7d0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa7d0065b00 0x7fa7d0067fc0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa7e8005930 tx=0x7fa7e8009040 comp rx=0 tx=0).stop 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 msgr2=0x7fa7ec0c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 0x7fa7ec0c6710 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec072a40 tx=0x7fa7dc004770 comp rx=0 tx=0).stop 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 shutdown_connections 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa7d0065b00 0x7fa7d0067fc0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7ec0b88b0 0x7fa7ec0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7ec06f3b0 0x7fa7ec0c6710 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 --2- 172.21.15.45:0/857524838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7ec06ea90 0x7fa7ec14a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 >> 172.21.15.45:0/857524838 conn(0x7fa7ec0b46d0 msgr2=0x7fa7ec155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 shutdown_connections 2023-12-19T17:52:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.690+0000 7fa7f2ae4700 1 -- 172.21.15.45:0/857524838 wait complete. 2023-12-19T17:52:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:52:03.714 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-19T17:52:02.200685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222916,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751804,"statfs":{"total":773094113280,"available":772865847296,"internally_reserved":0,"allocated":3280896,"data_stored":1987143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005530"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883478+0000","last_change":"2023-12-19T17:51:37.371560+0000","last_active":"2023-12-19T17:51:41.883478+0000","last_peered":"2023-12-19T17:51:41.883478+0000","last_clean":"2023-12-19T17:51:41.883478+0000","last_became_active":"2023-12-19T17:51:37.368980+0000","last_became_peered":"2023-12-19T17:51:37.368980+0000","last_unstale":"2023-12-19T17:51:41.883478+0000","last_undegraded":"2023-12-19T17:51:41.883478+0000","last_fullsized":"2023-12-19T17:51:41.883478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881409+0000","last_change":"2023-12-19T17:51:37.863698+0000","last_active":"2023-12-19T17:51:41.881409+0000","last_peered":"2023-12-19T17:51:41.881409+0000","last_clean":"2023-12-19T17:51:41.881409+0000","last_became_active":"2023-12-19T17:51:37.863369+0000","last_became_peered":"2023-12-19T17:51:37.863369+0000","last_unstale":"2023-12-19T17:51:41.881409+0000","last_undegraded":"2023-12-19T17:51:41.881409+0000","last_fullsized":"2023-12-19T17:51:41.881409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901112+0000","last_change":"2023-12-19T17:51:41.894945+0000","last_active":"2023-12-19T17:51:41.901112+0000","last_peered":"2023-12-19T17:51:41.901112+0000","last_clean":"2023-12-19T17:51:41.901112+0000","last_became_active":"2023-12-19T17:51:41.894291+0000","last_became_peered":"2023-12-19T17:51:41.894291+0000","last_unstale":"2023-12-19T17:51:41.901112+0000","last_undegraded":"2023-12-19T17:51:41.901112+0000","last_fullsized":"2023-12-19T17:51:41.901112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881515+0000","last_change":"2023-12-19T17:51:37.371310+0000","last_active":"2023-12-19T17:51:41.881515+0000","last_peered":"2023-12-19T17:51:41.881515+0000","last_clean":"2023-12-19T17:51:41.881515+0000","last_became_active":"2023-12-19T17:51:37.370946+0000","last_became_peered":"2023-12-19T17:51:37.370946+0000","last_unstale":"2023-12-19T17:51:41.881515+0000","last_undegraded":"2023-12-19T17:51:41.881515+0000","last_fullsized":"2023-12-19T17:51:41.881515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881893+0000","last_change":"2023-12-19T17:51:37.859332+0000","last_active":"2023-12-19T17:51:41.881893+0000","last_peered":"2023-12-19T17:51:41.881893+0000","last_clean":"2023-12-19T17:51:41.881893+0000","last_became_active":"2023-12-19T17:51:37.858295+0000","last_became_peered":"2023-12-19T17:51:37.858295+0000","last_unstale":"2023-12-19T17:51:41.881893+0000","last_undegraded":"2023-12-19T17:51:41.881893+0000","last_fullsized":"2023-12-19T17:51:41.881893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904185+0000","last_change":"2023-12-19T17:51:41.894941+0000","last_active":"2023-12-19T17:51:41.904185+0000","last_peered":"2023-12-19T17:51:41.904185+0000","last_clean":"2023-12-19T17:51:41.904185+0000","last_became_active":"2023-12-19T17:51:41.894354+0000","last_became_peered":"2023-12-19T17:51:41.894354+0000","last_unstale":"2023-12-19T17:51:41.904185+0000","last_undegraded":"2023-12-19T17:51:41.904185+0000","last_fullsized":"2023-12-19T17:51:41.904185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:24.899374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863045+0000","last_change":"2023-12-19T17:51:37.373590+0000","last_active":"2023-12-19T17:51:41.863045+0000","last_peered":"2023-12-19T17:51:41.863045+0000","last_clean":"2023-12-19T17:51:41.863045+0000","last_became_active":"2023-12-19T17:51:37.372932+0000","last_became_peered":"2023-12-19T17:51:37.372932+0000","last_unstale":"2023-12-19T17:51:41.863045+0000","last_undegraded":"2023-12-19T17:51:41.863045+0000","last_fullsized":"2023-12-19T17:51:41.863045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:41.180593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873974+0000","last_change":"2023-12-19T17:51:37.854515+0000","last_active":"2023-12-19T17:51:41.873974+0000","last_peered":"2023-12-19T17:51:41.873974+0000","last_clean":"2023-12-19T17:51:41.873974+0000","last_became_active":"2023-12-19T17:51:37.852250+0000","last_became_peered":"2023-12-19T17:51:37.852250+0000","last_unstale":"2023-12-19T17:51:41.873974+0000","last_undegraded":"2023-12-19T17:51:41.873974+0000","last_fullsized":"2023-12-19T17:51:41.873974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.913316+0000","last_change":"2023-12-19T17:51:41.912325+0000","last_active":"2023-12-19T17:51:41.913316+0000","last_peered":"2023-12-19T17:51:41.913316+0000","last_clean":"2023-12-19T17:51:41.913316+0000","last_became_active":"2023-12-19T17:51:41.907565+0000","last_became_peered":"2023-12-19T17:51:41.907565+0000","last_unstale":"2023-12-19T17:51:41.913316+0000","last_undegraded":"2023-12-19T17:51:41.913316+0000","last_fullsized":"2023-12-19T17:51:41.913316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863667+0000","last_change":"2023-12-19T17:51:37.375079+0000","last_active":"2023-12-19T17:51:41.863667+0000","last_peered":"2023-12-19T17:51:41.863667+0000","last_clean":"2023-12-19T17:51:41.863667+0000","last_became_active":"2023-12-19T17:51:37.373363+0000","last_became_peered":"2023-12-19T17:51:37.373363+0000","last_unstale":"2023-12-19T17:51:41.863667+0000","last_undegraded":"2023-12-19T17:51:41.863667+0000","last_fullsized":"2023-12-19T17:51:41.863667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:05.345443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874581+0000","last_change":"2023-12-19T17:51:37.854134+0000","last_active":"2023-12-19T17:51:41.874581+0000","last_peered":"2023-12-19T17:51:41.874581+0000","last_clean":"2023-12-19T17:51:41.874581+0000","last_became_active":"2023-12-19T17:51:37.852585+0000","last_became_peered":"2023-12-19T17:51:37.852585+0000","last_unstale":"2023-12-19T17:51:41.874581+0000","last_undegraded":"2023-12-19T17:51:41.874581+0000","last_fullsized":"2023-12-19T17:51:41.874581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892187+0000","last_change":"2023-12-19T17:51:41.886590+0000","last_active":"2023-12-19T17:51:41.892187+0000","last_peered":"2023-12-19T17:51:41.892187+0000","last_clean":"2023-12-19T17:51:41.892187+0000","last_became_active":"2023-12-19T17:51:41.885064+0000","last_became_peered":"2023-12-19T17:51:41.885064+0000","last_unstale":"2023-12-19T17:51:41.892187+0000","last_undegraded":"2023-12-19T17:51:41.892187+0000","last_fullsized":"2023-12-19T17:51:41.892187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:06.290013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863854+0000","last_change":"2023-12-19T17:51:37.860517+0000","last_active":"2023-12-19T17:51:41.863854+0000","last_peered":"2023-12-19T17:51:41.863854+0000","last_clean":"2023-12-19T17:51:41.863854+0000","last_became_active":"2023-12-19T17:51:37.860222+0000","last_became_peered":"2023-12-19T17:51:37.860222+0000","last_unstale":"2023-12-19T17:51:41.863854+0000","last_undegraded":"2023-12-19T17:51:41.863854+0000","last_fullsized":"2023-12-19T17:51:41.863854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861865+0000","last_change":"2023-12-19T17:51:37.374087+0000","last_active":"2023-12-19T17:51:41.861865+0000","last_peered":"2023-12-19T17:51:41.861865+0000","last_clean":"2023-12-19T17:51:41.861865+0000","last_became_active":"2023-12-19T17:51:37.373661+0000","last_became_peered":"2023-12-19T17:51:37.373661+0000","last_unstale":"2023-12-19T17:51:41.861865+0000","last_undegraded":"2023-12-19T17:51:41.861865+0000","last_fullsized":"2023-12-19T17:51:41.861865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:25.625813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892353+0000","last_change":"2023-12-19T17:51:41.885394+0000","last_active":"2023-12-19T17:51:41.892353+0000","last_peered":"2023-12-19T17:51:41.892353+0000","last_clean":"2023-12-19T17:51:41.892353+0000","last_became_active":"2023-12-19T17:51:41.884923+0000","last_became_peered":"2023-12-19T17:51:41.884923+0000","last_unstale":"2023-12-19T17:51:41.892353+0000","last_undegraded":"2023-12-19T17:51:41.892353+0000","last_fullsized":"2023-12-19T17:51:41.892353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:01.021272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874374+0000","last_change":"2023-12-19T17:51:37.861671+0000","last_active":"2023-12-19T17:51:41.874374+0000","last_peered":"2023-12-19T17:51:41.874374+0000","last_clean":"2023-12-19T17:51:41.874374+0000","last_became_active":"2023-12-19T17:51:37.860880+0000","last_became_peered":"2023-12-19T17:51:37.860880+0000","last_unstale":"2023-12-19T17:51:41.874374+0000","last_undegraded":"2023-12-19T17:51:41.874374+0000","last_fullsized":"2023-12-19T17:51:41.874374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862370+0000","last_change":"2023-12-19T17:51:37.365041+0000","last_active":"2023-12-19T17:51:41.862370+0000","last_peered":"2023-12-19T17:51:41.862370+0000","last_clean":"2023-12-19T17:51:41.862370+0000","last_became_active":"2023-12-19T17:51:37.364574+0000","last_became_peered":"2023-12-19T17:51:37.364574+0000","last_unstale":"2023-12-19T17:51:41.862370+0000","last_undegraded":"2023-12-19T17:51:41.862370+0000","last_fullsized":"2023-12-19T17:51:41.862370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.903630+0000","last_change":"2023-12-19T17:51:41.894392+0000","last_active":"2023-12-19T17:51:41.903630+0000","last_peered":"2023-12-19T17:51:41.903630+0000","last_clean":"2023-12-19T17:51:41.903630+0000","last_became_active":"2023-12-19T17:51:41.893912+0000","last_became_peered":"2023-12-19T17:51:41.893912+0000","last_unstale":"2023-12-19T17:51:41.903630+0000","last_undegraded":"2023-12-19T17:51:41.903630+0000","last_fullsized":"2023-12-19T17:51:41.903630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871673+0000","last_change":"2023-12-19T17:51:37.878509+0000","last_active":"2023-12-19T17:51:41.871673+0000","last_peered":"2023-12-19T17:51:41.871673+0000","last_clean":"2023-12-19T17:51:41.871673+0000","last_became_active":"2023-12-19T17:51:37.878267+0000","last_became_peered":"2023-12-19T17:51:37.878267+0000","last_unstale":"2023-12-19T17:51:41.871673+0000","last_undegraded":"2023-12-19T17:51:41.871673+0000","last_fullsized":"2023-12-19T17:51:41.871673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860703+0000","last_change":"2023-12-19T17:51:37.361332+0000","last_active":"2023-12-19T17:51:41.860703+0000","last_peered":"2023-12-19T17:51:41.860703+0000","last_clean":"2023-12-19T17:51:41.860703+0000","last_became_active":"2023-12-19T17:51:37.359992+0000","last_became_peered":"2023-12-19T17:51:37.359992+0000","last_unstale":"2023-12-19T17:51:41.860703+0000","last_undegraded":"2023-12-19T17:51:41.860703+0000","last_fullsized":"2023-12-19T17:51:41.860703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.905148+0000","last_change":"2023-12-19T17:51:41.902138+0000","last_active":"2023-12-19T17:51:41.905148+0000","last_peered":"2023-12-19T17:51:41.905148+0000","last_clean":"2023-12-19T17:51:41.905148+0000","last_became_active":"2023-12-19T17:51:41.901751+0000","last_became_peered":"2023-12-19T17:51:41.901751+0000","last_unstale":"2023-12-19T17:51:41.905148+0000","last_undegraded":"2023-12-19T17:51:41.905148+0000","last_fullsized":"2023-12-19T17:51:41.905148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:10.835359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872596+0000","last_change":"2023-12-19T17:51:37.852747+0000","last_active":"2023-12-19T17:51:41.872596+0000","last_peered":"2023-12-19T17:51:41.872596+0000","last_clean":"2023-12-19T17:51:41.872596+0000","last_became_active":"2023-12-19T17:51:37.852265+0000","last_became_peered":"2023-12-19T17:51:37.852265+0000","last_unstale":"2023-12-19T17:51:41.872596+0000","last_undegraded":"2023-12-19T17:51:41.872596+0000","last_fullsized":"2023-12-19T17:51:41.872596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:48.499693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861229+0000","last_change":"2023-12-19T17:51:37.374392+0000","last_active":"2023-12-19T17:51:41.861229+0000","last_peered":"2023-12-19T17:51:41.861229+0000","last_clean":"2023-12-19T17:51:41.861229+0000","last_became_active":"2023-12-19T17:51:37.373831+0000","last_became_peered":"2023-12-19T17:51:37.373831+0000","last_unstale":"2023-12-19T17:51:41.861229+0000","last_undegraded":"2023-12-19T17:51:41.861229+0000","last_fullsized":"2023-12-19T17:51:41.861229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:33.874748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895361+0000","last_change":"2023-12-19T17:51:41.889463+0000","last_active":"2023-12-19T17:51:41.895361+0000","last_peered":"2023-12-19T17:51:41.895361+0000","last_clean":"2023-12-19T17:51:41.895361+0000","last_became_active":"2023-12-19T17:51:41.888636+0000","last_became_peered":"2023-12-19T17:51:41.888636+0000","last_unstale":"2023-12-19T17:51:41.895361+0000","last_undegraded":"2023-12-19T17:51:41.895361+0000","last_fullsized":"2023-12-19T17:51:41.895361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.882268+0000","last_change":"2023-12-19T17:51:37.868058+0000","last_active":"2023-12-19T17:51:41.882268+0000","last_peered":"2023-12-19T17:51:41.882268+0000","last_clean":"2023-12-19T17:51:41.882268+0000","last_became_active":"2023-12-19T17:51:37.867800+0000","last_became_peered":"2023-12-19T17:51:37.867800+0000","last_unstale":"2023-12-19T17:51:41.882268+0000","last_undegraded":"2023-12-19T17:51:41.882268+0000","last_fullsized":"2023-12-19T17:51:41.882268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865357+0000","last_change":"2023-12-19T17:51:37.366626+0000","last_active":"2023-12-19T17:51:41.865357+0000","last_peered":"2023-12-19T17:51:41.865357+0000","last_clean":"2023-12-19T17:51:41.865357+0000","last_became_active":"2023-12-19T17:51:37.366007+0000","last_became_peered":"2023-12-19T17:51:37.366007+0000","last_unstale":"2023-12-19T17:51:41.865357+0000","last_undegraded":"2023-12-19T17:51:41.865357+0000","last_fullsized":"2023-12-19T17:51:41.865357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892118+0000","last_change":"2023-12-19T17:51:41.882903+0000","last_active":"2023-12-19T17:51:41.892118+0000","last_peered":"2023-12-19T17:51:41.892118+0000","last_clean":"2023-12-19T17:51:41.892118+0000","last_became_active":"2023-12-19T17:51:41.882532+0000","last_became_peered":"2023-12-19T17:51:41.882532+0000","last_unstale":"2023-12-19T17:51:41.892118+0000","last_undegraded":"2023-12-19T17:51:41.892118+0000","last_fullsized":"2023-12-19T17:51:41.892118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881484+0000","last_change":"2023-12-19T17:51:37.870213+0000","last_active":"2023-12-19T17:51:41.881484+0000","last_peered":"2023-12-19T17:51:41.881484+0000","last_clean":"2023-12-19T17:51:41.881484+0000","last_became_active":"2023-12-19T17:51:37.869912+0000","last_became_peered":"2023-12-19T17:51:37.869912+0000","last_unstale":"2023-12-19T17:51:41.881484+0000","last_undegraded":"2023-12-19T17:51:41.881484+0000","last_fullsized":"2023-12-19T17:51:41.881484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:52.781318+0000","last_change":"2023-12-19T17:51:37.367621+0000","last_active":"2023-12-19T17:51:52.781318+0000","last_peered":"2023-12-19T17:51:52.781318+0000","last_clean":"2023-12-19T17:51:52.781318+0000","last_became_active":"2023-12-19T17:51:37.367105+0000","last_became_peered":"2023-12-19T17:51:37.367105+0000","last_unstale":"2023-12-19T17:51:52.781318+0000","last_undegraded":"2023-12-19T17:51:52.781318+0000","last_fullsized":"2023-12-19T17:51:52.781318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909707+0000","last_change":"2023-12-19T17:51:41.904744+0000","last_active":"2023-12-19T17:51:41.909707+0000","last_peered":"2023-12-19T17:51:41.909707+0000","last_clean":"2023-12-19T17:51:41.909707+0000","last_became_active":"2023-12-19T17:51:41.904364+0000","last_became_peered":"2023-12-19T17:51:41.904364+0000","last_unstale":"2023-12-19T17:51:41.909707+0000","last_undegraded":"2023-12-19T17:51:41.909707+0000","last_fullsized":"2023-12-19T17:51:41.909707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:58.563321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860812+0000","last_change":"2023-12-19T17:51:37.865360+0000","last_active":"2023-12-19T17:51:41.860812+0000","last_peered":"2023-12-19T17:51:41.860812+0000","last_clean":"2023-12-19T17:51:41.860812+0000","last_became_active":"2023-12-19T17:51:37.865049+0000","last_became_peered":"2023-12-19T17:51:37.865049+0000","last_unstale":"2023-12-19T17:51:41.860812+0000","last_undegraded":"2023-12-19T17:51:41.860812+0000","last_fullsized":"2023-12-19T17:51:41.860812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863243+0000","last_change":"2023-12-19T17:51:37.374005+0000","last_active":"2023-12-19T17:51:41.863243+0000","last_peered":"2023-12-19T17:51:41.863243+0000","last_clean":"2023-12-19T17:51:41.863243+0000","last_became_active":"2023-12-19T17:51:37.373306+0000","last_became_peered":"2023-12-19T17:51:37.373306+0000","last_unstale":"2023-12-19T17:51:41.863243+0000","last_undegraded":"2023-12-19T17:51:41.863243+0000","last_fullsized":"2023-12-19T17:51:41.863243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:28.401279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909053+0000","last_change":"2023-12-19T17:51:41.907731+0000","last_active":"2023-12-19T17:51:41.909053+0000","last_peered":"2023-12-19T17:51:41.909053+0000","last_clean":"2023-12-19T17:51:41.909053+0000","last_became_active":"2023-12-19T17:51:41.907322+0000","last_became_peered":"2023-12-19T17:51:41.907322+0000","last_unstale":"2023-12-19T17:51:41.909053+0000","last_undegraded":"2023-12-19T17:51:41.909053+0000","last_fullsized":"2023-12-19T17:51:41.909053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874655+0000","last_change":"2023-12-19T17:51:37.868383+0000","last_active":"2023-12-19T17:51:41.874655+0000","last_peered":"2023-12-19T17:51:41.874655+0000","last_clean":"2023-12-19T17:51:41.874655+0000","last_became_active":"2023-12-19T17:51:37.867225+0000","last_became_peered":"2023-12-19T17:51:37.867225+0000","last_unstale":"2023-12-19T17:51:41.874655+0000","last_undegraded":"2023-12-19T17:51:41.874655+0000","last_fullsized":"2023-12-19T17:51:41.874655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861892+0000","last_change":"2023-12-19T17:51:37.372486+0000","last_active":"2023-12-19T17:51:41.861892+0000","last_peered":"2023-12-19T17:51:41.861892+0000","last_clean":"2023-12-19T17:51:41.861892+0000","last_became_active":"2023-12-19T17:51:37.371902+0000","last_became_peered":"2023-12-19T17:51:37.371902+0000","last_unstale":"2023-12-19T17:51:41.861892+0000","last_undegraded":"2023-12-19T17:51:41.861892+0000","last_fullsized":"2023-12-19T17:51:41.861892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901181+0000","last_change":"2023-12-19T17:51:41.893407+0000","last_active":"2023-12-19T17:51:41.901181+0000","last_peered":"2023-12-19T17:51:41.901181+0000","last_clean":"2023-12-19T17:51:41.901181+0000","last_became_active":"2023-12-19T17:51:41.892955+0000","last_became_peered":"2023-12-19T17:51:41.892955+0000","last_unstale":"2023-12-19T17:51:41.901181+0000","last_undegraded":"2023-12-19T17:51:41.901181+0000","last_fullsized":"2023-12-19T17:51:41.901181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871399+0000","last_change":"2023-12-19T17:51:37.856391+0000","last_active":"2023-12-19T17:51:41.871399+0000","last_peered":"2023-12-19T17:51:41.871399+0000","last_clean":"2023-12-19T17:51:41.871399+0000","last_became_active":"2023-12-19T17:51:37.855433+0000","last_became_peered":"2023-12-19T17:51:37.855433+0000","last_unstale":"2023-12-19T17:51:41.871399+0000","last_undegraded":"2023-12-19T17:51:41.871399+0000","last_fullsized":"2023-12-19T17:51:41.871399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:34.887797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870511+0000","last_change":"2023-12-19T17:51:37.356703+0000","last_active":"2023-12-19T17:51:41.870511+0000","last_peered":"2023-12-19T17:51:41.870511+0000","last_clean":"2023-12-19T17:51:41.870511+0000","last_became_active":"2023-12-19T17:51:37.354458+0000","last_became_peered":"2023-12-19T17:51:37.354458+0000","last_unstale":"2023-12-19T17:51:41.870511+0000","last_undegraded":"2023-12-19T17:51:41.870511+0000","last_fullsized":"2023-12-19T17:51:41.870511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.899818+0000","last_change":"2023-12-19T17:51:41.893006+0000","last_active":"2023-12-19T17:51:41.899818+0000","last_peered":"2023-12-19T17:51:41.899818+0000","last_clean":"2023-12-19T17:51:41.899818+0000","last_became_active":"2023-12-19T17:51:41.892320+0000","last_became_peered":"2023-12-19T17:51:41.892320+0000","last_unstale":"2023-12-19T17:51:41.899818+0000","last_undegraded":"2023-12-19T17:51:41.899818+0000","last_fullsized":"2023-12-19T17:51:41.899818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860734+0000","last_change":"2023-12-19T17:51:37.868336+0000","last_active":"2023-12-19T17:51:41.860734+0000","last_peered":"2023-12-19T17:51:41.860734+0000","last_clean":"2023-12-19T17:51:41.860734+0000","last_became_active":"2023-12-19T17:51:37.847762+0000","last_became_peered":"2023-12-19T17:51:37.847762+0000","last_unstale":"2023-12-19T17:51:41.860734+0000","last_undegraded":"2023-12-19T17:51:41.860734+0000","last_fullsized":"2023-12-19T17:51:41.860734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870223+0000","last_change":"2023-12-19T17:51:37.367919+0000","last_active":"2023-12-19T17:51:41.870223+0000","last_peered":"2023-12-19T17:51:41.870223+0000","last_clean":"2023-12-19T17:51:41.870223+0000","last_became_active":"2023-12-19T17:51:37.367646+0000","last_became_peered":"2023-12-19T17:51:37.367646+0000","last_unstale":"2023-12-19T17:51:41.870223+0000","last_undegraded":"2023-12-19T17:51:41.870223+0000","last_fullsized":"2023-12-19T17:51:41.870223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900252+0000","last_change":"2023-12-19T17:51:41.891782+0000","last_active":"2023-12-19T17:51:41.900252+0000","last_peered":"2023-12-19T17:51:41.900252+0000","last_clean":"2023-12-19T17:51:41.900252+0000","last_became_active":"2023-12-19T17:51:41.891400+0000","last_became_peered":"2023-12-19T17:51:41.891400+0000","last_unstale":"2023-12-19T17:51:41.900252+0000","last_undegraded":"2023-12-19T17:51:41.900252+0000","last_fullsized":"2023-12-19T17:51:41.900252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872648+0000","last_change":"2023-12-19T17:51:37.865125+0000","last_active":"2023-12-19T17:51:41.872648+0000","last_peered":"2023-12-19T17:51:41.872648+0000","last_clean":"2023-12-19T17:51:41.872648+0000","last_became_active":"2023-12-19T17:51:37.860190+0000","last_became_peered":"2023-12-19T17:51:37.860190+0000","last_unstale":"2023-12-19T17:51:41.872648+0000","last_undegraded":"2023-12-19T17:51:41.872648+0000","last_fullsized":"2023-12-19T17:51:41.872648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861321+0000","last_change":"2023-12-19T17:51:37.374377+0000","last_active":"2023-12-19T17:51:41.861321+0000","last_peered":"2023-12-19T17:51:41.861321+0000","last_clean":"2023-12-19T17:51:41.861321+0000","last_became_active":"2023-12-19T17:51:37.373141+0000","last_became_peered":"2023-12-19T17:51:37.373141+0000","last_unstale":"2023-12-19T17:51:41.861321+0000","last_undegraded":"2023-12-19T17:51:41.861321+0000","last_fullsized":"2023-12-19T17:51:41.861321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.889909+0000","last_change":"2023-12-19T17:51:41.885767+0000","last_active":"2023-12-19T17:51:41.889909+0000","last_peered":"2023-12-19T17:51:41.889909+0000","last_clean":"2023-12-19T17:51:41.889909+0000","last_became_active":"2023-12-19T17:51:41.884799+0000","last_became_peered":"2023-12-19T17:51:41.884799+0000","last_unstale":"2023-12-19T17:51:41.889909+0000","last_undegraded":"2023-12-19T17:51:41.889909+0000","last_fullsized":"2023-12-19T17:51:41.889909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:22.880744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874118+0000","last_change":"2023-12-19T17:51:37.879736+0000","last_active":"2023-12-19T17:51:41.874118+0000","last_peered":"2023-12-19T17:51:41.874118+0000","last_clean":"2023-12-19T17:51:41.874118+0000","last_became_active":"2023-12-19T17:51:37.877058+0000","last_became_peered":"2023-12-19T17:51:37.877058+0000","last_unstale":"2023-12-19T17:51:41.874118+0000","last_undegraded":"2023-12-19T17:51:41.874118+0000","last_fullsized":"2023-12-19T17:51:41.874118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.876487+0000","last_change":"2023-12-19T17:51:37.359468+0000","last_active":"2023-12-19T17:51:41.876487+0000","last_peered":"2023-12-19T17:51:41.876487+0000","last_clean":"2023-12-19T17:51:41.876487+0000","last_became_active":"2023-12-19T17:51:37.359194+0000","last_became_peered":"2023-12-19T17:51:37.359194+0000","last_unstale":"2023-12-19T17:51:41.876487+0000","last_undegraded":"2023-12-19T17:51:41.876487+0000","last_fullsized":"2023-12-19T17:51:41.876487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861414+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:51:41.861414+0000","last_peered":"2023-12-19T17:51:41.861414+0000","last_clean":"2023-12-19T17:51:41.861414+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:51:41.861414+0000","last_undegraded":"2023-12-19T17:51:41.861414+0000","last_fullsized":"2023-12-19T17:51:41.861414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897184+0000","last_change":"2023-12-19T17:51:41.893689+0000","last_active":"2023-12-19T17:51:41.897184+0000","last_peered":"2023-12-19T17:51:41.897184+0000","last_clean":"2023-12-19T17:51:41.897184+0000","last_became_active":"2023-12-19T17:51:41.893191+0000","last_became_peered":"2023-12-19T17:51:41.893191+0000","last_unstale":"2023-12-19T17:51:41.897184+0000","last_undegraded":"2023-12-19T17:51:41.897184+0000","last_fullsized":"2023-12-19T17:51:41.897184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:45.069338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861902+0000","last_change":"2023-12-19T17:51:37.868222+0000","last_active":"2023-12-19T17:51:41.861902+0000","last_peered":"2023-12-19T17:51:41.861902+0000","last_clean":"2023-12-19T17:51:41.861902+0000","last_became_active":"2023-12-19T17:51:37.867972+0000","last_became_peered":"2023-12-19T17:51:37.867972+0000","last_unstale":"2023-12-19T17:51:41.861902+0000","last_undegraded":"2023-12-19T17:51:41.861902+0000","last_fullsized":"2023-12-19T17:51:41.861902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871883+0000","last_change":"2023-12-19T17:51:37.366114+0000","last_active":"2023-12-19T17:51:41.871883+0000","last_peered":"2023-12-19T17:51:41.871883+0000","last_clean":"2023-12-19T17:51:41.871883+0000","last_became_active":"2023-12-19T17:51:37.365717+0000","last_became_peered":"2023-12-19T17:51:37.365717+0000","last_unstale":"2023-12-19T17:51:41.871883+0000","last_undegraded":"2023-12-19T17:51:41.871883+0000","last_fullsized":"2023-12-19T17:51:41.871883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.890817+0000","last_change":"2023-12-19T17:51:41.883576+0000","last_active":"2023-12-19T17:51:41.890817+0000","last_peered":"2023-12-19T17:51:41.890817+0000","last_clean":"2023-12-19T17:51:41.890817+0000","last_became_active":"2023-12-19T17:51:41.883135+0000","last_became_peered":"2023-12-19T17:51:41.883135+0000","last_unstale":"2023-12-19T17:51:41.890817+0000","last_undegraded":"2023-12-19T17:51:41.890817+0000","last_fullsized":"2023-12-19T17:51:41.890817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874046+0000","last_change":"2023-12-19T17:51:37.863995+0000","last_active":"2023-12-19T17:51:41.874046+0000","last_peered":"2023-12-19T17:51:41.874046+0000","last_clean":"2023-12-19T17:51:41.874046+0000","last_became_active":"2023-12-19T17:51:37.863704+0000","last_became_peered":"2023-12-19T17:51:37.863704+0000","last_unstale":"2023-12-19T17:51:41.874046+0000","last_undegraded":"2023-12-19T17:51:41.874046+0000","last_fullsized":"2023-12-19T17:51:41.874046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862307+0000","last_change":"2023-12-19T17:51:37.367329+0000","last_active":"2023-12-19T17:51:41.862307+0000","last_peered":"2023-12-19T17:51:41.862307+0000","last_clean":"2023-12-19T17:51:41.862307+0000","last_became_active":"2023-12-19T17:51:37.366996+0000","last_became_peered":"2023-12-19T17:51:37.366996+0000","last_unstale":"2023-12-19T17:51:41.862307+0000","last_undegraded":"2023-12-19T17:51:41.862307+0000","last_fullsized":"2023-12-19T17:51:41.862307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909072+0000","last_change":"2023-12-19T17:51:41.907875+0000","last_active":"2023-12-19T17:51:41.909072+0000","last_peered":"2023-12-19T17:51:41.909072+0000","last_clean":"2023-12-19T17:51:41.909072+0000","last_became_active":"2023-12-19T17:51:41.907461+0000","last_became_peered":"2023-12-19T17:51:41.907461+0000","last_unstale":"2023-12-19T17:51:41.909072+0000","last_undegraded":"2023-12-19T17:51:41.909072+0000","last_fullsized":"2023-12-19T17:51:41.909072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863419+0000","last_change":"2023-12-19T17:51:37.863678+0000","last_active":"2023-12-19T17:51:41.863419+0000","last_peered":"2023-12-19T17:51:41.863419+0000","last_clean":"2023-12-19T17:51:41.863419+0000","last_became_active":"2023-12-19T17:51:37.863378+0000","last_became_peered":"2023-12-19T17:51:37.863378+0000","last_unstale":"2023-12-19T17:51:41.863419+0000","last_undegraded":"2023-12-19T17:51:41.863419+0000","last_fullsized":"2023-12-19T17:51:41.863419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:21.936722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873263+0000","last_change":"2023-12-19T17:51:37.359686+0000","last_active":"2023-12-19T17:51:41.873263+0000","last_peered":"2023-12-19T17:51:41.873263+0000","last_clean":"2023-12-19T17:51:41.873263+0000","last_became_active":"2023-12-19T17:51:37.359340+0000","last_became_peered":"2023-12-19T17:51:37.359340+0000","last_unstale":"2023-12-19T17:51:41.873263+0000","last_undegraded":"2023-12-19T17:51:41.873263+0000","last_fullsized":"2023-12-19T17:51:41.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897294+0000","last_change":"2023-12-19T17:51:41.893188+0000","last_active":"2023-12-19T17:51:41.897294+0000","last_peered":"2023-12-19T17:51:41.897294+0000","last_clean":"2023-12-19T17:51:41.897294+0000","last_became_active":"2023-12-19T17:51:41.892695+0000","last_became_peered":"2023-12-19T17:51:41.892695+0000","last_unstale":"2023-12-19T17:51:41.897294+0000","last_undegraded":"2023-12-19T17:51:41.897294+0000","last_fullsized":"2023-12-19T17:51:41.897294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862719+0000","last_change":"2023-12-19T17:51:37.858250+0000","last_active":"2023-12-19T17:51:41.862719+0000","last_peered":"2023-12-19T17:51:41.862719+0000","last_clean":"2023-12-19T17:51:41.862719+0000","last_became_active":"2023-12-19T17:51:37.858002+0000","last_became_peered":"2023-12-19T17:51:37.858002+0000","last_unstale":"2023-12-19T17:51:41.862719+0000","last_undegraded":"2023-12-19T17:51:41.862719+0000","last_fullsized":"2023-12-19T17:51:41.862719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:21.378881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875262+0000","last_change":"2023-12-19T17:51:37.373582+0000","last_active":"2023-12-19T17:51:41.875262+0000","last_peered":"2023-12-19T17:51:41.875262+0000","last_clean":"2023-12-19T17:51:41.875262+0000","last_became_active":"2023-12-19T17:51:37.373152+0000","last_became_peered":"2023-12-19T17:51:37.373152+0000","last_unstale":"2023-12-19T17:51:41.875262+0000","last_undegraded":"2023-12-19T17:51:41.875262+0000","last_fullsized":"2023-12-19T17:51:41.875262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:14.694444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895324+0000","last_change":"2023-12-19T17:51:41.889020+0000","last_active":"2023-12-19T17:51:41.895324+0000","last_peered":"2023-12-19T17:51:41.895324+0000","last_clean":"2023-12-19T17:51:41.895324+0000","last_became_active":"2023-12-19T17:51:41.888202+0000","last_became_peered":"2023-12-19T17:51:41.888202+0000","last_unstale":"2023-12-19T17:51:41.895324+0000","last_undegraded":"2023-12-19T17:51:41.895324+0000","last_fullsized":"2023-12-19T17:51:41.895324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861516+0000","last_change":"2023-12-19T17:51:37.857128+0000","last_active":"2023-12-19T17:51:41.861516+0000","last_peered":"2023-12-19T17:51:41.861516+0000","last_clean":"2023-12-19T17:51:41.861516+0000","last_became_active":"2023-12-19T17:51:37.856862+0000","last_became_peered":"2023-12-19T17:51:37.856862+0000","last_unstale":"2023-12-19T17:51:41.861516+0000","last_undegraded":"2023-12-19T17:51:41.861516+0000","last_fullsized":"2023-12-19T17:51:41.861516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:01.983840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.868593+0000","last_change":"2023-12-19T17:51:37.368123+0000","last_active":"2023-12-19T17:51:41.868593+0000","last_peered":"2023-12-19T17:51:41.868593+0000","last_clean":"2023-12-19T17:51:41.868593+0000","last_became_active":"2023-12-19T17:51:37.367483+0000","last_became_peered":"2023-12-19T17:51:37.367483+0000","last_unstale":"2023-12-19T17:51:41.868593+0000","last_undegraded":"2023-12-19T17:51:41.868593+0000","last_fullsized":"2023-12-19T17:51:41.868593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900476+0000","last_change":"2023-12-19T17:51:41.890990+0000","last_active":"2023-12-19T17:51:41.900476+0000","last_peered":"2023-12-19T17:51:41.900476+0000","last_clean":"2023-12-19T17:51:41.900476+0000","last_became_active":"2023-12-19T17:51:41.890583+0000","last_became_peered":"2023-12-19T17:51:41.890583+0000","last_unstale":"2023-12-19T17:51:41.900476+0000","last_undegraded":"2023-12-19T17:51:41.900476+0000","last_fullsized":"2023-12-19T17:51:41.900476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862572+0000","last_change":"2023-12-19T17:51:37.874651+0000","last_active":"2023-12-19T17:51:41.862572+0000","last_peered":"2023-12-19T17:51:41.862572+0000","last_clean":"2023-12-19T17:51:41.862572+0000","last_became_active":"2023-12-19T17:51:37.874304+0000","last_became_peered":"2023-12-19T17:51:37.874304+0000","last_unstale":"2023-12-19T17:51:41.862572+0000","last_undegraded":"2023-12-19T17:51:41.862572+0000","last_fullsized":"2023-12-19T17:51:41.862572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862903+0000","last_change":"2023-12-19T17:51:37.368087+0000","last_active":"2023-12-19T17:51:41.862903+0000","last_peered":"2023-12-19T17:51:41.862903+0000","last_clean":"2023-12-19T17:51:41.862903+0000","last_became_active":"2023-12-19T17:51:37.367220+0000","last_became_peered":"2023-12-19T17:51:37.367220+0000","last_unstale":"2023-12-19T17:51:41.862903+0000","last_undegraded":"2023-12-19T17:51:41.862903+0000","last_fullsized":"2023-12-19T17:51:41.862903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909749+0000","last_change":"2023-12-19T17:51:41.904872+0000","last_active":"2023-12-19T17:51:41.909749+0000","last_peered":"2023-12-19T17:51:41.909749+0000","last_clean":"2023-12-19T17:51:41.909749+0000","last_became_active":"2023-12-19T17:51:41.904421+0000","last_became_peered":"2023-12-19T17:51:41.904421+0000","last_unstale":"2023-12-19T17:51:41.909749+0000","last_undegraded":"2023-12-19T17:51:41.909749+0000","last_fullsized":"2023-12-19T17:51:41.909749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:00.555281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861789+0000","last_change":"2023-12-19T17:51:37.863792+0000","last_active":"2023-12-19T17:51:41.861789+0000","last_peered":"2023-12-19T17:51:41.861789+0000","last_clean":"2023-12-19T17:51:41.861789+0000","last_became_active":"2023-12-19T17:51:37.863505+0000","last_became_peered":"2023-12-19T17:51:37.863505+0000","last_unstale":"2023-12-19T17:51:41.861789+0000","last_undegraded":"2023-12-19T17:51:41.861789+0000","last_fullsized":"2023-12-19T17:51:41.861789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:19.360251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870449+0000","last_change":"2023-12-19T17:51:37.365092+0000","last_active":"2023-12-19T17:51:41.870449+0000","last_peered":"2023-12-19T17:51:41.870449+0000","last_clean":"2023-12-19T17:51:41.870449+0000","last_became_active":"2023-12-19T17:51:37.361623+0000","last_became_peered":"2023-12-19T17:51:37.361623+0000","last_unstale":"2023-12-19T17:51:41.870449+0000","last_undegraded":"2023-12-19T17:51:41.870449+0000","last_fullsized":"2023-12-19T17:51:41.870449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.910085+0000","last_change":"2023-12-19T17:51:41.908920+0000","last_active":"2023-12-19T17:51:41.910085+0000","last_peered":"2023-12-19T17:51:41.910085+0000","last_clean":"2023-12-19T17:51:41.910085+0000","last_became_active":"2023-12-19T17:51:41.908497+0000","last_became_peered":"2023-12-19T17:51:41.908497+0000","last_unstale":"2023-12-19T17:51:41.910085+0000","last_undegraded":"2023-12-19T17:51:41.910085+0000","last_fullsized":"2023-12-19T17:51:41.910085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:24.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.878208+0000","last_change":"2023-12-19T17:51:37.857702+0000","last_active":"2023-12-19T17:51:41.878208+0000","last_peered":"2023-12-19T17:51:41.878208+0000","last_clean":"2023-12-19T17:51:41.878208+0000","last_became_active":"2023-12-19T17:51:37.857433+0000","last_became_peered":"2023-12-19T17:51:37.857433+0000","last_unstale":"2023-12-19T17:51:41.878208+0000","last_undegraded":"2023-12-19T17:51:41.878208+0000","last_fullsized":"2023-12-19T17:51:41.878208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880946+0000","last_change":"2023-12-19T17:51:37.362716+0000","last_active":"2023-12-19T17:51:41.880946+0000","last_peered":"2023-12-19T17:51:41.880946+0000","last_clean":"2023-12-19T17:51:41.880946+0000","last_became_active":"2023-12-19T17:51:37.361305+0000","last_became_peered":"2023-12-19T17:51:37.361305+0000","last_unstale":"2023-12-19T17:51:41.880946+0000","last_undegraded":"2023-12-19T17:51:41.880946+0000","last_fullsized":"2023-12-19T17:51:41.880946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897388+0000","last_change":"2023-12-19T17:51:41.893227+0000","last_active":"2023-12-19T17:51:41.897388+0000","last_peered":"2023-12-19T17:51:41.897388+0000","last_clean":"2023-12-19T17:51:41.897388+0000","last_became_active":"2023-12-19T17:51:41.892689+0000","last_became_peered":"2023-12-19T17:51:41.892689+0000","last_unstale":"2023-12-19T17:51:41.897388+0000","last_undegraded":"2023-12-19T17:51:41.897388+0000","last_fullsized":"2023-12-19T17:51:41.897388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:14.243432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861900+0000","last_change":"2023-12-19T17:51:37.870206+0000","last_active":"2023-12-19T17:51:41.861900+0000","last_peered":"2023-12-19T17:51:41.861900+0000","last_clean":"2023-12-19T17:51:41.861900+0000","last_became_active":"2023-12-19T17:51:37.869935+0000","last_became_peered":"2023-12-19T17:51:37.869935+0000","last_unstale":"2023-12-19T17:51:41.861900+0000","last_undegraded":"2023-12-19T17:51:41.861900+0000","last_fullsized":"2023-12-19T17:51:41.861900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:36.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:53.261006+0000","last_change":"2023-12-19T17:51:37.375150+0000","last_active":"2023-12-19T17:51:53.261006+0000","last_peered":"2023-12-19T17:51:53.261006+0000","last_clean":"2023-12-19T17:51:53.261006+0000","last_became_active":"2023-12-19T17:51:37.374662+0000","last_became_peered":"2023-12-19T17:51:37.374662+0000","last_unstale":"2023-12-19T17:51:53.261006+0000","last_undegraded":"2023-12-19T17:51:53.261006+0000","last_fullsized":"2023-12-19T17:51:53.261006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897598+0000","last_change":"2023-12-19T17:51:41.884755+0000","last_active":"2023-12-19T17:51:41.897598+0000","last_peered":"2023-12-19T17:51:41.897598+0000","last_clean":"2023-12-19T17:51:41.897598+0000","last_became_active":"2023-12-19T17:51:41.884141+0000","last_became_peered":"2023-12-19T17:51:41.884141+0000","last_unstale":"2023-12-19T17:51:41.897598+0000","last_undegraded":"2023-12-19T17:51:41.897598+0000","last_fullsized":"2023-12-19T17:51:41.897598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871819+0000","last_change":"2023-12-19T17:51:37.871807+0000","last_active":"2023-12-19T17:51:41.871819+0000","last_peered":"2023-12-19T17:51:41.871819+0000","last_clean":"2023-12-19T17:51:41.871819+0000","last_became_active":"2023-12-19T17:51:37.871521+0000","last_became_peered":"2023-12-19T17:51:37.871521+0000","last_unstale":"2023-12-19T17:51:41.871819+0000","last_undegraded":"2023-12-19T17:51:41.871819+0000","last_fullsized":"2023-12-19T17:51:41.871819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862120+0000","last_change":"2023-12-19T17:51:37.363031+0000","last_active":"2023-12-19T17:51:41.862120+0000","last_peered":"2023-12-19T17:51:41.862120+0000","last_clean":"2023-12-19T17:51:41.862120+0000","last_became_active":"2023-12-19T17:51:37.362756+0000","last_became_peered":"2023-12-19T17:51:37.362756+0000","last_unstale":"2023-12-19T17:51:41.862120+0000","last_undegraded":"2023-12-19T17:51:41.862120+0000","last_fullsized":"2023-12-19T17:51:41.862120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.907191+0000","last_change":"2023-12-19T17:51:41.901238+0000","last_active":"2023-12-19T17:51:41.907191+0000","last_peered":"2023-12-19T17:51:41.907191+0000","last_clean":"2023-12-19T17:51:41.907191+0000","last_became_active":"2023-12-19T17:51:41.900651+0000","last_became_peered":"2023-12-19T17:51:41.900651+0000","last_unstale":"2023-12-19T17:51:41.907191+0000","last_undegraded":"2023-12-19T17:51:41.907191+0000","last_fullsized":"2023-12-19T17:51:41.907191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:12:26.894141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883389+0000","last_change":"2023-12-19T17:51:37.859989+0000","last_active":"2023-12-19T17:51:41.883389+0000","last_peered":"2023-12-19T17:51:41.883389+0000","last_clean":"2023-12-19T17:51:41.883389+0000","last_became_active":"2023-12-19T17:51:37.858483+0000","last_became_peered":"2023-12-19T17:51:37.858483+0000","last_unstale":"2023-12-19T17:51:41.883389+0000","last_undegraded":"2023-12-19T17:51:41.883389+0000","last_fullsized":"2023-12-19T17:51:41.883389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880701+0000","last_change":"2023-12-19T17:51:37.370965+0000","last_active":"2023-12-19T17:51:41.880701+0000","last_peered":"2023-12-19T17:51:41.880701+0000","last_clean":"2023-12-19T17:51:41.880701+0000","last_became_active":"2023-12-19T17:51:37.370062+0000","last_became_peered":"2023-12-19T17:51:37.370062+0000","last_unstale":"2023-12-19T17:51:41.880701+0000","last_undegraded":"2023-12-19T17:51:41.880701+0000","last_fullsized":"2023-12-19T17:51:41.880701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904990+0000","last_change":"2023-12-19T17:51:41.901244+0000","last_active":"2023-12-19T17:51:41.904990+0000","last_peered":"2023-12-19T17:51:41.904990+0000","last_clean":"2023-12-19T17:51:41.904990+0000","last_became_active":"2023-12-19T17:51:41.900797+0000","last_became_peered":"2023-12-19T17:51:41.900797+0000","last_unstale":"2023-12-19T17:51:41.904990+0000","last_undegraded":"2023-12-19T17:51:41.904990+0000","last_fullsized":"2023-12-19T17:51:41.904990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:01.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880682+0000","last_change":"2023-12-19T17:51:37.862402+0000","last_active":"2023-12-19T17:51:41.880682+0000","last_peered":"2023-12-19T17:51:41.880682+0000","last_clean":"2023-12-19T17:51:41.880682+0000","last_became_active":"2023-12-19T17:51:37.862122+0000","last_became_peered":"2023-12-19T17:51:37.862122+0000","last_unstale":"2023-12-19T17:51:41.880682+0000","last_undegraded":"2023-12-19T17:51:41.880682+0000","last_fullsized":"2023-12-19T17:51:41.880682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865202+0000","last_change":"2023-12-19T17:51:37.369300+0000","last_active":"2023-12-19T17:51:41.865202+0000","last_peered":"2023-12-19T17:51:41.865202+0000","last_clean":"2023-12-19T17:51:41.865202+0000","last_became_active":"2023-12-19T17:51:37.368149+0000","last_became_peered":"2023-12-19T17:51:37.368149+0000","last_unstale":"2023-12-19T17:51:41.865202+0000","last_undegraded":"2023-12-19T17:51:41.865202+0000","last_fullsized":"2023-12-19T17:51:41.865202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901092+0000","last_change":"2023-12-19T17:51:41.894673+0000","last_active":"2023-12-19T17:51:41.901092+0000","last_peered":"2023-12-19T17:51:41.901092+0000","last_clean":"2023-12-19T17:51:41.901092+0000","last_became_active":"2023-12-19T17:51:41.893704+0000","last_became_peered":"2023-12-19T17:51:41.893704+0000","last_unstale":"2023-12-19T17:51:41.901092+0000","last_undegraded":"2023-12-19T17:51:41.901092+0000","last_fullsized":"2023-12-19T17:51:41.901092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:54.855527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904181+0000","last_change":"2023-12-19T17:51:41.901728+0000","last_active":"2023-12-19T17:51:41.904181+0000","last_peered":"2023-12-19T17:51:41.904181+0000","last_clean":"2023-12-19T17:51:41.904181+0000","last_became_active":"2023-12-19T17:51:41.900986+0000","last_became_peered":"2023-12-19T17:51:41.900986+0000","last_unstale":"2023-12-19T17:51:41.904181+0000","last_undegraded":"2023-12-19T17:51:41.904181+0000","last_fullsized":"2023-12-19T17:51:41.904181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860494+0000","last_change":"2023-12-19T17:51:37.869238+0000","last_active":"2023-12-19T17:51:41.860494+0000","last_peered":"2023-12-19T17:51:41.860494+0000","last_clean":"2023-12-19T17:51:41.860494+0000","last_became_active":"2023-12-19T17:51:37.868781+0000","last_became_peered":"2023-12-19T17:51:37.868781+0000","last_unstale":"2023-12-19T17:51:41.860494+0000","last_undegraded":"2023-12-19T17:51:41.860494+0000","last_fullsized":"2023-12-19T17:51:41.860494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874862+0000","last_change":"2023-12-19T17:51:37.370627+0000","last_active":"2023-12-19T17:51:41.874862+0000","last_peered":"2023-12-19T17:51:41.874862+0000","last_clean":"2023-12-19T17:51:41.874862+0000","last_became_active":"2023-12-19T17:51:37.366660+0000","last_became_peered":"2023-12-19T17:51:37.366660+0000","last_unstale":"2023-12-19T17:51:41.874862+0000","last_undegraded":"2023-12-19T17:51:41.874862+0000","last_fullsized":"2023-12-19T17:51:41.874862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.891084+0000","last_change":"2023-12-19T17:51:41.884759+0000","last_active":"2023-12-19T17:51:41.891084+0000","last_peered":"2023-12-19T17:51:41.891084+0000","last_clean":"2023-12-19T17:51:41.891084+0000","last_became_active":"2023-12-19T17:51:41.884313+0000","last_became_peered":"2023-12-19T17:51:41.884313+0000","last_unstale":"2023-12-19T17:51:41.891084+0000","last_undegraded":"2023-12-19T17:51:41.891084+0000","last_fullsized":"2023-12-19T17:51:41.891084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:41.801043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871597+0000","last_change":"2023-12-19T17:51:37.861948+0000","last_active":"2023-12-19T17:51:41.871597+0000","last_peered":"2023-12-19T17:51:41.871597+0000","last_clean":"2023-12-19T17:51:41.871597+0000","last_became_active":"2023-12-19T17:51:37.860829+0000","last_became_peered":"2023-12-19T17:51:37.860829+0000","last_unstale":"2023-12-19T17:51:41.871597+0000","last_undegraded":"2023-12-19T17:51:41.871597+0000","last_fullsized":"2023-12-19T17:51:41.871597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875499+0000","last_change":"2023-12-19T17:51:37.370607+0000","last_active":"2023-12-19T17:51:41.875499+0000","last_peered":"2023-12-19T17:51:41.875499+0000","last_clean":"2023-12-19T17:51:41.875499+0000","last_became_active":"2023-12-19T17:51:37.370306+0000","last_became_peered":"2023-12-19T17:51:37.370306+0000","last_unstale":"2023-12-19T17:51:41.875499+0000","last_undegraded":"2023-12-19T17:51:41.875499+0000","last_fullsized":"2023-12-19T17:51:41.875499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:54.261197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863959+0000","last_change":"2023-12-19T17:51:37.367794+0000","last_active":"2023-12-19T17:51:41.863959+0000","last_peered":"2023-12-19T17:51:41.863959+0000","last_clean":"2023-12-19T17:51:41.863959+0000","last_became_active":"2023-12-19T17:51:37.367484+0000","last_became_peered":"2023-12-19T17:51:37.367484+0000","last_unstale":"2023-12-19T17:51:41.863959+0000","last_undegraded":"2023-12-19T17:51:41.863959+0000","last_fullsized":"2023-12-19T17:51:41.863959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880861+0000","last_change":"2023-12-19T17:51:37.866914+0000","last_active":"2023-12-19T17:51:41.880861+0000","last_peered":"2023-12-19T17:51:41.880861+0000","last_clean":"2023-12-19T17:51:41.880861+0000","last_became_active":"2023-12-19T17:51:37.860031+0000","last_became_peered":"2023-12-19T17:51:37.860031+0000","last_unstale":"2023-12-19T17:51:41.880861+0000","last_undegraded":"2023-12-19T17:51:41.880861+0000","last_fullsized":"2023-12-19T17:51:41.880861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892712+0000","last_change":"2023-12-19T17:51:41.888154+0000","last_active":"2023-12-19T17:51:41.892712+0000","last_peered":"2023-12-19T17:51:41.892712+0000","last_clean":"2023-12-19T17:51:41.892712+0000","last_became_active":"2023-12-19T17:51:41.887685+0000","last_became_peered":"2023-12-19T17:51:41.887685+0000","last_unstale":"2023-12-19T17:51:41.892712+0000","last_undegraded":"2023-12-19T17:51:41.892712+0000","last_fullsized":"2023-12-19T17:51:41.892712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:49.694949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874462+0000","last_change":"2023-12-19T17:51:37.373607+0000","last_active":"2023-12-19T17:51:41.874462+0000","last_peered":"2023-12-19T17:51:41.874462+0000","last_clean":"2023-12-19T17:51:41.874462+0000","last_became_active":"2023-12-19T17:51:37.373028+0000","last_became_peered":"2023-12-19T17:51:37.373028+0000","last_unstale":"2023-12-19T17:51:41.874462+0000","last_undegraded":"2023-12-19T17:51:41.874462+0000","last_fullsized":"2023-12-19T17:51:41.874462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:29.861362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872203+0000","last_change":"2023-12-19T17:51:37.853456+0000","last_active":"2023-12-19T17:51:41.872203+0000","last_peered":"2023-12-19T17:51:41.872203+0000","last_clean":"2023-12-19T17:51:41.872203+0000","last_became_active":"2023-12-19T17:51:37.853073+0000","last_became_peered":"2023-12-19T17:51:37.853073+0000","last_unstale":"2023-12-19T17:51:41.872203+0000","last_undegraded":"2023-12-19T17:51:41.872203+0000","last_fullsized":"2023-12-19T17:51:41.872203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:56.244495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904914+0000","last_change":"2023-12-19T17:51:41.903216+0000","last_active":"2023-12-19T17:51:41.904914+0000","last_peered":"2023-12-19T17:51:41.904914+0000","last_clean":"2023-12-19T17:51:41.904914+0000","last_became_active":"2023-12-19T17:51:41.902823+0000","last_became_peered":"2023-12-19T17:51:41.902823+0000","last_unstale":"2023-12-19T17:51:41.904914+0000","last_undegraded":"2023-12-19T17:51:41.904914+0000","last_fullsized":"2023-12-19T17:51:41.904914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:32.887544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862464+0000","last_change":"2023-12-19T17:51:37.874316+0000","last_active":"2023-12-19T17:51:41.862464+0000","last_peered":"2023-12-19T17:51:41.862464+0000","last_clean":"2023-12-19T17:51:41.862464+0000","last_became_active":"2023-12-19T17:51:37.873086+0000","last_became_peered":"2023-12-19T17:51:37.873086+0000","last_unstale":"2023-12-19T17:51:41.862464+0000","last_undegraded":"2023-12-19T17:51:41.862464+0000","last_fullsized":"2023-12-19T17:51:41.862464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870124+0000","last_change":"2023-12-19T17:51:37.850435+0000","last_active":"2023-12-19T17:51:41.870124+0000","last_peered":"2023-12-19T17:51:41.870124+0000","last_clean":"2023-12-19T17:51:41.870124+0000","last_became_active":"2023-12-19T17:51:37.849426+0000","last_became_peered":"2023-12-19T17:51:37.849426+0000","last_unstale":"2023-12-19T17:51:41.870124+0000","last_undegraded":"2023-12-19T17:51:41.870124+0000","last_fullsized":"2023-12-19T17:51:41.870124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870410+0000","last_change":"2023-12-19T17:51:37.878151+0000","last_active":"2023-12-19T17:51:41.870410+0000","last_peered":"2023-12-19T17:51:41.870410+0000","last_clean":"2023-12-19T17:51:41.870410+0000","last_became_active":"2023-12-19T17:51:37.877950+0000","last_became_peered":"2023-12-19T17:51:37.877950+0000","last_unstale":"2023-12-19T17:51:41.870410+0000","last_undegraded":"2023-12-19T17:51:41.870410+0000","last_fullsized":"2023-12-19T17:51:41.870410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880786+0000","last_change":"2023-12-19T17:51:37.873480+0000","last_active":"2023-12-19T17:51:41.880786+0000","last_peered":"2023-12-19T17:51:41.880786+0000","last_clean":"2023-12-19T17:51:41.880786+0000","last_became_active":"2023-12-19T17:51:37.873217+0000","last_became_peered":"2023-12-19T17:51:37.873217+0000","last_unstale":"2023-12-19T17:51:41.880786+0000","last_undegraded":"2023-12-19T17:51:41.880786+0000","last_fullsized":"2023-12-19T17:51:41.880786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877566+0000","last_change":"2023-12-19T17:51:37.862909+0000","last_active":"2023-12-19T17:51:41.877566+0000","last_peered":"2023-12-19T17:51:41.877566+0000","last_clean":"2023-12-19T17:51:41.877566+0000","last_became_active":"2023-12-19T17:51:37.862582+0000","last_became_peered":"2023-12-19T17:51:37.862582+0000","last_unstale":"2023-12-19T17:51:41.877566+0000","last_undegraded":"2023-12-19T17:51:41.877566+0000","last_fullsized":"2023-12-19T17:51:41.877566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861447+0000","last_change":"2023-12-19T17:51:37.864245+0000","last_active":"2023-12-19T17:51:41.861447+0000","last_peered":"2023-12-19T17:51:41.861447+0000","last_clean":"2023-12-19T17:51:41.861447+0000","last_became_active":"2023-12-19T17:51:37.863824+0000","last_became_peered":"2023-12-19T17:51:37.863824+0000","last_unstale":"2023-12-19T17:51:41.861447+0000","last_undegraded":"2023-12-19T17:51:41.861447+0000","last_fullsized":"2023-12-19T17:51:41.861447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862736+0000","last_change":"2023-12-19T17:51:37.878924+0000","last_active":"2023-12-19T17:51:41.862736+0000","last_peered":"2023-12-19T17:51:41.862736+0000","last_clean":"2023-12-19T17:51:41.862736+0000","last_became_active":"2023-12-19T17:51:37.875497+0000","last_became_peered":"2023-12-19T17:51:37.875497+0000","last_unstale":"2023-12-19T17:51:41.862736+0000","last_undegraded":"2023-12-19T17:51:41.862736+0000","last_fullsized":"2023-12-19T17:51:41.862736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881391+0000","last_change":"2023-12-19T17:51:37.863018+0000","last_active":"2023-12-19T17:51:41.881391+0000","last_peered":"2023-12-19T17:51:41.881391+0000","last_clean":"2023-12-19T17:51:41.881391+0000","last_became_active":"2023-12-19T17:51:37.862800+0000","last_became_peered":"2023-12-19T17:51:37.862800+0000","last_unstale":"2023-12-19T17:51:41.881391+0000","last_undegraded":"2023-12-19T17:51:41.881391+0000","last_fullsized":"2023-12-19T17:51:41.881391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874580+0000","last_change":"2023-12-19T17:51:37.864066+0000","last_active":"2023-12-19T17:51:41.874580+0000","last_peered":"2023-12-19T17:51:41.874580+0000","last_clean":"2023-12-19T17:51:41.874580+0000","last_became_active":"2023-12-19T17:51:37.863848+0000","last_became_peered":"2023-12-19T17:51:37.863848+0000","last_unstale":"2023-12-19T17:51:41.874580+0000","last_undegraded":"2023-12-19T17:51:41.874580+0000","last_fullsized":"2023-12-19T17:51:41.874580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875414+0000","last_change":"2023-12-19T17:51:37.877889+0000","last_active":"2023-12-19T17:51:41.875414+0000","last_peered":"2023-12-19T17:51:41.875414+0000","last_clean":"2023-12-19T17:51:41.875414+0000","last_became_active":"2023-12-19T17:51:37.877109+0000","last_became_peered":"2023-12-19T17:51:37.877109+0000","last_unstale":"2023-12-19T17:51:41.875414+0000","last_undegraded":"2023-12-19T17:51:41.875414+0000","last_fullsized":"2023-12-19T17:51:41.875414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870359+0000","last_change":"2023-12-19T17:51:37.857037+0000","last_active":"2023-12-19T17:51:41.870359+0000","last_peered":"2023-12-19T17:51:41.870359+0000","last_clean":"2023-12-19T17:51:41.870359+0000","last_became_active":"2023-12-19T17:51:37.856790+0000","last_became_peered":"2023-12-19T17:51:37.856790+0000","last_unstale":"2023-12-19T17:51:41.870359+0000","last_undegraded":"2023-12-19T17:51:41.870359+0000","last_fullsized":"2023-12-19T17:51:41.870359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880706+0000","last_change":"2023-12-19T17:51:37.857822+0000","last_active":"2023-12-19T17:51:41.880706+0000","last_peered":"2023-12-19T17:51:41.880706+0000","last_clean":"2023-12-19T17:51:41.880706+0000","last_became_active":"2023-12-19T17:51:37.855549+0000","last_became_peered":"2023-12-19T17:51:37.855549+0000","last_unstale":"2023-12-19T17:51:41.880706+0000","last_undegraded":"2023-12-19T17:51:41.880706+0000","last_fullsized":"2023-12-19T17:51:41.880706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.864155+0000","last_change":"2023-12-19T17:51:37.860504+0000","last_active":"2023-12-19T17:51:41.864155+0000","last_peered":"2023-12-19T17:51:41.864155+0000","last_clean":"2023-12-19T17:51:41.864155+0000","last_became_active":"2023-12-19T17:51:37.860153+0000","last_became_peered":"2023-12-19T17:51:37.860153+0000","last_unstale":"2023-12-19T17:51:41.864155+0000","last_undegraded":"2023-12-19T17:51:41.864155+0000","last_fullsized":"2023-12-19T17:51:41.864155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863155+0000","last_change":"2023-12-19T17:51:37.861734+0000","last_active":"2023-12-19T17:51:41.863155+0000","last_peered":"2023-12-19T17:51:41.863155+0000","last_clean":"2023-12-19T17:51:41.863155+0000","last_became_active":"2023-12-19T17:51:37.855703+0000","last_became_peered":"2023-12-19T17:51:37.855703+0000","last_unstale":"2023-12-19T17:51:41.863155+0000","last_undegraded":"2023-12-19T17:51:41.863155+0000","last_fullsized":"2023-12-19T17:51:41.863155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873169+0000","last_change":"2023-12-19T17:51:37.860944+0000","last_active":"2023-12-19T17:51:41.873169+0000","last_peered":"2023-12-19T17:51:41.873169+0000","last_clean":"2023-12-19T17:51:41.873169+0000","last_became_active":"2023-12-19T17:51:37.860435+0000","last_became_peered":"2023-12-19T17:51:37.860435+0000","last_unstale":"2023-12-19T17:51:41.873169+0000","last_undegraded":"2023-12-19T17:51:41.873169+0000","last_fullsized":"2023-12-19T17:51:41.873169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:26.638861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875676+0000","last_change":"2023-12-19T17:51:37.871267+0000","last_active":"2023-12-19T17:51:41.875676+0000","last_peered":"2023-12-19T17:51:41.875676+0000","last_clean":"2023-12-19T17:51:41.875676+0000","last_became_active":"2023-12-19T17:51:37.871093+0000","last_became_peered":"2023-12-19T17:51:37.871093+0000","last_unstale":"2023-12-19T17:51:41.875676+0000","last_undegraded":"2023-12-19T17:51:41.875676+0000","last_fullsized":"2023-12-19T17:51:41.875676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874498+0000","last_change":"2023-12-19T17:51:37.859001+0000","last_active":"2023-12-19T17:51:41.874498+0000","last_peered":"2023-12-19T17:51:41.874498+0000","last_clean":"2023-12-19T17:51:41.874498+0000","last_became_active":"2023-12-19T17:51:37.858756+0000","last_became_peered":"2023-12-19T17:51:37.858756+0000","last_unstale":"2023-12-19T17:51:41.874498+0000","last_undegraded":"2023-12-19T17:51:41.874498+0000","last_fullsized":"2023-12-19T17:51:41.874498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860552+0000","last_change":"2023-12-19T17:51:37.869034+0000","last_active":"2023-12-19T17:51:41.860552+0000","last_peered":"2023-12-19T17:51:41.860552+0000","last_clean":"2023-12-19T17:51:41.860552+0000","last_became_active":"2023-12-19T17:51:37.868411+0000","last_became_peered":"2023-12-19T17:51:37.868411+0000","last_unstale":"2023-12-19T17:51:41.860552+0000","last_undegraded":"2023-12-19T17:51:41.860552+0000","last_fullsized":"2023-12-19T17:51:41.860552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877952+0000","last_change":"2023-12-19T17:51:37.851059+0000","last_active":"2023-12-19T17:51:41.877952+0000","last_peered":"2023-12-19T17:51:41.877952+0000","last_clean":"2023-12-19T17:51:41.877952+0000","last_became_active":"2023-12-19T17:51:37.850723+0000","last_became_peered":"2023-12-19T17:51:37.850723+0000","last_unstale":"2023-12-19T17:51:41.877952+0000","last_undegraded":"2023-12-19T17:51:41.877952+0000","last_fullsized":"2023-12-19T17:51:41.877952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874288+0000","last_change":"2023-12-19T17:51:37.866674+0000","last_active":"2023-12-19T17:51:41.874288+0000","last_peered":"2023-12-19T17:51:41.874288+0000","last_clean":"2023-12-19T17:51:41.874288+0000","last_became_active":"2023-12-19T17:51:37.865470+0000","last_became_peered":"2023-12-19T17:51:37.865470+0000","last_unstale":"2023-12-19T17:51:41.874288+0000","last_undegraded":"2023-12-19T17:51:41.874288+0000","last_fullsized":"2023-12-19T17:51:41.874288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871739+0000","last_change":"2023-12-19T17:51:37.875330+0000","last_active":"2023-12-19T17:51:41.871739+0000","last_peered":"2023-12-19T17:51:41.871739+0000","last_clean":"2023-12-19T17:51:41.871739+0000","last_became_active":"2023-12-19T17:51:37.874974+0000","last_became_peered":"2023-12-19T17:51:37.874974+0000","last_unstale":"2023-12-19T17:51:41.871739+0000","last_undegraded":"2023-12-19T17:51:41.871739+0000","last_fullsized":"2023-12-19T17:51:41.871739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:42.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865979+0000","last_change":"2023-12-19T17:51:37.875506+0000","last_active":"2023-12-19T17:51:41.865979+0000","last_peered":"2023-12-19T17:51:41.865979+0000","last_clean":"2023-12-19T17:51:41.865979+0000","last_became_active":"2023-12-19T17:51:37.875016+0000","last_became_peered":"2023-12-19T17:51:37.875016+0000","last_unstale":"2023-12-19T17:51:41.865979+0000","last_undegraded":"2023-12-19T17:51:41.865979+0000","last_fullsized":"2023-12-19T17:51:41.865979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862619+0000","last_change":"2023-12-19T17:51:37.878903+0000","last_active":"2023-12-19T17:51:41.862619+0000","last_peered":"2023-12-19T17:51:41.862619+0000","last_clean":"2023-12-19T17:51:41.862619+0000","last_became_active":"2023-12-19T17:51:37.874964+0000","last_became_peered":"2023-12-19T17:51:37.874964+0000","last_unstale":"2023-12-19T17:51:41.862619+0000","last_undegraded":"2023-12-19T17:51:41.862619+0000","last_fullsized":"2023-12-19T17:51:41.862619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863340+0000","last_change":"2023-12-19T17:51:37.858908+0000","last_active":"2023-12-19T17:51:41.863340+0000","last_peered":"2023-12-19T17:51:41.863340+0000","last_clean":"2023-12-19T17:51:41.863340+0000","last_became_active":"2023-12-19T17:51:37.858336+0000","last_became_peered":"2023-12-19T17:51:37.858336+0000","last_unstale":"2023-12-19T17:51:41.863340+0000","last_undegraded":"2023-12-19T17:51:41.863340+0000","last_fullsized":"2023-12-19T17:51:41.863340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871491+0000","last_change":"2023-12-19T17:51:37.862607+0000","last_active":"2023-12-19T17:51:41.871491+0000","last_peered":"2023-12-19T17:51:41.871491+0000","last_clean":"2023-12-19T17:51:41.871491+0000","last_became_active":"2023-12-19T17:51:37.862159+0000","last_became_peered":"2023-12-19T17:51:37.862159+0000","last_unstale":"2023-12-19T17:51:41.871491+0000","last_undegraded":"2023-12-19T17:51:41.871491+0000","last_fullsized":"2023-12-19T17:51:41.871491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861454+0000","last_change":"2023-12-19T17:51:37.848444+0000","last_active":"2023-12-19T17:51:41.861454+0000","last_peered":"2023-12-19T17:51:41.861454+0000","last_clean":"2023-12-19T17:51:41.861454+0000","last_became_active":"2023-12-19T17:51:37.848141+0000","last_became_peered":"2023-12-19T17:51:37.848141+0000","last_unstale":"2023-12-19T17:51:41.861454+0000","last_undegraded":"2023-12-19T17:51:41.861454+0000","last_fullsized":"2023-12-19T17:51:41.861454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870323+0000","last_change":"2023-12-19T17:51:37.859778+0000","last_active":"2023-12-19T17:51:41.870323+0000","last_peered":"2023-12-19T17:51:41.870323+0000","last_clean":"2023-12-19T17:51:41.870323+0000","last_became_active":"2023-12-19T17:51:37.859521+0000","last_became_peered":"2023-12-19T17:51:37.859521+0000","last_unstale":"2023-12-19T17:51:41.870323+0000","last_undegraded":"2023-12-19T17:51:41.870323+0000","last_fullsized":"2023-12-19T17:51:41.870323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861746+0000","last_change":"2023-12-19T17:51:37.848789+0000","last_active":"2023-12-19T17:51:41.861746+0000","last_peered":"2023-12-19T17:51:41.861746+0000","last_clean":"2023-12-19T17:51:41.861746+0000","last_became_active":"2023-12-19T17:51:37.848533+0000","last_became_peered":"2023-12-19T17:51:37.848533+0000","last_unstale":"2023-12-19T17:51:41.861746+0000","last_undegraded":"2023-12-19T17:51:41.861746+0000","last_fullsized":"2023-12-19T17:51:41.861746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873893+0000","last_change":"2023-12-19T17:51:37.878808+0000","last_active":"2023-12-19T17:51:41.873893+0000","last_peered":"2023-12-19T17:51:41.873893+0000","last_clean":"2023-12-19T17:51:41.873893+0000","last_became_active":"2023-12-19T17:51:37.878550+0000","last_became_peered":"2023-12-19T17:51:37.878550+0000","last_unstale":"2023-12-19T17:51:41.873893+0000","last_undegraded":"2023-12-19T17:51:41.873893+0000","last_fullsized":"2023-12-19T17:51:41.873893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880534+0000","last_change":"2023-12-19T17:51:37.842584+0000","last_active":"2023-12-19T17:51:41.880534+0000","last_peered":"2023-12-19T17:51:41.880534+0000","last_clean":"2023-12-19T17:51:41.880534+0000","last_became_active":"2023-12-19T17:51:37.842230+0000","last_became_peered":"2023-12-19T17:51:37.842230+0000","last_unstale":"2023-12-19T17:51:41.880534+0000","last_undegraded":"2023-12-19T17:51:41.880534+0000","last_fullsized":"2023-12-19T17:51:41.880534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861715+0000","last_change":"2023-12-19T17:51:37.866251+0000","last_active":"2023-12-19T17:51:41.861715+0000","last_peered":"2023-12-19T17:51:41.861715+0000","last_clean":"2023-12-19T17:51:41.861715+0000","last_became_active":"2023-12-19T17:51:37.865954+0000","last_became_peered":"2023-12-19T17:51:37.865954+0000","last_unstale":"2023-12-19T17:51:41.861715+0000","last_undegraded":"2023-12-19T17:51:41.861715+0000","last_fullsized":"2023-12-19T17:51:41.861715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863303+0000","last_change":"2023-12-19T17:51:37.869240+0000","last_active":"2023-12-19T17:51:41.863303+0000","last_peered":"2023-12-19T17:51:41.863303+0000","last_clean":"2023-12-19T17:51:41.863303+0000","last_became_active":"2023-12-19T17:51:37.868451+0000","last_became_peered":"2023-12-19T17:51:37.868451+0000","last_unstale":"2023-12-19T17:51:41.863303+0000","last_undegraded":"2023-12-19T17:51:41.863303+0000","last_fullsized":"2023-12-19T17:51:41.863303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:52:03.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:52:03.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.926+0000 7f7d2840a700 1 Processor -- start 2023-12-19T17:52:03.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d2840a700 1 -- start start 2023-12-19T17:52:03.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d2840a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d2006f4a0 0x7f7d200d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d2840a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d420 0x7f7d200d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d2840a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d200b6060 con 0x7f7d2015d040 2023-12-19T17:52:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d2840a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2006f930 con 0x7f7d2006f4a0 2023-12-19T17:52:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d2840a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2006fc10 con 0x7f7d2015d420 2023-12-19T17:52:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d259a5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d2006f4a0 0x7f7d200d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d261a6700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7d2015d040 0x7f7d200cdf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51188/0 (socket says 172.21.15.45:51188) 2023-12-19T17:52:03.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d261a6700 1 -- 172.21.15.45:0/3602794310 learned_addr learned my addr 172.21.15.45:0/3602794310 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d269a7700 1 --2- 172.21.15.45:0/3602794310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d420 0x7f7d200d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d259a5700 1 -- 172.21.15.45:0/3602794310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d420 msgr2=0x7f7d200d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d259a5700 1 --2- 172.21.15.45:0/3602794310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d420 0x7f7d200d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d259a5700 1 -- 172.21.15.45:0/3602794310 >> v1:172.21.15.73:6789/0 conn(0x7f7d2015d040 legacy=0x7f7d200cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d259a5700 1 -- 172.21.15.45:0/3602794310 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2006fef0 con 0x7f7d2006f4a0 2023-12-19T17:52:03.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.930+0000 7f7d251a4700 1 -- 172.21.15.45:0/3602794310 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256654403 0 0) 0x7f7d200b6060 con 0x7f7d2015d040 2023-12-19T17:52:03.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d259a5700 1 --2- 172.21.15.45:0/3602794310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2006f4a0 0x7f7d200d21a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009850 tx=0x7f7d10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eecb05a16a950c43 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d251a4700 1 -- 172.21.15.45:0/3602794310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011830 con 0x7f7d2006f4a0 2023-12-19T17:52:03.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d251a4700 1 -- 172.21.15.45:0/3602794310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d10011990 con 0x7f7d2006f4a0 2023-12-19T17:52:03.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d251a4700 1 -- 172.21.15.45:0/3602794310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011d40 con 0x7f7d2006f4a0 2023-12-19T17:52:03.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 -- 172.21.15.45:0/3602794310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2006f4a0 msgr2=0x7f7d200d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 --2- 172.21.15.45:0/3602794310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2006f4a0 0x7f7d200d21a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f7d10009850 tx=0x7f7d10009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:03.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 -- 172.21.15.45:0/3602794310 shutdown_connections 2023-12-19T17:52:03.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 --2- 172.21.15.45:0/3602794310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d420 0x7f7d200d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 --2- 172.21.15.45:0/3602794310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2006f4a0 0x7f7d200d21a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 -- 172.21.15.45:0/3602794310 >> 172.21.15.45:0/3602794310 conn(0x7f7d200d2e50 msgr2=0x7f7d200d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:03.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 -- 172.21.15.45:0/3602794310 shutdown_connections 2023-12-19T17:52:03.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.934+0000 7f7d2840a700 1 -- 172.21.15.45:0/3602794310 wait complete. 2023-12-19T17:52:03.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 Processor -- start 2023-12-19T17:52:03.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 -- start start 2023-12-19T17:52:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d040 0x7f7d20149f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d2015d420 0x7f7d2015f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 0x7f7d2015f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2015fff0 con 0x7f7d2014a470 2023-12-19T17:52:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d201602d0 con 0x7f7d2015d420 2023-12-19T17:52:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d2840a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d201605b0 con 0x7f7d2015d040 2023-12-19T17:52:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 0x7f7d2015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d261a6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d040 0x7f7d20149f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 0x7f7d2015f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37840/0 (socket says 172.21.15.45:37840) 2023-12-19T17:52:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 -- 172.21.15.45:0/832281200 learned_addr learned my addr 172.21.15.45:0/832281200 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d259a5700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d2015d420 0x7f7d2015f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 -- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d040 msgr2=0x7f7d20149f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d040 0x7f7d20149f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 -- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d2015d420 msgr2=0x7f7d2015f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d2015d420 0x7f7d2015f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.938+0000 7f7d269a7700 1 -- 172.21.15.45:0/832281200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d100094b0 con 0x7f7d2014a470 2023-12-19T17:52:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d269a7700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 0x7f7d2015f770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ef90 tx=0x7f7d18009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d18009b20 con 0x7f7d2014a470 2023-12-19T17:52:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d1800f040 con 0x7f7d2014a470 2023-12-19T17:52:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800cc70 con 0x7f7d2014a470 2023-12-19T17:52:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d20160890 con 0x7f7d2014a470 2023-12-19T17:52:03.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d20158590 con 0x7f7d2014a470 2023-12-19T17:52:03.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.942+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2004ed30 con 0x7f7d2014a470 2023-12-19T17:52:03.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.946+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d18014480 con 0x7f7d2014a470 2023-12-19T17:52:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.946+0000 7f7d16ffd700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d04065ad0 0x7f7d04067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.946+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d18083e10 con 0x7f7d2014a470 2023-12-19T17:52:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.946+0000 7f7d261a6700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d04065ad0 0x7f7d04067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.946+0000 7f7d261a6700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d04065ad0 0x7f7d04067f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c000f60 tx=0x7f7d1c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:03.954+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d18087030 con 0x7f7d2014a470 2023-12-19T17:52:04.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.130+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d200ce630 con 0x7f7d04065ad0 2023-12-19T17:52:04.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.150+0000 7f7d16ffd700 1 -- 172.21.15.45:0/832281200 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345125 (secure 0 0 0) 0x7f7d1c00f690 con 0x7f7d04065ad0 2023-12-19T17:52:04.154 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d04065ad0 msgr2=0x7f7d04067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d04065ad0 0x7f7d04067f90 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7d1c000f60 tx=0x7f7d1c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 msgr2=0x7f7d2015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 0x7f7d2015f770 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7d1800ef90 tx=0x7f7d18009f60 comp rx=0 tx=0).stop 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 shutdown_connections 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d04065ad0 0x7f7d04067f90 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d2014a470 0x7f7d2015f770 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d2015d420 0x7f7d2015f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 --2- 172.21.15.45:0/832281200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d2015d040 0x7f7d20149f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 >> 172.21.15.45:0/832281200 conn(0x7f7d200d2e50 msgr2=0x7f7d200cda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 shutdown_connections 2023-12-19T17:52:04.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.158+0000 7f7d2840a700 1 -- 172.21.15.45:0/832281200 wait complete. 2023-12-19T17:52:04.164 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:52:04.182 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-12-19T17:52:02.200685+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222916,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751804,"statfs":{"total":773094113280,"available":772865847296,"internally_reserved":0,"allocated":3280896,"data_stored":1987143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2231,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005530"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883478+0000","last_change":"2023-12-19T17:51:37.371560+0000","last_active":"2023-12-19T17:51:41.883478+0000","last_peered":"2023-12-19T17:51:41.883478+0000","last_clean":"2023-12-19T17:51:41.883478+0000","last_became_active":"2023-12-19T17:51:37.368980+0000","last_became_peered":"2023-12-19T17:51:37.368980+0000","last_unstale":"2023-12-19T17:51:41.883478+0000","last_undegraded":"2023-12-19T17:51:41.883478+0000","last_fullsized":"2023-12-19T17:51:41.883478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881409+0000","last_change":"2023-12-19T17:51:37.863698+0000","last_active":"2023-12-19T17:51:41.881409+0000","last_peered":"2023-12-19T17:51:41.881409+0000","last_clean":"2023-12-19T17:51:41.881409+0000","last_became_active":"2023-12-19T17:51:37.863369+0000","last_became_peered":"2023-12-19T17:51:37.863369+0000","last_unstale":"2023-12-19T17:51:41.881409+0000","last_undegraded":"2023-12-19T17:51:41.881409+0000","last_fullsized":"2023-12-19T17:51:41.881409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901112+0000","last_change":"2023-12-19T17:51:41.894945+0000","last_active":"2023-12-19T17:51:41.901112+0000","last_peered":"2023-12-19T17:51:41.901112+0000","last_clean":"2023-12-19T17:51:41.901112+0000","last_became_active":"2023-12-19T17:51:41.894291+0000","last_became_peered":"2023-12-19T17:51:41.894291+0000","last_unstale":"2023-12-19T17:51:41.901112+0000","last_undegraded":"2023-12-19T17:51:41.901112+0000","last_fullsized":"2023-12-19T17:51:41.901112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881515+0000","last_change":"2023-12-19T17:51:37.371310+0000","last_active":"2023-12-19T17:51:41.881515+0000","last_peered":"2023-12-19T17:51:41.881515+0000","last_clean":"2023-12-19T17:51:41.881515+0000","last_became_active":"2023-12-19T17:51:37.370946+0000","last_became_peered":"2023-12-19T17:51:37.370946+0000","last_unstale":"2023-12-19T17:51:41.881515+0000","last_undegraded":"2023-12-19T17:51:41.881515+0000","last_fullsized":"2023-12-19T17:51:41.881515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881893+0000","last_change":"2023-12-19T17:51:37.859332+0000","last_active":"2023-12-19T17:51:41.881893+0000","last_peered":"2023-12-19T17:51:41.881893+0000","last_clean":"2023-12-19T17:51:41.881893+0000","last_became_active":"2023-12-19T17:51:37.858295+0000","last_became_peered":"2023-12-19T17:51:37.858295+0000","last_unstale":"2023-12-19T17:51:41.881893+0000","last_undegraded":"2023-12-19T17:51:41.881893+0000","last_fullsized":"2023-12-19T17:51:41.881893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904185+0000","last_change":"2023-12-19T17:51:41.894941+0000","last_active":"2023-12-19T17:51:41.904185+0000","last_peered":"2023-12-19T17:51:41.904185+0000","last_clean":"2023-12-19T17:51:41.904185+0000","last_became_active":"2023-12-19T17:51:41.894354+0000","last_became_peered":"2023-12-19T17:51:41.894354+0000","last_unstale":"2023-12-19T17:51:41.904185+0000","last_undegraded":"2023-12-19T17:51:41.904185+0000","last_fullsized":"2023-12-19T17:51:41.904185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:24.899374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863045+0000","last_change":"2023-12-19T17:51:37.373590+0000","last_active":"2023-12-19T17:51:41.863045+0000","last_peered":"2023-12-19T17:51:41.863045+0000","last_clean":"2023-12-19T17:51:41.863045+0000","last_became_active":"2023-12-19T17:51:37.372932+0000","last_became_peered":"2023-12-19T17:51:37.372932+0000","last_unstale":"2023-12-19T17:51:41.863045+0000","last_undegraded":"2023-12-19T17:51:41.863045+0000","last_fullsized":"2023-12-19T17:51:41.863045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:41.180593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873974+0000","last_change":"2023-12-19T17:51:37.854515+0000","last_active":"2023-12-19T17:51:41.873974+0000","last_peered":"2023-12-19T17:51:41.873974+0000","last_clean":"2023-12-19T17:51:41.873974+0000","last_became_active":"2023-12-19T17:51:37.852250+0000","last_became_peered":"2023-12-19T17:51:37.852250+0000","last_unstale":"2023-12-19T17:51:41.873974+0000","last_undegraded":"2023-12-19T17:51:41.873974+0000","last_fullsized":"2023-12-19T17:51:41.873974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.913316+0000","last_change":"2023-12-19T17:51:41.912325+0000","last_active":"2023-12-19T17:51:41.913316+0000","last_peered":"2023-12-19T17:51:41.913316+0000","last_clean":"2023-12-19T17:51:41.913316+0000","last_became_active":"2023-12-19T17:51:41.907565+0000","last_became_peered":"2023-12-19T17:51:41.907565+0000","last_unstale":"2023-12-19T17:51:41.913316+0000","last_undegraded":"2023-12-19T17:51:41.913316+0000","last_fullsized":"2023-12-19T17:51:41.913316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863667+0000","last_change":"2023-12-19T17:51:37.375079+0000","last_active":"2023-12-19T17:51:41.863667+0000","last_peered":"2023-12-19T17:51:41.863667+0000","last_clean":"2023-12-19T17:51:41.863667+0000","last_became_active":"2023-12-19T17:51:37.373363+0000","last_became_peered":"2023-12-19T17:51:37.373363+0000","last_unstale":"2023-12-19T17:51:41.863667+0000","last_undegraded":"2023-12-19T17:51:41.863667+0000","last_fullsized":"2023-12-19T17:51:41.863667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:05.345443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874581+0000","last_change":"2023-12-19T17:51:37.854134+0000","last_active":"2023-12-19T17:51:41.874581+0000","last_peered":"2023-12-19T17:51:41.874581+0000","last_clean":"2023-12-19T17:51:41.874581+0000","last_became_active":"2023-12-19T17:51:37.852585+0000","last_became_peered":"2023-12-19T17:51:37.852585+0000","last_unstale":"2023-12-19T17:51:41.874581+0000","last_undegraded":"2023-12-19T17:51:41.874581+0000","last_fullsized":"2023-12-19T17:51:41.874581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892187+0000","last_change":"2023-12-19T17:51:41.886590+0000","last_active":"2023-12-19T17:51:41.892187+0000","last_peered":"2023-12-19T17:51:41.892187+0000","last_clean":"2023-12-19T17:51:41.892187+0000","last_became_active":"2023-12-19T17:51:41.885064+0000","last_became_peered":"2023-12-19T17:51:41.885064+0000","last_unstale":"2023-12-19T17:51:41.892187+0000","last_undegraded":"2023-12-19T17:51:41.892187+0000","last_fullsized":"2023-12-19T17:51:41.892187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:06.290013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863854+0000","last_change":"2023-12-19T17:51:37.860517+0000","last_active":"2023-12-19T17:51:41.863854+0000","last_peered":"2023-12-19T17:51:41.863854+0000","last_clean":"2023-12-19T17:51:41.863854+0000","last_became_active":"2023-12-19T17:51:37.860222+0000","last_became_peered":"2023-12-19T17:51:37.860222+0000","last_unstale":"2023-12-19T17:51:41.863854+0000","last_undegraded":"2023-12-19T17:51:41.863854+0000","last_fullsized":"2023-12-19T17:51:41.863854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861865+0000","last_change":"2023-12-19T17:51:37.374087+0000","last_active":"2023-12-19T17:51:41.861865+0000","last_peered":"2023-12-19T17:51:41.861865+0000","last_clean":"2023-12-19T17:51:41.861865+0000","last_became_active":"2023-12-19T17:51:37.373661+0000","last_became_peered":"2023-12-19T17:51:37.373661+0000","last_unstale":"2023-12-19T17:51:41.861865+0000","last_undegraded":"2023-12-19T17:51:41.861865+0000","last_fullsized":"2023-12-19T17:51:41.861865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:25.625813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892353+0000","last_change":"2023-12-19T17:51:41.885394+0000","last_active":"2023-12-19T17:51:41.892353+0000","last_peered":"2023-12-19T17:51:41.892353+0000","last_clean":"2023-12-19T17:51:41.892353+0000","last_became_active":"2023-12-19T17:51:41.884923+0000","last_became_peered":"2023-12-19T17:51:41.884923+0000","last_unstale":"2023-12-19T17:51:41.892353+0000","last_undegraded":"2023-12-19T17:51:41.892353+0000","last_fullsized":"2023-12-19T17:51:41.892353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:01.021272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874374+0000","last_change":"2023-12-19T17:51:37.861671+0000","last_active":"2023-12-19T17:51:41.874374+0000","last_peered":"2023-12-19T17:51:41.874374+0000","last_clean":"2023-12-19T17:51:41.874374+0000","last_became_active":"2023-12-19T17:51:37.860880+0000","last_became_peered":"2023-12-19T17:51:37.860880+0000","last_unstale":"2023-12-19T17:51:41.874374+0000","last_undegraded":"2023-12-19T17:51:41.874374+0000","last_fullsized":"2023-12-19T17:51:41.874374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862370+0000","last_change":"2023-12-19T17:51:37.365041+0000","last_active":"2023-12-19T17:51:41.862370+0000","last_peered":"2023-12-19T17:51:41.862370+0000","last_clean":"2023-12-19T17:51:41.862370+0000","last_became_active":"2023-12-19T17:51:37.364574+0000","last_became_peered":"2023-12-19T17:51:37.364574+0000","last_unstale":"2023-12-19T17:51:41.862370+0000","last_undegraded":"2023-12-19T17:51:41.862370+0000","last_fullsized":"2023-12-19T17:51:41.862370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.903630+0000","last_change":"2023-12-19T17:51:41.894392+0000","last_active":"2023-12-19T17:51:41.903630+0000","last_peered":"2023-12-19T17:51:41.903630+0000","last_clean":"2023-12-19T17:51:41.903630+0000","last_became_active":"2023-12-19T17:51:41.893912+0000","last_became_peered":"2023-12-19T17:51:41.893912+0000","last_unstale":"2023-12-19T17:51:41.903630+0000","last_undegraded":"2023-12-19T17:51:41.903630+0000","last_fullsized":"2023-12-19T17:51:41.903630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871673+0000","last_change":"2023-12-19T17:51:37.878509+0000","last_active":"2023-12-19T17:51:41.871673+0000","last_peered":"2023-12-19T17:51:41.871673+0000","last_clean":"2023-12-19T17:51:41.871673+0000","last_became_active":"2023-12-19T17:51:37.878267+0000","last_became_peered":"2023-12-19T17:51:37.878267+0000","last_unstale":"2023-12-19T17:51:41.871673+0000","last_undegraded":"2023-12-19T17:51:41.871673+0000","last_fullsized":"2023-12-19T17:51:41.871673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860703+0000","last_change":"2023-12-19T17:51:37.361332+0000","last_active":"2023-12-19T17:51:41.860703+0000","last_peered":"2023-12-19T17:51:41.860703+0000","last_clean":"2023-12-19T17:51:41.860703+0000","last_became_active":"2023-12-19T17:51:37.359992+0000","last_became_peered":"2023-12-19T17:51:37.359992+0000","last_unstale":"2023-12-19T17:51:41.860703+0000","last_undegraded":"2023-12-19T17:51:41.860703+0000","last_fullsized":"2023-12-19T17:51:41.860703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.905148+0000","last_change":"2023-12-19T17:51:41.902138+0000","last_active":"2023-12-19T17:51:41.905148+0000","last_peered":"2023-12-19T17:51:41.905148+0000","last_clean":"2023-12-19T17:51:41.905148+0000","last_became_active":"2023-12-19T17:51:41.901751+0000","last_became_peered":"2023-12-19T17:51:41.901751+0000","last_unstale":"2023-12-19T17:51:41.905148+0000","last_undegraded":"2023-12-19T17:51:41.905148+0000","last_fullsized":"2023-12-19T17:51:41.905148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:10.835359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872596+0000","last_change":"2023-12-19T17:51:37.852747+0000","last_active":"2023-12-19T17:51:41.872596+0000","last_peered":"2023-12-19T17:51:41.872596+0000","last_clean":"2023-12-19T17:51:41.872596+0000","last_became_active":"2023-12-19T17:51:37.852265+0000","last_became_peered":"2023-12-19T17:51:37.852265+0000","last_unstale":"2023-12-19T17:51:41.872596+0000","last_undegraded":"2023-12-19T17:51:41.872596+0000","last_fullsized":"2023-12-19T17:51:41.872596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:48.499693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861229+0000","last_change":"2023-12-19T17:51:37.374392+0000","last_active":"2023-12-19T17:51:41.861229+0000","last_peered":"2023-12-19T17:51:41.861229+0000","last_clean":"2023-12-19T17:51:41.861229+0000","last_became_active":"2023-12-19T17:51:37.373831+0000","last_became_peered":"2023-12-19T17:51:37.373831+0000","last_unstale":"2023-12-19T17:51:41.861229+0000","last_undegraded":"2023-12-19T17:51:41.861229+0000","last_fullsized":"2023-12-19T17:51:41.861229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:33.874748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895361+0000","last_change":"2023-12-19T17:51:41.889463+0000","last_active":"2023-12-19T17:51:41.895361+0000","last_peered":"2023-12-19T17:51:41.895361+0000","last_clean":"2023-12-19T17:51:41.895361+0000","last_became_active":"2023-12-19T17:51:41.888636+0000","last_became_peered":"2023-12-19T17:51:41.888636+0000","last_unstale":"2023-12-19T17:51:41.895361+0000","last_undegraded":"2023-12-19T17:51:41.895361+0000","last_fullsized":"2023-12-19T17:51:41.895361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.882268+0000","last_change":"2023-12-19T17:51:37.868058+0000","last_active":"2023-12-19T17:51:41.882268+0000","last_peered":"2023-12-19T17:51:41.882268+0000","last_clean":"2023-12-19T17:51:41.882268+0000","last_became_active":"2023-12-19T17:51:37.867800+0000","last_became_peered":"2023-12-19T17:51:37.867800+0000","last_unstale":"2023-12-19T17:51:41.882268+0000","last_undegraded":"2023-12-19T17:51:41.882268+0000","last_fullsized":"2023-12-19T17:51:41.882268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865357+0000","last_change":"2023-12-19T17:51:37.366626+0000","last_active":"2023-12-19T17:51:41.865357+0000","last_peered":"2023-12-19T17:51:41.865357+0000","last_clean":"2023-12-19T17:51:41.865357+0000","last_became_active":"2023-12-19T17:51:37.366007+0000","last_became_peered":"2023-12-19T17:51:37.366007+0000","last_unstale":"2023-12-19T17:51:41.865357+0000","last_undegraded":"2023-12-19T17:51:41.865357+0000","last_fullsized":"2023-12-19T17:51:41.865357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892118+0000","last_change":"2023-12-19T17:51:41.882903+0000","last_active":"2023-12-19T17:51:41.892118+0000","last_peered":"2023-12-19T17:51:41.892118+0000","last_clean":"2023-12-19T17:51:41.892118+0000","last_became_active":"2023-12-19T17:51:41.882532+0000","last_became_peered":"2023-12-19T17:51:41.882532+0000","last_unstale":"2023-12-19T17:51:41.892118+0000","last_undegraded":"2023-12-19T17:51:41.892118+0000","last_fullsized":"2023-12-19T17:51:41.892118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881484+0000","last_change":"2023-12-19T17:51:37.870213+0000","last_active":"2023-12-19T17:51:41.881484+0000","last_peered":"2023-12-19T17:51:41.881484+0000","last_clean":"2023-12-19T17:51:41.881484+0000","last_became_active":"2023-12-19T17:51:37.869912+0000","last_became_peered":"2023-12-19T17:51:37.869912+0000","last_unstale":"2023-12-19T17:51:41.881484+0000","last_undegraded":"2023-12-19T17:51:41.881484+0000","last_fullsized":"2023-12-19T17:51:41.881484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:52.781318+0000","last_change":"2023-12-19T17:51:37.367621+0000","last_active":"2023-12-19T17:51:52.781318+0000","last_peered":"2023-12-19T17:51:52.781318+0000","last_clean":"2023-12-19T17:51:52.781318+0000","last_became_active":"2023-12-19T17:51:37.367105+0000","last_became_peered":"2023-12-19T17:51:37.367105+0000","last_unstale":"2023-12-19T17:51:52.781318+0000","last_undegraded":"2023-12-19T17:51:52.781318+0000","last_fullsized":"2023-12-19T17:51:52.781318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909707+0000","last_change":"2023-12-19T17:51:41.904744+0000","last_active":"2023-12-19T17:51:41.909707+0000","last_peered":"2023-12-19T17:51:41.909707+0000","last_clean":"2023-12-19T17:51:41.909707+0000","last_became_active":"2023-12-19T17:51:41.904364+0000","last_became_peered":"2023-12-19T17:51:41.904364+0000","last_unstale":"2023-12-19T17:51:41.909707+0000","last_undegraded":"2023-12-19T17:51:41.909707+0000","last_fullsized":"2023-12-19T17:51:41.909707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:58.563321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860812+0000","last_change":"2023-12-19T17:51:37.865360+0000","last_active":"2023-12-19T17:51:41.860812+0000","last_peered":"2023-12-19T17:51:41.860812+0000","last_clean":"2023-12-19T17:51:41.860812+0000","last_became_active":"2023-12-19T17:51:37.865049+0000","last_became_peered":"2023-12-19T17:51:37.865049+0000","last_unstale":"2023-12-19T17:51:41.860812+0000","last_undegraded":"2023-12-19T17:51:41.860812+0000","last_fullsized":"2023-12-19T17:51:41.860812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863243+0000","last_change":"2023-12-19T17:51:37.374005+0000","last_active":"2023-12-19T17:51:41.863243+0000","last_peered":"2023-12-19T17:51:41.863243+0000","last_clean":"2023-12-19T17:51:41.863243+0000","last_became_active":"2023-12-19T17:51:37.373306+0000","last_became_peered":"2023-12-19T17:51:37.373306+0000","last_unstale":"2023-12-19T17:51:41.863243+0000","last_undegraded":"2023-12-19T17:51:41.863243+0000","last_fullsized":"2023-12-19T17:51:41.863243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:28.401279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909053+0000","last_change":"2023-12-19T17:51:41.907731+0000","last_active":"2023-12-19T17:51:41.909053+0000","last_peered":"2023-12-19T17:51:41.909053+0000","last_clean":"2023-12-19T17:51:41.909053+0000","last_became_active":"2023-12-19T17:51:41.907322+0000","last_became_peered":"2023-12-19T17:51:41.907322+0000","last_unstale":"2023-12-19T17:51:41.909053+0000","last_undegraded":"2023-12-19T17:51:41.909053+0000","last_fullsized":"2023-12-19T17:51:41.909053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874655+0000","last_change":"2023-12-19T17:51:37.868383+0000","last_active":"2023-12-19T17:51:41.874655+0000","last_peered":"2023-12-19T17:51:41.874655+0000","last_clean":"2023-12-19T17:51:41.874655+0000","last_became_active":"2023-12-19T17:51:37.867225+0000","last_became_peered":"2023-12-19T17:51:37.867225+0000","last_unstale":"2023-12-19T17:51:41.874655+0000","last_undegraded":"2023-12-19T17:51:41.874655+0000","last_fullsized":"2023-12-19T17:51:41.874655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861892+0000","last_change":"2023-12-19T17:51:37.372486+0000","last_active":"2023-12-19T17:51:41.861892+0000","last_peered":"2023-12-19T17:51:41.861892+0000","last_clean":"2023-12-19T17:51:41.861892+0000","last_became_active":"2023-12-19T17:51:37.371902+0000","last_became_peered":"2023-12-19T17:51:37.371902+0000","last_unstale":"2023-12-19T17:51:41.861892+0000","last_undegraded":"2023-12-19T17:51:41.861892+0000","last_fullsized":"2023-12-19T17:51:41.861892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901181+0000","last_change":"2023-12-19T17:51:41.893407+0000","last_active":"2023-12-19T17:51:41.901181+0000","last_peered":"2023-12-19T17:51:41.901181+0000","last_clean":"2023-12-19T17:51:41.901181+0000","last_became_active":"2023-12-19T17:51:41.892955+0000","last_became_peered":"2023-12-19T17:51:41.892955+0000","last_unstale":"2023-12-19T17:51:41.901181+0000","last_undegraded":"2023-12-19T17:51:41.901181+0000","last_fullsized":"2023-12-19T17:51:41.901181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871399+0000","last_change":"2023-12-19T17:51:37.856391+0000","last_active":"2023-12-19T17:51:41.871399+0000","last_peered":"2023-12-19T17:51:41.871399+0000","last_clean":"2023-12-19T17:51:41.871399+0000","last_became_active":"2023-12-19T17:51:37.855433+0000","last_became_peered":"2023-12-19T17:51:37.855433+0000","last_unstale":"2023-12-19T17:51:41.871399+0000","last_undegraded":"2023-12-19T17:51:41.871399+0000","last_fullsized":"2023-12-19T17:51:41.871399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:34.887797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870511+0000","last_change":"2023-12-19T17:51:37.356703+0000","last_active":"2023-12-19T17:51:41.870511+0000","last_peered":"2023-12-19T17:51:41.870511+0000","last_clean":"2023-12-19T17:51:41.870511+0000","last_became_active":"2023-12-19T17:51:37.354458+0000","last_became_peered":"2023-12-19T17:51:37.354458+0000","last_unstale":"2023-12-19T17:51:41.870511+0000","last_undegraded":"2023-12-19T17:51:41.870511+0000","last_fullsized":"2023-12-19T17:51:41.870511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.899818+0000","last_change":"2023-12-19T17:51:41.893006+0000","last_active":"2023-12-19T17:51:41.899818+0000","last_peered":"2023-12-19T17:51:41.899818+0000","last_clean":"2023-12-19T17:51:41.899818+0000","last_became_active":"2023-12-19T17:51:41.892320+0000","last_became_peered":"2023-12-19T17:51:41.892320+0000","last_unstale":"2023-12-19T17:51:41.899818+0000","last_undegraded":"2023-12-19T17:51:41.899818+0000","last_fullsized":"2023-12-19T17:51:41.899818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860734+0000","last_change":"2023-12-19T17:51:37.868336+0000","last_active":"2023-12-19T17:51:41.860734+0000","last_peered":"2023-12-19T17:51:41.860734+0000","last_clean":"2023-12-19T17:51:41.860734+0000","last_became_active":"2023-12-19T17:51:37.847762+0000","last_became_peered":"2023-12-19T17:51:37.847762+0000","last_unstale":"2023-12-19T17:51:41.860734+0000","last_undegraded":"2023-12-19T17:51:41.860734+0000","last_fullsized":"2023-12-19T17:51:41.860734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870223+0000","last_change":"2023-12-19T17:51:37.367919+0000","last_active":"2023-12-19T17:51:41.870223+0000","last_peered":"2023-12-19T17:51:41.870223+0000","last_clean":"2023-12-19T17:51:41.870223+0000","last_became_active":"2023-12-19T17:51:37.367646+0000","last_became_peered":"2023-12-19T17:51:37.367646+0000","last_unstale":"2023-12-19T17:51:41.870223+0000","last_undegraded":"2023-12-19T17:51:41.870223+0000","last_fullsized":"2023-12-19T17:51:41.870223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900252+0000","last_change":"2023-12-19T17:51:41.891782+0000","last_active":"2023-12-19T17:51:41.900252+0000","last_peered":"2023-12-19T17:51:41.900252+0000","last_clean":"2023-12-19T17:51:41.900252+0000","last_became_active":"2023-12-19T17:51:41.891400+0000","last_became_peered":"2023-12-19T17:51:41.891400+0000","last_unstale":"2023-12-19T17:51:41.900252+0000","last_undegraded":"2023-12-19T17:51:41.900252+0000","last_fullsized":"2023-12-19T17:51:41.900252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872648+0000","last_change":"2023-12-19T17:51:37.865125+0000","last_active":"2023-12-19T17:51:41.872648+0000","last_peered":"2023-12-19T17:51:41.872648+0000","last_clean":"2023-12-19T17:51:41.872648+0000","last_became_active":"2023-12-19T17:51:37.860190+0000","last_became_peered":"2023-12-19T17:51:37.860190+0000","last_unstale":"2023-12-19T17:51:41.872648+0000","last_undegraded":"2023-12-19T17:51:41.872648+0000","last_fullsized":"2023-12-19T17:51:41.872648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861321+0000","last_change":"2023-12-19T17:51:37.374377+0000","last_active":"2023-12-19T17:51:41.861321+0000","last_peered":"2023-12-19T17:51:41.861321+0000","last_clean":"2023-12-19T17:51:41.861321+0000","last_became_active":"2023-12-19T17:51:37.373141+0000","last_became_peered":"2023-12-19T17:51:37.373141+0000","last_unstale":"2023-12-19T17:51:41.861321+0000","last_undegraded":"2023-12-19T17:51:41.861321+0000","last_fullsized":"2023-12-19T17:51:41.861321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.889909+0000","last_change":"2023-12-19T17:51:41.885767+0000","last_active":"2023-12-19T17:51:41.889909+0000","last_peered":"2023-12-19T17:51:41.889909+0000","last_clean":"2023-12-19T17:51:41.889909+0000","last_became_active":"2023-12-19T17:51:41.884799+0000","last_became_peered":"2023-12-19T17:51:41.884799+0000","last_unstale":"2023-12-19T17:51:41.889909+0000","last_undegraded":"2023-12-19T17:51:41.889909+0000","last_fullsized":"2023-12-19T17:51:41.889909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:22.880744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874118+0000","last_change":"2023-12-19T17:51:37.879736+0000","last_active":"2023-12-19T17:51:41.874118+0000","last_peered":"2023-12-19T17:51:41.874118+0000","last_clean":"2023-12-19T17:51:41.874118+0000","last_became_active":"2023-12-19T17:51:37.877058+0000","last_became_peered":"2023-12-19T17:51:37.877058+0000","last_unstale":"2023-12-19T17:51:41.874118+0000","last_undegraded":"2023-12-19T17:51:41.874118+0000","last_fullsized":"2023-12-19T17:51:41.874118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.876487+0000","last_change":"2023-12-19T17:51:37.359468+0000","last_active":"2023-12-19T17:51:41.876487+0000","last_peered":"2023-12-19T17:51:41.876487+0000","last_clean":"2023-12-19T17:51:41.876487+0000","last_became_active":"2023-12-19T17:51:37.359194+0000","last_became_peered":"2023-12-19T17:51:37.359194+0000","last_unstale":"2023-12-19T17:51:41.876487+0000","last_undegraded":"2023-12-19T17:51:41.876487+0000","last_fullsized":"2023-12-19T17:51:41.876487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861414+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:51:41.861414+0000","last_peered":"2023-12-19T17:51:41.861414+0000","last_clean":"2023-12-19T17:51:41.861414+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:51:41.861414+0000","last_undegraded":"2023-12-19T17:51:41.861414+0000","last_fullsized":"2023-12-19T17:51:41.861414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897184+0000","last_change":"2023-12-19T17:51:41.893689+0000","last_active":"2023-12-19T17:51:41.897184+0000","last_peered":"2023-12-19T17:51:41.897184+0000","last_clean":"2023-12-19T17:51:41.897184+0000","last_became_active":"2023-12-19T17:51:41.893191+0000","last_became_peered":"2023-12-19T17:51:41.893191+0000","last_unstale":"2023-12-19T17:51:41.897184+0000","last_undegraded":"2023-12-19T17:51:41.897184+0000","last_fullsized":"2023-12-19T17:51:41.897184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:45.069338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861902+0000","last_change":"2023-12-19T17:51:37.868222+0000","last_active":"2023-12-19T17:51:41.861902+0000","last_peered":"2023-12-19T17:51:41.861902+0000","last_clean":"2023-12-19T17:51:41.861902+0000","last_became_active":"2023-12-19T17:51:37.867972+0000","last_became_peered":"2023-12-19T17:51:37.867972+0000","last_unstale":"2023-12-19T17:51:41.861902+0000","last_undegraded":"2023-12-19T17:51:41.861902+0000","last_fullsized":"2023-12-19T17:51:41.861902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871883+0000","last_change":"2023-12-19T17:51:37.366114+0000","last_active":"2023-12-19T17:51:41.871883+0000","last_peered":"2023-12-19T17:51:41.871883+0000","last_clean":"2023-12-19T17:51:41.871883+0000","last_became_active":"2023-12-19T17:51:37.365717+0000","last_became_peered":"2023-12-19T17:51:37.365717+0000","last_unstale":"2023-12-19T17:51:41.871883+0000","last_undegraded":"2023-12-19T17:51:41.871883+0000","last_fullsized":"2023-12-19T17:51:41.871883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.890817+0000","last_change":"2023-12-19T17:51:41.883576+0000","last_active":"2023-12-19T17:51:41.890817+0000","last_peered":"2023-12-19T17:51:41.890817+0000","last_clean":"2023-12-19T17:51:41.890817+0000","last_became_active":"2023-12-19T17:51:41.883135+0000","last_became_peered":"2023-12-19T17:51:41.883135+0000","last_unstale":"2023-12-19T17:51:41.890817+0000","last_undegraded":"2023-12-19T17:51:41.890817+0000","last_fullsized":"2023-12-19T17:51:41.890817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874046+0000","last_change":"2023-12-19T17:51:37.863995+0000","last_active":"2023-12-19T17:51:41.874046+0000","last_peered":"2023-12-19T17:51:41.874046+0000","last_clean":"2023-12-19T17:51:41.874046+0000","last_became_active":"2023-12-19T17:51:37.863704+0000","last_became_peered":"2023-12-19T17:51:37.863704+0000","last_unstale":"2023-12-19T17:51:41.874046+0000","last_undegraded":"2023-12-19T17:51:41.874046+0000","last_fullsized":"2023-12-19T17:51:41.874046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862307+0000","last_change":"2023-12-19T17:51:37.367329+0000","last_active":"2023-12-19T17:51:41.862307+0000","last_peered":"2023-12-19T17:51:41.862307+0000","last_clean":"2023-12-19T17:51:41.862307+0000","last_became_active":"2023-12-19T17:51:37.366996+0000","last_became_peered":"2023-12-19T17:51:37.366996+0000","last_unstale":"2023-12-19T17:51:41.862307+0000","last_undegraded":"2023-12-19T17:51:41.862307+0000","last_fullsized":"2023-12-19T17:51:41.862307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909072+0000","last_change":"2023-12-19T17:51:41.907875+0000","last_active":"2023-12-19T17:51:41.909072+0000","last_peered":"2023-12-19T17:51:41.909072+0000","last_clean":"2023-12-19T17:51:41.909072+0000","last_became_active":"2023-12-19T17:51:41.907461+0000","last_became_peered":"2023-12-19T17:51:41.907461+0000","last_unstale":"2023-12-19T17:51:41.909072+0000","last_undegraded":"2023-12-19T17:51:41.909072+0000","last_fullsized":"2023-12-19T17:51:41.909072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863419+0000","last_change":"2023-12-19T17:51:37.863678+0000","last_active":"2023-12-19T17:51:41.863419+0000","last_peered":"2023-12-19T17:51:41.863419+0000","last_clean":"2023-12-19T17:51:41.863419+0000","last_became_active":"2023-12-19T17:51:37.863378+0000","last_became_peered":"2023-12-19T17:51:37.863378+0000","last_unstale":"2023-12-19T17:51:41.863419+0000","last_undegraded":"2023-12-19T17:51:41.863419+0000","last_fullsized":"2023-12-19T17:51:41.863419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:21.936722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873263+0000","last_change":"2023-12-19T17:51:37.359686+0000","last_active":"2023-12-19T17:51:41.873263+0000","last_peered":"2023-12-19T17:51:41.873263+0000","last_clean":"2023-12-19T17:51:41.873263+0000","last_became_active":"2023-12-19T17:51:37.359340+0000","last_became_peered":"2023-12-19T17:51:37.359340+0000","last_unstale":"2023-12-19T17:51:41.873263+0000","last_undegraded":"2023-12-19T17:51:41.873263+0000","last_fullsized":"2023-12-19T17:51:41.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897294+0000","last_change":"2023-12-19T17:51:41.893188+0000","last_active":"2023-12-19T17:51:41.897294+0000","last_peered":"2023-12-19T17:51:41.897294+0000","last_clean":"2023-12-19T17:51:41.897294+0000","last_became_active":"2023-12-19T17:51:41.892695+0000","last_became_peered":"2023-12-19T17:51:41.892695+0000","last_unstale":"2023-12-19T17:51:41.897294+0000","last_undegraded":"2023-12-19T17:51:41.897294+0000","last_fullsized":"2023-12-19T17:51:41.897294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862719+0000","last_change":"2023-12-19T17:51:37.858250+0000","last_active":"2023-12-19T17:51:41.862719+0000","last_peered":"2023-12-19T17:51:41.862719+0000","last_clean":"2023-12-19T17:51:41.862719+0000","last_became_active":"2023-12-19T17:51:37.858002+0000","last_became_peered":"2023-12-19T17:51:37.858002+0000","last_unstale":"2023-12-19T17:51:41.862719+0000","last_undegraded":"2023-12-19T17:51:41.862719+0000","last_fullsized":"2023-12-19T17:51:41.862719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:21.378881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875262+0000","last_change":"2023-12-19T17:51:37.373582+0000","last_active":"2023-12-19T17:51:41.875262+0000","last_peered":"2023-12-19T17:51:41.875262+0000","last_clean":"2023-12-19T17:51:41.875262+0000","last_became_active":"2023-12-19T17:51:37.373152+0000","last_became_peered":"2023-12-19T17:51:37.373152+0000","last_unstale":"2023-12-19T17:51:41.875262+0000","last_undegraded":"2023-12-19T17:51:41.875262+0000","last_fullsized":"2023-12-19T17:51:41.875262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:14.694444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895324+0000","last_change":"2023-12-19T17:51:41.889020+0000","last_active":"2023-12-19T17:51:41.895324+0000","last_peered":"2023-12-19T17:51:41.895324+0000","last_clean":"2023-12-19T17:51:41.895324+0000","last_became_active":"2023-12-19T17:51:41.888202+0000","last_became_peered":"2023-12-19T17:51:41.888202+0000","last_unstale":"2023-12-19T17:51:41.895324+0000","last_undegraded":"2023-12-19T17:51:41.895324+0000","last_fullsized":"2023-12-19T17:51:41.895324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861516+0000","last_change":"2023-12-19T17:51:37.857128+0000","last_active":"2023-12-19T17:51:41.861516+0000","last_peered":"2023-12-19T17:51:41.861516+0000","last_clean":"2023-12-19T17:51:41.861516+0000","last_became_active":"2023-12-19T17:51:37.856862+0000","last_became_peered":"2023-12-19T17:51:37.856862+0000","last_unstale":"2023-12-19T17:51:41.861516+0000","last_undegraded":"2023-12-19T17:51:41.861516+0000","last_fullsized":"2023-12-19T17:51:41.861516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:01.983840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.868593+0000","last_change":"2023-12-19T17:51:37.368123+0000","last_active":"2023-12-19T17:51:41.868593+0000","last_peered":"2023-12-19T17:51:41.868593+0000","last_clean":"2023-12-19T17:51:41.868593+0000","last_became_active":"2023-12-19T17:51:37.367483+0000","last_became_peered":"2023-12-19T17:51:37.367483+0000","last_unstale":"2023-12-19T17:51:41.868593+0000","last_undegraded":"2023-12-19T17:51:41.868593+0000","last_fullsized":"2023-12-19T17:51:41.868593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900476+0000","last_change":"2023-12-19T17:51:41.890990+0000","last_active":"2023-12-19T17:51:41.900476+0000","last_peered":"2023-12-19T17:51:41.900476+0000","last_clean":"2023-12-19T17:51:41.900476+0000","last_became_active":"2023-12-19T17:51:41.890583+0000","last_became_peered":"2023-12-19T17:51:41.890583+0000","last_unstale":"2023-12-19T17:51:41.900476+0000","last_undegraded":"2023-12-19T17:51:41.900476+0000","last_fullsized":"2023-12-19T17:51:41.900476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862572+0000","last_change":"2023-12-19T17:51:37.874651+0000","last_active":"2023-12-19T17:51:41.862572+0000","last_peered":"2023-12-19T17:51:41.862572+0000","last_clean":"2023-12-19T17:51:41.862572+0000","last_became_active":"2023-12-19T17:51:37.874304+0000","last_became_peered":"2023-12-19T17:51:37.874304+0000","last_unstale":"2023-12-19T17:51:41.862572+0000","last_undegraded":"2023-12-19T17:51:41.862572+0000","last_fullsized":"2023-12-19T17:51:41.862572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862903+0000","last_change":"2023-12-19T17:51:37.368087+0000","last_active":"2023-12-19T17:51:41.862903+0000","last_peered":"2023-12-19T17:51:41.862903+0000","last_clean":"2023-12-19T17:51:41.862903+0000","last_became_active":"2023-12-19T17:51:37.367220+0000","last_became_peered":"2023-12-19T17:51:37.367220+0000","last_unstale":"2023-12-19T17:51:41.862903+0000","last_undegraded":"2023-12-19T17:51:41.862903+0000","last_fullsized":"2023-12-19T17:51:41.862903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909749+0000","last_change":"2023-12-19T17:51:41.904872+0000","last_active":"2023-12-19T17:51:41.909749+0000","last_peered":"2023-12-19T17:51:41.909749+0000","last_clean":"2023-12-19T17:51:41.909749+0000","last_became_active":"2023-12-19T17:51:41.904421+0000","last_became_peered":"2023-12-19T17:51:41.904421+0000","last_unstale":"2023-12-19T17:51:41.909749+0000","last_undegraded":"2023-12-19T17:51:41.909749+0000","last_fullsized":"2023-12-19T17:51:41.909749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:00.555281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861789+0000","last_change":"2023-12-19T17:51:37.863792+0000","last_active":"2023-12-19T17:51:41.861789+0000","last_peered":"2023-12-19T17:51:41.861789+0000","last_clean":"2023-12-19T17:51:41.861789+0000","last_became_active":"2023-12-19T17:51:37.863505+0000","last_became_peered":"2023-12-19T17:51:37.863505+0000","last_unstale":"2023-12-19T17:51:41.861789+0000","last_undegraded":"2023-12-19T17:51:41.861789+0000","last_fullsized":"2023-12-19T17:51:41.861789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:19.360251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870449+0000","last_change":"2023-12-19T17:51:37.365092+0000","last_active":"2023-12-19T17:51:41.870449+0000","last_peered":"2023-12-19T17:51:41.870449+0000","last_clean":"2023-12-19T17:51:41.870449+0000","last_became_active":"2023-12-19T17:51:37.361623+0000","last_became_peered":"2023-12-19T17:51:37.361623+0000","last_unstale":"2023-12-19T17:51:41.870449+0000","last_undegraded":"2023-12-19T17:51:41.870449+0000","last_fullsized":"2023-12-19T17:51:41.870449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.910085+0000","last_change":"2023-12-19T17:51:41.908920+0000","last_active":"2023-12-19T17:51:41.910085+0000","last_peered":"2023-12-19T17:51:41.910085+0000","last_clean":"2023-12-19T17:51:41.910085+0000","last_became_active":"2023-12-19T17:51:41.908497+0000","last_became_peered":"2023-12-19T17:51:41.908497+0000","last_unstale":"2023-12-19T17:51:41.910085+0000","last_undegraded":"2023-12-19T17:51:41.910085+0000","last_fullsized":"2023-12-19T17:51:41.910085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:24.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.878208+0000","last_change":"2023-12-19T17:51:37.857702+0000","last_active":"2023-12-19T17:51:41.878208+0000","last_peered":"2023-12-19T17:51:41.878208+0000","last_clean":"2023-12-19T17:51:41.878208+0000","last_became_active":"2023-12-19T17:51:37.857433+0000","last_became_peered":"2023-12-19T17:51:37.857433+0000","last_unstale":"2023-12-19T17:51:41.878208+0000","last_undegraded":"2023-12-19T17:51:41.878208+0000","last_fullsized":"2023-12-19T17:51:41.878208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880946+0000","last_change":"2023-12-19T17:51:37.362716+0000","last_active":"2023-12-19T17:51:41.880946+0000","last_peered":"2023-12-19T17:51:41.880946+0000","last_clean":"2023-12-19T17:51:41.880946+0000","last_became_active":"2023-12-19T17:51:37.361305+0000","last_became_peered":"2023-12-19T17:51:37.361305+0000","last_unstale":"2023-12-19T17:51:41.880946+0000","last_undegraded":"2023-12-19T17:51:41.880946+0000","last_fullsized":"2023-12-19T17:51:41.880946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897388+0000","last_change":"2023-12-19T17:51:41.893227+0000","last_active":"2023-12-19T17:51:41.897388+0000","last_peered":"2023-12-19T17:51:41.897388+0000","last_clean":"2023-12-19T17:51:41.897388+0000","last_became_active":"2023-12-19T17:51:41.892689+0000","last_became_peered":"2023-12-19T17:51:41.892689+0000","last_unstale":"2023-12-19T17:51:41.897388+0000","last_undegraded":"2023-12-19T17:51:41.897388+0000","last_fullsized":"2023-12-19T17:51:41.897388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:14.243432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861900+0000","last_change":"2023-12-19T17:51:37.870206+0000","last_active":"2023-12-19T17:51:41.861900+0000","last_peered":"2023-12-19T17:51:41.861900+0000","last_clean":"2023-12-19T17:51:41.861900+0000","last_became_active":"2023-12-19T17:51:37.869935+0000","last_became_peered":"2023-12-19T17:51:37.869935+0000","last_unstale":"2023-12-19T17:51:41.861900+0000","last_undegraded":"2023-12-19T17:51:41.861900+0000","last_fullsized":"2023-12-19T17:51:41.861900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:36.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:53.261006+0000","last_change":"2023-12-19T17:51:37.375150+0000","last_active":"2023-12-19T17:51:53.261006+0000","last_peered":"2023-12-19T17:51:53.261006+0000","last_clean":"2023-12-19T17:51:53.261006+0000","last_became_active":"2023-12-19T17:51:37.374662+0000","last_became_peered":"2023-12-19T17:51:37.374662+0000","last_unstale":"2023-12-19T17:51:53.261006+0000","last_undegraded":"2023-12-19T17:51:53.261006+0000","last_fullsized":"2023-12-19T17:51:53.261006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897598+0000","last_change":"2023-12-19T17:51:41.884755+0000","last_active":"2023-12-19T17:51:41.897598+0000","last_peered":"2023-12-19T17:51:41.897598+0000","last_clean":"2023-12-19T17:51:41.897598+0000","last_became_active":"2023-12-19T17:51:41.884141+0000","last_became_peered":"2023-12-19T17:51:41.884141+0000","last_unstale":"2023-12-19T17:51:41.897598+0000","last_undegraded":"2023-12-19T17:51:41.897598+0000","last_fullsized":"2023-12-19T17:51:41.897598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871819+0000","last_change":"2023-12-19T17:51:37.871807+0000","last_active":"2023-12-19T17:51:41.871819+0000","last_peered":"2023-12-19T17:51:41.871819+0000","last_clean":"2023-12-19T17:51:41.871819+0000","last_became_active":"2023-12-19T17:51:37.871521+0000","last_became_peered":"2023-12-19T17:51:37.871521+0000","last_unstale":"2023-12-19T17:51:41.871819+0000","last_undegraded":"2023-12-19T17:51:41.871819+0000","last_fullsized":"2023-12-19T17:51:41.871819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862120+0000","last_change":"2023-12-19T17:51:37.363031+0000","last_active":"2023-12-19T17:51:41.862120+0000","last_peered":"2023-12-19T17:51:41.862120+0000","last_clean":"2023-12-19T17:51:41.862120+0000","last_became_active":"2023-12-19T17:51:37.362756+0000","last_became_peered":"2023-12-19T17:51:37.362756+0000","last_unstale":"2023-12-19T17:51:41.862120+0000","last_undegraded":"2023-12-19T17:51:41.862120+0000","last_fullsized":"2023-12-19T17:51:41.862120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.907191+0000","last_change":"2023-12-19T17:51:41.901238+0000","last_active":"2023-12-19T17:51:41.907191+0000","last_peered":"2023-12-19T17:51:41.907191+0000","last_clean":"2023-12-19T17:51:41.907191+0000","last_became_active":"2023-12-19T17:51:41.900651+0000","last_became_peered":"2023-12-19T17:51:41.900651+0000","last_unstale":"2023-12-19T17:51:41.907191+0000","last_undegraded":"2023-12-19T17:51:41.907191+0000","last_fullsized":"2023-12-19T17:51:41.907191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:12:26.894141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883389+0000","last_change":"2023-12-19T17:51:37.859989+0000","last_active":"2023-12-19T17:51:41.883389+0000","last_peered":"2023-12-19T17:51:41.883389+0000","last_clean":"2023-12-19T17:51:41.883389+0000","last_became_active":"2023-12-19T17:51:37.858483+0000","last_became_peered":"2023-12-19T17:51:37.858483+0000","last_unstale":"2023-12-19T17:51:41.883389+0000","last_undegraded":"2023-12-19T17:51:41.883389+0000","last_fullsized":"2023-12-19T17:51:41.883389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880701+0000","last_change":"2023-12-19T17:51:37.370965+0000","last_active":"2023-12-19T17:51:41.880701+0000","last_peered":"2023-12-19T17:51:41.880701+0000","last_clean":"2023-12-19T17:51:41.880701+0000","last_became_active":"2023-12-19T17:51:37.370062+0000","last_became_peered":"2023-12-19T17:51:37.370062+0000","last_unstale":"2023-12-19T17:51:41.880701+0000","last_undegraded":"2023-12-19T17:51:41.880701+0000","last_fullsized":"2023-12-19T17:51:41.880701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904990+0000","last_change":"2023-12-19T17:51:41.901244+0000","last_active":"2023-12-19T17:51:41.904990+0000","last_peered":"2023-12-19T17:51:41.904990+0000","last_clean":"2023-12-19T17:51:41.904990+0000","last_became_active":"2023-12-19T17:51:41.900797+0000","last_became_peered":"2023-12-19T17:51:41.900797+0000","last_unstale":"2023-12-19T17:51:41.904990+0000","last_undegraded":"2023-12-19T17:51:41.904990+0000","last_fullsized":"2023-12-19T17:51:41.904990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:01.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880682+0000","last_change":"2023-12-19T17:51:37.862402+0000","last_active":"2023-12-19T17:51:41.880682+0000","last_peered":"2023-12-19T17:51:41.880682+0000","last_clean":"2023-12-19T17:51:41.880682+0000","last_became_active":"2023-12-19T17:51:37.862122+0000","last_became_peered":"2023-12-19T17:51:37.862122+0000","last_unstale":"2023-12-19T17:51:41.880682+0000","last_undegraded":"2023-12-19T17:51:41.880682+0000","last_fullsized":"2023-12-19T17:51:41.880682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865202+0000","last_change":"2023-12-19T17:51:37.369300+0000","last_active":"2023-12-19T17:51:41.865202+0000","last_peered":"2023-12-19T17:51:41.865202+0000","last_clean":"2023-12-19T17:51:41.865202+0000","last_became_active":"2023-12-19T17:51:37.368149+0000","last_became_peered":"2023-12-19T17:51:37.368149+0000","last_unstale":"2023-12-19T17:51:41.865202+0000","last_undegraded":"2023-12-19T17:51:41.865202+0000","last_fullsized":"2023-12-19T17:51:41.865202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901092+0000","last_change":"2023-12-19T17:51:41.894673+0000","last_active":"2023-12-19T17:51:41.901092+0000","last_peered":"2023-12-19T17:51:41.901092+0000","last_clean":"2023-12-19T17:51:41.901092+0000","last_became_active":"2023-12-19T17:51:41.893704+0000","last_became_peered":"2023-12-19T17:51:41.893704+0000","last_unstale":"2023-12-19T17:51:41.901092+0000","last_undegraded":"2023-12-19T17:51:41.901092+0000","last_fullsized":"2023-12-19T17:51:41.901092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:54.855527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904181+0000","last_change":"2023-12-19T17:51:41.901728+0000","last_active":"2023-12-19T17:51:41.904181+0000","last_peered":"2023-12-19T17:51:41.904181+0000","last_clean":"2023-12-19T17:51:41.904181+0000","last_became_active":"2023-12-19T17:51:41.900986+0000","last_became_peered":"2023-12-19T17:51:41.900986+0000","last_unstale":"2023-12-19T17:51:41.904181+0000","last_undegraded":"2023-12-19T17:51:41.904181+0000","last_fullsized":"2023-12-19T17:51:41.904181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860494+0000","last_change":"2023-12-19T17:51:37.869238+0000","last_active":"2023-12-19T17:51:41.860494+0000","last_peered":"2023-12-19T17:51:41.860494+0000","last_clean":"2023-12-19T17:51:41.860494+0000","last_became_active":"2023-12-19T17:51:37.868781+0000","last_became_peered":"2023-12-19T17:51:37.868781+0000","last_unstale":"2023-12-19T17:51:41.860494+0000","last_undegraded":"2023-12-19T17:51:41.860494+0000","last_fullsized":"2023-12-19T17:51:41.860494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874862+0000","last_change":"2023-12-19T17:51:37.370627+0000","last_active":"2023-12-19T17:51:41.874862+0000","last_peered":"2023-12-19T17:51:41.874862+0000","last_clean":"2023-12-19T17:51:41.874862+0000","last_became_active":"2023-12-19T17:51:37.366660+0000","last_became_peered":"2023-12-19T17:51:37.366660+0000","last_unstale":"2023-12-19T17:51:41.874862+0000","last_undegraded":"2023-12-19T17:51:41.874862+0000","last_fullsized":"2023-12-19T17:51:41.874862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.891084+0000","last_change":"2023-12-19T17:51:41.884759+0000","last_active":"2023-12-19T17:51:41.891084+0000","last_peered":"2023-12-19T17:51:41.891084+0000","last_clean":"2023-12-19T17:51:41.891084+0000","last_became_active":"2023-12-19T17:51:41.884313+0000","last_became_peered":"2023-12-19T17:51:41.884313+0000","last_unstale":"2023-12-19T17:51:41.891084+0000","last_undegraded":"2023-12-19T17:51:41.891084+0000","last_fullsized":"2023-12-19T17:51:41.891084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:41.801043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871597+0000","last_change":"2023-12-19T17:51:37.861948+0000","last_active":"2023-12-19T17:51:41.871597+0000","last_peered":"2023-12-19T17:51:41.871597+0000","last_clean":"2023-12-19T17:51:41.871597+0000","last_became_active":"2023-12-19T17:51:37.860829+0000","last_became_peered":"2023-12-19T17:51:37.860829+0000","last_unstale":"2023-12-19T17:51:41.871597+0000","last_undegraded":"2023-12-19T17:51:41.871597+0000","last_fullsized":"2023-12-19T17:51:41.871597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875499+0000","last_change":"2023-12-19T17:51:37.370607+0000","last_active":"2023-12-19T17:51:41.875499+0000","last_peered":"2023-12-19T17:51:41.875499+0000","last_clean":"2023-12-19T17:51:41.875499+0000","last_became_active":"2023-12-19T17:51:37.370306+0000","last_became_peered":"2023-12-19T17:51:37.370306+0000","last_unstale":"2023-12-19T17:51:41.875499+0000","last_undegraded":"2023-12-19T17:51:41.875499+0000","last_fullsized":"2023-12-19T17:51:41.875499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:54.261197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863959+0000","last_change":"2023-12-19T17:51:37.367794+0000","last_active":"2023-12-19T17:51:41.863959+0000","last_peered":"2023-12-19T17:51:41.863959+0000","last_clean":"2023-12-19T17:51:41.863959+0000","last_became_active":"2023-12-19T17:51:37.367484+0000","last_became_peered":"2023-12-19T17:51:37.367484+0000","last_unstale":"2023-12-19T17:51:41.863959+0000","last_undegraded":"2023-12-19T17:51:41.863959+0000","last_fullsized":"2023-12-19T17:51:41.863959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880861+0000","last_change":"2023-12-19T17:51:37.866914+0000","last_active":"2023-12-19T17:51:41.880861+0000","last_peered":"2023-12-19T17:51:41.880861+0000","last_clean":"2023-12-19T17:51:41.880861+0000","last_became_active":"2023-12-19T17:51:37.860031+0000","last_became_peered":"2023-12-19T17:51:37.860031+0000","last_unstale":"2023-12-19T17:51:41.880861+0000","last_undegraded":"2023-12-19T17:51:41.880861+0000","last_fullsized":"2023-12-19T17:51:41.880861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892712+0000","last_change":"2023-12-19T17:51:41.888154+0000","last_active":"2023-12-19T17:51:41.892712+0000","last_peered":"2023-12-19T17:51:41.892712+0000","last_clean":"2023-12-19T17:51:41.892712+0000","last_became_active":"2023-12-19T17:51:41.887685+0000","last_became_peered":"2023-12-19T17:51:41.887685+0000","last_unstale":"2023-12-19T17:51:41.892712+0000","last_undegraded":"2023-12-19T17:51:41.892712+0000","last_fullsized":"2023-12-19T17:51:41.892712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:49.694949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874462+0000","last_change":"2023-12-19T17:51:37.373607+0000","last_active":"2023-12-19T17:51:41.874462+0000","last_peered":"2023-12-19T17:51:41.874462+0000","last_clean":"2023-12-19T17:51:41.874462+0000","last_became_active":"2023-12-19T17:51:37.373028+0000","last_became_peered":"2023-12-19T17:51:37.373028+0000","last_unstale":"2023-12-19T17:51:41.874462+0000","last_undegraded":"2023-12-19T17:51:41.874462+0000","last_fullsized":"2023-12-19T17:51:41.874462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:29.861362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872203+0000","last_change":"2023-12-19T17:51:37.853456+0000","last_active":"2023-12-19T17:51:41.872203+0000","last_peered":"2023-12-19T17:51:41.872203+0000","last_clean":"2023-12-19T17:51:41.872203+0000","last_became_active":"2023-12-19T17:51:37.853073+0000","last_became_peered":"2023-12-19T17:51:37.853073+0000","last_unstale":"2023-12-19T17:51:41.872203+0000","last_undegraded":"2023-12-19T17:51:41.872203+0000","last_fullsized":"2023-12-19T17:51:41.872203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:56.244495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904914+0000","last_change":"2023-12-19T17:51:41.903216+0000","last_active":"2023-12-19T17:51:41.904914+0000","last_peered":"2023-12-19T17:51:41.904914+0000","last_clean":"2023-12-19T17:51:41.904914+0000","last_became_active":"2023-12-19T17:51:41.902823+0000","last_became_peered":"2023-12-19T17:51:41.902823+0000","last_unstale":"2023-12-19T17:51:41.904914+0000","last_undegraded":"2023-12-19T17:51:41.904914+0000","last_fullsized":"2023-12-19T17:51:41.904914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:32.887544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862464+0000","last_change":"2023-12-19T17:51:37.874316+0000","last_active":"2023-12-19T17:51:41.862464+0000","last_peered":"2023-12-19T17:51:41.862464+0000","last_clean":"2023-12-19T17:51:41.862464+0000","last_became_active":"2023-12-19T17:51:37.873086+0000","last_became_peered":"2023-12-19T17:51:37.873086+0000","last_unstale":"2023-12-19T17:51:41.862464+0000","last_undegraded":"2023-12-19T17:51:41.862464+0000","last_fullsized":"2023-12-19T17:51:41.862464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870124+0000","last_change":"2023-12-19T17:51:37.850435+0000","last_active":"2023-12-19T17:51:41.870124+0000","last_peered":"2023-12-19T17:51:41.870124+0000","last_clean":"2023-12-19T17:51:41.870124+0000","last_became_active":"2023-12-19T17:51:37.849426+0000","last_became_peered":"2023-12-19T17:51:37.849426+0000","last_unstale":"2023-12-19T17:51:41.870124+0000","last_undegraded":"2023-12-19T17:51:41.870124+0000","last_fullsized":"2023-12-19T17:51:41.870124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870410+0000","last_change":"2023-12-19T17:51:37.878151+0000","last_active":"2023-12-19T17:51:41.870410+0000","last_peered":"2023-12-19T17:51:41.870410+0000","last_clean":"2023-12-19T17:51:41.870410+0000","last_became_active":"2023-12-19T17:51:37.877950+0000","last_became_peered":"2023-12-19T17:51:37.877950+0000","last_unstale":"2023-12-19T17:51:41.870410+0000","last_undegraded":"2023-12-19T17:51:41.870410+0000","last_fullsized":"2023-12-19T17:51:41.870410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880786+0000","last_change":"2023-12-19T17:51:37.873480+0000","last_active":"2023-12-19T17:51:41.880786+0000","last_peered":"2023-12-19T17:51:41.880786+0000","last_clean":"2023-12-19T17:51:41.880786+0000","last_became_active":"2023-12-19T17:51:37.873217+0000","last_became_peered":"2023-12-19T17:51:37.873217+0000","last_unstale":"2023-12-19T17:51:41.880786+0000","last_undegraded":"2023-12-19T17:51:41.880786+0000","last_fullsized":"2023-12-19T17:51:41.880786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877566+0000","last_change":"2023-12-19T17:51:37.862909+0000","last_active":"2023-12-19T17:51:41.877566+0000","last_peered":"2023-12-19T17:51:41.877566+0000","last_clean":"2023-12-19T17:51:41.877566+0000","last_became_active":"2023-12-19T17:51:37.862582+0000","last_became_peered":"2023-12-19T17:51:37.862582+0000","last_unstale":"2023-12-19T17:51:41.877566+0000","last_undegraded":"2023-12-19T17:51:41.877566+0000","last_fullsized":"2023-12-19T17:51:41.877566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861447+0000","last_change":"2023-12-19T17:51:37.864245+0000","last_active":"2023-12-19T17:51:41.861447+0000","last_peered":"2023-12-19T17:51:41.861447+0000","last_clean":"2023-12-19T17:51:41.861447+0000","last_became_active":"2023-12-19T17:51:37.863824+0000","last_became_peered":"2023-12-19T17:51:37.863824+0000","last_unstale":"2023-12-19T17:51:41.861447+0000","last_undegraded":"2023-12-19T17:51:41.861447+0000","last_fullsized":"2023-12-19T17:51:41.861447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862736+0000","last_change":"2023-12-19T17:51:37.878924+0000","last_active":"2023-12-19T17:51:41.862736+0000","last_peered":"2023-12-19T17:51:41.862736+0000","last_clean":"2023-12-19T17:51:41.862736+0000","last_became_active":"2023-12-19T17:51:37.875497+0000","last_became_peered":"2023-12-19T17:51:37.875497+0000","last_unstale":"2023-12-19T17:51:41.862736+0000","last_undegraded":"2023-12-19T17:51:41.862736+0000","last_fullsized":"2023-12-19T17:51:41.862736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881391+0000","last_change":"2023-12-19T17:51:37.863018+0000","last_active":"2023-12-19T17:51:41.881391+0000","last_peered":"2023-12-19T17:51:41.881391+0000","last_clean":"2023-12-19T17:51:41.881391+0000","last_became_active":"2023-12-19T17:51:37.862800+0000","last_became_peered":"2023-12-19T17:51:37.862800+0000","last_unstale":"2023-12-19T17:51:41.881391+0000","last_undegraded":"2023-12-19T17:51:41.881391+0000","last_fullsized":"2023-12-19T17:51:41.881391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874580+0000","last_change":"2023-12-19T17:51:37.864066+0000","last_active":"2023-12-19T17:51:41.874580+0000","last_peered":"2023-12-19T17:51:41.874580+0000","last_clean":"2023-12-19T17:51:41.874580+0000","last_became_active":"2023-12-19T17:51:37.863848+0000","last_became_peered":"2023-12-19T17:51:37.863848+0000","last_unstale":"2023-12-19T17:51:41.874580+0000","last_undegraded":"2023-12-19T17:51:41.874580+0000","last_fullsized":"2023-12-19T17:51:41.874580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875414+0000","last_change":"2023-12-19T17:51:37.877889+0000","last_active":"2023-12-19T17:51:41.875414+0000","last_peered":"2023-12-19T17:51:41.875414+0000","last_clean":"2023-12-19T17:51:41.875414+0000","last_became_active":"2023-12-19T17:51:37.877109+0000","last_became_peered":"2023-12-19T17:51:37.877109+0000","last_unstale":"2023-12-19T17:51:41.875414+0000","last_undegraded":"2023-12-19T17:51:41.875414+0000","last_fullsized":"2023-12-19T17:51:41.875414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870359+0000","last_change":"2023-12-19T17:51:37.857037+0000","last_active":"2023-12-19T17:51:41.870359+0000","last_peered":"2023-12-19T17:51:41.870359+0000","last_clean":"2023-12-19T17:51:41.870359+0000","last_became_active":"2023-12-19T17:51:37.856790+0000","last_became_peered":"2023-12-19T17:51:37.856790+0000","last_unstale":"2023-12-19T17:51:41.870359+0000","last_undegraded":"2023-12-19T17:51:41.870359+0000","last_fullsized":"2023-12-19T17:51:41.870359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880706+0000","last_change":"2023-12-19T17:51:37.857822+0000","last_active":"2023-12-19T17:51:41.880706+0000","last_peered":"2023-12-19T17:51:41.880706+0000","last_clean":"2023-12-19T17:51:41.880706+0000","last_became_active":"2023-12-19T17:51:37.855549+0000","last_became_peered":"2023-12-19T17:51:37.855549+0000","last_unstale":"2023-12-19T17:51:41.880706+0000","last_undegraded":"2023-12-19T17:51:41.880706+0000","last_fullsized":"2023-12-19T17:51:41.880706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.864155+0000","last_change":"2023-12-19T17:51:37.860504+0000","last_active":"2023-12-19T17:51:41.864155+0000","last_peered":"2023-12-19T17:51:41.864155+0000","last_clean":"2023-12-19T17:51:41.864155+0000","last_became_active":"2023-12-19T17:51:37.860153+0000","last_became_peered":"2023-12-19T17:51:37.860153+0000","last_unstale":"2023-12-19T17:51:41.864155+0000","last_undegraded":"2023-12-19T17:51:41.864155+0000","last_fullsized":"2023-12-19T17:51:41.864155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863155+0000","last_change":"2023-12-19T17:51:37.861734+0000","last_active":"2023-12-19T17:51:41.863155+0000","last_peered":"2023-12-19T17:51:41.863155+0000","last_clean":"2023-12-19T17:51:41.863155+0000","last_became_active":"2023-12-19T17:51:37.855703+0000","last_became_peered":"2023-12-19T17:51:37.855703+0000","last_unstale":"2023-12-19T17:51:41.863155+0000","last_undegraded":"2023-12-19T17:51:41.863155+0000","last_fullsized":"2023-12-19T17:51:41.863155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873169+0000","last_change":"2023-12-19T17:51:37.860944+0000","last_active":"2023-12-19T17:51:41.873169+0000","last_peered":"2023-12-19T17:51:41.873169+0000","last_clean":"2023-12-19T17:51:41.873169+0000","last_became_active":"2023-12-19T17:51:37.860435+0000","last_became_peered":"2023-12-19T17:51:37.860435+0000","last_unstale":"2023-12-19T17:51:41.873169+0000","last_undegraded":"2023-12-19T17:51:41.873169+0000","last_fullsized":"2023-12-19T17:51:41.873169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:26.638861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875676+0000","last_change":"2023-12-19T17:51:37.871267+0000","last_active":"2023-12-19T17:51:41.875676+0000","last_peered":"2023-12-19T17:51:41.875676+0000","last_clean":"2023-12-19T17:51:41.875676+0000","last_became_active":"2023-12-19T17:51:37.871093+0000","last_became_peered":"2023-12-19T17:51:37.871093+0000","last_unstale":"2023-12-19T17:51:41.875676+0000","last_undegraded":"2023-12-19T17:51:41.875676+0000","last_fullsized":"2023-12-19T17:51:41.875676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874498+0000","last_change":"2023-12-19T17:51:37.859001+0000","last_active":"2023-12-19T17:51:41.874498+0000","last_peered":"2023-12-19T17:51:41.874498+0000","last_clean":"2023-12-19T17:51:41.874498+0000","last_became_active":"2023-12-19T17:51:37.858756+0000","last_became_peered":"2023-12-19T17:51:37.858756+0000","last_unstale":"2023-12-19T17:51:41.874498+0000","last_undegraded":"2023-12-19T17:51:41.874498+0000","last_fullsized":"2023-12-19T17:51:41.874498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860552+0000","last_change":"2023-12-19T17:51:37.869034+0000","last_active":"2023-12-19T17:51:41.860552+0000","last_peered":"2023-12-19T17:51:41.860552+0000","last_clean":"2023-12-19T17:51:41.860552+0000","last_became_active":"2023-12-19T17:51:37.868411+0000","last_became_peered":"2023-12-19T17:51:37.868411+0000","last_unstale":"2023-12-19T17:51:41.860552+0000","last_undegraded":"2023-12-19T17:51:41.860552+0000","last_fullsized":"2023-12-19T17:51:41.860552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877952+0000","last_change":"2023-12-19T17:51:37.851059+0000","last_active":"2023-12-19T17:51:41.877952+0000","last_peered":"2023-12-19T17:51:41.877952+0000","last_clean":"2023-12-19T17:51:41.877952+0000","last_became_active":"2023-12-19T17:51:37.850723+0000","last_became_peered":"2023-12-19T17:51:37.850723+0000","last_unstale":"2023-12-19T17:51:41.877952+0000","last_undegraded":"2023-12-19T17:51:41.877952+0000","last_fullsized":"2023-12-19T17:51:41.877952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874288+0000","last_change":"2023-12-19T17:51:37.866674+0000","last_active":"2023-12-19T17:51:41.874288+0000","last_peered":"2023-12-19T17:51:41.874288+0000","last_clean":"2023-12-19T17:51:41.874288+0000","last_became_active":"2023-12-19T17:51:37.865470+0000","last_became_peered":"2023-12-19T17:51:37.865470+0000","last_unstale":"2023-12-19T17:51:41.874288+0000","last_undegraded":"2023-12-19T17:51:41.874288+0000","last_fullsized":"2023-12-19T17:51:41.874288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871739+0000","last_change":"2023-12-19T17:51:37.875330+0000","last_active":"2023-12-19T17:51:41.871739+0000","last_peered":"2023-12-19T17:51:41.871739+0000","last_clean":"2023-12-19T17:51:41.871739+0000","last_became_active":"2023-12-19T17:51:37.874974+0000","last_became_peered":"2023-12-19T17:51:37.874974+0000","last_unstale":"2023-12-19T17:51:41.871739+0000","last_undegraded":"2023-12-19T17:51:41.871739+0000","last_fullsized":"2023-12-19T17:51:41.871739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:42.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865979+0000","last_change":"2023-12-19T17:51:37.875506+0000","last_active":"2023-12-19T17:51:41.865979+0000","last_peered":"2023-12-19T17:51:41.865979+0000","last_clean":"2023-12-19T17:51:41.865979+0000","last_became_active":"2023-12-19T17:51:37.875016+0000","last_became_peered":"2023-12-19T17:51:37.875016+0000","last_unstale":"2023-12-19T17:51:41.865979+0000","last_undegraded":"2023-12-19T17:51:41.865979+0000","last_fullsized":"2023-12-19T17:51:41.865979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862619+0000","last_change":"2023-12-19T17:51:37.878903+0000","last_active":"2023-12-19T17:51:41.862619+0000","last_peered":"2023-12-19T17:51:41.862619+0000","last_clean":"2023-12-19T17:51:41.862619+0000","last_became_active":"2023-12-19T17:51:37.874964+0000","last_became_peered":"2023-12-19T17:51:37.874964+0000","last_unstale":"2023-12-19T17:51:41.862619+0000","last_undegraded":"2023-12-19T17:51:41.862619+0000","last_fullsized":"2023-12-19T17:51:41.862619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863340+0000","last_change":"2023-12-19T17:51:37.858908+0000","last_active":"2023-12-19T17:51:41.863340+0000","last_peered":"2023-12-19T17:51:41.863340+0000","last_clean":"2023-12-19T17:51:41.863340+0000","last_became_active":"2023-12-19T17:51:37.858336+0000","last_became_peered":"2023-12-19T17:51:37.858336+0000","last_unstale":"2023-12-19T17:51:41.863340+0000","last_undegraded":"2023-12-19T17:51:41.863340+0000","last_fullsized":"2023-12-19T17:51:41.863340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871491+0000","last_change":"2023-12-19T17:51:37.862607+0000","last_active":"2023-12-19T17:51:41.871491+0000","last_peered":"2023-12-19T17:51:41.871491+0000","last_clean":"2023-12-19T17:51:41.871491+0000","last_became_active":"2023-12-19T17:51:37.862159+0000","last_became_peered":"2023-12-19T17:51:37.862159+0000","last_unstale":"2023-12-19T17:51:41.871491+0000","last_undegraded":"2023-12-19T17:51:41.871491+0000","last_fullsized":"2023-12-19T17:51:41.871491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861454+0000","last_change":"2023-12-19T17:51:37.848444+0000","last_active":"2023-12-19T17:51:41.861454+0000","last_peered":"2023-12-19T17:51:41.861454+0000","last_clean":"2023-12-19T17:51:41.861454+0000","last_became_active":"2023-12-19T17:51:37.848141+0000","last_became_peered":"2023-12-19T17:51:37.848141+0000","last_unstale":"2023-12-19T17:51:41.861454+0000","last_undegraded":"2023-12-19T17:51:41.861454+0000","last_fullsized":"2023-12-19T17:51:41.861454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870323+0000","last_change":"2023-12-19T17:51:37.859778+0000","last_active":"2023-12-19T17:51:41.870323+0000","last_peered":"2023-12-19T17:51:41.870323+0000","last_clean":"2023-12-19T17:51:41.870323+0000","last_became_active":"2023-12-19T17:51:37.859521+0000","last_became_peered":"2023-12-19T17:51:37.859521+0000","last_unstale":"2023-12-19T17:51:41.870323+0000","last_undegraded":"2023-12-19T17:51:41.870323+0000","last_fullsized":"2023-12-19T17:51:41.870323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861746+0000","last_change":"2023-12-19T17:51:37.848789+0000","last_active":"2023-12-19T17:51:41.861746+0000","last_peered":"2023-12-19T17:51:41.861746+0000","last_clean":"2023-12-19T17:51:41.861746+0000","last_became_active":"2023-12-19T17:51:37.848533+0000","last_became_peered":"2023-12-19T17:51:37.848533+0000","last_unstale":"2023-12-19T17:51:41.861746+0000","last_undegraded":"2023-12-19T17:51:41.861746+0000","last_fullsized":"2023-12-19T17:51:41.861746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873893+0000","last_change":"2023-12-19T17:51:37.878808+0000","last_active":"2023-12-19T17:51:41.873893+0000","last_peered":"2023-12-19T17:51:41.873893+0000","last_clean":"2023-12-19T17:51:41.873893+0000","last_became_active":"2023-12-19T17:51:37.878550+0000","last_became_peered":"2023-12-19T17:51:37.878550+0000","last_unstale":"2023-12-19T17:51:41.873893+0000","last_undegraded":"2023-12-19T17:51:41.873893+0000","last_fullsized":"2023-12-19T17:51:41.873893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880534+0000","last_change":"2023-12-19T17:51:37.842584+0000","last_active":"2023-12-19T17:51:41.880534+0000","last_peered":"2023-12-19T17:51:41.880534+0000","last_clean":"2023-12-19T17:51:41.880534+0000","last_became_active":"2023-12-19T17:51:37.842230+0000","last_became_peered":"2023-12-19T17:51:37.842230+0000","last_unstale":"2023-12-19T17:51:41.880534+0000","last_undegraded":"2023-12-19T17:51:41.880534+0000","last_fullsized":"2023-12-19T17:51:41.880534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861715+0000","last_change":"2023-12-19T17:51:37.866251+0000","last_active":"2023-12-19T17:51:41.861715+0000","last_peered":"2023-12-19T17:51:41.861715+0000","last_clean":"2023-12-19T17:51:41.861715+0000","last_became_active":"2023-12-19T17:51:37.865954+0000","last_became_peered":"2023-12-19T17:51:37.865954+0000","last_unstale":"2023-12-19T17:51:41.861715+0000","last_undegraded":"2023-12-19T17:51:41.861715+0000","last_fullsized":"2023-12-19T17:51:41.861715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863303+0000","last_change":"2023-12-19T17:51:37.869240+0000","last_active":"2023-12-19T17:51:41.863303+0000","last_peered":"2023-12-19T17:51:41.863303+0000","last_clean":"2023-12-19T17:51:41.863303+0000","last_became_active":"2023-12-19T17:51:37.868451+0000","last_became_peered":"2023-12-19T17:51:37.868451+0000","last_unstale":"2023-12-19T17:51:41.863303+0000","last_undegraded":"2023-12-19T17:51:41.863303+0000","last_fullsized":"2023-12-19T17:51:41.863303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3720000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.274}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.46}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2150000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5149999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94199999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4950000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.472}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:52:04.187 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T17:52:04.188 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-19T17:52:04.188 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-19T17:52:04.188 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-19T17:52:04.188 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-19T17:52:04.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 Processor -- start 2023-12-19T17:52:04.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 -- start start 2023-12-19T17:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c15e170 0x7f196c0cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f196c0cbe00 0x7f196c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f196c070fd0 con 0x7f196c15e550 2023-12-19T17:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f196c0aebe0 con 0x7f196c0cbe00 2023-12-19T17:52:04.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f1971eb0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c0aeec0 con 0x7f196c15e170 2023-12-19T17:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f19716af700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f196c15e550 0x7f196c06a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59196/0 (socket says 172.21.15.45:59196) 2023-12-19T17:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.410+0000 7f19716af700 1 -- 172.21.15.45:0/1329832448 learned_addr learned my addr 172.21.15.45:0/1329832448 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1970eae700 1 --2- 172.21.15.45:0/1329832448 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c15e170 0x7f196c0cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196bfff700 1 --2- 172.21.15.45:0/1329832448 >> v2:172.21.15.73:3300/0 conn(0x7f196c0cbe00 0x7f196c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196b7fe700 1 -- 172.21.15.45:0/1329832448 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911303484 0 0) 0x7f196c070fd0 con 0x7f196c15e550 2023-12-19T17:52:04.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196b7fe700 1 -- 172.21.15.45:0/1329832448 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f195c0035d0 con 0x7f196c15e550 2023-12-19T17:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1970eae700 1 -- 172.21.15.45:0/1329832448 >> v2:172.21.15.73:3300/0 conn(0x7f196c0cbe00 msgr2=0x7f196c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1970eae700 1 --2- 172.21.15.45:0/1329832448 >> v2:172.21.15.73:3300/0 conn(0x7f196c0cbe00 0x7f196c070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1970eae700 1 -- 172.21.15.45:0/1329832448 >> v1:172.21.15.45:6789/0 conn(0x7f196c15e550 legacy=0x7f196c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1970eae700 1 -- 172.21.15.45:0/1329832448 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f196c070290 con 0x7f196c15e170 2023-12-19T17:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196bfff700 1 --2- 172.21.15.45:0/1329832448 >> v2:172.21.15.73:3300/0 conn(0x7f196c0cbe00 0x7f196c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:04.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1970eae700 1 --2- 172.21.15.45:0/1329832448 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c15e170 0x7f196c0cb2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1960009850 tx=0x7f1960009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d278c118a1dcde4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:04.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196b7fe700 1 -- 172.21.15.45:0/1329832448 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011830 con 0x7f196c15e170 2023-12-19T17:52:04.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196b7fe700 1 -- 172.21.15.45:0/1329832448 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1960011990 con 0x7f196c15e170 2023-12-19T17:52:04.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f196b7fe700 1 -- 172.21.15.45:0/1329832448 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960011d40 con 0x7f196c15e170 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 -- 172.21.15.45:0/1329832448 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c15e170 msgr2=0x7f196c0cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 --2- 172.21.15.45:0/1329832448 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c15e170 0x7f196c0cb2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1960009850 tx=0x7f1960009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 -- 172.21.15.45:0/1329832448 shutdown_connections 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 --2- 172.21.15.45:0/1329832448 >> v2:172.21.15.73:3300/0 conn(0x7f196c0cbe00 0x7f196c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 --2- 172.21.15.45:0/1329832448 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c15e170 0x7f196c0cb2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 -- 172.21.15.45:0/1329832448 >> 172.21.15.45:0/1329832448 conn(0x7f196c0cf960 msgr2=0x7f196c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 -- 172.21.15.45:0/1329832448 shutdown_connections 2023-12-19T17:52:04.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.414+0000 7f1971eb0700 1 -- 172.21.15.45:0/1329832448 wait complete. 2023-12-19T17:52:04.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 Processor -- start 2023-12-19T17:52:04.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 -- start start 2023-12-19T17:52:04.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c0cbe00 0x7f196c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c15e170 0x7f196c159ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 0x7f196c0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15cfa0 con 0x7f196c15e550 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15c420 con 0x7f196c15e170 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f1971eb0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f196c15c700 con 0x7f196c0cbe00 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f19716af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 0x7f196c0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f19716af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 0x7f196c0c8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37848/0 (socket says 172.21.15.45:37848) 2023-12-19T17:52:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f19716af700 1 -- 172.21.15.45:0/3871521838 learned_addr learned my addr 172.21.15.45:0/3871521838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f1970eae700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c0cbe00 0x7f196c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.418+0000 7f196bfff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c15e170 0x7f196c159ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19716af700 1 -- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c0cbe00 msgr2=0x7f196c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19716af700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c0cbe00 0x7f196c158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19716af700 1 -- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c15e170 msgr2=0x7f196c159ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19716af700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c15e170 0x7f196c159ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19716af700 1 -- 172.21.15.45:0/3871521838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19580094b0 con 0x7f196c15e550 2023-12-19T17:52:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f196bfff700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c15e170 0x7f196c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:04.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19716af700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 0x7f196c0c8c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f196400ca70 tx=0x7f196400caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964007480 con 0x7f196c15e550 2023-12-19T17:52:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19640075e0 con 0x7f196c15e550 2023-12-19T17:52:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19600094b0 con 0x7f196c15e550 2023-12-19T17:52:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1964007950 con 0x7f196c15e550 2023-12-19T17:52:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.422+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f196c15ccc0 con 0x7f196c15e550 2023-12-19T17:52:04.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.426+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f196c067760 con 0x7f196c15e550 2023-12-19T17:52:04.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.426+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1964012400 con 0x7f196c15e550 2023-12-19T17:52:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.426+0000 7f19697fa700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1950065ad0 0x7f1950067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.426+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1964082b80 con 0x7f196c15e550 2023-12-19T17:52:04.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.426+0000 7f1970eae700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1950065ad0 0x7f1950067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.430+0000 7f1970eae700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1950065ad0 0x7f1950067f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19600090b0 tx=0x7f1960008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.434+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1964050310 con 0x7f196c15e550 2023-12-19T17:52:04.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.654+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f196c06fa90 con 0x7f196c15e550 2023-12-19T17:52:04.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.662+0000 7f19697fa700 1 -- 172.21.15.45:0/3871521838 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163362 (secure 0 0 0) 0x7f1964053930 con 0x7f196c15e550 2023-12-19T17:52:04.666 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:04.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1950065ad0 msgr2=0x7f1950067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1950065ad0 0x7f1950067f90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19600090b0 tx=0x7f1960008030 comp rx=0 tx=0).stop 2023-12-19T17:52:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 msgr2=0x7f196c0c8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 0x7f196c0c8c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f196400ca70 tx=0x7f196400caa0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 shutdown_connections 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1950065ad0 0x7f1950067f90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f196c15e550 0x7f196c0c8c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f196c15e170 0x7f196c159ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 --2- 172.21.15.45:0/3871521838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f196c0cbe00 0x7f196c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 >> 172.21.15.45:0/3871521838 conn(0x7f196c0cf960 msgr2=0x7f196c0b5010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 shutdown_connections 2023-12-19T17:52:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.670+0000 7f1971eb0700 1 -- 172.21.15.45:0/3871521838 wait complete. 2023-12-19T17:52:04.697 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6832","nonce":36158},{"type":"v1","addr":"172.21.15.45:6833","nonce":36158}]},"active_addr":"172.21.15.45:6833/36158","active_change":"2023-12-19T17:51:20.166741+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4114,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1177862517}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1094164529}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":691534104}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.45:0","nonce":1160442505}]}]} 2023-12-19T17:52:04.700 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-19T17:52:04.700 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-19T17:52:04.700 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.886+0000 7ff665b45700 1 Processor -- start 2023-12-19T17:52:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.886+0000 7ff665b45700 1 -- start start 2023-12-19T17:52:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff665b45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66015e450 0x7ff66006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff665b45700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66006c760 con 0x7ff6600af720 2023-12-19T17:52:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff665b45700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66006ca40 con 0x7ff660159a50 2023-12-19T17:52:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff665b45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff660070540 con 0x7ff66015e450 2023-12-19T17:52:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff664b43700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff660159a50 0x7ff6600c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51202/0 (socket says 172.21.15.45:51202) 2023-12-19T17:52:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff664b43700 1 -- 172.21.15.45:0/2211427626 learned_addr learned my addr 172.21.15.45:0/2211427626 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.890+0000 7ff65ffff700 1 --2- 172.21.15.45:0/2211427626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66015e450 0x7ff66006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605689533 0 0) 0x7ff66006ca40 con 0x7ff660159a50 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6500035d0 con 0x7ff660159a50 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174552393 0 0) 0x7ff66006c760 con 0x7ff6600af720 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66006ca40 con 0x7ff6600af720 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65ffff700 1 -- 172.21.15.45:0/2211427626 >> v1:172.21.15.73:6789/0 conn(0x7ff660159a50 legacy=0x7ff6600c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65ffff700 1 -- 172.21.15.45:0/2211427626 >> v1:172.21.15.45:6789/0 conn(0x7ff6600af720 legacy=0x7ff66006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65ffff700 1 -- 172.21.15.45:0/2211427626 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66006cd20 con 0x7ff66015e450 2023-12-19T17:52:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65ffff700 1 --2- 172.21.15.45:0/2211427626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66015e450 0x7ff66006fba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009880 tx=0x7ff64c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e3f360e7710b25 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c011830 con 0x7ff66015e450 2023-12-19T17:52:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c011990 con 0x7ff66015e450 2023-12-19T17:52:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff65f7fe700 1 -- 172.21.15.45:0/2211427626 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c011d20 con 0x7ff66015e450 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 -- 172.21.15.45:0/2211427626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66015e450 msgr2=0x7ff66006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 --2- 172.21.15.45:0/2211427626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66015e450 0x7ff66006fba0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7ff64c009880 tx=0x7ff64c009b90 comp rx=0 tx=0).stop 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 -- 172.21.15.45:0/2211427626 shutdown_connections 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 --2- 172.21.15.45:0/2211427626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff66015e450 0x7ff66006fba0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 -- 172.21.15.45:0/2211427626 >> 172.21.15.45:0/2211427626 conn(0x7ff6600cb900 msgr2=0x7ff6600b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 -- 172.21.15.45:0/2211427626 shutdown_connections 2023-12-19T17:52:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.894+0000 7ff665b45700 1 -- 172.21.15.45:0/2211427626 wait complete. 2023-12-19T17:52:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.898+0000 7ff665b45700 1 Processor -- start 2023-12-19T17:52:04.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.898+0000 7ff665b45700 1 -- start start 2023-12-19T17:52:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665b45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 0x7ff6601efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665b45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff660159a50 0x7ff6601f39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665b45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015e450 0x7ff6601f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665b45700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601f3790 con 0x7ff6600af720 2023-12-19T17:52:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665b45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601f31d0 con 0x7ff66015e450 2023-12-19T17:52:04.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665b45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6601f34b0 con 0x7ff660159a50 2023-12-19T17:52:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff664b43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 0x7ff6601efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff664b43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 0x7ff6601efcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37856/0 (socket says 172.21.15.45:37856) 2023-12-19T17:52:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff664b43700 1 -- 172.21.15.45:0/1118082229 learned_addr learned my addr 172.21.15.45:0/1118082229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff660159a50 0x7ff6601f39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff665344700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015e450 0x7ff6601f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 -- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015e450 msgr2=0x7ff6601f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015e450 0x7ff6601f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 -- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 msgr2=0x7ff6601efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 0x7ff6601efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 -- 172.21.15.45:0/1118082229 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff64c0094b0 con 0x7ff660159a50 2023-12-19T17:52:04.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff664b43700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 0x7ff6601efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65ffff700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff660159a50 0x7ff6601f39d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff64c015000 tx=0x7ff64c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01a8c0 con 0x7ff660159a50 2023-12-19T17:52:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.902+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff64c01e070 con 0x7ff660159a50 2023-12-19T17:52:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.906+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64c01aca0 con 0x7ff660159a50 2023-12-19T17:52:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.906+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66015a290 con 0x7ff660159a50 2023-12-19T17:52:04.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.906+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6601f01f0 con 0x7ff660159a50 2023-12-19T17:52:04.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.906+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6600cf9a0 con 0x7ff660159a50 2023-12-19T17:52:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.906+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff64c02c3f0 con 0x7ff660159a50 2023-12-19T17:52:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.910+0000 7ff65d7fa700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff644065ad0 0x7ff644067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.910+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff64c0841f0 con 0x7ff660159a50 2023-12-19T17:52:04.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.910+0000 7ff664b43700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff644065ad0 0x7ff644067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:04.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.910+0000 7ff664b43700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff644065ad0 0x7ff644067f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff654000f60 tx=0x7ff654009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:04.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:04.914+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff64c051930 con 0x7ff660159a50 2023-12-19T17:52:05.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.094+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff660067760 con 0x7ff660159a50 2023-12-19T17:52:05.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.098+0000 7ff65d7fa700 1 -- 172.21.15.45:0/1118082229 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7ff64c020020 con 0x7ff660159a50 2023-12-19T17:52:05.102 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:05.102 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff644065ad0 msgr2=0x7ff644067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff644065ad0 0x7ff644067f90 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff654000f60 tx=0x7ff654009040 comp rx=0 tx=0).stop 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff660159a50 msgr2=0x7ff6601f39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff660159a50 0x7ff6601f39d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff64c015000 tx=0x7ff64c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 shutdown_connections 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff644065ad0 0x7ff644067f90 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff66015e450 0x7ff6601f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff660159a50 0x7ff6601f39d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 --2- 172.21.15.45:0/1118082229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6600af720 0x7ff6601efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 >> 172.21.15.45:0/1118082229 conn(0x7ff6600cb900 msgr2=0x7ff6600cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 shutdown_connections 2023-12-19T17:52:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.106+0000 7ff665b45700 1 -- 172.21.15.45:0/1118082229 wait complete. 2023-12-19T17:52:05.130 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-19T17:52:05.131 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.322+0000 7f210e8fe700 1 Processor -- start 2023-12-19T17:52:05.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.322+0000 7f210e8fe700 1 -- start start 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e8fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f21080c96c0 0x7f2108070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e8fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2108070a80 0x7f210806d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e8fe700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f210815dc90 con 0x7f21080ccc40 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e8fe700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21081597e0 con 0x7f2108070a80 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e8fe700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210815d080 con 0x7f21080c96c0 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210d8fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f21080ccc40 0x7f21080cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59206/0 (socket says 172.21.15.45:59206) 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210d8fc700 1 -- 172.21.15.45:0/3552495272 learned_addr learned my addr 172.21.15.45:0/3552495272 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e0fd700 1 --2- 172.21.15.45:0/3552495272 >> v2:172.21.15.45:3300/0 conn(0x7f2108070a80 0x7f210806d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210d0fb700 1 --2- 172.21.15.45:0/3552495272 >> v2:172.21.15.73:3300/0 conn(0x7f21080c96c0 0x7f2108070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210c8fa700 1 -- 172.21.15.45:0/3552495272 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156450498 0 0) 0x7f210815dc90 con 0x7f21080ccc40 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210c8fa700 1 -- 172.21.15.45:0/3552495272 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f40035d0 con 0x7f21080ccc40 2023-12-19T17:52:05.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e0fd700 1 -- 172.21.15.45:0/3552495272 >> v2:172.21.15.73:3300/0 conn(0x7f21080c96c0 msgr2=0x7f2108070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e0fd700 1 --2- 172.21.15.45:0/3552495272 >> v2:172.21.15.73:3300/0 conn(0x7f21080c96c0 0x7f2108070540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e0fd700 1 -- 172.21.15.45:0/3552495272 >> v1:172.21.15.45:6789/0 conn(0x7f21080ccc40 legacy=0x7f21080cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e0fd700 1 -- 172.21.15.45:0/3552495272 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210815d360 con 0x7f2108070a80 2023-12-19T17:52:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210e0fd700 1 --2- 172.21.15.45:0/3552495272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2108070a80 0x7f210806d060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21080a0630 tx=0x7f210000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f09d28f1f97c47a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.326+0000 7f210c8fa700 1 -- 172.21.15.45:0/3552495272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000e070 con 0x7f2108070a80 2023-12-19T17:52:05.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210c8fa700 1 -- 172.21.15.45:0/3552495272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000bb20 con 0x7f2108070a80 2023-12-19T17:52:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210c8fa700 1 -- 172.21.15.45:0/3552495272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000be90 con 0x7f2108070a80 2023-12-19T17:52:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 -- 172.21.15.45:0/3552495272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2108070a80 msgr2=0x7f210806d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3552495272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2108070a80 0x7f210806d060 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f21080a0630 tx=0x7f210000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 -- 172.21.15.45:0/3552495272 shutdown_connections 2023-12-19T17:52:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3552495272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2108070a80 0x7f210806d060 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3552495272 >> v2:172.21.15.73:3300/0 conn(0x7f21080c96c0 0x7f2108070540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 -- 172.21.15.45:0/3552495272 >> 172.21.15.45:0/3552495272 conn(0x7f21080cf070 msgr2=0x7f21080cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 -- 172.21.15.45:0/3552495272 shutdown_connections 2023-12-19T17:52:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.330+0000 7f210e8fe700 1 -- 172.21.15.45:0/3552495272 wait complete. 2023-12-19T17:52:05.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 Processor -- start 2023-12-19T17:52:05.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 -- start start 2023-12-19T17:52:05.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 0x7f21080c4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21080c96c0 0x7f2108153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21080ccc40 0x7f21080b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080a0480 con 0x7f21080ccc40 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f210809f1e0 con 0x7f2108070a80 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.334+0000 7f210e8fe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080b2cf0 con 0x7f21080c96c0 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 0x7f21080c4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 0x7f21080c4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33270/0 (socket says 172.21.15.45:33270) 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 -- 172.21.15.45:0/3282704366 learned_addr learned my addr 172.21.15.45:0/3282704366 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210e0fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21080ccc40 0x7f21080b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d0fb700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21080c96c0 0x7f2108153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 -- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21080c96c0 msgr2=0x7f2108153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21080c96c0 0x7f2108153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 -- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21080ccc40 msgr2=0x7f21080b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21080ccc40 0x7f21080b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 -- 172.21.15.45:0/3282704366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2100009a70 con 0x7f2108070a80 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210e0fd700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21080ccc40 0x7f21080b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210d8fc700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 0x7f21080c4c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f210400c4d0 tx=0x7f210400c7e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104005d90 con 0x7f2108070a80 2023-12-19T17:52:05.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400ce80 con 0x7f2108070a80 2023-12-19T17:52:05.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21040072d0 con 0x7f2108070a80 2023-12-19T17:52:05.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21080b22b0 con 0x7f2108070a80 2023-12-19T17:52:05.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.338+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21080b2a10 con 0x7f2108070a80 2023-12-19T17:52:05.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.342+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210815d620 con 0x7f2108070a80 2023-12-19T17:52:05.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.342+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2104007430 con 0x7f2108070a80 2023-12-19T17:52:05.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.346+0000 7f20fe7fc700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f20ec065b20 0x7f20ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.346+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2104082690 con 0x7f2108070a80 2023-12-19T17:52:05.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.346+0000 7f210d0fb700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f20ec065b20 0x7f20ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.346+0000 7f210d0fb700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f20ec065b20 0x7f20ec067fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2108071800 tx=0x7f20f8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.354+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f210815d620 con 0x7f2108070a80 2023-12-19T17:52:05.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.538+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f210815d620 con 0x7f2108070a80 2023-12-19T17:52:05.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.542+0000 7f20fe7fc700 1 -- 172.21.15.45:0/3282704366 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f210815d620 con 0x7f2108070a80 2023-12-19T17:52:05.543 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:05.543 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f20ec065b20 msgr2=0x7f20ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f20ec065b20 0x7f20ec067fe0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2108071800 tx=0x7f20f8009240 comp rx=0 tx=0).stop 2023-12-19T17:52:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 msgr2=0x7f21080c4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 0x7f21080c4c60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f210400c4d0 tx=0x7f210400c7e0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 shutdown_connections 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f20ec065b20 0x7f20ec067fe0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21080ccc40 0x7f21080b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21080c96c0 0x7f2108153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 --2- 172.21.15.45:0/3282704366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2108070a80 0x7f21080c4c60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 >> 172.21.15.45:0/3282704366 conn(0x7f21080cf070 msgr2=0x7f210806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 shutdown_connections 2023-12-19T17:52:05.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.546+0000 7f210e8fe700 1 -- 172.21.15.45:0/3282704366 wait complete. 2023-12-19T17:52:05.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-19T17:52:05.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-19T17:52:05.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-19T17:52:05.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-19T17:52:05.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-19T17:52:05.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-19T17:52:05.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-19T17:52:05.573 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-19T17:52:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.810+0000 7f5b0d9f9700 1 Processor -- start 2023-12-19T17:52:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.810+0000 7fd4808fe700 1 Processor -- start 2023-12-19T17:52:05.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.810+0000 7fd4808fe700 1 -- start start 2023-12-19T17:52:05.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7ff74c0c8700 1 Processor -- start 2023-12-19T17:52:05.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7f5b0d9f9700 1 -- start start 2023-12-19T17:52:05.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7ff74c0c8700 1 -- start start 2023-12-19T17:52:05.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7f26dc5f9700 1 Processor -- start 2023-12-19T17:52:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b0d9f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5b0806c850 0x7f5b0806ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b0d9f9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5b080c4200 0x7f5b080c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7f26dc5f9700 1 -- start start 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7fd4808fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd47c158e00 0x7fd47c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7fd4808fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 0x7fd47c15d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7fd4808fe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c070b50 con 0x7fd47c0cbdc0 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7fd4808fe700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c070da0 con 0x7fd47c06efd0 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.814+0000 7fd4808fe700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c071080 con 0x7fd47c158e00 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 0x7fd47c15d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 0x7fd47c15d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37884/0 (socket says 172.21.15.45:37884) 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47bfff700 1 -- 172.21.15.45:0/2522748314 learned_addr learned my addr 172.21.15.45:0/2522748314 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74c0c8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff7441615a0 0x7ff7440c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74c0c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 0x7ff7440afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74c0c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7440c3f90 con 0x7ff7441611c0 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74c0c8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7440b00f0 con 0x7ff7441615a0 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74c0c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff744070340 con 0x7ff7440af720 2023-12-19T17:52:05.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b0d9f9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0815d410 con 0x7f5b0815d030 2023-12-19T17:52:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b0d9f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b080c4bd0 con 0x7f5b0806c850 2023-12-19T17:52:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b0d9f9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b0806f5f0 con 0x7f5b080c4200 2023-12-19T17:52:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47affd700 1 --2- 172.21.15.45:0/2522748314 >> v2:172.21.15.73:3300/0 conn(0x7fd47c158e00 0x7fd47c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b06ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f5b0815d030 0x7f5b080ccbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51206/0 (socket says 172.21.15.45:51206) 2023-12-19T17:52:05.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b06ffd700 1 -- 172.21.15.45:0/1099722117 learned_addr learned my addr 172.21.15.45:0/1099722117 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dc5f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26d406ea90 0x7f26d40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 0x7ff7440afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 0x7ff7440afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:54966/0 (socket says 172.21.15.45:54966) 2023-12-19T17:52:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 -- 172.21.15.45:0/1592512889 learned_addr learned my addr 172.21.15.45:0/1592512889 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff749663700 1 --2- 172.21.15.45:0/1592512889 >> v2:172.21.15.73:3300/0 conn(0x7ff7441615a0 0x7ff7440c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dc5f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b077fe700 1 --2- 172.21.15.45:0/1099722117 >> v2:172.21.15.73:3300/0 conn(0x7f5b080c4200 0x7f5b080c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dc5f9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d40d1820 con 0x7f26d40b88b0 2023-12-19T17:52:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dc5f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d40d1b00 con 0x7f26d406ea90 2023-12-19T17:52:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dc5f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40d1de0 con 0x7f26d406fe80 2023-12-19T17:52:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b067fc700 1 --2- 172.21.15.45:0/1099722117 >> v2:172.21.15.45:3300/0 conn(0x7f5b0806c850 0x7f5b0806ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b05ffb700 1 -- 172.21.15.45:0/1099722117 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 56349570 0 0) 0x7f5afc001110 con 0x7f5b0815d030 2023-12-19T17:52:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b05ffb700 1 -- 172.21.15.45:0/1099722117 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af00035d0 con 0x7f5b0815d030 2023-12-19T17:52:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dab96700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dab96700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d40b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:54976/0 (socket says 172.21.15.45:54976) 2023-12-19T17:52:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26dab96700 1 -- 172.21.15.45:0/795006505 learned_addr learned my addr 172.21.15.45:0/795006505 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 -- 172.21.15.45:0/1592512889 >> v2:172.21.15.73:3300/0 conn(0x7ff7441615a0 msgr2=0x7ff7440c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 --2- 172.21.15.45:0/1592512889 >> v2:172.21.15.73:3300/0 conn(0x7ff7441615a0 0x7ff7440c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b077fe700 1 -- 172.21.15.45:0/1099722117 >> v2:172.21.15.45:3300/0 conn(0x7f5b0806c850 msgr2=0x7f5b0806ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b077fe700 1 --2- 172.21.15.45:0/1099722117 >> v2:172.21.15.45:3300/0 conn(0x7f5b0806c850 0x7f5b0806ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b077fe700 1 -- 172.21.15.45:0/1099722117 >> v1:172.21.15.73:6789/0 conn(0x7f5b0815d030 legacy=0x7f5b080ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b077fe700 1 -- 172.21.15.45:0/1099722117 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080ae240 con 0x7f5b080c4200 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47affd700 1 -- 172.21.15.45:0/2522748314 >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 msgr2=0x7fd47c15d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47affd700 1 --2- 172.21.15.45:0/2522748314 >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 0x7fd47c15d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47affd700 1 -- 172.21.15.45:0/2522748314 >> v1:172.21.15.73:6789/0 conn(0x7fd47c0cbdc0 legacy=0x7fd47c159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 -- 172.21.15.45:0/1592512889 >> v1:172.21.15.73:6789/0 conn(0x7ff7441611c0 legacy=0x7ff74406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7ff74a665700 1 -- 172.21.15.45:0/1592512889 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7440c4270 con 0x7ff7440af720 2023-12-19T17:52:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f5b077fe700 1 --2- 172.21.15.45:0/1099722117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b080c4200 0x7f5b080c4690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5b080c5820 tx=0x7f5af8009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e57954dfeb84e645 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7f26da395700 1 --2- 172.21.15.45:0/795006505 >> v2:172.21.15.45:3300/0 conn(0x7f26d406ea90 0x7f26d40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dab96700 1 -- 172.21.15.45:0/795006505 >> v2:172.21.15.45:3300/0 conn(0x7f26d406ea90 msgr2=0x7f26d40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47a7fc700 1 -- 172.21.15.45:0/2522748314 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243203915 0 0) 0x7fd47c070b50 con 0x7fd47c0cbdc0 2023-12-19T17:52:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47affd700 1 -- 172.21.15.45:0/2522748314 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c071360 con 0x7fd47c158e00 2023-12-19T17:52:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.818+0000 7fd47bfff700 1 --2- 172.21.15.45:0/2522748314 >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 0x7fd47c15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:05.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74a665700 1 --2- 172.21.15.45:0/1592512889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 0x7ff7440afbb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009e50 tx=0x7ff73c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8d24ae9292240d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dab96700 1 --2- 172.21.15.45:0/795006505 >> v2:172.21.15.45:3300/0 conn(0x7f26d406ea90 0x7f26d40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dab96700 1 -- 172.21.15.45:0/795006505 >> v1:172.21.15.73:6789/0 conn(0x7f26d40b88b0 legacy=0x7f26d40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dab96700 1 -- 172.21.15.45:0/795006505 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40d20c0 con 0x7f26d406fe80 2023-12-19T17:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b05ffb700 1 -- 172.21.15.45:0/1099722117 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af8005ea0 con 0x7f5b080c4200 2023-12-19T17:52:05.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26da395700 1 --2- 172.21.15.45:0/795006505 >> v2:172.21.15.45:3300/0 conn(0x7f26d406ea90 0x7f26d40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b05ffb700 1 -- 172.21.15.45:0/1099722117 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af8006030 con 0x7f5b080c4200 2023-12-19T17:52:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b05ffb700 1 -- 172.21.15.45:0/1099722117 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af80063c0 con 0x7f5b080c4200 2023-12-19T17:52:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 Processor -- start 2023-12-19T17:52:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff748e62700 1 -- 172.21.15.45:0/1592512889 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00e070 con 0x7ff7440af720 2023-12-19T17:52:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff748e62700 1 -- 172.21.15.45:0/1592512889 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff73c00b9c0 con 0x7ff7440af720 2023-12-19T17:52:05.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff748e62700 1 -- 172.21.15.45:0/1592512889 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00bd70 con 0x7ff7440af720 2023-12-19T17:52:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dab96700 1 --2- 172.21.15.45:0/795006505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d40b6420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009e50 tx=0x7f26cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dbb8f14d26fddb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 -- start start 2023-12-19T17:52:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/1099722117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b080c4200 msgr2=0x7f5b080c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 --2- 172.21.15.45:0/1099722117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b080c4200 0x7f5b080c4690 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5b080c5820 tx=0x7f5af8009b20 comp rx=0 tx=0).stop 2023-12-19T17:52:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/1099722117 shutdown_connections 2023-12-19T17:52:05.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 --2- 172.21.15.45:0/1099722117 >> v2:172.21.15.45:3300/0 conn(0x7f5b0806c850 0x7f5b0806ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd47affd700 1 --2- 172.21.15.45:0/2522748314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c158e00 0x7fd47c06ea90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ce800 tx=0x7fd46c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb13b24887f065b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 --2- 172.21.15.45:0/1099722117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b080c4200 0x7f5b080c4690 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/1099722117 >> 172.21.15.45:0/1099722117 conn(0x7f5b080ce990 msgr2=0x7f5b080ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/1099722117 shutdown_connections 2023-12-19T17:52:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/1099722117 wait complete. 2023-12-19T17:52:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 -- 172.21.15.45:0/1592512889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 msgr2=0x7ff7440afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 --2- 172.21.15.45:0/1592512889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 0x7ff7440afbb0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009e50 tx=0x7ff73c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26d9393700 1 -- 172.21.15.45:0/795006505 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc00e070 con 0x7f26d406fe80 2023-12-19T17:52:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26d9393700 1 -- 172.21.15.45:0/795006505 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc003a40 con 0x7f26d406fe80 2023-12-19T17:52:05.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26d9393700 1 -- 172.21.15.45:0/795006505 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc003df0 con 0x7f26d406fe80 2023-12-19T17:52:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd47a7fc700 1 -- 172.21.15.45:0/2522748314 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011830 con 0x7fd47c158e00 2023-12-19T17:52:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd47a7fc700 1 -- 172.21.15.45:0/2522748314 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd46c011990 con 0x7fd47c158e00 2023-12-19T17:52:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd47a7fc700 1 -- 172.21.15.45:0/2522748314 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd46c011d20 con 0x7fd47c158e00 2023-12-19T17:52:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 -- 172.21.15.45:0/1592512889 shutdown_connections 2023-12-19T17:52:05.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 --2- 172.21.15.45:0/1592512889 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7440af720 0x7ff7440afbb0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 --2- 172.21.15.45:0/1592512889 >> v2:172.21.15.73:3300/0 conn(0x7ff7441615a0 0x7ff7440c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 -- 172.21.15.45:0/1592512889 >> 172.21.15.45:0/1592512889 conn(0x7ff7440cb900 msgr2=0x7ff7440b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 -- 172.21.15.45:0/1592512889 shutdown_connections 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7ff74c0c8700 1 -- 172.21.15.45:0/1592512889 wait complete. 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd4808fe700 1 -- 172.21.15.45:0/2522748314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c158e00 msgr2=0x7fd47c06ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd4808fe700 1 --2- 172.21.15.45:0/2522748314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c158e00 0x7fd47c06ea90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ce800 tx=0x7fd46c009b30 comp rx=0 tx=0).stop 2023-12-19T17:52:05.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dc5f9700 1 -- 172.21.15.45:0/795006505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 msgr2=0x7f26d40b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f26dc5f9700 1 --2- 172.21.15.45:0/795006505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d40b6420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f26cc009e50 tx=0x7f26cc00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ea40b88b0 0x7f8ea40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd4808fe700 1 -- 172.21.15.45:0/2522748314 shutdown_connections 2023-12-19T17:52:05.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd4808fe700 1 --2- 172.21.15.45:0/2522748314 >> v2:172.21.15.45:3300/0 conn(0x7fd47c06efd0 0x7fd47c15d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ea40b6250 0x7f8ea40b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40d1820 con 0x7f8ea40b88b0 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea40d1b00 con 0x7f8ea40b6250 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7f8eab182700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea40d1de0 con 0x7f8ea406ea90 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd4808fe700 1 --2- 172.21.15.45:0/2522748314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c158e00 0x7fd47c06ea90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.822+0000 7fd4808fe700 1 -- 172.21.15.45:0/2522748314 >> 172.21.15.45:0/2522748314 conn(0x7fd47c0cb2d0 msgr2=0x7fd47c0cb6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 Processor -- start 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 -- start start 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f26dc5f9700 1 -- 172.21.15.45:0/795006505 shutdown_connections 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f26dc5f9700 1 --2- 172.21.15.45:0/795006505 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d40b6420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f26dc5f9700 1 --2- 172.21.15.45:0/795006505 >> v2:172.21.15.45:3300/0 conn(0x7f26d406ea90 0x7f26d40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f26dc5f9700 1 -- 172.21.15.45:0/795006505 >> 172.21.15.45:0/795006505 conn(0x7f26d40b46d0 msgr2=0x7f26d40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8ea997f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ea40b88b0 0x7f8ea40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea40d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:54988/0 (socket says 172.21.15.45:54988) 2023-12-19T17:52:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 -- 172.21.15.45:0/1279672537 learned_addr learned my addr 172.21.15.45:0/1279672537 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fd4808fe700 1 -- 172.21.15.45:0/2522748314 shutdown_connections 2023-12-19T17:52:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa981700 1 --2- 172.21.15.45:0/1279672537 >> v2:172.21.15.73:3300/0 conn(0x7f8ea40b6250 0x7f8ea40b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 -- 172.21.15.45:0/1279672537 >> v2:172.21.15.73:3300/0 conn(0x7f8ea40b6250 msgr2=0x7f8ea40b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 --2- 172.21.15.45:0/1279672537 >> v2:172.21.15.73:3300/0 conn(0x7f8ea40b6250 0x7f8ea40b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f26dc5f9700 1 -- 172.21.15.45:0/795006505 shutdown_connections 2023-12-19T17:52:05.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 -- 172.21.15.45:0/1279672537 >> v2:172.21.15.45:3300/0 conn(0x7f8ea40b88b0 msgr2=0x7f8ea40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 --2- 172.21.15.45:0/1279672537 >> v2:172.21.15.45:3300/0 conn(0x7f8ea40b88b0 0x7f8ea40b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 -- 172.21.15.45:0/1279672537 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea40d20c0 con 0x7f8ea406ea90 2023-12-19T17:52:05.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fd4808fe700 1 -- 172.21.15.45:0/2522748314 wait complete. 2023-12-19T17:52:05.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f5b0d9f9700 1 Processor -- start 2023-12-19T17:52:05.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f5b0d9f9700 1 -- start start 2023-12-19T17:52:05.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 0x7fba88053de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba88054320 0x7fba880578c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba88054780 con 0x7fba880e3420 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba880e3800 con 0x7fba88054320 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba96107700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba88057150 con 0x7fba8803ecd0 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba95906700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba88054320 0x7fba880578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba95906700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba88054320 0x7fba880578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37910/0 (socket says 172.21.15.45:37910) 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7fba95906700 1 -- 172.21.15.45:0/3012703066 learned_addr learned my addr 172.21.15.45:0/3012703066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fd4808fe700 1 Processor -- start 2023-12-19T17:52:05.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba95906700 1 -- 172.21.15.45:0/3012703066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 msgr2=0x7fba88053de0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba95906700 1 --2- 172.21.15.45:0/3012703066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 0x7fba88053de0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba95906700 1 -- 172.21.15.45:0/3012703066 >> v1:172.21.15.73:6789/0 conn(0x7fba880e3420 legacy=0x7fba88006c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba95906700 1 -- 172.21.15.45:0/3012703066 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba88057430 con 0x7fba88054320 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b0806c850 0x7f5b08151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080c4200 0x7f5b081fa410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b0815d030 0x7f5b080c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0815ea90 con 0x7f5b080c4200 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b08152220 con 0x7f5b0806c850 2023-12-19T17:52:05.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0815f010 con 0x7f5b0815d030 2023-12-19T17:52:05.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8eaa180700 1 --2- 172.21.15.45:0/1279672537 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea40d0f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40cd5f0 tx=0x7f8e98009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f406b374f7c88b44 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8ea917e700 1 -- 172.21.15.45:0/1279672537 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011830 con 0x7f8ea406ea90 2023-12-19T17:52:05.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8ea917e700 1 -- 172.21.15.45:0/1279672537 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e98011990 con 0x7f8ea406ea90 2023-12-19T17:52:05.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f8ea917e700 1 -- 172.21.15.45:0/1279672537 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e98011d20 con 0x7f8ea406ea90 2023-12-19T17:52:05.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 -- 172.21.15.45:0/1279672537 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 msgr2=0x7f8ea40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 --2- 172.21.15.45:0/1279672537 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea40d0f20 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40cd5f0 tx=0x7f8e98009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7ff74c0c8700 1 Processor -- start 2023-12-19T17:52:05.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.826+0000 7f26dc5f9700 1 -- 172.21.15.45:0/795006505 wait complete. 2023-12-19T17:52:05.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f26dc5f9700 1 Processor -- start 2023-12-19T17:52:05.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080c4200 0x7f5b081fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7ff74c0c8700 1 -- start start 2023-12-19T17:52:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f28fc625700 1 Processor -- start 2023-12-19T17:52:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080c4200 0x7f5b081fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37926/0 (socket says 172.21.15.45:37926) 2023-12-19T17:52:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 -- 172.21.15.45:0/2114704053 learned_addr learned my addr 172.21.15.45:0/2114704053 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba95906700 1 --2- 172.21.15.45:0/3012703066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880578c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009910 tx=0x7fba8c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d22a41ee62645a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f28fc625700 1 -- start start 2023-12-19T17:52:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 -- 172.21.15.45:0/1279672537 shutdown_connections 2023-12-19T17:52:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 --2- 172.21.15.45:0/1279672537 >> v2:172.21.15.73:3300/0 conn(0x7f8ea40b6250 0x7f8ea40b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 --2- 172.21.15.45:0/1279672537 >> v2:172.21.15.45:3300/0 conn(0x7f8ea40b88b0 0x7f8ea40b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 --2- 172.21.15.45:0/1279672537 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea40d0f20 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 -- 172.21.15.45:0/1279672537 >> 172.21.15.45:0/1279672537 conn(0x7f8ea40b46d0 msgr2=0x7f8ea40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b077fe700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b0815d030 0x7f5b080c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 -- 172.21.15.45:0/2114704053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b0815d030 msgr2=0x7f5b080c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba87fff700 1 -- 172.21.15.45:0/3012703066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c004230 con 0x7fba88054320 2023-12-19T17:52:05.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5b0815d030 0x7f5b080c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 -- 172.21.15.45:0/2114704053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b0806c850 msgr2=0x7f5b08151ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T17:52:05.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5b0806c850 0x7f5b08151ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 -- 172.21.15.45:0/2114704053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80094a0 con 0x7f5b080c4200 2023-12-19T17:52:05.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 -- 172.21.15.45:0/1279672537 shutdown_connections 2023-12-19T17:52:05.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f8eab182700 1 -- 172.21.15.45:0/1279672537 wait complete. 2023-12-19T17:52:05.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba87fff700 1 -- 172.21.15.45:0/3012703066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c004390 con 0x7fba88054320 2023-12-19T17:52:05.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba87fff700 1 -- 172.21.15.45:0/3012703066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c009e60 con 0x7fba88054320 2023-12-19T17:52:05.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b067fc700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080c4200 0x7f5b081fa410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b00007ef0 tx=0x7f5b0000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f26dc5f9700 1 -- start start 2023-12-19T17:52:05.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7ff74c0c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440af720 0x7ff7441623b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00014420 con 0x7f5b080c4200 2023-12-19T17:52:05.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b00014580 con 0x7f5b080c4200 2023-12-19T17:52:05.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b00014910 con 0x7f5b080c4200 2023-12-19T17:52:05.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b081faed0 con 0x7f5b080c4200 2023-12-19T17:52:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7ff749e64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440af720 0x7ff7441623b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7ff749e64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440af720 0x7ff7441623b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37940/0 (socket says 172.21.15.45:37940) 2023-12-19T17:52:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7ff74c0c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7441611c0 0x7ff74414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fd4808fe700 1 -- start start 2023-12-19T17:52:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dc5f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d406ea90 0x7f26d40cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dc5f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d414e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff74c0c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7441615a0 0x7ff7440b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff74c0c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441fa290 con 0x7ff7440af720 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff74c0c8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74414e220 con 0x7ff7441615a0 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff74c0c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7441fa530 con 0x7ff7441611c0 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba96107700 1 -- 172.21.15.45:0/3012703066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 msgr2=0x7fba880578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.830+0000 7fba96107700 1 --2- 172.21.15.45:0/3012703066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880578c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fba8c009910 tx=0x7fba8c009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fba96107700 1 -- 172.21.15.45:0/3012703066 shutdown_connections 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fba96107700 1 --2- 172.21.15.45:0/3012703066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880578c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fba96107700 1 --2- 172.21.15.45:0/3012703066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 0x7fba88053de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fba96107700 1 -- 172.21.15.45:0/3012703066 >> 172.21.15.45:0/3012703066 conn(0x7fba880590a0 msgr2=0x7fba880594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dc5f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d40b88b0 0x7f26d40b77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dc5f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d415c710 con 0x7f26d40b88b0 2023-12-19T17:52:05.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dc5f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40c3ea0 con 0x7f26d406ea90 2023-12-19T17:52:05.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dc5f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d414eed0 con 0x7f26d406fe80 2023-12-19T17:52:05.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fba96107700 1 -- 172.21.15.45:0/3012703066 shutdown_connections 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fba96107700 1 -- 172.21.15.45:0/3012703066 wait complete. 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7441611c0 0x7ff74414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7441611c0 0x7ff74414dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55010/0 (socket says 172.21.15.45:55010) 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 -- 172.21.15.45:0/3800442613 learned_addr learned my addr 172.21.15.45:0/3800442613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff74a665700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7441615a0 0x7ff7440b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d40b88b0 0x7f26d40b77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26da395700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d406ea90 0x7f26d40cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d40b88b0 0x7f26d40b77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37952/0 (socket says 172.21.15.45:37952) 2023-12-19T17:52:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 -- 172.21.15.45:0/1769613213 learned_addr learned my addr 172.21.15.45:0/1769613213 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 -- 172.21.15.45:0/3800442613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7441615a0 msgr2=0x7ff7440b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7441615a0 0x7ff7440b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 -- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440af720 msgr2=0x7ff7441623b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f8f23f2c700 1 Processor -- start 2023-12-19T17:52:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd4808fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c06efd0 0x7fd47c2025d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f8eab182700 1 Processor -- start 2023-12-19T17:52:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440af720 0x7ff7441623b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 -- 172.21.15.45:0/3800442613 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009b30 con 0x7ff7441611c0 2023-12-19T17:52:05.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749e64700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7440af720 0x7ff7441623b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:05.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26d9b94700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d414e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd4808fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47c0cbdc0 0x7fd47c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f8eab182700 1 -- start start 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd4808fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd47c0cdbf0 0x7fd47c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd47b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c06efd0 0x7fd47c2025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd47b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c06efd0 0x7fd47c2025d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33342/0 (socket says 172.21.15.45:33342) 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f8f23f2c700 1 -- start start 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 -- 172.21.15.45:0/1769613213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 msgr2=0x7f26d414e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d406fe80 0x7f26d414e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 -- 172.21.15.45:0/1769613213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d406ea90 msgr2=0x7f26d40cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d406ea90 0x7f26d40cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 -- 172.21.15.45:0/1769613213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26cc009b30 con 0x7f26d40b88b0 2023-12-19T17:52:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff749663700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7441611c0 0x7ff74414dce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff73400e730 tx=0x7ff73400ea40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b00014a70 con 0x7f5b080c4200 2023-12-19T17:52:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd4808fe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c0ce0a0 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd4808fe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1557b0 con 0x7fd47c06efd0 2023-12-19T17:52:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd4808fe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c154ba0 con 0x7fd47c0cbdc0 2023-12-19T17:52:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fc625700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f40adad0 0x7f28f40c4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fc625700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28f40c4760 0x7f28f406f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd47b7fe700 1 -- 172.21.15.45:0/82618740 learned_addr learned my addr 172.21.15.45:0/82618740 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd47bfff700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd47c0cdbf0 0x7fd47c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fc625700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28f406eca0 con 0x7f28f415cdf0 2023-12-19T17:52:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fc625700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28f40c4bf0 con 0x7f28f40c4760 2023-12-19T17:52:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fc625700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40ccc60 con 0x7f28f40adad0 2023-12-19T17:52:05.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0815eca0 con 0x7f5b080c4200 2023-12-19T17:52:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f26dab96700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d40b88b0 0x7f26d40b77b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26d40d1f20 tx=0x7f26cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fa3c1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f28f415cdf0 0x7f28f406c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51242/0 (socket says 172.21.15.45:51242) 2023-12-19T17:52:05.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fa3c1700 1 -- 172.21.15.45:0/3471083406 learned_addr learned my addr 172.21.15.45:0/3471083406 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff734004220 con 0x7ff7441611c0 2023-12-19T17:52:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff734004380 con 0x7ff7441611c0 2023-12-19T17:52:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7340036c0 con 0x7ff7441611c0 2023-12-19T17:52:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7fd47affd700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47c0cbdc0 0x7fd47c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f28fabc2700 1 --2- 172.21.15.45:0/3471083406 >> v2:172.21.15.73:3300/0 conn(0x7f28f40c4760 0x7f28f406f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7f8eab182700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea4156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc004440 con 0x7f26d40b88b0 2023-12-19T17:52:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc0092e0 con 0x7f26d40b88b0 2023-12-19T17:52:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eab182700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ea40b6250 0x7f8ea41561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc004800 con 0x7f26d40b88b0 2023-12-19T17:52:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.834+0000 7ff74c0c8700 1 -- 172.21.15.45:0/3800442613 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7441fa810 con 0x7ff7441611c0 2023-12-19T17:52:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7ff74c0c8700 1 -- 172.21.15.45:0/3800442613 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7441fadd0 con 0x7ff7441611c0 2023-12-19T17:52:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f26dc5f9700 1 -- 172.21.15.45:0/1769613213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d414f1b0 con 0x7f26d40b88b0 2023-12-19T17:52:05.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f26dc5f9700 1 -- 172.21.15.45:0/1769613213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d40c40f0 con 0x7f26d40b88b0 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd47bfff700 1 -- 172.21.15.45:0/82618740 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47c0cbdc0 msgr2=0x7fd47c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd47bfff700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd47c0cbdc0 0x7fd47c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd47bfff700 1 -- 172.21.15.45:0/82618740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c06efd0 msgr2=0x7fd47c2025d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd47bfff700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd47c06efd0 0x7fd47c2025d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd47bfff700 1 -- 172.21.15.45:0/82618740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd470009570 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28f9bc0700 1 --2- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f40adad0 0x7f28f40c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f23f2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c15d030 0x7f8f1c0d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f23f2c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0ce290 0x7f8f1c0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f23f2c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f1c0d17a0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f23f2c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f1c0d1a80 con 0x7f8f1c0ce290 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f23f2c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0d1d60 con 0x7f8f1c15d030 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd47bfff700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd47c0cdbf0 0x7fd47c15a070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd47000e900 tx=0x7fd47000ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eab182700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ea40b88b0 0x7f8ea41f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eaa180700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea4156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8ea997f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ea40b6250 0x7f8ea41561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8ea997f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ea40b6250 0x7f8ea41561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33352/0 (socket says 172.21.15.45:33352) 2023-12-19T17:52:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7ff74c0c8700 1 -- 172.21.15.45:0/3800442613 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff74406ee10 con 0x7ff7441611c0 2023-12-19T17:52:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28fabc2700 1 -- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f40adad0 msgr2=0x7f28f40c4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28fabc2700 1 --2- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f40adad0 0x7f28f40c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28fabc2700 1 -- 172.21.15.45:0/3471083406 >> v1:172.21.15.73:6789/0 conn(0x7f28f415cdf0 legacy=0x7f28f406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28fabc2700 1 -- 172.21.15.45:0/3471083406 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f406d030 con 0x7f28f40c4760 2023-12-19T17:52:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eab182700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea41566f0 con 0x7f8ea40b88b0 2023-12-19T17:52:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8ea997f700 1 -- 172.21.15.45:0/2714800364 learned_addr learned my addr 172.21.15.45:0/2714800364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eaa180700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea4156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55030/0 (socket says 172.21.15.45:55030) 2023-12-19T17:52:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f214c7700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f8f1c0b8ab0 0x7f8f1c0cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51258/0 (socket says 172.21.15.45:51258) 2023-12-19T17:52:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4157490 con 0x7f8ea40b6250 2023-12-19T17:52:05.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f214c7700 1 -- 172.21.15.45:0/3415195346 learned_addr learned my addr 172.21.15.45:0/3415195346 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea4157770 con 0x7f8ea406ea90 2023-12-19T17:52:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f21cc8700 1 --2- 172.21.15.45:0/3415195346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c15d030 0x7f8f1c0d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28fabc2700 1 --2- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f406f130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009870 tx=0x7f28f0009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92b02dcb0e5e7fb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f224c9700 1 --2- 172.21.15.45:0/3415195346 >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0ce290 0x7f8f1c0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f26d4070310 con 0x7f26d40b88b0 2023-12-19T17:52:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f5aeffff700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5af4065ad0 0x7f5af4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470004020 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd470004180 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd470004530 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28f93bf700 1 -- 172.21.15.45:0/3471083406 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0004230 con 0x7f28f40c4760 2023-12-19T17:52:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f20cc6700 1 -- 172.21.15.45:0/3415195346 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 391735186 0 0) 0x7f8f1c0d17a0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5b0806d6a0 con 0x7f5b080c4200 2023-12-19T17:52:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5b00011260 con 0x7f5b080c4200 2023-12-19T17:52:05.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5b06ffd700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5af4065ad0 0x7f5af4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5aeffff700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f5af406f010 0x7f5af4071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5af4071b20 con 0x7f5af406f010 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b00050ad0 con 0x7f5b080c4200 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c0094b0 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c155160 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8eaa981700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ea40b88b0 0x7f8ea41f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea997f700 1 -- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 msgr2=0x7f8ea4156eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea997f700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ea406ea90 0x7f8ea4156eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea997f700 1 -- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ea40b88b0 msgr2=0x7f8ea41f5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea997f700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ea40b88b0 0x7f8ea41f5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea997f700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98009570 con 0x7f8ea40b6250 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 Processor -- start 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 -- start start 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28f93bf700 1 -- 172.21.15.45:0/3471083406 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f0004390 con 0x7f28f40c4760 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f28f93bf700 1 -- 172.21.15.45:0/3471083406 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f0003710 con 0x7f28f40c4760 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 -- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 msgr2=0x7f28f406f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 --2- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f406f130 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f28f0009870 tx=0x7f28f0009b80 comp rx=0 tx=0).stop 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f20cc6700 1 -- 172.21.15.45:0/3415195346 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f0c0035d0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f21cc8700 1 -- 172.21.15.45:0/3415195346 >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0ce290 msgr2=0x7f8f1c0b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f21cc8700 1 --2- 172.21.15.45:0/3415195346 >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0ce290 0x7f8f1c0b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f21cc8700 1 -- 172.21.15.45:0/3415195346 >> v1:172.21.15.73:6789/0 conn(0x7f8f1c0b8ab0 legacy=0x7f8f1c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.838+0000 7f8f21cc8700 1 -- 172.21.15.45:0/3415195346 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1c0d2040 con 0x7f8f1c15d030 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd47c15cb10 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff734003820 con 0x7ff7441611c0 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8f21cc8700 1 --2- 172.21.15.45:0/3415195346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c15d030 0x7f8f1c0d0ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009d90 tx=0x7f8f1000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b5da13f32b09d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 -- 172.21.15.45:0/3471083406 shutdown_connections 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 --2- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f40adad0 0x7f28f40c4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 --2- 172.21.15.45:0/3471083406 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f406f130 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 -- 172.21.15.45:0/3471083406 >> 172.21.15.45:0/3471083406 conn(0x7f28f40ce990 msgr2=0x7f28f40ceda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 -- 172.21.15.45:0/3471083406 shutdown_connections 2023-12-19T17:52:05.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f28fc625700 1 -- 172.21.15.45:0/3471083406 wait complete. 2023-12-19T17:52:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8f20cc6700 1 -- 172.21.15.45:0/3415195346 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000e070 con 0x7f8f1c15d030 2023-12-19T17:52:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5b06ffd700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5af4065ad0 0x7f5af4067f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0015a0 tx=0x7f5afc0010d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8f20cc6700 1 -- 172.21.15.45:0/3415195346 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1000bae0 con 0x7f8f1c15d030 2023-12-19T17:52:05.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8f20cc6700 1 -- 172.21.15.45:0/3415195346 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1000e070 con 0x7f8f1c15d030 2023-12-19T17:52:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f5b077fe700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f5af406f010 0x7f5af4071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26cc019070 con 0x7f26d40b88b0 2023-12-19T17:52:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea997f700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ea40b6250 0x7f8ea41561b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000e9d0 tx=0x7f8e9000ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90009720 con 0x7f8ea40b6250 2023-12-19T17:52:05.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000c850 con 0x7f8ea40b6250 2023-12-19T17:52:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000cbc0 con 0x7f8ea40b6250 2023-12-19T17:52:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 0x7fba8803b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880388c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba880e3420 0x7fba880e0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88038e00 con 0x7fba88054320 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba88039030 con 0x7fba880e3420 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba96107700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba88178f50 con 0x7fba8803ecd0 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba94904700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880388c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba94904700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880388c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37974/0 (socket says 172.21.15.45:37974) 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba94904700 1 -- 172.21.15.45:0/1280068805 learned_addr learned my addr 172.21.15.45:0/1280068805 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba95906700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba880e3420 0x7fba880e0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7fba95105700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 0x7fba8803b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7ff73a7fc700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff728065ba0 0x7ff728068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8f23f2c700 1 -- 172.21.15.45:0/3415195346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c15d030 msgr2=0x7f8f1c0d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8f23f2c700 1 --2- 172.21.15.45:0/3415195346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c15d030 0x7f8f1c0d0ea0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009d90 tx=0x7f8f1000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f5b077fe700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f5af406f010 0x7f5af4071450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8f23f2c700 1 -- 172.21.15.45:0/3415195346 shutdown_connections 2023-12-19T17:52:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8f23f2c700 1 --2- 172.21.15.45:0/3415195346 >> v2:172.21.15.73:3300/0 conn(0x7f8f1c0ce290 0x7f8f1c0b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8f23f2c700 1 --2- 172.21.15.45:0/3415195346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c15d030 0x7f8f1c0d0ea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8f23f2c700 1 -- 172.21.15.45:0/3415195346 >> 172.21.15.45:0/3415195346 conn(0x7f8f1c0cf830 msgr2=0x7f8f1c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea415d330 con 0x7f8ea40b6250 2023-12-19T17:52:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff734083410 con 0x7ff7441611c0 2023-12-19T17:52:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff73a7fc700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ff72806f1e0 0x7ff728071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff728071cf0 con 0x7ff72806f1e0 2023-12-19T17:52:05.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7340837c0 con 0x7ff7441611c0 2023-12-19T17:52:05.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba95906700 1 -- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 msgr2=0x7fba8803b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba95906700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8803ecd0 0x7fba8803b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba95906700 1 -- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 msgr2=0x7fba880388c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba95906700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba88054320 0x7fba880388c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba95906700 1 -- 172.21.15.45:0/1280068805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c009570 con 0x7fba880e3420 2023-12-19T17:52:05.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea4157d30 con 0x7f8ea40b6250 2023-12-19T17:52:05.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff749e64700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff728065ba0 0x7ff728068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba95906700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba880e3420 0x7fba880e0160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba8c015000 tx=0x7fba8c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 Processor -- start 2023-12-19T17:52:05.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f26caffd700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26b8065b50 0x7f26b8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f26cc0844b0 con 0x7f26d40b88b0 2023-12-19T17:52:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f26caffd700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f26b806f190 0x7f26b80715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f26b8071ca0 con 0x7f26b806f190 2023-12-19T17:52:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.842+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26cc086ad0 con 0x7f26d40b88b0 2023-12-19T17:52:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff74a665700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ff72806f1e0 0x7ff728071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 -- start start 2023-12-19T17:52:05.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c009e60 con 0x7fba880e3420 2023-12-19T17:52:05.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba8c0041e0 con 0x7fba880e3420 2023-12-19T17:52:05.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8f23f2c700 1 -- 172.21.15.45:0/3415195346 shutdown_connections 2023-12-19T17:52:05.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba8c003af0 con 0x7fba880e3420 2023-12-19T17:52:05.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ea415d1b0 con 0x7f8ea40b6250 2023-12-19T17:52:05.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba96107700 1 -- 172.21.15.45:0/1280068805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba88179230 con 0x7fba880e3420 2023-12-19T17:52:05.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f8f23f2c700 1 -- 172.21.15.45:0/3415195346 wait complete. 2023-12-19T17:52:05.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f26da395700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26b8065b50 0x7f26b8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff74a665700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ff72806f1e0 0x7ff728071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff749e64700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff728065ba0 0x7ff728068060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff7440c6c80 tx=0x7ff740009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fba96107700 1 -- 172.21.15.45:0/1280068805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba881797f0 con 0x7fba880e3420 2023-12-19T17:52:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f26d9b94700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f26b806f190 0x7f26b80715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f40adad0 0x7f28f40b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f40c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f26da395700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26b8065b50 0x7f26b8068010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26d000ab60 tx=0x7f26d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f415cdf0 0x7f28f415e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40b3eb0 con 0x7f28f40adad0 2023-12-19T17:52:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40c8ad0 con 0x7f28f40c4760 2023-12-19T17:52:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28fc625700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28f40b2e10 con 0x7f28f415cdf0 2023-12-19T17:52:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28f9bc0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f40c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff728071cf0 con 0x7ff72806f1e0 2023-12-19T17:52:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd4700036c0 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fd463fff700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd468065ba0 0x7fd468068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7f28f9bc0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f40c8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33384/0 (socket says 172.21.15.45:33384) 2023-12-19T17:52:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f26d9b94700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f26b806f190 0x7f26b80715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.846+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4700834a0 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fd463fff700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd46806f1e0 0x7fd468071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd468071cf0 con 0x7fd46806f1e0 2023-12-19T17:52:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd470083850 con 0x7fd47c0cdbf0 2023-12-19T17:52:05.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 -- 172.21.15.45:0/3866351274 learned_addr learned my addr 172.21.15.45:0/3866351274 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28fabc2700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f415cdf0 0x7f28f415e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28fa3c1700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f40adad0 0x7f28f40b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e9000cd20 con 0x7f8ea40b6250 2023-12-19T17:52:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8f23f2c700 1 Processor -- start 2023-12-19T17:52:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fba96107700 1 -- 172.21.15.45:0/1280068805 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fba70000fc0 con 0x7fba880e3420 2023-12-19T17:52:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f5af4071b20 con 0x7f5af406f010 2023-12-19T17:52:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f26b8071ca0 con 0x7f26b806f190 2023-12-19T17:52:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fd47affd700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd46806f1e0 0x7fd468071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8f23f2c700 1 -- start start 2023-12-19T17:52:05.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fd47b7fe700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd468065ba0 0x7fd468068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8ea2ffd700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e88065ba0 0x7f8e88068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e900838a0 con 0x7f8ea40b6250 2023-12-19T17:52:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba8c003c50 con 0x7fba880e3420 2023-12-19T17:52:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 -- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f415cdf0 msgr2=0x7f28f415e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28f415cdf0 0x7f28f415e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 -- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f40adad0 msgr2=0x7f28f40b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28f40adad0 0x7f28f40b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 -- 172.21.15.45:0/3866351274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28f00094a0 con 0x7f28f40c4760 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8ea2ffd700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f8e8806f1e0 0x7f8e88071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8e88071cf0 con 0x7f8e8806f1e0 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e90083c50 con 0x7f8ea40b6250 2023-12-19T17:52:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fd47affd700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd46806f1e0 0x7fd468071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8eaa180700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e88065ba0 0x7f8e88068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8eaa981700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f8e8806f1e0 0x7f8e88071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f28f9bc0700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f40c8590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28e400c7f0 tx=0x7f28e400cb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4004220 con 0x7f28f40c4760 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8f23f2c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0b8ab0 0x7f8f1c0b2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7f8f23f2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c0ce290 0x7f8f1c0ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0b8ab0 0x7f8f1c0b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0b8ab0 0x7f8f1c0b2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38004/0 (socket says 172.21.15.45:38004) 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8eaa981700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f8e8806f1e0 0x7f8e88071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fba85ffb700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba74065b20 0x7fba74067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.850+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba8c084f50 con 0x7fba880e3420 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fba85ffb700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fba7406f160 0x7fba740715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba74071c70 con 0x7fba7406f160 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba8c0875e0 con 0x7fba880e3420 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f23f2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15d030 0x7f8f1c0cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f23f2c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c0b2ca0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f23f2c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c15e680 con 0x7f8f1c15d030 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f23f2c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1c15e960 con 0x7f8f1c0ce290 2023-12-19T17:52:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4004380 con 0x7f28f40c4760 2023-12-19T17:52:05.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 -- 172.21.15.45:0/418401699 learned_addr learned my addr 172.21.15.45:0/418401699 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:05.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e40036c0 con 0x7f28f40c4760 2023-12-19T17:52:05.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f28fc625700 1 -- 172.21.15.45:0/3866351274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28f40b30f0 con 0x7f28f40c4760 2023-12-19T17:52:05.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f28fc625700 1 -- 172.21.15.45:0/3866351274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28f40b36b0 con 0x7f28f40c4760 2023-12-19T17:52:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8eaa180700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e88065ba0 0x7f8e88068060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e98014040 tx=0x7f8e98008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fba94904700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fba7406f160 0x7fba740715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f224c9700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15d030 0x7f8f1c0cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f214c7700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c0ce290 0x7f8f1c0ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fba95105700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba74065b20 0x7fba74067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 -- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c0ce290 msgr2=0x7f8f1c0ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c0ce290 0x7f8f1c0ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 -- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15d030 msgr2=0x7f8f1c0cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f1c15d030 0x7f8f1c0cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd468071cf0 con 0x7fd46806f1e0 2023-12-19T17:52:05.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7fd47b7fe700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd468065ba0 0x7fd468068060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd47400f400 tx=0x7fd474009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f28fc625700 1 -- 172.21.15.45:0/3866351274 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f28f406d5f0 con 0x7f28f40c4760 2023-12-19T17:52:05.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8e88071cf0 con 0x7f8e8806f1e0 2023-12-19T17:52:05.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 -- 172.21.15.45:0/418401699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10009a70 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f214c7700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f1c0ce290 0x7f8f1c0ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.854+0000 7f8f21cc8700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0b8ab0 0x7f8f1c0b2760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000b370 tx=0x7f8f10004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10004670 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7fba95105700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba74065b20 0x7fba74067fe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba9004fd50 tx=0x7fba90072040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f8f23f2c700 1 -- 172.21.15.45:0/418401699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1c15ec40 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f100047f0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10012670 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f8f23f2c700 1 -- 172.21.15.45:0/418401699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1c15f200 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7fba94904700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fba7406f160 0x7fba740715a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28e4003820 con 0x7f28f40c4760 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28eaffd700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28d8065b20 0x7f28d8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28e4082e20 con 0x7f28f40c4760 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28eaffd700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f28d806f160 0x7f28d80715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f28d8071c70 con 0x7f28d806f160 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f28e40854c0 con 0x7f28f40c4760 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28fabc2700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f28d806f160 0x7f28d80715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.858+0000 7f28fa3c1700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28d8065b20 0x7f28d8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fba74071c70 con 0x7fba7406f160 2023-12-19T17:52:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ef8000fc0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8f100127d0 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f28fa3c1700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28d8065b20 0x7f28d8067fe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28ec001f00 tx=0x7f28ec001e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f8f1a7fc700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f00065b20 0x7f8f00067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f10085560 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f28fabc2700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f28d806f160 0x7f28d80715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.862+0000 7f8f1a7fc700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f8f0006f160 0x7f8f000715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.866+0000 7f8f214c7700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f00065b20 0x7f8f00067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.866+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f00071c70 con 0x7f8f0006f160 2023-12-19T17:52:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.866+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f10087b40 con 0x7f8f1c0b8ab0 2023-12-19T17:52:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.866+0000 7f8f224c9700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f8f0006f160 0x7f8f000715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.866+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f28d8071c70 con 0x7f28d806f160 2023-12-19T17:52:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.866+0000 7f8f214c7700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f00065b20 0x7f8f00067fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0c90f0 tx=0x7f8f08007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.870+0000 7f8f224c9700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f8f0006f160 0x7f8f000715a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.870+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f8f00071c70 con 0x7f8f0006f160 2023-12-19T17:52:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.878+0000 7ff74c0c8700 1 -- 172.21.15.45:0/3800442613 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff74406eb30 con 0x7ff72806f1e0 2023-12-19T17:52:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f26d40d23a0 con 0x7f26b806f190 2023-12-19T17:52:05.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7ff73a7fc700 1 -- 172.21.15.45:0/3800442613 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff73c003a40 con 0x7ff72806f1e0 2023-12-19T17:52:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7f28fc625700 1 -- 172.21.15.45:0/3866351274 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f28f406d310 con 0x7f28d806f160 2023-12-19T17:52:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5b0806d3c0 con 0x7f5af406f010 2023-12-19T17:52:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ff72806f1e0 msgr2=0x7ff728071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7ff727fff700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ff72806f1e0 0x7ff728071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7f26caffd700 1 -- 172.21.15.45:0/1769613213 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f26b8071ca0 con 0x7f26b806f190 2023-12-19T17:52:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.882+0000 7f28eaffd700 1 -- 172.21.15.45:0/3866351274 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f28f0004030 con 0x7f28d806f160 2023-12-19T17:52:05.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5aeffff700 1 -- 172.21.15.45:0/2114704053 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5af8009320 con 0x7f5af406f010 2023-12-19T17:52:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff728065ba0 msgr2=0x7ff728068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff728065ba0 0x7ff728068060 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff7440c6c80 tx=0x7ff740009040 comp rx=0 tx=0).stop 2023-12-19T17:52:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7441611c0 msgr2=0x7ff74414dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 --2- 172.21.15.45:0/3800442613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7441611c0 0x7ff74414dce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff73400e730 tx=0x7ff73400ea40 comp rx=0 tx=0).stop 2023-12-19T17:52:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f28d806f160 msgr2=0x7f28d80715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f5af406f010 msgr2=0x7f5af4071450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f5af406f010 0x7f5af4071450 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff74a665700 1 -- 172.21.15.45:0/3800442613 reap_dead start 2023-12-19T17:52:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f28d806f160 0x7f28d80715a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 shutdown_connections 2023-12-19T17:52:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 >> 172.21.15.45:0/3800442613 conn(0x7ff7440cb900 msgr2=0x7ff7440ccec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd47c071640 con 0x7fd46806f1e0 2023-12-19T17:52:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 shutdown_connections 2023-12-19T17:52:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7ff727fff700 1 -- 172.21.15.45:0/3800442613 wait complete. 2023-12-19T17:52:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7fd463fff700 1 -- 172.21.15.45:0/82618740 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd46c022040 con 0x7fd46806f1e0 2023-12-19T17:52:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5af4065ad0 msgr2=0x7f5af4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5af4065ad0 0x7f5af4067f90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0015a0 tx=0x7f5afc0010d0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080c4200 msgr2=0x7f5b081fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 --2- 172.21.15.45:0/2114704053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5b080c4200 0x7f5b081fa410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5b00007ef0 tx=0x7f5b0000e3c0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b077fe700 1 -- 172.21.15.45:0/2114704053 reap_dead start 2023-12-19T17:52:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f26b806f190 msgr2=0x7f26b80715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f26b806f190 0x7f26b80715d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 shutdown_connections 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 >> 172.21.15.45:0/2114704053 conn(0x7f5b080ce990 msgr2=0x7f5b080cdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28d8065b20 msgr2=0x7f28d8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28d8065b20 0x7f28d8067fe0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f28ec001f00 tx=0x7f28ec001e90 comp rx=0 tx=0).stop 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 msgr2=0x7f28f40c8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 --2- 172.21.15.45:0/3866351274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f28f40c4760 0x7f28f40c8590 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f28e400c7f0 tx=0x7f28e400cb00 comp rx=0 tx=0).stop 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28fabc2700 1 -- 172.21.15.45:0/3866351274 reap_dead start 2023-12-19T17:52:05.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 shutdown_connections 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26b8065b50 msgr2=0x7f26b8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26b8065b50 0x7f26b8068010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f26d000ab60 tx=0x7f26d0008040 comp rx=0 tx=0).stop 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d40b88b0 msgr2=0x7f26d40b77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 --2- 172.21.15.45:0/1769613213 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d40b88b0 0x7f26d40b77b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26d40d1f20 tx=0x7f26cc004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26dab96700 1 -- 172.21.15.45:0/1769613213 reap_dead start 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 shutdown_connections 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 >> 172.21.15.45:0/1769613213 conn(0x7f26d40b46d0 msgr2=0x7f26d4070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 shutdown_connections 2023-12-19T17:52:05.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f26c8ff9700 1 -- 172.21.15.45:0/1769613213 wait complete. 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd46806f1e0 msgr2=0x7fd468071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7fd4808fe700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd46806f1e0 0x7fd468071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd468065ba0 msgr2=0x7fd468068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd468065ba0 0x7fd468068060 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd47400f400 tx=0x7fd474009040 comp rx=0 tx=0).stop 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd47c0cdbf0 msgr2=0x7fd47c15a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 --2- 172.21.15.45:0/82618740 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd47c0cdbf0 0x7fd47c15a070 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd47000e900 tx=0x7fd47000ec10 comp rx=0 tx=0).stop 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd47bfff700 1 -- 172.21.15.45:0/82618740 reap_dead start 2023-12-19T17:52:05.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 shutdown_connections 2023-12-19T17:52:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.886+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 >> 172.21.15.45:0/3866351274 conn(0x7f28f40ce990 msgr2=0x7f28f40c96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 shutdown_connections 2023-12-19T17:52:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f5b0d9f9700 1 -- 172.21.15.45:0/2114704053 wait complete. 2023-12-19T17:52:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 shutdown_connections 2023-12-19T17:52:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 >> 172.21.15.45:0/82618740 conn(0x7fd47c0cb2d0 msgr2=0x7fd47c0c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f28e8ff9700 1 -- 172.21.15.45:0/3866351274 wait complete. 2023-12-19T17:52:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ea41578e0 con 0x7f8e8806f1e0 2023-12-19T17:52:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 shutdown_connections 2023-12-19T17:52:05.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7fd4808fe700 1 -- 172.21.15.45:0/82618740 wait complete. 2023-12-19T17:52:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f8ea2ffd700 1 -- 172.21.15.45:0/2714800364 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ea41578e0 con 0x7f8e8806f1e0 2023-12-19T17:52:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f8e8806f1e0 msgr2=0x7f8e88071620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f8eab182700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f8e8806f1e0 0x7f8e88071620 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.890+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e88065ba0 msgr2=0x7f8e88068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.894+0000 7f8eab182700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e88065ba0 0x7f8e88068060 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f8e98014040 tx=0x7f8e98008030 comp rx=0 tx=0).stop 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.894+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ea40b6250 msgr2=0x7f8ea41561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.894+0000 7f8eab182700 1 --2- 172.21.15.45:0/2714800364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ea40b6250 0x7f8ea41561b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8e9000e9d0 tx=0x7f8e9000ece0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.894+0000 7f8eaa981700 1 -- 172.21.15.45:0/2714800364 reap_dead start 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.894+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 shutdown_connections 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.894+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 >> 172.21.15.45:0/2714800364 conn(0x7f8ea40b46d0 msgr2=0x7f8ea40cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.898+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 shutdown_connections 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.898+0000 7f8eab182700 1 -- 172.21.15.45:0/2714800364 wait complete. 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.902+0000 7fba96107700 1 -- 172.21.15.45:0/1280068805 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba70002d60 con 0x7fba7406f160 2023-12-19T17:52:05.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.906+0000 7fba85ffb700 1 -- 172.21.15.45:0/1280068805 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fba70002d60 con 0x7fba7406f160 2023-12-19T17:52:05.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.906+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ef8002d60 con 0x7f8f0006f160 2023-12-19T17:52:05.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.906+0000 7f8f1a7fc700 1 -- 172.21.15.45:0/418401699 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8ef8002d60 con 0x7f8f0006f160 2023-12-19T17:52:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fba7406f160 msgr2=0x7fba740715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fba7406f160 0x7fba740715a0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba74065b20 msgr2=0x7fba74067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba74065b20 0x7fba74067fe0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fba9004fd50 tx=0x7fba90072040 comp rx=0 tx=0).stop 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba880e3420 msgr2=0x7fba880e0160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 --2- 172.21.15.45:0/1280068805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba880e3420 0x7fba880e0160 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba8c015000 tx=0x7fba8c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba95906700 1 -- 172.21.15.45:0/1280068805 reap_dead start 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 shutdown_connections 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 >> 172.21.15.45:0/1280068805 conn(0x7fba880590a0 msgr2=0x7fba8803e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 shutdown_connections 2023-12-19T17:52:05.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.910+0000 7fba7b7fe700 1 -- 172.21.15.45:0/1280068805 wait complete. 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f8f0006f160 msgr2=0x7f8f000715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f8f0006f160 0x7f8f000715a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f00065b20 msgr2=0x7f8f00067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f00065b20 0x7f8f00067fe0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0c90f0 tx=0x7f8f08007d00 comp rx=0 tx=0).stop 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0b8ab0 msgr2=0x7f8f1c0b2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 --2- 172.21.15.45:0/418401699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f1c0b8ab0 0x7f8f1c0b2760 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8f1000b370 tx=0x7f8f10004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8f224c9700 1 -- 172.21.15.45:0/418401699 reap_dead start 2023-12-19T17:52:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 shutdown_connections 2023-12-19T17:52:05.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 >> 172.21.15.45:0/418401699 conn(0x7f8f1c0cf830 msgr2=0x7f8f1c0b5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:05.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.914+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 shutdown_connections 2023-12-19T17:52:05.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:05.918+0000 7f8efffff700 1 -- 172.21.15.45:0/418401699 wait complete. 2023-12-19T17:52:05.930 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:05.930 INFO:teuthology.orchestra.run.smithi045.stdout:55834574859 2023-12-19T17:52:05.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-19T17:52:05.931 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-19T17:52:05.932 INFO:teuthology.orchestra.run.smithi045.stdout:55834574859 2023-12-19T17:52:05.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-19T17:52:05.933 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:05.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-19T17:52:05.934 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:05.935 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-19T17:52:05.935 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:05.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-19T17:52:05.938 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:05.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-19T17:52:05.943 INFO:teuthology.orchestra.run.smithi045.stdout:55834574857 2023-12-19T17:52:05.943 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-19T17:52:06.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.166+0000 7f83db33f700 1 Processor -- start 2023-12-19T17:52:06.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.170+0000 7f83db33f700 1 -- start start 2023-12-19T17:52:06.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.170+0000 7f83db33f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83d40b8410 0x7f83d4165860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.170+0000 7f83d88da700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f83d4071260 0x7f83d40d1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59222/0 (socket says 172.21.15.45:59222) 2023-12-19T17:52:06.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.170+0000 7f83d88da700 1 -- 172.21.15.45:0/865244634 learned_addr learned my addr 172.21.15.45:0/865244634 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:06.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d406d270 con 0x7f83d4071260 2023-12-19T17:52:06.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83d98dc700 1 --2- 172.21.15.45:0/865244634 >> v2:172.21.15.45:3300/0 conn(0x7f83d40b8410 0x7f83d4165860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83d4165da0 con 0x7f83d4161280 2023-12-19T17:52:06.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83d40b8240 con 0x7f83d40b8410 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128678409 0 0) 0x7f83d406d270 con 0x7f83d4071260 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c00035d0 con 0x7f83d4071260 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4192925658 0 0) 0x7f83d4165da0 con 0x7f83d4161280 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83c00038f0 con 0x7f83d4161280 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83d98dc700 1 -- 172.21.15.45:0/865244634 >> v1:172.21.15.73:6789/0 conn(0x7f83d4161280 legacy=0x7f83d4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83d98dc700 1 -- 172.21.15.45:0/865244634 >> v1:172.21.15.45:6789/0 conn(0x7f83d4071260 legacy=0x7f83d40d1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83d98dc700 1 -- 172.21.15.45:0/865244634 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d406c660 con 0x7f83d40b8410 2023-12-19T17:52:06.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.174+0000 7f83d98dc700 1 --2- 172.21.15.45:0/865244634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d40b8410 0x7f83d4165860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009d90 tx=0x7f83cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4457154e51145f3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00e070 con 0x7f83d40b8410 2023-12-19T17:52:06.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc00bb20 con 0x7f83d40b8410 2023-12-19T17:52:06.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83cbfff700 1 -- 172.21.15.45:0/865244634 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc00be90 con 0x7f83d40b8410 2023-12-19T17:52:06.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d40b8410 msgr2=0x7f83d4165860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83db33f700 1 --2- 172.21.15.45:0/865244634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d40b8410 0x7f83d4165860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f83cc009d90 tx=0x7f83cc00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:06.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 shutdown_connections 2023-12-19T17:52:06.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83db33f700 1 --2- 172.21.15.45:0/865244634 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d40b8410 0x7f83d4165860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 >> 172.21.15.45:0/865244634 conn(0x7f83d40d3ae0 msgr2=0x7f83d40d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.178+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 shutdown_connections 2023-12-19T17:52:06.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.182+0000 7f83db33f700 1 -- 172.21.15.45:0/865244634 wait complete. 2023-12-19T17:52:06.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.182+0000 7f83db33f700 1 Processor -- start 2023-12-19T17:52:06.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.182+0000 7f83db33f700 1 -- start start 2023-12-19T17:52:06.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83db33f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d4071260 0x7f83d4162e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83db33f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d40b8410 0x7f83d40ba010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83db33f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 0x7f83d4159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83db33f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d41ff2a0 con 0x7f83d4161280 2023-12-19T17:52:06.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 0x7f83d4159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 0x7f83d4159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38020/0 (socket says 172.21.15.45:38020) 2023-12-19T17:52:06.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d88da700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d40b8410 0x7f83d40ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 -- 172.21.15.45:0/3641033368 learned_addr learned my addr 172.21.15.45:0/3641033368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d415eaa0 con 0x7f83d4071260 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d4163710 con 0x7f83d40b8410 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d90db700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d4071260 0x7f83d4162e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 -- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d40b8410 msgr2=0x7f83d40ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d40b8410 0x7f83d40ba010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 -- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d4071260 msgr2=0x7f83d4162e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d4071260 0x7f83d4162e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.186+0000 7f83d98dc700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83cc009a70 con 0x7f83d4161280 2023-12-19T17:52:06.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83d88da700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d40b8410 0x7f83d40ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:06.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83d98dc700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 0x7f83d4159220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83d4165f30 tx=0x7f83cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc007000 con 0x7f83d4161280 2023-12-19T17:52:06.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83cc012650 con 0x7f83d4161280 2023-12-19T17:52:06.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83cc012a00 con 0x7f83d4161280 2023-12-19T17:52:06.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83d41639f0 con 0x7f83d4161280 2023-12-19T17:52:06.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.190+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83d415ecf0 con 0x7f83d4161280 2023-12-19T17:52:06.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.194+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83d4067760 con 0x7f83d4161280 2023-12-19T17:52:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.206+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83cc012b60 con 0x7f83d4161280 2023-12-19T17:52:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.206+0000 7f83c9ffb700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83b8065b20 0x7f83b8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.206+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f83cc085780 con 0x7f83d4161280 2023-12-19T17:52:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.210+0000 7f83d90db700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83b8065b20 0x7f83b8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.210+0000 7f83d90db700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83b8065b20 0x7f83b8067fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83c40011e0 tx=0x7f83c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.210+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f83cc052f40 con 0x7f83d4161280 2023-12-19T17:52:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.218+0000 7f47ec7a5700 1 Processor -- start 2023-12-19T17:52:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.218+0000 7f47ec7a5700 1 -- start start 2023-12-19T17:52:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47ec7a5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 0x7f47e40d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47ec7a5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f47e415d420 0x7f47e40d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47ec7a5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e40b6060 con 0x7f47e415d040 2023-12-19T17:52:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47ec7a5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e406f930 con 0x7f47e415d420 2023-12-19T17:52:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47ec7a5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e406fc10 con 0x7f47e406f4a0 2023-12-19T17:52:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 0x7f47e40d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 0x7f47e40d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55076/0 (socket says 172.21.15.45:55076) 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 -- 172.21.15.45:0/1947462015 learned_addr learned my addr 172.21.15.45:0/1947462015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47ead42700 1 --2- 172.21.15.45:0/1947462015 >> v2:172.21.15.45:3300/0 conn(0x7f47e415d420 0x7f47e40d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 -- 172.21.15.45:0/1947462015 >> v2:172.21.15.45:3300/0 conn(0x7f47e415d420 msgr2=0x7f47e40d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 --2- 172.21.15.45:0/1947462015 >> v2:172.21.15.45:3300/0 conn(0x7f47e415d420 0x7f47e40d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 -- 172.21.15.45:0/1947462015 >> v1:172.21.15.73:6789/0 conn(0x7f47e415d040 legacy=0x7f47e40cdf20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 -- 172.21.15.45:0/1947462015 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e406fef0 con 0x7f47e406f4a0 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e9d40700 1 --2- 172.21.15.45:0/1947462015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 0x7f47e40d21a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=123473769a3f5814 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e953f700 1 -- 172.21.15.45:0/1947462015 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4004230 con 0x7f47e406f4a0 2023-12-19T17:52:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e953f700 1 -- 172.21.15.45:0/1947462015 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d4004390 con 0x7f47e406f4a0 2023-12-19T17:52:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.222+0000 7f47e953f700 1 -- 172.21.15.45:0/1947462015 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d4009e60 con 0x7f47e406f4a0 2023-12-19T17:52:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 Processor -- start 2023-12-19T17:52:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1947462015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 msgr2=0x7f47e40d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1947462015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 0x7f47e40d21a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d4009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 -- start start 2023-12-19T17:52:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1947462015 shutdown_connections 2023-12-19T17:52:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1947462015 >> v2:172.21.15.45:3300/0 conn(0x7f47e415d420 0x7f47e40d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1947462015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e406f4a0 0x7f47e40d21a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1947462015 >> 172.21.15.45:0/1947462015 conn(0x7f47e40d2e50 msgr2=0x7f47e40d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1947462015 shutdown_connections 2023-12-19T17:52:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1947462015 wait complete. 2023-12-19T17:52:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 0x7f8f6c0072c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8f6c038800 0x7f8f6c039f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8f6c050ff0 0x7f8f6c03a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c007800 con 0x7f8f6c038800 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6c006e30 con 0x7f8f6c050ff0 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f7c189700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c03a9d0 con 0x7f8f6c0e11b0 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.226+0000 7f8f79f25700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 0x7f8f6c0072c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 0x7f8f6c0072c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55080/0 (socket says 172.21.15.45:55080) 2023-12-19T17:52:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 -- 172.21.15.45:0/1177187559 learned_addr learned my addr 172.21.15.45:0/1177187559 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f7a726700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.73:3300/0 conn(0x7f8f6c050ff0 0x7f8f6c03a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79724700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.45:3300/0 conn(0x7f8f6c038800 0x7f8f6c039f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 Processor -- start 2023-12-19T17:52:06.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 -- start start 2023-12-19T17:52:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7fc66329f700 1 Processor -- start 2023-12-19T17:52:06.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f46700ec700 1 Processor -- start 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 -- 172.21.15.45:0/1177187559 >> v2:172.21.15.73:3300/0 conn(0x7f8f6c050ff0 msgr2=0x7f8f6c03a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.73:3300/0 conn(0x7f8f6c050ff0 0x7f8f6c03a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 -- 172.21.15.45:0/1177187559 >> v2:172.21.15.45:3300/0 conn(0x7f8f6c038800 msgr2=0x7f8f6c039f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.45:3300/0 conn(0x7f8f6c038800 0x7f8f6c039f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79f25700 1 -- 172.21.15.45:0/1177187559 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6c0e1590 con 0x7f8f6c0e11b0 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f7a726700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.73:3300/0 conn(0x7f8f6c050ff0 0x7f8f6c03a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f8f79724700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.45:3300/0 conn(0x7f8f6c038800 0x7f8f6c039f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:06.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f46700ec700 1 -- start start 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 0x7f47e4153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e415d420 0x7f47e40cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e4157790 0x7f47e40c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40cc910 con 0x7f47e4157790 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40c76e0 con 0x7f47e415d420 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ec7a5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40cb330 con 0x7f47e415d040 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 0x7f47e4153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 0x7f47e4153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55094/0 (socket says 172.21.15.45:55094) 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 -- 172.21.15.45:0/1708222296 learned_addr learned my addr 172.21.15.45:0/1708222296 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47e9d40700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e415d420 0x7f47e40cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ead42700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e4157790 0x7f47e40c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 -- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e415d420 msgr2=0x7f47e40cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e415d420 0x7f47e40cc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 -- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e4157790 msgr2=0x7f47e40c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e4157790 0x7f47e40c8b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7f47ea541700 1 -- 172.21.15.45:0/1708222296 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009570 con 0x7f47e415d040 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f47ea541700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 0x7f47e4153c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47e000b550 tx=0x7f47e000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0011830 con 0x7f47e415d040 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e00119b0 con 0x7f47e415d040 2023-12-19T17:52:06.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f46700ec700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4668164a70 0x7f46680cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f46700ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46680c4510 0x7f46680cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f46700ec700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46680cd8b0 con 0x7f4668164690 2023-12-19T17:52:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e40cb610 con 0x7f47e415d040 2023-12-19T17:52:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e40cbbd0 con 0x7f47e415d040 2023-12-19T17:52:06.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f8f79f25700 1 --2- 172.21.15.45:0/1177187559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 0x7f8f6c0072c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00d8e0 tx=0x7f8f64009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbe7e7079c450050 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.230+0000 7fc66329f700 1 -- start start 2023-12-19T17:52:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc66329f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc65c1615a0 0x7fc65c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc66329f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c0c3f90 con 0x7fc65c1611c0 2023-12-19T17:52:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc66329f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc65c0c4270 con 0x7fc65c0af720 2023-12-19T17:52:06.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc66329f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c06eb30 con 0x7fc65c1615a0 2023-12-19T17:52:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466de88700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4668164690 0x7f46680c3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59232/0 (socket says 172.21.15.45:59232) 2023-12-19T17:52:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466de88700 1 -- 172.21.15.45:0/321622867 learned_addr learned my addr 172.21.15.45:0/321622867 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46680cdb80 con 0x7f4668164a70 2023-12-19T17:52:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46680cde60 con 0x7f46680c4510 2023-12-19T17:52:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466e689700 1 --2- 172.21.15.45:0/321622867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46680c4510 0x7f46680cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f8f78f23700 1 -- 172.21.15.45:0/1177187559 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64011830 con 0x7f8f6c0e11b0 2023-12-19T17:52:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc661a9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc65c1615a0 0x7fc65c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc661a9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc65c1615a0 0x7fc65c0c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38068/0 (socket says 172.21.15.45:38068) 2023-12-19T17:52:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7fc661a9c700 1 -- 172.21.15.45:0/2615707088 learned_addr learned my addr 172.21.15.45:0/2615707088 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466d687700 1 --2- 172.21.15.45:0/321622867 >> v2:172.21.15.45:3300/0 conn(0x7f4668164a70 0x7f46680cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e0011d60 con 0x7f47e415d040 2023-12-19T17:52:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f8f78f23700 1 -- 172.21.15.45:0/1177187559 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f64011990 con 0x7f8f6c0e11b0 2023-12-19T17:52:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f8f78f23700 1 -- 172.21.15.45:0/1177187559 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64011d20 con 0x7f8f6c0e11b0 2023-12-19T17:52:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466e689700 1 -- 172.21.15.45:0/321622867 >> v2:172.21.15.45:3300/0 conn(0x7f4668164a70 msgr2=0x7f46680cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466e689700 1 --2- 172.21.15.45:0/321622867 >> v2:172.21.15.45:3300/0 conn(0x7f4668164a70 0x7f46680cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466e689700 1 -- 172.21.15.45:0/321622867 >> v1:172.21.15.45:6789/0 conn(0x7f4668164690 legacy=0x7f46680c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466e689700 1 -- 172.21.15.45:0/321622867 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46680ce140 con 0x7f46680c4510 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f8f7c189700 1 -- 172.21.15.45:0/1177187559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 msgr2=0x7f8f6c0072c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f8f7c189700 1 --2- 172.21.15.45:0/1177187559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 0x7f8f6c0072c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8f6c00d8e0 tx=0x7f8f64009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.234+0000 7f466e689700 1 --2- 172.21.15.45:0/321622867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46680c4510 0x7f46680cd370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4660009d90 tx=0x7f466000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d76145c108da886 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 -- 172.21.15.45:0/1177187559 shutdown_connections 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.73:3300/0 conn(0x7f8f6c050ff0 0x7f8f6c03a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 --2- 172.21.15.45:0/1177187559 >> v2:172.21.15.45:3300/0 conn(0x7f8f6c038800 0x7f8f6c039f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 --2- 172.21.15.45:0/1177187559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c0e11b0 0x7f8f6c0072c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc66129b700 1 -- 172.21.15.45:0/2615707088 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696352569 0 0) 0x7fc65c0c4270 con 0x7fc65c0af720 2023-12-19T17:52:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc66129b700 1 -- 172.21.15.45:0/2615707088 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6480035d0 con 0x7fc65c0af720 2023-12-19T17:52:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 -- 172.21.15.45:0/1177187559 >> 172.21.15.45:0/1177187559 conn(0x7f8f6c054b50 msgr2=0x7f8f6c054f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f466ce86700 1 -- 172.21.15.45:0/321622867 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f466000e070 con 0x7f46680c4510 2023-12-19T17:52:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f466ce86700 1 -- 172.21.15.45:0/321622867 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f466000bbd0 con 0x7f46680c4510 2023-12-19T17:52:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f466ce86700 1 -- 172.21.15.45:0/321622867 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4660012430 con 0x7f46680c4510 2023-12-19T17:52:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 -- 172.21.15.45:0/1177187559 shutdown_connections 2023-12-19T17:52:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 -- 172.21.15.45:0/1177187559 wait complete. 2023-12-19T17:52:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc66129b700 1 -- 172.21.15.45:0/2615707088 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2720100607 0 0) 0x7fc6480035d0 con 0x7fc65c0af720 2023-12-19T17:52:06.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc661a9c700 1 -- 172.21.15.45:0/2615707088 >> v1:172.21.15.73:6789/0 conn(0x7fc65c0af720 legacy=0x7fc65c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc661a9c700 1 -- 172.21.15.45:0/2615707088 >> v1:172.21.15.45:6789/0 conn(0x7fc65c1611c0 legacy=0x7fc65c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc661a9c700 1 -- 172.21.15.45:0/2615707088 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c06ee10 con 0x7fc65c1615a0 2023-12-19T17:52:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46680c4510 msgr2=0x7f46680cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc005310 con 0x7f47e415d040 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 --2- 172.21.15.45:0/321622867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46680c4510 0x7f46680cd370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4660009d90 tx=0x7f466000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 shutdown_connections 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 --2- 172.21.15.45:0/321622867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f46680c4510 0x7f46680cd370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 --2- 172.21.15.45:0/321622867 >> v2:172.21.15.45:3300/0 conn(0x7f4668164a70 0x7f46680cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 >> 172.21.15.45:0/321622867 conn(0x7f46680cba40 msgr2=0x7f46680ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc661a9c700 1 --2- 172.21.15.45:0/2615707088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 0x7fc65c0c3920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009890 tx=0x7fc64c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9570bbc5e2aefe11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 shutdown_connections 2023-12-19T17:52:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc66129b700 1 -- 172.21.15.45:0/2615707088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6540019f0 con 0x7fc65c1615a0 2023-12-19T17:52:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc66129b700 1 -- 172.21.15.45:0/2615707088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c004030 con 0x7fc65c1615a0 2023-12-19T17:52:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f47e001a400 con 0x7f47e415d040 2023-12-19T17:52:06.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 Processor -- start 2023-12-19T17:52:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f47daffd700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47c8065ba0 0x7f47c8068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47e0083500 con 0x7f47e415d040 2023-12-19T17:52:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f8f7c189700 1 -- start start 2023-12-19T17:52:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7fc66129b700 1 -- 172.21.15.45:0/2615707088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c0043a0 con 0x7fc65c1615a0 2023-12-19T17:52:06.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 -- 172.21.15.45:0/2615707088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 msgr2=0x7fc65c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 --2- 172.21.15.45:0/2615707088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 0x7fc65c0c3920 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc64c009890 tx=0x7fc64c009ba0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.238+0000 7f46700ec700 1 -- 172.21.15.45:0/321622867 wait complete. 2023-12-19T17:52:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 Processor -- start 2023-12-19T17:52:06.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 -- start start 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7c189700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 0x7f8f6c17c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7c189700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c050ff0 0x7f8f6c0dae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7c189700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6c0e11b0 0x7f8f6c0db380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7c189700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0d9fb0 con 0x7f8f6c038800 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7c189700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0dd6d0 con 0x7f8f6c0e11b0 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7c189700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6c0d91f0 con 0x7f8f6c050ff0 2023-12-19T17:52:06.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 -- 172.21.15.45:0/2615707088 shutdown_connections 2023-12-19T17:52:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 --2- 172.21.15.45:0/2615707088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 0x7fc65c0c3920 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 -- 172.21.15.45:0/2615707088 >> 172.21.15.45:0/2615707088 conn(0x7fc65c0cb900 msgr2=0x7fc65c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f47e9d40700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47c8065ba0 0x7f47c8068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f79f25700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 0x7f8f6c17c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f47e9d40700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47c8065ba0 0x7f47c8068060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f79f25700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 0x7f8f6c17c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38080/0 (socket says 172.21.15.45:38080) 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f79f25700 1 -- 172.21.15.45:0/2627886864 learned_addr learned my addr 172.21.15.45:0/2627886864 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f79724700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c050ff0 0x7f8f6c0dae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f7a726700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6c0e11b0 0x7f8f6c0db380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 -- 172.21.15.45:0/2615707088 shutdown_connections 2023-12-19T17:52:06.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fc66329f700 1 -- 172.21.15.45:0/2615707088 wait complete. 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46680c4510 0x7f4668200160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4668164690 0x7f46681fecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4668164a70 0x7f46681ff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46682006a0 con 0x7f4668164a70 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4668156d90 con 0x7f46680c4510 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f46700ec700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4668157070 con 0x7f4668164690 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f466e689700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4668164a70 0x7f46681ff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fbb63dba700 1 Processor -- start 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7fbb63dba700 1 -- start start 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f8f79f25700 1 -- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c050ff0 msgr2=0x7f8f6c0dae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f79f25700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c050ff0 0x7f8f6c0dae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f466d687700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4668164690 0x7f46681fecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f466e689700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4668164a70 0x7f46681ff1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38086/0 (socket says 172.21.15.45:38086) 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f466e689700 1 -- 172.21.15.45:0/1145928796 learned_addr learned my addr 172.21.15.45:0/1145928796 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.242+0000 7f466de88700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46680c4510 0x7f4668200160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f79f25700 1 -- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6c0e11b0 msgr2=0x7f8f6c0db380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb63dba700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb5c164920 0x7fbb5c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f79f25700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6c0e11b0 0x7f8f6c0db380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f79f25700 1 -- 172.21.15.45:0/2627886864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f700094b0 con 0x7f8f6c038800 2023-12-19T17:52:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb63dba700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0d0b10 con 0x7fbb5c0b4830 2023-12-19T17:52:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb63dba700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c164d00 con 0x7fbb5c0d15b0 2023-12-19T17:52:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb63dba700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c06f990 con 0x7fbb5c164920 2023-12-19T17:52:06.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f7a726700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6c0e11b0 0x7f8f6c0db380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fc66329f700 1 Processor -- start 2023-12-19T17:52:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb62357700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbb5c0d15b0 0x7fbb5c0cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51292/0 (socket says 172.21.15.45:51292) 2023-12-19T17:52:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb62357700 1 -- 172.21.15.45:0/2630716054 learned_addr learned my addr 172.21.15.45:0/2630716054 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb61b56700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb5c164920 0x7fbb5c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f79f25700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 0x7f8f6c17c3b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f64000c00 tx=0x7f8f64004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fc66329f700 1 -- start start 2023-12-19T17:52:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466de88700 1 -- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4668164690 msgr2=0x7f46681fecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466de88700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4668164690 0x7f46681fecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466de88700 1 -- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4668164a70 msgr2=0x7f46681ff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466de88700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4668164a70 0x7f46681ff1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016511862 0 0) 0x7fbb5c164d00 con 0x7fbb5c0d15b0 2023-12-19T17:52:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466de88700 1 -- 172.21.15.45:0/1145928796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4660009a70 con 0x7f46680c4510 2023-12-19T17:52:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466d687700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4668164690 0x7f46681fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:06.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f466de88700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46680c4510 0x7f4668200160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f465800c480 tx=0x7f465800c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb440035d0 con 0x7fbb5c0d15b0 2023-12-19T17:52:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f64004240 con 0x7f8f6c038800 2023-12-19T17:52:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6401f070 con 0x7f8f6c038800 2023-12-19T17:52:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640045c0 con 0x7f8f6c038800 2023-12-19T17:52:06.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f64009570 con 0x7f8f6c038800 2023-12-19T17:52:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f6c0d97b0 con 0x7f8f6c038800 2023-12-19T17:52:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658005d90 con 0x7f46680c4510 2023-12-19T17:52:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f465800ce90 con 0x7f46680c4510 2023-12-19T17:52:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46580072d0 con 0x7f46680c4510 2023-12-19T17:52:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 <== mon.1 v1:172.21.15.73:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893770835 0 0) 0x7fbb440035d0 con 0x7fbb5c0d15b0 2023-12-19T17:52:06.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 >> v2:172.21.15.45:3300/0 conn(0x7fbb5c164920 msgr2=0x7fbb5c06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 --2- 172.21.15.45:0/2630716054 >> v2:172.21.15.45:3300/0 conn(0x7fbb5c164920 0x7fbb5c06f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 >> v1:172.21.15.45:6789/0 conn(0x7fbb5c0b4830 legacy=0x7fbb5c0b5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 --> v1:172.21.15.73:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0b4dd0 con 0x7fbb5c0d15b0 2023-12-19T17:52:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4668157350 con 0x7f46680c4510 2023-12-19T17:52:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 <== mon.1 v1:172.21.15.73:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fbb4c001670 con 0x7fbb5c0d15b0 2023-12-19T17:52:06.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 >> v1:172.21.15.73:6789/0 conn(0x7fbb5c0d15b0 legacy=0x7fbb5c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4668157910 con 0x7f46680c4510 2023-12-19T17:52:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb44003a70 0x7fbb44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fc66329f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 0x7fc65c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fc66329f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 0x7fc65c162950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.246+0000 7fbb60b54700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb44004870 0x7fbb44004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66329f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 0x7fc65c0c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 0x7fc65c162950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 0x7fc65c162950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33482/0 (socket says 172.21.15.45:33482) 2023-12-19T17:52:06.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66229d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 0x7fc65c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66229d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 0x7fc65c0b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55126/0 (socket says 172.21.15.45:55126) 2023-12-19T17:52:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 -- 172.21.15.45:0/3617250643 learned_addr learned my addr 172.21.15.45:0/3617250643 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb60b54700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005300 0x7fbb4400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61b56700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb44003a70 0x7fbb44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61355700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb44004870 0x7fbb44004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f47e0050c40 con 0x7f47e415d040 2023-12-19T17:52:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0b1640 con 0x7fc65c1615a0 2023-12-19T17:52:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c06f990 con 0x7fbb44005300 2023-12-19T17:52:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4400c250 con 0x7fbb44004870 2023-12-19T17:52:06.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f6c005320 con 0x7f8f6c038800 2023-12-19T17:52:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4400c410 con 0x7fbb44003a70 2023-12-19T17:52:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0c73d0 con 0x7fc65c1611c0 2023-12-19T17:52:06.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb62357700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005300 0x7fbb4400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c0b2bf0 con 0x7fc65c0af720 2023-12-19T17:52:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61355700 1 -- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb44003a70 msgr2=0x7fbb44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61355700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb44003a70 0x7fbb44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61355700 1 -- 172.21.15.45:0/2630716054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005300 msgr2=0x7fbb4400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61355700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005300 0x7fbb4400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 -- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 msgr2=0x7fc65c0b3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 0x7fc65c0b3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb61355700 1 -- 172.21.15.45:0/2630716054 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb440035d0 con 0x7fbb44004870 2023-12-19T17:52:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb62357700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44005300 0x7fbb4400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:06.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fbb62357700 1 -- 172.21.15.45:0/2630716054 reap_dead start 2023-12-19T17:52:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f466804ed30 con 0x7f46680c4510 2023-12-19T17:52:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7f6232f5e700 1 Processor -- start 2023-12-19T17:52:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 -- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 msgr2=0x7fc65c0c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 0x7fc65c0c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc661a9c700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c009570 con 0x7fc65c1611c0 2023-12-19T17:52:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7fc66229d700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 0x7fc65c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb61355700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb44004870 0x7fbb44004cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb50003ef0 tx=0x7fbb440058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f75e25162e350be1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8f64021030 con 0x7f8f6c038800 2023-12-19T17:52:06.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.250+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4658007430 con 0x7f46680c4510 2023-12-19T17:52:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50016070 con 0x7fbb44004870 2023-12-19T17:52:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50006880 con 0x7fbb44004870 2023-12-19T17:52:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb60b54700 1 -- 172.21.15.45:0/2630716054 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50003990 con 0x7fbb44004870 2023-12-19T17:52:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fc661a9c700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 0x7fc65c162950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc64c000c00 tx=0x7fc64c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6232f5e700 1 -- start start 2023-12-19T17:52:06.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f465e7fc700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f464c065b20 0x7f464c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4658082540 con 0x7f46680c4510 2023-12-19T17:52:06.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f371f691700 1 Processor -- start 2023-12-19T17:52:06.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f8f6a7fc700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f58065ba0 0x7f8f58068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb63dba700 1 -- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb44004870 msgr2=0x7fbb44004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb63dba700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb44004870 0x7fbb44004cf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbb50003ef0 tx=0x7fbb440058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f371f691700 1 -- start start 2023-12-19T17:52:06.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f64084840 con 0x7f8f6c038800 2023-12-19T17:52:06.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f8f79724700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f58065ba0 0x7f8f58068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6232f5e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f622c164690 0x7f622c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6232f5e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f622c0cd540 0x7f622c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f466d687700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f464c065b20 0x7f464c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6232f5e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f622c0cdb80 con 0x7f622c164a70 2023-12-19T17:52:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6232f5e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c0cd970 con 0x7f622c164690 2023-12-19T17:52:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6232f5e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f622c0cde60 con 0x7f622c0cd540 2023-12-19T17:52:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f622bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f622c164a70 0x7f622c0cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59252/0 (socket says 172.21.15.45:59252) 2023-12-19T17:52:06.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f622bfff700 1 -- 172.21.15.45:0/144146305 learned_addr learned my addr 172.21.15.45:0/144146305 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f6230cfa700 1 --2- 172.21.15.45:0/144146305 >> v2:172.21.15.45:3300/0 conn(0x7f622c164690 0x7f622c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7f62314fb700 1 --2- 172.21.15.45:0/144146305 >> v2:172.21.15.73:3300/0 conn(0x7f622c0cd540 0x7f622c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb63dba700 1 -- 172.21.15.45:0/2630716054 shutdown_connections 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb63dba700 1 --2- 172.21.15.45:0/2630716054 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb44004870 0x7fbb44004cf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.254+0000 7fbb63dba700 1 -- 172.21.15.45:0/2630716054 >> 172.21.15.45:0/2630716054 conn(0x7fbb5c0cf830 msgr2=0x7fbb5c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371f691700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37180b6580 0x7f37180c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371f691700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37180b5260 con 0x7f37180cfcd0 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371f691700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37180b4650 con 0x7f371815ae50 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371f691700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180b4930 con 0x7f37180b6580 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7fbb63dba700 1 -- 172.21.15.45:0/2630716054 shutdown_connections 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f62314fb700 1 -- 172.21.15.45:0/144146305 >> v2:172.21.15.45:3300/0 conn(0x7f622c164690 msgr2=0x7f622c0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f62314fb700 1 --2- 172.21.15.45:0/144146305 >> v2:172.21.15.45:3300/0 conn(0x7f622c164690 0x7f622c0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f62314fb700 1 -- 172.21.15.45:0/144146305 >> v1:172.21.15.45:6789/0 conn(0x7f622c164a70 legacy=0x7f622c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f62314fb700 1 -- 172.21.15.45:0/144146305 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f622c0ce140 con 0x7f622c0cd540 2023-12-19T17:52:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f8f79724700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f58065ba0 0x7f8f58068060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f74000b60 tx=0x7f8f7408b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f466d687700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f464c065b20 0x7f464c067fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46680c4b80 tx=0x7f4664008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7fbb63dba700 1 -- 172.21.15.45:0/2630716054 wait complete. 2023-12-19T17:52:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8f640520a0 con 0x7f8f6c038800 2023-12-19T17:52:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371d42d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f371815ae50 0x7f37180b3d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51304/0 (socket says 172.21.15.45:51304) 2023-12-19T17:52:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371d42d700 1 -- 172.21.15.45:0/1196779212 learned_addr learned my addr 172.21.15.45:0/1196779212 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:06.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f62314fb700 1 --2- 172.21.15.45:0/144146305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c0cd540 0x7f622c0c4340 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f622c0cf250 tx=0x7f6224009b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d00ba052167aa07 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371cc2c700 1 --2- 172.21.15.45:0/1196779212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37180b6580 0x7f37180c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371cc2c700 1 -- 172.21.15.45:0/1196779212 >> v1:172.21.15.73:6789/0 conn(0x7f371815ae50 legacy=0x7f37180b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371cc2c700 1 -- 172.21.15.45:0/1196779212 >> v1:172.21.15.45:6789/0 conn(0x7f37180cfcd0 legacy=0x7f37180b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371cc2c700 1 -- 172.21.15.45:0/1196779212 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37180b4c10 con 0x7f37180b6580 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f370ffff700 1 -- 172.21.15.45:0/1196779212 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257500351 0 0) 0x7f37180b5260 con 0x7f37180cfcd0 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f371cc2c700 1 --2- 172.21.15.45:0/1196779212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37180b6580 0x7f37180c47b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3708009880 tx=0x7f3708009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f13bcbcf54ba3f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f370ffff700 1 -- 172.21.15.45:0/1196779212 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708010a90 con 0x7f37180b6580 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f370ffff700 1 -- 172.21.15.45:0/1196779212 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708010bf0 con 0x7f37180b6580 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.258+0000 7f370ffff700 1 -- 172.21.15.45:0/1196779212 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708018440 con 0x7f37180b6580 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 -- 172.21.15.45:0/1196779212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37180b6580 msgr2=0x7f37180c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 --2- 172.21.15.45:0/1196779212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37180b6580 0x7f37180c47b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3708009880 tx=0x7f3708009b90 comp rx=0 tx=0).stop 2023-12-19T17:52:06.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 Processor -- start 2023-12-19T17:52:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 -- 172.21.15.45:0/1196779212 shutdown_connections 2023-12-19T17:52:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 --2- 172.21.15.45:0/1196779212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37180b6580 0x7f37180c47b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 -- 172.21.15.45:0/1196779212 >> 172.21.15.45:0/1196779212 conn(0x7f37180d0c60 msgr2=0x7f37180d1040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 -- start start 2023-12-19T17:52:06.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 -- 172.21.15.45:0/1196779212 shutdown_connections 2023-12-19T17:52:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c011630 con 0x7fc65c1611c0 2023-12-19T17:52:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f371f691700 1 -- 172.21.15.45:0/1196779212 wait complete. 2023-12-19T17:52:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc65c0b2ed0 con 0x7fc65c1611c0 2023-12-19T17:52:06.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c0b3490 con 0x7fc65c1611c0 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f465804fe30 con 0x7f46680c4510 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44004870 0x7fbb5c14def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 0x7fbb5c14d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06a3d0 0x7fbb5c0cbe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c06cda0 con 0x7fbb44004870 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c14e430 con 0x7fbb5c06a3d0 2023-12-19T17:52:06.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb63dba700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c14dc10 con 0x7fbb5c15e630 2023-12-19T17:52:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f622b7fe700 1 -- 172.21.15.45:0/144146305 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6224005ea0 con 0x7f622c0cd540 2023-12-19T17:52:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f622b7fe700 1 -- 172.21.15.45:0/144146305 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6224006030 con 0x7f622c0cd540 2023-12-19T17:52:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f622b7fe700 1 -- 172.21.15.45:0/144146305 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62240063c0 con 0x7f622c0cd540 2023-12-19T17:52:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 0x7fbb5c14d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 0x7fbb5c14d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55150/0 (socket says 172.21.15.45:55150) 2023-12-19T17:52:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 -- 172.21.15.45:0/113139104 learned_addr learned my addr 172.21.15.45:0/113139104 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c011790 con 0x7fc65c1611c0 2023-12-19T17:52:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c011b00 con 0x7fc65c1611c0 2023-12-19T17:52:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f6232f5e700 1 -- 172.21.15.45:0/144146305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c0cd540 msgr2=0x7f622c0c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7f6232f5e700 1 --2- 172.21.15.45:0/144146305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c0cd540 0x7f622c0c4340 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f622c0cf250 tx=0x7f6224009b20 comp rx=0 tx=0).stop 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 -- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06a3d0 msgr2=0x7fbb5c0cbe90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06a3d0 0x7fbb5c0cbe90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 -- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44004870 msgr2=0x7fbb5c14def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44004870 0x7fbb5c14def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 -- 172.21.15.45:0/113139104 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c06c470 con 0x7fbb5c15e630 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.262+0000 7fbb61355700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 0x7fbb5c14d6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400c3e0 tx=0x7fbb500037a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f371f691700 1 Processor -- start 2023-12-19T17:52:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50016040 con 0x7fbb5c15e630 2023-12-19T17:52:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb50007570 con 0x7fbb5c15e630 2023-12-19T17:52:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb50025440 con 0x7fbb5c15e630 2023-12-19T17:52:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c06c750 con 0x7fbb5c15e630 2023-12-19T17:52:06.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c06c120 con 0x7fbb5c15e630 2023-12-19T17:52:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc64c021070 con 0x7fc65c1611c0 2023-12-19T17:52:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc644005310 con 0x7fc65c1611c0 2023-12-19T17:52:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f371f691700 1 -- start start 2023-12-19T17:52:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fc652ffd700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc640065ad0 0x7fc640067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc64c084b00 con 0x7fc65c1611c0 2023-12-19T17:52:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f6232f5e700 1 -- 172.21.15.45:0/144146305 shutdown_connections 2023-12-19T17:52:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f6232f5e700 1 --2- 172.21.15.45:0/144146305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c0cd540 0x7f622c0c4340 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f6232f5e700 1 --2- 172.21.15.45:0/144146305 >> v2:172.21.15.45:3300/0 conn(0x7f622c164690 0x7f622c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f6232f5e700 1 -- 172.21.15.45:0/144146305 >> 172.21.15.45:0/144146305 conn(0x7f622c0cba40 msgr2=0x7f622c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f6232f5e700 1 -- 172.21.15.45:0/144146305 shutdown_connections 2023-12-19T17:52:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f371f691700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37180b6580 0x7f371815dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371f691700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37180cfcd0 0x7f37181fea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371f691700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f371815ae50 0x7f371815bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7f6232f5e700 1 -- 172.21.15.45:0/144146305 wait complete. 2023-12-19T17:52:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371f691700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180c7dd0 con 0x7f37180b6580 2023-12-19T17:52:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371f691700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180c8040 con 0x7f37180cfcd0 2023-12-19T17:52:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.266+0000 7fc66229d700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc640065ad0 0x7fc640067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371d42d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37180b6580 0x7f371815dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371f691700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180c8320 con 0x7f371815ae50 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371cc2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37180cfcd0 0x7f37181fea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371dc2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f371815ae50 0x7f371815bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371cc2c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37180cfcd0 0x7f37181fea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:33532/0 (socket says 172.21.15.45:33532) 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371cc2c700 1 -- 172.21.15.45:0/2698761576 learned_addr learned my addr 172.21.15.45:0/2698761576 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb500255c0 con 0x7fbb5c15e630 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7fbb5a7fc700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb48065b20 0x7fbb48067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371d42d700 1 -- 172.21.15.45:0/2698761576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f371815ae50 msgr2=0x7f371815bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371d42d700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f371815ae50 0x7f371815bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371d42d700 1 -- 172.21.15.45:0/2698761576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37180cfcd0 msgr2=0x7f37181fea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f6232f5e700 1 Processor -- start 2023-12-19T17:52:06.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371d42d700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37180cfcd0 0x7f37181fea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f371d42d700 1 -- 172.21.15.45:0/2698761576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37080094b0 con 0x7f37180b6580 2023-12-19T17:52:06.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbb50054f90 con 0x7fbb5c15e630 2023-12-19T17:52:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c04ed30 con 0x7fbb5c15e630 2023-12-19T17:52:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7fbb61b56700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb48065b20 0x7fbb48067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7f6232f5e700 1 -- start start 2023-12-19T17:52:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7fbb61b56700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb48065b20 0x7fbb48067fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb54003fd0 tx=0x7fbb54003a60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.270+0000 7fc66229d700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc640065ad0 0x7fc640067f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc658000f60 tx=0x7fc658009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f371d42d700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37180b6580 0x7f371815dd00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f371000caa0 tx=0x7f371000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc64c0521c0 con 0x7fc65c1611c0 2023-12-19T17:52:06.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710007480 con 0x7f37180b6580 2023-12-19T17:52:06.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6232f5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 0x7f622c0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6232f5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c164690 0x7f622c0b4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37100075e0 con 0x7f37180b6580 2023-12-19T17:52:06.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6232f5e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622c164a70 0x7f622c06cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710007950 con 0x7f37180b6580 2023-12-19T17:52:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6232f5e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0c8860 con 0x7f622c164a70 2023-12-19T17:52:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6230cfa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 0x7f622c0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6232f5e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0b28a0 con 0x7f622c164690 2023-12-19T17:52:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6230cfa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 0x7f622c0b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55162/0 (socket says 172.21.15.45:55162) 2023-12-19T17:52:06.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6230cfa700 1 -- 172.21.15.45:0/2074324388 learned_addr learned my addr 172.21.15.45:0/2074324388 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f622c0b2b80 con 0x7f622c0cd540 2023-12-19T17:52:06.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f62314fb700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622c164a70 0x7f622c06cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.274+0000 7f622bfff700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c164690 0x7f622c0b4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37180c8600 con 0x7f37180b6580 2023-12-19T17:52:06.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f371814b070 con 0x7f37180b6580 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f6230cfa700 1 -- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c164690 msgr2=0x7f622c0b4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f6230cfa700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c164690 0x7f622c0b4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f6230cfa700 1 -- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622c164a70 msgr2=0x7f622c06cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f6230cfa700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622c164a70 0x7f622c06cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f6230cfa700 1 -- 172.21.15.45:0/2074324388 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240094a0 con 0x7f622c0cd540 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f62314fb700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622c164a70 0x7f622c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f6230cfa700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 0x7f622c0b3d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6220007ef0 tx=0x7f622000e3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.278+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f371804ed30 con 0x7f37180b6580 2023-12-19T17:52:06.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f622000eea0 con 0x7f622c0cd540 2023-12-19T17:52:06.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f622c0b2e60 con 0x7f622c0cd540 2023-12-19T17:52:06.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f622c0b2570 con 0x7f622c0cd540 2023-12-19T17:52:06.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3710012400 con 0x7f37180b6580 2023-12-19T17:52:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb50051a60 con 0x7fbb5c15e630 2023-12-19T17:52:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622c0b3380 con 0x7f622c0cd540 2023-12-19T17:52:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f370dffb700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f36fc065ba0 0x7f36fc068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3710082b90 con 0x7f37180b6580 2023-12-19T17:52:06.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.282+0000 7f371cc2c700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f36fc065ba0 0x7f36fc068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.286+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6220014420 con 0x7f622c0cd540 2023-12-19T17:52:06.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.286+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62200147b0 con 0x7f622c0cd540 2023-12-19T17:52:06.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.286+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6220014910 con 0x7f622c0cd540 2023-12-19T17:52:06.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.290+0000 7f371cc2c700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f36fc065ba0 0x7f36fc068060 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3708009bd0 tx=0x7f3708014000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.290+0000 7f62297fa700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6210065ad0 0x7f6210067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.290+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f62200848d0 con 0x7f622c0cd540 2023-12-19T17:52:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.290+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6220052010 con 0x7f622c0cd540 2023-12-19T17:52:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.290+0000 7f622bfff700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6210065ad0 0x7f6210067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.290+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3710050300 con 0x7f37180b6580 2023-12-19T17:52:06.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.298+0000 7f622bfff700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6210065ad0 0x7f6210067f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f622c0c8100 tx=0x7f6218007f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.570+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f83d40718a0 con 0x7f83d4161280 2023-12-19T17:52:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.570+0000 7f83c9ffb700 1 -- 172.21.15.45:0/3641033368 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f83cc056560 con 0x7f83d4161280 2023-12-19T17:52:06.572 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83b8065b20 msgr2=0x7f83b8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83b8065b20 0x7f83b8067fe0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f83c40011e0 tx=0x7f83c4009040 comp rx=0 tx=0).stop 2023-12-19T17:52:06.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 msgr2=0x7f83d4159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 0x7f83d4159220 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f83d4165f30 tx=0x7f83cc004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 shutdown_connections 2023-12-19T17:52:06.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83b8065b20 0x7f83b8067fe0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83d4161280 0x7f83d4159220 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83d40b8410 0x7f83d40ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 --2- 172.21.15.45:0/3641033368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83d4071260 0x7f83d4162e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 >> 172.21.15.45:0/3641033368 conn(0x7f83d40d3ae0 msgr2=0x7f83d415c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 shutdown_connections 2023-12-19T17:52:06.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.574+0000 7f83db33f700 1 -- 172.21.15.45:0/3641033368 wait complete. 2023-12-19T17:52:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.598+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8f6c0da1d0 con 0x7f8f6c038800 2023-12-19T17:52:06.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.598+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f47cc0055c0 con 0x7f47e415d040 2023-12-19T17:52:06.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.598+0000 7f8f6a7fc700 1 -- 172.21.15.45:0/2627886864 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f640556c0 con 0x7f8f6c038800 2023-12-19T17:52:06.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-12-19T17:52:06.603 INFO:teuthology.orchestra.run.smithi045.stdout:55834574859 2023-12-19T17:52:06.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f47daffd700 1 -- 172.21.15.45:0/1708222296 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47e0054260 con 0x7f47e415d040 2023-12-19T17:52:06.603 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.603 INFO:teuthology.orchestra.run.smithi045.stdout:55834574859 2023-12-19T17:52:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f58065ba0 msgr2=0x7f8f58068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f58065ba0 0x7f8f58068060 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8f74000b60 tx=0x7f8f7408b040 comp rx=0 tx=0).stop 2023-12-19T17:52:06.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 msgr2=0x7f8f6c17c3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 0x7f8f6c17c3b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f64000c00 tx=0x7f8f64004770 comp rx=0 tx=0).stop 2023-12-19T17:52:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 shutdown_connections 2023-12-19T17:52:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8f58065ba0 0x7f8f58068060 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8f6c0e11b0 0x7f8f6c0db380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8f6c050ff0 0x7f8f6c0dae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 --2- 172.21.15.45:0/2627886864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8f6c038800 0x7f8f6c17c3b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 >> 172.21.15.45:0/2627886864 conn(0x7f8f6c054b50 msgr2=0x7f8f6c04d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 shutdown_connections 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f8f7c189700 1 -- 172.21.15.45:0/2627886864 wait complete. 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47c8065ba0 msgr2=0x7f47c8068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47c8065ba0 0x7f47c8068060 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d4008030 comp rx=0 tx=0).stop 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 msgr2=0x7f47e4153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.602+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 0x7f47e4153c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47e000b550 tx=0x7f47e000b910 comp rx=0 tx=0).stop 2023-12-19T17:52:06.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.606+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 shutdown_connections 2023-12-19T17:52:06.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.606+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47c8065ba0 0x7f47c8068060 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.606+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f47e4157790 0x7f47e40c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.606+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47e415d420 0x7f47e40cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.606+0000 7f47ec7a5700 1 --2- 172.21.15.45:0/1708222296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f47e415d040 0x7f47e4153c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.606+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 >> 172.21.15.45:0/1708222296 conn(0x7f47e40d2e50 msgr2=0x7f47e40d2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.610+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 shutdown_connections 2023-12-19T17:52:06.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.610+0000 7f47ec7a5700 1 -- 172.21.15.45:0/1708222296 wait complete. 2023-12-19T17:52:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.618+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f466806e1e0 con 0x7f46680c4510 2023-12-19T17:52:06.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.618+0000 7f465e7fc700 1 -- 172.21.15.45:0/1145928796 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4658053450 con 0x7f46680c4510 2023-12-19T17:52:06.622 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fc6440055c0 con 0x7fc65c1611c0 2023-12-19T17:52:06.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2023-12-19T17:52:06.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7fc652ffd700 1 -- 172.21.15.45:0/3617250643 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc64c0557e0 con 0x7fc65c1611c0 2023-12-19T17:52:06.625 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.625 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f464c065b20 msgr2=0x7f464c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f464c065b20 0x7f464c067fe0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46680c4b80 tx=0x7f4664008040 comp rx=0 tx=0).stop 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46680c4510 msgr2=0x7f4668200160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46680c4510 0x7f4668200160 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f465800c480 tx=0x7f465800c790 comp rx=0 tx=0).stop 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 shutdown_connections 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f464c065b20 0x7f464c067fe0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f46680c4b80 tx=0x7f4664008040 comp rx=0 tx=0).stop 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4668164a70 0x7f46681ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4668164690 0x7f46681fecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 --2- 172.21.15.45:0/1145928796 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46680c4510 0x7f4668200160 secure :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f465800c480 tx=0x7f465800c790 comp rx=0 tx=0).stop 2023-12-19T17:52:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 >> 172.21.15.45:0/1145928796 conn(0x7f46680cba40 msgr2=0x7f46680c8fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 shutdown_connections 2023-12-19T17:52:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.622+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fbb5c06cee0 con 0x7fbb5c15e630 2023-12-19T17:52:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7f46700ec700 1 -- 172.21.15.45:0/1145928796 wait complete. 2023-12-19T17:52:06.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fbb5a7fc700 1 -- 172.21.15.45:0/113139104 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb5002a020 con 0x7fbb5c15e630 2023-12-19T17:52:06.628 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc640065ad0 msgr2=0x7fc640067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc640065ad0 0x7fc640067f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc658000f60 tx=0x7fc658009040 comp rx=0 tx=0).stop 2023-12-19T17:52:06.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 msgr2=0x7fc65c162950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 0x7fc65c162950 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc64c000c00 tx=0x7fc64c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 shutdown_connections 2023-12-19T17:52:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc640065ad0 0x7fc640067f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc65c1615a0 0x7fc65c0c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc65c1611c0 0x7fc65c162950 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 --2- 172.21.15.45:0/3617250643 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc65c0af720 0x7fc65c0b3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 >> 172.21.15.45:0/3617250643 conn(0x7fc65c0cb900 msgr2=0x7fc65c15cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 shutdown_connections 2023-12-19T17:52:06.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.626+0000 7fc66329f700 1 -- 172.21.15.45:0/3617250643 wait complete. 2023-12-19T17:52:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb48065b20 msgr2=0x7fbb48067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb48065b20 0x7fbb48067fe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fbb54003fd0 tx=0x7fbb54003a60 comp rx=0 tx=0).stop 2023-12-19T17:52:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 msgr2=0x7fbb5c14d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 0x7fbb5c14d6d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400c3e0 tx=0x7fbb500037a0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 shutdown_connections 2023-12-19T17:52:06.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb48065b20 0x7fbb48067fe0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c06a3d0 0x7fbb5c0cbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15e630 0x7fbb5c14d6d0 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fbb4400c3e0 tx=0x7fbb500037a0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 --2- 172.21.15.45:0/113139104 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb44004870 0x7fbb5c14def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 >> 172.21.15.45:0/113139104 conn(0x7fbb5c0cf830 msgr2=0x7fbb5c0b3dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f622c0b3380 con 0x7f622c0cd540 2023-12-19T17:52:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 shutdown_connections 2023-12-19T17:52:06.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.630+0000 7fbb63dba700 1 -- 172.21.15.45:0/113139104 wait complete. 2023-12-19T17:52:06.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.634+0000 7f62297fa700 1 -- 172.21.15.45:0/2074324388 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f622c0b3380 con 0x7f622c0cd540 2023-12-19T17:52:06.635 INFO:teuthology.orchestra.run.smithi045.stdout:55834574858 2023-12-19T17:52:06.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.3 2023-12-19T17:52:06.636 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.634+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f371806bc20 con 0x7f37180b6580 2023-12-19T17:52:06.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.634+0000 7f370dffb700 1 -- 172.21.15.45:0/2698761576 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3710017020 con 0x7f37180b6580 2023-12-19T17:52:06.637 INFO:teuthology.orchestra.run.smithi045.stdout:55834574857 2023-12-19T17:52:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6210065ad0 msgr2=0x7f6210067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6210065ad0 0x7f6210067f90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f622c0c8100 tx=0x7f6218007f30 comp rx=0 tx=0).stop 2023-12-19T17:52:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 msgr2=0x7f622c0b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 0x7f622c0b3d50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6220007ef0 tx=0x7f622000e3c0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 shutdown_connections 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6210065ad0 0x7f6210067f90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f622c164a70 0x7f622c06cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f622c164690 0x7f622c0b4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 --2- 172.21.15.45:0/2074324388 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f622c0cd540 0x7f622c0b3d50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 >> 172.21.15.45:0/2074324388 conn(0x7f622c0cba40 msgr2=0x7f622c0ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 shutdown_connections 2023-12-19T17:52:06.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f6232f5e700 1 -- 172.21.15.45:0/2074324388 wait complete. 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f36fc065ba0 msgr2=0x7f36fc068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f36fc065ba0 0x7f36fc068060 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3708009bd0 tx=0x7f3708014000 comp rx=0 tx=0).stop 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37180b6580 msgr2=0x7f371815dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37180b6580 0x7f371815dd00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f371000caa0 tx=0x7f371000cad0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 shutdown_connections 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f36fc065ba0 0x7f36fc068060 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f371815ae50 0x7f371815bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37180cfcd0 0x7f37181fea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 --2- 172.21.15.45:0/2698761576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37180b6580 0x7f371815dd00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 >> 172.21.15.45:0/2698761576 conn(0x7f37180d0c60 msgr2=0x7f3718159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 shutdown_connections 2023-12-19T17:52:06.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.638+0000 7f371f691700 1 -- 172.21.15.45:0/2698761576 wait complete. 2023-12-19T17:52:06.647 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2023-12-19T17:52:06.648 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-12-19T17:52:06.656 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.657 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2023-12-19T17:52:06.657 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-12-19T17:52:06.660 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.661 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2023-12-19T17:52:06.661 DEBUG:teuthology.parallel:result is None 2023-12-19T17:52:06.661 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T17:52:06.662 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:52:06.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 Processor -- start 2023-12-19T17:52:06.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 -- start start 2023-12-19T17:52:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f997415ab50 0x7f99740ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f997406e0a0 0x7f99740cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997406cbb0 con 0x7f997415af30 2023-12-19T17:52:06.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997406fa10 con 0x7f997406e0a0 2023-12-19T17:52:06.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f997a28a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997406fcf0 con 0x7f997415ab50 2023-12-19T17:52:06.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f997406e0a0 0x7f99740cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f997406e0a0 0x7f99740cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38166/0 (socket says 172.21.15.45:38166) 2023-12-19T17:52:06.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 -- 172.21.15.45:0/2771432305 learned_addr learned my addr 172.21.15.45:0/2771432305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9973fff700 1 --2- 172.21.15.45:0/2771432305 >> v2:172.21.15.73:3300/0 conn(0x7f997415ab50 0x7f99740ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 -- 172.21.15.45:0/2771432305 >> v2:172.21.15.73:3300/0 conn(0x7f997415ab50 msgr2=0x7f99740ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 --2- 172.21.15.45:0/2771432305 >> v2:172.21.15.73:3300/0 conn(0x7f997415ab50 0x7f99740ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 -- 172.21.15.45:0/2771432305 >> v1:172.21.15.45:6789/0 conn(0x7f997415af30 legacy=0x7f997415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.870+0000 7f9978827700 1 -- 172.21.15.45:0/2771432305 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997406ffd0 con 0x7f997406e0a0 2023-12-19T17:52:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f9978827700 1 --2- 172.21.15.45:0/2771432305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997406e0a0 0x7f99740cd2b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9974070630 tx=0x7f996c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14dc59fac9bdca9b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f9972ffd700 1 -- 172.21.15.45:0/2771432305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00e070 con 0x7f997406e0a0 2023-12-19T17:52:06.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f9972ffd700 1 -- 172.21.15.45:0/2771432305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c00b9c0 con 0x7f997406e0a0 2023-12-19T17:52:06.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f9972ffd700 1 -- 172.21.15.45:0/2771432305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c00bd70 con 0x7f997406e0a0 2023-12-19T17:52:06.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 -- 172.21.15.45:0/2771432305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997406e0a0 msgr2=0x7f99740cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 --2- 172.21.15.45:0/2771432305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997406e0a0 0x7f99740cd2b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9974070630 tx=0x7f996c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:06.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 -- 172.21.15.45:0/2771432305 shutdown_connections 2023-12-19T17:52:06.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 --2- 172.21.15.45:0/2771432305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997406e0a0 0x7f99740cd2b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 --2- 172.21.15.45:0/2771432305 >> v2:172.21.15.73:3300/0 conn(0x7f997415ab50 0x7f99740ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 -- 172.21.15.45:0/2771432305 >> 172.21.15.45:0/2771432305 conn(0x7f99740cba40 msgr2=0x7f99740ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:06.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 -- 172.21.15.45:0/2771432305 shutdown_connections 2023-12-19T17:52:06.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 -- 172.21.15.45:0/2771432305 wait complete. 2023-12-19T17:52:06.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.874+0000 7f997a28a700 1 Processor -- start 2023-12-19T17:52:06.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 -- start start 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997406e0a0 0x7f99740c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f997415ab50 0x7f997414ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 0x7f997414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740c7650 con 0x7f997415af30 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99740c8020 con 0x7f997406e0a0 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9974150a50 con 0x7f997415ab50 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 0x7f997414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 0x7f997414f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38172/0 (socket says 172.21.15.45:38172) 2023-12-19T17:52:06.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 -- 172.21.15.45:0/3064821584 learned_addr learned my addr 172.21.15.45:0/3064821584 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9973fff700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997406e0a0 0x7f99740c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 -- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f997415ab50 msgr2=0x7f997414ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f99737fe700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f997415ab50 0x7f997414ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f997415ab50 0x7f997414ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 -- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997406e0a0 msgr2=0x7f99740c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997406e0a0 0x7f99740c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 -- 172.21.15.45:0/3064821584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f996c009b30 con 0x7f997415af30 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9973fff700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997406e0a0 0x7f99740c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f99737fe700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f997415ab50 0x7f997414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9978827700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 0x7f997414f020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f996c009fd0 tx=0x7f996c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c0049e0 con 0x7f997415af30 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c0092e0 con 0x7f997415af30 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99740c6d20 con 0x7f997415af30 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.878+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c01c680 con 0x7f997415af30 2023-12-19T17:52:06.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.882+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99740c72e0 con 0x7f997415af30 2023-12-19T17:52:06.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.882+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99740c7470 con 0x7f997415af30 2023-12-19T17:52:06.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.882+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f996c01c7e0 con 0x7f997415af30 2023-12-19T17:52:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.882+0000 7f9970ff9700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9960065ad0 0x7f9960067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.886+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f996c006e40 con 0x7f997415af30 2023-12-19T17:52:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.886+0000 7f9973fff700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9960065ad0 0x7f9960067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:06.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.886+0000 7f9973fff700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9960065ad0 0x7f9960067f90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9964009a20 tx=0x7f9964008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:06.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:06.890+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f996c052600 con 0x7f997415af30 2023-12-19T17:52:07.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.054+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99740702b0 con 0x7f9960065ad0 2023-12-19T17:52:07.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.070+0000 7f9970ff9700 1 -- 172.21.15.45:0/3064821584 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345106 (secure 0 0 0) 0x7f9964009e90 con 0x7f9960065ad0 2023-12-19T17:52:07.081 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9960065ad0 msgr2=0x7f9960067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9960065ad0 0x7f9960067f90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9964009a20 tx=0x7f9964008040 comp rx=0 tx=0).stop 2023-12-19T17:52:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 msgr2=0x7f997414f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 0x7f997414f020 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f996c009fd0 tx=0x7f996c004b40 comp rx=0 tx=0).stop 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 shutdown_connections 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9960065ad0 0x7f9960067f90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f997415af30 0x7f997414f020 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f997415ab50 0x7f997414ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 --2- 172.21.15.45:0/3064821584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f997406e0a0 0x7f99740c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 >> 172.21.15.45:0/3064821584 conn(0x7f99740cba40 msgr2=0x7f9974152450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 shutdown_connections 2023-12-19T17:52:07.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.082+0000 7f997a28a700 1 -- 172.21.15.45:0/3064821584 wait complete. 2023-12-19T17:52:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:52:07.110 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-19T17:52:06.202838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222916,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751804,"statfs":{"total":773094113280,"available":772865847296,"internally_reserved":0,"allocated":3280896,"data_stored":1987143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005771"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883478+0000","last_change":"2023-12-19T17:51:37.371560+0000","last_active":"2023-12-19T17:51:41.883478+0000","last_peered":"2023-12-19T17:51:41.883478+0000","last_clean":"2023-12-19T17:51:41.883478+0000","last_became_active":"2023-12-19T17:51:37.368980+0000","last_became_peered":"2023-12-19T17:51:37.368980+0000","last_unstale":"2023-12-19T17:51:41.883478+0000","last_undegraded":"2023-12-19T17:51:41.883478+0000","last_fullsized":"2023-12-19T17:51:41.883478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881409+0000","last_change":"2023-12-19T17:51:37.863698+0000","last_active":"2023-12-19T17:51:41.881409+0000","last_peered":"2023-12-19T17:51:41.881409+0000","last_clean":"2023-12-19T17:51:41.881409+0000","last_became_active":"2023-12-19T17:51:37.863369+0000","last_became_peered":"2023-12-19T17:51:37.863369+0000","last_unstale":"2023-12-19T17:51:41.881409+0000","last_undegraded":"2023-12-19T17:51:41.881409+0000","last_fullsized":"2023-12-19T17:51:41.881409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901112+0000","last_change":"2023-12-19T17:51:41.894945+0000","last_active":"2023-12-19T17:51:41.901112+0000","last_peered":"2023-12-19T17:51:41.901112+0000","last_clean":"2023-12-19T17:51:41.901112+0000","last_became_active":"2023-12-19T17:51:41.894291+0000","last_became_peered":"2023-12-19T17:51:41.894291+0000","last_unstale":"2023-12-19T17:51:41.901112+0000","last_undegraded":"2023-12-19T17:51:41.901112+0000","last_fullsized":"2023-12-19T17:51:41.901112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881515+0000","last_change":"2023-12-19T17:51:37.371310+0000","last_active":"2023-12-19T17:51:41.881515+0000","last_peered":"2023-12-19T17:51:41.881515+0000","last_clean":"2023-12-19T17:51:41.881515+0000","last_became_active":"2023-12-19T17:51:37.370946+0000","last_became_peered":"2023-12-19T17:51:37.370946+0000","last_unstale":"2023-12-19T17:51:41.881515+0000","last_undegraded":"2023-12-19T17:51:41.881515+0000","last_fullsized":"2023-12-19T17:51:41.881515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881893+0000","last_change":"2023-12-19T17:51:37.859332+0000","last_active":"2023-12-19T17:51:41.881893+0000","last_peered":"2023-12-19T17:51:41.881893+0000","last_clean":"2023-12-19T17:51:41.881893+0000","last_became_active":"2023-12-19T17:51:37.858295+0000","last_became_peered":"2023-12-19T17:51:37.858295+0000","last_unstale":"2023-12-19T17:51:41.881893+0000","last_undegraded":"2023-12-19T17:51:41.881893+0000","last_fullsized":"2023-12-19T17:51:41.881893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904185+0000","last_change":"2023-12-19T17:51:41.894941+0000","last_active":"2023-12-19T17:51:41.904185+0000","last_peered":"2023-12-19T17:51:41.904185+0000","last_clean":"2023-12-19T17:51:41.904185+0000","last_became_active":"2023-12-19T17:51:41.894354+0000","last_became_peered":"2023-12-19T17:51:41.894354+0000","last_unstale":"2023-12-19T17:51:41.904185+0000","last_undegraded":"2023-12-19T17:51:41.904185+0000","last_fullsized":"2023-12-19T17:51:41.904185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:24.899374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863045+0000","last_change":"2023-12-19T17:51:37.373590+0000","last_active":"2023-12-19T17:51:41.863045+0000","last_peered":"2023-12-19T17:51:41.863045+0000","last_clean":"2023-12-19T17:51:41.863045+0000","last_became_active":"2023-12-19T17:51:37.372932+0000","last_became_peered":"2023-12-19T17:51:37.372932+0000","last_unstale":"2023-12-19T17:51:41.863045+0000","last_undegraded":"2023-12-19T17:51:41.863045+0000","last_fullsized":"2023-12-19T17:51:41.863045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:41.180593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873974+0000","last_change":"2023-12-19T17:51:37.854515+0000","last_active":"2023-12-19T17:51:41.873974+0000","last_peered":"2023-12-19T17:51:41.873974+0000","last_clean":"2023-12-19T17:51:41.873974+0000","last_became_active":"2023-12-19T17:51:37.852250+0000","last_became_peered":"2023-12-19T17:51:37.852250+0000","last_unstale":"2023-12-19T17:51:41.873974+0000","last_undegraded":"2023-12-19T17:51:41.873974+0000","last_fullsized":"2023-12-19T17:51:41.873974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.913316+0000","last_change":"2023-12-19T17:51:41.912325+0000","last_active":"2023-12-19T17:51:41.913316+0000","last_peered":"2023-12-19T17:51:41.913316+0000","last_clean":"2023-12-19T17:51:41.913316+0000","last_became_active":"2023-12-19T17:51:41.907565+0000","last_became_peered":"2023-12-19T17:51:41.907565+0000","last_unstale":"2023-12-19T17:51:41.913316+0000","last_undegraded":"2023-12-19T17:51:41.913316+0000","last_fullsized":"2023-12-19T17:51:41.913316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863667+0000","last_change":"2023-12-19T17:51:37.375079+0000","last_active":"2023-12-19T17:51:41.863667+0000","last_peered":"2023-12-19T17:51:41.863667+0000","last_clean":"2023-12-19T17:51:41.863667+0000","last_became_active":"2023-12-19T17:51:37.373363+0000","last_became_peered":"2023-12-19T17:51:37.373363+0000","last_unstale":"2023-12-19T17:51:41.863667+0000","last_undegraded":"2023-12-19T17:51:41.863667+0000","last_fullsized":"2023-12-19T17:51:41.863667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:05.345443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874581+0000","last_change":"2023-12-19T17:51:37.854134+0000","last_active":"2023-12-19T17:51:41.874581+0000","last_peered":"2023-12-19T17:51:41.874581+0000","last_clean":"2023-12-19T17:51:41.874581+0000","last_became_active":"2023-12-19T17:51:37.852585+0000","last_became_peered":"2023-12-19T17:51:37.852585+0000","last_unstale":"2023-12-19T17:51:41.874581+0000","last_undegraded":"2023-12-19T17:51:41.874581+0000","last_fullsized":"2023-12-19T17:51:41.874581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892187+0000","last_change":"2023-12-19T17:51:41.886590+0000","last_active":"2023-12-19T17:51:41.892187+0000","last_peered":"2023-12-19T17:51:41.892187+0000","last_clean":"2023-12-19T17:51:41.892187+0000","last_became_active":"2023-12-19T17:51:41.885064+0000","last_became_peered":"2023-12-19T17:51:41.885064+0000","last_unstale":"2023-12-19T17:51:41.892187+0000","last_undegraded":"2023-12-19T17:51:41.892187+0000","last_fullsized":"2023-12-19T17:51:41.892187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:06.290013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863854+0000","last_change":"2023-12-19T17:51:37.860517+0000","last_active":"2023-12-19T17:51:41.863854+0000","last_peered":"2023-12-19T17:51:41.863854+0000","last_clean":"2023-12-19T17:51:41.863854+0000","last_became_active":"2023-12-19T17:51:37.860222+0000","last_became_peered":"2023-12-19T17:51:37.860222+0000","last_unstale":"2023-12-19T17:51:41.863854+0000","last_undegraded":"2023-12-19T17:51:41.863854+0000","last_fullsized":"2023-12-19T17:51:41.863854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861865+0000","last_change":"2023-12-19T17:51:37.374087+0000","last_active":"2023-12-19T17:51:41.861865+0000","last_peered":"2023-12-19T17:51:41.861865+0000","last_clean":"2023-12-19T17:51:41.861865+0000","last_became_active":"2023-12-19T17:51:37.373661+0000","last_became_peered":"2023-12-19T17:51:37.373661+0000","last_unstale":"2023-12-19T17:51:41.861865+0000","last_undegraded":"2023-12-19T17:51:41.861865+0000","last_fullsized":"2023-12-19T17:51:41.861865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:25.625813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892353+0000","last_change":"2023-12-19T17:51:41.885394+0000","last_active":"2023-12-19T17:51:41.892353+0000","last_peered":"2023-12-19T17:51:41.892353+0000","last_clean":"2023-12-19T17:51:41.892353+0000","last_became_active":"2023-12-19T17:51:41.884923+0000","last_became_peered":"2023-12-19T17:51:41.884923+0000","last_unstale":"2023-12-19T17:51:41.892353+0000","last_undegraded":"2023-12-19T17:51:41.892353+0000","last_fullsized":"2023-12-19T17:51:41.892353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:01.021272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874374+0000","last_change":"2023-12-19T17:51:37.861671+0000","last_active":"2023-12-19T17:51:41.874374+0000","last_peered":"2023-12-19T17:51:41.874374+0000","last_clean":"2023-12-19T17:51:41.874374+0000","last_became_active":"2023-12-19T17:51:37.860880+0000","last_became_peered":"2023-12-19T17:51:37.860880+0000","last_unstale":"2023-12-19T17:51:41.874374+0000","last_undegraded":"2023-12-19T17:51:41.874374+0000","last_fullsized":"2023-12-19T17:51:41.874374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862370+0000","last_change":"2023-12-19T17:51:37.365041+0000","last_active":"2023-12-19T17:51:41.862370+0000","last_peered":"2023-12-19T17:51:41.862370+0000","last_clean":"2023-12-19T17:51:41.862370+0000","last_became_active":"2023-12-19T17:51:37.364574+0000","last_became_peered":"2023-12-19T17:51:37.364574+0000","last_unstale":"2023-12-19T17:51:41.862370+0000","last_undegraded":"2023-12-19T17:51:41.862370+0000","last_fullsized":"2023-12-19T17:51:41.862370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.903630+0000","last_change":"2023-12-19T17:51:41.894392+0000","last_active":"2023-12-19T17:51:41.903630+0000","last_peered":"2023-12-19T17:51:41.903630+0000","last_clean":"2023-12-19T17:51:41.903630+0000","last_became_active":"2023-12-19T17:51:41.893912+0000","last_became_peered":"2023-12-19T17:51:41.893912+0000","last_unstale":"2023-12-19T17:51:41.903630+0000","last_undegraded":"2023-12-19T17:51:41.903630+0000","last_fullsized":"2023-12-19T17:51:41.903630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871673+0000","last_change":"2023-12-19T17:51:37.878509+0000","last_active":"2023-12-19T17:51:41.871673+0000","last_peered":"2023-12-19T17:51:41.871673+0000","last_clean":"2023-12-19T17:51:41.871673+0000","last_became_active":"2023-12-19T17:51:37.878267+0000","last_became_peered":"2023-12-19T17:51:37.878267+0000","last_unstale":"2023-12-19T17:51:41.871673+0000","last_undegraded":"2023-12-19T17:51:41.871673+0000","last_fullsized":"2023-12-19T17:51:41.871673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860703+0000","last_change":"2023-12-19T17:51:37.361332+0000","last_active":"2023-12-19T17:51:41.860703+0000","last_peered":"2023-12-19T17:51:41.860703+0000","last_clean":"2023-12-19T17:51:41.860703+0000","last_became_active":"2023-12-19T17:51:37.359992+0000","last_became_peered":"2023-12-19T17:51:37.359992+0000","last_unstale":"2023-12-19T17:51:41.860703+0000","last_undegraded":"2023-12-19T17:51:41.860703+0000","last_fullsized":"2023-12-19T17:51:41.860703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.905148+0000","last_change":"2023-12-19T17:51:41.902138+0000","last_active":"2023-12-19T17:51:41.905148+0000","last_peered":"2023-12-19T17:51:41.905148+0000","last_clean":"2023-12-19T17:51:41.905148+0000","last_became_active":"2023-12-19T17:51:41.901751+0000","last_became_peered":"2023-12-19T17:51:41.901751+0000","last_unstale":"2023-12-19T17:51:41.905148+0000","last_undegraded":"2023-12-19T17:51:41.905148+0000","last_fullsized":"2023-12-19T17:51:41.905148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:10.835359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872596+0000","last_change":"2023-12-19T17:51:37.852747+0000","last_active":"2023-12-19T17:51:41.872596+0000","last_peered":"2023-12-19T17:51:41.872596+0000","last_clean":"2023-12-19T17:51:41.872596+0000","last_became_active":"2023-12-19T17:51:37.852265+0000","last_became_peered":"2023-12-19T17:51:37.852265+0000","last_unstale":"2023-12-19T17:51:41.872596+0000","last_undegraded":"2023-12-19T17:51:41.872596+0000","last_fullsized":"2023-12-19T17:51:41.872596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:48.499693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861229+0000","last_change":"2023-12-19T17:51:37.374392+0000","last_active":"2023-12-19T17:51:41.861229+0000","last_peered":"2023-12-19T17:51:41.861229+0000","last_clean":"2023-12-19T17:51:41.861229+0000","last_became_active":"2023-12-19T17:51:37.373831+0000","last_became_peered":"2023-12-19T17:51:37.373831+0000","last_unstale":"2023-12-19T17:51:41.861229+0000","last_undegraded":"2023-12-19T17:51:41.861229+0000","last_fullsized":"2023-12-19T17:51:41.861229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:33.874748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895361+0000","last_change":"2023-12-19T17:51:41.889463+0000","last_active":"2023-12-19T17:51:41.895361+0000","last_peered":"2023-12-19T17:51:41.895361+0000","last_clean":"2023-12-19T17:51:41.895361+0000","last_became_active":"2023-12-19T17:51:41.888636+0000","last_became_peered":"2023-12-19T17:51:41.888636+0000","last_unstale":"2023-12-19T17:51:41.895361+0000","last_undegraded":"2023-12-19T17:51:41.895361+0000","last_fullsized":"2023-12-19T17:51:41.895361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.882268+0000","last_change":"2023-12-19T17:51:37.868058+0000","last_active":"2023-12-19T17:51:41.882268+0000","last_peered":"2023-12-19T17:51:41.882268+0000","last_clean":"2023-12-19T17:51:41.882268+0000","last_became_active":"2023-12-19T17:51:37.867800+0000","last_became_peered":"2023-12-19T17:51:37.867800+0000","last_unstale":"2023-12-19T17:51:41.882268+0000","last_undegraded":"2023-12-19T17:51:41.882268+0000","last_fullsized":"2023-12-19T17:51:41.882268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865357+0000","last_change":"2023-12-19T17:51:37.366626+0000","last_active":"2023-12-19T17:51:41.865357+0000","last_peered":"2023-12-19T17:51:41.865357+0000","last_clean":"2023-12-19T17:51:41.865357+0000","last_became_active":"2023-12-19T17:51:37.366007+0000","last_became_peered":"2023-12-19T17:51:37.366007+0000","last_unstale":"2023-12-19T17:51:41.865357+0000","last_undegraded":"2023-12-19T17:51:41.865357+0000","last_fullsized":"2023-12-19T17:51:41.865357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892118+0000","last_change":"2023-12-19T17:51:41.882903+0000","last_active":"2023-12-19T17:51:41.892118+0000","last_peered":"2023-12-19T17:51:41.892118+0000","last_clean":"2023-12-19T17:51:41.892118+0000","last_became_active":"2023-12-19T17:51:41.882532+0000","last_became_peered":"2023-12-19T17:51:41.882532+0000","last_unstale":"2023-12-19T17:51:41.892118+0000","last_undegraded":"2023-12-19T17:51:41.892118+0000","last_fullsized":"2023-12-19T17:51:41.892118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881484+0000","last_change":"2023-12-19T17:51:37.870213+0000","last_active":"2023-12-19T17:51:41.881484+0000","last_peered":"2023-12-19T17:51:41.881484+0000","last_clean":"2023-12-19T17:51:41.881484+0000","last_became_active":"2023-12-19T17:51:37.869912+0000","last_became_peered":"2023-12-19T17:51:37.869912+0000","last_unstale":"2023-12-19T17:51:41.881484+0000","last_undegraded":"2023-12-19T17:51:41.881484+0000","last_fullsized":"2023-12-19T17:51:41.881484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:52.781318+0000","last_change":"2023-12-19T17:51:37.367621+0000","last_active":"2023-12-19T17:51:52.781318+0000","last_peered":"2023-12-19T17:51:52.781318+0000","last_clean":"2023-12-19T17:51:52.781318+0000","last_became_active":"2023-12-19T17:51:37.367105+0000","last_became_peered":"2023-12-19T17:51:37.367105+0000","last_unstale":"2023-12-19T17:51:52.781318+0000","last_undegraded":"2023-12-19T17:51:52.781318+0000","last_fullsized":"2023-12-19T17:51:52.781318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909707+0000","last_change":"2023-12-19T17:51:41.904744+0000","last_active":"2023-12-19T17:51:41.909707+0000","last_peered":"2023-12-19T17:51:41.909707+0000","last_clean":"2023-12-19T17:51:41.909707+0000","last_became_active":"2023-12-19T17:51:41.904364+0000","last_became_peered":"2023-12-19T17:51:41.904364+0000","last_unstale":"2023-12-19T17:51:41.909707+0000","last_undegraded":"2023-12-19T17:51:41.909707+0000","last_fullsized":"2023-12-19T17:51:41.909707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:58.563321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860812+0000","last_change":"2023-12-19T17:51:37.865360+0000","last_active":"2023-12-19T17:51:41.860812+0000","last_peered":"2023-12-19T17:51:41.860812+0000","last_clean":"2023-12-19T17:51:41.860812+0000","last_became_active":"2023-12-19T17:51:37.865049+0000","last_became_peered":"2023-12-19T17:51:37.865049+0000","last_unstale":"2023-12-19T17:51:41.860812+0000","last_undegraded":"2023-12-19T17:51:41.860812+0000","last_fullsized":"2023-12-19T17:51:41.860812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863243+0000","last_change":"2023-12-19T17:51:37.374005+0000","last_active":"2023-12-19T17:51:41.863243+0000","last_peered":"2023-12-19T17:51:41.863243+0000","last_clean":"2023-12-19T17:51:41.863243+0000","last_became_active":"2023-12-19T17:51:37.373306+0000","last_became_peered":"2023-12-19T17:51:37.373306+0000","last_unstale":"2023-12-19T17:51:41.863243+0000","last_undegraded":"2023-12-19T17:51:41.863243+0000","last_fullsized":"2023-12-19T17:51:41.863243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:28.401279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909053+0000","last_change":"2023-12-19T17:51:41.907731+0000","last_active":"2023-12-19T17:51:41.909053+0000","last_peered":"2023-12-19T17:51:41.909053+0000","last_clean":"2023-12-19T17:51:41.909053+0000","last_became_active":"2023-12-19T17:51:41.907322+0000","last_became_peered":"2023-12-19T17:51:41.907322+0000","last_unstale":"2023-12-19T17:51:41.909053+0000","last_undegraded":"2023-12-19T17:51:41.909053+0000","last_fullsized":"2023-12-19T17:51:41.909053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874655+0000","last_change":"2023-12-19T17:51:37.868383+0000","last_active":"2023-12-19T17:51:41.874655+0000","last_peered":"2023-12-19T17:51:41.874655+0000","last_clean":"2023-12-19T17:51:41.874655+0000","last_became_active":"2023-12-19T17:51:37.867225+0000","last_became_peered":"2023-12-19T17:51:37.867225+0000","last_unstale":"2023-12-19T17:51:41.874655+0000","last_undegraded":"2023-12-19T17:51:41.874655+0000","last_fullsized":"2023-12-19T17:51:41.874655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861892+0000","last_change":"2023-12-19T17:51:37.372486+0000","last_active":"2023-12-19T17:51:41.861892+0000","last_peered":"2023-12-19T17:51:41.861892+0000","last_clean":"2023-12-19T17:51:41.861892+0000","last_became_active":"2023-12-19T17:51:37.371902+0000","last_became_peered":"2023-12-19T17:51:37.371902+0000","last_unstale":"2023-12-19T17:51:41.861892+0000","last_undegraded":"2023-12-19T17:51:41.861892+0000","last_fullsized":"2023-12-19T17:51:41.861892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901181+0000","last_change":"2023-12-19T17:51:41.893407+0000","last_active":"2023-12-19T17:51:41.901181+0000","last_peered":"2023-12-19T17:51:41.901181+0000","last_clean":"2023-12-19T17:51:41.901181+0000","last_became_active":"2023-12-19T17:51:41.892955+0000","last_became_peered":"2023-12-19T17:51:41.892955+0000","last_unstale":"2023-12-19T17:51:41.901181+0000","last_undegraded":"2023-12-19T17:51:41.901181+0000","last_fullsized":"2023-12-19T17:51:41.901181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871399+0000","last_change":"2023-12-19T17:51:37.856391+0000","last_active":"2023-12-19T17:51:41.871399+0000","last_peered":"2023-12-19T17:51:41.871399+0000","last_clean":"2023-12-19T17:51:41.871399+0000","last_became_active":"2023-12-19T17:51:37.855433+0000","last_became_peered":"2023-12-19T17:51:37.855433+0000","last_unstale":"2023-12-19T17:51:41.871399+0000","last_undegraded":"2023-12-19T17:51:41.871399+0000","last_fullsized":"2023-12-19T17:51:41.871399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:34.887797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870511+0000","last_change":"2023-12-19T17:51:37.356703+0000","last_active":"2023-12-19T17:51:41.870511+0000","last_peered":"2023-12-19T17:51:41.870511+0000","last_clean":"2023-12-19T17:51:41.870511+0000","last_became_active":"2023-12-19T17:51:37.354458+0000","last_became_peered":"2023-12-19T17:51:37.354458+0000","last_unstale":"2023-12-19T17:51:41.870511+0000","last_undegraded":"2023-12-19T17:51:41.870511+0000","last_fullsized":"2023-12-19T17:51:41.870511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.899818+0000","last_change":"2023-12-19T17:51:41.893006+0000","last_active":"2023-12-19T17:51:41.899818+0000","last_peered":"2023-12-19T17:51:41.899818+0000","last_clean":"2023-12-19T17:51:41.899818+0000","last_became_active":"2023-12-19T17:51:41.892320+0000","last_became_peered":"2023-12-19T17:51:41.892320+0000","last_unstale":"2023-12-19T17:51:41.899818+0000","last_undegraded":"2023-12-19T17:51:41.899818+0000","last_fullsized":"2023-12-19T17:51:41.899818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860734+0000","last_change":"2023-12-19T17:51:37.868336+0000","last_active":"2023-12-19T17:51:41.860734+0000","last_peered":"2023-12-19T17:51:41.860734+0000","last_clean":"2023-12-19T17:51:41.860734+0000","last_became_active":"2023-12-19T17:51:37.847762+0000","last_became_peered":"2023-12-19T17:51:37.847762+0000","last_unstale":"2023-12-19T17:51:41.860734+0000","last_undegraded":"2023-12-19T17:51:41.860734+0000","last_fullsized":"2023-12-19T17:51:41.860734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870223+0000","last_change":"2023-12-19T17:51:37.367919+0000","last_active":"2023-12-19T17:51:41.870223+0000","last_peered":"2023-12-19T17:51:41.870223+0000","last_clean":"2023-12-19T17:51:41.870223+0000","last_became_active":"2023-12-19T17:51:37.367646+0000","last_became_peered":"2023-12-19T17:51:37.367646+0000","last_unstale":"2023-12-19T17:51:41.870223+0000","last_undegraded":"2023-12-19T17:51:41.870223+0000","last_fullsized":"2023-12-19T17:51:41.870223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900252+0000","last_change":"2023-12-19T17:51:41.891782+0000","last_active":"2023-12-19T17:51:41.900252+0000","last_peered":"2023-12-19T17:51:41.900252+0000","last_clean":"2023-12-19T17:51:41.900252+0000","last_became_active":"2023-12-19T17:51:41.891400+0000","last_became_peered":"2023-12-19T17:51:41.891400+0000","last_unstale":"2023-12-19T17:51:41.900252+0000","last_undegraded":"2023-12-19T17:51:41.900252+0000","last_fullsized":"2023-12-19T17:51:41.900252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872648+0000","last_change":"2023-12-19T17:51:37.865125+0000","last_active":"2023-12-19T17:51:41.872648+0000","last_peered":"2023-12-19T17:51:41.872648+0000","last_clean":"2023-12-19T17:51:41.872648+0000","last_became_active":"2023-12-19T17:51:37.860190+0000","last_became_peered":"2023-12-19T17:51:37.860190+0000","last_unstale":"2023-12-19T17:51:41.872648+0000","last_undegraded":"2023-12-19T17:51:41.872648+0000","last_fullsized":"2023-12-19T17:51:41.872648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861321+0000","last_change":"2023-12-19T17:51:37.374377+0000","last_active":"2023-12-19T17:51:41.861321+0000","last_peered":"2023-12-19T17:51:41.861321+0000","last_clean":"2023-12-19T17:51:41.861321+0000","last_became_active":"2023-12-19T17:51:37.373141+0000","last_became_peered":"2023-12-19T17:51:37.373141+0000","last_unstale":"2023-12-19T17:51:41.861321+0000","last_undegraded":"2023-12-19T17:51:41.861321+0000","last_fullsized":"2023-12-19T17:51:41.861321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.889909+0000","last_change":"2023-12-19T17:51:41.885767+0000","last_active":"2023-12-19T17:51:41.889909+0000","last_peered":"2023-12-19T17:51:41.889909+0000","last_clean":"2023-12-19T17:51:41.889909+0000","last_became_active":"2023-12-19T17:51:41.884799+0000","last_became_peered":"2023-12-19T17:51:41.884799+0000","last_unstale":"2023-12-19T17:51:41.889909+0000","last_undegraded":"2023-12-19T17:51:41.889909+0000","last_fullsized":"2023-12-19T17:51:41.889909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:22.880744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874118+0000","last_change":"2023-12-19T17:51:37.879736+0000","last_active":"2023-12-19T17:51:41.874118+0000","last_peered":"2023-12-19T17:51:41.874118+0000","last_clean":"2023-12-19T17:51:41.874118+0000","last_became_active":"2023-12-19T17:51:37.877058+0000","last_became_peered":"2023-12-19T17:51:37.877058+0000","last_unstale":"2023-12-19T17:51:41.874118+0000","last_undegraded":"2023-12-19T17:51:41.874118+0000","last_fullsized":"2023-12-19T17:51:41.874118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.876487+0000","last_change":"2023-12-19T17:51:37.359468+0000","last_active":"2023-12-19T17:51:41.876487+0000","last_peered":"2023-12-19T17:51:41.876487+0000","last_clean":"2023-12-19T17:51:41.876487+0000","last_became_active":"2023-12-19T17:51:37.359194+0000","last_became_peered":"2023-12-19T17:51:37.359194+0000","last_unstale":"2023-12-19T17:51:41.876487+0000","last_undegraded":"2023-12-19T17:51:41.876487+0000","last_fullsized":"2023-12-19T17:51:41.876487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861414+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:51:41.861414+0000","last_peered":"2023-12-19T17:51:41.861414+0000","last_clean":"2023-12-19T17:51:41.861414+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:51:41.861414+0000","last_undegraded":"2023-12-19T17:51:41.861414+0000","last_fullsized":"2023-12-19T17:51:41.861414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897184+0000","last_change":"2023-12-19T17:51:41.893689+0000","last_active":"2023-12-19T17:51:41.897184+0000","last_peered":"2023-12-19T17:51:41.897184+0000","last_clean":"2023-12-19T17:51:41.897184+0000","last_became_active":"2023-12-19T17:51:41.893191+0000","last_became_peered":"2023-12-19T17:51:41.893191+0000","last_unstale":"2023-12-19T17:51:41.897184+0000","last_undegraded":"2023-12-19T17:51:41.897184+0000","last_fullsized":"2023-12-19T17:51:41.897184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:45.069338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861902+0000","last_change":"2023-12-19T17:51:37.868222+0000","last_active":"2023-12-19T17:51:41.861902+0000","last_peered":"2023-12-19T17:51:41.861902+0000","last_clean":"2023-12-19T17:51:41.861902+0000","last_became_active":"2023-12-19T17:51:37.867972+0000","last_became_peered":"2023-12-19T17:51:37.867972+0000","last_unstale":"2023-12-19T17:51:41.861902+0000","last_undegraded":"2023-12-19T17:51:41.861902+0000","last_fullsized":"2023-12-19T17:51:41.861902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871883+0000","last_change":"2023-12-19T17:51:37.366114+0000","last_active":"2023-12-19T17:51:41.871883+0000","last_peered":"2023-12-19T17:51:41.871883+0000","last_clean":"2023-12-19T17:51:41.871883+0000","last_became_active":"2023-12-19T17:51:37.365717+0000","last_became_peered":"2023-12-19T17:51:37.365717+0000","last_unstale":"2023-12-19T17:51:41.871883+0000","last_undegraded":"2023-12-19T17:51:41.871883+0000","last_fullsized":"2023-12-19T17:51:41.871883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.890817+0000","last_change":"2023-12-19T17:51:41.883576+0000","last_active":"2023-12-19T17:51:41.890817+0000","last_peered":"2023-12-19T17:51:41.890817+0000","last_clean":"2023-12-19T17:51:41.890817+0000","last_became_active":"2023-12-19T17:51:41.883135+0000","last_became_peered":"2023-12-19T17:51:41.883135+0000","last_unstale":"2023-12-19T17:51:41.890817+0000","last_undegraded":"2023-12-19T17:51:41.890817+0000","last_fullsized":"2023-12-19T17:51:41.890817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874046+0000","last_change":"2023-12-19T17:51:37.863995+0000","last_active":"2023-12-19T17:51:41.874046+0000","last_peered":"2023-12-19T17:51:41.874046+0000","last_clean":"2023-12-19T17:51:41.874046+0000","last_became_active":"2023-12-19T17:51:37.863704+0000","last_became_peered":"2023-12-19T17:51:37.863704+0000","last_unstale":"2023-12-19T17:51:41.874046+0000","last_undegraded":"2023-12-19T17:51:41.874046+0000","last_fullsized":"2023-12-19T17:51:41.874046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862307+0000","last_change":"2023-12-19T17:51:37.367329+0000","last_active":"2023-12-19T17:51:41.862307+0000","last_peered":"2023-12-19T17:51:41.862307+0000","last_clean":"2023-12-19T17:51:41.862307+0000","last_became_active":"2023-12-19T17:51:37.366996+0000","last_became_peered":"2023-12-19T17:51:37.366996+0000","last_unstale":"2023-12-19T17:51:41.862307+0000","last_undegraded":"2023-12-19T17:51:41.862307+0000","last_fullsized":"2023-12-19T17:51:41.862307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909072+0000","last_change":"2023-12-19T17:51:41.907875+0000","last_active":"2023-12-19T17:51:41.909072+0000","last_peered":"2023-12-19T17:51:41.909072+0000","last_clean":"2023-12-19T17:51:41.909072+0000","last_became_active":"2023-12-19T17:51:41.907461+0000","last_became_peered":"2023-12-19T17:51:41.907461+0000","last_unstale":"2023-12-19T17:51:41.909072+0000","last_undegraded":"2023-12-19T17:51:41.909072+0000","last_fullsized":"2023-12-19T17:51:41.909072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863419+0000","last_change":"2023-12-19T17:51:37.863678+0000","last_active":"2023-12-19T17:51:41.863419+0000","last_peered":"2023-12-19T17:51:41.863419+0000","last_clean":"2023-12-19T17:51:41.863419+0000","last_became_active":"2023-12-19T17:51:37.863378+0000","last_became_peered":"2023-12-19T17:51:37.863378+0000","last_unstale":"2023-12-19T17:51:41.863419+0000","last_undegraded":"2023-12-19T17:51:41.863419+0000","last_fullsized":"2023-12-19T17:51:41.863419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:21.936722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873263+0000","last_change":"2023-12-19T17:51:37.359686+0000","last_active":"2023-12-19T17:51:41.873263+0000","last_peered":"2023-12-19T17:51:41.873263+0000","last_clean":"2023-12-19T17:51:41.873263+0000","last_became_active":"2023-12-19T17:51:37.359340+0000","last_became_peered":"2023-12-19T17:51:37.359340+0000","last_unstale":"2023-12-19T17:51:41.873263+0000","last_undegraded":"2023-12-19T17:51:41.873263+0000","last_fullsized":"2023-12-19T17:51:41.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897294+0000","last_change":"2023-12-19T17:51:41.893188+0000","last_active":"2023-12-19T17:51:41.897294+0000","last_peered":"2023-12-19T17:51:41.897294+0000","last_clean":"2023-12-19T17:51:41.897294+0000","last_became_active":"2023-12-19T17:51:41.892695+0000","last_became_peered":"2023-12-19T17:51:41.892695+0000","last_unstale":"2023-12-19T17:51:41.897294+0000","last_undegraded":"2023-12-19T17:51:41.897294+0000","last_fullsized":"2023-12-19T17:51:41.897294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862719+0000","last_change":"2023-12-19T17:51:37.858250+0000","last_active":"2023-12-19T17:51:41.862719+0000","last_peered":"2023-12-19T17:51:41.862719+0000","last_clean":"2023-12-19T17:51:41.862719+0000","last_became_active":"2023-12-19T17:51:37.858002+0000","last_became_peered":"2023-12-19T17:51:37.858002+0000","last_unstale":"2023-12-19T17:51:41.862719+0000","last_undegraded":"2023-12-19T17:51:41.862719+0000","last_fullsized":"2023-12-19T17:51:41.862719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:21.378881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875262+0000","last_change":"2023-12-19T17:51:37.373582+0000","last_active":"2023-12-19T17:51:41.875262+0000","last_peered":"2023-12-19T17:51:41.875262+0000","last_clean":"2023-12-19T17:51:41.875262+0000","last_became_active":"2023-12-19T17:51:37.373152+0000","last_became_peered":"2023-12-19T17:51:37.373152+0000","last_unstale":"2023-12-19T17:51:41.875262+0000","last_undegraded":"2023-12-19T17:51:41.875262+0000","last_fullsized":"2023-12-19T17:51:41.875262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:14.694444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895324+0000","last_change":"2023-12-19T17:51:41.889020+0000","last_active":"2023-12-19T17:51:41.895324+0000","last_peered":"2023-12-19T17:51:41.895324+0000","last_clean":"2023-12-19T17:51:41.895324+0000","last_became_active":"2023-12-19T17:51:41.888202+0000","last_became_peered":"2023-12-19T17:51:41.888202+0000","last_unstale":"2023-12-19T17:51:41.895324+0000","last_undegraded":"2023-12-19T17:51:41.895324+0000","last_fullsized":"2023-12-19T17:51:41.895324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861516+0000","last_change":"2023-12-19T17:51:37.857128+0000","last_active":"2023-12-19T17:51:41.861516+0000","last_peered":"2023-12-19T17:51:41.861516+0000","last_clean":"2023-12-19T17:51:41.861516+0000","last_became_active":"2023-12-19T17:51:37.856862+0000","last_became_peered":"2023-12-19T17:51:37.856862+0000","last_unstale":"2023-12-19T17:51:41.861516+0000","last_undegraded":"2023-12-19T17:51:41.861516+0000","last_fullsized":"2023-12-19T17:51:41.861516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:01.983840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.868593+0000","last_change":"2023-12-19T17:51:37.368123+0000","last_active":"2023-12-19T17:51:41.868593+0000","last_peered":"2023-12-19T17:51:41.868593+0000","last_clean":"2023-12-19T17:51:41.868593+0000","last_became_active":"2023-12-19T17:51:37.367483+0000","last_became_peered":"2023-12-19T17:51:37.367483+0000","last_unstale":"2023-12-19T17:51:41.868593+0000","last_undegraded":"2023-12-19T17:51:41.868593+0000","last_fullsized":"2023-12-19T17:51:41.868593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900476+0000","last_change":"2023-12-19T17:51:41.890990+0000","last_active":"2023-12-19T17:51:41.900476+0000","last_peered":"2023-12-19T17:51:41.900476+0000","last_clean":"2023-12-19T17:51:41.900476+0000","last_became_active":"2023-12-19T17:51:41.890583+0000","last_became_peered":"2023-12-19T17:51:41.890583+0000","last_unstale":"2023-12-19T17:51:41.900476+0000","last_undegraded":"2023-12-19T17:51:41.900476+0000","last_fullsized":"2023-12-19T17:51:41.900476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862572+0000","last_change":"2023-12-19T17:51:37.874651+0000","last_active":"2023-12-19T17:51:41.862572+0000","last_peered":"2023-12-19T17:51:41.862572+0000","last_clean":"2023-12-19T17:51:41.862572+0000","last_became_active":"2023-12-19T17:51:37.874304+0000","last_became_peered":"2023-12-19T17:51:37.874304+0000","last_unstale":"2023-12-19T17:51:41.862572+0000","last_undegraded":"2023-12-19T17:51:41.862572+0000","last_fullsized":"2023-12-19T17:51:41.862572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862903+0000","last_change":"2023-12-19T17:51:37.368087+0000","last_active":"2023-12-19T17:51:41.862903+0000","last_peered":"2023-12-19T17:51:41.862903+0000","last_clean":"2023-12-19T17:51:41.862903+0000","last_became_active":"2023-12-19T17:51:37.367220+0000","last_became_peered":"2023-12-19T17:51:37.367220+0000","last_unstale":"2023-12-19T17:51:41.862903+0000","last_undegraded":"2023-12-19T17:51:41.862903+0000","last_fullsized":"2023-12-19T17:51:41.862903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909749+0000","last_change":"2023-12-19T17:51:41.904872+0000","last_active":"2023-12-19T17:51:41.909749+0000","last_peered":"2023-12-19T17:51:41.909749+0000","last_clean":"2023-12-19T17:51:41.909749+0000","last_became_active":"2023-12-19T17:51:41.904421+0000","last_became_peered":"2023-12-19T17:51:41.904421+0000","last_unstale":"2023-12-19T17:51:41.909749+0000","last_undegraded":"2023-12-19T17:51:41.909749+0000","last_fullsized":"2023-12-19T17:51:41.909749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:00.555281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861789+0000","last_change":"2023-12-19T17:51:37.863792+0000","last_active":"2023-12-19T17:51:41.861789+0000","last_peered":"2023-12-19T17:51:41.861789+0000","last_clean":"2023-12-19T17:51:41.861789+0000","last_became_active":"2023-12-19T17:51:37.863505+0000","last_became_peered":"2023-12-19T17:51:37.863505+0000","last_unstale":"2023-12-19T17:51:41.861789+0000","last_undegraded":"2023-12-19T17:51:41.861789+0000","last_fullsized":"2023-12-19T17:51:41.861789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:19.360251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870449+0000","last_change":"2023-12-19T17:51:37.365092+0000","last_active":"2023-12-19T17:51:41.870449+0000","last_peered":"2023-12-19T17:51:41.870449+0000","last_clean":"2023-12-19T17:51:41.870449+0000","last_became_active":"2023-12-19T17:51:37.361623+0000","last_became_peered":"2023-12-19T17:51:37.361623+0000","last_unstale":"2023-12-19T17:51:41.870449+0000","last_undegraded":"2023-12-19T17:51:41.870449+0000","last_fullsized":"2023-12-19T17:51:41.870449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.910085+0000","last_change":"2023-12-19T17:51:41.908920+0000","last_active":"2023-12-19T17:51:41.910085+0000","last_peered":"2023-12-19T17:51:41.910085+0000","last_clean":"2023-12-19T17:51:41.910085+0000","last_became_active":"2023-12-19T17:51:41.908497+0000","last_became_peered":"2023-12-19T17:51:41.908497+0000","last_unstale":"2023-12-19T17:51:41.910085+0000","last_undegraded":"2023-12-19T17:51:41.910085+0000","last_fullsized":"2023-12-19T17:51:41.910085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:24.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.878208+0000","last_change":"2023-12-19T17:51:37.857702+0000","last_active":"2023-12-19T17:51:41.878208+0000","last_peered":"2023-12-19T17:51:41.878208+0000","last_clean":"2023-12-19T17:51:41.878208+0000","last_became_active":"2023-12-19T17:51:37.857433+0000","last_became_peered":"2023-12-19T17:51:37.857433+0000","last_unstale":"2023-12-19T17:51:41.878208+0000","last_undegraded":"2023-12-19T17:51:41.878208+0000","last_fullsized":"2023-12-19T17:51:41.878208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880946+0000","last_change":"2023-12-19T17:51:37.362716+0000","last_active":"2023-12-19T17:51:41.880946+0000","last_peered":"2023-12-19T17:51:41.880946+0000","last_clean":"2023-12-19T17:51:41.880946+0000","last_became_active":"2023-12-19T17:51:37.361305+0000","last_became_peered":"2023-12-19T17:51:37.361305+0000","last_unstale":"2023-12-19T17:51:41.880946+0000","last_undegraded":"2023-12-19T17:51:41.880946+0000","last_fullsized":"2023-12-19T17:51:41.880946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897388+0000","last_change":"2023-12-19T17:51:41.893227+0000","last_active":"2023-12-19T17:51:41.897388+0000","last_peered":"2023-12-19T17:51:41.897388+0000","last_clean":"2023-12-19T17:51:41.897388+0000","last_became_active":"2023-12-19T17:51:41.892689+0000","last_became_peered":"2023-12-19T17:51:41.892689+0000","last_unstale":"2023-12-19T17:51:41.897388+0000","last_undegraded":"2023-12-19T17:51:41.897388+0000","last_fullsized":"2023-12-19T17:51:41.897388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:14.243432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861900+0000","last_change":"2023-12-19T17:51:37.870206+0000","last_active":"2023-12-19T17:51:41.861900+0000","last_peered":"2023-12-19T17:51:41.861900+0000","last_clean":"2023-12-19T17:51:41.861900+0000","last_became_active":"2023-12-19T17:51:37.869935+0000","last_became_peered":"2023-12-19T17:51:37.869935+0000","last_unstale":"2023-12-19T17:51:41.861900+0000","last_undegraded":"2023-12-19T17:51:41.861900+0000","last_fullsized":"2023-12-19T17:51:41.861900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:36.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:53.261006+0000","last_change":"2023-12-19T17:51:37.375150+0000","last_active":"2023-12-19T17:51:53.261006+0000","last_peered":"2023-12-19T17:51:53.261006+0000","last_clean":"2023-12-19T17:51:53.261006+0000","last_became_active":"2023-12-19T17:51:37.374662+0000","last_became_peered":"2023-12-19T17:51:37.374662+0000","last_unstale":"2023-12-19T17:51:53.261006+0000","last_undegraded":"2023-12-19T17:51:53.261006+0000","last_fullsized":"2023-12-19T17:51:53.261006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897598+0000","last_change":"2023-12-19T17:51:41.884755+0000","last_active":"2023-12-19T17:51:41.897598+0000","last_peered":"2023-12-19T17:51:41.897598+0000","last_clean":"2023-12-19T17:51:41.897598+0000","last_became_active":"2023-12-19T17:51:41.884141+0000","last_became_peered":"2023-12-19T17:51:41.884141+0000","last_unstale":"2023-12-19T17:51:41.897598+0000","last_undegraded":"2023-12-19T17:51:41.897598+0000","last_fullsized":"2023-12-19T17:51:41.897598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871819+0000","last_change":"2023-12-19T17:51:37.871807+0000","last_active":"2023-12-19T17:51:41.871819+0000","last_peered":"2023-12-19T17:51:41.871819+0000","last_clean":"2023-12-19T17:51:41.871819+0000","last_became_active":"2023-12-19T17:51:37.871521+0000","last_became_peered":"2023-12-19T17:51:37.871521+0000","last_unstale":"2023-12-19T17:51:41.871819+0000","last_undegraded":"2023-12-19T17:51:41.871819+0000","last_fullsized":"2023-12-19T17:51:41.871819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862120+0000","last_change":"2023-12-19T17:51:37.363031+0000","last_active":"2023-12-19T17:51:41.862120+0000","last_peered":"2023-12-19T17:51:41.862120+0000","last_clean":"2023-12-19T17:51:41.862120+0000","last_became_active":"2023-12-19T17:51:37.362756+0000","last_became_peered":"2023-12-19T17:51:37.362756+0000","last_unstale":"2023-12-19T17:51:41.862120+0000","last_undegraded":"2023-12-19T17:51:41.862120+0000","last_fullsized":"2023-12-19T17:51:41.862120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.907191+0000","last_change":"2023-12-19T17:51:41.901238+0000","last_active":"2023-12-19T17:51:41.907191+0000","last_peered":"2023-12-19T17:51:41.907191+0000","last_clean":"2023-12-19T17:51:41.907191+0000","last_became_active":"2023-12-19T17:51:41.900651+0000","last_became_peered":"2023-12-19T17:51:41.900651+0000","last_unstale":"2023-12-19T17:51:41.907191+0000","last_undegraded":"2023-12-19T17:51:41.907191+0000","last_fullsized":"2023-12-19T17:51:41.907191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:12:26.894141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883389+0000","last_change":"2023-12-19T17:51:37.859989+0000","last_active":"2023-12-19T17:51:41.883389+0000","last_peered":"2023-12-19T17:51:41.883389+0000","last_clean":"2023-12-19T17:51:41.883389+0000","last_became_active":"2023-12-19T17:51:37.858483+0000","last_became_peered":"2023-12-19T17:51:37.858483+0000","last_unstale":"2023-12-19T17:51:41.883389+0000","last_undegraded":"2023-12-19T17:51:41.883389+0000","last_fullsized":"2023-12-19T17:51:41.883389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880701+0000","last_change":"2023-12-19T17:51:37.370965+0000","last_active":"2023-12-19T17:51:41.880701+0000","last_peered":"2023-12-19T17:51:41.880701+0000","last_clean":"2023-12-19T17:51:41.880701+0000","last_became_active":"2023-12-19T17:51:37.370062+0000","last_became_peered":"2023-12-19T17:51:37.370062+0000","last_unstale":"2023-12-19T17:51:41.880701+0000","last_undegraded":"2023-12-19T17:51:41.880701+0000","last_fullsized":"2023-12-19T17:51:41.880701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904990+0000","last_change":"2023-12-19T17:51:41.901244+0000","last_active":"2023-12-19T17:51:41.904990+0000","last_peered":"2023-12-19T17:51:41.904990+0000","last_clean":"2023-12-19T17:51:41.904990+0000","last_became_active":"2023-12-19T17:51:41.900797+0000","last_became_peered":"2023-12-19T17:51:41.900797+0000","last_unstale":"2023-12-19T17:51:41.904990+0000","last_undegraded":"2023-12-19T17:51:41.904990+0000","last_fullsized":"2023-12-19T17:51:41.904990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:01.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880682+0000","last_change":"2023-12-19T17:51:37.862402+0000","last_active":"2023-12-19T17:51:41.880682+0000","last_peered":"2023-12-19T17:51:41.880682+0000","last_clean":"2023-12-19T17:51:41.880682+0000","last_became_active":"2023-12-19T17:51:37.862122+0000","last_became_peered":"2023-12-19T17:51:37.862122+0000","last_unstale":"2023-12-19T17:51:41.880682+0000","last_undegraded":"2023-12-19T17:51:41.880682+0000","last_fullsized":"2023-12-19T17:51:41.880682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865202+0000","last_change":"2023-12-19T17:51:37.369300+0000","last_active":"2023-12-19T17:51:41.865202+0000","last_peered":"2023-12-19T17:51:41.865202+0000","last_clean":"2023-12-19T17:51:41.865202+0000","last_became_active":"2023-12-19T17:51:37.368149+0000","last_became_peered":"2023-12-19T17:51:37.368149+0000","last_unstale":"2023-12-19T17:51:41.865202+0000","last_undegraded":"2023-12-19T17:51:41.865202+0000","last_fullsized":"2023-12-19T17:51:41.865202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901092+0000","last_change":"2023-12-19T17:51:41.894673+0000","last_active":"2023-12-19T17:51:41.901092+0000","last_peered":"2023-12-19T17:51:41.901092+0000","last_clean":"2023-12-19T17:51:41.901092+0000","last_became_active":"2023-12-19T17:51:41.893704+0000","last_became_peered":"2023-12-19T17:51:41.893704+0000","last_unstale":"2023-12-19T17:51:41.901092+0000","last_undegraded":"2023-12-19T17:51:41.901092+0000","last_fullsized":"2023-12-19T17:51:41.901092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:54.855527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904181+0000","last_change":"2023-12-19T17:51:41.901728+0000","last_active":"2023-12-19T17:51:41.904181+0000","last_peered":"2023-12-19T17:51:41.904181+0000","last_clean":"2023-12-19T17:51:41.904181+0000","last_became_active":"2023-12-19T17:51:41.900986+0000","last_became_peered":"2023-12-19T17:51:41.900986+0000","last_unstale":"2023-12-19T17:51:41.904181+0000","last_undegraded":"2023-12-19T17:51:41.904181+0000","last_fullsized":"2023-12-19T17:51:41.904181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860494+0000","last_change":"2023-12-19T17:51:37.869238+0000","last_active":"2023-12-19T17:51:41.860494+0000","last_peered":"2023-12-19T17:51:41.860494+0000","last_clean":"2023-12-19T17:51:41.860494+0000","last_became_active":"2023-12-19T17:51:37.868781+0000","last_became_peered":"2023-12-19T17:51:37.868781+0000","last_unstale":"2023-12-19T17:51:41.860494+0000","last_undegraded":"2023-12-19T17:51:41.860494+0000","last_fullsized":"2023-12-19T17:51:41.860494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874862+0000","last_change":"2023-12-19T17:51:37.370627+0000","last_active":"2023-12-19T17:51:41.874862+0000","last_peered":"2023-12-19T17:51:41.874862+0000","last_clean":"2023-12-19T17:51:41.874862+0000","last_became_active":"2023-12-19T17:51:37.366660+0000","last_became_peered":"2023-12-19T17:51:37.366660+0000","last_unstale":"2023-12-19T17:51:41.874862+0000","last_undegraded":"2023-12-19T17:51:41.874862+0000","last_fullsized":"2023-12-19T17:51:41.874862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.891084+0000","last_change":"2023-12-19T17:51:41.884759+0000","last_active":"2023-12-19T17:51:41.891084+0000","last_peered":"2023-12-19T17:51:41.891084+0000","last_clean":"2023-12-19T17:51:41.891084+0000","last_became_active":"2023-12-19T17:51:41.884313+0000","last_became_peered":"2023-12-19T17:51:41.884313+0000","last_unstale":"2023-12-19T17:51:41.891084+0000","last_undegraded":"2023-12-19T17:51:41.891084+0000","last_fullsized":"2023-12-19T17:51:41.891084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:41.801043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871597+0000","last_change":"2023-12-19T17:51:37.861948+0000","last_active":"2023-12-19T17:51:41.871597+0000","last_peered":"2023-12-19T17:51:41.871597+0000","last_clean":"2023-12-19T17:51:41.871597+0000","last_became_active":"2023-12-19T17:51:37.860829+0000","last_became_peered":"2023-12-19T17:51:37.860829+0000","last_unstale":"2023-12-19T17:51:41.871597+0000","last_undegraded":"2023-12-19T17:51:41.871597+0000","last_fullsized":"2023-12-19T17:51:41.871597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875499+0000","last_change":"2023-12-19T17:51:37.370607+0000","last_active":"2023-12-19T17:51:41.875499+0000","last_peered":"2023-12-19T17:51:41.875499+0000","last_clean":"2023-12-19T17:51:41.875499+0000","last_became_active":"2023-12-19T17:51:37.370306+0000","last_became_peered":"2023-12-19T17:51:37.370306+0000","last_unstale":"2023-12-19T17:51:41.875499+0000","last_undegraded":"2023-12-19T17:51:41.875499+0000","last_fullsized":"2023-12-19T17:51:41.875499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:54.261197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863959+0000","last_change":"2023-12-19T17:51:37.367794+0000","last_active":"2023-12-19T17:51:41.863959+0000","last_peered":"2023-12-19T17:51:41.863959+0000","last_clean":"2023-12-19T17:51:41.863959+0000","last_became_active":"2023-12-19T17:51:37.367484+0000","last_became_peered":"2023-12-19T17:51:37.367484+0000","last_unstale":"2023-12-19T17:51:41.863959+0000","last_undegraded":"2023-12-19T17:51:41.863959+0000","last_fullsized":"2023-12-19T17:51:41.863959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880861+0000","last_change":"2023-12-19T17:51:37.866914+0000","last_active":"2023-12-19T17:51:41.880861+0000","last_peered":"2023-12-19T17:51:41.880861+0000","last_clean":"2023-12-19T17:51:41.880861+0000","last_became_active":"2023-12-19T17:51:37.860031+0000","last_became_peered":"2023-12-19T17:51:37.860031+0000","last_unstale":"2023-12-19T17:51:41.880861+0000","last_undegraded":"2023-12-19T17:51:41.880861+0000","last_fullsized":"2023-12-19T17:51:41.880861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892712+0000","last_change":"2023-12-19T17:51:41.888154+0000","last_active":"2023-12-19T17:51:41.892712+0000","last_peered":"2023-12-19T17:51:41.892712+0000","last_clean":"2023-12-19T17:51:41.892712+0000","last_became_active":"2023-12-19T17:51:41.887685+0000","last_became_peered":"2023-12-19T17:51:41.887685+0000","last_unstale":"2023-12-19T17:51:41.892712+0000","last_undegraded":"2023-12-19T17:51:41.892712+0000","last_fullsized":"2023-12-19T17:51:41.892712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:49.694949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874462+0000","last_change":"2023-12-19T17:51:37.373607+0000","last_active":"2023-12-19T17:51:41.874462+0000","last_peered":"2023-12-19T17:51:41.874462+0000","last_clean":"2023-12-19T17:51:41.874462+0000","last_became_active":"2023-12-19T17:51:37.373028+0000","last_became_peered":"2023-12-19T17:51:37.373028+0000","last_unstale":"2023-12-19T17:51:41.874462+0000","last_undegraded":"2023-12-19T17:51:41.874462+0000","last_fullsized":"2023-12-19T17:51:41.874462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:29.861362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872203+0000","last_change":"2023-12-19T17:51:37.853456+0000","last_active":"2023-12-19T17:51:41.872203+0000","last_peered":"2023-12-19T17:51:41.872203+0000","last_clean":"2023-12-19T17:51:41.872203+0000","last_became_active":"2023-12-19T17:51:37.853073+0000","last_became_peered":"2023-12-19T17:51:37.853073+0000","last_unstale":"2023-12-19T17:51:41.872203+0000","last_undegraded":"2023-12-19T17:51:41.872203+0000","last_fullsized":"2023-12-19T17:51:41.872203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:56.244495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904914+0000","last_change":"2023-12-19T17:51:41.903216+0000","last_active":"2023-12-19T17:51:41.904914+0000","last_peered":"2023-12-19T17:51:41.904914+0000","last_clean":"2023-12-19T17:51:41.904914+0000","last_became_active":"2023-12-19T17:51:41.902823+0000","last_became_peered":"2023-12-19T17:51:41.902823+0000","last_unstale":"2023-12-19T17:51:41.904914+0000","last_undegraded":"2023-12-19T17:51:41.904914+0000","last_fullsized":"2023-12-19T17:51:41.904914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:32.887544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862464+0000","last_change":"2023-12-19T17:51:37.874316+0000","last_active":"2023-12-19T17:51:41.862464+0000","last_peered":"2023-12-19T17:51:41.862464+0000","last_clean":"2023-12-19T17:51:41.862464+0000","last_became_active":"2023-12-19T17:51:37.873086+0000","last_became_peered":"2023-12-19T17:51:37.873086+0000","last_unstale":"2023-12-19T17:51:41.862464+0000","last_undegraded":"2023-12-19T17:51:41.862464+0000","last_fullsized":"2023-12-19T17:51:41.862464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870124+0000","last_change":"2023-12-19T17:51:37.850435+0000","last_active":"2023-12-19T17:51:41.870124+0000","last_peered":"2023-12-19T17:51:41.870124+0000","last_clean":"2023-12-19T17:51:41.870124+0000","last_became_active":"2023-12-19T17:51:37.849426+0000","last_became_peered":"2023-12-19T17:51:37.849426+0000","last_unstale":"2023-12-19T17:51:41.870124+0000","last_undegraded":"2023-12-19T17:51:41.870124+0000","last_fullsized":"2023-12-19T17:51:41.870124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870410+0000","last_change":"2023-12-19T17:51:37.878151+0000","last_active":"2023-12-19T17:51:41.870410+0000","last_peered":"2023-12-19T17:51:41.870410+0000","last_clean":"2023-12-19T17:51:41.870410+0000","last_became_active":"2023-12-19T17:51:37.877950+0000","last_became_peered":"2023-12-19T17:51:37.877950+0000","last_unstale":"2023-12-19T17:51:41.870410+0000","last_undegraded":"2023-12-19T17:51:41.870410+0000","last_fullsized":"2023-12-19T17:51:41.870410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880786+0000","last_change":"2023-12-19T17:51:37.873480+0000","last_active":"2023-12-19T17:51:41.880786+0000","last_peered":"2023-12-19T17:51:41.880786+0000","last_clean":"2023-12-19T17:51:41.880786+0000","last_became_active":"2023-12-19T17:51:37.873217+0000","last_became_peered":"2023-12-19T17:51:37.873217+0000","last_unstale":"2023-12-19T17:51:41.880786+0000","last_undegraded":"2023-12-19T17:51:41.880786+0000","last_fullsized":"2023-12-19T17:51:41.880786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877566+0000","last_change":"2023-12-19T17:51:37.862909+0000","last_active":"2023-12-19T17:51:41.877566+0000","last_peered":"2023-12-19T17:51:41.877566+0000","last_clean":"2023-12-19T17:51:41.877566+0000","last_became_active":"2023-12-19T17:51:37.862582+0000","last_became_peered":"2023-12-19T17:51:37.862582+0000","last_unstale":"2023-12-19T17:51:41.877566+0000","last_undegraded":"2023-12-19T17:51:41.877566+0000","last_fullsized":"2023-12-19T17:51:41.877566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861447+0000","last_change":"2023-12-19T17:51:37.864245+0000","last_active":"2023-12-19T17:51:41.861447+0000","last_peered":"2023-12-19T17:51:41.861447+0000","last_clean":"2023-12-19T17:51:41.861447+0000","last_became_active":"2023-12-19T17:51:37.863824+0000","last_became_peered":"2023-12-19T17:51:37.863824+0000","last_unstale":"2023-12-19T17:51:41.861447+0000","last_undegraded":"2023-12-19T17:51:41.861447+0000","last_fullsized":"2023-12-19T17:51:41.861447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862736+0000","last_change":"2023-12-19T17:51:37.878924+0000","last_active":"2023-12-19T17:51:41.862736+0000","last_peered":"2023-12-19T17:51:41.862736+0000","last_clean":"2023-12-19T17:51:41.862736+0000","last_became_active":"2023-12-19T17:51:37.875497+0000","last_became_peered":"2023-12-19T17:51:37.875497+0000","last_unstale":"2023-12-19T17:51:41.862736+0000","last_undegraded":"2023-12-19T17:51:41.862736+0000","last_fullsized":"2023-12-19T17:51:41.862736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881391+0000","last_change":"2023-12-19T17:51:37.863018+0000","last_active":"2023-12-19T17:51:41.881391+0000","last_peered":"2023-12-19T17:51:41.881391+0000","last_clean":"2023-12-19T17:51:41.881391+0000","last_became_active":"2023-12-19T17:51:37.862800+0000","last_became_peered":"2023-12-19T17:51:37.862800+0000","last_unstale":"2023-12-19T17:51:41.881391+0000","last_undegraded":"2023-12-19T17:51:41.881391+0000","last_fullsized":"2023-12-19T17:51:41.881391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874580+0000","last_change":"2023-12-19T17:51:37.864066+0000","last_active":"2023-12-19T17:51:41.874580+0000","last_peered":"2023-12-19T17:51:41.874580+0000","last_clean":"2023-12-19T17:51:41.874580+0000","last_became_active":"2023-12-19T17:51:37.863848+0000","last_became_peered":"2023-12-19T17:51:37.863848+0000","last_unstale":"2023-12-19T17:51:41.874580+0000","last_undegraded":"2023-12-19T17:51:41.874580+0000","last_fullsized":"2023-12-19T17:51:41.874580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875414+0000","last_change":"2023-12-19T17:51:37.877889+0000","last_active":"2023-12-19T17:51:41.875414+0000","last_peered":"2023-12-19T17:51:41.875414+0000","last_clean":"2023-12-19T17:51:41.875414+0000","last_became_active":"2023-12-19T17:51:37.877109+0000","last_became_peered":"2023-12-19T17:51:37.877109+0000","last_unstale":"2023-12-19T17:51:41.875414+0000","last_undegraded":"2023-12-19T17:51:41.875414+0000","last_fullsized":"2023-12-19T17:51:41.875414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870359+0000","last_change":"2023-12-19T17:51:37.857037+0000","last_active":"2023-12-19T17:51:41.870359+0000","last_peered":"2023-12-19T17:51:41.870359+0000","last_clean":"2023-12-19T17:51:41.870359+0000","last_became_active":"2023-12-19T17:51:37.856790+0000","last_became_peered":"2023-12-19T17:51:37.856790+0000","last_unstale":"2023-12-19T17:51:41.870359+0000","last_undegraded":"2023-12-19T17:51:41.870359+0000","last_fullsized":"2023-12-19T17:51:41.870359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880706+0000","last_change":"2023-12-19T17:51:37.857822+0000","last_active":"2023-12-19T17:51:41.880706+0000","last_peered":"2023-12-19T17:51:41.880706+0000","last_clean":"2023-12-19T17:51:41.880706+0000","last_became_active":"2023-12-19T17:51:37.855549+0000","last_became_peered":"2023-12-19T17:51:37.855549+0000","last_unstale":"2023-12-19T17:51:41.880706+0000","last_undegraded":"2023-12-19T17:51:41.880706+0000","last_fullsized":"2023-12-19T17:51:41.880706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.864155+0000","last_change":"2023-12-19T17:51:37.860504+0000","last_active":"2023-12-19T17:51:41.864155+0000","last_peered":"2023-12-19T17:51:41.864155+0000","last_clean":"2023-12-19T17:51:41.864155+0000","last_became_active":"2023-12-19T17:51:37.860153+0000","last_became_peered":"2023-12-19T17:51:37.860153+0000","last_unstale":"2023-12-19T17:51:41.864155+0000","last_undegraded":"2023-12-19T17:51:41.864155+0000","last_fullsized":"2023-12-19T17:51:41.864155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863155+0000","last_change":"2023-12-19T17:51:37.861734+0000","last_active":"2023-12-19T17:51:41.863155+0000","last_peered":"2023-12-19T17:51:41.863155+0000","last_clean":"2023-12-19T17:51:41.863155+0000","last_became_active":"2023-12-19T17:51:37.855703+0000","last_became_peered":"2023-12-19T17:51:37.855703+0000","last_unstale":"2023-12-19T17:51:41.863155+0000","last_undegraded":"2023-12-19T17:51:41.863155+0000","last_fullsized":"2023-12-19T17:51:41.863155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873169+0000","last_change":"2023-12-19T17:51:37.860944+0000","last_active":"2023-12-19T17:51:41.873169+0000","last_peered":"2023-12-19T17:51:41.873169+0000","last_clean":"2023-12-19T17:51:41.873169+0000","last_became_active":"2023-12-19T17:51:37.860435+0000","last_became_peered":"2023-12-19T17:51:37.860435+0000","last_unstale":"2023-12-19T17:51:41.873169+0000","last_undegraded":"2023-12-19T17:51:41.873169+0000","last_fullsized":"2023-12-19T17:51:41.873169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:26.638861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875676+0000","last_change":"2023-12-19T17:51:37.871267+0000","last_active":"2023-12-19T17:51:41.875676+0000","last_peered":"2023-12-19T17:51:41.875676+0000","last_clean":"2023-12-19T17:51:41.875676+0000","last_became_active":"2023-12-19T17:51:37.871093+0000","last_became_peered":"2023-12-19T17:51:37.871093+0000","last_unstale":"2023-12-19T17:51:41.875676+0000","last_undegraded":"2023-12-19T17:51:41.875676+0000","last_fullsized":"2023-12-19T17:51:41.875676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874498+0000","last_change":"2023-12-19T17:51:37.859001+0000","last_active":"2023-12-19T17:51:41.874498+0000","last_peered":"2023-12-19T17:51:41.874498+0000","last_clean":"2023-12-19T17:51:41.874498+0000","last_became_active":"2023-12-19T17:51:37.858756+0000","last_became_peered":"2023-12-19T17:51:37.858756+0000","last_unstale":"2023-12-19T17:51:41.874498+0000","last_undegraded":"2023-12-19T17:51:41.874498+0000","last_fullsized":"2023-12-19T17:51:41.874498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860552+0000","last_change":"2023-12-19T17:51:37.869034+0000","last_active":"2023-12-19T17:51:41.860552+0000","last_peered":"2023-12-19T17:51:41.860552+0000","last_clean":"2023-12-19T17:51:41.860552+0000","last_became_active":"2023-12-19T17:51:37.868411+0000","last_became_peered":"2023-12-19T17:51:37.868411+0000","last_unstale":"2023-12-19T17:51:41.860552+0000","last_undegraded":"2023-12-19T17:51:41.860552+0000","last_fullsized":"2023-12-19T17:51:41.860552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877952+0000","last_change":"2023-12-19T17:51:37.851059+0000","last_active":"2023-12-19T17:51:41.877952+0000","last_peered":"2023-12-19T17:51:41.877952+0000","last_clean":"2023-12-19T17:51:41.877952+0000","last_became_active":"2023-12-19T17:51:37.850723+0000","last_became_peered":"2023-12-19T17:51:37.850723+0000","last_unstale":"2023-12-19T17:51:41.877952+0000","last_undegraded":"2023-12-19T17:51:41.877952+0000","last_fullsized":"2023-12-19T17:51:41.877952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874288+0000","last_change":"2023-12-19T17:51:37.866674+0000","last_active":"2023-12-19T17:51:41.874288+0000","last_peered":"2023-12-19T17:51:41.874288+0000","last_clean":"2023-12-19T17:51:41.874288+0000","last_became_active":"2023-12-19T17:51:37.865470+0000","last_became_peered":"2023-12-19T17:51:37.865470+0000","last_unstale":"2023-12-19T17:51:41.874288+0000","last_undegraded":"2023-12-19T17:51:41.874288+0000","last_fullsized":"2023-12-19T17:51:41.874288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871739+0000","last_change":"2023-12-19T17:51:37.875330+0000","last_active":"2023-12-19T17:51:41.871739+0000","last_peered":"2023-12-19T17:51:41.871739+0000","last_clean":"2023-12-19T17:51:41.871739+0000","last_became_active":"2023-12-19T17:51:37.874974+0000","last_became_peered":"2023-12-19T17:51:37.874974+0000","last_unstale":"2023-12-19T17:51:41.871739+0000","last_undegraded":"2023-12-19T17:51:41.871739+0000","last_fullsized":"2023-12-19T17:51:41.871739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:42.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865979+0000","last_change":"2023-12-19T17:51:37.875506+0000","last_active":"2023-12-19T17:51:41.865979+0000","last_peered":"2023-12-19T17:51:41.865979+0000","last_clean":"2023-12-19T17:51:41.865979+0000","last_became_active":"2023-12-19T17:51:37.875016+0000","last_became_peered":"2023-12-19T17:51:37.875016+0000","last_unstale":"2023-12-19T17:51:41.865979+0000","last_undegraded":"2023-12-19T17:51:41.865979+0000","last_fullsized":"2023-12-19T17:51:41.865979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862619+0000","last_change":"2023-12-19T17:51:37.878903+0000","last_active":"2023-12-19T17:51:41.862619+0000","last_peered":"2023-12-19T17:51:41.862619+0000","last_clean":"2023-12-19T17:51:41.862619+0000","last_became_active":"2023-12-19T17:51:37.874964+0000","last_became_peered":"2023-12-19T17:51:37.874964+0000","last_unstale":"2023-12-19T17:51:41.862619+0000","last_undegraded":"2023-12-19T17:51:41.862619+0000","last_fullsized":"2023-12-19T17:51:41.862619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863340+0000","last_change":"2023-12-19T17:51:37.858908+0000","last_active":"2023-12-19T17:51:41.863340+0000","last_peered":"2023-12-19T17:51:41.863340+0000","last_clean":"2023-12-19T17:51:41.863340+0000","last_became_active":"2023-12-19T17:51:37.858336+0000","last_became_peered":"2023-12-19T17:51:37.858336+0000","last_unstale":"2023-12-19T17:51:41.863340+0000","last_undegraded":"2023-12-19T17:51:41.863340+0000","last_fullsized":"2023-12-19T17:51:41.863340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871491+0000","last_change":"2023-12-19T17:51:37.862607+0000","last_active":"2023-12-19T17:51:41.871491+0000","last_peered":"2023-12-19T17:51:41.871491+0000","last_clean":"2023-12-19T17:51:41.871491+0000","last_became_active":"2023-12-19T17:51:37.862159+0000","last_became_peered":"2023-12-19T17:51:37.862159+0000","last_unstale":"2023-12-19T17:51:41.871491+0000","last_undegraded":"2023-12-19T17:51:41.871491+0000","last_fullsized":"2023-12-19T17:51:41.871491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861454+0000","last_change":"2023-12-19T17:51:37.848444+0000","last_active":"2023-12-19T17:51:41.861454+0000","last_peered":"2023-12-19T17:51:41.861454+0000","last_clean":"2023-12-19T17:51:41.861454+0000","last_became_active":"2023-12-19T17:51:37.848141+0000","last_became_peered":"2023-12-19T17:51:37.848141+0000","last_unstale":"2023-12-19T17:51:41.861454+0000","last_undegraded":"2023-12-19T17:51:41.861454+0000","last_fullsized":"2023-12-19T17:51:41.861454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870323+0000","last_change":"2023-12-19T17:51:37.859778+0000","last_active":"2023-12-19T17:51:41.870323+0000","last_peered":"2023-12-19T17:51:41.870323+0000","last_clean":"2023-12-19T17:51:41.870323+0000","last_became_active":"2023-12-19T17:51:37.859521+0000","last_became_peered":"2023-12-19T17:51:37.859521+0000","last_unstale":"2023-12-19T17:51:41.870323+0000","last_undegraded":"2023-12-19T17:51:41.870323+0000","last_fullsized":"2023-12-19T17:51:41.870323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861746+0000","last_change":"2023-12-19T17:51:37.848789+0000","last_active":"2023-12-19T17:51:41.861746+0000","last_peered":"2023-12-19T17:51:41.861746+0000","last_clean":"2023-12-19T17:51:41.861746+0000","last_became_active":"2023-12-19T17:51:37.848533+0000","last_became_peered":"2023-12-19T17:51:37.848533+0000","last_unstale":"2023-12-19T17:51:41.861746+0000","last_undegraded":"2023-12-19T17:51:41.861746+0000","last_fullsized":"2023-12-19T17:51:41.861746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873893+0000","last_change":"2023-12-19T17:51:37.878808+0000","last_active":"2023-12-19T17:51:41.873893+0000","last_peered":"2023-12-19T17:51:41.873893+0000","last_clean":"2023-12-19T17:51:41.873893+0000","last_became_active":"2023-12-19T17:51:37.878550+0000","last_became_peered":"2023-12-19T17:51:37.878550+0000","last_unstale":"2023-12-19T17:51:41.873893+0000","last_undegraded":"2023-12-19T17:51:41.873893+0000","last_fullsized":"2023-12-19T17:51:41.873893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880534+0000","last_change":"2023-12-19T17:51:37.842584+0000","last_active":"2023-12-19T17:51:41.880534+0000","last_peered":"2023-12-19T17:51:41.880534+0000","last_clean":"2023-12-19T17:51:41.880534+0000","last_became_active":"2023-12-19T17:51:37.842230+0000","last_became_peered":"2023-12-19T17:51:37.842230+0000","last_unstale":"2023-12-19T17:51:41.880534+0000","last_undegraded":"2023-12-19T17:51:41.880534+0000","last_fullsized":"2023-12-19T17:51:41.880534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861715+0000","last_change":"2023-12-19T17:51:37.866251+0000","last_active":"2023-12-19T17:51:41.861715+0000","last_peered":"2023-12-19T17:51:41.861715+0000","last_clean":"2023-12-19T17:51:41.861715+0000","last_became_active":"2023-12-19T17:51:37.865954+0000","last_became_peered":"2023-12-19T17:51:37.865954+0000","last_unstale":"2023-12-19T17:51:41.861715+0000","last_undegraded":"2023-12-19T17:51:41.861715+0000","last_fullsized":"2023-12-19T17:51:41.861715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863303+0000","last_change":"2023-12-19T17:51:37.869240+0000","last_active":"2023-12-19T17:51:41.863303+0000","last_peered":"2023-12-19T17:51:41.863303+0000","last_clean":"2023-12-19T17:51:41.863303+0000","last_became_active":"2023-12-19T17:51:37.868451+0000","last_became_peered":"2023-12-19T17:51:37.868451+0000","last_unstale":"2023-12-19T17:51:41.863303+0000","last_undegraded":"2023-12-19T17:51:41.863303+0000","last_fullsized":"2023-12-19T17:51:41.863303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4420000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4610000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:52:07.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:52:07.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.330+0000 7f847625d700 1 Processor -- start 2023-12-19T17:52:07.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.330+0000 7f847625d700 1 -- start start 2023-12-19T17:52:07.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f847625d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84701611c0 0x7f84700c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f847625d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 0x7f847006d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f847625d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f847006dc80 con 0x7f84700af720 2023-12-19T17:52:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f847625d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8470070340 con 0x7f84701611c0 2023-12-19T17:52:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f847625d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84700c3f90 con 0x7f84701615a0 2023-12-19T17:52:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 0x7f847006d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 0x7f847006d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55182/0 (socket says 172.21.15.45:55182) 2023-12-19T17:52:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 -- 172.21.15.45:0/2265490029 learned_addr learned my addr 172.21.15.45:0/2265490029 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f847525b700 1 --2- 172.21.15.45:0/2265490029 >> v2:172.21.15.73:3300/0 conn(0x7f84701611c0 0x7f84700c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 -- 172.21.15.45:0/2265490029 >> v2:172.21.15.73:3300/0 conn(0x7f84701611c0 msgr2=0x7f84700c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 --2- 172.21.15.45:0/2265490029 >> v2:172.21.15.73:3300/0 conn(0x7f84701611c0 0x7f84700c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 -- 172.21.15.45:0/2265490029 >> v1:172.21.15.73:6789/0 conn(0x7f84700af720 legacy=0x7f8470164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8474a5a700 1 -- 172.21.15.45:0/2265490029 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84700c4270 con 0x7f84701615a0 2023-12-19T17:52:07.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.334+0000 7f8467fff700 1 -- 172.21.15.45:0/2265490029 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1005586080 0 0) 0x7f847006dc80 con 0x7f84700af720 2023-12-19T17:52:07.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f8474a5a700 1 --2- 172.21.15.45:0/2265490029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 0x7f847006d740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8460009910 tx=0x7f8460009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b641efac6ccda4f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:07.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f8467fff700 1 -- 172.21.15.45:0/2265490029 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011830 con 0x7f84701615a0 2023-12-19T17:52:07.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f8467fff700 1 -- 172.21.15.45:0/2265490029 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8460011990 con 0x7f84701615a0 2023-12-19T17:52:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f8467fff700 1 -- 172.21.15.45:0/2265490029 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8460011d40 con 0x7f84701615a0 2023-12-19T17:52:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 -- 172.21.15.45:0/2265490029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 msgr2=0x7f847006d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 --2- 172.21.15.45:0/2265490029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 0x7f847006d740 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8460009910 tx=0x7f8460009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 -- 172.21.15.45:0/2265490029 shutdown_connections 2023-12-19T17:52:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 --2- 172.21.15.45:0/2265490029 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701615a0 0x7f847006d740 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 --2- 172.21.15.45:0/2265490029 >> v2:172.21.15.73:3300/0 conn(0x7f84701611c0 0x7f84700c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 -- 172.21.15.45:0/2265490029 >> 172.21.15.45:0/2265490029 conn(0x7f84700cb900 msgr2=0x7f84700b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 -- 172.21.15.45:0/2265490029 shutdown_connections 2023-12-19T17:52:07.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.338+0000 7f847625d700 1 -- 172.21.15.45:0/2265490029 wait complete. 2023-12-19T17:52:07.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 Processor -- start 2023-12-19T17:52:07.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 -- start start 2023-12-19T17:52:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 0x7f8470150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701611c0 0x7f84701eb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84701615a0 0x7f84701eb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470151270 con 0x7f84700af720 2023-12-19T17:52:07.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8470161d20 con 0x7f84701615a0 2023-12-19T17:52:07.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847625d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84701ebc70 con 0x7f84701611c0 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847525b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 0x7f8470150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847525b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 0x7f8470150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38180/0 (socket says 172.21.15.45:38180) 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847525b700 1 -- 172.21.15.45:0/4204988468 learned_addr learned my addr 172.21.15.45:0/4204988468 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f8475a5c700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84701615a0 0x7f84701eb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f8474a5a700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701611c0 0x7f84701eb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847525b700 1 -- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701611c0 msgr2=0x7f84701eb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.342+0000 7f847525b700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701611c0 0x7f84701eb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847525b700 1 -- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84701615a0 msgr2=0x7f84701eb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847525b700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84701615a0 0x7f84701eb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847525b700 1 -- 172.21.15.45:0/4204988468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8460009570 con 0x7f84700af720 2023-12-19T17:52:07.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847525b700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 0x7f8470150d30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f846c00e9d0 tx=0x7f846c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:07.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c009720 con 0x7f84700af720 2023-12-19T17:52:07.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f846c00c850 con 0x7f84700af720 2023-12-19T17:52:07.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84701e9be0 con 0x7f84700af720 2023-12-19T17:52:07.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f846c00cbc0 con 0x7f84700af720 2023-12-19T17:52:07.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84701ea1a0 con 0x7f84700af720 2023-12-19T17:52:07.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.346+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f847006e760 con 0x7f84700af720 2023-12-19T17:52:07.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.350+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f846c00cd20 con 0x7f84700af720 2023-12-19T17:52:07.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.350+0000 7f8465ffb700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8454065ad0 0x7f8454067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.354+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f846c083630 con 0x7f84700af720 2023-12-19T17:52:07.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.354+0000 7f8474a5a700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8454065ad0 0x7f8454067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.354+0000 7f8474a5a700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8454065ad0 0x7f8454067f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8460014040 tx=0x7f8460008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:07.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.358+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f846c050c60 con 0x7f84700af720 2023-12-19T17:52:07.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.526+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f847006eb30 con 0x7f8454065ad0 2023-12-19T17:52:07.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.538+0000 7f8465ffb700 1 -- 172.21.15.45:0/4204988468 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345106 (secure 0 0 0) 0x7f8460011b80 con 0x7f8454065ad0 2023-12-19T17:52:07.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8454065ad0 msgr2=0x7f8454067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8454065ad0 0x7f8454067f90 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8460014040 tx=0x7f8460008030 comp rx=0 tx=0).stop 2023-12-19T17:52:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 msgr2=0x7f8470150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 0x7f8470150d30 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f846c00e9d0 tx=0x7f846c00ed90 comp rx=0 tx=0).stop 2023-12-19T17:52:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 shutdown_connections 2023-12-19T17:52:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8454065ad0 0x7f8454067f90 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84701615a0 0x7f84701eb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84701611c0 0x7f84701eb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 --2- 172.21.15.45:0/4204988468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84700af720 0x7f8470150d30 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 >> 172.21.15.45:0/4204988468 conn(0x7f84700cb900 msgr2=0x7f847006f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 shutdown_connections 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.546+0000 7f847625d700 1 -- 172.21.15.45:0/4204988468 wait complete. 2023-12-19T17:52:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:52:07.570 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2023-12-19T17:52:06.202838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594961,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":222916,"kb_used_data":3204,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754751804,"statfs":{"total":773094113280,"available":772865847296,"internally_reserved":0,"allocated":3280896,"data_stored":1987143,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005771"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883478+0000","last_change":"2023-12-19T17:51:37.371560+0000","last_active":"2023-12-19T17:51:41.883478+0000","last_peered":"2023-12-19T17:51:41.883478+0000","last_clean":"2023-12-19T17:51:41.883478+0000","last_became_active":"2023-12-19T17:51:37.368980+0000","last_became_peered":"2023-12-19T17:51:37.368980+0000","last_unstale":"2023-12-19T17:51:41.883478+0000","last_undegraded":"2023-12-19T17:51:41.883478+0000","last_fullsized":"2023-12-19T17:51:41.883478+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881409+0000","last_change":"2023-12-19T17:51:37.863698+0000","last_active":"2023-12-19T17:51:41.881409+0000","last_peered":"2023-12-19T17:51:41.881409+0000","last_clean":"2023-12-19T17:51:41.881409+0000","last_became_active":"2023-12-19T17:51:37.863369+0000","last_became_peered":"2023-12-19T17:51:37.863369+0000","last_unstale":"2023-12-19T17:51:41.881409+0000","last_undegraded":"2023-12-19T17:51:41.881409+0000","last_fullsized":"2023-12-19T17:51:41.881409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901112+0000","last_change":"2023-12-19T17:51:41.894945+0000","last_active":"2023-12-19T17:51:41.901112+0000","last_peered":"2023-12-19T17:51:41.901112+0000","last_clean":"2023-12-19T17:51:41.901112+0000","last_became_active":"2023-12-19T17:51:41.894291+0000","last_became_peered":"2023-12-19T17:51:41.894291+0000","last_unstale":"2023-12-19T17:51:41.901112+0000","last_undegraded":"2023-12-19T17:51:41.901112+0000","last_fullsized":"2023-12-19T17:51:41.901112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881515+0000","last_change":"2023-12-19T17:51:37.371310+0000","last_active":"2023-12-19T17:51:41.881515+0000","last_peered":"2023-12-19T17:51:41.881515+0000","last_clean":"2023-12-19T17:51:41.881515+0000","last_became_active":"2023-12-19T17:51:37.370946+0000","last_became_peered":"2023-12-19T17:51:37.370946+0000","last_unstale":"2023-12-19T17:51:41.881515+0000","last_undegraded":"2023-12-19T17:51:41.881515+0000","last_fullsized":"2023-12-19T17:51:41.881515+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881893+0000","last_change":"2023-12-19T17:51:37.859332+0000","last_active":"2023-12-19T17:51:41.881893+0000","last_peered":"2023-12-19T17:51:41.881893+0000","last_clean":"2023-12-19T17:51:41.881893+0000","last_became_active":"2023-12-19T17:51:37.858295+0000","last_became_peered":"2023-12-19T17:51:37.858295+0000","last_unstale":"2023-12-19T17:51:41.881893+0000","last_undegraded":"2023-12-19T17:51:41.881893+0000","last_fullsized":"2023-12-19T17:51:41.881893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904185+0000","last_change":"2023-12-19T17:51:41.894941+0000","last_active":"2023-12-19T17:51:41.904185+0000","last_peered":"2023-12-19T17:51:41.904185+0000","last_clean":"2023-12-19T17:51:41.904185+0000","last_became_active":"2023-12-19T17:51:41.894354+0000","last_became_peered":"2023-12-19T17:51:41.894354+0000","last_unstale":"2023-12-19T17:51:41.904185+0000","last_undegraded":"2023-12-19T17:51:41.904185+0000","last_fullsized":"2023-12-19T17:51:41.904185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:24.899374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863045+0000","last_change":"2023-12-19T17:51:37.373590+0000","last_active":"2023-12-19T17:51:41.863045+0000","last_peered":"2023-12-19T17:51:41.863045+0000","last_clean":"2023-12-19T17:51:41.863045+0000","last_became_active":"2023-12-19T17:51:37.372932+0000","last_became_peered":"2023-12-19T17:51:37.372932+0000","last_unstale":"2023-12-19T17:51:41.863045+0000","last_undegraded":"2023-12-19T17:51:41.863045+0000","last_fullsized":"2023-12-19T17:51:41.863045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:41.180593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873974+0000","last_change":"2023-12-19T17:51:37.854515+0000","last_active":"2023-12-19T17:51:41.873974+0000","last_peered":"2023-12-19T17:51:41.873974+0000","last_clean":"2023-12-19T17:51:41.873974+0000","last_became_active":"2023-12-19T17:51:37.852250+0000","last_became_peered":"2023-12-19T17:51:37.852250+0000","last_unstale":"2023-12-19T17:51:41.873974+0000","last_undegraded":"2023-12-19T17:51:41.873974+0000","last_fullsized":"2023-12-19T17:51:41.873974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.913316+0000","last_change":"2023-12-19T17:51:41.912325+0000","last_active":"2023-12-19T17:51:41.913316+0000","last_peered":"2023-12-19T17:51:41.913316+0000","last_clean":"2023-12-19T17:51:41.913316+0000","last_became_active":"2023-12-19T17:51:41.907565+0000","last_became_peered":"2023-12-19T17:51:41.907565+0000","last_unstale":"2023-12-19T17:51:41.913316+0000","last_undegraded":"2023-12-19T17:51:41.913316+0000","last_fullsized":"2023-12-19T17:51:41.913316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863667+0000","last_change":"2023-12-19T17:51:37.375079+0000","last_active":"2023-12-19T17:51:41.863667+0000","last_peered":"2023-12-19T17:51:41.863667+0000","last_clean":"2023-12-19T17:51:41.863667+0000","last_became_active":"2023-12-19T17:51:37.373363+0000","last_became_peered":"2023-12-19T17:51:37.373363+0000","last_unstale":"2023-12-19T17:51:41.863667+0000","last_undegraded":"2023-12-19T17:51:41.863667+0000","last_fullsized":"2023-12-19T17:51:41.863667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:05.345443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874581+0000","last_change":"2023-12-19T17:51:37.854134+0000","last_active":"2023-12-19T17:51:41.874581+0000","last_peered":"2023-12-19T17:51:41.874581+0000","last_clean":"2023-12-19T17:51:41.874581+0000","last_became_active":"2023-12-19T17:51:37.852585+0000","last_became_peered":"2023-12-19T17:51:37.852585+0000","last_unstale":"2023-12-19T17:51:41.874581+0000","last_undegraded":"2023-12-19T17:51:41.874581+0000","last_fullsized":"2023-12-19T17:51:41.874581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892187+0000","last_change":"2023-12-19T17:51:41.886590+0000","last_active":"2023-12-19T17:51:41.892187+0000","last_peered":"2023-12-19T17:51:41.892187+0000","last_clean":"2023-12-19T17:51:41.892187+0000","last_became_active":"2023-12-19T17:51:41.885064+0000","last_became_peered":"2023-12-19T17:51:41.885064+0000","last_unstale":"2023-12-19T17:51:41.892187+0000","last_undegraded":"2023-12-19T17:51:41.892187+0000","last_fullsized":"2023-12-19T17:51:41.892187+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:31:06.290013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863854+0000","last_change":"2023-12-19T17:51:37.860517+0000","last_active":"2023-12-19T17:51:41.863854+0000","last_peered":"2023-12-19T17:51:41.863854+0000","last_clean":"2023-12-19T17:51:41.863854+0000","last_became_active":"2023-12-19T17:51:37.860222+0000","last_became_peered":"2023-12-19T17:51:37.860222+0000","last_unstale":"2023-12-19T17:51:41.863854+0000","last_undegraded":"2023-12-19T17:51:41.863854+0000","last_fullsized":"2023-12-19T17:51:41.863854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861865+0000","last_change":"2023-12-19T17:51:37.374087+0000","last_active":"2023-12-19T17:51:41.861865+0000","last_peered":"2023-12-19T17:51:41.861865+0000","last_clean":"2023-12-19T17:51:41.861865+0000","last_became_active":"2023-12-19T17:51:37.373661+0000","last_became_peered":"2023-12-19T17:51:37.373661+0000","last_unstale":"2023-12-19T17:51:41.861865+0000","last_undegraded":"2023-12-19T17:51:41.861865+0000","last_fullsized":"2023-12-19T17:51:41.861865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:25.625813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892353+0000","last_change":"2023-12-19T17:51:41.885394+0000","last_active":"2023-12-19T17:51:41.892353+0000","last_peered":"2023-12-19T17:51:41.892353+0000","last_clean":"2023-12-19T17:51:41.892353+0000","last_became_active":"2023-12-19T17:51:41.884923+0000","last_became_peered":"2023-12-19T17:51:41.884923+0000","last_unstale":"2023-12-19T17:51:41.892353+0000","last_undegraded":"2023-12-19T17:51:41.892353+0000","last_fullsized":"2023-12-19T17:51:41.892353+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:01.021272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874374+0000","last_change":"2023-12-19T17:51:37.861671+0000","last_active":"2023-12-19T17:51:41.874374+0000","last_peered":"2023-12-19T17:51:41.874374+0000","last_clean":"2023-12-19T17:51:41.874374+0000","last_became_active":"2023-12-19T17:51:37.860880+0000","last_became_peered":"2023-12-19T17:51:37.860880+0000","last_unstale":"2023-12-19T17:51:41.874374+0000","last_undegraded":"2023-12-19T17:51:41.874374+0000","last_fullsized":"2023-12-19T17:51:41.874374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862370+0000","last_change":"2023-12-19T17:51:37.365041+0000","last_active":"2023-12-19T17:51:41.862370+0000","last_peered":"2023-12-19T17:51:41.862370+0000","last_clean":"2023-12-19T17:51:41.862370+0000","last_became_active":"2023-12-19T17:51:37.364574+0000","last_became_peered":"2023-12-19T17:51:37.364574+0000","last_unstale":"2023-12-19T17:51:41.862370+0000","last_undegraded":"2023-12-19T17:51:41.862370+0000","last_fullsized":"2023-12-19T17:51:41.862370+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.903630+0000","last_change":"2023-12-19T17:51:41.894392+0000","last_active":"2023-12-19T17:51:41.903630+0000","last_peered":"2023-12-19T17:51:41.903630+0000","last_clean":"2023-12-19T17:51:41.903630+0000","last_became_active":"2023-12-19T17:51:41.893912+0000","last_became_peered":"2023-12-19T17:51:41.893912+0000","last_unstale":"2023-12-19T17:51:41.903630+0000","last_undegraded":"2023-12-19T17:51:41.903630+0000","last_fullsized":"2023-12-19T17:51:41.903630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871673+0000","last_change":"2023-12-19T17:51:37.878509+0000","last_active":"2023-12-19T17:51:41.871673+0000","last_peered":"2023-12-19T17:51:41.871673+0000","last_clean":"2023-12-19T17:51:41.871673+0000","last_became_active":"2023-12-19T17:51:37.878267+0000","last_became_peered":"2023-12-19T17:51:37.878267+0000","last_unstale":"2023-12-19T17:51:41.871673+0000","last_undegraded":"2023-12-19T17:51:41.871673+0000","last_fullsized":"2023-12-19T17:51:41.871673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860703+0000","last_change":"2023-12-19T17:51:37.361332+0000","last_active":"2023-12-19T17:51:41.860703+0000","last_peered":"2023-12-19T17:51:41.860703+0000","last_clean":"2023-12-19T17:51:41.860703+0000","last_became_active":"2023-12-19T17:51:37.359992+0000","last_became_peered":"2023-12-19T17:51:37.359992+0000","last_unstale":"2023-12-19T17:51:41.860703+0000","last_undegraded":"2023-12-19T17:51:41.860703+0000","last_fullsized":"2023-12-19T17:51:41.860703+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.905148+0000","last_change":"2023-12-19T17:51:41.902138+0000","last_active":"2023-12-19T17:51:41.905148+0000","last_peered":"2023-12-19T17:51:41.905148+0000","last_clean":"2023-12-19T17:51:41.905148+0000","last_became_active":"2023-12-19T17:51:41.901751+0000","last_became_peered":"2023-12-19T17:51:41.901751+0000","last_unstale":"2023-12-19T17:51:41.905148+0000","last_undegraded":"2023-12-19T17:51:41.905148+0000","last_fullsized":"2023-12-19T17:51:41.905148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:10.835359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872596+0000","last_change":"2023-12-19T17:51:37.852747+0000","last_active":"2023-12-19T17:51:41.872596+0000","last_peered":"2023-12-19T17:51:41.872596+0000","last_clean":"2023-12-19T17:51:41.872596+0000","last_became_active":"2023-12-19T17:51:37.852265+0000","last_became_peered":"2023-12-19T17:51:37.852265+0000","last_unstale":"2023-12-19T17:51:41.872596+0000","last_undegraded":"2023-12-19T17:51:41.872596+0000","last_fullsized":"2023-12-19T17:51:41.872596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:48.499693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861229+0000","last_change":"2023-12-19T17:51:37.374392+0000","last_active":"2023-12-19T17:51:41.861229+0000","last_peered":"2023-12-19T17:51:41.861229+0000","last_clean":"2023-12-19T17:51:41.861229+0000","last_became_active":"2023-12-19T17:51:37.373831+0000","last_became_peered":"2023-12-19T17:51:37.373831+0000","last_unstale":"2023-12-19T17:51:41.861229+0000","last_undegraded":"2023-12-19T17:51:41.861229+0000","last_fullsized":"2023-12-19T17:51:41.861229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:33.874748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895361+0000","last_change":"2023-12-19T17:51:41.889463+0000","last_active":"2023-12-19T17:51:41.895361+0000","last_peered":"2023-12-19T17:51:41.895361+0000","last_clean":"2023-12-19T17:51:41.895361+0000","last_became_active":"2023-12-19T17:51:41.888636+0000","last_became_peered":"2023-12-19T17:51:41.888636+0000","last_unstale":"2023-12-19T17:51:41.895361+0000","last_undegraded":"2023-12-19T17:51:41.895361+0000","last_fullsized":"2023-12-19T17:51:41.895361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.882268+0000","last_change":"2023-12-19T17:51:37.868058+0000","last_active":"2023-12-19T17:51:41.882268+0000","last_peered":"2023-12-19T17:51:41.882268+0000","last_clean":"2023-12-19T17:51:41.882268+0000","last_became_active":"2023-12-19T17:51:37.867800+0000","last_became_peered":"2023-12-19T17:51:37.867800+0000","last_unstale":"2023-12-19T17:51:41.882268+0000","last_undegraded":"2023-12-19T17:51:41.882268+0000","last_fullsized":"2023-12-19T17:51:41.882268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865357+0000","last_change":"2023-12-19T17:51:37.366626+0000","last_active":"2023-12-19T17:51:41.865357+0000","last_peered":"2023-12-19T17:51:41.865357+0000","last_clean":"2023-12-19T17:51:41.865357+0000","last_became_active":"2023-12-19T17:51:37.366007+0000","last_became_peered":"2023-12-19T17:51:37.366007+0000","last_unstale":"2023-12-19T17:51:41.865357+0000","last_undegraded":"2023-12-19T17:51:41.865357+0000","last_fullsized":"2023-12-19T17:51:41.865357+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892118+0000","last_change":"2023-12-19T17:51:41.882903+0000","last_active":"2023-12-19T17:51:41.892118+0000","last_peered":"2023-12-19T17:51:41.892118+0000","last_clean":"2023-12-19T17:51:41.892118+0000","last_became_active":"2023-12-19T17:51:41.882532+0000","last_became_peered":"2023-12-19T17:51:41.882532+0000","last_unstale":"2023-12-19T17:51:41.892118+0000","last_undegraded":"2023-12-19T17:51:41.892118+0000","last_fullsized":"2023-12-19T17:51:41.892118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881484+0000","last_change":"2023-12-19T17:51:37.870213+0000","last_active":"2023-12-19T17:51:41.881484+0000","last_peered":"2023-12-19T17:51:41.881484+0000","last_clean":"2023-12-19T17:51:41.881484+0000","last_became_active":"2023-12-19T17:51:37.869912+0000","last_became_peered":"2023-12-19T17:51:37.869912+0000","last_unstale":"2023-12-19T17:51:41.881484+0000","last_undegraded":"2023-12-19T17:51:41.881484+0000","last_fullsized":"2023-12-19T17:51:41.881484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:52.781318+0000","last_change":"2023-12-19T17:51:37.367621+0000","last_active":"2023-12-19T17:51:52.781318+0000","last_peered":"2023-12-19T17:51:52.781318+0000","last_clean":"2023-12-19T17:51:52.781318+0000","last_became_active":"2023-12-19T17:51:37.367105+0000","last_became_peered":"2023-12-19T17:51:37.367105+0000","last_unstale":"2023-12-19T17:51:52.781318+0000","last_undegraded":"2023-12-19T17:51:52.781318+0000","last_fullsized":"2023-12-19T17:51:52.781318+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909707+0000","last_change":"2023-12-19T17:51:41.904744+0000","last_active":"2023-12-19T17:51:41.909707+0000","last_peered":"2023-12-19T17:51:41.909707+0000","last_clean":"2023-12-19T17:51:41.909707+0000","last_became_active":"2023-12-19T17:51:41.904364+0000","last_became_peered":"2023-12-19T17:51:41.904364+0000","last_unstale":"2023-12-19T17:51:41.909707+0000","last_undegraded":"2023-12-19T17:51:41.909707+0000","last_fullsized":"2023-12-19T17:51:41.909707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:58.563321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860812+0000","last_change":"2023-12-19T17:51:37.865360+0000","last_active":"2023-12-19T17:51:41.860812+0000","last_peered":"2023-12-19T17:51:41.860812+0000","last_clean":"2023-12-19T17:51:41.860812+0000","last_became_active":"2023-12-19T17:51:37.865049+0000","last_became_peered":"2023-12-19T17:51:37.865049+0000","last_unstale":"2023-12-19T17:51:41.860812+0000","last_undegraded":"2023-12-19T17:51:41.860812+0000","last_fullsized":"2023-12-19T17:51:41.860812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863243+0000","last_change":"2023-12-19T17:51:37.374005+0000","last_active":"2023-12-19T17:51:41.863243+0000","last_peered":"2023-12-19T17:51:41.863243+0000","last_clean":"2023-12-19T17:51:41.863243+0000","last_became_active":"2023-12-19T17:51:37.373306+0000","last_became_peered":"2023-12-19T17:51:37.373306+0000","last_unstale":"2023-12-19T17:51:41.863243+0000","last_undegraded":"2023-12-19T17:51:41.863243+0000","last_fullsized":"2023-12-19T17:51:41.863243+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:34:28.401279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909053+0000","last_change":"2023-12-19T17:51:41.907731+0000","last_active":"2023-12-19T17:51:41.909053+0000","last_peered":"2023-12-19T17:51:41.909053+0000","last_clean":"2023-12-19T17:51:41.909053+0000","last_became_active":"2023-12-19T17:51:41.907322+0000","last_became_peered":"2023-12-19T17:51:41.907322+0000","last_unstale":"2023-12-19T17:51:41.909053+0000","last_undegraded":"2023-12-19T17:51:41.909053+0000","last_fullsized":"2023-12-19T17:51:41.909053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874655+0000","last_change":"2023-12-19T17:51:37.868383+0000","last_active":"2023-12-19T17:51:41.874655+0000","last_peered":"2023-12-19T17:51:41.874655+0000","last_clean":"2023-12-19T17:51:41.874655+0000","last_became_active":"2023-12-19T17:51:37.867225+0000","last_became_peered":"2023-12-19T17:51:37.867225+0000","last_unstale":"2023-12-19T17:51:41.874655+0000","last_undegraded":"2023-12-19T17:51:41.874655+0000","last_fullsized":"2023-12-19T17:51:41.874655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861892+0000","last_change":"2023-12-19T17:51:37.372486+0000","last_active":"2023-12-19T17:51:41.861892+0000","last_peered":"2023-12-19T17:51:41.861892+0000","last_clean":"2023-12-19T17:51:41.861892+0000","last_became_active":"2023-12-19T17:51:37.371902+0000","last_became_peered":"2023-12-19T17:51:37.371902+0000","last_unstale":"2023-12-19T17:51:41.861892+0000","last_undegraded":"2023-12-19T17:51:41.861892+0000","last_fullsized":"2023-12-19T17:51:41.861892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901181+0000","last_change":"2023-12-19T17:51:41.893407+0000","last_active":"2023-12-19T17:51:41.901181+0000","last_peered":"2023-12-19T17:51:41.901181+0000","last_clean":"2023-12-19T17:51:41.901181+0000","last_became_active":"2023-12-19T17:51:41.892955+0000","last_became_peered":"2023-12-19T17:51:41.892955+0000","last_unstale":"2023-12-19T17:51:41.901181+0000","last_undegraded":"2023-12-19T17:51:41.901181+0000","last_fullsized":"2023-12-19T17:51:41.901181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:06:10.271692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871399+0000","last_change":"2023-12-19T17:51:37.856391+0000","last_active":"2023-12-19T17:51:41.871399+0000","last_peered":"2023-12-19T17:51:41.871399+0000","last_clean":"2023-12-19T17:51:41.871399+0000","last_became_active":"2023-12-19T17:51:37.855433+0000","last_became_peered":"2023-12-19T17:51:37.855433+0000","last_unstale":"2023-12-19T17:51:41.871399+0000","last_undegraded":"2023-12-19T17:51:41.871399+0000","last_fullsized":"2023-12-19T17:51:41.871399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:55:34.887797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870511+0000","last_change":"2023-12-19T17:51:37.356703+0000","last_active":"2023-12-19T17:51:41.870511+0000","last_peered":"2023-12-19T17:51:41.870511+0000","last_clean":"2023-12-19T17:51:41.870511+0000","last_became_active":"2023-12-19T17:51:37.354458+0000","last_became_peered":"2023-12-19T17:51:37.354458+0000","last_unstale":"2023-12-19T17:51:41.870511+0000","last_undegraded":"2023-12-19T17:51:41.870511+0000","last_fullsized":"2023-12-19T17:51:41.870511+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.899818+0000","last_change":"2023-12-19T17:51:41.893006+0000","last_active":"2023-12-19T17:51:41.899818+0000","last_peered":"2023-12-19T17:51:41.899818+0000","last_clean":"2023-12-19T17:51:41.899818+0000","last_became_active":"2023-12-19T17:51:41.892320+0000","last_became_peered":"2023-12-19T17:51:41.892320+0000","last_unstale":"2023-12-19T17:51:41.899818+0000","last_undegraded":"2023-12-19T17:51:41.899818+0000","last_fullsized":"2023-12-19T17:51:41.899818+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860734+0000","last_change":"2023-12-19T17:51:37.868336+0000","last_active":"2023-12-19T17:51:41.860734+0000","last_peered":"2023-12-19T17:51:41.860734+0000","last_clean":"2023-12-19T17:51:41.860734+0000","last_became_active":"2023-12-19T17:51:37.847762+0000","last_became_peered":"2023-12-19T17:51:37.847762+0000","last_unstale":"2023-12-19T17:51:41.860734+0000","last_undegraded":"2023-12-19T17:51:41.860734+0000","last_fullsized":"2023-12-19T17:51:41.860734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870223+0000","last_change":"2023-12-19T17:51:37.367919+0000","last_active":"2023-12-19T17:51:41.870223+0000","last_peered":"2023-12-19T17:51:41.870223+0000","last_clean":"2023-12-19T17:51:41.870223+0000","last_became_active":"2023-12-19T17:51:37.367646+0000","last_became_peered":"2023-12-19T17:51:37.367646+0000","last_unstale":"2023-12-19T17:51:41.870223+0000","last_undegraded":"2023-12-19T17:51:41.870223+0000","last_fullsized":"2023-12-19T17:51:41.870223+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900252+0000","last_change":"2023-12-19T17:51:41.891782+0000","last_active":"2023-12-19T17:51:41.900252+0000","last_peered":"2023-12-19T17:51:41.900252+0000","last_clean":"2023-12-19T17:51:41.900252+0000","last_became_active":"2023-12-19T17:51:41.891400+0000","last_became_peered":"2023-12-19T17:51:41.891400+0000","last_unstale":"2023-12-19T17:51:41.900252+0000","last_undegraded":"2023-12-19T17:51:41.900252+0000","last_fullsized":"2023-12-19T17:51:41.900252+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872648+0000","last_change":"2023-12-19T17:51:37.865125+0000","last_active":"2023-12-19T17:51:41.872648+0000","last_peered":"2023-12-19T17:51:41.872648+0000","last_clean":"2023-12-19T17:51:41.872648+0000","last_became_active":"2023-12-19T17:51:37.860190+0000","last_became_peered":"2023-12-19T17:51:37.860190+0000","last_unstale":"2023-12-19T17:51:41.872648+0000","last_undegraded":"2023-12-19T17:51:41.872648+0000","last_fullsized":"2023-12-19T17:51:41.872648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861321+0000","last_change":"2023-12-19T17:51:37.374377+0000","last_active":"2023-12-19T17:51:41.861321+0000","last_peered":"2023-12-19T17:51:41.861321+0000","last_clean":"2023-12-19T17:51:41.861321+0000","last_became_active":"2023-12-19T17:51:37.373141+0000","last_became_peered":"2023-12-19T17:51:37.373141+0000","last_unstale":"2023-12-19T17:51:41.861321+0000","last_undegraded":"2023-12-19T17:51:41.861321+0000","last_fullsized":"2023-12-19T17:51:41.861321+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.889909+0000","last_change":"2023-12-19T17:51:41.885767+0000","last_active":"2023-12-19T17:51:41.889909+0000","last_peered":"2023-12-19T17:51:41.889909+0000","last_clean":"2023-12-19T17:51:41.889909+0000","last_became_active":"2023-12-19T17:51:41.884799+0000","last_became_peered":"2023-12-19T17:51:41.884799+0000","last_unstale":"2023-12-19T17:51:41.889909+0000","last_undegraded":"2023-12-19T17:51:41.889909+0000","last_fullsized":"2023-12-19T17:51:41.889909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:22.880744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874118+0000","last_change":"2023-12-19T17:51:37.879736+0000","last_active":"2023-12-19T17:51:41.874118+0000","last_peered":"2023-12-19T17:51:41.874118+0000","last_clean":"2023-12-19T17:51:41.874118+0000","last_became_active":"2023-12-19T17:51:37.877058+0000","last_became_peered":"2023-12-19T17:51:37.877058+0000","last_unstale":"2023-12-19T17:51:41.874118+0000","last_undegraded":"2023-12-19T17:51:41.874118+0000","last_fullsized":"2023-12-19T17:51:41.874118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.876487+0000","last_change":"2023-12-19T17:51:37.359468+0000","last_active":"2023-12-19T17:51:41.876487+0000","last_peered":"2023-12-19T17:51:41.876487+0000","last_clean":"2023-12-19T17:51:41.876487+0000","last_became_active":"2023-12-19T17:51:37.359194+0000","last_became_peered":"2023-12-19T17:51:37.359194+0000","last_unstale":"2023-12-19T17:51:41.876487+0000","last_undegraded":"2023-12-19T17:51:41.876487+0000","last_fullsized":"2023-12-19T17:51:41.876487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861414+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:51:41.861414+0000","last_peered":"2023-12-19T17:51:41.861414+0000","last_clean":"2023-12-19T17:51:41.861414+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:51:41.861414+0000","last_undegraded":"2023-12-19T17:51:41.861414+0000","last_fullsized":"2023-12-19T17:51:41.861414+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897184+0000","last_change":"2023-12-19T17:51:41.893689+0000","last_active":"2023-12-19T17:51:41.897184+0000","last_peered":"2023-12-19T17:51:41.897184+0000","last_clean":"2023-12-19T17:51:41.897184+0000","last_became_active":"2023-12-19T17:51:41.893191+0000","last_became_peered":"2023-12-19T17:51:41.893191+0000","last_unstale":"2023-12-19T17:51:41.897184+0000","last_undegraded":"2023-12-19T17:51:41.897184+0000","last_fullsized":"2023-12-19T17:51:41.897184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:45.069338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861902+0000","last_change":"2023-12-19T17:51:37.868222+0000","last_active":"2023-12-19T17:51:41.861902+0000","last_peered":"2023-12-19T17:51:41.861902+0000","last_clean":"2023-12-19T17:51:41.861902+0000","last_became_active":"2023-12-19T17:51:37.867972+0000","last_became_peered":"2023-12-19T17:51:37.867972+0000","last_unstale":"2023-12-19T17:51:41.861902+0000","last_undegraded":"2023-12-19T17:51:41.861902+0000","last_fullsized":"2023-12-19T17:51:41.861902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871883+0000","last_change":"2023-12-19T17:51:37.366114+0000","last_active":"2023-12-19T17:51:41.871883+0000","last_peered":"2023-12-19T17:51:41.871883+0000","last_clean":"2023-12-19T17:51:41.871883+0000","last_became_active":"2023-12-19T17:51:37.365717+0000","last_became_peered":"2023-12-19T17:51:37.365717+0000","last_unstale":"2023-12-19T17:51:41.871883+0000","last_undegraded":"2023-12-19T17:51:41.871883+0000","last_fullsized":"2023-12-19T17:51:41.871883+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.890817+0000","last_change":"2023-12-19T17:51:41.883576+0000","last_active":"2023-12-19T17:51:41.890817+0000","last_peered":"2023-12-19T17:51:41.890817+0000","last_clean":"2023-12-19T17:51:41.890817+0000","last_became_active":"2023-12-19T17:51:41.883135+0000","last_became_peered":"2023-12-19T17:51:41.883135+0000","last_unstale":"2023-12-19T17:51:41.890817+0000","last_undegraded":"2023-12-19T17:51:41.890817+0000","last_fullsized":"2023-12-19T17:51:41.890817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:51:16.679810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874046+0000","last_change":"2023-12-19T17:51:37.863995+0000","last_active":"2023-12-19T17:51:41.874046+0000","last_peered":"2023-12-19T17:51:41.874046+0000","last_clean":"2023-12-19T17:51:41.874046+0000","last_became_active":"2023-12-19T17:51:37.863704+0000","last_became_peered":"2023-12-19T17:51:37.863704+0000","last_unstale":"2023-12-19T17:51:41.874046+0000","last_undegraded":"2023-12-19T17:51:41.874046+0000","last_fullsized":"2023-12-19T17:51:41.874046+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:03:19.119941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862307+0000","last_change":"2023-12-19T17:51:37.367329+0000","last_active":"2023-12-19T17:51:41.862307+0000","last_peered":"2023-12-19T17:51:41.862307+0000","last_clean":"2023-12-19T17:51:41.862307+0000","last_became_active":"2023-12-19T17:51:37.366996+0000","last_became_peered":"2023-12-19T17:51:37.366996+0000","last_unstale":"2023-12-19T17:51:41.862307+0000","last_undegraded":"2023-12-19T17:51:41.862307+0000","last_fullsized":"2023-12-19T17:51:41.862307+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909072+0000","last_change":"2023-12-19T17:51:41.907875+0000","last_active":"2023-12-19T17:51:41.909072+0000","last_peered":"2023-12-19T17:51:41.909072+0000","last_clean":"2023-12-19T17:51:41.909072+0000","last_became_active":"2023-12-19T17:51:41.907461+0000","last_became_peered":"2023-12-19T17:51:41.907461+0000","last_unstale":"2023-12-19T17:51:41.909072+0000","last_undegraded":"2023-12-19T17:51:41.909072+0000","last_fullsized":"2023-12-19T17:51:41.909072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:00:39.253451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863419+0000","last_change":"2023-12-19T17:51:37.863678+0000","last_active":"2023-12-19T17:51:41.863419+0000","last_peered":"2023-12-19T17:51:41.863419+0000","last_clean":"2023-12-19T17:51:41.863419+0000","last_became_active":"2023-12-19T17:51:37.863378+0000","last_became_peered":"2023-12-19T17:51:37.863378+0000","last_unstale":"2023-12-19T17:51:41.863419+0000","last_undegraded":"2023-12-19T17:51:41.863419+0000","last_fullsized":"2023-12-19T17:51:41.863419+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:37:21.936722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873263+0000","last_change":"2023-12-19T17:51:37.359686+0000","last_active":"2023-12-19T17:51:41.873263+0000","last_peered":"2023-12-19T17:51:41.873263+0000","last_clean":"2023-12-19T17:51:41.873263+0000","last_became_active":"2023-12-19T17:51:37.359340+0000","last_became_peered":"2023-12-19T17:51:37.359340+0000","last_unstale":"2023-12-19T17:51:41.873263+0000","last_undegraded":"2023-12-19T17:51:41.873263+0000","last_fullsized":"2023-12-19T17:51:41.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897294+0000","last_change":"2023-12-19T17:51:41.893188+0000","last_active":"2023-12-19T17:51:41.897294+0000","last_peered":"2023-12-19T17:51:41.897294+0000","last_clean":"2023-12-19T17:51:41.897294+0000","last_became_active":"2023-12-19T17:51:41.892695+0000","last_became_peered":"2023-12-19T17:51:41.892695+0000","last_unstale":"2023-12-19T17:51:41.897294+0000","last_undegraded":"2023-12-19T17:51:41.897294+0000","last_fullsized":"2023-12-19T17:51:41.897294+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:06.333544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862719+0000","last_change":"2023-12-19T17:51:37.858250+0000","last_active":"2023-12-19T17:51:41.862719+0000","last_peered":"2023-12-19T17:51:41.862719+0000","last_clean":"2023-12-19T17:51:41.862719+0000","last_became_active":"2023-12-19T17:51:37.858002+0000","last_became_peered":"2023-12-19T17:51:37.858002+0000","last_unstale":"2023-12-19T17:51:41.862719+0000","last_undegraded":"2023-12-19T17:51:41.862719+0000","last_fullsized":"2023-12-19T17:51:41.862719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:21.378881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875262+0000","last_change":"2023-12-19T17:51:37.373582+0000","last_active":"2023-12-19T17:51:41.875262+0000","last_peered":"2023-12-19T17:51:41.875262+0000","last_clean":"2023-12-19T17:51:41.875262+0000","last_became_active":"2023-12-19T17:51:37.373152+0000","last_became_peered":"2023-12-19T17:51:37.373152+0000","last_unstale":"2023-12-19T17:51:41.875262+0000","last_undegraded":"2023-12-19T17:51:41.875262+0000","last_fullsized":"2023-12-19T17:51:41.875262+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:30:14.694444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.895324+0000","last_change":"2023-12-19T17:51:41.889020+0000","last_active":"2023-12-19T17:51:41.895324+0000","last_peered":"2023-12-19T17:51:41.895324+0000","last_clean":"2023-12-19T17:51:41.895324+0000","last_became_active":"2023-12-19T17:51:41.888202+0000","last_became_peered":"2023-12-19T17:51:41.888202+0000","last_unstale":"2023-12-19T17:51:41.895324+0000","last_undegraded":"2023-12-19T17:51:41.895324+0000","last_fullsized":"2023-12-19T17:51:41.895324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:15.850386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861516+0000","last_change":"2023-12-19T17:51:37.857128+0000","last_active":"2023-12-19T17:51:41.861516+0000","last_peered":"2023-12-19T17:51:41.861516+0000","last_clean":"2023-12-19T17:51:41.861516+0000","last_became_active":"2023-12-19T17:51:37.856862+0000","last_became_peered":"2023-12-19T17:51:37.856862+0000","last_unstale":"2023-12-19T17:51:41.861516+0000","last_undegraded":"2023-12-19T17:51:41.861516+0000","last_fullsized":"2023-12-19T17:51:41.861516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:01.983840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.868593+0000","last_change":"2023-12-19T17:51:37.368123+0000","last_active":"2023-12-19T17:51:41.868593+0000","last_peered":"2023-12-19T17:51:41.868593+0000","last_clean":"2023-12-19T17:51:41.868593+0000","last_became_active":"2023-12-19T17:51:37.367483+0000","last_became_peered":"2023-12-19T17:51:37.367483+0000","last_unstale":"2023-12-19T17:51:41.868593+0000","last_undegraded":"2023-12-19T17:51:41.868593+0000","last_fullsized":"2023-12-19T17:51:41.868593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.900476+0000","last_change":"2023-12-19T17:51:41.890990+0000","last_active":"2023-12-19T17:51:41.900476+0000","last_peered":"2023-12-19T17:51:41.900476+0000","last_clean":"2023-12-19T17:51:41.900476+0000","last_became_active":"2023-12-19T17:51:41.890583+0000","last_became_peered":"2023-12-19T17:51:41.890583+0000","last_unstale":"2023-12-19T17:51:41.900476+0000","last_undegraded":"2023-12-19T17:51:41.900476+0000","last_fullsized":"2023-12-19T17:51:41.900476+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862572+0000","last_change":"2023-12-19T17:51:37.874651+0000","last_active":"2023-12-19T17:51:41.862572+0000","last_peered":"2023-12-19T17:51:41.862572+0000","last_clean":"2023-12-19T17:51:41.862572+0000","last_became_active":"2023-12-19T17:51:37.874304+0000","last_became_peered":"2023-12-19T17:51:37.874304+0000","last_unstale":"2023-12-19T17:51:41.862572+0000","last_undegraded":"2023-12-19T17:51:41.862572+0000","last_fullsized":"2023-12-19T17:51:41.862572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862903+0000","last_change":"2023-12-19T17:51:37.368087+0000","last_active":"2023-12-19T17:51:41.862903+0000","last_peered":"2023-12-19T17:51:41.862903+0000","last_clean":"2023-12-19T17:51:41.862903+0000","last_became_active":"2023-12-19T17:51:37.367220+0000","last_became_peered":"2023-12-19T17:51:37.367220+0000","last_unstale":"2023-12-19T17:51:41.862903+0000","last_undegraded":"2023-12-19T17:51:41.862903+0000","last_fullsized":"2023-12-19T17:51:41.862903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:47.486645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.909749+0000","last_change":"2023-12-19T17:51:41.904872+0000","last_active":"2023-12-19T17:51:41.909749+0000","last_peered":"2023-12-19T17:51:41.909749+0000","last_clean":"2023-12-19T17:51:41.909749+0000","last_became_active":"2023-12-19T17:51:41.904421+0000","last_became_peered":"2023-12-19T17:51:41.904421+0000","last_unstale":"2023-12-19T17:51:41.909749+0000","last_undegraded":"2023-12-19T17:51:41.909749+0000","last_fullsized":"2023-12-19T17:51:41.909749+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:00.555281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861789+0000","last_change":"2023-12-19T17:51:37.863792+0000","last_active":"2023-12-19T17:51:41.861789+0000","last_peered":"2023-12-19T17:51:41.861789+0000","last_clean":"2023-12-19T17:51:41.861789+0000","last_became_active":"2023-12-19T17:51:37.863505+0000","last_became_peered":"2023-12-19T17:51:37.863505+0000","last_unstale":"2023-12-19T17:51:41.861789+0000","last_undegraded":"2023-12-19T17:51:41.861789+0000","last_fullsized":"2023-12-19T17:51:41.861789+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:19.360251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870449+0000","last_change":"2023-12-19T17:51:37.365092+0000","last_active":"2023-12-19T17:51:41.870449+0000","last_peered":"2023-12-19T17:51:41.870449+0000","last_clean":"2023-12-19T17:51:41.870449+0000","last_became_active":"2023-12-19T17:51:37.361623+0000","last_became_peered":"2023-12-19T17:51:37.361623+0000","last_unstale":"2023-12-19T17:51:41.870449+0000","last_undegraded":"2023-12-19T17:51:41.870449+0000","last_fullsized":"2023-12-19T17:51:41.870449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:56:41.162682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.910085+0000","last_change":"2023-12-19T17:51:41.908920+0000","last_active":"2023-12-19T17:51:41.910085+0000","last_peered":"2023-12-19T17:51:41.910085+0000","last_clean":"2023-12-19T17:51:41.910085+0000","last_became_active":"2023-12-19T17:51:41.908497+0000","last_became_peered":"2023-12-19T17:51:41.908497+0000","last_unstale":"2023-12-19T17:51:41.910085+0000","last_undegraded":"2023-12-19T17:51:41.910085+0000","last_fullsized":"2023-12-19T17:51:41.910085+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:46:24.700627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.878208+0000","last_change":"2023-12-19T17:51:37.857702+0000","last_active":"2023-12-19T17:51:41.878208+0000","last_peered":"2023-12-19T17:51:41.878208+0000","last_clean":"2023-12-19T17:51:41.878208+0000","last_became_active":"2023-12-19T17:51:37.857433+0000","last_became_peered":"2023-12-19T17:51:37.857433+0000","last_unstale":"2023-12-19T17:51:41.878208+0000","last_undegraded":"2023-12-19T17:51:41.878208+0000","last_fullsized":"2023-12-19T17:51:41.878208+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880946+0000","last_change":"2023-12-19T17:51:37.362716+0000","last_active":"2023-12-19T17:51:41.880946+0000","last_peered":"2023-12-19T17:51:41.880946+0000","last_clean":"2023-12-19T17:51:41.880946+0000","last_became_active":"2023-12-19T17:51:37.361305+0000","last_became_peered":"2023-12-19T17:51:37.361305+0000","last_unstale":"2023-12-19T17:51:41.880946+0000","last_undegraded":"2023-12-19T17:51:41.880946+0000","last_fullsized":"2023-12-19T17:51:41.880946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:00.744670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897388+0000","last_change":"2023-12-19T17:51:41.893227+0000","last_active":"2023-12-19T17:51:41.897388+0000","last_peered":"2023-12-19T17:51:41.897388+0000","last_clean":"2023-12-19T17:51:41.897388+0000","last_became_active":"2023-12-19T17:51:41.892689+0000","last_became_peered":"2023-12-19T17:51:41.892689+0000","last_unstale":"2023-12-19T17:51:41.897388+0000","last_undegraded":"2023-12-19T17:51:41.897388+0000","last_fullsized":"2023-12-19T17:51:41.897388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:14.243432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861900+0000","last_change":"2023-12-19T17:51:37.870206+0000","last_active":"2023-12-19T17:51:41.861900+0000","last_peered":"2023-12-19T17:51:41.861900+0000","last_clean":"2023-12-19T17:51:41.861900+0000","last_became_active":"2023-12-19T17:51:37.869935+0000","last_became_peered":"2023-12-19T17:51:37.869935+0000","last_unstale":"2023-12-19T17:51:41.861900+0000","last_undegraded":"2023-12-19T17:51:41.861900+0000","last_fullsized":"2023-12-19T17:51:41.861900+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:22:36.436180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'11","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-19T17:51:53.261006+0000","last_change":"2023-12-19T17:51:37.375150+0000","last_active":"2023-12-19T17:51:53.261006+0000","last_peered":"2023-12-19T17:51:53.261006+0000","last_clean":"2023-12-19T17:51:53.261006+0000","last_became_active":"2023-12-19T17:51:37.374662+0000","last_became_peered":"2023-12-19T17:51:37.374662+0000","last_unstale":"2023-12-19T17:51:53.261006+0000","last_undegraded":"2023-12-19T17:51:53.261006+0000","last_fullsized":"2023-12-19T17:51:53.261006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3795,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.897598+0000","last_change":"2023-12-19T17:51:41.884755+0000","last_active":"2023-12-19T17:51:41.897598+0000","last_peered":"2023-12-19T17:51:41.897598+0000","last_clean":"2023-12-19T17:51:41.897598+0000","last_became_active":"2023-12-19T17:51:41.884141+0000","last_became_peered":"2023-12-19T17:51:41.884141+0000","last_unstale":"2023-12-19T17:51:41.897598+0000","last_undegraded":"2023-12-19T17:51:41.897598+0000","last_fullsized":"2023-12-19T17:51:41.897598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:29:21.267192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871819+0000","last_change":"2023-12-19T17:51:37.871807+0000","last_active":"2023-12-19T17:51:41.871819+0000","last_peered":"2023-12-19T17:51:41.871819+0000","last_clean":"2023-12-19T17:51:41.871819+0000","last_became_active":"2023-12-19T17:51:37.871521+0000","last_became_peered":"2023-12-19T17:51:37.871521+0000","last_unstale":"2023-12-19T17:51:41.871819+0000","last_undegraded":"2023-12-19T17:51:41.871819+0000","last_fullsized":"2023-12-19T17:51:41.871819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862120+0000","last_change":"2023-12-19T17:51:37.363031+0000","last_active":"2023-12-19T17:51:41.862120+0000","last_peered":"2023-12-19T17:51:41.862120+0000","last_clean":"2023-12-19T17:51:41.862120+0000","last_became_active":"2023-12-19T17:51:37.362756+0000","last_became_peered":"2023-12-19T17:51:37.362756+0000","last_unstale":"2023-12-19T17:51:41.862120+0000","last_undegraded":"2023-12-19T17:51:41.862120+0000","last_fullsized":"2023-12-19T17:51:41.862120+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.907191+0000","last_change":"2023-12-19T17:51:41.901238+0000","last_active":"2023-12-19T17:51:41.907191+0000","last_peered":"2023-12-19T17:51:41.907191+0000","last_clean":"2023-12-19T17:51:41.907191+0000","last_became_active":"2023-12-19T17:51:41.900651+0000","last_became_peered":"2023-12-19T17:51:41.900651+0000","last_unstale":"2023-12-19T17:51:41.907191+0000","last_undegraded":"2023-12-19T17:51:41.907191+0000","last_fullsized":"2023-12-19T17:51:41.907191+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:12:26.894141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.883389+0000","last_change":"2023-12-19T17:51:37.859989+0000","last_active":"2023-12-19T17:51:41.883389+0000","last_peered":"2023-12-19T17:51:41.883389+0000","last_clean":"2023-12-19T17:51:41.883389+0000","last_became_active":"2023-12-19T17:51:37.858483+0000","last_became_peered":"2023-12-19T17:51:37.858483+0000","last_unstale":"2023-12-19T17:51:41.883389+0000","last_undegraded":"2023-12-19T17:51:41.883389+0000","last_fullsized":"2023-12-19T17:51:41.883389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880701+0000","last_change":"2023-12-19T17:51:37.370965+0000","last_active":"2023-12-19T17:51:41.880701+0000","last_peered":"2023-12-19T17:51:41.880701+0000","last_clean":"2023-12-19T17:51:41.880701+0000","last_became_active":"2023-12-19T17:51:37.370062+0000","last_became_peered":"2023-12-19T17:51:37.370062+0000","last_unstale":"2023-12-19T17:51:41.880701+0000","last_undegraded":"2023-12-19T17:51:41.880701+0000","last_fullsized":"2023-12-19T17:51:41.880701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:33.734696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904990+0000","last_change":"2023-12-19T17:51:41.901244+0000","last_active":"2023-12-19T17:51:41.904990+0000","last_peered":"2023-12-19T17:51:41.904990+0000","last_clean":"2023-12-19T17:51:41.904990+0000","last_became_active":"2023-12-19T17:51:41.900797+0000","last_became_peered":"2023-12-19T17:51:41.900797+0000","last_unstale":"2023-12-19T17:51:41.904990+0000","last_undegraded":"2023-12-19T17:51:41.904990+0000","last_fullsized":"2023-12-19T17:51:41.904990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:07:01.265536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880682+0000","last_change":"2023-12-19T17:51:37.862402+0000","last_active":"2023-12-19T17:51:41.880682+0000","last_peered":"2023-12-19T17:51:41.880682+0000","last_clean":"2023-12-19T17:51:41.880682+0000","last_became_active":"2023-12-19T17:51:37.862122+0000","last_became_peered":"2023-12-19T17:51:37.862122+0000","last_unstale":"2023-12-19T17:51:41.880682+0000","last_undegraded":"2023-12-19T17:51:41.880682+0000","last_fullsized":"2023-12-19T17:51:41.880682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865202+0000","last_change":"2023-12-19T17:51:37.369300+0000","last_active":"2023-12-19T17:51:41.865202+0000","last_peered":"2023-12-19T17:51:41.865202+0000","last_clean":"2023-12-19T17:51:41.865202+0000","last_became_active":"2023-12-19T17:51:37.368149+0000","last_became_peered":"2023-12-19T17:51:37.368149+0000","last_unstale":"2023-12-19T17:51:41.865202+0000","last_undegraded":"2023-12-19T17:51:41.865202+0000","last_fullsized":"2023-12-19T17:51:41.865202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:55.231446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.901092+0000","last_change":"2023-12-19T17:51:41.894673+0000","last_active":"2023-12-19T17:51:41.901092+0000","last_peered":"2023-12-19T17:51:41.901092+0000","last_clean":"2023-12-19T17:51:41.901092+0000","last_became_active":"2023-12-19T17:51:41.893704+0000","last_became_peered":"2023-12-19T17:51:41.893704+0000","last_unstale":"2023-12-19T17:51:41.901092+0000","last_undegraded":"2023-12-19T17:51:41.901092+0000","last_fullsized":"2023-12-19T17:51:41.901092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:36:54.855527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904181+0000","last_change":"2023-12-19T17:51:41.901728+0000","last_active":"2023-12-19T17:51:41.904181+0000","last_peered":"2023-12-19T17:51:41.904181+0000","last_clean":"2023-12-19T17:51:41.904181+0000","last_became_active":"2023-12-19T17:51:41.900986+0000","last_became_peered":"2023-12-19T17:51:41.900986+0000","last_unstale":"2023-12-19T17:51:41.904181+0000","last_undegraded":"2023-12-19T17:51:41.904181+0000","last_fullsized":"2023-12-19T17:51:41.904181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:06.066157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860494+0000","last_change":"2023-12-19T17:51:37.869238+0000","last_active":"2023-12-19T17:51:41.860494+0000","last_peered":"2023-12-19T17:51:41.860494+0000","last_clean":"2023-12-19T17:51:41.860494+0000","last_became_active":"2023-12-19T17:51:37.868781+0000","last_became_peered":"2023-12-19T17:51:37.868781+0000","last_unstale":"2023-12-19T17:51:41.860494+0000","last_undegraded":"2023-12-19T17:51:41.860494+0000","last_fullsized":"2023-12-19T17:51:41.860494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874862+0000","last_change":"2023-12-19T17:51:37.370627+0000","last_active":"2023-12-19T17:51:41.874862+0000","last_peered":"2023-12-19T17:51:41.874862+0000","last_clean":"2023-12-19T17:51:41.874862+0000","last_became_active":"2023-12-19T17:51:37.366660+0000","last_became_peered":"2023-12-19T17:51:37.366660+0000","last_unstale":"2023-12-19T17:51:41.874862+0000","last_undegraded":"2023-12-19T17:51:41.874862+0000","last_fullsized":"2023-12-19T17:51:41.874862+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:59:16.916105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.891084+0000","last_change":"2023-12-19T17:51:41.884759+0000","last_active":"2023-12-19T17:51:41.891084+0000","last_peered":"2023-12-19T17:51:41.891084+0000","last_clean":"2023-12-19T17:51:41.891084+0000","last_became_active":"2023-12-19T17:51:41.884313+0000","last_became_peered":"2023-12-19T17:51:41.884313+0000","last_unstale":"2023-12-19T17:51:41.891084+0000","last_undegraded":"2023-12-19T17:51:41.891084+0000","last_fullsized":"2023-12-19T17:51:41.891084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:41.801043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871597+0000","last_change":"2023-12-19T17:51:37.861948+0000","last_active":"2023-12-19T17:51:41.871597+0000","last_peered":"2023-12-19T17:51:41.871597+0000","last_clean":"2023-12-19T17:51:41.871597+0000","last_became_active":"2023-12-19T17:51:37.860829+0000","last_became_peered":"2023-12-19T17:51:37.860829+0000","last_unstale":"2023-12-19T17:51:41.871597+0000","last_undegraded":"2023-12-19T17:51:41.871597+0000","last_fullsized":"2023-12-19T17:51:41.871597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875499+0000","last_change":"2023-12-19T17:51:37.370607+0000","last_active":"2023-12-19T17:51:41.875499+0000","last_peered":"2023-12-19T17:51:41.875499+0000","last_clean":"2023-12-19T17:51:41.875499+0000","last_became_active":"2023-12-19T17:51:37.370306+0000","last_became_peered":"2023-12-19T17:51:37.370306+0000","last_unstale":"2023-12-19T17:51:41.875499+0000","last_undegraded":"2023-12-19T17:51:41.875499+0000","last_fullsized":"2023-12-19T17:51:41.875499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:54.261197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863959+0000","last_change":"2023-12-19T17:51:37.367794+0000","last_active":"2023-12-19T17:51:41.863959+0000","last_peered":"2023-12-19T17:51:41.863959+0000","last_clean":"2023-12-19T17:51:41.863959+0000","last_became_active":"2023-12-19T17:51:37.367484+0000","last_became_peered":"2023-12-19T17:51:37.367484+0000","last_unstale":"2023-12-19T17:51:41.863959+0000","last_undegraded":"2023-12-19T17:51:41.863959+0000","last_fullsized":"2023-12-19T17:51:41.863959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:41.423812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880861+0000","last_change":"2023-12-19T17:51:37.866914+0000","last_active":"2023-12-19T17:51:41.880861+0000","last_peered":"2023-12-19T17:51:41.880861+0000","last_clean":"2023-12-19T17:51:41.880861+0000","last_became_active":"2023-12-19T17:51:37.860031+0000","last_became_peered":"2023-12-19T17:51:37.860031+0000","last_unstale":"2023-12-19T17:51:41.880861+0000","last_undegraded":"2023-12-19T17:51:41.880861+0000","last_fullsized":"2023-12-19T17:51:41.880861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.892712+0000","last_change":"2023-12-19T17:51:41.888154+0000","last_active":"2023-12-19T17:51:41.892712+0000","last_peered":"2023-12-19T17:51:41.892712+0000","last_clean":"2023-12-19T17:51:41.892712+0000","last_became_active":"2023-12-19T17:51:41.887685+0000","last_became_peered":"2023-12-19T17:51:41.887685+0000","last_unstale":"2023-12-19T17:51:41.892712+0000","last_undegraded":"2023-12-19T17:51:41.892712+0000","last_fullsized":"2023-12-19T17:51:41.892712+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:49.694949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874462+0000","last_change":"2023-12-19T17:51:37.373607+0000","last_active":"2023-12-19T17:51:41.874462+0000","last_peered":"2023-12-19T17:51:41.874462+0000","last_clean":"2023-12-19T17:51:41.874462+0000","last_became_active":"2023-12-19T17:51:37.373028+0000","last_became_peered":"2023-12-19T17:51:37.373028+0000","last_unstale":"2023-12-19T17:51:41.874462+0000","last_undegraded":"2023-12-19T17:51:41.874462+0000","last_fullsized":"2023-12-19T17:51:41.874462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:36.311147+0000","last_clean_scrub_stamp":"2023-12-19T17:51:36.311147+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:29.861362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.872203+0000","last_change":"2023-12-19T17:51:37.853456+0000","last_active":"2023-12-19T17:51:41.872203+0000","last_peered":"2023-12-19T17:51:41.872203+0000","last_clean":"2023-12-19T17:51:41.872203+0000","last_became_active":"2023-12-19T17:51:37.853073+0000","last_became_peered":"2023-12-19T17:51:37.853073+0000","last_unstale":"2023-12-19T17:51:41.872203+0000","last_undegraded":"2023-12-19T17:51:41.872203+0000","last_fullsized":"2023-12-19T17:51:41.872203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:15:56.244495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.904914+0000","last_change":"2023-12-19T17:51:41.903216+0000","last_active":"2023-12-19T17:51:41.904914+0000","last_peered":"2023-12-19T17:51:41.904914+0000","last_clean":"2023-12-19T17:51:41.904914+0000","last_became_active":"2023-12-19T17:51:41.902823+0000","last_became_peered":"2023-12-19T17:51:41.902823+0000","last_unstale":"2023-12-19T17:51:41.904914+0000","last_undegraded":"2023-12-19T17:51:41.904914+0000","last_fullsized":"2023-12-19T17:51:41.904914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:40.844688+0000","last_clean_scrub_stamp":"2023-12-19T17:51:40.844688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:32.887544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862464+0000","last_change":"2023-12-19T17:51:37.874316+0000","last_active":"2023-12-19T17:51:41.862464+0000","last_peered":"2023-12-19T17:51:41.862464+0000","last_clean":"2023-12-19T17:51:41.862464+0000","last_became_active":"2023-12-19T17:51:37.873086+0000","last_became_peered":"2023-12-19T17:51:37.873086+0000","last_unstale":"2023-12-19T17:51:41.862464+0000","last_undegraded":"2023-12-19T17:51:41.862464+0000","last_fullsized":"2023-12-19T17:51:41.862464+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870124+0000","last_change":"2023-12-19T17:51:37.850435+0000","last_active":"2023-12-19T17:51:41.870124+0000","last_peered":"2023-12-19T17:51:41.870124+0000","last_clean":"2023-12-19T17:51:41.870124+0000","last_became_active":"2023-12-19T17:51:37.849426+0000","last_became_peered":"2023-12-19T17:51:37.849426+0000","last_unstale":"2023-12-19T17:51:41.870124+0000","last_undegraded":"2023-12-19T17:51:41.870124+0000","last_fullsized":"2023-12-19T17:51:41.870124+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:06.358491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870410+0000","last_change":"2023-12-19T17:51:37.878151+0000","last_active":"2023-12-19T17:51:41.870410+0000","last_peered":"2023-12-19T17:51:41.870410+0000","last_clean":"2023-12-19T17:51:41.870410+0000","last_became_active":"2023-12-19T17:51:37.877950+0000","last_became_peered":"2023-12-19T17:51:37.877950+0000","last_unstale":"2023-12-19T17:51:41.870410+0000","last_undegraded":"2023-12-19T17:51:41.870410+0000","last_fullsized":"2023-12-19T17:51:41.870410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880786+0000","last_change":"2023-12-19T17:51:37.873480+0000","last_active":"2023-12-19T17:51:41.880786+0000","last_peered":"2023-12-19T17:51:41.880786+0000","last_clean":"2023-12-19T17:51:41.880786+0000","last_became_active":"2023-12-19T17:51:37.873217+0000","last_became_peered":"2023-12-19T17:51:37.873217+0000","last_unstale":"2023-12-19T17:51:41.880786+0000","last_undegraded":"2023-12-19T17:51:41.880786+0000","last_fullsized":"2023-12-19T17:51:41.880786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:10:16.720087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877566+0000","last_change":"2023-12-19T17:51:37.862909+0000","last_active":"2023-12-19T17:51:41.877566+0000","last_peered":"2023-12-19T17:51:41.877566+0000","last_clean":"2023-12-19T17:51:41.877566+0000","last_became_active":"2023-12-19T17:51:37.862582+0000","last_became_peered":"2023-12-19T17:51:37.862582+0000","last_unstale":"2023-12-19T17:51:41.877566+0000","last_undegraded":"2023-12-19T17:51:41.877566+0000","last_fullsized":"2023-12-19T17:51:41.877566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861447+0000","last_change":"2023-12-19T17:51:37.864245+0000","last_active":"2023-12-19T17:51:41.861447+0000","last_peered":"2023-12-19T17:51:41.861447+0000","last_clean":"2023-12-19T17:51:41.861447+0000","last_became_active":"2023-12-19T17:51:37.863824+0000","last_became_peered":"2023-12-19T17:51:37.863824+0000","last_unstale":"2023-12-19T17:51:41.861447+0000","last_undegraded":"2023-12-19T17:51:41.861447+0000","last_fullsized":"2023-12-19T17:51:41.861447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862736+0000","last_change":"2023-12-19T17:51:37.878924+0000","last_active":"2023-12-19T17:51:41.862736+0000","last_peered":"2023-12-19T17:51:41.862736+0000","last_clean":"2023-12-19T17:51:41.862736+0000","last_became_active":"2023-12-19T17:51:37.875497+0000","last_became_peered":"2023-12-19T17:51:37.875497+0000","last_unstale":"2023-12-19T17:51:41.862736+0000","last_undegraded":"2023-12-19T17:51:41.862736+0000","last_fullsized":"2023-12-19T17:51:41.862736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.881391+0000","last_change":"2023-12-19T17:51:37.863018+0000","last_active":"2023-12-19T17:51:41.881391+0000","last_peered":"2023-12-19T17:51:41.881391+0000","last_clean":"2023-12-19T17:51:41.881391+0000","last_became_active":"2023-12-19T17:51:37.862800+0000","last_became_peered":"2023-12-19T17:51:37.862800+0000","last_unstale":"2023-12-19T17:51:41.881391+0000","last_undegraded":"2023-12-19T17:51:41.881391+0000","last_fullsized":"2023-12-19T17:51:41.881391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874580+0000","last_change":"2023-12-19T17:51:37.864066+0000","last_active":"2023-12-19T17:51:41.874580+0000","last_peered":"2023-12-19T17:51:41.874580+0000","last_clean":"2023-12-19T17:51:41.874580+0000","last_became_active":"2023-12-19T17:51:37.863848+0000","last_became_peered":"2023-12-19T17:51:37.863848+0000","last_unstale":"2023-12-19T17:51:41.874580+0000","last_undegraded":"2023-12-19T17:51:41.874580+0000","last_fullsized":"2023-12-19T17:51:41.874580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875414+0000","last_change":"2023-12-19T17:51:37.877889+0000","last_active":"2023-12-19T17:51:41.875414+0000","last_peered":"2023-12-19T17:51:41.875414+0000","last_clean":"2023-12-19T17:51:41.875414+0000","last_became_active":"2023-12-19T17:51:37.877109+0000","last_became_peered":"2023-12-19T17:51:37.877109+0000","last_unstale":"2023-12-19T17:51:41.875414+0000","last_undegraded":"2023-12-19T17:51:41.875414+0000","last_fullsized":"2023-12-19T17:51:41.875414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:27:37.056809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870359+0000","last_change":"2023-12-19T17:51:37.857037+0000","last_active":"2023-12-19T17:51:41.870359+0000","last_peered":"2023-12-19T17:51:41.870359+0000","last_clean":"2023-12-19T17:51:41.870359+0000","last_became_active":"2023-12-19T17:51:37.856790+0000","last_became_peered":"2023-12-19T17:51:37.856790+0000","last_unstale":"2023-12-19T17:51:41.870359+0000","last_undegraded":"2023-12-19T17:51:41.870359+0000","last_fullsized":"2023-12-19T17:51:41.870359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880706+0000","last_change":"2023-12-19T17:51:37.857822+0000","last_active":"2023-12-19T17:51:41.880706+0000","last_peered":"2023-12-19T17:51:41.880706+0000","last_clean":"2023-12-19T17:51:41.880706+0000","last_became_active":"2023-12-19T17:51:37.855549+0000","last_became_peered":"2023-12-19T17:51:37.855549+0000","last_unstale":"2023-12-19T17:51:41.880706+0000","last_undegraded":"2023-12-19T17:51:41.880706+0000","last_fullsized":"2023-12-19T17:51:41.880706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.864155+0000","last_change":"2023-12-19T17:51:37.860504+0000","last_active":"2023-12-19T17:51:41.864155+0000","last_peered":"2023-12-19T17:51:41.864155+0000","last_clean":"2023-12-19T17:51:41.864155+0000","last_became_active":"2023-12-19T17:51:37.860153+0000","last_became_peered":"2023-12-19T17:51:37.860153+0000","last_unstale":"2023-12-19T17:51:41.864155+0000","last_undegraded":"2023-12-19T17:51:41.864155+0000","last_fullsized":"2023-12-19T17:51:41.864155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:35:42.902910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863155+0000","last_change":"2023-12-19T17:51:37.861734+0000","last_active":"2023-12-19T17:51:41.863155+0000","last_peered":"2023-12-19T17:51:41.863155+0000","last_clean":"2023-12-19T17:51:41.863155+0000","last_became_active":"2023-12-19T17:51:37.855703+0000","last_became_peered":"2023-12-19T17:51:37.855703+0000","last_unstale":"2023-12-19T17:51:41.863155+0000","last_undegraded":"2023-12-19T17:51:41.863155+0000","last_fullsized":"2023-12-19T17:51:41.863155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:38.034430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873169+0000","last_change":"2023-12-19T17:51:37.860944+0000","last_active":"2023-12-19T17:51:41.873169+0000","last_peered":"2023-12-19T17:51:41.873169+0000","last_clean":"2023-12-19T17:51:41.873169+0000","last_became_active":"2023-12-19T17:51:37.860435+0000","last_became_peered":"2023-12-19T17:51:37.860435+0000","last_unstale":"2023-12-19T17:51:41.873169+0000","last_undegraded":"2023-12-19T17:51:41.873169+0000","last_fullsized":"2023-12-19T17:51:41.873169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:26.638861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.875676+0000","last_change":"2023-12-19T17:51:37.871267+0000","last_active":"2023-12-19T17:51:41.875676+0000","last_peered":"2023-12-19T17:51:41.875676+0000","last_clean":"2023-12-19T17:51:41.875676+0000","last_became_active":"2023-12-19T17:51:37.871093+0000","last_became_peered":"2023-12-19T17:51:37.871093+0000","last_unstale":"2023-12-19T17:51:41.875676+0000","last_undegraded":"2023-12-19T17:51:41.875676+0000","last_fullsized":"2023-12-19T17:51:41.875676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:32.279330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874498+0000","last_change":"2023-12-19T17:51:37.859001+0000","last_active":"2023-12-19T17:51:41.874498+0000","last_peered":"2023-12-19T17:51:41.874498+0000","last_clean":"2023-12-19T17:51:41.874498+0000","last_became_active":"2023-12-19T17:51:37.858756+0000","last_became_peered":"2023-12-19T17:51:37.858756+0000","last_unstale":"2023-12-19T17:51:41.874498+0000","last_undegraded":"2023-12-19T17:51:41.874498+0000","last_fullsized":"2023-12-19T17:51:41.874498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:02.744778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.860552+0000","last_change":"2023-12-19T17:51:37.869034+0000","last_active":"2023-12-19T17:51:41.860552+0000","last_peered":"2023-12-19T17:51:41.860552+0000","last_clean":"2023-12-19T17:51:41.860552+0000","last_became_active":"2023-12-19T17:51:37.868411+0000","last_became_peered":"2023-12-19T17:51:37.868411+0000","last_unstale":"2023-12-19T17:51:41.860552+0000","last_undegraded":"2023-12-19T17:51:41.860552+0000","last_fullsized":"2023-12-19T17:51:41.860552+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.877952+0000","last_change":"2023-12-19T17:51:37.851059+0000","last_active":"2023-12-19T17:51:41.877952+0000","last_peered":"2023-12-19T17:51:41.877952+0000","last_clean":"2023-12-19T17:51:41.877952+0000","last_became_active":"2023-12-19T17:51:37.850723+0000","last_became_peered":"2023-12-19T17:51:37.850723+0000","last_unstale":"2023-12-19T17:51:41.877952+0000","last_undegraded":"2023-12-19T17:51:41.877952+0000","last_fullsized":"2023-12-19T17:51:41.877952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:42.951165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.874288+0000","last_change":"2023-12-19T17:51:37.866674+0000","last_active":"2023-12-19T17:51:41.874288+0000","last_peered":"2023-12-19T17:51:41.874288+0000","last_clean":"2023-12-19T17:51:41.874288+0000","last_became_active":"2023-12-19T17:51:37.865470+0000","last_became_peered":"2023-12-19T17:51:37.865470+0000","last_unstale":"2023-12-19T17:51:41.874288+0000","last_undegraded":"2023-12-19T17:51:41.874288+0000","last_fullsized":"2023-12-19T17:51:41.874288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:19:29.391163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871739+0000","last_change":"2023-12-19T17:51:37.875330+0000","last_active":"2023-12-19T17:51:41.871739+0000","last_peered":"2023-12-19T17:51:41.871739+0000","last_clean":"2023-12-19T17:51:41.871739+0000","last_became_active":"2023-12-19T17:51:37.874974+0000","last_became_peered":"2023-12-19T17:51:37.874974+0000","last_unstale":"2023-12-19T17:51:41.871739+0000","last_undegraded":"2023-12-19T17:51:41.871739+0000","last_fullsized":"2023-12-19T17:51:41.871739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:26:42.193642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.865979+0000","last_change":"2023-12-19T17:51:37.875506+0000","last_active":"2023-12-19T17:51:41.865979+0000","last_peered":"2023-12-19T17:51:41.865979+0000","last_clean":"2023-12-19T17:51:41.865979+0000","last_became_active":"2023-12-19T17:51:37.875016+0000","last_became_peered":"2023-12-19T17:51:37.875016+0000","last_unstale":"2023-12-19T17:51:41.865979+0000","last_undegraded":"2023-12-19T17:51:41.865979+0000","last_fullsized":"2023-12-19T17:51:41.865979+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:47:46.174457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.862619+0000","last_change":"2023-12-19T17:51:37.878903+0000","last_active":"2023-12-19T17:51:41.862619+0000","last_peered":"2023-12-19T17:51:41.862619+0000","last_clean":"2023-12-19T17:51:41.862619+0000","last_became_active":"2023-12-19T17:51:37.874964+0000","last_became_peered":"2023-12-19T17:51:37.874964+0000","last_unstale":"2023-12-19T17:51:41.862619+0000","last_undegraded":"2023-12-19T17:51:41.862619+0000","last_fullsized":"2023-12-19T17:51:41.862619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863340+0000","last_change":"2023-12-19T17:51:37.858908+0000","last_active":"2023-12-19T17:51:41.863340+0000","last_peered":"2023-12-19T17:51:41.863340+0000","last_clean":"2023-12-19T17:51:41.863340+0000","last_became_active":"2023-12-19T17:51:37.858336+0000","last_became_peered":"2023-12-19T17:51:37.858336+0000","last_unstale":"2023-12-19T17:51:41.863340+0000","last_undegraded":"2023-12-19T17:51:41.863340+0000","last_fullsized":"2023-12-19T17:51:41.863340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:55:49.251577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.871491+0000","last_change":"2023-12-19T17:51:37.862607+0000","last_active":"2023-12-19T17:51:41.871491+0000","last_peered":"2023-12-19T17:51:41.871491+0000","last_clean":"2023-12-19T17:51:41.871491+0000","last_became_active":"2023-12-19T17:51:37.862159+0000","last_became_peered":"2023-12-19T17:51:37.862159+0000","last_unstale":"2023-12-19T17:51:41.871491+0000","last_undegraded":"2023-12-19T17:51:41.871491+0000","last_fullsized":"2023-12-19T17:51:41.871491+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861454+0000","last_change":"2023-12-19T17:51:37.848444+0000","last_active":"2023-12-19T17:51:41.861454+0000","last_peered":"2023-12-19T17:51:41.861454+0000","last_clean":"2023-12-19T17:51:41.861454+0000","last_became_active":"2023-12-19T17:51:37.848141+0000","last_became_peered":"2023-12-19T17:51:37.848141+0000","last_unstale":"2023-12-19T17:51:41.861454+0000","last_undegraded":"2023-12-19T17:51:41.861454+0000","last_fullsized":"2023-12-19T17:51:41.861454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:03.428851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.870323+0000","last_change":"2023-12-19T17:51:37.859778+0000","last_active":"2023-12-19T17:51:41.870323+0000","last_peered":"2023-12-19T17:51:41.870323+0000","last_clean":"2023-12-19T17:51:41.870323+0000","last_became_active":"2023-12-19T17:51:37.859521+0000","last_became_peered":"2023-12-19T17:51:37.859521+0000","last_unstale":"2023-12-19T17:51:41.870323+0000","last_undegraded":"2023-12-19T17:51:41.870323+0000","last_fullsized":"2023-12-19T17:51:41.870323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:25.889709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861746+0000","last_change":"2023-12-19T17:51:37.848789+0000","last_active":"2023-12-19T17:51:41.861746+0000","last_peered":"2023-12-19T17:51:41.861746+0000","last_clean":"2023-12-19T17:51:41.861746+0000","last_became_active":"2023-12-19T17:51:37.848533+0000","last_became_peered":"2023-12-19T17:51:37.848533+0000","last_unstale":"2023-12-19T17:51:41.861746+0000","last_undegraded":"2023-12-19T17:51:41.861746+0000","last_fullsized":"2023-12-19T17:51:41.861746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.873893+0000","last_change":"2023-12-19T17:51:37.878808+0000","last_active":"2023-12-19T17:51:41.873893+0000","last_peered":"2023-12-19T17:51:41.873893+0000","last_clean":"2023-12-19T17:51:41.873893+0000","last_became_active":"2023-12-19T17:51:37.878550+0000","last_became_peered":"2023-12-19T17:51:37.878550+0000","last_unstale":"2023-12-19T17:51:41.873893+0000","last_undegraded":"2023-12-19T17:51:41.873893+0000","last_fullsized":"2023-12-19T17:51:41.873893+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:41:57.503218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.880534+0000","last_change":"2023-12-19T17:51:37.842584+0000","last_active":"2023-12-19T17:51:41.880534+0000","last_peered":"2023-12-19T17:51:41.880534+0000","last_clean":"2023-12-19T17:51:41.880534+0000","last_became_active":"2023-12-19T17:51:37.842230+0000","last_became_peered":"2023-12-19T17:51:37.842230+0000","last_unstale":"2023-12-19T17:51:41.880534+0000","last_undegraded":"2023-12-19T17:51:41.880534+0000","last_fullsized":"2023-12-19T17:51:41.880534+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:50:11.437641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.861715+0000","last_change":"2023-12-19T17:51:37.866251+0000","last_active":"2023-12-19T17:51:41.861715+0000","last_peered":"2023-12-19T17:51:41.861715+0000","last_clean":"2023-12-19T17:51:41.861715+0000","last_became_active":"2023-12-19T17:51:37.865954+0000","last_became_peered":"2023-12-19T17:51:37.865954+0000","last_unstale":"2023-12-19T17:51:41.861715+0000","last_undegraded":"2023-12-19T17:51:41.861715+0000","last_fullsized":"2023-12-19T17:51:41.861715+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:57:08.342436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-19T17:51:41.863303+0000","last_change":"2023-12-19T17:51:37.869240+0000","last_active":"2023-12-19T17:51:41.863303+0000","last_peered":"2023-12-19T17:51:41.863303+0000","last_clean":"2023-12-19T17:51:41.863303+0000","last_became_active":"2023-12-19T17:51:37.868451+0000","last_became_peered":"2023-12-19T17:51:37.868451+0000","last_unstale":"2023-12-19T17:51:41.863303+0000","last_undegraded":"2023-12-19T17:51:41.863303+0000","last_fullsized":"2023-12-19T17:51:41.863303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:37.324195+0000","last_clean_scrub_stamp":"2023-12-19T17:51:37.324195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:17:31.584625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4593,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":851968,"data_stored":690730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93899999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2709999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.361}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0469999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1659999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.522}]}]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":258048,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1339999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":99906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4420000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4350000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.621}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.4610000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1459999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":266240,"data_stored":103575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0740000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":253952,"data_stored":99780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92100000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3480000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27208,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344632,"statfs":{"total":96636764160,"available":96608903168,"internally_reserved":0,"allocated":262144,"data_stored":99940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.756}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0880000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0569999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.145}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31884,"kb_used_data":836,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339956,"statfs":{"total":96636764160,"available":96604114944,"internally_reserved":0,"allocated":856064,"data_stored":689767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.294}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4510000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6040000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:52:07.578 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T17:52:07.578 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-19T17:52:07.578 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-19T17:52:07.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-19T17:52:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.794+0000 7f1d6f0fe700 1 Processor -- start 2023-12-19T17:52:07.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.794+0000 7f1d6f0fe700 1 -- start start 2023-12-19T17:52:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6f0fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6815cff0 0x7f1d68161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6f0fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d680c3920 0x7f1d680c3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6f0fe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d680c42c0 con 0x7f1d6806ddd0 2023-12-19T17:52:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6f0fe700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d6815d3d0 con 0x7f1d680c3920 2023-12-19T17:52:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6f0fe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680ca6f0 con 0x7f1d6815cff0 2023-12-19T17:52:07.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d680c3920 0x7f1d680c3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d680c3920 0x7f1d680c3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38188/0 (socket says 172.21.15.45:38188) 2023-12-19T17:52:07.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/2040253318 learned_addr learned my addr 172.21.15.45:0/2040253318 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:07.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e0fc700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6815cff0 0x7f1d68161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/2040253318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6815cff0 msgr2=0x7f1d68161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6815cff0 0x7f1d68161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/2040253318 >> v1:172.21.15.73:6789/0 conn(0x7f1d6806ddd0 legacy=0x7f1d680c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/2040253318 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d680c9220 con 0x7f1d680c3920 2023-12-19T17:52:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e0fc700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6815cff0 0x7f1d68161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:07.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6e8fd700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d680c3920 0x7f1d680c3d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009e50 tx=0x7f1d6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d644d4a228b80ac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6d0fa700 1 -- 172.21.15.45:0/2040253318 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000e070 con 0x7f1d680c3920 2023-12-19T17:52:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6d0fa700 1 -- 172.21.15.45:0/2040253318 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d6000b9c0 con 0x7f1d680c3920 2023-12-19T17:52:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.798+0000 7f1d6d0fa700 1 -- 172.21.15.45:0/2040253318 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6000bd70 con 0x7f1d680c3920 2023-12-19T17:52:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/2040253318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d680c3920 msgr2=0x7f1d680c3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d680c3920 0x7f1d680c3d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1d60009e50 tx=0x7f1d6000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:07.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/2040253318 shutdown_connections 2023-12-19T17:52:07.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d680c3920 0x7f1d680c3d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/2040253318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6815cff0 0x7f1d68161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/2040253318 >> 172.21.15.45:0/2040253318 conn(0x7f1d680cb900 msgr2=0x7f1d680b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:07.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/2040253318 shutdown_connections 2023-12-19T17:52:07.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/2040253318 wait complete. 2023-12-19T17:52:07.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 Processor -- start 2023-12-19T17:52:07.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.802+0000 7f1d6f0fe700 1 -- start start 2023-12-19T17:52:07.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6806ddd0 0x7f1d680b2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d680c3920 0x7f1d681f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 0x7f1d680c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680b1650 con 0x7f1d6815cff0 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680b2940 con 0x7f1d680c3920 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d680c6a60 con 0x7f1d6806ddd0 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 0x7f1d680c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 0x7f1d680c7820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38190/0 (socket says 172.21.15.45:38190) 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/323888572 learned_addr learned my addr 172.21.15.45:0/323888572 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:07.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6d8fb700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d680c3920 0x7f1d681f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e0fc700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6806ddd0 0x7f1d680b2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6806ddd0 msgr2=0x7f1d680b2400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6806ddd0 0x7f1d680b2400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d680c3920 msgr2=0x7f1d681f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d680c3920 0x7f1d681f3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 -- 172.21.15.45:0/323888572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d60009b30 con 0x7f1d6815cff0 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6e8fd700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 0x7f1d680c7820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d6806abb0 tx=0x7f1d60004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d600048b0 con 0x7f1d6815cff0 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d600099b0 con 0x7f1d6815cff0 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d680c6d40 con 0x7f1d6815cff0 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d6001c680 con 0x7f1d6815cff0 2023-12-19T17:52:07.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.806+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d680c7300 con 0x7f1d6815cff0 2023-12-19T17:52:07.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.810+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d680c7520 con 0x7f1d6815cff0 2023-12-19T17:52:07.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.810+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d6001c7e0 con 0x7f1d6815cff0 2023-12-19T17:52:07.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.810+0000 7f1d5effd700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d4c065ad0 0x7f1d4c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:07.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.810+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1d600850e0 con 0x7f1d6815cff0 2023-12-19T17:52:07.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.814+0000 7f1d6e0fc700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d4c065ad0 0x7f1d4c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:07.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.814+0000 7f1d6e0fc700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d4c065ad0 0x7f1d4c067f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d6815fcb0 tx=0x7f1d64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:07.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:07.814+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d600527a0 con 0x7f1d6815cff0 2023-12-19T17:52:08.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.026+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1d68067760 con 0x7f1d6815cff0 2023-12-19T17:52:08.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d5effd700 1 -- 172.21.15.45:0/323888572 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f1d60055dc0 con 0x7f1d6815cff0 2023-12-19T17:52:08.031 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:08.031 INFO:teuthology.orchestra.run.smithi045.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-19T17:52:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d4c065ad0 msgr2=0x7f1d4c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d4c065ad0 0x7f1d4c067f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1d6815fcb0 tx=0x7f1d64008040 comp rx=0 tx=0).stop 2023-12-19T17:52:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 msgr2=0x7f1d680c7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 0x7f1d680c7820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1d6806abb0 tx=0x7f1d60004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 shutdown_connections 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d4c065ad0 0x7f1d4c067f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d6815cff0 0x7f1d680c7820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d680c3920 0x7f1d681f3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 --2- 172.21.15.45:0/323888572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d6806ddd0 0x7f1d680b2400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 >> 172.21.15.45:0/323888572 conn(0x7f1d680cb900 msgr2=0x7f1d6806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 shutdown_connections 2023-12-19T17:52:08.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.030+0000 7f1d6f0fe700 1 -- 172.21.15.45:0/323888572 wait complete. 2023-12-19T17:52:08.055 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-19T17:52:08.055 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.234+0000 7f3b47039700 1 Processor -- start 2023-12-19T17:52:08.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.234+0000 7f3b47039700 1 -- start start 2023-12-19T17:52:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b47039700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b4006ea90 0x7f3b400d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b47039700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3b400b88b0 0x7f3b400b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b47039700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b400b6dd0 con 0x7f3b400b6250 2023-12-19T17:52:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b47039700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400d1820 con 0x7f3b4006ea90 2023-12-19T17:52:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b47039700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b400d1b00 con 0x7f3b400b88b0 2023-12-19T17:52:08.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b4006ea90 0x7f3b400d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3b4006ea90 0x7f3b400d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38206/0 (socket says 172.21.15.45:38206) 2023-12-19T17:52:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b45836700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3b400b88b0 0x7f3b400b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 -- 172.21.15.45:0/2572401803 learned_addr learned my addr 172.21.15.45:0/2572401803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 -- 172.21.15.45:0/2572401803 >> v2:172.21.15.73:3300/0 conn(0x7f3b400b88b0 msgr2=0x7f3b400b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:08.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 --2- 172.21.15.45:0/2572401803 >> v2:172.21.15.73:3300/0 conn(0x7f3b400b88b0 0x7f3b400b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 -- 172.21.15.45:0/2572401803 >> v1:172.21.15.73:6789/0 conn(0x7f3b400b6250 legacy=0x7f3b400b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 -- 172.21.15.45:0/2572401803 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b400d1de0 con 0x7f3b4006ea90 2023-12-19T17:52:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b46037700 1 --2- 172.21.15.45:0/2572401803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4006ea90 0x7f3b400d0f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b400b2610 tx=0x7f3b30009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92b6d0d1f5eee11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b45035700 1 -- 172.21.15.45:0/2572401803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30011830 con 0x7f3b4006ea90 2023-12-19T17:52:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b45035700 1 -- 172.21.15.45:0/2572401803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b30011990 con 0x7f3b4006ea90 2023-12-19T17:52:08.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.238+0000 7f3b45035700 1 -- 172.21.15.45:0/2572401803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30011d20 con 0x7f3b4006ea90 2023-12-19T17:52:08.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 -- 172.21.15.45:0/2572401803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4006ea90 msgr2=0x7f3b400d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 --2- 172.21.15.45:0/2572401803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4006ea90 0x7f3b400d0f20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3b400b2610 tx=0x7f3b30009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 -- 172.21.15.45:0/2572401803 shutdown_connections 2023-12-19T17:52:08.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 --2- 172.21.15.45:0/2572401803 >> v2:172.21.15.73:3300/0 conn(0x7f3b400b88b0 0x7f3b400b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 --2- 172.21.15.45:0/2572401803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b4006ea90 0x7f3b400d0f20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 -- 172.21.15.45:0/2572401803 >> 172.21.15.45:0/2572401803 conn(0x7f3b400b46d0 msgr2=0x7f3b400b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:08.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 -- 172.21.15.45:0/2572401803 shutdown_connections 2023-12-19T17:52:08.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.242+0000 7f3b47039700 1 -- 172.21.15.45:0/2572401803 wait complete. 2023-12-19T17:52:08.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 Processor -- start 2023-12-19T17:52:08.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 -- start start 2023-12-19T17:52:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b4006ea90 0x7f3b4014dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b400b6250 0x7f3b401e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b400b88b0 0x7f3b401e5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401e31f0 con 0x7f3b400b6250 2023-12-19T17:52:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401e34d0 con 0x7f3b400b88b0 2023-12-19T17:52:08.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b47039700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b401e37b0 con 0x7f3b4006ea90 2023-12-19T17:52:08.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b45836700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b400b6250 0x7f3b401e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b46037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b4006ea90 0x7f3b4014dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b45836700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b400b6250 0x7f3b401e4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38216/0 (socket says 172.21.15.45:38216) 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b45836700 1 -- 172.21.15.45:0/1320372101 learned_addr learned my addr 172.21.15.45:0/1320372101 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.246+0000 7f3b46838700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b400b88b0 0x7f3b401e5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b46037700 1 -- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b400b88b0 msgr2=0x7f3b401e5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b46037700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b400b88b0 0x7f3b401e5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b46037700 1 -- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b400b6250 msgr2=0x7f3b401e4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b46037700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b400b6250 0x7f3b401e4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b46037700 1 -- 172.21.15.45:0/1320372101 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b30009570 con 0x7f3b4006ea90 2023-12-19T17:52:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b46037700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b4006ea90 0x7f3b4014dee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b30016000 tx=0x7f3b30004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30004590 con 0x7f3b4006ea90 2023-12-19T17:52:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3001e070 con 0x7f3b4006ea90 2023-12-19T17:52:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b401e3a90 con 0x7f3b4006ea90 2023-12-19T17:52:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b30003900 con 0x7f3b4006ea90 2023-12-19T17:52:08.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b401e4290 con 0x7f3b4006ea90 2023-12-19T17:52:08.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.250+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b401e3fb0 con 0x7f3b4006ea90 2023-12-19T17:52:08.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.254+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b30003a60 con 0x7f3b4006ea90 2023-12-19T17:52:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.254+0000 7f3b3effd700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b2c065ad0 0x7f3b2c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.254+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b30083ef0 con 0x7f3b4006ea90 2023-12-19T17:52:08.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.254+0000 7f3b45836700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b2c065ad0 0x7f3b2c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.258+0000 7f3b45836700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b2c065ad0 0x7f3b2c067f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b400cf1c0 tx=0x7f3b34009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:08.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.266+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3b401e3fb0 con 0x7f3b4006ea90 2023-12-19T17:52:08.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.454+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b401e3fb0 con 0x7f3b4006ea90 2023-12-19T17:52:08.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.458+0000 7f3b3effd700 1 -- 172.21.15.45:0/1320372101 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f3b300516d0 con 0x7f3b4006ea90 2023-12-19T17:52:08.461 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:08.461 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b2c065ad0 msgr2=0x7f3b2c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b2c065ad0 0x7f3b2c067f90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3b400cf1c0 tx=0x7f3b34009240 comp rx=0 tx=0).stop 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b4006ea90 msgr2=0x7f3b4014dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b4006ea90 0x7f3b4014dee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3b30016000 tx=0x7f3b30004770 comp rx=0 tx=0).stop 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 shutdown_connections 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b2c065ad0 0x7f3b2c067f90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b400b88b0 0x7f3b401e5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b400b6250 0x7f3b401e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 --2- 172.21.15.45:0/1320372101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b4006ea90 0x7f3b4014dee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 >> 172.21.15.45:0/1320372101 conn(0x7f3b400b46d0 msgr2=0x7f3b400b1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:08.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 shutdown_connections 2023-12-19T17:52:08.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.462+0000 7f3b47039700 1 -- 172.21.15.45:0/1320372101 wait complete. 2023-12-19T17:52:08.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:08.489 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:08.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.670+0000 7f214c73a700 1 Processor -- start 2023-12-19T17:52:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.670+0000 7f214c73a700 1 -- start start 2023-12-19T17:52:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214c73a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21440cce30 0x7f21440cd270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214c73a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2144071890 0x7f2144071d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214c73a700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214415aab0 con 0x7f214415d0a0 2023-12-19T17:52:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214c73a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21440cd7b0 con 0x7f2144071890 2023-12-19T17:52:08.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214c73a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21440cf030 con 0x7f21440cce30 2023-12-19T17:52:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214a4d6700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f214415d0a0 0x7f2144159810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59282/0 (socket says 172.21.15.45:59282) 2023-12-19T17:52:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214a4d6700 1 -- 172.21.15.45:0/1257260094 learned_addr learned my addr 172.21.15.45:0/1257260094 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214acd7700 1 --2- 172.21.15.45:0/1257260094 >> v2:172.21.15.73:3300/0 conn(0x7f2144071890 0x7f2144071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f2149cd5700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21440cce30 0x7f21440cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f21494d4700 1 -- 172.21.15.45:0/1257260094 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4140082858 0 0) 0x7f214415aab0 con 0x7f214415d0a0 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f21494d4700 1 -- 172.21.15.45:0/1257260094 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21300057e0 con 0x7f214415d0a0 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214acd7700 1 -- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21440cce30 msgr2=0x7f21440cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214acd7700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21440cce30 0x7f21440cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214acd7700 1 -- 172.21.15.45:0/1257260094 >> v1:172.21.15.45:6789/0 conn(0x7f214415d0a0 legacy=0x7f2144159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f214acd7700 1 -- 172.21.15.45:0/1257260094 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214415a210 con 0x7f2144071890 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.674+0000 7f2149cd5700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21440cce30 0x7f21440cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:08.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214acd7700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2144071890 0x7f2144071d00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f213c009d90 tx=0x7f213c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b811876fad624060 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f21494d4700 1 -- 172.21.15.45:0/1257260094 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c00e070 con 0x7f2144071890 2023-12-19T17:52:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f21494d4700 1 -- 172.21.15.45:0/1257260094 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c00bb20 con 0x7f2144071890 2023-12-19T17:52:08.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f21494d4700 1 -- 172.21.15.45:0/1257260094 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c012430 con 0x7f2144071890 2023-12-19T17:52:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 -- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2144071890 msgr2=0x7f2144071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2144071890 0x7f2144071d00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f213c009d90 tx=0x7f213c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 -- 172.21.15.45:0/1257260094 shutdown_connections 2023-12-19T17:52:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2144071890 0x7f2144071d00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 --2- 172.21.15.45:0/1257260094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f21440cce30 0x7f21440cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 -- 172.21.15.45:0/1257260094 >> 172.21.15.45:0/1257260094 conn(0x7f21440cf260 msgr2=0x7f21440cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 -- 172.21.15.45:0/1257260094 shutdown_connections 2023-12-19T17:52:08.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.678+0000 7f214c73a700 1 -- 172.21.15.45:0/1257260094 wait complete. 2023-12-19T17:52:08.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 Processor -- start 2023-12-19T17:52:08.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 -- start start 2023-12-19T17:52:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2144071890 0x7f214409ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 0x7f2144153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f214415d0a0 0x7f21440c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21440c26e0 con 0x7f21440cce30 2023-12-19T17:52:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214409e780 con 0x7f214415d0a0 2023-12-19T17:52:08.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f214c73a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214409d720 con 0x7f2144071890 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.682+0000 7f2149cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 0x7f2144153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 0x7f2144153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38224/0 (socket says 172.21.15.45:38224) 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 -- 172.21.15.45:0/3504266294 learned_addr learned my addr 172.21.15.45:0/3504266294 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f214acd7700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f214415d0a0 0x7f21440c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f214a4d6700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2144071890 0x7f214409ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 -- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2144071890 msgr2=0x7f214409ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2144071890 0x7f214409ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 -- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f214415d0a0 msgr2=0x7f21440c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f214415d0a0 0x7f21440c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 -- 172.21.15.45:0/3504266294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21340094b0 con 0x7f21440cce30 2023-12-19T17:52:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f2149cd5700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 0x7f2144153f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f213400ebe0 tx=0x7f213400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:08.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2134009770 con 0x7f21440cce30 2023-12-19T17:52:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213400c850 con 0x7f21440cce30 2023-12-19T17:52:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f213c009a70 con 0x7f21440cce30 2023-12-19T17:52:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213400cbe0 con 0x7f21440cce30 2023-12-19T17:52:08.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214409f150 con 0x7f21440cce30 2023-12-19T17:52:08.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.686+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214409d590 con 0x7f21440cce30 2023-12-19T17:52:08.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.690+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f213400cd40 con 0x7f21440cce30 2023-12-19T17:52:08.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.690+0000 7f213affd700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2128065b00 0x7f2128067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:08.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.690+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2134083460 con 0x7f21440cce30 2023-12-19T17:52:08.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.690+0000 7f214a4d6700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2128065b00 0x7f2128067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:08.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.694+0000 7f214a4d6700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2128065b00 0x7f2128067fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2140001360 tx=0x7f2140009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:08.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.698+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2134050a90 con 0x7f21440cce30 2023-12-19T17:52:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.874+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f214404ed30 con 0x7f21440cce30 2023-12-19T17:52:08.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.874+0000 7f213affd700 1 -- 172.21.15.45:0/3504266294 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21340540b0 con 0x7f21440cce30 2023-12-19T17:52:08.877 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2128065b00 msgr2=0x7f2128067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2128065b00 0x7f2128067fc0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2140001360 tx=0x7f2140009040 comp rx=0 tx=0).stop 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 msgr2=0x7f2144153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 0x7f2144153f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f213400ebe0 tx=0x7f213400eef0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 shutdown_connections 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2128065b00 0x7f2128067fc0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f214415d0a0 0x7f21440c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f21440cce30 0x7f2144153f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 --2- 172.21.15.45:0/3504266294 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2144071890 0x7f214409ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 >> 172.21.15.45:0/3504266294 conn(0x7f21440cf260 msgr2=0x7f21441551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 shutdown_connections 2023-12-19T17:52:08.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:08.878+0000 7f214c73a700 1 -- 172.21.15.45:0/3504266294 wait complete. 2023-12-19T17:52:08.901 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.086+0000 7f566ffff700 1 Processor -- start 2023-12-19T17:52:09.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.086+0000 7f566ffff700 1 -- start start 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f56700cdfd0 0x7f5670167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566ffff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f567015d300 con 0x7f567015cf20 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566ffff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56700d1550 con 0x7f56700b8580 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566ffff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56700d1360 con 0x7f56700cdfd0 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566effd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f567015cf20 0x7f56700d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48910/0 (socket says 172.21.15.45:48910) 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566effd700 1 -- 172.21.15.45:0/2989820985 learned_addr learned my addr 172.21.15.45:0/2989820985 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:09.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566f7fe700 1 --2- 172.21.15.45:0/2989820985 >> v2:172.21.15.73:3300/0 conn(0x7f56700cdfd0 0x7f5670167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205576914 0 0) 0x7f567015d300 con 0x7f567015cf20 2023-12-19T17:52:09.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56580035d0 con 0x7f567015cf20 2023-12-19T17:52:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226755946 0 0) 0x7f56700d1550 con 0x7f56700b8580 2023-12-19T17:52:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f567015d300 con 0x7f56700b8580 2023-12-19T17:52:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566f7fe700 1 -- 172.21.15.45:0/2989820985 >> v1:172.21.15.73:6789/0 conn(0x7f56700b8580 legacy=0x7f56700cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566f7fe700 1 -- 172.21.15.45:0/2989820985 >> v1:172.21.15.45:6789/0 conn(0x7f567015cf20 legacy=0x7f56700d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.090+0000 7f566f7fe700 1 -- 172.21.15.45:0/2989820985 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56700d1830 con 0x7f56700cdfd0 2023-12-19T17:52:09.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566f7fe700 1 --2- 172.21.15.45:0/2989820985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700cdfd0 0x7f5670167a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5668009d90 tx=0x7f566800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85dbe200b637ea7e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566800e070 con 0x7f56700cdfd0 2023-12-19T17:52:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566800bb20 con 0x7f56700cdfd0 2023-12-19T17:52:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566dffb700 1 -- 172.21.15.45:0/2989820985 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5668012430 con 0x7f56700cdfd0 2023-12-19T17:52:09.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 -- 172.21.15.45:0/2989820985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700cdfd0 msgr2=0x7f5670167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 --2- 172.21.15.45:0/2989820985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700cdfd0 0x7f5670167a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5668009d90 tx=0x7f566800b330 comp rx=0 tx=0).stop 2023-12-19T17:52:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 -- 172.21.15.45:0/2989820985 shutdown_connections 2023-12-19T17:52:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 --2- 172.21.15.45:0/2989820985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700cdfd0 0x7f5670167a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 -- 172.21.15.45:0/2989820985 >> 172.21.15.45:0/2989820985 conn(0x7f56700b4670 msgr2=0x7f56700b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 -- 172.21.15.45:0/2989820985 shutdown_connections 2023-12-19T17:52:09.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.094+0000 7f566ffff700 1 -- 172.21.15.45:0/2989820985 wait complete. 2023-12-19T17:52:09.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 Processor -- start 2023-12-19T17:52:09.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 -- start start 2023-12-19T17:52:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700b8580 0x7f567014a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 0x7f567015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f567015cf20 0x7f56700b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567014abf0 con 0x7f56700cdfd0 2023-12-19T17:52:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567015f870 con 0x7f56700b8580 2023-12-19T17:52:09.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567015fb50 con 0x7f567015cf20 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 0x7f567015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 0x7f567015ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41288/0 (socket says 172.21.15.45:41288) 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 -- 172.21.15.45:0/3027051378 learned_addr learned my addr 172.21.15.45:0/3027051378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566effd700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700b8580 0x7f567014a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566f7fe700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f567015cf20 0x7f56700b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 -- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f567015cf20 msgr2=0x7f56700b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f567015cf20 0x7f56700b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 -- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700b8580 msgr2=0x7f567014a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700b8580 0x7f567014a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 -- 172.21.15.45:0/3027051378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668009a70 con 0x7f56700cdfd0 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566effd700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700b8580 0x7f567014a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:09.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.098+0000 7f566e7fc700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 0x7f567015ee20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f566400c730 tx=0x7f566400caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640052d0 con 0x7f56700cdfd0 2023-12-19T17:52:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5664005430 con 0x7f56700cdfd0 2023-12-19T17:52:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56640055a0 con 0x7f56700cdfd0 2023-12-19T17:52:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567015fe30 con 0x7f56700cdfd0 2023-12-19T17:52:09.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56701603f0 con 0x7f56700cdfd0 2023-12-19T17:52:09.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56700a95e0 con 0x7f56700cdfd0 2023-12-19T17:52:09.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.102+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f56640038e0 con 0x7f56700cdfd0 2023-12-19T17:52:09.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.106+0000 7f56577fe700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f565c065ad0 0x7f565c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.106+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5664082a90 con 0x7f56700cdfd0 2023-12-19T17:52:09.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.106+0000 7f566effd700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f565c065ad0 0x7f565c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.106+0000 7f566effd700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f565c065ad0 0x7f565c067f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5660005930 tx=0x7f5660009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.114+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f56640500d0 con 0x7f56700cdfd0 2023-12-19T17:52:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.290+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f567004ed30 con 0x7f56700cdfd0 2023-12-19T17:52:09.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f56577fe700 1 -- 172.21.15.45:0/3027051378 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f56640170a0 con 0x7f56700cdfd0 2023-12-19T17:52:09.295 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f565c065ad0 msgr2=0x7f565c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f565c065ad0 0x7f565c067f90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5660005930 tx=0x7f5660009040 comp rx=0 tx=0).stop 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 msgr2=0x7f567015ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 0x7f567015ee20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f566400c730 tx=0x7f566400caf0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 shutdown_connections 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f565c065ad0 0x7f565c067f90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f567015cf20 0x7f56700b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56700cdfd0 0x7f567015ee20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 --2- 172.21.15.45:0/3027051378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56700b8580 0x7f567014a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 >> 172.21.15.45:0/3027051378 conn(0x7f56700b4670 msgr2=0x7f56700b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 shutdown_connections 2023-12-19T17:52:09.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.294+0000 7f566ffff700 1 -- 172.21.15.45:0/3027051378 wait complete. 2023-12-19T17:52:09.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.494+0000 7f583d408700 1 Processor -- start 2023-12-19T17:52:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.494+0000 7f583d408700 1 -- start start 2023-12-19T17:52:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f583d408700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f58380b8580 0x7f58380cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f583d408700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583815d300 con 0x7f58380d25f0 2023-12-19T17:52:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f583d408700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58380d1550 con 0x7f583815cf20 2023-12-19T17:52:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f583d408700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380d1360 con 0x7f58380b8580 2023-12-19T17:52:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f583cc07700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f58380d25f0 0x7f58380b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48920/0 (socket says 172.21.15.45:48920) 2023-12-19T17:52:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f583cc07700 1 -- 172.21.15.45:0/4179080348 learned_addr learned my addr 172.21.15.45:0/4179080348 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f58377fe700 1 --2- 172.21.15.45:0/4179080348 >> v2:172.21.15.73:3300/0 conn(0x7f58380b8580 0x7f58380cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f5836ffd700 1 -- 172.21.15.45:0/4179080348 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079031128 0 0) 0x7f583815d300 con 0x7f58380d25f0 2023-12-19T17:52:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f5836ffd700 1 -- 172.21.15.45:0/4179080348 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58200035d0 con 0x7f58380d25f0 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f5836ffd700 1 -- 172.21.15.45:0/4179080348 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582049821 0 0) 0x7f58380d1550 con 0x7f583815cf20 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f58377fe700 1 -- 172.21.15.45:0/4179080348 >> v1:172.21.15.73:6789/0 conn(0x7f583815cf20 legacy=0x7f58380d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f58377fe700 1 -- 172.21.15.45:0/4179080348 >> v1:172.21.15.45:6789/0 conn(0x7f58380d25f0 legacy=0x7f58380b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f58377fe700 1 -- 172.21.15.45:0/4179080348 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380d1830 con 0x7f58380b8580 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.498+0000 7f58377fe700 1 --2- 172.21.15.45:0/4179080348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58380b8580 0x7f58380cd8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f582c009850 tx=0x7f582c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fea87961d2d413ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f5836ffd700 1 -- 172.21.15.45:0/4179080348 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c011830 con 0x7f58380b8580 2023-12-19T17:52:09.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f5836ffd700 1 -- 172.21.15.45:0/4179080348 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c011990 con 0x7f58380b8580 2023-12-19T17:52:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f5836ffd700 1 -- 172.21.15.45:0/4179080348 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c011d40 con 0x7f58380b8580 2023-12-19T17:52:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 -- 172.21.15.45:0/4179080348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58380b8580 msgr2=0x7f58380cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 --2- 172.21.15.45:0/4179080348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58380b8580 0x7f58380cd8c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f582c009850 tx=0x7f582c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 -- 172.21.15.45:0/4179080348 shutdown_connections 2023-12-19T17:52:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 --2- 172.21.15.45:0/4179080348 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f58380b8580 0x7f58380cd8c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 -- 172.21.15.45:0/4179080348 >> 172.21.15.45:0/4179080348 conn(0x7f58380b4670 msgr2=0x7f58380b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 -- 172.21.15.45:0/4179080348 shutdown_connections 2023-12-19T17:52:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 -- 172.21.15.45:0/4179080348 wait complete. 2023-12-19T17:52:09.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 Processor -- start 2023-12-19T17:52:09.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.502+0000 7f583d408700 1 -- start start 2023-12-19T17:52:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f58380b8580 0x7f5838159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 0x7f583806eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583815cf20 0x7f583806f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380ca790 con 0x7f58380d25f0 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380cb730 con 0x7f583815cf20 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f583815f0b0 con 0x7f58380b8580 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 0x7f583806eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 0x7f583806eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41298/0 (socket says 172.21.15.45:41298) 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 -- 172.21.15.45:0/3784312266 learned_addr learned my addr 172.21.15.45:0/3784312266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583cc07700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583815cf20 0x7f583806f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f5837fff700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f58380b8580 0x7f5838159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 -- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f58380b8580 msgr2=0x7f5838159010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f58380b8580 0x7f5838159010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 -- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583815cf20 msgr2=0x7f583806f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583815cf20 0x7f583806f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 -- 172.21.15.45:0/3784312266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0094b0 con 0x7f58380d25f0 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583cc07700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583815cf20 0x7f583806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f58377fe700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 0x7f583806eac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f582c009eb0 tx=0x7f582c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c01aba0 con 0x7f58380d25f0 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c01f070 con 0x7f58380d25f0 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c01b430 con 0x7f58380d25f0 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58380c9df0 con 0x7f58380d25f0 2023-12-19T17:52:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.506+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58380ca3b0 con 0x7f58380d25f0 2023-12-19T17:52:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.510+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5838160520 con 0x7f58380d25f0 2023-12-19T17:52:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.510+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f582c01b590 con 0x7f58380d25f0 2023-12-19T17:52:09.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.510+0000 7f5834ff9700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5824065ad0 0x7f5824067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.510+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f582c084600 con 0x7f58380d25f0 2023-12-19T17:52:09.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.514+0000 7f5837fff700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5824065ad0 0x7f5824067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.514+0000 7f5837fff700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5824065ad0 0x7f5824067f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5828000f60 tx=0x7f5828009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.518+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f582c051cc0 con 0x7f58380d25f0 2023-12-19T17:52:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.702+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58380b1fd0 con 0x7f58380d25f0 2023-12-19T17:52:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.702+0000 7f5834ff9700 1 -- 172.21.15.45:0/3784312266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f582c0210a0 con 0x7f58380d25f0 2023-12-19T17:52:09.705 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5824065ad0 msgr2=0x7f5824067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5824065ad0 0x7f5824067f90 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5828000f60 tx=0x7f5828009040 comp rx=0 tx=0).stop 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 msgr2=0x7f583806eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 0x7f583806eac0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f582c009eb0 tx=0x7f582c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 shutdown_connections 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5824065ad0 0x7f5824067f90 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f583815cf20 0x7f583806f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58380d25f0 0x7f583806eac0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 --2- 172.21.15.45:0/3784312266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f58380b8580 0x7f5838159010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 >> 172.21.15.45:0/3784312266 conn(0x7f58380b4670 msgr2=0x7f583815af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 shutdown_connections 2023-12-19T17:52:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.706+0000 7f583d408700 1 -- 172.21.15.45:0/3784312266 wait complete. 2023-12-19T17:52:09.733 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 Processor -- start 2023-12-19T17:52:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 -- start start 2023-12-19T17:52:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4964071ae0 0x7f49640cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49640cb840 0x7f49640b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640b1b80 con 0x7f49641443e0 2023-12-19T17:52:09.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49641447c0 con 0x7f49640cb840 2023-12-19T17:52:09.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f4968a1d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49640b1830 con 0x7f4964071ae0 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49640cb840 0x7f49640b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f49640cb840 0x7f49640b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41302/0 (socket says 172.21.15.45:41302) 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 -- 172.21.15.45:0/2385651166 learned_addr learned my addr 172.21.15.45:0/2385651166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f495a59c700 1 --2- 172.21.15.45:0/2385651166 >> v2:172.21.15.73:3300/0 conn(0x7f4964071ae0 0x7f49640cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 -- 172.21.15.45:0/2385651166 >> v2:172.21.15.73:3300/0 conn(0x7f4964071ae0 msgr2=0x7f49640cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 --2- 172.21.15.45:0/2385651166 >> v2:172.21.15.73:3300/0 conn(0x7f4964071ae0 0x7f49640cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 -- 172.21.15.45:0/2385651166 >> v1:172.21.15.73:6789/0 conn(0x7f49641443e0 legacy=0x7f49640713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 -- 172.21.15.45:0/2385651166 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49640cc070 con 0x7f49640cb840 2023-12-19T17:52:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.914+0000 7f496359e700 1 --2- 172.21.15.45:0/2385651166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49640cb840 0x7f49640b2010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f496406c630 tx=0x7f495c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b55ec063eca798 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f496259c700 1 -- 172.21.15.45:0/2385651166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c005ea0 con 0x7f49640cb840 2023-12-19T17:52:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f496259c700 1 -- 172.21.15.45:0/2385651166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f495c006030 con 0x7f49640cb840 2023-12-19T17:52:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f496259c700 1 -- 172.21.15.45:0/2385651166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c0063c0 con 0x7f49640cb840 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 -- 172.21.15.45:0/2385651166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49640cb840 msgr2=0x7f49640b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 --2- 172.21.15.45:0/2385651166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49640cb840 0x7f49640b2010 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f496406c630 tx=0x7f495c009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 -- 172.21.15.45:0/2385651166 shutdown_connections 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 --2- 172.21.15.45:0/2385651166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49640cb840 0x7f49640b2010 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 --2- 172.21.15.45:0/2385651166 >> v2:172.21.15.73:3300/0 conn(0x7f4964071ae0 0x7f49640cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 -- 172.21.15.45:0/2385651166 >> 172.21.15.45:0/2385651166 conn(0x7f49640cf5a0 msgr2=0x7f4964070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 -- 172.21.15.45:0/2385651166 shutdown_connections 2023-12-19T17:52:09.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 -- 172.21.15.45:0/2385651166 wait complete. 2023-12-19T17:52:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 Processor -- start 2023-12-19T17:52:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.918+0000 7f4968a1d700 1 -- start start 2023-12-19T17:52:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f49640cb840 0x7f4964141c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 0x7f49640aa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496415d740 0x7f49640aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640aa710 con 0x7f49641443e0 2023-12-19T17:52:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496415cca0 con 0x7f496415d740 2023-12-19T17:52:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640a94a0 con 0x7f49640cb840 2023-12-19T17:52:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 0x7f49640aa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 0x7f49640aa1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41308/0 (socket says 172.21.15.45:41308) 2023-12-19T17:52:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 -- 172.21.15.45:0/803875020 learned_addr learned my addr 172.21.15.45:0/803875020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 -- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f49640cb840 msgr2=0x7f4964141c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4962d9d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f49640cb840 0x7f4964141c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f496359e700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496415d740 0x7f49640aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f49640cb840 0x7f4964141c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 -- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496415d740 msgr2=0x7f49640aaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496415d740 0x7f49640aaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 -- 172.21.15.45:0/803875020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c009570 con 0x7f49641443e0 2023-12-19T17:52:09.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f496359e700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496415d740 0x7f49640aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4962d9d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f49640cb840 0x7f4964141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495a59c700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 0x7f49640aa1d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e760 tx=0x7f494c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c013610 con 0x7f49641443e0 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494c013770 con 0x7f49641443e0 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640a9780 con 0x7f49641443e0 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494c013ae0 con 0x7f49641443e0 2023-12-19T17:52:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.922+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496415d220 con 0x7f49641443e0 2023-12-19T17:52:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.926+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f494c013c40 con 0x7f49641443e0 2023-12-19T17:52:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.926+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f496415d410 con 0x7f49641443e0 2023-12-19T17:52:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.926+0000 7f495bfff700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4944065b00 0x7f4944067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.926+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f494c083170 con 0x7f49641443e0 2023-12-19T17:52:09.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.926+0000 7f4962d9d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4944065b00 0x7f4944067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.926+0000 7f4962d9d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4944065b00 0x7f4944067fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4954002160 tx=0x7f4954009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:09.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:09.934+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f494c0507a0 con 0x7f49641443e0 2023-12-19T17:52:10.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.106+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f496404ed30 con 0x7f49641443e0 2023-12-19T17:52:10.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.106+0000 7f495bfff700 1 -- 172.21.15.45:0/803875020 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f494c053dc0 con 0x7f49641443e0 2023-12-19T17:52:10.110 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4944065b00 msgr2=0x7f4944067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4944065b00 0x7f4944067fc0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4954002160 tx=0x7f4954009040 comp rx=0 tx=0).stop 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 msgr2=0x7f49640aa1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 0x7f49640aa1d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e760 tx=0x7f494c00eb20 comp rx=0 tx=0).stop 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 shutdown_connections 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4944065b00 0x7f4944067fc0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f496415d740 0x7f49640aaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f49641443e0 0x7f49640aa1d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 --2- 172.21.15.45:0/803875020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f49640cb840 0x7f4964141c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 >> 172.21.15.45:0/803875020 conn(0x7f4964071ae0 msgr2=0x7f496406d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 shutdown_connections 2023-12-19T17:52:10.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.110+0000 7f4968a1d700 1 -- 172.21.15.45:0/803875020 wait complete. 2023-12-19T17:52:10.135 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:52:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.306+0000 7f57cf59e700 1 Processor -- start 2023-12-19T17:52:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.306+0000 7f57cf59e700 1 -- start start 2023-12-19T17:52:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57cf59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57d01591b0 0x7f57d006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57cf59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57d00c4120 0x7f57d00c45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57cf59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57d00c3e20 con 0x7f57d0159590 2023-12-19T17:52:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57cf59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00cadb0 con 0x7f57d01591b0 2023-12-19T17:52:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57cf59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57d00c4b10 con 0x7f57d00c4120 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57d01591b0 0x7f57d006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57d01591b0 0x7f57d006ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41310/0 (socket says 172.21.15.45:41310) 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 -- 172.21.15.45:0/3761610791 learned_addr learned my addr 172.21.15.45:0/3761610791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ced9d700 1 --2- 172.21.15.45:0/3761610791 >> v2:172.21.15.73:3300/0 conn(0x7f57d00c4120 0x7f57d00c45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 -- 172.21.15.45:0/3761610791 >> v2:172.21.15.73:3300/0 conn(0x7f57d00c4120 msgr2=0x7f57d00c45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 --2- 172.21.15.45:0/3761610791 >> v2:172.21.15.73:3300/0 conn(0x7f57d00c4120 0x7f57d00c45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 -- 172.21.15.45:0/3761610791 >> v1:172.21.15.73:6789/0 conn(0x7f57d0159590 legacy=0x7f57d00c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.310+0000 7f57ce59c700 1 -- 172.21.15.45:0/3761610791 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57d00ca7f0 con 0x7f57d01591b0 2023-12-19T17:52:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57ce59c700 1 --2- 172.21.15.45:0/3761610791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d01591b0 0x7f57d006ea90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f57d00afa80 tx=0x7f57c000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d35bb40b85a7571d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cdd9b700 1 -- 172.21.15.45:0/3761610791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c000dd90 con 0x7f57d01591b0 2023-12-19T17:52:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cdd9b700 1 -- 172.21.15.45:0/3761610791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c0010470 con 0x7f57d01591b0 2023-12-19T17:52:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cdd9b700 1 -- 172.21.15.45:0/3761610791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c0010800 con 0x7f57d01591b0 2023-12-19T17:52:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 -- 172.21.15.45:0/3761610791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d01591b0 msgr2=0x7f57d006ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3761610791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d01591b0 0x7f57d006ea90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f57d00afa80 tx=0x7f57c000be90 comp rx=0 tx=0).stop 2023-12-19T17:52:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 -- 172.21.15.45:0/3761610791 shutdown_connections 2023-12-19T17:52:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3761610791 >> v2:172.21.15.73:3300/0 conn(0x7f57d00c4120 0x7f57d00c45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3761610791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d01591b0 0x7f57d006ea90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 -- 172.21.15.45:0/3761610791 >> 172.21.15.45:0/3761610791 conn(0x7f57d00cb900 msgr2=0x7f57d00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 -- 172.21.15.45:0/3761610791 shutdown_connections 2023-12-19T17:52:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.314+0000 7f57cf59e700 1 -- 172.21.15.45:0/3761610791 wait complete. 2023-12-19T17:52:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 Processor -- start 2023-12-19T17:52:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 -- start start 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d00c4120 0x7f57d00b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57d01591b0 0x7f57d00aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 0x7f57d00b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00b3500 con 0x7f57d015c050 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00af3d0 con 0x7f57d00c4120 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57cf59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57d00b28f0 con 0x7f57d01591b0 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 0x7f57d00b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 0x7f57d00b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41314/0 (socket says 172.21.15.45:41314) 2023-12-19T17:52:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 -- 172.21.15.45:0/3090342428 learned_addr learned my addr 172.21.15.45:0/3090342428 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ce59c700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d00c4120 0x7f57d00b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57c5d9b700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57d01591b0 0x7f57d00aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 -- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57d01591b0 msgr2=0x7f57d00aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57d01591b0 0x7f57d00aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 -- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d00c4120 msgr2=0x7f57d00b3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d00c4120 0x7f57d00b3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 -- 172.21.15.45:0/3090342428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c000b810 con 0x7f57d015c050 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ce59c700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d00c4120 0x7f57d00b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57c5d9b700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57d01591b0 0x7f57d00aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.318+0000 7f57ced9d700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 0x7f57d00b1f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f57c8007e70 tx=0x7f57c800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c800ee50 con 0x7f57d015c050 2023-12-19T17:52:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c8014420 con 0x7f57d015c050 2023-12-19T17:52:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c80147d0 con 0x7f57d015c050 2023-12-19T17:52:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57d00b2bd0 con 0x7f57d015c050 2023-12-19T17:52:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57d00b3190 con 0x7f57d015c050 2023-12-19T17:52:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57d00b3670 con 0x7f57d015c050 2023-12-19T17:52:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.322+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57c8014930 con 0x7f57d015c050 2023-12-19T17:52:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.326+0000 7f57c77fe700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f57b0065ad0 0x7f57b0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.326+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57c8083bf0 con 0x7f57d015c050 2023-12-19T17:52:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.326+0000 7f57ce59c700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f57b0065ad0 0x7f57b0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.326+0000 7f57ce59c700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f57b0065ad0 0x7f57b0067f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57c000bfd0 tx=0x7f57c0013000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:10.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.330+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57c8051350 con 0x7f57d015c050 2023-12-19T17:52:10.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.542+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57d0067760 con 0x7f57d015c050 2023-12-19T17:52:10.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.542+0000 7f57c77fe700 1 -- 172.21.15.45:0/3090342428 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f57c8054970 con 0x7f57d015c050 2023-12-19T17:52:10.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:10.545 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:52:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f57b0065ad0 msgr2=0x7f57b0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f57b0065ad0 0x7f57b0067f90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f57c000bfd0 tx=0x7f57c0013000 comp rx=0 tx=0).stop 2023-12-19T17:52:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 msgr2=0x7f57d00b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 0x7f57d00b1f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f57c8007e70 tx=0x7f57c800e3c0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 shutdown_connections 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f57b0065ad0 0x7f57b0067f90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57d015c050 0x7f57d00b1f80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57d01591b0 0x7f57d00aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 --2- 172.21.15.45:0/3090342428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57d00c4120 0x7f57d00b3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 >> 172.21.15.45:0/3090342428 conn(0x7f57d00cb900 msgr2=0x7f57d00cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:10.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 shutdown_connections 2023-12-19T17:52:10.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.546+0000 7f57cf59e700 1 -- 172.21.15.45:0/3090342428 wait complete. 2023-12-19T17:52:10.550 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:52:10.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.746+0000 7f0b7d09b700 1 Processor -- start 2023-12-19T17:52:10.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.746+0000 7f0b7d09b700 1 -- start start 2023-12-19T17:52:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.746+0000 7f0b7d09b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b780c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.746+0000 7f0b7d09b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b78164a70 0x7f0b780c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7d09b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b780cdb80 con 0x7f0b780cce30 2023-12-19T17:52:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7d09b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b780cde60 con 0x7f0b78164a70 2023-12-19T17:52:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7d09b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b780ce140 con 0x7f0b78164690 2023-12-19T17:52:10.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b78164a70 0x7f0b780c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b780c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7759e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0b780cce30 0x7f0b780cd2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:60968/0 (socket says 172.21.15.45:60968) 2023-12-19T17:52:10.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7759e700 1 -- 172.21.15.45:0/2090746265 learned_addr learned my addr 172.21.15.45:0/2090746265 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:10.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7659c700 1 -- 172.21.15.45:0/2090746265 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 msgr2=0x7f0b780c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:10.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b75d9b700 1 -- 172.21.15.45:0/2090746265 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2188374627 0 0) 0x7f0b780cdb80 con 0x7f0b780cce30 2023-12-19T17:52:10.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7659c700 1 --2- 172.21.15.45:0/2090746265 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b780c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7659c700 1 -- 172.21.15.45:0/2090746265 >> v1:172.21.15.73:6789/0 conn(0x7f0b780cce30 legacy=0x7f0b780cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7659c700 1 -- 172.21.15.45:0/2090746265 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b780ce420 con 0x7f0b78164a70 2023-12-19T17:52:10.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7659c700 1 --2- 172.21.15.45:0/2090746265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b78164a70 0x7f0b780c4340 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009850 tx=0x7f0b6c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd073be5f7c16548 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:10.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b75d9b700 1 -- 172.21.15.45:0/2090746265 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c011830 con 0x7f0b78164a70 2023-12-19T17:52:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b75d9b700 1 -- 172.21.15.45:0/2090746265 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6c011990 con 0x7f0b78164a70 2023-12-19T17:52:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b75d9b700 1 -- 172.21.15.45:0/2090746265 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6c011d40 con 0x7f0b78164a70 2023-12-19T17:52:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7d09b700 1 -- 172.21.15.45:0/2090746265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b78164a70 msgr2=0x7f0b780c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.750+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/2090746265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b78164a70 0x7f0b780c4340 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c009850 tx=0x7f0b6c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:10.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.754+0000 7f0b7d09b700 1 -- 172.21.15.45:0/2090746265 shutdown_connections 2023-12-19T17:52:10.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.754+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/2090746265 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b78164a70 0x7f0b780c4340 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.754+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/2090746265 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b780c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.754+0000 7f0b7d09b700 1 -- 172.21.15.45:0/2090746265 >> 172.21.15.45:0/2090746265 conn(0x7f0b780cba40 msgr2=0x7f0b780ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:10.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.754+0000 7f0b7d09b700 1 -- 172.21.15.45:0/2090746265 shutdown_connections 2023-12-19T17:52:10.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.754+0000 7f0b7d09b700 1 -- 172.21.15.45:0/2090746265 wait complete. 2023-12-19T17:52:10.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 Processor -- start 2023-12-19T17:52:10.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 -- start start 2023-12-19T17:52:10.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 0x7f0b78160640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b781fa060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b78164a70 0x7f0b781fa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78156560 con 0x7f0b780cce30 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78162bb0 con 0x7f0b78164a70 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7d09b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b78163170 con 0x7f0b78164690 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 0x7f0b78160640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b76d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 0x7f0b78160640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41334/0 (socket says 172.21.15.45:41334) 2023-12-19T17:52:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b76d9d700 1 -- 172.21.15.45:0/1989796843 learned_addr learned my addr 172.21.15.45:0/1989796843 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7659c700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b781fa060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.758+0000 7f0b7759e700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b78164a70 0x7f0b781fa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b76d9d700 1 -- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 msgr2=0x7f0b781fa060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b76d9d700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b781fa060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b76d9d700 1 -- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b78164a70 msgr2=0x7f0b781fa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b76d9d700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b78164a70 0x7f0b781fa5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b76d9d700 1 -- 172.21.15.45:0/1989796843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c0094b0 con 0x7f0b780cce30 2023-12-19T17:52:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b76d9d700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 0x7f0b78160640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800ea00 tx=0x7f0b6800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68009720 con 0x7f0b780cce30 2023-12-19T17:52:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6800eea0 con 0x7f0b780cce30 2023-12-19T17:52:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b780b1a40 con 0x7f0b780cce30 2023-12-19T17:52:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800ca50 con 0x7f0b780cce30 2023-12-19T17:52:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b78162e00 con 0x7f0b780cce30 2023-12-19T17:52:10.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.762+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b7804ed30 con 0x7f0b780cce30 2023-12-19T17:52:10.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.766+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b6800cbb0 con 0x7f0b780cce30 2023-12-19T17:52:10.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.766+0000 7f0b5f7fe700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b64065b00 0x7f0b64067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:10.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.766+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b680837f0 con 0x7f0b780cce30 2023-12-19T17:52:10.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.766+0000 7f0b7659c700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b64065b00 0x7f0b64067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:10.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.766+0000 7f0b7659c700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b64065b00 0x7f0b64067fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0090b0 tx=0x7f0b6c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:10.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.774+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0b68050e20 con 0x7f0b780cce30 2023-12-19T17:52:10.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.958+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b7806dee0 con 0x7f0b780cce30 2023-12-19T17:52:10.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.958+0000 7f0b5f7fe700 1 -- 172.21.15.45:0/1989796843 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7f0b68054440 con 0x7f0b780cce30 2023-12-19T17:52:10.962 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:10.963 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b64065b00 msgr2=0x7f0b64067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b64065b00 0x7f0b64067fc0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0090b0 tx=0x7f0b6c01c040 comp rx=0 tx=0).stop 2023-12-19T17:52:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 msgr2=0x7f0b78160640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:10.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 0x7f0b78160640 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800ea00 tx=0x7f0b6800ed10 comp rx=0 tx=0).stop 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 shutdown_connections 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b64065b00 0x7f0b64067fc0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b78164a70 0x7f0b781fa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b78164690 0x7f0b781fa060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 --2- 172.21.15.45:0/1989796843 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b780cce30 0x7f0b78160640 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 >> 172.21.15.45:0/1989796843 conn(0x7f0b780cba40 msgr2=0x7f0b780ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 shutdown_connections 2023-12-19T17:52:10.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:10.962+0000 7f0b7d09b700 1 -- 172.21.15.45:0/1989796843 wait complete. 2023-12-19T17:52:10.988 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:10.988 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.166+0000 7ff1ab59e700 1 Processor -- start 2023-12-19T17:52:11.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.166+0000 7ff1ab59e700 1 -- start start 2023-12-19T17:52:11.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1ab59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac15cf20 0x7ff1ac0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1ab59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff1ac0cdfd0 0x7ff1ac0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1ab59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1ac15d300 con 0x7ff1ac0b8580 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1ab59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1ac0d1550 con 0x7ff1ac0cdfd0 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1ab59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0d1830 con 0x7ff1ac15cf20 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1a9d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1ac0b8580 0x7ff1ac0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48936/0 (socket says 172.21.15.45:48936) 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1a9d9b700 1 -- 172.21.15.45:0/3244668868 learned_addr learned my addr 172.21.15.45:0/3244668868 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:11.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1aa59c700 1 --2- 172.21.15.45:0/3244668868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac15cf20 0x7ff1ac0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.170+0000 7ff1aad9d700 1 --2- 172.21.15.45:0/3244668868 >> v2:172.21.15.73:3300/0 conn(0x7ff1ac0cdfd0 0x7ff1ac0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1aa59c700 1 -- 172.21.15.45:0/3244668868 >> v2:172.21.15.73:3300/0 conn(0x7ff1ac0cdfd0 msgr2=0x7ff1ac0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1aa59c700 1 --2- 172.21.15.45:0/3244668868 >> v2:172.21.15.73:3300/0 conn(0x7ff1ac0cdfd0 0x7ff1ac0b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1aa59c700 1 -- 172.21.15.45:0/3244668868 >> v1:172.21.15.45:6789/0 conn(0x7ff1ac0b8580 legacy=0x7ff1ac0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1aa59c700 1 -- 172.21.15.45:0/3244668868 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1ac0d1b10 con 0x7ff1ac15cf20 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1a959a700 1 -- 172.21.15.45:0/3244668868 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 276067502 0 0) 0x7ff1ac15d300 con 0x7ff1ac0b8580 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1aa59c700 1 --2- 172.21.15.45:0/3244668868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac15cf20 0x7ff1ac0d0c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009850 tx=0x7ff19c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a2d3ae9b6392225 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:11.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1a959a700 1 -- 172.21.15.45:0/3244668868 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c011830 con 0x7ff1ac15cf20 2023-12-19T17:52:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1a959a700 1 -- 172.21.15.45:0/3244668868 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c011990 con 0x7ff1ac15cf20 2023-12-19T17:52:11.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1a959a700 1 -- 172.21.15.45:0/3244668868 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c011d40 con 0x7ff1ac15cf20 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 -- 172.21.15.45:0/3244668868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac15cf20 msgr2=0x7ff1ac0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/3244668868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac15cf20 0x7ff1ac0d0c50 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009850 tx=0x7ff19c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 -- 172.21.15.45:0/3244668868 shutdown_connections 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/3244668868 >> v2:172.21.15.73:3300/0 conn(0x7ff1ac0cdfd0 0x7ff1ac0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/3244668868 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac15cf20 0x7ff1ac0d0c50 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 -- 172.21.15.45:0/3244668868 >> 172.21.15.45:0/3244668868 conn(0x7ff1ac0b4670 msgr2=0x7ff1ac0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:11.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 -- 172.21.15.45:0/3244668868 shutdown_connections 2023-12-19T17:52:11.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.174+0000 7ff1ab59e700 1 -- 172.21.15.45:0/3244668868 wait complete. 2023-12-19T17:52:11.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.178+0000 7ff1ab59e700 1 Processor -- start 2023-12-19T17:52:11.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.178+0000 7ff1ab59e700 1 -- start start 2023-12-19T17:52:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac0b8580 0x7ff1ac15f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 0x7ff1ac1f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1ac15cf20 0x7ff1ac0b0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1f7770 con 0x7ff1ac0cdfd0 2023-12-19T17:52:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac1f6ca0 con 0x7ff1ac15cf20 2023-12-19T17:52:11.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1ac0b13f0 con 0x7ff1ac0b8580 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1a9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 0x7ff1ac1f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac0b8580 0x7ff1ac15f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aad9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1ac15cf20 0x7ff1ac0b0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1a9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 0x7ff1ac1f6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41336/0 (socket says 172.21.15.45:41336) 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1a9d9b700 1 -- 172.21.15.45:0/331824389 learned_addr learned my addr 172.21.15.45:0/331824389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 -- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1ac15cf20 msgr2=0x7ff1ac0b0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1ac15cf20 0x7ff1ac0b0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 -- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 msgr2=0x7ff1ac1f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 0x7ff1ac1f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 -- 172.21.15.45:0/331824389 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c0094b0 con 0x7ff1ac0b8580 2023-12-19T17:52:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1a9d9b700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 0x7ff1ac1f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:11.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1aa59c700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac0b8580 0x7ff1ac15f540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff19c016000 tx=0x7ff19c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c019980 con 0x7ff1ac0b8580 2023-12-19T17:52:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c01e070 con 0x7ff1ac0b8580 2023-12-19T17:52:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1ac1f6ed0 con 0x7ff1ac0b8580 2023-12-19T17:52:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c019d40 con 0x7ff1ac0b8580 2023-12-19T17:52:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.182+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1ac1f7490 con 0x7ff1ac0b8580 2023-12-19T17:52:11.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.186+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1ac04ed30 con 0x7ff1ac0b8580 2023-12-19T17:52:11.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.186+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff19c02d450 con 0x7ff1ac0b8580 2023-12-19T17:52:11.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.190+0000 7ff19affd700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff18c065ad0 0x7ff18c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.190+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff19c084360 con 0x7ff1ac0b8580 2023-12-19T17:52:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.190+0000 7ff1a9d9b700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff18c065ad0 0x7ff18c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.190+0000 7ff1a9d9b700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff18c065ad0 0x7ff18c067f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac160660 tx=0x7ff1a0007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:11.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.198+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff19c051a20 con 0x7ff1ac0b8580 2023-12-19T17:52:11.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.374+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1ac0b3040 con 0x7ff1ac0b8580 2023-12-19T17:52:11.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.378+0000 7ff19affd700 1 -- 172.21.15.45:0/331824389 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff19c0200a0 con 0x7ff1ac0b8580 2023-12-19T17:52:11.380 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff18c065ad0 msgr2=0x7ff18c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff18c065ad0 0x7ff18c067f90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac160660 tx=0x7ff1a0007e90 comp rx=0 tx=0).stop 2023-12-19T17:52:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac0b8580 msgr2=0x7ff1ac15f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac0b8580 0x7ff1ac15f540 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff19c016000 tx=0x7ff19c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 shutdown_connections 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff18c065ad0 0x7ff18c067f90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1ac15cf20 0x7ff1ac0b0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1ac0cdfd0 0x7ff1ac1f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 --2- 172.21.15.45:0/331824389 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1ac0b8580 0x7ff1ac15f540 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 >> 172.21.15.45:0/331824389 conn(0x7ff1ac0b4670 msgr2=0x7ff1ac0cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 shutdown_connections 2023-12-19T17:52:11.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.382+0000 7ff1ab59e700 1 -- 172.21.15.45:0/331824389 wait complete. 2023-12-19T17:52:11.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.590+0000 7f182620f700 1 Processor -- start 2023-12-19T17:52:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.590+0000 7f182620f700 1 -- start start 2023-12-19T17:52:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f182620f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200b8580 0x7f18200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f182620f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182015d300 con 0x7f18200d25f0 2023-12-19T17:52:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f182620f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18200d1550 con 0x7f182015cf20 2023-12-19T17:52:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f182620f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18200d1360 con 0x7f18200b8580 2023-12-19T17:52:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1825a0e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f18200d25f0 0x7f18200b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48944/0 (socket says 172.21.15.45:48944) 2023-12-19T17:52:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1825a0e700 1 -- 172.21.15.45:0/1681841088 learned_addr learned my addr 172.21.15.45:0/1681841088 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f182520d700 1 --1- 172.21.15.45:0/1681841088 >> v1:172.21.15.73:6789/0 conn(0x7f182015cf20 0x7f18200d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:60976/0 (socket says 172.21.15.45:60976) 2023-12-19T17:52:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1824a0c700 1 --2- 172.21.15.45:0/1681841088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200b8580 0x7f18200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1817fff700 1 -- 172.21.15.45:0/1681841088 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2230868400 0 0) 0x7f182015d300 con 0x7f18200d25f0 2023-12-19T17:52:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1824a0c700 1 -- 172.21.15.45:0/1681841088 >> v1:172.21.15.73:6789/0 conn(0x7f182015cf20 legacy=0x7f18200d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1824a0c700 1 -- 172.21.15.45:0/1681841088 >> v1:172.21.15.45:6789/0 conn(0x7f18200d25f0 legacy=0x7f18200b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1824a0c700 1 -- 172.21.15.45:0/1681841088 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18200d1830 con 0x7f18200b8580 2023-12-19T17:52:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.594+0000 7f1824a0c700 1 --2- 172.21.15.45:0/1681841088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200b8580 0x7f18200cd8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1810009800 tx=0x7f1810009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34a7b8558bcfc286 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:11.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f1817fff700 1 -- 172.21.15.45:0/1681841088 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810004230 con 0x7f18200b8580 2023-12-19T17:52:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f1817fff700 1 -- 172.21.15.45:0/1681841088 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1810004390 con 0x7f18200b8580 2023-12-19T17:52:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f1817fff700 1 -- 172.21.15.45:0/1681841088 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18100036c0 con 0x7f18200b8580 2023-12-19T17:52:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 -- 172.21.15.45:0/1681841088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200b8580 msgr2=0x7f18200cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 --2- 172.21.15.45:0/1681841088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200b8580 0x7f18200cd8c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1810009800 tx=0x7f1810009b10 comp rx=0 tx=0).stop 2023-12-19T17:52:11.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 -- 172.21.15.45:0/1681841088 shutdown_connections 2023-12-19T17:52:11.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 --2- 172.21.15.45:0/1681841088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200b8580 0x7f18200cd8c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 -- 172.21.15.45:0/1681841088 >> 172.21.15.45:0/1681841088 conn(0x7f18200b4670 msgr2=0x7f18200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:11.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 -- 172.21.15.45:0/1681841088 shutdown_connections 2023-12-19T17:52:11.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 -- 172.21.15.45:0/1681841088 wait complete. 2023-12-19T17:52:11.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 Processor -- start 2023-12-19T17:52:11.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.598+0000 7f182620f700 1 -- start start 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 0x7f18200aa570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200d25f0 0x7f182015df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f182015cf20 0x7f18200b72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182015e7c0 con 0x7f18200b8580 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182015eaa0 con 0x7f182015cf20 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182015ed80 con 0x7f18200d25f0 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 0x7f18200aa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 0x7f18200aa570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41350/0 (socket says 172.21.15.45:41350) 2023-12-19T17:52:11.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 -- 172.21.15.45:0/3437285354 learned_addr learned my addr 172.21.15.45:0/3437285354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f1825a0e700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f182015cf20 0x7f18200b72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f1824a0c700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200d25f0 0x7f182015df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 -- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200d25f0 msgr2=0x7f182015df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200d25f0 0x7f182015df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 -- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f182015cf20 msgr2=0x7f18200b72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f182015cf20 0x7f18200b72a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 -- 172.21.15.45:0/3437285354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18100094b0 con 0x7f18200b8580 2023-12-19T17:52:11.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f1825a0e700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f182015cf20 0x7f18200b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:11.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182520d700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 0x7f18200aa570 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c780 tx=0x7f181c00ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:11.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c004ca0 con 0x7f18200b8580 2023-12-19T17:52:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f181c004e20 con 0x7f18200b8580 2023-12-19T17:52:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c007310 con 0x7f18200b8580 2023-12-19T17:52:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.602+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182015f060 con 0x7f18200b8580 2023-12-19T17:52:11.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.606+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182015e440 con 0x7f18200b8580 2023-12-19T17:52:11.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.606+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182015f580 con 0x7f18200b8580 2023-12-19T17:52:11.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.606+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f181c007470 con 0x7f18200b8580 2023-12-19T17:52:11.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.610+0000 7f1815ffb700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1804065ad0 0x7f1804067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:11.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.610+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f181c0831b0 con 0x7f18200b8580 2023-12-19T17:52:11.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.610+0000 7f1824a0c700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1804065ad0 0x7f1804067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:11.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.610+0000 7f1824a0c700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1804065ad0 0x7f1804067f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1810009800 tx=0x7f1810008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:11.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.614+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f182015f580 con 0x7f18200b8580 2023-12-19T17:52:11.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.794+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18200d1dc0 con 0x7f18200b8580 2023-12-19T17:52:11.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.794+0000 7f1815ffb700 1 -- 172.21.15.45:0/3437285354 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f181c050910 con 0x7f18200b8580 2023-12-19T17:52:11.796 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:11.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1804065ad0 msgr2=0x7f1804067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1804065ad0 0x7f1804067f90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1810009800 tx=0x7f1810008030 comp rx=0 tx=0).stop 2023-12-19T17:52:11.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 msgr2=0x7f18200aa570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:11.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 0x7f18200aa570 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f181c00c780 tx=0x7f181c00ca90 comp rx=0 tx=0).stop 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 shutdown_connections 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1804065ad0 0x7f1804067f90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f182015cf20 0x7f18200b72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f18200d25f0 0x7f182015df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 --2- 172.21.15.45:0/3437285354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f18200b8580 0x7f18200aa570 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 >> 172.21.15.45:0/3437285354 conn(0x7f18200b4670 msgr2=0x7f182015c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 shutdown_connections 2023-12-19T17:52:11.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:11.798+0000 7f182620f700 1 -- 172.21.15.45:0/3437285354 wait complete. 2023-12-19T17:52:11.824 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.006+0000 7fe3cb630700 1 Processor -- start 2023-12-19T17:52:12.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.006+0000 7fe3cb630700 1 -- start start 2023-12-19T17:52:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3cb630700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c41626c0 0x7fe3c41619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3cb630700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe3c40b2490 0x7fe3c406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3cb630700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3c406dba0 0x7fe3c4164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3cb630700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c406e030 con 0x7fe3c406dba0 2023-12-19T17:52:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3cb630700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3c40b1d20 con 0x7fe3c40b2490 2023-12-19T17:52:12.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3cb630700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c406ec50 con 0x7fe3c41626c0 2023-12-19T17:52:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c9bcd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe3c406dba0 0x7fe3c4164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe3c40b2490 0x7fe3c406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe3c40b2490 0x7fe3c406d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:60984/0 (socket says 172.21.15.45:60984) 2023-12-19T17:52:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 -- 172.21.15.45:0/1314472614 learned_addr learned my addr 172.21.15.45:0/1314472614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c93cc700 1 --2- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c41626c0 0x7fe3c41619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 -- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c41626c0 msgr2=0x7fe3c41619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 --2- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c41626c0 0x7fe3c41619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 -- 172.21.15.45:0/1314472614 >> v2:172.21.15.45:3300/0 conn(0x7fe3c406dba0 msgr2=0x7fe3c4164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.010+0000 7fe3c8bcb700 1 --2- 172.21.15.45:0/1314472614 >> v2:172.21.15.45:3300/0 conn(0x7fe3c406dba0 0x7fe3c4164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3c8bcb700 1 -- 172.21.15.45:0/1314472614 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c40b2c00 con 0x7fe3c40b2490 2023-12-19T17:52:12.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3c8bcb700 1 --2- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c40b2490 0x7fe3c406d660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4070630 tx=0x7fe3b4009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76244dc03a49bc93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3bbfff700 1 -- 172.21.15.45:0/1314472614 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4011830 con 0x7fe3c40b2490 2023-12-19T17:52:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3bbfff700 1 -- 172.21.15.45:0/1314472614 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3b4011990 con 0x7fe3c40b2490 2023-12-19T17:52:12.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3bbfff700 1 -- 172.21.15.45:0/1314472614 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3b4011d20 con 0x7fe3c40b2490 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 -- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c40b2490 msgr2=0x7fe3c406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 --2- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c40b2490 0x7fe3c406d660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe3c4070630 tx=0x7fe3b4009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 -- 172.21.15.45:0/1314472614 shutdown_connections 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 --2- 172.21.15.45:0/1314472614 >> v2:172.21.15.45:3300/0 conn(0x7fe3c406dba0 0x7fe3c4164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 --2- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c40b2490 0x7fe3c406d660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 --2- 172.21.15.45:0/1314472614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c41626c0 0x7fe3c41619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 -- 172.21.15.45:0/1314472614 >> 172.21.15.45:0/1314472614 conn(0x7fe3c4071990 msgr2=0x7fe3c40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 -- 172.21.15.45:0/1314472614 shutdown_connections 2023-12-19T17:52:12.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.014+0000 7fe3cb630700 1 -- 172.21.15.45:0/1314472614 wait complete. 2023-12-19T17:52:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 Processor -- start 2023-12-19T17:52:12.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 -- start start 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 0x7fe3c415d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c40b2490 0x7fe3c40cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c41626c0 0x7fe3c40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c415d6e0 con 0x7fe3c406dba0 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c414b2c0 con 0x7fe3c41626c0 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3cb630700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c414a830 con 0x7fe3c40b2490 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 0x7fe3c415d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 0x7fe3c415d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41362/0 (socket says 172.21.15.45:41362) 2023-12-19T17:52:12.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 -- 172.21.15.45:0/515376606 learned_addr learned my addr 172.21.15.45:0/515376606 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:12.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 -- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c40b2490 msgr2=0x7fe3c40cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c40b2490 0x7fe3c40cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c9bcd700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c41626c0 0x7fe3c40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 -- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c41626c0 msgr2=0x7fe3c40cdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c41626c0 0x7fe3c40cdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.018+0000 7fe3c93cc700 1 -- 172.21.15.45:0/515376606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3b4009570 con 0x7fe3c406dba0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3c9bcd700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c41626c0 0x7fe3c40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3c93cc700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 0x7fe3c415d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009d10 tx=0x7fe3c000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0009b80 con 0x7fe3c406dba0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3c000f040 con 0x7fe3c406dba0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3c415d8d0 con 0x7fe3c406dba0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3c0014480 con 0x7fe3c406dba0 2023-12-19T17:52:12.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3c415de90 con 0x7fe3c406dba0 2023-12-19T17:52:12.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.022+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3c404ed30 con 0x7fe3c406dba0 2023-12-19T17:52:12.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.026+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3c00145e0 con 0x7fe3c406dba0 2023-12-19T17:52:12.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.026+0000 7fe3b9ffb700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3a8065ad0 0x7fe3a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.026+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe3c0083c40 con 0x7fe3c406dba0 2023-12-19T17:52:12.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.026+0000 7fe3c8bcb700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3a8065ad0 0x7fe3a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.026+0000 7fe3c8bcb700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3a8065ad0 0x7fe3a8067f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40ce3d0 tx=0x7fe3b4010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.034+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe3c00513a0 con 0x7fe3c406dba0 2023-12-19T17:52:12.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.210+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe3c406cef0 con 0x7fe3c406dba0 2023-12-19T17:52:12.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3b9ffb700 1 -- 172.21.15.45:0/515376606 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe3c00549c0 con 0x7fe3c406dba0 2023-12-19T17:52:12.215 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3a8065ad0 msgr2=0x7fe3a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3a8065ad0 0x7fe3a8067f90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe3c40ce3d0 tx=0x7fe3b4010000 comp rx=0 tx=0).stop 2023-12-19T17:52:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 msgr2=0x7fe3c415d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 0x7fe3c415d1a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0009d10 tx=0x7fe3c000c3a0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 shutdown_connections 2023-12-19T17:52:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3a8065ad0 0x7fe3a8067f90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3c41626c0 0x7fe3c40cdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3c40b2490 0x7fe3c40cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 --2- 172.21.15.45:0/515376606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3c406dba0 0x7fe3c415d1a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 >> 172.21.15.45:0/515376606 conn(0x7fe3c4071990 msgr2=0x7fe3c4157f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 shutdown_connections 2023-12-19T17:52:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.214+0000 7fe3cb630700 1 -- 172.21.15.45:0/515376606 wait complete. 2023-12-19T17:52:12.239 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.446+0000 7f2916645700 1 Processor -- start 2023-12-19T17:52:12.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.446+0000 7f2916645700 1 -- start start 2023-12-19T17:52:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2916645700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29100b8580 0x7f29100cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2916645700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29100cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2916645700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f291015d300 con 0x7f291015cf20 2023-12-19T17:52:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2916645700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29100d1360 con 0x7f29100b8580 2023-12-19T17:52:12.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2916645700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100d1550 con 0x7f29100d25f0 2023-12-19T17:52:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2915e44700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29100cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2914e42700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29100b8580 0x7f29100cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2915643700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f291015cf20 0x7f29100d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:60990/0 (socket says 172.21.15.45:60990) 2023-12-19T17:52:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2915e44700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29100cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:35108/0 (socket says 172.21.15.45:35108) 2023-12-19T17:52:12.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.450+0000 7f2915643700 1 -- 172.21.15.45:0/1317152059 learned_addr learned my addr 172.21.15.45:0/1317152059 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2915e44700 1 -- 172.21.15.45:0/1317152059 >> v2:172.21.15.73:3300/0 conn(0x7f29100b8580 msgr2=0x7f29100cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2915e44700 1 --2- 172.21.15.45:0/1317152059 >> v2:172.21.15.73:3300/0 conn(0x7f29100b8580 0x7f29100cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2915e44700 1 -- 172.21.15.45:0/1317152059 >> v1:172.21.15.73:6789/0 conn(0x7f291015cf20 legacy=0x7f29100d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2915e44700 1 -- 172.21.15.45:0/1317152059 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100d1830 con 0x7f29100d25f0 2023-12-19T17:52:12.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2915e44700 1 --2- 172.21.15.45:0/1317152059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29100cde00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f290800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e872ab51deeb0f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2907fff700 1 -- 172.21.15.45:0/1317152059 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290800e070 con 0x7f29100d25f0 2023-12-19T17:52:12.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2907fff700 1 -- 172.21.15.45:0/1317152059 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290800bb20 con 0x7f29100d25f0 2023-12-19T17:52:12.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2907fff700 1 -- 172.21.15.45:0/1317152059 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908012430 con 0x7f29100d25f0 2023-12-19T17:52:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 -- 172.21.15.45:0/1317152059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 msgr2=0x7f29100cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 --2- 172.21.15.45:0/1317152059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29100cde00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2908009d90 tx=0x7f290800b330 comp rx=0 tx=0).stop 2023-12-19T17:52:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 -- 172.21.15.45:0/1317152059 shutdown_connections 2023-12-19T17:52:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 --2- 172.21.15.45:0/1317152059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29100cde00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 --2- 172.21.15.45:0/1317152059 >> v2:172.21.15.73:3300/0 conn(0x7f29100b8580 0x7f29100cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 -- 172.21.15.45:0/1317152059 >> 172.21.15.45:0/1317152059 conn(0x7f29100b4670 msgr2=0x7f29100b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 -- 172.21.15.45:0/1317152059 shutdown_connections 2023-12-19T17:52:12.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.454+0000 7f2916645700 1 -- 172.21.15.45:0/1317152059 wait complete. 2023-12-19T17:52:12.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.458+0000 7f2916645700 1 Processor -- start 2023-12-19T17:52:12.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.458+0000 7f2916645700 1 -- start start 2023-12-19T17:52:12.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2916645700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29100b8580 0x7f29100aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2916645700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29101f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2916645700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 0x7f29100cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2916645700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291015f570 con 0x7f291015cf20 2023-12-19T17:52:12.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2916645700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291015f290 con 0x7f29100b8580 2023-12-19T17:52:12.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2916645700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100a9780 con 0x7f29100d25f0 2023-12-19T17:52:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 0x7f29100cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 0x7f29100cbc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41366/0 (socket says 172.21.15.45:41366) 2023-12-19T17:52:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2914e42700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29101f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 -- 172.21.15.45:0/782743180 learned_addr learned my addr 172.21.15.45:0/782743180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:12.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915643700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29100b8580 0x7f29100aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 -- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 msgr2=0x7f29101f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29101f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 -- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29100b8580 msgr2=0x7f29100aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29100b8580 0x7f29100aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 -- 172.21.15.45:0/782743180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009a70 con 0x7f291015cf20 2023-12-19T17:52:12.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.462+0000 7f2915e44700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 0x7f29100cbc60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2908014040 tx=0x7f2908004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.466+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2908012430 con 0x7f291015cf20 2023-12-19T17:52:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.466+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2908020070 con 0x7f291015cf20 2023-12-19T17:52:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.466+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080098f0 con 0x7f291015cf20 2023-12-19T17:52:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.466+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29100a9a60 con 0x7f291015cf20 2023-12-19T17:52:12.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.466+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29101f2230 con 0x7f291015cf20 2023-12-19T17:52:12.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.466+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29100a95e0 con 0x7f291015cf20 2023-12-19T17:52:12.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.470+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2908004040 con 0x7f291015cf20 2023-12-19T17:52:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.470+0000 7f2905ffb700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28f4065ad0 0x7f28f4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.470+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2908022070 con 0x7f291015cf20 2023-12-19T17:52:12.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.470+0000 7f2915643700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28f4065ad0 0x7f28f4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.474+0000 7f2915643700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28f4065ad0 0x7f28f4067f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f290c005930 tx=0x7f290c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.478+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f29100a95e0 con 0x7f291015cf20 2023-12-19T17:52:12.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.658+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f29100a9f80 con 0x7f291015cf20 2023-12-19T17:52:12.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.658+0000 7f2905ffb700 1 -- 172.21.15.45:0/782743180 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f29100a9f80 con 0x7f291015cf20 2023-12-19T17:52:12.662 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28f4065ad0 msgr2=0x7f28f4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28f4065ad0 0x7f28f4067f90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f290c005930 tx=0x7f290c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 msgr2=0x7f29100cbc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 0x7f29100cbc60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2908014040 tx=0x7f2908004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 shutdown_connections 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28f4065ad0 0x7f28f4067f90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f291015cf20 0x7f29100cbc60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f29100d25f0 0x7f29101f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 --2- 172.21.15.45:0/782743180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29100b8580 0x7f29100aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 >> 172.21.15.45:0/782743180 conn(0x7f29100b4670 msgr2=0x7f291015c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:12.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 shutdown_connections 2023-12-19T17:52:12.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.662+0000 7f2916645700 1 -- 172.21.15.45:0/782743180 wait complete. 2023-12-19T17:52:12.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:52:12.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.866+0000 7fc97cf99700 1 Processor -- start 2023-12-19T17:52:12.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.866+0000 7fc97cf99700 1 -- start start 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97cf99700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc978164690 0x7fc9780c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97cf99700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9780cd540 0x7fc9780c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97cf99700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9780cdb80 con 0x7fc978164a70 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97cf99700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9780cde60 con 0x7fc978164690 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97cf99700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780ce140 con 0x7fc9780cd540 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc96ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc978164a70 0x7fc9780cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48954/0 (socket says 172.21.15.45:48954) 2023-12-19T17:52:12.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc96ffff700 1 -- 172.21.15.45:0/43077837 learned_addr learned my addr 172.21.15.45:0/43077837 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97659c700 1 --2- 172.21.15.45:0/43077837 >> v2:172.21.15.45:3300/0 conn(0x7fc978164690 0x7fc9780c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc976d9d700 1 --2- 172.21.15.45:0/43077837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9780cd540 0x7fc9780c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc975d9b700 1 -- 172.21.15.45:0/43077837 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2590618942 0 0) 0x7fc9780cdb80 con 0x7fc978164a70 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc975d9b700 1 -- 172.21.15.45:0/43077837 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9640035d0 con 0x7fc978164a70 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc976d9d700 1 -- 172.21.15.45:0/43077837 >> v2:172.21.15.45:3300/0 conn(0x7fc978164690 msgr2=0x7fc9780c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc976d9d700 1 --2- 172.21.15.45:0/43077837 >> v2:172.21.15.45:3300/0 conn(0x7fc978164690 0x7fc9780c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc976d9d700 1 -- 172.21.15.45:0/43077837 >> v1:172.21.15.45:6789/0 conn(0x7fc978164a70 legacy=0x7fc9780cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc976d9d700 1 -- 172.21.15.45:0/43077837 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9780ce420 con 0x7fc9780cd540 2023-12-19T17:52:12.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc97659c700 1 --2- 172.21.15.45:0/43077837 >> v2:172.21.15.45:3300/0 conn(0x7fc978164690 0x7fc9780c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.870+0000 7fc976d9d700 1 --2- 172.21.15.45:0/43077837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9780cd540 0x7fc9780c4340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc970009d90 tx=0x7fc97000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a26161b4c543bfd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc975d9b700 1 -- 172.21.15.45:0/43077837 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97000e070 con 0x7fc9780cd540 2023-12-19T17:52:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc975d9b700 1 -- 172.21.15.45:0/43077837 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97000bb20 con 0x7fc9780cd540 2023-12-19T17:52:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc975d9b700 1 -- 172.21.15.45:0/43077837 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc970012430 con 0x7fc9780cd540 2023-12-19T17:52:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 -- 172.21.15.45:0/43077837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9780cd540 msgr2=0x7fc9780c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 --2- 172.21.15.45:0/43077837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9780cd540 0x7fc9780c4340 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc970009d90 tx=0x7fc97000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 -- 172.21.15.45:0/43077837 shutdown_connections 2023-12-19T17:52:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 --2- 172.21.15.45:0/43077837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9780cd540 0x7fc9780c4340 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 --2- 172.21.15.45:0/43077837 >> v2:172.21.15.45:3300/0 conn(0x7fc978164690 0x7fc9780c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 -- 172.21.15.45:0/43077837 >> 172.21.15.45:0/43077837 conn(0x7fc9780cba40 msgr2=0x7fc9780ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 -- 172.21.15.45:0/43077837 shutdown_connections 2023-12-19T17:52:12.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.874+0000 7fc97cf99700 1 -- 172.21.15.45:0/43077837 wait complete. 2023-12-19T17:52:12.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 Processor -- start 2023-12-19T17:52:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 -- start start 2023-12-19T17:52:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 0x7fc9781f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc978164690 0x7fc9780c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978164a70 0x7fc97815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c6780 con 0x7fc9780cd540 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c5b00 con 0x7fc978164a70 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97cf99700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9780c5de0 con 0x7fc978164690 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 0x7fc9781f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 0x7fc9781f79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41374/0 (socket says 172.21.15.45:41374) 2023-12-19T17:52:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc97659c700 1 -- 172.21.15.45:0/847481837 learned_addr learned my addr 172.21.15.45:0/847481837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc96ffff700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc978164690 0x7fc9780c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.878+0000 7fc976d9d700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978164a70 0x7fc97815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97659c700 1 -- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc978164690 msgr2=0x7fc9780c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97659c700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc978164690 0x7fc9780c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97659c700 1 -- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978164a70 msgr2=0x7fc97815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97659c700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978164a70 0x7fc97815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97659c700 1 -- 172.21.15.45:0/847481837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680094b0 con 0x7fc9780cd540 2023-12-19T17:52:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97659c700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 0x7fc9781f79e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc96800ebe0 tx=0x7fc968009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96800c910 con 0x7fc9780cd540 2023-12-19T17:52:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96800ca70 con 0x7fc9780cd540 2023-12-19T17:52:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96800ce00 con 0x7fc9780cd540 2023-12-19T17:52:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc970009a70 con 0x7fc9780cd540 2023-12-19T17:52:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9780c63a0 con 0x7fc9780cd540 2023-12-19T17:52:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.882+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc97804ed30 con 0x7fc9780cd540 2023-12-19T17:52:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.886+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc968013470 con 0x7fc9780cd540 2023-12-19T17:52:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.886+0000 7fc96effd700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc958065ad0 0x7fc958067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.886+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc968083680 con 0x7fc9780cd540 2023-12-19T17:52:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.886+0000 7fc96ffff700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc958065ad0 0x7fc958067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.886+0000 7fc96ffff700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc958065ad0 0x7fc958067f90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9781f4a30 tx=0x7fc960009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:12.890+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc968050d50 con 0x7fc9780cd540 2023-12-19T17:52:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.102+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc978163eb0 con 0x7fc9780cd540 2023-12-19T17:52:13.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.102+0000 7fc96effd700 1 -- 172.21.15.45:0/847481837 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7fc968054370 con 0x7fc9780cd540 2023-12-19T17:52:13.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:13.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.106+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc958065ad0 msgr2=0x7fc958067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.106+0000 7fc97cf99700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc958065ad0 0x7fc958067f90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc9781f4a30 tx=0x7fc960009040 comp rx=0 tx=0).stop 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.106+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 msgr2=0x7fc9781f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.106+0000 7fc97cf99700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 0x7fc9781f79e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fc96800ebe0 tx=0x7fc968009ed0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 shutdown_connections 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc958065ad0 0x7fc958067f90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc978164a70 0x7fc97815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc978164690 0x7fc9780c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 --2- 172.21.15.45:0/847481837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9780cd540 0x7fc9781f79e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 >> 172.21.15.45:0/847481837 conn(0x7fc9780cba40 msgr2=0x7fc9780ca780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 shutdown_connections 2023-12-19T17:52:13.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.110+0000 7fc97cf99700 1 -- 172.21.15.45:0/847481837 wait complete. 2023-12-19T17:52:13.114 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:52:13.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:13.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.318+0000 7fc34f551700 1 Processor -- start 2023-12-19T17:52:13.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.318+0000 7fc34f551700 1 -- start start 2023-12-19T17:52:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34f551700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc34815cff0 0x7fc348161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34f551700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34806ddd0 0x7fc3480c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34f551700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3480c9220 con 0x7fc3480ca520 2023-12-19T17:52:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34f551700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc34815d3d0 con 0x7fc34815cff0 2023-12-19T17:52:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34f551700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3480c9500 con 0x7fc34806ddd0 2023-12-19T17:52:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34ed50700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc3480ca520 0x7fc3480c3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:32768/0 (socket says 172.21.15.45:32768) 2023-12-19T17:52:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34ed50700 1 -- 172.21.15.45:0/723689048 learned_addr learned my addr 172.21.15.45:0/723689048 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34e54f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc34815cff0 0x7fc348161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34dd4e700 1 --2- 172.21.15.45:0/723689048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34806ddd0 0x7fc3480c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34dd4e700 1 -- 172.21.15.45:0/723689048 >> v2:172.21.15.45:3300/0 conn(0x7fc34815cff0 msgr2=0x7fc348161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34dd4e700 1 --2- 172.21.15.45:0/723689048 >> v2:172.21.15.45:3300/0 conn(0x7fc34815cff0 0x7fc348161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34dd4e700 1 -- 172.21.15.45:0/723689048 >> v1:172.21.15.73:6789/0 conn(0x7fc3480ca520 legacy=0x7fc3480c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34dd4e700 1 -- 172.21.15.45:0/723689048 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3480c97e0 con 0x7fc34806ddd0 2023-12-19T17:52:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34e54f700 1 --2- 172.21.15.45:0/723689048 >> v2:172.21.15.45:3300/0 conn(0x7fc34815cff0 0x7fc348161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34dd4e700 1 --2- 172.21.15.45:0/723689048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34806ddd0 0x7fc3480c9fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc338009850 tx=0x7fc338009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fac0edc137a119 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34d54d700 1 -- 172.21.15.45:0/723689048 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338011830 con 0x7fc34806ddd0 2023-12-19T17:52:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34d54d700 1 -- 172.21.15.45:0/723689048 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338011990 con 0x7fc34806ddd0 2023-12-19T17:52:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.322+0000 7fc34d54d700 1 -- 172.21.15.45:0/723689048 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338011d40 con 0x7fc34806ddd0 2023-12-19T17:52:13.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 -- 172.21.15.45:0/723689048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34806ddd0 msgr2=0x7fc3480c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 --2- 172.21.15.45:0/723689048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34806ddd0 0x7fc3480c9fe0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc338009850 tx=0x7fc338009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 -- 172.21.15.45:0/723689048 shutdown_connections 2023-12-19T17:52:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 --2- 172.21.15.45:0/723689048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34806ddd0 0x7fc3480c9fe0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 --2- 172.21.15.45:0/723689048 >> v2:172.21.15.45:3300/0 conn(0x7fc34815cff0 0x7fc348161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 -- 172.21.15.45:0/723689048 >> 172.21.15.45:0/723689048 conn(0x7fc3480cb900 msgr2=0x7fc3480b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 -- 172.21.15.45:0/723689048 shutdown_connections 2023-12-19T17:52:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 -- 172.21.15.45:0/723689048 wait complete. 2023-12-19T17:52:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 Processor -- start 2023-12-19T17:52:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.326+0000 7fc34f551700 1 -- start start 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc34806ddd0 0x7fc3481f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34815cff0 0x7fc3481542e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 0x7fc348070b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3481552f0 con 0x7fc348154820 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc348154d30 con 0x7fc34806ddd0 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc348155010 con 0x7fc34815cff0 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 0x7fc348070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 0x7fc348070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41392/0 (socket says 172.21.15.45:41392) 2023-12-19T17:52:13.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 -- 172.21.15.45:0/3660562737 learned_addr learned my addr 172.21.15.45:0/3660562737 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34dd4e700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34815cff0 0x7fc3481542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34e54f700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc34806ddd0 0x7fc3481f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 -- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34815cff0 msgr2=0x7fc3481542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34815cff0 0x7fc3481542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 -- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc34806ddd0 msgr2=0x7fc3481f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc34806ddd0 0x7fc3481f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 -- 172.21.15.45:0/3660562737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3440094b0 con 0x7fc348154820 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34ed50700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 0x7fc348070b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc34000cbc0 tx=0x7fc34000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000a9e0 con 0x7fc348154820 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34000ab40 con 0x7fc348154820 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3380094b0 con 0x7fc348154820 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34000ce80 con 0x7fc348154820 2023-12-19T17:52:13.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc348144550 con 0x7fc348154820 2023-12-19T17:52:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.330+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc348144740 con 0x7fc348154820 2023-12-19T17:52:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.334+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc34001b3b0 con 0x7fc348154820 2023-12-19T17:52:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.334+0000 7fc33effd700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc32c065ad0 0x7fc32c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.334+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc340082dc0 con 0x7fc348154820 2023-12-19T17:52:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.334+0000 7fc34e54f700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc32c065ad0 0x7fc32c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.338+0000 7fc34e54f700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc32c065ad0 0x7fc32c067f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc344009c70 tx=0x7fc344008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.338+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc340050530 con 0x7fc348154820 2023-12-19T17:52:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.518+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc348067760 con 0x7fc348154820 2023-12-19T17:52:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc33effd700 1 -- 172.21.15.45:0/3660562737 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+17830 (secure 0 0 0) 0x7fc340053b50 con 0x7fc348154820 2023-12-19T17:52:13.523 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:13.524 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":24,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:51:42.348119+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc32c065ad0 msgr2=0x7fc32c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc32c065ad0 0x7fc32c067f90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc344009c70 tx=0x7fc344008040 comp rx=0 tx=0).stop 2023-12-19T17:52:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 msgr2=0x7fc348070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 0x7fc348070b50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc34000cbc0 tx=0x7fc34000cca0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 shutdown_connections 2023-12-19T17:52:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc32c065ad0 0x7fc32c067f90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc348154820 0x7fc348070b50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc34815cff0 0x7fc3481542e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 --2- 172.21.15.45:0/3660562737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc34806ddd0 0x7fc3481f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 >> 172.21.15.45:0/3660562737 conn(0x7fc3480cb900 msgr2=0x7fc3480cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 shutdown_connections 2023-12-19T17:52:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.522+0000 7fc34f551700 1 -- 172.21.15.45:0/3660562737 wait complete. 2023-12-19T17:52:13.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:52:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.722+0000 7ffb1177d700 1 Processor -- start 2023-12-19T17:52:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.722+0000 7ffb1177d700 1 -- start start 2023-12-19T17:52:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.726+0000 7ffb1177d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.726+0000 7ffb1177d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06f0a0 con 0x7ffb0c06cad0 2023-12-19T17:52:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.726+0000 7ffb1177d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06ea90 con 0x7ffb0c0af720 2023-12-19T17:52:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.726+0000 7ffb1177d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0c3f60 con 0x7ffb0c15ae20 2023-12-19T17:52:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.726+0000 7ffb037fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffb0c06cad0 0x7ffb0c0c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48956/0 (socket says 172.21.15.45:48956) 2023-12-19T17:52:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.726+0000 7ffb037fe700 1 -- 172.21.15.45:0/697308816 learned_addr learned my addr 172.21.15.45:0/697308816 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0bfff700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154016312 0 0) 0x7ffb0c06f0a0 con 0x7ffb0c06cad0 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffaf80035d0 con 0x7ffb0c06cad0 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1167569792 0 0) 0x7ffb0c06ea90 con 0x7ffb0c0af720 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb0c06f0a0 con 0x7ffb0c0af720 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3401826218 0 0) 0x7ffaf80035d0 con 0x7ffb0c06cad0 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 msgr2=0x7ffb0c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 >> v1:172.21.15.73:6789/0 conn(0x7ffb0c0af720 legacy=0x7ffb0c06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c0c4240 con 0x7ffb0c06cad0 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7ffaf4001670 con 0x7ffb0c06cad0 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 >> v1:172.21.15.45:6789/0 conn(0x7ffb0c06cad0 legacy=0x7ffb0c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaf8003be0 0x7ffaf8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffaf8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf8004db0 0x7ffaf8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0c3f60 con 0x7ffaf8003be0 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf800bae0 con 0x7ffaf8004db0 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf800bca0 con 0x7ffb0c15ae20 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0bfff700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaf8003be0 0x7ffaf8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffaf8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb10f7c700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf8004db0 0x7ffaf8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 -- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf8004db0 msgr2=0x7ffaf8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffaf8004db0 0x7ffaf8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 -- 172.21.15.45:0/697308816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaf8003be0 msgr2=0x7ffaf8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffaf8003be0 0x7ffaf8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 -- 172.21.15.45:0/697308816 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf80035d0 con 0x7ffb0c15ae20 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb037fe700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffaf8004870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06cf10 tx=0x7ffaf80058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5310215bc3bd1465 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400cc90 con 0x7ffb0c15ae20 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf400ce10 con 0x7ffb0c15ae20 2023-12-19T17:52:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.730+0000 7ffb0b7fe700 1 -- 172.21.15.45:0/697308816 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4005bc0 con 0x7ffb0c15ae20 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb1177d700 1 -- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 msgr2=0x7ffaf8004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb1177d700 1 --2- 172.21.15.45:0/697308816 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffaf8004870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06cf10 tx=0x7ffaf80058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb10f7c700 1 -- 172.21.15.45:0/697308816 reap_dead start 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb1177d700 1 -- 172.21.15.45:0/697308816 shutdown_connections 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb1177d700 1 -- 172.21.15.45:0/697308816 >> 172.21.15.45:0/697308816 conn(0x7ffb0c0cb900 msgr2=0x7ffb0c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb1177d700 1 -- 172.21.15.45:0/697308816 shutdown_connections 2023-12-19T17:52:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.734+0000 7ffb1177d700 1 -- 172.21.15.45:0/697308816 wait complete. 2023-12-19T17:52:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 Processor -- start 2023-12-19T17:52:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 -- start start 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b1e30 0x7ffb0c14f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 0x7ffb0c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1f0ea0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1f0220 con 0x7ffb0c0b1e30 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb1177d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c1f0500 con 0x7ffb0c15ae20 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 0x7ffb0c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 0x7ffb0c151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41420/0 (socket says 172.21.15.45:41420) 2023-12-19T17:52:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 -- 172.21.15.45:0/631102262 learned_addr learned my addr 172.21.15.45:0/631102262 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb037fe700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b1e30 0x7ffb0c14f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb0bfff700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 -- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 msgr2=0x7ffb0c15cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 -- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b1e30 msgr2=0x7ffb0c14f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b1e30 0x7ffb0c14f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 -- 172.21.15.45:0/631102262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c1f07e0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.738+0000 7ffb10f7c700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 0x7ffb0c151970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06c330 tx=0x7ffb0400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.742+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04003c30 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.742+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb04003db0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.742+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c1f0ac0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.742+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb04005310 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.742+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c15d000 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.742+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c1f0fe0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.746+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb04005470 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.746+0000 7ffb097fa700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffaec065ad0 0x7ffaec067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.746+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffb04083480 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.746+0000 7ffb0bfff700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffaec065ad0 0x7ffaec067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.750+0000 7ffb0bfff700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffaec065ad0 0x7ffaec067f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009b90 tx=0x7ffafc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.754+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb0c1f0fe0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.974+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffb0c1f0fe0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb097fa700 1 -- 172.21.15.45:0/631102262 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7ffb0c1f0fe0 con 0x7ffb0c14f9d0 2023-12-19T17:52:13.979 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:13.979 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:52:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffaec065ad0 msgr2=0x7ffaec067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffaec065ad0 0x7ffaec067f90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ffafc009b90 tx=0x7ffafc009240 comp rx=0 tx=0).stop 2023-12-19T17:52:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 msgr2=0x7ffb0c151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 0x7ffb0c151970 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c06c330 tx=0x7ffb0400ee70 comp rx=0 tx=0).stop 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 shutdown_connections 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffaec065ad0 0x7ffaec067f90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb0c14f9d0 0x7ffb0c151970 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb0c0b1e30 0x7ffb0c14f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 --2- 172.21.15.45:0/631102262 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb0c15ae20 0x7ffb0c15cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.978+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 >> 172.21.15.45:0/631102262 conn(0x7ffb0c0cb900 msgr2=0x7ffb0c155cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.982+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 shutdown_connections 2023-12-19T17:52:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:13.982+0000 7ffb1177d700 1 -- 172.21.15.45:0/631102262 wait complete. 2023-12-19T17:52:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:52:14.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:51:37.822341+0000', 'modified': '2023-12-19T17:52:02.383603+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 54167}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_54167': {'gid': 54167, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6835/3913672139', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6833', 'nonce': 3913672139}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3913672139}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:52:14.408 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:52:14.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T17:52:14.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.606+0000 7fba15bd2700 1 Processor -- start 2023-12-19T17:52:14.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.606+0000 7fba15bd2700 1 -- start start 2023-12-19T17:52:14.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.606+0000 7fba15bd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba101659f0 0x7fba10167de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.606+0000 7fba15bd2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100d1820 con 0x7fba100b88b0 2023-12-19T17:52:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.606+0000 7fba15bd2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba100d1b00 con 0x7fba1006ea90 2023-12-19T17:52:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.606+0000 7fba15bd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100d1630 con 0x7fba101659f0 2023-12-19T17:52:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba100b88b0 0x7fba1006ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48964/0 (socket says 172.21.15.45:48964) 2023-12-19T17:52:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0ffff700 1 -- 172.21.15.45:0/50115273 learned_addr learned my addr 172.21.15.45:0/50115273 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:14.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 --1- 172.21.15.45:0/50115273 >> v1:172.21.15.73:6789/0 conn(0x7fba1006ea90 0x7fba100d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:32798/0 (socket says 172.21.15.45:32798) 2023-12-19T17:52:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba153d1700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba101659f0 0x7fba10167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506767857 0 0) 0x7fba100d1b00 con 0x7fba1006ea90 2023-12-19T17:52:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba000035d0 con 0x7fba1006ea90 2023-12-19T17:52:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203178401 0 0) 0x7fba100d1820 con 0x7fba100b88b0 2023-12-19T17:52:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba100d1b00 con 0x7fba100b88b0 2023-12-19T17:52:14.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1604503900 0 0) 0x7fba100d1b00 con 0x7fba100b88b0 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba101659f0 msgr2=0x7fba10167de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba101659f0 0x7fba10167de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 >> v1:172.21.15.73:6789/0 conn(0x7fba1006ea90 legacy=0x7fba100d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100d1de0 con 0x7fba100b88b0 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fb9fc001670 con 0x7fba100b88b0 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 >> v1:172.21.15.45:6789/0 conn(0x7fba100b88b0 legacy=0x7fba1006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00004c70 0x7fba00005050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00003810 0x7fba00003c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000041d0 0x7fba0000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04001230 con 0x7fba00004c70 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0000c100 con 0x7fba00003810 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0000c240 con 0x7fba000041d0 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba153d1700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba101659f0 0x7fba10167de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:14.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00004c70 0x7fba00005050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0ffff700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00003810 0x7fba00003c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 -- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000041d0 msgr2=0x7fba0000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba153d1700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000041d0 0x7fba0000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000041d0 0x7fba0000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 -- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00003810 msgr2=0x7fba00003c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00003810 0x7fba00003c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba14bd0700 1 -- 172.21.15.45:0/50115273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100d1b00 con 0x7fba00004c70 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba0ffff700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00003810 0x7fba00003c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.610+0000 7fba153d1700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000041d0 0x7fba0000ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:14.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba14bd0700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00004c70 0x7fba00005050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba0400c110 tx=0x7fba000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d18cd07621640b8b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04007a70 con 0x7fba00004c70 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0400cc30 con 0x7fba00004c70 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba0f7fe700 1 -- 172.21.15.45:0/50115273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba04004890 con 0x7fba00004c70 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba15bd2700 1 -- 172.21.15.45:0/50115273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00004c70 msgr2=0x7fba00005050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba15bd2700 1 --2- 172.21.15.45:0/50115273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba00004c70 0x7fba00005050 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fba0400c110 tx=0x7fba000058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba153d1700 1 -- 172.21.15.45:0/50115273 reap_dead start 2023-12-19T17:52:14.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba15bd2700 1 -- 172.21.15.45:0/50115273 shutdown_connections 2023-12-19T17:52:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba15bd2700 1 -- 172.21.15.45:0/50115273 >> 172.21.15.45:0/50115273 conn(0x7fba100b46d0 msgr2=0x7fba100b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba15bd2700 1 -- 172.21.15.45:0/50115273 shutdown_connections 2023-12-19T17:52:14.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.614+0000 7fba15bd2700 1 -- 172.21.15.45:0/50115273 wait complete. 2023-12-19T17:52:14.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 Processor -- start 2023-12-19T17:52:14.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 -- start start 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 0x7fba101571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba100ca530 0x7fba100ca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd620 0x7fba100cdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba101576e0 con 0x7fba100ca530 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba100cdfe0 con 0x7fba00004c70 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.618+0000 7fba15bd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba100b3080 con 0x7fba100cd620 2023-12-19T17:52:14.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 0x7fba101571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba153d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd620 0x7fba100cdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 0x7fba101571a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:32852/0 (socket says 172.21.15.45:32852) 2023-12-19T17:52:14.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 -- 172.21.15.45:0/3153418935 learned_addr learned my addr 172.21.15.45:0/3153418935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:14.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba0ffff700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba100ca530 0x7fba100ca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 -- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd620 msgr2=0x7fba100cdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd620 0x7fba100cdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 -- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba100ca530 msgr2=0x7fba100ca9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba100ca530 0x7fba100ca9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 -- 172.21.15.45:0/3153418935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba100cb0a0 con 0x7fba00004c70 2023-12-19T17:52:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba0ffff700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba100ca530 0x7fba100ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:14.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba14bd0700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 0x7fba101571a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba0400c700 tx=0x7fba04001750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba0d7fa700 1 -- 172.21.15.45:0/3153418935 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040013f0 con 0x7fba00004c70 2023-12-19T17:52:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba0d7fa700 1 -- 172.21.15.45:0/3153418935 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba04001550 con 0x7fba00004c70 2023-12-19T17:52:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba0d7fa700 1 -- 172.21.15.45:0/3153418935 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba040072d0 con 0x7fba00004c70 2023-12-19T17:52:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba100b2750 con 0x7fba00004c70 2023-12-19T17:52:14.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.622+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba100b2d10 con 0x7fba00004c70 2023-12-19T17:52:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.626+0000 7fba0d7fa700 1 -- 172.21.15.45:0/3153418935 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba04007430 con 0x7fba00004c70 2023-12-19T17:52:14.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.630+0000 7fba0d7fa700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9f4065b20 0x7fb9f4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.630+0000 7fba0d7fa700 1 -- 172.21.15.45:0/3153418935 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fba040848d0 con 0x7fba00004c70 2023-12-19T17:52:14.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.630+0000 7fba0ffff700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9f4065b20 0x7fb9f4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.630+0000 7fba0ffff700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9f4065b20 0x7fb9f4067fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fba10158bc0 tx=0x7fb9fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.630+0000 7fba1a0c3740 1 Processor -- start 2023-12-19T17:52:14.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.630+0000 7fba1a0c3740 1 -- start start 2023-12-19T17:52:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24a9eb0 0x245fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 0x24aa290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x245d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x23d15b0 con 0x2488430 2023-12-19T17:52:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x23ced40 con 0x24aa7d0 2023-12-19T17:52:14.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x23ca630 con 0x24a9eb0 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 0x24aa290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 0x24aa290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41440/0 (socket says 172.21.15.45:41440) 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 -- 172.21.15.45:0/426869544 learned_addr learned my addr 172.21.15.45:0/426869544 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba153d1700 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x245d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba14bd0700 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24a9eb0 0x245fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 -- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24a9eb0 msgr2=0x245fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24a9eb0 0x245fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 -- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 msgr2=0x245d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x245d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 -- 172.21.15.45:0/426869544 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x223d960 con 0x2488430 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba0ffff700 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 0x24aa290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc007570 tx=0x7fb9fc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3632047142f7550 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fb9fa7fc700 1 -- 172.21.15.45:0/426869544 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc014a20 con 0x2488430 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fb9fa7fc700 1 -- 172.21.15.45:0/426869544 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00d050 con 0x2488430 2023-12-19T17:52:14.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fb9fa7fc700 1 -- 172.21.15.45:0/426869544 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc014d80 con 0x2488430 2023-12-19T17:52:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 -- 172.21.15.45:0/426869544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 msgr2=0x24aa290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.634+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 0x24aa290 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc007570 tx=0x7fb9fc013000 comp rx=0 tx=0).stop 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- 172.21.15.45:0/426869544 shutdown_connections 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x245d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2488430 0x24aa290 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/426869544 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24a9eb0 0x245fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- 172.21.15.45:0/426869544 >> 172.21.15.45:0/426869544 conn(0x21f24d0 msgr2=0x2463d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- 172.21.15.45:0/426869544 shutdown_connections 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- 172.21.15.45:0/426869544 wait complete. 2023-12-19T17:52:14.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- start start 2023-12-19T17:52:14.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 Processor -- start 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2473b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x2487ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x2471eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2387c80 con 0x24a9eb0 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x238db00 con 0x24aa7d0 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2276aa0 con 0x2488430 2023-12-19T17:52:14.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.638+0000 7fba1a0c3740 10 client.0 _ll_register_callbacks cb 0x23c3f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:52:14.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x2487ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba14bd0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2473b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x2487ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41452/0 (socket says 172.21.15.45:41452) 2023-12-19T17:52:14.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 -- 172.21.15.45:0/1135844941 learned_addr learned my addr 172.21.15.45:0/1135844941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:14.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba153d1700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x2471eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 -- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 msgr2=0x2473b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2473b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 -- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 msgr2=0x2471eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x2471eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 -- 172.21.15.45:0/1135844941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba100d1de0 con 0x24a9eb0 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba14bd0700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2473b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:14.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba0ffff700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x2487ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc001eb0 tx=0x7fb9fc0019f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7525586ff90ea0c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fb9ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:52:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/1135844941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc021830 con 0x24a9eb0 2023-12-19T17:52:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/1135844941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9fc01c050 con 0x24a9eb0 2023-12-19T17:52:14.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x23c36b0 con 0x24a9eb0 2023-12-19T17:52:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/1135844941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9fc007d90 con 0x24a9eb0 2023-12-19T17:52:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 10 client.4785 fetch_fsmap learned FSMap version 8 2023-12-19T17:52:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x2390770 con 0x24a9eb0 2023-12-19T17:52:14.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/1135844941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x23c36b0 con 0x24a9eb0 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/1135844941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fb9fc021990 con 0x24a9eb0 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 10 client.4785 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 10 client.4785 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 20 client.4785 populate_metadata read hostname 'smithi045' 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x246fbf0 0x246ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 4 client.4785 mds_command: new command op to 54167 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.642+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 --> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2385a00 con 0x246fbf0 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba14bd0700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x246fbf0 0x246ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba14bd0700 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x246fbf0 0x246ffd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f156ea3b3cfff164 server_cookie=e1f42f2b44bc5d56 in_seq=0 out_seq=0 2023-12-19T17:52:14.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fb9ef7fe700 10 client.4785 ms_handle_connect on v2:172.21.15.73:6833/3913672139 2023-12-19T17:52:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/1135844941 <== mds.0 v2:172.21.15.73:6833/3913672139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x2385a00 con 0x246fbf0 2023-12-19T17:52:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fb9ef7fe700 10 client.4785 handle_command_reply: tid=0 2023-12-19T17:52:14.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 client.4785 shutdown 2023-12-19T17:52:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 msgr2=0x2487ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x2487ab0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc001eb0 tx=0x7fb9fc0019f0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 shutdown_connections 2023-12-19T17:52:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x246fbf0 0x246ffd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x2471eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x2487ab0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fb9ef7fe700 0 client.4785 ms_handle_reset on v2:172.21.15.73:6833/3913672139 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/1135844941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2473b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.646+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 >> 172.21.15.45:0/1135844941 conn(0x21f24d0 msgr2=0x248abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.650+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 shutdown_connections 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.650+0000 7fba1a0c3740 1 -- 172.21.15.45:0/1135844941 wait complete. 2023-12-19T17:52:14.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.650+0000 7fba1a0c3740 20 client.4785 trim_cache size 0 max 16384 2023-12-19T17:52:14.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.666+0000 7fba1a0c3740 1 Processor -- start 2023-12-19T17:52:14.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.666+0000 7fba1a0c3740 1 -- start start 2023-12-19T17:52:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2462b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24bf3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24bf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x23723d0 con 0x24a9eb0 2023-12-19T17:52:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x24c3860 con 0x24aa7d0 2023-12-19T17:52:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2398670 con 0x2488430 2023-12-19T17:52:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24bf3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24bf3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41458/0 (socket says 172.21.15.45:41458) 2023-12-19T17:52:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 -- 172.21.15.45:0/2258831299 learned_addr learned my addr 172.21.15.45:0/2258831299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba14bd0700 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2462b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba153d1700 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24bf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 -- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 msgr2=0x2462b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2462b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 -- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 msgr2=0x24bf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24bf930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 -- 172.21.15.45:0/2258831299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23769a0 con 0x24a9eb0 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba153d1700 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24bf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba0ffff700 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24bf3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0018b0 tx=0x7fb9fc02f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d40bc7e752c4c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fb9faffd700 1 -- 172.21.15.45:0/2258831299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc021ea0 con 0x24a9eb0 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fb9faffd700 1 -- 172.21.15.45:0/2258831299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc021830 con 0x24a9eb0 2023-12-19T17:52:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fb9faffd700 1 -- 172.21.15.45:0/2258831299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0383a0 con 0x24a9eb0 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 -- 172.21.15.45:0/2258831299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 msgr2=0x24bf3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24bf3f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0018b0 tx=0x7fb9fc02f000 comp rx=0 tx=0).stop 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 -- 172.21.15.45:0/2258831299 shutdown_connections 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24bf930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24bf3f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/2258831299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2462b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.670+0000 7fba1a0c3740 1 -- 172.21.15.45:0/2258831299 >> 172.21.15.45:0/2258831299 conn(0x21f24d0 msgr2=0x248a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 -- 172.21.15.45:0/2258831299 shutdown_connections 2023-12-19T17:52:14.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 -- 172.21.15.45:0/2258831299 wait complete. 2023-12-19T17:52:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 -- start start 2023-12-19T17:52:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 Processor -- start 2023-12-19T17:52:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2509470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24c2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x23c7e40 con 0x24a9eb0 2023-12-19T17:52:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2379930 con 0x24aa7d0 2023-12-19T17:52:14.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x23689c0 con 0x2488430 2023-12-19T17:52:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba1a0c3740 10 client.0 _ll_register_callbacks cb 0x2303e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:52:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41468/0 (socket says 172.21.15.45:41468) 2023-12-19T17:52:14.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 -- 172.21.15.45:0/4051541287 learned_addr learned my addr 172.21.15.45:0/4051541287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba14bd0700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2509470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 -- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 msgr2=0x2509470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba153d1700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2509470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 -- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 msgr2=0x24c2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24c2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 -- 172.21.15.45:0/4051541287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2390770 con 0x24a9eb0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba14bd0700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2509470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba153d1700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fba0ffff700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24c2200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009010 tx=0x7fb9fc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7028fd3b6969ee server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.674+0000 7fb9ef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/4051541287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc04e070 con 0x24a9eb0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/4051541287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb9fc01c030 con 0x24a9eb0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb9fc00d050 con 0x24a9eb0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/4051541287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9fc038350 con 0x24a9eb0 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 10 client.4791 fetch_fsmap learned FSMap version 8 2023-12-19T17:52:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x236ac70 con 0x24a9eb0 2023-12-19T17:52:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/4051541287 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00d050 con 0x24a9eb0 2023-12-19T17:52:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/4051541287 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 8) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fb9fc051020 con 0x24a9eb0 2023-12-19T17:52:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 10 client.4791 fetch_fsmap finished waiting for FSMap version 8 2023-12-19T17:52:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 10 client.4791 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:52:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 20 client.4791 populate_metadata read hostname 'smithi045' 2023-12-19T17:52:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x2460500 0x24a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 4 client.4791 mds_command: new command op to 54167 tid=0[{"prefix": "status"}] 2023-12-19T17:52:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 --> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2249460 con 0x2460500 2023-12-19T17:52:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba14bd0700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x2460500 0x24a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fba14bd0700 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x2460500 0x24a3430 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc04c9a00c952af server_cookie=ae1775b75407ad4f in_seq=0 out_seq=0 2023-12-19T17:52:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.678+0000 7fb9ef7fe700 10 client.4791 ms_handle_connect on v2:172.21.15.73:6833/3913672139 2023-12-19T17:52:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fb9ef7fe700 1 -- 172.21.15.45:0/4051541287 <== mds.0 v2:172.21.15.73:6833/3913672139 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x2249460 con 0x2460500 2023-12-19T17:52:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fb9ef7fe700 10 client.4791 handle_command_reply: tid=0 2023-12-19T17:52:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 client.4791 shutdown 2023-12-19T17:52:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 msgr2=0x24c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24c2200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009010 tx=0x7fb9fc014000 comp rx=0 tx=0).stop 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 shutdown_connections 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:6833/3913672139,v1:172.21.15.73:6835/3913672139] conn(0x2460500 0x24a3430 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24aa7d0 0x24c2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24a9eb0 0x24c2200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 --2- 172.21.15.45:0/4051541287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2488430 0x2509470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fb9ef7fe700 0 client.4791 ms_handle_reset on v2:172.21.15.73:6833/3913672139 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 >> 172.21.15.45:0/4051541287 conn(0x21f24d0 msgr2=0x248a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 shutdown_connections 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 1 -- 172.21.15.45:0/4051541287 wait complete. 2023-12-19T17:52:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba1a0c3740 20 client.4791 trim_cache size 0 max 16384 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 54167, 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 36.852024679000003, 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 8, 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 24, 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 24, 2023-12-19T17:52:14.685 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 41.908715385000001 2023-12-19T17:52:14.686 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:52:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9f4065b20 msgr2=0x7fb9f4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9f4065b20 0x7fb9f4067fe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fba10158bc0 tx=0x7fb9fc009040 comp rx=0 tx=0).stop 2023-12-19T17:52:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 msgr2=0x7fba101571a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 0x7fba101571a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fba0400c700 tx=0x7fba04001750 comp rx=0 tx=0).stop 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 shutdown_connections 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9f4065b20 0x7fb9f4067fe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba100cd620 0x7fba100cdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba100ca530 0x7fba100ca9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 --2- 172.21.15.45:0/3153418935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00004c70 0x7fba101571a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 >> 172.21.15.45:0/3153418935 conn(0x7fba100b46d0 msgr2=0x7fba10158cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 shutdown_connections 2023-12-19T17:52:14.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:14.682+0000 7fba15bd2700 1 -- 172.21.15.45:0/3153418935 wait complete. 2023-12-19T17:52:14.711 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-19T17:52:14.722 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-19T17:52:14.722 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-19T17:52:14.722 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-19T17:52:14.722 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T17:52:14.722 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:14.722 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-19T17:52:14.722 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T17:52:14.722 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:14.723 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-19T17:52:14.723 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T17:52:14.723 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:14.723 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-19T17:52:14.723 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-19T17:52:14.723 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:14.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:14.723 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T17:52:14.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:14.746 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-19T17:52:14.840 INFO:teuthology.orchestra.run.smithi073.stderr:Cannot find device "ceph-brx" 2023-12-19T17:52:14.844 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:52:14.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:14.845 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:52:14.867 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-19T17:52:14.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:14.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-19T17:52:14.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:14.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-12-19T17:52:15.179 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-19T17:52:15.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:52:15.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.358+0000 7f2f70836700 1 Processor -- start 2023-12-19T17:52:15.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.358+0000 7f2f70836700 1 -- start start 2023-12-19T17:52:15.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:15.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f6c06cad0 0x7f2f6c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:15.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c06f0a0 con 0x7f2f6c0af720 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c06ea90 con 0x7f2f6c06cad0 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c3f60 con 0x7f2f6c15ae20 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f6c06cad0 0x7f2f6c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f6c06cad0 0x7f2f6c0c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41476/0 (socket says 172.21.15.45:41476) 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 -- 172.21.15.45:0/1949425593 learned_addr learned my addr 172.21.15.45:0/1949425593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6ad9d700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 -- 172.21.15.45:0/1949425593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 msgr2=0x7f2f6c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 -- 172.21.15.45:0/1949425593 >> v1:172.21.15.73:6789/0 conn(0x7f2f6c0af720 legacy=0x7f2f6c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 -- 172.21.15.45:0/1949425593 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c0c4240 con 0x7f2f6c06cad0 2023-12-19T17:52:15.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6ad9d700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:15.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6259c700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c0c3710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009910 tx=0x7f2f54009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aca372a98b10bb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:15.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6a59c700 1 -- 172.21.15.45:0/1949425593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54004230 con 0x7f2f6c06cad0 2023-12-19T17:52:15.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6a59c700 1 -- 172.21.15.45:0/1949425593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f54004390 con 0x7f2f6c06cad0 2023-12-19T17:52:15.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f6a59c700 1 -- 172.21.15.45:0/1949425593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54009e60 con 0x7f2f6c06cad0 2023-12-19T17:52:15.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- 172.21.15.45:0/1949425593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 msgr2=0x7f2f6c0c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:15.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c0c3710 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f2f54009910 tx=0x7f2f54009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:15.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- 172.21.15.45:0/1949425593 shutdown_connections 2023-12-19T17:52:15.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c0c3710 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 --2- 172.21.15.45:0/1949425593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- 172.21.15.45:0/1949425593 >> 172.21.15.45:0/1949425593 conn(0x7f2f6c0cb900 msgr2=0x7f2f6c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:15.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- 172.21.15.45:0/1949425593 shutdown_connections 2023-12-19T17:52:15.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.362+0000 7f2f70836700 1 -- 172.21.15.45:0/1949425593 wait complete. 2023-12-19T17:52:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.366+0000 7f2f70836700 1 Processor -- start 2023-12-19T17:52:15.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 -- start start 2023-12-19T17:52:15.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c1f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:15.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f6c0af720 0x7f2f6c151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:15.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:15.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c1f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c152210 con 0x7f2f6c06cad0 2023-12-19T17:52:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0ca250 con 0x7f2f6c0af720 2023-12-19T17:52:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f70836700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c6600 con 0x7f2f6c15ae20 2023-12-19T17:52:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f6c0af720 0x7f2f6c151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c1f2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41480/0 (socket says 172.21.15.45:41480) 2023-12-19T17:52:15.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6ad9d700 1 -- 172.21.15.45:0/3732231002 learned_addr learned my addr 172.21.15.45:0/3732231002 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6b59e700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6259c700 1 -- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 msgr2=0x7f2f6c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6259c700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6259c700 1 -- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 msgr2=0x7f2f6c1f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6259c700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c1f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.370+0000 7f2f6259c700 1 -- 172.21.15.45:0/3732231002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f54009570 con 0x7f2f6c0af720 2023-12-19T17:52:15.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f6259c700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f6c0af720 0x7f2f6c151cd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f54015000 tx=0x7f2f54004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:15.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f540045c0 con 0x7f2f6c0af720 2023-12-19T17:52:15.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f5401f070 con 0x7f2f6c0af720 2023-12-19T17:52:15.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f54003900 con 0x7f2f6c0af720 2023-12-19T17:52:15.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0c9640 con 0x7f2f6c0af720 2023-12-19T17:52:15.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c0c9c00 con 0x7f2f6c0af720 2023-12-19T17:52:15.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.374+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c067760 con 0x7f2f6c0af720 2023-12-19T17:52:15.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.378+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f54021030 con 0x7f2f6c0af720 2023-12-19T17:52:15.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.378+0000 7f2f63fff700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f4c065ad0 0x7f2f4c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:15.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.378+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f54084b80 con 0x7f2f6c0af720 2023-12-19T17:52:15.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.378+0000 7f2f6ad9d700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f4c065ad0 0x7f2f4c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:15.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.382+0000 7f2f6ad9d700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f4c065ad0 0x7f2f4c067f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c006fd0 tx=0x7f2f5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:15.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.386+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2f54052360 con 0x7f2f6c0af720 2023-12-19T17:52:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.606+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2f6c067760 con 0x7f2f6c0af720 2023-12-19T17:52:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.606+0000 7f2f63fff700 1 -- 172.21.15.45:0/3732231002 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2f54055980 con 0x7f2f6c0af720 2023-12-19T17:52:15.609 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f4c065ad0 msgr2=0x7f2f4c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f4c065ad0 0x7f2f4c067f90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c006fd0 tx=0x7f2f5c008040 comp rx=0 tx=0).stop 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f6c0af720 msgr2=0x7f2f6c151cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f6c0af720 0x7f2f6c151cd0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f2f54015000 tx=0x7f2f54004770 comp rx=0 tx=0).stop 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 shutdown_connections 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f4c065ad0 0x7f2f4c067f90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f6c15ae20 0x7f2f6c0c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f6c0af720 0x7f2f6c151cd0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 --2- 172.21.15.45:0/3732231002 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f6c06cad0 0x7f2f6c1f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 >> 172.21.15.45:0/3732231002 conn(0x7f2f6c0cb900 msgr2=0x7f2f6c06da90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:15.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 shutdown_connections 2023-12-19T17:52:15.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:15.610+0000 7f2f70836700 1 -- 172.21.15.45:0/3732231002 wait complete. 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:52:15.639 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:52:15.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:15.640 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:52:15.653 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:15.654 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42329sec preferred_lft 42329sec 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:52:15.655 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:15.656 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T17:52:15.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:15.656 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:15.656 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:15.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add name ceph-brx type bridge 2023-12-19T17:52:15.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr flush dev ceph-brx 2023-12-19T17:52:15.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set ceph-brx up 2023-12-19T17:52:15.657 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T17:52:15.657 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:15.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:15.807 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:52:15.840 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:52:15.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:15.845 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:52:15.909 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:52:15.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:15.911 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:15.911 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:15.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:52:15.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:52:15.911 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:52:15.911 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:16.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.049 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:52:16.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.070 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-19T17:52:16.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.127 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:16.127 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:16.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:52:16.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-19T17:52:16.127 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:16.247 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-19T17:52:16.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-19T17:52:16.248 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:16.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.400 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:16.400 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:16.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:52:16.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T17:52:16.400 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:16.475 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T17:52:16.475 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:16.476 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:16.491 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:52:16.492 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:16.492 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:16.552 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:52:16.634 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:16.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:16.714 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:16.718 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:16.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.719 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:52:16.780 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:52:16.781 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T17:52:16.833 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:52:16.867 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:16.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:16.941 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:16.943 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:16.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:16.944 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:52:16.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T17:52:16.978+0000 7f89594f9640 -1 init, newargv = 0x55b480a0beb0 newargc=15 2023-12-19T17:52:16.981 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[42925]: starting ceph client 2023-12-19T17:52:16.995 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:52:16.997 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:52:16.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:52:16.997 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:52:16.997 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:52:16.998 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T17:52:16.999 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:52:17.000 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[42925]: starting fuse 2023-12-19T17:52:17.160 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.42925.asok 2023-12-19T17:52:17.341 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.42925.asok 2023-12-19T17:52:17.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:17.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.42925.asok status 2023-12-19T17:52:17.546 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:52:17.546 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:52:17.546 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:52:17.546 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:52:17.546 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T17:52:17.546 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "42925", 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:52:17.547 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4803, 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4803 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:52:17.548 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:52:17.549 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:52:17.549 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1179056295 2023-12-19T17:52:17.549 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:52:17.549 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:17.549 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:52:17.549 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1179056295 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4803 192.168.0.1:0/1179056295", 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1179056295", 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 8, 2023-12-19T17:52:17.550 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 24, 2023-12-19T17:52:17.551 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:52:17.551 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:52:17.551 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:52:17.551 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:52:17.561 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:52:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 Processor -- start 2023-12-19T17:52:17.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 -- start start 2023-12-19T17:52:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f790806ea90 0x7f79080d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79080b88b0 0x7f79080b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79080b6dd0 con 0x7f79080b6250 2023-12-19T17:52:17.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080d1820 con 0x7f790806ea90 2023-12-19T17:52:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f790ceca700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79080d1b00 con 0x7f79080b88b0 2023-12-19T17:52:17.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f79077fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f790806ea90 0x7f79080d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f79077fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f790806ea90 0x7f79080d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41484/0 (socket says 172.21.15.45:41484) 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f79077fe700 1 -- 172.21.15.45:0/667864389 learned_addr learned my addr 172.21.15.45:0/667864389 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.738+0000 7f78fffff700 1 --2- 172.21.15.45:0/667864389 >> v2:172.21.15.73:3300/0 conn(0x7f79080b88b0 0x7f79080b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f79077fe700 1 -- 172.21.15.45:0/667864389 >> v2:172.21.15.73:3300/0 conn(0x7f79080b88b0 msgr2=0x7f79080b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f79077fe700 1 --2- 172.21.15.45:0/667864389 >> v2:172.21.15.73:3300/0 conn(0x7f79080b88b0 0x7f79080b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f79077fe700 1 -- 172.21.15.45:0/667864389 >> v1:172.21.15.73:6789/0 conn(0x7f79080b6250 legacy=0x7f79080b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:17.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f79077fe700 1 -- 172.21.15.45:0/667864389 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79080d1de0 con 0x7f790806ea90 2023-12-19T17:52:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f79077fe700 1 --2- 172.21.15.45:0/667864389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f790806ea90 0x7f79080d0f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79080b2610 tx=0x7f78f8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0308b40254db899 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f7906ffd700 1 -- 172.21.15.45:0/667864389 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8011830 con 0x7f790806ea90 2023-12-19T17:52:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f7906ffd700 1 -- 172.21.15.45:0/667864389 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f8011990 con 0x7f790806ea90 2023-12-19T17:52:17.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f7906ffd700 1 -- 172.21.15.45:0/667864389 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f8011d20 con 0x7f790806ea90 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 -- 172.21.15.45:0/667864389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f790806ea90 msgr2=0x7f79080d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 --2- 172.21.15.45:0/667864389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f790806ea90 0x7f79080d0f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f79080b2610 tx=0x7f78f8009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 -- 172.21.15.45:0/667864389 shutdown_connections 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 --2- 172.21.15.45:0/667864389 >> v2:172.21.15.73:3300/0 conn(0x7f79080b88b0 0x7f79080b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 --2- 172.21.15.45:0/667864389 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f790806ea90 0x7f79080d0f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 -- 172.21.15.45:0/667864389 >> 172.21.15.45:0/667864389 conn(0x7f79080b46d0 msgr2=0x7f79080b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 -- 172.21.15.45:0/667864389 shutdown_connections 2023-12-19T17:52:17.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.742+0000 7f790ceca700 1 -- 172.21.15.45:0/667864389 wait complete. 2023-12-19T17:52:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 Processor -- start 2023-12-19T17:52:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 -- start start 2023-12-19T17:52:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f790806ea90 0x7f79081e4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 0x7f790815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79080b88b0 0x7f79081e21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79081e35a0 con 0x7f79080b6250 2023-12-19T17:52:17.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f790815b5b0 con 0x7f79080b88b0 2023-12-19T17:52:17.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f790ceca700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79081e2a20 con 0x7f790806ea90 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 0x7f790815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 0x7f790815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41496/0 (socket says 172.21.15.45:41496) 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 -- 172.21.15.45:0/69763394 learned_addr learned my addr 172.21.15.45:0/69763394 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f79077fe700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f790806ea90 0x7f79081e4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f7907fff700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79080b88b0 0x7f79081e21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 -- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f790806ea90 msgr2=0x7f79081e4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f790806ea90 0x7f79081e4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 -- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79080b88b0 msgr2=0x7f79081e21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79080b88b0 0x7f79081e21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 -- 172.21.15.45:0/69763394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f8009570 con 0x7f79080b6250 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f79077fe700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f790806ea90 0x7f79081e4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f7907fff700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79080b88b0 0x7f79081e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:17.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f78fffff700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 0x7f790815b070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78f000e840 tx=0x7f78f000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00095a0 con 0x7f79080b6250 2023-12-19T17:52:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.750+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79081e2d00 con 0x7f79080b6250 2023-12-19T17:52:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.746+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f000c690 con 0x7f79080b6250 2023-12-19T17:52:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.750+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f000ca00 con 0x7f79080b6250 2023-12-19T17:52:17.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.750+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79081e32c0 con 0x7f79080b6250 2023-12-19T17:52:17.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.750+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7908067760 con 0x7f79080b6250 2023-12-19T17:52:17.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.750+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78f000cb60 con 0x7f79080b6250 2023-12-19T17:52:17.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.754+0000 7f7904ff9700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78e8065ad0 0x7f78e8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.754+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78f00833f0 con 0x7f79080b6250 2023-12-19T17:52:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.754+0000 7f79077fe700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78e8065ad0 0x7f78e8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:17.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.754+0000 7f79077fe700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78e8065ad0 0x7f78e8067f90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:17.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.762+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78f0050ab0 con 0x7f79080b6250 2023-12-19T17:52:17.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.974+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7908071b70 con 0x7f79080b6250 2023-12-19T17:52:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.978+0000 7f7904ff9700 1 -- 172.21.15.45:0/69763394 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f78f00540d0 con 0x7f79080b6250 2023-12-19T17:52:17.979 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T17:52:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78e8065ad0 msgr2=0x7f78e8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78e8065ad0 0x7f78e8067f90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f78f8000c00 tx=0x7f78f8008030 comp rx=0 tx=0).stop 2023-12-19T17:52:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 msgr2=0x7f790815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 0x7f790815b070 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f78f000e840 tx=0x7f78f000ec00 comp rx=0 tx=0).stop 2023-12-19T17:52:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 shutdown_connections 2023-12-19T17:52:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78e8065ad0 0x7f78e8067f90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79080b88b0 0x7f79081e21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79080b6250 0x7f790815b070 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 --2- 172.21.15.45:0/69763394 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f790806ea90 0x7f79081e4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 >> 172.21.15.45:0/69763394 conn(0x7f79080b46d0 msgr2=0x7f790806fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 shutdown_connections 2023-12-19T17:52:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:17.982+0000 7f790ceca700 1 -- 172.21.15.45:0/69763394 wait complete. 2023-12-19T17:52:18.006 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:52:18.006 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:52:18.006 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:52:18.006 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-19T17:52:18.006 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:18.006 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:52:18.007 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:52:18.007 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:52:18.007 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-19T17:52:18.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.007 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:52:18.028 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:18.028 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:18.028 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:18.028 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.028 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:18.028 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:52:18.029 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42327sec preferred_lft 42327sec 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:18.030 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:52:18.031 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.032 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T17:52:18.032 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.032 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:52:18.032 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:52:18.032 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link tentative 2023-12-19T17:52:18.032 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.034 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:52:18.113 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:52:18.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.116 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:52:18.177 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:52:18.178 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:52:18.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.179 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:18.179 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:18.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:52:18.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:52:18.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:52:18.179 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:18.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.316 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:52:18.337 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:52:18.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.338 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list-id 2023-12-19T17:52:18.399 INFO:teuthology.orchestra.run.smithi045.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-19T17:52:18.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.401 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:18.401 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:18.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T17:52:18.401 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-19T17:52:18.401 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:18.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.520 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T17:52:18.553 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:18.553 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:18.553 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:18.553 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.553 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:18.553 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.554 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:52:18.554 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 2e:2e:28:f2:24:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T17:52:18.554 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T17:52:18.554 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.554 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::2c2e:28ff:fef2:24bd/64 scope link 2023-12-19T17:52:18.554 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.557 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 2e:2e:28:f2:24:bd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T17:52:18.638 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T17:52:18.639 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.639 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::2c2e:28ff:fef2:24bd/64 scope link 2023-12-19T17:52:18.639 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:18.642 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-19T17:52:18.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-19T17:52:18.642 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:18.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:18.840 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:52:18.841 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:52:18.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.1 up 2023-12-19T17:52:18.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T17:52:18.841 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:52:18.916 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-19T17:52:18.916 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:18.916 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:18.936 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-19T17:52:18.937 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:18.937 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:19.001 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:52:19.081 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:19.082 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:19.161 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:19.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:19.162 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:52:19.224 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:52:19.225 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-12-19T17:52:19.225 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-19T17:52:19.273 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:52:19.305 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:19.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:19.379 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:19.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:19.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:19.382 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:52:19.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:2023-12-19T17:52:19.418+0000 7f4c5754a640 -1 init, newargv = 0x5614282ebe40 newargc=15 2023-12-19T17:52:19.420 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:ceph-fuse[43062]: starting ceph client 2023-12-19T17:52:19.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi045.stderr:ceph-fuse[43062]: starting fuse 2023-12-19T17:52:19.434 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:52:19.434 INFO:teuthology.orchestra.run.smithi045.stdout:50 2023-12-19T17:52:19.434 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:52:19.435 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:52:19.436 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:52:19.437 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:52:19.438 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.2")) 2023-12-19T17:52:19.438 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:52:19.598 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.2.43062.asok 2023-12-19T17:52:19.782 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.43062.asok 2023-12-19T17:52:19.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:19.782 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.43062.asok status 2023-12-19T17:52:19.985 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "2", 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "43062", 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:52:19.986 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 4815, 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 4815 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.2:0", 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1528073544 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:19.987 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.2:0", 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1528073544 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.4815 192.168.0.2:0/1528073544", 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.2:0/1528073544", 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 8, 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 24, 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:52:19.988 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:52:20.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:52:20.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f81189a6700 1 Processor -- start 2023-12-19T17:52:20.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f81189a6700 1 -- start start 2023-12-19T17:52:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f81189a6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f811406ea90 0x7f81140d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f81189a6700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140d1820 con 0x7f81140b88b0 2023-12-19T17:52:20.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f81189a6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81140d1b00 con 0x7f811406fe80 2023-12-19T17:52:20.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f81189a6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81140d1de0 con 0x7f811406ea90 2023-12-19T17:52:20.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f811259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81140b88b0 0x7f81140b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44256/0 (socket says 172.21.15.45:44256) 2023-12-19T17:52:20.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.174+0000 7f811259c700 1 -- 172.21.15.45:0/1295604020 learned_addr learned my addr 172.21.15.45:0/1295604020 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:20.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 --2- 172.21.15.45:0/1295604020 >> v2:172.21.15.73:3300/0 conn(0x7f811406ea90 0x7f81140d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1369754981 0 0) 0x7f81140d1820 con 0x7f81140b88b0 2023-12-19T17:52:20.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80fc0035d0 con 0x7f81140b88b0 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1918736144 0 0) 0x7f81140d1b00 con 0x7f811406fe80 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81140d1820 con 0x7f811406fe80 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1519420030 0 0) 0x7f80fc0035d0 con 0x7f81140b88b0 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 >> v2:172.21.15.73:3300/0 conn(0x7f811406ea90 msgr2=0x7f81140d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 --2- 172.21.15.45:0/1295604020 >> v2:172.21.15.73:3300/0 conn(0x7f811406ea90 0x7f81140d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 >> v1:172.21.15.73:6789/0 conn(0x7f811406fe80 legacy=0x7f81140b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81140d20c0 con 0x7f81140b88b0 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f8108001670 con 0x7f81140b88b0 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 >> v1:172.21.15.45:6789/0 conn(0x7f81140b88b0 legacy=0x7f81140b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f80fc003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80fc004870 0x7f80fc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80fc005230 0x7f80fc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140d1de0 con 0x7f80fc003bb0 2023-12-19T17:52:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00c160 con 0x7f80fc005230 2023-12-19T17:52:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80fc00c320 con 0x7f80fc004870 2023-12-19T17:52:20.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f80fc003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f811359e700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80fc005230 0x7f80fc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f811259c700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80fc004870 0x7f80fc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 -- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80fc004870 msgr2=0x7f80fc004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80fc004870 0x7f80fc004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 -- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80fc005230 msgr2=0x7f80fc00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80fc005230 0x7f80fc00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f811359e700 1 -- 172.21.15.45:0/1295604020 reap_dead start 2023-12-19T17:52:20.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 -- 172.21.15.45:0/1295604020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc0035d0 con 0x7f80fc003bb0 2023-12-19T17:52:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8112d9d700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f80fc003fb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8104009b70 tx=0x7f80fc0058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c406905a05ed98e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400e6c0 con 0x7f80fc003bb0 2023-12-19T17:52:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f810400e820 con 0x7f80fc003bb0 2023-12-19T17:52:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.178+0000 7f8111d9b700 1 -- 172.21.15.45:0/1295604020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400eb90 con 0x7f80fc003bb0 2023-12-19T17:52:20.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 -- 172.21.15.45:0/1295604020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 msgr2=0x7f80fc003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f80fc003fb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8104009b70 tx=0x7f80fc0058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 -- 172.21.15.45:0/1295604020 shutdown_connections 2023-12-19T17:52:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 --2- 172.21.15.45:0/1295604020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f80fc003fb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 -- 172.21.15.45:0/1295604020 >> 172.21.15.45:0/1295604020 conn(0x7f81140b46d0 msgr2=0x7f81140b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 -- 172.21.15.45:0/1295604020 shutdown_connections 2023-12-19T17:52:20.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.182+0000 7f81189a6700 1 -- 172.21.15.45:0/1295604020 wait complete. 2023-12-19T17:52:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 Processor -- start 2023-12-19T17:52:20.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 -- start start 2023-12-19T17:52:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f81141f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81140c8fb0 0x7f8114160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81141f27c0 0x7f81141f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81140c9de0 con 0x7f80fc003bb0 2023-12-19T17:52:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81141f6c30 con 0x7f81141f27c0 2023-12-19T17:52:20.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f81189a6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81141f6390 con 0x7f81140c8fb0 2023-12-19T17:52:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f81141f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f81141f5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38676/0 (socket says 172.21.15.45:38676) 2023-12-19T17:52:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 -- 172.21.15.45:0/410714122 learned_addr learned my addr 172.21.15.45:0/410714122 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f811259c700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81140c8fb0 0x7f8114160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f811359e700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81141f27c0 0x7f81141f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 -- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81140c8fb0 msgr2=0x7f8114160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81140c8fb0 0x7f8114160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 -- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81141f27c0 msgr2=0x7f81141f2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81141f27c0 0x7f81141f2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 -- 172.21.15.45:0/410714122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81141f6670 con 0x7f80fc003bb0 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f811359e700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81141f27c0 0x7f81141f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.186+0000 7f8112d9d700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f81141f5db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c130 tx=0x7f81040047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.190+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810400e6c0 con 0x7f80fc003bb0 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.190+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8104003b10 con 0x7f80fc003bb0 2023-12-19T17:52:20.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.190+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81040045a0 con 0x7f80fc003bb0 2023-12-19T17:52:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.190+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81141f6950 con 0x7f80fc003bb0 2023-12-19T17:52:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.190+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141606a0 con 0x7f80fc003bb0 2023-12-19T17:52:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.190+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8114067760 con 0x7f80fc003bb0 2023-12-19T17:52:20.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.194+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8104013470 con 0x7f80fc003bb0 2023-12-19T17:52:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.194+0000 7f80fb7fe700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8100065ad0 0x7f8100067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.194+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8104084890 con 0x7f80fc003bb0 2023-12-19T17:52:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.194+0000 7f811259c700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8100065ad0 0x7f8100067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:20.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.194+0000 7f811259c700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8100065ad0 0x7f8100067f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f811415ca80 tx=0x7f8108007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:20.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.202+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f81040520a0 con 0x7f80fc003bb0 2023-12-19T17:52:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.422+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8114159650 con 0x7f80fc003bb0 2023-12-19T17:52:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.422+0000 7f80fb7fe700 1 -- 172.21.15.45:0/410714122 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8104017070 con 0x7f80fc003bb0 2023-12-19T17:52:20.424 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T17:52:20.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8100065ad0 msgr2=0x7f8100067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8100065ad0 0x7f8100067f90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f811415ca80 tx=0x7f8108007040 comp rx=0 tx=0).stop 2023-12-19T17:52:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 msgr2=0x7f81141f5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f81141f5db0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f80fc00c130 tx=0x7f81040047e0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 shutdown_connections 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8100065ad0 0x7f8100067f90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81141f27c0 0x7f81141f2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81140c8fb0 0x7f8114160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 --2- 172.21.15.45:0/410714122 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80fc003bb0 0x7f81141f5db0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 >> 172.21.15.45:0/410714122 conn(0x7f81140b46d0 msgr2=0x7f81140ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.426+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 shutdown_connections 2023-12-19T17:52:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:20.430+0000 7f81189a6700 1 -- 172.21.15.45:0/410714122 wait complete. 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:52:20.453 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-19T17:52:20.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.453 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:20.473 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42316sec preferred_lft 42316sec 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:bd:67:f8:8b brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:20.474 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:52:20.475 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:20.475 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-19T17:52:20.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add name ceph-brx type bridge 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr flush dev ceph-brx 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set ceph-brx up 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-19T17:52:20.476 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:20.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.622 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:52:20.652 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T17:52:20.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.656 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-19T17:52:20.739 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:52:20.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.740 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:20.740 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:20.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T17:52:20.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T17:52:20.741 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T17:52:20.741 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:20.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.876 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T17:52:20.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.897 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-12-19T17:52:20.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:20.958 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:20.958 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:20.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T17:52:20.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-19T17:52:20.959 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:21.077 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-19T17:52:21.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:21.077 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:21.077 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:21.077 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-19T17:52:21.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-19T17:52:21.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-19T17:52:21.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-19T17:52:21.078 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-19T17:52:21.078 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:21.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:21.286 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:21.286 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:21.287 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.0 up 2023-12-19T17:52:21.287 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.0 master ceph-brx 2023-12-19T17:52:21.287 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:21.356 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-19T17:52:21.356 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:21.356 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:21.374 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-19T17:52:21.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:21.375 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:21.429 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2023-12-19T17:52:21.510 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:21.510 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:21.580 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:21.584 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:21.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:21.585 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2023-12-19T17:52:21.647 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:52:21.648 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-19T17:52:21.695 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2023-12-19T17:52:21.730 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:21.731 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:21.805 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:21.806 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:21.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:21.807 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2023-12-19T17:52:21.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:2023-12-19T17:52:21.836+0000 7f9dbaa0a640 -1 init, newargv = 0x55e0fffc5eb0 newargc=15 2023-12-19T17:52:21.840 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[41763]: starting ceph client 2023-12-19T17:52:21.854 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi073.stderr:ceph-fuse[41763]: starting fuse 2023-12-19T17:52:21.855 INFO:teuthology.orchestra.run.smithi073.stdout:49 2023-12-19T17:52:21.856 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> import re 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> import os 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:21.856 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> return f 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.1")) 2023-12-19T17:52:21.857 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T17:52:22.011 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.1.41763.asok 2023-12-19T17:52:22.198 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.41763.asok 2023-12-19T17:52:22.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:22.198 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.41763.asok status 2023-12-19T17:52:22.395 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T17:52:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2023-12-19T17:52:22.395 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "1", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "41763", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4825, 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4825 2023-12-19T17:52:22.396 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2309772350 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 2309772350 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4825 192.168.0.1:0/2309772350", 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.1:0/2309772350", 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2023-12-19T17:52:22.397 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 8, 2023-12-19T17:52:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 26, 2023-12-19T17:52:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:52:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2023-12-19T17:52:22.398 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2023-12-19T17:52:22.398 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T17:52:22.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:52:22.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.594+0000 7f11a6f1d700 1 Processor -- start 2023-12-19T17:52:22.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a6f1d700 1 -- start start 2023-12-19T17:52:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a6f1d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11a006ea90 0x7f11a00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a6f1d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00d1820 con 0x7f11a00b88b0 2023-12-19T17:52:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a6f1d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11a00d1b00 con 0x7f11a006fe80 2023-12-19T17:52:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a6f1d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11a00d1de0 con 0x7f11a006ea90 2023-12-19T17:52:22.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a5f1b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11a006ea90 0x7f11a00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:22.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a571a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f11a00b88b0 0x7f11a00b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44270/0 (socket says 172.21.15.45:44270) 2023-12-19T17:52:22.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.598+0000 7f11a571a700 1 -- 172.21.15.45:0/187137703 learned_addr learned my addr 172.21.15.45:0/187137703 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a4f19700 1 -- 172.21.15.45:0/187137703 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 446676499 0 0) 0x7f11a00d1820 con 0x7f11a00b88b0 2023-12-19T17:52:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a4f19700 1 -- 172.21.15.45:0/187137703 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f118c0035d0 con 0x7f11a00b88b0 2023-12-19T17:52:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a5f1b700 1 -- 172.21.15.45:0/187137703 >> v1:172.21.15.73:6789/0 conn(0x7f11a006fe80 legacy=0x7f11a00b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a5f1b700 1 -- 172.21.15.45:0/187137703 >> v1:172.21.15.45:6789/0 conn(0x7f11a00b88b0 legacy=0x7f11a00b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a5f1b700 1 -- 172.21.15.45:0/187137703 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a00d20c0 con 0x7f11a006ea90 2023-12-19T17:52:22.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a5f1b700 1 --2- 172.21.15.45:0/187137703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a00d0f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f119c009d90 tx=0x7f119c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a563006f794c74 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a4f19700 1 -- 172.21.15.45:0/187137703 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00e070 con 0x7f11a006ea90 2023-12-19T17:52:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a4f19700 1 -- 172.21.15.45:0/187137703 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00bae0 con 0x7f11a006ea90 2023-12-19T17:52:22.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a4f19700 1 -- 172.21.15.45:0/187137703 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00be50 con 0x7f11a006ea90 2023-12-19T17:52:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 -- 172.21.15.45:0/187137703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 msgr2=0x7f11a00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/187137703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a00d0f20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f119c009d90 tx=0x7f119c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 -- 172.21.15.45:0/187137703 shutdown_connections 2023-12-19T17:52:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/187137703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a00d0f20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 -- 172.21.15.45:0/187137703 >> 172.21.15.45:0/187137703 conn(0x7f11a00b46d0 msgr2=0x7f11a00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:22.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 -- 172.21.15.45:0/187137703 shutdown_connections 2023-12-19T17:52:22.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.602+0000 7f11a6f1d700 1 -- 172.21.15.45:0/187137703 wait complete. 2023-12-19T17:52:22.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 Processor -- start 2023-12-19T17:52:22.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 -- start start 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a0157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 0x7f11a00b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11a00b88b0 0x7f11a01556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0156fe0 con 0x7f11a006fe80 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0156a20 con 0x7f11a006ea90 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a6f1d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11a0156d00 con 0x7f11a00b88b0 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a571a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 0x7f11a00b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a571a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 0x7f11a00b6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38690/0 (socket says 172.21.15.45:38690) 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a571a700 1 -- 172.21.15.45:0/3943899897 learned_addr learned my addr 172.21.15.45:0/3943899897 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a671c700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11a00b88b0 0x7f11a01556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:22.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.606+0000 7f11a5f1b700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a0157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a571a700 1 -- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11a00b88b0 msgr2=0x7f11a01556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a571a700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11a00b88b0 0x7f11a01556a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a571a700 1 -- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 msgr2=0x7f11a0157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a571a700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a0157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a571a700 1 -- 172.21.15.45:0/3943899897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c009a70 con 0x7f11a006fe80 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a571a700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 0x7f11a00b6b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f119000c4d0 tx=0x7f119000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1190005d90 con 0x7f11a006fe80 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000ce80 con 0x7f11a006fe80 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11a00cadf0 con 0x7f11a006fe80 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900072d0 con 0x7f11a006fe80 2023-12-19T17:52:22.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11a0157850 con 0x7f11a006fe80 2023-12-19T17:52:22.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.610+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11a00cb310 con 0x7f11a006fe80 2023-12-19T17:52:22.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.614+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1190007430 con 0x7f11a006fe80 2023-12-19T17:52:22.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.614+0000 7f11967fc700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065ad0 0x7f1184067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:22.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.614+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1190082850 con 0x7f11a006fe80 2023-12-19T17:52:22.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.614+0000 7f11a5f1b700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065ad0 0x7f1184067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:22.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.614+0000 7f11a5f1b700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065ad0 0x7f1184067f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f119c00d010 tx=0x7f119c014040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:22.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.622+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11a00cb310 con 0x7f11a006fe80 2023-12-19T17:52:22.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.834+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f11a00cb310 con 0x7f11a006fe80 2023-12-19T17:52:22.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.834+0000 7f11967fc700 1 -- 172.21.15.45:0/3943899897 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f1190017070 con 0x7f11a006fe80 2023-12-19T17:52:22.836 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-19T17:52:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065ad0 msgr2=0x7f1184067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065ad0 0x7f1184067f90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f119c00d010 tx=0x7f119c014040 comp rx=0 tx=0).stop 2023-12-19T17:52:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 msgr2=0x7f11a00b6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:22.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 0x7f11a00b6b00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f119000c4d0 tx=0x7f119000c7e0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 shutdown_connections 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065ad0 0x7f1184067f90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11a00b88b0 0x7f11a01556a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11a006fe80 0x7f11a00b6b00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 --2- 172.21.15.45:0/3943899897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11a006ea90 0x7f11a0157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 >> 172.21.15.45:0/3943899897 conn(0x7f11a00b46d0 msgr2=0x7f11a00b3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 shutdown_connections 2023-12-19T17:52:22.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:22.838+0000 7f11a6f1d700 1 -- 172.21.15.45:0/3943899897 wait complete. 2023-12-19T17:52:22.863 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:52:22.863 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:52:22.863 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi073.front.sepia.ceph.com 2023-12-19T17:52:22.863 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-19T17:52:22.863 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:22.863 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:52:22.864 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:52:22.864 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:52:22.864 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-19T17:52:22.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:22.864 DEBUG:teuthology.orchestra.run.smithi073:> ip addr 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:ea brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f0 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:d8:d9:eb brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: altname enp7s0f1 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7c brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 0c:c4:7a:8f:ce:7d brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.21.15.73/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft 42314sec preferred_lft 42314sec 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::ec4:7aff:fe8f:ce7d/64 scope link 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether 02:42:bd:67:f8:8b brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether b6:5d:3f:e2:37:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T17:52:22.888 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:52:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::207d:beff:fece:723b/64 scope link 2023-12-19T17:52:22.889 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.890 INFO:teuthology.orchestra.run.smithi073.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:52:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether b6:5d:3f:e2:37:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T17:52:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::b45d:3fff:fee2:376e/64 scope link 2023-12-19T17:52:22.890 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:22.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:22.890 DEBUG:teuthology.orchestra.run.smithi073:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:52:22.966 INFO:teuthology.orchestra.run.smithi073.stdout:1 2023-12-19T17:52:22.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:22.969 DEBUG:teuthology.orchestra.run.smithi073:> route 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:Kernel IP routing table 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 enp3s0f1 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-19T17:52:23.036 INFO:teuthology.orchestra.run.smithi073.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:52:23.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.037 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:23.037 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:23.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-19T17:52:23.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-19T17:52:23.037 DEBUG:teuthology.orchestra.run.smithi073:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-19T17:52:23.037 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:23.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.161 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T17:52:23.176 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T17:52:23.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.178 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list-id 2023-12-19T17:52:23.241 INFO:teuthology.orchestra.run.smithi073.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-19T17:52:23.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.242 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:23.242 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:23.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T17:52:23.242 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-19T17:52:23.242 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:23.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.363 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T17:52:23.401 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:23.401 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether d6:e0:2a:f2:5c:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::d4e0:2aff:fef2:5c55/64 scope link 2023-12-19T17:52:23.402 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.407 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-19T17:52:23.492 INFO:teuthology.orchestra.run.smithi073.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:52:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:52:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:52:23.492 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 ::1/128 scope host 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: link/ether d6:e0:2a:f2:5c:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: inet6 fe80::d4e0:2aff:fef2:5c55/64 scope link 2023-12-19T17:52:23.493 INFO:teuthology.orchestra.run.smithi073.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:52:23.495 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-19T17:52:23.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.495 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:23.495 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:23.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-19T17:52:23.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-19T17:52:23.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-19T17:52:23.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-19T17:52:23.496 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-19T17:52:23.496 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:23.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:23.686 DEBUG:teuthology.orchestra.run.smithi073:> (cd / && exec bash -c ' 2023-12-19T17:52:23.686 DEBUG:teuthology.orchestra.run.smithi073:> set -e 2023-12-19T17:52:23.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set brx.1 up 2023-12-19T17:52:23.686 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link set dev brx.1 master ceph-brx 2023-12-19T17:52:23.686 DEBUG:teuthology.orchestra.run.smithi073:> ') 2023-12-19T17:52:23.758 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-19T17:52:23.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:23.758 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:23.775 INFO:teuthology.orchestra.run.smithi073.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-19T17:52:23.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:52:23.775 DEBUG:teuthology.orchestra.run.smithi073:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:23.836 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2023-12-19T17:52:23.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:23.922 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:24.002 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:24.004 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:24.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.005 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2023-12-19T17:52:24.067 INFO:teuthology.orchestra.run.smithi073.stdout:49 2023-12-19T17:52:24.068 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [49] 2023-12-19T17:52:24.068 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-19T17:52:24.115 DEBUG:teuthology.orchestra.run.smithi073:> sudo modprobe fuse 2023-12-19T17:52:24.147 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:52:24.147 DEBUG:teuthology.orchestra.run.smithi073:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:52:24.221 INFO:teuthology.orchestra.run.smithi073.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:52:24.225 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:52:24.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.226 DEBUG:teuthology.orchestra.run.smithi073:> ls /sys/fs/fuse/connections 2023-12-19T17:52:24.261 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi073.stderr:2023-12-19T17:52:24.256+0000 7f9800169640 -1 init, newargv = 0x55b7ac317350 newargc=15 2023-12-19T17:52:24.262 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi073.stderr:ceph-fuse[41873]: starting ceph client 2023-12-19T17:52:24.272 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi073.stderr:ceph-fuse[41873]: starting fuse 2023-12-19T17:52:24.274 INFO:teuthology.orchestra.run.smithi073.stdout:49 2023-12-19T17:52:24.274 INFO:teuthology.orchestra.run.smithi073.stdout:50 2023-12-19T17:52:24.274 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49, 50] 2023-12-19T17:52:24.274 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:52:24.274 DEBUG:teuthology.orchestra.run.smithi073:> import glob 2023-12-19T17:52:24.274 DEBUG:teuthology.orchestra.run.smithi073:> import re 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> import os 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> import subprocess 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> def _find_admin_socket(client_name): 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> files = glob.glob(asok_path) 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> # Given a non-glob path, it better be there 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> if "*" not in asok_path: 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> assert(len(files) == 1) 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> return files[0] 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> for f in files: 2023-12-19T17:52:24.275 DEBUG:teuthology.orchestra.run.smithi073:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> contents = proc_f.read() 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> if mountpoint in contents: 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> return f 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> print(_find_admin_socket("client.3")) 2023-12-19T17:52:24.276 DEBUG:teuthology.orchestra.run.smithi073:> ' 2023-12-19T17:52:24.430 INFO:teuthology.orchestra.run.smithi073.stdout:/var/run/ceph/ceph-client.3.41873.asok 2023-12-19T17:52:24.617 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.41873.asok 2023-12-19T17:52:24.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.617 DEBUG:teuthology.orchestra.run.smithi073:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.41873.asok status 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "metadata": { 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "entity_id": "3", 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "hostname": "smithi073", 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "pid": "41873", 2023-12-19T17:52:24.812 INFO:teuthology.orchestra.run.smithi073.stdout: "root": "/" 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_count": 0, 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "dentry_pinned_count": 0, 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "id": 4840, 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "inst": { 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "name": { 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "client", 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "num": 4840 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.2:0", 2023-12-19T17:52:24.813 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3619821813 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: } 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": { 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "type": "v1", 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "addr": "192.168.0.2:0", 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "nonce": 3619821813 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "inst_str": "client.4840 192.168.0.2:0/3619821813", 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "addr_str": "192.168.0.2:0/3619821813", 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "inode_count": 1, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_epoch": 8, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch": 26, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "blocklisted": false, 2023-12-19T17:52:24.814 INFO:teuthology.orchestra.run.smithi073.stdout: "fs_name": "cephfs" 2023-12-19T17:52:24.815 INFO:teuthology.orchestra.run.smithi073.stdout:} 2023-12-19T17:52:24.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.826 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:52:24.826 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:24.849 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:52:24.850 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:24.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:24.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.935 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:52:24.935 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:24.996 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:52:24.996 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:24.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:24.997 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:25.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:25.075 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2023-12-19T17:52:25.075 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:25.099 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2023-12-19T17:52:25.099 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:25.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:25.099 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:25.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:25.174 DEBUG:teuthology.orchestra.run.smithi073:> stat --file-system '--printf=%T 2023-12-19T17:52:25.174 DEBUG:teuthology.orchestra.run.smithi073:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:25.237 INFO:teuthology.orchestra.run.smithi073.stdout:fuseblk 2023-12-19T17:52:25.237 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:25.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:25.237 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:25.313 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-19T17:52:25.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:25.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd41cce4700 1 Processor -- start 2023-12-19T17:52:25.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd41cce4700 1 -- start start 2023-12-19T17:52:25.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd41cce4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4180c4030 0x7fd41806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd41cce4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41806e310 con 0x7fd41815cff0 2023-12-19T17:52:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd41cce4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd418161990 con 0x7fd418161530 2023-12-19T17:52:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd41cce4700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41815d3d0 con 0x7fd4180c4030 2023-12-19T17:52:25.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd417fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4180c4030 0x7fd41806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd417fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd4180c4030 0x7fd41806ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38704/0 (socket says 172.21.15.45:38704) 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd417fff700 1 -- 172.21.15.45:0/1825967046 learned_addr learned my addr 172.21.15.45:0/1825967046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.518+0000 7fd4177fe700 1 --1- 172.21.15.45:0/1825967046 >> v1:172.21.15.45:6789/0 conn(0x7fd41815cff0 0x7fd4180c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44280/0 (socket says 172.21.15.45:44280) 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd417fff700 1 -- 172.21.15.45:0/1825967046 >> v1:172.21.15.73:6789/0 conn(0x7fd418161530 legacy=0x7fd4180c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd417fff700 1 -- 172.21.15.45:0/1825967046 >> v1:172.21.15.45:6789/0 conn(0x7fd41815cff0 legacy=0x7fd4180c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd417fff700 1 -- 172.21.15.45:0/1825967046 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4180ca6f0 con 0x7fd4180c4030 2023-12-19T17:52:25.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd417fff700 1 --2- 172.21.15.45:0/1825967046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4180c4030 0x7fd41806ddd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd410009e50 tx=0x7fd41000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8489bb15ca8e6835 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd4167fc700 1 -- 172.21.15.45:0/1825967046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41000e070 con 0x7fd4180c4030 2023-12-19T17:52:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd4167fc700 1 -- 172.21.15.45:0/1825967046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410003a40 con 0x7fd4180c4030 2023-12-19T17:52:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd4167fc700 1 -- 172.21.15.45:0/1825967046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410003df0 con 0x7fd4180c4030 2023-12-19T17:52:25.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 -- 172.21.15.45:0/1825967046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4180c4030 msgr2=0x7fd41806ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 --2- 172.21.15.45:0/1825967046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4180c4030 0x7fd41806ddd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd410009e50 tx=0x7fd41000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 -- 172.21.15.45:0/1825967046 shutdown_connections 2023-12-19T17:52:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 --2- 172.21.15.45:0/1825967046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd4180c4030 0x7fd41806ddd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 -- 172.21.15.45:0/1825967046 >> 172.21.15.45:0/1825967046 conn(0x7fd4180cb900 msgr2=0x7fd4180b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 -- 172.21.15.45:0/1825967046 shutdown_connections 2023-12-19T17:52:25.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.522+0000 7fd41cce4700 1 -- 172.21.15.45:0/1825967046 wait complete. 2023-12-19T17:52:25.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 Processor -- start 2023-12-19T17:52:25.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 -- start start 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c4030 0x7fd4180c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41815cff0 0x7fd4180b4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 0x7fd4181f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180c5dd0 con 0x7fd418161530 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180c7f00 con 0x7fd4180c4030 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.526+0000 7fd41cce4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4180c89f0 con 0x7fd41815cff0 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 0x7fd4181f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 0x7fd4181f1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38716/0 (socket says 172.21.15.45:38716) 2023-12-19T17:52:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 -- 172.21.15.45:0/4238507075 learned_addr learned my addr 172.21.15.45:0/4238507075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd4177fe700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c4030 0x7fd4180c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd416ffd700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41815cff0 0x7fd4180b4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 -- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41815cff0 msgr2=0x7fd4180b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41815cff0 0x7fd4180b4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 -- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c4030 msgr2=0x7fd4180c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c4030 0x7fd4180c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 -- 172.21.15.45:0/4238507075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd410009b30 con 0x7fd418161530 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd417fff700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 0x7fd4181f1980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd41806abb0 tx=0x7fd410004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410004440 con 0x7fd418161530 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4100045a0 con 0x7fd418161530 2023-12-19T17:52:25.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410004950 con 0x7fd418161530 2023-12-19T17:52:25.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4180c8150 con 0x7fd418161530 2023-12-19T17:52:25.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.530+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4180c8710 con 0x7fd418161530 2023-12-19T17:52:25.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.534+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41815e5f0 con 0x7fd418161530 2023-12-19T17:52:25.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.534+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd410012430 con 0x7fd418161530 2023-12-19T17:52:25.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.538+0000 7fd3fffff700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd404065ad0 0x7fd404067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.538+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd4100849a0 con 0x7fd418161530 2023-12-19T17:52:25.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.538+0000 7fd4177fe700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd404065ad0 0x7fd404067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.538+0000 7fd4177fe700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd404065ad0 0x7fd404067f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd408000f60 tx=0x7fd408007f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:25.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.542+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd41815e5f0 con 0x7fd418161530 2023-12-19T17:52:25.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.722+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd41815e5f0 con 0x7fd418161530 2023-12-19T17:52:25.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.726+0000 7fd3fffff700 1 -- 172.21.15.45:0/4238507075 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fd41815e5f0 con 0x7fd418161530 2023-12-19T17:52:25.728 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:25.729 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:25.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd404065ad0 msgr2=0x7fd404067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd404065ad0 0x7fd404067f90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd408000f60 tx=0x7fd408007f30 comp rx=0 tx=0).stop 2023-12-19T17:52:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 msgr2=0x7fd4181f1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 0x7fd4181f1980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd41806abb0 tx=0x7fd410004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 shutdown_connections 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd404065ad0 0x7fd404067f90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd418161530 0x7fd4181f1980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41815cff0 0x7fd4180b4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 --2- 172.21.15.45:0/4238507075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd4180c4030 0x7fd4180c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 >> 172.21.15.45:0/4238507075 conn(0x7fd4180cb900 msgr2=0x7fd4180c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 shutdown_connections 2023-12-19T17:52:25.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.730+0000 7fd41cce4700 1 -- 172.21.15.45:0/4238507075 wait complete. 2023-12-19T17:52:25.757 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:25.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:25.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.946+0000 7f7c4f978700 1 Processor -- start 2023-12-19T17:52:25.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.946+0000 7f7c4f978700 1 -- start start 2023-12-19T17:52:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4f978700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c480d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4f978700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c480cdff0 0x7f7c480cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4f978700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c480cfd70 0x7f7c4806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4f978700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480b6040 con 0x7f7c480cfd70 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4f978700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c480d01e0 con 0x7f7c480cdff0 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4f978700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c480d10e0 con 0x7f7c4815d090 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4d714700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c480d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c480cfd70 0x7f7c4806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4cf13700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c480cdff0 0x7f7c480cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7c480cfd70 0x7f7c4806ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38722/0 (socket says 172.21.15.45:38722) 2023-12-19T17:52:25.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 -- 172.21.15.45:0/2173214632 learned_addr learned my addr 172.21.15.45:0/2173214632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 -- 172.21.15.45:0/2173214632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 msgr2=0x7f7c480d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:25.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 --2- 172.21.15.45:0/2173214632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c480d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 -- 172.21.15.45:0/2173214632 >> v2:172.21.15.73:3300/0 conn(0x7f7c480cdff0 msgr2=0x7f7c480cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 --2- 172.21.15.45:0/2173214632 >> v2:172.21.15.73:3300/0 conn(0x7f7c480cdff0 0x7f7c480cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.950+0000 7f7c4df15700 1 -- 172.21.15.45:0/2173214632 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c480d13c0 con 0x7f7c480cfd70 2023-12-19T17:52:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4df15700 1 --2- 172.21.15.45:0/2173214632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c4806ea90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c480d0430 tx=0x7f7c4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9612e54f0fb579 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c3ffff700 1 -- 172.21.15.45:0/2173214632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000e070 con 0x7f7c480cfd70 2023-12-19T17:52:25.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c3ffff700 1 -- 172.21.15.45:0/2173214632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c4000b910 con 0x7f7c480cfd70 2023-12-19T17:52:25.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c3ffff700 1 -- 172.21.15.45:0/2173214632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c4000bcc0 con 0x7f7c480cfd70 2023-12-19T17:52:25.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 -- 172.21.15.45:0/2173214632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 msgr2=0x7f7c4806ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 --2- 172.21.15.45:0/2173214632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c4806ea90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c480d0430 tx=0x7f7c4000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 -- 172.21.15.45:0/2173214632 shutdown_connections 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 --2- 172.21.15.45:0/2173214632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c4806ea90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 --2- 172.21.15.45:0/2173214632 >> v2:172.21.15.73:3300/0 conn(0x7f7c480cdff0 0x7f7c480cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 --2- 172.21.15.45:0/2173214632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c480d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 -- 172.21.15.45:0/2173214632 >> 172.21.15.45:0/2173214632 conn(0x7f7c480b4b90 msgr2=0x7f7c480b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 -- 172.21.15.45:0/2173214632 shutdown_connections 2023-12-19T17:52:25.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.954+0000 7f7c4f978700 1 -- 172.21.15.45:0/2173214632 wait complete. 2023-12-19T17:52:25.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 Processor -- start 2023-12-19T17:52:25.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 -- start start 2023-12-19T17:52:25.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c480cdff0 0x7f7c48159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c481f5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c481f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48159eb0 con 0x7f7c480cfd70 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48146a10 con 0x7f7c480cdff0 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4f978700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c48146cf0 con 0x7f7c4815d090 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c481f5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c481f5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38730/0 (socket says 172.21.15.45:38730) 2023-12-19T17:52:25.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 -- 172.21.15.45:0/1883860145 learned_addr learned my addr 172.21.15.45:0/1883860145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4d714700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c480cdff0 0x7f7c48159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4df15700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c481f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 -- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 msgr2=0x7f7c481f61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c481f61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 -- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c480cdff0 msgr2=0x7f7c48159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c480cdff0 0x7f7c48159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 -- 172.21.15.45:0/1883860145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40009b30 con 0x7f7c480cfd70 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4df15700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c481f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4d714700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c480cdff0 0x7f7c48159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:25.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.958+0000 7f7c4cf13700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c481f5c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800e940 tx=0x7f7c3800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:25.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c380096a0 con 0x7f7c480cfd70 2023-12-19T17:52:25.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3800c850 con 0x7f7c480cfd70 2023-12-19T17:52:25.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c48146fd0 con 0x7f7c480cfd70 2023-12-19T17:52:25.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800cbe0 con 0x7f7c480cfd70 2023-12-19T17:52:25.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c48147590 con 0x7f7c480cfd70 2023-12-19T17:52:25.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c48147750 con 0x7f7c480cfd70 2023-12-19T17:52:25.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.962+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c3800cd40 con 0x7f7c480cfd70 2023-12-19T17:52:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.966+0000 7f7c3dffb700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c2c065ad0 0x7f7c2c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.966+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7c380836d0 con 0x7f7c480cfd70 2023-12-19T17:52:25.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.966+0000 7f7c4d714700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c2c065ad0 0x7f7c2c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:25.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.966+0000 7f7c4d714700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c2c065ad0 0x7f7c2c067f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009ba0 tx=0x7f7c44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:25.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:25.970+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c38050b90 con 0x7f7c480cfd70 2023-12-19T17:52:26.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.150+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c4804ed30 con 0x7f7c480cfd70 2023-12-19T17:52:26.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.150+0000 7f7c3dffb700 1 -- 172.21.15.45:0/1883860145 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c380541b0 con 0x7f7c480cfd70 2023-12-19T17:52:26.154 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:26.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c2c065ad0 msgr2=0x7f7c2c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c2c065ad0 0x7f7c2c067f90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f7c44009ba0 tx=0x7f7c44008040 comp rx=0 tx=0).stop 2023-12-19T17:52:26.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 msgr2=0x7f7c481f5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c481f5c80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800e940 tx=0x7f7c3800ed00 comp rx=0 tx=0).stop 2023-12-19T17:52:26.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 shutdown_connections 2023-12-19T17:52:26.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c2c065ad0 0x7f7c2c067f90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4815d090 0x7f7c481f61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c480cfd70 0x7f7c481f5c80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 --2- 172.21.15.45:0/1883860145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c480cdff0 0x7f7c48159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 >> 172.21.15.45:0/1883860145 conn(0x7f7c480b4b90 msgr2=0x7f7c480cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:26.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 shutdown_connections 2023-12-19T17:52:26.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.154+0000 7f7c4f978700 1 -- 172.21.15.45:0/1883860145 wait complete. 2023-12-19T17:52:26.180 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.374+0000 7f7cdd8c8700 1 Processor -- start 2023-12-19T17:52:26.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.374+0000 7f7cdd8c8700 1 -- start start 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cd80b8580 0x7f7cd80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd815d300 con 0x7f7cd815cf20 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd80d1360 con 0x7f7cd80b8580 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80d1550 con 0x7f7cd80d25f0 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cd80b8580 0x7f7cd80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd6ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7cd815cf20 0x7f7cd80d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44294/0 (socket says 172.21.15.45:44294) 2023-12-19T17:52:26.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd6ffd700 1 -- 172.21.15.45:0/2367229071 learned_addr learned my addr 172.21.15.45:0/2367229071 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:26.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd77fe700 1 --2- 172.21.15.45:0/2367229071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd5ffb700 1 -- 172.21.15.45:0/2367229071 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2998633171 0 0) 0x7f7cd815d300 con 0x7f7cd815cf20 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd67fc700 1 -- 172.21.15.45:0/2367229071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 msgr2=0x7f7cd80cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd67fc700 1 --2- 172.21.15.45:0/2367229071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd67fc700 1 -- 172.21.15.45:0/2367229071 >> v1:172.21.15.45:6789/0 conn(0x7f7cd815cf20 legacy=0x7f7cd80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd67fc700 1 -- 172.21.15.45:0/2367229071 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd80d1830 con 0x7f7cd80b8580 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd67fc700 1 --2- 172.21.15.45:0/2367229071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd80cd8c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009850 tx=0x7f7ccc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e5f67c839cc41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd5ffb700 1 -- 172.21.15.45:0/2367229071 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc011830 con 0x7f7cd80b8580 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd5ffb700 1 -- 172.21.15.45:0/2367229071 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ccc011990 con 0x7f7cd80b8580 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cd5ffb700 1 -- 172.21.15.45:0/2367229071 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc011d40 con 0x7f7cd80b8580 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2367229071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 msgr2=0x7f7cd80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2367229071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd80cd8c0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc009850 tx=0x7f7ccc009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:26.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2367229071 shutdown_connections 2023-12-19T17:52:26.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2367229071 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2367229071 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd80cd8c0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2367229071 >> 172.21.15.45:0/2367229071 conn(0x7f7cd80b4670 msgr2=0x7f7cd80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:26.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2367229071 shutdown_connections 2023-12-19T17:52:26.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.378+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2367229071 wait complete. 2023-12-19T17:52:26.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 Processor -- start 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 -- start start 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd8152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd815cf20 0x7f7cd8157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8152970 con 0x7f7cd80b8580 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80ca0d0 con 0x7f7cd815cf20 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cdd8c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd8158d20 con 0x7f7cd80d25f0 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd8152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cd6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd8152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38758/0 (socket says 172.21.15.45:38758) 2023-12-19T17:52:26.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cd6ffd700 1 -- 172.21.15.45:0/2939416047 learned_addr learned my addr 172.21.15.45:0/2939416047 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:26.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cd67fc700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.382+0000 7f7cd77fe700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd815cf20 0x7f7cd8157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cd6ffd700 1 -- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 msgr2=0x7f7cd80cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cd6ffd700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cd6ffd700 1 -- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd815cf20 msgr2=0x7f7cd8157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cd6ffd700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd815cf20 0x7f7cd8157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cd6ffd700 1 -- 172.21.15.45:0/2939416047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ccc0094b0 con 0x7f7cd80b8580 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cd6ffd700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd8152430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800c4e0 tx=0x7f7cc800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8004ca0 con 0x7f7cd80b8580 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc8004e20 con 0x7f7cd80b8580 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd8159000 con 0x7f7cd80b8580 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc8007310 con 0x7f7cd80b8580 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd81595c0 con 0x7f7cd80b8580 2023-12-19T17:52:26.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.386+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd804ed30 con 0x7f7cd80b8580 2023-12-19T17:52:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.390+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7cc8007470 con 0x7f7cd80b8580 2023-12-19T17:52:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.390+0000 7f7cbffff700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cc4065ad0 0x7f7cc4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.390+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7cc8083180 con 0x7f7cd80b8580 2023-12-19T17:52:26.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.390+0000 7f7cd67fc700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cc4065ad0 0x7f7cc4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.390+0000 7f7cd67fc700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cc4065ad0 0x7f7cc4067f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0090b0 tx=0x7f7ccc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:26.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.398+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7cc80506c0 con 0x7f7cd80b8580 2023-12-19T17:52:26.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.574+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7cd80cf100 con 0x7f7cd80b8580 2023-12-19T17:52:26.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.578+0000 7f7cbffff700 1 -- 172.21.15.45:0/2939416047 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7cc8007720 con 0x7f7cd80b8580 2023-12-19T17:52:26.579 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:26.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.578+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cc4065ad0 msgr2=0x7f7cc4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.578+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cc4065ad0 0x7f7cc4067f90 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc0090b0 tx=0x7f7ccc008030 comp rx=0 tx=0).stop 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.578+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 msgr2=0x7f7cd8152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.578+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd8152430 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800c4e0 tx=0x7f7cc800c7f0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 shutdown_connections 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cc4065ad0 0x7f7cc4067f90 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cd815cf20 0x7f7cd8157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cd80d25f0 0x7f7cd80cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 --2- 172.21.15.45:0/2939416047 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cd80b8580 0x7f7cd8152430 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 >> 172.21.15.45:0/2939416047 conn(0x7f7cd80b4670 msgr2=0x7f7cd80cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:26.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 shutdown_connections 2023-12-19T17:52:26.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.582+0000 7f7cdd8c8700 1 -- 172.21.15.45:0/2939416047 wait complete. 2023-12-19T17:52:26.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:26.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.782+0000 7f97a2aee700 1 Processor -- start 2023-12-19T17:52:26.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.782+0000 7f97a2aee700 1 -- start start 2023-12-19T17:52:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a2aee700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f979c06b020 0x7f979c06b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a2aee700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f979c15a8b0 0x7f979c15ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a2aee700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f979c06b940 con 0x7f979c0ce8a0 2023-12-19T17:52:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a2aee700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c0cfe30 con 0x7f979c06b020 2023-12-19T17:52:26.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a2aee700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979c0d0050 con 0x7f979c15a8b0 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f979c06b020 0x7f979c06b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f979c06b020 0x7f979c06b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38764/0 (socket says 172.21.15.45:38764) 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 -- 172.21.15.45:0/1605878791 learned_addr learned my addr 172.21.15.45:0/1605878791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a108b700 1 --2- 172.21.15.45:0/1605878791 >> v2:172.21.15.73:3300/0 conn(0x7f979c15a8b0 0x7f979c15ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 -- 172.21.15.45:0/1605878791 >> v2:172.21.15.73:3300/0 conn(0x7f979c15a8b0 msgr2=0x7f979c15ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 --2- 172.21.15.45:0/1605878791 >> v2:172.21.15.73:3300/0 conn(0x7f979c15a8b0 0x7f979c15ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 -- 172.21.15.45:0/1605878791 >> v1:172.21.15.73:6789/0 conn(0x7f979c0ce8a0 legacy=0x7f979c0cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 -- 172.21.15.45:0/1605878791 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979c0d0330 con 0x7f979c06b020 2023-12-19T17:52:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a108b700 1 --2- 172.21.15.45:0/1605878791 >> v2:172.21.15.73:3300/0 conn(0x7f979c15a8b0 0x7f979c15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:26.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f97a088a700 1 --2- 172.21.15.45:0/1605878791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c06b400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f979c068580 tx=0x7f979000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a7b243beb24f339 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f979b7fe700 1 -- 172.21.15.45:0/1605878791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f979000e070 con 0x7f979c06b020 2023-12-19T17:52:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f979b7fe700 1 -- 172.21.15.45:0/1605878791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9790003a40 con 0x7f979c06b020 2023-12-19T17:52:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.786+0000 7f979b7fe700 1 -- 172.21.15.45:0/1605878791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790003df0 con 0x7f979c06b020 2023-12-19T17:52:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 -- 172.21.15.45:0/1605878791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 msgr2=0x7f979c06b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 --2- 172.21.15.45:0/1605878791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c06b400 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f979c068580 tx=0x7f979000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:26.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 -- 172.21.15.45:0/1605878791 shutdown_connections 2023-12-19T17:52:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 --2- 172.21.15.45:0/1605878791 >> v2:172.21.15.73:3300/0 conn(0x7f979c15a8b0 0x7f979c15ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 --2- 172.21.15.45:0/1605878791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c06b400 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 -- 172.21.15.45:0/1605878791 >> 172.21.15.45:0/1605878791 conn(0x7f979c0cd6e0 msgr2=0x7f979c0cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 -- 172.21.15.45:0/1605878791 shutdown_connections 2023-12-19T17:52:26.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 -- 172.21.15.45:0/1605878791 wait complete. 2023-12-19T17:52:26.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 Processor -- start 2023-12-19T17:52:26.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.790+0000 7f97a2aee700 1 -- start start 2023-12-19T17:52:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c158730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f979c0ce8a0 0x7f979c0cee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f979c15a8b0 0x7f979c0cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1f0d60 con 0x7f979c06b020 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979c0c7570 con 0x7f979c15a8b0 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f979c1f03c0 con 0x7f979c0ce8a0 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c158730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c158730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38768/0 (socket says 172.21.15.45:38768) 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 -- 172.21.15.45:0/3701557871 learned_addr learned my addr 172.21.15.45:0/3701557871 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a108b700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f979c15a8b0 0x7f979c0cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f979bfff700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f979c0ce8a0 0x7f979c0cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 -- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f979c0ce8a0 msgr2=0x7f979c0cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f979c0ce8a0 0x7f979c0cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 -- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f979c15a8b0 msgr2=0x7f979c0cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f979c15a8b0 0x7f979c0cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 -- 172.21.15.45:0/3701557871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009b30 con 0x7f979c06b020 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f979bfff700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f979c0ce8a0 0x7f979c0cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a088a700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c158730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9790000f80 tx=0x7f9790004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790004440 con 0x7f979c06b020 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900045a0 con 0x7f979c06b020 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f979c1f06a0 con 0x7f979c06b020 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9790004950 con 0x7f979c06b020 2023-12-19T17:52:26.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.794+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979c1f1180 con 0x7f979c06b020 2023-12-19T17:52:26.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.798+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f979c1f0ea0 con 0x7f979c06b020 2023-12-19T17:52:26.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.798+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9790012430 con 0x7f979c06b020 2023-12-19T17:52:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.802+0000 7f97997fa700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9780065ad0 0x7f9780067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.802+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9790084c20 con 0x7f979c06b020 2023-12-19T17:52:26.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.802+0000 7f979bfff700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9780065ad0 0x7f9780067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:26.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.802+0000 7f979bfff700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9780065ad0 0x7f9780067f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f979c15e900 tx=0x7f9788009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:26.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.806+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f979c1f0ea0 con 0x7f979c06b020 2023-12-19T17:52:26.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.978+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f979c1f0ea0 con 0x7f979c06b020 2023-12-19T17:52:26.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97997fa700 1 -- 172.21.15.45:0/3701557871 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9790017020 con 0x7f979c06b020 2023-12-19T17:52:26.983 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:26.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9780065ad0 msgr2=0x7f9780067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9780065ad0 0x7f9780067f90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f979c15e900 tx=0x7f9788009040 comp rx=0 tx=0).stop 2023-12-19T17:52:26.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 msgr2=0x7f979c158730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:26.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c158730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9790000f80 tx=0x7f9790004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 shutdown_connections 2023-12-19T17:52:26.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9780065ad0 0x7f9780067f90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f979c15a8b0 0x7f979c0cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f979c0ce8a0 0x7f979c0cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 --2- 172.21.15.45:0/3701557871 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f979c06b020 0x7f979c158730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:26.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 >> 172.21.15.45:0/3701557871 conn(0x7f979c0cd6e0 msgr2=0x7f979c159fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:26.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 shutdown_connections 2023-12-19T17:52:26.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:26.982+0000 7f97a2aee700 1 -- 172.21.15.45:0/3701557871 wait complete. 2023-12-19T17:52:27.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:27.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.202+0000 7fe67551f700 1 Processor -- start 2023-12-19T17:52:27.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.202+0000 7fe67551f700 1 -- start start 2023-12-19T17:52:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe67551f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe67006fba0 0x7fe67006ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe67551f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67006d690 0x7fe6700b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe67551f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6700cceb0 con 0x7fe67015d840 2023-12-19T17:52:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe67551f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6700cddd0 con 0x7fe67006fba0 2023-12-19T17:52:27.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe67551f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700704c0 con 0x7fe67006d690 2023-12-19T17:52:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe67015d840 0x7fe67015dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44310/0 (socket says 172.21.15.45:44310) 2023-12-19T17:52:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66f7fe700 1 -- 172.21.15.45:0/686710325 learned_addr learned my addr 172.21.15.45:0/686710325 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66effd700 1 --2- 172.21.15.45:0/686710325 >> v2:172.21.15.73:3300/0 conn(0x7fe67006fba0 0x7fe67006ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66e7fc700 1 --2- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67006d690 0x7fe6700b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66dffb700 1 -- 172.21.15.45:0/686710325 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3342828167 0 0) 0x7fe6700cceb0 con 0x7fe67015d840 2023-12-19T17:52:27.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66dffb700 1 -- 172.21.15.45:0/686710325 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6580035d0 con 0x7fe67015d840 2023-12-19T17:52:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66effd700 1 -- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67006d690 msgr2=0x7fe6700b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66effd700 1 --2- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67006d690 0x7fe6700b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66effd700 1 -- 172.21.15.45:0/686710325 >> v1:172.21.15.45:6789/0 conn(0x7fe67015d840 legacy=0x7fe67015dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66dffb700 1 -- 172.21.15.45:0/686710325 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4086813854 0 0) 0x7fe6580035d0 con 0x7fe67015d840 2023-12-19T17:52:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66effd700 1 -- 172.21.15.45:0/686710325 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6700b2a00 con 0x7fe67006fba0 2023-12-19T17:52:27.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66effd700 1 --2- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006fba0 0x7fe67006ff80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe660009850 tx=0x7fe660009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be00c41750938561 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66dffb700 1 -- 172.21.15.45:0/686710325 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6680019f0 con 0x7fe67006fba0 2023-12-19T17:52:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66dffb700 1 -- 172.21.15.45:0/686710325 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660004030 con 0x7fe67006fba0 2023-12-19T17:52:27.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.206+0000 7fe66dffb700 1 -- 172.21.15.45:0/686710325 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6600043e0 con 0x7fe67006fba0 2023-12-19T17:52:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 -- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006fba0 msgr2=0x7fe67006ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 --2- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006fba0 0x7fe67006ff80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe660009850 tx=0x7fe660009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 -- 172.21.15.45:0/686710325 shutdown_connections 2023-12-19T17:52:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 --2- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67006d690 0x7fe6700b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 --2- 172.21.15.45:0/686710325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006fba0 0x7fe67006ff80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 -- 172.21.15.45:0/686710325 >> 172.21.15.45:0/686710325 conn(0x7fe670071990 msgr2=0x7fe6700b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:27.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 -- 172.21.15.45:0/686710325 shutdown_connections 2023-12-19T17:52:27.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.210+0000 7fe67551f700 1 -- 172.21.15.45:0/686710325 wait complete. 2023-12-19T17:52:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 Processor -- start 2023-12-19T17:52:27.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 -- start start 2023-12-19T17:52:27.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006d690 0x7fe6700ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 0x7fe670158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67015d840 0x7fe6701f6590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701f5e20 con 0x7fe67006fba0 2023-12-19T17:52:27.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6701f6100 con 0x7fe67006d690 2023-12-19T17:52:27.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe67551f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6700abf30 con 0x7fe67015d840 2023-12-19T17:52:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 0x7fe670158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 0x7fe670158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38772/0 (socket says 172.21.15.45:38772) 2023-12-19T17:52:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 -- 172.21.15.45:0/1284741491 learned_addr learned my addr 172.21.15.45:0/1284741491 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66f7fe700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67015d840 0x7fe6701f6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66effd700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006d690 0x7fe6700ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 -- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67015d840 msgr2=0x7fe6701f6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67015d840 0x7fe6701f6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 -- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006d690 msgr2=0x7fe6700ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006d690 0x7fe6700ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66e7fc700 1 -- 172.21.15.45:0/1284741491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600094b0 con 0x7fe67006fba0 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.214+0000 7fe66effd700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006d690 0x7fe6700ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe66e7fc700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 0x7fe670158ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe66400e840 tx=0x7fe66400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:27.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640095a0 con 0x7fe67006fba0 2023-12-19T17:52:27.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe664013680 con 0x7fe67006fba0 2023-12-19T17:52:27.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6640139f0 con 0x7fe67006fba0 2023-12-19T17:52:27.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6700ac210 con 0x7fe67006fba0 2023-12-19T17:52:27.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67015d4f0 con 0x7fe67006fba0 2023-12-19T17:52:27.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.218+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67004ed30 con 0x7fe67006fba0 2023-12-19T17:52:27.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.222+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe664013b50 con 0x7fe67006fba0 2023-12-19T17:52:27.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.222+0000 7fe6577fe700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe65c065b00 0x7fe65c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.222+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe6640833c0 con 0x7fe67006fba0 2023-12-19T17:52:27.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.222+0000 7fe66effd700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe65c065b00 0x7fe65c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.222+0000 7fe66effd700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe65c065b00 0x7fe65c067fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6600090b0 tx=0x7fe660013040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:27.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.230+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe664050990 con 0x7fe67006fba0 2023-12-19T17:52:27.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.406+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe67006dfc0 con 0x7fe67006fba0 2023-12-19T17:52:27.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.406+0000 7fe6577fe700 1 -- 172.21.15.45:0/1284741491 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe664053fb0 con 0x7fe67006fba0 2023-12-19T17:52:27.410 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe65c065b00 msgr2=0x7fe65c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe65c065b00 0x7fe65c067fc0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe6600090b0 tx=0x7fe660013040 comp rx=0 tx=0).stop 2023-12-19T17:52:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 msgr2=0x7fe670158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 0x7fe670158ec0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe66400e840 tx=0x7fe66400eb50 comp rx=0 tx=0).stop 2023-12-19T17:52:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 shutdown_connections 2023-12-19T17:52:27.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe65c065b00 0x7fe65c067fc0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe67015d840 0x7fe6701f6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67006fba0 0x7fe670158ec0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 --2- 172.21.15.45:0/1284741491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67006d690 0x7fe6700ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 >> 172.21.15.45:0/1284741491 conn(0x7fe670071990 msgr2=0x7fe670142aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 shutdown_connections 2023-12-19T17:52:27.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.410+0000 7fe67551f700 1 -- 172.21.15.45:0/1284741491 wait complete. 2023-12-19T17:52:27.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:27.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82e53e700 1 Processor -- start 2023-12-19T17:52:27.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82e53e700 1 -- start start 2023-12-19T17:52:27.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82e53e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd82815ae20 0x7fd82815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82e53e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82806f0a0 con 0x7fd82806cad0 2023-12-19T17:52:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82e53e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd82806ea90 con 0x7fd8280af720 2023-12-19T17:52:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82e53e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8280c3f60 con 0x7fd82815ae20 2023-12-19T17:52:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.609+0000 7fd82d53c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd82815ae20 0x7fd82815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82cd3b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd82806cad0 0x7fd8280c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44318/0 (socket says 172.21.15.45:44318) 2023-12-19T17:52:27.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82cd3b700 1 -- 172.21.15.45:0/3795939668 learned_addr learned my addr 172.21.15.45:0/3795939668 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:27.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82d53c700 1 -- 172.21.15.45:0/3795939668 >> v1:172.21.15.73:6789/0 conn(0x7fd8280af720 legacy=0x7fd82806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82d53c700 1 -- 172.21.15.45:0/3795939668 >> v1:172.21.15.45:6789/0 conn(0x7fd82806cad0 legacy=0x7fd8280c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82d53c700 1 -- 172.21.15.45:0/3795939668 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280c4240 con 0x7fd82815ae20 2023-12-19T17:52:27.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd81ffff700 1 -- 172.21.15.45:0/3795939668 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3679523723 0 0) 0x7fd82806f0a0 con 0x7fd82806cad0 2023-12-19T17:52:27.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82d53c700 1 --2- 172.21.15.45:0/3795939668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd82815be40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd824009d90 tx=0x7fd82400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0fc8adfc415845 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:27.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd81ffff700 1 -- 172.21.15.45:0/3795939668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82400e070 con 0x7fd82815ae20 2023-12-19T17:52:27.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd81ffff700 1 -- 172.21.15.45:0/3795939668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82400bbd0 con 0x7fd82815ae20 2023-12-19T17:52:27.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd81ffff700 1 -- 172.21.15.45:0/3795939668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824012430 con 0x7fd82815ae20 2023-12-19T17:52:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 -- 172.21.15.45:0/3795939668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 msgr2=0x7fd82815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3795939668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd82815be40 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd824009d90 tx=0x7fd82400b330 comp rx=0 tx=0).stop 2023-12-19T17:52:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 -- 172.21.15.45:0/3795939668 shutdown_connections 2023-12-19T17:52:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3795939668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd82815be40 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 -- 172.21.15.45:0/3795939668 >> 172.21.15.45:0/3795939668 conn(0x7fd8280cb900 msgr2=0x7fd8280b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 -- 172.21.15.45:0/3795939668 shutdown_connections 2023-12-19T17:52:27.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.613+0000 7fd82e53e700 1 -- 172.21.15.45:0/3795939668 wait complete. 2023-12-19T17:52:27.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.617+0000 7fd82e53e700 1 Processor -- start 2023-12-19T17:52:27.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.617+0000 7fd82e53e700 1 -- start start 2023-12-19T17:52:27.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd82806cad0 0x7fd8281f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8280af720 0x7fd8280c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd8280c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280ab8a0 con 0x7fd82815ae20 2023-12-19T17:52:27.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281f2780 con 0x7fd8280af720 2023-12-19T17:52:27.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8280c8350 con 0x7fd82806cad0 2023-12-19T17:52:27.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd8280c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd8280c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38784/0 (socket says 172.21.15.45:38784) 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 -- 172.21.15.45:0/3875743268 learned_addr learned my addr 172.21.15.45:0/3875743268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82d53c700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd82806cad0 0x7fd8281f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82cd3b700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8280af720 0x7fd8280c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 -- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd82806cad0 msgr2=0x7fd8281f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd82806cad0 0x7fd8281f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 -- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8280af720 msgr2=0x7fd8280c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8280af720 0x7fd8280c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 -- 172.21.15.45:0/3875743268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009a70 con 0x7fd82815ae20 2023-12-19T17:52:27.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82cd3b700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8280af720 0x7fd8280c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82dd3d700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd8280c7960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c480 tx=0x7fd82000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200052d0 con 0x7fd82815ae20 2023-12-19T17:52:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820005430 con 0x7fd82815ae20 2023-12-19T17:52:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8280c8070 con 0x7fd82815ae20 2023-12-19T17:52:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8200055a0 con 0x7fd82815ae20 2023-12-19T17:52:27.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.621+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8280b14f0 con 0x7fd82815ae20 2023-12-19T17:52:27.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.625+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8280b1060 con 0x7fd82815ae20 2023-12-19T17:52:27.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.625+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd8200038e0 con 0x7fd82815ae20 2023-12-19T17:52:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.629+0000 7fd81dffb700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd80c065ad0 0x7fd80c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:27.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.629+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd8200829f0 con 0x7fd82815ae20 2023-12-19T17:52:27.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.629+0000 7fd82d53c700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd80c065ad0 0x7fd80c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:27.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.629+0000 7fd82d53c700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd80c065ad0 0x7fd80c067f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd824014040 tx=0x7fd82401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:27.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.633+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd82004ff30 con 0x7fd82815ae20 2023-12-19T17:52:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.817+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd828067760 con 0x7fd82815ae20 2023-12-19T17:52:27.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.817+0000 7fd81dffb700 1 -- 172.21.15.45:0/3875743268 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fd820053550 con 0x7fd82815ae20 2023-12-19T17:52:27.822 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:27.822 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd80c065ad0 msgr2=0x7fd80c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd80c065ad0 0x7fd80c067f90 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd824014040 tx=0x7fd82401d040 comp rx=0 tx=0).stop 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 msgr2=0x7fd8280c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd8280c7960 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fd82000c480 tx=0x7fd82000c840 comp rx=0 tx=0).stop 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 shutdown_connections 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd80c065ad0 0x7fd80c067f90 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd82815ae20 0x7fd8280c7960 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd8280af720 0x7fd8280c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 --2- 172.21.15.45:0/3875743268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd82806cad0 0x7fd8281f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 >> 172.21.15.45:0/3875743268 conn(0x7fd8280cb900 msgr2=0x7fd82806de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 shutdown_connections 2023-12-19T17:52:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:27.821+0000 7fd82e53e700 1 -- 172.21.15.45:0/3875743268 wait complete. 2023-12-19T17:52:27.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:27.850 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:28.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.041+0000 7f81ae535700 1 Processor -- start 2023-12-19T17:52:28.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.041+0000 7f81ae535700 1 -- start start 2023-12-19T17:52:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81ae535700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a8159fb0 0x7f81a80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81ae535700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80ce0c0 con 0x7f81a8159bd0 2023-12-19T17:52:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81ae535700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80ce3a0 con 0x7f81a80cbe90 2023-12-19T17:52:28.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81ae535700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80ced40 con 0x7f81a8159fb0 2023-12-19T17:52:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81a7fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f81a8159bd0 0x7f81a80cb780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44330/0 (socket says 172.21.15.45:44330) 2023-12-19T17:52:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81a7fff700 1 -- 172.21.15.45:0/3246309944 learned_addr learned my addr 172.21.15.45:0/3246309944 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:28.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f819f7fe700 1 --2- 172.21.15.45:0/3246309944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a8159fb0 0x7f81a80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f819f7fe700 1 -- 172.21.15.45:0/3246309944 >> v1:172.21.15.73:6789/0 conn(0x7f81a80cbe90 legacy=0x7f81a80cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f819f7fe700 1 -- 172.21.15.45:0/3246309944 >> v1:172.21.15.45:6789/0 conn(0x7f81a8159bd0 legacy=0x7f81a80cb780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81a77fe700 1 -- 172.21.15.45:0/3246309944 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2399408284 0 0) 0x7f81a80ce0c0 con 0x7f81a8159bd0 2023-12-19T17:52:28.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f819f7fe700 1 -- 172.21.15.45:0/3246309944 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80ce680 con 0x7f81a8159fb0 2023-12-19T17:52:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f819f7fe700 1 --2- 172.21.15.45:0/3246309944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a8159fb0 0x7f81a80aef40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8190009dc0 tx=0x7f819000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6623621ca170a2c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81a77fe700 1 -- 172.21.15.45:0/3246309944 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000e070 con 0x7f81a8159fb0 2023-12-19T17:52:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81a77fe700 1 -- 172.21.15.45:0/3246309944 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819000bbd0 con 0x7f81a8159fb0 2023-12-19T17:52:28.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.045+0000 7f81a77fe700 1 -- 172.21.15.45:0/3246309944 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190012430 con 0x7f81a8159fb0 2023-12-19T17:52:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 -- 172.21.15.45:0/3246309944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a8159fb0 msgr2=0x7f81a80aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 --2- 172.21.15.45:0/3246309944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a8159fb0 0x7f81a80aef40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8190009dc0 tx=0x7f819000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 -- 172.21.15.45:0/3246309944 shutdown_connections 2023-12-19T17:52:28.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 --2- 172.21.15.45:0/3246309944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a8159fb0 0x7f81a80aef40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 -- 172.21.15.45:0/3246309944 >> 172.21.15.45:0/3246309944 conn(0x7f81a806a010 msgr2=0x7f81a806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 -- 172.21.15.45:0/3246309944 shutdown_connections 2023-12-19T17:52:28.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.049+0000 7f81ae535700 1 -- 172.21.15.45:0/3246309944 wait complete. 2023-12-19T17:52:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 Processor -- start 2023-12-19T17:52:28.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 -- start start 2023-12-19T17:52:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a80cbe90 0x7f81a80c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 0x7f81a814f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a8159fb0 0x7f81a80b0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80c9c90 con 0x7f81a8159bd0 2023-12-19T17:52:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a814f8d0 con 0x7f81a8159fb0 2023-12-19T17:52:28.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81ae535700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80c8bf0 con 0x7f81a80cbe90 2023-12-19T17:52:28.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f819f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 0x7f81a814f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f819f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 0x7f81a814f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38798/0 (socket says 172.21.15.45:38798) 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f819f7fe700 1 -- 172.21.15.45:0/3537825433 learned_addr learned my addr 172.21.15.45:0/3537825433 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81acad2700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a8159fb0 0x7f81a80b0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.053+0000 7f81a7fff700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a80cbe90 0x7f81a80c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f819f7fe700 1 -- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a80cbe90 msgr2=0x7f81a80c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f819f7fe700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a80cbe90 0x7f81a80c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f819f7fe700 1 -- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a8159fb0 msgr2=0x7f81a80b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f819f7fe700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a8159fb0 0x7f81a80b0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f819f7fe700 1 -- 172.21.15.45:0/3537825433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190009a70 con 0x7f81a8159bd0 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81acad2700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a8159fb0 0x7f81a80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:28.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81a7fff700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a80cbe90 0x7f81a80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f819f7fe700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 0x7f81a814f390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8190014040 tx=0x7f8190004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190012430 con 0x7f81a8159bd0 2023-12-19T17:52:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190020070 con 0x7f81a8159bd0 2023-12-19T17:52:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a80c8ed0 con 0x7f81a8159bd0 2023-12-19T17:52:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190004280 con 0x7f81a8159bd0 2023-12-19T17:52:28.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a80c9490 con 0x7f81a8159bd0 2023-12-19T17:52:28.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.057+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a804ed30 con 0x7f81a8159bd0 2023-12-19T17:52:28.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.061+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f81900043e0 con 0x7f81a8159bd0 2023-12-19T17:52:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.061+0000 7f81a57fa700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8188065ad0 0x7f8188067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.061+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8190022070 con 0x7f81a8159bd0 2023-12-19T17:52:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.061+0000 7f81a7fff700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8188065ad0 0x7f8188067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.065+0000 7f81a7fff700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8188065ad0 0x7f8188067f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8198000f60 tx=0x7f8198007d00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.065+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8190053140 con 0x7f81a8159bd0 2023-12-19T17:52:28.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.249+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f81a80b0760 con 0x7f81a8159bd0 2023-12-19T17:52:28.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.249+0000 7f81a57fa700 1 -- 172.21.15.45:0/3537825433 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8190056760 con 0x7f81a8159bd0 2023-12-19T17:52:28.253 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.253+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8188065ad0 msgr2=0x7f8188067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.253+0000 7f81ae535700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8188065ad0 0x7f8188067f90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8198000f60 tx=0x7f8198007d00 comp rx=0 tx=0).stop 2023-12-19T17:52:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.253+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 msgr2=0x7f81a814f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.253+0000 7f81ae535700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 0x7f81a814f390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8190014040 tx=0x7f8190004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 shutdown_connections 2023-12-19T17:52:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8188065ad0 0x7f8188067f90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f81a8159fb0 0x7f81a80b0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f81a8159bd0 0x7f81a814f390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 --2- 172.21.15.45:0/3537825433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f81a80cbe90 0x7f81a80c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 >> 172.21.15.45:0/3537825433 conn(0x7f81a806a010 msgr2=0x7f81a815a4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 shutdown_connections 2023-12-19T17:52:28.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.257+0000 7f81ae535700 1 -- 172.21.15.45:0/3537825433 wait complete. 2023-12-19T17:52:28.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:28.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 Processor -- start 2023-12-19T17:52:28.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 -- start start 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f672c15cf20 0x7f672c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f672c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f672c15d300 con 0x7f672c0d25f0 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672c0d1550 con 0x7f672c15cf20 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67330d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0d1830 con 0x7f672c0b8580 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67328d7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f672c0d25f0 0x7f672c06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44334/0 (socket says 172.21.15.45:44334) 2023-12-19T17:52:28.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67328d7700 1 -- 172.21.15.45:0/3300424219 learned_addr learned my addr 172.21.15.45:0/3300424219 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67320d6700 1 --2- 172.21.15.45:0/3300424219 >> v2:172.21.15.73:3300/0 conn(0x7f672c15cf20 0x7f672c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.473+0000 7f67318d5700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f672c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3179434590 0 0) 0x7f672c15d300 con 0x7f672c0d25f0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67180035d0 con 0x7f672c0d25f0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3847272832 0 0) 0x7f67180035d0 con 0x7f672c0d25f0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 msgr2=0x7f672c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f672c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 >> v2:172.21.15.73:3300/0 conn(0x7f672c15cf20 msgr2=0x7f672c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 --2- 172.21.15.45:0/3300424219 >> v2:172.21.15.73:3300/0 conn(0x7f672c15cf20 0x7f672c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0d1b10 con 0x7f672c0d25f0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f67240019f0 con 0x7f672c0d25f0 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 >> v1:172.21.15.45:6789/0 conn(0x7f672c0d25f0 legacy=0x7f672c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6718003a20 0x7f6718003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6718004870 0x7f6718004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f6718005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0d1550 con 0x7f6718003a20 2023-12-19T17:52:28.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0d1830 con 0x7f6718004870 2023-12-19T17:52:28.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671800ba30 con 0x7f672c0b8580 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67320d6700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6718003a20 0x7f6718003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f6718005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67318d5700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6718004870 0x7f6718004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 -- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6718004870 msgr2=0x7f6718004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6718004870 0x7f6718004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 -- 172.21.15.45:0/3300424219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6718003a20 msgr2=0x7f6718003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:28.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6718003a20 0x7f6718003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 -- 172.21.15.45:0/3300424219 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67180035d0 con 0x7f672c0b8580 2023-12-19T17:52:28.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67320d6700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6718003a20 0x7f6718003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:28.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67328d7700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f6718005230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f672400a860 tx=0x7f67180058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57906176b19d71d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67240072d0 con 0x7f672c0b8580 2023-12-19T17:52:28.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6724007450 con 0x7f672c0b8580 2023-12-19T17:52:28.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.477+0000 7f67310d4700 1 -- 172.21.15.45:0/3300424219 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6724007800 con 0x7f672c0b8580 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67330d8700 1 -- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 msgr2=0x7f6718005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67330d8700 1 --2- 172.21.15.45:0/3300424219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c0b8580 0x7f6718005230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f672400a860 tx=0x7f67180058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67328d7700 1 -- 172.21.15.45:0/3300424219 reap_dead start 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67330d8700 1 -- 172.21.15.45:0/3300424219 shutdown_connections 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67330d8700 1 -- 172.21.15.45:0/3300424219 >> 172.21.15.45:0/3300424219 conn(0x7f672c0b4670 msgr2=0x7f672c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67330d8700 1 -- 172.21.15.45:0/3300424219 shutdown_connections 2023-12-19T17:52:28.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.481+0000 7f67330d8700 1 -- 172.21.15.45:0/3300424219 wait complete. 2023-12-19T17:52:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 Processor -- start 2023-12-19T17:52:28.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 -- start start 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 0x7f672c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f672c0ca630 0x7f672c15f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c152330 0x7f672c15fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c15e800 con 0x7f672c0b8580 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0cab60 con 0x7f672c0ca630 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67330d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c0cae40 con 0x7f672c152330 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 0x7f672c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 0x7f672c0cc590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38814/0 (socket says 172.21.15.45:38814) 2023-12-19T17:52:28.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 -- 172.21.15.45:0/93858080 learned_addr learned my addr 172.21.15.45:0/93858080 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67318d5700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f672c0ca630 0x7f672c15f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67328d7700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c152330 0x7f672c15fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 -- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c152330 msgr2=0x7f672c15fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c152330 0x7f672c15fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 -- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f672c0ca630 msgr2=0x7f672c15f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f672c0ca630 0x7f672c15f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67320d6700 1 -- 172.21.15.45:0/93858080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c0cb120 con 0x7f672c0b8580 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67318d5700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f672c0ca630 0x7f672c15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:28.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.485+0000 7f67328d7700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c152330 0x7f672c15fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:28.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f67320d6700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 0x7f672c0cc590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6728011cd0 tx=0x7f672800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728011e70 con 0x7f672c0b8580 2023-12-19T17:52:28.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672800fd40 con 0x7f672c0b8580 2023-12-19T17:52:28.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6728004240 con 0x7f672c0b8580 2023-12-19T17:52:28.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f672c0cb400 con 0x7f672c0b8580 2023-12-19T17:52:28.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c15d4f0 con 0x7f672c0b8580 2023-12-19T17:52:28.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.489+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f672c0cb590 con 0x7f672c0b8580 2023-12-19T17:52:28.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.493+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f67280043a0 con 0x7f672c0b8580 2023-12-19T17:52:28.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.493+0000 7f6722ffd700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6710065ad0 0x7f6710067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.493+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f6728083c60 con 0x7f672c0b8580 2023-12-19T17:52:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.493+0000 7f67318d5700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6710065ad0 0x7f6710067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.493+0000 7f67318d5700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6710065ad0 0x7f6710067f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f672c0c8d50 tx=0x7f671c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.501+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f67280511a0 con 0x7f672c0b8580 2023-12-19T17:52:28.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.681+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f672c04ed30 con 0x7f672c0b8580 2023-12-19T17:52:28.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.681+0000 7f6722ffd700 1 -- 172.21.15.45:0/93858080 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6728022020 con 0x7f672c0b8580 2023-12-19T17:52:28.684 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6710065ad0 msgr2=0x7f6710067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6710065ad0 0x7f6710067f90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f672c0c8d50 tx=0x7f671c008040 comp rx=0 tx=0).stop 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 msgr2=0x7f672c0cc590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 0x7f672c0cc590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6728011cd0 tx=0x7f672800f520 comp rx=0 tx=0).stop 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 shutdown_connections 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6710065ad0 0x7f6710067f90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f672c152330 0x7f672c15fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f672c0ca630 0x7f672c15f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 --2- 172.21.15.45:0/93858080 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f672c0b8580 0x7f672c0cc590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 >> 172.21.15.45:0/93858080 conn(0x7f672c0b4670 msgr2=0x7f672c06ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:28.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 shutdown_connections 2023-12-19T17:52:28.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.685+0000 7f67330d8700 1 -- 172.21.15.45:0/93858080 wait complete. 2023-12-19T17:52:28.712 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:28.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.905+0000 7f96cb7d2700 1 Processor -- start 2023-12-19T17:52:28.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.905+0000 7f96cb7d2700 1 -- start start 2023-12-19T17:52:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96cb7d2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96c40d2860 0x7f96c40b4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96cb7d2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40d1560 con 0x7f96c40b4d90 2023-12-19T17:52:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96cb7d2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c40b51a0 con 0x7f96c415d1c0 2023-12-19T17:52:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96cb7d2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c40d17c0 con 0x7f96c40d2860 2023-12-19T17:52:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c956e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f96c415d1c0 0x7f96c40d0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48826/0 (socket says 172.21.15.45:48826) 2023-12-19T17:52:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c9d6f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96c40b4d90 0x7f96c40b5f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53038/0 (socket says 172.21.15.45:53038) 2023-12-19T17:52:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c956e700 1 -- 172.21.15.45:0/1304747248 learned_addr learned my addr 172.21.15.45:0/1304747248 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:28.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c8d6d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f96c40d2860 0x7f96c40b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96bbfff700 1 -- 172.21.15.45:0/1304747248 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1289790493 0 0) 0x7f96c40b51a0 con 0x7f96c415d1c0 2023-12-19T17:52:28.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1304747248 >> v1:172.21.15.73:6789/0 conn(0x7f96c415d1c0 legacy=0x7f96c40d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1304747248 >> v1:172.21.15.45:6789/0 conn(0x7f96c40b4d90 legacy=0x7f96c40b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.909+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1304747248 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c40d1aa0 con 0x7f96c40d2860 2023-12-19T17:52:28.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96c8d6d700 1 --2- 172.21.15.45:0/1304747248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40b4850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009850 tx=0x7f96b4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1361f0d4b8ad01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96bbfff700 1 -- 172.21.15.45:0/1304747248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4004230 con 0x7f96c40d2860 2023-12-19T17:52:28.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96bbfff700 1 -- 172.21.15.45:0/1304747248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b4004390 con 0x7f96c40d2860 2023-12-19T17:52:28.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96bbfff700 1 -- 172.21.15.45:0/1304747248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b40036c0 con 0x7f96c40d2860 2023-12-19T17:52:28.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1304747248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 msgr2=0x7f96c40b4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1304747248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40b4850 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009850 tx=0x7f96b4009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:28.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1304747248 shutdown_connections 2023-12-19T17:52:28.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1304747248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40b4850 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1304747248 >> 172.21.15.45:0/1304747248 conn(0x7f96c40cfa30 msgr2=0x7f96c40cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:28.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1304747248 shutdown_connections 2023-12-19T17:52:28.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1304747248 wait complete. 2023-12-19T17:52:28.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.913+0000 7f96cb7d2700 1 Processor -- start 2023-12-19T17:52:28.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 -- start start 2023-12-19T17:52:28.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96c40b4d90 0x7f96c40c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40cc5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96c415d1c0 0x7f96c40c68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cc1a0 con 0x7f96c40d2860 2023-12-19T17:52:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cb590 con 0x7f96c40b4d90 2023-12-19T17:52:28.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c40cb800 con 0x7f96c415d1c0 2023-12-19T17:52:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40cc5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40cc5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51194/0 (socket says 172.21.15.45:51194) 2023-12-19T17:52:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1659051290 learned_addr learned my addr 172.21.15.45:0/1659051290 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c9d6f700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96c415d1c0 0x7f96c40c68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c956e700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96c40b4d90 0x7f96c40c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96c415d1c0 msgr2=0x7f96c40c68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96c415d1c0 0x7f96c40c68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96c40b4d90 msgr2=0x7f96c40c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96c40b4d90 0x7f96c40c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 -- 172.21.15.45:0/1659051290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b40094b0 con 0x7f96c40d2860 2023-12-19T17:52:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c956e700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96c40b4d90 0x7f96c40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:28.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96c8d6d700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40cc5c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96b40090b0 tx=0x7f96b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011630 con 0x7f96c40d2860 2023-12-19T17:52:28.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b40117b0 con 0x7f96c40d2860 2023-12-19T17:52:28.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b4011b60 con 0x7f96c40d2860 2023-12-19T17:52:28.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.917+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c40cbae0 con 0x7f96c40d2860 2023-12-19T17:52:28.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.921+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c40c80f0 con 0x7f96c40d2860 2023-12-19T17:52:28.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.921+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c40cc2e0 con 0x7f96c40d2860 2023-12-19T17:52:28.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.921+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f96b4018050 con 0x7f96c40d2860 2023-12-19T17:52:28.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.925+0000 7f96b9ffb700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f96a8065ad0 0x7f96a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:28.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.925+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f96b4084290 con 0x7f96c40d2860 2023-12-19T17:52:28.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.925+0000 7f96c956e700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f96a8065ad0 0x7f96a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:28.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.925+0000 7f96c956e700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f96a8065ad0 0x7f96a8067f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007c00 tx=0x7f96c0007dd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:28.933+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f96c40cc2e0 con 0x7f96c40d2860 2023-12-19T17:52:29.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.109+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f96c40cc2e0 con 0x7f96c40d2860 2023-12-19T17:52:29.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.109+0000 7f96b9ffb700 1 -- 172.21.15.45:0/1659051290 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f96c40cc2e0 con 0x7f96c40d2860 2023-12-19T17:52:29.112 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f96a8065ad0 msgr2=0x7f96a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f96a8065ad0 0x7f96a8067f90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007c00 tx=0x7f96c0007dd0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 msgr2=0x7f96c40cc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40cc5c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f96b40090b0 tx=0x7f96b4004770 comp rx=0 tx=0).stop 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 shutdown_connections 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f96a8065ad0 0x7f96a8067f90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96c415d1c0 0x7f96c40c68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96c40d2860 0x7f96c40cc5c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 --2- 172.21.15.45:0/1659051290 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96c40b4d90 0x7f96c40c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 >> 172.21.15.45:0/1659051290 conn(0x7f96c40cfa30 msgr2=0x7f96c415b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 shutdown_connections 2023-12-19T17:52:29.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.113+0000 7f96cb7d2700 1 -- 172.21.15.45:0/1659051290 wait complete. 2023-12-19T17:52:29.137 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:29.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.325+0000 7fb283501700 1 Processor -- start 2023-12-19T17:52:29.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.325+0000 7fb283501700 1 -- start start 2023-12-19T17:52:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb283501700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c15d090 0x7fb27c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb283501700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb27c0cdff0 0x7fb27c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb283501700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb27c0d01e0 con 0x7fb27c0cfd70 2023-12-19T17:52:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb283501700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb27c0b6040 con 0x7fb27c0cdff0 2023-12-19T17:52:29.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb283501700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c0d10e0 con 0x7fb27c15d090 2023-12-19T17:52:29.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb27c0cdff0 0x7fb27c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb27c0cdff0 0x7fb27c0cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51210/0 (socket says 172.21.15.45:51210) 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 -- 172.21.15.45:0/19154298 learned_addr learned my addr 172.21.15.45:0/19154298 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb28129d700 1 --2- 172.21.15.45:0/19154298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c15d090 0x7fb27c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 -- 172.21.15.45:0/19154298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c15d090 msgr2=0x7fb27c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 --2- 172.21.15.45:0/19154298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c15d090 0x7fb27c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 -- 172.21.15.45:0/19154298 >> v1:172.21.15.73:6789/0 conn(0x7fb27c0cfd70 legacy=0x7fb27c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:29.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 -- 172.21.15.45:0/19154298 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c0d13c0 con 0x7fb27c0cdff0 2023-12-19T17:52:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb280a9c700 1 --2- 172.21.15.45:0/19154298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c0cdff0 0x7fb27c0cf830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009910 tx=0x7fb26c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0abc109f570ad4d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.329+0000 7fb273fff700 1 -- 172.21.15.45:0/19154298 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c004230 con 0x7fb27c0cdff0 2023-12-19T17:52:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb273fff700 1 -- 172.21.15.45:0/19154298 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c004390 con 0x7fb27c0cdff0 2023-12-19T17:52:29.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb273fff700 1 -- 172.21.15.45:0/19154298 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c009e60 con 0x7fb27c0cdff0 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 -- 172.21.15.45:0/19154298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c0cdff0 msgr2=0x7fb27c0cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 --2- 172.21.15.45:0/19154298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c0cdff0 0x7fb27c0cf830 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb26c009910 tx=0x7fb26c009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 -- 172.21.15.45:0/19154298 shutdown_connections 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 --2- 172.21.15.45:0/19154298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c0cdff0 0x7fb27c0cf830 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 --2- 172.21.15.45:0/19154298 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c15d090 0x7fb27c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 -- 172.21.15.45:0/19154298 >> 172.21.15.45:0/19154298 conn(0x7fb27c0b4b90 msgr2=0x7fb27c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 -- 172.21.15.45:0/19154298 shutdown_connections 2023-12-19T17:52:29.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.333+0000 7fb283501700 1 -- 172.21.15.45:0/19154298 wait complete. 2023-12-19T17:52:29.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 Processor -- start 2023-12-19T17:52:29.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 -- start start 2023-12-19T17:52:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c0cdff0 0x7fb27c155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb27c0cfd70 0x7fb27c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 0x7fb27c1595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15f1d0 con 0x7fb27c15d090 2023-12-19T17:52:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15f4b0 con 0x7fb27c0cfd70 2023-12-19T17:52:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb283501700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb27c15f790 con 0x7fb27c0cdff0 2023-12-19T17:52:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 0x7fb27c1595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb28129d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c0cdff0 0x7fb27c155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 0x7fb27c1595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51224/0 (socket says 172.21.15.45:51224) 2023-12-19T17:52:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb280a9c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb27c0cfd70 0x7fb27c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 -- 172.21.15.45:0/1623721746 learned_addr learned my addr 172.21.15.45:0/1623721746 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 -- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c0cdff0 msgr2=0x7fb27c155cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c0cdff0 0x7fb27c155cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 -- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb27c0cfd70 msgr2=0x7fb27c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb27c0cfd70 0x7fb27c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb281a9e700 1 -- 172.21.15.45:0/1623721746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb26c009570 con 0x7fb27c15d090 2023-12-19T17:52:29.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.337+0000 7fb28129d700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c0cdff0 0x7fb27c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:29.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb281a9e700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 0x7fb27c1595e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb27400cc10 tx=0x7fb27400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb27400aa60 con 0x7fb27c15d090 2023-12-19T17:52:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb27400abc0 con 0x7fb27c15d090 2023-12-19T17:52:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb274012420 con 0x7fb27c15d090 2023-12-19T17:52:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb27c15fa70 con 0x7fb27c15d090 2023-12-19T17:52:29.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb27c156210 con 0x7fb27c15d090 2023-12-19T17:52:29.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.341+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb27c04ed30 con 0x7fb27c15d090 2023-12-19T17:52:29.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.345+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb274012580 con 0x7fb27c15d090 2023-12-19T17:52:29.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.345+0000 7fb271ffb700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb260065ad0 0x7fb260067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.345+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb2740837d0 con 0x7fb27c15d090 2023-12-19T17:52:29.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.345+0000 7fb28129d700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb260065ad0 0x7fb260067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.345+0000 7fb28129d700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb260065ad0 0x7fb260067f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb278006b40 tx=0x7fb278008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:29.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.353+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb274050db0 con 0x7fb27c15d090 2023-12-19T17:52:29.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.541+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb27c0ca280 con 0x7fb27c15d090 2023-12-19T17:52:29.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.541+0000 7fb271ffb700 1 -- 172.21.15.45:0/1623721746 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb2740543d0 con 0x7fb27c15d090 2023-12-19T17:52:29.545 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:29.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb260065ad0 msgr2=0x7fb260067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb260065ad0 0x7fb260067f90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fb278006b40 tx=0x7fb278008040 comp rx=0 tx=0).stop 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 msgr2=0x7fb27c1595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 0x7fb27c1595e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb27400cc10 tx=0x7fb27400cf20 comp rx=0 tx=0).stop 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 shutdown_connections 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb260065ad0 0x7fb260067f90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb27c15d090 0x7fb27c1595e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb27c0cfd70 0x7fb27c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 --2- 172.21.15.45:0/1623721746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb27c0cdff0 0x7fb27c155cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 >> 172.21.15.45:0/1623721746 conn(0x7fb27c0b4b90 msgr2=0x7fb27c0c9650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:29.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.545+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 shutdown_connections 2023-12-19T17:52:29.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.549+0000 7fb283501700 1 -- 172.21.15.45:0/1623721746 wait complete. 2023-12-19T17:52:29.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:29.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.757+0000 7f04ab990700 1 Processor -- start 2023-12-19T17:52:29.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04ab990700 1 -- start start 2023-12-19T17:52:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04ab990700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f04a415ab50 0x7f04a40ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04ab990700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a415af30 0x7f04a40cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04ab990700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a406cbb0 con 0x7f04a406f4a0 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04ab990700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a406fa10 con 0x7f04a415af30 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04ab990700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a406fcf0 con 0x7f04a415ab50 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.761+0000 7f04a8f2b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a415af30 0x7f04a40cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f04a415af30 0x7f04a40cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51238/0 (socket says 172.21.15.45:51238) 2023-12-19T17:52:29.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 -- 172.21.15.45:0/1079302089 learned_addr learned my addr 172.21.15.45:0/1079302089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a9f2d700 1 --1- 172.21.15.45:0/1079302089 >> v1:172.21.15.45:6789/0 conn(0x7f04a406f4a0 0x7f04a415e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53042/0 (socket says 172.21.15.45:53042) 2023-12-19T17:52:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a972c700 1 --2- 172.21.15.45:0/1079302089 >> v2:172.21.15.73:3300/0 conn(0x7f04a415ab50 0x7f04a40ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 -- 172.21.15.45:0/1079302089 >> v2:172.21.15.73:3300/0 conn(0x7f04a415ab50 msgr2=0x7f04a40ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 --2- 172.21.15.45:0/1079302089 >> v2:172.21.15.73:3300/0 conn(0x7f04a415ab50 0x7f04a40ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 -- 172.21.15.45:0/1079302089 >> v1:172.21.15.45:6789/0 conn(0x7f04a406f4a0 legacy=0x7f04a415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 -- 172.21.15.45:0/1079302089 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a406ffd0 con 0x7f04a415af30 2023-12-19T17:52:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04a8f2b700 1 --2- 172.21.15.45:0/1079302089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415af30 0x7f04a40cd2b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04a4070630 tx=0x7f0494009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dba1160eeae5b3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f049bfff700 1 -- 172.21.15.45:0/1079302089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011830 con 0x7f04a415af30 2023-12-19T17:52:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f049bfff700 1 -- 172.21.15.45:0/1079302089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0494011990 con 0x7f04a415af30 2023-12-19T17:52:29.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f049bfff700 1 -- 172.21.15.45:0/1079302089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494011d20 con 0x7f04a415af30 2023-12-19T17:52:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 -- 172.21.15.45:0/1079302089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415af30 msgr2=0x7f04a40cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 --2- 172.21.15.45:0/1079302089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415af30 0x7f04a40cd2b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f04a4070630 tx=0x7f0494009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 -- 172.21.15.45:0/1079302089 shutdown_connections 2023-12-19T17:52:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 --2- 172.21.15.45:0/1079302089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415af30 0x7f04a40cd2b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 --2- 172.21.15.45:0/1079302089 >> v2:172.21.15.73:3300/0 conn(0x7f04a415ab50 0x7f04a40ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 -- 172.21.15.45:0/1079302089 >> 172.21.15.45:0/1079302089 conn(0x7f04a40cba40 msgr2=0x7f04a40ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 -- 172.21.15.45:0/1079302089 shutdown_connections 2023-12-19T17:52:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.765+0000 7f04ab990700 1 -- 172.21.15.45:0/1079302089 wait complete. 2023-12-19T17:52:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 Processor -- start 2023-12-19T17:52:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 -- start start 2023-12-19T17:52:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04a406f4a0 0x7f04a40af630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 0x7f04a4144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04a415af30 0x7f04a40c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a4151bb0 con 0x7f04a415ab50 2023-12-19T17:52:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41f38f0 con 0x7f04a415af30 2023-12-19T17:52:29.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.769+0000 7f04ab990700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a41f2d70 con 0x7f04a406f4a0 2023-12-19T17:52:29.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 0x7f04a4144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 0x7f04a4144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51244/0 (socket says 172.21.15.45:51244) 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 -- 172.21.15.45:0/367188566 learned_addr learned my addr 172.21.15.45:0/367188566 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a972c700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04a406f4a0 0x7f04a40af630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a9f2d700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04a415af30 0x7f04a40c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 -- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04a406f4a0 msgr2=0x7f04a40af630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04a406f4a0 0x7f04a40af630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 -- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04a415af30 msgr2=0x7f04a40c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04a415af30 0x7f04a40c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 -- 172.21.15.45:0/367188566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0494009570 con 0x7f04a415ab50 2023-12-19T17:52:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04a8f2b700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 0x7f04a4144380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494004510 con 0x7f04a415ab50 2023-12-19T17:52:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049401e070 con 0x7f04a415ab50 2023-12-19T17:52:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494003900 con 0x7f04a415ab50 2023-12-19T17:52:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a41f3050 con 0x7f04a415ab50 2023-12-19T17:52:29.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.773+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a41f3610 con 0x7f04a415ab50 2023-12-19T17:52:29.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.777+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a404ed30 con 0x7f04a415ab50 2023-12-19T17:52:29.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.777+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0494003a60 con 0x7f04a415ab50 2023-12-19T17:52:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.777+0000 7f0499ffb700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0488065ad0 0x7f0488067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.777+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0494084410 con 0x7f04a415ab50 2023-12-19T17:52:29.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.777+0000 7f04a972c700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0488065ad0 0x7f0488067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:29.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.781+0000 7f04a972c700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0488065ad0 0x7f0488067f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009bf0 tx=0x7f04a0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:29.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.785+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0494051960 con 0x7f04a415ab50 2023-12-19T17:52:29.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:52:29.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:52:29.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.965+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04a406c990 con 0x7f04a415ab50 2023-12-19T17:52:29.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.965+0000 7f0499ffb700 1 -- 172.21.15.45:0/367188566 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f0494054f80 con 0x7f04a415ab50 2023-12-19T17:52:29.970 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:29.970 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:29.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0488065ad0 msgr2=0x7f0488067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0488065ad0 0x7f0488067f90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009bf0 tx=0x7f04a0009240 comp rx=0 tx=0).stop 2023-12-19T17:52:29.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 msgr2=0x7f04a4144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:29.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 0x7f04a4144380 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0494000c00 tx=0x7f0494004770 comp rx=0 tx=0).stop 2023-12-19T17:52:29.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 shutdown_connections 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0488065ad0 0x7f0488067f90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04a415af30 0x7f04a40c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04a415ab50 0x7f04a4144380 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 --2- 172.21.15.45:0/367188566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04a406f4a0 0x7f04a40af630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 >> 172.21.15.45:0/367188566 conn(0x7f04a40cba40 msgr2=0x7f04a40c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 shutdown_connections 2023-12-19T17:52:29.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:29.969+0000 7f04ab990700 1 -- 172.21.15.45:0/367188566 wait complete. 2023-12-19T17:52:29.997 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:29.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:30.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.241+0000 7fcc3359e700 1 Processor -- start 2023-12-19T17:52:30.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3359e700 1 -- start start 2023-12-19T17:52:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc3415cf20 0x7fcc340d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc340cdfd0 0x7fcc340b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc3415d300 con 0x7fcc340b8580 2023-12-19T17:52:30.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3359e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc340d1550 con 0x7fcc340cdfd0 2023-12-19T17:52:30.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340d1830 con 0x7fcc3415cf20 2023-12-19T17:52:30.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc340cdfd0 0x7fcc340b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc3415cf20 0x7fcc340d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcc340cdfd0 0x7fcc340b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51252/0 (socket says 172.21.15.45:51252) 2023-12-19T17:52:30.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 -- 172.21.15.45:0/835467329 learned_addr learned my addr 172.21.15.45:0/835467329 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3159a700 1 -- 172.21.15.45:0/835467329 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055206305 0 0) 0x7fcc3415d300 con 0x7fcc340b8580 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3159a700 1 -- 172.21.15.45:0/835467329 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc1c0035d0 con 0x7fcc340b8580 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 -- 172.21.15.45:0/835467329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc3415cf20 msgr2=0x7fcc340d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 --2- 172.21.15.45:0/835467329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc3415cf20 0x7fcc340d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 -- 172.21.15.45:0/835467329 >> v1:172.21.15.73:6789/0 conn(0x7fcc340b8580 legacy=0x7fcc340cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc32d9d700 1 -- 172.21.15.45:0/835467329 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc340d1b10 con 0x7fcc340cdfd0 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.245+0000 7fcc3259c700 1 --2- 172.21.15.45:0/835467329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc3415cf20 0x7fcc340d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc32d9d700 1 --2- 172.21.15.45:0/835467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc340cdfd0 0x7fcc340b5d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009e50 tx=0x7fcc2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=112d166f8983de00 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3159a700 1 -- 172.21.15.45:0/835467329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00e070 con 0x7fcc340cdfd0 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3159a700 1 -- 172.21.15.45:0/835467329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c00b910 con 0x7fcc340cdfd0 2023-12-19T17:52:30.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3159a700 1 -- 172.21.15.45:0/835467329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c00bc80 con 0x7fcc340cdfd0 2023-12-19T17:52:30.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 -- 172.21.15.45:0/835467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc340cdfd0 msgr2=0x7fcc340b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 --2- 172.21.15.45:0/835467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc340cdfd0 0x7fcc340b5d20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c009e50 tx=0x7fcc2c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 -- 172.21.15.45:0/835467329 shutdown_connections 2023-12-19T17:52:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 --2- 172.21.15.45:0/835467329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc340cdfd0 0x7fcc340b5d20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 --2- 172.21.15.45:0/835467329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc3415cf20 0x7fcc340d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 -- 172.21.15.45:0/835467329 >> 172.21.15.45:0/835467329 conn(0x7fcc340b4670 msgr2=0x7fcc340b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 -- 172.21.15.45:0/835467329 shutdown_connections 2023-12-19T17:52:30.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.249+0000 7fcc3359e700 1 -- 172.21.15.45:0/835467329 wait complete. 2023-12-19T17:52:30.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 Processor -- start 2023-12-19T17:52:30.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 -- start start 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc340b8580 0x7fcc3415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc340cdfd0 0x7fcc340ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 0x7fcc341f5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc340ab210 con 0x7fcc3415cf20 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc341f64d0 con 0x7fcc340b8580 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc3415a9f0 con 0x7fcc340cdfd0 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc32d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 0x7fcc341f5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc3259c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc340b8580 0x7fcc3415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc32d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 0x7fcc341f5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51254/0 (socket says 172.21.15.45:51254) 2023-12-19T17:52:30.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc32d9d700 1 -- 172.21.15.45:0/1619029619 learned_addr learned my addr 172.21.15.45:0/1619029619 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.253+0000 7fcc31d9b700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc340cdfd0 0x7fcc340ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc32d9d700 1 -- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc340cdfd0 msgr2=0x7fcc340ca580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc32d9d700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc340cdfd0 0x7fcc340ca580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc32d9d700 1 -- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc340b8580 msgr2=0x7fcc3415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc32d9d700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc340b8580 0x7fcc3415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc32d9d700 1 -- 172.21.15.45:0/1619029619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc240094b0 con 0x7fcc3415cf20 2023-12-19T17:52:30.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc32d9d700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 0x7fcc341f5550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c012000 tx=0x7fcc2c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:30.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0099b0 con 0x7fcc3415cf20 2023-12-19T17:52:30.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc2c009b30 con 0x7fcc3415cf20 2023-12-19T17:52:30.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc2c004970 con 0x7fcc3415cf20 2023-12-19T17:52:30.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c01c680 con 0x7fcc3415cf20 2023-12-19T17:52:30.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc341f61f0 con 0x7fcc3415cf20 2023-12-19T17:52:30.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.257+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc3404ed30 con 0x7fcc3415cf20 2023-12-19T17:52:30.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.261+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcc2c01c7e0 con 0x7fcc3415cf20 2023-12-19T17:52:30.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.261+0000 7fcc22ffd700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcc14065ad0 0x7fcc14067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.261+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcc2c084ec0 con 0x7fcc3415cf20 2023-12-19T17:52:30.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.261+0000 7fcc3259c700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcc14065ad0 0x7fcc14067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.265+0000 7fcc3259c700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcc14065ad0 0x7fcc14067f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009ce0 tx=0x7fcc24009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:30.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.269+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcc2c052410 con 0x7fcc3415cf20 2023-12-19T17:52:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.445+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcc340d2720 con 0x7fcc3415cf20 2023-12-19T17:52:30.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc22ffd700 1 -- 172.21.15.45:0/1619029619 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcc2c055a30 con 0x7fcc3415cf20 2023-12-19T17:52:30.451 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcc14065ad0 msgr2=0x7fcc14067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcc14065ad0 0x7fcc14067f90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcc24009ce0 tx=0x7fcc24009240 comp rx=0 tx=0).stop 2023-12-19T17:52:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 msgr2=0x7fcc341f5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 0x7fcc341f5550 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c012000 tx=0x7fcc2c004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 shutdown_connections 2023-12-19T17:52:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcc14065ad0 0x7fcc14067f90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcc3415cf20 0x7fcc341f5550 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcc340cdfd0 0x7fcc340ca580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 --2- 172.21.15.45:0/1619029619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcc340b8580 0x7fcc3415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 >> 172.21.15.45:0/1619029619 conn(0x7fcc340b4670 msgr2=0x7fcc340b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 shutdown_connections 2023-12-19T17:52:30.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.449+0000 7fcc3359e700 1 -- 172.21.15.45:0/1619029619 wait complete. 2023-12-19T17:52:30.474 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 Processor -- start 2023-12-19T17:52:30.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 -- start start 2023-12-19T17:52:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb5c15d090 0x7fbb5c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c0cdff0 0x7fbb5c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5c0d01e0 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5c0b6040 con 0x7fbb5c15d090 2023-12-19T17:52:30.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb638b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c0d10e0 con 0x7fbb5c0cdff0 2023-12-19T17:52:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb61651700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb5c15d090 0x7fbb5c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb61651700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb5c15d090 0x7fbb5c0d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51260/0 (socket says 172.21.15.45:51260) 2023-12-19T17:52:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb61651700 1 -- 172.21.15.45:0/1683547305 learned_addr learned my addr 172.21.15.45:0/1683547305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:30.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.653+0000 7fbb60e50700 1 --2- 172.21.15.45:0/1683547305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c0cdff0 0x7fbb5c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb61651700 1 -- 172.21.15.45:0/1683547305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c0cdff0 msgr2=0x7fbb5c0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb61651700 1 --2- 172.21.15.45:0/1683547305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c0cdff0 0x7fbb5c0cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb61651700 1 -- 172.21.15.45:0/1683547305 >> v1:172.21.15.73:6789/0 conn(0x7fbb5c0cfd70 legacy=0x7fbb5c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb61651700 1 -- 172.21.15.45:0/1683547305 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb5c0d13c0 con 0x7fbb5c15d090 2023-12-19T17:52:30.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb61651700 1 --2- 172.21.15.45:0/1683547305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c15d090 0x7fbb5c0d0a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009910 tx=0x7fbb58009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c27c024cad092798 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb53fff700 1 -- 172.21.15.45:0/1683547305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011830 con 0x7fbb5c15d090 2023-12-19T17:52:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb53fff700 1 -- 172.21.15.45:0/1683547305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb58011990 con 0x7fbb5c15d090 2023-12-19T17:52:30.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb53fff700 1 -- 172.21.15.45:0/1683547305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb58011d40 con 0x7fbb5c15d090 2023-12-19T17:52:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 -- 172.21.15.45:0/1683547305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c15d090 msgr2=0x7fbb5c0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1683547305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c15d090 0x7fbb5c0d0a50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fbb58009910 tx=0x7fbb58009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 -- 172.21.15.45:0/1683547305 shutdown_connections 2023-12-19T17:52:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1683547305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c0cdff0 0x7fbb5c0cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1683547305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c15d090 0x7fbb5c0d0a50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 -- 172.21.15.45:0/1683547305 >> 172.21.15.45:0/1683547305 conn(0x7fbb5c0b4b90 msgr2=0x7fbb5c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 -- 172.21.15.45:0/1683547305 shutdown_connections 2023-12-19T17:52:30.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.657+0000 7fbb638b5700 1 -- 172.21.15.45:0/1683547305 wait complete. 2023-12-19T17:52:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.661+0000 7fbb638b5700 1 Processor -- start 2023-12-19T17:52:30.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.661+0000 7fbb638b5700 1 -- start start 2023-12-19T17:52:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c0cdff0 0x7fbb5c14d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 0x7fbb5c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15d090 0x7fbb5c0cb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c14d890 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c15ec00 con 0x7fbb5c0cdff0 2023-12-19T17:52:30.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5c15eeb0 con 0x7fbb5c15d090 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 0x7fbb5c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb61651700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c0cdff0 0x7fbb5c14d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb61e52700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15d090 0x7fbb5c0cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 0x7fbb5c15e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51264/0 (socket says 172.21.15.45:51264) 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 -- 172.21.15.45:0/1054468257 learned_addr learned my addr 172.21.15.45:0/1054468257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 -- 172.21.15.45:0/1054468257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15d090 msgr2=0x7fbb5c0cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15d090 0x7fbb5c0cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 -- 172.21.15.45:0/1054468257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c0cdff0 msgr2=0x7fbb5c14d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c0cdff0 0x7fbb5c14d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 -- 172.21.15.45:0/1054468257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb58009570 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb60e50700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 0x7fbb5c15e6c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e9d0 tx=0x7fbb4c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c009720 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c00ee70 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5c15f190 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c00ca50 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.665+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb5c15f750 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.669+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb5c04ed30 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.669+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb4c00cbb0 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.673+0000 7fbb51ffb700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb40065ad0 0x7fbb40067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.673+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbb4c083630 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.673+0000 7fbb61651700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb40065ad0 0x7fbb40067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:30.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.673+0000 7fbb61651700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb40065ad0 0x7fbb40067f90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:30.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.681+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb4c050b70 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.857+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbb5c0b1ff0 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.857+0000 7fbb51ffb700 1 -- 172.21.15.45:0/1054468257 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbb4c00ce60 con 0x7fbb5c0cfd70 2023-12-19T17:52:30.862 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb40065ad0 msgr2=0x7fbb40067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb40065ad0 0x7fbb40067f90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbb58000c00 tx=0x7fbb58008030 comp rx=0 tx=0).stop 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 msgr2=0x7fbb5c15e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 0x7fbb5c15e6c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c00e9d0 tx=0x7fbb4c00ece0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 shutdown_connections 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb40065ad0 0x7fbb40067f90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb5c15d090 0x7fbb5c0cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb5c0cfd70 0x7fbb5c15e6c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 --2- 172.21.15.45:0/1054468257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb5c0cdff0 0x7fbb5c14d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 >> 172.21.15.45:0/1054468257 conn(0x7fbb5c0b4b90 msgr2=0x7fbb5c06ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 shutdown_connections 2023-12-19T17:52:30.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:30.865+0000 7fbb638b5700 1 -- 172.21.15.45:0/1054468257 wait complete. 2023-12-19T17:52:30.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.069+0000 7f9e933ce700 1 Processor -- start 2023-12-19T17:52:31.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.069+0000 7f9e933ce700 1 -- start start 2023-12-19T17:52:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e933ce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e933ce700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e8c0caa20 0x7f9e8c0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e933ce700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e8c0adf70 con 0x7f9e8c0caea0 2023-12-19T17:52:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e933ce700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e8c0cb530 con 0x7f9e8c0caa20 2023-12-19T17:52:31.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e933ce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c159760 con 0x7f9e8c159380 2023-12-19T17:52:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e91bcb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e8c0caa20 0x7f9e8c0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c0713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:37594/0 (socket says 172.21.15.45:37594) 2023-12-19T17:52:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 -- 172.21.15.45:0/1191441581 learned_addr learned my addr 172.21.15.45:0/1191441581 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:31.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 -- 172.21.15.45:0/1191441581 >> v2:172.21.15.73:3300/0 conn(0x7f9e8c0caa20 msgr2=0x7f9e8c0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 --2- 172.21.15.45:0/1191441581 >> v2:172.21.15.73:3300/0 conn(0x7f9e8c0caa20 0x7f9e8c0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 -- 172.21.15.45:0/1191441581 >> v1:172.21.15.73:6789/0 conn(0x7f9e8c0caea0 legacy=0x7f9e8c15cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 -- 172.21.15.45:0/1191441581 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c0b23c0 con 0x7f9e8c159380 2023-12-19T17:52:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e923cc700 1 --2- 172.21.15.45:0/1191441581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c0713d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009910 tx=0x7f9e88009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ed9fead7858d523 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e913ca700 1 -- 172.21.15.45:0/1191441581 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e88005e50 con 0x7f9e8c159380 2023-12-19T17:52:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e913ca700 1 -- 172.21.15.45:0/1191441581 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e88006030 con 0x7f9e8c159380 2023-12-19T17:52:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.073+0000 7f9e913ca700 1 -- 172.21.15.45:0/1191441581 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e880063e0 con 0x7f9e8c159380 2023-12-19T17:52:31.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 -- 172.21.15.45:0/1191441581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 msgr2=0x7f9e8c0713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 --2- 172.21.15.45:0/1191441581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c0713d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9e88009910 tx=0x7f9e88009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 -- 172.21.15.45:0/1191441581 shutdown_connections 2023-12-19T17:52:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 --2- 172.21.15.45:0/1191441581 >> v2:172.21.15.73:3300/0 conn(0x7f9e8c0caa20 0x7f9e8c0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 --2- 172.21.15.45:0/1191441581 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c0713d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 -- 172.21.15.45:0/1191441581 >> 172.21.15.45:0/1191441581 conn(0x7f9e8c0cf5a0 msgr2=0x7f9e8c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 -- 172.21.15.45:0/1191441581 shutdown_connections 2023-12-19T17:52:31.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.077+0000 7f9e933ce700 1 -- 172.21.15.45:0/1191441581 wait complete. 2023-12-19T17:52:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 Processor -- start 2023-12-19T17:52:31.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 -- start start 2023-12-19T17:52:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c0caea0 0x7f9e8c13a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 0x7f9e8c0cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c14a160 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c15b270 con 0x7f9e8c0caea0 2023-12-19T17:52:31.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e933ce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8c15b550 con 0x7f9e8c159380 2023-12-19T17:52:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 0x7f9e8c0cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 0x7f9e8c0cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51270/0 (socket says 172.21.15.45:51270) 2023-12-19T17:52:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e91bcb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 -- 172.21.15.45:0/3115470111 learned_addr learned my addr 172.21.15.45:0/3115470111 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:31.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e923cc700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c0caea0 0x7f9e8c13a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 -- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 msgr2=0x7f9e8c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c15a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 -- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c0caea0 msgr2=0x7f9e8c13a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c0caea0 0x7f9e8c13a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 -- 172.21.15.45:0/3115470111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e88009520 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e91bcb700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e923cc700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c0caea0 0x7f9e8c13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:31.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.081+0000 7f9e92bcd700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 0x7f9e8c0cc520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400cb90 tx=0x7f9e8400cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.085+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e84003c70 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.085+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e84003df0 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.085+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e8400aae0 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.085+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e8c15b830 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.085+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8c156130 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.085+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c14a2d0 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.089+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e8400ac40 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.089+0000 7f9e82ffd700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e70065b00 0x7f9e70067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.089+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9e84083560 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.089+0000 7f9e923cc700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e70065b00 0x7f9e70067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.089+0000 7f9e923cc700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e70065b00 0x7f9e70067fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006000 tx=0x7f9e88008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.093+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9e84050ac0 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.269+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9e8c04ed30 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.273+0000 7f9e82ffd700 1 -- 172.21.15.45:0/3115470111 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9e840540e0 con 0x7f9e8c15c4a0 2023-12-19T17:52:31.275 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e70065b00 msgr2=0x7f9e70067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e70065b00 0x7f9e70067fc0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9e88006000 tx=0x7f9e88008070 comp rx=0 tx=0).stop 2023-12-19T17:52:31.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 msgr2=0x7f9e8c0cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 0x7f9e8c0cc520 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400cb90 tx=0x7f9e8400cea0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 shutdown_connections 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e70065b00 0x7f9e70067fc0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e8c15c4a0 0x7f9e8c0cc520 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e8c159380 0x7f9e8c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 --2- 172.21.15.45:0/3115470111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8c0caea0 0x7f9e8c13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 >> 172.21.15.45:0/3115470111 conn(0x7f9e8c0caa20 msgr2=0x7f9e8c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 shutdown_connections 2023-12-19T17:52:31.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.277+0000 7f9e933ce700 1 -- 172.21.15.45:0/3115470111 wait complete. 2023-12-19T17:52:31.301 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:31.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.489+0000 7efe21345700 1 Processor -- start 2023-12-19T17:52:31.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.489+0000 7efe21345700 1 -- start start 2023-12-19T17:52:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe21345700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe21345700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe1c0b8580 0x7efe1c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe21345700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe1c0d25f0 0x7efe1c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe21345700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c15d300 con 0x7efe1c0b8580 2023-12-19T17:52:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe21345700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe1c0d1550 con 0x7efe1c0d25f0 2023-12-19T17:52:31.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe21345700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c0d1830 con 0x7efe1c15cf20 2023-12-19T17:52:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe1c0b8580 0x7efe1c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe20b44700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe1c0d25f0 0x7efe1c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe1c0b8580 0x7efe1c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51276/0 (socket says 172.21.15.45:51276) 2023-12-19T17:52:31.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 -- 172.21.15.45:0/678889849 learned_addr learned my addr 172.21.15.45:0/678889849 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 -- 172.21.15.45:0/678889849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 msgr2=0x7efe1c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 --2- 172.21.15.45:0/678889849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 -- 172.21.15.45:0/678889849 >> v2:172.21.15.73:3300/0 conn(0x7efe1c0d25f0 msgr2=0x7efe1c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 --2- 172.21.15.45:0/678889849 >> v2:172.21.15.73:3300/0 conn(0x7efe1c0d25f0 0x7efe1c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.493+0000 7efe1b7fe700 1 -- 172.21.15.45:0/678889849 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c0d1b10 con 0x7efe1c0b8580 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe20b44700 1 --2- 172.21.15.45:0/678889849 >> v2:172.21.15.73:3300/0 conn(0x7efe1c0d25f0 0x7efe1c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:31.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe1b7fe700 1 --2- 172.21.15.45:0/678889849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0b8580 0x7efe1c0cd8c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efe1c071c00 tx=0x7efe10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a363bfa345e882e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe1affd700 1 -- 172.21.15.45:0/678889849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011830 con 0x7efe1c0b8580 2023-12-19T17:52:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe1affd700 1 -- 172.21.15.45:0/678889849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe10011990 con 0x7efe1c0b8580 2023-12-19T17:52:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe1affd700 1 -- 172.21.15.45:0/678889849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10011d20 con 0x7efe1c0b8580 2023-12-19T17:52:31.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 -- 172.21.15.45:0/678889849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0b8580 msgr2=0x7efe1c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 --2- 172.21.15.45:0/678889849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0b8580 0x7efe1c0cd8c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7efe1c071c00 tx=0x7efe10009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 -- 172.21.15.45:0/678889849 shutdown_connections 2023-12-19T17:52:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 --2- 172.21.15.45:0/678889849 >> v2:172.21.15.73:3300/0 conn(0x7efe1c0d25f0 0x7efe1c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 --2- 172.21.15.45:0/678889849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0b8580 0x7efe1c0cd8c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 --2- 172.21.15.45:0/678889849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 -- 172.21.15.45:0/678889849 >> 172.21.15.45:0/678889849 conn(0x7efe1c0b4670 msgr2=0x7efe1c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 -- 172.21.15.45:0/678889849 shutdown_connections 2023-12-19T17:52:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.497+0000 7efe21345700 1 -- 172.21.15.45:0/678889849 wait complete. 2023-12-19T17:52:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 Processor -- start 2023-12-19T17:52:31.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 -- start start 2023-12-19T17:52:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe1c0b8580 0x7efe1c157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 0x7efe1c157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c06eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c149f00 con 0x7efe1c0d25f0 2023-12-19T17:52:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c1585d0 con 0x7efe1c0b8580 2023-12-19T17:52:31.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe21345700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c149140 con 0x7efe1c15cf20 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 0x7efe1c157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 0x7efe1c157fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51290/0 (socket says 172.21.15.45:51290) 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 -- 172.21.15.45:0/3242932126 learned_addr learned my addr 172.21.15.45:0/3242932126 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1bfff700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe1c0b8580 0x7efe1c157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe20b44700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c06eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 -- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 msgr2=0x7efe1c06eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c06eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 -- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe1c0b8580 msgr2=0x7efe1c157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe1c0b8580 0x7efe1c157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 -- 172.21.15.45:0/3242932126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14009a70 con 0x7efe1c0d25f0 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe20b44700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.501+0000 7efe1b7fe700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 0x7efe1c157fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efe10000c00 tx=0x7efe10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10004590 con 0x7efe1c0d25f0 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1001e070 con 0x7efe1c0d25f0 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe10009570 con 0x7efe1c0d25f0 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe10003900 con 0x7efe1c0d25f0 2023-12-19T17:52:31.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c149700 con 0x7efe1c0d25f0 2023-12-19T17:52:31.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c04ed30 con 0x7efe1c0d25f0 2023-12-19T17:52:31.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.505+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe10003a60 con 0x7efe1c0d25f0 2023-12-19T17:52:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.509+0000 7efe18ff9700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe08065ad0 0x7efe08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.509+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efe10084010 con 0x7efe1c0d25f0 2023-12-19T17:52:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.509+0000 7efe1bfff700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe08065ad0 0x7efe08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.509+0000 7efe1bfff700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe08065ad0 0x7efe08067f90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009b00 tx=0x7efe0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.513+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efe10051700 con 0x7efe1c0d25f0 2023-12-19T17:52:31.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.697+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efe1c0ccd90 con 0x7efe1c0d25f0 2023-12-19T17:52:31.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.697+0000 7efe18ff9700 1 -- 172.21.15.45:0/3242932126 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7efe10054d20 con 0x7efe1c0d25f0 2023-12-19T17:52:31.701 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe08065ad0 msgr2=0x7efe08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe08065ad0 0x7efe08067f90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7efe0c009b00 tx=0x7efe0c008040 comp rx=0 tx=0).stop 2023-12-19T17:52:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 msgr2=0x7efe1c157fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 0x7efe1c157fa0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7efe10000c00 tx=0x7efe10004770 comp rx=0 tx=0).stop 2023-12-19T17:52:31.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 shutdown_connections 2023-12-19T17:52:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe08065ad0 0x7efe08067f90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe1c15cf20 0x7efe1c06eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe1c0d25f0 0x7efe1c157fa0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 --2- 172.21.15.45:0/3242932126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe1c0b8580 0x7efe1c157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 >> 172.21.15.45:0/3242932126 conn(0x7efe1c0b4670 msgr2=0x7efe1c0cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:31.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 shutdown_connections 2023-12-19T17:52:31.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.701+0000 7efe21345700 1 -- 172.21.15.45:0/3242932126 wait complete. 2023-12-19T17:52:31.727 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:31.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 Processor -- start 2023-12-19T17:52:31.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 -- start start 2023-12-19T17:52:31.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f665015ab50 0x7f66500ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665006e0a0 0x7f66500cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f665006cbb0 con 0x7f665015af30 2023-12-19T17:52:31.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665006fa10 con 0x7f665015ab50 2023-12-19T17:52:31.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.913+0000 7f665833a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f665006fcf0 con 0x7f665006e0a0 2023-12-19T17:52:31.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66558d5700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f665015af30 0x7f665015e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53056/0 (socket says 172.21.15.45:53056) 2023-12-19T17:52:31.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66558d5700 1 -- 172.21.15.45:0/1606729062 learned_addr learned my addr 172.21.15.45:0/1606729062 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:31.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66560d6700 1 --2- 172.21.15.45:0/1606729062 >> v2:172.21.15.45:3300/0 conn(0x7f665015ab50 0x7f66500ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66568d7700 1 --2- 172.21.15.45:0/1606729062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665006e0a0 0x7f66500cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66550d4700 1 -- 172.21.15.45:0/1606729062 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2975520862 0 0) 0x7f665006cbb0 con 0x7f665015af30 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66550d4700 1 -- 172.21.15.45:0/1606729062 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f663c0035d0 con 0x7f665015af30 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66560d6700 1 -- 172.21.15.45:0/1606729062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665006e0a0 msgr2=0x7f66500cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66560d6700 1 --2- 172.21.15.45:0/1606729062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665006e0a0 0x7f66500cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66560d6700 1 -- 172.21.15.45:0/1606729062 >> v1:172.21.15.45:6789/0 conn(0x7f665015af30 legacy=0x7f665015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66550d4700 1 -- 172.21.15.45:0/1606729062 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2405753531 0 0) 0x7f663c0035d0 con 0x7f665015af30 2023-12-19T17:52:31.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66560d6700 1 -- 172.21.15.45:0/1606729062 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f665006ffd0 con 0x7f665015ab50 2023-12-19T17:52:31.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66560d6700 1 --2- 172.21.15.45:0/1606729062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665015ab50 0x7f66500ccd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f664c009850 tx=0x7f664c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24caf249fca6906e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66550d4700 1 -- 172.21.15.45:0/1606729062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6640001670 con 0x7f665015ab50 2023-12-19T17:52:31.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66550d4700 1 -- 172.21.15.45:0/1606729062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c004030 con 0x7f665015ab50 2023-12-19T17:52:31.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f66550d4700 1 -- 172.21.15.45:0/1606729062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c0043a0 con 0x7f665015ab50 2023-12-19T17:52:31.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f665833a700 1 -- 172.21.15.45:0/1606729062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665015ab50 msgr2=0x7f66500ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.917+0000 7f665833a700 1 --2- 172.21.15.45:0/1606729062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665015ab50 0x7f66500ccd70 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f664c009850 tx=0x7f664c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:31.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.921+0000 7f665833a700 1 -- 172.21.15.45:0/1606729062 shutdown_connections 2023-12-19T17:52:31.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.921+0000 7f665833a700 1 --2- 172.21.15.45:0/1606729062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665006e0a0 0x7f66500cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.921+0000 7f665833a700 1 --2- 172.21.15.45:0/1606729062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665015ab50 0x7f66500ccd70 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.921+0000 7f665833a700 1 -- 172.21.15.45:0/1606729062 >> 172.21.15.45:0/1606729062 conn(0x7f66500cba40 msgr2=0x7f66500ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.921+0000 7f665833a700 1 -- 172.21.15.45:0/1606729062 shutdown_connections 2023-12-19T17:52:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.921+0000 7f665833a700 1 -- 172.21.15.45:0/1606729062 wait complete. 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 Processor -- start 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 -- start start 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 0x7f665014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665015ab50 0x7f66500b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f665015af30 0x7f66500c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6650150ea0 con 0x7f665006e0a0 2023-12-19T17:52:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66501510f0 con 0x7f665015af30 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f665833a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66501513d0 con 0x7f665015ab50 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 0x7f665014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 0x7f665014faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51316/0 (socket says 172.21.15.45:51316) 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 -- 172.21.15.45:0/1754554703 learned_addr learned my addr 172.21.15.45:0/1754554703 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66558d5700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665015ab50 0x7f66500b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66568d7700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f665015af30 0x7f66500c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 -- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665015ab50 msgr2=0x7f66500b3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665015ab50 0x7f66500b3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 -- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f665015af30 msgr2=0x7f66500c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f665015af30 0x7f66500c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 -- 172.21.15.45:0/1754554703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f664c0094b0 con 0x7f665006e0a0 2023-12-19T17:52:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.925+0000 7f66560d6700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 0x7f665014faa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f664c0090b0 tx=0x7f664c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.929+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c003e30 con 0x7f665006e0a0 2023-12-19T17:52:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.929+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664c01f070 con 0x7f665006e0a0 2023-12-19T17:52:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.929+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664c011870 con 0x7f665006e0a0 2023-12-19T17:52:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.929+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66501516b0 con 0x7f665006e0a0 2023-12-19T17:52:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.929+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665014ffe0 con 0x7f665006e0a0 2023-12-19T17:52:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.929+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6650151bd0 con 0x7f665006e0a0 2023-12-19T17:52:31.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.933+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f664c0119d0 con 0x7f665006e0a0 2023-12-19T17:52:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.933+0000 7f6646ffd700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6634065ad0 0x7f6634067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.933+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f664c021070 con 0x7f665006e0a0 2023-12-19T17:52:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.933+0000 7f66558d5700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6634065ad0 0x7f6634067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:31.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.933+0000 7f66558d5700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6634065ad0 0x7f6634067f90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f66500c7f60 tx=0x7f6640001be0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:31.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:31.937+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6650151bd0 con 0x7f665006e0a0 2023-12-19T17:52:32.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.121+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f665004ed30 con 0x7f665006e0a0 2023-12-19T17:52:32.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.125+0000 7f6646ffd700 1 -- 172.21.15.45:0/1754554703 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f664c02b020 con 0x7f665006e0a0 2023-12-19T17:52:32.127 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:32.127 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6634065ad0 msgr2=0x7f6634067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6634065ad0 0x7f6634067f90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f66500c7f60 tx=0x7f6640001be0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 msgr2=0x7f665014faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 0x7f665014faa0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f664c0090b0 tx=0x7f664c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 shutdown_connections 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6634065ad0 0x7f6634067f90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f665015af30 0x7f66500c9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f665015ab50 0x7f66500b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 --2- 172.21.15.45:0/1754554703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f665006e0a0 0x7f665014faa0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 >> 172.21.15.45:0/1754554703 conn(0x7f66500cba40 msgr2=0x7f6650071080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 shutdown_connections 2023-12-19T17:52:32.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.129+0000 7f665833a700 1 -- 172.21.15.45:0/1754554703 wait complete. 2023-12-19T17:52:32.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:32.154 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.337+0000 7f9942370700 1 Processor -- start 2023-12-19T17:52:32.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.337+0000 7f9942370700 1 -- start start 2023-12-19T17:52:32.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9942370700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0b8580 0x7f993c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9942370700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f993c0d25f0 0x7f993c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9942370700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f993c15d300 con 0x7f993c15cf20 2023-12-19T17:52:32.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9942370700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f993c0d1360 con 0x7f993c0d25f0 2023-12-19T17:52:32.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9942370700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c0d1550 con 0x7f993c0b8580 2023-12-19T17:52:32.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9941b6f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f993c0d25f0 0x7f993c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9940b6d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0b8580 0x7f993c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f994136e700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f993c15cf20 0x7f993c0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48886/0 (socket says 172.21.15.45:48886) 2023-12-19T17:52:32.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f994136e700 1 -- 172.21.15.45:0/141099277 learned_addr learned my addr 172.21.15.45:0/141099277 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:32.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9940b6d700 1 -- 172.21.15.45:0/141099277 >> v2:172.21.15.45:3300/0 conn(0x7f993c0d25f0 msgr2=0x7f993c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:32.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9940b6d700 1 --2- 172.21.15.45:0/141099277 >> v2:172.21.15.45:3300/0 conn(0x7f993c0d25f0 0x7f993c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9940b6d700 1 -- 172.21.15.45:0/141099277 >> v1:172.21.15.73:6789/0 conn(0x7f993c15cf20 legacy=0x7f993c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9940b6d700 1 -- 172.21.15.45:0/141099277 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f993c0d1830 con 0x7f993c0b8580 2023-12-19T17:52:32.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.341+0000 7f9933fff700 1 -- 172.21.15.45:0/141099277 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312200537 0 0) 0x7f993c15d300 con 0x7f993c15cf20 2023-12-19T17:52:32.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9940b6d700 1 --2- 172.21.15.45:0/141099277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0b8580 0x7f993c0cd8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f992c009850 tx=0x7f992c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0eba3e238fcc7fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:32.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9933fff700 1 -- 172.21.15.45:0/141099277 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c011830 con 0x7f993c0b8580 2023-12-19T17:52:32.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9933fff700 1 -- 172.21.15.45:0/141099277 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c011990 con 0x7f993c0b8580 2023-12-19T17:52:32.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9933fff700 1 -- 172.21.15.45:0/141099277 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c011d40 con 0x7f993c0b8580 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 -- 172.21.15.45:0/141099277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0b8580 msgr2=0x7f993c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 --2- 172.21.15.45:0/141099277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0b8580 0x7f993c0cd8c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f992c009850 tx=0x7f992c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 -- 172.21.15.45:0/141099277 shutdown_connections 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 --2- 172.21.15.45:0/141099277 >> v2:172.21.15.45:3300/0 conn(0x7f993c0d25f0 0x7f993c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 --2- 172.21.15.45:0/141099277 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0b8580 0x7f993c0cd8c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 -- 172.21.15.45:0/141099277 >> 172.21.15.45:0/141099277 conn(0x7f993c0b4670 msgr2=0x7f993c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:32.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 -- 172.21.15.45:0/141099277 shutdown_connections 2023-12-19T17:52:32.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.345+0000 7f9942370700 1 -- 172.21.15.45:0/141099277 wait complete. 2023-12-19T17:52:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.349+0000 7f9942370700 1 Processor -- start 2023-12-19T17:52:32.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.349+0000 7f9942370700 1 -- start start 2023-12-19T17:52:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f993c0b8580 0x7f993c0b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0d25f0 0x7f993c15f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993c15cf20 0x7f993c15fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c1f6c70 con 0x7f993c15cf20 2023-12-19T17:52:32.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f993c1602c0 con 0x7f993c0b8580 2023-12-19T17:52:32.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f993c156c30 con 0x7f993c0d25f0 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9941b6f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993c15cf20 0x7f993c15fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9941b6f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993c15cf20 0x7f993c15fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51332/0 (socket says 172.21.15.45:51332) 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9941b6f700 1 -- 172.21.15.45:0/173080174 learned_addr learned my addr 172.21.15.45:0/173080174 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0d25f0 0x7f993c15f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f994136e700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f993c0b8580 0x7f993c0b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 -- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f993c0b8580 msgr2=0x7f993c0b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f993c0b8580 0x7f993c0b2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 -- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993c15cf20 msgr2=0x7f993c15fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993c15cf20 0x7f993c15fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 -- 172.21.15.45:0/173080174 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c0094b0 con 0x7f993c0d25f0 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9940b6d700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0d25f0 0x7f993c15f840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f992c016000 tx=0x7f992c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c019980 con 0x7f993c0d25f0 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c01e070 con 0x7f993c0d25f0 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c019d60 con 0x7f993c0d25f0 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993c1f7090 con 0x7f993c0d25f0 2023-12-19T17:52:32.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.353+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f993c160510 con 0x7f993c0d25f0 2023-12-19T17:52:32.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.357+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993c1f6db0 con 0x7f993c0d25f0 2023-12-19T17:52:32.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.357+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f992c01a420 con 0x7f993c0d25f0 2023-12-19T17:52:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.361+0000 7f9931ffb700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9920065b20 0x7f9920067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.361+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f992c0844c0 con 0x7f993c0d25f0 2023-12-19T17:52:32.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.361+0000 7f994136e700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9920065b20 0x7f9920067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.361+0000 7f994136e700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9920065b20 0x7f9920067fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9938000f60 tx=0x7f9938007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:32.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.369+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f993c1f6db0 con 0x7f993c0d25f0 2023-12-19T17:52:32.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.549+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f993c1f6db0 con 0x7f993c0d25f0 2023-12-19T17:52:32.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.549+0000 7f9931ffb700 1 -- 172.21.15.45:0/173080174 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f993c1f6db0 con 0x7f993c0d25f0 2023-12-19T17:52:32.553 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9920065b20 msgr2=0x7f9920067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9920065b20 0x7f9920067fe0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9938000f60 tx=0x7f9938007e00 comp rx=0 tx=0).stop 2023-12-19T17:52:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0d25f0 msgr2=0x7f993c15f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0d25f0 0x7f993c15f840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f992c016000 tx=0x7f992c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:32.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 shutdown_connections 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9920065b20 0x7f9920067fe0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f993c15cf20 0x7f993c15fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f993c0d25f0 0x7f993c15f840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 --2- 172.21.15.45:0/173080174 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f993c0b8580 0x7f993c0b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 >> 172.21.15.45:0/173080174 conn(0x7f993c0b4670 msgr2=0x7f993c15c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 shutdown_connections 2023-12-19T17:52:32.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.553+0000 7f9942370700 1 -- 172.21.15.45:0/173080174 wait complete. 2023-12-19T17:52:32.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.797+0000 7f2ffd082700 1 Processor -- start 2023-12-19T17:52:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.797+0000 7f2ffd082700 1 -- start start 2023-12-19T17:52:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ffd082700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ff815d090 0x7f2ff80d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ffd082700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80d10e0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ffd082700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80d13c0 con 0x7f2ff80cff40 2023-12-19T17:52:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ffd082700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80b6040 con 0x7f2ff815d090 2023-12-19T17:52:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ff659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2ff80cdff0 0x7f2ff80cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53060/0 (socket says 172.21.15.45:53060) 2023-12-19T17:52:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ff659c700 1 -- 172.21.15.45:0/1327518489 learned_addr learned my addr 172.21.15.45:0/1327518489 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.801+0000 7f2ff6d9d700 1 --2- 172.21.15.45:0/1327518489 >> v2:172.21.15.45:3300/0 conn(0x7f2ff815d090 0x7f2ff80d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff5d9b700 1 -- 172.21.15.45:0/1327518489 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416259838 0 0) 0x7f2ff80d10e0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff5d9b700 1 -- 172.21.15.45:0/1327518489 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fe00035d0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/1327518489 >> v1:172.21.15.73:6789/0 conn(0x7f2ff80cff40 legacy=0x7f2ff80b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/1327518489 >> v1:172.21.15.45:6789/0 conn(0x7f2ff80cdff0 legacy=0x7f2ff80cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/1327518489 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80d16a0 con 0x7f2ff815d090 2023-12-19T17:52:32.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff6d9d700 1 --2- 172.21.15.45:0/1327518489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff815d090 0x7f2ff80d0a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009850 tx=0x7f2fe8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a143a9363d2c58a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff5d9b700 1 -- 172.21.15.45:0/1327518489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011830 con 0x7f2ff815d090 2023-12-19T17:52:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff5d9b700 1 -- 172.21.15.45:0/1327518489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe8011990 con 0x7f2ff815d090 2023-12-19T17:52:32.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ff5d9b700 1 -- 172.21.15.45:0/1327518489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011d40 con 0x7f2ff815d090 2023-12-19T17:52:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 -- 172.21.15.45:0/1327518489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff815d090 msgr2=0x7f2ff80d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 --2- 172.21.15.45:0/1327518489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff815d090 0x7f2ff80d0a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8009850 tx=0x7f2fe8009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 -- 172.21.15.45:0/1327518489 shutdown_connections 2023-12-19T17:52:32.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 --2- 172.21.15.45:0/1327518489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff815d090 0x7f2ff80d0a50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 -- 172.21.15.45:0/1327518489 >> 172.21.15.45:0/1327518489 conn(0x7f2ff80b4b90 msgr2=0x7f2ff80b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 -- 172.21.15.45:0/1327518489 shutdown_connections 2023-12-19T17:52:32.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.805+0000 7f2ffd082700 1 -- 172.21.15.45:0/1327518489 wait complete. 2023-12-19T17:52:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.809+0000 7f2ffd082700 1 Processor -- start 2023-12-19T17:52:32.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.809+0000 7f2ffd082700 1 -- start start 2023-12-19T17:52:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 0x7f2ff8152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ff80cff40 0x7f2ff815e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff815d090 0x7f2ff80c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8152950 con 0x7f2ff80cdff0 2023-12-19T17:52:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815f720 con 0x7f2ff815d090 2023-12-19T17:52:32.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff815e660 con 0x7f2ff80cff40 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 0x7f2ff8152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 0x7f2ff8152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51350/0 (socket says 172.21.15.45:51350) 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/3866030575 learned_addr learned my addr 172.21.15.45:0/3866030575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff659c700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ff80cff40 0x7f2ff815e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff759e700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff815d090 0x7f2ff80c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ff80cff40 msgr2=0x7f2ff815e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ff80cff40 0x7f2ff815e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff815d090 msgr2=0x7f2ff80c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff815d090 0x7f2ff80c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:32.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 -- 172.21.15.45:0/3866030575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fe80094b0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff759e700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff815d090 0x7f2ff80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ff6d9d700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 0x7f2ff8152410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8014040 tx=0x7f2fe8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8019a00 con 0x7f2ff80cdff0 2023-12-19T17:52:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe801e070 con 0x7f2ff80cdff0 2023-12-19T17:52:32.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8019da0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff80c6ea0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.813+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80c7460 con 0x7f2ff80cdff0 2023-12-19T17:52:32.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.817+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff80d0db0 con 0x7f2ff80cdff0 2023-12-19T17:52:32.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.817+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2fe802d430 con 0x7f2ff80cdff0 2023-12-19T17:52:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.821+0000 7f2fdf7fe700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2fe4065b00 0x7f2fe4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:32.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.821+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2fe8084510 con 0x7f2ff80cdff0 2023-12-19T17:52:32.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.821+0000 7f2ff659c700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2fe4065b00 0x7f2fe4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:32.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.821+0000 7f2ff659c700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2fe4065b00 0x7f2fe4067fc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80b8200 tx=0x7f2fec007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:32.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:32.825+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2fe8051b80 con 0x7f2ff80cdff0 2023-12-19T17:52:33.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.001+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2ff804ed30 con 0x7f2ff80cdff0 2023-12-19T17:52:33.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.001+0000 7f2fdf7fe700 1 -- 172.21.15.45:0/3866030575 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fe8006ce0 con 0x7f2ff80cdff0 2023-12-19T17:52:33.004 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2fe4065b00 msgr2=0x7f2fe4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2fe4065b00 0x7f2fe4067fc0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80b8200 tx=0x7f2fec007de0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 msgr2=0x7f2ff8152410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 0x7f2ff8152410 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8014040 tx=0x7f2fe8004770 comp rx=0 tx=0).stop 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 shutdown_connections 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2fe4065b00 0x7f2fe4067fc0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ff815d090 0x7f2ff80c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ff80cff40 0x7f2ff815e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 --2- 172.21.15.45:0/3866030575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ff80cdff0 0x7f2ff8152410 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 >> 172.21.15.45:0/3866030575 conn(0x7f2ff80b4b90 msgr2=0x7f2ff80ce620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 shutdown_connections 2023-12-19T17:52:33.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.005+0000 7f2ffd082700 1 -- 172.21.15.45:0/3866030575 wait complete. 2023-12-19T17:52:33.032 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:33.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.217+0000 7fe8da40a700 1 Processor -- start 2023-12-19T17:52:33.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.217+0000 7fe8da40a700 1 -- start start 2023-12-19T17:52:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8da40a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe8d40cff40 0x7fe8d4167d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8da40a700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40d10e0 con 0x7fe8d415d090 2023-12-19T17:52:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8da40a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8d40d13c0 con 0x7fe8d40d0a50 2023-12-19T17:52:33.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8da40a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8d40b6040 con 0x7fe8d40cff40 2023-12-19T17:52:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8d415d090 0x7fe8d40cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53066/0 (socket says 172.21.15.45:53066) 2023-12-19T17:52:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d3fff700 1 -- 172.21.15.45:0/3043372432 learned_addr learned my addr 172.21.15.45:0/3043372432 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d89a7700 1 --2- 172.21.15.45:0/3043372432 >> v2:172.21.15.45:3300/0 conn(0x7fe8d40cff40 0x7fe8d4167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d89a7700 1 -- 172.21.15.45:0/3043372432 >> v1:172.21.15.73:6789/0 conn(0x7fe8d40d0a50 legacy=0x7fe8d40cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d37fe700 1 -- 172.21.15.45:0/3043372432 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3730777442 0 0) 0x7fe8d40d10e0 con 0x7fe8d415d090 2023-12-19T17:52:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d89a7700 1 -- 172.21.15.45:0/3043372432 >> v1:172.21.15.45:6789/0 conn(0x7fe8d415d090 legacy=0x7fe8d40cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d89a7700 1 -- 172.21.15.45:0/3043372432 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d40d16a0 con 0x7fe8d40cff40 2023-12-19T17:52:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.221+0000 7fe8d89a7700 1 --2- 172.21.15.45:0/3043372432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d4167d30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009d90 tx=0x7fe8cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c85f7c14c9cee7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:33.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8d37fe700 1 -- 172.21.15.45:0/3043372432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00e070 con 0x7fe8d40cff40 2023-12-19T17:52:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8d37fe700 1 -- 172.21.15.45:0/3043372432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8cc00bad0 con 0x7fe8d40cff40 2023-12-19T17:52:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8d37fe700 1 -- 172.21.15.45:0/3043372432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8cc00be80 con 0x7fe8d40cff40 2023-12-19T17:52:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 -- 172.21.15.45:0/3043372432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 msgr2=0x7fe8d4167d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 --2- 172.21.15.45:0/3043372432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d4167d30 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe8cc009d90 tx=0x7fe8cc00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:33.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 -- 172.21.15.45:0/3043372432 shutdown_connections 2023-12-19T17:52:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 --2- 172.21.15.45:0/3043372432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d4167d30 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 -- 172.21.15.45:0/3043372432 >> 172.21.15.45:0/3043372432 conn(0x7fe8d40b4b90 msgr2=0x7fe8d40b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 -- 172.21.15.45:0/3043372432 shutdown_connections 2023-12-19T17:52:33.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 -- 172.21.15.45:0/3043372432 wait complete. 2023-12-19T17:52:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 Processor -- start 2023-12-19T17:52:33.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.225+0000 7fe8da40a700 1 -- start start 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d40cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8d40d0a50 0x7fe8d40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8d415d090 0x7fe8d40c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d415dad0 con 0x7fe8d40cff40 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40c8950 con 0x7fe8d415d090 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8d40c8c30 con 0x7fe8d40d0a50 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d40cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d40cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51364/0 (socket says 172.21.15.45:51364) 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 -- 172.21.15.45:0/609078263 learned_addr learned my addr 172.21.15.45:0/609078263 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d89a7700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8d415d090 0x7fe8d40c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8cbfff700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8d40d0a50 0x7fe8d40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 -- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8d40d0a50 msgr2=0x7fe8d40c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8d40d0a50 0x7fe8d40c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 -- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8d415d090 msgr2=0x7fe8d40c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8d415d090 0x7fe8d40c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 -- 172.21.15.45:0/609078263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8cc009a70 con 0x7fe8d40cff40 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d3fff700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d40cb980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c4e0 tx=0x7fe8c400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4004ca0 con 0x7fe8d40cff40 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8c4004e20 con 0x7fe8d40cff40 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8c4007310 con 0x7fe8d40cff40 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8d40c8f10 con 0x7fe8d40cff40 2023-12-19T17:52:33.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.229+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8d40c94d0 con 0x7fe8d40cff40 2023-12-19T17:52:33.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.233+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8d404ed30 con 0x7fe8d40cff40 2023-12-19T17:52:33.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.233+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8c4007470 con 0x7fe8d40cff40 2023-12-19T17:52:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.233+0000 7fe8d17fa700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8b4065ad0 0x7fe8b4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.237+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe8c40832a0 con 0x7fe8d40cff40 2023-12-19T17:52:33.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.237+0000 7fe8cbfff700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8b4065ad0 0x7fe8b4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.237+0000 7fe8cbfff700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8b4065ad0 0x7fe8b4067f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4148960 tx=0x7fe8bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:33.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.245+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe8c40507f0 con 0x7fe8d40cff40 2023-12-19T17:52:33.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.421+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8d415c8c0 con 0x7fe8d40cff40 2023-12-19T17:52:33.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8d17fa700 1 -- 172.21.15.45:0/609078263 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8c4007720 con 0x7fe8d40cff40 2023-12-19T17:52:33.427 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:33.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8b4065ad0 msgr2=0x7fe8b4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8b4065ad0 0x7fe8b4067f90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe8d4148960 tx=0x7fe8bc009040 comp rx=0 tx=0).stop 2023-12-19T17:52:33.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 msgr2=0x7fe8d40cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d40cb980 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe8c400c4e0 tx=0x7fe8c400c7f0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 shutdown_connections 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8b4065ad0 0x7fe8b4067f90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8d415d090 0x7fe8d40c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8d40d0a50 0x7fe8d40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 --2- 172.21.15.45:0/609078263 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8d40cff40 0x7fe8d40cb980 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 >> 172.21.15.45:0/609078263 conn(0x7fe8d40b4b90 msgr2=0x7fe8d40b7a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.425+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 shutdown_connections 2023-12-19T17:52:33.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.429+0000 7fe8da40a700 1 -- 172.21.15.45:0/609078263 wait complete. 2023-12-19T17:52:33.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:33.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.629+0000 7efe33516700 1 Processor -- start 2023-12-19T17:52:33.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.629+0000 7efe33516700 1 -- start start 2023-12-19T17:52:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe33516700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe2c0cd410 0x7efe2c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe33516700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c0cd8a0 con 0x7efe2c0cb830 2023-12-19T17:52:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe33516700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2c0cdb80 con 0x7efe2c071bf0 2023-12-19T17:52:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe33516700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2c0ce520 con 0x7efe2c0cd410 2023-12-19T17:52:33.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31d13700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe2c0cd410 0x7efe2c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31d13700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe2c0cd410 0x7efe2c0ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51376/0 (socket says 172.21.15.45:51376) 2023-12-19T17:52:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe32d15700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efe2c0cb830 0x7efe2c070190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53068/0 (socket says 172.21.15.45:53068) 2023-12-19T17:52:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31d13700 1 -- 172.21.15.45:0/1102836148 learned_addr learned my addr 172.21.15.45:0/1102836148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:33.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31512700 1 -- 172.21.15.45:0/1102836148 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144687227 0 0) 0x7efe2c0cdb80 con 0x7efe2c071bf0 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31d13700 1 -- 172.21.15.45:0/1102836148 >> v1:172.21.15.73:6789/0 conn(0x7efe2c071bf0 legacy=0x7efe2c0cb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31d13700 1 -- 172.21.15.45:0/1102836148 >> v1:172.21.15.45:6789/0 conn(0x7efe2c0cb830 legacy=0x7efe2c070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.633+0000 7efe31d13700 1 -- 172.21.15.45:0/1102836148 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c0cde60 con 0x7efe2c0cd410 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe31d13700 1 --2- 172.21.15.45:0/1102836148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cd410 0x7efe2c0ce920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009910 tx=0x7efe1c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e0d101fbf33b68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe31512700 1 -- 172.21.15.45:0/1102836148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c004230 con 0x7efe2c0cd410 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe31512700 1 -- 172.21.15.45:0/1102836148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1c004390 con 0x7efe2c0cd410 2023-12-19T17:52:33.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe31512700 1 -- 172.21.15.45:0/1102836148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c009e60 con 0x7efe2c0cd410 2023-12-19T17:52:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 -- 172.21.15.45:0/1102836148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cd410 msgr2=0x7efe2c0ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 --2- 172.21.15.45:0/1102836148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cd410 0x7efe2c0ce920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7efe1c009910 tx=0x7efe1c009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:33.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 -- 172.21.15.45:0/1102836148 shutdown_connections 2023-12-19T17:52:33.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 --2- 172.21.15.45:0/1102836148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cd410 0x7efe2c0ce920 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 -- 172.21.15.45:0/1102836148 >> 172.21.15.45:0/1102836148 conn(0x7efe2c0b13c0 msgr2=0x7efe2c0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:33.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 -- 172.21.15.45:0/1102836148 shutdown_connections 2023-12-19T17:52:33.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.637+0000 7efe33516700 1 -- 172.21.15.45:0/1102836148 wait complete. 2023-12-19T17:52:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 Processor -- start 2023-12-19T17:52:33.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 -- start start 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe2c071bf0 0x7efe2c1601e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 0x7efe2c154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe2c0b4900 0x7efe2c1f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c1f6c50 con 0x7efe2c0cb830 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c155400 con 0x7efe2c071bf0 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe33516700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c06aba0 con 0x7efe2c0b4900 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe31d13700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 0x7efe2c154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe32514700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe2c071bf0 0x7efe2c1601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe31d13700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 0x7efe2c154ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51386/0 (socket says 172.21.15.45:51386) 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe31d13700 1 -- 172.21.15.45:0/3063726241 learned_addr learned my addr 172.21.15.45:0/3063726241 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:33.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.641+0000 7efe32d15700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe2c0b4900 0x7efe2c1f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe32514700 1 -- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe2c0b4900 msgr2=0x7efe2c1f5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe32514700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe2c0b4900 0x7efe2c1f5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe32514700 1 -- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 msgr2=0x7efe2c154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe32514700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 0x7efe2c154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe32514700 1 -- 172.21.15.45:0/3063726241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe1c009570 con 0x7efe2c071bf0 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe31d13700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 0x7efe2c154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe32514700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe2c071bf0 0x7efe2c1601e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe2800c4e0 tx=0x7efe2800c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe280054e0 con 0x7efe2c071bf0 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe280036a0 con 0x7efe2c071bf0 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe28003a50 con 0x7efe2c071bf0 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c06ae40 con 0x7efe2c071bf0 2023-12-19T17:52:33.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c0b50e0 con 0x7efe2c071bf0 2023-12-19T17:52:33.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.645+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c04ed30 con 0x7efe2c071bf0 2023-12-19T17:52:33.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.649+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe28003bb0 con 0x7efe2c071bf0 2023-12-19T17:52:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.649+0000 7efe22ffd700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe10065b00 0x7efe10067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.649+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efe280829c0 con 0x7efe2c071bf0 2023-12-19T17:52:33.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.649+0000 7efe31d13700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe10065b00 0x7efe10067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:33.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.649+0000 7efe31d13700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe10065b00 0x7efe10067fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe1c000c00 tx=0x7efe1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:33.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.657+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efe2804ff00 con 0x7efe2c071bf0 2023-12-19T17:52:33.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.841+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7efe2c0cec40 con 0x7efe2c071bf0 2023-12-19T17:52:33.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe22ffd700 1 -- 172.21.15.45:0/3063726241 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7efe280170a0 con 0x7efe2c071bf0 2023-12-19T17:52:33.847 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe10065b00 msgr2=0x7efe10067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe10065b00 0x7efe10067fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7efe1c000c00 tx=0x7efe1c008030 comp rx=0 tx=0).stop 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe2c071bf0 msgr2=0x7efe2c1601e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe2c071bf0 0x7efe2c1601e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe2800c4e0 tx=0x7efe2800c7f0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 shutdown_connections 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe10065b00 0x7efe10067fc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe2c0b4900 0x7efe2c1f5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe2c0cb830 0x7efe2c154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 --2- 172.21.15.45:0/3063726241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe2c071bf0 0x7efe2c1601e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.845+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 >> 172.21.15.45:0/3063726241 conn(0x7efe2c0b13c0 msgr2=0x7efe2c0b17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.849+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 shutdown_connections 2023-12-19T17:52:33.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:33.849+0000 7efe33516700 1 -- 172.21.15.45:0/3063726241 wait complete. 2023-12-19T17:52:33.884 INFO:tasks.cephfs_test_runner:Starting test: test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T17:52:33.885 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files' 2023-12-19T17:52:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.061+0000 7fb6fa724700 1 Processor -- start 2023-12-19T17:52:34.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6fa724700 1 -- start start 2023-12-19T17:52:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6fa724700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb6f41659f0 0x7fb6f4167de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6fa724700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40d1820 con 0x7fb6f406ea90 2023-12-19T17:52:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6fa724700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f40d1b00 con 0x7fb6f40b88b0 2023-12-19T17:52:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6fa724700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f40d1630 con 0x7fb6f41659f0 2023-12-19T17:52:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6f9722700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb6f406ea90 0x7fb6f40d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53076/0 (socket says 172.21.15.45:53076) 2023-12-19T17:52:34.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6f9722700 1 -- 172.21.15.45:0/1860102976 learned_addr learned my addr 172.21.15.45:0/1860102976 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6f9f23700 1 --2- 172.21.15.45:0/1860102976 >> v2:172.21.15.45:3300/0 conn(0x7fb6f41659f0 0x7fb6f4167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4040717233 0 0) 0x7fb6f40d1820 con 0x7fb6f406ea90 2023-12-19T17:52:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6e00035d0 con 0x7fb6f406ea90 2023-12-19T17:52:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867395729 0 0) 0x7fb6f40d1b00 con 0x7fb6f40b88b0 2023-12-19T17:52:34.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6f40d1820 con 0x7fb6f40b88b0 2023-12-19T17:52:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6f9f23700 1 -- 172.21.15.45:0/1860102976 >> v1:172.21.15.73:6789/0 conn(0x7fb6f40b88b0 legacy=0x7fb6f406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2532320797 0 0) 0x7fb6e00035d0 con 0x7fb6f406ea90 2023-12-19T17:52:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.065+0000 7fb6f9f23700 1 -- 172.21.15.45:0/1860102976 >> v1:172.21.15.45:6789/0 conn(0x7fb6f406ea90 legacy=0x7fb6f40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6f9f23700 1 -- 172.21.15.45:0/1860102976 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f40d1de0 con 0x7fb6f41659f0 2023-12-19T17:52:34.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6f9f23700 1 --2- 172.21.15.45:0/1860102976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f4167de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009d90 tx=0x7fb6ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8442614c36354f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec00e070 con 0x7fb6f41659f0 2023-12-19T17:52:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec003a40 con 0x7fb6f41659f0 2023-12-19T17:52:34.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6ebfff700 1 -- 172.21.15.45:0/1860102976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0001670 con 0x7fb6f41659f0 2023-12-19T17:52:34.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 -- 172.21.15.45:0/1860102976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 msgr2=0x7fb6f4167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 --2- 172.21.15.45:0/1860102976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f4167de0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec009d90 tx=0x7fb6ec00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:34.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 -- 172.21.15.45:0/1860102976 shutdown_connections 2023-12-19T17:52:34.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 --2- 172.21.15.45:0/1860102976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f4167de0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 -- 172.21.15.45:0/1860102976 >> 172.21.15.45:0/1860102976 conn(0x7fb6f40b46d0 msgr2=0x7fb6f40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 -- 172.21.15.45:0/1860102976 shutdown_connections 2023-12-19T17:52:34.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.069+0000 7fb6fa724700 1 -- 172.21.15.45:0/1860102976 wait complete. 2023-12-19T17:52:34.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.073+0000 7fb6fa724700 1 Processor -- start 2023-12-19T17:52:34.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.073+0000 7fb6fa724700 1 -- start start 2023-12-19T17:52:34.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f406ea90 0x7fb6f415dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f40b88b0 0x7fb6f41583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f40c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f40ca090 con 0x7fb6f41659f0 2023-12-19T17:52:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4158ed0 con 0x7fb6f40b88b0 2023-12-19T17:52:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f4158bf0 con 0x7fb6f406ea90 2023-12-19T17:52:34.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f40c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9722700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f406ea90 0x7fb6f415dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f40c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51418/0 (socket says 172.21.15.45:51418) 2023-12-19T17:52:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 -- 172.21.15.45:0/2776497220 learned_addr learned my addr 172.21.15.45:0/2776497220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f8f21700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f40b88b0 0x7fb6f41583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 -- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f406ea90 msgr2=0x7fb6f415dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f406ea90 0x7fb6f415dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 -- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f40b88b0 msgr2=0x7fb6f41583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f40b88b0 0x7fb6f41583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 -- 172.21.15.45:0/2776497220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec009a70 con 0x7fb6f41659f0 2023-12-19T17:52:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9722700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f406ea90 0x7fb6f415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:34.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6f9f23700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f40c8720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec004000 tx=0x7fb6ec004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:34.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004440 con 0x7fb6f41659f0 2023-12-19T17:52:34.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0045a0 con 0x7fb6f41659f0 2023-12-19T17:52:34.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f415c5b0 con 0x7fb6f41659f0 2023-12-19T17:52:34.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004910 con 0x7fb6f41659f0 2023-12-19T17:52:34.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.077+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f40c9cb0 con 0x7fb6f41659f0 2023-12-19T17:52:34.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.081+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f40ca1d0 con 0x7fb6f41659f0 2023-12-19T17:52:34.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.081+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb6ec01d470 con 0x7fb6f41659f0 2023-12-19T17:52:34.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.081+0000 7fb6e9ffb700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb6d8065ad0 0x7fb6d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.081+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb6ec0852c0 con 0x7fb6f41659f0 2023-12-19T17:52:34.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.085+0000 7fb6f9722700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb6d8065ad0 0x7fb6d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.085+0000 7fb6f9722700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb6d8065ad0 0x7fb6d8067f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0007fd0 tx=0x7fb6f0007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:34.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.089+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb6f40ca1d0 con 0x7fb6f41659f0 2023-12-19T17:52:34.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.333+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files"]} v 0) v1 -- 0x7fb6f40ca1d0 con 0x7fb6f41659f0 2023-12-19T17:52:34.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.637+0000 7fb6e9ffb700 1 -- 172.21.15.45:0/2776497220 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files"]}]=0 v73) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb6f40ca1d0 con 0x7fb6f41659f0 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb6d8065ad0 msgr2=0x7fb6d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb6d8065ad0 0x7fb6d8067f90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0007fd0 tx=0x7fb6f0007c00 comp rx=0 tx=0).stop 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 msgr2=0x7fb6f40c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f40c8720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec004000 tx=0x7fb6ec004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 shutdown_connections 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb6d8065ad0 0x7fb6d8067f90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb6f41659f0 0x7fb6f40c8720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb6f40b88b0 0x7fb6f41583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 --2- 172.21.15.45:0/2776497220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb6f406ea90 0x7fb6f415dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 >> 172.21.15.45:0/2776497220 conn(0x7fb6f40b46d0 msgr2=0x7fb6f40b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:34.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 shutdown_connections 2023-12-19T17:52:34.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.641+0000 7fb6fa724700 1 -- 172.21.15.45:0/2776497220 wait complete. 2023-12-19T17:52:34.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T17:52:34.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.861+0000 7fe3e759e700 1 Processor -- start 2023-12-19T17:52:34.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.861+0000 7fe3e759e700 1 -- start start 2023-12-19T17:52:34.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe3e80b8580 0x7fe3e80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e815d300 con 0x7fe3e80d25f0 2023-12-19T17:52:34.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e80d1550 con 0x7fe3e815cf20 2023-12-19T17:52:34.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e80d1360 con 0x7fe3e80b8580 2023-12-19T17:52:34.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e6d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe3e80d25f0 0x7fe3e80b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53080/0 (socket says 172.21.15.45:53080) 2023-12-19T17:52:34.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e6d9d700 1 -- 172.21.15.45:0/81442582 learned_addr learned my addr 172.21.15.45:0/81442582 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:34.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e5d9b700 1 --2- 172.21.15.45:0/81442582 >> v2:172.21.15.73:3300/0 conn(0x7fe3e80b8580 0x7fe3e80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.865+0000 7fe3e559a700 1 -- 172.21.15.45:0/81442582 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922027035 0 0) 0x7fe3e815d300 con 0x7fe3e80d25f0 2023-12-19T17:52:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e559a700 1 -- 172.21.15.45:0/81442582 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3d00035d0 con 0x7fe3e80d25f0 2023-12-19T17:52:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/81442582 >> v1:172.21.15.73:6789/0 conn(0x7fe3e815cf20 legacy=0x7fe3e80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e559a700 1 -- 172.21.15.45:0/81442582 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1860203286 0 0) 0x7fe3e80d1550 con 0x7fe3e815cf20 2023-12-19T17:52:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/81442582 >> v1:172.21.15.45:6789/0 conn(0x7fe3e80d25f0 legacy=0x7fe3e80b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/81442582 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e80d1830 con 0x7fe3e80b8580 2023-12-19T17:52:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e5d9b700 1 --2- 172.21.15.45:0/81442582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e80b8580 0x7fe3e80cd8c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009850 tx=0x7fe3dc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27f9bb1258eaf581 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e559a700 1 -- 172.21.15.45:0/81442582 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc011830 con 0x7fe3e80b8580 2023-12-19T17:52:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e559a700 1 -- 172.21.15.45:0/81442582 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc011990 con 0x7fe3e80b8580 2023-12-19T17:52:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e559a700 1 -- 172.21.15.45:0/81442582 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc011d40 con 0x7fe3e80b8580 2023-12-19T17:52:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 -- 172.21.15.45:0/81442582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e80b8580 msgr2=0x7fe3e80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 --2- 172.21.15.45:0/81442582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e80b8580 0x7fe3e80cd8c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009850 tx=0x7fe3dc009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 -- 172.21.15.45:0/81442582 shutdown_connections 2023-12-19T17:52:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 --2- 172.21.15.45:0/81442582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e80b8580 0x7fe3e80cd8c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 -- 172.21.15.45:0/81442582 >> 172.21.15.45:0/81442582 conn(0x7fe3e80b4670 msgr2=0x7fe3e80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:34.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 -- 172.21.15.45:0/81442582 shutdown_connections 2023-12-19T17:52:34.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.869+0000 7fe3e759e700 1 -- 172.21.15.45:0/81442582 wait complete. 2023-12-19T17:52:34.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.873+0000 7fe3e759e700 1 Processor -- start 2023-12-19T17:52:34.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.873+0000 7fe3e759e700 1 -- start start 2023-12-19T17:52:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3e80b8580 0x7fe3e80b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 0x7fe3e80cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e815cf20 0x7fe3e80b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e815a9d0 con 0x7fe3e80d25f0 2023-12-19T17:52:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e81f24b0 con 0x7fe3e815cf20 2023-12-19T17:52:34.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e80b4180 con 0x7fe3e80b8580 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 0x7fe3e80cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 0x7fe3e80cc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51428/0 (socket says 172.21.15.45:51428) 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/197958664 learned_addr learned my addr 172.21.15.45:0/197958664 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e659c700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3e80b8580 0x7fe3e80b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e6d9d700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e815cf20 0x7fe3e80b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3e80b8580 msgr2=0x7fe3e80b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3e80b8580 0x7fe3e80b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e815cf20 msgr2=0x7fe3e80b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e815cf20 0x7fe3e80b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 -- 172.21.15.45:0/197958664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3dc0094b0 con 0x7fe3e80d25f0 2023-12-19T17:52:34.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e5d9b700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 0x7fe3e80cc580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009eb0 tx=0x7fe3dc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc01aaf0 con 0x7fe3e80d25f0 2023-12-19T17:52:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3dc01f070 con 0x7fe3e80d25f0 2023-12-19T17:52:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3dc01ae90 con 0x7fe3e80d25f0 2023-12-19T17:52:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e815e8e0 con 0x7fe3e80d25f0 2023-12-19T17:52:34.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.877+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e815eea0 con 0x7fe3e80d25f0 2023-12-19T17:52:34.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.881+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e81f2630 con 0x7fe3e80d25f0 2023-12-19T17:52:34.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.881+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe3dc01b430 con 0x7fe3e80d25f0 2023-12-19T17:52:34.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.885+0000 7fe3d6ffd700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3c8065b00 0x7fe3c8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:34.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.885+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe3dc084680 con 0x7fe3e80d25f0 2023-12-19T17:52:34.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.885+0000 7fe3e659c700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3c8065b00 0x7fe3c8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:34.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.885+0000 7fe3e659c700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3c8065b00 0x7fe3c8067fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000f60 tx=0x7fe3d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:34.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:34.889+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe3e81f2630 con 0x7fe3e80d25f0 2023-12-19T17:52:35.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.073+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe3e81f2630 con 0x7fe3e80d25f0 2023-12-19T17:52:35.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.077+0000 7fe3d6ffd700 1 -- 172.21.15.45:0/197958664 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe3e81f2630 con 0x7fe3e80d25f0 2023-12-19T17:52:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3c8065b00 msgr2=0x7fe3c8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3c8065b00 0x7fe3c8067fc0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe3d8000f60 tx=0x7fe3d8009040 comp rx=0 tx=0).stop 2023-12-19T17:52:35.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 msgr2=0x7fe3e80cc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 0x7fe3e80cc580 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe3dc009eb0 tx=0x7fe3dc004770 comp rx=0 tx=0).stop 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 shutdown_connections 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe3c8065b00 0x7fe3c8067fc0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe3e815cf20 0x7fe3e80b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe3e80d25f0 0x7fe3e80cc580 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 --2- 172.21.15.45:0/197958664 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe3e80b8580 0x7fe3e80b0fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 >> 172.21.15.45:0/197958664 conn(0x7fe3e80b4670 msgr2=0x7fe3e80b6220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 shutdown_connections 2023-12-19T17:52:35.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.081+0000 7fe3e759e700 1 -- 172.21.15.45:0/197958664 wait complete. 2023-12-19T17:52:35.106 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T17:52:35.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:52:35.154 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:52:35.198 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T17:52:35.198 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:52:35.198 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:35.221 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:52:35.221 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:35.275 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:35.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 Processor -- start 2023-12-19T17:52:35.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 -- start start 2023-12-19T17:52:35.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4741615a0 0x7ff4740c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4740af720 0x7ff4740afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4740c3f90 con 0x7ff4741611c0 2023-12-19T17:52:35.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4740b00f0 con 0x7ff4741615a0 2023-12-19T17:52:35.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff474070340 con 0x7ff4740af720 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff4741611c0 0x7ff47406d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53088/0 (socket says 172.21.15.45:53088) 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff47259c700 1 -- 172.21.15.45:0/2509544153 learned_addr learned my addr 172.21.15.45:0/2509544153 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff471d9b700 1 --2- 172.21.15.45:0/2509544153 >> v2:172.21.15.73:3300/0 conn(0x7ff4741615a0 0x7ff4740c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.501+0000 7ff472d9d700 1 --2- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4740af720 0x7ff4740afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47159a700 1 -- 172.21.15.45:0/2509544153 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3431956465 0 0) 0x7ff4740c3f90 con 0x7ff4741611c0 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47159a700 1 -- 172.21.15.45:0/2509544153 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff45c0035d0 con 0x7ff4741611c0 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff471d9b700 1 -- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4740af720 msgr2=0x7ff4740afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff471d9b700 1 --2- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4740af720 0x7ff4740afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff471d9b700 1 -- 172.21.15.45:0/2509544153 >> v1:172.21.15.45:6789/0 conn(0x7ff4741611c0 legacy=0x7ff47406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff471d9b700 1 -- 172.21.15.45:0/2509544153 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4740c4270 con 0x7ff4741615a0 2023-12-19T17:52:35.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff471d9b700 1 --2- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741615a0 0x7ff4740c3920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff468009850 tx=0x7ff468009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b443565c90aff1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:35.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47159a700 1 -- 172.21.15.45:0/2509544153 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468011830 con 0x7ff4741615a0 2023-12-19T17:52:35.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47159a700 1 -- 172.21.15.45:0/2509544153 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff468011990 con 0x7ff4741615a0 2023-12-19T17:52:35.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47159a700 1 -- 172.21.15.45:0/2509544153 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff468011d40 con 0x7ff4741615a0 2023-12-19T17:52:35.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 -- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741615a0 msgr2=0x7ff4740c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 --2- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741615a0 0x7ff4740c3920 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff468009850 tx=0x7ff468009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:35.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 -- 172.21.15.45:0/2509544153 shutdown_connections 2023-12-19T17:52:35.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 --2- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4740af720 0x7ff4740afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 --2- 172.21.15.45:0/2509544153 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741615a0 0x7ff4740c3920 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 -- 172.21.15.45:0/2509544153 >> 172.21.15.45:0/2509544153 conn(0x7ff4740cb900 msgr2=0x7ff4740b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:35.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 -- 172.21.15.45:0/2509544153 shutdown_connections 2023-12-19T17:52:35.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.505+0000 7ff47359e700 1 -- 172.21.15.45:0/2509544153 wait complete. 2023-12-19T17:52:35.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.509+0000 7ff47359e700 1 Processor -- start 2023-12-19T17:52:35.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.509+0000 7ff47359e700 1 -- start start 2023-12-19T17:52:35.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 0x7ff474152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741611c0 0x7ff4741642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4741615a0 0x7ff47415f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741f68b0 con 0x7ff4740af720 2023-12-19T17:52:35.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741f6b20 con 0x7ff4741611c0 2023-12-19T17:52:35.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4741f6e00 con 0x7ff4741615a0 2023-12-19T17:52:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 0x7ff474152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 0x7ff474152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51444/0 (socket says 172.21.15.45:51444) 2023-12-19T17:52:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 -- 172.21.15.45:0/50274303 learned_addr learned my addr 172.21.15.45:0/50274303 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff471d9b700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741611c0 0x7ff4741642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff472d9d700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4741615a0 0x7ff47415f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 -- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4741615a0 msgr2=0x7ff47415f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4741615a0 0x7ff47415f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 -- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741611c0 msgr2=0x7ff4741642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741611c0 0x7ff4741642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 -- 172.21.15.45:0/50274303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4680094b0 con 0x7ff4740af720 2023-12-19T17:52:35.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff47259c700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 0x7ff474152d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c700 tx=0x7ff46400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:35.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.513+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464005d90 con 0x7ff4740af720 2023-12-19T17:52:35.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.517+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4640070d0 con 0x7ff4740af720 2023-12-19T17:52:35.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.517+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4741f70e0 con 0x7ff4740af720 2023-12-19T17:52:35.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.517+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff464007480 con 0x7ff4740af720 2023-12-19T17:52:35.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.517+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4741f76a0 con 0x7ff4740af720 2023-12-19T17:52:35.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.517+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47406e760 con 0x7ff4740af720 2023-12-19T17:52:35.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.521+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4640075e0 con 0x7ff4740af720 2023-12-19T17:52:35.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.521+0000 7ff462ffd700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff454065b20 0x7ff454067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.521+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff464082970 con 0x7ff4740af720 2023-12-19T17:52:35.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.521+0000 7ff471d9b700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff454065b20 0x7ff454067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.521+0000 7ff471d9b700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff454065b20 0x7ff454067fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff468009850 tx=0x7ff468008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:35.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.529+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff46404ffc0 con 0x7ff4740af720 2023-12-19T17:52:35.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.709+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4740b0ea0 con 0x7ff4740af720 2023-12-19T17:52:35.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.709+0000 7ff462ffd700 1 -- 172.21.15.45:0/50274303 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7ff464017090 con 0x7ff4740af720 2023-12-19T17:52:35.715 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:35.715 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:35.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff454065b20 msgr2=0x7ff454067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff454065b20 0x7ff454067fe0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff468009850 tx=0x7ff468008030 comp rx=0 tx=0).stop 2023-12-19T17:52:35.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 msgr2=0x7ff474152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 0x7ff474152d30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff46400c700 tx=0x7ff46400ca10 comp rx=0 tx=0).stop 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 shutdown_connections 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff454065b20 0x7ff454067fe0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4741615a0 0x7ff47415f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4741611c0 0x7ff4741642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 --2- 172.21.15.45:0/50274303 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4740af720 0x7ff474152d30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 >> 172.21.15.45:0/50274303 conn(0x7ff4740cb900 msgr2=0x7ff47415cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 shutdown_connections 2023-12-19T17:52:35.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.713+0000 7ff47359e700 1 -- 172.21.15.45:0/50274303 wait complete. 2023-12-19T17:52:35.741 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:35.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:35.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.929+0000 7f94260d3700 1 Processor -- start 2023-12-19T17:52:35.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.929+0000 7f94260d3700 1 -- start start 2023-12-19T17:52:35.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94260d3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f942015cf20 0x7f94200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94260d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94200b8580 0x7f94200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94260d3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f942015d300 con 0x7f94200d25f0 2023-12-19T17:52:35.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94260d3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94200d1550 con 0x7f942015cf20 2023-12-19T17:52:35.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94260d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94200d1830 con 0x7f94200b8580 2023-12-19T17:52:35.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94250d1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f942015cf20 0x7f94200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94248d0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94200b8580 0x7f94200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94250d1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f942015cf20 0x7f94200d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:43398/0 (socket says 172.21.15.45:43398) 2023-12-19T17:52:35.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94258d2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f94200d25f0 0x7f942006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53094/0 (socket says 172.21.15.45:53094) 2023-12-19T17:52:35.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.933+0000 7f94250d1700 1 -- 172.21.15.45:0/660499042 learned_addr learned my addr 172.21.15.45:0/660499042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:35.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94250d1700 1 -- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94200b8580 msgr2=0x7f94200cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:35.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94250d1700 1 --2- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94200b8580 0x7f94200cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94250d1700 1 -- 172.21.15.45:0/660499042 >> v1:172.21.15.45:6789/0 conn(0x7f94200d25f0 legacy=0x7f942006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94250d1700 1 -- 172.21.15.45:0/660499042 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94200d1b10 con 0x7f942015cf20 2023-12-19T17:52:35.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94250d1700 1 --2- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f942015cf20 0x7f94200d0c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f941c009910 tx=0x7f941c009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f599c60aaed9b52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:35.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f9417fff700 1 -- 172.21.15.45:0/660499042 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011830 con 0x7f942015cf20 2023-12-19T17:52:35.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f9417fff700 1 -- 172.21.15.45:0/660499042 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c011990 con 0x7f942015cf20 2023-12-19T17:52:35.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f9417fff700 1 -- 172.21.15.45:0/660499042 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c011d40 con 0x7f942015cf20 2023-12-19T17:52:35.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 -- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f942015cf20 msgr2=0x7f94200d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 --2- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f942015cf20 0x7f94200d0c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f941c009910 tx=0x7f941c009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:35.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 -- 172.21.15.45:0/660499042 shutdown_connections 2023-12-19T17:52:35.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 --2- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94200b8580 0x7f94200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 --2- 172.21.15.45:0/660499042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f942015cf20 0x7f94200d0c50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 -- 172.21.15.45:0/660499042 >> 172.21.15.45:0/660499042 conn(0x7f94200b4670 msgr2=0x7f94200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:35.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 -- 172.21.15.45:0/660499042 shutdown_connections 2023-12-19T17:52:35.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.937+0000 7f94260d3700 1 -- 172.21.15.45:0/660499042 wait complete. 2023-12-19T17:52:35.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 Processor -- start 2023-12-19T17:52:35.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 -- start start 2023-12-19T17:52:35.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 0x7f94201f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94200d25f0 0x7f942015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f942015cf20 0x7f942015f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942015de40 con 0x7f94200b8580 2023-12-19T17:52:35.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f942015e120 con 0x7f94200d25f0 2023-12-19T17:52:35.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.941+0000 7f94260d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f942015e400 con 0x7f942015cf20 2023-12-19T17:52:35.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 0x7f94201f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 0x7f94201f1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51454/0 (socket says 172.21.15.45:51454) 2023-12-19T17:52:35.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 -- 172.21.15.45:0/1946240501 learned_addr learned my addr 172.21.15.45:0/1946240501 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:35.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94248d0700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94200d25f0 0x7f942015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 -- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f942015cf20 msgr2=0x7f942015f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94258d2700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f942015cf20 0x7f942015f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f942015cf20 0x7f942015f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 -- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94200d25f0 msgr2=0x7f942015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94200d25f0 0x7f942015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 -- 172.21.15.45:0/1946240501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c009570 con 0x7f94200b8580 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94248d0700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94200d25f0 0x7f942015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94258d2700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f942015cf20 0x7f942015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94250d1700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 0x7f94201f1e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f941c000c00 tx=0x7f941c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c004610 con 0x7f94200b8580 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941c0036c0 con 0x7f94200b8580 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f942015e6e0 con 0x7f94200b8580 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941c003a50 con 0x7f94200b8580 2023-12-19T17:52:35.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.945+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94201f2350 con 0x7f94200b8580 2023-12-19T17:52:35.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.949+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94200c9c30 con 0x7f94200b8580 2023-12-19T17:52:35.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.949+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f941c003bb0 con 0x7f94200b8580 2023-12-19T17:52:35.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.949+0000 7f9415ffb700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9404065ad0 0x7f9404067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:35.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.949+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f941c021030 con 0x7f94200b8580 2023-12-19T17:52:35.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.949+0000 7f94248d0700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9404065ad0 0x7f9404067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:35.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.953+0000 7f94248d0700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9404065ad0 0x7f9404067f90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f942015eec0 tx=0x7f9410008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:35.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:35.957+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f941c0522c0 con 0x7f94200b8580 2023-12-19T17:52:36.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.133+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f942004ed30 con 0x7f94200b8580 2023-12-19T17:52:36.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.133+0000 7f9415ffb700 1 -- 172.21.15.45:0/1946240501 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f941c003e60 con 0x7f94200b8580 2023-12-19T17:52:36.138 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9404065ad0 msgr2=0x7f9404067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9404065ad0 0x7f9404067f90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f942015eec0 tx=0x7f9410008040 comp rx=0 tx=0).stop 2023-12-19T17:52:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 msgr2=0x7f94201f1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 0x7f94201f1e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f941c000c00 tx=0x7f941c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 shutdown_connections 2023-12-19T17:52:36.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9404065ad0 0x7f9404067f90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f942015cf20 0x7f942015f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94200d25f0 0x7f942015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 --2- 172.21.15.45:0/1946240501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94200b8580 0x7f94201f1e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 >> 172.21.15.45:0/1946240501 conn(0x7f94200b4670 msgr2=0x7f94200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 shutdown_connections 2023-12-19T17:52:36.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.137+0000 7f94260d3700 1 -- 172.21.15.45:0/1946240501 wait complete. 2023-12-19T17:52:36.160 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:36.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.345+0000 7ff990ed8700 1 Processor -- start 2023-12-19T17:52:36.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.345+0000 7ff990ed8700 1 -- start start 2023-12-19T17:52:36.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff990ed8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff98c15d090 0x7ff98c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff990ed8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c0cdff0 0x7ff98c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff990ed8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff98c0d01e0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff990ed8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff98c0b6040 con 0x7ff98c15d090 2023-12-19T17:52:36.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff990ed8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c0d10e0 con 0x7ff98c0cdff0 2023-12-19T17:52:36.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff98a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff98c15d090 0x7ff98c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff989d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c0cdff0 0x7ff98c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff98ad9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff98c0cfd70 0x7ff98c06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48942/0 (socket says 172.21.15.45:48942) 2023-12-19T17:52:36.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff98ad9d700 1 -- 172.21.15.45:0/1012185836 learned_addr learned my addr 172.21.15.45:0/1012185836 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:36.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff98959a700 1 -- 172.21.15.45:0/1012185836 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273727326 0 0) 0x7ff984001490 con 0x7ff98c0cfd70 2023-12-19T17:52:36.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff98959a700 1 -- 172.21.15.45:0/1012185836 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9740035d0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff989d9b700 1 -- 172.21.15.45:0/1012185836 >> v2:172.21.15.45:3300/0 conn(0x7ff98c15d090 msgr2=0x7ff98c0d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:36.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff989d9b700 1 --2- 172.21.15.45:0/1012185836 >> v2:172.21.15.45:3300/0 conn(0x7ff98c15d090 0x7ff98c0d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff989d9b700 1 -- 172.21.15.45:0/1012185836 >> v1:172.21.15.73:6789/0 conn(0x7ff98c0cfd70 legacy=0x7ff98c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.349+0000 7ff989d9b700 1 -- 172.21.15.45:0/1012185836 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c0d13c0 con 0x7ff98c0cdff0 2023-12-19T17:52:36.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff989d9b700 1 --2- 172.21.15.45:0/1012185836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c0cdff0 0x7ff98c0cf830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff980009850 tx=0x7ff980009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8cb61f01e1508e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:36.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff98959a700 1 -- 172.21.15.45:0/1012185836 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980011830 con 0x7ff98c0cdff0 2023-12-19T17:52:36.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff98959a700 1 -- 172.21.15.45:0/1012185836 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff980011990 con 0x7ff98c0cdff0 2023-12-19T17:52:36.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff98959a700 1 -- 172.21.15.45:0/1012185836 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980011d40 con 0x7ff98c0cdff0 2023-12-19T17:52:36.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 -- 172.21.15.45:0/1012185836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c0cdff0 msgr2=0x7ff98c0cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 --2- 172.21.15.45:0/1012185836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c0cdff0 0x7ff98c0cf830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff980009850 tx=0x7ff980009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:36.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 -- 172.21.15.45:0/1012185836 shutdown_connections 2023-12-19T17:52:36.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 --2- 172.21.15.45:0/1012185836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c0cdff0 0x7ff98c0cf830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 --2- 172.21.15.45:0/1012185836 >> v2:172.21.15.45:3300/0 conn(0x7ff98c15d090 0x7ff98c0d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 -- 172.21.15.45:0/1012185836 >> 172.21.15.45:0/1012185836 conn(0x7ff98c0b4b90 msgr2=0x7ff98c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:36.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 -- 172.21.15.45:0/1012185836 shutdown_connections 2023-12-19T17:52:36.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.353+0000 7ff990ed8700 1 -- 172.21.15.45:0/1012185836 wait complete. 2023-12-19T17:52:36.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 Processor -- start 2023-12-19T17:52:36.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 -- start start 2023-12-19T17:52:36.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff98c0cdff0 0x7ff98c1578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 0x7ff98c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c15d090 0x7ff98c0cacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c15d510 con 0x7ff98c0cfd70 2023-12-19T17:52:36.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c15d7f0 con 0x7ff98c0cdff0 2023-12-19T17:52:36.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff990ed8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff98c15dad0 con 0x7ff98c15d090 2023-12-19T17:52:36.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff989d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 0x7ff98c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff989d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 0x7ff98c158da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51466/0 (socket says 172.21.15.45:51466) 2023-12-19T17:52:36.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff989d9b700 1 -- 172.21.15.45:0/902738823 learned_addr learned my addr 172.21.15.45:0/902738823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:36.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff98ad9d700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c15d090 0x7ff98c0cacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.357+0000 7ff98a59c700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff98c0cdff0 0x7ff98c1578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff989d9b700 1 -- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c15d090 msgr2=0x7ff98c0cacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff989d9b700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c15d090 0x7ff98c0cacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff989d9b700 1 -- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff98c0cdff0 msgr2=0x7ff98c1578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff989d9b700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff98c0cdff0 0x7ff98c1578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff989d9b700 1 -- 172.21.15.45:0/902738823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9800094b0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff98ad9d700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c15d090 0x7ff98c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff98a59c700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff98c0cdff0 0x7ff98c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff989d9b700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 0x7ff98c158da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9800090b0 tx=0x7ff980004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980004480 con 0x7ff98c0cfd70 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98001f070 con 0x7ff98c0cfd70 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff980003900 con 0x7ff98c0cfd70 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98c15ddb0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98c157e30 con 0x7ff98c0cfd70 2023-12-19T17:52:36.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.361+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98c15e2d0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.365+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff980021030 con 0x7ff98c0cfd70 2023-12-19T17:52:36.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.365+0000 7ff97affd700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff96c065b20 0x7ff96c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.365+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff980084880 con 0x7ff98c0cfd70 2023-12-19T17:52:36.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.365+0000 7ff98a59c700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff96c065b20 0x7ff96c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.369+0000 7ff98a59c700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff96c065b20 0x7ff96c067fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009ba0 tx=0x7ff97c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:36.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.373+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff980051ff0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.549+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff98c04ed30 con 0x7ff98c0cfd70 2023-12-19T17:52:36.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff97affd700 1 -- 172.21.15.45:0/902738823 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff980006ce0 con 0x7ff98c0cfd70 2023-12-19T17:52:36.555 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff96c065b20 msgr2=0x7ff96c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff96c065b20 0x7ff96c067fe0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009ba0 tx=0x7ff97c008040 comp rx=0 tx=0).stop 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 msgr2=0x7ff98c158da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 0x7ff98c158da0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9800090b0 tx=0x7ff980004770 comp rx=0 tx=0).stop 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 shutdown_connections 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff96c065b20 0x7ff96c067fe0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff98c15d090 0x7ff98c0cacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff98c0cfd70 0x7ff98c158da0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 --2- 172.21.15.45:0/902738823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff98c0cdff0 0x7ff98c1578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 >> 172.21.15.45:0/902738823 conn(0x7ff98c0b4b90 msgr2=0x7ff98c0b6490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 shutdown_connections 2023-12-19T17:52:36.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.553+0000 7ff990ed8700 1 -- 172.21.15.45:0/902738823 wait complete. 2023-12-19T17:52:36.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:36.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.773+0000 7f256b59e700 1 Processor -- start 2023-12-19T17:52:36.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.777+0000 7f256b59e700 1 -- start start 2023-12-19T17:52:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.777+0000 7f256b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f256c0b8580 0x7f256c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.777+0000 7f256b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c15d300 con 0x7f256c0d25f0 2023-12-19T17:52:36.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.777+0000 7f256b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256c0d1550 con 0x7f256c15cf20 2023-12-19T17:52:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.777+0000 7f256b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256c0d1360 con 0x7f256c0b8580 2023-12-19T17:52:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256ad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f256c0d25f0 0x7f256c0b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53096/0 (socket says 172.21.15.45:53096) 2023-12-19T17:52:36.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256ad9d700 1 -- 172.21.15.45:0/973517882 learned_addr learned my addr 172.21.15.45:0/973517882 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 --2- 172.21.15.45:0/973517882 >> v2:172.21.15.73:3300/0 conn(0x7f256c0b8580 0x7f256c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700369682 0 0) 0x7f256c15d300 con 0x7f256c0d25f0 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25540035d0 con 0x7f256c0d25f0 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 38302429 0 0) 0x7f256c0d1550 con 0x7f256c15cf20 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f256c15d300 con 0x7f256c15cf20 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2351302417 0 0) 0x7f25540035d0 con 0x7f256c0d25f0 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 >> v2:172.21.15.73:3300/0 conn(0x7f256c0b8580 msgr2=0x7f256c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:36.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 --2- 172.21.15.45:0/973517882 >> v2:172.21.15.73:3300/0 conn(0x7f256c0b8580 0x7f256c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 >> v1:172.21.15.73:6789/0 conn(0x7f256c15cf20 legacy=0x7f256c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c0d1830 con 0x7f256c0d25f0 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f25640019f0 con 0x7f256c0d25f0 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 >> v1:172.21.15.45:6789/0 conn(0x7f256c0d25f0 legacy=0x7f256c0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554003bb0 0x7f2554003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2554004870 0x7f2554004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2554005230 0x7f255400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255400c080 con 0x7f2554004870 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255400c1f0 con 0x7f2554003bb0 2023-12-19T17:52:36.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255400c3b0 con 0x7f2554005230 2023-12-19T17:52:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2554004870 0x7f2554004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256a59c700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554003bb0 0x7f2554003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256ad9d700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2554005230 0x7f255400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 -- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2554005230 msgr2=0x7f255400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2554005230 0x7f255400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 -- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554003bb0 msgr2=0x7f2554003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554003bb0 0x7f2554003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f2569d9b700 1 -- 172.21.15.45:0/973517882 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540035d0 con 0x7f2554004870 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.781+0000 7f256ad9d700 1 -- 172.21.15.45:0/973517882 reap_dead start 2023-12-19T17:52:36.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f2569d9b700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2554004870 0x7f2554004cf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2560009b70 tx=0x7f25540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb9e4960db89a51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e6c0 con 0x7f2554004870 2023-12-19T17:52:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f256000e820 con 0x7f2554004870 2023-12-19T17:52:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256959a700 1 -- 172.21.15.45:0/973517882 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000eb90 con 0x7f2554004870 2023-12-19T17:52:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 -- 172.21.15.45:0/973517882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2554004870 msgr2=0x7f2554004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2554004870 0x7f2554004cf0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2560009b70 tx=0x7f25540058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 -- 172.21.15.45:0/973517882 shutdown_connections 2023-12-19T17:52:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 --2- 172.21.15.45:0/973517882 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2554004870 0x7f2554004cf0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 -- 172.21.15.45:0/973517882 >> 172.21.15.45:0/973517882 conn(0x7f256c0b4670 msgr2=0x7f256c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 -- 172.21.15.45:0/973517882 shutdown_connections 2023-12-19T17:52:36.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.785+0000 7f256b59e700 1 -- 172.21.15.45:0/973517882 wait complete. 2023-12-19T17:52:36.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.789+0000 7f256b59e700 1 Processor -- start 2023-12-19T17:52:36.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.789+0000 7f256b59e700 1 -- start start 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554004870 0x7f256c15d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 0x7f256c15a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f256c153ea0 0x7f256c154320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c154860 con 0x7f256c1f6220 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256c15acf0 con 0x7f2554004870 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256c15bb20 con 0x7f256c153ea0 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 0x7f256c15a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 0x7f256c15a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51482/0 (socket says 172.21.15.45:51482) 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 -- 172.21.15.45:0/243116052 learned_addr learned my addr 172.21.15.45:0/243116052 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:36.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256a59c700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554004870 0x7f256c15d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256ad9d700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f256c153ea0 0x7f256c154320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 -- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f256c153ea0 msgr2=0x7f256c154320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f256c153ea0 0x7f256c154320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 -- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554004870 msgr2=0x7f256c15d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554004870 0x7f256c15d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 -- 172.21.15.45:0/243116052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256c1f6660 con 0x7f256c1f6220 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256a59c700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554004870 0x7f256c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f2569d9b700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 0x7f256c15a7b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25600042f0 tx=0x7f25600047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f256000e6c0 con 0x7f256c1f6220 2023-12-19T17:52:36.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2560003af0 con 0x7f256c1f6220 2023-12-19T17:52:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f256c15af10 con 0x7f256c1f6220 2023-12-19T17:52:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2560003ea0 con 0x7f256c1f6220 2023-12-19T17:52:36.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.793+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256c15b4d0 con 0x7f256c1f6220 2023-12-19T17:52:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.797+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f256c04ed30 con 0x7f256c1f6220 2023-12-19T17:52:36.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.797+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2560013470 con 0x7f256c1f6220 2023-12-19T17:52:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.797+0000 7f255affd700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f254c065ad0 0x7f254c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.797+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2560084bb0 con 0x7f256c1f6220 2023-12-19T17:52:36.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.797+0000 7f256a59c700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f254c065ad0 0x7f254c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:36.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.801+0000 7f256a59c700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f254c065ad0 0x7f254c067f90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f255c007fd0 tx=0x7f255c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:36.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.805+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2560052340 con 0x7f256c1f6220 2023-12-19T17:52:36.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.981+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f256c0d1dc0 con 0x7f256c1f6220 2023-12-19T17:52:36.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.981+0000 7f255affd700 1 -- 172.21.15.45:0/243116052 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2560055960 con 0x7f256c1f6220 2023-12-19T17:52:36.984 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f254c065ad0 msgr2=0x7f254c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f254c065ad0 0x7f254c067f90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f255c007fd0 tx=0x7f255c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:36.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 msgr2=0x7f256c15a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 0x7f256c15a7b0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f25600042f0 tx=0x7f25600047e0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 shutdown_connections 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f254c065ad0 0x7f254c067f90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f256c153ea0 0x7f256c154320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f256c1f6220 0x7f256c15a7b0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 --2- 172.21.15.45:0/243116052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2554004870 0x7f256c15d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 >> 172.21.15.45:0/243116052 conn(0x7f256c0b4670 msgr2=0x7f256c1551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 shutdown_connections 2023-12-19T17:52:36.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:36.985+0000 7f256b59e700 1 -- 172.21.15.45:0/243116052 wait complete. 2023-12-19T17:52:37.013 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.189+0000 7f8ecce7b700 1 Processor -- start 2023-12-19T17:52:37.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.189+0000 7f8ecce7b700 1 -- start start 2023-12-19T17:52:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ecce7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 0x7f8ec80b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ecce7b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ec80acd20 0x7f8ec80ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ecce7b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec8161710 con 0x7f8ec815d170 2023-12-19T17:52:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ecce7b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80adec0 con 0x7f8ec80acd20 2023-12-19T17:52:37.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ecce7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80b1f30 con 0x7f8ec80ada60 2023-12-19T17:52:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 0x7f8ec80b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 0x7f8ec80b19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:37746/0 (socket says 172.21.15.45:37746) 2023-12-19T17:52:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 -- 172.21.15.45:0/2887474093 learned_addr learned my addr 172.21.15.45:0/2887474093 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:37.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec6d9d700 1 --2- 172.21.15.45:0/2887474093 >> v2:172.21.15.73:3300/0 conn(0x7f8ec80acd20 0x7f8ec80ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 -- 172.21.15.45:0/2887474093 >> v2:172.21.15.73:3300/0 conn(0x7f8ec80acd20 msgr2=0x7f8ec80ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 --2- 172.21.15.45:0/2887474093 >> v2:172.21.15.73:3300/0 conn(0x7f8ec80acd20 0x7f8ec80ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 -- 172.21.15.45:0/2887474093 >> v1:172.21.15.73:6789/0 conn(0x7f8ec815d170 legacy=0x7f8ec806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 -- 172.21.15.45:0/2887474093 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec81619f0 con 0x7f8ec80ada60 2023-12-19T17:52:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec5d9b700 1 --2- 172.21.15.45:0/2887474093 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 0x7f8ec80b19f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009910 tx=0x7f8ebc009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b113e6c65ee50c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec559a700 1 -- 172.21.15.45:0/2887474093 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011830 con 0x7f8ec80ada60 2023-12-19T17:52:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec559a700 1 -- 172.21.15.45:0/2887474093 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ebc011990 con 0x7f8ec80ada60 2023-12-19T17:52:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.193+0000 7f8ec559a700 1 -- 172.21.15.45:0/2887474093 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ebc011d40 con 0x7f8ec80ada60 2023-12-19T17:52:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 -- 172.21.15.45:0/2887474093 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 msgr2=0x7f8ec80b19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/2887474093 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 0x7f8ec80b19f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc009910 tx=0x7f8ebc009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 -- 172.21.15.45:0/2887474093 shutdown_connections 2023-12-19T17:52:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/2887474093 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec80ada60 0x7f8ec80b19f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/2887474093 >> v2:172.21.15.73:3300/0 conn(0x7f8ec80acd20 0x7f8ec80ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 -- 172.21.15.45:0/2887474093 >> 172.21.15.45:0/2887474093 conn(0x7f8ec8071990 msgr2=0x7f8ec80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 -- 172.21.15.45:0/2887474093 shutdown_connections 2023-12-19T17:52:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.197+0000 7f8ecce7b700 1 -- 172.21.15.45:0/2887474093 wait complete. 2023-12-19T17:52:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 Processor -- start 2023-12-19T17:52:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 -- start start 2023-12-19T17:52:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 0x7f8ec81569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec80ada60 0x7f8ec8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec815d170 0x7f8ec8153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8145dc0 con 0x7f8ec80acd20 2023-12-19T17:52:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81f7070 con 0x7f8ec80ada60 2023-12-19T17:52:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ecce7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8156f00 con 0x7f8ec815d170 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ec659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 0x7f8ec81569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ec659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 0x7f8ec81569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51492/0 (socket says 172.21.15.45:51492) 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ec659c700 1 -- 172.21.15.45:0/1798398168 learned_addr learned my addr 172.21.15.45:0/1798398168 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.201+0000 7f8ec6d9d700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec815d170 0x7f8ec8153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec5d9b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec80ada60 0x7f8ec8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec659c700 1 -- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec815d170 msgr2=0x7f8ec8153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec659c700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec815d170 0x7f8ec8153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec659c700 1 -- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec80ada60 msgr2=0x7f8ec8155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec659c700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec80ada60 0x7f8ec8155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec659c700 1 -- 172.21.15.45:0/1798398168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ebc009570 con 0x7f8ec80acd20 2023-12-19T17:52:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ec659c700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 0x7f8ec81569c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c530 tx=0x7f8eb800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80052d0 con 0x7f8ec80acd20 2023-12-19T17:52:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb8005430 con 0x7f8ec80acd20 2023-12-19T17:52:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec81faaf0 con 0x7f8ec80acd20 2023-12-19T17:52:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80055a0 con 0x7f8ec80acd20 2023-12-19T17:52:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec81fb0b0 con 0x7f8ec80acd20 2023-12-19T17:52:37.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.205+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec81f71c0 con 0x7f8ec80acd20 2023-12-19T17:52:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.209+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8eb80036a0 con 0x7f8ec80acd20 2023-12-19T17:52:37.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.209+0000 7f8eb6ffd700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ea8065ad0 0x7f8ea8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.209+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8eb8082720 con 0x7f8ec80acd20 2023-12-19T17:52:37.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.209+0000 7f8ec5d9b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ea8065ad0 0x7f8ea8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.213+0000 7f8ec5d9b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ea8065ad0 0x7f8ea8067f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc000c00 tx=0x7f8ebc01d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:37.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.217+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8ec81f71c0 con 0x7f8ec80acd20 2023-12-19T17:52:37.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.393+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8ec81f71c0 con 0x7f8ec80acd20 2023-12-19T17:52:37.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.393+0000 7f8eb6ffd700 1 -- 172.21.15.45:0/1798398168 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8eb804fcf0 con 0x7f8ec80acd20 2023-12-19T17:52:37.396 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ea8065ad0 msgr2=0x7f8ea8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ea8065ad0 0x7f8ea8067f90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc000c00 tx=0x7f8ebc01d040 comp rx=0 tx=0).stop 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 msgr2=0x7f8ec81569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 0x7f8ec81569c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800c530 tx=0x7f8eb800c840 comp rx=0 tx=0).stop 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 shutdown_connections 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ea8065ad0 0x7f8ea8067f90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ec815d170 0x7f8ec8153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ec80ada60 0x7f8ec8155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 --2- 172.21.15.45:0/1798398168 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ec80acd20 0x7f8ec81569c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 >> 172.21.15.45:0/1798398168 conn(0x7f8ec8071990 msgr2=0x7f8ec806ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 shutdown_connections 2023-12-19T17:52:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.397+0000 7f8ecce7b700 1 -- 172.21.15.45:0/1798398168 wait complete. 2023-12-19T17:52:37.423 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:37.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.597+0000 7f008af2e700 1 Processor -- start 2023-12-19T17:52:37.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.597+0000 7f008af2e700 1 -- start start 2023-12-19T17:52:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008af2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 0x7f00840d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008af2e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00840b88b0 0x7f00840b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008af2e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00840b6250 0x7f00840b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008af2e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840d1820 con 0x7f00840b88b0 2023-12-19T17:52:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008af2e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00840d1b00 con 0x7f00840b6250 2023-12-19T17:52:37.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008af2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840d1de0 con 0x7f008406ea90 2023-12-19T17:52:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008972b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00840b88b0 0x7f00840b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 0x7f00840d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 0x7f00840d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:37768/0 (socket says 172.21.15.45:37768) 2023-12-19T17:52:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 -- 172.21.15.45:0/3583309552 learned_addr learned my addr 172.21.15.45:0/3583309552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:37.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f008a72d700 1 --2- 172.21.15.45:0/3583309552 >> v2:172.21.15.73:3300/0 conn(0x7f00840b6250 0x7f00840b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 -- 172.21.15.45:0/3583309552 >> v2:172.21.15.73:3300/0 conn(0x7f00840b6250 msgr2=0x7f00840b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 --2- 172.21.15.45:0/3583309552 >> v2:172.21.15.73:3300/0 conn(0x7f00840b6250 0x7f00840b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 -- 172.21.15.45:0/3583309552 >> v2:172.21.15.45:3300/0 conn(0x7f00840b88b0 msgr2=0x7f00840b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:37.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 --2- 172.21.15.45:0/3583309552 >> v2:172.21.15.45:3300/0 conn(0x7f00840b88b0 0x7f00840b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 -- 172.21.15.45:0/3583309552 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00840d20c0 con 0x7f008406ea90 2023-12-19T17:52:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0089f2c700 1 --2- 172.21.15.45:0/3583309552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 0x7f00840d0f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00840cd5f0 tx=0x7f0080009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0efb76df02b648b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0088f2a700 1 -- 172.21.15.45:0/3583309552 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080011830 con 0x7f008406ea90 2023-12-19T17:52:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0088f2a700 1 -- 172.21.15.45:0/3583309552 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0080011990 con 0x7f008406ea90 2023-12-19T17:52:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.601+0000 7f0088f2a700 1 -- 172.21.15.45:0/3583309552 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080011d20 con 0x7f008406ea90 2023-12-19T17:52:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 -- 172.21.15.45:0/3583309552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 msgr2=0x7f00840d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 --2- 172.21.15.45:0/3583309552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 0x7f00840d0f20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00840cd5f0 tx=0x7f0080009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 -- 172.21.15.45:0/3583309552 shutdown_connections 2023-12-19T17:52:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 --2- 172.21.15.45:0/3583309552 >> v2:172.21.15.73:3300/0 conn(0x7f00840b6250 0x7f00840b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 --2- 172.21.15.45:0/3583309552 >> v2:172.21.15.45:3300/0 conn(0x7f00840b88b0 0x7f00840b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 --2- 172.21.15.45:0/3583309552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f008406ea90 0x7f00840d0f20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 -- 172.21.15.45:0/3583309552 >> 172.21.15.45:0/3583309552 conn(0x7f00840b46d0 msgr2=0x7f00840b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:37.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 -- 172.21.15.45:0/3583309552 shutdown_connections 2023-12-19T17:52:37.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 -- 172.21.15.45:0/3583309552 wait complete. 2023-12-19T17:52:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 Processor -- start 2023-12-19T17:52:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.605+0000 7f008af2e700 1 -- start start 2023-12-19T17:52:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 0x7f0084154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00840b6250 0x7f00840c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00840b88b0 0x7f00840c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00841f2580 con 0x7f008406ea90 2023-12-19T17:52:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c7a70 con 0x7f00840b6250 2023-12-19T17:52:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00840c7d50 con 0x7f00840b88b0 2023-12-19T17:52:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 0x7f0084154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 0x7f0084154020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51510/0 (socket says 172.21.15.45:51510) 2023-12-19T17:52:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 -- 172.21.15.45:0/2605705170 learned_addr learned my addr 172.21.15.45:0/2605705170 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008a72d700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00840b88b0 0x7f00840c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008972b700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00840b6250 0x7f00840c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 -- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00840b88b0 msgr2=0x7f00840c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00840b88b0 0x7f00840c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 -- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00840b6250 msgr2=0x7f00840c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00840b6250 0x7f00840c7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 -- 172.21.15.45:0/2605705170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0080009570 con 0x7f008406ea90 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008972b700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00840b6250 0x7f00840c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f0089f2c700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 0x7f0084154020 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0080014040 tx=0x7f0080004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0080004450 con 0x7f008406ea90 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008001e070 con 0x7f008406ea90 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00800038e0 con 0x7f008406ea90 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008415d330 con 0x7f008406ea90 2023-12-19T17:52:37.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.609+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00841f2200 con 0x7f008406ea90 2023-12-19T17:52:37.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.613+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0084067760 con 0x7f008406ea90 2023-12-19T17:52:37.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.613+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0080003a40 con 0x7f008406ea90 2023-12-19T17:52:37.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.617+0000 7f007a7fc700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0068065b00 0x7f0068067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:37.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.617+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f0080083fc0 con 0x7f008406ea90 2023-12-19T17:52:37.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.617+0000 7f008972b700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0068065b00 0x7f0068067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.617+0000 7f008972b700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0068065b00 0x7f0068067fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0074009c40 tx=0x7f0074008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:37.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.621+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0080051630 con 0x7f008406ea90 2023-12-19T17:52:37.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.805+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0084066150 con 0x7f008406ea90 2023-12-19T17:52:37.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.809+0000 7f007a7fc700 1 -- 172.21.15.45:0/2605705170 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0080059e60 con 0x7f008406ea90 2023-12-19T17:52:37.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0068065b00 msgr2=0x7f0068067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0068065b00 0x7f0068067fc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0074009c40 tx=0x7f0074008040 comp rx=0 tx=0).stop 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 msgr2=0x7f0084154020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 0x7f0084154020 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0080014040 tx=0x7f0080004770 comp rx=0 tx=0).stop 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 shutdown_connections 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0068065b00 0x7f0068067fc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00840b88b0 0x7f00840c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00840b6250 0x7f00840c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 --2- 172.21.15.45:0/2605705170 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f008406ea90 0x7f0084154020 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 >> 172.21.15.45:0/2605705170 conn(0x7f00840b46d0 msgr2=0x7f00840b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 shutdown_connections 2023-12-19T17:52:37.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:37.813+0000 7f008af2e700 1 -- 172.21.15.45:0/2605705170 wait complete. 2023-12-19T17:52:37.817 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:37.838 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:52:37.838 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:37.854 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.065+0000 7ff60b59e700 1 Processor -- start 2023-12-19T17:52:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.065+0000 7ff60b59e700 1 -- start start 2023-12-19T17:52:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff60c06ea90 0x7ff60c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06fe80 0x7ff60c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c0d1820 con 0x7ff60c0b88b0 2023-12-19T17:52:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60b59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0d1b00 con 0x7ff60c06ea90 2023-12-19T17:52:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0d1de0 con 0x7ff60c06fe80 2023-12-19T17:52:38.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60a59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff60c06ea90 0x7ff60c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff609d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff60c0b88b0 0x7ff60c0b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53106/0 (socket says 172.21.15.45:53106) 2023-12-19T17:52:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff609d9b700 1 -- 172.21.15.45:0/784266229 learned_addr learned my addr 172.21.15.45:0/784266229 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60ad9d700 1 --2- 172.21.15.45:0/784266229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06fe80 0x7ff60c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60a59c700 1 -- 172.21.15.45:0/784266229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06fe80 msgr2=0x7ff60c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60a59c700 1 --2- 172.21.15.45:0/784266229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06fe80 0x7ff60c0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60a59c700 1 -- 172.21.15.45:0/784266229 >> v1:172.21.15.45:6789/0 conn(0x7ff60c0b88b0 legacy=0x7ff60c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60a59c700 1 -- 172.21.15.45:0/784266229 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0d20c0 con 0x7ff60c06ea90 2023-12-19T17:52:38.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.069+0000 7ff60a59c700 1 --2- 172.21.15.45:0/784266229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06ea90 0x7ff60c0d0f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009850 tx=0x7ff5fc009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e00e38b00b33dca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60959a700 1 -- 172.21.15.45:0/784266229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc011830 con 0x7ff60c06ea90 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60959a700 1 -- 172.21.15.45:0/784266229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc011990 con 0x7ff60c06ea90 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60959a700 1 -- 172.21.15.45:0/784266229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc011d40 con 0x7ff60c06ea90 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 -- 172.21.15.45:0/784266229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06ea90 msgr2=0x7ff60c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 --2- 172.21.15.45:0/784266229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06ea90 0x7ff60c0d0f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009850 tx=0x7ff5fc009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 -- 172.21.15.45:0/784266229 shutdown_connections 2023-12-19T17:52:38.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 --2- 172.21.15.45:0/784266229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06fe80 0x7ff60c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 --2- 172.21.15.45:0/784266229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06ea90 0x7ff60c0d0f20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 -- 172.21.15.45:0/784266229 >> 172.21.15.45:0/784266229 conn(0x7ff60c0b46d0 msgr2=0x7ff60c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 -- 172.21.15.45:0/784266229 shutdown_connections 2023-12-19T17:52:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.073+0000 7ff60b59e700 1 -- 172.21.15.45:0/784266229 wait complete. 2023-12-19T17:52:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 Processor -- start 2023-12-19T17:52:38.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 -- start start 2023-12-19T17:52:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06ea90 0x7ff60c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 0x7ff60c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff60c0b88b0 0x7ff60c0cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0ca020 con 0x7ff60c06fe80 2023-12-19T17:52:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0b14a0 con 0x7ff60c0b88b0 2023-12-19T17:52:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c7010 con 0x7ff60c06ea90 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 0x7ff60c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 0x7ff60c0c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51538/0 (socket says 172.21.15.45:51538) 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 -- 172.21.15.45:0/4020523403 learned_addr learned my addr 172.21.15.45:0/4020523403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60a59c700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06ea90 0x7ff60c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60ad9d700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff60c0b88b0 0x7ff60c0cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 -- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06ea90 msgr2=0x7ff60c0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06ea90 0x7ff60c0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 -- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff60c0b88b0 msgr2=0x7ff60c0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff60c0b88b0 0x7ff60c0cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 -- 172.21.15.45:0/4020523403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0094b0 con 0x7ff60c06fe80 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60ad9d700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff60c0b88b0 0x7ff60c0cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60a59c700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06ea90 0x7ff60c0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff609d9b700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 0x7ff60c0c6710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c700 tx=0x7ff60000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600005d90 con 0x7ff60c06fe80 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6000070d0 con 0x7ff60c06fe80 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600007440 con 0x7ff60c06fe80 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c0c72f0 con 0x7ff60c06fe80 2023-12-19T17:52:38.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.077+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c0c9cb0 con 0x7ff60c06fe80 2023-12-19T17:52:38.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.081+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c0ca1d0 con 0x7ff60c06fe80 2023-12-19T17:52:38.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.081+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6000075a0 con 0x7ff60c06fe80 2023-12-19T17:52:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.085+0000 7ff5faffd700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5ec065b00 0x7ff5ec067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.085+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff6000829d0 con 0x7ff60c06fe80 2023-12-19T17:52:38.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.085+0000 7ff60a59c700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5ec065b00 0x7ff5ec067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.085+0000 7ff60a59c700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5ec065b00 0x7ff5ec067fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0090b0 tx=0x7ff5fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.093+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff60c0ca1d0 con 0x7ff60c06fe80 2023-12-19T17:52:38.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.273+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff60c067760 con 0x7ff60c06fe80 2023-12-19T17:52:38.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.277+0000 7ff5faffd700 1 -- 172.21.15.45:0/4020523403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7ff60004ffd0 con 0x7ff60c06fe80 2023-12-19T17:52:38.281 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:38.281 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5ec065b00 msgr2=0x7ff5ec067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5ec065b00 0x7ff5ec067fc0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0090b0 tx=0x7ff5fc008030 comp rx=0 tx=0).stop 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 msgr2=0x7ff60c0c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 0x7ff60c0c6710 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff60000c700 tx=0x7ff60000cac0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 shutdown_connections 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5ec065b00 0x7ff5ec067fc0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff60c0b88b0 0x7ff60c0cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff60c06fe80 0x7ff60c0c6710 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 --2- 172.21.15.45:0/4020523403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff60c06ea90 0x7ff60c0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 >> 172.21.15.45:0/4020523403 conn(0x7ff60c0b46d0 msgr2=0x7ff60c0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:38.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 shutdown_connections 2023-12-19T17:52:38.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.281+0000 7ff60b59e700 1 -- 172.21.15.45:0/4020523403 wait complete. 2023-12-19T17:52:38.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:38.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.485+0000 7f9619419700 1 Processor -- start 2023-12-19T17:52:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.485+0000 7f9619419700 1 -- start start 2023-12-19T17:52:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.485+0000 7f9619419700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f96140d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.485+0000 7f9619419700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96140cdff0 0x7f96140cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9619419700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96140d01e0 con 0x7f96140cfd70 2023-12-19T17:52:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9619419700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96140b6040 con 0x7f96140cdff0 2023-12-19T17:52:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9619419700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140d10e0 con 0x7f961415d090 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f960bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96140cdff0 0x7f96140cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9612ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f96140d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96137fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f96140cfd70 0x7f961406ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48972/0 (socket says 172.21.15.45:48972) 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96137fe700 1 -- 172.21.15.45:0/3347480764 learned_addr learned my addr 172.21.15.45:0/3347480764 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96127fc700 1 -- 172.21.15.45:0/3347480764 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155321845 0 0) 0x7f960c001490 con 0x7f96140cfd70 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96127fc700 1 -- 172.21.15.45:0/3347480764 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96000035d0 con 0x7f96140cfd70 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9612ffd700 1 -- 172.21.15.45:0/3347480764 >> v2:172.21.15.73:3300/0 conn(0x7f96140cdff0 msgr2=0x7f96140cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9612ffd700 1 --2- 172.21.15.45:0/3347480764 >> v2:172.21.15.73:3300/0 conn(0x7f96140cdff0 0x7f96140cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9612ffd700 1 -- 172.21.15.45:0/3347480764 >> v1:172.21.15.73:6789/0 conn(0x7f96140cfd70 legacy=0x7f961406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9612ffd700 1 -- 172.21.15.45:0/3347480764 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96140d13c0 con 0x7f961415d090 2023-12-19T17:52:38.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f9612ffd700 1 --2- 172.21.15.45:0/3347480764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f96140d0a50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9604009850 tx=0x7f9604009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc1530b3360fc319 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96127fc700 1 -- 172.21.15.45:0/3347480764 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604011830 con 0x7f961415d090 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96127fc700 1 -- 172.21.15.45:0/3347480764 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9604011990 con 0x7f961415d090 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.489+0000 7f96127fc700 1 -- 172.21.15.45:0/3347480764 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604011d40 con 0x7f961415d090 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 -- 172.21.15.45:0/3347480764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 msgr2=0x7f96140d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 --2- 172.21.15.45:0/3347480764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f96140d0a50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9604009850 tx=0x7f9604009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 -- 172.21.15.45:0/3347480764 shutdown_connections 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 --2- 172.21.15.45:0/3347480764 >> v2:172.21.15.73:3300/0 conn(0x7f96140cdff0 0x7f96140cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 --2- 172.21.15.45:0/3347480764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f96140d0a50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 -- 172.21.15.45:0/3347480764 >> 172.21.15.45:0/3347480764 conn(0x7f96140b4b90 msgr2=0x7f96140b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:38.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 -- 172.21.15.45:0/3347480764 shutdown_connections 2023-12-19T17:52:38.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 -- 172.21.15.45:0/3347480764 wait complete. 2023-12-19T17:52:38.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 Processor -- start 2023-12-19T17:52:38.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.493+0000 7f9619419700 1 -- start start 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96140cdff0 0x7f96140c9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 0x7f9614150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f9614150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96141f6b70 con 0x7f96140cfd70 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96140a98b0 con 0x7f96140cdff0 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96140a9b90 con 0x7f961415d090 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 0x7f9614150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 0x7f9614150a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51546/0 (socket says 172.21.15.45:51546) 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 -- 172.21.15.45:0/4202797342 learned_addr learned my addr 172.21.15.45:0/4202797342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9612ffd700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96140cdff0 0x7f96140c9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f96137fe700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f9614150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 -- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 msgr2=0x7f9614150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f9614150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 -- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96140cdff0 msgr2=0x7f96140c9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96140cdff0 0x7f96140c9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 -- 172.21.15.45:0/4202797342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040094b0 con 0x7f96140cfd70 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960bfff700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 0x7f9614150a10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00e9d0 tx=0x7f95fc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc009720 con 0x7f96140cfd70 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc00ee70 con 0x7f96140cfd70 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc00ca50 con 0x7f96140cfd70 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96140a9e70 con 0x7f96140cfd70 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.497+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96140c97d0 con 0x7f96140cfd70 2023-12-19T17:52:38.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.501+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96140cf680 con 0x7f96140cfd70 2023-12-19T17:52:38.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.501+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f95fc00cbb0 con 0x7f96140cfd70 2023-12-19T17:52:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.505+0000 7f960b7fe700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f95f4065ad0 0x7f95f4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.505+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f95fc0835e0 con 0x7f96140cfd70 2023-12-19T17:52:38.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.505+0000 7f9612ffd700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f95f4065ad0 0x7f95f4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.505+0000 7f9612ffd700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f95f4065ad0 0x7f95f4067f90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96040090b0 tx=0x7f960401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.513+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f95fc050b20 con 0x7f96140cfd70 2023-12-19T17:52:38.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.685+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f961404ed30 con 0x7f96140cfd70 2023-12-19T17:52:38.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.685+0000 7f960b7fe700 1 -- 172.21.15.45:0/4202797342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95fc00ce60 con 0x7f96140cfd70 2023-12-19T17:52:38.690 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f95f4065ad0 msgr2=0x7f95f4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f95f4065ad0 0x7f95f4067f90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f96040090b0 tx=0x7f960401c040 comp rx=0 tx=0).stop 2023-12-19T17:52:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 msgr2=0x7f9614150a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 0x7f9614150a10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00e9d0 tx=0x7f95fc00ece0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 shutdown_connections 2023-12-19T17:52:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f95f4065ad0 0x7f95f4067f90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f961415d090 0x7f9614150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96140cfd70 0x7f9614150a10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 --2- 172.21.15.45:0/4202797342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96140cdff0 0x7f96140c9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 >> 172.21.15.45:0/4202797342 conn(0x7f96140b4b90 msgr2=0x7f96140ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 shutdown_connections 2023-12-19T17:52:38.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.689+0000 7f9619419700 1 -- 172.21.15.45:0/4202797342 wait complete. 2023-12-19T17:52:38.715 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.901+0000 7f7816b01700 1 Processor -- start 2023-12-19T17:52:38.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.901+0000 7f7816b01700 1 -- start start 2023-12-19T17:52:38.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f7816b01700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f781015d090 0x7f78100d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f7816b01700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f7816b01700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78100d10e0 con 0x7f78100cdff0 2023-12-19T17:52:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f7816b01700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78100b6040 con 0x7f781015d090 2023-12-19T17:52:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f7816b01700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100d13c0 con 0x7f78100cff40 2023-12-19T17:52:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f780ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f78100cdff0 0x7f78100cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56030/0 (socket says 172.21.15.45:56030) 2023-12-19T17:52:38.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f780ffff700 1 -- 172.21.15.45:0/1226727565 learned_addr learned my addr 172.21.15.45:0/1226727565 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f781489d700 1 --2- 172.21.15.45:0/1226727565 >> v2:172.21.15.73:3300/0 conn(0x7f781015d090 0x7f78100d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f781509e700 1 --2- 172.21.15.45:0/1226727565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f780f7fe700 1 -- 172.21.15.45:0/1226727565 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423111002 0 0) 0x7f78100d10e0 con 0x7f78100cdff0 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f780f7fe700 1 -- 172.21.15.45:0/1226727565 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78000035d0 con 0x7f78100cdff0 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f781509e700 1 -- 172.21.15.45:0/1226727565 >> v2:172.21.15.73:3300/0 conn(0x7f781015d090 msgr2=0x7f78100d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f781509e700 1 --2- 172.21.15.45:0/1226727565 >> v2:172.21.15.73:3300/0 conn(0x7f781015d090 0x7f78100d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f781509e700 1 -- 172.21.15.45:0/1226727565 >> v1:172.21.15.45:6789/0 conn(0x7f78100cdff0 legacy=0x7f78100cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.905+0000 7f781509e700 1 -- 172.21.15.45:0/1226727565 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78100d16a0 con 0x7f78100cff40 2023-12-19T17:52:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f781509e700 1 --2- 172.21.15.45:0/1226727565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b6490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7808009d90 tx=0x7f780800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4e4683dcb9b2af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f780f7fe700 1 -- 172.21.15.45:0/1226727565 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800e070 con 0x7f78100cff40 2023-12-19T17:52:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f780f7fe700 1 -- 172.21.15.45:0/1226727565 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780800bb20 con 0x7f78100cff40 2023-12-19T17:52:38.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f780f7fe700 1 -- 172.21.15.45:0/1226727565 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780800be90 con 0x7f78100cff40 2023-12-19T17:52:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 -- 172.21.15.45:0/1226727565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 msgr2=0x7f78100b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 --2- 172.21.15.45:0/1226727565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b6490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7808009d90 tx=0x7f780800b330 comp rx=0 tx=0).stop 2023-12-19T17:52:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 -- 172.21.15.45:0/1226727565 shutdown_connections 2023-12-19T17:52:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 --2- 172.21.15.45:0/1226727565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b6490 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 --2- 172.21.15.45:0/1226727565 >> v2:172.21.15.73:3300/0 conn(0x7f781015d090 0x7f78100d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 -- 172.21.15.45:0/1226727565 >> 172.21.15.45:0/1226727565 conn(0x7f78100b4b90 msgr2=0x7f78100b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 -- 172.21.15.45:0/1226727565 shutdown_connections 2023-12-19T17:52:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.909+0000 7f7816b01700 1 -- 172.21.15.45:0/1226727565 wait complete. 2023-12-19T17:52:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 Processor -- start 2023-12-19T17:52:38.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 -- start start 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100cdff0 0x7f78100c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 0x7f78100b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c7cb0 con 0x7f781015d090 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c6ed0 con 0x7f78100cdff0 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f7816b01700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78100c7130 con 0x7f78100cff40 2023-12-19T17:52:38.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 0x7f78100b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 0x7f78100b2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54860/0 (socket says 172.21.15.45:54860) 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 -- 172.21.15.45:0/1424369506 learned_addr learned my addr 172.21.15.45:0/1424369506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f780ffff700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781489d700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100cdff0 0x7f78100c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 -- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 msgr2=0x7f78100b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 -- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100cdff0 msgr2=0x7f78100c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100cdff0 0x7f78100c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.913+0000 7f781509e700 1 -- 172.21.15.45:0/1424369506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808009a70 con 0x7f781015d090 2023-12-19T17:52:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f781509e700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 0x7f78100b2700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7808014040 tx=0x7f7808004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7808004800 con 0x7f781015d090 2023-12-19T17:52:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7808020070 con 0x7f781015d090 2023-12-19T17:52:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080276c0 con 0x7f781015d090 2023-12-19T17:52:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78100c7410 con 0x7f781015d090 2023-12-19T17:52:38.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78100c79d0 con 0x7f781015d090 2023-12-19T17:52:38.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.917+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78101596c0 con 0x7f781015d090 2023-12-19T17:52:38.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.921+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7808012430 con 0x7f781015d090 2023-12-19T17:52:38.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.921+0000 7f780d7fa700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f77f4065ad0 0x7f77f4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:38.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.921+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f7808022070 con 0x7f781015d090 2023-12-19T17:52:38.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.921+0000 7f781489d700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f77f4065ad0 0x7f77f4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:38.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.925+0000 7f781489d700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f77f4065ad0 0x7f77f4067f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7804009b50 tx=0x7f7804009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:38.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:38.929+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78101596c0 con 0x7f781015d090 2023-12-19T17:52:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.109+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78101596c0 con 0x7f781015d090 2023-12-19T17:52:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.109+0000 7f780d7fa700 1 -- 172.21.15.45:0/1424369506 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f78101596c0 con 0x7f781015d090 2023-12-19T17:52:39.112 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f77f4065ad0 msgr2=0x7f77f4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f77f4065ad0 0x7f77f4067f90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7804009b50 tx=0x7f7804009240 comp rx=0 tx=0).stop 2023-12-19T17:52:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 msgr2=0x7f78100b2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 0x7f78100b2700 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7808014040 tx=0x7f7808004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 shutdown_connections 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f77f4065ad0 0x7f77f4067f90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f781015d090 0x7f78100b2700 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78100cff40 0x7f78100b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 --2- 172.21.15.45:0/1424369506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78100cdff0 0x7f78100c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 >> 172.21.15.45:0/1424369506 conn(0x7f78100b4b90 msgr2=0x7f781015b980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 shutdown_connections 2023-12-19T17:52:39.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.113+0000 7f7816b01700 1 -- 172.21.15.45:0/1424369506 wait complete. 2023-12-19T17:52:39.136 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.313+0000 7fc4e4f5d700 1 Processor -- start 2023-12-19T17:52:39.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.313+0000 7fc4e4f5d700 1 -- start start 2023-12-19T17:52:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4e4f5d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc4e015cf20 0x7fc4e00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4e4f5d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e015d300 con 0x7fc4e00cdfd0 2023-12-19T17:52:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4e4f5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4e00d1550 con 0x7fc4e00b8580 2023-12-19T17:52:39.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4e4f5d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4e00d1830 con 0x7fc4e015cf20 2023-12-19T17:52:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4dffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc4e00cdfd0 0x7fc4e00b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56040/0 (socket says 172.21.15.45:56040) 2023-12-19T17:52:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4dffff700 1 -- 172.21.15.45:0/368504308 learned_addr learned my addr 172.21.15.45:0/368504308 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4df7fe700 1 --2- 172.21.15.45:0/368504308 >> v2:172.21.15.73:3300/0 conn(0x7fc4e015cf20 0x7fc4e00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4de7fc700 1 -- 172.21.15.45:0/368504308 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551712613 0 0) 0x7fc4e015d300 con 0x7fc4e00cdfd0 2023-12-19T17:52:39.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4de7fc700 1 -- 172.21.15.45:0/368504308 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4c80035d0 con 0x7fc4e00cdfd0 2023-12-19T17:52:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4df7fe700 1 -- 172.21.15.45:0/368504308 >> v1:172.21.15.73:6789/0 conn(0x7fc4e00b8580 legacy=0x7fc4e00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4df7fe700 1 -- 172.21.15.45:0/368504308 >> v1:172.21.15.45:6789/0 conn(0x7fc4e00cdfd0 legacy=0x7fc4e00b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4de7fc700 1 -- 172.21.15.45:0/368504308 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 246579158 0 0) 0x7fc4c80035d0 con 0x7fc4e00cdfd0 2023-12-19T17:52:39.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4df7fe700 1 -- 172.21.15.45:0/368504308 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e00d1b10 con 0x7fc4e015cf20 2023-12-19T17:52:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.317+0000 7fc4df7fe700 1 --2- 172.21.15.45:0/368504308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e015cf20 0x7fc4e00d0c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009850 tx=0x7fc4d0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fefb58ecd32cd331 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4de7fc700 1 -- 172.21.15.45:0/368504308 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8001a10 con 0x7fc4e015cf20 2023-12-19T17:52:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4de7fc700 1 -- 172.21.15.45:0/368504308 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d0004030 con 0x7fc4e015cf20 2023-12-19T17:52:39.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4de7fc700 1 -- 172.21.15.45:0/368504308 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d00043c0 con 0x7fc4e015cf20 2023-12-19T17:52:39.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/368504308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e015cf20 msgr2=0x7fc4e00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/368504308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e015cf20 0x7fc4e00d0c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0009850 tx=0x7fc4d0009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/368504308 shutdown_connections 2023-12-19T17:52:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/368504308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e015cf20 0x7fc4e00d0c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/368504308 >> 172.21.15.45:0/368504308 conn(0x7fc4e00b4670 msgr2=0x7fc4e00b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/368504308 shutdown_connections 2023-12-19T17:52:39.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.321+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/368504308 wait complete. 2023-12-19T17:52:39.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 Processor -- start 2023-12-19T17:52:39.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 -- start start 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e00b8580 0x7fc4e006a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4e00cdfd0 0x7fc4e01fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4e015cf20 0x7fc4e015f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e006a7a0 con 0x7fc4e015cf20 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015d550 con 0x7fc4e00b8580 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4e4f5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e015d7f0 con 0x7fc4e00cdfd0 2023-12-19T17:52:39.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.325+0000 7fc4dffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4e015cf20 0x7fc4e015f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4dffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4e015cf20 0x7fc4e015f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54874/0 (socket says 172.21.15.45:54874) 2023-12-19T17:52:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4dffff700 1 -- 172.21.15.45:0/757499078 learned_addr learned my addr 172.21.15.45:0/757499078 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e00b8580 0x7fc4e006a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4deffd700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4e00cdfd0 0x7fc4e01fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 -- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4e00cdfd0 msgr2=0x7fc4e01fa4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4e00cdfd0 0x7fc4e01fa4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 -- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4e015cf20 msgr2=0x7fc4e015f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4e015cf20 0x7fc4e015f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 -- 172.21.15.45:0/757499078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d00094b0 con 0x7fc4e00b8580 2023-12-19T17:52:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4df7fe700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e00b8580 0x7fc4e006a260 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0015000 tx=0x7fc4d0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:39.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0003d60 con 0x7fc4e00b8580 2023-12-19T17:52:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d001f070 con 0x7fc4e00b8580 2023-12-19T17:52:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e015dad0 con 0x7fc4e00b8580 2023-12-19T17:52:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d0011870 con 0x7fc4e00b8580 2023-12-19T17:52:39.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.329+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e006e1c0 con 0x7fc4e00b8580 2023-12-19T17:52:39.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.333+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e004ed30 con 0x7fc4e00b8580 2023-12-19T17:52:39.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.333+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc4d0021030 con 0x7fc4e00b8580 2023-12-19T17:52:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.337+0000 7fc4c7fff700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc4cc065b20 0x7fc4cc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.337+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc4d0084df0 con 0x7fc4e00b8580 2023-12-19T17:52:39.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.337+0000 7fc4deffd700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc4cc065b20 0x7fc4cc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.337+0000 7fc4deffd700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc4cc065b20 0x7fc4cc067fe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00b5550 tx=0x7fc4d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:39.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.345+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc4d0052440 con 0x7fc4e00b8580 2023-12-19T17:52:39.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.521+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc4e015d930 con 0x7fc4e00b8580 2023-12-19T17:52:39.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.525+0000 7fc4c7fff700 1 -- 172.21.15.45:0/757499078 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc4e015d930 con 0x7fc4e00b8580 2023-12-19T17:52:39.528 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:39.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc4cc065b20 msgr2=0x7fc4cc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc4cc065b20 0x7fc4cc067fe0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc4e00b5550 tx=0x7fc4d4009040 comp rx=0 tx=0).stop 2023-12-19T17:52:39.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e00b8580 msgr2=0x7fc4e006a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e00b8580 0x7fc4e006a260 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc4d0015000 tx=0x7fc4d0004770 comp rx=0 tx=0).stop 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 shutdown_connections 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc4cc065b20 0x7fc4cc067fe0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc4e015cf20 0x7fc4e015f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc4e00cdfd0 0x7fc4e01fa4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 --2- 172.21.15.45:0/757499078 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4e00b8580 0x7fc4e006a260 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 >> 172.21.15.45:0/757499078 conn(0x7fc4e00b4670 msgr2=0x7fc4e00b3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 shutdown_connections 2023-12-19T17:52:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.529+0000 7fc4e4f5d700 1 -- 172.21.15.45:0/757499078 wait complete. 2023-12-19T17:52:39.556 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.745+0000 7f38e2145700 1 Processor -- start 2023-12-19T17:52:39.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.745+0000 7f38e2145700 1 -- start start 2023-12-19T17:52:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e2145700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 0x7f38dc0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e2145700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38dc071830 0x7f38dc0af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e2145700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38dc0b2a40 con 0x7f38dc0713d0 2023-12-19T17:52:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e2145700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38dc0ccb50 con 0x7f38dc071830 2023-12-19T17:52:39.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e2145700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc0ae5d0 con 0x7f38dc159a40 2023-12-19T17:52:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 0x7f38dc0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1944700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f38dc071830 0x7f38dc0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 0x7f38dc0ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:36168/0 (socket says 172.21.15.45:36168) 2023-12-19T17:52:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e0942700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f38dc0713d0 0x7f38dc0aecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:42976/0 (socket says 172.21.15.45:42976) 2023-12-19T17:52:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 -- 172.21.15.45:0/1584000513 learned_addr learned my addr 172.21.15.45:0/1584000513 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:39.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1944700 1 --2- 172.21.15.45:0/1584000513 >> v2:172.21.15.73:3300/0 conn(0x7f38dc071830 0x7f38dc0af400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:56444/0 (socket says 172.21.15.45:56444) 2023-12-19T17:52:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 -- 172.21.15.45:0/1584000513 >> v2:172.21.15.73:3300/0 conn(0x7f38dc071830 msgr2=0x7f38dc0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 --2- 172.21.15.45:0/1584000513 >> v2:172.21.15.73:3300/0 conn(0x7f38dc071830 0x7f38dc0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 -- 172.21.15.45:0/1584000513 >> v1:172.21.15.73:6789/0 conn(0x7f38dc0713d0 legacy=0x7f38dc0aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 -- 172.21.15.45:0/1584000513 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38dc0b2c90 con 0x7f38dc159a40 2023-12-19T17:52:39.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.749+0000 7f38e1143700 1 --2- 172.21.15.45:0/1584000513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 0x7f38dc0ae090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38d800bbb0 tx=0x7f38d800bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31daf194f2e9ca82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38d3fff700 1 -- 172.21.15.45:0/1584000513 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d8005e50 con 0x7f38dc159a40 2023-12-19T17:52:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38d3fff700 1 -- 172.21.15.45:0/1584000513 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38d800d920 con 0x7f38dc159a40 2023-12-19T17:52:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38d3fff700 1 -- 172.21.15.45:0/1584000513 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38d800dcb0 con 0x7f38dc159a40 2023-12-19T17:52:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 -- 172.21.15.45:0/1584000513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 msgr2=0x7f38dc0ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 --2- 172.21.15.45:0/1584000513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 0x7f38dc0ae090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f38d800bbb0 tx=0x7f38d800bec0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 -- 172.21.15.45:0/1584000513 shutdown_connections 2023-12-19T17:52:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 --2- 172.21.15.45:0/1584000513 >> v2:172.21.15.73:3300/0 conn(0x7f38dc071830 0x7f38dc0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 --2- 172.21.15.45:0/1584000513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc159a40 0x7f38dc0ae090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 -- 172.21.15.45:0/1584000513 >> 172.21.15.45:0/1584000513 conn(0x7f38dc0cf5a0 msgr2=0x7f38dc070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 -- 172.21.15.45:0/1584000513 shutdown_connections 2023-12-19T17:52:39.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.753+0000 7f38e2145700 1 -- 172.21.15.45:0/1584000513 wait complete. 2023-12-19T17:52:39.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 Processor -- start 2023-12-19T17:52:39.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 -- start start 2023-12-19T17:52:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc071830 0x7f38dc146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 0x7f38dc151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc1f3000 0x7f38dc0ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc157bf0 con 0x7f38dc159a40 2023-12-19T17:52:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc1526e0 con 0x7f38dc1f3000 2023-12-19T17:52:39.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e2145700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc151e40 con 0x7f38dc071830 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.757+0000 7f38e0942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 0x7f38dc151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 0x7f38dc151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54882/0 (socket says 172.21.15.45:54882) 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 -- 172.21.15.45:0/3636174428 learned_addr learned my addr 172.21.15.45:0/3636174428 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e1143700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc071830 0x7f38dc146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e1944700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc1f3000 0x7f38dc0ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 -- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc071830 msgr2=0x7f38dc146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc071830 0x7f38dc146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 -- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc1f3000 msgr2=0x7f38dc0ac2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc1f3000 0x7f38dc0ac2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 -- 172.21.15.45:0/3636174428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d800b7c0 con 0x7f38dc159a40 2023-12-19T17:52:39.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e1944700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc1f3000 0x7f38dc0ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e0942700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 0x7f38dc151540 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c700 tx=0x7f38cc00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc005cd0 con 0x7f38dc159a40 2023-12-19T17:52:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38cc005e30 con 0x7f38dc159a40 2023-12-19T17:52:39.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38cc0072d0 con 0x7f38dc159a40 2023-12-19T17:52:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc152120 con 0x7f38dc159a40 2023-12-19T17:52:39.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc1467b0 con 0x7f38dc159a40 2023-12-19T17:52:39.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.761+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc0cbbb0 con 0x7f38dc159a40 2023-12-19T17:52:39.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.765+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f38cc007430 con 0x7f38dc159a40 2023-12-19T17:52:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.765+0000 7f38d1ffb700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38c0065ad0 0x7f38c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:39.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.765+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f38cc082980 con 0x7f38dc159a40 2023-12-19T17:52:39.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.765+0000 7f38e1143700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38c0065ad0 0x7f38c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:39.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.769+0000 7f38e1143700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38c0065ad0 0x7f38c0067f90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f38d800bfd0 tx=0x7f38d801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:39.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.769+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f38cc04ff70 con 0x7f38dc159a40 2023-12-19T17:52:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.949+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f38dc04ed30 con 0x7f38dc159a40 2023-12-19T17:52:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38d1ffb700 1 -- 172.21.15.45:0/3636174428 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f38cc0170a0 con 0x7f38dc159a40 2023-12-19T17:52:39.955 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38c0065ad0 msgr2=0x7f38c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38c0065ad0 0x7f38c0067f90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f38d800bfd0 tx=0x7f38d801c040 comp rx=0 tx=0).stop 2023-12-19T17:52:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 msgr2=0x7f38dc151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 0x7f38dc151540 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00c700 tx=0x7f38cc00ca10 comp rx=0 tx=0).stop 2023-12-19T17:52:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 shutdown_connections 2023-12-19T17:52:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f38c0065ad0 0x7f38c0067f90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38dc1f3000 0x7f38dc0ac2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f38dc159a40 0x7f38dc151540 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.953+0000 7f38e2145700 1 --2- 172.21.15.45:0/3636174428 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f38dc071830 0x7f38dc146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.957+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 >> 172.21.15.45:0/3636174428 conn(0x7f38dc0713d0 msgr2=0x7f38dc0cd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.957+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 shutdown_connections 2023-12-19T17:52:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:39.957+0000 7f38e2145700 1 -- 172.21.15.45:0/3636174428 wait complete. 2023-12-19T17:52:39.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.149+0000 7f92b6c45700 1 Processor -- start 2023-12-19T17:52:40.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.149+0000 7f92b6c45700 1 -- start start 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b6c45700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92b015cff0 0x7f92b0161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b6c45700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00ca6f0 con 0x7f92b00c3920 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b6c45700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00c9220 con 0x7f92b006ddd0 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b6c45700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b015d3d0 con 0x7f92b015cff0 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b6444700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92b00c3920 0x7f92b006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56052/0 (socket says 172.21.15.45:56052) 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b6444700 1 -- 172.21.15.45:0/2683211060 learned_addr learned my addr 172.21.15.45:0/2683211060 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:40.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b5c43700 1 --2- 172.21.15.45:0/2683211060 >> v2:172.21.15.73:3300/0 conn(0x7f92b015cff0 0x7f92b0161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b4c41700 1 -- 172.21.15.45:0/2683211060 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1467531249 0 0) 0x7f92b00ca6f0 con 0x7f92b00c3920 2023-12-19T17:52:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.153+0000 7f92b4c41700 1 -- 172.21.15.45:0/2683211060 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f929c0035d0 con 0x7f92b00c3920 2023-12-19T17:52:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b5c43700 1 -- 172.21.15.45:0/2683211060 >> v1:172.21.15.73:6789/0 conn(0x7f92b006ddd0 legacy=0x7f92b00c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b5c43700 1 -- 172.21.15.45:0/2683211060 >> v1:172.21.15.45:6789/0 conn(0x7f92b00c3920 legacy=0x7f92b006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b5c43700 1 -- 172.21.15.45:0/2683211060 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b00c9500 con 0x7f92b015cff0 2023-12-19T17:52:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b5c43700 1 --2- 172.21.15.45:0/2683211060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b015cff0 0x7f92b0161530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009850 tx=0x7f92ac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5ffcba32128a1c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b4c41700 1 -- 172.21.15.45:0/2683211060 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011830 con 0x7f92b015cff0 2023-12-19T17:52:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b4c41700 1 -- 172.21.15.45:0/2683211060 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac011990 con 0x7f92b015cff0 2023-12-19T17:52:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b4c41700 1 -- 172.21.15.45:0/2683211060 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac011d40 con 0x7f92b015cff0 2023-12-19T17:52:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 -- 172.21.15.45:0/2683211060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b015cff0 msgr2=0x7f92b0161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 --2- 172.21.15.45:0/2683211060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b015cff0 0x7f92b0161530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009850 tx=0x7f92ac009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 -- 172.21.15.45:0/2683211060 shutdown_connections 2023-12-19T17:52:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 --2- 172.21.15.45:0/2683211060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b015cff0 0x7f92b0161530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 -- 172.21.15.45:0/2683211060 >> 172.21.15.45:0/2683211060 conn(0x7f92b00cb900 msgr2=0x7f92b00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 -- 172.21.15.45:0/2683211060 shutdown_connections 2023-12-19T17:52:40.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.157+0000 7f92b6c45700 1 -- 172.21.15.45:0/2683211060 wait complete. 2023-12-19T17:52:40.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.161+0000 7f92b6c45700 1 Processor -- start 2023-12-19T17:52:40.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.161+0000 7f92b6c45700 1 -- start start 2023-12-19T17:52:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b006ddd0 0x7f92b00b3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92b00c3920 0x7f92b006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 0x7f92b006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00c7370 con 0x7f92b015cff0 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00c5c70 con 0x7f92b006ddd0 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b00c5f50 con 0x7f92b00c3920 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 0x7f92b006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 0x7f92b006efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54884/0 (socket says 172.21.15.45:54884) 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 -- 172.21.15.45:0/656490989 learned_addr learned my addr 172.21.15.45:0/656490989 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:40.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b5c43700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b006ddd0 0x7f92b00b3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b5442700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92b00c3920 0x7f92b006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 -- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92b00c3920 msgr2=0x7f92b006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92b00c3920 0x7f92b006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 -- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b006ddd0 msgr2=0x7f92b00b3dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b006ddd0 0x7f92b00b3dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 -- 172.21.15.45:0/656490989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92ac0094b0 con 0x7f92b015cff0 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b5c43700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b006ddd0 0x7f92b00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6444700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 0x7f92b006efd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f92a800cb40 tx=0x7f92a800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800a7b0 con 0x7f92b015cff0 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800a910 con 0x7f92b015cff0 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b00c6230 con 0x7f92b015cff0 2023-12-19T17:52:40.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800ac80 con 0x7f92b015cff0 2023-12-19T17:52:40.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.165+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b00c67f0 con 0x7f92b015cff0 2023-12-19T17:52:40.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.169+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b0067760 con 0x7f92b015cff0 2023-12-19T17:52:40.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.169+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f92a801b3b0 con 0x7f92b015cff0 2023-12-19T17:52:40.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.169+0000 7f92a67fc700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9294065ad0 0x7f9294067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.169+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f92a8082e00 con 0x7f92b015cff0 2023-12-19T17:52:40.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.169+0000 7f92b5c43700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9294065ad0 0x7f9294067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.173+0000 7f92b5c43700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9294065ad0 0x7f9294067f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0090b0 tx=0x7f92ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:40.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.177+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f92a80504a0 con 0x7f92b015cff0 2023-12-19T17:52:40.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.369+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f92b00c4af0 con 0x7f92b015cff0 2023-12-19T17:52:40.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.369+0000 7f92a67fc700 1 -- 172.21.15.45:0/656490989 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92a8053ac0 con 0x7f92b015cff0 2023-12-19T17:52:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9294065ad0 msgr2=0x7f9294067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9294065ad0 0x7f9294067f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f92ac0090b0 tx=0x7f92ac008030 comp rx=0 tx=0).stop 2023-12-19T17:52:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 msgr2=0x7f92b006efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 0x7f92b006efd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f92a800cb40 tx=0x7f92a800cb70 comp rx=0 tx=0).stop 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 shutdown_connections 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9294065ad0 0x7f9294067f90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92b015cff0 0x7f92b006efd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92b00c3920 0x7f92b006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 --2- 172.21.15.45:0/656490989 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92b006ddd0 0x7f92b00b3dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 >> 172.21.15.45:0/656490989 conn(0x7f92b00cb900 msgr2=0x7f92b0161160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 shutdown_connections 2023-12-19T17:52:40.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.373+0000 7f92b6c45700 1 -- 172.21.15.45:0/656490989 wait complete. 2023-12-19T17:52:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:40.400 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:52:40.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:40.400 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T17:52:40.439 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:52:40.439 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:52:40.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:40.439 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T17:52:40.502 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:52:40.502 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:40.522 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:52:40.522 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:40.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:40.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.777+0000 7f72cd898700 1 Processor -- start 2023-12-19T17:52:40.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.777+0000 7f72cd898700 1 -- start start 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd898700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f72c81659f0 0x7f72c8167de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd898700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80d1820 con 0x7f72c806ea90 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd898700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80d1b00 con 0x7f72c80b88b0 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd898700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c80d1630 con 0x7f72c81659f0 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cc896700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f72c806ea90 0x7f72c80d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56058/0 (socket says 172.21.15.45:56058) 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cc896700 1 -- 172.21.15.45:0/3239266055 learned_addr learned my addr 172.21.15.45:0/3239266055 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:40.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd097700 1 --2- 172.21.15.45:0/3239266055 >> v2:172.21.15.45:3300/0 conn(0x7f72c81659f0 0x7f72c8167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72c77fe700 1 -- 172.21.15.45:0/3239266055 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727225450 0 0) 0x7f72c80d1820 con 0x7f72c806ea90 2023-12-19T17:52:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72c77fe700 1 -- 172.21.15.45:0/3239266055 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72b80035d0 con 0x7f72c806ea90 2023-12-19T17:52:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd097700 1 -- 172.21.15.45:0/3239266055 >> v1:172.21.15.73:6789/0 conn(0x7f72c80b88b0 legacy=0x7f72c806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd097700 1 -- 172.21.15.45:0/3239266055 >> v1:172.21.15.45:6789/0 conn(0x7f72c806ea90 legacy=0x7f72c80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd097700 1 -- 172.21.15.45:0/3239266055 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80d1de0 con 0x7f72c81659f0 2023-12-19T17:52:40.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd097700 1 --2- 172.21.15.45:0/3239266055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c8167de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009d90 tx=0x7f72c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b70e76ed51162f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:40.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72c77fe700 1 -- 172.21.15.45:0/3239266055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c000e070 con 0x7f72c81659f0 2023-12-19T17:52:40.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72c77fe700 1 -- 172.21.15.45:0/3239266055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c000bb20 con 0x7f72c81659f0 2023-12-19T17:52:40.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72c77fe700 1 -- 172.21.15.45:0/3239266055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0012430 con 0x7f72c81659f0 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.781+0000 7f72cd898700 1 -- 172.21.15.45:0/3239266055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 msgr2=0x7f72c8167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 --2- 172.21.15.45:0/3239266055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c8167de0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f72c0009d90 tx=0x7f72c000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 -- 172.21.15.45:0/3239266055 shutdown_connections 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 --2- 172.21.15.45:0/3239266055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c8167de0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 -- 172.21.15.45:0/3239266055 >> 172.21.15.45:0/3239266055 conn(0x7f72c80b46d0 msgr2=0x7f72c80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 -- 172.21.15.45:0/3239266055 shutdown_connections 2023-12-19T17:52:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 -- 172.21.15.45:0/3239266055 wait complete. 2023-12-19T17:52:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 Processor -- start 2023-12-19T17:52:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.785+0000 7f72cd898700 1 -- start start 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd898700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c806ea90 0x7f72c806f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd898700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72c80b88b0 0x7f72c80cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd898700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c80cc210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd898700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80cc750 con 0x7f72c81659f0 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd898700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80b2910 con 0x7f72c806ea90 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd898700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80b3920 con 0x7f72c80b88b0 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c80cc210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c80cc210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54902/0 (socket says 172.21.15.45:54902) 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 -- 172.21.15.45:0/3977248559 learned_addr learned my addr 172.21.15.45:0/3977248559 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72c7fff700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72c80b88b0 0x7f72c80cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cc896700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c806ea90 0x7f72c806f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 -- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72c80b88b0 msgr2=0x7f72c80cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72c80b88b0 0x7f72c80cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 -- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c806ea90 msgr2=0x7f72c806f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c806ea90 0x7f72c806f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 -- 172.21.15.45:0/3977248559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c0009a70 con 0x7f72c81659f0 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.789+0000 7f72cd097700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c80cc210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72c0013000 tx=0x7f72c0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0012430 con 0x7f72c81659f0 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c0020070 con 0x7f72c81659f0 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0004280 con 0x7f72c81659f0 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c80b2b60 con 0x7f72c81659f0 2023-12-19T17:52:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c80b3120 con 0x7f72c81659f0 2023-12-19T17:52:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c8067760 con 0x7f72c81659f0 2023-12-19T17:52:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.793+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f72c00043e0 con 0x7f72c81659f0 2023-12-19T17:52:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.797+0000 7f72c57fa700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72ac065ad0 0x7f72ac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.797+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f72c0022070 con 0x7f72c81659f0 2023-12-19T17:52:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.797+0000 7f72cc896700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72ac065ad0 0x7f72ac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:40.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.797+0000 7f72cc896700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72ac065ad0 0x7f72ac067f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0011e0 tx=0x7f72bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:40.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.801+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f72c00528a0 con 0x7f72c81659f0 2023-12-19T17:52:40.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.985+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c8070a60 con 0x7f72c81659f0 2023-12-19T17:52:40.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.985+0000 7f72c57fa700 1 -- 172.21.15.45:0/3977248559 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f72c0055ec0 con 0x7f72c81659f0 2023-12-19T17:52:40.990 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:40.990 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72ac065ad0 msgr2=0x7f72ac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72ac065ad0 0x7f72ac067f90 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f72bc0011e0 tx=0x7f72bc009040 comp rx=0 tx=0).stop 2023-12-19T17:52:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 msgr2=0x7f72c80cc210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:40.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c80cc210 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f72c0013000 tx=0x7f72c0004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 shutdown_connections 2023-12-19T17:52:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f72ac065ad0 0x7f72ac067f90 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f72c81659f0 0x7f72c80cc210 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f72c80b88b0 0x7f72c80cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 --2- 172.21.15.45:0/3977248559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f72c806ea90 0x7f72c806f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 >> 172.21.15.45:0/3977248559 conn(0x7f72c80b46d0 msgr2=0x7f72c80d0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 shutdown_connections 2023-12-19T17:52:40.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:40.989+0000 7f72cd898700 1 -- 172.21.15.45:0/3977248559 wait complete. 2023-12-19T17:52:41.015 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:41.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.205+0000 7f0229a1e700 1 Processor -- start 2023-12-19T17:52:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.205+0000 7f0229a1e700 1 -- start start 2023-12-19T17:52:41.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.205+0000 7f0229a1e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0224159a40 0x7f02240ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f02240af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02240b2a40 con 0x7f02240713d0 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02240ccb50 con 0x7f0224159a40 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0224071cf0 con 0x7f0224071860 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0224159a40 0x7f02240ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0224159a40 0x7f02240ae090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54914/0 (socket says 172.21.15.45:54914) 2023-12-19T17:52:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 -- 172.21.15.45:0/2038449994 learned_addr learned my addr 172.21.15.45:0/2038449994 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f02237fe700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f02240af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 -- 172.21.15.45:0/2038449994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 msgr2=0x7f02240af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f02240af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 -- 172.21.15.45:0/2038449994 >> v1:172.21.15.73:6789/0 conn(0x7f02240713d0 legacy=0x7f02240aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 -- 172.21.15.45:0/2038449994 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02240ae5d0 con 0x7f0224159a40 2023-12-19T17:52:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f02237fe700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f02240af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0222ffd700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0224159a40 0x7f02240ae090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0214009910 tx=0x7f0214009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd710dd0dcf5a83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0221ffb700 1 -- 172.21.15.45:0/2038449994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214005e50 con 0x7f0224159a40 2023-12-19T17:52:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0221ffb700 1 -- 172.21.15.45:0/2038449994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0214009e60 con 0x7f0224159a40 2023-12-19T17:52:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0221ffb700 1 -- 172.21.15.45:0/2038449994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400b870 con 0x7f0224159a40 2023-12-19T17:52:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- 172.21.15.45:0/2038449994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0224159a40 msgr2=0x7f02240ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0224159a40 0x7f02240ae090 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0214009910 tx=0x7f0214009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- 172.21.15.45:0/2038449994 shutdown_connections 2023-12-19T17:52:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f02240af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 --2- 172.21.15.45:0/2038449994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0224159a40 0x7f02240ae090 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- 172.21.15.45:0/2038449994 >> 172.21.15.45:0/2038449994 conn(0x7f02240cf5a0 msgr2=0x7f0224070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.209+0000 7f0229a1e700 1 -- 172.21.15.45:0/2038449994 shutdown_connections 2023-12-19T17:52:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.213+0000 7f0229a1e700 1 -- 172.21.15.45:0/2038449994 wait complete. 2023-12-19T17:52:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.213+0000 7f0229a1e700 1 Processor -- start 2023-12-19T17:52:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.213+0000 7f0229a1e700 1 -- start start 2023-12-19T17:52:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f022414e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0224159a40 0x7f02240a7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 0x7f02240af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022414ea50 con 0x7f02240a79d0 2023-12-19T17:52:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02241f2560 con 0x7f0224159a40 2023-12-19T17:52:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02241f2840 con 0x7f0224071860 2023-12-19T17:52:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 0x7f02240af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 0x7f02240af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54930/0 (socket says 172.21.15.45:54930) 2023-12-19T17:52:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 -- 172.21.15.45:0/263412007 learned_addr learned my addr 172.21.15.45:0/263412007 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0222ffd700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f022414e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02227fc700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0224159a40 0x7f02240a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 -- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 msgr2=0x7f022414e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f022414e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 -- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0224159a40 msgr2=0x7f02240a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0224159a40 0x7f02240a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 -- 172.21.15.45:0/263412007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0214009520 con 0x7f02240a79d0 2023-12-19T17:52:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f02237fe700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 0x7f02240af4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f021c007ef0 tx=0x7f021c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c00dd80 con 0x7f02240a79d0 2023-12-19T17:52:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f021c00f040 con 0x7f02240a79d0 2023-12-19T17:52:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c003cd0 con 0x7f02240a79d0 2023-12-19T17:52:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02241f2b20 con 0x7f02240a79d0 2023-12-19T17:52:41.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.217+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02241f2120 con 0x7f02240a79d0 2023-12-19T17:52:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.221+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f022404ed30 con 0x7f02240a79d0 2023-12-19T17:52:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.221+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f021c004030 con 0x7f02240a79d0 2023-12-19T17:52:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.225+0000 7f020bfff700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0210065b00 0x7f0210067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.225+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f021c006e40 con 0x7f02240a79d0 2023-12-19T17:52:41.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.225+0000 7f0222ffd700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0210065b00 0x7f0210067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.225+0000 7f0222ffd700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0210065b00 0x7f0210067fc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0214009c60 tx=0x7f0214008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:41.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.229+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f021c050b20 con 0x7f02240a79d0 2023-12-19T17:52:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.441+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02240cb8d0 con 0x7f02240a79d0 2023-12-19T17:52:41.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.441+0000 7f020bfff700 1 -- 172.21.15.45:0/263412007 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f021c054140 con 0x7f02240a79d0 2023-12-19T17:52:41.444 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0210065b00 msgr2=0x7f0210067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0210065b00 0x7f0210067fc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0214009c60 tx=0x7f0214008070 comp rx=0 tx=0).stop 2023-12-19T17:52:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 msgr2=0x7f02240af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 0x7f02240af4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f021c007ef0 tx=0x7f021c00d3b0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 shutdown_connections 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0210065b00 0x7f0210067fc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02240a79d0 0x7f02240af4c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0224159a40 0x7f02240a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 --2- 172.21.15.45:0/263412007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0224071860 0x7f022414e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 >> 172.21.15.45:0/263412007 conn(0x7f02240713d0 msgr2=0x7f02240b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 shutdown_connections 2023-12-19T17:52:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.445+0000 7f0229a1e700 1 -- 172.21.15.45:0/263412007 wait complete. 2023-12-19T17:52:41.472 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:41.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.657+0000 7f9522da8700 1 Processor -- start 2023-12-19T17:52:41.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.657+0000 7f9522da8700 1 -- start start 2023-12-19T17:52:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f951c0b8580 0x7f951c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f951c0d25f0 0x7f951c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f951c15d300 con 0x7f951c15cf20 2023-12-19T17:52:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0d1360 con 0x7f951c0b8580 2023-12-19T17:52:41.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c0d1550 con 0x7f951c0d25f0 2023-12-19T17:52:41.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95215a5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f951c0b8580 0x7f951c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9521da6700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f951c15cf20 0x7f951c0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56066/0 (socket says 172.21.15.45:56066) 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9521da6700 1 -- 172.21.15.45:0/2780773124 learned_addr learned my addr 172.21.15.45:0/2780773124 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95225a7700 1 --2- 172.21.15.45:0/2780773124 >> v2:172.21.15.73:3300/0 conn(0x7f951c0d25f0 0x7f951c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95215a5700 1 -- 172.21.15.45:0/2780773124 >> v2:172.21.15.73:3300/0 conn(0x7f951c0d25f0 msgr2=0x7f951c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95215a5700 1 --2- 172.21.15.45:0/2780773124 >> v2:172.21.15.73:3300/0 conn(0x7f951c0d25f0 0x7f951c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95215a5700 1 -- 172.21.15.45:0/2780773124 >> v1:172.21.15.45:6789/0 conn(0x7f951c15cf20 legacy=0x7f951c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95215a5700 1 -- 172.21.15.45:0/2780773124 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c0d1830 con 0x7f951c0b8580 2023-12-19T17:52:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f95215a5700 1 --2- 172.21.15.45:0/2780773124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0b8580 0x7f951c0cd8c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f951c0cd160 tx=0x7f950c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d225ed3c276a74a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9520da4700 1 -- 172.21.15.45:0/2780773124 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c011830 con 0x7f951c0b8580 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9520da4700 1 -- 172.21.15.45:0/2780773124 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c011990 con 0x7f951c0b8580 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9520da4700 1 -- 172.21.15.45:0/2780773124 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c011d40 con 0x7f951c0b8580 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- 172.21.15.45:0/2780773124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0b8580 msgr2=0x7f951c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 --2- 172.21.15.45:0/2780773124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0b8580 0x7f951c0cd8c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f951c0cd160 tx=0x7f950c009b30 comp rx=0 tx=0).stop 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- 172.21.15.45:0/2780773124 shutdown_connections 2023-12-19T17:52:41.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 --2- 172.21.15.45:0/2780773124 >> v2:172.21.15.73:3300/0 conn(0x7f951c0d25f0 0x7f951c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 --2- 172.21.15.45:0/2780773124 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0b8580 0x7f951c0cd8c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- 172.21.15.45:0/2780773124 >> 172.21.15.45:0/2780773124 conn(0x7f951c0b4670 msgr2=0x7f951c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- 172.21.15.45:0/2780773124 shutdown_connections 2023-12-19T17:52:41.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.661+0000 7f9522da8700 1 -- 172.21.15.45:0/2780773124 wait complete. 2023-12-19T17:52:41.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.665+0000 7f9522da8700 1 Processor -- start 2023-12-19T17:52:41.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.665+0000 7f9522da8700 1 -- start start 2023-12-19T17:52:41.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f951c0b8580 0x7f951c155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 0x7f951c0b11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f951c15cf20 0x7f951c158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0b16e0 con 0x7f951c0d25f0 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c159b60 con 0x7f951c0b8580 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c1f3780 con 0x7f951c15cf20 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 0x7f951c0b11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 0x7f951c0b11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54956/0 (socket says 172.21.15.45:54956) 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 -- 172.21.15.45:0/1670048968 learned_addr learned my addr 172.21.15.45:0/1670048968 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9521da6700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f951c0b8580 0x7f951c155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95225a7700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f951c15cf20 0x7f951c158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 -- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f951c15cf20 msgr2=0x7f951c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f951c15cf20 0x7f951c158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 -- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f951c0b8580 msgr2=0x7f951c155f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f951c0b8580 0x7f951c155f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 -- 172.21.15.45:0/1670048968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950c0094b0 con 0x7f951c0d25f0 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95225a7700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f951c15cf20 0x7f951c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:41.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95215a5700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 0x7f951c0b11a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f950c0090b0 tx=0x7f950c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:41.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c0036c0 con 0x7f951c0d25f0 2023-12-19T17:52:41.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c01e070 con 0x7f951c0d25f0 2023-12-19T17:52:41.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951c1595a0 con 0x7f951c0d25f0 2023-12-19T17:52:41.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f950c003a80 con 0x7f951c0d25f0 2023-12-19T17:52:41.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.669+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f951c1f3410 con 0x7f951c0d25f0 2023-12-19T17:52:41.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.673+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c04ed30 con 0x7f951c0d25f0 2023-12-19T17:52:41.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.673+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f950c003be0 con 0x7f951c0d25f0 2023-12-19T17:52:41.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.677+0000 7f95127fc700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9500065b00 0x7f9500067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:41.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.677+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f950c020070 con 0x7f951c0d25f0 2023-12-19T17:52:41.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.677+0000 7f9521da6700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9500065b00 0x7f9500067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:41.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.677+0000 7f9521da6700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9500065b00 0x7f9500067fc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9518005930 tx=0x7f9518009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:41.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.685+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f950c0520b0 con 0x7f951c0d25f0 2023-12-19T17:52:41.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.869+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f951c1f38c0 con 0x7f951c0d25f0 2023-12-19T17:52:41.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.869+0000 7f95127fc700 1 -- 172.21.15.45:0/1670048968 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f950c015020 con 0x7f951c0d25f0 2023-12-19T17:52:41.872 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9500065b00 msgr2=0x7f9500067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9500065b00 0x7f9500067fc0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9518005930 tx=0x7f9518009040 comp rx=0 tx=0).stop 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 msgr2=0x7f951c0b11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 0x7f951c0b11a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f950c0090b0 tx=0x7f950c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 shutdown_connections 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9500065b00 0x7f9500067fc0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f951c15cf20 0x7f951c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f951c0d25f0 0x7f951c0b11a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 --2- 172.21.15.45:0/1670048968 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f951c0b8580 0x7f951c155f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 >> 172.21.15.45:0/1670048968 conn(0x7f951c0b4670 msgr2=0x7f951c15c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 shutdown_connections 2023-12-19T17:52:41.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:41.873+0000 7f9522da8700 1 -- 172.21.15.45:0/1670048968 wait complete. 2023-12-19T17:52:41.897 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:42.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.085+0000 7effaeb46700 1 Processor -- start 2023-12-19T17:52:42.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.085+0000 7effaeb46700 1 -- start start 2023-12-19T17:52:42.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effaeb46700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effa80b2d90 0x7effa8071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effaeb46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80cc4a0 con 0x7effa8072260 2023-12-19T17:52:42.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effaeb46700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effa80cbbb0 con 0x7effa815aef0 2023-12-19T17:52:42.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effaeb46700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effa80726f0 con 0x7effa80b2d90 2023-12-19T17:52:42.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effac8e2700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7effa815aef0 0x7effa80ac460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:43008/0 (socket says 172.21.15.45:43008) 2023-12-19T17:52:42.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effac8e2700 1 -- 172.21.15.45:0/1991277344 learned_addr learned my addr 172.21.15.45:0/1991277344 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:42.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effad0e3700 1 --1- 172.21.15.45:0/1991277344 >> v1:172.21.15.45:6789/0 conn(0x7effa8072260 0x7effa815ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56076/0 (socket says 172.21.15.45:56076) 2023-12-19T17:52:42.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effa7fff700 1 --2- 172.21.15.45:0/1991277344 >> v2:172.21.15.73:3300/0 conn(0x7effa80b2d90 0x7effa8071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3843903298 0 0) 0x7effa80cbbb0 con 0x7effa815aef0 2023-12-19T17:52:42.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff980035d0 con 0x7effa815aef0 2023-12-19T17:52:42.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 778343000 0 0) 0x7effa80cc4a0 con 0x7effa8072260 2023-12-19T17:52:42.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.089+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa80cbbb0 con 0x7effa8072260 2023-12-19T17:52:42.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa7fff700 1 -- 172.21.15.45:0/1991277344 >> v1:172.21.15.73:6789/0 conn(0x7effa815aef0 legacy=0x7effa80ac460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa7fff700 1 -- 172.21.15.45:0/1991277344 >> v1:172.21.15.45:6789/0 conn(0x7effa8072260 legacy=0x7effa815ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa7fff700 1 -- 172.21.15.45:0/1991277344 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa80acb70 con 0x7effa80b2d90 2023-12-19T17:52:42.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa7fff700 1 --2- 172.21.15.45:0/1991277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa80b2d90 0x7effa8071d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff94009850 tx=0x7eff94009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48f15b1397609f8e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94011830 con 0x7effa80b2d90 2023-12-19T17:52:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff94011990 con 0x7effa80b2d90 2023-12-19T17:52:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effa77fe700 1 -- 172.21.15.45:0/1991277344 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff94011d40 con 0x7effa80b2d90 2023-12-19T17:52:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 -- 172.21.15.45:0/1991277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa80b2d90 msgr2=0x7effa8071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 --2- 172.21.15.45:0/1991277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa80b2d90 0x7effa8071d20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7eff94009850 tx=0x7eff94009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:42.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 -- 172.21.15.45:0/1991277344 shutdown_connections 2023-12-19T17:52:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 --2- 172.21.15.45:0/1991277344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa80b2d90 0x7effa8071d20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 -- 172.21.15.45:0/1991277344 >> 172.21.15.45:0/1991277344 conn(0x7effa806a010 msgr2=0x7effa806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 -- 172.21.15.45:0/1991277344 shutdown_connections 2023-12-19T17:52:42.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.093+0000 7effaeb46700 1 -- 172.21.15.45:0/1991277344 wait complete. 2023-12-19T17:52:42.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 Processor -- start 2023-12-19T17:52:42.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 -- start start 2023-12-19T17:52:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa8072260 0x7effa81f6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 0x7effa8154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa815aef0 0x7effa80b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa8155ea0 con 0x7effa80b2d90 2023-12-19T17:52:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81f71c0 con 0x7effa8072260 2023-12-19T17:52:42.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effaeb46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effa8154d60 con 0x7effa815aef0 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 0x7effa8154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 0x7effa8154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54966/0 (socket says 172.21.15.45:54966) 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 -- 172.21.15.45:0/3348266490 learned_addr learned my addr 172.21.15.45:0/3348266490 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effac8e2700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa8072260 0x7effa81f6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effad0e3700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa815aef0 0x7effa80b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 -- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa815aef0 msgr2=0x7effa80b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa815aef0 0x7effa80b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 -- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa8072260 msgr2=0x7effa81f6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa8072260 0x7effa81f6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 -- 172.21.15.45:0/3348266490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff940094b0 con 0x7effa80b2d90 2023-12-19T17:52:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.097+0000 7effa7fff700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 0x7effa8154820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff94009eb0 tx=0x7eff94004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9401aaf0 con 0x7effa80b2d90 2023-12-19T17:52:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff9401f070 con 0x7effa80b2d90 2023-12-19T17:52:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9401ae90 con 0x7effa80b2d90 2023-12-19T17:52:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa8155290 con 0x7effa80b2d90 2023-12-19T17:52:42.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa8155850 con 0x7effa80b2d90 2023-12-19T17:52:42.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effa8156050 con 0x7effa80b2d90 2023-12-19T17:52:42.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.101+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff9401b430 con 0x7effa80b2d90 2023-12-19T17:52:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.105+0000 7effa57fa700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff8c065b00 0x7eff8c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.105+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7eff94084610 con 0x7effa80b2d90 2023-12-19T17:52:42.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.105+0000 7effac8e2700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff8c065b00 0x7eff8c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.105+0000 7effac8e2700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff8c065b00 0x7eff8c067fc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000f60 tx=0x7eff9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.109+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7effa8156050 con 0x7effa80b2d90 2023-12-19T17:52:42.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.289+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effa8156050 con 0x7effa80b2d90 2023-12-19T17:52:42.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.289+0000 7effa57fa700 1 -- 172.21.15.45:0/3348266490 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7effa8156050 con 0x7effa80b2d90 2023-12-19T17:52:42.294 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:42.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff8c065b00 msgr2=0x7eff8c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff8c065b00 0x7eff8c067fc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff9c000f60 tx=0x7eff9c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:42.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 msgr2=0x7effa8154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 0x7effa8154820 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7eff94009eb0 tx=0x7eff94004770 comp rx=0 tx=0).stop 2023-12-19T17:52:42.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 shutdown_connections 2023-12-19T17:52:42.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff8c065b00 0x7eff8c067fc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effa815aef0 0x7effa80b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effa80b2d90 0x7effa8154820 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 --2- 172.21.15.45:0/3348266490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effa8072260 0x7effa81f6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 >> 172.21.15.45:0/3348266490 conn(0x7effa806a010 msgr2=0x7effa806f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:42.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 shutdown_connections 2023-12-19T17:52:42.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.293+0000 7effaeb46700 1 -- 172.21.15.45:0/3348266490 wait complete. 2023-12-19T17:52:42.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:42.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.493+0000 7f6497fff700 1 Processor -- start 2023-12-19T17:52:42.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.493+0000 7f6497fff700 1 -- start start 2023-12-19T17:52:42.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f6497fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f649815d220 0x7f64980d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f6497fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980d2200 con 0x7f64980cd4b0 2023-12-19T17:52:42.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f6497fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980d1920 con 0x7f64980d0e30 2023-12-19T17:52:42.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f6497fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64980cd8c0 con 0x7f649815d220 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f6496ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f64980d0e30 0x7f64980d1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:43010/0 (socket says 172.21.15.45:43010) 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f6496ffd700 1 -- 172.21.15.45:0/2755415073 learned_addr learned my addr 172.21.15.45:0/2755415073 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f648ffff700 1 --2- 172.21.15.45:0/2755415073 >> v2:172.21.15.45:3300/0 conn(0x7f649815d220 0x7f64980d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881784696 0 0) 0x7f64980d2200 con 0x7f64980cd4b0 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64840035d0 con 0x7f64980cd4b0 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 795045049 0 0) 0x7f64980d1920 con 0x7f64980d0e30 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64980d2200 con 0x7f64980d0e30 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f648ffff700 1 -- 172.21.15.45:0/2755415073 >> v1:172.21.15.73:6789/0 conn(0x7f64980d0e30 legacy=0x7f64980d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f648ffff700 1 -- 172.21.15.45:0/2755415073 >> v1:172.21.15.45:6789/0 conn(0x7f64980cd4b0 legacy=0x7f649806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f648ffff700 1 -- 172.21.15.45:0/2755415073 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6498070210 con 0x7f649815d220 2023-12-19T17:52:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f648ffff700 1 --2- 172.21.15.45:0/2755415073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980d2690 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6480009850 tx=0x7f6480009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d54715fb0a2de1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011830 con 0x7f649815d220 2023-12-19T17:52:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480011990 con 0x7f649815d220 2023-12-19T17:52:42.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.497+0000 7f64967fc700 1 -- 172.21.15.45:0/2755415073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480011d40 con 0x7f649815d220 2023-12-19T17:52:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 -- 172.21.15.45:0/2755415073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 msgr2=0x7f64980d2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 --2- 172.21.15.45:0/2755415073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980d2690 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6480009850 tx=0x7f6480009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 -- 172.21.15.45:0/2755415073 shutdown_connections 2023-12-19T17:52:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 --2- 172.21.15.45:0/2755415073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980d2690 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 -- 172.21.15.45:0/2755415073 >> 172.21.15.45:0/2755415073 conn(0x7f64980b46d0 msgr2=0x7f64980b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 -- 172.21.15.45:0/2755415073 shutdown_connections 2023-12-19T17:52:42.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.501+0000 7f6497fff700 1 -- 172.21.15.45:0/2755415073 wait complete. 2023-12-19T17:52:42.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 Processor -- start 2023-12-19T17:52:42.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 -- start start 2023-12-19T17:52:42.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64980cd4b0 0x7f64980c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64980d0e30 0x7f6498159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c9520 con 0x7f649815d220 2023-12-19T17:52:42.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981597b0 con 0x7f64980cd4b0 2023-12-19T17:52:42.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6497fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980c8610 con 0x7f64980d0e30 2023-12-19T17:52:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54976/0 (socket says 172.21.15.45:54976) 2023-12-19T17:52:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f6496ffd700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64980cd4b0 0x7f64980c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 -- 172.21.15.45:0/2470570666 learned_addr learned my addr 172.21.15.45:0/2470570666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f648ffff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64980d0e30 0x7f6498159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 -- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64980d0e30 msgr2=0x7f6498159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64980d0e30 0x7f6498159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 -- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64980cd4b0 msgr2=0x7f64980c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64980cd4b0 0x7f64980c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.505+0000 7f64977fe700 1 -- 172.21.15.45:0/2470570666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64800094b0 con 0x7f649815d220 2023-12-19T17:52:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f64977fe700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980c80d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f649000cc40 tx=0x7f649000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490003c20 con 0x7f649815d220 2023-12-19T17:52:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6490003d80 con 0x7f649815d220 2023-12-19T17:52:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000ab00 con 0x7f649815d220 2023-12-19T17:52:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64980c8f60 con 0x7f649815d220 2023-12-19T17:52:42.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64981f5fc0 con 0x7f649815d220 2023-12-19T17:52:42.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.509+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6498072a90 con 0x7f649815d220 2023-12-19T17:52:42.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.513+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f649000ac60 con 0x7f649815d220 2023-12-19T17:52:42.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.513+0000 7f6494ff9700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6478065ad0 0x7f6478067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.513+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f64900835a0 con 0x7f649815d220 2023-12-19T17:52:42.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.513+0000 7f6496ffd700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6478065ad0 0x7f6478067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.513+0000 7f6496ffd700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6478065ad0 0x7f6478067f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6488007fd0 tx=0x7f6488007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.521+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6490050b70 con 0x7f649815d220 2023-12-19T17:52:42.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.701+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f649804ed30 con 0x7f649815d220 2023-12-19T17:52:42.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.701+0000 7f6494ff9700 1 -- 172.21.15.45:0/2470570666 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6490054190 con 0x7f649815d220 2023-12-19T17:52:42.706 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:42.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6478065ad0 msgr2=0x7f6478067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6478065ad0 0x7f6478067f90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6488007fd0 tx=0x7f6488007de0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 msgr2=0x7f64980c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980c80d0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f649000cc40 tx=0x7f649000cf50 comp rx=0 tx=0).stop 2023-12-19T17:52:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 shutdown_connections 2023-12-19T17:52:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6478065ad0 0x7f6478067f90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f649815d220 0x7f64980c80d0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64980d0e30 0x7f6498159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 --2- 172.21.15.45:0/2470570666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64980cd4b0 0x7f64980c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 >> 172.21.15.45:0/2470570666 conn(0x7f64980b46d0 msgr2=0x7f64980b7f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 shutdown_connections 2023-12-19T17:52:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.705+0000 7f6497fff700 1 -- 172.21.15.45:0/2470570666 wait complete. 2023-12-19T17:52:42.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:42.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.909+0000 7fe014881700 1 Processor -- start 2023-12-19T17:52:42.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.909+0000 7fe014881700 1 -- start start 2023-12-19T17:52:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe014881700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0100cb500 0x7fe0100ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe014881700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe010070130 con 0x7fe0100b4940 2023-12-19T17:52:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe014881700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0100b4d20 con 0x7fe0100ca0f0 2023-12-19T17:52:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe014881700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe01006b9c0 con 0x7fe0100cb500 2023-12-19T17:52:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0100cb500 0x7fe0100ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe0100cb500 0x7fe0100ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54984/0 (socket says 172.21.15.45:54984) 2023-12-19T17:52:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 -- 172.21.15.45:0/741269442 learned_addr learned my addr 172.21.15.45:0/741269442 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe00ed9d700 1 --1- 172.21.15.45:0/741269442 >> v1:172.21.15.45:6789/0 conn(0x7fe0100b4940 0x7fe0100cadf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56094/0 (socket says 172.21.15.45:56094) 2023-12-19T17:52:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 -- 172.21.15.45:0/741269442 >> v1:172.21.15.73:6789/0 conn(0x7fe0100ca0f0 legacy=0x7fe0100cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 -- 172.21.15.45:0/741269442 >> v1:172.21.15.45:6789/0 conn(0x7fe0100b4940 legacy=0x7fe0100cadf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 -- 172.21.15.45:0/741269442 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100703a0 con 0x7fe0100cb500 2023-12-19T17:52:42.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe007fff700 1 --2- 172.21.15.45:0/741269442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ccc90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdff800bbb0 tx=0x7fdff800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c310b883f15941f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe00e59c700 1 -- 172.21.15.45:0/741269442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff800dd90 con 0x7fe0100cb500 2023-12-19T17:52:42.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe00e59c700 1 -- 172.21.15.45:0/741269442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdff8010470 con 0x7fe0100cb500 2023-12-19T17:52:42.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.913+0000 7fe00e59c700 1 -- 172.21.15.45:0/741269442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdff8010820 con 0x7fe0100cb500 2023-12-19T17:52:42.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 -- 172.21.15.45:0/741269442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 msgr2=0x7fe0100ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 --2- 172.21.15.45:0/741269442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ccc90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdff800bbb0 tx=0x7fdff800bec0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 -- 172.21.15.45:0/741269442 shutdown_connections 2023-12-19T17:52:42.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 --2- 172.21.15.45:0/741269442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ccc90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 -- 172.21.15.45:0/741269442 >> 172.21.15.45:0/741269442 conn(0x7fe0100cbb40 msgr2=0x7fe0100cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 -- 172.21.15.45:0/741269442 shutdown_connections 2023-12-19T17:52:42.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 -- 172.21.15.45:0/741269442 wait complete. 2023-12-19T17:52:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.917+0000 7fe014881700 1 Processor -- start 2023-12-19T17:52:42.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 -- start start 2023-12-19T17:52:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0100b4940 0x7fe0100ac530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0100ca0f0 0x7fe0101f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101f39c0 con 0x7fe0100cb500 2023-12-19T17:52:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101f6e30 con 0x7fe0100b4940 2023-12-19T17:52:42.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0101f36e0 con 0x7fe0100ca0f0 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55000/0 (socket says 172.21.15.45:55000) 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 -- 172.21.15.45:0/2623500593 learned_addr learned my addr 172.21.15.45:0/2623500593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00ed9d700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0100b4940 0x7fe0100ac530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe007fff700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0100ca0f0 0x7fe0101f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 -- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0100ca0f0 msgr2=0x7fe0101f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0100ca0f0 0x7fe0101f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 -- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0100b4940 msgr2=0x7fe0100ac530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0100b4940 0x7fe0100ac530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 -- 172.21.15.45:0/2623500593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdff800b810 con 0x7fe0100cb500 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00ed9d700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0100b4940 0x7fe0100ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:42.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe007fff700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0100ca0f0 0x7fe0101f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe00f59e700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ad4e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe00800cc50 tx=0x7fe00800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800ad80 con 0x7fe0100cb500 2023-12-19T17:52:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800ce50 con 0x7fe0100cb500 2023-12-19T17:52:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0100aba50 con 0x7fe0100cb500 2023-12-19T17:52:42.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.921+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008003c60 con 0x7fe0100cb500 2023-12-19T17:52:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.925+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0100ac010 con 0x7fe0100cb500 2023-12-19T17:52:42.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.925+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0100ab8b0 con 0x7fe0100cb500 2023-12-19T17:52:42.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.925+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe0080050d0 con 0x7fe0100cb500 2023-12-19T17:52:42.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.929+0000 7fe0077fe700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdff0065ad0 0x7fdff0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.929+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe008083700 con 0x7fe0100cb500 2023-12-19T17:52:42.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.929+0000 7fe00ed9d700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdff0065ad0 0x7fdff0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:42.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.929+0000 7fe00ed9d700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdff0065ad0 0x7fdff0067f90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe000000f60 tx=0x7fe000007df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:42.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:42.937+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe0100ab8b0 con 0x7fe0100cb500 2023-12-19T17:52:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.129+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0100ab8b0 con 0x7fe0100cb500 2023-12-19T17:52:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.129+0000 7fe0077fe700 1 -- 172.21.15.45:0/2623500593 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe0100ab8b0 con 0x7fe0100cb500 2023-12-19T17:52:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.129+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdff0065ad0 msgr2=0x7fdff0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.129+0000 7fe014881700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdff0065ad0 0x7fdff0067f90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fe000000f60 tx=0x7fe000007df0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.129+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 msgr2=0x7fe0100ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.129+0000 7fe014881700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ad4e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fe00800cc50 tx=0x7fe00800a340 comp rx=0 tx=0).stop 2023-12-19T17:52:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 shutdown_connections 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdff0065ad0 0x7fdff0067f90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe0100cb500 0x7fe0100ad4e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0100ca0f0 0x7fe0101f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 --2- 172.21.15.45:0/2623500593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0100b4940 0x7fe0100ac530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 >> 172.21.15.45:0/2623500593 conn(0x7fe0100cbb40 msgr2=0x7fe0100b03d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 shutdown_connections 2023-12-19T17:52:43.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.133+0000 7fe014881700 1 -- 172.21.15.45:0/2623500593 wait complete. 2023-12-19T17:52:43.137 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:43.155 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:52:43.155 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:43.175 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:43.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.345+0000 7fb145e51700 1 Processor -- start 2023-12-19T17:52:43.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.345+0000 7fb145e51700 1 -- start start 2023-12-19T17:52:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb145e51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1400ade00 0x7fb1400cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb145e51700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb14006c850 0x7fb14006cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb145e51700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1400c5870 con 0x7fb140159dd0 2023-12-19T17:52:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb145e51700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1400c4ca0 con 0x7fb14006c850 2023-12-19T17:52:43.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb145e51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14015a1b0 con 0x7fb1400ade00 2023-12-19T17:52:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb140159dd0 0x7fb1400c5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56104/0 (socket says 172.21.15.45:56104) 2023-12-19T17:52:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13f7fe700 1 -- 172.21.15.45:0/359238615 learned_addr learned my addr 172.21.15.45:0/359238615 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13ffff700 1 --2- 172.21.15.45:0/359238615 >> v2:172.21.15.73:3300/0 conn(0x7fb14006c850 0x7fb14006cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb137fff700 1 --2- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1400ade00 0x7fb1400cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13effd700 1 -- 172.21.15.45:0/359238615 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129025779 0 0) 0x7fb1400c5870 con 0x7fb140159dd0 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13effd700 1 -- 172.21.15.45:0/359238615 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb12c0057e0 con 0x7fb140159dd0 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13ffff700 1 -- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1400ade00 msgr2=0x7fb1400cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13ffff700 1 --2- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1400ade00 0x7fb1400cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13ffff700 1 -- 172.21.15.45:0/359238615 >> v1:172.21.15.45:6789/0 conn(0x7fb140159dd0 legacy=0x7fb1400c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13ffff700 1 -- 172.21.15.45:0/359238615 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14015e6d0 con 0x7fb14006c850 2023-12-19T17:52:43.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13ffff700 1 --2- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb14006cce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb138009dc0 tx=0x7fb13800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82b7bab9cdacc1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13effd700 1 -- 172.21.15.45:0/359238615 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800e070 con 0x7fb14006c850 2023-12-19T17:52:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13effd700 1 -- 172.21.15.45:0/359238615 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13800bae0 con 0x7fb14006c850 2023-12-19T17:52:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.349+0000 7fb13effd700 1 -- 172.21.15.45:0/359238615 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13800be90 con 0x7fb14006c850 2023-12-19T17:52:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 -- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 msgr2=0x7fb14006cce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 --2- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb14006cce0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb138009dc0 tx=0x7fb13800b330 comp rx=0 tx=0).stop 2023-12-19T17:52:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 -- 172.21.15.45:0/359238615 shutdown_connections 2023-12-19T17:52:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 --2- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb14006cce0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 --2- 172.21.15.45:0/359238615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1400ade00 0x7fb1400cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 -- 172.21.15.45:0/359238615 >> 172.21.15.45:0/359238615 conn(0x7fb1400cba40 msgr2=0x7fb1400ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 -- 172.21.15.45:0/359238615 shutdown_connections 2023-12-19T17:52:43.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 -- 172.21.15.45:0/359238615 wait complete. 2023-12-19T17:52:43.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 Processor -- start 2023-12-19T17:52:43.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.353+0000 7fb145e51700 1 -- start start 2023-12-19T17:52:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb1400b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 0x7fb14015cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb140159dd0 0x7fb1400b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400b1bd0 con 0x7fb1400ade00 2023-12-19T17:52:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400b29d0 con 0x7fb14006c850 2023-12-19T17:52:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400b1dc0 con 0x7fb140159dd0 2023-12-19T17:52:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 0x7fb14015cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 0x7fb14015cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55006/0 (socket says 172.21.15.45:55006) 2023-12-19T17:52:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 -- 172.21.15.45:0/3551821757 learned_addr learned my addr 172.21.15.45:0/3551821757 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb13f7fe700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb1400b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb13ffff700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb140159dd0 0x7fb1400b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 -- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb140159dd0 msgr2=0x7fb1400b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb140159dd0 0x7fb1400b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 -- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 msgr2=0x7fb1400b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb1400b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 -- 172.21.15.45:0/3551821757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009a70 con 0x7fb1400ade00 2023-12-19T17:52:43.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb137fff700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 0x7fb14015cd70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb12800ea00 tx=0x7fb12800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128009720 con 0x7fb1400ade00 2023-12-19T17:52:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12800eea0 con 0x7fb1400ade00 2023-12-19T17:52:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1400b20a0 con 0x7fb1400ade00 2023-12-19T17:52:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12800ca50 con 0x7fb1400ade00 2023-12-19T17:52:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.357+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1400b2660 con 0x7fb1400ade00 2023-12-19T17:52:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.361+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb14004ed30 con 0x7fb1400ade00 2023-12-19T17:52:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.361+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb12800cbb0 con 0x7fb1400ade00 2023-12-19T17:52:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.361+0000 7fb13cff9700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb120065b00 0x7fb120067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.361+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb1280836d0 con 0x7fb1400ade00 2023-12-19T17:52:43.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.361+0000 7fb13f7fe700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb120065b00 0x7fb120067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.361+0000 7fb13f7fe700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb120065b00 0x7fb120067fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb130007fd0 tx=0x7fb130007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:43.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.369+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb128050b00 con 0x7fb1400ade00 2023-12-19T17:52:43.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.545+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1400b2b10 con 0x7fb1400ade00 2023-12-19T17:52:43.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.549+0000 7fb13cff9700 1 -- 172.21.15.45:0/3551821757 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fb128054120 con 0x7fb1400ade00 2023-12-19T17:52:43.554 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:43.554 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.553+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb120065b00 msgr2=0x7fb120067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.553+0000 7fb145e51700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb120065b00 0x7fb120067fc0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb130007fd0 tx=0x7fb130007de0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.553+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 msgr2=0x7fb14015cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.553+0000 7fb145e51700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 0x7fb14015cd70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb12800ea00 tx=0x7fb12800ed10 comp rx=0 tx=0).stop 2023-12-19T17:52:43.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 shutdown_connections 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb120065b00 0x7fb120067fc0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb140159dd0 0x7fb1400b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1400ade00 0x7fb14015cd70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 --2- 172.21.15.45:0/3551821757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb14006c850 0x7fb1400b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 >> 172.21.15.45:0/3551821757 conn(0x7fb1400cba40 msgr2=0x7fb1400cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 shutdown_connections 2023-12-19T17:52:43.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.557+0000 7fb145e51700 1 -- 172.21.15.45:0/3551821757 wait complete. 2023-12-19T17:52:43.581 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:43.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.761+0000 7f57b9b2e700 1 Processor -- start 2023-12-19T17:52:43.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.761+0000 7f57b9b2e700 1 -- start start 2023-12-19T17:52:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b9b2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b4159a40 0x7f57b40ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b9b2e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57b40713d0 0x7f57b4071830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b9b2e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b40aecf0 0x7f57b40af180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b9b2e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b40ccb50 con 0x7f57b40aecf0 2023-12-19T17:52:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b9b2e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b4071d70 con 0x7f57b40713d0 2023-12-19T17:52:43.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b9b2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b40b2a40 con 0x7f57b4159a40 2023-12-19T17:52:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b932d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b40aecf0 0x7f57b40af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b8b2c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b4159a40 0x7f57b40ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57b40713d0 0x7f57b4071830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b932d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f57b40aecf0 0x7f57b40af180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55012/0 (socket says 172.21.15.45:55012) 2023-12-19T17:52:43.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b932d700 1 -- 172.21.15.45:0/3830618688 learned_addr learned my addr 172.21.15.45:0/3830618688 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b932d700 1 -- 172.21.15.45:0/3830618688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b4159a40 msgr2=0x7f57b40ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.765+0000 7f57b932d700 1 --2- 172.21.15.45:0/3830618688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b4159a40 0x7f57b40ae090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b932d700 1 -- 172.21.15.45:0/3830618688 >> v2:172.21.15.73:3300/0 conn(0x7f57b40713d0 msgr2=0x7f57b4071830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b932d700 1 --2- 172.21.15.45:0/3830618688 >> v2:172.21.15.73:3300/0 conn(0x7f57b40713d0 0x7f57b4071830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b932d700 1 -- 172.21.15.45:0/3830618688 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b40ae5d0 con 0x7f57b40aecf0 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b3fff700 1 --2- 172.21.15.45:0/3830618688 >> v2:172.21.15.73:3300/0 conn(0x7f57b40713d0 0x7f57b4071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b932d700 1 --2- 172.21.15.45:0/3830618688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b40aecf0 0x7f57b40af180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57b406acb0 tx=0x7f57ac00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40ff7209816ccf7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b37fe700 1 -- 172.21.15.45:0/3830618688 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00e070 con 0x7f57b40aecf0 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b37fe700 1 -- 172.21.15.45:0/3830618688 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac00b910 con 0x7f57b40aecf0 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b37fe700 1 -- 172.21.15.45:0/3830618688 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac00bcc0 con 0x7f57b40aecf0 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3830618688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b40aecf0 msgr2=0x7f57b40af180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3830618688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b40aecf0 0x7f57b40af180 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f57b406acb0 tx=0x7f57ac00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3830618688 shutdown_connections 2023-12-19T17:52:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3830618688 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b40aecf0 0x7f57b40af180 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3830618688 >> v2:172.21.15.73:3300/0 conn(0x7f57b40713d0 0x7f57b4071830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3830618688 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b4159a40 0x7f57b40ae090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3830618688 >> 172.21.15.45:0/3830618688 conn(0x7f57b40cf5a0 msgr2=0x7f57b4070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3830618688 shutdown_connections 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.769+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3830618688 wait complete. 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 Processor -- start 2023-12-19T17:52:43.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 -- start start 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b40aecf0 0x7f57b413cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b4159a40 0x7f57b41f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 0x7f57b4151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b413f570 con 0x7f57b41f4590 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b413f850 con 0x7f57b4159a40 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b9b2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b413fb30 con 0x7f57b40aecf0 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b932d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 0x7f57b4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b932d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 0x7f57b4151770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55024/0 (socket says 172.21.15.45:55024) 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b932d700 1 -- 172.21.15.45:0/3095264433 learned_addr learned my addr 172.21.15.45:0/3095264433 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.773+0000 7f57b3fff700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b4159a40 0x7f57b41f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b8b2c700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b40aecf0 0x7f57b413cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b932d700 1 -- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b40aecf0 msgr2=0x7f57b413cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b932d700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b40aecf0 0x7f57b413cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b932d700 1 -- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b4159a40 msgr2=0x7f57b41f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b932d700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b4159a40 0x7f57b41f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b932d700 1 -- 172.21.15.45:0/3095264433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a00094b0 con 0x7f57b41f4590 2023-12-19T17:52:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b932d700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 0x7f57b4151770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b370 tx=0x7f57ac004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac0099b0 con 0x7f57b41f4590 2023-12-19T17:52:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57ac0092e0 con 0x7f57b41f4590 2023-12-19T17:52:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac009b30 con 0x7f57b41f4590 2023-12-19T17:52:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57ac004470 con 0x7f57b41f4590 2023-12-19T17:52:43.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b413d010 con 0x7f57b41f4590 2023-12-19T17:52:43.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.777+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b4140330 con 0x7f57b41f4590 2023-12-19T17:52:43.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.781+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57ac0045d0 con 0x7f57b41f4590 2023-12-19T17:52:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.781+0000 7f57b17fa700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5798065ad0 0x7f5798067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.781+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f57ac006e40 con 0x7f57b41f4590 2023-12-19T17:52:43.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.781+0000 7f57b8b2c700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5798065ad0 0x7f5798067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:43.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.785+0000 7f57b8b2c700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5798065ad0 0x7f5798067f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009b40 tx=0x7f57a80091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:43.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.789+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57b4140330 con 0x7f57b41f4590 2023-12-19T17:52:43.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.965+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57b4140330 con 0x7f57b41f4590 2023-12-19T17:52:43.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.965+0000 7f57b17fa700 1 -- 172.21.15.45:0/3095264433 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57b4140330 con 0x7f57b41f4590 2023-12-19T17:52:43.969 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5798065ad0 msgr2=0x7f5798067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5798065ad0 0x7f5798067f90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009b40 tx=0x7f57a80091c0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 msgr2=0x7f57b4151770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:43.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 0x7f57b4151770 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f57ac00b370 tx=0x7f57ac004b40 comp rx=0 tx=0).stop 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 shutdown_connections 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5798065ad0 0x7f5798067f90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57b41f4590 0x7f57b4151770 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57b4159a40 0x7f57b41f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 --2- 172.21.15.45:0/3095264433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57b40aecf0 0x7f57b413cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 >> 172.21.15.45:0/3095264433 conn(0x7f57b40713d0 msgr2=0x7f57b406db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 shutdown_connections 2023-12-19T17:52:43.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:43.969+0000 7f57b9b2e700 1 -- 172.21.15.45:0/3095264433 wait complete. 2023-12-19T17:52:43.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.173+0000 7efe79589700 1 Processor -- start 2023-12-19T17:52:44.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 -- start start 2023-12-19T17:52:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe7415cf20 0x7efe740d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe740b8580 0x7efe740cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe740d25f0 0x7efe740cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe7415d300 con 0x7efe740d25f0 2023-12-19T17:52:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe740d1550 con 0x7efe740b8580 2023-12-19T17:52:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe79589700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe740d1830 con 0x7efe7415cf20 2023-12-19T17:52:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe740b8580 0x7efe740cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe737fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe740d25f0 0x7efe740cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe740b8580 0x7efe740cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:56566/0 (socket says 172.21.15.45:56566) 2023-12-19T17:52:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 -- 172.21.15.45:0/1372095620 learned_addr learned my addr 172.21.15.45:0/1372095620 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe72ffd700 1 --2- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe7415cf20 0x7efe740d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 -- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe7415cf20 msgr2=0x7efe740d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 --2- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe7415cf20 0x7efe740d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 -- 172.21.15.45:0/1372095620 >> v2:172.21.15.45:3300/0 conn(0x7efe740d25f0 msgr2=0x7efe740cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 --2- 172.21.15.45:0/1372095620 >> v2:172.21.15.45:3300/0 conn(0x7efe740d25f0 0x7efe740cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 -- 172.21.15.45:0/1372095620 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe740d1b10 con 0x7efe740b8580 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe737fe700 1 --2- 172.21.15.45:0/1372095620 >> v2:172.21.15.45:3300/0 conn(0x7efe740d25f0 0x7efe740cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.177+0000 7efe727fc700 1 --2- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe740b8580 0x7efe740cd8c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efe74072d00 tx=0x7efe68009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2e090dd9f0dfd33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe71ffb700 1 -- 172.21.15.45:0/1372095620 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68011830 con 0x7efe740b8580 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe71ffb700 1 -- 172.21.15.45:0/1372095620 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe68011990 con 0x7efe740b8580 2023-12-19T17:52:44.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe71ffb700 1 -- 172.21.15.45:0/1372095620 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68011d20 con 0x7efe740b8580 2023-12-19T17:52:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 -- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe740b8580 msgr2=0x7efe740cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 --2- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe740b8580 0x7efe740cd8c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7efe74072d00 tx=0x7efe68009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 -- 172.21.15.45:0/1372095620 shutdown_connections 2023-12-19T17:52:44.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 --2- 172.21.15.45:0/1372095620 >> v2:172.21.15.45:3300/0 conn(0x7efe740d25f0 0x7efe740cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 --2- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe740b8580 0x7efe740cd8c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 --2- 172.21.15.45:0/1372095620 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe7415cf20 0x7efe740d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 -- 172.21.15.45:0/1372095620 >> 172.21.15.45:0/1372095620 conn(0x7efe740b4670 msgr2=0x7efe740b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 -- 172.21.15.45:0/1372095620 shutdown_connections 2023-12-19T17:52:44.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.181+0000 7efe79589700 1 -- 172.21.15.45:0/1372095620 wait complete. 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 Processor -- start 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 -- start start 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe740b8580 0x7efe74157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 0x7efe7415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe7415cf20 0x7efe7415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7415d4d0 con 0x7efe740d25f0 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7415e050 con 0x7efe7415cf20 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe79589700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe74152110 con 0x7efe740b8580 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe727fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 0x7efe7415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe727fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 0x7efe7415e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55034/0 (socket says 172.21.15.45:55034) 2023-12-19T17:52:44.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe727fc700 1 -- 172.21.15.45:0/3218781521 learned_addr learned my addr 172.21.15.45:0/3218781521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:44.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe737fe700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe7415cf20 0x7efe7415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.185+0000 7efe72ffd700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe740b8580 0x7efe74157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe727fc700 1 -- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe740b8580 msgr2=0x7efe74157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe727fc700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe740b8580 0x7efe74157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe727fc700 1 -- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe7415cf20 msgr2=0x7efe7415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe727fc700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe7415cf20 0x7efe7415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe727fc700 1 -- 172.21.15.45:0/3218781521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6c009a70 con 0x7efe740d25f0 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe737fe700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe7415cf20 0x7efe7415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe727fc700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 0x7efe7415e4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe740d1690 tx=0x7efe68004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68004450 con 0x7efe740d25f0 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe680045b0 con 0x7efe740d25f0 2023-12-19T17:52:44.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe68003900 con 0x7efe740d25f0 2023-12-19T17:52:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe68009570 con 0x7efe740d25f0 2023-12-19T17:52:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7415da00 con 0x7efe740d25f0 2023-12-19T17:52:44.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.189+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe7415e1e0 con 0x7efe740d25f0 2023-12-19T17:52:44.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.193+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe68003a60 con 0x7efe740d25f0 2023-12-19T17:52:44.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.193+0000 7efe5b7fe700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe60065b00 0x7efe60067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.193+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efe68084490 con 0x7efe740d25f0 2023-12-19T17:52:44.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.193+0000 7efe72ffd700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe60065b00 0x7efe60067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.197+0000 7efe72ffd700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe60065b00 0x7efe60067fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe64009ad0 tx=0x7efe64009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:44.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.201+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efe680519e0 con 0x7efe740d25f0 2023-12-19T17:52:44.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.377+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efe7404ed30 con 0x7efe740d25f0 2023-12-19T17:52:44.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe5b7fe700 1 -- 172.21.15.45:0/3218781521 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efe68055000 con 0x7efe740d25f0 2023-12-19T17:52:44.383 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:44.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe60065b00 msgr2=0x7efe60067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe60065b00 0x7efe60067fc0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7efe64009ad0 tx=0x7efe64009240 comp rx=0 tx=0).stop 2023-12-19T17:52:44.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 msgr2=0x7efe7415e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 0x7efe7415e4e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe740d1690 tx=0x7efe68004770 comp rx=0 tx=0).stop 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 shutdown_connections 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe60065b00 0x7efe60067fc0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe7415cf20 0x7efe7415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe740d25f0 0x7efe7415e4e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 --2- 172.21.15.45:0/3218781521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe740b8580 0x7efe74157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 >> 172.21.15.45:0/3218781521 conn(0x7efe740b4670 msgr2=0x7efe740b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 shutdown_connections 2023-12-19T17:52:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.381+0000 7efe79589700 1 -- 172.21.15.45:0/3218781521 wait complete. 2023-12-19T17:52:44.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:44.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.597+0000 7f8348c4a700 1 Processor -- start 2023-12-19T17:52:44.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.597+0000 7f8348c4a700 1 -- start start 2023-12-19T17:52:44.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8348c4a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f834415d090 0x7f83440d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8348c4a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83440cdff0 0x7f83440cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8348c4a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83440cfd70 0x7f834406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8348c4a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83440b6040 con 0x7f83440cfd70 2023-12-19T17:52:44.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8348c4a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83440d01e0 con 0x7f83440cdff0 2023-12-19T17:52:44.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8348c4a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83440d10e0 con 0x7f834415d090 2023-12-19T17:52:44.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f834259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f834415d090 0x7f83440d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83440cdff0 0x7f83440cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8342d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83440cfd70 0x7f834406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f834259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f834415d090 0x7f83440d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:36302/0 (socket says 172.21.15.45:36302) 2023-12-19T17:52:44.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f834259c700 1 -- 172.21.15.45:0/45849859 learned_addr learned my addr 172.21.15.45:0/45849859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:44.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 -- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f834415d090 msgr2=0x7f83440d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 --2- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f834415d090 0x7f83440d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 -- 172.21.15.45:0/45849859 >> v2:172.21.15.45:3300/0 conn(0x7f83440cfd70 msgr2=0x7f834406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 --2- 172.21.15.45:0/45849859 >> v2:172.21.15.45:3300/0 conn(0x7f83440cfd70 0x7f834406ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 -- 172.21.15.45:0/45849859 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83440d13c0 con 0x7f83440cdff0 2023-12-19T17:52:44.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f8341d9b700 1 --2- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cdff0 0x7f83440cf830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83440d0430 tx=0x7f8338009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=384cc1450d16e9fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.601+0000 7f834159a700 1 -- 172.21.15.45:0/45849859 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338011830 con 0x7f83440cdff0 2023-12-19T17:52:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f834159a700 1 -- 172.21.15.45:0/45849859 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8338011990 con 0x7f83440cdff0 2023-12-19T17:52:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f834159a700 1 -- 172.21.15.45:0/45849859 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8338011d20 con 0x7f83440cdff0 2023-12-19T17:52:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 -- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cdff0 msgr2=0x7f83440cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 --2- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cdff0 0x7f83440cf830 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83440d0430 tx=0x7f8338009b30 comp rx=0 tx=0).stop 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 -- 172.21.15.45:0/45849859 shutdown_connections 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 --2- 172.21.15.45:0/45849859 >> v2:172.21.15.45:3300/0 conn(0x7f83440cfd70 0x7f834406ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 --2- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cdff0 0x7f83440cf830 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 --2- 172.21.15.45:0/45849859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f834415d090 0x7f83440d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 -- 172.21.15.45:0/45849859 >> 172.21.15.45:0/45849859 conn(0x7f83440b4b90 msgr2=0x7f83440b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 -- 172.21.15.45:0/45849859 shutdown_connections 2023-12-19T17:52:44.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 -- 172.21.15.45:0/45849859 wait complete. 2023-12-19T17:52:44.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.605+0000 7f8348c4a700 1 Processor -- start 2023-12-19T17:52:44.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 -- start start 2023-12-19T17:52:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83440cdff0 0x7f83440a9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cfd70 0x7f83440c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 0x7f83441f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440aa0d0 con 0x7f834415d090 2023-12-19T17:52:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83440aa3b0 con 0x7f83440cfd70 2023-12-19T17:52:44.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83440aa690 con 0x7f83440cdff0 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 0x7f83441f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 0x7f83441f22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55052/0 (socket says 172.21.15.45:55052) 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 -- 172.21.15.45:0/1512398086 learned_addr learned my addr 172.21.15.45:0/1512398086 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f834259c700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83440cdff0 0x7f83440a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8341d9b700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cfd70 0x7f83440c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 -- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83440cdff0 msgr2=0x7f83440a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83440cdff0 0x7f83440a9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 -- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cfd70 msgr2=0x7f83440c8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cfd70 0x7f83440c8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 -- 172.21.15.45:0/1512398086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380094b0 con 0x7f834415d090 2023-12-19T17:52:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8342d9d700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 0x7f83441f22e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f833c00eed0 tx=0x7f833c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c010040 con 0x7f834415d090 2023-12-19T17:52:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c00bc80 con 0x7f834415d090 2023-12-19T17:52:44.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834415d470 con 0x7f834415d090 2023-12-19T17:52:44.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c009e40 con 0x7f834415d090 2023-12-19T17:52:44.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.609+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83440a9d50 con 0x7f834415d090 2023-12-19T17:52:44.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.613+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f834404ed30 con 0x7f834415d090 2023-12-19T17:52:44.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.613+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f833c014400 con 0x7f834415d090 2023-12-19T17:52:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.617+0000 7f8332ffd700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8324065ad0 0x7f8324067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.617+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f833c0839c0 con 0x7f834415d090 2023-12-19T17:52:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.617+0000 7f834259c700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8324065ad0 0x7f8324067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:44.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.617+0000 7f834259c700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8324065ad0 0x7f8324067f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8334009b50 tx=0x7f83340092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:44.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.621+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f833c050f10 con 0x7f834415d090 2023-12-19T17:52:44.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.801+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f834415c4b0 con 0x7f834415d090 2023-12-19T17:52:44.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8332ffd700 1 -- 172.21.15.45:0/1512398086 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f833c054530 con 0x7f834415d090 2023-12-19T17:52:44.807 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8324065ad0 msgr2=0x7f8324067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8324065ad0 0x7f8324067f90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8334009b50 tx=0x7f83340092e0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 msgr2=0x7f83441f22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 0x7f83441f22e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f833c00eed0 tx=0x7f833c00b390 comp rx=0 tx=0).stop 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 shutdown_connections 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8324065ad0 0x7f8324067f90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f834415d090 0x7f83441f22e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83440cfd70 0x7f83440c8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 --2- 172.21.15.45:0/1512398086 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83440cdff0 0x7f83440a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 >> 172.21.15.45:0/1512398086 conn(0x7f83440b4b90 msgr2=0x7f83440cc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 shutdown_connections 2023-12-19T17:52:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:44.805+0000 7f8348c4a700 1 -- 172.21.15.45:0/1512398086 wait complete. 2023-12-19T17:52:44.831 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.021+0000 7f3ecedef700 1 Processor -- start 2023-12-19T17:52:45.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecedef700 1 -- start start 2023-12-19T17:52:45.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecedef700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ec80b39b0 0x7f3ec80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecedef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec815cde0 0x7f3ec815d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecedef700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ec80b3060 con 0x7f3ec8153a20 2023-12-19T17:52:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecedef700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ec815d790 con 0x7f3ec80b39b0 2023-12-19T17:52:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecedef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815dd10 con 0x7f3ec815cde0 2023-12-19T17:52:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecdded700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3ec8153a20 0x7f3ec80b32a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:43030/0 (socket says 172.21.15.45:43030) 2023-12-19T17:52:45.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.025+0000 7f3ecdded700 1 -- 172.21.15.45:0/2959775296 learned_addr learned my addr 172.21.15.45:0/2959775296 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ece5ee700 1 --2- 172.21.15.45:0/2959775296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec815cde0 0x7f3ec815d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ecd5ec700 1 --2- 172.21.15.45:0/2959775296 >> v2:172.21.15.73:3300/0 conn(0x7f3ec80b39b0 0x7f3ec80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3eccdeb700 1 -- 172.21.15.45:0/2959775296 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 444834655 0 0) 0x7f3ec80b3060 con 0x7f3ec8153a20 2023-12-19T17:52:45.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3eccdeb700 1 -- 172.21.15.45:0/2959775296 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3eb40046e0 con 0x7f3ec8153a20 2023-12-19T17:52:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ece5ee700 1 -- 172.21.15.45:0/2959775296 >> v2:172.21.15.73:3300/0 conn(0x7f3ec80b39b0 msgr2=0x7f3ec80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ece5ee700 1 --2- 172.21.15.45:0/2959775296 >> v2:172.21.15.73:3300/0 conn(0x7f3ec80b39b0 0x7f3ec80b2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ece5ee700 1 -- 172.21.15.45:0/2959775296 >> v1:172.21.15.73:6789/0 conn(0x7f3ec8153a20 legacy=0x7f3ec80b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ece5ee700 1 -- 172.21.15.45:0/2959775296 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec815da30 con 0x7f3ec815cde0 2023-12-19T17:52:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ece5ee700 1 --2- 172.21.15.45:0/2959775296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec815cde0 0x7f3ec815d250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009d90 tx=0x7f3ec000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3391ec28140773c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3eccdeb700 1 -- 172.21.15.45:0/2959775296 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000e070 con 0x7f3ec815cde0 2023-12-19T17:52:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3eccdeb700 1 -- 172.21.15.45:0/2959775296 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ec000bb20 con 0x7f3ec815cde0 2023-12-19T17:52:45.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3eccdeb700 1 -- 172.21.15.45:0/2959775296 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0012430 con 0x7f3ec815cde0 2023-12-19T17:52:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ecedef700 1 -- 172.21.15.45:0/2959775296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec815cde0 msgr2=0x7f3ec815d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.029+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2959775296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec815cde0 0x7f3ec815d250 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0009d90 tx=0x7f3ec000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:45.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 -- 172.21.15.45:0/2959775296 shutdown_connections 2023-12-19T17:52:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2959775296 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec815cde0 0x7f3ec815d250 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2959775296 >> v2:172.21.15.73:3300/0 conn(0x7f3ec80b39b0 0x7f3ec80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 -- 172.21.15.45:0/2959775296 >> 172.21.15.45:0/2959775296 conn(0x7f3ec806a010 msgr2=0x7f3ec806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 -- 172.21.15.45:0/2959775296 shutdown_connections 2023-12-19T17:52:45.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 -- 172.21.15.45:0/2959775296 wait complete. 2023-12-19T17:52:45.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.033+0000 7f3ecedef700 1 Processor -- start 2023-12-19T17:52:45.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 -- start start 2023-12-19T17:52:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec80b39b0 0x7f3ec815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 0x7f3ec81568a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815cde0 0x7f3ec814fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815a190 con 0x7f3ec8153a20 2023-12-19T17:52:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815a710 con 0x7f3ec815cde0 2023-12-19T17:52:45.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecedef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec815c580 con 0x7f3ec80b39b0 2023-12-19T17:52:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 0x7f3ec81568a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 0x7f3ec81568a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55066/0 (socket says 172.21.15.45:55066) 2023-12-19T17:52:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 -- 172.21.15.45:0/2344442215 learned_addr learned my addr 172.21.15.45:0/2344442215 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecdded700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec80b39b0 0x7f3ec815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ece5ee700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815cde0 0x7f3ec814fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 -- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec80b39b0 msgr2=0x7f3ec815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec80b39b0 0x7f3ec815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 -- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815cde0 msgr2=0x7f3ec814fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815cde0 0x7f3ec814fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.037+0000 7f3ecd5ec700 1 -- 172.21.15.45:0/2344442215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec0009a70 con 0x7f3ec8153a20 2023-12-19T17:52:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ecd5ec700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 0x7f3ec81568a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ea00 tx=0x7f3eb800ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb8009720 con 0x7f3ec8153a20 2023-12-19T17:52:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb800eea0 con 0x7f3ec8153a20 2023-12-19T17:52:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec8156de0 con 0x7f3ec8153a20 2023-12-19T17:52:45.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb800ca50 con 0x7f3ec8153a20 2023-12-19T17:52:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec815c2a0 con 0x7f3ec8153a20 2023-12-19T17:52:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ec8067260 con 0x7f3ec8153a20 2023-12-19T17:52:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.041+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3eb800cc10 con 0x7f3ec8153a20 2023-12-19T17:52:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.045+0000 7f3ebe7fc700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3eac065b00 0x7f3eac067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.045+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3eb80837f0 con 0x7f3ec8153a20 2023-12-19T17:52:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.045+0000 7f3ecdded700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3eac065b00 0x7f3eac067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.045+0000 7f3ecdded700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3eac065b00 0x7f3eac067fc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4007fd0 tx=0x7f3ec4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:45.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.049+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3eb8050de0 con 0x7f3ec8153a20 2023-12-19T17:52:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.225+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3ec815a8c0 con 0x7f3ec8153a20 2023-12-19T17:52:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ebe7fc700 1 -- 172.21.15.45:0/2344442215 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3ec815a8c0 con 0x7f3ec8153a20 2023-12-19T17:52:45.231 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:45.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3eac065b00 msgr2=0x7f3eac067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3eac065b00 0x7f3eac067fc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4007fd0 tx=0x7f3ec4007de0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 msgr2=0x7f3ec81568a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 0x7f3ec81568a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f3eb800ea00 tx=0x7f3eb800ed10 comp rx=0 tx=0).stop 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 shutdown_connections 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3eac065b00 0x7f3eac067fc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ec815cde0 0x7f3ec814fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ec8153a20 0x7f3ec81568a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 --2- 172.21.15.45:0/2344442215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ec80b39b0 0x7f3ec815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 >> 172.21.15.45:0/2344442215 conn(0x7f3ec806a010 msgr2=0x7f3ec80b32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 shutdown_connections 2023-12-19T17:52:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.229+0000 7f3ecedef700 1 -- 172.21.15.45:0/2344442215 wait complete. 2023-12-19T17:52:45.253 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.433+0000 7fb1b8876700 1 Processor -- start 2023-12-19T17:52:45.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.433+0000 7fb1b8876700 1 -- start start 2023-12-19T17:52:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b8876700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406ea90 0x7fb1b40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b8876700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1b406fe80 0x7fb1b40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b8876700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b40d1820 con 0x7fb1b40b88b0 2023-12-19T17:52:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b8876700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b40d1b00 con 0x7fb1b406fe80 2023-12-19T17:52:45.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b8876700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b40d1de0 con 0x7fb1b406ea90 2023-12-19T17:52:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b2ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb1b40b88b0 0x7fb1b40b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56120/0 (socket says 172.21.15.45:56120) 2023-12-19T17:52:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b2ffd700 1 -- 172.21.15.45:0/2490687896 learned_addr learned my addr 172.21.15.45:0/2490687896 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b37fe700 1 --2- 172.21.15.45:0/2490687896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406ea90 0x7fb1b40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b3fff700 1 --2- 172.21.15.45:0/2490687896 >> v2:172.21.15.45:3300/0 conn(0x7fb1b406fe80 0x7fb1b40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b27fc700 1 -- 172.21.15.45:0/2490687896 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 905032126 0 0) 0x7fb1b40d1820 con 0x7fb1b40b88b0 2023-12-19T17:52:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b27fc700 1 -- 172.21.15.45:0/2490687896 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb19c0035d0 con 0x7fb1b40b88b0 2023-12-19T17:52:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b37fe700 1 -- 172.21.15.45:0/2490687896 >> v2:172.21.15.45:3300/0 conn(0x7fb1b406fe80 msgr2=0x7fb1b40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b37fe700 1 --2- 172.21.15.45:0/2490687896 >> v2:172.21.15.45:3300/0 conn(0x7fb1b406fe80 0x7fb1b40b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b37fe700 1 -- 172.21.15.45:0/2490687896 >> v1:172.21.15.45:6789/0 conn(0x7fb1b40b88b0 legacy=0x7fb1b40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b37fe700 1 -- 172.21.15.45:0/2490687896 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b40d20c0 con 0x7fb1b406ea90 2023-12-19T17:52:45.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.437+0000 7fb1b37fe700 1 --2- 172.21.15.45:0/2490687896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406ea90 0x7fb1b40d0f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009850 tx=0x7fb1a4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1907a57ca5e52876 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:45.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b27fc700 1 -- 172.21.15.45:0/2490687896 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4011830 con 0x7fb1b406ea90 2023-12-19T17:52:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b27fc700 1 -- 172.21.15.45:0/2490687896 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a4011990 con 0x7fb1b406ea90 2023-12-19T17:52:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b27fc700 1 -- 172.21.15.45:0/2490687896 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a4011d40 con 0x7fb1b406ea90 2023-12-19T17:52:45.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 -- 172.21.15.45:0/2490687896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406ea90 msgr2=0x7fb1b40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 --2- 172.21.15.45:0/2490687896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406ea90 0x7fb1b40d0f20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009850 tx=0x7fb1a4009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 -- 172.21.15.45:0/2490687896 shutdown_connections 2023-12-19T17:52:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 --2- 172.21.15.45:0/2490687896 >> v2:172.21.15.45:3300/0 conn(0x7fb1b406fe80 0x7fb1b40b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 --2- 172.21.15.45:0/2490687896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406ea90 0x7fb1b40d0f20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 -- 172.21.15.45:0/2490687896 >> 172.21.15.45:0/2490687896 conn(0x7fb1b40b46d0 msgr2=0x7fb1b40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 -- 172.21.15.45:0/2490687896 shutdown_connections 2023-12-19T17:52:45.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.441+0000 7fb1b8876700 1 -- 172.21.15.45:0/2490687896 wait complete. 2023-12-19T17:52:45.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 Processor -- start 2023-12-19T17:52:45.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 -- start start 2023-12-19T17:52:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b406ea90 0x7fb1b41f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406fe80 0x7fb1b41f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 0x7fb1b4156120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41f2610 con 0x7fb1b40b88b0 2023-12-19T17:52:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41f65d0 con 0x7fb1b406ea90 2023-12-19T17:52:45.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b8876700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b41f2840 con 0x7fb1b406fe80 2023-12-19T17:52:45.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 0x7fb1b4156120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 0x7fb1b4156120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55082/0 (socket says 172.21.15.45:55082) 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b3fff700 1 -- 172.21.15.45:0/3887524326 learned_addr learned my addr 172.21.15.45:0/3887524326 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b2ffd700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406fe80 0x7fb1b41f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.445+0000 7fb1b37fe700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b406ea90 0x7fb1b41f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b3fff700 1 -- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406fe80 msgr2=0x7fb1b41f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b3fff700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406fe80 0x7fb1b41f6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b3fff700 1 -- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b406ea90 msgr2=0x7fb1b41f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b3fff700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b406ea90 0x7fb1b41f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b3fff700 1 -- 172.21.15.45:0/3887524326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40094b0 con 0x7fb1b40b88b0 2023-12-19T17:52:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b3fff700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 0x7fb1b4156120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00efc0 tx=0x7fb1ac00c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00cad0 con 0x7fb1b40b88b0 2023-12-19T17:52:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1ac00f040 con 0x7fb1b40b88b0 2023-12-19T17:52:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b41f2b20 con 0x7fb1b40b88b0 2023-12-19T17:52:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac00ce70 con 0x7fb1b40b88b0 2023-12-19T17:52:45.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b4156f30 con 0x7fb1b40b88b0 2023-12-19T17:52:45.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.449+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b41f3040 con 0x7fb1b40b88b0 2023-12-19T17:52:45.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.453+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb1ac014480 con 0x7fb1b40b88b0 2023-12-19T17:52:45.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.453+0000 7fb19bfff700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1a0065ad0 0x7fb1a0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:45.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.453+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fb1ac083be0 con 0x7fb1b40b88b0 2023-12-19T17:52:45.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.453+0000 7fb1b37fe700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1a0065ad0 0x7fb1a0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:45.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.453+0000 7fb1b37fe700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1a0065ad0 0x7fb1a0067f90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40090b0 tx=0x7fb1a401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:45.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.461+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb1ac051300 con 0x7fb1b40b88b0 2023-12-19T17:52:45.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.665+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1b4067760 con 0x7fb1b40b88b0 2023-12-19T17:52:45.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.669+0000 7fb19bfff700 1 -- 172.21.15.45:0/3887524326 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1ac018020 con 0x7fb1b40b88b0 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1a0065ad0 msgr2=0x7fb1a0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1a0065ad0 0x7fb1a0067f90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb1a40090b0 tx=0x7fb1a401c040 comp rx=0 tx=0).stop 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 msgr2=0x7fb1b4156120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 0x7fb1b4156120 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00efc0 tx=0x7fb1ac00c0c0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 shutdown_connections 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1a0065ad0 0x7fb1a0067f90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1b40b88b0 0x7fb1b4156120 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1b406fe80 0x7fb1b41f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 --2- 172.21.15.45:0/3887524326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb1b406ea90 0x7fb1b41f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:45.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 >> 172.21.15.45:0/3887524326 conn(0x7fb1b40b46d0 msgr2=0x7fb1b40b3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 shutdown_connections 2023-12-19T17:52:45.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:45.673+0000 7fb1b8876700 1 -- 172.21.15.45:0/3887524326 wait complete. 2023-12-19T17:52:45.681 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:45.699 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2023-12-19T17:52:45.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:45.699 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-19T17:52:45.750 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:52:45.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:52:45.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:45.751 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T17:52:45.777 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:52:45.778 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:45.797 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:52:45.797 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:45.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.069+0000 7f5584988700 1 Processor -- start 2023-12-19T17:52:46.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.069+0000 7f5584988700 1 -- start start 2023-12-19T17:52:46.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5584988700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f558015ae20 0x7f558015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5584988700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f55800af720 0x7f55800afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5584988700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558006f0a0 con 0x7f558006cad0 2023-12-19T17:52:46.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5584988700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55800b00d0 con 0x7f558015ae20 2023-12-19T17:52:46.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5584988700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558006ea90 con 0x7f55800af720 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f558015ae20 0x7f558015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5577fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f558006cad0 0x7f55800c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56124/0 (socket says 172.21.15.45:56124) 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f5577fff700 1 -- 172.21.15.45:0/162922616 learned_addr learned my addr 172.21.15.45:0/162922616 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557f59e700 1 --2- 172.21.15.45:0/162922616 >> v2:172.21.15.73:3300/0 conn(0x7f55800af720 0x7f55800afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557ed9d700 1 -- 172.21.15.45:0/162922616 >> v2:172.21.15.73:3300/0 conn(0x7f55800af720 msgr2=0x7f55800afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557ed9d700 1 --2- 172.21.15.45:0/162922616 >> v2:172.21.15.73:3300/0 conn(0x7f55800af720 0x7f55800afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557ed9d700 1 -- 172.21.15.45:0/162922616 >> v1:172.21.15.45:6789/0 conn(0x7f558006cad0 legacy=0x7f55800c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557ed9d700 1 -- 172.21.15.45:0/162922616 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55800c3f60 con 0x7f558015ae20 2023-12-19T17:52:46.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.073+0000 7f557e59c700 1 -- 172.21.15.45:0/162922616 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2726511022 0 0) 0x7f558006f0a0 con 0x7f558006cad0 2023-12-19T17:52:46.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f557ed9d700 1 --2- 172.21.15.45:0/162922616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558015ae20 0x7f558015be40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55800cc270 tx=0x7f5570009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=840d450276288d38 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f557e59c700 1 -- 172.21.15.45:0/162922616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011830 con 0x7f558015ae20 2023-12-19T17:52:46.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f557e59c700 1 -- 172.21.15.45:0/162922616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5570011990 con 0x7f558015ae20 2023-12-19T17:52:46.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f557e59c700 1 -- 172.21.15.45:0/162922616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570011d20 con 0x7f558015ae20 2023-12-19T17:52:46.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 -- 172.21.15.45:0/162922616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558015ae20 msgr2=0x7f558015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 --2- 172.21.15.45:0/162922616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558015ae20 0x7f558015be40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f55800cc270 tx=0x7f5570009b30 comp rx=0 tx=0).stop 2023-12-19T17:52:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 -- 172.21.15.45:0/162922616 shutdown_connections 2023-12-19T17:52:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 --2- 172.21.15.45:0/162922616 >> v2:172.21.15.73:3300/0 conn(0x7f55800af720 0x7f55800afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 --2- 172.21.15.45:0/162922616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558015ae20 0x7f558015be40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 -- 172.21.15.45:0/162922616 >> 172.21.15.45:0/162922616 conn(0x7f55800cb900 msgr2=0x7f55800b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 -- 172.21.15.45:0/162922616 shutdown_connections 2023-12-19T17:52:46.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.077+0000 7f5584988700 1 -- 172.21.15.45:0/162922616 wait complete. 2023-12-19T17:52:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 Processor -- start 2023-12-19T17:52:46.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 -- start start 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 0x7f558006fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55800af720 0x7f55800b2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f558015ae20 0x7f558014b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55801f3680 con 0x7f558006cad0 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55801f2a70 con 0x7f558015ae20 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5584988700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55801f2d50 con 0x7f55800af720 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 0x7f558006fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 0x7f558006fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55102/0 (socket says 172.21.15.45:55102) 2023-12-19T17:52:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 -- 172.21.15.45:0/476538963 learned_addr learned my addr 172.21.15.45:0/476538963 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:46.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557f59e700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f558015ae20 0x7f558014b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f5577fff700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55800af720 0x7f55800b2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 -- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55800af720 msgr2=0x7f55800b2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55800af720 0x7f55800b2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 -- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f558015ae20 msgr2=0x7f558014b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f558015ae20 0x7f558014b3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.081+0000 7f557ed9d700 1 -- 172.21.15.45:0/476538963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55700094b0 con 0x7f558006cad0 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f557ed9d700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 0x7f558006fb90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5570014040 tx=0x7f5570004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55700036c0 con 0x7f558006cad0 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557001e070 con 0x7f558006cad0 2023-12-19T17:52:46.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55801f3030 con 0x7f558006cad0 2023-12-19T17:52:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5570003a80 con 0x7f558006cad0 2023-12-19T17:52:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55800700d0 con 0x7f558006cad0 2023-12-19T17:52:46.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5580067760 con 0x7f558006cad0 2023-12-19T17:52:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.085+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5570003be0 con 0x7f558006cad0 2023-12-19T17:52:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.089+0000 7f55777fe700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5560065b20 0x7f5560067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.089+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5570084340 con 0x7f558006cad0 2023-12-19T17:52:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.089+0000 7f5577fff700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5560065b20 0x7f5560067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.089+0000 7f5577fff700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5560065b20 0x7f5560067fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f55800cabf0 tx=0x7f5568007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.093+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5570051990 con 0x7f558006cad0 2023-12-19T17:52:46.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.277+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f558006d500 con 0x7f558006cad0 2023-12-19T17:52:46.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.281+0000 7f55777fe700 1 -- 172.21.15.45:0/476538963 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f5570054fb0 con 0x7f558006cad0 2023-12-19T17:52:46.284 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:46.284 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5560065b20 msgr2=0x7f5560067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5560065b20 0x7f5560067fe0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f55800cabf0 tx=0x7f5568007c00 comp rx=0 tx=0).stop 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 msgr2=0x7f558006fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 0x7f558006fb90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5570014040 tx=0x7f5570004770 comp rx=0 tx=0).stop 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 shutdown_connections 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5560065b20 0x7f5560067fe0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f558015ae20 0x7f558014b3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f55800af720 0x7f55800b2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 --2- 172.21.15.45:0/476538963 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f558006cad0 0x7f558006fb90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 >> 172.21.15.45:0/476538963 conn(0x7f55800cb900 msgr2=0x7f55801552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 shutdown_connections 2023-12-19T17:52:46.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.285+0000 7f5584988700 1 -- 172.21.15.45:0/476538963 wait complete. 2023-12-19T17:52:46.308 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:46.308 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.485+0000 7fa940fd2700 1 Processor -- start 2023-12-19T17:52:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.485+0000 7fa940fd2700 1 -- start start 2023-12-19T17:52:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa940fd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa940fd2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa93c071ae0 0x7fa93c0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa940fd2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c162700 con 0x7fa93c15b920 2023-12-19T17:52:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa940fd2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c0b2830 con 0x7fa93c071ae0 2023-12-19T17:52:46.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa940fd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0b1bb0 con 0x7fa93c15b540 2023-12-19T17:52:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa93c071ae0 0x7fa93c0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa932ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa93c15b920 0x7fa93c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56126/0 (socket says 172.21.15.45:56126) 2023-12-19T17:52:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa932ffd700 1 -- 172.21.15.45:0/2973189454 learned_addr learned my addr 172.21.15.45:0/2973189454 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:46.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93b7fe700 1 --2- 172.21.15.45:0/2973189454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93bfff700 1 -- 172.21.15.45:0/2973189454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 msgr2=0x7fa93c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93bfff700 1 --2- 172.21.15.45:0/2973189454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c1621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93bfff700 1 -- 172.21.15.45:0/2973189454 >> v1:172.21.15.45:6789/0 conn(0x7fa93c15b920 legacy=0x7fa93c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93bfff700 1 -- 172.21.15.45:0/2973189454 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c0b1e90 con 0x7fa93c071ae0 2023-12-19T17:52:46.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93affd700 1 -- 172.21.15.45:0/2973189454 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666177419 0 0) 0x7fa93c162700 con 0x7fa93c15b920 2023-12-19T17:52:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.489+0000 7fa93bfff700 1 --2- 172.21.15.45:0/2973189454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c071ae0 0x7fa93c0af8e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa934009d90 tx=0x7fa93400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e209089bf607c970 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa93affd700 1 -- 172.21.15.45:0/2973189454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93400e070 con 0x7fa93c071ae0 2023-12-19T17:52:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa93affd700 1 -- 172.21.15.45:0/2973189454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93400bb20 con 0x7fa93c071ae0 2023-12-19T17:52:46.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa93affd700 1 -- 172.21.15.45:0/2973189454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934012430 con 0x7fa93c071ae0 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 -- 172.21.15.45:0/2973189454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c071ae0 msgr2=0x7fa93c0af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2973189454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c071ae0 0x7fa93c0af8e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa934009d90 tx=0x7fa93400b330 comp rx=0 tx=0).stop 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 -- 172.21.15.45:0/2973189454 shutdown_connections 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2973189454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c071ae0 0x7fa93c0af8e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2973189454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 -- 172.21.15.45:0/2973189454 >> 172.21.15.45:0/2973189454 conn(0x7fa93c0cf5a0 msgr2=0x7fa93c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 -- 172.21.15.45:0/2973189454 shutdown_connections 2023-12-19T17:52:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.493+0000 7fa940fd2700 1 -- 172.21.15.45:0/2973189454 wait complete. 2023-12-19T17:52:46.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 Processor -- start 2023-12-19T17:52:46.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 -- start start 2023-12-19T17:52:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c149b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa93c15b920 0x7fa93c0cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 0x7fa93c15a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1561f0 con 0x7fa93c0cd890 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0cdd20 con 0x7fa93c15b920 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa940fd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c1555b0 con 0x7fa93c15b540 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa93bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 0x7fa93c15a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa93bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 0x7fa93c15a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55124/0 (socket says 172.21.15.45:55124) 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa93bfff700 1 -- 172.21.15.45:0/2249076103 learned_addr learned my addr 172.21.15.45:0/2249076103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa93b7fe700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa932ffd700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa93c15b920 0x7fa93c0cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa93bfff700 1 -- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 msgr2=0x7fa93c149b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.497+0000 7fa93bfff700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c149b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa93bfff700 1 -- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa93c15b920 msgr2=0x7fa93c0cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa93bfff700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa93c15b920 0x7fa93c0cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa93bfff700 1 -- 172.21.15.45:0/2249076103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934009a70 con 0x7fa93c0cd890 2023-12-19T17:52:46.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa93bfff700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 0x7fa93c15a1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa934014040 tx=0x7fa934004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934012430 con 0x7fa93c0cd890 2023-12-19T17:52:46.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa934020070 con 0x7fa93c0cd890 2023-12-19T17:52:46.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c14a050 con 0x7fa93c0cd890 2023-12-19T17:52:46.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa934004280 con 0x7fa93c0cd890 2023-12-19T17:52:46.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c155b30 con 0x7fa93c0cd890 2023-12-19T17:52:46.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.501+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93c1564f0 con 0x7fa93c0cd890 2023-12-19T17:52:46.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.505+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa9340043e0 con 0x7fa93c0cd890 2023-12-19T17:52:46.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.505+0000 7fa938ff9700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa91c065ad0 0x7fa91c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.505+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa934022070 con 0x7fa93c0cd890 2023-12-19T17:52:46.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.505+0000 7fa93b7fe700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa91c065ad0 0x7fa91c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.505+0000 7fa93b7fe700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa91c065ad0 0x7fa91c067f90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009be0 tx=0x7fa92c0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.513+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa934052c20 con 0x7fa93c0cd890 2023-12-19T17:52:46.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa93c156330 con 0x7fa93c0cd890 2023-12-19T17:52:46.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa938ff9700 1 -- 172.21.15.45:0/2249076103 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa93c156330 con 0x7fa93c0cd890 2023-12-19T17:52:46.695 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:46.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa91c065ad0 msgr2=0x7fa91c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa91c065ad0 0x7fa91c067f90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa92c009be0 tx=0x7fa92c0091c0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 msgr2=0x7fa93c15a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 0x7fa93c15a1a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa934014040 tx=0x7fa934004b40 comp rx=0 tx=0).stop 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 shutdown_connections 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.693+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa91c065ad0 0x7fa91c067f90 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.697+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa93c0cd890 0x7fa93c15a1a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.697+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa93c15b920 0x7fa93c0cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.697+0000 7fa940fd2700 1 --2- 172.21.15.45:0/2249076103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa93c15b540 0x7fa93c149b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.697+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 >> 172.21.15.45:0/2249076103 conn(0x7fa93c071ae0 msgr2=0x7fa93c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.697+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 shutdown_connections 2023-12-19T17:52:46.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.697+0000 7fa940fd2700 1 -- 172.21.15.45:0/2249076103 wait complete. 2023-12-19T17:52:46.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 Processor -- start 2023-12-19T17:52:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 -- start start 2023-12-19T17:52:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c15b540 0x7f9d7c1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9d7c15b920 0x7f9d7c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d7c162700 con 0x7f9d7c071910 2023-12-19T17:52:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d7c0b2830 con 0x7f9d7c15b920 2023-12-19T17:52:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d82bb5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c071da0 con 0x7f9d7c15b540 2023-12-19T17:52:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d823b4700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f9d7c071910 0x7f9d7c164d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:43036/0 (socket says 172.21.15.45:43036) 2023-12-19T17:52:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.901+0000 7f9d81bb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c15b540 0x7f9d7c1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d823b4700 1 -- 172.21.15.45:0/1700719008 learned_addr learned my addr 172.21.15.45:0/1700719008 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d813b2700 1 --2- 172.21.15.45:0/1700719008 >> v2:172.21.15.73:3300/0 conn(0x7f9d7c15b920 0x7f9d7c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d80bb1700 1 -- 172.21.15.45:0/1700719008 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973626252 0 0) 0x7f9d7c162700 con 0x7f9d7c071910 2023-12-19T17:52:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d80bb1700 1 -- 172.21.15.45:0/1700719008 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d680035d0 con 0x7f9d7c071910 2023-12-19T17:52:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d813b2700 1 -- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c15b540 msgr2=0x7f9d7c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d813b2700 1 --2- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c15b540 0x7f9d7c1621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d813b2700 1 -- 172.21.15.45:0/1700719008 >> v1:172.21.15.73:6789/0 conn(0x7f9d7c071910 legacy=0x7f9d7c164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d813b2700 1 -- 172.21.15.45:0/1700719008 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d7c0b08f0 con 0x7f9d7c15b920 2023-12-19T17:52:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d81bb3700 1 --2- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c15b540 0x7f9d7c1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:46.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d813b2700 1 --2- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c0713d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009850 tx=0x7f9d6c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e11fd70a5e4d8a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d80bb1700 1 -- 172.21.15.45:0/1700719008 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c011830 con 0x7f9d7c15b920 2023-12-19T17:52:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d80bb1700 1 -- 172.21.15.45:0/1700719008 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d6c011990 con 0x7f9d7c15b920 2023-12-19T17:52:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d80bb1700 1 -- 172.21.15.45:0/1700719008 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d6c011d40 con 0x7f9d7c15b920 2023-12-19T17:52:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d82bb5700 1 -- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 msgr2=0x7f9d7c0713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c0713d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009850 tx=0x7f9d6c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d82bb5700 1 -- 172.21.15.45:0/1700719008 shutdown_connections 2023-12-19T17:52:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c0713d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/1700719008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c15b540 0x7f9d7c1621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.905+0000 7f9d82bb5700 1 -- 172.21.15.45:0/1700719008 >> 172.21.15.45:0/1700719008 conn(0x7f9d7c0cf5a0 msgr2=0x7f9d7c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.909+0000 7f9d82bb5700 1 -- 172.21.15.45:0/1700719008 shutdown_connections 2023-12-19T17:52:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.909+0000 7f9d82bb5700 1 -- 172.21.15.45:0/1700719008 wait complete. 2023-12-19T17:52:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.909+0000 7f9d82bb5700 1 Processor -- start 2023-12-19T17:52:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.909+0000 7f9d82bb5700 1 -- start start 2023-12-19T17:52:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 0x7f9d7c147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c1f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c158590 0x7f9d7c155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c15d600 con 0x7f9d7c15b540 2023-12-19T17:52:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c147b90 con 0x7f9d7c15b920 2023-12-19T17:52:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7c1f6d90 con 0x7f9d7c158590 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 0x7f9d7c147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 0x7f9d7c147650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55134/0 (socket says 172.21.15.45:55134) 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 -- 172.21.15.45:0/2813035010 learned_addr learned my addr 172.21.15.45:0/2813035010 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d823b4700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c158590 0x7f9d7c155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d813b2700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c1f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 -- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c158590 msgr2=0x7f9d7c155fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c158590 0x7f9d7c155fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 -- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 msgr2=0x7f9d7c1f6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c1f6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 -- 172.21.15.45:0/2813035010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009450 con 0x7f9d7c15b540 2023-12-19T17:52:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d81bb3700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 0x7f9d7c147650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800ebe0 tx=0x7f9d7800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78005a40 con 0x7f9d7c15b540 2023-12-19T17:52:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78005ba0 con 0x7f9d7c15b540 2023-12-19T17:52:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7800c850 con 0x7f9d7c15b540 2023-12-19T17:52:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d6c0094b0 con 0x7f9d7c15b540 2023-12-19T17:52:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.913+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d7c1567d0 con 0x7f9d7c15b540 2023-12-19T17:52:46.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.917+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d7c04ed30 con 0x7f9d7c15b540 2023-12-19T17:52:46.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.917+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9d7800c9b0 con 0x7f9d7c15b540 2023-12-19T17:52:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.921+0000 7f9d727fc700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d60065ad0 0x7f9d60067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.921+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9d78083760 con 0x7f9d7c15b540 2023-12-19T17:52:46.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.921+0000 7f9d813b2700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d60065ad0 0x7f9d60067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:46.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.921+0000 7f9d813b2700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d60065ad0 0x7f9d60067f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0090b0 tx=0x7f9d6c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:46.925+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9d78050d50 con 0x7f9d7c15b540 2023-12-19T17:52:47.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.097+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9d7c0b2f00 con 0x7f9d7c15b540 2023-12-19T17:52:47.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.101+0000 7f9d727fc700 1 -- 172.21.15.45:0/2813035010 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9d78054370 con 0x7f9d7c15b540 2023-12-19T17:52:47.103 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:47.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.101+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d60065ad0 msgr2=0x7f9d60067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.101+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d60065ad0 0x7f9d60067f90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c0090b0 tx=0x7f9d6c01c040 comp rx=0 tx=0).stop 2023-12-19T17:52:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.101+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 msgr2=0x7f9d7c147650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.101+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 0x7f9d7c147650 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9d7800ebe0 tx=0x7f9d7800eef0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 shutdown_connections 2023-12-19T17:52:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d60065ad0 0x7f9d60067f90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d7c158590 0x7f9d7c155fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d7c15b920 0x7f9d7c1f6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 --2- 172.21.15.45:0/2813035010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d7c15b540 0x7f9d7c147650 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 >> 172.21.15.45:0/2813035010 conn(0x7f9d7c071910 msgr2=0x7f9d7c06da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:47.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 shutdown_connections 2023-12-19T17:52:47.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.105+0000 7f9d82bb5700 1 -- 172.21.15.45:0/2813035010 wait complete. 2023-12-19T17:52:47.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:47.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.317+0000 7ff1297d2700 1 Processor -- start 2023-12-19T17:52:47.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.317+0000 7ff1297d2700 1 -- start start 2023-12-19T17:52:47.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1297d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff12415cf20 0x7ff1240d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1297d2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1240cdfd0 0x7ff1240b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1297d2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff12415d300 con 0x7ff1240b8580 2023-12-19T17:52:47.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1297d2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1240d1550 con 0x7ff1240cdfd0 2023-12-19T17:52:47.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1297d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1240d1830 con 0x7ff12415cf20 2023-12-19T17:52:47.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1237fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff1240b8580 0x7ff1240cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56136/0 (socket says 172.21.15.45:56136) 2023-12-19T17:52:47.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff1237fe700 1 -- 172.21.15.45:0/1273598976 learned_addr learned my addr 172.21.15.45:0/1273598976 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:47.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff128fd1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1240cdfd0 0x7ff1240b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff123fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff12415cf20 0x7ff1240d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff122ffd700 1 -- 172.21.15.45:0/1273598976 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2860645464 0 0) 0x7ff12415d300 con 0x7ff1240b8580 2023-12-19T17:52:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff128fd1700 1 -- 172.21.15.45:0/1273598976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff12415cf20 msgr2=0x7ff1240d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff128fd1700 1 --2- 172.21.15.45:0/1273598976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff12415cf20 0x7ff1240d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff128fd1700 1 -- 172.21.15.45:0/1273598976 >> v1:172.21.15.45:6789/0 conn(0x7ff1240b8580 legacy=0x7ff1240cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff128fd1700 1 -- 172.21.15.45:0/1273598976 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1240d1b10 con 0x7ff1240cdfd0 2023-12-19T17:52:47.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.321+0000 7ff128fd1700 1 --2- 172.21.15.45:0/1273598976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1240cdfd0 0x7ff1240b5d20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009d90 tx=0x7ff11c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cde17153e3c9f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff122ffd700 1 -- 172.21.15.45:0/1273598976 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c00e070 con 0x7ff1240cdfd0 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff122ffd700 1 -- 172.21.15.45:0/1273598976 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c00bb20 con 0x7ff1240cdfd0 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff122ffd700 1 -- 172.21.15.45:0/1273598976 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c012430 con 0x7ff1240cdfd0 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 -- 172.21.15.45:0/1273598976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1240cdfd0 msgr2=0x7ff1240b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 --2- 172.21.15.45:0/1273598976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1240cdfd0 0x7ff1240b5d20 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009d90 tx=0x7ff11c00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 -- 172.21.15.45:0/1273598976 shutdown_connections 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 --2- 172.21.15.45:0/1273598976 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1240cdfd0 0x7ff1240b5d20 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 --2- 172.21.15.45:0/1273598976 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff12415cf20 0x7ff1240d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 -- 172.21.15.45:0/1273598976 >> 172.21.15.45:0/1273598976 conn(0x7ff1240b4670 msgr2=0x7ff1240b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 -- 172.21.15.45:0/1273598976 shutdown_connections 2023-12-19T17:52:47.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 -- 172.21.15.45:0/1273598976 wait complete. 2023-12-19T17:52:47.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 Processor -- start 2023-12-19T17:52:47.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.325+0000 7ff1297d2700 1 -- start start 2023-12-19T17:52:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240b8580 0x7ff1240ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1240cdfd0 0x7ff12415feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 0x7ff1240cabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1241597e0 con 0x7ff12415cf20 2023-12-19T17:52:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12415f0f0 con 0x7ff1240b8580 2023-12-19T17:52:47.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12415f3d0 con 0x7ff1240cdfd0 2023-12-19T17:52:47.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 0x7ff1240cabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 0x7ff1240cabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55138/0 (socket says 172.21.15.45:55138) 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 -- 172.21.15.45:0/62856594 learned_addr learned my addr 172.21.15.45:0/62856594 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1237fe700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1240cdfd0 0x7ff12415feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff123fff700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240b8580 0x7ff1240ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 -- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1240cdfd0 msgr2=0x7ff12415feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1240cdfd0 0x7ff12415feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 -- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240b8580 msgr2=0x7ff1240ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240b8580 0x7ff1240ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 -- 172.21.15.45:0/62856594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c009a70 con 0x7ff12415cf20 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff123fff700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240b8580 0x7ff1240ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1237fe700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1240cdfd0 0x7ff12415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff128fd1700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 0x7ff1240cabb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff11c013000 tx=0x7ff11c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c012430 con 0x7ff12415cf20 2023-12-19T17:52:47.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11c020070 con 0x7ff12415cf20 2023-12-19T17:52:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11c004280 con 0x7ff12415cf20 2023-12-19T17:52:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12415f6b0 con 0x7ff12415cf20 2023-12-19T17:52:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.329+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1240cb0f0 con 0x7ff12415cf20 2023-12-19T17:52:47.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.333+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12415f230 con 0x7ff12415cf20 2023-12-19T17:52:47.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.333+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff11c0043e0 con 0x7ff12415cf20 2023-12-19T17:52:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.333+0000 7ff120ff9700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff110065ad0 0x7ff110067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.333+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff11c022070 con 0x7ff12415cf20 2023-12-19T17:52:47.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.333+0000 7ff123fff700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff110065ad0 0x7ff110067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.337+0000 7ff123fff700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff110065ad0 0x7ff110067f90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff114009ba0 tx=0x7ff114008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:47.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.341+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff12415f230 con 0x7ff12415cf20 2023-12-19T17:52:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.521+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff12415fbd0 con 0x7ff12415cf20 2023-12-19T17:52:47.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.521+0000 7ff120ff9700 1 -- 172.21.15.45:0/62856594 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff12415fbd0 con 0x7ff12415cf20 2023-12-19T17:52:47.527 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:47.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff110065ad0 msgr2=0x7ff110067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff110065ad0 0x7ff110067f90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff114009ba0 tx=0x7ff114008040 comp rx=0 tx=0).stop 2023-12-19T17:52:47.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 msgr2=0x7ff1240cabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 0x7ff1240cabb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff11c013000 tx=0x7ff11c004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 shutdown_connections 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff110065ad0 0x7ff110067f90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff12415cf20 0x7ff1240cabb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1240cdfd0 0x7ff12415feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 --2- 172.21.15.45:0/62856594 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1240b8580 0x7ff1240ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 >> 172.21.15.45:0/62856594 conn(0x7ff1240b4670 msgr2=0x7ff1240b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 shutdown_connections 2023-12-19T17:52:47.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.525+0000 7ff1297d2700 1 -- 172.21.15.45:0/62856594 wait complete. 2023-12-19T17:52:47.553 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.737+0000 7f56f4a39700 1 Processor -- start 2023-12-19T17:52:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.737+0000 7f56f4a39700 1 -- start start 2023-12-19T17:52:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56f4a39700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 0x7f56f00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56f4a39700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f56f00b8580 0x7f56f00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56f4a39700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f015d300 con 0x7f56f00d25f0 2023-12-19T17:52:47.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56f4a39700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f00d1550 con 0x7f56f00b8580 2023-12-19T17:52:47.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56f4a39700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00d1830 con 0x7f56f015cf20 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 0x7f56f00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 0x7f56f00d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:36418/0 (socket says 172.21.15.45:36418) 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56effff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f56f00d25f0 0x7f56f006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56144/0 (socket says 172.21.15.45:56144) 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 -- 172.21.15.45:0/3013069211 learned_addr learned my addr 172.21.15.45:0/3013069211 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56eeffd700 1 --2- 172.21.15.45:0/3013069211 >> v2:172.21.15.45:3300/0 conn(0x7f56f00b8580 0x7f56f00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 -- 172.21.15.45:0/3013069211 >> v2:172.21.15.45:3300/0 conn(0x7f56f00b8580 msgr2=0x7f56f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 --2- 172.21.15.45:0/3013069211 >> v2:172.21.15.45:3300/0 conn(0x7f56f00b8580 0x7f56f00cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 -- 172.21.15.45:0/3013069211 >> v1:172.21.15.45:6789/0 conn(0x7f56f00d25f0 legacy=0x7f56f006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 -- 172.21.15.45:0/3013069211 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f00d1b10 con 0x7f56f015cf20 2023-12-19T17:52:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ef7fe700 1 --2- 172.21.15.45:0/3013069211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 0x7f56f00d0c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009910 tx=0x7f56e0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b9894240debeb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ee7fc700 1 -- 172.21.15.45:0/3013069211 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0011830 con 0x7f56f015cf20 2023-12-19T17:52:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ee7fc700 1 -- 172.21.15.45:0/3013069211 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e0011990 con 0x7f56f015cf20 2023-12-19T17:52:47.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.741+0000 7f56ee7fc700 1 -- 172.21.15.45:0/3013069211 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e0011d40 con 0x7f56f015cf20 2023-12-19T17:52:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 -- 172.21.15.45:0/3013069211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 msgr2=0x7f56f00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 --2- 172.21.15.45:0/3013069211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 0x7f56f00d0c50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009910 tx=0x7f56e0009c20 comp rx=0 tx=0).stop 2023-12-19T17:52:47.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 -- 172.21.15.45:0/3013069211 shutdown_connections 2023-12-19T17:52:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 --2- 172.21.15.45:0/3013069211 >> v2:172.21.15.45:3300/0 conn(0x7f56f00b8580 0x7f56f00cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 --2- 172.21.15.45:0/3013069211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f015cf20 0x7f56f00d0c50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 -- 172.21.15.45:0/3013069211 >> 172.21.15.45:0/3013069211 conn(0x7f56f00b4670 msgr2=0x7f56f00b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 -- 172.21.15.45:0/3013069211 shutdown_connections 2023-12-19T17:52:47.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.745+0000 7f56f4a39700 1 -- 172.21.15.45:0/3013069211 wait complete. 2023-12-19T17:52:47.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 Processor -- start 2023-12-19T17:52:47.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 -- start start 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f00b8580 0x7f56f0151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f00d25f0 0x7f56f0148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56f015cf20 0x7f56f00cb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f01494c0 con 0x7f56f015cf20 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00ca1a0 con 0x7f56f00b8580 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56f4a39700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f00cc700 con 0x7f56f00d25f0 2023-12-19T17:52:47.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f00b8580 0x7f56f0151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56ef7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f00b8580 0x7f56f0151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:56686/0 (socket says 172.21.15.45:56686) 2023-12-19T17:52:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56effff700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56f015cf20 0x7f56f00cb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56ef7fe700 1 -- 172.21.15.45:0/1517784735 learned_addr learned my addr 172.21.15.45:0/1517784735 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:47.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56eeffd700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f00d25f0 0x7f56f0148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56effff700 1 -- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f00d25f0 msgr2=0x7f56f0148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56effff700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f00d25f0 0x7f56f0148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56effff700 1 -- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f00b8580 msgr2=0x7f56f0151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56effff700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f00b8580 0x7f56f0151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.749+0000 7f56effff700 1 -- 172.21.15.45:0/1517784735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e0009570 con 0x7f56f015cf20 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56effff700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56f015cf20 0x7f56f00cb880 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f56e800cb10 tx=0x7f56e800ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:47.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e800a9e0 con 0x7f56f015cf20 2023-12-19T17:52:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56e800ab40 con 0x7f56f015cf20 2023-12-19T17:52:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f00cc9e0 con 0x7f56f015cf20 2023-12-19T17:52:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56e8007070 con 0x7f56f015cf20 2023-12-19T17:52:47.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f01524f0 con 0x7f56f015cf20 2023-12-19T17:52:47.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.753+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f00ccf00 con 0x7f56f015cf20 2023-12-19T17:52:47.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.757+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f56e80071d0 con 0x7f56f015cf20 2023-12-19T17:52:47.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.757+0000 7f56d7fff700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f56dc065b00 0x7f56dc067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:47.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.757+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f56e8083090 con 0x7f56f015cf20 2023-12-19T17:52:47.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.757+0000 7f56ef7fe700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f56dc065b00 0x7f56dc067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:47.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.761+0000 7f56ef7fe700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f56dc065b00 0x7f56dc067fc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009150 tx=0x7f56e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:47.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.765+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f56f00ccf00 con 0x7f56f015cf20 2023-12-19T17:52:47.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.941+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f56f00ccf00 con 0x7f56f015cf20 2023-12-19T17:52:47.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56d7fff700 1 -- 172.21.15.45:0/1517784735 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f56f00ccf00 con 0x7f56f015cf20 2023-12-19T17:52:47.947 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f56dc065b00 msgr2=0x7f56dc067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f56dc065b00 0x7f56dc067fc0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009150 tx=0x7f56e0008030 comp rx=0 tx=0).stop 2023-12-19T17:52:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56f015cf20 msgr2=0x7f56f00cb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:47.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56f015cf20 0x7f56f00cb880 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f56e800cb10 tx=0x7f56e800ce20 comp rx=0 tx=0).stop 2023-12-19T17:52:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 shutdown_connections 2023-12-19T17:52:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f56dc065b00 0x7f56dc067fc0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56f015cf20 0x7f56f00cb880 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56f00d25f0 0x7f56f0148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 --2- 172.21.15.45:0/1517784735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56f00b8580 0x7f56f0151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 >> 172.21.15.45:0/1517784735 conn(0x7f56f00b4670 msgr2=0x7f56f006fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.945+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 shutdown_connections 2023-12-19T17:52:47.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:47.949+0000 7f56f4a39700 1 -- 172.21.15.45:0/1517784735 wait complete. 2023-12-19T17:52:47.973 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:48.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.149+0000 7f391cffb700 1 Processor -- start 2023-12-19T17:52:48.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.149+0000 7f391cffb700 1 -- start start 2023-12-19T17:52:48.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f391806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f391806f3b0 0x7f391806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39180d1820 con 0x7f391806ea90 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39180d1630 con 0x7f391806f3b0 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39180d1b00 con 0x7f39180b88b0 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f39177fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f391806ea90 0x7f39180d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56160/0 (socket says 172.21.15.45:56160) 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f39177fe700 1 -- 172.21.15.45:0/3968034616 learned_addr learned my addr 172.21.15.45:0/3968034616 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3917fff700 1 --2- 172.21.15.45:0/3968034616 >> v2:172.21.15.45:3300/0 conn(0x7f391806f3b0 0x7f391806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3916ffd700 1 --2- 172.21.15.45:0/3968034616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f391806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3917fff700 1 -- 172.21.15.45:0/3968034616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 msgr2=0x7f391806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3917fff700 1 --2- 172.21.15.45:0/3968034616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f391806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3917fff700 1 -- 172.21.15.45:0/3968034616 >> v1:172.21.15.45:6789/0 conn(0x7f391806ea90 legacy=0x7f39180d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3917fff700 1 -- 172.21.15.45:0/3968034616 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39180d1de0 con 0x7f391806f3b0 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f3917fff700 1 --2- 172.21.15.45:0/3968034616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806f3b0 0x7f391806f840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3910009d90 tx=0x7f391000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559bc313f3dafe31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f39167fc700 1 -- 172.21.15.45:0/3968034616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391000e070 con 0x7f391806f3b0 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f39167fc700 1 -- 172.21.15.45:0/3968034616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391000bb20 con 0x7f391806f3b0 2023-12-19T17:52:48.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f39167fc700 1 -- 172.21.15.45:0/3968034616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3910012430 con 0x7f391806f3b0 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 -- 172.21.15.45:0/3968034616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806f3b0 msgr2=0x7f391806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.153+0000 7f391cffb700 1 --2- 172.21.15.45:0/3968034616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806f3b0 0x7f391806f840 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3910009d90 tx=0x7f391000b330 comp rx=0 tx=0).stop 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.157+0000 7f391cffb700 1 -- 172.21.15.45:0/3968034616 shutdown_connections 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.157+0000 7f391cffb700 1 --2- 172.21.15.45:0/3968034616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806f3b0 0x7f391806f840 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.157+0000 7f391cffb700 1 --2- 172.21.15.45:0/3968034616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f391806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.157+0000 7f391cffb700 1 -- 172.21.15.45:0/3968034616 >> 172.21.15.45:0/3968034616 conn(0x7f39180b46d0 msgr2=0x7f39180b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.157+0000 7f391cffb700 1 -- 172.21.15.45:0/3968034616 shutdown_connections 2023-12-19T17:52:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.157+0000 7f391cffb700 1 -- 172.21.15.45:0/3968034616 wait complete. 2023-12-19T17:52:48.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 Processor -- start 2023-12-19T17:52:48.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 -- start start 2023-12-19T17:52:48.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 0x7f391806fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f391806f3b0 0x7f391815e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f39181f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180c9cb0 con 0x7f391806ea90 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39180ca230 con 0x7f391806f3b0 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f391cffb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39181f6970 con 0x7f39180b88b0 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 0x7f391806fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 0x7f391806fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55164/0 (socket says 172.21.15.45:55164) 2023-12-19T17:52:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 -- 172.21.15.45:0/3036627344 learned_addr learned my addr 172.21.15.45:0/3036627344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f3917fff700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f39181f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f3916ffd700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f391806f3b0 0x7f391815e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 -- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 msgr2=0x7f39181f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f39181f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 -- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f391806f3b0 msgr2=0x7f391815e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f391806f3b0 0x7f391815e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f39177fe700 1 -- 172.21.15.45:0/3036627344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3910009a70 con 0x7f391806ea90 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.161+0000 7f3916ffd700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f391806f3b0 0x7f391815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f39177fe700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 0x7f391806fa00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3908001eb0 tx=0x7f390800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908005d90 con 0x7f391806ea90 2023-12-19T17:52:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39080070d0 con 0x7f391806ea90 2023-12-19T17:52:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3908007440 con 0x7f391806ea90 2023-12-19T17:52:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39181f6c50 con 0x7f391806ea90 2023-12-19T17:52:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39180c9040 con 0x7f391806ea90 2023-12-19T17:52:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.165+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3918067760 con 0x7f391806ea90 2023-12-19T17:52:48.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.169+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39080075a0 con 0x7f391806ea90 2023-12-19T17:52:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.169+0000 7f38fffff700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3904065b20 0x7f3904067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.169+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f39080827b0 con 0x7f391806ea90 2023-12-19T17:52:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.169+0000 7f3916ffd700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3904065b20 0x7f3904067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.169+0000 7f3916ffd700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3904065b20 0x7f3904067fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f39180cb5b0 tx=0x7f390c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:48.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.177+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f390804ff20 con 0x7f391806ea90 2023-12-19T17:52:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.369+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f39180cbb70 con 0x7f391806ea90 2023-12-19T17:52:48.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.369+0000 7f38fffff700 1 -- 172.21.15.45:0/3036627344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3908053540 con 0x7f391806ea90 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3904065b20 msgr2=0x7f3904067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3904065b20 0x7f3904067fe0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f39180cb5b0 tx=0x7f390c008040 comp rx=0 tx=0).stop 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 msgr2=0x7f391806fa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 0x7f391806fa00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3908001eb0 tx=0x7f390800c7b0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 shutdown_connections 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3904065b20 0x7f3904067fe0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39180b88b0 0x7f39181f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f391806f3b0 0x7f391815e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 --2- 172.21.15.45:0/3036627344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f391806ea90 0x7f391806fa00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 >> 172.21.15.45:0/3036627344 conn(0x7f39180b46d0 msgr2=0x7f39180b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 shutdown_connections 2023-12-19T17:52:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.373+0000 7f391cffb700 1 -- 172.21.15.45:0/3036627344 wait complete. 2023-12-19T17:52:48.377 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:48.397 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:52:48.397 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:48.418 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:48.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.645+0000 7f912cb05700 1 Processor -- start 2023-12-19T17:52:48.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.645+0000 7f912cb05700 1 -- start start 2023-12-19T17:52:48.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91281611c0 0x7f91280c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f91281615a0 0x7f912806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f912806dc80 con 0x7f91280af720 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9128070340 con 0x7f91281615a0 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91280c3f90 con 0x7f91281611c0 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f91281615a0 0x7f912806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f91281615a0 0x7f912806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55166/0 (socket says 172.21.15.45:55166) 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 -- 172.21.15.45:0/2757454766 learned_addr learned my addr 172.21.15.45:0/2757454766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f91277fe700 1 --2- 172.21.15.45:0/2757454766 >> v2:172.21.15.73:3300/0 conn(0x7f91281611c0 0x7f91280c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 -- 172.21.15.45:0/2757454766 >> v2:172.21.15.73:3300/0 conn(0x7f91281611c0 msgr2=0x7f91280c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:48.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 --2- 172.21.15.45:0/2757454766 >> v2:172.21.15.73:3300/0 conn(0x7f91281611c0 0x7f91280c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 -- 172.21.15.45:0/2757454766 >> v1:172.21.15.73:6789/0 conn(0x7f91280af720 legacy=0x7f9128164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 -- 172.21.15.45:0/2757454766 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91280c4270 con 0x7f91281615a0 2023-12-19T17:52:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f91277fe700 1 --2- 172.21.15.45:0/2757454766 >> v2:172.21.15.73:3300/0 conn(0x7f91281611c0 0x7f91280c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f9126ffd700 1 --2- 172.21.15.45:0/2757454766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281615a0 0x7f912806d740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9128072080 tx=0x7f911c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8513d2a49c876519 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f91267fc700 1 -- 172.21.15.45:0/2757454766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00b8a0 con 0x7f91281615a0 2023-12-19T17:52:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f91267fc700 1 -- 172.21.15.45:0/2757454766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c00ba00 con 0x7f91281615a0 2023-12-19T17:52:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f91267fc700 1 -- 172.21.15.45:0/2757454766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c00bd90 con 0x7f91281615a0 2023-12-19T17:52:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 -- 172.21.15.45:0/2757454766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281615a0 msgr2=0x7f912806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 --2- 172.21.15.45:0/2757454766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281615a0 0x7f912806d740 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9128072080 tx=0x7f911c009bf0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 -- 172.21.15.45:0/2757454766 shutdown_connections 2023-12-19T17:52:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 --2- 172.21.15.45:0/2757454766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281615a0 0x7f912806d740 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 --2- 172.21.15.45:0/2757454766 >> v2:172.21.15.73:3300/0 conn(0x7f91281611c0 0x7f91280c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.649+0000 7f912cb05700 1 -- 172.21.15.45:0/2757454766 >> 172.21.15.45:0/2757454766 conn(0x7f91280cb900 msgr2=0x7f91280b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.653+0000 7f912cb05700 1 -- 172.21.15.45:0/2757454766 shutdown_connections 2023-12-19T17:52:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.653+0000 7f912cb05700 1 -- 172.21.15.45:0/2757454766 wait complete. 2023-12-19T17:52:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.653+0000 7f912cb05700 1 Processor -- start 2023-12-19T17:52:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.653+0000 7f912cb05700 1 -- start start 2023-12-19T17:52:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91280af720 0x7f9128151130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 0x7f9128158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91281615a0 0x7f9128163700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128162ae0 con 0x7f91281611c0 2023-12-19T17:52:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9128164270 con 0x7f91280af720 2023-12-19T17:52:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91280c5890 con 0x7f91281615a0 2023-12-19T17:52:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 0x7f9128158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 0x7f9128158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:55172/0 (socket says 172.21.15.45:55172) 2023-12-19T17:52:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 -- 172.21.15.45:0/2841519108 learned_addr learned my addr 172.21.15.45:0/2841519108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f91277fe700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91280af720 0x7f9128151130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9127fff700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91281615a0 0x7f9128163700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 -- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91281615a0 msgr2=0x7f9128163700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91281615a0 0x7f9128163700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 -- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91280af720 msgr2=0x7f9128151130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91280af720 0x7f9128151130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 -- 172.21.15.45:0/2841519108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f911c009570 con 0x7f91281611c0 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9127fff700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91281615a0 0x7f9128163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f9126ffd700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 0x7f9128158300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f911c000c00 tx=0x7f911c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c0038c0 con 0x7f91281611c0 2023-12-19T17:52:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f911c01e070 con 0x7f91281611c0 2023-12-19T17:52:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f911c003c80 con 0x7f91281611c0 2023-12-19T17:52:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91280c5b70 con 0x7f91281611c0 2023-12-19T17:52:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.657+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91280c6130 con 0x7f91281611c0 2023-12-19T17:52:48.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.661+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f912806e760 con 0x7f91281611c0 2023-12-19T17:52:48.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.661+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f911c011420 con 0x7f91281611c0 2023-12-19T17:52:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.665+0000 7f910ffff700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9114065ad0 0x7f9114067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.665+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f911c020070 con 0x7f91281611c0 2023-12-19T17:52:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.665+0000 7f91277fe700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9114065ad0 0x7f9114067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.665+0000 7f91277fe700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9114065ad0 0x7f9114067f90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91180099f0 tx=0x7f9118008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:48.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.669+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f911c0522b0 con 0x7f91281611c0 2023-12-19T17:52:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.853+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9128067760 con 0x7f91281611c0 2023-12-19T17:52:48.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.857+0000 7f910ffff700 1 -- 172.21.15.45:0/2841519108 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f911c015090 con 0x7f91281611c0 2023-12-19T17:52:48.862 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:48.862 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9114065ad0 msgr2=0x7f9114067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9114065ad0 0x7f9114067f90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91180099f0 tx=0x7f9118008040 comp rx=0 tx=0).stop 2023-12-19T17:52:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 msgr2=0x7f9128158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 0x7f9128158300 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f911c000c00 tx=0x7f911c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 shutdown_connections 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9114065ad0 0x7f9114067f90 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91281615a0 0x7f9128163700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91281611c0 0x7f9128158300 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 --2- 172.21.15.45:0/2841519108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91280af720 0x7f9128151130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 >> 172.21.15.45:0/2841519108 conn(0x7f91280cb900 msgr2=0x7f91280b35a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 shutdown_connections 2023-12-19T17:52:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:48.861+0000 7f912cb05700 1 -- 172.21.15.45:0/2841519108 wait complete. 2023-12-19T17:52:48.889 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:48.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.069+0000 7ffb92770700 1 Processor -- start 2023-12-19T17:52:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.069+0000 7ffb92770700 1 -- start start 2023-12-19T17:52:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb92770700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 0x7ffb8c0cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb92770700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0d10e0 con 0x7ffb8c0cfd70 2023-12-19T17:52:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb92770700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8c0d13c0 con 0x7ffb8c15d090 2023-12-19T17:52:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb92770700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0b6040 con 0x7ffb8c0d0a50 2023-12-19T17:52:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb90d0d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffb8c0cfd70 0x7ffb8c0b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58956/0 (socket says 172.21.15.45:58956) 2023-12-19T17:52:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb90d0d700 1 -- 172.21.15.45:0/657559210 learned_addr learned my addr 172.21.15.45:0/657559210 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb8b7fe700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 0x7ffb8c0cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1896497525 0 0) 0x7ffb8c0d10e0 con 0x7ffb8c0cfd70 2023-12-19T17:52:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb740035d0 con 0x7ffb8c0cfd70 2023-12-19T17:52:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 851109919 0 0) 0x7ffb8c0d13c0 con 0x7ffb8c15d090 2023-12-19T17:52:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb8c0d10e0 con 0x7ffb8c15d090 2023-12-19T17:52:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.073+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 579513252 0 0) 0x7ffb740035d0 con 0x7ffb8c0cfd70 2023-12-19T17:52:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 msgr2=0x7ffb8c0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 0x7ffb8c0cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 >> v1:172.21.15.73:6789/0 conn(0x7ffb8c15d090 legacy=0x7ffb8c0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0d16a0 con 0x7ffb8c0cfd70 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7ffb840019f0 con 0x7ffb8c0cfd70 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 >> v1:172.21.15.45:6789/0 conn(0x7ffb8c0cfd70 legacy=0x7ffb8c0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 0x7ffb74003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004190 0x7ffb74004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb74004db0 0x7ffb74005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0b6040 con 0x7ffb74004db0 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7400bb70 con 0x7ffb74004190 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb7400bd30 con 0x7ffb8c0d0a50 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb74004db0 0x7ffb74005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8bfff700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 0x7ffb74003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8b7fe700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004190 0x7ffb74004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 -- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 msgr2=0x7ffb74003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c0d0a50 0x7ffb74003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 -- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004190 msgr2=0x7ffb74004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004190 0x7ffb74004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 -- 172.21.15.45:0/657559210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb740035d0 con 0x7ffb74004db0 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb74004db0 0x7ffb74005230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400a710 tx=0x7ffb740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ec6bc61f81427f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840070d0 con 0x7ffb74004db0 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb84007230 con 0x7ffb74004db0 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb8affd700 1 -- 172.21.15.45:0/657559210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb840075e0 con 0x7ffb74004db0 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb92770700 1 -- 172.21.15.45:0/657559210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb74004db0 msgr2=0x7ffb74005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb92770700 1 --2- 172.21.15.45:0/657559210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb74004db0 0x7ffb74005230 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb8400a710 tx=0x7ffb740058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb90d0d700 1 -- 172.21.15.45:0/657559210 reap_dead start 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb92770700 1 -- 172.21.15.45:0/657559210 shutdown_connections 2023-12-19T17:52:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb92770700 1 -- 172.21.15.45:0/657559210 >> 172.21.15.45:0/657559210 conn(0x7ffb8c0b4b90 msgr2=0x7ffb8c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb92770700 1 -- 172.21.15.45:0/657559210 shutdown_connections 2023-12-19T17:52:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.077+0000 7ffb92770700 1 -- 172.21.15.45:0/657559210 wait complete. 2023-12-19T17:52:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 Processor -- start 2023-12-19T17:52:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 -- start start 2023-12-19T17:52:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004db0 0x7ffb8c0b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 0x7ffb8c152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c1534c0 0x7ffb8c149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c0b2a10 con 0x7ffb8c0b2590 2023-12-19T17:52:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c153940 con 0x7ffb74004db0 2023-12-19T17:52:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.081+0000 7ffb92770700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8c1559e0 con 0x7ffb8c1534c0 2023-12-19T17:52:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 0x7ffb8c152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 0x7ffb8c152f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32946/0 (socket says 172.21.15.45:32946) 2023-12-19T17:52:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 -- 172.21.15.45:0/2626696495 learned_addr learned my addr 172.21.15.45:0/2626696495 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb90d0d700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c1534c0 0x7ffb8c149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8bfff700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004db0 0x7ffb8c0b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 -- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c1534c0 msgr2=0x7ffb8c149800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c1534c0 0x7ffb8c149800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 -- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004db0 msgr2=0x7ffb8c0b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004db0 0x7ffb8c0b2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 -- 172.21.15.45:0/2626696495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c1550b0 con 0x7ffb8c0b2590 2023-12-19T17:52:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb8b7fe700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 0x7ffb8c152f80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb80011a20 tx=0x7ffb80011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb80011ec0 con 0x7ffb8c0b2590 2023-12-19T17:52:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb8000f8e0 con 0x7ffb8c0b2590 2023-12-19T17:52:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb8000fc70 con 0x7ffb8c0b2590 2023-12-19T17:52:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb8c155390 con 0x7ffb8c0b2590 2023-12-19T17:52:49.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb8c154d60 con 0x7ffb8c0b2590 2023-12-19T17:52:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.085+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8c06e420 con 0x7ffb8c0b2590 2023-12-19T17:52:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.089+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffb80014440 con 0x7ffb8c0b2590 2023-12-19T17:52:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.089+0000 7ffb88ff9700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffb78065ad0 0x7ffb78067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.089+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ffb80083af0 con 0x7ffb8c0b2590 2023-12-19T17:52:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.089+0000 7ffb8bfff700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffb78065ad0 0x7ffb78067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.093+0000 7ffb8bfff700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffb78065ad0 0x7ffb78067f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007fd0 tx=0x7ffb7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.097+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffb80051180 con 0x7ffb8c0b2590 2023-12-19T17:52:49.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.273+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb8c0d13c0 con 0x7ffb8c0b2590 2023-12-19T17:52:49.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb88ff9700 1 -- 172.21.15.45:0/2626696495 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb800220a0 con 0x7ffb8c0b2590 2023-12-19T17:52:49.279 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffb78065ad0 msgr2=0x7ffb78067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffb78065ad0 0x7ffb78067f90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c007fd0 tx=0x7ffb7c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 msgr2=0x7ffb8c152f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 0x7ffb8c152f80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb80011a20 tx=0x7ffb80011d30 comp rx=0 tx=0).stop 2023-12-19T17:52:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 shutdown_connections 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffb78065ad0 0x7ffb78067f90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffb8c1534c0 0x7ffb8c149800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffb8c0b2590 0x7ffb8c152f80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 --2- 172.21.15.45:0/2626696495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffb74004db0 0x7ffb8c0b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.277+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 >> 172.21.15.45:0/2626696495 conn(0x7ffb8c0b4b90 msgr2=0x7ffb8c0cc760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.281+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 shutdown_connections 2023-12-19T17:52:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.281+0000 7ffb92770700 1 -- 172.21.15.45:0/2626696495 wait complete. 2023-12-19T17:52:49.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.493+0000 7f8411a39700 1 Processor -- start 2023-12-19T17:52:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.493+0000 7f8411a39700 1 -- start start 2023-12-19T17:52:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411a39700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f840c15d220 0x7f840c0d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411a39700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411a39700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c0d2200 con 0x7f840c0d0e30 2023-12-19T17:52:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411a39700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c06ffe0 con 0x7f840c15d220 2023-12-19T17:52:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411a39700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0d1920 con 0x7f840c0cd4b0 2023-12-19T17:52:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411238700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f840c15d220 0x7f840c0d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411238700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c06ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:45464/0 (socket says 172.21.15.45:45464) 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8411238700 1 -- 172.21.15.45:0/3585443961 learned_addr learned my addr 172.21.15.45:0/3585443961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f8410a37700 1 --1- 172.21.15.45:0/3585443961 >> v1:172.21.15.73:6789/0 conn(0x7f840c0d0e30 0x7f840c0d1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34412/0 (socket says 172.21.15.45:34412) 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840bfff700 1 -- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 msgr2=0x7f840c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840bfff700 1 --2- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c06ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840bfff700 1 -- 172.21.15.45:0/3585443961 >> v1:172.21.15.73:6789/0 conn(0x7f840c0d0e30 legacy=0x7f840c0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840bfff700 1 -- 172.21.15.45:0/3585443961 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0cd8c0 con 0x7f840c15d220 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840bfff700 1 --2- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c0d2690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009850 tx=0x7f83f8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5718439e979f0740 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840b7fe700 1 -- 172.21.15.45:0/3585443961 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8011830 con 0x7f840c15d220 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840b7fe700 1 -- 172.21.15.45:0/3585443961 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f8011990 con 0x7f840c15d220 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.497+0000 7f840b7fe700 1 -- 172.21.15.45:0/3585443961 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8011d40 con 0x7f840c15d220 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 -- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 msgr2=0x7f840c0d2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 --2- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c0d2690 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f83f8009850 tx=0x7f83f8009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 -- 172.21.15.45:0/3585443961 shutdown_connections 2023-12-19T17:52:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 --2- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c06ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 --2- 172.21.15.45:0/3585443961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c0d2690 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 -- 172.21.15.45:0/3585443961 >> 172.21.15.45:0/3585443961 conn(0x7f840c0b46d0 msgr2=0x7f840c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 -- 172.21.15.45:0/3585443961 shutdown_connections 2023-12-19T17:52:49.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 -- 172.21.15.45:0/3585443961 wait complete. 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 Processor -- start 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.501+0000 7f8411a39700 1 -- start start 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 0x7f840c15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c15ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c15dcc0 con 0x7f840c0d0e30 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c1604d0 con 0x7f840c15d220 2023-12-19T17:52:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c158380 con 0x7f840c0cd4b0 2023-12-19T17:52:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 0x7f840c15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 0x7f840c15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32958/0 (socket says 172.21.15.45:32958) 2023-12-19T17:52:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 -- 172.21.15.45:0/63482444 learned_addr learned my addr 172.21.15.45:0/63482444 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8410a37700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411238700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c15ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 -- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 msgr2=0x7f840c159140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c159140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 -- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 msgr2=0x7f840c15ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c15ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 -- 172.21.15.45:0/63482444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f80094b0 con 0x7f840c0d0e30 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f840bfff700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 0x7f840c15d630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83f80090b0 tx=0x7f83f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8004480 con 0x7f840c0d0e30 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f801f070 con 0x7f840c0d0e30 2023-12-19T17:52:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c158660 con 0x7f840c0d0e30 2023-12-19T17:52:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f8003900 con 0x7f840c0d0e30 2023-12-19T17:52:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.505+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c158c20 con 0x7f840c0d0e30 2023-12-19T17:52:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.509+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c072a90 con 0x7f840c0d0e30 2023-12-19T17:52:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.509+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83f8021030 con 0x7f840c0d0e30 2023-12-19T17:52:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.513+0000 7f84097fa700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83f0065ad0 0x7f83f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.513+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f83f80848b0 con 0x7f840c0d0e30 2023-12-19T17:52:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.513+0000 7f8410a37700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83f0065ad0 0x7f83f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.513+0000 7f8410a37700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83f0065ad0 0x7f83f0067f90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8400000f60 tx=0x7f8400007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.521+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f83f8051fa0 con 0x7f840c0d0e30 2023-12-19T17:52:49.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.697+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f840c158e10 con 0x7f840c0d0e30 2023-12-19T17:52:49.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.697+0000 7f84097fa700 1 -- 172.21.15.45:0/63482444 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83f80555c0 con 0x7f840c0d0e30 2023-12-19T17:52:49.701 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83f0065ad0 msgr2=0x7f83f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83f0065ad0 0x7f83f0067f90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f8400000f60 tx=0x7f8400007ef0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 msgr2=0x7f840c15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 0x7f840c15d630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f83f80090b0 tx=0x7f83f8004770 comp rx=0 tx=0).stop 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 shutdown_connections 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83f0065ad0 0x7f83f0067f90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f840c15d220 0x7f840c15ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840c0d0e30 0x7f840c15d630 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 --2- 172.21.15.45:0/63482444 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f840c0cd4b0 0x7f840c159140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 >> 172.21.15.45:0/63482444 conn(0x7f840c0b46d0 msgr2=0x7f840c0b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:49.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 shutdown_connections 2023-12-19T17:52:49.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.701+0000 7f8411a39700 1 -- 172.21.15.45:0/63482444 wait complete. 2023-12-19T17:52:49.726 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.909+0000 7f17eb10e700 1 Processor -- start 2023-12-19T17:52:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.909+0000 7f17eb10e700 1 -- start start 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17eb10e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17e415cf20 0x7f17e40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17eb10e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17e40cdfd0 0x7f17e40b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17eb10e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e415d300 con 0x7f17e40b8580 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17eb10e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e40d1550 con 0x7f17e40cdfd0 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17eb10e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e40d1830 con 0x7f17e415cf20 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17e990b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f17e40b8580 0x7f17e40cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58966/0 (socket says 172.21.15.45:58966) 2023-12-19T17:52:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17ea90d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17e40cdfd0 0x7f17e40b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17e990b700 1 -- 172.21.15.45:0/4062252598 learned_addr learned my addr 172.21.15.45:0/4062252598 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17ea10c700 1 --2- 172.21.15.45:0/4062252598 >> v2:172.21.15.73:3300/0 conn(0x7f17e415cf20 0x7f17e40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17ea90d700 1 -- 172.21.15.45:0/4062252598 >> v2:172.21.15.73:3300/0 conn(0x7f17e415cf20 msgr2=0x7f17e40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17ea90d700 1 --2- 172.21.15.45:0/4062252598 >> v2:172.21.15.73:3300/0 conn(0x7f17e415cf20 0x7f17e40d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17ea90d700 1 -- 172.21.15.45:0/4062252598 >> v1:172.21.15.45:6789/0 conn(0x7f17e40b8580 legacy=0x7f17e40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.913+0000 7f17ea90d700 1 -- 172.21.15.45:0/4062252598 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e40d1b10 con 0x7f17e40cdfd0 2023-12-19T17:52:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17ea90d700 1 --2- 172.21.15.45:0/4062252598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b5d20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f17e408bc50 tx=0x7f17dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111a0e2b46c8ae45 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17e910a700 1 -- 172.21.15.45:0/4062252598 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc00e070 con 0x7f17e40cdfd0 2023-12-19T17:52:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17e910a700 1 -- 172.21.15.45:0/4062252598 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17dc00bb20 con 0x7f17e40cdfd0 2023-12-19T17:52:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17e910a700 1 -- 172.21.15.45:0/4062252598 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17dc012430 con 0x7f17e40cdfd0 2023-12-19T17:52:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 -- 172.21.15.45:0/4062252598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 msgr2=0x7f17e40b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 --2- 172.21.15.45:0/4062252598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b5d20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f17e408bc50 tx=0x7f17dc00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 -- 172.21.15.45:0/4062252598 shutdown_connections 2023-12-19T17:52:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 --2- 172.21.15.45:0/4062252598 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b5d20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 --2- 172.21.15.45:0/4062252598 >> v2:172.21.15.73:3300/0 conn(0x7f17e415cf20 0x7f17e40d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 -- 172.21.15.45:0/4062252598 >> 172.21.15.45:0/4062252598 conn(0x7f17e40b4670 msgr2=0x7f17e40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 -- 172.21.15.45:0/4062252598 shutdown_connections 2023-12-19T17:52:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.917+0000 7f17eb10e700 1 -- 172.21.15.45:0/4062252598 wait complete. 2023-12-19T17:52:49.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 Processor -- start 2023-12-19T17:52:49.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 -- start start 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17e40b8580 0x7f17e40b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17e415cf20 0x7f17e415e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4146740 con 0x7f17e40cdfd0 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4145ac0 con 0x7f17e40b8580 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17eb10e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e4145da0 con 0x7f17e415cf20 2023-12-19T17:52:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17e990b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17e990b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:32978/0 (socket says 172.21.15.45:32978) 2023-12-19T17:52:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17e990b700 1 -- 172.21.15.45:0/3898372073 learned_addr learned my addr 172.21.15.45:0/3898372073 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17ea90d700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17e415cf20 0x7f17e415e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.921+0000 7f17ea10c700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17e40b8580 0x7f17e40b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17e990b700 1 -- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17e415cf20 msgr2=0x7f17e415e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17e990b700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17e415cf20 0x7f17e415e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17e990b700 1 -- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17e40b8580 msgr2=0x7f17e40b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17e990b700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17e40b8580 0x7f17e40b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17e990b700 1 -- 172.21.15.45:0/3898372073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17dc009a70 con 0x7f17e40cdfd0 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17e990b700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b3f80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c700 tx=0x7f17d400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4005d90 con 0x7f17e40cdfd0 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d40070d0 con 0x7f17e40cdfd0 2023-12-19T17:52:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4007460 con 0x7f17e40cdfd0 2023-12-19T17:52:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e4146080 con 0x7f17e40cdfd0 2023-12-19T17:52:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e415ea40 con 0x7f17e40cdfd0 2023-12-19T17:52:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.925+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e404ed30 con 0x7f17e40cdfd0 2023-12-19T17:52:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.929+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f17d40075c0 con 0x7f17e40cdfd0 2023-12-19T17:52:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.929+0000 7f17daffd700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17c8065ad0 0x7f17c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.929+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f17d4082ad0 con 0x7f17e40cdfd0 2023-12-19T17:52:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.929+0000 7f17ea10c700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17c8065ad0 0x7f17c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.929+0000 7f17ea10c700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17c8065ad0 0x7f17c8067f90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009ae0 tx=0x7f17e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:49.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:49.937+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f17d404ff80 con 0x7f17e40cdfd0 2023-12-19T17:52:50.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.173+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17e406fcb0 con 0x7f17e40cdfd0 2023-12-19T17:52:50.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.173+0000 7f17daffd700 1 -- 172.21.15.45:0/3898372073 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f17d40170a0 con 0x7f17e40cdfd0 2023-12-19T17:52:50.179 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17c8065ad0 msgr2=0x7f17c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17c8065ad0 0x7f17c8067f90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009ae0 tx=0x7f17e0008040 comp rx=0 tx=0).stop 2023-12-19T17:52:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 msgr2=0x7f17e40b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b3f80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f17d400c700 tx=0x7f17d400ca10 comp rx=0 tx=0).stop 2023-12-19T17:52:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 shutdown_connections 2023-12-19T17:52:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17c8065ad0 0x7f17c8067f90 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17e415cf20 0x7f17e415e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17e40cdfd0 0x7f17e40b3f80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 --2- 172.21.15.45:0/3898372073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17e40b8580 0x7f17e40b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 >> 172.21.15.45:0/3898372073 conn(0x7f17e40b4670 msgr2=0x7f17e40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 shutdown_connections 2023-12-19T17:52:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.181+0000 7f17eb10e700 1 -- 172.21.15.45:0/3898372073 wait complete. 2023-12-19T17:52:50.207 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.385+0000 7fd38d545700 1 Processor -- start 2023-12-19T17:52:50.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.385+0000 7fd38d545700 1 -- start start 2023-12-19T17:52:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38d545700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3880d0e30 0x7fd3880d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38d545700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd38815d220 0x7fd3880cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38d545700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3880d2200 con 0x7fd3880d1210 2023-12-19T17:52:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38d545700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd388070210 con 0x7fd3880d0e30 2023-12-19T17:52:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38d545700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880d1bb0 con 0x7fd38815d220 2023-12-19T17:52:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38cd44700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd3880d1210 0x7fd3880b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58974/0 (socket says 172.21.15.45:58974) 2023-12-19T17:52:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd38cd44700 1 -- 172.21.15.45:0/3625009726 learned_addr learned my addr 172.21.15.45:0/3625009726 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd387fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3880d0e30 0x7fd3880d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd3877fe700 1 --2- 172.21.15.45:0/3625009726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd38815d220 0x7fd3880cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd387fff700 1 -- 172.21.15.45:0/3625009726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd38815d220 msgr2=0x7fd3880cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd387fff700 1 --2- 172.21.15.45:0/3625009726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd38815d220 0x7fd3880cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd387fff700 1 -- 172.21.15.45:0/3625009726 >> v1:172.21.15.45:6789/0 conn(0x7fd3880d1210 legacy=0x7fd3880b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd387fff700 1 -- 172.21.15.45:0/3625009726 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880d1e90 con 0x7fd3880d0e30 2023-12-19T17:52:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.389+0000 7fd386ffd700 1 -- 172.21.15.45:0/3625009726 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3199542755 0 0) 0x7fd3880d2200 con 0x7fd3880d1210 2023-12-19T17:52:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd387fff700 1 --2- 172.21.15.45:0/3625009726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d0e30 0x7fd3880d2690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd378009850 tx=0x7fd378009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdff89072f28cdd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd386ffd700 1 -- 172.21.15.45:0/3625009726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378011830 con 0x7fd3880d0e30 2023-12-19T17:52:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd386ffd700 1 -- 172.21.15.45:0/3625009726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd378011990 con 0x7fd3880d0e30 2023-12-19T17:52:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd386ffd700 1 -- 172.21.15.45:0/3625009726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378011d40 con 0x7fd3880d0e30 2023-12-19T17:52:50.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 -- 172.21.15.45:0/3625009726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d0e30 msgr2=0x7fd3880d2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 --2- 172.21.15.45:0/3625009726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d0e30 0x7fd3880d2690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd378009850 tx=0x7fd378009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:50.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 -- 172.21.15.45:0/3625009726 shutdown_connections 2023-12-19T17:52:50.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 --2- 172.21.15.45:0/3625009726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd38815d220 0x7fd3880cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 --2- 172.21.15.45:0/3625009726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d0e30 0x7fd3880d2690 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 -- 172.21.15.45:0/3625009726 >> 172.21.15.45:0/3625009726 conn(0x7fd3880b46d0 msgr2=0x7fd3880b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:50.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 -- 172.21.15.45:0/3625009726 shutdown_connections 2023-12-19T17:52:50.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 -- 172.21.15.45:0/3625009726 wait complete. 2023-12-19T17:52:50.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.393+0000 7fd38d545700 1 Processor -- start 2023-12-19T17:52:50.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 -- start start 2023-12-19T17:52:50.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3880d0e30 0x7fd38814aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 0x7fd3880cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd38815d220 0x7fd3880b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38814af80 con 0x7fd3880d1210 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880ccbb0 con 0x7fd38815d220 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38815d760 con 0x7fd3880d0e30 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 0x7fd3880cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 0x7fd3880cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33000/0 (socket says 172.21.15.45:33000) 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 -- 172.21.15.45:0/3045788719 learned_addr learned my addr 172.21.15.45:0/3045788719 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd387fff700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3880d0e30 0x7fd38814aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38cd44700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd38815d220 0x7fd3880b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 -- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3880d0e30 msgr2=0x7fd38814aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3880d0e30 0x7fd38814aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 -- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd38815d220 msgr2=0x7fd3880b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd38815d220 0x7fd3880b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 -- 172.21.15.45:0/3045788719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780094b0 con 0x7fd3880d1210 2023-12-19T17:52:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd3877fe700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 0x7fd3880cc670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00e9a0 tx=0x7fd37c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c009720 con 0x7fd3880d1210 2023-12-19T17:52:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00c850 con 0x7fd3880d1210 2023-12-19T17:52:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00cc00 con 0x7fd3880d1210 2023-12-19T17:52:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.397+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3880d1980 con 0x7fd3880d1210 2023-12-19T17:52:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.401+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38815dd20 con 0x7fd3880d1210 2023-12-19T17:52:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.401+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd388072a90 con 0x7fd3880d1210 2023-12-19T17:52:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.401+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd37c013470 con 0x7fd3880d1210 2023-12-19T17:52:50.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.401+0000 7fd384ff9700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd374065ad0 0x7fd374067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.405+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd37c0835c0 con 0x7fd3880d1210 2023-12-19T17:52:50.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.405+0000 7fd387fff700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd374065ad0 0x7fd374067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.405+0000 7fd387fff700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd374065ad0 0x7fd374067f90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3780090b0 tx=0x7fd37801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:50.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.409+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd37c050b90 con 0x7fd3880d1210 2023-12-19T17:52:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.589+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd38804ed30 con 0x7fd3880d1210 2023-12-19T17:52:50.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.589+0000 7fd384ff9700 1 -- 172.21.15.45:0/3045788719 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd37c0541b0 con 0x7fd3880d1210 2023-12-19T17:52:50.595 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd374065ad0 msgr2=0x7fd374067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd374065ad0 0x7fd374067f90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd3780090b0 tx=0x7fd37801c040 comp rx=0 tx=0).stop 2023-12-19T17:52:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 msgr2=0x7fd3880cc670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 0x7fd3880cc670 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd37c00e9a0 tx=0x7fd37c00ecb0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 shutdown_connections 2023-12-19T17:52:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd374065ad0 0x7fd374067f90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd38815d220 0x7fd3880b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3880d1210 0x7fd3880cc670 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 --2- 172.21.15.45:0/3045788719 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3880d0e30 0x7fd38814aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 >> 172.21.15.45:0/3045788719 conn(0x7fd3880b46d0 msgr2=0x7fd38815b220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 shutdown_connections 2023-12-19T17:52:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.597+0000 7fd38d545700 1 -- 172.21.15.45:0/3045788719 wait complete. 2023-12-19T17:52:50.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.801+0000 7f457b59e700 1 Processor -- start 2023-12-19T17:52:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.801+0000 7f457b59e700 1 -- start start 2023-12-19T17:52:50.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f457b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f457c06a720 0x7f457c0cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f457b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c160ac0 con 0x7f457c15d180 2023-12-19T17:52:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f457b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457c161640 con 0x7f457c15cda0 2023-12-19T17:52:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f457b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457c160d10 con 0x7f457c06a720 2023-12-19T17:52:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f457ad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f457c15d180 0x7f457c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58984/0 (socket says 172.21.15.45:58984) 2023-12-19T17:52:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f457ad9d700 1 -- 172.21.15.45:0/3382261885 learned_addr learned my addr 172.21.15.45:0/3382261885 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.805+0000 7f4579d9b700 1 --2- 172.21.15.45:0/3382261885 >> v2:172.21.15.73:3300/0 conn(0x7f457c06a720 0x7f457c0cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457959a700 1 -- 172.21.15.45:0/3382261885 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979918935 0 0) 0x7f457c160ac0 con 0x7f457c15d180 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457959a700 1 -- 172.21.15.45:0/3382261885 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45640035d0 con 0x7f457c15d180 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457959a700 1 -- 172.21.15.45:0/3382261885 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1576431166 0 0) 0x7f45640035d0 con 0x7f457c15d180 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f4579d9b700 1 -- 172.21.15.45:0/3382261885 >> v1:172.21.15.73:6789/0 conn(0x7f457c15cda0 legacy=0x7f457c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f4579d9b700 1 -- 172.21.15.45:0/3382261885 >> v1:172.21.15.45:6789/0 conn(0x7f457c15d180 legacy=0x7f457c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f4579d9b700 1 -- 172.21.15.45:0/3382261885 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457c160ff0 con 0x7f457c06a720 2023-12-19T17:52:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f4579d9b700 1 --2- 172.21.15.45:0/3382261885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c0cb1b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4570009850 tx=0x7f4570009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f5c33f27f66295 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457959a700 1 -- 172.21.15.45:0/3382261885 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740019f0 con 0x7f457c06a720 2023-12-19T17:52:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457959a700 1 -- 172.21.15.45:0/3382261885 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4570004030 con 0x7f457c06a720 2023-12-19T17:52:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457959a700 1 -- 172.21.15.45:0/3382261885 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45700043c0 con 0x7f457c06a720 2023-12-19T17:52:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 -- 172.21.15.45:0/3382261885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 msgr2=0x7f457c0cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 --2- 172.21.15.45:0/3382261885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c0cb1b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f4570009850 tx=0x7f4570009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 -- 172.21.15.45:0/3382261885 shutdown_connections 2023-12-19T17:52:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 --2- 172.21.15.45:0/3382261885 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c0cb1b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 -- 172.21.15.45:0/3382261885 >> 172.21.15.45:0/3382261885 conn(0x7f457c0cf960 msgr2=0x7f457c0cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 -- 172.21.15.45:0/3382261885 shutdown_connections 2023-12-19T17:52:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.809+0000 7f457b59e700 1 -- 172.21.15.45:0/3382261885 wait complete. 2023-12-19T17:52:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 Processor -- start 2023-12-19T17:52:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 -- start start 2023-12-19T17:52:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f457c15cda0 0x7f457c0c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 0x7f457c0b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c1f2680 con 0x7f457c15d180 2023-12-19T17:52:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f457c0c8d00 con 0x7f457c06a720 2023-12-19T17:52:50.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.813+0000 7f457b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f457c151130 con 0x7f457c15cda0 2023-12-19T17:52:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 0x7f457c0b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 0x7f457c0b09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33016/0 (socket says 172.21.15.45:33016) 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 -- 172.21.15.45:0/1685626308 learned_addr learned my addr 172.21.15.45:0/1685626308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457a59c700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f4579d9b700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f457c15cda0 0x7f457c0c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 -- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f457c15cda0 msgr2=0x7f457c0c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f457c15cda0 0x7f457c0c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 -- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 msgr2=0x7f457c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 -- 172.21.15.45:0/1685626308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45700094b0 con 0x7f457c15d180 2023-12-19T17:52:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457ad9d700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 0x7f457c0b09b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f457400cc10 tx=0x7f457400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457400a9e0 con 0x7f457c15d180 2023-12-19T17:52:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c14dd20 con 0x7f457c15d180 2023-12-19T17:52:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457400ab40 con 0x7f457c15d180 2023-12-19T17:52:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45740070d0 con 0x7f457c15d180 2023-12-19T17:52:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.817+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f457c14d760 con 0x7f457c15d180 2023-12-19T17:52:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.821+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f457c06f5d0 con 0x7f457c15d180 2023-12-19T17:52:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.821+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4574007230 con 0x7f457c15d180 2023-12-19T17:52:50.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.821+0000 7f456affd700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f455c065ad0 0x7f455c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:50.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.821+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4574083410 con 0x7f457c15d180 2023-12-19T17:52:50.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.825+0000 7f457a59c700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f455c065ad0 0x7f455c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:50.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.825+0000 7f457a59c700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f455c065ad0 0x7f455c067f90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f456c000f60 tx=0x7f456c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:50.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:50.829+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f45740508d0 con 0x7f457c15d180 2023-12-19T17:52:51.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.021+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f457c067760 con 0x7f457c15d180 2023-12-19T17:52:51.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f456affd700 1 -- 172.21.15.45:0/1685626308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4574053ef0 con 0x7f457c15d180 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f455c065ad0 msgr2=0x7f455c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f455c065ad0 0x7f455c067f90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f456c000f60 tx=0x7f456c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 msgr2=0x7f457c0b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 0x7f457c0b09b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f457400cc10 tx=0x7f457400cf20 comp rx=0 tx=0).stop 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 shutdown_connections 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f455c065ad0 0x7f455c067f90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f457c15d180 0x7f457c0b09b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f457c15cda0 0x7f457c0c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 --2- 172.21.15.45:0/1685626308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f457c06a720 0x7f457c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 >> 172.21.15.45:0/1685626308 conn(0x7f457c0cf960 msgr2=0x7f457c0cfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 shutdown_connections 2023-12-19T17:52:51.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.025+0000 7f457b59e700 1 -- 172.21.15.45:0/1685626308 wait complete. 2023-12-19T17:52:51.033 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:51.056 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:52:51.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:51.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-19T17:52:51.092 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:52:51.092 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:52:51.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:51.092 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T17:52:51.156 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:52:51.156 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:51.176 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:52:51.176 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:51.235 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:51.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.413+0000 7f4592e5e700 1 Processor -- start 2023-12-19T17:52:51.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.413+0000 7f4592e5e700 1 -- start start 2023-12-19T17:52:51.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4592e5e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f458c06f4a0 0x7f458c0d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4592e5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d420 0x7f458c0d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4592e5e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458c0b6060 con 0x7f458c15d040 2023-12-19T17:52:51.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4592e5e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f458c06f930 con 0x7f458c06f4a0 2023-12-19T17:52:51.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4592e5e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c06fc10 con 0x7f458c15d420 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4590bfa700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f458c15d040 0x7f458c0cdf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58996/0 (socket says 172.21.15.45:58996) 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4590bfa700 1 -- 172.21.15.45:0/1078113449 learned_addr learned my addr 172.21.15.45:0/1078113449 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f4583fff700 1 --2- 172.21.15.45:0/1078113449 >> v2:172.21.15.45:3300/0 conn(0x7f458c06f4a0 0x7f458c0d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.417+0000 7f45913fb700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d420 0x7f458c0d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f45837fe700 1 -- 172.21.15.45:0/1078113449 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366172208 0 0) 0x7f458c0b6060 con 0x7f458c15d040 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f45837fe700 1 -- 172.21.15.45:0/1078113449 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45740035d0 con 0x7f458c15d040 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4583fff700 1 -- 172.21.15.45:0/1078113449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d420 msgr2=0x7f458c0d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4583fff700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d420 0x7f458c0d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4583fff700 1 -- 172.21.15.45:0/1078113449 >> v1:172.21.15.45:6789/0 conn(0x7f458c15d040 legacy=0x7f458c0cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4583fff700 1 -- 172.21.15.45:0/1078113449 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f458c06fef0 con 0x7f458c06f4a0 2023-12-19T17:52:51.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f45913fb700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d420 0x7f458c0d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:51.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4583fff700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c06f4a0 0x7f458c0d21a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f457c009850 tx=0x7f457c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea319ba194fe638b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:51.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f45837fe700 1 -- 172.21.15.45:0/1078113449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011830 con 0x7f458c06f4a0 2023-12-19T17:52:51.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f45837fe700 1 -- 172.21.15.45:0/1078113449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457c011990 con 0x7f458c06f4a0 2023-12-19T17:52:51.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f45837fe700 1 -- 172.21.15.45:0/1078113449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f457c011d40 con 0x7f458c06f4a0 2023-12-19T17:52:51.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 -- 172.21.15.45:0/1078113449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c06f4a0 msgr2=0x7f458c0d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c06f4a0 0x7f458c0d21a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f457c009850 tx=0x7f457c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:51.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 -- 172.21.15.45:0/1078113449 shutdown_connections 2023-12-19T17:52:51.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d420 0x7f458c0d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1078113449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c06f4a0 0x7f458c0d21a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 -- 172.21.15.45:0/1078113449 >> 172.21.15.45:0/1078113449 conn(0x7f458c0d2e50 msgr2=0x7f458c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:51.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 -- 172.21.15.45:0/1078113449 shutdown_connections 2023-12-19T17:52:51.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.421+0000 7f4592e5e700 1 -- 172.21.15.45:0/1078113449 wait complete. 2023-12-19T17:52:51.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.425+0000 7f4592e5e700 1 Processor -- start 2023-12-19T17:52:51.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.425+0000 7f4592e5e700 1 -- start start 2023-12-19T17:52:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.425+0000 7f4592e5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d040 0x7f458c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.425+0000 7f4592e5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458c15d420 0x7f458c0cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.425+0000 7f4592e5e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 0x7f458c1e6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4592e5e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0cbed0 con 0x7f458c0ccac0 2023-12-19T17:52:51.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4592e5e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0caf70 con 0x7f458c15d420 2023-12-19T17:52:51.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4592e5e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f458c0cb250 con 0x7f458c15d040 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 0x7f458c1e6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 0x7f458c1e6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33038/0 (socket says 172.21.15.45:33038) 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 -- 172.21.15.45:0/1562568281 learned_addr learned my addr 172.21.15.45:0/1562568281 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4590bfa700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d040 0x7f458c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4583fff700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458c15d420 0x7f458c0cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 -- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d040 msgr2=0x7f458c14b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d040 0x7f458c14b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 -- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458c15d420 msgr2=0x7f458c0cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458c15d420 0x7f458c0cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 -- 172.21.15.45:0/1562568281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4584009a70 con 0x7f458c0ccac0 2023-12-19T17:52:51.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45913fb700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 0x7f458c1e6b50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f458400efc0 tx=0x7f458400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:51.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f458400cb40 con 0x7f458c0ccac0 2023-12-19T17:52:51.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f458400f040 con 0x7f458c0ccac0 2023-12-19T17:52:51.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f457c0094b0 con 0x7f458c0ccac0 2023-12-19T17:52:51.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4584003a40 con 0x7f458c0ccac0 2023-12-19T17:52:51.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.429+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f458c0cb810 con 0x7f458c0ccac0 2023-12-19T17:52:51.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.433+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f458c0cc010 con 0x7f458c0ccac0 2023-12-19T17:52:51.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.433+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4584014480 con 0x7f458c0ccac0 2023-12-19T17:52:51.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.433+0000 7f45817fa700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4578065ad0 0x7f4578067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.433+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4584083f10 con 0x7f458c0ccac0 2023-12-19T17:52:51.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.437+0000 7f4590bfa700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4578065ad0 0x7f4578067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.437+0000 7f4590bfa700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4578065ad0 0x7f4578067f90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4588005930 tx=0x7f4588009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:51.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.441+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f458c0cc010 con 0x7f458c0ccac0 2023-12-19T17:52:51.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.617+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f458c0cc010 con 0x7f458c0ccac0 2023-12-19T17:52:51.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.621+0000 7f45817fa700 1 -- 172.21.15.45:0/1562568281 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f458c0cc010 con 0x7f458c0ccac0 2023-12-19T17:52:51.624 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:51.624 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:51.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.621+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4578065ad0 msgr2=0x7f4578067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.621+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4578065ad0 0x7f4578067f90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4588005930 tx=0x7f4588009040 comp rx=0 tx=0).stop 2023-12-19T17:52:51.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.621+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 msgr2=0x7f458c1e6b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.621+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 0x7f458c1e6b50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f458400efc0 tx=0x7f458400c3a0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 shutdown_connections 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4578065ad0 0x7f4578067f90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f458c0ccac0 0x7f458c1e6b50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f458c15d420 0x7f458c0cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 --2- 172.21.15.45:0/1562568281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f458c15d040 0x7f458c14b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 >> 172.21.15.45:0/1562568281 conn(0x7f458c0d2e50 msgr2=0x7f458c0c5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 shutdown_connections 2023-12-19T17:52:51.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.625+0000 7f4592e5e700 1 -- 172.21.15.45:0/1562568281 wait complete. 2023-12-19T17:52:51.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:51.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:51.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.841+0000 7efe62266700 1 Processor -- start 2023-12-19T17:52:51.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.841+0000 7efe62266700 1 -- start start 2023-12-19T17:52:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe62266700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efe5c0cdfd0 0x7efe5c167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe62266700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c15d300 con 0x7efe5c15cf20 2023-12-19T17:52:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe62266700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5c0d1550 con 0x7efe5c0b8580 2023-12-19T17:52:51.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe62266700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe5c0d1360 con 0x7efe5c0cdfd0 2023-12-19T17:52:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe61264700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efe5c15cf20 0x7efe5c0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59006/0 (socket says 172.21.15.45:59006) 2023-12-19T17:52:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe61264700 1 -- 172.21.15.45:0/2996984768 learned_addr learned my addr 172.21.15.45:0/2996984768 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:51.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.845+0000 7efe61a65700 1 --2- 172.21.15.45:0/2996984768 >> v2:172.21.15.45:3300/0 conn(0x7efe5c0cdfd0 0x7efe5c167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128137655 0 0) 0x7efe5c15d300 con 0x7efe5c15cf20 2023-12-19T17:52:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe480035d0 con 0x7efe5c15cf20 2023-12-19T17:52:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3555467664 0 0) 0x7efe5c0d1550 con 0x7efe5c0b8580 2023-12-19T17:52:51.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe5c15d300 con 0x7efe5c0b8580 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe61a65700 1 -- 172.21.15.45:0/2996984768 >> v1:172.21.15.73:6789/0 conn(0x7efe5c0b8580 legacy=0x7efe5c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe61a65700 1 -- 172.21.15.45:0/2996984768 >> v1:172.21.15.45:6789/0 conn(0x7efe5c15cf20 legacy=0x7efe5c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe61a65700 1 -- 172.21.15.45:0/2996984768 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe5c0d1830 con 0x7efe5c0cdfd0 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe61a65700 1 --2- 172.21.15.45:0/2996984768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0cdfd0 0x7efe5c167a30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe54009d90 tx=0x7efe5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c40176c36c1d94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe5400e070 con 0x7efe5c0cdfd0 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe5400bb20 con 0x7efe5c0cdfd0 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe53fff700 1 -- 172.21.15.45:0/2996984768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54012430 con 0x7efe5c0cdfd0 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 -- 172.21.15.45:0/2996984768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0cdfd0 msgr2=0x7efe5c167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 --2- 172.21.15.45:0/2996984768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0cdfd0 0x7efe5c167a30 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efe54009d90 tx=0x7efe5400b330 comp rx=0 tx=0).stop 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 -- 172.21.15.45:0/2996984768 shutdown_connections 2023-12-19T17:52:51.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 --2- 172.21.15.45:0/2996984768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0cdfd0 0x7efe5c167a30 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 -- 172.21.15.45:0/2996984768 >> 172.21.15.45:0/2996984768 conn(0x7efe5c0b4670 msgr2=0x7efe5c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 -- 172.21.15.45:0/2996984768 shutdown_connections 2023-12-19T17:52:51.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.849+0000 7efe62266700 1 -- 172.21.15.45:0/2996984768 wait complete. 2023-12-19T17:52:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 Processor -- start 2023-12-19T17:52:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 -- start start 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 0x7efe5c14a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe5c0cdfd0 0x7efe5c15ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe5c15cf20 0x7efe5c0b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c14abf0 con 0x7efe5c0b8580 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c15f870 con 0x7efe5c15cf20 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe62266700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5c15fb50 con 0x7efe5c0cdfd0 2023-12-19T17:52:51.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.853+0000 7efe61264700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 0x7efe5c14a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 0x7efe5c14a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33052/0 (socket says 172.21.15.45:33052) 2023-12-19T17:52:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 -- 172.21.15.45:0/319033947 learned_addr learned my addr 172.21.15.45:0/319033947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61a65700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe5c15cf20 0x7efe5c0b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe60a63700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe5c0cdfd0 0x7efe5c15ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 -- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe5c0cdfd0 msgr2=0x7efe5c15ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe5c0cdfd0 0x7efe5c15ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 -- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe5c15cf20 msgr2=0x7efe5c0b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe5c15cf20 0x7efe5c0b7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 -- 172.21.15.45:0/319033947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe54009a70 con 0x7efe5c0b8580 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe61264700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 0x7efe5c14a6b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efe58001eb0 tx=0x7efe5800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58005d90 con 0x7efe5c0b8580 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe580070d0 con 0x7efe5c0b8580 2023-12-19T17:52:51.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe58007460 con 0x7efe5c0b8580 2023-12-19T17:52:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5c15fe30 con 0x7efe5c0b8580 2023-12-19T17:52:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.857+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5c1603f0 con 0x7efe5c0b8580 2023-12-19T17:52:51.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.861+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5c0a95e0 con 0x7efe5c0b8580 2023-12-19T17:52:51.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.861+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efe580075c0 con 0x7efe5c0b8580 2023-12-19T17:52:51.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.865+0000 7efe51ffb700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe40065ad0 0x7efe40067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:51.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.865+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efe580829d0 con 0x7efe5c0b8580 2023-12-19T17:52:51.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.865+0000 7efe60a63700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe40065ad0 0x7efe40067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:51.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.865+0000 7efe60a63700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe40065ad0 0x7efe40067f90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe5c1f5730 tx=0x7efe4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:51.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:51.869+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efe5804fe80 con 0x7efe5c0b8580 2023-12-19T17:52:52.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.053+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe5c04ed30 con 0x7efe5c0b8580 2023-12-19T17:52:52.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.053+0000 7efe51ffb700 1 -- 172.21.15.45:0/319033947 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe580170a0 con 0x7efe5c0b8580 2023-12-19T17:52:52.057 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe40065ad0 msgr2=0x7efe40067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe40065ad0 0x7efe40067f90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7efe5c1f5730 tx=0x7efe4c009040 comp rx=0 tx=0).stop 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 msgr2=0x7efe5c14a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 0x7efe5c14a6b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efe58001eb0 tx=0x7efe5800c7b0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 shutdown_connections 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe40065ad0 0x7efe40067f90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe5c15cf20 0x7efe5c0b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe5c0cdfd0 0x7efe5c15ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 --2- 172.21.15.45:0/319033947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe5c0b8580 0x7efe5c14a6b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 >> 172.21.15.45:0/319033947 conn(0x7efe5c0b4670 msgr2=0x7efe5c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 shutdown_connections 2023-12-19T17:52:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.057+0000 7efe62266700 1 -- 172.21.15.45:0/319033947 wait complete. 2023-12-19T17:52:52.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:52.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.265+0000 7fea7132c700 1 Processor -- start 2023-12-19T17:52:52.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.265+0000 7fea7132c700 1 -- start start 2023-12-19T17:52:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea7132c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea7132c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0d10e0 con 0x7fea6c0cff40 2023-12-19T17:52:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea7132c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0d13c0 con 0x7fea6c0cdff0 2023-12-19T17:52:52.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea7132c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0b6040 con 0x7fea6c15d090 2023-12-19T17:52:52.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea6c0cff40 0x7fea6c0b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59020/0 (socket says 172.21.15.45:59020) 2023-12-19T17:52:52.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6b7fe700 1 -- 172.21.15.45:0/1845612771 learned_addr learned my addr 172.21.15.45:0/1845612771 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:52.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6affd700 1 --2- 172.21.15.45:0/1845612771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea69ffb700 1 -- 172.21.15.45:0/1845612771 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191197348 0 0) 0x7fea6c0d10e0 con 0x7fea6c0cff40 2023-12-19T17:52:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea69ffb700 1 -- 172.21.15.45:0/1845612771 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea540035d0 con 0x7fea6c0cff40 2023-12-19T17:52:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6affd700 1 -- 172.21.15.45:0/1845612771 >> v1:172.21.15.73:6789/0 conn(0x7fea6c0cdff0 legacy=0x7fea6c0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6affd700 1 -- 172.21.15.45:0/1845612771 >> v1:172.21.15.45:6789/0 conn(0x7fea6c0cff40 legacy=0x7fea6c0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6affd700 1 -- 172.21.15.45:0/1845612771 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0d16a0 con 0x7fea6c15d090 2023-12-19T17:52:52.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea6affd700 1 --2- 172.21.15.45:0/1845612771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c0d0a50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009880 tx=0x7fea5c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=352594e2180d6924 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:52.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea69ffb700 1 -- 172.21.15.45:0/1845612771 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011830 con 0x7fea6c15d090 2023-12-19T17:52:52.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea69ffb700 1 -- 172.21.15.45:0/1845612771 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c011990 con 0x7fea6c15d090 2023-12-19T17:52:52.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.269+0000 7fea69ffb700 1 -- 172.21.15.45:0/1845612771 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c011d20 con 0x7fea6c15d090 2023-12-19T17:52:52.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 -- 172.21.15.45:0/1845612771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 msgr2=0x7fea6c0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 --2- 172.21.15.45:0/1845612771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c0d0a50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fea5c009880 tx=0x7fea5c009b90 comp rx=0 tx=0).stop 2023-12-19T17:52:52.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 -- 172.21.15.45:0/1845612771 shutdown_connections 2023-12-19T17:52:52.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 --2- 172.21.15.45:0/1845612771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c0d0a50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 -- 172.21.15.45:0/1845612771 >> 172.21.15.45:0/1845612771 conn(0x7fea6c0b4b90 msgr2=0x7fea6c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 -- 172.21.15.45:0/1845612771 shutdown_connections 2023-12-19T17:52:52.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.273+0000 7fea7132c700 1 -- 172.21.15.45:0/1845612771 wait complete. 2023-12-19T17:52:52.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 Processor -- start 2023-12-19T17:52:52.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 -- start start 2023-12-19T17:52:52.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 0x7fea6c1547a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0cff40 0x7fea6c14ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c160160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c15e3c0 con 0x7fea6c0cdff0 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c150470 con 0x7fea6c0cff40 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea7132c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c155340 con 0x7fea6c15d090 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea6affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 0x7fea6c1547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea6a7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0cff40 0x7fea6c14ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea6affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 0x7fea6c1547a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33062/0 (socket says 172.21.15.45:33062) 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea6affd700 1 -- 172.21.15.45:0/3937678950 learned_addr learned my addr 172.21.15.45:0/3937678950 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:52.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.277+0000 7fea6b7fe700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c160160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6affd700 1 -- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 msgr2=0x7fea6c160160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6affd700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c160160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6affd700 1 -- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0cff40 msgr2=0x7fea6c14ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6affd700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0cff40 0x7fea6c14ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6affd700 1 -- 172.21.15.45:0/3937678950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea5c0094b0 con 0x7fea6c0cdff0 2023-12-19T17:52:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6a7fc700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0cff40 0x7fea6c14ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6b7fe700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea6affd700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 0x7fea6c1547a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea5c013040 tx=0x7fea5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c004610 con 0x7fea6c0cdff0 2023-12-19T17:52:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea5c0036c0 con 0x7fea6c0cdff0 2023-12-19T17:52:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5c003a50 con 0x7fea6c0cdff0 2023-12-19T17:52:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c154d80 con 0x7fea6c0cdff0 2023-12-19T17:52:52.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c15e5f0 con 0x7fea6c0cdff0 2023-12-19T17:52:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.281+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c04ed30 con 0x7fea6c0cdff0 2023-12-19T17:52:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.285+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea5c003bb0 con 0x7fea6c0cdff0 2023-12-19T17:52:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.285+0000 7fea537fe700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea58065ad0 0x7fea58067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.285+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fea5c084c80 con 0x7fea6c0cdff0 2023-12-19T17:52:52.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.285+0000 7fea6a7fc700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea58065ad0 0x7fea58067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.285+0000 7fea6a7fc700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea58065ad0 0x7fea58067f90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea60000f60 tx=0x7fea60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:52.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.289+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea5c052410 con 0x7fea6c0cdff0 2023-12-19T17:52:52.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.465+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fea6c0cb850 con 0x7fea6c0cdff0 2023-12-19T17:52:52.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.465+0000 7fea537fe700 1 -- 172.21.15.45:0/3937678950 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fea5c003e60 con 0x7fea6c0cdff0 2023-12-19T17:52:52.470 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea58065ad0 msgr2=0x7fea58067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea58065ad0 0x7fea58067f90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fea60000f60 tx=0x7fea60009040 comp rx=0 tx=0).stop 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 msgr2=0x7fea6c1547a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 0x7fea6c1547a0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea5c013040 tx=0x7fea5c004770 comp rx=0 tx=0).stop 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 shutdown_connections 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea58065ad0 0x7fea58067f90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c15d090 0x7fea6c160160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0cff40 0x7fea6c14ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 --2- 172.21.15.45:0/3937678950 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0cdff0 0x7fea6c1547a0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 >> 172.21.15.45:0/3937678950 conn(0x7fea6c0b4b90 msgr2=0x7fea6c152200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:52.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 shutdown_connections 2023-12-19T17:52:52.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.473+0000 7fea7132c700 1 -- 172.21.15.45:0/3937678950 wait complete. 2023-12-19T17:52:52.498 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.681+0000 7f19b72a7700 1 Processor -- start 2023-12-19T17:52:52.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.681+0000 7f19b72a7700 1 -- start start 2023-12-19T17:52:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.681+0000 7f19b72a7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19b00cc690 0x7f19b015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.681+0000 7f19b72a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b00cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b72a7700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19b006ea90 con 0x7f19b00cb700 2023-12-19T17:52:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b72a7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19b00cbb70 con 0x7f19b00cc690 2023-12-19T17:52:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b72a7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b015c340 con 0x7f19b00ce350 2023-12-19T17:52:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b5844700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19b00cb700 0x7f19b015e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59022/0 (socket says 172.21.15.45:59022) 2023-12-19T17:52:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b5844700 1 -- 172.21.15.45:0/726711049 learned_addr learned my addr 172.21.15.45:0/726711049 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b5043700 1 --2- 172.21.15.45:0/726711049 >> v2:172.21.15.73:3300/0 conn(0x7f19b00cc690 0x7f19b015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b4842700 1 --2- 172.21.15.45:0/726711049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b00cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19a7fff700 1 -- 172.21.15.45:0/726711049 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 89912140 0 0) 0x7f19b006ea90 con 0x7f19b00cb700 2023-12-19T17:52:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19a7fff700 1 -- 172.21.15.45:0/726711049 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f199c0035d0 con 0x7f19b00cb700 2023-12-19T17:52:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b4842700 1 -- 172.21.15.45:0/726711049 >> v2:172.21.15.73:3300/0 conn(0x7f19b00cc690 msgr2=0x7f19b015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b4842700 1 --2- 172.21.15.45:0/726711049 >> v2:172.21.15.73:3300/0 conn(0x7f19b00cc690 0x7f19b015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b4842700 1 -- 172.21.15.45:0/726711049 >> v1:172.21.15.45:6789/0 conn(0x7f19b00cb700 legacy=0x7f19b015e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b4842700 1 -- 172.21.15.45:0/726711049 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b015baa0 con 0x7f19b00ce350 2023-12-19T17:52:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19b4842700 1 --2- 172.21.15.45:0/726711049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b00cb1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009850 tx=0x7f19a0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aee90eb0d1e592c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19a7fff700 1 -- 172.21.15.45:0/726711049 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011830 con 0x7f19b00ce350 2023-12-19T17:52:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19a7fff700 1 -- 172.21.15.45:0/726711049 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a0011990 con 0x7f19b00ce350 2023-12-19T17:52:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.685+0000 7f19a7fff700 1 -- 172.21.15.45:0/726711049 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0011d40 con 0x7f19b00ce350 2023-12-19T17:52:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 -- 172.21.15.45:0/726711049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 msgr2=0x7f19b00cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 --2- 172.21.15.45:0/726711049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b00cb1c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009850 tx=0x7f19a0009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 -- 172.21.15.45:0/726711049 shutdown_connections 2023-12-19T17:52:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 --2- 172.21.15.45:0/726711049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b00cb1c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 --2- 172.21.15.45:0/726711049 >> v2:172.21.15.73:3300/0 conn(0x7f19b00cc690 0x7f19b015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 -- 172.21.15.45:0/726711049 >> 172.21.15.45:0/726711049 conn(0x7f19b0071990 msgr2=0x7f19b00b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 -- 172.21.15.45:0/726711049 shutdown_connections 2023-12-19T17:52:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.689+0000 7f19b72a7700 1 -- 172.21.15.45:0/726711049 wait complete. 2023-12-19T17:52:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 Processor -- start 2023-12-19T17:52:52.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 -- start start 2023-12-19T17:52:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19b00cb700 0x7f19b014ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 0x7f19b01522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b01516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0152820 con 0x7f19b00cc690 2023-12-19T17:52:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0151230 con 0x7f19b00cb700 2023-12-19T17:52:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b72a7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19b0156900 con 0x7f19b00ce350 2023-12-19T17:52:52.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b4842700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 0x7f19b01522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b4842700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 0x7f19b01522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33066/0 (socket says 172.21.15.45:33066) 2023-12-19T17:52:52.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b4842700 1 -- 172.21.15.45:0/1385034975 learned_addr learned my addr 172.21.15.45:0/1385034975 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:52.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b5043700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19b00cb700 0x7f19b014ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b5844700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b01516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b4842700 1 -- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 msgr2=0x7f19b01516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.693+0000 7f19b4842700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b01516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b4842700 1 -- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19b00cb700 msgr2=0x7f19b014ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b4842700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19b00cb700 0x7f19b014ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b4842700 1 -- 172.21.15.45:0/1385034975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00094b0 con 0x7f19b00cc690 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b5043700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19b00cb700 0x7f19b014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b5844700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b4842700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 0x7f19b01522e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f19a00090b0 tx=0x7f19a0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0004520 con 0x7f19b00cc690 2023-12-19T17:52:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a001f070 con 0x7f19b00cc690 2023-12-19T17:52:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0003900 con 0x7f19b00cc690 2023-12-19T17:52:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19b0156be0 con 0x7f19b00cc690 2023-12-19T17:52:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b0152ca0 con 0x7f19b00cc690 2023-12-19T17:52:52.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.697+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19b00cf8d0 con 0x7f19b00cc690 2023-12-19T17:52:52.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.701+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19a0003a60 con 0x7f19b00cc690 2023-12-19T17:52:52.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.701+0000 7f19a5ffb700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1994065ad0 0x7f1994067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:52.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.701+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f19a0021070 con 0x7f19b00cc690 2023-12-19T17:52:52.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.701+0000 7f19b5043700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1994065ad0 0x7f1994067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:52.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.705+0000 7f19b5043700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1994065ad0 0x7f1994067f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009ba0 tx=0x7f19ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:52.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.709+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f19a0052130 con 0x7f19b00cc690 2023-12-19T17:52:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.889+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19b01513a0 con 0x7f19b00cc690 2023-12-19T17:52:52.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.889+0000 7f19a5ffb700 1 -- 172.21.15.45:0/1385034975 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19a002b0a0 con 0x7f19b00cc690 2023-12-19T17:52:52.894 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:52.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1994065ad0 msgr2=0x7f1994067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1994065ad0 0x7f1994067f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009ba0 tx=0x7f19ac008040 comp rx=0 tx=0).stop 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 msgr2=0x7f19b01522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 0x7f19b01522e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f19a00090b0 tx=0x7f19a0004770 comp rx=0 tx=0).stop 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 shutdown_connections 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1994065ad0 0x7f1994067f90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19b00ce350 0x7f19b01516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19b00cc690 0x7f19b01522e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 --2- 172.21.15.45:0/1385034975 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19b00cb700 0x7f19b014ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 >> 172.21.15.45:0/1385034975 conn(0x7f19b0071990 msgr2=0x7f19b00b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 shutdown_connections 2023-12-19T17:52:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:52.893+0000 7f19b72a7700 1 -- 172.21.15.45:0/1385034975 wait complete. 2023-12-19T17:52:52.919 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:53.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.105+0000 7f4835384700 1 Processor -- start 2023-12-19T17:52:53.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.105+0000 7f4835384700 1 -- start start 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4835384700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48300713d0 0x7f4830071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4835384700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48300ccd70 0x7f48300cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4835384700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48300b2a40 con 0x7f4830159a40 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4835384700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48300ccb50 con 0x7f48300713d0 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4835384700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830071da0 con 0x7f48300ccd70 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4830159a40 0x7f48300ae090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59036/0 (socket says 172.21.15.45:59036) 2023-12-19T17:52:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482ffff700 1 -- 172.21.15.45:0/857507048 learned_addr learned my addr 172.21.15.45:0/857507048 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482f7fe700 1 --2- 172.21.15.45:0/857507048 >> v2:172.21.15.73:3300/0 conn(0x7f48300713d0 0x7f4830071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4834b83700 1 --2- 172.21.15.45:0/857507048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48300ccd70 0x7f48300cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482effd700 1 -- 172.21.15.45:0/857507048 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762046370 0 0) 0x7f48300b2a40 con 0x7f4830159a40 2023-12-19T17:52:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482effd700 1 -- 172.21.15.45:0/857507048 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48180035d0 con 0x7f4830159a40 2023-12-19T17:52:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4834b83700 1 -- 172.21.15.45:0/857507048 >> v2:172.21.15.73:3300/0 conn(0x7f48300713d0 msgr2=0x7f4830071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4834b83700 1 --2- 172.21.15.45:0/857507048 >> v2:172.21.15.73:3300/0 conn(0x7f48300713d0 0x7f4830071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4834b83700 1 -- 172.21.15.45:0/857507048 >> v1:172.21.15.45:6789/0 conn(0x7f4830159a40 legacy=0x7f48300ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482effd700 1 -- 172.21.15.45:0/857507048 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1542439909 0 0) 0x7f48180035d0 con 0x7f4830159a40 2023-12-19T17:52:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4834b83700 1 -- 172.21.15.45:0/857507048 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48300b2c90 con 0x7f48300ccd70 2023-12-19T17:52:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f4834b83700 1 --2- 172.21.15.45:0/857507048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48300ccd70 0x7f48300cd1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4828009d90 tx=0x7f482800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1598ca616df63af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482effd700 1 -- 172.21.15.45:0/857507048 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482800e070 con 0x7f48300ccd70 2023-12-19T17:52:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482effd700 1 -- 172.21.15.45:0/857507048 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482800bb20 con 0x7f48300ccd70 2023-12-19T17:52:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.109+0000 7f482effd700 1 -- 172.21.15.45:0/857507048 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828012430 con 0x7f48300ccd70 2023-12-19T17:52:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 -- 172.21.15.45:0/857507048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48300ccd70 msgr2=0x7f48300cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 --2- 172.21.15.45:0/857507048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48300ccd70 0x7f48300cd1d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4828009d90 tx=0x7f482800b330 comp rx=0 tx=0).stop 2023-12-19T17:52:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 -- 172.21.15.45:0/857507048 shutdown_connections 2023-12-19T17:52:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 --2- 172.21.15.45:0/857507048 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48300ccd70 0x7f48300cd1d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 --2- 172.21.15.45:0/857507048 >> v2:172.21.15.73:3300/0 conn(0x7f48300713d0 0x7f4830071860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 -- 172.21.15.45:0/857507048 >> 172.21.15.45:0/857507048 conn(0x7f48300cf5a0 msgr2=0x7f4830070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 -- 172.21.15.45:0/857507048 shutdown_connections 2023-12-19T17:52:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 -- 172.21.15.45:0/857507048 wait complete. 2023-12-19T17:52:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.113+0000 7f4835384700 1 Processor -- start 2023-12-19T17:52:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 -- start start 2023-12-19T17:52:53.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48300ccd70 0x7f4830154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4830159a40 0x7f4830158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f483006d6d0 0x7f483014e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483014e1f0 con 0x7f483006d6d0 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48301548b0 con 0x7f48300ccd70 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4835384700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483014dba0 con 0x7f4830159a40 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f4834b83700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f483006d6d0 0x7f483014e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48300ccd70 0x7f4830154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482f7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4830159a40 0x7f4830158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48300ccd70 0x7f4830154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:52376/0 (socket says 172.21.15.45:52376) 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482ffff700 1 -- 172.21.15.45:0/3672363067 learned_addr learned my addr 172.21.15.45:0/3672363067 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482f7fe700 1 -- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48300ccd70 msgr2=0x7f4830154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482f7fe700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48300ccd70 0x7f4830154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482f7fe700 1 -- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f483006d6d0 msgr2=0x7f483014e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482f7fe700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f483006d6d0 0x7f483014e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.117+0000 7f482f7fe700 1 -- 172.21.15.45:0/3672363067 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4828009a70 con 0x7f4830159a40 2023-12-19T17:52:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f482f7fe700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4830159a40 0x7f4830158600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f482400e900 tx=0x7f482400ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824013680 con 0x7f4830159a40 2023-12-19T17:52:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f483014de80 con 0x7f4830159a40 2023-12-19T17:52:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48240137e0 con 0x7f4830159a40 2023-12-19T17:52:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4824013b50 con 0x7f4830159a40 2023-12-19T17:52:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4830154b90 con 0x7f4830159a40 2023-12-19T17:52:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.121+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483014e360 con 0x7f4830159a40 2023-12-19T17:52:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.125+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4824013cb0 con 0x7f4830159a40 2023-12-19T17:52:53.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.125+0000 7f482cff9700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065b00 0x7f481c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.125+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f48240837c0 con 0x7f4830159a40 2023-12-19T17:52:53.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.125+0000 7f482ffff700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065b00 0x7f481c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.125+0000 7f482ffff700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065b00 0x7f481c067fc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f48200010e0 tx=0x7f4820009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:53.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.137+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4824050d10 con 0x7f4830159a40 2023-12-19T17:52:53.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.317+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f48300b2f70 con 0x7f4830159a40 2023-12-19T17:52:53.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.321+0000 7f482cff9700 1 -- 172.21.15.45:0/3672363067 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4824054330 con 0x7f4830159a40 2023-12-19T17:52:53.323 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:53.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065b00 msgr2=0x7f481c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065b00 0x7f481c067fc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f48200010e0 tx=0x7f4820009040 comp rx=0 tx=0).stop 2023-12-19T17:52:53.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4830159a40 msgr2=0x7f4830158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4830159a40 0x7f4830158600 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f482400e900 tx=0x7f482400ec10 comp rx=0 tx=0).stop 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 shutdown_connections 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065b00 0x7f481c067fc0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f483006d6d0 0x7f483014e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4830159a40 0x7f4830158600 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 --2- 172.21.15.45:0/3672363067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48300ccd70 0x7f4830154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 >> 172.21.15.45:0/3672363067 conn(0x7f48300713d0 msgr2=0x7f483006ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 shutdown_connections 2023-12-19T17:52:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.325+0000 7f4835384700 1 -- 172.21.15.45:0/3672363067 wait complete. 2023-12-19T17:52:53.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5a98700 1 Processor -- start 2023-12-19T17:52:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5a98700 1 -- start start 2023-12-19T17:52:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5a98700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 0x7f9da00c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5a98700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da0070340 con 0x7f9da01611c0 2023-12-19T17:52:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5a98700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9da00c3f90 con 0x7f9da01615a0 2023-12-19T17:52:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5a98700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c4270 con 0x7f9da00afe30 2023-12-19T17:52:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da4a96700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9da01611c0 0x7f9da006d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59040/0 (socket says 172.21.15.45:59040) 2023-12-19T17:52:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da4a96700 1 -- 172.21.15.45:0/665446833 learned_addr learned my addr 172.21.15.45:0/665446833 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.533+0000 7f9da5297700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 0x7f9da00c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2739744427 0 0) 0x7f9da0070340 con 0x7f9da01611c0 2023-12-19T17:52:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d900035d0 con 0x7f9da01611c0 2023-12-19T17:52:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569636113 0 0) 0x7f9da00c3f90 con 0x7f9da01615a0 2023-12-19T17:52:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da0070340 con 0x7f9da01615a0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163324278 0 0) 0x7f9d900035d0 con 0x7f9da01611c0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 msgr2=0x7f9da00c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 0x7f9da00c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 >> v1:172.21.15.73:6789/0 conn(0x7f9da01615a0 legacy=0x7f9da00af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da006eb30 con 0x7f9da01611c0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f9d94001670 con 0x7f9da01611c0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 >> v1:172.21.15.45:6789/0 conn(0x7f9da01611c0 legacy=0x7f9da006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90003be0 0x7f9d90003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 0x7f9d90004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d90004db0 0x7f9d90005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da00c4270 con 0x7f9d90004db0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9000bb60 con 0x7f9d90003be0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9000bd20 con 0x7f9da00afe30 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d90004db0 0x7f9d90005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da4a96700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90003be0 0x7f9d90003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9ffff700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 0x7f9d90004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 -- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 msgr2=0x7f9d90004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9da00afe30 0x7f9d90004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 -- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90003be0 msgr2=0x7f9d90003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d90003be0 0x7f9d90003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 -- 172.21.15.45:0/665446833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d900035d0 con 0x7f9d90004db0 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d90004db0 0x7f9d90005230 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009fc0 tx=0x7f9d900058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f292939d9fec0efb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800ec30 con 0x7f9d90004db0 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d9800f040 con 0x7f9d90004db0 2023-12-19T17:52:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9d9f7fe700 1 -- 172.21.15.45:0/665446833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98014480 con 0x7f9d90004db0 2023-12-19T17:52:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5a98700 1 -- 172.21.15.45:0/665446833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d90004db0 msgr2=0x7f9d90005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5a98700 1 --2- 172.21.15.45:0/665446833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9d90004db0 0x7f9d90005230 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f9d98009fc0 tx=0x7f9d900058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.537+0000 7f9da5297700 1 -- 172.21.15.45:0/665446833 reap_dead start 2023-12-19T17:52:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.541+0000 7f9da5a98700 1 -- 172.21.15.45:0/665446833 shutdown_connections 2023-12-19T17:52:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.541+0000 7f9da5a98700 1 -- 172.21.15.45:0/665446833 >> 172.21.15.45:0/665446833 conn(0x7f9da00cb900 msgr2=0x7f9da00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.541+0000 7f9da5a98700 1 -- 172.21.15.45:0/665446833 shutdown_connections 2023-12-19T17:52:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.541+0000 7f9da5a98700 1 -- 172.21.15.45:0/665446833 wait complete. 2023-12-19T17:52:53.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.541+0000 7f9da5a98700 1 Processor -- start 2023-12-19T17:52:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.541+0000 7f9da5a98700 1 -- start start 2023-12-19T17:52:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d90004db0 0x7f9da0164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da0158a40 0x7f9da01fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 0x7f9da01f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0161a60 con 0x7f9da01f5e30 2023-12-19T17:52:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9da0164940 con 0x7f9da0158a40 2023-12-19T17:52:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9da01f6820 con 0x7f9d90004db0 2023-12-19T17:52:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 0x7f9da01f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 0x7f9da01f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33102/0 (socket says 172.21.15.45:33102) 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 -- 172.21.15.45:0/3013662162 learned_addr learned my addr 172.21.15.45:0/3013662162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9d9ffff700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da0158a40 0x7f9da01fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da4a96700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d90004db0 0x7f9da0164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 -- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d90004db0 msgr2=0x7f9da0164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d90004db0 0x7f9da0164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 -- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da0158a40 msgr2=0x7f9da01fa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da0158a40 0x7f9da01fa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 -- 172.21.15.45:0/3013662162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da00b2410 con 0x7f9da01f5e30 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5297700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 0x7f9da01f62e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9d98017040 tx=0x7f9d98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98007000 con 0x7f9da01f5e30 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d98003e70 con 0x7f9da01f5e30 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9da00b26f0 con 0x7f9da01f5e30 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d98014a80 con 0x7f9da01f5e30 2023-12-19T17:52:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.545+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9da0161f90 con 0x7f9da01f5e30 2023-12-19T17:52:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.549+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da006e760 con 0x7f9da01f5e30 2023-12-19T17:52:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.549+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9d98023020 con 0x7f9da01f5e30 2023-12-19T17:52:53.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.553+0000 7f9d9d7fa700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d84065b00 0x7f9d84067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:53.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.553+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9d98084850 con 0x7f9da01f5e30 2023-12-19T17:52:53.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.553+0000 7f9da4a96700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d84065b00 0x7f9d84067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.553+0000 7f9da4a96700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d84065b00 0x7f9d84067fc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d94000c00 tx=0x7f9d94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:53.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.561+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9d98051ec0 con 0x7f9da01f5e30 2023-12-19T17:52:53.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.753+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9da00c9040 con 0x7f9da01f5e30 2023-12-19T17:52:53.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.753+0000 7f9d9d7fa700 1 -- 172.21.15.45:0/3013662162 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9d98018080 con 0x7f9da01f5e30 2023-12-19T17:52:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d84065b00 msgr2=0x7f9d84067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d84065b00 0x7f9d84067fc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f9d94000c00 tx=0x7f9d94009040 comp rx=0 tx=0).stop 2023-12-19T17:52:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 msgr2=0x7f9da01f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 0x7f9da01f62e0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9d98017040 tx=0x7f9d98009750 comp rx=0 tx=0).stop 2023-12-19T17:52:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 shutdown_connections 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9d84065b00 0x7f9d84067fc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9da01f5e30 0x7f9da01f62e0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9da0158a40 0x7f9da01fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 --2- 172.21.15.45:0/3013662162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9d90004db0 0x7f9da0164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 >> 172.21.15.45:0/3013662162 conn(0x7f9da00cb900 msgr2=0x7f9da00ca240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 shutdown_connections 2023-12-19T17:52:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:53.757+0000 7f9da5a98700 1 -- 172.21.15.45:0/3013662162 wait complete. 2023-12-19T17:52:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:53.788 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:52:53.788 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:52:53.808 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.021+0000 7f962f59e700 1 Processor -- start 2023-12-19T17:52:54.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.021+0000 7f962f59e700 1 -- start start 2023-12-19T17:52:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f963015cd70 0x7f96300cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f9630160de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962f59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9630161320 con 0x7f96300b1cd0 2023-12-19T17:52:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96300b0c30 con 0x7f963015cd70 2023-12-19T17:52:54.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96300b0f10 con 0x7f96301609b0 2023-12-19T17:52:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962e59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f963015cd70 0x7f96300cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f9625d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96300b1cd0 0x7f96300b0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59050/0 (socket says 172.21.15.45:59050) 2023-12-19T17:52:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f9625d9b700 1 -- 172.21.15.45:0/2246502307 learned_addr learned my addr 172.21.15.45:0/2246502307 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:54.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962ed9d700 1 --2- 172.21.15.45:0/2246502307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f9630160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962ed9d700 1 -- 172.21.15.45:0/2246502307 >> v2:172.21.15.73:3300/0 conn(0x7f963015cd70 msgr2=0x7f96300cf410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962ed9d700 1 --2- 172.21.15.45:0/2246502307 >> v2:172.21.15.73:3300/0 conn(0x7f963015cd70 0x7f96300cf410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962ed9d700 1 -- 172.21.15.45:0/2246502307 >> v1:172.21.15.45:6789/0 conn(0x7f96300b1cd0 legacy=0x7f96300b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962ed9d700 1 -- 172.21.15.45:0/2246502307 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96300b11f0 con 0x7f96301609b0 2023-12-19T17:52:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962e59c700 1 --2- 172.21.15.45:0/2246502307 >> v2:172.21.15.73:3300/0 conn(0x7f963015cd70 0x7f96300cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:54.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962dd9b700 1 -- 172.21.15.45:0/2246502307 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753827470 0 0) 0x7f9630161320 con 0x7f96300b1cd0 2023-12-19T17:52:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962ed9d700 1 --2- 172.21.15.45:0/2246502307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f9630160de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9628009d90 tx=0x7f962800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35491a5dcfa07321 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962dd9b700 1 -- 172.21.15.45:0/2246502307 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962800e070 con 0x7f96301609b0 2023-12-19T17:52:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962dd9b700 1 -- 172.21.15.45:0/2246502307 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962800bb20 con 0x7f96301609b0 2023-12-19T17:52:54.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.025+0000 7f962dd9b700 1 -- 172.21.15.45:0/2246502307 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9628012430 con 0x7f96301609b0 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 -- 172.21.15.45:0/2246502307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 msgr2=0x7f9630160de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 --2- 172.21.15.45:0/2246502307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f9630160de0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9628009d90 tx=0x7f962800b330 comp rx=0 tx=0).stop 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 -- 172.21.15.45:0/2246502307 shutdown_connections 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 --2- 172.21.15.45:0/2246502307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f9630160de0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 --2- 172.21.15.45:0/2246502307 >> v2:172.21.15.73:3300/0 conn(0x7f963015cd70 0x7f96300cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 -- 172.21.15.45:0/2246502307 >> 172.21.15.45:0/2246502307 conn(0x7f96300b2540 msgr2=0x7f96300b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 -- 172.21.15.45:0/2246502307 shutdown_connections 2023-12-19T17:52:54.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.029+0000 7f962f59e700 1 -- 172.21.15.45:0/2246502307 wait complete. 2023-12-19T17:52:54.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 Processor -- start 2023-12-19T17:52:54.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 -- start start 2023-12-19T17:52:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 0x7f9630160040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963015cd70 0x7f963014bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f963014e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963014d740 con 0x7f96300b1cd0 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f963014d9c0 con 0x7f963015cd70 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963014dca0 con 0x7f96301609b0 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 0x7f9630160040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 0x7f9630160040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33104/0 (socket says 172.21.15.45:33104) 2023-12-19T17:52:54.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 -- 172.21.15.45:0/2059412166 learned_addr learned my addr 172.21.15.45:0/2059412166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f9625d9b700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963015cd70 0x7f963014bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962ed9d700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f963014e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 -- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 msgr2=0x7f963014e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f963014e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 -- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963015cd70 msgr2=0x7f963014bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963015cd70 0x7f963014bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962e59c700 1 -- 172.21.15.45:0/2059412166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96200094b0 con 0x7f96300b1cd0 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.033+0000 7f962ed9d700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f963014e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f962e59c700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 0x7f9630160040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f962000ebe0 tx=0x7f9620009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000c910 con 0x7f96300b1cd0 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962000ca70 con 0x7f96300b1cd0 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962000ce00 con 0x7f96300b1cd0 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9628009a70 con 0x7f96300b1cd0 2023-12-19T17:52:54.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f963014e960 con 0x7f96300b1cd0 2023-12-19T17:52:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.037+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9630067760 con 0x7f96300b1cd0 2023-12-19T17:52:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.041+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9620013470 con 0x7f96300b1cd0 2023-12-19T17:52:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.041+0000 7f96277fe700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9610065ad0 0x7f9610067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.041+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9620083810 con 0x7f96300b1cd0 2023-12-19T17:52:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.041+0000 7f9625d9b700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9610065ad0 0x7f9610067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.045+0000 7f9625d9b700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9610065ad0 0x7f9610067f90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9630160580 tx=0x7f9618007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.049+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9620050d50 con 0x7f96300b1cd0 2023-12-19T17:52:54.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.233+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9630070490 con 0x7f96300b1cd0 2023-12-19T17:52:54.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.233+0000 7f96277fe700 1 -- 172.21.15.45:0/2059412166 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f9620054370 con 0x7f96300b1cd0 2023-12-19T17:52:54.238 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:54.238 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9610065ad0 msgr2=0x7f9610067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9610065ad0 0x7f9610067f90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9630160580 tx=0x7f9618007c00 comp rx=0 tx=0).stop 2023-12-19T17:52:54.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 msgr2=0x7f9630160040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 0x7f9630160040 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f962000ebe0 tx=0x7f9620009ed0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 shutdown_connections 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9610065ad0 0x7f9610067f90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96301609b0 0x7f963014e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f963015cd70 0x7f963014bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 --2- 172.21.15.45:0/2059412166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96300b1cd0 0x7f9630160040 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 >> 172.21.15.45:0/2059412166 conn(0x7f96300b2540 msgr2=0x7f963006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 shutdown_connections 2023-12-19T17:52:54.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.237+0000 7f962f59e700 1 -- 172.21.15.45:0/2059412166 wait complete. 2023-12-19T17:52:54.263 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:54.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 Processor -- start 2023-12-19T17:52:54.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 -- start start 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b48c0 0x7f304c0b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f304c0b5f70 0x7f304c0b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c0b5260 con 0x7f304c15d0a0 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0d1960 con 0x7f304c0b5f70 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3053e5e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0d1c40 con 0x7f304c0b48c0 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3051bfa700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f304c15d0a0 0x7f304c0d0f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59056/0 (socket says 172.21.15.45:59056) 2023-12-19T17:52:54.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f3051bfa700 1 -- 172.21.15.45:0/4225895106 learned_addr learned my addr 172.21.15.45:0/4225895106 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f30523fb700 1 --2- 172.21.15.45:0/4225895106 >> v2:172.21.15.73:3300/0 conn(0x7f304c0b5f70 0x7f304c0b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.441+0000 7f30513f9700 1 --2- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b48c0 0x7f304c0b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3050bf8700 1 -- 172.21.15.45:0/4225895106 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1984958118 0 0) 0x7f304c0b5260 con 0x7f304c15d0a0 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3050bf8700 1 -- 172.21.15.45:0/4225895106 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f30380035d0 con 0x7f304c15d0a0 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f30523fb700 1 -- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b48c0 msgr2=0x7f304c0b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f30523fb700 1 --2- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b48c0 0x7f304c0b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f30523fb700 1 -- 172.21.15.45:0/4225895106 >> v1:172.21.15.45:6789/0 conn(0x7f304c15d0a0 legacy=0x7f304c0d0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f30523fb700 1 -- 172.21.15.45:0/4225895106 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c0d1f20 con 0x7f304c0b5f70 2023-12-19T17:52:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f30523fb700 1 --2- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c0b5f70 0x7f304c0b63e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3044009d90 tx=0x7f304400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=170a1b4454e04896 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3050bf8700 1 -- 172.21.15.45:0/4225895106 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400e070 con 0x7f304c0b5f70 2023-12-19T17:52:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3050bf8700 1 -- 172.21.15.45:0/4225895106 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304400bb20 con 0x7f304c0b5f70 2023-12-19T17:52:54.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3050bf8700 1 -- 172.21.15.45:0/4225895106 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f304400be90 con 0x7f304c0b5f70 2023-12-19T17:52:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 -- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c0b5f70 msgr2=0x7f304c0b63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 --2- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c0b5f70 0x7f304c0b63e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3044009d90 tx=0x7f304400b330 comp rx=0 tx=0).stop 2023-12-19T17:52:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 -- 172.21.15.45:0/4225895106 shutdown_connections 2023-12-19T17:52:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 --2- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c0b5f70 0x7f304c0b63e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 --2- 172.21.15.45:0/4225895106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b48c0 0x7f304c0b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 -- 172.21.15.45:0/4225895106 >> 172.21.15.45:0/4225895106 conn(0x7f304c0cf8c0 msgr2=0x7f304c0cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 -- 172.21.15.45:0/4225895106 shutdown_connections 2023-12-19T17:52:54.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.445+0000 7f3053e5e700 1 -- 172.21.15.45:0/4225895106 wait complete. 2023-12-19T17:52:54.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.449+0000 7f3053e5e700 1 Processor -- start 2023-12-19T17:52:54.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.449+0000 7f3053e5e700 1 -- start start 2023-12-19T17:52:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 0x7f304c151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b5f70 0x7f304c1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c15d0a0 0x7f304c1512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1f33c0 con 0x7f304c0b48c0 2023-12-19T17:52:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1520e0 con 0x7f304c15d0a0 2023-12-19T17:52:54.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c1523c0 con 0x7f304c0b5f70 2023-12-19T17:52:54.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 0x7f304c151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 0x7f304c151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33118/0 (socket says 172.21.15.45:33118) 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 -- 172.21.15.45:0/186190091 learned_addr learned my addr 172.21.15.45:0/186190091 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f30513f9700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b5f70 0x7f304c1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f30523fb700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c15d0a0 0x7f304c1512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 -- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b5f70 msgr2=0x7f304c1f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b5f70 0x7f304c1f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 -- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c15d0a0 msgr2=0x7f304c1512a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c15d0a0 0x7f304c1512a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 -- 172.21.15.45:0/186190091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3044009a70 con 0x7f304c0b48c0 2023-12-19T17:52:54.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3051bfa700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 0x7f304c151b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f304800c4d0 tx=0x7f304800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3048005d90 con 0x7f304c0b48c0 2023-12-19T17:52:54.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f304800ce80 con 0x7f304c0b48c0 2023-12-19T17:52:54.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c1526a0 con 0x7f304c0b48c0 2023-12-19T17:52:54.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30480072d0 con 0x7f304c0b48c0 2023-12-19T17:52:54.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.453+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c152c60 con 0x7f304c0b48c0 2023-12-19T17:52:54.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.457+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c0c7fc0 con 0x7f304c0b48c0 2023-12-19T17:52:54.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.457+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3048007430 con 0x7f304c0b48c0 2023-12-19T17:52:54.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.457+0000 7f30427fc700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3030065b00 0x7f3030067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.457+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3048082740 con 0x7f304c0b48c0 2023-12-19T17:52:54.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.457+0000 7f30513f9700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3030065b00 0x7f3030067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.461+0000 7f30513f9700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3030065b00 0x7f3030067fc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f304c0cffc0 tx=0x7f303c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.465+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f304c0c7fc0 con 0x7f304c0b48c0 2023-12-19T17:52:54.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.641+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f304c0c7fc0 con 0x7f304c0b48c0 2023-12-19T17:52:54.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f30427fc700 1 -- 172.21.15.45:0/186190091 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3048017020 con 0x7f304c0b48c0 2023-12-19T17:52:54.647 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:54.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3030065b00 msgr2=0x7f3030067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3030065b00 0x7f3030067fc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f304c0cffc0 tx=0x7f303c009240 comp rx=0 tx=0).stop 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 msgr2=0x7f304c151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 0x7f304c151b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f304800c4d0 tx=0x7f304800c7e0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 shutdown_connections 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3030065b00 0x7f3030067fc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f304c15d0a0 0x7f304c1512a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f304c0b5f70 0x7f304c1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 --2- 172.21.15.45:0/186190091 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f304c0b48c0 0x7f304c151b00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 >> 172.21.15.45:0/186190091 conn(0x7f304c0cf8c0 msgr2=0x7f304c15be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 shutdown_connections 2023-12-19T17:52:54.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.645+0000 7f3053e5e700 1 -- 172.21.15.45:0/186190091 wait complete. 2023-12-19T17:52:54.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.869+0000 7fc8a30bc700 1 Processor -- start 2023-12-19T17:52:54.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.869+0000 7fc8a30bc700 1 -- start start 2023-12-19T17:52:54.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a30bc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc89c0cdfd0 0x7fc89c167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a30bc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c15d300 con 0x7fc89c0b8580 2023-12-19T17:52:54.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a30bc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89c0d1550 con 0x7fc89c15cf20 2023-12-19T17:52:54.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a18b9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc89c0b8580 0x7fc89c0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59058/0 (socket says 172.21.15.45:59058) 2023-12-19T17:52:54.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a30bc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89c0d1360 con 0x7fc89c0cdfd0 2023-12-19T17:52:54.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a18b9700 1 -- 172.21.15.45:0/283084854 learned_addr learned my addr 172.21.15.45:0/283084854 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550610123 0 0) 0x7fc89c15d300 con 0x7fc89c0b8580 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8880035d0 con 0x7fc89c0b8580 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a28bb700 1 --2- 172.21.15.45:0/283084854 >> v2:172.21.15.73:3300/0 conn(0x7fc89c0cdfd0 0x7fc89c167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533184680 0 0) 0x7fc8880035d0 con 0x7fc89c0b8580 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 >> v2:172.21.15.73:3300/0 conn(0x7fc89c0cdfd0 msgr2=0x7fc89c167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 --2- 172.21.15.45:0/283084854 >> v2:172.21.15.73:3300/0 conn(0x7fc89c0cdfd0 0x7fc89c167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 >> v1:172.21.15.73:6789/0 conn(0x7fc89c15cf20 legacy=0x7fc89c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0d1830 con 0x7fc89c0b8580 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fc88c001690 con 0x7fc89c0b8580 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 >> v1:172.21.15.45:6789/0 conn(0x7fc89c0b8580 legacy=0x7fc89c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc888003a70 0x7fc888003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc888004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc888005280 0x7fc88800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88800c1a0 con 0x7fc888004870 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc88800c310 con 0x7fc888005280 2023-12-19T17:52:54.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.873+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc88800c4d0 con 0x7fc888003a70 2023-12-19T17:52:54.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc888004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a20ba700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc888003a70 0x7fc888003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a28bb700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc888005280 0x7fc88800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 -- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc888003a70 msgr2=0x7fc888003e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:54.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc888003a70 0x7fc888003e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 -- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc888005280 msgr2=0x7fc88800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc888005280 0x7fc88800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 -- 172.21.15.45:0/283084854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8880035d0 con 0x7fc888004870 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a28bb700 1 -- 172.21.15.45:0/283084854 reap_dead start 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc888004cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c160 tx=0x7fc8880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ea5db4b9b682ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c007b70 con 0x7fc888004870 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c00ccc0 con 0x7fc888004870 2023-12-19T17:52:54.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a10b8700 1 -- 172.21.15.45:0/283084854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c005bc0 con 0x7fc888004870 2023-12-19T17:52:54.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 -- 172.21.15.45:0/283084854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 msgr2=0x7fc888004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc888004cf0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fc88c00c160 tx=0x7fc8880058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 -- 172.21.15.45:0/283084854 shutdown_connections 2023-12-19T17:52:54.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/283084854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc888004cf0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 -- 172.21.15.45:0/283084854 >> 172.21.15.45:0/283084854 conn(0x7fc89c0b4670 msgr2=0x7fc89c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:54.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 -- 172.21.15.45:0/283084854 shutdown_connections 2023-12-19T17:52:54.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.877+0000 7fc8a30bc700 1 -- 172.21.15.45:0/283084854 wait complete. 2023-12-19T17:52:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.881+0000 7fc8a30bc700 1 Processor -- start 2023-12-19T17:52:54.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.881+0000 7fc8a30bc700 1 -- start start 2023-12-19T17:52:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc89c1591a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc89c0b6cf0 0x7fc89c1f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89c144e60 0x7fc89c1452e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c142e60 con 0x7fc888004870 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c145820 con 0x7fc89c0b6cf0 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc89c0b7260 con 0x7fc89c144e60 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc89c1591a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc89c1591a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33134/0 (socket says 172.21.15.45:33134) 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 -- 172.21.15.45:0/1201728887 learned_addr learned my addr 172.21.15.45:0/1201728887 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc89c0b6cf0 0x7fc89c1f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a28bb700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89c144e60 0x7fc89c1452e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 -- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89c144e60 msgr2=0x7fc89c1452e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89c144e60 0x7fc89c1452e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 -- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc89c0b6cf0 msgr2=0x7fc89c1f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc89c0b6cf0 0x7fc89c1f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:54.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 -- 172.21.15.45:0/1201728887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc89c0b7540 con 0x7fc888004870 2023-12-19T17:52:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a20ba700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc89c1591a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc89800f7a0 tx=0x7fc89800fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980052e0 con 0x7fc888004870 2023-12-19T17:52:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc898005440 con 0x7fc888004870 2023-12-19T17:52:54.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980038e0 con 0x7fc888004870 2023-12-19T17:52:54.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89c0b7820 con 0x7fc888004870 2023-12-19T17:52:54.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89c1596e0 con 0x7fc888004870 2023-12-19T17:52:54.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.885+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc89c04ed30 con 0x7fc888004870 2023-12-19T17:52:54.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.889+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc898003a40 con 0x7fc888004870 2023-12-19T17:52:54.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.889+0000 7fc892ffd700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc880065ad0 0x7fc880067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.889+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc898083320 con 0x7fc888004870 2023-12-19T17:52:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.889+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc880065ad0 0x7fc880067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:54.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.893+0000 7fc8a18b9700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc880065ad0 0x7fc880067f90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0b4b20 tx=0x7fc88c007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:54.897+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc898050910 con 0x7fc888004870 2023-12-19T17:52:55.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.073+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc89c0b7d40 con 0x7fc888004870 2023-12-19T17:52:55.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc892ffd700 1 -- 172.21.15.45:0/1201728887 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc89c0b7d40 con 0x7fc888004870 2023-12-19T17:52:55.079 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc880065ad0 msgr2=0x7fc880067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc880065ad0 0x7fc880067f90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc89c0b4b20 tx=0x7fc88c007000 comp rx=0 tx=0).stop 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 msgr2=0x7fc89c1591a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc89c1591a0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc89800f7a0 tx=0x7fc89800fb60 comp rx=0 tx=0).stop 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 shutdown_connections 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc880065ad0 0x7fc880067f90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc89c144e60 0x7fc89c1452e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc89c0b6cf0 0x7fc89c1f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 --2- 172.21.15.45:0/1201728887 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc888004870 0x7fc89c1591a0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 >> 172.21.15.45:0/1201728887 conn(0x7fc89c0b4670 msgr2=0x7fc89c0cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 shutdown_connections 2023-12-19T17:52:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.077+0000 7fc8a30bc700 1 -- 172.21.15.45:0/1201728887 wait complete. 2023-12-19T17:52:55.101 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.301+0000 7f16ea2fc700 1 Processor -- start 2023-12-19T17:52:55.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.301+0000 7f16ea2fc700 1 -- start start 2023-12-19T17:52:55.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16ea2fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e40cdfd0 0x7f16e4167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16ea2fc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e415d300 con 0x7f16e415cf20 2023-12-19T17:52:55.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16ea2fc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e40d1550 con 0x7f16e40b8580 2023-12-19T17:52:55.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16ea2fc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e40d1360 con 0x7f16e40cdfd0 2023-12-19T17:52:55.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e92fa700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f16e415cf20 0x7f16e40d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59066/0 (socket says 172.21.15.45:59066) 2023-12-19T17:52:55.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e92fa700 1 -- 172.21.15.45:0/2917603941 learned_addr learned my addr 172.21.15.45:0/2917603941 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:55.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e9afb700 1 --2- 172.21.15.45:0/2917603941 >> v2:172.21.15.45:3300/0 conn(0x7f16e40cdfd0 0x7f16e4167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16dbfff700 1 -- 172.21.15.45:0/2917603941 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667071905 0 0) 0x7f16e415d300 con 0x7f16e415cf20 2023-12-19T17:52:55.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16dbfff700 1 -- 172.21.15.45:0/2917603941 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16d00035d0 con 0x7f16e415cf20 2023-12-19T17:52:55.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e9afb700 1 -- 172.21.15.45:0/2917603941 >> v1:172.21.15.73:6789/0 conn(0x7f16e40b8580 legacy=0x7f16e40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16dbfff700 1 -- 172.21.15.45:0/2917603941 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169617898 0 0) 0x7f16e40d1550 con 0x7f16e40b8580 2023-12-19T17:52:55.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e9afb700 1 -- 172.21.15.45:0/2917603941 >> v1:172.21.15.45:6789/0 conn(0x7f16e415cf20 legacy=0x7f16e40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e9afb700 1 -- 172.21.15.45:0/2917603941 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e40d1830 con 0x7f16e40cdfd0 2023-12-19T17:52:55.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16e9afb700 1 --2- 172.21.15.45:0/2917603941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40cdfd0 0x7f16e4167a30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009d90 tx=0x7f16dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f48700ea4482103f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:55.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16dbfff700 1 -- 172.21.15.45:0/2917603941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00e070 con 0x7f16e40cdfd0 2023-12-19T17:52:55.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16dbfff700 1 -- 172.21.15.45:0/2917603941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc00bb20 con 0x7f16e40cdfd0 2023-12-19T17:52:55.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.305+0000 7f16dbfff700 1 -- 172.21.15.45:0/2917603941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc00bed0 con 0x7f16e40cdfd0 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 -- 172.21.15.45:0/2917603941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40cdfd0 msgr2=0x7f16e4167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/2917603941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40cdfd0 0x7f16e4167a30 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f16dc009d90 tx=0x7f16dc00b330 comp rx=0 tx=0).stop 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 -- 172.21.15.45:0/2917603941 shutdown_connections 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/2917603941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e40cdfd0 0x7f16e4167a30 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 -- 172.21.15.45:0/2917603941 >> 172.21.15.45:0/2917603941 conn(0x7f16e40b4670 msgr2=0x7f16e40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 -- 172.21.15.45:0/2917603941 shutdown_connections 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 -- 172.21.15.45:0/2917603941 wait complete. 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 Processor -- start 2023-12-19T17:52:55.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.309+0000 7f16ea2fc700 1 -- start start 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e40b8580 0x7f16e41506d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e40cdfd0 0x7f16e4156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 0x7f16e415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4156ab0 con 0x7f16e415cf20 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4155ea0 con 0x7f16e40cdfd0 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e4156180 con 0x7f16e40b8580 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 0x7f16e415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 0x7f16e415ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33142/0 (socket says 172.21.15.45:33142) 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 -- 172.21.15.45:0/3361123661 learned_addr learned my addr 172.21.15.45:0/3361123661 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e92fa700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e40b8580 0x7f16e41506d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e8af9700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e40cdfd0 0x7f16e4156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 -- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e40b8580 msgr2=0x7f16e41506d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e40b8580 0x7f16e41506d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 -- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e40cdfd0 msgr2=0x7f16e4156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e40cdfd0 0x7f16e4156f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 -- 172.21.15.45:0/3361123661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16dc009a70 con 0x7f16e415cf20 2023-12-19T17:52:55.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16e9afb700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 0x7f16e415ef10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f16dc014040 tx=0x7f16dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc01b8d0 con 0x7f16e415cf20 2023-12-19T17:52:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16dc020070 con 0x7f16e415cf20 2023-12-19T17:52:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e4156460 con 0x7f16e415cf20 2023-12-19T17:52:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16dc01bc70 con 0x7f16e415cf20 2023-12-19T17:52:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.313+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e4157480 con 0x7f16e415cf20 2023-12-19T17:52:55.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.317+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e4156c20 con 0x7f16e415cf20 2023-12-19T17:52:55.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.317+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16dc01c400 con 0x7f16e415cf20 2023-12-19T17:52:55.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.321+0000 7f16d9ffb700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065ad0 0x7f16c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.321+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f16dc022070 con 0x7f16e415cf20 2023-12-19T17:52:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.321+0000 7f16e92fa700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065ad0 0x7f16c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.321+0000 7f16e92fa700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065ad0 0x7f16c8067f90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f16e0001200 tx=0x7f16e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:55.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.325+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16dc056750 con 0x7f16e415cf20 2023-12-19T17:52:55.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.505+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f16e404ed30 con 0x7f16e415cf20 2023-12-19T17:52:55.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.505+0000 7f16d9ffb700 1 -- 172.21.15.45:0/3361123661 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f16dc0562e0 con 0x7f16e415cf20 2023-12-19T17:52:55.510 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065ad0 msgr2=0x7f16c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065ad0 0x7f16c8067f90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f16e0001200 tx=0x7f16e0009040 comp rx=0 tx=0).stop 2023-12-19T17:52:55.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 msgr2=0x7f16e415ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 0x7f16e415ef10 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f16dc014040 tx=0x7f16dc004af0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 shutdown_connections 2023-12-19T17:52:55.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065ad0 0x7f16c8067f90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e415cf20 0x7f16e415ef10 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e40cdfd0 0x7f16e4156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 --2- 172.21.15.45:0/3361123661 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e40b8580 0x7f16e41506d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 >> 172.21.15.45:0/3361123661 conn(0x7f16e40b4670 msgr2=0x7f16e415be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:55.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 shutdown_connections 2023-12-19T17:52:55.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.509+0000 7f16ea2fc700 1 -- 172.21.15.45:0/3361123661 wait complete. 2023-12-19T17:52:55.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:55.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.713+0000 7f41d23ce700 1 Processor -- start 2023-12-19T17:52:55.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.713+0000 7f41d23ce700 1 -- start start 2023-12-19T17:52:55.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d23ce700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f41cc0713d0 0x7f41cc071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d23ce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 0x7f41cc0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d23ce700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41cc0b2a40 con 0x7f41cc159a40 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d23ce700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41cc0ccb50 con 0x7f41cc0713d0 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d23ce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc071da0 con 0x7f41cc0ccd70 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d13cc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f41cc159a40 0x7f41cc0ae090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59074/0 (socket says 172.21.15.45:59074) 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d13cc700 1 -- 172.21.15.45:0/3876311258 learned_addr learned my addr 172.21.15.45:0/3876311258 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d0bcb700 1 --2- 172.21.15.45:0/3876311258 >> v2:172.21.15.73:3300/0 conn(0x7f41cc0713d0 0x7f41cc071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41d1bcd700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 0x7f41cc0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2578959745 0 0) 0x7f41cc0b2a40 con 0x7f41cc159a40 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f41b80035d0 con 0x7f41cc159a40 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3503672536 0 0) 0x7f41b80035d0 con 0x7f41cc159a40 2023-12-19T17:52:55.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 msgr2=0x7f41cc0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 0x7f41cc0cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 >> v2:172.21.15.73:3300/0 conn(0x7f41cc0713d0 msgr2=0x7f41cc071860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 --2- 172.21.15.45:0/3876311258 >> v2:172.21.15.73:3300/0 conn(0x7f41cc0713d0 0x7f41cc071860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc0b2c90 con 0x7f41cc159a40 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f41c80017f0 con 0x7f41cc159a40 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 >> v1:172.21.15.45:6789/0 conn(0x7f41cc159a40 legacy=0x7f41cc0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41b8003a20 0x7f41b8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 0x7f41b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8004db0 0x7f41b8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0ccb50 con 0x7f41b8003a20 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc071da0 con 0x7f41b8004db0 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.717+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41b800ba30 con 0x7f41cc0ccd70 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d13cc700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41b8003a20 0x7f41b8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d0bcb700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 0x7f41b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8004db0 0x7f41b8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 -- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 msgr2=0x7f41b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc0ccd70 0x7f41b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 -- 172.21.15.45:0/3876311258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41b8003a20 msgr2=0x7f41b8003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41b8003a20 0x7f41b8003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 -- 172.21.15.45:0/3876311258 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41b80035d0 con 0x7f41b8004db0 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d13cc700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41b8003a20 0x7f41b8003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8004db0 0x7f41b8005230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009fc0 tx=0x7f41b80058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fa5c0939775d94f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:55.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c400ec30 con 0x7f41b8004db0 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c400f040 con 0x7f41b8004db0 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41c3fff700 1 -- 172.21.15.45:0/3876311258 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c4012430 con 0x7f41b8004db0 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d23ce700 1 -- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8004db0 msgr2=0x7f41b8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d23ce700 1 --2- 172.21.15.45:0/3876311258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41b8004db0 0x7f41b8005230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f41c4009fc0 tx=0x7f41b80058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d1bcd700 1 -- 172.21.15.45:0/3876311258 reap_dead start 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d23ce700 1 -- 172.21.15.45:0/3876311258 shutdown_connections 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d23ce700 1 -- 172.21.15.45:0/3876311258 >> 172.21.15.45:0/3876311258 conn(0x7f41cc0cf5a0 msgr2=0x7f41cc070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.721+0000 7f41d23ce700 1 -- 172.21.15.45:0/3876311258 shutdown_connections 2023-12-19T17:52:55.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.725+0000 7f41d23ce700 1 -- 172.21.15.45:0/3876311258 wait complete. 2023-12-19T17:52:55.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.725+0000 7f41d23ce700 1 Processor -- start 2023-12-19T17:52:55.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.725+0000 7f41d23ce700 1 -- start start 2023-12-19T17:52:55.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41cc146390 0x7f41cc0ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 0x7f41cc155dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc1f2310 0x7f41cc1f2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc156310 con 0x7f41cc155950 2023-12-19T17:52:55.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc1f2cd0 con 0x7f41cc146390 2023-12-19T17:52:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41cc0abdd0 con 0x7f41cc1f2310 2023-12-19T17:52:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 0x7f41cc155dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 0x7f41cc155dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33146/0 (socket says 172.21.15.45:33146) 2023-12-19T17:52:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 -- 172.21.15.45:0/1493026706 learned_addr learned my addr 172.21.15.45:0/1493026706 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d1bcd700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc1f2310 0x7f41cc1f2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d13cc700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41cc146390 0x7f41cc0ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 -- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc1f2310 msgr2=0x7f41cc1f2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc1f2310 0x7f41cc1f2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 -- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41cc146390 msgr2=0x7f41cc0ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41cc146390 0x7f41cc0ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 -- 172.21.15.45:0/1493026706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41cc156eb0 con 0x7f41cc155950 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d0bcb700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 0x7f41cc155dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f41bc011aa0 tx=0x7f41bc011db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00f940 con 0x7f41cc155950 2023-12-19T17:52:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00faa0 con 0x7f41cc155950 2023-12-19T17:52:55.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00fe50 con 0x7f41cc155950 2023-12-19T17:52:55.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41cc1f2f20 con 0x7f41cc155950 2023-12-19T17:52:55.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.729+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41cc0a7960 con 0x7f41cc155950 2023-12-19T17:52:55.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.733+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41cc04ed30 con 0x7f41cc155950 2023-12-19T17:52:55.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.733+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f41bc014440 con 0x7f41cc155950 2023-12-19T17:52:55.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.737+0000 7f41c1ffb700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f41b0065b00 0x7f41b0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:55.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.737+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f41bc083b70 con 0x7f41cc155950 2023-12-19T17:52:55.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.737+0000 7f41d13cc700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f41b0065b00 0x7f41b0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:55.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.737+0000 7f41d13cc700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f41b0065b00 0x7f41b0067fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f41c8001170 tx=0x7f41c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.745+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f41bc051140 con 0x7f41cc155950 2023-12-19T17:52:55.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.925+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f41cc0ae560 con 0x7f41cc155950 2023-12-19T17:52:55.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.925+0000 7f41c1ffb700 1 -- 172.21.15.45:0/1493026706 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f41bc022020 con 0x7f41cc155950 2023-12-19T17:52:55.929 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f41b0065b00 msgr2=0x7f41b0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f41b0065b00 0x7f41b0067fc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f41c8001170 tx=0x7f41c8009040 comp rx=0 tx=0).stop 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 msgr2=0x7f41cc155dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 0x7f41cc155dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f41bc011aa0 tx=0x7f41bc011db0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 shutdown_connections 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f41b0065b00 0x7f41b0067fc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f41cc1f2310 0x7f41cc1f2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f41cc155950 0x7f41cc155dd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 --2- 172.21.15.45:0/1493026706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41cc146390 0x7f41cc0ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 >> 172.21.15.45:0/1493026706 conn(0x7f41b8004db0 msgr2=0x7f41cc06ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 shutdown_connections 2023-12-19T17:52:55.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:55.929+0000 7f41d23ce700 1 -- 172.21.15.45:0/1493026706 wait complete. 2023-12-19T17:52:55.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:52:56.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.133+0000 7f455db58700 1 Processor -- start 2023-12-19T17:52:56.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.133+0000 7f455db58700 1 -- start start 2023-12-19T17:52:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455db58700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f45580ca000 0x7f455806b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455db58700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f455815d160 0x7f45580ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455db58700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455806b6d0 con 0x7f455806f0c0 2023-12-19T17:52:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455db58700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45580ca920 con 0x7f45580ca000 2023-12-19T17:52:56.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455db58700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580c9710 con 0x7f455815d160 2023-12-19T17:52:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455d357700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f455806f0c0 0x7f455806f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59090/0 (socket says 172.21.15.45:59090) 2023-12-19T17:52:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455d357700 1 -- 172.21.15.45:0/1867278731 learned_addr learned my addr 172.21.15.45:0/1867278731 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f4557fff700 1 --2- 172.21.15.45:0/1867278731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f455815d160 0x7f45580ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455cb56700 1 --2- 172.21.15.45:0/1867278731 >> v2:172.21.15.73:3300/0 conn(0x7f45580ca000 0x7f455806b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f4557fff700 1 -- 172.21.15.45:0/1867278731 >> v2:172.21.15.73:3300/0 conn(0x7f45580ca000 msgr2=0x7f455806b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f4557fff700 1 --2- 172.21.15.45:0/1867278731 >> v2:172.21.15.73:3300/0 conn(0x7f45580ca000 0x7f455806b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f4557fff700 1 -- 172.21.15.45:0/1867278731 >> v1:172.21.15.45:6789/0 conn(0x7f455806f0c0 legacy=0x7f455806f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f4557fff700 1 -- 172.21.15.45:0/1867278731 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580c99f0 con 0x7f455815d160 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f45577fe700 1 -- 172.21.15.45:0/1867278731 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1408311817 0 0) 0x7f455806b6d0 con 0x7f455806f0c0 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f455cb56700 1 --2- 172.21.15.45:0/1867278731 >> v2:172.21.15.73:3300/0 conn(0x7f45580ca000 0x7f455806b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:56.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f4557fff700 1 --2- 172.21.15.45:0/1867278731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f455815d160 0x7f45580ca3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4544009850 tx=0x7f4544009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9bcaa58bbb4ce9d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:56.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f45577fe700 1 -- 172.21.15.45:0/1867278731 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544011830 con 0x7f455815d160 2023-12-19T17:52:56.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f45577fe700 1 -- 172.21.15.45:0/1867278731 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4544011990 con 0x7f455815d160 2023-12-19T17:52:56.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.137+0000 7f45577fe700 1 -- 172.21.15.45:0/1867278731 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4544011d20 con 0x7f455815d160 2023-12-19T17:52:56.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 -- 172.21.15.45:0/1867278731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f455815d160 msgr2=0x7f45580ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 --2- 172.21.15.45:0/1867278731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f455815d160 0x7f45580ca3e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4544009850 tx=0x7f4544009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:56.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 -- 172.21.15.45:0/1867278731 shutdown_connections 2023-12-19T17:52:56.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 --2- 172.21.15.45:0/1867278731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f455815d160 0x7f45580ca3e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 --2- 172.21.15.45:0/1867278731 >> v2:172.21.15.73:3300/0 conn(0x7f45580ca000 0x7f455806b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 -- 172.21.15.45:0/1867278731 >> 172.21.15.45:0/1867278731 conn(0x7f45580cbb40 msgr2=0x7f45580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:56.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 -- 172.21.15.45:0/1867278731 shutdown_connections 2023-12-19T17:52:56.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.141+0000 7f455db58700 1 -- 172.21.15.45:0/1867278731 wait complete. 2023-12-19T17:52:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 Processor -- start 2023-12-19T17:52:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 -- start start 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 0x7f45580b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45580ca000 0x7f45580ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45580adac0 0x7f45580abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b43a0 con 0x7f455806f0c0 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b4640 con 0x7f45580ca000 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455db58700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45580b4920 con 0x7f45580adac0 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455cb56700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 0x7f45580b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455cb56700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 0x7f45580b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33158/0 (socket says 172.21.15.45:33158) 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.145+0000 7f455cb56700 1 -- 172.21.15.45:0/1308106513 learned_addr learned my addr 172.21.15.45:0/1308106513 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f4557fff700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45580ca000 0x7f45580ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455d357700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45580adac0 0x7f45580abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455cb56700 1 -- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45580adac0 msgr2=0x7f45580abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455cb56700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45580adac0 0x7f45580abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455cb56700 1 -- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45580ca000 msgr2=0x7f45580ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455cb56700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45580ca000 0x7f45580ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455cb56700 1 -- 172.21.15.45:0/1308106513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45440094b0 con 0x7f455806f0c0 2023-12-19T17:52:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f4557fff700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45580ca000 0x7f45580ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:52:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455cb56700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 0x7f45580b36b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f454c00e760 tx=0x7f454c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c004230 con 0x7f455806f0c0 2023-12-19T17:52:56.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f454c0043b0 con 0x7f455806f0c0 2023-12-19T17:52:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45580c38e0 con 0x7f455806f0c0 2023-12-19T17:52:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c0036c0 con 0x7f455806f0c0 2023-12-19T17:52:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45580b3bf0 con 0x7f455806f0c0 2023-12-19T17:52:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.149+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45580c3ad0 con 0x7f455806f0c0 2023-12-19T17:52:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.153+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f454c003820 con 0x7f455806f0c0 2023-12-19T17:52:56.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.153+0000 7f45557fa700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f453c065ad0 0x7f453c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.153+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f454c0830b0 con 0x7f455806f0c0 2023-12-19T17:52:56.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.153+0000 7f4557fff700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f453c065ad0 0x7f453c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.153+0000 7f4557fff700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f453c065ad0 0x7f453c067f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4544014040 tx=0x7f4544008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:56.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.161+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f454c0505f0 con 0x7f455806f0c0 2023-12-19T17:52:56.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.349+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f45580cb6c0 con 0x7f455806f0c0 2023-12-19T17:52:56.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f45557fa700 1 -- 172.21.15.45:0/1308106513 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f454c053c10 con 0x7f455806f0c0 2023-12-19T17:52:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f453c065ad0 msgr2=0x7f453c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f453c065ad0 0x7f453c067f90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4544014040 tx=0x7f4544008030 comp rx=0 tx=0).stop 2023-12-19T17:52:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 msgr2=0x7f45580b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 0x7f45580b36b0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f454c00e760 tx=0x7f454c00eb20 comp rx=0 tx=0).stop 2023-12-19T17:52:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 shutdown_connections 2023-12-19T17:52:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f453c065ad0 0x7f453c067f90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f45580adac0 0x7f45580abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45580ca000 0x7f45580ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 --2- 172.21.15.45:0/1308106513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f455806f0c0 0x7f45580b36b0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 >> 172.21.15.45:0/1308106513 conn(0x7f45580cbb40 msgr2=0x7f4558158c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 shutdown_connections 2023-12-19T17:52:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.353+0000 7f455db58700 1 -- 172.21.15.45:0/1308106513 wait complete. 2023-12-19T17:52:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:52:56.379 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi073.front.sepia.ceph.com... 2023-12-19T17:52:56.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:56.380 DEBUG:teuthology.orchestra.run.smithi073:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-19T17:52:56.419 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:52:56.420 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:52:56.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:52:56.420 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T17:52:56.485 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T17:52:56.486 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:52:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c3a926700 1 Processor -- start 2023-12-19T17:52:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c3a926700 1 -- start start 2023-12-19T17:52:56.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c3a926700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c3406f4a0 0x7f3c340d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c3a926700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c340b6060 con 0x7f3c3415d040 2023-12-19T17:52:56.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c3a926700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3406f930 con 0x7f3c3415d420 2023-12-19T17:52:56.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c3a926700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3406fc10 con 0x7f3c3406f4a0 2023-12-19T17:52:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c33fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3c3415d040 0x7f3c340cdf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59092/0 (socket says 172.21.15.45:59092) 2023-12-19T17:52:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c33fff700 1 -- 172.21.15.45:0/716119967 learned_addr learned my addr 172.21.15.45:0/716119967 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:56.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.673+0000 7f3c2b7fe700 1 --2- 172.21.15.45:0/716119967 >> v2:172.21.15.45:3300/0 conn(0x7f3c3406f4a0 0x7f3c340d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c337fe700 1 -- 172.21.15.45:0/716119967 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3794225445 0 0) 0x7f3c340b6060 con 0x7f3c3415d040 2023-12-19T17:52:56.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c337fe700 1 -- 172.21.15.45:0/716119967 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c140035d0 con 0x7f3c3415d040 2023-12-19T17:52:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c337fe700 1 -- 172.21.15.45:0/716119967 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129121724 0 0) 0x7f3c3406f930 con 0x7f3c3415d420 2023-12-19T17:52:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c2b7fe700 1 -- 172.21.15.45:0/716119967 >> v1:172.21.15.73:6789/0 conn(0x7f3c3415d420 legacy=0x7f3c340b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c2b7fe700 1 -- 172.21.15.45:0/716119967 >> v1:172.21.15.45:6789/0 conn(0x7f3c3415d040 legacy=0x7f3c340cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c2b7fe700 1 -- 172.21.15.45:0/716119967 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3406fef0 con 0x7f3c3406f4a0 2023-12-19T17:52:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c2b7fe700 1 --2- 172.21.15.45:0/716119967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3406f4a0 0x7f3c340d21a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009850 tx=0x7f3c1c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35909312f70df6bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c337fe700 1 -- 172.21.15.45:0/716119967 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c011830 con 0x7f3c3406f4a0 2023-12-19T17:52:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c337fe700 1 -- 172.21.15.45:0/716119967 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c011990 con 0x7f3c3406f4a0 2023-12-19T17:52:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c337fe700 1 -- 172.21.15.45:0/716119967 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c011d40 con 0x7f3c3406f4a0 2023-12-19T17:52:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 -- 172.21.15.45:0/716119967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3406f4a0 msgr2=0x7f3c340d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 --2- 172.21.15.45:0/716119967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3406f4a0 0x7f3c340d21a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009850 tx=0x7f3c1c009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 -- 172.21.15.45:0/716119967 shutdown_connections 2023-12-19T17:52:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 --2- 172.21.15.45:0/716119967 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3406f4a0 0x7f3c340d21a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 -- 172.21.15.45:0/716119967 >> 172.21.15.45:0/716119967 conn(0x7f3c340d2e50 msgr2=0x7f3c340d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 -- 172.21.15.45:0/716119967 shutdown_connections 2023-12-19T17:52:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.677+0000 7f3c3a926700 1 -- 172.21.15.45:0/716119967 wait complete. 2023-12-19T17:52:56.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.681+0000 7f3c3a926700 1 Processor -- start 2023-12-19T17:52:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.681+0000 7f3c3a926700 1 -- start start 2023-12-19T17:52:56.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 0x7f3c34153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c3415d420 0x7f3c340c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c340c8a10 0x7f3c340cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340cc630 con 0x7f3c3415d040 2023-12-19T17:52:56.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340c79f0 con 0x7f3c3415d420 2023-12-19T17:52:56.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340c7cd0 con 0x7f3c340c8a10 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 0x7f3c34153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 0x7f3c34153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33184/0 (socket says 172.21.15.45:33184) 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 -- 172.21.15.45:0/1754187163 learned_addr learned my addr 172.21.15.45:0/1754187163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c2b7fe700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c3415d420 0x7f3c340c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c38ec3700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c340c8a10 0x7f3c340cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 -- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c340c8a10 msgr2=0x7f3c340cbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c340c8a10 0x7f3c340cbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 -- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c3415d420 msgr2=0x7f3c340c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c3415d420 0x7f3c340c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 -- 172.21.15.45:0/1754187163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c0094b0 con 0x7f3c3415d040 2023-12-19T17:52:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c33fff700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 0x7f3c34153610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c4f0 tx=0x7f3c2400c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24005d90 con 0x7f3c3415d040 2023-12-19T17:52:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c240070d0 con 0x7f3c3415d040 2023-12-19T17:52:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c340c7fb0 con 0x7f3c3415d040 2023-12-19T17:52:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c24007440 con 0x7f3c3415d040 2023-12-19T17:52:56.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.685+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c340c9880 con 0x7f3c3415d040 2023-12-19T17:52:56.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.689+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3404ed30 con 0x7f3c3415d040 2023-12-19T17:52:56.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.689+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c240075a0 con 0x7f3c3415d040 2023-12-19T17:52:56.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.689+0000 7f3c317fa700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c18065ad0 0x7f3c18067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:56.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.693+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3c24082970 con 0x7f3c3415d040 2023-12-19T17:52:56.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.693+0000 7f3c2b7fe700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c18065ad0 0x7f3c18067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:56.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.693+0000 7f3c2b7fe700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c18065ad0 0x7f3c18067f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0090b0 tx=0x7f3c1c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:56.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.697+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c2404ff60 con 0x7f3c3415d040 2023-12-19T17:52:56.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.917+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c3415bd30 con 0x7f3c3415d040 2023-12-19T17:52:56.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.917+0000 7f3c317fa700 1 -- 172.21.15.45:0/1754187163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f3c24017090 con 0x7f3c3415d040 2023-12-19T17:52:56.922 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:56.922 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:52:56.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c18065ad0 msgr2=0x7f3c18067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c18065ad0 0x7f3c18067f90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0090b0 tx=0x7f3c1c008030 comp rx=0 tx=0).stop 2023-12-19T17:52:56.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 msgr2=0x7f3c34153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:56.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 0x7f3c34153610 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c4f0 tx=0x7f3c2400c800 comp rx=0 tx=0).stop 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 shutdown_connections 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c18065ad0 0x7f3c18067f90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c340c8a10 0x7f3c340cbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c3415d420 0x7f3c340c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 --2- 172.21.15.45:0/1754187163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c3415d040 0x7f3c34153610 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 >> 172.21.15.45:0/1754187163 conn(0x7f3c340d2e50 msgr2=0x7f3c341541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 shutdown_connections 2023-12-19T17:52:56.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:56.921+0000 7f3c3a926700 1 -- 172.21.15.45:0/1754187163 wait complete. 2023-12-19T17:52:56.928 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:52:56.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:57.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 Processor -- start 2023-12-19T17:52:57.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 -- start start 2023-12-19T17:52:57.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f515c1615a0 0x7f515c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c0af720 0x7f515c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f515c0c3f90 con 0x7f515c1611c0 2023-12-19T17:52:57.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f515c0b00f0 con 0x7f515c1615a0 2023-12-19T17:52:57.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f5160f75700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c070340 con 0x7f515c0af720 2023-12-19T17:52:57.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f515b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f515c1611c0 0x7f515c06d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59106/0 (socket says 172.21.15.45:59106) 2023-12-19T17:52:57.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f515b7fe700 1 -- 172.21.15.45:0/42585753 learned_addr learned my addr 172.21.15.45:0/42585753 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:57.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f515bfff700 1 --2- 172.21.15.45:0/42585753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c0af720 0x7f515c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.125+0000 7f515affd700 1 --2- 172.21.15.45:0/42585753 >> v2:172.21.15.73:3300/0 conn(0x7f515c1615a0 0x7f515c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515a7fc700 1 -- 172.21.15.45:0/42585753 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3675322702 0 0) 0x7f515c0c3f90 con 0x7f515c1611c0 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515a7fc700 1 -- 172.21.15.45:0/42585753 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51480035d0 con 0x7f515c1611c0 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515bfff700 1 -- 172.21.15.45:0/42585753 >> v2:172.21.15.73:3300/0 conn(0x7f515c1615a0 msgr2=0x7f515c0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515bfff700 1 --2- 172.21.15.45:0/42585753 >> v2:172.21.15.73:3300/0 conn(0x7f515c1615a0 0x7f515c0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515bfff700 1 -- 172.21.15.45:0/42585753 >> v1:172.21.15.45:6789/0 conn(0x7f515c1611c0 legacy=0x7f515c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515bfff700 1 -- 172.21.15.45:0/42585753 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f515c0c4270 con 0x7f515c0af720 2023-12-19T17:52:57.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515bfff700 1 --2- 172.21.15.45:0/42585753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c0af720 0x7f515c0afbb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5154009850 tx=0x7f5154009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=643435d2aea3f560 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515a7fc700 1 -- 172.21.15.45:0/42585753 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154011830 con 0x7f515c0af720 2023-12-19T17:52:57.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515a7fc700 1 -- 172.21.15.45:0/42585753 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5154011990 con 0x7f515c0af720 2023-12-19T17:52:57.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f515a7fc700 1 -- 172.21.15.45:0/42585753 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5154011d40 con 0x7f515c0af720 2023-12-19T17:52:57.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 -- 172.21.15.45:0/42585753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c0af720 msgr2=0x7f515c0afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 --2- 172.21.15.45:0/42585753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c0af720 0x7f515c0afbb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5154009850 tx=0x7f5154009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:57.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 -- 172.21.15.45:0/42585753 shutdown_connections 2023-12-19T17:52:57.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 --2- 172.21.15.45:0/42585753 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c0af720 0x7f515c0afbb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 --2- 172.21.15.45:0/42585753 >> v2:172.21.15.73:3300/0 conn(0x7f515c1615a0 0x7f515c0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 -- 172.21.15.45:0/42585753 >> 172.21.15.45:0/42585753 conn(0x7f515c0cb900 msgr2=0x7f515c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:57.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 -- 172.21.15.45:0/42585753 shutdown_connections 2023-12-19T17:52:57.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.129+0000 7f5160f75700 1 -- 172.21.15.45:0/42585753 wait complete. 2023-12-19T17:52:57.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.133+0000 7f5160f75700 1 Processor -- start 2023-12-19T17:52:57.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 -- start start 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 0x7f515c162680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f515c1611c0 0x7f515c152ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c1615a0 0x7f515c0b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c153420 con 0x7f515c0af720 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f515c163f60 con 0x7f515c1611c0 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f515c1641e0 con 0x7f515c1615a0 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 0x7f515c162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 0x7f515c162680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33188/0 (socket says 172.21.15.45:33188) 2023-12-19T17:52:57.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 -- 172.21.15.45:0/2325405181 learned_addr learned my addr 172.21.15.45:0/2325405181 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515bfff700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c1615a0 0x7f515c0b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515affd700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f515c1611c0 0x7f515c152ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 -- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c1615a0 msgr2=0x7f515c0b1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c1615a0 0x7f515c0b1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 -- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f515c1611c0 msgr2=0x7f515c152ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f515c1611c0 0x7f515c152ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 -- 172.21.15.45:0/2325405181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51540094b0 con 0x7f515c0af720 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515affd700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f515c1611c0 0x7f515c152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f515b7fe700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 0x7f515c162680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f514c00cbc0 tx=0x7f514c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c00a9e0 con 0x7f515c0af720 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f514c00ab40 con 0x7f515c0af720 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f515c1644a0 con 0x7f515c0af720 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f514c012400 con 0x7f515c0af720 2023-12-19T17:52:57.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.137+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f515c0c7050 con 0x7f515c0af720 2023-12-19T17:52:57.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.141+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f515c06e760 con 0x7f515c0af720 2023-12-19T17:52:57.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.141+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f514c012560 con 0x7f515c0af720 2023-12-19T17:52:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.145+0000 7f5153fff700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f513c065ad0 0x7f513c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.145+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f514c083760 con 0x7f515c0af720 2023-12-19T17:52:57.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.145+0000 7f515affd700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f513c065ad0 0x7f513c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.145+0000 7f515affd700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f513c065ad0 0x7f513c067f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f515c0ce580 tx=0x7f5144008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.149+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f514c050ca0 con 0x7f515c0af720 2023-12-19T17:52:57.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.325+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f515c067760 con 0x7f515c0af720 2023-12-19T17:52:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5153fff700 1 -- 172.21.15.45:0/2325405181 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f514c0542c0 con 0x7f515c0af720 2023-12-19T17:52:57.332 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:57.332 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f513c065ad0 msgr2=0x7f513c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f513c065ad0 0x7f513c067f90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f515c0ce580 tx=0x7f5144008040 comp rx=0 tx=0).stop 2023-12-19T17:52:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 msgr2=0x7f515c162680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 0x7f515c162680 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f514c00cbc0 tx=0x7f514c00cca0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 shutdown_connections 2023-12-19T17:52:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f513c065ad0 0x7f513c067f90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f515c1615a0 0x7f515c0b1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f515c1611c0 0x7f515c152ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 --2- 172.21.15.45:0/2325405181 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f515c0af720 0x7f515c162680 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.329+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 >> 172.21.15.45:0/2325405181 conn(0x7f515c0cb900 msgr2=0x7f515c06d710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.333+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 shutdown_connections 2023-12-19T17:52:57.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.333+0000 7f5160f75700 1 -- 172.21.15.45:0/2325405181 wait complete. 2023-12-19T17:52:57.356 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:51:35.638865+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:51:36.805553+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-19T17:51:39.915006+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-19T17:52:57.357 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:52:57.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.541+0000 7f52d98fa700 1 Processor -- start 2023-12-19T17:52:57.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.541+0000 7f52d98fa700 1 -- start start 2023-12-19T17:52:57.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d98fa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f52d40b8580 0x7f52d40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d98fa700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d415d300 con 0x7f52d40d25f0 2023-12-19T17:52:57.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d98fa700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52d40d1550 con 0x7f52d415cf20 2023-12-19T17:52:57.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d98fa700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52d40d1360 con 0x7f52d40b8580 2023-12-19T17:52:57.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f52d40d25f0 0x7f52d40b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59110/0 (socket says 172.21.15.45:59110) 2023-12-19T17:52:57.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d37fe700 1 -- 172.21.15.45:0/2612463076 learned_addr learned my addr 172.21.15.45:0/2612463076 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d27fc700 1 --2- 172.21.15.45:0/2612463076 >> v2:172.21.15.73:3300/0 conn(0x7f52d40b8580 0x7f52d40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3520501161 0 0) 0x7f52d415d300 con 0x7f52d40d25f0 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52bc0035d0 con 0x7f52d40d25f0 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3145194751 0 0) 0x7f52bc0035d0 con 0x7f52d40d25f0 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 >> v2:172.21.15.73:3300/0 conn(0x7f52d40b8580 msgr2=0x7f52d40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 --2- 172.21.15.45:0/2612463076 >> v2:172.21.15.73:3300/0 conn(0x7f52d40b8580 0x7f52d40cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 >> v1:172.21.15.73:6789/0 conn(0x7f52d415cf20 legacy=0x7f52d40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d40d1830 con 0x7f52d40d25f0 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f52cc0019f0 con 0x7f52d40d25f0 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 >> v1:172.21.15.45:6789/0 conn(0x7f52d40d25f0 legacy=0x7f52d40b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52bc003a20 0x7f52bc003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc004870 0x7f52bc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52bc005230 0x7f52bc00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00c050 con 0x7f52bc004870 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00c1c0 con 0x7f52bc005230 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.545+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52bc00c380 con 0x7f52bc003a20 2023-12-19T17:52:57.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52bc005230 0x7f52bc00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d2ffd700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52bc003a20 0x7f52bc003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d27fc700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc004870 0x7f52bc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 -- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52bc003a20 msgr2=0x7f52bc003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52bc003a20 0x7f52bc003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 -- 172.21.15.45:0/2612463076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc004870 msgr2=0x7f52bc004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc004870 0x7f52bc004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 -- 172.21.15.45:0/2612463076 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc0035d0 con 0x7f52bc005230 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 -- 172.21.15.45:0/2612463076 reap_dead start 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d37fe700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52bc005230 0x7f52bc00ba30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00a810 tx=0x7f52bc0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a082d629596d1ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc00a250 con 0x7f52bc005230 2023-12-19T17:52:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52cc0072d0 con 0x7f52bc005230 2023-12-19T17:52:57.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d1ffb700 1 -- 172.21.15.45:0/2612463076 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52cc007660 con 0x7f52bc005230 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 -- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52bc005230 msgr2=0x7f52bc00ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52bc005230 0x7f52bc00ba30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52cc00a810 tx=0x7f52bc0058a0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 -- 172.21.15.45:0/2612463076 shutdown_connections 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 --2- 172.21.15.45:0/2612463076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52bc005230 0x7f52bc00ba30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 -- 172.21.15.45:0/2612463076 >> 172.21.15.45:0/2612463076 conn(0x7f52d40b4670 msgr2=0x7f52d40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 -- 172.21.15.45:0/2612463076 shutdown_connections 2023-12-19T17:52:57.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.549+0000 7f52d98fa700 1 -- 172.21.15.45:0/2612463076 wait complete. 2023-12-19T17:52:57.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.553+0000 7f52d98fa700 1 Processor -- start 2023-12-19T17:52:57.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 -- start start 2023-12-19T17:52:57.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 0x7f52d4152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52d41e7020 0x7f52d415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52d41e7480 0x7f52d415eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d415e730 con 0x7f52bc005230 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52d415d690 con 0x7f52d41e7480 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52d415d970 con 0x7f52d41e7020 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 0x7f52d4152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 0x7f52d4152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33214/0 (socket says 172.21.15.45:33214) 2023-12-19T17:52:57.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 -- 172.21.15.45:0/4191778635 learned_addr learned my addr 172.21.15.45:0/4191778635 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:57.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d27fc700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52d41e7020 0x7f52d415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d37fe700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52d41e7480 0x7f52d415eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 -- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52d41e7020 msgr2=0x7f52d415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52d41e7020 0x7f52d415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 -- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52d41e7480 msgr2=0x7f52d415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52d41e7480 0x7f52d415eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 -- 172.21.15.45:0/4191778635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52d415dc50 con 0x7f52bc005230 2023-12-19T17:52:57.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d2ffd700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 0x7f52d4152d60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f52c400f7a0 tx=0x7f52c400fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4017070 con 0x7f52bc005230 2023-12-19T17:52:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52c40052e0 con 0x7f52bc005230 2023-12-19T17:52:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4005470 con 0x7f52bc005230 2023-12-19T17:52:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.557+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52d415df30 con 0x7f52bc005230 2023-12-19T17:52:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.561+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52d41532a0 con 0x7f52bc005230 2023-12-19T17:52:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.561+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52d415e450 con 0x7f52bc005230 2023-12-19T17:52:57.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.565+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f52c4006880 con 0x7f52bc005230 2023-12-19T17:52:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.565+0000 7f52bbfff700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f52c0065ad0 0x7f52c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.565+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f52c4082d20 con 0x7f52bc005230 2023-12-19T17:52:57.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.565+0000 7f52d27fc700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f52c0065ad0 0x7f52c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.565+0000 7f52d27fc700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f52c0065ad0 0x7f52c0067f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52d41f56f0 tx=0x7f52c8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.573+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f52c4050260 con 0x7f52bc005230 2023-12-19T17:52:57.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.745+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f52d404ed30 con 0x7f52bc005230 2023-12-19T17:52:57.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.745+0000 7f52bbfff700 1 -- 172.21.15.45:0/4191778635 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f52c4053880 con 0x7f52bc005230 2023-12-19T17:52:57.750 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f52c0065ad0 msgr2=0x7f52c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f52c0065ad0 0x7f52c0067f90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f52d41f56f0 tx=0x7f52c8009240 comp rx=0 tx=0).stop 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 msgr2=0x7f52d4152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 0x7f52d4152d60 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f52c400f7a0 tx=0x7f52c400fb60 comp rx=0 tx=0).stop 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 shutdown_connections 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f52c0065ad0 0x7f52c0067f90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f52d41e7480 0x7f52d415eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f52d41e7020 0x7f52d415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 --2- 172.21.15.45:0/4191778635 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f52bc005230 0x7f52d4152d60 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 >> 172.21.15.45:0/4191778635 conn(0x7f52d40b4670 msgr2=0x7f52d41551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:57.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 shutdown_connections 2023-12-19T17:52:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.749+0000 7f52d98fa700 1 -- 172.21.15.45:0/4191778635 wait complete. 2023-12-19T17:52:57.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:52:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 Processor -- start 2023-12-19T17:52:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 -- start start 2023-12-19T17:52:57.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b040cd4b0 0x7f9b0406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b040cd920 con 0x7f9b040d0e30 2023-12-19T17:52:57.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0406ffe0 con 0x7f9b040cd4b0 2023-12-19T17:52:57.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b08b1d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040d2200 con 0x7f9b0415d220 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b037fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b040d0e30 0x7f9b040d1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59124/0 (socket says 172.21.15.45:59124) 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b037fe700 1 -- 172.21.15.45:0/4250678669 learned_addr learned my addr 172.21.15.45:0/4250678669 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b02ffd700 1 --2- 172.21.15.45:0/4250678669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.965+0000 7f9b03fff700 1 --2- 172.21.15.45:0/4250678669 >> v2:172.21.15.73:3300/0 conn(0x7f9b040cd4b0 0x7f9b0406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b027fc700 1 -- 172.21.15.45:0/4250678669 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626887984 0 0) 0x7f9b040cd920 con 0x7f9b040d0e30 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b027fc700 1 -- 172.21.15.45:0/4250678669 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9aec0035d0 con 0x7f9b040d0e30 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b02ffd700 1 -- 172.21.15.45:0/4250678669 >> v2:172.21.15.73:3300/0 conn(0x7f9b040cd4b0 msgr2=0x7f9b0406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b02ffd700 1 --2- 172.21.15.45:0/4250678669 >> v2:172.21.15.73:3300/0 conn(0x7f9b040cd4b0 0x7f9b0406ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b02ffd700 1 -- 172.21.15.45:0/4250678669 >> v1:172.21.15.45:6789/0 conn(0x7f9b040d0e30 legacy=0x7f9b040d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b02ffd700 1 -- 172.21.15.45:0/4250678669 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b040d1920 con 0x7f9b0415d220 2023-12-19T17:52:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b02ffd700 1 --2- 172.21.15.45:0/4250678669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040d2690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009850 tx=0x7f9af8009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=397ecdc001f177c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b027fc700 1 -- 172.21.15.45:0/4250678669 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8011830 con 0x7f9b0415d220 2023-12-19T17:52:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b027fc700 1 -- 172.21.15.45:0/4250678669 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8011990 con 0x7f9b0415d220 2023-12-19T17:52:57.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b027fc700 1 -- 172.21.15.45:0/4250678669 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8011d40 con 0x7f9b0415d220 2023-12-19T17:52:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 -- 172.21.15.45:0/4250678669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 msgr2=0x7f9b040d2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/4250678669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040d2690 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009850 tx=0x7f9af8009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 -- 172.21.15.45:0/4250678669 shutdown_connections 2023-12-19T17:52:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/4250678669 >> v2:172.21.15.73:3300/0 conn(0x7f9b040cd4b0 0x7f9b0406ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/4250678669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040d2690 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 -- 172.21.15.45:0/4250678669 >> 172.21.15.45:0/4250678669 conn(0x7f9b040b46d0 msgr2=0x7f9b040b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 -- 172.21.15.45:0/4250678669 shutdown_connections 2023-12-19T17:52:57.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.969+0000 7f9b08b1d700 1 -- 172.21.15.45:0/4250678669 wait complete. 2023-12-19T17:52:57.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.973+0000 7f9b08b1d700 1 Processor -- start 2023-12-19T17:52:57.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.973+0000 7f9b08b1d700 1 -- start start 2023-12-19T17:52:57.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.973+0000 7f9b08b1d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b040cd4b0 0x7f9b04158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 0x7f9b040cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040b3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040cc870 con 0x7f9b040d0e30 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040ccaa0 con 0x7f9b040cd4b0 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b040c6c80 con 0x7f9b0415d220 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 0x7f9b040cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b040cd4b0 0x7f9b04158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 0x7f9b040cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33220/0 (socket says 172.21.15.45:33220) 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 -- 172.21.15.45:0/317000472 learned_addr learned my addr 172.21.15.45:0/317000472 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:57.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b03fff700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040b3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 -- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 msgr2=0x7f9b040b3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040b3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 -- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b040cd4b0 msgr2=0x7f9b04158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b040cd4b0 0x7f9b04158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 -- 172.21.15.45:0/317000472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af80094b0 con 0x7f9b040d0e30 2023-12-19T17:52:57.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b02ffd700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 0x7f9b040cc330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9af80090b0 tx=0x7f9af8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8004520 con 0x7f9b040d0e30 2023-12-19T17:52:57.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af801f070 con 0x7f9b040d0e30 2023-12-19T17:52:57.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b040c6f60 con 0x7f9b040d0e30 2023-12-19T17:52:57.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8003900 con 0x7f9b040d0e30 2023-12-19T17:52:57.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.977+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b040c7520 con 0x7f9b040d0e30 2023-12-19T17:52:57.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.981+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b04072a90 con 0x7f9b040d0e30 2023-12-19T17:52:57.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.981+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9af8003a60 con 0x7f9b040d0e30 2023-12-19T17:52:57.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.981+0000 7f9aebfff700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9af0065ad0 0x7f9af0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.985+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9af8021070 con 0x7f9b040d0e30 2023-12-19T17:52:57.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.985+0000 7f9b037fe700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9af0065ad0 0x7f9af0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:57.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.985+0000 7f9b037fe700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9af0065ad0 0x7f9af0067f90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9af4007fd0 tx=0x7f9af4007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:57.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:57.989+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9af8051f50 con 0x7f9b040d0e30 2023-12-19T17:52:58.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.165+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b040c7710 con 0x7f9b040d0e30 2023-12-19T17:52:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.165+0000 7f9aebfff700 1 -- 172.21.15.45:0/317000472 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9af8006ce0 con 0x7f9b040d0e30 2023-12-19T17:52:58.170 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9af0065ad0 msgr2=0x7f9af0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9af0065ad0 0x7f9af0067f90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9af4007fd0 tx=0x7f9af4007de0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 msgr2=0x7f9b040cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 0x7f9b040cc330 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9af80090b0 tx=0x7f9af8004770 comp rx=0 tx=0).stop 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 shutdown_connections 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9af0065ad0 0x7f9af0067f90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b0415d220 0x7f9b040b3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b040d0e30 0x7f9b040cc330 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 --2- 172.21.15.45:0/317000472 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b040cd4b0 0x7f9b04158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.169+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 >> 172.21.15.45:0/317000472 conn(0x7f9b040b46d0 msgr2=0x7f9b040cd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:58.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.173+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 shutdown_connections 2023-12-19T17:52:58.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.173+0000 7f9b08b1d700 1 -- 172.21.15.45:0/317000472 wait complete. 2023-12-19T17:52:58.198 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.381+0000 7fdfd18c8700 1 Processor -- start 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.381+0000 7fdfd18c8700 1 -- start start 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.381+0000 7fdfd18c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc159a40 0x7fdfcc0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.381+0000 7fdfd18c8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0b2a40 con 0x7fdfcc0713d0 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.381+0000 7fdfd18c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc0afb10 con 0x7fdfcc071830 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.381+0000 7fdfd18c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc0ccb50 con 0x7fdfcc159a40 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfca7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdfcc0713d0 0x7fdfcc0aecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59134/0 (socket says 172.21.15.45:59134) 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfca7fc700 1 -- 172.21.15.45:0/3503889318 learned_addr learned my addr 172.21.15.45:0/3503889318 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfcaffd700 1 --2- 172.21.15.45:0/3503889318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc159a40 0x7fdfcc0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfc9ffb700 1 -- 172.21.15.45:0/3503889318 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 452422171 0 0) 0x7fdfcc0b2a40 con 0x7fdfcc0713d0 2023-12-19T17:52:58.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfc9ffb700 1 -- 172.21.15.45:0/3503889318 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfb40035d0 con 0x7fdfcc0713d0 2023-12-19T17:52:58.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfcaffd700 1 -- 172.21.15.45:0/3503889318 >> v1:172.21.15.73:6789/0 conn(0x7fdfcc071830 legacy=0x7fdfcc0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfc9ffb700 1 -- 172.21.15.45:0/3503889318 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610299471 0 0) 0x7fdfcc0afb10 con 0x7fdfcc071830 2023-12-19T17:52:58.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfcaffd700 1 -- 172.21.15.45:0/3503889318 >> v1:172.21.15.45:6789/0 conn(0x7fdfcc0713d0 legacy=0x7fdfcc0aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfcaffd700 1 -- 172.21.15.45:0/3503889318 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0ae5d0 con 0x7fdfcc159a40 2023-12-19T17:52:58.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfcaffd700 1 --2- 172.21.15.45:0/3503889318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc159a40 0x7fdfcc0ae090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009870 tx=0x7fdfbc009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edccd1698c614b0e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:58.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfc9ffb700 1 -- 172.21.15.45:0/3503889318 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0001670 con 0x7fdfcc159a40 2023-12-19T17:52:58.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfc9ffb700 1 -- 172.21.15.45:0/3503889318 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc004030 con 0x7fdfcc159a40 2023-12-19T17:52:58.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.385+0000 7fdfc9ffb700 1 -- 172.21.15.45:0/3503889318 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0043c0 con 0x7fdfcc159a40 2023-12-19T17:52:58.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 -- 172.21.15.45:0/3503889318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc159a40 msgr2=0x7fdfcc0ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/3503889318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc159a40 0x7fdfcc0ae090 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009870 tx=0x7fdfbc009b80 comp rx=0 tx=0).stop 2023-12-19T17:52:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 -- 172.21.15.45:0/3503889318 shutdown_connections 2023-12-19T17:52:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/3503889318 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc159a40 0x7fdfcc0ae090 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 -- 172.21.15.45:0/3503889318 >> 172.21.15.45:0/3503889318 conn(0x7fdfcc0cf5a0 msgr2=0x7fdfcc070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 -- 172.21.15.45:0/3503889318 shutdown_connections 2023-12-19T17:52:58.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 -- 172.21.15.45:0/3503889318 wait complete. 2023-12-19T17:52:58.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.389+0000 7fdfd18c8700 1 Processor -- start 2023-12-19T17:52:58.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 -- start start 2023-12-19T17:52:58.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfcc071830 0x7fdfcc0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 0x7fdfcc145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc146410 0x7fdfcc15b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc146880 con 0x7fdfcc159a40 2023-12-19T17:52:58.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc15bd60 con 0x7fdfcc071830 2023-12-19T17:52:58.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfd18c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc15c040 con 0x7fdfcc146410 2023-12-19T17:52:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 0x7fdfcc145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 0x7fdfcc145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:33224/0 (socket says 172.21.15.45:33224) 2023-12-19T17:52:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 -- 172.21.15.45:0/1904242033 learned_addr learned my addr 172.21.15.45:0/1904242033 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfcaffd700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfcc071830 0x7fdfcc0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfcb7fe700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc146410 0x7fdfcc15b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 -- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc146410 msgr2=0x7fdfcc15b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc146410 0x7fdfcc15b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 -- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfcc071830 msgr2=0x7fdfcc0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfcc071830 0x7fdfcc0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 -- 172.21.15.45:0/1904242033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009450 con 0x7fdfcc159a40 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.393+0000 7fdfca7fc700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 0x7fdfcc145ed0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c6d0 tx=0x7fdfc000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.397+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0004ca0 con 0x7fdfcc159a40 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.397+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc0004e20 con 0x7fdfcc159a40 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.397+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc15c320 con 0x7fdfcc159a40 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.397+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfc0007310 con 0x7fdfcc159a40 2023-12-19T17:52:58.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.397+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc15c8e0 con 0x7fdfcc159a40 2023-12-19T17:52:58.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.397+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc15cb00 con 0x7fdfcc159a40 2023-12-19T17:52:58.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.401+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdfc0007470 con 0x7fdfcc159a40 2023-12-19T17:52:58.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.401+0000 7fdfb3fff700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfb8065b00 0x7fdfb8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.401+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fdfc0083370 con 0x7fdfcc159a40 2023-12-19T17:52:58.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.401+0000 7fdfcaffd700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfb8065b00 0x7fdfb8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.401+0000 7fdfcaffd700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfb8065b00 0x7fdfb8067fc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097c0 tx=0x7fdfbc008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:58.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.409+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdfc00508b0 con 0x7fdfcc159a40 2023-12-19T17:52:58.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.585+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdfcc0ae800 con 0x7fdfcc159a40 2023-12-19T17:52:58.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfb3fff700 1 -- 172.21.15.45:0/1904242033 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdfc0007720 con 0x7fdfcc159a40 2023-12-19T17:52:58.593 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfb8065b00 msgr2=0x7fdfb8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfb8065b00 0x7fdfb8067fc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc0097c0 tx=0x7fdfbc008000 comp rx=0 tx=0).stop 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 msgr2=0x7fdfcc145ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 0x7fdfcc145ed0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdfc000c6d0 tx=0x7fdfc000c9e0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 shutdown_connections 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfb8065b00 0x7fdfb8067fc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfcc146410 0x7fdfcc15b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfcc159a40 0x7fdfcc145ed0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 --2- 172.21.15.45:0/1904242033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfcc071830 0x7fdfcc0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 >> 172.21.15.45:0/1904242033 conn(0x7fdfcc0713d0 msgr2=0x7fdfcc155a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:58.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 shutdown_connections 2023-12-19T17:52:58.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.589+0000 7fdfd18c8700 1 -- 172.21.15.45:0/1904242033 wait complete. 2023-12-19T17:52:58.616 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-19T17:52:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.809+0000 7f02c1bd9700 1 Processor -- start 2023-12-19T17:52:58.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.809+0000 7f02c1bd9700 1 -- start start 2023-12-19T17:52:58.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02c1bd9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc15d170 0x7f02bc0ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02c1bd9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc161710 con 0x7f02bc0b19f0 2023-12-19T17:52:58.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02c1bd9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02bc1619f0 con 0x7f02bc0acd20 2023-12-19T17:52:58.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02c1bd9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc0ac520 con 0x7f02bc15d170 2023-12-19T17:52:58.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02baffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f02bc0b19f0 0x7f02bc06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56816/0 (socket says 172.21.15.45:56816) 2023-12-19T17:52:58.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02baffd700 1 -- 172.21.15.45:0/3124589156 learned_addr learned my addr 172.21.15.45:0/3124589156 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:58.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02bb7fe700 1 --2- 172.21.15.45:0/3124589156 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc15d170 0x7f02bc0ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02bb7fe700 1 -- 172.21.15.45:0/3124589156 >> v1:172.21.15.73:6789/0 conn(0x7f02bc0acd20 legacy=0x7f02bc0b2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02bb7fe700 1 -- 172.21.15.45:0/3124589156 >> v1:172.21.15.45:6789/0 conn(0x7f02bc0b19f0 legacy=0x7f02bc06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02bb7fe700 1 -- 172.21.15.45:0/3124589156 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02bc0ac800 con 0x7f02bc15d170 2023-12-19T17:52:58.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02ba7fc700 1 -- 172.21.15.45:0/3124589156 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959041524 0 0) 0x7f02bc161710 con 0x7f02bc0b19f0 2023-12-19T17:52:58.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.813+0000 7f02bb7fe700 1 --2- 172.21.15.45:0/3124589156 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc15d170 0x7f02bc0ada60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009880 tx=0x7f02ac009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15ee0cff27a8151 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:58.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.821+0000 7f02ba7fc700 1 -- 172.21.15.45:0/3124589156 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac011830 con 0x7f02bc15d170 2023-12-19T17:52:58.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.821+0000 7f02ba7fc700 1 -- 172.21.15.45:0/3124589156 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac011990 con 0x7f02bc15d170 2023-12-19T17:52:58.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.821+0000 7f02ba7fc700 1 -- 172.21.15.45:0/3124589156 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac011d20 con 0x7f02bc15d170 2023-12-19T17:52:58.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.821+0000 7f02c1bd9700 1 -- 172.21.15.45:0/3124589156 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc15d170 msgr2=0x7f02bc0ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.821+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/3124589156 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc15d170 0x7f02bc0ada60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f02ac009880 tx=0x7f02ac009b90 comp rx=0 tx=0).stop 2023-12-19T17:52:58.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.825+0000 7f02c1bd9700 1 -- 172.21.15.45:0/3124589156 shutdown_connections 2023-12-19T17:52:58.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.825+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/3124589156 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc15d170 0x7f02bc0ada60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.825+0000 7f02c1bd9700 1 -- 172.21.15.45:0/3124589156 >> 172.21.15.45:0/3124589156 conn(0x7f02bc071990 msgr2=0x7f02bc0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:58.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.825+0000 7f02c1bd9700 1 -- 172.21.15.45:0/3124589156 shutdown_connections 2023-12-19T17:52:58.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.825+0000 7f02c1bd9700 1 -- 172.21.15.45:0/3124589156 wait complete. 2023-12-19T17:52:58.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.825+0000 7f02c1bd9700 1 Processor -- start 2023-12-19T17:52:58.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 -- start start 2023-12-19T17:52:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 0x7f02bc1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc0b19f0 0x7f02bc14ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 0x7f02bc13a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc1f6080 con 0x7f02bc15d170 2023-12-19T17:52:58.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc14b530 con 0x7f02bc0acd20 2023-12-19T17:52:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02c1bd9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02bc1f62d0 con 0x7f02bc0b19f0 2023-12-19T17:52:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 0x7f02bc13a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02baffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc0b19f0 0x7f02bc14ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 0x7f02bc1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 0x7f02bc1473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40304/0 (socket says 172.21.15.45:40304) 2023-12-19T17:52:58.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 -- 172.21.15.45:0/1059864850 learned_addr learned my addr 172.21.15.45:0/1059864850 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02baffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc0b19f0 0x7f02bc14ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:42856/0 (socket says 172.21.15.45:42856) 2023-12-19T17:52:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 0x7f02bc13a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43240/0 (socket says 172.21.15.45:43240) 2023-12-19T17:52:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 -- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc0b19f0 msgr2=0x7f02bc14ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc0b19f0 0x7f02bc14ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 -- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 msgr2=0x7f02bc13a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:58.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 0x7f02bc13a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bb7fe700 1 -- 172.21.15.45:0/1059864850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ac0094b0 con 0x7f02bc0acd20 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.829+0000 7f02bbfff700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 0x7f02bc13a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02bb7fe700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 0x7f02bc1473b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02ac014040 tx=0x7f02ac004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00ba70 con 0x7f02bc0acd20 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ac01e070 con 0x7f02bc0acd20 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ac00be10 con 0x7f02bc0acd20 2023-12-19T17:52:58.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02bc1f65b0 con 0x7f02bc0acd20 2023-12-19T17:52:58.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02bc1f6db0 con 0x7f02bc0acd20 2023-12-19T17:52:58.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.833+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02bc1f6fa0 con 0x7f02bc0acd20 2023-12-19T17:52:58.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.837+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f02ac02d450 con 0x7f02bc0acd20 2023-12-19T17:52:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.837+0000 7f02a3fff700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02a8065b20 0x7f02a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:58.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.837+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f02ac084610 con 0x7f02bc0acd20 2023-12-19T17:52:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.837+0000 7f02baffd700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02a8065b20 0x7f02a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:58.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.837+0000 7f02baffd700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02a8065b20 0x7f02a8067fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02b0007b30 tx=0x7f02b0007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:58.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:58.841+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f02ac051c60 con 0x7f02bc0acd20 2023-12-19T17:52:59.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.025+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f02bc04ed30 con 0x7f02bc0acd20 2023-12-19T17:52:59.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.029+0000 7f02a3fff700 1 -- 172.21.15.45:0/1059864850 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f02ac055280 con 0x7f02bc0acd20 2023-12-19T17:52:59.031 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:52:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02a8065b20 msgr2=0x7f02a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02a8065b20 0x7f02a8067fe0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02b0007b30 tx=0x7f02b0007a80 comp rx=0 tx=0).stop 2023-12-19T17:52:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 msgr2=0x7f02bc1473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 0x7f02bc1473b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f02ac014040 tx=0x7f02ac004770 comp rx=0 tx=0).stop 2023-12-19T17:52:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 shutdown_connections 2023-12-19T17:52:59.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02a8065b20 0x7f02a8067fe0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02bc15d170 0x7f02bc13a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02bc0b19f0 0x7f02bc14ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 --2- 172.21.15.45:0/1059864850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02bc0acd20 0x7f02bc1473b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 >> 172.21.15.45:0/1059864850 conn(0x7f02bc071990 msgr2=0x7f02bc06fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 shutdown_connections 2023-12-19T17:52:59.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.033+0000 7f02c1bd9700 1 -- 172.21.15.45:0/1059864850 wait complete. 2023-12-19T17:52:59.059 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:52:59.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.237+0000 7f01665d9700 1 Processor -- start 2023-12-19T17:52:59.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.237+0000 7f01665d9700 1 -- start start 2023-12-19T17:52:59.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01665d9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0160164a70 0x7f01600cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01665d9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f01600cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01665d9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01600cd8b0 con 0x7f0160164690 2023-12-19T17:52:59.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01665d9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01600cdb80 con 0x7f0160164a70 2023-12-19T17:52:59.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01665d9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600cde60 con 0x7f01600c4510 2023-12-19T17:52:59.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01577fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0160164a70 0x7f01600cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f0164b76700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f01600cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f015ffff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0160164690 0x7f01600c3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:51316/0 (socket says 172.21.15.45:51316) 2023-12-19T17:52:59.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f015ffff700 1 -- 172.21.15.45:0/2563237531 learned_addr learned my addr 172.21.15.45:0/2563237531 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01577fe700 1 -- 172.21.15.45:0/2563237531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 msgr2=0x7f01600cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:52:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01577fe700 1 --2- 172.21.15.45:0/2563237531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f01600cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f015f7fe700 1 -- 172.21.15.45:0/2563237531 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 949542283 0 0) 0x7f01600cd8b0 con 0x7f0160164690 2023-12-19T17:52:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01577fe700 1 -- 172.21.15.45:0/2563237531 >> v1:172.21.15.73:6789/0 conn(0x7f0160164690 legacy=0x7f01600c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.241+0000 7f01577fe700 1 -- 172.21.15.45:0/2563237531 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600ce140 con 0x7f0160164a70 2023-12-19T17:52:59.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01577fe700 1 --2- 172.21.15.45:0/2563237531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164a70 0x7f01600cce30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0148009850 tx=0x7f0148009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcd05d2934123c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:59.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f015f7fe700 1 -- 172.21.15.45:0/2563237531 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148011830 con 0x7f0160164a70 2023-12-19T17:52:59.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f015f7fe700 1 -- 172.21.15.45:0/2563237531 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0148011990 con 0x7f0160164a70 2023-12-19T17:52:59.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f015f7fe700 1 -- 172.21.15.45:0/2563237531 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148011d40 con 0x7f0160164a70 2023-12-19T17:52:59.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 -- 172.21.15.45:0/2563237531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164a70 msgr2=0x7f01600cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 --2- 172.21.15.45:0/2563237531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164a70 0x7f01600cce30 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0148009850 tx=0x7f0148009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:59.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 -- 172.21.15.45:0/2563237531 shutdown_connections 2023-12-19T17:52:59.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 --2- 172.21.15.45:0/2563237531 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f01600cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 --2- 172.21.15.45:0/2563237531 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164a70 0x7f01600cce30 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 -- 172.21.15.45:0/2563237531 >> 172.21.15.45:0/2563237531 conn(0x7f01600cba40 msgr2=0x7f01600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:59.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 -- 172.21.15.45:0/2563237531 shutdown_connections 2023-12-19T17:52:59.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.245+0000 7f01665d9700 1 -- 172.21.15.45:0/2563237531 wait complete. 2023-12-19T17:52:59.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 Processor -- start 2023-12-19T17:52:59.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 -- start start 2023-12-19T17:52:59.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f0160156c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 0x7f0160159040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160164a70 0x7f01601fabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600b3620 con 0x7f0160164690 2023-12-19T17:52:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01601fb130 con 0x7f0160164a70 2023-12-19T17:52:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01665d9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600b3040 con 0x7f01600c4510 2023-12-19T17:52:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 0x7f0160159040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 0x7f0160159040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43260/0 (socket says 172.21.15.45:43260) 2023-12-19T17:52:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 -- 172.21.15.45:0/2483618512 learned_addr learned my addr 172.21.15.45:0/2483618512 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:59.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f015ffff700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f0160156c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f0164b76700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160164a70 0x7f01601fabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 -- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 msgr2=0x7f0160156c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f0160156c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 -- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160164a70 msgr2=0x7f01601fabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160164a70 0x7f01601fabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.249+0000 7f01577fe700 1 -- 172.21.15.45:0/2483618512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480094b0 con 0x7f0160164690 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f01577fe700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 0x7f0160159040 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0148014040 tx=0x7f0148004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01480036c0 con 0x7f0160164690 2023-12-19T17:52:59.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014801e070 con 0x7f0160164690 2023-12-19T17:52:59.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01601596e0 con 0x7f0160164690 2023-12-19T17:52:59.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148003a80 con 0x7f0160164690 2023-12-19T17:52:59.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01601599c0 con 0x7f0160164690 2023-12-19T17:52:59.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.253+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01600b2ea0 con 0x7f0160164690 2023-12-19T17:52:59.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.257+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0148003be0 con 0x7f0160164690 2023-12-19T17:52:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.257+0000 7f015d7fa700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0140065ad0 0x7f0140067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.257+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f01480844f0 con 0x7f0160164690 2023-12-19T17:52:59.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.257+0000 7f015ffff700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0140065ad0 0x7f0140067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.257+0000 7f015ffff700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0140065ad0 0x7f0140067f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0150000f60 tx=0x7f0150007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:59.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.261+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f01600b2ea0 con 0x7f0160164690 2023-12-19T17:52:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.477+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01600b2ea0 con 0x7f0160164690 2023-12-19T17:52:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.477+0000 7f015d7fa700 1 -- 172.21.15.45:0/2483618512 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f01600b2ea0 con 0x7f0160164690 2023-12-19T17:52:59.482 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:59.482 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:52:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0140065ad0 msgr2=0x7f0140067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0140065ad0 0x7f0140067f90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0150000f60 tx=0x7f0150007c00 comp rx=0 tx=0).stop 2023-12-19T17:52:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 msgr2=0x7f0160159040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 0x7f0160159040 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f0148014040 tx=0x7f0148004770 comp rx=0 tx=0).stop 2023-12-19T17:52:59.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 shutdown_connections 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0140065ad0 0x7f0140067f90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0160164a70 0x7f01601fabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0160164690 0x7f0160159040 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 --2- 172.21.15.45:0/2483618512 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f01600c4510 0x7f0160156c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 >> 172.21.15.45:0/2483618512 conn(0x7f01600cba40 msgr2=0x7f01600ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 shutdown_connections 2023-12-19T17:52:59.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.481+0000 7f01665d9700 1 -- 172.21.15.45:0/2483618512 wait complete. 2023-12-19T17:52:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:52:59.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:52:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507b59e700 1 Processor -- start 2023-12-19T17:52:59.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507b59e700 1 -- start start 2023-12-19T17:52:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f507c0b88b0 0x7f507c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c0d1820 con 0x7f507c06ea90 2023-12-19T17:52:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507c0d1b00 con 0x7f507c06f3b0 2023-12-19T17:52:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f507c0d1630 con 0x7f507c0b88b0 2023-12-19T17:52:59.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f507c06ea90 0x7f507c0d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56832/0 (socket says 172.21.15.45:56832) 2023-12-19T17:52:59.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507a59c700 1 -- 172.21.15.45:0/2352129071 learned_addr learned my addr 172.21.15.45:0/2352129071 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:52:59.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f5079d9b700 1 --2- 172.21.15.45:0/2352129071 >> v2:172.21.15.73:3300/0 conn(0x7f507c0b88b0 0x7f507c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.693+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3080463724 0 0) 0x7f507c0d1820 con 0x7f507c06ea90 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50640035d0 con 0x7f507c06ea90 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722189660 0 0) 0x7f507c0d1b00 con 0x7f507c06f3b0 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f507c0d1820 con 0x7f507c06f3b0 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f5079d9b700 1 -- 172.21.15.45:0/2352129071 >> v1:172.21.15.73:6789/0 conn(0x7f507c06f3b0 legacy=0x7f507c06f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f5079d9b700 1 -- 172.21.15.45:0/2352129071 >> v1:172.21.15.45:6789/0 conn(0x7f507c06ea90 legacy=0x7f507c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f5079d9b700 1 -- 172.21.15.45:0/2352129071 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507c0d1de0 con 0x7f507c0b88b0 2023-12-19T17:52:59.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f5079d9b700 1 --2- 172.21.15.45:0/2352129071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c06ee70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5070009850 tx=0x7f5070009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76c09d266419e2af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:59.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011830 con 0x7f507c0b88b0 2023-12-19T17:52:59.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5070011990 con 0x7f507c0b88b0 2023-12-19T17:52:59.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507959a700 1 -- 172.21.15.45:0/2352129071 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5070011d40 con 0x7f507c0b88b0 2023-12-19T17:52:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 -- 172.21.15.45:0/2352129071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 msgr2=0x7f507c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 --2- 172.21.15.45:0/2352129071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c06ee70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5070009850 tx=0x7f5070009b60 comp rx=0 tx=0).stop 2023-12-19T17:52:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 -- 172.21.15.45:0/2352129071 shutdown_connections 2023-12-19T17:52:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 --2- 172.21.15.45:0/2352129071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c06ee70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 -- 172.21.15.45:0/2352129071 >> 172.21.15.45:0/2352129071 conn(0x7f507c0b46d0 msgr2=0x7f507c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 -- 172.21.15.45:0/2352129071 shutdown_connections 2023-12-19T17:52:59.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.697+0000 7f507b59e700 1 -- 172.21.15.45:0/2352129071 wait complete. 2023-12-19T17:52:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.701+0000 7f507b59e700 1 Processor -- start 2023-12-19T17:52:59.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.701+0000 7f507b59e700 1 -- start start 2023-12-19T17:52:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c06ea90 0x7f507c0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 0x7f507c15a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c1e5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0caca0 con 0x7f507c06f3b0 2023-12-19T17:52:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0cb430 con 0x7f507c0b88b0 2023-12-19T17:52:59.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507c0cb710 con 0x7f507c06ea90 2023-12-19T17:52:59.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 0x7f507c15a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 0x7f507c15a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43274/0 (socket says 172.21.15.45:43274) 2023-12-19T17:52:59.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 -- 172.21.15.45:0/2728256051 learned_addr learned my addr 172.21.15.45:0/2728256051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507a59c700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c06ea90 0x7f507c0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507ad9d700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c1e5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 -- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c06ea90 msgr2=0x7f507c0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c06ea90 0x7f507c0ca6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 -- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 msgr2=0x7f507c1e5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c1e5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 -- 172.21.15.45:0/2728256051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700094b0 con 0x7f507c06f3b0 2023-12-19T17:52:59.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f5079d9b700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 0x7f507c15a0d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f507c072a40 tx=0x7f5070004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:59.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507001a990 con 0x7f507c06f3b0 2023-12-19T17:52:59.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f507001f070 con 0x7f507c06f3b0 2023-12-19T17:52:59.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f507001ad30 con 0x7f507c06f3b0 2023-12-19T17:52:59.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507c0cb9f0 con 0x7f507c06f3b0 2023-12-19T17:52:59.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.705+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507c15b170 con 0x7f507c06f3b0 2023-12-19T17:52:59.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.709+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507c0cbf10 con 0x7f507c06f3b0 2023-12-19T17:52:59.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.709+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f507001b430 con 0x7f507c06f3b0 2023-12-19T17:52:59.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.713+0000 7f506affd700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f505c065b00 0x7f505c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:52:59.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.713+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f50700844e0 con 0x7f507c06f3b0 2023-12-19T17:52:59.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.713+0000 7f507a59c700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f505c065b00 0x7f505c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:52:59.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.713+0000 7f507a59c700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f505c065b00 0x7f505c067fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f506c000f60 tx=0x7f506c007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:52:59.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.721+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f507c0cbf10 con 0x7f507c06f3b0 2023-12-19T17:52:59.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.897+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f507c0cbf10 con 0x7f507c06f3b0 2023-12-19T17:52:59.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.901+0000 7f506affd700 1 -- 172.21.15.45:0/2728256051 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7f507c0cbf10 con 0x7f507c06f3b0 2023-12-19T17:52:59.904 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:52:59.904 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.901+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f505c065b00 msgr2=0x7f505c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.901+0000 7f507b59e700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f505c065b00 0x7f505c067fc0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f506c000f60 tx=0x7f506c007e20 comp rx=0 tx=0).stop 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.901+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 msgr2=0x7f507c15a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.901+0000 7f507b59e700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 0x7f507c15a0d0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f507c072a40 tx=0x7f5070004770 comp rx=0 tx=0).stop 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 shutdown_connections 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f505c065b00 0x7f505c067fc0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f507c0b88b0 0x7f507c1e5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f507c06f3b0 0x7f507c15a0d0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 --2- 172.21.15.45:0/2728256051 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f507c06ea90 0x7f507c0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:52:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 >> 172.21.15.45:0/2728256051 conn(0x7f507c0b46d0 msgr2=0x7f507c0c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:52:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 shutdown_connections 2023-12-19T17:52:59.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:52:59.905+0000 7f507b59e700 1 -- 172.21.15.45:0/2728256051 wait complete. 2023-12-19T17:52:59.929 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T17:52:59.929 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:00.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:53:00.039 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:53:00.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 Processor -- start 2023-12-19T17:53:00.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 -- start start 2023-12-19T17:53:00.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2bf0164a70 0x7f2bf00cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bf00c4510 0x7f2bf00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bf00cd8b0 con 0x7f2bf0164690 2023-12-19T17:53:00.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00cdb80 con 0x7f2bf00c4510 2023-12-19T17:53:00.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.101+0000 7f2bf81e6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bf00cde60 con 0x7f2bf0164a70 2023-12-19T17:53:00.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bf00c4510 0x7f2bf00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bf00c4510 0x7f2bf00cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43282/0 (socket says 172.21.15.45:43282) 2023-12-19T17:53:00.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 -- 172.21.15.45:0/2544049656 learned_addr learned my addr 172.21.15.45:0/2544049656 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:00.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf5781700 1 --2- 172.21.15.45:0/2544049656 >> v2:172.21.15.73:3300/0 conn(0x7f2bf0164a70 0x7f2bf00cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 -- 172.21.15.45:0/2544049656 >> v2:172.21.15.73:3300/0 conn(0x7f2bf0164a70 msgr2=0x7f2bf00cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:00.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 --2- 172.21.15.45:0/2544049656 >> v2:172.21.15.73:3300/0 conn(0x7f2bf0164a70 0x7f2bf00cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 -- 172.21.15.45:0/2544049656 >> v1:172.21.15.73:6789/0 conn(0x7f2bf0164690 legacy=0x7f2bf00c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 -- 172.21.15.45:0/2544049656 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf00ce140 con 0x7f2bf00c4510 2023-12-19T17:53:00.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf6783700 1 --2- 172.21.15.45:0/2544049656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf00cd370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00b4b60 tx=0x7f2be800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19887c75b924b7f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:00.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf4f80700 1 -- 172.21.15.45:0/2544049656 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800e070 con 0x7f2bf00c4510 2023-12-19T17:53:00.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf4f80700 1 -- 172.21.15.45:0/2544049656 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be800b910 con 0x7f2bf00c4510 2023-12-19T17:53:00.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf4f80700 1 -- 172.21.15.45:0/2544049656 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be800bcc0 con 0x7f2bf00c4510 2023-12-19T17:53:00.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 -- 172.21.15.45:0/2544049656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 msgr2=0x7f2bf00cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/2544049656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf00cd370 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2bf00b4b60 tx=0x7f2be800b330 comp rx=0 tx=0).stop 2023-12-19T17:53:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 -- 172.21.15.45:0/2544049656 shutdown_connections 2023-12-19T17:53:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/2544049656 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf00cd370 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/2544049656 >> v2:172.21.15.73:3300/0 conn(0x7f2bf0164a70 0x7f2bf00cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 -- 172.21.15.45:0/2544049656 >> 172.21.15.45:0/2544049656 conn(0x7f2bf00cba40 msgr2=0x7f2bf00ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 -- 172.21.15.45:0/2544049656 shutdown_connections 2023-12-19T17:53:00.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.105+0000 7f2bf81e6700 1 -- 172.21.15.45:0/2544049656 wait complete. 2023-12-19T17:53:00.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 Processor -- start 2023-12-19T17:53:00.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 -- start start 2023-12-19T17:53:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf0156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 0x7f2bf0161160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 0x7f2bf01616a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf0160990 con 0x7f2bf00c4510 2023-12-19T17:53:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00c5a60 con 0x7f2bf0164a70 2023-12-19T17:53:00.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf81e6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf00c6850 con 0x7f2bf0164690 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf5f82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf0156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf5781700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 0x7f2bf0161160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf6783700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 0x7f2bf01616a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf6783700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 0x7f2bf01616a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40344/0 (socket says 172.21.15.45:40344) 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf6783700 1 -- 172.21.15.45:0/3057091021 learned_addr learned my addr 172.21.15.45:0/3057091021 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf5781700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 0x7f2bf0161160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:42892/0 (socket says 172.21.15.45:42892) 2023-12-19T17:53:00.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.109+0000 7f2bf5f82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf0156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43298/0 (socket says 172.21.15.45:43298) 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf6783700 1 -- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 msgr2=0x7f2bf0161160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf6783700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 0x7f2bf0161160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf6783700 1 -- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 msgr2=0x7f2bf0156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf6783700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf0156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf6783700 1 -- 172.21.15.45:0/3057091021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be8009b30 con 0x7f2bf0164a70 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf5f82700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf5781700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 0x7f2bf0161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:00.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf6783700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 0x7f2bf01616a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fd0 tx=0x7f2be8004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be8004880 con 0x7f2bf0164a70 2023-12-19T17:53:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2be80092e0 con 0x7f2bf0164a70 2023-12-19T17:53:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bf00c5c40 con 0x7f2bf0164a70 2023-12-19T17:53:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2be80049e0 con 0x7f2bf0164a70 2023-12-19T17:53:00.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bf00c6200 con 0x7f2bf0164a70 2023-12-19T17:53:00.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.113+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bf00c6a00 con 0x7f2bf0164a70 2023-12-19T17:53:00.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.117+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2be801c680 con 0x7f2bf0164a70 2023-12-19T17:53:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.117+0000 7f2be67fc700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bd4065ad0 0x7f2bd4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.117+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f2be8006e40 con 0x7f2bf0164a70 2023-12-19T17:53:00.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.117+0000 7f2bf5f82700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bd4065ad0 0x7f2bd4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.117+0000 7f2bf5f82700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bd4065ad0 0x7f2bd4067f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000f60 tx=0x7f2bec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:00.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.125+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2bf00c6a00 con 0x7f2bf0164a70 2023-12-19T17:53:00.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.345+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bf00c69c0 con 0x7f2bf0164a70 2023-12-19T17:53:00.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.345+0000 7f2be67fc700 1 -- 172.21.15.45:0/3057091021 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7f2be8052460 con 0x7f2bf0164a70 2023-12-19T17:53:00.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:00.351 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:53:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bd4065ad0 msgr2=0x7f2bd4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bd4065ad0 0x7f2bd4067f90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2bec000f60 tx=0x7f2bec009040 comp rx=0 tx=0).stop 2023-12-19T17:53:00.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 msgr2=0x7f2bf01616a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 0x7f2bf01616a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2be8009fd0 tx=0x7f2be8004b40 comp rx=0 tx=0).stop 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 shutdown_connections 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bd4065ad0 0x7f2bd4067f90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf0164a70 0x7f2bf01616a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bf0164690 0x7f2bf0161160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 --2- 172.21.15.45:0/3057091021 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bf00c4510 0x7f2bf0156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 >> 172.21.15.45:0/3057091021 conn(0x7f2bf00cba40 msgr2=0x7f2bf006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 shutdown_connections 2023-12-19T17:53:00.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.349+0000 7f2bf81e6700 1 -- 172.21.15.45:0/3057091021 wait complete. 2023-12-19T17:53:00.356 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:53:00.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:00.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.597+0000 7fc592c2f700 1 Processor -- start 2023-12-19T17:53:00.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.597+0000 7fc592c2f700 1 -- start start 2023-12-19T17:53:00.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc592c2f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc58c15cf50 0x7fc58c0cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc592c2f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc58c0b85d0 0x7fc58c0cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc592c2f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c06f4a0 con 0x7fc58c0701d0 2023-12-19T17:53:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc592c2f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c15d330 con 0x7fc58c0b85d0 2023-12-19T17:53:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc592c2f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0b8a90 con 0x7fc58c15cf50 2023-12-19T17:53:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59142c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc58c0b85d0 0x7fc58c0cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59242e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc58c0701d0 0x7fc58c160a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56842/0 (socket says 172.21.15.45:56842) 2023-12-19T17:53:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59242e700 1 -- 172.21.15.45:0/1607041364 learned_addr learned my addr 172.21.15.45:0/1607041364 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc591c2d700 1 --2- 172.21.15.45:0/1607041364 >> v2:172.21.15.73:3300/0 conn(0x7fc58c15cf50 0x7fc58c0cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59142c700 1 -- 172.21.15.45:0/1607041364 >> v2:172.21.15.73:3300/0 conn(0x7fc58c15cf50 msgr2=0x7fc58c0cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:00.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59142c700 1 --2- 172.21.15.45:0/1607041364 >> v2:172.21.15.73:3300/0 conn(0x7fc58c15cf50 0x7fc58c0cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59142c700 1 -- 172.21.15.45:0/1607041364 >> v1:172.21.15.45:6789/0 conn(0x7fc58c0701d0 legacy=0x7fc58c160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59142c700 1 -- 172.21.15.45:0/1607041364 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c06f6f0 con 0x7fc58c0b85d0 2023-12-19T17:53:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc590c2b700 1 -- 172.21.15.45:0/1607041364 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055684756 0 0) 0x7fc58c06f4a0 con 0x7fc58c0701d0 2023-12-19T17:53:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc59142c700 1 --2- 172.21.15.45:0/1607041364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0cdec0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc58c071d70 tx=0x7fc57c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b0ac84ef5d6676 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc590c2b700 1 -- 172.21.15.45:0/1607041364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c011830 con 0x7fc58c0b85d0 2023-12-19T17:53:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc590c2b700 1 -- 172.21.15.45:0/1607041364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57c011990 con 0x7fc58c0b85d0 2023-12-19T17:53:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.601+0000 7fc590c2b700 1 -- 172.21.15.45:0/1607041364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57c011d20 con 0x7fc58c0b85d0 2023-12-19T17:53:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 -- 172.21.15.45:0/1607041364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0b85d0 msgr2=0x7fc58c0cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 --2- 172.21.15.45:0/1607041364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0cdec0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc58c071d70 tx=0x7fc57c009b30 comp rx=0 tx=0).stop 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 -- 172.21.15.45:0/1607041364 shutdown_connections 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 --2- 172.21.15.45:0/1607041364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0cdec0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 --2- 172.21.15.45:0/1607041364 >> v2:172.21.15.73:3300/0 conn(0x7fc58c15cf50 0x7fc58c0cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 -- 172.21.15.45:0/1607041364 >> 172.21.15.45:0/1607041364 conn(0x7fc58c0b4730 msgr2=0x7fc58c0b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 -- 172.21.15.45:0/1607041364 shutdown_connections 2023-12-19T17:53:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.605+0000 7fc592c2f700 1 -- 172.21.15.45:0/1607041364 wait complete. 2023-12-19T17:53:00.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 Processor -- start 2023-12-19T17:53:00.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 -- start start 2023-12-19T17:53:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 0x7fc58c0ab420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc58c15cf50 0x7fc58c1f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0d1700 con 0x7fc58c0701d0 2023-12-19T17:53:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c15ad10 con 0x7fc58c0b85d0 2023-12-19T17:53:00.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc592c2f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c15e5f0 con 0x7fc58c15cf50 2023-12-19T17:53:00.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 0x7fc58c0ab420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 0x7fc58c0ab420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43304/0 (socket says 172.21.15.45:43304) 2023-12-19T17:53:00.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 -- 172.21.15.45:0/2297619499 learned_addr learned my addr 172.21.15.45:0/2297619499 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:00.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc59142c700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc59242e700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc58c15cf50 0x7fc58c1f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 -- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc58c15cf50 msgr2=0x7fc58c1f58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc58c15cf50 0x7fc58c1f58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 -- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc58c0b85d0 msgr2=0x7fc58c0ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.609+0000 7fc591c2d700 1 -- 172.21.15.45:0/2297619499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c0094b0 con 0x7fc58c0701d0 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc591c2d700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 0x7fc58c0ab420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc58800e840 tx=0x7fc58800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880095a0 con 0x7fc58c0701d0 2023-12-19T17:53:00.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588013680 con 0x7fc58c0701d0 2023-12-19T17:53:00.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5880139f0 con 0x7fc58c0701d0 2023-12-19T17:53:00.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c15e8d0 con 0x7fc58c0701d0 2023-12-19T17:53:00.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c15ee90 con 0x7fc58c0701d0 2023-12-19T17:53:00.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c0cef70 con 0x7fc58c0701d0 2023-12-19T17:53:00.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.613+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc588013b50 con 0x7fc58c0701d0 2023-12-19T17:53:00.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.617+0000 7fc5827fc700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc570065b20 0x7fc570067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:00.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.617+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc5880833e0 con 0x7fc58c0701d0 2023-12-19T17:53:00.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.617+0000 7fc59142c700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc570065b20 0x7fc570067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:00.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.617+0000 7fc59142c700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc570065b20 0x7fc570067fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0090b0 tx=0x7fc57c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:00.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.621+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc588050a30 con 0x7fc58c0701d0 2023-12-19T17:53:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.833+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc58c067760 con 0x7fc58c0701d0 2023-12-19T17:53:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.837+0000 7fc5827fc700 1 -- 172.21.15.45:0/2297619499 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4705 (secure 0 0 0) 0x7fc588054050 con 0x7fc58c0701d0 2023-12-19T17:53:00.840 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:00.840 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/902560818","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":902560818},{"type":"v1","addr":"172.21.15.45:6837","nonce":902560818}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4273,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1007199053","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1007199053},{"type":"v1","addr":"172.21.15.45:6835","nonce":1007199053}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/2317554471","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2317554471},{"type":"v1","addr":"172.21.15.73:6834","nonce":2317554471}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:51:37.822341+0000","modified":"2023-12-19T17:52:02.383603+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":54167},"failed":[],"damaged":[],"stopped":[],"info":{"gid_54167":{"gid":54167,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/3913672139","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3913672139},{"type":"v1","addr":"172.21.15.73:6835","nonce":3913672139}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc570065b20 msgr2=0x7fc570067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc570065b20 0x7fc570067fe0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc57c0090b0 tx=0x7fc57c008030 comp rx=0 tx=0).stop 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 msgr2=0x7fc58c0ab420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 0x7fc58c0ab420 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc58800e840 tx=0x7fc58800eb50 comp rx=0 tx=0).stop 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 shutdown_connections 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc570065b20 0x7fc570067fe0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc58c15cf50 0x7fc58c1f58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc58c0b85d0 0x7fc58c0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 --2- 172.21.15.45:0/2297619499 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc58c0701d0 0x7fc58c0ab420 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 >> 172.21.15.45:0/2297619499 conn(0x7fc58c0b4730 msgr2=0x7fc58c0cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 shutdown_connections 2023-12-19T17:53:00.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:00.841+0000 7fc592c2f700 1 -- 172.21.15.45:0/2297619499 wait complete. 2023-12-19T17:53:00.845 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 8 2023-12-19T17:53:00.864 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.037+0000 7fae3b59e700 1 Processor -- start 2023-12-19T17:53:01.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.037+0000 7fae3b59e700 1 -- start start 2023-12-19T17:53:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fae3c06ea90 0x7fae3c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0d1820 con 0x7fae3c0b88b0 2023-12-19T17:53:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3c0d1b00 con 0x7fae3c06fe80 2023-12-19T17:53:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae3c0d1de0 con 0x7fae3c06ea90 2023-12-19T17:53:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae39d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fae3c0b88b0 0x7fae3c0b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56848/0 (socket says 172.21.15.45:56848) 2023-12-19T17:53:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae39d9b700 1 -- 172.21.15.45:0/1037251680 learned_addr learned my addr 172.21.15.45:0/1037251680 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3a59c700 1 --2- 172.21.15.45:0/1037251680 >> v2:172.21.15.73:3300/0 conn(0x7fae3c06ea90 0x7fae3c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3959a700 1 -- 172.21.15.45:0/1037251680 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74689721 0 0) 0x7fae3c0d1820 con 0x7fae3c0b88b0 2023-12-19T17:53:01.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3959a700 1 -- 172.21.15.45:0/1037251680 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae280035d0 con 0x7fae3c0b88b0 2023-12-19T17:53:01.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3a59c700 1 -- 172.21.15.45:0/1037251680 >> v1:172.21.15.73:6789/0 conn(0x7fae3c06fe80 legacy=0x7fae3c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3a59c700 1 -- 172.21.15.45:0/1037251680 >> v1:172.21.15.45:6789/0 conn(0x7fae3c0b88b0 legacy=0x7fae3c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3a59c700 1 -- 172.21.15.45:0/1037251680 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c0d20c0 con 0x7fae3c06ea90 2023-12-19T17:53:01.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3a59c700 1 --2- 172.21.15.45:0/1037251680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c06ea90 0x7fae3c0d0f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009850 tx=0x7fae2c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df464f8785090ad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3959a700 1 -- 172.21.15.45:0/1037251680 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011830 con 0x7fae3c06ea90 2023-12-19T17:53:01.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3959a700 1 -- 172.21.15.45:0/1037251680 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c011990 con 0x7fae3c06ea90 2023-12-19T17:53:01.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.041+0000 7fae3959a700 1 -- 172.21.15.45:0/1037251680 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c011d00 con 0x7fae3c06ea90 2023-12-19T17:53:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 -- 172.21.15.45:0/1037251680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c06ea90 msgr2=0x7fae3c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 --2- 172.21.15.45:0/1037251680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c06ea90 0x7fae3c0d0f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009850 tx=0x7fae2c009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 -- 172.21.15.45:0/1037251680 shutdown_connections 2023-12-19T17:53:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 --2- 172.21.15.45:0/1037251680 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c06ea90 0x7fae3c0d0f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 -- 172.21.15.45:0/1037251680 >> 172.21.15.45:0/1037251680 conn(0x7fae3c0b46d0 msgr2=0x7fae3c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 -- 172.21.15.45:0/1037251680 shutdown_connections 2023-12-19T17:53:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.045+0000 7fae3b59e700 1 -- 172.21.15.45:0/1037251680 wait complete. 2023-12-19T17:53:01.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 Processor -- start 2023-12-19T17:53:01.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 -- start start 2023-12-19T17:53:01.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 0x7fae3c1564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae3c06fe80 0x7fae3c15a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c0b88b0 0x7fae3c15a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c158080 con 0x7fae3c06ea90 2023-12-19T17:53:01.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c1f3050 con 0x7fae3c0b88b0 2023-12-19T17:53:01.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3c156a10 con 0x7fae3c06fe80 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 0x7fae3c1564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 0x7fae3c1564d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43314/0 (socket says 172.21.15.45:43314) 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 -- 172.21.15.45:0/2760085558 learned_addr learned my addr 172.21.15.45:0/2760085558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae39d9b700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae3c06fe80 0x7fae3c15a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3ad9d700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c0b88b0 0x7fae3c15a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 -- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae3c06fe80 msgr2=0x7fae3c15a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae3c06fe80 0x7fae3c15a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 -- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c0b88b0 msgr2=0x7fae3c15a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c0b88b0 0x7fae3c15a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 -- 172.21.15.45:0/2760085558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c0094b0 con 0x7fae3c06ea90 2023-12-19T17:53:01.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae39d9b700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae3c06fe80 0x7fae3c15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.049+0000 7fae3a59c700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 0x7fae3c1564d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009ba0 tx=0x7fae2c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c004550 con 0x7fae3c06ea90 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c01e070 con 0x7fae3c06ea90 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c003900 con 0x7fae3c06ea90 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3c157da0 con 0x7fae3c06ea90 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3c1f3540 con 0x7fae3c06ea90 2023-12-19T17:53:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae3c067760 con 0x7fae3c06ea90 2023-12-19T17:53:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.053+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae2c003a60 con 0x7fae3c06ea90 2023-12-19T17:53:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.057+0000 7fae32ffd700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fae1c065ad0 0x7fae1c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.057+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fae2c084500 con 0x7fae3c06ea90 2023-12-19T17:53:01.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.057+0000 7fae39d9b700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fae1c065ad0 0x7fae1c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.057+0000 7fae39d9b700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fae1c065ad0 0x7fae1c067f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b1810 tx=0x7fae24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.065+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae2c051a50 con 0x7fae3c06ea90 2023-12-19T17:53:01.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.285+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae3c066a60 con 0x7fae3c06ea90 2023-12-19T17:53:01.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae32ffd700 1 -- 172.21.15.45:0/2760085558 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18204 (secure 0 0 0) 0x7fae2c055070 con 0x7fae3c06ea90 2023-12-19T17:53:01.291 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:01.291 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:52:21.528570+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:51:35.638865+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-19T17:51:36.805553+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-19T17:51:39.915006+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.f","mappings":[{"from":7,"to":2}]},{"pgid":"3.17","mappings":[{"from":0,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.25","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fae1c065ad0 msgr2=0x7fae1c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fae1c065ad0 0x7fae1c067f90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fae3c0b1810 tx=0x7fae24009040 comp rx=0 tx=0).stop 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 msgr2=0x7fae3c1564d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 0x7fae3c1564d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009ba0 tx=0x7fae2c004770 comp rx=0 tx=0).stop 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 shutdown_connections 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fae1c065ad0 0x7fae1c067f90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae3c0b88b0 0x7fae3c15a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae3c06fe80 0x7fae3c15a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 --2- 172.21.15.45:0/2760085558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae3c06ea90 0x7fae3c1564d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.289+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 >> 172.21.15.45:0/2760085558 conn(0x7fae3c0b46d0 msgr2=0x7fae3c0b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:01.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.293+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 shutdown_connections 2023-12-19T17:53:01.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.293+0000 7fae3b59e700 1 -- 172.21.15.45:0/2760085558 wait complete. 2023-12-19T17:53:01.318 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T17:53:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 Processor -- start 2023-12-19T17:53:01.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 -- start start 2023-12-19T17:53:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88dc15cd70 0x7f88dc0cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88dc1609b0 0x7f88dc160dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88dc161300 con 0x7f88dc0b1cd0 2023-12-19T17:53:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0b0c30 con 0x7f88dc15cd70 2023-12-19T17:53:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88db59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88dc0b0f10 con 0x7f88dc1609b0 2023-12-19T17:53:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88da59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88dc15cd70 0x7f88dc0cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88da59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88dc15cd70 0x7f88dc0cf410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43324/0 (socket says 172.21.15.45:43324) 2023-12-19T17:53:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88da59c700 1 -- 172.21.15.45:0/4234503231 learned_addr learned my addr 172.21.15.45:0/4234503231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88dad9d700 1 --2- 172.21.15.45:0/4234503231 >> v2:172.21.15.73:3300/0 conn(0x7f88dc1609b0 0x7f88dc160dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88da59c700 1 -- 172.21.15.45:0/4234503231 >> v2:172.21.15.73:3300/0 conn(0x7f88dc1609b0 msgr2=0x7f88dc160dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.505+0000 7f88da59c700 1 --2- 172.21.15.45:0/4234503231 >> v2:172.21.15.73:3300/0 conn(0x7f88dc1609b0 0x7f88dc160dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88da59c700 1 -- 172.21.15.45:0/4234503231 >> v1:172.21.15.73:6789/0 conn(0x7f88dc0b1cd0 legacy=0x7f88dc0b0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88da59c700 1 -- 172.21.15.45:0/4234503231 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88dc0b11f0 con 0x7f88dc15cd70 2023-12-19T17:53:01.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88dad9d700 1 --2- 172.21.15.45:0/4234503231 >> v2:172.21.15.73:3300/0 conn(0x7f88dc1609b0 0x7f88dc160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88da59c700 1 --2- 172.21.15.45:0/4234503231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc0cf410 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f88dc06e590 tx=0x7f88cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8189ecaf06011a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88d959a700 1 -- 172.21.15.45:0/4234503231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00b8a0 con 0x7f88dc15cd70 2023-12-19T17:53:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88d959a700 1 -- 172.21.15.45:0/4234503231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc00ba00 con 0x7f88dc15cd70 2023-12-19T17:53:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88d959a700 1 -- 172.21.15.45:0/4234503231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc00bd90 con 0x7f88dc15cd70 2023-12-19T17:53:01.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 -- 172.21.15.45:0/4234503231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 msgr2=0x7f88dc0cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 --2- 172.21.15.45:0/4234503231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc0cf410 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f88dc06e590 tx=0x7f88cc009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 -- 172.21.15.45:0/4234503231 shutdown_connections 2023-12-19T17:53:01.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 --2- 172.21.15.45:0/4234503231 >> v2:172.21.15.73:3300/0 conn(0x7f88dc1609b0 0x7f88dc160dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 --2- 172.21.15.45:0/4234503231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc0cf410 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 -- 172.21.15.45:0/4234503231 >> 172.21.15.45:0/4234503231 conn(0x7f88dc0b2540 msgr2=0x7f88dc0b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 -- 172.21.15.45:0/4234503231 shutdown_connections 2023-12-19T17:53:01.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.509+0000 7f88db59e700 1 -- 172.21.15.45:0/4234503231 wait complete. 2023-12-19T17:53:01.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.513+0000 7f88db59e700 1 Processor -- start 2023-12-19T17:53:01.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.513+0000 7f88db59e700 1 -- start start 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88dc0b1cd0 0x7f88dc0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc15ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88dc1609b0 0x7f88dc1f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc160440 con 0x7f88dc15cd70 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c8110 con 0x7f88dc0b1cd0 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88dc0c83f0 con 0x7f88dc1609b0 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc15ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc15ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43332/0 (socket says 172.21.15.45:43332) 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 -- 172.21.15.45:0/4094020730 learned_addr learned my addr 172.21.15.45:0/4094020730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88da59c700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88dc0b1cd0 0x7f88dc0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88dad9d700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88dc1609b0 0x7f88dc1f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 -- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88dc1609b0 msgr2=0x7f88dc1f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88dc1609b0 0x7f88dc1f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 -- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88dc0b1cd0 msgr2=0x7f88dc0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88dc0b1cd0 0x7f88dc0c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 -- 172.21.15.45:0/4094020730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc009570 con 0x7f88dc15cd70 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88d9d9b700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc15ff00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c500 tx=0x7f88d000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00052d0 con 0x7f88dc15cd70 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d0005430 con 0x7f88dc15cd70 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88dc0c86d0 con 0x7f88dc15cd70 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00055a0 con 0x7f88dc15cd70 2023-12-19T17:53:01.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.517+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88dc0c8c90 con 0x7f88dc15cd70 2023-12-19T17:53:01.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.521+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88dc067760 con 0x7f88dc15cd70 2023-12-19T17:53:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.521+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88d00036a0 con 0x7f88dc15cd70 2023-12-19T17:53:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.521+0000 7f88caffd700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88bc065ad0 0x7f88bc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.521+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f88d00827b0 con 0x7f88dc15cd70 2023-12-19T17:53:01.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.525+0000 7f88da59c700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88bc065ad0 0x7f88bc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.525+0000 7f88da59c700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88bc065ad0 0x7f88bc067f90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88cc000c00 tx=0x7f88cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.529+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88d004fcf0 con 0x7f88dc15cd70 2023-12-19T17:53:01.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.745+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f88dc15c2a0 con 0x7f88dc15cd70 2023-12-19T17:53:01.749 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:53:01.745+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:53:01.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.761+0000 7f88caffd700 1 -- 172.21.15.45:0/4094020730 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f88d0053310 con 0x7f88dc15cd70 2023-12-19T17:53:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88bc065ad0 msgr2=0x7f88bc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88bc065ad0 0x7f88bc067f90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f88cc000c00 tx=0x7f88cc008030 comp rx=0 tx=0).stop 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 msgr2=0x7f88dc15ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc15ff00 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c500 tx=0x7f88d000c810 comp rx=0 tx=0).stop 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 shutdown_connections 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88bc065ad0 0x7f88bc067f90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88dc1609b0 0x7f88dc1f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88dc15cd70 0x7f88dc15ff00 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 --2- 172.21.15.45:0/4094020730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88dc0b1cd0 0x7f88dc0c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 >> 172.21.15.45:0/4094020730 conn(0x7f88dc0b2540 msgr2=0x7f88dc070b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 shutdown_connections 2023-12-19T17:53:01.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.765+0000 7f88db59e700 1 -- 172.21.15.45:0/4094020730 wait complete. 2023-12-19T17:53:01.771 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T17:53:01.776 INFO:tasks.ceph.mds.d.smithi073.stderr: -4446> 2023-12-19T17:51:38.769+0000 7f2d0ebeb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:53:01.795 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T17:53:01.834 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:53:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 Processor -- start 2023-12-19T17:53:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 -- start start 2023-12-19T17:53:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7d4015cf20 0x7f7d400d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d400b8580 0x7f7d400cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4015d300 con 0x7f7d400d25f0 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400d1550 con 0x7f7d400b8580 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.989+0000 7f7d3f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d400d1830 con 0x7f7d4015cf20 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d400b8580 0x7f7d400cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d400b8580 0x7f7d400cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43346/0 (socket says 172.21.15.45:43346) 2023-12-19T17:53:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 -- 172.21.15.45:0/981809269 learned_addr learned my addr 172.21.15.45:0/981809269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3e59c700 1 --2- 172.21.15.45:0/981809269 >> v2:172.21.15.73:3300/0 conn(0x7f7d4015cf20 0x7f7d400d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 -- 172.21.15.45:0/981809269 >> v2:172.21.15.73:3300/0 conn(0x7f7d4015cf20 msgr2=0x7f7d400d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 --2- 172.21.15.45:0/981809269 >> v2:172.21.15.73:3300/0 conn(0x7f7d4015cf20 0x7f7d400d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 -- 172.21.15.45:0/981809269 >> v1:172.21.15.73:6789/0 conn(0x7f7d400d25f0 legacy=0x7f7d4006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 -- 172.21.15.45:0/981809269 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d400d1b10 con 0x7f7d400b8580 2023-12-19T17:53:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3dd9b700 1 --2- 172.21.15.45:0/981809269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d400b8580 0x7f7d400cd8c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d4008bc50 tx=0x7f7d34009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fa3b3de8a5e9493 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3d59a700 1 -- 172.21.15.45:0/981809269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400b8a0 con 0x7f7d400b8580 2023-12-19T17:53:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3d59a700 1 -- 172.21.15.45:0/981809269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3400ba00 con 0x7f7d400b8580 2023-12-19T17:53:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3d59a700 1 -- 172.21.15.45:0/981809269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400bd90 con 0x7f7d400b8580 2023-12-19T17:53:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3f59e700 1 -- 172.21.15.45:0/981809269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d400b8580 msgr2=0x7f7d400cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:01.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.993+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/981809269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d400b8580 0x7f7d400cd8c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7d4008bc50 tx=0x7f7d34009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 -- 172.21.15.45:0/981809269 shutdown_connections 2023-12-19T17:53:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/981809269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d400b8580 0x7f7d400cd8c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/981809269 >> v2:172.21.15.73:3300/0 conn(0x7f7d4015cf20 0x7f7d400d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 -- 172.21.15.45:0/981809269 >> 172.21.15.45:0/981809269 conn(0x7f7d400b4670 msgr2=0x7f7d400b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 -- 172.21.15.45:0/981809269 shutdown_connections 2023-12-19T17:53:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 -- 172.21.15.45:0/981809269 wait complete. 2023-12-19T17:53:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 Processor -- start 2023-12-19T17:53:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:01.997+0000 7f7d3f59e700 1 -- start start 2023-12-19T17:53:02.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d400b8580 0x7f7d4014df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d400d25f0 0x7f7d4015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 0x7f7d400aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401518c0 con 0x7f7d4015cf20 2023-12-19T17:53:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401f30b0 con 0x7f7d400b8580 2023-12-19T17:53:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d401f3390 con 0x7f7d400d25f0 2023-12-19T17:53:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 0x7f7d400aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 0x7f7d400aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43358/0 (socket says 172.21.15.45:43358) 2023-12-19T17:53:02.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 -- 172.21.15.45:0/3962658902 learned_addr learned my addr 172.21.15.45:0/3962658902 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:02.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3e59c700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d400b8580 0x7f7d4014df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:02.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3dd9b700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d400d25f0 0x7f7d4015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:02.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 -- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d400d25f0 msgr2=0x7f7d4015d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:02.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d400d25f0 0x7f7d4015d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 -- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d400b8580 msgr2=0x7f7d4014df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d400b8580 0x7f7d4014df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 -- 172.21.15.45:0/3962658902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d34009570 con 0x7f7d4015cf20 2023-12-19T17:53:02.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3ed9d700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 0x7f7d400aaf00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800cc50 tx=0x7f7d3800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:02.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d38003c20 con 0x7f7d4015cf20 2023-12-19T17:53:02.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d38003d80 con 0x7f7d4015cf20 2023-12-19T17:53:02.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d400a9680 con 0x7f7d4015cf20 2023-12-19T17:53:02.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3800ab60 con 0x7f7d4015cf20 2023-12-19T17:53:02.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.001+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d400a9c40 con 0x7f7d4015cf20 2023-12-19T17:53:02.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.005+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4004ed30 con 0x7f7d4015cf20 2023-12-19T17:53:02.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.005+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d3800acc0 con 0x7f7d4015cf20 2023-12-19T17:53:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.005+0000 7f7d2effd700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d20065b50 0x7f7d20068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.005+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f7d38083600 con 0x7f7d4015cf20 2023-12-19T17:53:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.009+0000 7f7d3e59c700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d20065b50 0x7f7d20068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.009+0000 7f7d3e59c700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d20065b50 0x7f7d20068010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009a00 tx=0x7f7d30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:02.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.013+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d38050b70 con 0x7f7d4015cf20 2023-12-19T17:53:02.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.225+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7d400b5f70 con 0x7f7d4015cf20 2023-12-19T17:53:02.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.845+0000 7f7d2effd700 1 -- 172.21.15.45:0/3962658902 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f7d38054190 con 0x7f7d4015cf20 2023-12-19T17:53:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d20065b50 msgr2=0x7f7d20068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d20065b50 0x7f7d20068010 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7d30009a00 tx=0x7f7d30008040 comp rx=0 tx=0).stop 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 msgr2=0x7f7d400aaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 0x7f7d400aaf00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7d3800cc50 tx=0x7f7d3800cf60 comp rx=0 tx=0).stop 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 shutdown_connections 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d20065b50 0x7f7d20068010 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4015cf20 0x7f7d400aaf00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d400d25f0 0x7f7d4015d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 --2- 172.21.15.45:0/3962658902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d400b8580 0x7f7d4014df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 >> 172.21.15.45:0/3962658902 conn(0x7f7d400b4670 msgr2=0x7f7d40070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 shutdown_connections 2023-12-19T17:53:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:02.849+0000 7f7d3f59e700 1 -- 172.21.15.45:0/3962658902 wait complete. 2023-12-19T17:53:02.880 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T17:53:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.065+0000 7f0872b60700 1 Processor -- start 2023-12-19T17:53:03.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f0872b60700 1 -- start start 2023-12-19T17:53:03.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f0872b60700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c15cf40 0x7f086c0b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:03.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f0872b60700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f086c161340 0x7f086c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:03.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f0872b60700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f086c06fe80 con 0x7f086c15d320 2023-12-19T17:53:03.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f0872b60700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f086c070440 con 0x7f086c161340 2023-12-19T17:53:03.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f0872b60700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c070160 con 0x7f086c15cf40 2023-12-19T17:53:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f086bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f086c15d320 0x7f086c160c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56858/0 (socket says 172.21.15.45:56858) 2023-12-19T17:53:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f086bfff700 1 -- 172.21.15.45:0/3741439828 learned_addr learned my addr 172.21.15.45:0/3741439828 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.069+0000 7f08710fd700 1 --2- 172.21.15.45:0/3741439828 >> v2:172.21.15.45:3300/0 conn(0x7f086c161340 0x7f086c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f08708fc700 1 --2- 172.21.15.45:0/3741439828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c15cf40 0x7f086c0b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f086b7fe700 1 -- 172.21.15.45:0/3741439828 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2403875660 0 0) 0x7f086c06fe80 con 0x7f086c15d320 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f086b7fe700 1 -- 172.21.15.45:0/3741439828 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f085c0035d0 con 0x7f086c15d320 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f08710fd700 1 -- 172.21.15.45:0/3741439828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c15cf40 msgr2=0x7f086c0b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f08710fd700 1 --2- 172.21.15.45:0/3741439828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c15cf40 0x7f086c0b8770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f08710fd700 1 -- 172.21.15.45:0/3741439828 >> v1:172.21.15.45:6789/0 conn(0x7f086c15d320 legacy=0x7f086c160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f08710fd700 1 -- 172.21.15.45:0/3741439828 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f086c0d1030 con 0x7f086c161340 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f08710fd700 1 --2- 172.21.15.45:0/3741439828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c161340 0x7f086c0d1830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0864009d90 tx=0x7f086400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313b68562190e0a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f086b7fe700 1 -- 172.21.15.45:0/3741439828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086400e070 con 0x7f086c161340 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f086b7fe700 1 -- 172.21.15.45:0/3741439828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086400bb20 con 0x7f086c161340 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f086b7fe700 1 -- 172.21.15.45:0/3741439828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0864012430 con 0x7f086c161340 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 -- 172.21.15.45:0/3741439828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c161340 msgr2=0x7f086c0d1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 --2- 172.21.15.45:0/3741439828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c161340 0x7f086c0d1830 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0864009d90 tx=0x7f086400b330 comp rx=0 tx=0).stop 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 -- 172.21.15.45:0/3741439828 shutdown_connections 2023-12-19T17:53:03.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 --2- 172.21.15.45:0/3741439828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c161340 0x7f086c0d1830 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 --2- 172.21.15.45:0/3741439828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c15cf40 0x7f086c0b8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 -- 172.21.15.45:0/3741439828 >> 172.21.15.45:0/3741439828 conn(0x7f086c0d2e50 msgr2=0x7f086c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 -- 172.21.15.45:0/3741439828 shutdown_connections 2023-12-19T17:53:03.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.073+0000 7f0872b60700 1 -- 172.21.15.45:0/3741439828 wait complete. 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 Processor -- start 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 -- start start 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 0x7f086c14e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086c15d320 0x7f086c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c161340 0x7f086c0ca830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0ccff0 con 0x7f086c15cf40 2023-12-19T17:53:03.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0cd2d0 con 0x7f086c15d320 2023-12-19T17:53:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f0872b60700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f086c0cd5b0 con 0x7f086c161340 2023-12-19T17:53:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 0x7f086c14e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 0x7f086c14e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43388/0 (socket says 172.21.15.45:43388) 2023-12-19T17:53:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 -- 172.21.15.45:0/3622479385 learned_addr learned my addr 172.21.15.45:0/3622479385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08710fd700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c161340 0x7f086c0ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:03.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f086bfff700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086c15d320 0x7f086c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 -- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c161340 msgr2=0x7f086c0ca830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c161340 0x7f086c0ca830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 -- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086c15d320 msgr2=0x7f086c0cc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086c15d320 0x7f086c0cc730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.077+0000 7f08708fc700 1 -- 172.21.15.45:0/3622479385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0864009a70 con 0x7f086c15cf40 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f08708fc700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 0x7f086c14e760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f086000e9d0 tx=0x7f086000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0860009720 con 0x7f086c15cf40 2023-12-19T17:53:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f086000ee70 con 0x7f086c15cf40 2023-12-19T17:53:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f086000ca50 con 0x7f086c15cf40 2023-12-19T17:53:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f086c0cd890 con 0x7f086c15cf40 2023-12-19T17:53:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f086c14eca0 con 0x7f086c15cf40 2023-12-19T17:53:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.081+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f086c04ed30 con 0x7f086c15cf40 2023-12-19T17:53:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.085+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f086000cbb0 con 0x7f086c15cf40 2023-12-19T17:53:03.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.085+0000 7f08697fa700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0850065ad0 0x7f0850067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.085+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f0860083630 con 0x7f086c15cf40 2023-12-19T17:53:03.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.085+0000 7f086bfff700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0850065ad0 0x7f0850067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:03.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.085+0000 7f086bfff700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0850065ad0 0x7f0850067f90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f086c1607c0 tx=0x7f0858007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:03.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.089+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0860050b20 con 0x7f086c15cf40 2023-12-19T17:53:03.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.269+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f086c0d0a40 con 0x7f086c15cf40 2023-12-19T17:53:03.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.865+0000 7f08697fa700 1 -- 172.21.15.45:0/3622479385 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7f086000ce60 con 0x7f086c15cf40 2023-12-19T17:53:03.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0850065ad0 msgr2=0x7f0850067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0850065ad0 0x7f0850067f90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f086c1607c0 tx=0x7f0858007de0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 msgr2=0x7f086c14e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 0x7f086c14e760 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f086000e9d0 tx=0x7f086000ece0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 shutdown_connections 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0850065ad0 0x7f0850067f90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f086c161340 0x7f086c0ca830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f086c15d320 0x7f086c0cc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 --2- 172.21.15.45:0/3622479385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f086c15cf40 0x7f086c14e760 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 >> 172.21.15.45:0/3622479385 conn(0x7f086c0d2e50 msgr2=0x7f086c15c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 shutdown_connections 2023-12-19T17:53:03.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:03.873+0000 7f0872b60700 1 -- 172.21.15.45:0/3622479385 wait complete. 2023-12-19T17:53:03.881 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-19T17:53:03.906 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T17:53:04.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.085+0000 7f35aeb05700 1 Processor -- start 2023-12-19T17:53:04.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.085+0000 7f35aeb05700 1 -- start start 2023-12-19T17:53:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35aeb05700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 0x7f35a80b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35aeb05700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a8071160 0x7f35a80d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35aeb05700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80d15b0 con 0x7f35a815d090 2023-12-19T17:53:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35aeb05700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a80d2b90 con 0x7f35a815ccb0 2023-12-19T17:53:04.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35aeb05700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80d1890 con 0x7f35a8071160 2023-12-19T17:53:04.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35adb03700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 0x7f35a80b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:04.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35adb03700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 0x7f35a80b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40422/0 (socket says 172.21.15.45:40422) 2023-12-19T17:53:04.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35adb03700 1 -- 172.21.15.45:0/642101698 learned_addr learned my addr 172.21.15.45:0/642101698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35ae304700 1 --2- 172.21.15.45:0/642101698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a8071160 0x7f35a80d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35ae304700 1 -- 172.21.15.45:0/642101698 >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 msgr2=0x7f35a80b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35ae304700 1 --2- 172.21.15.45:0/642101698 >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 0x7f35a80b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35ae304700 1 -- 172.21.15.45:0/642101698 >> v1:172.21.15.73:6789/0 conn(0x7f35a815d090 legacy=0x7f35a8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35ae304700 1 -- 172.21.15.45:0/642101698 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a80d1b70 con 0x7f35a8071160 2023-12-19T17:53:04.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.089+0000 7f35adb03700 1 --2- 172.21.15.45:0/642101698 >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 0x7f35a80b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:04.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35ae304700 1 --2- 172.21.15.45:0/642101698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a8071160 0x7f35a80d2650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009d90 tx=0x7f35a000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e5531fadd354aea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:04.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35acb01700 1 -- 172.21.15.45:0/642101698 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a000e070 con 0x7f35a8071160 2023-12-19T17:53:04.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35acb01700 1 -- 172.21.15.45:0/642101698 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a000bb20 con 0x7f35a8071160 2023-12-19T17:53:04.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35acb01700 1 -- 172.21.15.45:0/642101698 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0012430 con 0x7f35a8071160 2023-12-19T17:53:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 -- 172.21.15.45:0/642101698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a8071160 msgr2=0x7f35a80d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 --2- 172.21.15.45:0/642101698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a8071160 0x7f35a80d2650 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35a0009d90 tx=0x7f35a000b330 comp rx=0 tx=0).stop 2023-12-19T17:53:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 -- 172.21.15.45:0/642101698 shutdown_connections 2023-12-19T17:53:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 --2- 172.21.15.45:0/642101698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a8071160 0x7f35a80d2650 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 --2- 172.21.15.45:0/642101698 >> v2:172.21.15.73:3300/0 conn(0x7f35a815ccb0 0x7f35a80b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 -- 172.21.15.45:0/642101698 >> 172.21.15.45:0/642101698 conn(0x7f35a80d2f50 msgr2=0x7f35a80d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 -- 172.21.15.45:0/642101698 shutdown_connections 2023-12-19T17:53:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.093+0000 7f35aeb05700 1 -- 172.21.15.45:0/642101698 wait complete. 2023-12-19T17:53:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 Processor -- start 2023-12-19T17:53:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 -- start start 2023-12-19T17:53:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 0x7f35a8153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a815ccb0 0x7f35a80c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35a815d090 0x7f35a80c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8154f60 con 0x7f35a8071160 2023-12-19T17:53:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81542e0 con 0x7f35a815d090 2023-12-19T17:53:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.097+0000 7f35aeb05700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a81545c0 con 0x7f35a815ccb0 2023-12-19T17:53:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 0x7f35a8153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 0x7f35a8153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43392/0 (socket says 172.21.15.45:43392) 2023-12-19T17:53:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 -- 172.21.15.45:0/935420460 learned_addr learned my addr 172.21.15.45:0/935420460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35ad302700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a815ccb0 0x7f35a80c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35ae304700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35a815d090 0x7f35a80c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 -- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a815ccb0 msgr2=0x7f35a80c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a815ccb0 0x7f35a80c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 -- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35a815d090 msgr2=0x7f35a80c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35a815d090 0x7f35a80c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 -- 172.21.15.45:0/935420460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009570 con 0x7f35a8071160 2023-12-19T17:53:04.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35adb03700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 0x7f35a8153800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f35a400ebe0 tx=0x7f35a400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400c850 con 0x7f35a8071160 2023-12-19T17:53:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400c9b0 con 0x7f35a8071160 2023-12-19T17:53:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a0009a70 con 0x7f35a8071160 2023-12-19T17:53:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400cd20 con 0x7f35a8071160 2023-12-19T17:53:04.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a8154b80 con 0x7f35a8071160 2023-12-19T17:53:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.101+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a8067c10 con 0x7f35a8071160 2023-12-19T17:53:04.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.105+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35a4013470 con 0x7f35a8071160 2023-12-19T17:53:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.105+0000 7f359e7fc700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f358c065b00 0x7f358c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.109+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f35a4083160 con 0x7f35a8071160 2023-12-19T17:53:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.109+0000 7f35ad302700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f358c065b00 0x7f358c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.109+0000 7f35ad302700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f358c065b00 0x7f358c067fc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35a80cbf50 tx=0x7f3598009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.113+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f35a4050890 con 0x7f35a8071160 2023-12-19T17:53:04.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.293+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f35a804ed30 con 0x7f35a8071160 2023-12-19T17:53:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.877+0000 7f359e7fc700 1 -- 172.21.15.45:0/935420460 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f35a4053eb0 con 0x7f35a8071160 2023-12-19T17:53:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.885+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f358c065b00 msgr2=0x7f358c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.885+0000 7f35aeb05700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f358c065b00 0x7f358c067fc0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35a80cbf50 tx=0x7f3598009040 comp rx=0 tx=0).stop 2023-12-19T17:53:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.885+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 msgr2=0x7f35a8153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.885+0000 7f35aeb05700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 0x7f35a8153800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f35a400ebe0 tx=0x7f35a400eef0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 shutdown_connections 2023-12-19T17:53:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f358c065b00 0x7f358c067fc0 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f35a80cbf50 tx=0x7f3598009040 comp rx=0 tx=0).stop 2023-12-19T17:53:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35a815d090 0x7f35a80c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35a815ccb0 0x7f35a80c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 --2- 172.21.15.45:0/935420460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35a8071160 0x7f35a8153800 secure :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f35a400ebe0 tx=0x7f35a400eef0 comp rx=0 tx=0).stop 2023-12-19T17:53:04.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 >> 172.21.15.45:0/935420460 conn(0x7f35a80d2f50 msgr2=0x7f35a8159a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 shutdown_connections 2023-12-19T17:53:04.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:04.889+0000 7f35aeb05700 1 -- 172.21.15.45:0/935420460 wait complete. 2023-12-19T17:53:04.896 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-19T17:53:04.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-19T17:53:05.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.101+0000 7f5483fff700 1 Processor -- start 2023-12-19T17:53:05.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.101+0000 7f5483fff700 1 -- start start 2023-12-19T17:53:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5483fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5484143750 0x7f548406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5483fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54840b0af0 0x7f548406f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5483fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54840b1430 con 0x7f5484143b30 2023-12-19T17:53:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5483fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54840b0f50 con 0x7f54840b0af0 2023-12-19T17:53:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5483fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840c38d0 con 0x7f5484143750 2023-12-19T17:53:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54840b0af0 0x7f548406f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5482ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5484143750 0x7f548406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f54840b0af0 0x7f548406f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40442/0 (socket says 172.21.15.45:40442) 2023-12-19T17:53:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 -- 172.21.15.45:0/390099461 learned_addr learned my addr 172.21.15.45:0/390099461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 -- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5484143750 msgr2=0x7f548406eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 --2- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5484143750 0x7f548406eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 -- 172.21.15.45:0/390099461 >> v1:172.21.15.73:6789/0 conn(0x7f5484143b30 legacy=0x7f54840b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f54837fe700 1 -- 172.21.15.45:0/390099461 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54840b1150 con 0x7f54840b0af0 2023-12-19T17:53:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.105+0000 7f5482ffd700 1 --2- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5484143750 0x7f548406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:05.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f54837fe700 1 --2- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54840b0af0 0x7f548406f3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f547c009e50 tx=0x7f547c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2825863c4e8a2dd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5481ffb700 1 -- 172.21.15.45:0/390099461 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00e070 con 0x7f54840b0af0 2023-12-19T17:53:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5481ffb700 1 -- 172.21.15.45:0/390099461 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547c00b910 con 0x7f54840b0af0 2023-12-19T17:53:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5481ffb700 1 -- 172.21.15.45:0/390099461 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547c00bcc0 con 0x7f54840b0af0 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 -- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54840b0af0 msgr2=0x7f548406f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 --2- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54840b0af0 0x7f548406f3f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f547c009e50 tx=0x7f547c00b330 comp rx=0 tx=0).stop 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 -- 172.21.15.45:0/390099461 shutdown_connections 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 --2- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54840b0af0 0x7f548406f3f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 --2- 172.21.15.45:0/390099461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5484143750 0x7f548406eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 -- 172.21.15.45:0/390099461 >> 172.21.15.45:0/390099461 conn(0x7f54840cecd0 msgr2=0x7f54840cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 -- 172.21.15.45:0/390099461 shutdown_connections 2023-12-19T17:53:05.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.109+0000 7f5483fff700 1 -- 172.21.15.45:0/390099461 wait complete. 2023-12-19T17:53:05.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 Processor -- start 2023-12-19T17:53:05.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 -- start start 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54840b0af0 0x7f548413d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 0x7f548406d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f548406db90 0x7f54840c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840cdae0 con 0x7f5484143750 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54840cced0 con 0x7f548406db90 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5483fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54840cd1b0 con 0x7f54840b0af0 2023-12-19T17:53:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 0x7f548406d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:05.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 0x7f548406d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43396/0 (socket says 172.21.15.45:43396) 2023-12-19T17:53:05.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 -- 172.21.15.45:0/3018939292 learned_addr learned my addr 172.21.15.45:0/3018939292 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:05.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f5482ffd700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54840b0af0 0x7f548413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:05.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54837fe700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f548406db90 0x7f54840c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 -- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54840b0af0 msgr2=0x7f548413d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54840b0af0 0x7f548413d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 -- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f548406db90 msgr2=0x7f54840c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f548406db90 0x7f54840c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 -- 172.21.15.45:0/3018939292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54740094b0 con 0x7f5484143750 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.113+0000 7f54827fc700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 0x7f548406d650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f547800c500 tx=0x7f547800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780052d0 con 0x7f5484143750 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5478005430 con 0x7f5484143750 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c009b30 con 0x7f5484143750 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54780055a0 con 0x7f5484143750 2023-12-19T17:53:05.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54840cd770 con 0x7f5484143750 2023-12-19T17:53:05.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f548404ed30 con 0x7f5484143750 2023-12-19T17:53:05.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.117+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54780038e0 con 0x7f5484143750 2023-12-19T17:53:05.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.121+0000 7f546bfff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5470065ad0 0x7f5470067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:05.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.121+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f5478082530 con 0x7f5484143750 2023-12-19T17:53:05.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.121+0000 7f5482ffd700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5470065ad0 0x7f5470067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:05.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.121+0000 7f5482ffd700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5470065ad0 0x7f5470067f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54840af9a0 tx=0x7f5474009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:05.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.125+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f547804fe00 con 0x7f5484143750 2023-12-19T17:53:05.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.305+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f54840cf230 con 0x7f5484143750 2023-12-19T17:53:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.889+0000 7f546bfff700 1 -- 172.21.15.45:0/3018939292 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7f5478053420 con 0x7f5484143750 2023-12-19T17:53:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5470065ad0 msgr2=0x7f5470067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5470065ad0 0x7f5470067f90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f54840af9a0 tx=0x7f5474009240 comp rx=0 tx=0).stop 2023-12-19T17:53:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 msgr2=0x7f548406d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 0x7f548406d650 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f547800c500 tx=0x7f547800c810 comp rx=0 tx=0).stop 2023-12-19T17:53:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 shutdown_connections 2023-12-19T17:53:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5470065ad0 0x7f5470067f90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f548406db90 0x7f54840c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5484143750 0x7f548406d650 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 --2- 172.21.15.45:0/3018939292 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54840b0af0 0x7f548413d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 >> 172.21.15.45:0/3018939292 conn(0x7f54840cecd0 msgr2=0x7f54840c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 shutdown_connections 2023-12-19T17:53:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:05.893+0000 7f5483fff700 1 -- 172.21.15.45:0/3018939292 wait complete. 2023-12-19T17:53:05.904 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_ec' removed 2023-12-19T17:53:05.933 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T17:53:05.934 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T17:53:05.934 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T17:53:05.934 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:53:05.934 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T17:53:05.934 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T17:53:05.934 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T17:53:05.935 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:53:05.935 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T17:53:05.935 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T17:53:05.935 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T17:53:05.935 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:53:05.935 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T17:53:05.935 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T17:53:05.935 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T17:53:05.936 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:53:05.955 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T17:53:05.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T17:53:05.956 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T17:53:05.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T17:53:05.962 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T17:53:05.962 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T17:53:05.965 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T17:53:05.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T17:53:06.010 INFO:tasks.ceph.mds.c:Started 2023-12-19T17:53:06.010 DEBUG:teuthology.parallel:result is None 2023-12-19T17:53:06.014 INFO:tasks.ceph.mds.a:Started 2023-12-19T17:53:06.015 DEBUG:teuthology.parallel:result is None 2023-12-19T17:53:06.018 INFO:tasks.ceph.mds.d:Started 2023-12-19T17:53:06.018 DEBUG:teuthology.parallel:result is None 2023-12-19T17:53:06.024 INFO:tasks.ceph.mds.b:Started 2023-12-19T17:53:06.024 DEBUG:teuthology.parallel:result is None 2023-12-19T17:53:06.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T17:53:06.125 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:53:06.126 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:53:06.128 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T17:53:06.125+0000 7fed7e9a8700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-12-19T17:53:06.139 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T17:53:06.141 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:53:06.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-19T17:53:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2734c20700 1 Processor -- start 2023-12-19T17:53:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2734c20700 1 -- start start 2023-12-19T17:53:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2734c20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f27300afe30 0x7f273015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2734c20700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273006f0a0 con 0x7f273006cad0 2023-12-19T17:53:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2734c20700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f273006ea90 con 0x7f273015ae20 2023-12-19T17:53:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2734c20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27300c3f60 con 0x7f27300afe30 2023-12-19T17:53:06.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2727fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f273006cad0 0x7f27300af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56886/0 (socket says 172.21.15.45:56886) 2023-12-19T17:53:06.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f2727fff700 1 -- 172.21.15.45:0/612022068 learned_addr learned my addr 172.21.15.45:0/612022068 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:06.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.209+0000 7f272ffff700 1 --2- 172.21.15.45:0/612022068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f27300afe30 0x7f273015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195445202 0 0) 0x7f273006ea90 con 0x7f273015ae20 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c0035d0 con 0x7f273015ae20 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796550412 0 0) 0x7f273006f0a0 con 0x7f273006cad0 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273006ea90 con 0x7f273006cad0 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272ffff700 1 -- 172.21.15.45:0/612022068 >> v1:172.21.15.73:6789/0 conn(0x7f273015ae20 legacy=0x7f27300c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272ffff700 1 -- 172.21.15.45:0/612022068 >> v1:172.21.15.45:6789/0 conn(0x7f273006cad0 legacy=0x7f27300af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272ffff700 1 -- 172.21.15.45:0/612022068 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27300c4240 con 0x7f27300afe30 2023-12-19T17:53:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272ffff700 1 --2- 172.21.15.45:0/612022068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f27300afe30 0x7f273015be40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2728009dc0 tx=0x7f272800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d9f8d3c35662f9f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:06.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800e070 con 0x7f27300afe30 2023-12-19T17:53:06.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272800bb20 con 0x7f27300afe30 2023-12-19T17:53:06.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f272effd700 1 -- 172.21.15.45:0/612022068 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800be90 con 0x7f27300afe30 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 -- 172.21.15.45:0/612022068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f27300afe30 msgr2=0x7f273015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 --2- 172.21.15.45:0/612022068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f27300afe30 0x7f273015be40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2728009dc0 tx=0x7f272800b330 comp rx=0 tx=0).stop 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 -- 172.21.15.45:0/612022068 shutdown_connections 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 --2- 172.21.15.45:0/612022068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f27300afe30 0x7f273015be40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 -- 172.21.15.45:0/612022068 >> 172.21.15.45:0/612022068 conn(0x7f27300cb900 msgr2=0x7f27300b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 -- 172.21.15.45:0/612022068 shutdown_connections 2023-12-19T17:53:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.213+0000 7f2734c20700 1 -- 172.21.15.45:0/612022068 wait complete. 2023-12-19T17:53:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 Processor -- start 2023-12-19T17:53:06.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 -- start start 2023-12-19T17:53:06.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 0x7f273014f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300afe30 0x7f27301501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015ae20 0x7f2730151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2730153090 con 0x7f273006cad0 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273014fc60 con 0x7f27300afe30 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2734c20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27301506f0 con 0x7f273015ae20 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f272f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 0x7f273014f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f272f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 0x7f273014f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43424/0 (socket says 172.21.15.45:43424) 2023-12-19T17:53:06.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f272f7fe700 1 -- 172.21.15.45:0/1025785699 learned_addr learned my addr 172.21.15.45:0/1025785699 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f2727fff700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300afe30 0x7f27301501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f272ffff700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015ae20 0x7f2730151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:06.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.217+0000 7f272f7fe700 1 -- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015ae20 msgr2=0x7f2730151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272f7fe700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015ae20 0x7f2730151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272f7fe700 1 -- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300afe30 msgr2=0x7f27301501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272f7fe700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300afe30 0x7f27301501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272f7fe700 1 -- 172.21.15.45:0/1025785699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728009a70 con 0x7f273006cad0 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272f7fe700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 0x7f273014f720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f27200010e0 tx=0x7f272000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200052d0 con 0x7f273006cad0 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2720005430 con 0x7f273006cad0 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27200055a0 con 0x7f273006cad0 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27301532c0 con 0x7f273006cad0 2023-12-19T17:53:06.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2730153880 con 0x7f273006cad0 2023-12-19T17:53:06.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.221+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2730067760 con 0x7f273006cad0 2023-12-19T17:53:06.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.225+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f27200038e0 con 0x7f273006cad0 2023-12-19T17:53:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.225+0000 7f272cff9700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2710065ad0 0x7f2710067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.225+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2720082540 con 0x7f273006cad0 2023-12-19T17:53:06.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.225+0000 7f2727fff700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2710065ad0 0x7f2710067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:06.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.225+0000 7f2727fff700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2710065ad0 0x7f2710067f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f27300afe00 tx=0x7f2718009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:06.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.233+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2720050020 con 0x7f273006cad0 2023-12-19T17:53:06.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:06.429+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2730154e40 con 0x7f273006cad0 2023-12-19T17:53:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.181+0000 7f272cff9700 1 -- 172.21.15.45:0/1025785699 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2720053640 con 0x7f273006cad0 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2710065ad0 msgr2=0x7f2710067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2710065ad0 0x7f2710067f90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f27300afe00 tx=0x7f2718009040 comp rx=0 tx=0).stop 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 msgr2=0x7f273014f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 0x7f273014f720 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f27200010e0 tx=0x7f272000c860 comp rx=0 tx=0).stop 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 shutdown_connections 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2710065ad0 0x7f2710067f90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f273015ae20 0x7f2730151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f27300afe30 0x7f27301501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 --2- 172.21.15.45:0/1025785699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f273006cad0 0x7f273014f720 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 >> 172.21.15.45:0/1025785699 conn(0x7f27300cb900 msgr2=0x7f27300c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 shutdown_connections 2023-12-19T17:53:07.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.185+0000 7f2734c20700 1 -- 172.21.15.45:0/1025785699 wait complete. 2023-12-19T17:53:07.190 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-19T17:53:07.210 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T17:53:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.393+0000 7f3c6ef58700 1 Processor -- start 2023-12-19T17:53:07.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.393+0000 7f3c6ef58700 1 -- start start 2023-12-19T17:53:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6ef58700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806ea90 0x7f3c680d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6ef58700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c680d1820 con 0x7f3c6806fe80 2023-12-19T17:53:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6ef58700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c680d1b00 con 0x7f3c680b88b0 2023-12-19T17:53:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6ef58700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680d1de0 con 0x7f3c6806ea90 2023-12-19T17:53:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6e757700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3c6806fe80 0x7f3c680b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56898/0 (socket says 172.21.15.45:56898) 2023-12-19T17:53:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6e757700 1 -- 172.21.15.45:0/2692684145 learned_addr learned my addr 172.21.15.45:0/2692684145 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6df56700 1 --2- 172.21.15.45:0/2692684145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806ea90 0x7f3c680d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032233780 0 0) 0x7f3c680d1820 con 0x7f3c6806fe80 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c540035d0 con 0x7f3c6806fe80 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3995537659 0 0) 0x7f3c680d1b00 con 0x7f3c680b88b0 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c680d1820 con 0x7f3c680b88b0 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6df56700 1 -- 172.21.15.45:0/2692684145 >> v1:172.21.15.73:6789/0 conn(0x7f3c680b88b0 legacy=0x7f3c680b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6df56700 1 -- 172.21.15.45:0/2692684145 >> v1:172.21.15.45:6789/0 conn(0x7f3c6806fe80 legacy=0x7f3c680b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6df56700 1 -- 172.21.15.45:0/2692684145 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c680d20c0 con 0x7f3c6806ea90 2023-12-19T17:53:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6df56700 1 --2- 172.21.15.45:0/2692684145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806ea90 0x7f3c680d0f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009880 tx=0x7f3c64009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23f54cd1eb38113d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64011830 con 0x7f3c6806ea90 2023-12-19T17:53:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c64011990 con 0x7f3c6806ea90 2023-12-19T17:53:07.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.397+0000 7f3c6cf54700 1 -- 172.21.15.45:0/2692684145 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64011d00 con 0x7f3c6806ea90 2023-12-19T17:53:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 -- 172.21.15.45:0/2692684145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806ea90 msgr2=0x7f3c680d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/2692684145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806ea90 0x7f3c680d0f20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009880 tx=0x7f3c64009b90 comp rx=0 tx=0).stop 2023-12-19T17:53:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 -- 172.21.15.45:0/2692684145 shutdown_connections 2023-12-19T17:53:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/2692684145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806ea90 0x7f3c680d0f20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 -- 172.21.15.45:0/2692684145 >> 172.21.15.45:0/2692684145 conn(0x7f3c680b46d0 msgr2=0x7f3c680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 -- 172.21.15.45:0/2692684145 shutdown_connections 2023-12-19T17:53:07.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 -- 172.21.15.45:0/2692684145 wait complete. 2023-12-19T17:53:07.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.401+0000 7f3c6ef58700 1 Processor -- start 2023-12-19T17:53:07.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 -- start start 2023-12-19T17:53:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 0x7f3c680cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806fe80 0x7f3c680cc3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c680b88b0 0x7f3c68157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c681597d0 con 0x7f3c6806ea90 2023-12-19T17:53:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680cba20 con 0x7f3c680b88b0 2023-12-19T17:53:07.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6815b380 con 0x7f3c6806fe80 2023-12-19T17:53:07.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 0x7f3c680cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 0x7f3c680cbeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43440/0 (socket says 172.21.15.45:43440) 2023-12-19T17:53:07.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 -- 172.21.15.45:0/3571147881 learned_addr learned my addr 172.21.15.45:0/3571147881 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:07.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6d755700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806fe80 0x7f3c680cc3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6e757700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c680b88b0 0x7f3c68157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 -- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806fe80 msgr2=0x7f3c680cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806fe80 0x7f3c680cc3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 -- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c680b88b0 msgr2=0x7f3c68157600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c680b88b0 0x7f3c68157600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 -- 172.21.15.45:0/3571147881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640094b0 con 0x7f3c6806ea90 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6d755700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806fe80 0x7f3c680cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6df56700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 0x7f3c680cbeb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c640090b0 tx=0x7f3c64004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64004610 con 0x7f3c6806ea90 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c640036c0 con 0x7f3c6806ea90 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c680cb6d0 con 0x7f3c6806ea90 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.405+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64003a70 con 0x7f3c6806ea90 2023-12-19T17:53:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.409+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c68159ce0 con 0x7f3c6806ea90 2023-12-19T17:53:07.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.409+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c68071ae0 con 0x7f3c6806ea90 2023-12-19T17:53:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.409+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c64003bd0 con 0x7f3c6806ea90 2023-12-19T17:53:07.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.413+0000 7f3c5e7fc700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c4c065ad0 0x7f3c4c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.413+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3c640844a0 con 0x7f3c6806ea90 2023-12-19T17:53:07.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.413+0000 7f3c6d755700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c4c065ad0 0x7f3c4c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.417+0000 7f3c6d755700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c4c065ad0 0x7f3c4c067f90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c680c9a20 tx=0x7f3c58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:07.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.421+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c64052060 con 0x7f3c6806ea90 2023-12-19T17:53:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.657+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f3c68067760 con 0x7f3c6806ea90 2023-12-19T17:53:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.657+0000 7f3c5e7fc700 1 -- 172.21.15.45:0/3571147881 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v7) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3c64055680 con 0x7f3c6806ea90 2023-12-19T17:53:07.660 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:07.660 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:53:07.660 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-19T17:53:07.660 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.660 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A==", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg==", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.661 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA==", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.662 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ==", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg==", 2023-12-19T17:53:07.663 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA==", 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.664 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w==", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ==", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.665 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg==", 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-19T17:53:07.666 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA==", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w==", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.667 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA==", 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA==", 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.668 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A==", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.669 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ==", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ==", 2023-12-19T17:53:07.670 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl3IfBDBAAsKhx3aytTBDBVKorcbcCHw==", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.671 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mds", 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAR2IFlc0WwHxAAfQbvTNcXAdaJ2Ukj4uDCRA==", 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mds" 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-mgr", 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAR2IFlw1mwHxAA8MW/6Ekj2K5ZfxMEjqkrvQ==", 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-19T17:53:07.672 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-osd", 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAR2IFlh2SwHxAAbYeeK+QzeuRmtlDbt8Agog==", 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-osd" 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd", 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAR2IFlMm+wHxAAP7HptdiZZSnNb/nAKwChIQ==", 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.673 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAR2IFlLnqwHxAAqPFwQWcziv6aWdwIqQqtMA==", 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.bootstrap-rgw", 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAR2IFlhoWwHxAASErdLHwXYCpyqE2gf6uCEQ==", 2023-12-19T17:53:07.674 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA==", 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:07.675 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q==", 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-19T17:53:07.676 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:53:07.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c4c065ad0 msgr2=0x7f3c4c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c4c065ad0 0x7f3c4c067f90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3c680c9a20 tx=0x7f3c58009040 comp rx=0 tx=0).stop 2023-12-19T17:53:07.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 msgr2=0x7f3c680cbeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 0x7f3c680cbeb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3c640090b0 tx=0x7f3c64004770 comp rx=0 tx=0).stop 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 shutdown_connections 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c4c065ad0 0x7f3c4c067f90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c680b88b0 0x7f3c68157600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c6806fe80 0x7f3c680cc3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 --2- 172.21.15.45:0/3571147881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c6806ea90 0x7f3c680cbeb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 >> 172.21.15.45:0/3571147881 conn(0x7f3c680b46d0 msgr2=0x7f3c68070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 shutdown_connections 2023-12-19T17:53:07.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.661+0000 7f3c6ef58700 1 -- 172.21.15.45:0/3571147881 wait complete. 2023-12-19T17:53:07.684 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-19T17:53:07.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.865+0000 7f6972ec0700 1 Processor -- start 2023-12-19T17:53:07.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.865+0000 7f6972ec0700 1 -- start start 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6972ec0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 0x7f696c070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6972ec0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f696c070a80 0x7f696c06d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6972ec0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c15dc90 con 0x7f696c0ccc40 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6972ec0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c1597e0 con 0x7f696c070a80 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6972ec0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15d080 con 0x7f696c0c96c0 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6971ebe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f696c0ccc40 0x7f696c0cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56912/0 (socket says 172.21.15.45:56912) 2023-12-19T17:53:07.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6971ebe700 1 -- 172.21.15.45:0/692098984 learned_addr learned my addr 172.21.15.45:0/692098984 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:07.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f69726bf700 1 --2- 172.21.15.45:0/692098984 >> v2:172.21.15.73:3300/0 conn(0x7f696c070a80 0x7f696c06d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f69716bd700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 0x7f696c070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 253837858 0 0) 0x7f696c15dc90 con 0x7f696c0ccc40 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69580035d0 con 0x7f696c0ccc40 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3068658277 0 0) 0x7f69580035d0 con 0x7f696c0ccc40 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 msgr2=0x7f696c070540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 0x7f696c070540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 >> v2:172.21.15.73:3300/0 conn(0x7f696c070a80 msgr2=0x7f696c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 --2- 172.21.15.45:0/692098984 >> v2:172.21.15.73:3300/0 conn(0x7f696c070a80 0x7f696c06d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c15d360 con 0x7f696c0ccc40 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f6968001670 con 0x7f696c0ccc40 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 >> v1:172.21.15.45:6789/0 conn(0x7f696c0ccc40 legacy=0x7f696c0cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 0x7f6958003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f6958004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6958004db0 0x7f6958005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1597e0 con 0x7f6958003ff0 2023-12-19T17:53:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c15d080 con 0x7f6958004db0 2023-12-19T17:53:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695800dc40 con 0x7f696c0c96c0 2023-12-19T17:53:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f69716bd700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f6958004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.869+0000 7f6971ebe700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 0x7f6958003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69726bf700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6958004db0 0x7f6958005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69716bd700 1 -- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 msgr2=0x7f6958003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69716bd700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c0c96c0 0x7f6958003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69716bd700 1 -- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6958004db0 msgr2=0x7f6958005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69716bd700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6958004db0 0x7f6958005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69716bd700 1 -- 172.21.15.45:0/692098984 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69580035d0 con 0x7f6958003ff0 2023-12-19T17:53:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69716bd700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f6958004870 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f695c009b70 tx=0x7f69580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f849f6131e50ab4f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00e6c0 con 0x7f6958003ff0 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00e820 con 0x7f6958003ff0 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6970ebc700 1 -- 172.21.15.45:0/692098984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00eb90 con 0x7f6958003ff0 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6972ec0700 1 -- 172.21.15.45:0/692098984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 msgr2=0x7f6958004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6972ec0700 1 --2- 172.21.15.45:0/692098984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f6958004870 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f695c009b70 tx=0x7f69580058a0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f69726bf700 1 -- 172.21.15.45:0/692098984 reap_dead start 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6972ec0700 1 -- 172.21.15.45:0/692098984 shutdown_connections 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6972ec0700 1 -- 172.21.15.45:0/692098984 >> 172.21.15.45:0/692098984 conn(0x7f696c0cf070 msgr2=0x7f696c0cf480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6972ec0700 1 -- 172.21.15.45:0/692098984 shutdown_connections 2023-12-19T17:53:07.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.873+0000 7f6972ec0700 1 -- 172.21.15.45:0/692098984 wait complete. 2023-12-19T17:53:07.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.877+0000 7f6972ec0700 1 Processor -- start 2023-12-19T17:53:07.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.877+0000 7f6972ec0700 1 -- start start 2023-12-19T17:53:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6972ec0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f696c0b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6972ec0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c157cf0 0x7f696c0b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6972ec0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f696c0b3c30 0x7f696c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6972ec0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0a0260 con 0x7f6958003ff0 2023-12-19T17:53:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6972ec0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0c59e0 con 0x7f696c0b3c30 2023-12-19T17:53:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6972ec0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c09fca0 con 0x7f696c157cf0 2023-12-19T17:53:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f696c0b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f696c0b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43448/0 (socket says 172.21.15.45:43448) 2023-12-19T17:53:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 -- 172.21.15.45:0/611956615 learned_addr learned my addr 172.21.15.45:0/611956615 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f69716bd700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c157cf0 0x7f696c0b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f69726bf700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f696c0b3c30 0x7f696c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 -- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c157cf0 msgr2=0x7f696c0b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c157cf0 0x7f696c0b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 -- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f696c0b3c30 msgr2=0x7f696c156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f696c0b3c30 0x7f696c156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 -- 172.21.15.45:0/611956615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c09ff80 con 0x7f6958003ff0 2023-12-19T17:53:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f6971ebe700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f696c0b4670 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6968007310 tx=0x7f6968007620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.881+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011580 con 0x7f6958003ff0 2023-12-19T17:53:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.885+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6968011700 con 0x7f6958003ff0 2023-12-19T17:53:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.885+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c0b4150 con 0x7f6958003ff0 2023-12-19T17:53:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.885+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6968011ab0 con 0x7f6958003ff0 2023-12-19T17:53:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.885+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c157730 con 0x7f6958003ff0 2023-12-19T17:53:07.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.885+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c067760 con 0x7f6958003ff0 2023-12-19T17:53:07.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.889+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6968011c10 con 0x7f6958003ff0 2023-12-19T17:53:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.889+0000 7f69627fc700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6950065b00 0x7f6950067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.889+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f6968082ff0 con 0x7f6958003ff0 2023-12-19T17:53:07.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.889+0000 7f69716bd700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6950065b00 0x7f6950067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:07.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.889+0000 7f69716bd700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6950065b00 0x7f6950067fc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f695c0090b0 tx=0x7f695c01e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:07.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:07.897+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f69680b40a0 con 0x7f6958003ff0 2023-12-19T17:53:08.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.137+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f696c0cfd40 con 0x7f6958003ff0 2023-12-19T17:53:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.145+0000 7f69627fc700 1 -- 172.21.15.45:0/611956615 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f69680545f0 con 0x7f6958003ff0 2023-12-19T17:53:08.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6950065b00 msgr2=0x7f6950067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6950065b00 0x7f6950067fc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f695c0090b0 tx=0x7f695c01e040 comp rx=0 tx=0).stop 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 msgr2=0x7f696c0b4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f696c0b4670 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f6968007310 tx=0x7f6968007620 comp rx=0 tx=0).stop 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 shutdown_connections 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6950065b00 0x7f6950067fc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f696c0b3c30 0x7f696c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f696c157cf0 0x7f696c0b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 --2- 172.21.15.45:0/611956615 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6958003ff0 0x7f696c0b4670 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 >> 172.21.15.45:0/611956615 conn(0x7f696c0cf070 msgr2=0x7f696c0caf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 shutdown_connections 2023-12-19T17:53:08.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.149+0000 7f6972ec0700 1 -- 172.21.15.45:0/611956615 wait complete. 2023-12-19T17:53:08.176 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-19T17:53:08.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb20d2e700 1 Processor -- start 2023-12-19T17:53:08.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb20d2e700 1 -- start start 2023-12-19T17:53:08.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb20d2e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdb1c161530 0x7fdb1c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb20d2e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c06e310 con 0x7fdb1c0c3920 2023-12-19T17:53:08.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb20d2e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c161990 con 0x7fdb1c15cff0 2023-12-19T17:53:08.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb20d2e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1c15d3d0 con 0x7fdb1c161530 2023-12-19T17:53:08.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb1bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb1c0c3920 0x7fdb1c06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56920/0 (socket says 172.21.15.45:56920) 2023-12-19T17:53:08.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb1bfff700 1 -- 172.21.15.45:0/3355786876 learned_addr learned my addr 172.21.15.45:0/3355786876 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:08.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb1affd700 1 --2- 172.21.15.45:0/3355786876 >> v2:172.21.15.73:3300/0 conn(0x7fdb1c161530 0x7fdb1c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.353+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1728879447 0 0) 0x7fdb1c06e310 con 0x7fdb1c0c3920 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb040035d0 con 0x7fdb1c0c3920 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3136193239 0 0) 0x7fdb1c161990 con 0x7fdb1c15cff0 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb1c06e310 con 0x7fdb1c15cff0 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1affd700 1 -- 172.21.15.45:0/3355786876 >> v1:172.21.15.73:6789/0 conn(0x7fdb1c15cff0 legacy=0x7fdb1c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1affd700 1 -- 172.21.15.45:0/3355786876 >> v1:172.21.15.45:6789/0 conn(0x7fdb1c0c3920 legacy=0x7fdb1c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1affd700 1 -- 172.21.15.45:0/3355786876 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c0ca6f0 con 0x7fdb1c161530 2023-12-19T17:53:08.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1affd700 1 --2- 172.21.15.45:0/3355786876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c06ddd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009850 tx=0x7fdb10009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b19a825d6765a06 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011830 con 0x7fdb1c161530 2023-12-19T17:53:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb10011990 con 0x7fdb1c161530 2023-12-19T17:53:08.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb1a7fc700 1 -- 172.21.15.45:0/3355786876 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10011d40 con 0x7fdb1c161530 2023-12-19T17:53:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 -- 172.21.15.45:0/3355786876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 msgr2=0x7fdb1c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/3355786876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c06ddd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdb10009850 tx=0x7fdb10009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 -- 172.21.15.45:0/3355786876 shutdown_connections 2023-12-19T17:53:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/3355786876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c06ddd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 -- 172.21.15.45:0/3355786876 >> 172.21.15.45:0/3355786876 conn(0x7fdb1c0cb900 msgr2=0x7fdb1c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:08.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 -- 172.21.15.45:0/3355786876 shutdown_connections 2023-12-19T17:53:08.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.357+0000 7fdb20d2e700 1 -- 172.21.15.45:0/3355786876 wait complete. 2023-12-19T17:53:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.361+0000 7fdb20d2e700 1 Processor -- start 2023-12-19T17:53:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.361+0000 7fdb20d2e700 1 -- start start 2023-12-19T17:53:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb1c0c3920 0x7fdb1c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 0x7fdb1c0b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c0b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0b2100 con 0x7fdb1c15cff0 2023-12-19T17:53:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0b23e0 con 0x7fdb1c161530 2023-12-19T17:53:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c0b26c0 con 0x7fdb1c0c3920 2023-12-19T17:53:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 0x7fdb1c0b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 0x7fdb1c0b1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43462/0 (socket says 172.21.15.45:43462) 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 -- 172.21.15.45:0/1364559921 learned_addr learned my addr 172.21.15.45:0/1364559921 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1b7fe700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb1c0c3920 0x7fdb1c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1bfff700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c0b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 -- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb1c0c3920 msgr2=0x7fdb1c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb1c0c3920 0x7fdb1c15a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 -- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 msgr2=0x7fdb1c0b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c0b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 -- 172.21.15.45:0/1364559921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb100094b0 con 0x7fdb1c15cff0 2023-12-19T17:53:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb1affd700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 0x7fdb1c0b1590 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb100090b0 tx=0x7fdb10004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10019a00 con 0x7fdb1c15cff0 2023-12-19T17:53:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1001e070 con 0x7fdb1c15cff0 2023-12-19T17:53:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c0b29a0 con 0x7fdb1c15cff0 2023-12-19T17:53:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10019dc0 con 0x7fdb1c15cff0 2023-12-19T17:53:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.365+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c0ac840 con 0x7fdb1c15cff0 2023-12-19T17:53:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.369+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c0b2bb0 con 0x7fdb1c15cff0 2023-12-19T17:53:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.369+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb1002d450 con 0x7fdb1c15cff0 2023-12-19T17:53:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.373+0000 7fdb03fff700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdb08065ad0 0x7fdb08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.373+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fdb10083ec0 con 0x7fdb1c15cff0 2023-12-19T17:53:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.373+0000 7fdb1b7fe700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdb08065ad0 0x7fdb08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.373+0000 7fdb1b7fe700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdb08065ad0 0x7fdb08067f90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0011e0 tx=0x7fdb0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:08.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.377+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdb10051a80 con 0x7fdb1c15cff0 2023-12-19T17:53:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.617+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fdb1c067760 con 0x7fdb1c15cff0 2023-12-19T17:53:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.625+0000 7fdb03fff700 1 -- 172.21.15.45:0/1364559921 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdb100150a0 con 0x7fdb1c15cff0 2023-12-19T17:53:08.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdb08065ad0 msgr2=0x7fdb08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdb08065ad0 0x7fdb08067f90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0011e0 tx=0x7fdb0c009040 comp rx=0 tx=0).stop 2023-12-19T17:53:08.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 msgr2=0x7fdb1c0b1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 0x7fdb1c0b1590 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fdb100090b0 tx=0x7fdb10004770 comp rx=0 tx=0).stop 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 shutdown_connections 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdb08065ad0 0x7fdb08067f90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb1c161530 0x7fdb1c0b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb1c15cff0 0x7fdb1c0b1590 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 --2- 172.21.15.45:0/1364559921 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb1c0c3920 0x7fdb1c15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 >> 172.21.15.45:0/1364559921 conn(0x7fdb1c0cb900 msgr2=0x7fdb1c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.629+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 shutdown_connections 2023-12-19T17:53:08.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.633+0000 7fdb20d2e700 1 -- 172.21.15.45:0/1364559921 wait complete. 2023-12-19T17:53:08.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-19T17:53:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.837+0000 7f5ba759e700 1 Processor -- start 2023-12-19T17:53:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.837+0000 7f5ba759e700 1 -- start start 2023-12-19T17:53:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806ea90 0x7f5ba80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80d1820 con 0x7f5ba806fe80 2023-12-19T17:53:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba80d1b00 con 0x7f5ba80b88b0 2023-12-19T17:53:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80d1de0 con 0x7f5ba806ea90 2023-12-19T17:53:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba6d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ba806fe80 0x7f5ba80b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48380/0 (socket says 172.21.15.45:48380) 2023-12-19T17:53:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba6d9d700 1 -- 172.21.15.45:0/1384610826 learned_addr learned my addr 172.21.15.45:0/1384610826 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba659c700 1 --2- 172.21.15.45:0/1384610826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806ea90 0x7f5ba80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153704043 0 0) 0x7f5ba80d1820 con 0x7f5ba806fe80 2023-12-19T17:53:08.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b900035d0 con 0x7f5ba806fe80 2023-12-19T17:53:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164387094 0 0) 0x7f5ba80d1b00 con 0x7f5ba80b88b0 2023-12-19T17:53:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ba80d1820 con 0x7f5ba80b88b0 2023-12-19T17:53:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba659c700 1 -- 172.21.15.45:0/1384610826 >> v1:172.21.15.73:6789/0 conn(0x7f5ba80b88b0 legacy=0x7f5ba80b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba659c700 1 -- 172.21.15.45:0/1384610826 >> v1:172.21.15.45:6789/0 conn(0x7f5ba806fe80 legacy=0x7f5ba80b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.841+0000 7f5ba659c700 1 -- 172.21.15.45:0/1384610826 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba80d20c0 con 0x7f5ba806ea90 2023-12-19T17:53:08.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba659c700 1 --2- 172.21.15.45:0/1384610826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806ea90 0x7f5ba80d0f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009880 tx=0x7f5b98009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56183855c7d5a9c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98011830 con 0x7f5ba806ea90 2023-12-19T17:53:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b98011990 con 0x7f5ba806ea90 2023-12-19T17:53:08.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba559a700 1 -- 172.21.15.45:0/1384610826 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98011d20 con 0x7f5ba806ea90 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 -- 172.21.15.45:0/1384610826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806ea90 msgr2=0x7f5ba80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 --2- 172.21.15.45:0/1384610826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806ea90 0x7f5ba80d0f20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5b98009880 tx=0x7f5b98009b90 comp rx=0 tx=0).stop 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 -- 172.21.15.45:0/1384610826 shutdown_connections 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 --2- 172.21.15.45:0/1384610826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806ea90 0x7f5ba80d0f20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 -- 172.21.15.45:0/1384610826 >> 172.21.15.45:0/1384610826 conn(0x7f5ba80b46d0 msgr2=0x7f5ba80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 -- 172.21.15.45:0/1384610826 shutdown_connections 2023-12-19T17:53:08.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.845+0000 7f5ba759e700 1 -- 172.21.15.45:0/1384610826 wait complete. 2023-12-19T17:53:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 Processor -- start 2023-12-19T17:53:08.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 -- start start 2023-12-19T17:53:08.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 0x7f5ba80c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806fe80 0x7f5ba81564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba80b88b0 0x7f5ba8159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba8156a10 con 0x7f5ba806ea90 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80caea0 con 0x7f5ba80b88b0 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba80ca290 con 0x7f5ba806fe80 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 0x7f5ba80c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 0x7f5ba80c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57434/0 (socket says 172.21.15.45:57434) 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.849+0000 7f5ba659c700 1 -- 172.21.15.45:0/2158701749 learned_addr learned my addr 172.21.15.45:0/2158701749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba6d9d700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba80b88b0 0x7f5ba8159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba5d9b700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806fe80 0x7f5ba81564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba659c700 1 -- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806fe80 msgr2=0x7f5ba81564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba659c700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806fe80 0x7f5ba81564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba659c700 1 -- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba80b88b0 msgr2=0x7f5ba8159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:08.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba659c700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba80b88b0 0x7f5ba8159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:08.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba659c700 1 -- 172.21.15.45:0/2158701749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b980094b0 con 0x7f5ba806ea90 2023-12-19T17:53:08.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba659c700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 0x7f5ba80c9cb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5b98013040 tx=0x7f5b98004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:08.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9801a8c0 con 0x7f5ba806ea90 2023-12-19T17:53:08.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b9801e070 con 0x7f5ba806ea90 2023-12-19T17:53:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba80ca570 con 0x7f5ba806ea90 2023-12-19T17:53:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9801ac60 con 0x7f5ba806ea90 2023-12-19T17:53:08.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba80cab30 con 0x7f5ba806ea90 2023-12-19T17:53:08.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.853+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba8067760 con 0x7f5ba806ea90 2023-12-19T17:53:08.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.857+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b9802d450 con 0x7f5ba806ea90 2023-12-19T17:53:08.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.857+0000 7f5b96ffd700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b88065ad0 0x7f5b88067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:08.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.857+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5b98083cf0 con 0x7f5ba806ea90 2023-12-19T17:53:08.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.861+0000 7f5ba5d9b700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b88065ad0 0x7f5b88067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:08.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.861+0000 7f5ba5d9b700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b88065ad0 0x7f5b88067f90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ba815c5e0 tx=0x7f5b9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:08.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:08.865+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5b98051960 con 0x7f5ba806ea90 2023-12-19T17:53:09.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.113+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f5ba8066110 con 0x7f5ba806ea90 2023-12-19T17:53:09.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.121+0000 7f5b96ffd700 1 -- 172.21.15.45:0/2158701749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5b98020070 con 0x7f5ba806ea90 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b88065ad0 msgr2=0x7f5b88067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b88065ad0 0x7f5b88067f90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ba815c5e0 tx=0x7f5b9c009040 comp rx=0 tx=0).stop 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 msgr2=0x7f5ba80c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 0x7f5ba80c9cb0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f5b98013040 tx=0x7f5b98004770 comp rx=0 tx=0).stop 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 shutdown_connections 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b88065ad0 0x7f5b88067f90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba80b88b0 0x7f5ba8159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba806fe80 0x7f5ba81564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 --2- 172.21.15.45:0/2158701749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba806ea90 0x7f5ba80c9cb0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 >> 172.21.15.45:0/2158701749 conn(0x7f5ba80b46d0 msgr2=0x7f5ba80b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 shutdown_connections 2023-12-19T17:53:09.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.125+0000 7f5ba759e700 1 -- 172.21.15.45:0/2158701749 wait complete. 2023-12-19T17:53:09.152 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-19T17:53:09.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.325+0000 7fb085825700 1 Processor -- start 2023-12-19T17:53:09.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.325+0000 7fb085825700 1 -- start start 2023-12-19T17:53:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb085825700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb0800afe30 0x7fb08015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb085825700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08006f0a0 con 0x7fb08015ae20 2023-12-19T17:53:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb085825700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08006ea90 con 0x7fb08006cad0 2023-12-19T17:53:09.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb085825700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0800c3f60 con 0x7fb0800afe30 2023-12-19T17:53:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07effd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb08015ae20 0x7fb0800c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48394/0 (socket says 172.21.15.45:48394) 2023-12-19T17:53:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07effd700 1 -- 172.21.15.45:0/963263052 learned_addr learned my addr 172.21.15.45:0/963263052 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:09.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07f7fe700 1 --2- 172.21.15.45:0/963263052 >> v2:172.21.15.73:3300/0 conn(0x7fb0800afe30 0x7fb08015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1807265573 0 0) 0x7fb08006ea90 con 0x7fb08006cad0 2023-12-19T17:53:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0680035d0 con 0x7fb08006cad0 2023-12-19T17:53:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1187729263 0 0) 0x7fb08006f0a0 con 0x7fb08015ae20 2023-12-19T17:53:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb08006ea90 con 0x7fb08015ae20 2023-12-19T17:53:09.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07f7fe700 1 -- 172.21.15.45:0/963263052 >> v1:172.21.15.73:6789/0 conn(0x7fb08006cad0 legacy=0x7fb0800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07f7fe700 1 -- 172.21.15.45:0/963263052 >> v1:172.21.15.45:6789/0 conn(0x7fb08015ae20 legacy=0x7fb0800c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.329+0000 7fb07f7fe700 1 -- 172.21.15.45:0/963263052 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0800c4240 con 0x7fb0800afe30 2023-12-19T17:53:09.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb07f7fe700 1 --2- 172.21.15.45:0/963263052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb08015be40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb078009d90 tx=0x7fb07800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=affc0b20d891663 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb07800e070 con 0x7fb0800afe30 2023-12-19T17:53:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb07800bb20 con 0x7fb0800afe30 2023-12-19T17:53:09.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb07dffb700 1 -- 172.21.15.45:0/963263052 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb078012430 con 0x7fb0800afe30 2023-12-19T17:53:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 -- 172.21.15.45:0/963263052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 msgr2=0x7fb08015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 --2- 172.21.15.45:0/963263052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb08015be40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb078009d90 tx=0x7fb07800b330 comp rx=0 tx=0).stop 2023-12-19T17:53:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 -- 172.21.15.45:0/963263052 shutdown_connections 2023-12-19T17:53:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 --2- 172.21.15.45:0/963263052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb08015be40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 -- 172.21.15.45:0/963263052 >> 172.21.15.45:0/963263052 conn(0x7fb0800cb900 msgr2=0x7fb0800b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:09.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 -- 172.21.15.45:0/963263052 shutdown_connections 2023-12-19T17:53:09.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.333+0000 7fb085825700 1 -- 172.21.15.45:0/963263052 wait complete. 2023-12-19T17:53:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 Processor -- start 2023-12-19T17:53:09.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 -- start start 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 0x7fb0800c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb0801f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb08015ae20 0x7fb0801f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801faa50 con 0x7fb08006cad0 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0801fad30 con 0x7fb0800afe30 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb085825700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0800c5890 con 0x7fb08015ae20 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb07effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 0x7fb0800c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb07effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 0x7fb0800c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57442/0 (socket says 172.21.15.45:57442) 2023-12-19T17:53:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb07effd700 1 -- 172.21.15.45:0/545075172 learned_addr learned my addr 172.21.15.45:0/545075172 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.337+0000 7fb07e7fc700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb0801f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07f7fe700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb08015ae20 0x7fb0801f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07effd700 1 -- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb08015ae20 msgr2=0x7fb0801f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07effd700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb08015ae20 0x7fb0801f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07effd700 1 -- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 msgr2=0x7fb0801f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07effd700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb0801f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07effd700 1 -- 172.21.15.45:0/545075172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb078009a70 con 0x7fb08006cad0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb07effd700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 0x7fb0800c6370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c4d0 tx=0x7fb07000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070005d90 con 0x7fb08006cad0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0700070d0 con 0x7fb08006cad0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0800c5b70 con 0x7fb08006cad0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070007480 con 0x7fb08006cad0 2023-12-19T17:53:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb08014af40 con 0x7fb08006cad0 2023-12-19T17:53:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.341+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0800c6090 con 0x7fb08006cad0 2023-12-19T17:53:09.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.345+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb0700075e0 con 0x7fb08006cad0 2023-12-19T17:53:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.345+0000 7fb067fff700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.349+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb070082550 con 0x7fb08006cad0 2023-12-19T17:53:09.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.349+0000 7fb07e7fc700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.349+0000 7fb07e7fc700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb08014b310 tx=0x7fb074009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:09.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.353+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb0800c6090 con 0x7fb08006cad0 2023-12-19T17:53:09.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.589+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fb0800b0cb0 con 0x7fb08006cad0 2023-12-19T17:53:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.597+0000 7fb067fff700 1 -- 172.21.15.45:0/545075172 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb070050080 con 0x7fb08006cad0 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 msgr2=0x7fb06c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fb08014b310 tx=0x7fb074009040 comp rx=0 tx=0).stop 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 msgr2=0x7fb0800c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 0x7fb0800c6370 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c4d0 tx=0x7fb07000c890 comp rx=0 tx=0).stop 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 shutdown_connections 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb08015ae20 0x7fb0801f9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0800afe30 0x7fb0801f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 --2- 172.21.15.45:0/545075172 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08006cad0 0x7fb0800c6370 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.601+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 >> 172.21.15.45:0/545075172 conn(0x7fb0800cb900 msgr2=0x7fb080165180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.605+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 shutdown_connections 2023-12-19T17:53:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.605+0000 7fb085825700 1 -- 172.21.15.45:0/545075172 wait complete. 2023-12-19T17:53:09.629 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-19T17:53:09.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.809+0000 7f5cf759e700 1 Processor -- start 2023-12-19T17:53:09.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.809+0000 7f5cf759e700 1 -- start start 2023-12-19T17:53:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5cf81611c0 0x7f5cf80c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf80af720 0x7f5cf80afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cf80b00c0 con 0x7f5cf81615a0 2023-12-19T17:53:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cf8070340 con 0x7f5cf81611c0 2023-12-19T17:53:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf80c3f90 con 0x7f5cf80af720 2023-12-19T17:53:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5cf81611c0 0x7f5cf80c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5cf81611c0 0x7f5cf80c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57452/0 (socket says 172.21.15.45:57452) 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 -- 172.21.15.45:0/4116676276 learned_addr learned my addr 172.21.15.45:0/4116676276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf6d9d700 1 --2- 172.21.15.45:0/4116676276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf80af720 0x7f5cf80afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 -- 172.21.15.45:0/4116676276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf80af720 msgr2=0x7f5cf80afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 --2- 172.21.15.45:0/4116676276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf80af720 0x7f5cf80afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 -- 172.21.15.45:0/4116676276 >> v1:172.21.15.45:6789/0 conn(0x7f5cf81615a0 legacy=0x7f5cf806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 -- 172.21.15.45:0/4116676276 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf80c4270 con 0x7f5cf81611c0 2023-12-19T17:53:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf659c700 1 --2- 172.21.15.45:0/4116676276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf80c3920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009910 tx=0x7f5ce8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83c1abd63116d09 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:09.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf5d9b700 1 -- 172.21.15.45:0/4116676276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce800ba60 con 0x7f5cf81611c0 2023-12-19T17:53:09.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf5d9b700 1 -- 172.21.15.45:0/4116676276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce800bbc0 con 0x7f5cf81611c0 2023-12-19T17:53:09.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.813+0000 7f5cf5d9b700 1 -- 172.21.15.45:0/4116676276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce8009e60 con 0x7f5cf81611c0 2023-12-19T17:53:09.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 -- 172.21.15.45:0/4116676276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 msgr2=0x7f5cf80c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 --2- 172.21.15.45:0/4116676276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf80c3920 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8009910 tx=0x7f5ce8009c20 comp rx=0 tx=0).stop 2023-12-19T17:53:09.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 -- 172.21.15.45:0/4116676276 shutdown_connections 2023-12-19T17:53:09.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 --2- 172.21.15.45:0/4116676276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf80af720 0x7f5cf80afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 --2- 172.21.15.45:0/4116676276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf80c3920 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 -- 172.21.15.45:0/4116676276 >> 172.21.15.45:0/4116676276 conn(0x7f5cf80cb900 msgr2=0x7f5cf80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 -- 172.21.15.45:0/4116676276 shutdown_connections 2023-12-19T17:53:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.817+0000 7f5cf759e700 1 -- 172.21.15.45:0/4116676276 wait complete. 2023-12-19T17:53:09.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 Processor -- start 2023-12-19T17:53:09.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 -- start start 2023-12-19T17:53:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf80af720 0x7f5cf815cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf81f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf81615a0 0x7f5cf8160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf81f7b30 con 0x7f5cf81611c0 2023-12-19T17:53:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf81607d0 con 0x7f5cf80af720 2023-12-19T17:53:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf815d560 con 0x7f5cf81615a0 2023-12-19T17:53:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf81f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf81f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57466/0 (socket says 172.21.15.45:57466) 2023-12-19T17:53:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 -- 172.21.15.45:0/3410141730 learned_addr learned my addr 172.21.15.45:0/3410141730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf659c700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf80af720 0x7f5cf815cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5cf6d9d700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf81615a0 0x7f5cf8160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 -- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf81615a0 msgr2=0x7f5cf8160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf81615a0 0x7f5cf8160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 -- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf80af720 msgr2=0x7f5cf815cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf80af720 0x7f5cf815cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.821+0000 7f5ceffff700 1 -- 172.21.15.45:0/3410141730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce8009570 con 0x7f5cf81611c0 2023-12-19T17:53:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5ceffff700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf81f75f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c450 tx=0x7f5ce000c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00052d0 con 0x7f5cf81611c0 2023-12-19T17:53:09.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce0005450 con 0x7f5cf81611c0 2023-12-19T17:53:09.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce00038e0 con 0x7f5cf81611c0 2023-12-19T17:53:09.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf815f7b0 con 0x7f5cf81611c0 2023-12-19T17:53:09.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf815fd70 con 0x7f5cf81611c0 2023-12-19T17:53:09.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.825+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf806e760 con 0x7f5cf81611c0 2023-12-19T17:53:09.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.829+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5ce0003a40 con 0x7f5cf81611c0 2023-12-19T17:53:09.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.829+0000 7f5ceeffd700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5cd8065ad0 0x7f5cd8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:09.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.829+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5ce00822f0 con 0x7f5cf81611c0 2023-12-19T17:53:09.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.829+0000 7f5cf659c700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5cd8065ad0 0x7f5cd8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:09.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.833+0000 7f5cf659c700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5cd8065ad0 0x7f5cd8067f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8000c00 tx=0x7f5ce8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:09.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:09.833+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5ce004fe20 con 0x7f5cf81611c0 2023-12-19T17:53:10.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.089+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5cf815ff90 con 0x7f5cf81611c0 2023-12-19T17:53:10.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.097+0000 7f5ceeffd700 1 -- 172.21.15.45:0/3410141730 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v12) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ce000ce60 con 0x7f5cf81611c0 2023-12-19T17:53:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5cd8065ad0 msgr2=0x7f5cd8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5cd8065ad0 0x7f5cd8067f90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8000c00 tx=0x7f5ce8008030 comp rx=0 tx=0).stop 2023-12-19T17:53:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 msgr2=0x7f5cf81f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf81f75f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5ce000c450 tx=0x7f5ce000c760 comp rx=0 tx=0).stop 2023-12-19T17:53:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 shutdown_connections 2023-12-19T17:53:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5cd8065ad0 0x7f5cd8067f90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cf81615a0 0x7f5cf8160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cf81611c0 0x7f5cf81f75f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 --2- 172.21.15.45:0/3410141730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cf80af720 0x7f5cf815cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 >> 172.21.15.45:0/3410141730 conn(0x7f5cf80cb900 msgr2=0x7f5cf80cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 shutdown_connections 2023-12-19T17:53:10.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.101+0000 7f5cf759e700 1 -- 172.21.15.45:0/3410141730 wait complete. 2023-12-19T17:53:10.128 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-19T17:53:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.305+0000 7efdff59e700 1 Processor -- start 2023-12-19T17:53:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.305+0000 7efdff59e700 1 -- start start 2023-12-19T17:53:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdff59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe0006ea90 0x7efe000d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdff59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe000b88b0 0x7efe000b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdff59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe000b6df0 con 0x7efe000b6250 2023-12-19T17:53:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdff59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe000d1820 con 0x7efe0006ea90 2023-12-19T17:53:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdff59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000d1b00 con 0x7efe000b88b0 2023-12-19T17:53:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfe59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe0006ea90 0x7efe000d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfed9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7efe000b6250 0x7efe000b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56286/0 (socket says 172.21.15.45:56286) 2023-12-19T17:53:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfed9d700 1 -- 172.21.15.45:0/1758691699 learned_addr learned my addr 172.21.15.45:0/1758691699 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:10.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfdd9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe000b88b0 0x7efe000b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfd59a700 1 -- 172.21.15.45:0/1758691699 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881082270 0 0) 0x7efe000b6df0 con 0x7efe000b6250 2023-12-19T17:53:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfd59a700 1 -- 172.21.15.45:0/1758691699 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde80035d0 con 0x7efe000b6250 2023-12-19T17:53:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfe59c700 1 -- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe000b88b0 msgr2=0x7efe000b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfe59c700 1 --2- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe000b88b0 0x7efe000b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfe59c700 1 -- 172.21.15.45:0/1758691699 >> v1:172.21.15.73:6789/0 conn(0x7efe000b6250 legacy=0x7efe000b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.309+0000 7efdfe59c700 1 -- 172.21.15.45:0/1758691699 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe000d1de0 con 0x7efe0006ea90 2023-12-19T17:53:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdfe59c700 1 --2- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe0006ea90 0x7efe000d0f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009850 tx=0x7efdf0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0e967621362d194 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdfd59a700 1 -- 172.21.15.45:0/1758691699 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0011830 con 0x7efe0006ea90 2023-12-19T17:53:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdfd59a700 1 -- 172.21.15.45:0/1758691699 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf0011990 con 0x7efe0006ea90 2023-12-19T17:53:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdfd59a700 1 -- 172.21.15.45:0/1758691699 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0011d00 con 0x7efe0006ea90 2023-12-19T17:53:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 -- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe0006ea90 msgr2=0x7efe000d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 --2- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe0006ea90 0x7efe000d0f20 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009850 tx=0x7efdf0009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 -- 172.21.15.45:0/1758691699 shutdown_connections 2023-12-19T17:53:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 --2- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe000b88b0 0x7efe000b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 --2- 172.21.15.45:0/1758691699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe0006ea90 0x7efe000d0f20 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 -- 172.21.15.45:0/1758691699 >> 172.21.15.45:0/1758691699 conn(0x7efe000b46d0 msgr2=0x7efe000b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 -- 172.21.15.45:0/1758691699 shutdown_connections 2023-12-19T17:53:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.313+0000 7efdff59e700 1 -- 172.21.15.45:0/1758691699 wait complete. 2023-12-19T17:53:10.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 Processor -- start 2023-12-19T17:53:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 -- start start 2023-12-19T17:53:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe0006ea90 0x7efe000cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 0x7efe001f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe000b88b0 0x7efe000c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000ccc20 con 0x7efe000b6250 2023-12-19T17:53:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe000caa50 con 0x7efe000b88b0 2023-12-19T17:53:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.317+0000 7efdff59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe000ca770 con 0x7efe0006ea90 2023-12-19T17:53:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 0x7efe001f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 0x7efe001f2230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57472/0 (socket says 172.21.15.45:57472) 2023-12-19T17:53:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfdd9b700 1 -- 172.21.15.45:0/3334970932 learned_addr learned my addr 172.21.15.45:0/3334970932 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe0006ea90 0x7efe000cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfed9d700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe000b88b0 0x7efe000c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 -- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe000b88b0 msgr2=0x7efe000c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe000b88b0 0x7efe000c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 -- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 msgr2=0x7efe001f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 0x7efe001f2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 -- 172.21.15.45:0/3334970932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf00094b0 con 0x7efe0006ea90 2023-12-19T17:53:10.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfdd9b700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 0x7efe001f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdfe59c700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe0006ea90 0x7efe000cc6e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdf0016000 tx=0x7efdf0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf0004450 con 0x7efe0006ea90 2023-12-19T17:53:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf001e070 con 0x7efe0006ea90 2023-12-19T17:53:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe0015def0 con 0x7efe0006ea90 2023-12-19T17:53:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf00038e0 con 0x7efe0006ea90 2023-12-19T17:53:10.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.321+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe0015e4b0 con 0x7efe0006ea90 2023-12-19T17:53:10.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.325+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe00067760 con 0x7efe0006ea90 2023-12-19T17:53:10.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.325+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efdf0003a40 con 0x7efe0006ea90 2023-12-19T17:53:10.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.329+0000 7efdeeffd700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efde0065ad0 0x7efde0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.329+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7efdf0084150 con 0x7efe0006ea90 2023-12-19T17:53:10.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.329+0000 7efdfdd9b700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efde0065ad0 0x7efde0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.329+0000 7efdfdd9b700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efde0065ad0 0x7efde0067f90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe001f5700 tx=0x7efdf4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:10.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.333+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efdf0051d90 con 0x7efe0006ea90 2023-12-19T17:53:10.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.569+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7efe0015e6a0 con 0x7efe0006ea90 2023-12-19T17:53:10.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.581+0000 7efdeeffd700 1 -- 172.21.15.45:0/3334970932 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v13) v1 ==== 90+0+0 (secure 0 0 0) 0x7efdf00553b0 con 0x7efe0006ea90 2023-12-19T17:53:10.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efde0065ad0 msgr2=0x7efde0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efde0065ad0 0x7efde0067f90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7efe001f5700 tx=0x7efdf4009240 comp rx=0 tx=0).stop 2023-12-19T17:53:10.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe0006ea90 msgr2=0x7efe000cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe0006ea90 0x7efe000cc6e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7efdf0016000 tx=0x7efdf0004770 comp rx=0 tx=0).stop 2023-12-19T17:53:10.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 shutdown_connections 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efde0065ad0 0x7efde0067f90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe000b88b0 0x7efe000c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe000b6250 0x7efe001f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 --2- 172.21.15.45:0/3334970932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe0006ea90 0x7efe000cc6e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 >> 172.21.15.45:0/3334970932 conn(0x7efe000b46d0 msgr2=0x7efe000b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 shutdown_connections 2023-12-19T17:53:10.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.585+0000 7efdff59e700 1 -- 172.21.15.45:0/3334970932 wait complete. 2023-12-19T17:53:10.622 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:10.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.797+0000 7f0060c82700 1 Processor -- start 2023-12-19T17:53:10.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.797+0000 7f0060c82700 1 -- start start 2023-12-19T17:53:10.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0060c82700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f005c15e260 0x7f005c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0060c82700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f005c06efd0 0x7f005c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0060c82700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f005c0ae1e0 con 0x7f005c15ab50 2023-12-19T17:53:10.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0060c82700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c15af30 con 0x7f005c15e260 2023-12-19T17:53:10.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0060c82700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005c0cd010 con 0x7f005c06efd0 2023-12-19T17:53:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0059d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f005c15e260 0x7f005c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0059d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f005c15e260 0x7f005c06ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57480/0 (socket says 172.21.15.45:57480) 2023-12-19T17:53:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0059d9b700 1 -- 172.21.15.45:0/3678240236 learned_addr learned my addr 172.21.15.45:0/3678240236 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:10.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f005ad9d700 1 --2- 172.21.15.45:0/3678240236 >> v2:172.21.15.73:3300/0 conn(0x7f005c06efd0 0x7f005c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.801+0000 7f0059d9b700 1 -- 172.21.15.45:0/3678240236 >> v2:172.21.15.73:3300/0 conn(0x7f005c06efd0 msgr2=0x7f005c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0059d9b700 1 --2- 172.21.15.45:0/3678240236 >> v2:172.21.15.73:3300/0 conn(0x7f005c06efd0 0x7f005c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0059d9b700 1 -- 172.21.15.45:0/3678240236 >> v1:172.21.15.73:6789/0 conn(0x7f005c15ab50 legacy=0x7f005c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0059d9b700 1 -- 172.21.15.45:0/3678240236 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c0cd2f0 con 0x7f005c15e260 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0059d9b700 1 --2- 172.21.15.45:0/3678240236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15e260 0x7f005c06ea90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f005c160a10 tx=0x7f0050009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27e173bb656512e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f005959a700 1 -- 172.21.15.45:0/3678240236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050011830 con 0x7f005c15e260 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f005959a700 1 -- 172.21.15.45:0/3678240236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050011990 con 0x7f005c15e260 2023-12-19T17:53:10.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f005959a700 1 -- 172.21.15.45:0/3678240236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050011d20 con 0x7f005c15e260 2023-12-19T17:53:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 -- 172.21.15.45:0/3678240236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15e260 msgr2=0x7f005c06ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 --2- 172.21.15.45:0/3678240236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15e260 0x7f005c06ea90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f005c160a10 tx=0x7f0050009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 -- 172.21.15.45:0/3678240236 shutdown_connections 2023-12-19T17:53:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 --2- 172.21.15.45:0/3678240236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15e260 0x7f005c06ea90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 --2- 172.21.15.45:0/3678240236 >> v2:172.21.15.73:3300/0 conn(0x7f005c06efd0 0x7f005c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 -- 172.21.15.45:0/3678240236 >> 172.21.15.45:0/3678240236 conn(0x7f005c0cba40 msgr2=0x7f005c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 -- 172.21.15.45:0/3678240236 shutdown_connections 2023-12-19T17:53:10.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.805+0000 7f0060c82700 1 -- 172.21.15.45:0/3678240236 wait complete. 2023-12-19T17:53:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 Processor -- start 2023-12-19T17:53:10.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 -- start start 2023-12-19T17:53:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c06efd0 0x7f005c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 0x7f005c0b4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f005c15e260 0x7f005c0ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0ae960 con 0x7f005c15ab50 2023-12-19T17:53:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0aeb90 con 0x7f005c06efd0 2023-12-19T17:53:10.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0060c82700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005c0aee70 con 0x7f005c15e260 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 0x7f005c0b4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 0x7f005c0b4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57494/0 (socket says 172.21.15.45:57494) 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 -- 172.21.15.45:0/2361981034 learned_addr learned my addr 172.21.15.45:0/2361981034 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f005a59c700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c06efd0 0x7f005c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f005ad9d700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f005c15e260 0x7f005c0ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 -- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f005c15e260 msgr2=0x7f005c0ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f005c15e260 0x7f005c0ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 -- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c06efd0 msgr2=0x7f005c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c06efd0 0x7f005c159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f0059d9b700 1 -- 172.21.15.45:0/2361981034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0050009570 con 0x7f005c15ab50 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.809+0000 7f005ad9d700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f005c15e260 0x7f005c0ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f0059d9b700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 0x7f005c0b4510 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f005c0b1660 tx=0x7f0050004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050004550 con 0x7f005c15ab50 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005001f070 con 0x7f005c15ab50 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c0af150 con 0x7f005c15ab50 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050003900 con 0x7f005c15ab50 2023-12-19T17:53:10.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c0af710 con 0x7f005c15ab50 2023-12-19T17:53:10.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.813+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c0af900 con 0x7f005c15ab50 2023-12-19T17:53:10.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.817+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0050003a60 con 0x7f005c15ab50 2023-12-19T17:53:10.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.817+0000 7f004affd700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f003c065b00 0x7f003c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:10.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.817+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0050021070 con 0x7f005c15ab50 2023-12-19T17:53:10.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.817+0000 7f005a59c700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f003c065b00 0x7f003c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:10.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.817+0000 7f005a59c700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f003c065b00 0x7f003c067fc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f004c000f60 tx=0x7f004c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:10.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:10.825+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0050052030 con 0x7f005c15ab50 2023-12-19T17:53:11.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.009+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f005c04ed30 con 0x7f005c15ab50 2023-12-19T17:53:11.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.009+0000 7f004affd700 1 -- 172.21.15.45:0/2361981034 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+12546 (secure 0 0 0) 0x7f0050055650 con 0x7f005c15ab50 2023-12-19T17:53:11.013 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:11.013 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":35,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:07.171041+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f003c065b00 msgr2=0x7f003c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f003c065b00 0x7f003c067fc0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f004c000f60 tx=0x7f004c009040 comp rx=0 tx=0).stop 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 msgr2=0x7f005c0b4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 0x7f005c0b4510 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f005c0b1660 tx=0x7f0050004770 comp rx=0 tx=0).stop 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 shutdown_connections 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f003c065b00 0x7f003c067fc0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f005c15e260 0x7f005c0ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f005c15ab50 0x7f005c0b4510 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 --2- 172.21.15.45:0/2361981034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f005c06efd0 0x7f005c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 >> 172.21.15.45:0/2361981034 conn(0x7f005c0cba40 msgr2=0x7f005c15f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 shutdown_connections 2023-12-19T17:53:11.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.013+0000 7f0060c82700 1 -- 172.21.15.45:0/2361981034 wait complete. 2023-12-19T17:53:11.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:53:11.038 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:53:11.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.221+0000 7f15b98ca700 1 Processor -- start 2023-12-19T17:53:11.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.221+0000 7f15b98ca700 1 -- start start 2023-12-19T17:53:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b98ca700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f15b415ccf0 0x7f15b40b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b98ca700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 0x7f15b40d1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b98ca700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15b406f4a0 con 0x7f15b40cd940 2023-12-19T17:53:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b98ca700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15b4070370 con 0x7f15b415ccf0 2023-12-19T17:53:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b98ca700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b406f6f0 con 0x7f15b40d0df0 2023-12-19T17:53:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 0x7f15b40d1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b88c8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f15b415ccf0 0x7f15b40b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 0x7f15b40d1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:59884/0 (socket says 172.21.15.45:59884) 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 -- 172.21.15.45:0/1786282617 learned_addr learned my addr 172.21.15.45:0/1786282617 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 -- 172.21.15.45:0/1786282617 >> v2:172.21.15.73:3300/0 conn(0x7f15b415ccf0 msgr2=0x7f15b40b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 --2- 172.21.15.45:0/1786282617 >> v2:172.21.15.73:3300/0 conn(0x7f15b415ccf0 0x7f15b40b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 -- 172.21.15.45:0/1786282617 >> v1:172.21.15.73:6789/0 conn(0x7f15b40cd940 legacy=0x7f15b40cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 -- 172.21.15.45:0/1786282617 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b406f9d0 con 0x7f15b40d0df0 2023-12-19T17:53:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b90c9700 1 --2- 172.21.15.45:0/1786282617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 0x7f15b40d1280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009e50 tx=0x7f15ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7775198a73ed0450 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b37fe700 1 -- 172.21.15.45:0/1786282617 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00e070 con 0x7f15b40d0df0 2023-12-19T17:53:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b37fe700 1 -- 172.21.15.45:0/1786282617 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ac00b910 con 0x7f15b40d0df0 2023-12-19T17:53:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.225+0000 7f15b37fe700 1 -- 172.21.15.45:0/1786282617 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ac00bcc0 con 0x7f15b40d0df0 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 -- 172.21.15.45:0/1786282617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 msgr2=0x7f15b40d1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 --2- 172.21.15.45:0/1786282617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 0x7f15b40d1280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f15ac009e50 tx=0x7f15ac00b330 comp rx=0 tx=0).stop 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 -- 172.21.15.45:0/1786282617 shutdown_connections 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 --2- 172.21.15.45:0/1786282617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b40d0df0 0x7f15b40d1280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 --2- 172.21.15.45:0/1786282617 >> v2:172.21.15.73:3300/0 conn(0x7f15b415ccf0 0x7f15b40b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 -- 172.21.15.45:0/1786282617 >> 172.21.15.45:0/1786282617 conn(0x7f15b40b46f0 msgr2=0x7f15b40b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 -- 172.21.15.45:0/1786282617 shutdown_connections 2023-12-19T17:53:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 -- 172.21.15.45:0/1786282617 wait complete. 2023-12-19T17:53:11.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 Processor -- start 2023-12-19T17:53:11.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.229+0000 7f15b98ca700 1 -- start start 2023-12-19T17:53:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40cd940 0x7f15b40ccb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 0x7f15b40c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b415ccf0 0x7f15b4155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4154130 con 0x7f15b40d0df0 2023-12-19T17:53:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15b4154f90 con 0x7f15b40cd940 2023-12-19T17:53:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15b40cd070 con 0x7f15b415ccf0 2023-12-19T17:53:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 0x7f15b40c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 0x7f15b40c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57502/0 (socket says 172.21.15.45:57502) 2023-12-19T17:53:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 -- 172.21.15.45:0/2229117228 learned_addr learned my addr 172.21.15.45:0/2229117228 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b88c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40cd940 0x7f15b40ccb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b90c9700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b415ccf0 0x7f15b4155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 -- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b415ccf0 msgr2=0x7f15b4155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b415ccf0 0x7f15b4155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 -- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40cd940 msgr2=0x7f15b40ccb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40cd940 0x7f15b40ccb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 -- 172.21.15.45:0/2229117228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15ac009b30 con 0x7f15b40d0df0 2023-12-19T17:53:11.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b3fff700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 0x7f15b40c8800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c500 tx=0x7f15a000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:11.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00052d0 con 0x7f15b40d0df0 2023-12-19T17:53:11.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15a0005430 con 0x7f15b40d0df0 2023-12-19T17:53:11.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15a00055a0 con 0x7f15b40d0df0 2023-12-19T17:53:11.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15b4154380 con 0x7f15b40d0df0 2023-12-19T17:53:11.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.233+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15b4154940 con 0x7f15b40d0df0 2023-12-19T17:53:11.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.237+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15b4155100 con 0x7f15b40d0df0 2023-12-19T17:53:11.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.237+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f15a00038e0 con 0x7f15b40d0df0 2023-12-19T17:53:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.241+0000 7f15b17fa700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1598065ad0 0x7f1598067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.241+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f15a0082360 con 0x7f15b40d0df0 2023-12-19T17:53:11.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.241+0000 7f15b88c8700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1598065ad0 0x7f1598067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.241+0000 7f15b88c8700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1598065ad0 0x7f1598067f90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009b50 tx=0x7f15a8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:11.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.245+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f15a004fe90 con 0x7f15b40d0df0 2023-12-19T17:53:11.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.421+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f15b404ed30 con 0x7f15b40d0df0 2023-12-19T17:53:11.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b17fa700 1 -- 172.21.15.45:0/2229117228 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f15a00534b0 con 0x7f15b40d0df0 2023-12-19T17:53:11.427 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:53:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1598065ad0 msgr2=0x7f1598067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1598065ad0 0x7f1598067f90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f15a8009b50 tx=0x7f15a8009240 comp rx=0 tx=0).stop 2023-12-19T17:53:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 msgr2=0x7f15b40c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 0x7f15b40c8800 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f15a000c500 tx=0x7f15a000c810 comp rx=0 tx=0).stop 2023-12-19T17:53:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 shutdown_connections 2023-12-19T17:53:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1598065ad0 0x7f1598067f90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f15b415ccf0 0x7f15b4155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f15b40d0df0 0x7f15b40c8800 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 --2- 172.21.15.45:0/2229117228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15b40cd940 0x7f15b40ccb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 >> 172.21.15.45:0/2229117228 conn(0x7f15b40b46f0 msgr2=0x7f15b415d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 shutdown_connections 2023-12-19T17:53:11.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.425+0000 7f15b98ca700 1 -- 172.21.15.45:0/2229117228 wait complete. 2023-12-19T17:53:11.451 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T17:53:11.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.653+0000 7f2044e0f700 1 Processor -- start 2023-12-19T17:53:11.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.653+0000 7f2044e0f700 1 -- start start 2023-12-19T17:53:11.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f2044e0f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20400b88b0 0x7f204006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f2044e0f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f204006f3b0 0x7f204006f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f2044e0f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20400d1820 con 0x7f204006ea90 2023-12-19T17:53:11.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f2044e0f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400d1630 con 0x7f20400b88b0 2023-12-19T17:53:11.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f2044e0f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20400d1b00 con 0x7f204006f3b0 2023-12-19T17:53:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f20400b88b0 0x7f204006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f204006f3b0 0x7f204006f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f204006ea90 0x7f20400d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56330/0 (socket says 172.21.15.45:56330) 2023-12-19T17:53:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203f7fe700 1 -- 172.21.15.45:0/2787846527 learned_addr learned my addr 172.21.15.45:0/2787846527 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203ffff700 1 -- 172.21.15.45:0/2787846527 >> v2:172.21.15.45:3300/0 conn(0x7f20400b88b0 msgr2=0x7f204006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203ffff700 1 --2- 172.21.15.45:0/2787846527 >> v2:172.21.15.45:3300/0 conn(0x7f20400b88b0 0x7f204006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203ffff700 1 -- 172.21.15.45:0/2787846527 >> v1:172.21.15.73:6789/0 conn(0x7f204006ea90 legacy=0x7f20400d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.657+0000 7f203ffff700 1 -- 172.21.15.45:0/2787846527 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20400d1de0 con 0x7f204006f3b0 2023-12-19T17:53:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f203ffff700 1 --2- 172.21.15.45:0/2787846527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f3b0 0x7f204006f820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f204008bc60 tx=0x7f203800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c06a1919e986a3ba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f203e7fc700 1 -- 172.21.15.45:0/2787846527 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203800e070 con 0x7f204006f3b0 2023-12-19T17:53:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f203e7fc700 1 -- 172.21.15.45:0/2787846527 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2038003a40 con 0x7f204006f3b0 2023-12-19T17:53:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f203e7fc700 1 -- 172.21.15.45:0/2787846527 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038003df0 con 0x7f204006f3b0 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 -- 172.21.15.45:0/2787846527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f3b0 msgr2=0x7f204006f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2787846527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f3b0 0x7f204006f820 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f204008bc60 tx=0x7f203800b330 comp rx=0 tx=0).stop 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 -- 172.21.15.45:0/2787846527 shutdown_connections 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2787846527 >> v2:172.21.15.45:3300/0 conn(0x7f20400b88b0 0x7f204006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2787846527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006f3b0 0x7f204006f820 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 -- 172.21.15.45:0/2787846527 >> 172.21.15.45:0/2787846527 conn(0x7f20400b46d0 msgr2=0x7f20400b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 -- 172.21.15.45:0/2787846527 shutdown_connections 2023-12-19T17:53:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.661+0000 7f2044e0f700 1 -- 172.21.15.45:0/2787846527 wait complete. 2023-12-19T17:53:11.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 Processor -- start 2023-12-19T17:53:11.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 -- start start 2023-12-19T17:53:11.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006ea90 0x7f20400c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f204006f3b0 0x7f204015e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 0x7f20401f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400cca30 con 0x7f20400b88b0 2023-12-19T17:53:11.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20400cbad0 con 0x7f204006ea90 2023-12-19T17:53:11.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f2044e0f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20400cbdb0 con 0x7f204006f3b0 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f203ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 0x7f20401f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f203ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 0x7f20401f8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57522/0 (socket says 172.21.15.45:57522) 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f203ffff700 1 -- 172.21.15.45:0/2045437062 learned_addr learned my addr 172.21.15.45:0/2045437062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f203effd700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f204006f3b0 0x7f204015e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.665+0000 7f203f7fe700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006ea90 0x7f20400c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f203ffff700 1 -- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f204006f3b0 msgr2=0x7f204015e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f203ffff700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f204006f3b0 0x7f204015e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f203ffff700 1 -- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006ea90 msgr2=0x7f20400c8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f203ffff700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006ea90 0x7f20400c8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f203ffff700 1 -- 172.21.15.45:0/2045437062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2038009a70 con 0x7f20400b88b0 2023-12-19T17:53:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f203ffff700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 0x7f20401f8f30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f203800b370 tx=0x7f2038004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038004540 con 0x7f20400b88b0 2023-12-19T17:53:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20380046c0 con 0x7f20400b88b0 2023-12-19T17:53:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2038012430 con 0x7f20400b88b0 2023-12-19T17:53:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20400cc090 con 0x7f20400b88b0 2023-12-19T17:53:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20400cc650 con 0x7f20400b88b0 2023-12-19T17:53:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.669+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20400ccb70 con 0x7f20400b88b0 2023-12-19T17:53:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.673+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2038012590 con 0x7f20400b88b0 2023-12-19T17:53:11.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.673+0000 7f2027fff700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:11.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.673+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f20380847e0 con 0x7f20400b88b0 2023-12-19T17:53:11.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.673+0000 7f203f7fe700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:11.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.677+0000 7f203f7fe700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20400cd1a0 tx=0x7f2030004a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:11.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.681+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f20400ccb70 con 0x7f20400b88b0 2023-12-19T17:53:11.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.861+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f20400ccb70 con 0x7f20400b88b0 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.861+0000 7f2027fff700 1 -- 172.21.15.45:0/2045437062 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f20400ccb70 con 0x7f20400b88b0 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:11.865 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 msgr2=0x7f202c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20400cd1a0 tx=0x7f2030004a70 comp rx=0 tx=0).stop 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 msgr2=0x7f20401f8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 0x7f20401f8f30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f203800b370 tx=0x7f2038004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 shutdown_connections 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f20400b88b0 0x7f20401f8f30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f204006f3b0 0x7f204015e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 --2- 172.21.15.45:0/2045437062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204006ea90 0x7f20400c8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 >> 172.21.15.45:0/2045437062 conn(0x7f20400b46d0 msgr2=0x7f2040070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 shutdown_connections 2023-12-19T17:53:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:11.865+0000 7f2044e0f700 1 -- 172.21.15.45:0/2045437062 wait complete. 2023-12-19T17:53:11.890 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T17:53:11.890 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T17:53:12.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.073+0000 7fa0e759e700 1 Processor -- start 2023-12-19T17:53:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.077+0000 7fa0e759e700 1 -- start start 2023-12-19T17:53:12.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.077+0000 7fa0e759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0e815d090 0x7fa0e80b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:12.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.077+0000 7fa0e759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80d15b0 con 0x7fa0e815ccb0 2023-12-19T17:53:12.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.077+0000 7fa0e759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e80d1890 con 0x7fa0e8071160 2023-12-19T17:53:12.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.077+0000 7fa0e759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e80d1b70 con 0x7fa0e815d090 2023-12-19T17:53:12.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa0e815ccb0 0x7fa0e8070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48400/0 (socket says 172.21.15.45:48400) 2023-12-19T17:53:12.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e659c700 1 -- 172.21.15.45:0/3371968232 learned_addr learned my addr 172.21.15.45:0/3371968232 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:12.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e6d9d700 1 --2- 172.21.15.45:0/3371968232 >> v2:172.21.15.45:3300/0 conn(0x7fa0e815d090 0x7fa0e80b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340609457 0 0) 0x7fa0e80d1890 con 0x7fa0e8071160 2023-12-19T17:53:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0d00035d0 con 0x7fa0e8071160 2023-12-19T17:53:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734127292 0 0) 0x7fa0e80d15b0 con 0x7fa0e815ccb0 2023-12-19T17:53:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0e80d1890 con 0x7fa0e815ccb0 2023-12-19T17:53:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3371968232 >> v1:172.21.15.73:6789/0 conn(0x7fa0e8071160 legacy=0x7fa0e80b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3371968232 >> v1:172.21.15.45:6789/0 conn(0x7fa0e815ccb0 legacy=0x7fa0e8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3371968232 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e80d1e50 con 0x7fa0e815d090 2023-12-19T17:53:12.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e6d9d700 1 --2- 172.21.15.45:0/3371968232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80b8900 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009d90 tx=0x7fa0e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=939d5637ae9bb580 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:12.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e000e070 con 0x7fa0e815d090 2023-12-19T17:53:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e000bb20 con 0x7fa0e815d090 2023-12-19T17:53:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e559a700 1 -- 172.21.15.45:0/3371968232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e0012430 con 0x7fa0e815d090 2023-12-19T17:53:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e759e700 1 -- 172.21.15.45:0/3371968232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 msgr2=0x7fa0e80b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.081+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3371968232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80b8900 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0009d90 tx=0x7fa0e000b330 comp rx=0 tx=0).stop 2023-12-19T17:53:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- 172.21.15.45:0/3371968232 shutdown_connections 2023-12-19T17:53:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3371968232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80b8900 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- 172.21.15.45:0/3371968232 >> 172.21.15.45:0/3371968232 conn(0x7fa0e80d2f50 msgr2=0x7fa0e80d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- 172.21.15.45:0/3371968232 shutdown_connections 2023-12-19T17:53:12.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- 172.21.15.45:0/3371968232 wait complete. 2023-12-19T17:53:12.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 Processor -- start 2023-12-19T17:53:12.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- start start 2023-12-19T17:53:12.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0e8071160 0x7fa0e8146a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:12.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e815ccb0 0x7fa0e81e4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:12.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e81e4ba0 con 0x7fa0e815d090 2023-12-19T17:53:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80cbc30 con 0x7fa0e815ccb0 2023-12-19T17:53:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.085+0000 7fa0e759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e80c8fc0 con 0x7fa0e8071160 2023-12-19T17:53:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57534/0 (socket says 172.21.15.45:57534) 2023-12-19T17:53:12.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3995534861 learned_addr learned my addr 172.21.15.45:0/3995534861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:12.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e659c700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0e8071160 0x7fa0e8146a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:12.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e5d9b700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e815ccb0 0x7fa0e81e4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:12.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0e8071160 msgr2=0x7fa0e8146a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0e8071160 0x7fa0e8146a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e815ccb0 msgr2=0x7fa0e81e4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e815ccb0 0x7fa0e81e4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 -- 172.21.15.45:0/3995534861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e0009a70 con 0x7fa0e815d090 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e6d9d700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80c8a80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8071980 tx=0x7fa0e0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e001c810 con 0x7fa0e815d090 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e0020070 con 0x7fa0e815d090 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e001cbb0 con 0x7fa0e815d090 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e81e76d0 con 0x7fa0e815d090 2023-12-19T17:53:12.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e80cb5e0 con 0x7fa0e815d090 2023-12-19T17:53:12.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.089+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e8067c10 con 0x7fa0e815d090 2023-12-19T17:53:12.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.093+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa0e001cd10 con 0x7fa0e815d090 2023-12-19T17:53:12.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.093+0000 7fa0d6ffd700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa0c8065ad0 0x7fa0c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:12.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.093+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa0e0022070 con 0x7fa0e815d090 2023-12-19T17:53:12.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.093+0000 7fa0e659c700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa0c8065ad0 0x7fa0c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:12.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.097+0000 7fa0e659c700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa0c8065ad0 0x7fa0c8067f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005930 tx=0x7fa0d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:12.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.101+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa0e0052af0 con 0x7fa0e815d090 2023-12-19T17:53:12.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.281+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa0e804ed30 con 0x7fa0e815d090 2023-12-19T17:53:12.876 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-19T17:53:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.933+0000 7fa0d6ffd700 1 -- 172.21.15.45:0/3995534861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa0e002c0b0 con 0x7fa0e815d090 2023-12-19T17:53:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa0c8065ad0 msgr2=0x7fa0c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa0c8065ad0 0x7fa0c8067f90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8005930 tx=0x7fa0d8009040 comp rx=0 tx=0).stop 2023-12-19T17:53:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 msgr2=0x7fa0e80c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:12.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80c8a80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fa0e8071980 tx=0x7fa0e0004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 shutdown_connections 2023-12-19T17:53:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa0c8065ad0 0x7fa0c8067f90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0e815d090 0x7fa0e80c8a80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e815ccb0 0x7fa0e81e4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 --2- 172.21.15.45:0/3995534861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa0e8071160 0x7fa0e8146a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:12.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 >> 172.21.15.45:0/3995534861 conn(0x7fa0e80d2f50 msgr2=0x7fa0e8157400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 shutdown_connections 2023-12-19T17:53:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:12.941+0000 7fa0e759e700 1 -- 172.21.15.45:0/3995534861 wait complete. 2023-12-19T17:53:12.949 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-19T17:53:12.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T17:53:13.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.177+0000 7fdd8af4d700 1 Processor -- start 2023-12-19T17:53:13.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.177+0000 7fdd8af4d700 1 -- start start 2023-12-19T17:53:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd8af4d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd8415d0b0 0x7fdd840b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd8af4d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd840b8b90 0x7fdd84160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd8af4d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd840b5dd0 con 0x7fdd841610c0 2023-12-19T17:53:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd8af4d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd84161550 con 0x7fdd840b8b90 2023-12-19T17:53:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd8af4d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840d1240 con 0x7fdd8415d0b0 2023-12-19T17:53:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd894ea700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdd841610c0 0x7fdd8406ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48408/0 (socket says 172.21.15.45:48408) 2023-12-19T17:53:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd894ea700 1 -- 172.21.15.45:0/3988498311 learned_addr learned my addr 172.21.15.45:0/3988498311 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd88ce9700 1 --2- 172.21.15.45:0/3988498311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd8415d0b0 0x7fdd840b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd83fff700 1 --2- 172.21.15.45:0/3988498311 >> v2:172.21.15.73:3300/0 conn(0x7fdd840b8b90 0x7fdd84160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd837fe700 1 -- 172.21.15.45:0/3988498311 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692855027 0 0) 0x7fdd840b5dd0 con 0x7fdd841610c0 2023-12-19T17:53:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd837fe700 1 -- 172.21.15.45:0/3988498311 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd740035d0 con 0x7fdd841610c0 2023-12-19T17:53:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd88ce9700 1 -- 172.21.15.45:0/3988498311 >> v2:172.21.15.73:3300/0 conn(0x7fdd840b8b90 msgr2=0x7fdd84160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd88ce9700 1 --2- 172.21.15.45:0/3988498311 >> v2:172.21.15.73:3300/0 conn(0x7fdd840b8b90 0x7fdd84160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd88ce9700 1 -- 172.21.15.45:0/3988498311 >> v1:172.21.15.45:6789/0 conn(0x7fdd841610c0 legacy=0x7fdd8406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd88ce9700 1 -- 172.21.15.45:0/3988498311 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8415d490 con 0x7fdd8415d0b0 2023-12-19T17:53:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd88ce9700 1 --2- 172.21.15.45:0/3988498311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd8415d0b0 0x7fdd840b8650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009850 tx=0x7fdd78009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33c774b6089356e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd837fe700 1 -- 172.21.15.45:0/3988498311 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011830 con 0x7fdd8415d0b0 2023-12-19T17:53:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd837fe700 1 -- 172.21.15.45:0/3988498311 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd78011990 con 0x7fdd8415d0b0 2023-12-19T17:53:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.181+0000 7fdd837fe700 1 -- 172.21.15.45:0/3988498311 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78011d40 con 0x7fdd8415d0b0 2023-12-19T17:53:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 -- 172.21.15.45:0/3988498311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd8415d0b0 msgr2=0x7fdd840b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/3988498311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd8415d0b0 0x7fdd840b8650 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fdd78009850 tx=0x7fdd78009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 -- 172.21.15.45:0/3988498311 shutdown_connections 2023-12-19T17:53:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/3988498311 >> v2:172.21.15.73:3300/0 conn(0x7fdd840b8b90 0x7fdd84160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/3988498311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd8415d0b0 0x7fdd840b8650 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 -- 172.21.15.45:0/3988498311 >> 172.21.15.45:0/3988498311 conn(0x7fdd840d2e10 msgr2=0x7fdd840d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 -- 172.21.15.45:0/3988498311 shutdown_connections 2023-12-19T17:53:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 -- 172.21.15.45:0/3988498311 wait complete. 2023-12-19T17:53:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 Processor -- start 2023-12-19T17:53:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.185+0000 7fdd8af4d700 1 -- start start 2023-12-19T17:53:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 0x7fdd841f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415d0b0 0x7fdd8406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd841610c0 0x7fdd8415ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840caf40 con 0x7fdd840b8b90 2023-12-19T17:53:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841f6b40 con 0x7fdd8415d0b0 2023-12-19T17:53:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840ca2c0 con 0x7fdd841610c0 2023-12-19T17:53:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 0x7fdd841f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 0x7fdd841f6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57538/0 (socket says 172.21.15.45:57538) 2023-12-19T17:53:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 -- 172.21.15.45:0/50296241 learned_addr learned my addr 172.21.15.45:0/50296241 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd83fff700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415d0b0 0x7fdd8406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd894ea700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd841610c0 0x7fdd8415ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 -- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd841610c0 msgr2=0x7fdd8415ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd841610c0 0x7fdd8415ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 -- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415d0b0 msgr2=0x7fdd8406ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415d0b0 0x7fdd8406ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 -- 172.21.15.45:0/50296241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd780094b0 con 0x7fdd840b8b90 2023-12-19T17:53:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd88ce9700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 0x7fdd841f6600 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdd840d1380 tx=0x7fdd78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd78004380 con 0x7fdd840b8b90 2023-12-19T17:53:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7801f070 con 0x7fdd840b8b90 2023-12-19T17:53:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd780036c0 con 0x7fdd840b8b90 2023-12-19T17:53:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd840ca5a0 con 0x7fdd840b8b90 2023-12-19T17:53:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.189+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840cab60 con 0x7fdd840b8b90 2023-12-19T17:53:13.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.193+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd8415d680 con 0x7fdd840b8b90 2023-12-19T17:53:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.193+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdd78021030 con 0x7fdd840b8b90 2023-12-19T17:53:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.197+0000 7fdd817fa700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd68065ad0 0x7fdd68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.197+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fdd78084610 con 0x7fdd840b8b90 2023-12-19T17:53:13.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.197+0000 7fdd83fff700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd68065ad0 0x7fdd68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:13.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.197+0000 7fdd83fff700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd68065ad0 0x7fdd68067f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd840cbab0 tx=0x7fdd70009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.201+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdd78052180 con 0x7fdd840b8b90 2023-12-19T17:53:13.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.381+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdd8404ed30 con 0x7fdd840b8b90 2023-12-19T17:53:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.953+0000 7fdd817fa700 1 -- 172.21.15.45:0/50296241 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdd78006ce0 con 0x7fdd840b8b90 2023-12-19T17:53:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.965+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd68065ad0 msgr2=0x7fdd68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.965+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd68065ad0 0x7fdd68067f90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fdd840cbab0 tx=0x7fdd70009240 comp rx=0 tx=0).stop 2023-12-19T17:53:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.965+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 msgr2=0x7fdd841f6600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.965+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 0x7fdd841f6600 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdd840d1380 tx=0x7fdd78004770 comp rx=0 tx=0).stop 2023-12-19T17:53:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 shutdown_connections 2023-12-19T17:53:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd68065ad0 0x7fdd68067f90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd841610c0 0x7fdd8415ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd8415d0b0 0x7fdd8406ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 --2- 172.21.15.45:0/50296241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd840b8b90 0x7fdd841f6600 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 >> 172.21.15.45:0/50296241 conn(0x7fdd840d2e10 msgr2=0x7fdd8415b270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 shutdown_connections 2023-12-19T17:53:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:13.973+0000 7fdd8af4d700 1 -- 172.21.15.45:0/50296241 wait complete. 2023-12-19T17:53:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-19T17:53:14.005 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T17:53:14.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.185+0000 7fc9cdafc700 1 Processor -- start 2023-12-19T17:53:14.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.185+0000 7fc9cdafc700 1 -- start start 2023-12-19T17:53:14.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cdafc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c81443e0 0x7fc9c80713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cdafc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9c80cba10 0x7fc9c80b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cdafc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c8071d70 con 0x7fc9c8071910 2023-12-19T17:53:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cdafc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80b1b80 con 0x7fc9c80cba10 2023-12-19T17:53:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cdafc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81447c0 con 0x7fc9c81443e0 2023-12-19T17:53:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9c7fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc9c8071910 0x7fc9c80cb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48422/0 (socket says 172.21.15.45:48422) 2023-12-19T17:53:14.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9c7fff700 1 -- 172.21.15.45:0/3913290301 learned_addr learned my addr 172.21.15.45:0/3913290301 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cd2fb700 1 --2- 172.21.15.45:0/3913290301 >> v2:172.21.15.73:3300/0 conn(0x7fc9c80cba10 0x7fc9c80b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9ccafa700 1 --2- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c81443e0 0x7fc9c80713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9c77fe700 1 -- 172.21.15.45:0/3913290301 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816724105 0 0) 0x7fc9c8071d70 con 0x7fc9c8071910 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9c77fe700 1 -- 172.21.15.45:0/3913290301 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9b80035d0 con 0x7fc9c8071910 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cd2fb700 1 -- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c81443e0 msgr2=0x7fc9c80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cd2fb700 1 --2- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c81443e0 0x7fc9c80713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9c77fe700 1 -- 172.21.15.45:0/3913290301 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3342130798 0 0) 0x7fc9b80035d0 con 0x7fc9c8071910 2023-12-19T17:53:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cd2fb700 1 -- 172.21.15.45:0/3913290301 >> v1:172.21.15.45:6789/0 conn(0x7fc9c8071910 legacy=0x7fc9c80cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cd2fb700 1 -- 172.21.15.45:0/3913290301 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80b1830 con 0x7fc9c80cba10 2023-12-19T17:53:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.189+0000 7fc9cd2fb700 1 --2- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c80cba10 0x7fc9c80b2010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009d90 tx=0x7fc9c000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44c56de4e84efeb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9c77fe700 1 -- 172.21.15.45:0/3913290301 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c000e070 con 0x7fc9c80cba10 2023-12-19T17:53:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9c77fe700 1 -- 172.21.15.45:0/3913290301 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c0003a90 con 0x7fc9c80cba10 2023-12-19T17:53:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9c77fe700 1 -- 172.21.15.45:0/3913290301 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4001670 con 0x7fc9c80cba10 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 -- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c80cba10 msgr2=0x7fc9c80b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c80cba10 0x7fc9c80b2010 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009d90 tx=0x7fc9c000b330 comp rx=0 tx=0).stop 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 -- 172.21.15.45:0/3913290301 shutdown_connections 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c80cba10 0x7fc9c80b2010 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/3913290301 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c81443e0 0x7fc9c80713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 -- 172.21.15.45:0/3913290301 >> 172.21.15.45:0/3913290301 conn(0x7fc9c80cf5a0 msgr2=0x7fc9c8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 -- 172.21.15.45:0/3913290301 shutdown_connections 2023-12-19T17:53:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.193+0000 7fc9cdafc700 1 -- 172.21.15.45:0/3913290301 wait complete. 2023-12-19T17:53:14.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 Processor -- start 2023-12-19T17:53:14.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 -- start start 2023-12-19T17:53:14.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 0x7fc9c815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c81443e0 0x7fc9c813f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c815daa0 0x7fc9c80af560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815d610 con 0x7fc9c80cba10 2023-12-19T17:53:14.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815ca00 con 0x7fc9c81443e0 2023-12-19T17:53:14.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cdafc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c815cce0 con 0x7fc9c815daa0 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 0x7fc9c815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 0x7fc9c815a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57552/0 (socket says 172.21.15.45:57552) 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 -- 172.21.15.45:0/1374643817 learned_addr learned my addr 172.21.15.45:0/1374643817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9cd2fb700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c815daa0 0x7fc9c80af560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9c7fff700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c81443e0 0x7fc9c813f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 -- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c815daa0 msgr2=0x7fc9c80af560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c815daa0 0x7fc9c80af560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 -- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c81443e0 msgr2=0x7fc9c813f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c81443e0 0x7fc9c813f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 -- 172.21.15.45:0/1374643817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c0009a70 con 0x7fc9c80cba10 2023-12-19T17:53:14.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9c7fff700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c81443e0 0x7fc9c813f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:14.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.197+0000 7fc9ccafa700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 0x7fc9c815a260 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00e9b0 tx=0x7fc9bc00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:14.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.201+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc009710 con 0x7fc9c80cba10 2023-12-19T17:53:14.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.201+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc00c850 con 0x7fc9c80cba10 2023-12-19T17:53:14.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.201+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc00cbc0 con 0x7fc9c80cba10 2023-12-19T17:53:14.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.201+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c815cfc0 con 0x7fc9c80cba10 2023-12-19T17:53:14.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.201+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c815a990 con 0x7fc9c80cba10 2023-12-19T17:53:14.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.201+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c804ed30 con 0x7fc9c80cba10 2023-12-19T17:53:14.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.205+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc9bc00cd20 con 0x7fc9c80cba10 2023-12-19T17:53:14.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.205+0000 7fc9c57fa700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc9ac065ad0 0x7fc9ac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.205+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fc9bc0835f0 con 0x7fc9c80cba10 2023-12-19T17:53:14.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.205+0000 7fc9c7fff700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc9ac065ad0 0x7fc9ac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.205+0000 7fc9c7fff700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc9ac065ad0 0x7fc9ac067f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4007fd0 tx=0x7fc9b4007b20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:14.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.213+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc9bc050f60 con 0x7fc9c80cba10 2023-12-19T17:53:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.425+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc9c80b0ce0 con 0x7fc9c80cba10 2023-12-19T17:53:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.437+0000 7fc9c57fa700 1 -- 172.21.15.45:0/1374643817 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc9bc081e60 con 0x7fc9c80cba10 2023-12-19T17:53:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc9ac065ad0 msgr2=0x7fc9ac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc9ac065ad0 0x7fc9ac067f90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9b4007fd0 tx=0x7fc9b4007b20 comp rx=0 tx=0).stop 2023-12-19T17:53:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 msgr2=0x7fc9c815a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 0x7fc9c815a260 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00e9b0 tx=0x7fc9bc00ecc0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 shutdown_connections 2023-12-19T17:53:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc9ac065ad0 0x7fc9ac067f90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9c815daa0 0x7fc9c80af560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9c81443e0 0x7fc9c813f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 --2- 172.21.15.45:0/1374643817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9c80cba10 0x7fc9c815a260 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.445+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 >> 172.21.15.45:0/1374643817 conn(0x7fc9c8071910 msgr2=0x7fc9c815e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.449+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 shutdown_connections 2023-12-19T17:53:14.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.449+0000 7fc9cdafc700 1 -- 172.21.15.45:0/1374643817 wait complete. 2023-12-19T17:53:14.462 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 5 and data pool 6 2023-12-19T17:53:14.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.657+0000 7fcf617ef700 1 Processor -- start 2023-12-19T17:53:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.657+0000 7fcf617ef700 1 -- start start 2023-12-19T17:53:14.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.657+0000 7fcf617ef700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf5c06ea90 0x7fcf5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.657+0000 7fcf617ef700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcf5c06fe80 0x7fcf5c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0d1820 con 0x7fcf5c0b88b0 2023-12-19T17:53:14.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0d1b00 con 0x7fcf5c06ea90 2023-12-19T17:53:14.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0d1de0 con 0x7fcf5c06fe80 2023-12-19T17:53:14.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf5c06ea90 0x7fcf5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf5c06ea90 0x7fcf5c0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57554/0 (socket says 172.21.15.45:57554) 2023-12-19T17:53:14.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 -- 172.21.15.45:0/811059660 learned_addr learned my addr 172.21.15.45:0/811059660 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:14.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf60fee700 1 --2- 172.21.15.45:0/811059660 >> v2:172.21.15.73:3300/0 conn(0x7fcf5c06fe80 0x7fcf5c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 -- 172.21.15.45:0/811059660 >> v2:172.21.15.73:3300/0 conn(0x7fcf5c06fe80 msgr2=0x7fcf5c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:14.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 --2- 172.21.15.45:0/811059660 >> v2:172.21.15.73:3300/0 conn(0x7fcf5c06fe80 0x7fcf5c0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 -- 172.21.15.45:0/811059660 >> v1:172.21.15.73:6789/0 conn(0x7fcf5c0b88b0 legacy=0x7fcf5c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 -- 172.21.15.45:0/811059660 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0d20c0 con 0x7fcf5c06ea90 2023-12-19T17:53:14.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5bfff700 1 --2- 172.21.15.45:0/811059660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0d0f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c08bc60 tx=0x7fcf4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a400adc1c13bee2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:14.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5b7fe700 1 -- 172.21.15.45:0/811059660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00e070 con 0x7fcf5c06ea90 2023-12-19T17:53:14.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5b7fe700 1 -- 172.21.15.45:0/811059660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00b910 con 0x7fcf5c06ea90 2023-12-19T17:53:14.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf5b7fe700 1 -- 172.21.15.45:0/811059660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00bcc0 con 0x7fcf5c06ea90 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 -- 172.21.15.45:0/811059660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 msgr2=0x7fcf5c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 --2- 172.21.15.45:0/811059660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0d0f20 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c08bc60 tx=0x7fcf4c00b330 comp rx=0 tx=0).stop 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 -- 172.21.15.45:0/811059660 shutdown_connections 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 --2- 172.21.15.45:0/811059660 >> v2:172.21.15.73:3300/0 conn(0x7fcf5c06fe80 0x7fcf5c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 --2- 172.21.15.45:0/811059660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0d0f20 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.661+0000 7fcf617ef700 1 -- 172.21.15.45:0/811059660 >> 172.21.15.45:0/811059660 conn(0x7fcf5c0b46d0 msgr2=0x7fcf5c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.665+0000 7fcf617ef700 1 -- 172.21.15.45:0/811059660 shutdown_connections 2023-12-19T17:53:14.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.665+0000 7fcf617ef700 1 -- 172.21.15.45:0/811059660 wait complete. 2023-12-19T17:53:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.665+0000 7fcf617ef700 1 Processor -- start 2023-12-19T17:53:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.665+0000 7fcf617ef700 1 -- start start 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf5c06fe80 0x7fcf5c0cb170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf5c0b88b0 0x7fcf5c0b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c14de80 con 0x7fcf5c06ea90 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0ca9c0 con 0x7fcf5c06fe80 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c14a8c0 con 0x7fcf5c0b88b0 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57568/0 (socket says 172.21.15.45:57568) 2023-12-19T17:53:14.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 -- 172.21.15.45:0/1373848613 learned_addr learned my addr 172.21.15.45:0/1373848613 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf537fe700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf5c06fe80 0x7fcf5c0cb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 -- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf5c0b88b0 msgr2=0x7fcf5c0b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf60fee700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf5c0b88b0 0x7fcf5c0b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf5c0b88b0 0x7fcf5c0b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 -- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf5c06fe80 msgr2=0x7fcf5c0cb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf5c06fe80 0x7fcf5c0cb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 -- 172.21.15.45:0/1373848613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c009b30 con 0x7fcf5c06ea90 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf537fe700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf5c06fe80 0x7fcf5c0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf60fee700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf5c0b88b0 0x7fcf5c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf5bfff700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0ca480 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c072a40 tx=0x7fcf4c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c0099b0 con 0x7fcf5c06ea90 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c0092e0 con 0x7fcf5c06ea90 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0c6c10 con 0x7fcf5c06ea90 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c01b650 con 0x7fcf5c06ea90 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.669+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0c71d0 con 0x7fcf5c06ea90 2023-12-19T17:53:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.673+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c067760 con 0x7fcf5c06ea90 2023-12-19T17:53:14.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.673+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf4c01b7b0 con 0x7fcf5c06ea90 2023-12-19T17:53:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.673+0000 7fcf597fa700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf3c065ad0 0x7fcf3c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.677+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf4c084900 con 0x7fcf5c06ea90 2023-12-19T17:53:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.677+0000 7fcf537fe700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf3c065ad0 0x7fcf3c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:14.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.677+0000 7fcf537fe700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf3c065ad0 0x7fcf3c067f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c14da80 tx=0x7fcf44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.681+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcf4c052170 con 0x7fcf5c06ea90 2023-12-19T17:53:14.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.853+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf5c066a60 con 0x7fcf5c06ea90 2023-12-19T17:53:14.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.857+0000 7fcf597fa700 1 -- 172.21.15.45:0/1373848613 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16271 (secure 0 0 0) 0x7fcf4c01f090 con 0x7fcf5c06ea90 2023-12-19T17:53:14.861 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:14.861 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:14.428398+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf3c065ad0 msgr2=0x7fcf3c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf3c065ad0 0x7fcf3c067f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c14da80 tx=0x7fcf44009040 comp rx=0 tx=0).stop 2023-12-19T17:53:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 msgr2=0x7fcf5c0ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:14.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0ca480 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c072a40 tx=0x7fcf4c004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 shutdown_connections 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf3c065ad0 0x7fcf3c067f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf5c0b88b0 0x7fcf5c0b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf5c06fe80 0x7fcf5c0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 --2- 172.21.15.45:0/1373848613 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf5c06ea90 0x7fcf5c0ca480 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 >> 172.21.15.45:0/1373848613 conn(0x7fcf5c0b46d0 msgr2=0x7fcf5c0b3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 shutdown_connections 2023-12-19T17:53:14.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:14.861+0000 7fcf617ef700 1 -- 172.21.15.45:0/1373848613 wait complete. 2023-12-19T17:53:14.888 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.065+0000 7f7171901700 1 Processor -- start 2023-12-19T17:53:15.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.065+0000 7f7171901700 1 -- start start 2023-12-19T17:53:15.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.069+0000 7f7171901700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c159dd0 0x7f716c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.069+0000 7f7171901700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f716c0ade00 0x7f716c0c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.069+0000 7f7171901700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f716c15e6d0 con 0x7f716c06c850 2023-12-19T17:53:15.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.069+0000 7f7171901700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716c0c4ca0 con 0x7f716c0ade00 2023-12-19T17:53:15.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.069+0000 7f7171901700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c15a1b0 con 0x7f716c159dd0 2023-12-19T17:53:15.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f716c06c850 0x7f716c06cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56358/0 (socket says 172.21.15.45:56358) 2023-12-19T17:53:15.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7163fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f716c0ade00 0x7f716c0c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c159dd0 0x7f716c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716b7fe700 1 -- 172.21.15.45:0/3959886962 learned_addr learned my addr 172.21.15.45:0/3959886962 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716affd700 1 -- 172.21.15.45:0/3959886962 >> v2:172.21.15.45:3300/0 conn(0x7f716c0ade00 msgr2=0x7f716c0c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716affd700 1 --2- 172.21.15.45:0/3959886962 >> v2:172.21.15.45:3300/0 conn(0x7f716c0ade00 0x7f716c0c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716affd700 1 -- 172.21.15.45:0/3959886962 >> v1:172.21.15.73:6789/0 conn(0x7f716c06c850 legacy=0x7f716c06cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716affd700 1 -- 172.21.15.45:0/3959886962 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716c070110 con 0x7f716c159dd0 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7163fff700 1 --2- 172.21.15.45:0/3959886962 >> v2:172.21.15.45:3300/0 conn(0x7f716c0ade00 0x7f716c0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716a7fc700 1 -- 172.21.15.45:0/3959886962 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493280297 0 0) 0x7f716c15e6d0 con 0x7f716c06c850 2023-12-19T17:53:15.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716affd700 1 --2- 172.21.15.45:0/3959886962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c159dd0 0x7f716c0cc560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f715c009850 tx=0x7f715c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa213d492ffacdcd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716a7fc700 1 -- 172.21.15.45:0/3959886962 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c011830 con 0x7f716c159dd0 2023-12-19T17:53:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716a7fc700 1 -- 172.21.15.45:0/3959886962 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c011990 con 0x7f716c159dd0 2023-12-19T17:53:15.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f716a7fc700 1 -- 172.21.15.45:0/3959886962 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c011d40 con 0x7f716c159dd0 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 -- 172.21.15.45:0/3959886962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c159dd0 msgr2=0x7f716c0cc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 --2- 172.21.15.45:0/3959886962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c159dd0 0x7f716c0cc560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f715c009850 tx=0x7f715c009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 -- 172.21.15.45:0/3959886962 shutdown_connections 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 --2- 172.21.15.45:0/3959886962 >> v2:172.21.15.45:3300/0 conn(0x7f716c0ade00 0x7f716c0c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 --2- 172.21.15.45:0/3959886962 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c159dd0 0x7f716c0cc560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 -- 172.21.15.45:0/3959886962 >> 172.21.15.45:0/3959886962 conn(0x7f716c0cba40 msgr2=0x7f716c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:15.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 -- 172.21.15.45:0/3959886962 shutdown_connections 2023-12-19T17:53:15.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.073+0000 7f7171901700 1 -- 172.21.15.45:0/3959886962 wait complete. 2023-12-19T17:53:15.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 Processor -- start 2023-12-19T17:53:15.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 -- start start 2023-12-19T17:53:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 0x7f716c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c0ade00 0x7f716c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f716c159dd0 0x7f716c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1f3380 con 0x7f716c06c850 2023-12-19T17:53:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1f2700 con 0x7f716c159dd0 2023-12-19T17:53:15.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f7171901700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f716c1f29e0 con 0x7f716c0ade00 2023-12-19T17:53:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f716affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 0x7f716c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f716affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 0x7f716c0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57578/0 (socket says 172.21.15.45:57578) 2023-12-19T17:53:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.077+0000 7f716affd700 1 -- 172.21.15.45:0/3196924651 learned_addr learned my addr 172.21.15.45:0/3196924651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7163fff700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c0ade00 0x7f716c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716b7fe700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f716c159dd0 0x7f716c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716affd700 1 -- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c0ade00 msgr2=0x7f716c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716affd700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c0ade00 0x7f716c0ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716affd700 1 -- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f716c159dd0 msgr2=0x7f716c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716affd700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f716c159dd0 0x7f716c152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716affd700 1 -- 172.21.15.45:0/3196924651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71540094b0 con 0x7f716c06c850 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f716affd700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 0x7f716c0b3f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f715c014040 tx=0x7f715c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:15.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c019b60 con 0x7f716c06c850 2023-12-19T17:53:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c01e070 con 0x7f716c06c850 2023-12-19T17:53:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f715c0094b0 con 0x7f716c06c850 2023-12-19T17:53:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c01a420 con 0x7f716c06c850 2023-12-19T17:53:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c1f2fa0 con 0x7f716c06c850 2023-12-19T17:53:15.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.081+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c1f34c0 con 0x7f716c06c850 2023-12-19T17:53:15.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.085+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f715c01a580 con 0x7f716c06c850 2023-12-19T17:53:15.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.085+0000 7f7168ff9700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f714c065ad0 0x7f714c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.085+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f715c0843e0 con 0x7f716c06c850 2023-12-19T17:53:15.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.089+0000 7f7163fff700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f714c065ad0 0x7f714c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.089+0000 7f7163fff700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f714c065ad0 0x7f714c067f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f716c1557f0 tx=0x7f7154008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:15.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.093+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f716c1f34c0 con 0x7f716c06c850 2023-12-19T17:53:15.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.273+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f716c1f34c0 con 0x7f716c06c850 2023-12-19T17:53:15.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7168ff9700 1 -- 172.21.15.45:0/3196924651 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16271 (secure 0 0 0) 0x7f716c1f34c0 con 0x7f716c06c850 2023-12-19T17:53:15.279 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:15.279 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":38,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:14.428398+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f714c065ad0 msgr2=0x7f714c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f714c065ad0 0x7f714c067f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f716c1557f0 tx=0x7f7154008040 comp rx=0 tx=0).stop 2023-12-19T17:53:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 msgr2=0x7f716c0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 0x7f716c0b3f20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f715c014040 tx=0x7f715c004770 comp rx=0 tx=0).stop 2023-12-19T17:53:15.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 shutdown_connections 2023-12-19T17:53:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f714c065ad0 0x7f714c067f90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f716c159dd0 0x7f716c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f716c0ade00 0x7f716c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 --2- 172.21.15.45:0/3196924651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f716c06c850 0x7f716c0b3f20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 >> 172.21.15.45:0/3196924651 conn(0x7f716c0cba40 msgr2=0x7f716c0cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:15.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 shutdown_connections 2023-12-19T17:53:15.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.277+0000 7f7171901700 1 -- 172.21.15.45:0/3196924651 wait complete. 2023-12-19T17:53:15.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T17:53:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f1a66700 1 Processor -- start 2023-12-19T17:53:15.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f1a66700 1 -- start start 2023-12-19T17:53:15.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f1a66700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc3ec0b8580 0x7fc3ec0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f1a66700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec15d300 con 0x7fc3ec15cf20 2023-12-19T17:53:15.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f1a66700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3ec0d1550 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f1a66700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3ec0d1360 con 0x7fc3ec0b8580 2023-12-19T17:53:15.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f0a64700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc3ec15cf20 0x7fc3ec0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48432/0 (socket says 172.21.15.45:48432) 2023-12-19T17:53:15.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3f0a64700 1 -- 172.21.15.45:0/3078912221 learned_addr learned my addr 172.21.15.45:0/3078912221 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:15.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.485+0000 7fc3ebfff700 1 --2- 172.21.15.45:0/3078912221 >> v2:172.21.15.45:3300/0 conn(0x7fc3ec0b8580 0x7fc3ec0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262875485 0 0) 0x7fc3ec15d300 con 0x7fc3ec15cf20 2023-12-19T17:53:15.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3dc0035d0 con 0x7fc3ec15cf20 2023-12-19T17:53:15.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 423775149 0 0) 0x7fc3ec0d1550 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ec15d300 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3078912221 >> v1:172.21.15.73:6789/0 conn(0x7fc3ec0d25f0 legacy=0x7fc3ec0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3078912221 >> v1:172.21.15.45:6789/0 conn(0x7fc3ec15cf20 legacy=0x7fc3ec0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3078912221 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ec0d1830 con 0x7fc3ec0b8580 2023-12-19T17:53:15.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3ebfff700 1 --2- 172.21.15.45:0/3078912221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0b8580 0x7fc3ec0cd8c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009850 tx=0x7fc3d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644f43070e37a429 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:15.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8011830 con 0x7fc3ec0b8580 2023-12-19T17:53:15.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d8011990 con 0x7fc3ec0b8580 2023-12-19T17:53:15.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3eb7fe700 1 -- 172.21.15.45:0/3078912221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d8011d40 con 0x7fc3ec0b8580 2023-12-19T17:53:15.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3078912221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0b8580 msgr2=0x7fc3ec0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3078912221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0b8580 0x7fc3ec0cd8c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009850 tx=0x7fc3d8009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:15.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3078912221 shutdown_connections 2023-12-19T17:53:15.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3078912221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0b8580 0x7fc3ec0cd8c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3078912221 >> 172.21.15.45:0/3078912221 conn(0x7fc3ec0b4670 msgr2=0x7fc3ec0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:15.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3078912221 shutdown_connections 2023-12-19T17:53:15.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.489+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3078912221 wait complete. 2023-12-19T17:53:15.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.493+0000 7fc3f1a66700 1 Processor -- start 2023-12-19T17:53:15.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.493+0000 7fc3f1a66700 1 -- start start 2023-12-19T17:53:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3ec0b8580 0x7fc3ec156270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 0x7fc3ec157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3ec15cf20 0x7fc3ec0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1fadb0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec1fa920 con 0x7fc3ec15cf20 2023-12-19T17:53:15.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ec157ae0 con 0x7fc3ec0b8580 2023-12-19T17:53:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 0x7fc3ec157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 0x7fc3ec157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57602/0 (socket says 172.21.15.45:57602) 2023-12-19T17:53:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3156141898 learned_addr learned my addr 172.21.15.45:0/3156141898 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:15.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f0a64700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3ec0b8580 0x7fc3ec156270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1265700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3ec15cf20 0x7fc3ec0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3ec0b8580 msgr2=0x7fc3ec156270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3ec0b8580 0x7fc3ec156270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3ec15cf20 msgr2=0x7fc3ec0b6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3ec15cf20 0x7fc3ec0b6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 -- 172.21.15.45:0/3156141898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80094b0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1265700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3ec15cf20 0x7fc3ec0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3ebfff700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 0x7fc3ec157290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009eb0 tx=0x7fc3d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d801aa10 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d801f070 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3ec1f9ff0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d801adf0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.497+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3ec1fa5b0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.501+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3ec1faad0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.501+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc3d801b430 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.501+0000 7fc3e97fa700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc3d0065b00 0x7fc3d0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.501+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc3d80842e0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.501+0000 7fc3f0a64700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc3d0065b00 0x7fc3d0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:15.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.505+0000 7fc3f0a64700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc3d0065b00 0x7fc3d0067fc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000f60 tx=0x7fc3e0007e20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:15.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.509+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc3ec1faad0 con 0x7fc3ec0d25f0 2023-12-19T17:53:15.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:15.741+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc3ec1faad0 con 0x7fc3ec0d25f0 2023-12-19T17:53:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.453+0000 7fc3e97fa700 1 -- 172.21.15.45:0/3156141898 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc3ec1faad0 con 0x7fc3ec0d25f0 2023-12-19T17:53:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc3d0065b00 msgr2=0x7fc3d0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc3d0065b00 0x7fc3d0067fc0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000f60 tx=0x7fc3e0007e20 comp rx=0 tx=0).stop 2023-12-19T17:53:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 msgr2=0x7fc3ec157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 0x7fc3ec157290 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009eb0 tx=0x7fc3d8004770 comp rx=0 tx=0).stop 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 shutdown_connections 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc3d0065b00 0x7fc3d0067fc0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc3ec15cf20 0x7fc3ec0b6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc3ec0d25f0 0x7fc3ec157290 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 --2- 172.21.15.45:0/3156141898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc3ec0b8580 0x7fc3ec156270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 >> 172.21.15.45:0/3156141898 conn(0x7fc3ec0b4670 msgr2=0x7fc3ec0b2ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:16.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 shutdown_connections 2023-12-19T17:53:16.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.457+0000 7fc3f1a66700 1 -- 172.21.15.45:0/3156141898 wait complete. 2023-12-19T17:53:16.488 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T17:53:16.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T17:53:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.677+0000 7fbc2b24c700 1 Processor -- start 2023-12-19T17:53:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.677+0000 7fbc2b24c700 1 -- start start 2023-12-19T17:53:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.677+0000 7fbc2b24c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc240b8580 0x7fbc240cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.677+0000 7fbc2b24c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc2415d300 con 0x7fbc2415cf20 2023-12-19T17:53:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc2b24c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240d1550 con 0x7fbc240d25f0 2023-12-19T17:53:16.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc2b24c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc240d1360 con 0x7fbc240b8580 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc2a24a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbc2415cf20 0x7fbc240d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48440/0 (socket says 172.21.15.45:48440) 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc2a24a700 1 -- 172.21.15.45:0/2462793856 learned_addr learned my addr 172.21.15.45:0/2462793856 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29a49700 1 --2- 172.21.15.45:0/2462793856 >> v2:172.21.15.73:3300/0 conn(0x7fbc240b8580 0x7fbc240cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29248700 1 -- 172.21.15.45:0/2462793856 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653788690 0 0) 0x7fbc2415d300 con 0x7fbc2415cf20 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29a49700 1 -- 172.21.15.45:0/2462793856 >> v1:172.21.15.73:6789/0 conn(0x7fbc240d25f0 legacy=0x7fbc240b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29a49700 1 -- 172.21.15.45:0/2462793856 >> v1:172.21.15.45:6789/0 conn(0x7fbc2415cf20 legacy=0x7fbc240d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29a49700 1 -- 172.21.15.45:0/2462793856 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240d1830 con 0x7fbc240b8580 2023-12-19T17:53:16.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29a49700 1 --2- 172.21.15.45:0/2462793856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240b8580 0x7fbc240cd8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009850 tx=0x7fbc14009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9640e333a3076d0d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:16.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29248700 1 -- 172.21.15.45:0/2462793856 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14011830 con 0x7fbc240b8580 2023-12-19T17:53:16.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29248700 1 -- 172.21.15.45:0/2462793856 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc14011990 con 0x7fbc240b8580 2023-12-19T17:53:16.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc29248700 1 -- 172.21.15.45:0/2462793856 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc14011d20 con 0x7fbc240b8580 2023-12-19T17:53:16.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc2b24c700 1 -- 172.21.15.45:0/2462793856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240b8580 msgr2=0x7fbc240cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.681+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/2462793856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240b8580 0x7fbc240cd8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbc14009850 tx=0x7fbc14009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:16.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.685+0000 7fbc2b24c700 1 -- 172.21.15.45:0/2462793856 shutdown_connections 2023-12-19T17:53:16.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.685+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/2462793856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240b8580 0x7fbc240cd8c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.685+0000 7fbc2b24c700 1 -- 172.21.15.45:0/2462793856 >> 172.21.15.45:0/2462793856 conn(0x7fbc240b4670 msgr2=0x7fbc240b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:16.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.685+0000 7fbc2b24c700 1 -- 172.21.15.45:0/2462793856 shutdown_connections 2023-12-19T17:53:16.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.685+0000 7fbc2b24c700 1 -- 172.21.15.45:0/2462793856 wait complete. 2023-12-19T17:53:16.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 Processor -- start 2023-12-19T17:53:16.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 -- start start 2023-12-19T17:53:16.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 0x7fbc2415a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:16.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240d25f0 0x7fbc240cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:16.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc2415cf20 0x7fbc240cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:16.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2415acb0 con 0x7fbc240b8580 2023-12-19T17:53:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2415ff80 con 0x7fbc2415cf20 2023-12-19T17:53:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2b24c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2415f370 con 0x7fbc240d25f0 2023-12-19T17:53:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 0x7fbc2415a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 0x7fbc2415a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57612/0 (socket says 172.21.15.45:57612) 2023-12-19T17:53:16.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 -- 172.21.15.45:0/1136440476 learned_addr learned my addr 172.21.15.45:0/1136440476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2aa4b700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc2415cf20 0x7fbc240cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc29a49700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240d25f0 0x7fbc240cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 -- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240d25f0 msgr2=0x7fbc240cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240d25f0 0x7fbc240cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 -- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc2415cf20 msgr2=0x7fbc240cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc2415cf20 0x7fbc240cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.689+0000 7fbc2a24a700 1 -- 172.21.15.45:0/1136440476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc140094b0 con 0x7fbc240b8580 2023-12-19T17:53:16.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc2a24a700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 0x7fbc2415a770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c4a0 tx=0x7fbc2000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20004ca0 con 0x7fbc240b8580 2023-12-19T17:53:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc20004e00 con 0x7fbc240b8580 2023-12-19T17:53:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2415f650 con 0x7fbc240b8580 2023-12-19T17:53:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc20007310 con 0x7fbc240b8580 2023-12-19T17:53:16.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2415fc10 con 0x7fbc240b8580 2023-12-19T17:53:16.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.693+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2404ed30 con 0x7fbc240b8580 2023-12-19T17:53:16.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.697+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc20007470 con 0x7fbc240b8580 2023-12-19T17:53:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.697+0000 7fbc1affd700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.697+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fbc20082fe0 con 0x7fbc240b8580 2023-12-19T17:53:16.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.701+0000 7fbc29a49700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:16.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.701+0000 7fbc29a49700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc140090b0 tx=0x7fbc14008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:16.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.705+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbc20050820 con 0x7fbc240b8580 2023-12-19T17:53:16.912 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:53:16.907+0000 7fc92a92f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:53:16.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:16.921+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fbc2415ae10 con 0x7fbc240b8580 2023-12-19T17:53:17.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.457+0000 7fbc1affd700 1 -- 172.21.15.45:0/1136440476 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbc20007720 con 0x7fbc240b8580 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 msgr2=0x7fbc08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fbc140090b0 tx=0x7fbc14008030 comp rx=0 tx=0).stop 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 msgr2=0x7fbc2415a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 0x7fbc2415a770 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbc2000c4a0 tx=0x7fbc2000c860 comp rx=0 tx=0).stop 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 shutdown_connections 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc2415cf20 0x7fbc240cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240d25f0 0x7fbc240cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 --2- 172.21.15.45:0/1136440476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240b8580 0x7fbc2415a770 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 >> 172.21.15.45:0/1136440476 conn(0x7fbc240b4670 msgr2=0x7fbc2415c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 shutdown_connections 2023-12-19T17:53:17.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.461+0000 7fbc2b24c700 1 -- 172.21.15.45:0/1136440476 wait complete. 2023-12-19T17:53:17.492 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T17:53:17.492 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d91b7700 1 Processor -- start 2023-12-19T17:53:17.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d91b7700 1 -- start start 2023-12-19T17:53:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d91b7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d40afe30 0x7f31d40c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d91b7700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d4070340 con 0x7f31d41611c0 2023-12-19T17:53:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d91b7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d40c3f90 con 0x7f31d41615a0 2023-12-19T17:53:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d91b7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c4270 con 0x7f31d40afe30 2023-12-19T17:53:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f31d41611c0 0x7f31d406d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48454/0 (socket says 172.21.15.45:48454) 2023-12-19T17:53:17.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d3fff700 1 -- 172.21.15.45:0/930566727 learned_addr learned my addr 172.21.15.45:0/930566727 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.673+0000 7f31d89b6700 1 --2- 172.21.15.45:0/930566727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d40afe30 0x7f31d40c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d37fe700 1 -- 172.21.15.45:0/930566727 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591080211 0 0) 0x7f31d4070340 con 0x7f31d41611c0 2023-12-19T17:53:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d37fe700 1 -- 172.21.15.45:0/930566727 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31b40035d0 con 0x7f31d41611c0 2023-12-19T17:53:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d89b6700 1 -- 172.21.15.45:0/930566727 >> v1:172.21.15.73:6789/0 conn(0x7f31d41615a0 legacy=0x7f31d40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d89b6700 1 -- 172.21.15.45:0/930566727 >> v1:172.21.15.45:6789/0 conn(0x7f31d41611c0 legacy=0x7f31d406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d89b6700 1 -- 172.21.15.45:0/930566727 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d406eb30 con 0x7f31d40afe30 2023-12-19T17:53:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d89b6700 1 --2- 172.21.15.45:0/930566727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d40afe30 0x7f31d40c3920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009dc0 tx=0x7f31cc00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebeda3004d1de223 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d37fe700 1 -- 172.21.15.45:0/930566727 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00e070 con 0x7f31d40afe30 2023-12-19T17:53:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d37fe700 1 -- 172.21.15.45:0/930566727 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00bb20 con 0x7f31d40afe30 2023-12-19T17:53:17.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d37fe700 1 -- 172.21.15.45:0/930566727 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc012430 con 0x7f31d40afe30 2023-12-19T17:53:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 -- 172.21.15.45:0/930566727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d40afe30 msgr2=0x7f31d40c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 --2- 172.21.15.45:0/930566727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d40afe30 0x7f31d40c3920 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f31cc009dc0 tx=0x7f31cc00b330 comp rx=0 tx=0).stop 2023-12-19T17:53:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 -- 172.21.15.45:0/930566727 shutdown_connections 2023-12-19T17:53:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 --2- 172.21.15.45:0/930566727 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d40afe30 0x7f31d40c3920 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 -- 172.21.15.45:0/930566727 >> 172.21.15.45:0/930566727 conn(0x7f31d40cb900 msgr2=0x7f31d40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 -- 172.21.15.45:0/930566727 shutdown_connections 2023-12-19T17:53:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.677+0000 7f31d91b7700 1 -- 172.21.15.45:0/930566727 wait complete. 2023-12-19T17:53:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 Processor -- start 2023-12-19T17:53:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 -- start start 2023-12-19T17:53:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40afe30 0x7f31d4162400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d41611c0 0x7f31d40c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 0x7f31d41632b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c6830 con 0x7f31d41615a0 2023-12-19T17:53:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c6270 con 0x7f31d40afe30 2023-12-19T17:53:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d91b7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40c6550 con 0x7f31d41611c0 2023-12-19T17:53:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 0x7f31d41632b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 0x7f31d41632b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57628/0 (socket says 172.21.15.45:57628) 2023-12-19T17:53:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 -- 172.21.15.45:0/3770859605 learned_addr learned my addr 172.21.15.45:0/3770859605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d3fff700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40afe30 0x7f31d4162400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31cbfff700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d41611c0 0x7f31d40c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 -- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d41611c0 msgr2=0x7f31d40c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d41611c0 0x7f31d40c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 -- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40afe30 msgr2=0x7f31d4162400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40afe30 0x7f31d4162400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.681+0000 7f31d89b6700 1 -- 172.21.15.45:0/3770859605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc009a70 con 0x7f31d41615a0 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d89b6700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 0x7f31d41632b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f31d4070510 tx=0x7f31cc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc012430 con 0x7f31d41615a0 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc020070 con 0x7f31d41615a0 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d4161c00 con 0x7f31d41615a0 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc004280 con 0x7f31d41615a0 2023-12-19T17:53:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d4162940 con 0x7f31d41615a0 2023-12-19T17:53:17.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.685+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d406e760 con 0x7f31d41615a0 2023-12-19T17:53:17.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.689+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31cc0043e0 con 0x7f31d41615a0 2023-12-19T17:53:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.689+0000 7f31d17fa700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31b8065ad0 0x7f31b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.689+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f31cc022070 con 0x7f31d41615a0 2023-12-19T17:53:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.689+0000 7f31d3fff700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31b8065ad0 0x7f31b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.689+0000 7f31d3fff700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31b8065ad0 0x7f31b8067f90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31c40011e0 tx=0x7f31c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.697+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31cc052c70 con 0x7f31d41615a0 2023-12-19T17:53:17.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.909+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f31d4161a60 con 0x7f31d41615a0 2023-12-19T17:53:17.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.909+0000 7f31d17fa700 1 -- 172.21.15.45:0/3770859605 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f31d4161a60 con 0x7f31d41615a0 2023-12-19T17:53:17.912 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:17.912 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:14.429162+0000","modified":"2023-12-19T17:53:17.452125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3731258594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3731258594},{"type":"v1","addr":"172.21.15.73:6835","nonce":3731258594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:17.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31b8065ad0 msgr2=0x7f31b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31b8065ad0 0x7f31b8067f90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f31c40011e0 tx=0x7f31c4009040 comp rx=0 tx=0).stop 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 msgr2=0x7f31d41632b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 0x7f31d41632b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f31d4070510 tx=0x7f31cc004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 shutdown_connections 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31b8065ad0 0x7f31b8067f90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31d41615a0 0x7f31d41632b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31d41611c0 0x7f31d40c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 --2- 172.21.15.45:0/3770859605 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31d40afe30 0x7f31d4162400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:17.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 >> 172.21.15.45:0/3770859605 conn(0x7f31d40cb900 msgr2=0x7f31d40c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:17.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 shutdown_connections 2023-12-19T17:53:17.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:17.913+0000 7f31d91b7700 1 -- 172.21.15.45:0/3770859605 wait complete. 2023-12-19T17:53:17.918 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-12-19T17:53:17.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:18.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 Processor -- start 2023-12-19T17:53:18.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 -- start start 2023-12-19T17:53:18.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f48cc15ab50 0x7f48cc0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 0x7f48cc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc06cbb0 con 0x7f48cc06f4a0 2023-12-19T17:53:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc06fa10 con 0x7f48cc15ab50 2023-12-19T17:53:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d2a71700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06fcf0 con 0x7f48cc15af30 2023-12-19T17:53:18.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d100e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f48cc06f4a0 0x7f48cc15e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48460/0 (socket says 172.21.15.45:48460) 2023-12-19T17:53:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d100e700 1 -- 172.21.15.45:0/3291816786 learned_addr learned my addr 172.21.15.45:0/3291816786 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48d080d700 1 --2- 172.21.15.45:0/3291816786 >> v2:172.21.15.73:3300/0 conn(0x7f48cc15ab50 0x7f48cc0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cbfff700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 0x7f48cc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439646496 0 0) 0x7f48cc06cbb0 con 0x7f48cc06f4a0 2023-12-19T17:53:18.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48bc0035d0 con 0x7f48cc06f4a0 2023-12-19T17:53:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 511185834 0 0) 0x7f48bc0035d0 con 0x7f48cc06f4a0 2023-12-19T17:53:18.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 msgr2=0x7f48cc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 0x7f48cc0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 >> v2:172.21.15.73:3300/0 conn(0x7f48cc15ab50 msgr2=0x7f48cc0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 --2- 172.21.15.45:0/3291816786 >> v2:172.21.15.73:3300/0 conn(0x7f48cc15ab50 0x7f48cc0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.113+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc06ffd0 con 0x7f48cc06f4a0 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f48c4001a40 con 0x7f48cc06f4a0 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 >> v1:172.21.15.45:6789/0 conn(0x7f48cc06f4a0 legacy=0x7f48cc15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48bc003a20 0x7f48bc003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48bc004870 0x7f48bc004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 0x7f48bc005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06fa10 con 0x7f48bc003a20 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc06fcf0 con 0x7f48bc004870 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48bc00ba30 con 0x7f48cc15af30 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d080d700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48bc003a20 0x7f48bc003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48bc004870 0x7f48bc004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d100e700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 0x7f48bc005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 -- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 msgr2=0x7f48bc005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48cc15af30 0x7f48bc005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 -- 172.21.15.45:0/3291816786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48bc003a20 msgr2=0x7f48bc003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48bc003a20 0x7f48bc003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 -- 172.21.15.45:0/3291816786 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48bc0035d0 con 0x7f48bc004870 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d080d700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48bc003a20 0x7f48bc003e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:18.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cbfff700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48bc004870 0x7f48bc004cf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009b40 tx=0x7f48bc0058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87ec18069a8c9c58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:18.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800e6c0 con 0x7f48bc004870 2023-12-19T17:53:18.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b800e820 con 0x7f48bc004870 2023-12-19T17:53:18.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48cb7fe700 1 -- 172.21.15.45:0/3291816786 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800eb90 con 0x7f48bc004870 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d2a71700 1 -- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48bc004870 msgr2=0x7f48bc004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d2a71700 1 --2- 172.21.15.45:0/3291816786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48bc004870 0x7f48bc004cf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f48b8009b40 tx=0x7f48bc0058a0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d100e700 1 -- 172.21.15.45:0/3291816786 reap_dead start 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d2a71700 1 -- 172.21.15.45:0/3291816786 shutdown_connections 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.117+0000 7f48d2a71700 1 -- 172.21.15.45:0/3291816786 >> 172.21.15.45:0/3291816786 conn(0x7f48cc0cba40 msgr2=0x7f48cc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.121+0000 7f48d2a71700 1 -- 172.21.15.45:0/3291816786 shutdown_connections 2023-12-19T17:53:18.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.121+0000 7f48d2a71700 1 -- 172.21.15.45:0/3291816786 wait complete. 2023-12-19T17:53:18.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.121+0000 7f48d2a71700 1 Processor -- start 2023-12-19T17:53:18.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.121+0000 7f48d2a71700 1 -- start start 2023-12-19T17:53:18.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48bc004870 0x7f48cc0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 0x7f48cc140c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48cc1411c0 0x7f48cc141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0c6e00 con 0x7f48cc0c6980 2023-12-19T17:53:18.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc152120 con 0x7f48cc1411c0 2023-12-19T17:53:18.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc141bb0 con 0x7f48bc004870 2023-12-19T17:53:18.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 0x7f48cc140c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 0x7f48cc140c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57646/0 (socket says 172.21.15.45:57646) 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 -- 172.21.15.45:0/269047238 learned_addr learned my addr 172.21.15.45:0/269047238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d080d700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48bc004870 0x7f48cc0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d100e700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48cc1411c0 0x7f48cc141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 -- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48bc004870 msgr2=0x7f48cc0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48bc004870 0x7f48cc0c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 -- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48cc1411c0 msgr2=0x7f48cc141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48cc1411c0 0x7f48cc141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 -- 172.21.15.45:0/269047238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc0c7050 con 0x7f48cc0c6980 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d100e700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48cc1411c0 0x7f48cc141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:18.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d080d700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48bc004870 0x7f48cc0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:18.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48cbfff700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 0x7f48cc140c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f48bc004740 tx=0x7f48b80047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:18.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b800e6c0 con 0x7f48cc0c6980 2023-12-19T17:53:18.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b8013e90 con 0x7f48cc0c6980 2023-12-19T17:53:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc0c7330 con 0x7f48cc0c6980 2023-12-19T17:53:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b8004270 con 0x7f48cc0c6980 2023-12-19T17:53:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.125+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc0b2d20 con 0x7f48cc0c6980 2023-12-19T17:53:18.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.129+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc0b28a0 con 0x7f48cc0c6980 2023-12-19T17:53:18.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.129+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f48b80043d0 con 0x7f48cc0c6980 2023-12-19T17:53:18.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.129+0000 7f48c97fa700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f48b0065b00 0x7f48b0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.129+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f48b8084a60 con 0x7f48cc0c6980 2023-12-19T17:53:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.133+0000 7f48d080d700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f48b0065b00 0x7f48b0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.133+0000 7f48d080d700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f48b0065b00 0x7f48b0067fc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009e90 tx=0x7f48c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:18.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.137+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f48cc0b28a0 con 0x7f48cc0c6980 2023-12-19T17:53:18.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.317+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48cc0b28a0 con 0x7f48cc0c6980 2023-12-19T17:53:18.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.321+0000 7f48c97fa700 1 -- 172.21.15.45:0/269047238 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16258 (secure 0 0 0) 0x7f48cc0b28a0 con 0x7f48cc0c6980 2023-12-19T17:53:18.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:18.324 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":39,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:15.435342+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f48b0065b00 msgr2=0x7f48b0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f48b0065b00 0x7f48b0067fc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009e90 tx=0x7f48c0008040 comp rx=0 tx=0).stop 2023-12-19T17:53:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 msgr2=0x7f48cc140c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 0x7f48cc140c80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f48bc004740 tx=0x7f48b80047e0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 shutdown_connections 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f48b0065b00 0x7f48b0067fc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48cc1411c0 0x7f48cc141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48cc0c6980 0x7f48cc140c80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 --2- 172.21.15.45:0/269047238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48bc004870 0x7f48cc0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 >> 172.21.15.45:0/269047238 conn(0x7f48cc0cba40 msgr2=0x7f48cc0ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 shutdown_connections 2023-12-19T17:53:18.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.325+0000 7f48d2a71700 1 -- 172.21.15.45:0/269047238 wait complete. 2023-12-19T17:53:18.350 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T17:53:18.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:53:18.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.513+0000 7f560dd5d700 1 Processor -- start 2023-12-19T17:53:18.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.513+0000 7f560dd5d700 1 -- start start 2023-12-19T17:53:18.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560dd5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56081659f0 0x7f5608167de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560dd5d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080d1820 con 0x7f56080b88b0 2023-12-19T17:53:18.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560dd5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56080d1b00 con 0x7f560806ea90 2023-12-19T17:53:18.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560dd5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56080d1630 con 0x7f56081659f0 2023-12-19T17:53:18.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55fffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f56080b88b0 0x7f560806ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48462/0 (socket says 172.21.15.45:48462) 2023-12-19T17:53:18.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55fffff700 1 -- 172.21.15.45:0/1249502109 learned_addr learned my addr 172.21.15.45:0/1249502109 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:18.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560d55c700 1 --2- 172.21.15.45:0/1249502109 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56081659f0 0x7f5608167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2129558296 0 0) 0x7f56080d1820 con 0x7f56080b88b0 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f00035d0 con 0x7f56080b88b0 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688531075 0 0) 0x7f56080d1b00 con 0x7f560806ea90 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56080d1820 con 0x7f560806ea90 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560d55c700 1 -- 172.21.15.45:0/1249502109 >> v1:172.21.15.73:6789/0 conn(0x7f560806ea90 legacy=0x7f56080d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560d55c700 1 -- 172.21.15.45:0/1249502109 >> v1:172.21.15.45:6789/0 conn(0x7f56080b88b0 legacy=0x7f560806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560d55c700 1 -- 172.21.15.45:0/1249502109 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56080d1de0 con 0x7f56081659f0 2023-12-19T17:53:18.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f560d55c700 1 --2- 172.21.15.45:0/1249502109 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56081659f0 0x7f5608167de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5600009880 tx=0x7f5600009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e053283b65b3b23 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:18.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600011830 con 0x7f56081659f0 2023-12-19T17:53:18.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5600011990 con 0x7f56081659f0 2023-12-19T17:53:18.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.517+0000 7f55ff7fe700 1 -- 172.21.15.45:0/1249502109 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5600011d20 con 0x7f56081659f0 2023-12-19T17:53:18.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 -- 172.21.15.45:0/1249502109 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56081659f0 msgr2=0x7f5608167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1249502109 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56081659f0 0x7f5608167de0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5600009880 tx=0x7f5600009b90 comp rx=0 tx=0).stop 2023-12-19T17:53:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 -- 172.21.15.45:0/1249502109 shutdown_connections 2023-12-19T17:53:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1249502109 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56081659f0 0x7f5608167de0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 -- 172.21.15.45:0/1249502109 >> 172.21.15.45:0/1249502109 conn(0x7f56080b46d0 msgr2=0x7f56080b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 -- 172.21.15.45:0/1249502109 shutdown_connections 2023-12-19T17:53:18.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.521+0000 7f560dd5d700 1 -- 172.21.15.45:0/1249502109 wait complete. 2023-12-19T17:53:18.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 Processor -- start 2023-12-19T17:53:18.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 -- start start 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f560806ea90 0x7f56081540b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 0x7f560806f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56081659f0 0x7f560806fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608153c20 con 0x7f56080b88b0 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56080b3420 con 0x7f56081659f0 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560dd5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56081535d0 con 0x7f560806ea90 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f55fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 0x7f560806f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f55fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 0x7f560806f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57660/0 (socket says 172.21.15.45:57660) 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f55fffff700 1 -- 172.21.15.45:0/1929971916 learned_addr learned my addr 172.21.15.45:0/1929971916 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560d55c700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56081659f0 0x7f560806fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.525+0000 7f560cd5b700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f560806ea90 0x7f56081540b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fffff700 1 -- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f560806ea90 msgr2=0x7f56081540b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fffff700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f560806ea90 0x7f56081540b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fffff700 1 -- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56081659f0 msgr2=0x7f560806fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fffff700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56081659f0 0x7f560806fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fffff700 1 -- 172.21.15.45:0/1929971916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000094b0 con 0x7f56080b88b0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fffff700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 0x7f560806f6f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f55f800c4d0 tx=0x7f55f800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8005d90 con 0x7f56080b88b0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f80070d0 con 0x7f56080b88b0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56081538b0 con 0x7f56080b88b0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f8007460 con 0x7f56080b88b0 2023-12-19T17:53:18.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56080b4440 con 0x7f56080b88b0 2023-12-19T17:53:18.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.529+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5608153430 con 0x7f56080b88b0 2023-12-19T17:53:18.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.533+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f55f80075c0 con 0x7f56080b88b0 2023-12-19T17:53:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.533+0000 7f55fd7fa700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55f4065b50 0x7f55f4068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:18.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.533+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f55f80826c0 con 0x7f56080b88b0 2023-12-19T17:53:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.533+0000 7f560cd5b700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55f4065b50 0x7f55f4068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:18.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.537+0000 7f560cd5b700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55f4065b50 0x7f55f4068010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5604001560 tx=0x7f5604009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:18.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.541+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5608153430 con 0x7f56080b88b0 2023-12-19T17:53:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.717+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56080d23a0 con 0x7f55f4065b50 2023-12-19T17:53:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.737+0000 7f55fd7fa700 1 -- 172.21.15.45:0/1929971916 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286851 (secure 0 0 0) 0x7f560400fc10 con 0x7f55f4065b50 2023-12-19T17:53:18.745 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55f4065b50 msgr2=0x7f55f4068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55f4065b50 0x7f55f4068010 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5604001560 tx=0x7f5604009040 comp rx=0 tx=0).stop 2023-12-19T17:53:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 msgr2=0x7f560806f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:18.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 0x7f560806f6f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f55f800c4d0 tx=0x7f55f800c7e0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 shutdown_connections 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f55f4065b50 0x7f55f4068010 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56081659f0 0x7f560806fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56080b88b0 0x7f560806f6f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 --2- 172.21.15.45:0/1929971916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f560806ea90 0x7f56081540b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 >> 172.21.15.45:0/1929971916 conn(0x7f56080b46d0 msgr2=0x7f560806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 shutdown_connections 2023-12-19T17:53:18.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:18.741+0000 7f560dd5d700 1 -- 172.21.15.45:0/1929971916 wait complete. 2023-12-19T17:53:18.749 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:53:18.771 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-19T17:53:18.228467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224392,"kb_used_data":4680,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750328,"statfs":{"total":773094113280,"available":772864335872,"internally_reserved":0,"allocated":4792320,"data_stored":2705557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.291507"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478833+0000","last_change":"2023-12-19T17:53:14.473667+0000","last_active":"2023-12-19T17:53:14.478833+0000","last_peered":"2023-12-19T17:53:14.478833+0000","last_clean":"2023-12-19T17:53:14.478833+0000","last_became_active":"2023-12-19T17:53:14.473362+0000","last_became_peered":"2023-12-19T17:53:14.473362+0000","last_unstale":"2023-12-19T17:53:14.478833+0000","last_undegraded":"2023-12-19T17:53:14.478833+0000","last_fullsized":"2023-12-19T17:53:14.478833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.865682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478591+0000","last_change":"2023-12-19T17:53:14.473330+0000","last_active":"2023-12-19T17:53:14.478591+0000","last_peered":"2023-12-19T17:53:14.478591+0000","last_clean":"2023-12-19T17:53:14.478591+0000","last_became_active":"2023-12-19T17:53:14.472947+0000","last_became_peered":"2023-12-19T17:53:14.472947+0000","last_unstale":"2023-12-19T17:53:14.478591+0000","last_undegraded":"2023-12-19T17:53:14.478591+0000","last_fullsized":"2023-12-19T17:53:14.478591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:05.577856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735371+0000","last_change":"2023-12-19T17:53:14.479990+0000","last_active":"2023-12-19T17:53:15.735371+0000","last_peered":"2023-12-19T17:53:15.735371+0000","last_clean":"2023-12-19T17:53:15.735371+0000","last_became_active":"2023-12-19T17:53:14.479688+0000","last_became_peered":"2023-12-19T17:53:14.479688+0000","last_unstale":"2023-12-19T17:53:15.735371+0000","last_undegraded":"2023-12-19T17:53:15.735371+0000","last_fullsized":"2023-12-19T17:53:15.735371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157506+0000","last_change":"2023-12-19T17:53:14.475913+0000","last_active":"2023-12-19T17:53:16.157506+0000","last_peered":"2023-12-19T17:53:16.157506+0000","last_clean":"2023-12-19T17:53:16.157506+0000","last_became_active":"2023-12-19T17:53:14.475357+0000","last_became_peered":"2023-12-19T17:53:14.475357+0000","last_unstale":"2023-12-19T17:53:16.157506+0000","last_undegraded":"2023-12-19T17:53:16.157506+0000","last_fullsized":"2023-12-19T17:53:16.157506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:06.840638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157547+0000","last_change":"2023-12-19T17:53:14.462398+0000","last_active":"2023-12-19T17:53:16.157547+0000","last_peered":"2023-12-19T17:53:16.157547+0000","last_clean":"2023-12-19T17:53:16.157547+0000","last_became_active":"2023-12-19T17:53:14.462125+0000","last_became_peered":"2023-12-19T17:53:14.462125+0000","last_unstale":"2023-12-19T17:53:16.157547+0000","last_undegraded":"2023-12-19T17:53:16.157547+0000","last_fullsized":"2023-12-19T17:53:16.157547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:05.680245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452257+0000","last_change":"2023-12-19T17:53:14.462850+0000","last_active":"2023-12-19T17:53:15.452257+0000","last_peered":"2023-12-19T17:53:15.452257+0000","last_clean":"2023-12-19T17:53:15.452257+0000","last_became_active":"2023-12-19T17:53:14.461967+0000","last_became_peered":"2023-12-19T17:53:14.461967+0000","last_unstale":"2023-12-19T17:53:15.452257+0000","last_undegraded":"2023-12-19T17:53:15.452257+0000","last_fullsized":"2023-12-19T17:53:15.452257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:57.956733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164275+0000","last_change":"2023-12-19T17:53:14.465610+0000","last_active":"2023-12-19T17:53:16.164275+0000","last_peered":"2023-12-19T17:53:16.164275+0000","last_clean":"2023-12-19T17:53:16.164275+0000","last_became_active":"2023-12-19T17:53:14.465025+0000","last_became_peered":"2023-12-19T17:53:14.465025+0000","last_unstale":"2023-12-19T17:53:16.164275+0000","last_undegraded":"2023-12-19T17:53:16.164275+0000","last_fullsized":"2023-12-19T17:53:16.164275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.481378+0000","last_change":"2023-12-19T17:53:14.479239+0000","last_active":"2023-12-19T17:53:14.481378+0000","last_peered":"2023-12-19T17:53:14.481378+0000","last_clean":"2023-12-19T17:53:14.481378+0000","last_became_active":"2023-12-19T17:53:14.478993+0000","last_became_peered":"2023-12-19T17:53:14.478993+0000","last_unstale":"2023-12-19T17:53:14.481378+0000","last_undegraded":"2023-12-19T17:53:14.481378+0000","last_fullsized":"2023-12-19T17:53:14.481378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:02.044708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735636+0000","last_change":"2023-12-19T17:53:14.470439+0000","last_active":"2023-12-19T17:53:15.735636+0000","last_peered":"2023-12-19T17:53:15.735636+0000","last_clean":"2023-12-19T17:53:15.735636+0000","last_became_active":"2023-12-19T17:53:14.470145+0000","last_became_peered":"2023-12-19T17:53:14.470145+0000","last_unstale":"2023-12-19T17:53:15.735636+0000","last_undegraded":"2023-12-19T17:53:15.735636+0000","last_fullsized":"2023-12-19T17:53:15.735636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165029+0000","last_change":"2023-12-19T17:53:14.477417+0000","last_active":"2023-12-19T17:53:16.165029+0000","last_peered":"2023-12-19T17:53:16.165029+0000","last_clean":"2023-12-19T17:53:16.165029+0000","last_became_active":"2023-12-19T17:53:14.473192+0000","last_became_peered":"2023-12-19T17:53:14.473192+0000","last_unstale":"2023-12-19T17:53:16.165029+0000","last_undegraded":"2023-12-19T17:53:16.165029+0000","last_fullsized":"2023-12-19T17:53:16.165029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164832+0000","last_change":"2023-12-19T17:53:14.480792+0000","last_active":"2023-12-19T17:53:16.164832+0000","last_peered":"2023-12-19T17:53:16.164832+0000","last_clean":"2023-12-19T17:53:16.164832+0000","last_became_active":"2023-12-19T17:53:14.480370+0000","last_became_peered":"2023-12-19T17:53:14.480370+0000","last_unstale":"2023-12-19T17:53:16.164832+0000","last_undegraded":"2023-12-19T17:53:16.164832+0000","last_fullsized":"2023-12-19T17:53:16.164832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735299+0000","last_change":"2023-12-19T17:53:14.453686+0000","last_active":"2023-12-19T17:53:15.735299+0000","last_peered":"2023-12-19T17:53:15.735299+0000","last_clean":"2023-12-19T17:53:15.735299+0000","last_became_active":"2023-12-19T17:53:14.453442+0000","last_became_peered":"2023-12-19T17:53:14.453442+0000","last_unstale":"2023-12-19T17:53:15.735299+0000","last_undegraded":"2023-12-19T17:53:15.735299+0000","last_fullsized":"2023-12-19T17:53:15.735299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:48.605948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164540+0000","last_change":"2023-12-19T17:53:14.478769+0000","last_active":"2023-12-19T17:53:16.164540+0000","last_peered":"2023-12-19T17:53:16.164540+0000","last_clean":"2023-12-19T17:53:16.164540+0000","last_became_active":"2023-12-19T17:53:14.478515+0000","last_became_peered":"2023-12-19T17:53:14.478515+0000","last_unstale":"2023-12-19T17:53:16.164540+0000","last_undegraded":"2023-12-19T17:53:16.164540+0000","last_fullsized":"2023-12-19T17:53:16.164540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.484142+0000","last_change":"2023-12-19T17:53:14.482177+0000","last_active":"2023-12-19T17:53:14.484142+0000","last_peered":"2023-12-19T17:53:14.484142+0000","last_clean":"2023-12-19T17:53:14.484142+0000","last_became_active":"2023-12-19T17:53:14.481920+0000","last_became_peered":"2023-12-19T17:53:14.481920+0000","last_unstale":"2023-12-19T17:53:14.484142+0000","last_undegraded":"2023-12-19T17:53:14.484142+0000","last_fullsized":"2023-12-19T17:53:14.484142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164353+0000","last_change":"2023-12-19T17:53:14.465401+0000","last_active":"2023-12-19T17:53:16.164353+0000","last_peered":"2023-12-19T17:53:16.164353+0000","last_clean":"2023-12-19T17:53:16.164353+0000","last_became_active":"2023-12-19T17:53:14.465000+0000","last_became_peered":"2023-12-19T17:53:14.465000+0000","last_unstale":"2023-12-19T17:53:16.164353+0000","last_undegraded":"2023-12-19T17:53:16.164353+0000","last_fullsized":"2023-12-19T17:53:16.164353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457408+0000","last_change":"2023-12-19T17:53:14.466569+0000","last_active":"2023-12-19T17:53:15.457408+0000","last_peered":"2023-12-19T17:53:15.457408+0000","last_clean":"2023-12-19T17:53:15.457408+0000","last_became_active":"2023-12-19T17:53:14.466302+0000","last_became_peered":"2023-12-19T17:53:14.466302+0000","last_unstale":"2023-12-19T17:53:15.457408+0000","last_undegraded":"2023-12-19T17:53:15.457408+0000","last_fullsized":"2023-12-19T17:53:15.457408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:59.698917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457321+0000","last_change":"2023-12-19T17:53:14.471846+0000","last_active":"2023-12-19T17:53:15.457321+0000","last_peered":"2023-12-19T17:53:15.457321+0000","last_clean":"2023-12-19T17:53:15.457321+0000","last_became_active":"2023-12-19T17:53:14.471589+0000","last_became_peered":"2023-12-19T17:53:14.471589+0000","last_unstale":"2023-12-19T17:53:15.457321+0000","last_undegraded":"2023-12-19T17:53:15.457321+0000","last_fullsized":"2023-12-19T17:53:15.457321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.458037+0000","last_change":"2023-12-19T17:53:14.475851+0000","last_active":"2023-12-19T17:53:15.458037+0000","last_peered":"2023-12-19T17:53:15.458037+0000","last_clean":"2023-12-19T17:53:15.458037+0000","last_became_active":"2023-12-19T17:53:14.475409+0000","last_became_peered":"2023-12-19T17:53:14.475409+0000","last_unstale":"2023-12-19T17:53:15.458037+0000","last_undegraded":"2023-12-19T17:53:15.458037+0000","last_fullsized":"2023-12-19T17:53:15.458037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:00.824597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157922+0000","last_change":"2023-12-19T17:53:14.457315+0000","last_active":"2023-12-19T17:53:16.157922+0000","last_peered":"2023-12-19T17:53:16.157922+0000","last_clean":"2023-12-19T17:53:16.157922+0000","last_became_active":"2023-12-19T17:53:14.456856+0000","last_became_peered":"2023-12-19T17:53:14.456856+0000","last_unstale":"2023-12-19T17:53:16.157922+0000","last_undegraded":"2023-12-19T17:53:16.157922+0000","last_fullsized":"2023-12-19T17:53:16.157922+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:23:20.957209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457747+0000","last_change":"2023-12-19T17:53:14.468477+0000","last_active":"2023-12-19T17:53:15.457747+0000","last_peered":"2023-12-19T17:53:15.457747+0000","last_clean":"2023-12-19T17:53:15.457747+0000","last_became_active":"2023-12-19T17:53:14.468209+0000","last_became_peered":"2023-12-19T17:53:14.468209+0000","last_unstale":"2023-12-19T17:53:15.457747+0000","last_undegraded":"2023-12-19T17:53:15.457747+0000","last_fullsized":"2023-12-19T17:53:15.457747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:05.680245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164334+0000","last_change":"2023-12-19T17:53:14.465291+0000","last_active":"2023-12-19T17:53:16.164334+0000","last_peered":"2023-12-19T17:53:16.164334+0000","last_clean":"2023-12-19T17:53:16.164334+0000","last_became_active":"2023-12-19T17:53:14.464940+0000","last_became_peered":"2023-12-19T17:53:14.464940+0000","last_unstale":"2023-12-19T17:53:16.164334+0000","last_undegraded":"2023-12-19T17:53:16.164334+0000","last_fullsized":"2023-12-19T17:53:16.164334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.474432+0000","last_change":"2023-12-19T17:53:14.466194+0000","last_active":"2023-12-19T17:53:14.474432+0000","last_peered":"2023-12-19T17:53:14.474432+0000","last_clean":"2023-12-19T17:53:14.474432+0000","last_became_active":"2023-12-19T17:53:14.465880+0000","last_became_peered":"2023-12-19T17:53:14.465880+0000","last_unstale":"2023-12-19T17:53:14.474432+0000","last_undegraded":"2023-12-19T17:53:14.474432+0000","last_fullsized":"2023-12-19T17:53:14.474432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456925+0000","last_change":"2023-12-19T17:53:14.453144+0000","last_active":"2023-12-19T17:53:15.456925+0000","last_peered":"2023-12-19T17:53:15.456925+0000","last_clean":"2023-12-19T17:53:15.456925+0000","last_became_active":"2023-12-19T17:53:14.452411+0000","last_became_peered":"2023-12-19T17:53:14.452411+0000","last_unstale":"2023-12-19T17:53:15.456925+0000","last_undegraded":"2023-12-19T17:53:15.456925+0000","last_fullsized":"2023-12-19T17:53:15.456925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157453+0000","last_change":"2023-12-19T17:53:14.457708+0000","last_active":"2023-12-19T17:53:16.157453+0000","last_peered":"2023-12-19T17:53:16.157453+0000","last_clean":"2023-12-19T17:53:16.157453+0000","last_became_active":"2023-12-19T17:53:14.454536+0000","last_became_peered":"2023-12-19T17:53:14.454536+0000","last_unstale":"2023-12-19T17:53:16.157453+0000","last_undegraded":"2023-12-19T17:53:16.157453+0000","last_fullsized":"2023-12-19T17:53:16.157453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:16.859344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457988+0000","last_change":"2023-12-19T17:53:14.467856+0000","last_active":"2023-12-19T17:53:15.457988+0000","last_peered":"2023-12-19T17:53:15.457988+0000","last_clean":"2023-12-19T17:53:15.457988+0000","last_became_active":"2023-12-19T17:53:14.464337+0000","last_became_peered":"2023-12-19T17:53:14.464337+0000","last_unstale":"2023-12-19T17:53:15.457988+0000","last_undegraded":"2023-12-19T17:53:15.457988+0000","last_fullsized":"2023-12-19T17:53:15.457988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:04.819385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452801+0000","last_change":"2023-12-19T17:53:14.466483+0000","last_active":"2023-12-19T17:53:15.452801+0000","last_peered":"2023-12-19T17:53:15.452801+0000","last_clean":"2023-12-19T17:53:15.452801+0000","last_became_active":"2023-12-19T17:53:14.466239+0000","last_became_peered":"2023-12-19T17:53:14.466239+0000","last_unstale":"2023-12-19T17:53:15.452801+0000","last_undegraded":"2023-12-19T17:53:15.452801+0000","last_fullsized":"2023-12-19T17:53:15.452801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457851+0000","last_change":"2023-12-19T17:53:14.469576+0000","last_active":"2023-12-19T17:53:15.457851+0000","last_peered":"2023-12-19T17:53:15.457851+0000","last_clean":"2023-12-19T17:53:15.457851+0000","last_became_active":"2023-12-19T17:53:14.467647+0000","last_became_peered":"2023-12-19T17:53:14.467647+0000","last_unstale":"2023-12-19T17:53:15.457851+0000","last_undegraded":"2023-12-19T17:53:15.457851+0000","last_fullsized":"2023-12-19T17:53:15.457851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:06.840638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164808+0000","last_change":"2023-12-19T17:53:14.478110+0000","last_active":"2023-12-19T17:53:16.164808+0000","last_peered":"2023-12-19T17:53:16.164808+0000","last_clean":"2023-12-19T17:53:16.164808+0000","last_became_active":"2023-12-19T17:53:14.477842+0000","last_became_peered":"2023-12-19T17:53:14.477842+0000","last_unstale":"2023-12-19T17:53:16.164808+0000","last_undegraded":"2023-12-19T17:53:16.164808+0000","last_fullsized":"2023-12-19T17:53:16.164808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457087+0000","last_change":"2023-12-19T17:53:14.466761+0000","last_active":"2023-12-19T17:53:15.457087+0000","last_peered":"2023-12-19T17:53:15.457087+0000","last_clean":"2023-12-19T17:53:15.457087+0000","last_became_active":"2023-12-19T17:53:14.466482+0000","last_became_peered":"2023-12-19T17:53:14.466482+0000","last_unstale":"2023-12-19T17:53:15.457087+0000","last_undegraded":"2023-12-19T17:53:15.457087+0000","last_fullsized":"2023-12-19T17:53:15.457087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:22.648642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456696+0000","last_change":"2023-12-19T17:53:14.468042+0000","last_active":"2023-12-19T17:53:15.456696+0000","last_peered":"2023-12-19T17:53:15.456696+0000","last_clean":"2023-12-19T17:53:15.456696+0000","last_became_active":"2023-12-19T17:53:14.467270+0000","last_became_peered":"2023-12-19T17:53:14.467270+0000","last_unstale":"2023-12-19T17:53:15.456696+0000","last_undegraded":"2023-12-19T17:53:15.456696+0000","last_fullsized":"2023-12-19T17:53:15.456696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:23:20.957209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457109+0000","last_change":"2023-12-19T17:53:14.454385+0000","last_active":"2023-12-19T17:53:15.457109+0000","last_peered":"2023-12-19T17:53:15.457109+0000","last_clean":"2023-12-19T17:53:15.457109+0000","last_became_active":"2023-12-19T17:53:14.453835+0000","last_became_peered":"2023-12-19T17:53:14.453835+0000","last_unstale":"2023-12-19T17:53:15.457109+0000","last_undegraded":"2023-12-19T17:53:15.457109+0000","last_fullsized":"2023-12-19T17:53:15.457109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:57.956733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452156+0000","last_change":"2023-12-19T17:53:14.453222+0000","last_active":"2023-12-19T17:53:15.452156+0000","last_peered":"2023-12-19T17:53:15.452156+0000","last_clean":"2023-12-19T17:53:15.452156+0000","last_became_active":"2023-12-19T17:53:14.452961+0000","last_became_peered":"2023-12-19T17:53:14.452961+0000","last_unstale":"2023-12-19T17:53:15.452156+0000","last_undegraded":"2023-12-19T17:53:15.452156+0000","last_fullsized":"2023-12-19T17:53:15.452156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457129+0000","last_change":"2023-12-19T17:53:14.474306+0000","last_active":"2023-12-19T17:53:15.457129+0000","last_peered":"2023-12-19T17:53:15.457129+0000","last_clean":"2023-12-19T17:53:15.457129+0000","last_became_active":"2023-12-19T17:53:14.474064+0000","last_became_peered":"2023-12-19T17:53:14.474064+0000","last_unstale":"2023-12-19T17:53:15.457129+0000","last_undegraded":"2023-12-19T17:53:15.457129+0000","last_fullsized":"2023-12-19T17:53:15.457129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457998+0000","last_change":"2023-12-19T17:53:13.984204+0000","last_active":"2023-12-19T17:53:15.457998+0000","last_peered":"2023-12-19T17:53:15.457998+0000","last_clean":"2023-12-19T17:53:15.457998+0000","last_became_active":"2023-12-19T17:53:13.983878+0000","last_became_peered":"2023-12-19T17:53:13.983878+0000","last_unstale":"2023-12-19T17:53:15.457998+0000","last_undegraded":"2023-12-19T17:53:15.457998+0000","last_fullsized":"2023-12-19T17:53:15.457998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:53.371017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452888+0000","last_change":"2023-12-19T17:53:14.479730+0000","last_active":"2023-12-19T17:53:15.452888+0000","last_peered":"2023-12-19T17:53:15.452888+0000","last_clean":"2023-12-19T17:53:15.452888+0000","last_became_active":"2023-12-19T17:53:14.479276+0000","last_became_peered":"2023-12-19T17:53:14.479276+0000","last_unstale":"2023-12-19T17:53:15.452888+0000","last_undegraded":"2023-12-19T17:53:15.452888+0000","last_fullsized":"2023-12-19T17:53:15.452888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735548+0000","last_change":"2023-12-19T17:53:13.980591+0000","last_active":"2023-12-19T17:53:15.735548+0000","last_peered":"2023-12-19T17:53:15.735548+0000","last_clean":"2023-12-19T17:53:15.735548+0000","last_became_active":"2023-12-19T17:53:13.979773+0000","last_became_peered":"2023-12-19T17:53:13.979773+0000","last_unstale":"2023-12-19T17:53:15.735548+0000","last_undegraded":"2023-12-19T17:53:15.735548+0000","last_fullsized":"2023-12-19T17:53:15.735548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:43.232708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.477315+0000","last_change":"2023-12-19T17:53:14.473510+0000","last_active":"2023-12-19T17:53:14.477315+0000","last_peered":"2023-12-19T17:53:14.477315+0000","last_clean":"2023-12-19T17:53:14.477315+0000","last_became_active":"2023-12-19T17:53:14.473239+0000","last_became_peered":"2023-12-19T17:53:14.473239+0000","last_unstale":"2023-12-19T17:53:14.477315+0000","last_undegraded":"2023-12-19T17:53:14.477315+0000","last_fullsized":"2023-12-19T17:53:14.477315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.453062+0000","last_change":"2023-12-19T17:53:13.983036+0000","last_active":"2023-12-19T17:53:15.453062+0000","last_peered":"2023-12-19T17:53:15.453062+0000","last_clean":"2023-12-19T17:53:15.453062+0000","last_became_active":"2023-12-19T17:53:13.982750+0000","last_became_peered":"2023-12-19T17:53:13.982750+0000","last_unstale":"2023-12-19T17:53:15.453062+0000","last_undegraded":"2023-12-19T17:53:15.453062+0000","last_fullsized":"2023-12-19T17:53:15.453062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.827194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.481270+0000","last_change":"2023-12-19T17:53:14.478738+0000","last_active":"2023-12-19T17:53:14.481270+0000","last_peered":"2023-12-19T17:53:14.481270+0000","last_clean":"2023-12-19T17:53:14.481270+0000","last_became_active":"2023-12-19T17:53:14.478546+0000","last_became_peered":"2023-12-19T17:53:14.478546+0000","last_unstale":"2023-12-19T17:53:14.481270+0000","last_undegraded":"2023-12-19T17:53:14.481270+0000","last_fullsized":"2023-12-19T17:53:14.481270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:56.461304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.474234+0000","last_change":"2023-12-19T17:53:13.984365+0000","last_active":"2023-12-19T17:53:14.474234+0000","last_peered":"2023-12-19T17:53:14.474234+0000","last_clean":"2023-12-19T17:53:14.474234+0000","last_became_active":"2023-12-19T17:53:13.984083+0000","last_became_peered":"2023-12-19T17:53:13.984083+0000","last_unstale":"2023-12-19T17:53:14.474234+0000","last_undegraded":"2023-12-19T17:53:14.474234+0000","last_fullsized":"2023-12-19T17:53:14.474234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.827194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.734663+0000","last_change":"2023-12-19T17:53:14.459320+0000","last_active":"2023-12-19T17:53:15.734663+0000","last_peered":"2023-12-19T17:53:15.734663+0000","last_clean":"2023-12-19T17:53:15.734663+0000","last_became_active":"2023-12-19T17:53:14.458709+0000","last_became_peered":"2023-12-19T17:53:14.458709+0000","last_unstale":"2023-12-19T17:53:15.734663+0000","last_undegraded":"2023-12-19T17:53:15.734663+0000","last_fullsized":"2023-12-19T17:53:15.734663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164623+0000","last_change":"2023-12-19T17:53:13.983065+0000","last_active":"2023-12-19T17:53:16.164623+0000","last_peered":"2023-12-19T17:53:16.164623+0000","last_clean":"2023-12-19T17:53:16.164623+0000","last_became_active":"2023-12-19T17:53:13.982795+0000","last_became_peered":"2023-12-19T17:53:13.982795+0000","last_unstale":"2023-12-19T17:53:16.164623+0000","last_undegraded":"2023-12-19T17:53:16.164623+0000","last_fullsized":"2023-12-19T17:53:16.164623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:05.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164490+0000","last_change":"2023-12-19T17:53:14.469709+0000","last_active":"2023-12-19T17:53:16.164490+0000","last_peered":"2023-12-19T17:53:16.164490+0000","last_clean":"2023-12-19T17:53:16.164490+0000","last_became_active":"2023-12-19T17:53:14.465456+0000","last_became_peered":"2023-12-19T17:53:14.465456+0000","last_unstale":"2023-12-19T17:53:16.164490+0000","last_undegraded":"2023-12-19T17:53:16.164490+0000","last_fullsized":"2023-12-19T17:53:16.164490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:42:15.657524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456944+0000","last_change":"2023-12-19T17:53:13.980483+0000","last_active":"2023-12-19T17:53:15.456944+0000","last_peered":"2023-12-19T17:53:15.456944+0000","last_clean":"2023-12-19T17:53:15.456944+0000","last_became_active":"2023-12-19T17:53:13.980171+0000","last_became_peered":"2023-12-19T17:53:13.980171+0000","last_unstale":"2023-12-19T17:53:15.456944+0000","last_undegraded":"2023-12-19T17:53:15.456944+0000","last_fullsized":"2023-12-19T17:53:15.456944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:05.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.483073+0000","last_change":"2023-12-19T17:53:14.481442+0000","last_active":"2023-12-19T17:53:14.483073+0000","last_peered":"2023-12-19T17:53:14.483073+0000","last_clean":"2023-12-19T17:53:14.483073+0000","last_became_active":"2023-12-19T17:53:14.481182+0000","last_became_peered":"2023-12-19T17:53:14.481182+0000","last_unstale":"2023-12-19T17:53:14.483073+0000","last_undegraded":"2023-12-19T17:53:14.483073+0000","last_fullsized":"2023-12-19T17:53:14.483073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452230+0000","last_change":"2023-12-19T17:53:13.978215+0000","last_active":"2023-12-19T17:53:15.452230+0000","last_peered":"2023-12-19T17:53:15.452230+0000","last_clean":"2023-12-19T17:53:15.452230+0000","last_became_active":"2023-12-19T17:53:13.977909+0000","last_became_peered":"2023-12-19T17:53:13.977909+0000","last_unstale":"2023-12-19T17:53:15.452230+0000","last_undegraded":"2023-12-19T17:53:15.452230+0000","last_fullsized":"2023-12-19T17:53:15.452230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:15.845900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478362+0000","last_change":"2023-12-19T17:53:14.468332+0000","last_active":"2023-12-19T17:53:14.478362+0000","last_peered":"2023-12-19T17:53:14.478362+0000","last_clean":"2023-12-19T17:53:14.478362+0000","last_became_active":"2023-12-19T17:53:14.468037+0000","last_became_peered":"2023-12-19T17:53:14.468037+0000","last_unstale":"2023-12-19T17:53:14.478362+0000","last_undegraded":"2023-12-19T17:53:14.478362+0000","last_fullsized":"2023-12-19T17:53:14.478362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:41.484396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.458656+0000","last_change":"2023-12-19T17:53:13.979970+0000","last_active":"2023-12-19T17:53:14.458656+0000","last_peered":"2023-12-19T17:53:14.458656+0000","last_clean":"2023-12-19T17:53:14.458656+0000","last_became_active":"2023-12-19T17:53:13.979426+0000","last_became_peered":"2023-12-19T17:53:13.979426+0000","last_unstale":"2023-12-19T17:53:14.458656+0000","last_undegraded":"2023-12-19T17:53:14.458656+0000","last_fullsized":"2023-12-19T17:53:14.458656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:43.232708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157720+0000","last_change":"2023-12-19T17:53:14.476113+0000","last_active":"2023-12-19T17:53:16.157720+0000","last_peered":"2023-12-19T17:53:16.157720+0000","last_clean":"2023-12-19T17:53:16.157720+0000","last_became_active":"2023-12-19T17:53:14.475677+0000","last_became_peered":"2023-12-19T17:53:14.475677+0000","last_unstale":"2023-12-19T17:53:16.157720+0000","last_undegraded":"2023-12-19T17:53:16.157720+0000","last_fullsized":"2023-12-19T17:53:16.157720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:44.246152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.465169+0000","last_change":"2023-12-19T17:53:13.984038+0000","last_active":"2023-12-19T17:53:14.465169+0000","last_peered":"2023-12-19T17:53:14.465169+0000","last_clean":"2023-12-19T17:53:14.465169+0000","last_became_active":"2023-12-19T17:53:13.983671+0000","last_became_peered":"2023-12-19T17:53:13.983671+0000","last_unstale":"2023-12-19T17:53:14.465169+0000","last_undegraded":"2023-12-19T17:53:14.465169+0000","last_fullsized":"2023-12-19T17:53:14.465169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:58.116723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456938+0000","last_change":"2023-12-19T17:53:14.459497+0000","last_active":"2023-12-19T17:53:15.456938+0000","last_peered":"2023-12-19T17:53:15.456938+0000","last_clean":"2023-12-19T17:53:15.456938+0000","last_became_active":"2023-12-19T17:53:14.459206+0000","last_became_peered":"2023-12-19T17:53:14.459206+0000","last_unstale":"2023-12-19T17:53:15.456938+0000","last_undegraded":"2023-12-19T17:53:15.456938+0000","last_fullsized":"2023-12-19T17:53:15.456938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165211+0000","last_change":"2023-12-19T17:53:13.986381+0000","last_active":"2023-12-19T17:53:16.165211+0000","last_peered":"2023-12-19T17:53:16.165211+0000","last_clean":"2023-12-19T17:53:16.165211+0000","last_became_active":"2023-12-19T17:53:13.985959+0000","last_became_peered":"2023-12-19T17:53:13.985959+0000","last_unstale":"2023-12-19T17:53:16.165211+0000","last_undegraded":"2023-12-19T17:53:16.165211+0000","last_fullsized":"2023-12-19T17:53:16.165211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:57.073920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735371+0000","last_change":"2023-12-19T17:53:14.464438+0000","last_active":"2023-12-19T17:53:15.735371+0000","last_peered":"2023-12-19T17:53:15.735371+0000","last_clean":"2023-12-19T17:53:15.735371+0000","last_became_active":"2023-12-19T17:53:14.464140+0000","last_became_peered":"2023-12-19T17:53:14.464140+0000","last_unstale":"2023-12-19T17:53:15.735371+0000","last_undegraded":"2023-12-19T17:53:15.735371+0000","last_fullsized":"2023-12-19T17:53:15.735371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165060+0000","last_change":"2023-12-19T17:53:13.982049+0000","last_active":"2023-12-19T17:53:16.165060+0000","last_peered":"2023-12-19T17:53:16.165060+0000","last_clean":"2023-12-19T17:53:16.165060+0000","last_became_active":"2023-12-19T17:53:13.981593+0000","last_became_peered":"2023-12-19T17:53:13.981593+0000","last_unstale":"2023-12-19T17:53:16.165060+0000","last_undegraded":"2023-12-19T17:53:16.165060+0000","last_fullsized":"2023-12-19T17:53:16.165060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:36.600471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.476166+0000","last_change":"2023-12-19T17:53:14.473416+0000","last_active":"2023-12-19T17:53:14.476166+0000","last_peered":"2023-12-19T17:53:14.476166+0000","last_clean":"2023-12-19T17:53:14.476166+0000","last_became_active":"2023-12-19T17:53:14.472481+0000","last_became_peered":"2023-12-19T17:53:14.472481+0000","last_unstale":"2023-12-19T17:53:14.476166+0000","last_undegraded":"2023-12-19T17:53:14.476166+0000","last_fullsized":"2023-12-19T17:53:14.476166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.484060+0000","last_change":"2023-12-19T17:53:13.980184+0000","last_active":"2023-12-19T17:53:14.484060+0000","last_peered":"2023-12-19T17:53:14.484060+0000","last_clean":"2023-12-19T17:53:14.484060+0000","last_became_active":"2023-12-19T17:53:13.979900+0000","last_became_peered":"2023-12-19T17:53:13.979900+0000","last_unstale":"2023-12-19T17:53:14.484060+0000","last_undegraded":"2023-12-19T17:53:14.484060+0000","last_fullsized":"2023-12-19T17:53:14.484060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:47.592504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.734673+0000","last_change":"2023-12-19T17:53:14.470007+0000","last_active":"2023-12-19T17:53:15.734673+0000","last_peered":"2023-12-19T17:53:15.734673+0000","last_clean":"2023-12-19T17:53:15.734673+0000","last_became_active":"2023-12-19T17:53:14.469708+0000","last_became_peered":"2023-12-19T17:53:14.469708+0000","last_unstale":"2023-12-19T17:53:15.734673+0000","last_undegraded":"2023-12-19T17:53:15.734673+0000","last_fullsized":"2023-12-19T17:53:15.734673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.473131+0000","last_change":"2023-12-19T17:53:13.984032+0000","last_active":"2023-12-19T17:53:14.473131+0000","last_peered":"2023-12-19T17:53:14.473131+0000","last_clean":"2023-12-19T17:53:14.473131+0000","last_became_active":"2023-12-19T17:53:13.983745+0000","last_became_peered":"2023-12-19T17:53:13.983745+0000","last_unstale":"2023-12-19T17:53:14.473131+0000","last_undegraded":"2023-12-19T17:53:14.473131+0000","last_fullsized":"2023-12-19T17:53:14.473131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:42:14.644080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.476910+0000","last_change":"2023-12-19T17:53:14.464591+0000","last_active":"2023-12-19T17:53:14.476910+0000","last_peered":"2023-12-19T17:53:14.476910+0000","last_clean":"2023-12-19T17:53:14.476910+0000","last_became_active":"2023-12-19T17:53:14.462039+0000","last_became_peered":"2023-12-19T17:53:14.462039+0000","last_unstale":"2023-12-19T17:53:14.476910+0000","last_undegraded":"2023-12-19T17:53:14.476910+0000","last_fullsized":"2023-12-19T17:53:14.476910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:42.150658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452413+0000","last_change":"2023-12-19T17:53:13.978479+0000","last_active":"2023-12-19T17:53:15.452413+0000","last_peered":"2023-12-19T17:53:15.452413+0000","last_clean":"2023-12-19T17:53:15.452413+0000","last_became_active":"2023-12-19T17:53:13.978228+0000","last_became_peered":"2023-12-19T17:53:13.978228+0000","last_unstale":"2023-12-19T17:53:15.452413+0000","last_undegraded":"2023-12-19T17:53:15.452413+0000","last_fullsized":"2023-12-19T17:53:15.452413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:04.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456769+0000","last_change":"2023-12-19T17:53:14.453043+0000","last_active":"2023-12-19T17:53:15.456769+0000","last_peered":"2023-12-19T17:53:15.456769+0000","last_clean":"2023-12-19T17:53:15.456769+0000","last_became_active":"2023-12-19T17:53:14.452446+0000","last_became_peered":"2023-12-19T17:53:14.452446+0000","last_unstale":"2023-12-19T17:53:15.456769+0000","last_undegraded":"2023-12-19T17:53:15.456769+0000","last_fullsized":"2023-12-19T17:53:15.456769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456541+0000","last_change":"2023-12-19T17:53:13.980434+0000","last_active":"2023-12-19T17:53:15.456541+0000","last_peered":"2023-12-19T17:53:15.456541+0000","last_clean":"2023-12-19T17:53:15.456541+0000","last_became_active":"2023-12-19T17:53:13.980155+0000","last_became_peered":"2023-12-19T17:53:13.980155+0000","last_unstale":"2023-12-19T17:53:15.456541+0000","last_undegraded":"2023-12-19T17:53:15.456541+0000","last_fullsized":"2023-12-19T17:53:15.456541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:04.816889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478137+0000","last_change":"2023-12-19T17:53:14.465344+0000","last_active":"2023-12-19T17:53:14.478137+0000","last_peered":"2023-12-19T17:53:14.478137+0000","last_clean":"2023-12-19T17:53:14.478137+0000","last_became_active":"2023-12-19T17:53:14.465024+0000","last_became_peered":"2023-12-19T17:53:14.465024+0000","last_unstale":"2023-12-19T17:53:14.478137+0000","last_undegraded":"2023-12-19T17:53:14.478137+0000","last_fullsized":"2023-12-19T17:53:14.478137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:59:56.520373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457512+0000","last_change":"2023-12-19T17:53:13.979946+0000","last_active":"2023-12-19T17:53:15.457512+0000","last_peered":"2023-12-19T17:53:15.457512+0000","last_clean":"2023-12-19T17:53:15.457512+0000","last_became_active":"2023-12-19T17:53:13.979644+0000","last_became_peered":"2023-12-19T17:53:13.979644+0000","last_unstale":"2023-12-19T17:53:15.457512+0000","last_undegraded":"2023-12-19T17:53:15.457512+0000","last_fullsized":"2023-12-19T17:53:15.457512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:52.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.480259+0000","last_change":"2023-12-19T17:53:14.478011+0000","last_active":"2023-12-19T17:53:14.480259+0000","last_peered":"2023-12-19T17:53:14.480259+0000","last_clean":"2023-12-19T17:53:14.480259+0000","last_became_active":"2023-12-19T17:53:14.477706+0000","last_became_peered":"2023-12-19T17:53:14.477706+0000","last_unstale":"2023-12-19T17:53:14.480259+0000","last_undegraded":"2023-12-19T17:53:14.480259+0000","last_fullsized":"2023-12-19T17:53:14.480259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:28:53.470910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165310+0000","last_change":"2023-12-19T17:53:13.981789+0000","last_active":"2023-12-19T17:53:16.165310+0000","last_peered":"2023-12-19T17:53:16.165310+0000","last_clean":"2023-12-19T17:53:16.165310+0000","last_became_active":"2023-12-19T17:53:13.981479+0000","last_became_peered":"2023-12-19T17:53:13.981479+0000","last_unstale":"2023-12-19T17:53:16.165310+0000","last_undegraded":"2023-12-19T17:53:16.165310+0000","last_fullsized":"2023-12-19T17:53:16.165310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:52.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165075+0000","last_change":"2023-12-19T17:53:14.469503+0000","last_active":"2023-12-19T17:53:16.165075+0000","last_peered":"2023-12-19T17:53:16.165075+0000","last_clean":"2023-12-19T17:53:16.165075+0000","last_became_active":"2023-12-19T17:53:14.469257+0000","last_became_peered":"2023-12-19T17:53:14.469257+0000","last_unstale":"2023-12-19T17:53:16.165075+0000","last_undegraded":"2023-12-19T17:53:16.165075+0000","last_fullsized":"2023-12-19T17:53:16.165075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:48.605948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.486194+0000","last_change":"2023-12-19T17:53:13.977647+0000","last_active":"2023-12-19T17:53:14.486194+0000","last_peered":"2023-12-19T17:53:14.486194+0000","last_clean":"2023-12-19T17:53:14.486194+0000","last_became_active":"2023-12-19T17:53:13.977331+0000","last_became_peered":"2023-12-19T17:53:13.977331+0000","last_unstale":"2023-12-19T17:53:14.486194+0000","last_undegraded":"2023-12-19T17:53:14.486194+0000","last_fullsized":"2023-12-19T17:53:14.486194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:04.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.474793+0000","last_change":"2023-12-19T17:53:14.468444+0000","last_active":"2023-12-19T17:53:14.474793+0000","last_peered":"2023-12-19T17:53:14.474793+0000","last_clean":"2023-12-19T17:53:14.474793+0000","last_became_active":"2023-12-19T17:53:14.468165+0000","last_became_peered":"2023-12-19T17:53:14.468165+0000","last_unstale":"2023-12-19T17:53:14.474793+0000","last_undegraded":"2023-12-19T17:53:14.474793+0000","last_fullsized":"2023-12-19T17:53:14.474793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.158061+0000","last_change":"2023-12-19T17:53:13.977508+0000","last_active":"2023-12-19T17:53:16.158061+0000","last_peered":"2023-12-19T17:53:16.158061+0000","last_clean":"2023-12-19T17:53:16.158061+0000","last_became_active":"2023-12-19T17:53:13.977215+0000","last_became_peered":"2023-12-19T17:53:13.977215+0000","last_unstale":"2023-12-19T17:53:16.158061+0000","last_undegraded":"2023-12-19T17:53:16.158061+0000","last_fullsized":"2023-12-19T17:53:16.158061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:01.022462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157937+0000","last_change":"2023-12-19T17:53:14.475115+0000","last_active":"2023-12-19T17:53:16.157937+0000","last_peered":"2023-12-19T17:53:16.157937+0000","last_clean":"2023-12-19T17:53:16.157937+0000","last_became_active":"2023-12-19T17:53:14.474797+0000","last_became_peered":"2023-12-19T17:53:14.474797+0000","last_unstale":"2023-12-19T17:53:16.157937+0000","last_undegraded":"2023-12-19T17:53:16.157937+0000","last_fullsized":"2023-12-19T17:53:16.157937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:00.824597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452598+0000","last_change":"2023-12-19T17:53:13.982351+0000","last_active":"2023-12-19T17:53:15.452598+0000","last_peered":"2023-12-19T17:53:15.452598+0000","last_clean":"2023-12-19T17:53:15.452598+0000","last_became_active":"2023-12-19T17:53:13.982024+0000","last_became_peered":"2023-12-19T17:53:13.982024+0000","last_unstale":"2023-12-19T17:53:15.452598+0000","last_undegraded":"2023-12-19T17:53:15.452598+0000","last_fullsized":"2023-12-19T17:53:15.452598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:43.232708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457631+0000","last_change":"2023-12-19T17:53:14.454192+0000","last_active":"2023-12-19T17:53:15.457631+0000","last_peered":"2023-12-19T17:53:15.457631+0000","last_clean":"2023-12-19T17:53:15.457631+0000","last_became_active":"2023-12-19T17:53:14.453841+0000","last_became_peered":"2023-12-19T17:53:14.453841+0000","last_unstale":"2023-12-19T17:53:15.457631+0000","last_undegraded":"2023-12-19T17:53:15.457631+0000","last_fullsized":"2023-12-19T17:53:15.457631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:59.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157333+0000","last_change":"2023-12-19T17:53:13.978031+0000","last_active":"2023-12-19T17:53:16.157333+0000","last_peered":"2023-12-19T17:53:16.157333+0000","last_clean":"2023-12-19T17:53:16.157333+0000","last_became_active":"2023-12-19T17:53:13.977681+0000","last_became_peered":"2023-12-19T17:53:13.977681+0000","last_unstale":"2023-12-19T17:53:16.157333+0000","last_undegraded":"2023-12-19T17:53:16.157333+0000","last_fullsized":"2023-12-19T17:53:16.157333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:28.261390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.734827+0000","last_change":"2023-12-19T17:53:14.464069+0000","last_active":"2023-12-19T17:53:15.734827+0000","last_peered":"2023-12-19T17:53:15.734827+0000","last_clean":"2023-12-19T17:53:15.734827+0000","last_became_active":"2023-12-19T17:53:14.463738+0000","last_became_peered":"2023-12-19T17:53:14.463738+0000","last_unstale":"2023-12-19T17:53:15.734827+0000","last_undegraded":"2023-12-19T17:53:15.734827+0000","last_fullsized":"2023-12-19T17:53:15.734827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:22.648642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157521+0000","last_change":"2023-12-19T17:53:13.980952+0000","last_active":"2023-12-19T17:53:16.157521+0000","last_peered":"2023-12-19T17:53:16.157521+0000","last_clean":"2023-12-19T17:53:16.157521+0000","last_became_active":"2023-12-19T17:53:13.980679+0000","last_became_peered":"2023-12-19T17:53:13.980679+0000","last_unstale":"2023-12-19T17:53:16.157521+0000","last_undegraded":"2023-12-19T17:53:16.157521+0000","last_fullsized":"2023-12-19T17:53:16.157521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:19.460800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164809+0000","last_change":"2023-12-19T17:53:14.465100+0000","last_active":"2023-12-19T17:53:16.164809+0000","last_peered":"2023-12-19T17:53:16.164809+0000","last_clean":"2023-12-19T17:53:16.164809+0000","last_became_active":"2023-12-19T17:53:14.464809+0000","last_became_peered":"2023-12-19T17:53:14.464809+0000","last_unstale":"2023-12-19T17:53:16.164809+0000","last_undegraded":"2023-12-19T17:53:16.164809+0000","last_fullsized":"2023-12-19T17:53:16.164809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:59.698917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457249+0000","last_change":"2023-12-19T17:53:13.978239+0000","last_active":"2023-12-19T17:53:15.457249+0000","last_peered":"2023-12-19T17:53:15.457249+0000","last_clean":"2023-12-19T17:53:15.457249+0000","last_became_active":"2023-12-19T17:53:13.977604+0000","last_became_peered":"2023-12-19T17:53:13.977604+0000","last_unstale":"2023-12-19T17:53:15.457249+0000","last_undegraded":"2023-12-19T17:53:15.457249+0000","last_fullsized":"2023-12-19T17:53:15.457249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:29.892346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478343+0000","last_change":"2023-12-19T17:53:14.468235+0000","last_active":"2023-12-19T17:53:14.478343+0000","last_peered":"2023-12-19T17:53:14.478343+0000","last_clean":"2023-12-19T17:53:14.478343+0000","last_became_active":"2023-12-19T17:53:14.467935+0000","last_became_peered":"2023-12-19T17:53:14.467935+0000","last_unstale":"2023-12-19T17:53:14.478343+0000","last_undegraded":"2023-12-19T17:53:14.478343+0000","last_fullsized":"2023-12-19T17:53:14.478343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:10.757413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157733+0000","last_change":"2023-12-19T17:53:13.978374+0000","last_active":"2023-12-19T17:53:16.157733+0000","last_peered":"2023-12-19T17:53:16.157733+0000","last_clean":"2023-12-19T17:53:16.157733+0000","last_became_active":"2023-12-19T17:53:13.978102+0000","last_became_peered":"2023-12-19T17:53:13.978102+0000","last_unstale":"2023-12-19T17:53:16.157733+0000","last_undegraded":"2023-12-19T17:53:16.157733+0000","last_fullsized":"2023-12-19T17:53:16.157733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:40.727927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452476+0000","last_change":"2023-12-19T17:53:14.481471+0000","last_active":"2023-12-19T17:53:15.452476+0000","last_peered":"2023-12-19T17:53:15.452476+0000","last_clean":"2023-12-19T17:53:15.452476+0000","last_became_active":"2023-12-19T17:53:14.481191+0000","last_became_peered":"2023-12-19T17:53:14.481191+0000","last_unstale":"2023-12-19T17:53:15.452476+0000","last_undegraded":"2023-12-19T17:53:15.452476+0000","last_fullsized":"2023-12-19T17:53:15.452476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165425+0000","last_change":"2023-12-19T17:53:13.982831+0000","last_active":"2023-12-19T17:53:16.165425+0000","last_peered":"2023-12-19T17:53:16.165425+0000","last_clean":"2023-12-19T17:53:16.165425+0000","last_became_active":"2023-12-19T17:53:13.982559+0000","last_became_peered":"2023-12-19T17:53:13.982559+0000","last_unstale":"2023-12-19T17:53:16.165425+0000","last_undegraded":"2023-12-19T17:53:16.165425+0000","last_fullsized":"2023-12-19T17:53:16.165425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:29.892346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457038+0000","last_change":"2023-12-19T17:53:14.459872+0000","last_active":"2023-12-19T17:53:15.457038+0000","last_peered":"2023-12-19T17:53:15.457038+0000","last_clean":"2023-12-19T17:53:15.457038+0000","last_became_active":"2023-12-19T17:53:14.459587+0000","last_became_peered":"2023-12-19T17:53:14.459587+0000","last_unstale":"2023-12-19T17:53:15.457038+0000","last_undegraded":"2023-12-19T17:53:15.457038+0000","last_fullsized":"2023-12-19T17:53:15.457038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.162280+0000","last_change":"2023-12-19T17:53:13.974992+0000","last_active":"2023-12-19T17:53:16.162280+0000","last_peered":"2023-12-19T17:53:16.162280+0000","last_clean":"2023-12-19T17:53:16.162280+0000","last_became_active":"2023-12-19T17:53:13.974716+0000","last_became_peered":"2023-12-19T17:53:13.974716+0000","last_unstale":"2023-12-19T17:53:16.162280+0000","last_undegraded":"2023-12-19T17:53:16.162280+0000","last_fullsized":"2023-12-19T17:53:16.162280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:22:23.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.480222+0000","last_change":"2023-12-19T17:53:14.478453+0000","last_active":"2023-12-19T17:53:14.480222+0000","last_peered":"2023-12-19T17:53:14.480222+0000","last_clean":"2023-12-19T17:53:14.480222+0000","last_became_active":"2023-12-19T17:53:14.477826+0000","last_became_peered":"2023-12-19T17:53:14.477826+0000","last_unstale":"2023-12-19T17:53:14.480222+0000","last_undegraded":"2023-12-19T17:53:14.480222+0000","last_fullsized":"2023-12-19T17:53:14.480222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:58:46.449659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735336+0000","last_change":"2023-12-19T17:53:13.984259+0000","last_active":"2023-12-19T17:53:15.735336+0000","last_peered":"2023-12-19T17:53:15.735336+0000","last_clean":"2023-12-19T17:53:15.735336+0000","last_became_active":"2023-12-19T17:53:13.981333+0000","last_became_peered":"2023-12-19T17:53:13.981333+0000","last_unstale":"2023-12-19T17:53:15.735336+0000","last_undegraded":"2023-12-19T17:53:15.735336+0000","last_fullsized":"2023-12-19T17:53:15.735336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:04.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735021+0000","last_change":"2023-12-19T17:53:14.459490+0000","last_active":"2023-12-19T17:53:15.735021+0000","last_peered":"2023-12-19T17:53:15.735021+0000","last_clean":"2023-12-19T17:53:15.735021+0000","last_became_active":"2023-12-19T17:53:14.459048+0000","last_became_peered":"2023-12-19T17:53:14.459048+0000","last_unstale":"2023-12-19T17:53:15.735021+0000","last_undegraded":"2023-12-19T17:53:15.735021+0000","last_fullsized":"2023-12-19T17:53:15.735021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735241+0000","last_change":"2023-12-19T17:53:13.980171+0000","last_active":"2023-12-19T17:53:15.735241+0000","last_peered":"2023-12-19T17:53:15.735241+0000","last_clean":"2023-12-19T17:53:15.735241+0000","last_became_active":"2023-12-19T17:53:13.979375+0000","last_became_peered":"2023-12-19T17:53:13.979375+0000","last_unstale":"2023-12-19T17:53:15.735241+0000","last_undegraded":"2023-12-19T17:53:15.735241+0000","last_fullsized":"2023-12-19T17:53:15.735241+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.827194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452052+0000","last_change":"2023-12-19T17:53:14.464644+0000","last_active":"2023-12-19T17:53:15.452052+0000","last_peered":"2023-12-19T17:53:15.452052+0000","last_clean":"2023-12-19T17:53:15.452052+0000","last_became_active":"2023-12-19T17:53:14.464400+0000","last_became_peered":"2023-12-19T17:53:14.464400+0000","last_unstale":"2023-12-19T17:53:15.452052+0000","last_undegraded":"2023-12-19T17:53:15.452052+0000","last_fullsized":"2023-12-19T17:53:15.452052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456770+0000","last_change":"2023-12-19T17:53:13.975777+0000","last_active":"2023-12-19T17:53:15.456770+0000","last_peered":"2023-12-19T17:53:15.456770+0000","last_clean":"2023-12-19T17:53:15.456770+0000","last_became_active":"2023-12-19T17:53:13.974298+0000","last_became_peered":"2023-12-19T17:53:13.974298+0000","last_unstale":"2023-12-19T17:53:15.456770+0000","last_undegraded":"2023-12-19T17:53:15.456770+0000","last_fullsized":"2023-12-19T17:53:15.456770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:22:23.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.477286+0000","last_change":"2023-12-19T17:53:14.474336+0000","last_active":"2023-12-19T17:53:14.477286+0000","last_peered":"2023-12-19T17:53:14.477286+0000","last_clean":"2023-12-19T17:53:14.477286+0000","last_became_active":"2023-12-19T17:53:14.474069+0000","last_became_peered":"2023-12-19T17:53:14.474069+0000","last_unstale":"2023-12-19T17:53:14.477286+0000","last_undegraded":"2023-12-19T17:53:14.477286+0000","last_fullsized":"2023-12-19T17:53:14.477286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.458891+0000","last_change":"2023-12-19T17:53:13.982635+0000","last_active":"2023-12-19T17:53:14.458891+0000","last_peered":"2023-12-19T17:53:14.458891+0000","last_clean":"2023-12-19T17:53:14.458891+0000","last_became_active":"2023-12-19T17:53:13.982152+0000","last_became_peered":"2023-12-19T17:53:13.982152+0000","last_unstale":"2023-12-19T17:53:14.458891+0000","last_undegraded":"2023-12-19T17:53:14.458891+0000","last_fullsized":"2023-12-19T17:53:14.458891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:15.845900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457180+0000","last_change":"2023-12-19T17:53:14.455151+0000","last_active":"2023-12-19T17:53:15.457180+0000","last_peered":"2023-12-19T17:53:15.457180+0000","last_clean":"2023-12-19T17:53:15.457180+0000","last_became_active":"2023-12-19T17:53:14.454873+0000","last_became_peered":"2023-12-19T17:53:14.454873+0000","last_unstale":"2023-12-19T17:53:15.457180+0000","last_undegraded":"2023-12-19T17:53:15.457180+0000","last_fullsized":"2023-12-19T17:53:15.457180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:22.648642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.458165+0000","last_change":"2023-12-19T17:53:13.981158+0000","last_active":"2023-12-19T17:53:14.458165+0000","last_peered":"2023-12-19T17:53:14.458165+0000","last_clean":"2023-12-19T17:53:14.458165+0000","last_became_active":"2023-12-19T17:53:13.980889+0000","last_became_peered":"2023-12-19T17:53:13.980889+0000","last_unstale":"2023-12-19T17:53:14.458165+0000","last_undegraded":"2023-12-19T17:53:14.458165+0000","last_fullsized":"2023-12-19T17:53:14.458165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:26:59.305183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165182+0000","last_change":"2023-12-19T17:53:14.479499+0000","last_active":"2023-12-19T17:53:16.165182+0000","last_peered":"2023-12-19T17:53:16.165182+0000","last_clean":"2023-12-19T17:53:16.165182+0000","last_became_active":"2023-12-19T17:53:14.479253+0000","last_became_peered":"2023-12-19T17:53:14.479253+0000","last_unstale":"2023-12-19T17:53:16.165182+0000","last_undegraded":"2023-12-19T17:53:16.165182+0000","last_fullsized":"2023-12-19T17:53:16.165182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:23:09.788883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457271+0000","last_change":"2023-12-19T17:53:13.978411+0000","last_active":"2023-12-19T17:53:15.457271+0000","last_peered":"2023-12-19T17:53:15.457271+0000","last_clean":"2023-12-19T17:53:15.457271+0000","last_became_active":"2023-12-19T17:53:13.978094+0000","last_became_peered":"2023-12-19T17:53:13.978094+0000","last_unstale":"2023-12-19T17:53:15.457271+0000","last_undegraded":"2023-12-19T17:53:15.457271+0000","last_fullsized":"2023-12-19T17:53:15.457271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:57.073920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.446198+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:53:14.446198+0000","last_peered":"2023-12-19T17:53:14.446198+0000","last_clean":"2023-12-19T17:53:14.446198+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:53:14.446198+0000","last_undegraded":"2023-12-19T17:53:14.446198+0000","last_fullsized":"2023-12-19T17:53:14.446198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.042},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.84199999999999997}]},{"osd":2,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.234}]},{"osd":3,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3089999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.0920000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.347},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.181}]},{"osd":6,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.119},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.278}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":4.5979999999999999,"5min":4.5979999999999999,"15min":4.5979999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.089}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.90700000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":8.5470000000000006,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.6340000000000003,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.153}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":4.508,"5min":4.508,"15min":4.508},"last":1.294}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.125},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.70899999999999996}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.214}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.351}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":187769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.70899999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.995},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.109}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0740000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":3.21,"5min":3.21,"15min":3.21},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.024}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.046},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":1.1579999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":188261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":5.4420000000000002,"5min":5.4420000000000002,"15min":5.4420000000000002},"last":1.123},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":5.5049999999999999,"5min":5.5049999999999999,"15min":5.5049999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":1.0409999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":1.258},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":1.2849999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.161}]},{"osd":6,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.198}]},{"osd":7,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":1.302},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":189255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0129999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.98099999999999998}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.121},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.589}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":1.216}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.651},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.149}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.7849999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":187727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.32,"5min":13.32,"15min":13.32},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":13.206,"5min":13.206,"15min":13.206},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4870000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.026}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.1910000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.371},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.4530000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.999}]},{"osd":2,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.4199999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":0.91100000000000003}]},{"osd":3,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.4950000000000001,"5min":3.4950000000000001,"15min":3.4950000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":1.1000000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":4.3869999999999996,"5min":4.3869999999999996,"15min":4.3869999999999996},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.03},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.5780000000000003,"5min":4.5780000000000003,"15min":4.5780000000000003},"last":1.643},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.728}]},{"osd":7,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":1.601},{"interface":"front","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.8320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":777040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.29},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.6279999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.79300000000000004}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.98699999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.353}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.153}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.5569999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.823,"5min":1.823,"15min":1.823},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":1.47},{"interface":"front","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":4.8250000000000002,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.4359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:53:18.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:53:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 Processor -- start 2023-12-19T17:53:19.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 -- start start 2023-12-19T17:53:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb58015d030 0x7fb5800d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5800b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5800d17a0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5800d1a80 con 0x7fb58015d030 2023-12-19T17:53:19.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.001+0000 7fb5850e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800d1d60 con 0x7fb5800ce290 2023-12-19T17:53:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb58015d030 0x7fb5800d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb577fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb5800b8ab0 0x7fb5800cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53774/0 (socket says 172.21.15.45:53774) 2023-12-19T17:53:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb577fff700 1 -- 172.21.15.45:0/1994176136 learned_addr learned my addr 172.21.15.45:0/1994176136 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:19.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57f59e700 1 --2- 172.21.15.45:0/1994176136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5800b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57e59c700 1 -- 172.21.15.45:0/1994176136 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 513643921 0 0) 0x7fb5800d17a0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57e59c700 1 -- 172.21.15.45:0/1994176136 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb56c0035d0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1994176136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 msgr2=0x7fb5800b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57ed9d700 1 --2- 172.21.15.45:0/1994176136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5800b5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1994176136 >> v1:172.21.15.45:6789/0 conn(0x7fb5800b8ab0 legacy=0x7fb5800cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1994176136 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5800d2040 con 0x7fb58015d030 2023-12-19T17:53:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57ed9d700 1 --2- 172.21.15.45:0/1994176136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb58015d030 0x7fb5800d0ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb570009850 tx=0x7fb570009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73298fbe0e93854b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57e59c700 1 -- 172.21.15.45:0/1994176136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570011830 con 0x7fb58015d030 2023-12-19T17:53:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57e59c700 1 -- 172.21.15.45:0/1994176136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb570011990 con 0x7fb58015d030 2023-12-19T17:53:19.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb57e59c700 1 -- 172.21.15.45:0/1994176136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570011d00 con 0x7fb58015d030 2023-12-19T17:53:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb5850e0700 1 -- 172.21.15.45:0/1994176136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb58015d030 msgr2=0x7fb5800d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.005+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1994176136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb58015d030 0x7fb5800d0ea0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fb570009850 tx=0x7fb570009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:19.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 -- 172.21.15.45:0/1994176136 shutdown_connections 2023-12-19T17:53:19.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1994176136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5800b5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1994176136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb58015d030 0x7fb5800d0ea0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 -- 172.21.15.45:0/1994176136 >> 172.21.15.45:0/1994176136 conn(0x7fb5800cf830 msgr2=0x7fb5800cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:19.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 -- 172.21.15.45:0/1994176136 shutdown_connections 2023-12-19T17:53:19.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 -- 172.21.15.45:0/1994176136 wait complete. 2023-12-19T17:53:19.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 Processor -- start 2023-12-19T17:53:19.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.009+0000 7fb5850e0700 1 -- start start 2023-12-19T17:53:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 0x7fb5800b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5801f6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb58015d030 0x7fb5800cc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5801f6c50 con 0x7fb5800b8ab0 2023-12-19T17:53:19.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800cc8f0 con 0x7fb58015d030 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5800ccbd0 con 0x7fb5800ce290 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 0x7fb5800b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 0x7fb5800b1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56574/0 (socket says 172.21.15.45:56574) 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1489045478 learned_addr learned my addr 172.21.15.45:0/1489045478 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57f59e700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb58015d030 0x7fb5800cc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb577fff700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5801f6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 msgr2=0x7fb5801f6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5801f6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb58015d030 msgr2=0x7fb5800cc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb58015d030 0x7fb5800cc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 -- 172.21.15.45:0/1489045478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700094b0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57f59e700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb58015d030 0x7fb5800cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb577fff700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5801f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:19.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb57ed9d700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 0x7fb5800b1110 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb570009ba0 tx=0x7fb570004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5700036c0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57001e070 con 0x7fb5800b8ab0 2023-12-19T17:53:19.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb570003a60 con 0x7fb5800b8ab0 2023-12-19T17:53:19.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5801f5f10 con 0x7fb5800b8ab0 2023-12-19T17:53:19.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.013+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5800cc5e0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.017+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5801f5d70 con 0x7fb5800b8ab0 2023-12-19T17:53:19.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.017+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb570003bc0 con 0x7fb5800b8ab0 2023-12-19T17:53:19.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.021+0000 7fb5777fe700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb560065ad0 0x7fb560067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.021+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb570084240 con 0x7fb5800b8ab0 2023-12-19T17:53:19.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.021+0000 7fb577fff700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb560065ad0 0x7fb560067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.021+0000 7fb577fff700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb560065ad0 0x7fb560067f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb5800b5a40 tx=0x7fb568009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.025+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb5801f5d70 con 0x7fb5800b8ab0 2023-12-19T17:53:19.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.201+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb58015d410 con 0x7fb560065ad0 2023-12-19T17:53:19.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.209+0000 7fb5777fe700 1 -- 172.21.15.45:0/1489045478 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286851 (secure 0 0 0) 0x7fb568001c70 con 0x7fb560065ad0 2023-12-19T17:53:19.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb560065ad0 msgr2=0x7fb560067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb560065ad0 0x7fb560067f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb5800b5a40 tx=0x7fb568009040 comp rx=0 tx=0).stop 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 msgr2=0x7fb5800b1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 0x7fb5800b1110 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb570009ba0 tx=0x7fb570004770 comp rx=0 tx=0).stop 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 shutdown_connections 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb560065ad0 0x7fb560067f90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb58015d030 0x7fb5800cc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb5800ce290 0x7fb5801f6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 --2- 172.21.15.45:0/1489045478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb5800b8ab0 0x7fb5800b1110 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 >> 172.21.15.45:0/1489045478 conn(0x7fb5800cf830 msgr2=0x7fb5800b2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:19.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 shutdown_connections 2023-12-19T17:53:19.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.217+0000 7fb5850e0700 1 -- 172.21.15.45:0/1489045478 wait complete. 2023-12-19T17:53:19.223 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:53:19.244 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-19T17:53:18.228467+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224392,"kb_used_data":4680,"kb_used_omap":0,"kb_used_meta":219648,"kb_avail":754750328,"statfs":{"total":773094113280,"available":772864335872,"internally_reserved":0,"allocated":4792320,"data_stored":2705557,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":224919552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.291507"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478833+0000","last_change":"2023-12-19T17:53:14.473667+0000","last_active":"2023-12-19T17:53:14.478833+0000","last_peered":"2023-12-19T17:53:14.478833+0000","last_clean":"2023-12-19T17:53:14.478833+0000","last_became_active":"2023-12-19T17:53:14.473362+0000","last_became_peered":"2023-12-19T17:53:14.473362+0000","last_unstale":"2023-12-19T17:53:14.478833+0000","last_undegraded":"2023-12-19T17:53:14.478833+0000","last_fullsized":"2023-12-19T17:53:14.478833+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.865682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478591+0000","last_change":"2023-12-19T17:53:14.473330+0000","last_active":"2023-12-19T17:53:14.478591+0000","last_peered":"2023-12-19T17:53:14.478591+0000","last_clean":"2023-12-19T17:53:14.478591+0000","last_became_active":"2023-12-19T17:53:14.472947+0000","last_became_peered":"2023-12-19T17:53:14.472947+0000","last_unstale":"2023-12-19T17:53:14.478591+0000","last_undegraded":"2023-12-19T17:53:14.478591+0000","last_fullsized":"2023-12-19T17:53:14.478591+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:05.577856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735371+0000","last_change":"2023-12-19T17:53:14.479990+0000","last_active":"2023-12-19T17:53:15.735371+0000","last_peered":"2023-12-19T17:53:15.735371+0000","last_clean":"2023-12-19T17:53:15.735371+0000","last_became_active":"2023-12-19T17:53:14.479688+0000","last_became_peered":"2023-12-19T17:53:14.479688+0000","last_unstale":"2023-12-19T17:53:15.735371+0000","last_undegraded":"2023-12-19T17:53:15.735371+0000","last_fullsized":"2023-12-19T17:53:15.735371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157506+0000","last_change":"2023-12-19T17:53:14.475913+0000","last_active":"2023-12-19T17:53:16.157506+0000","last_peered":"2023-12-19T17:53:16.157506+0000","last_clean":"2023-12-19T17:53:16.157506+0000","last_became_active":"2023-12-19T17:53:14.475357+0000","last_became_peered":"2023-12-19T17:53:14.475357+0000","last_unstale":"2023-12-19T17:53:16.157506+0000","last_undegraded":"2023-12-19T17:53:16.157506+0000","last_fullsized":"2023-12-19T17:53:16.157506+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:06.840638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157547+0000","last_change":"2023-12-19T17:53:14.462398+0000","last_active":"2023-12-19T17:53:16.157547+0000","last_peered":"2023-12-19T17:53:16.157547+0000","last_clean":"2023-12-19T17:53:16.157547+0000","last_became_active":"2023-12-19T17:53:14.462125+0000","last_became_peered":"2023-12-19T17:53:14.462125+0000","last_unstale":"2023-12-19T17:53:16.157547+0000","last_undegraded":"2023-12-19T17:53:16.157547+0000","last_fullsized":"2023-12-19T17:53:16.157547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:05.680245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452257+0000","last_change":"2023-12-19T17:53:14.462850+0000","last_active":"2023-12-19T17:53:15.452257+0000","last_peered":"2023-12-19T17:53:15.452257+0000","last_clean":"2023-12-19T17:53:15.452257+0000","last_became_active":"2023-12-19T17:53:14.461967+0000","last_became_peered":"2023-12-19T17:53:14.461967+0000","last_unstale":"2023-12-19T17:53:15.452257+0000","last_undegraded":"2023-12-19T17:53:15.452257+0000","last_fullsized":"2023-12-19T17:53:15.452257+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:57.956733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164275+0000","last_change":"2023-12-19T17:53:14.465610+0000","last_active":"2023-12-19T17:53:16.164275+0000","last_peered":"2023-12-19T17:53:16.164275+0000","last_clean":"2023-12-19T17:53:16.164275+0000","last_became_active":"2023-12-19T17:53:14.465025+0000","last_became_peered":"2023-12-19T17:53:14.465025+0000","last_unstale":"2023-12-19T17:53:16.164275+0000","last_undegraded":"2023-12-19T17:53:16.164275+0000","last_fullsized":"2023-12-19T17:53:16.164275+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.481378+0000","last_change":"2023-12-19T17:53:14.479239+0000","last_active":"2023-12-19T17:53:14.481378+0000","last_peered":"2023-12-19T17:53:14.481378+0000","last_clean":"2023-12-19T17:53:14.481378+0000","last_became_active":"2023-12-19T17:53:14.478993+0000","last_became_peered":"2023-12-19T17:53:14.478993+0000","last_unstale":"2023-12-19T17:53:14.481378+0000","last_undegraded":"2023-12-19T17:53:14.481378+0000","last_fullsized":"2023-12-19T17:53:14.481378+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:02.044708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735636+0000","last_change":"2023-12-19T17:53:14.470439+0000","last_active":"2023-12-19T17:53:15.735636+0000","last_peered":"2023-12-19T17:53:15.735636+0000","last_clean":"2023-12-19T17:53:15.735636+0000","last_became_active":"2023-12-19T17:53:14.470145+0000","last_became_peered":"2023-12-19T17:53:14.470145+0000","last_unstale":"2023-12-19T17:53:15.735636+0000","last_undegraded":"2023-12-19T17:53:15.735636+0000","last_fullsized":"2023-12-19T17:53:15.735636+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165029+0000","last_change":"2023-12-19T17:53:14.477417+0000","last_active":"2023-12-19T17:53:16.165029+0000","last_peered":"2023-12-19T17:53:16.165029+0000","last_clean":"2023-12-19T17:53:16.165029+0000","last_became_active":"2023-12-19T17:53:14.473192+0000","last_became_peered":"2023-12-19T17:53:14.473192+0000","last_unstale":"2023-12-19T17:53:16.165029+0000","last_undegraded":"2023-12-19T17:53:16.165029+0000","last_fullsized":"2023-12-19T17:53:16.165029+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164832+0000","last_change":"2023-12-19T17:53:14.480792+0000","last_active":"2023-12-19T17:53:16.164832+0000","last_peered":"2023-12-19T17:53:16.164832+0000","last_clean":"2023-12-19T17:53:16.164832+0000","last_became_active":"2023-12-19T17:53:14.480370+0000","last_became_peered":"2023-12-19T17:53:14.480370+0000","last_unstale":"2023-12-19T17:53:16.164832+0000","last_undegraded":"2023-12-19T17:53:16.164832+0000","last_fullsized":"2023-12-19T17:53:16.164832+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735299+0000","last_change":"2023-12-19T17:53:14.453686+0000","last_active":"2023-12-19T17:53:15.735299+0000","last_peered":"2023-12-19T17:53:15.735299+0000","last_clean":"2023-12-19T17:53:15.735299+0000","last_became_active":"2023-12-19T17:53:14.453442+0000","last_became_peered":"2023-12-19T17:53:14.453442+0000","last_unstale":"2023-12-19T17:53:15.735299+0000","last_undegraded":"2023-12-19T17:53:15.735299+0000","last_fullsized":"2023-12-19T17:53:15.735299+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:48.605948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164540+0000","last_change":"2023-12-19T17:53:14.478769+0000","last_active":"2023-12-19T17:53:16.164540+0000","last_peered":"2023-12-19T17:53:16.164540+0000","last_clean":"2023-12-19T17:53:16.164540+0000","last_became_active":"2023-12-19T17:53:14.478515+0000","last_became_peered":"2023-12-19T17:53:14.478515+0000","last_unstale":"2023-12-19T17:53:16.164540+0000","last_undegraded":"2023-12-19T17:53:16.164540+0000","last_fullsized":"2023-12-19T17:53:16.164540+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.484142+0000","last_change":"2023-12-19T17:53:14.482177+0000","last_active":"2023-12-19T17:53:14.484142+0000","last_peered":"2023-12-19T17:53:14.484142+0000","last_clean":"2023-12-19T17:53:14.484142+0000","last_became_active":"2023-12-19T17:53:14.481920+0000","last_became_peered":"2023-12-19T17:53:14.481920+0000","last_unstale":"2023-12-19T17:53:14.484142+0000","last_undegraded":"2023-12-19T17:53:14.484142+0000","last_fullsized":"2023-12-19T17:53:14.484142+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164353+0000","last_change":"2023-12-19T17:53:14.465401+0000","last_active":"2023-12-19T17:53:16.164353+0000","last_peered":"2023-12-19T17:53:16.164353+0000","last_clean":"2023-12-19T17:53:16.164353+0000","last_became_active":"2023-12-19T17:53:14.465000+0000","last_became_peered":"2023-12-19T17:53:14.465000+0000","last_unstale":"2023-12-19T17:53:16.164353+0000","last_undegraded":"2023-12-19T17:53:16.164353+0000","last_fullsized":"2023-12-19T17:53:16.164353+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457408+0000","last_change":"2023-12-19T17:53:14.466569+0000","last_active":"2023-12-19T17:53:15.457408+0000","last_peered":"2023-12-19T17:53:15.457408+0000","last_clean":"2023-12-19T17:53:15.457408+0000","last_became_active":"2023-12-19T17:53:14.466302+0000","last_became_peered":"2023-12-19T17:53:14.466302+0000","last_unstale":"2023-12-19T17:53:15.457408+0000","last_undegraded":"2023-12-19T17:53:15.457408+0000","last_fullsized":"2023-12-19T17:53:15.457408+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:59.698917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457321+0000","last_change":"2023-12-19T17:53:14.471846+0000","last_active":"2023-12-19T17:53:15.457321+0000","last_peered":"2023-12-19T17:53:15.457321+0000","last_clean":"2023-12-19T17:53:15.457321+0000","last_became_active":"2023-12-19T17:53:14.471589+0000","last_became_peered":"2023-12-19T17:53:14.471589+0000","last_unstale":"2023-12-19T17:53:15.457321+0000","last_undegraded":"2023-12-19T17:53:15.457321+0000","last_fullsized":"2023-12-19T17:53:15.457321+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.458037+0000","last_change":"2023-12-19T17:53:14.475851+0000","last_active":"2023-12-19T17:53:15.458037+0000","last_peered":"2023-12-19T17:53:15.458037+0000","last_clean":"2023-12-19T17:53:15.458037+0000","last_became_active":"2023-12-19T17:53:14.475409+0000","last_became_peered":"2023-12-19T17:53:14.475409+0000","last_unstale":"2023-12-19T17:53:15.458037+0000","last_undegraded":"2023-12-19T17:53:15.458037+0000","last_fullsized":"2023-12-19T17:53:15.458037+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:00.824597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157922+0000","last_change":"2023-12-19T17:53:14.457315+0000","last_active":"2023-12-19T17:53:16.157922+0000","last_peered":"2023-12-19T17:53:16.157922+0000","last_clean":"2023-12-19T17:53:16.157922+0000","last_became_active":"2023-12-19T17:53:14.456856+0000","last_became_peered":"2023-12-19T17:53:14.456856+0000","last_unstale":"2023-12-19T17:53:16.157922+0000","last_undegraded":"2023-12-19T17:53:16.157922+0000","last_fullsized":"2023-12-19T17:53:16.157922+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:23:20.957209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457747+0000","last_change":"2023-12-19T17:53:14.468477+0000","last_active":"2023-12-19T17:53:15.457747+0000","last_peered":"2023-12-19T17:53:15.457747+0000","last_clean":"2023-12-19T17:53:15.457747+0000","last_became_active":"2023-12-19T17:53:14.468209+0000","last_became_peered":"2023-12-19T17:53:14.468209+0000","last_unstale":"2023-12-19T17:53:15.457747+0000","last_undegraded":"2023-12-19T17:53:15.457747+0000","last_fullsized":"2023-12-19T17:53:15.457747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:05.680245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164334+0000","last_change":"2023-12-19T17:53:14.465291+0000","last_active":"2023-12-19T17:53:16.164334+0000","last_peered":"2023-12-19T17:53:16.164334+0000","last_clean":"2023-12-19T17:53:16.164334+0000","last_became_active":"2023-12-19T17:53:14.464940+0000","last_became_peered":"2023-12-19T17:53:14.464940+0000","last_unstale":"2023-12-19T17:53:16.164334+0000","last_undegraded":"2023-12-19T17:53:16.164334+0000","last_fullsized":"2023-12-19T17:53:16.164334+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.474432+0000","last_change":"2023-12-19T17:53:14.466194+0000","last_active":"2023-12-19T17:53:14.474432+0000","last_peered":"2023-12-19T17:53:14.474432+0000","last_clean":"2023-12-19T17:53:14.474432+0000","last_became_active":"2023-12-19T17:53:14.465880+0000","last_became_peered":"2023-12-19T17:53:14.465880+0000","last_unstale":"2023-12-19T17:53:14.474432+0000","last_undegraded":"2023-12-19T17:53:14.474432+0000","last_fullsized":"2023-12-19T17:53:14.474432+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456925+0000","last_change":"2023-12-19T17:53:14.453144+0000","last_active":"2023-12-19T17:53:15.456925+0000","last_peered":"2023-12-19T17:53:15.456925+0000","last_clean":"2023-12-19T17:53:15.456925+0000","last_became_active":"2023-12-19T17:53:14.452411+0000","last_became_peered":"2023-12-19T17:53:14.452411+0000","last_unstale":"2023-12-19T17:53:15.456925+0000","last_undegraded":"2023-12-19T17:53:15.456925+0000","last_fullsized":"2023-12-19T17:53:15.456925+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157453+0000","last_change":"2023-12-19T17:53:14.457708+0000","last_active":"2023-12-19T17:53:16.157453+0000","last_peered":"2023-12-19T17:53:16.157453+0000","last_clean":"2023-12-19T17:53:16.157453+0000","last_became_active":"2023-12-19T17:53:14.454536+0000","last_became_peered":"2023-12-19T17:53:14.454536+0000","last_unstale":"2023-12-19T17:53:16.157453+0000","last_undegraded":"2023-12-19T17:53:16.157453+0000","last_fullsized":"2023-12-19T17:53:16.157453+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:16.859344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457988+0000","last_change":"2023-12-19T17:53:14.467856+0000","last_active":"2023-12-19T17:53:15.457988+0000","last_peered":"2023-12-19T17:53:15.457988+0000","last_clean":"2023-12-19T17:53:15.457988+0000","last_became_active":"2023-12-19T17:53:14.464337+0000","last_became_peered":"2023-12-19T17:53:14.464337+0000","last_unstale":"2023-12-19T17:53:15.457988+0000","last_undegraded":"2023-12-19T17:53:15.457988+0000","last_fullsized":"2023-12-19T17:53:15.457988+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:04.819385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452801+0000","last_change":"2023-12-19T17:53:14.466483+0000","last_active":"2023-12-19T17:53:15.452801+0000","last_peered":"2023-12-19T17:53:15.452801+0000","last_clean":"2023-12-19T17:53:15.452801+0000","last_became_active":"2023-12-19T17:53:14.466239+0000","last_became_peered":"2023-12-19T17:53:14.466239+0000","last_unstale":"2023-12-19T17:53:15.452801+0000","last_undegraded":"2023-12-19T17:53:15.452801+0000","last_fullsized":"2023-12-19T17:53:15.452801+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457851+0000","last_change":"2023-12-19T17:53:14.469576+0000","last_active":"2023-12-19T17:53:15.457851+0000","last_peered":"2023-12-19T17:53:15.457851+0000","last_clean":"2023-12-19T17:53:15.457851+0000","last_became_active":"2023-12-19T17:53:14.467647+0000","last_became_peered":"2023-12-19T17:53:14.467647+0000","last_unstale":"2023-12-19T17:53:15.457851+0000","last_undegraded":"2023-12-19T17:53:15.457851+0000","last_fullsized":"2023-12-19T17:53:15.457851+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:06.840638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164808+0000","last_change":"2023-12-19T17:53:14.478110+0000","last_active":"2023-12-19T17:53:16.164808+0000","last_peered":"2023-12-19T17:53:16.164808+0000","last_clean":"2023-12-19T17:53:16.164808+0000","last_became_active":"2023-12-19T17:53:14.477842+0000","last_became_peered":"2023-12-19T17:53:14.477842+0000","last_unstale":"2023-12-19T17:53:16.164808+0000","last_undegraded":"2023-12-19T17:53:16.164808+0000","last_fullsized":"2023-12-19T17:53:16.164808+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457087+0000","last_change":"2023-12-19T17:53:14.466761+0000","last_active":"2023-12-19T17:53:15.457087+0000","last_peered":"2023-12-19T17:53:15.457087+0000","last_clean":"2023-12-19T17:53:15.457087+0000","last_became_active":"2023-12-19T17:53:14.466482+0000","last_became_peered":"2023-12-19T17:53:14.466482+0000","last_unstale":"2023-12-19T17:53:15.457087+0000","last_undegraded":"2023-12-19T17:53:15.457087+0000","last_fullsized":"2023-12-19T17:53:15.457087+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:22.648642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456696+0000","last_change":"2023-12-19T17:53:14.468042+0000","last_active":"2023-12-19T17:53:15.456696+0000","last_peered":"2023-12-19T17:53:15.456696+0000","last_clean":"2023-12-19T17:53:15.456696+0000","last_became_active":"2023-12-19T17:53:14.467270+0000","last_became_peered":"2023-12-19T17:53:14.467270+0000","last_unstale":"2023-12-19T17:53:15.456696+0000","last_undegraded":"2023-12-19T17:53:15.456696+0000","last_fullsized":"2023-12-19T17:53:15.456696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:23:20.957209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457109+0000","last_change":"2023-12-19T17:53:14.454385+0000","last_active":"2023-12-19T17:53:15.457109+0000","last_peered":"2023-12-19T17:53:15.457109+0000","last_clean":"2023-12-19T17:53:15.457109+0000","last_became_active":"2023-12-19T17:53:14.453835+0000","last_became_peered":"2023-12-19T17:53:14.453835+0000","last_unstale":"2023-12-19T17:53:15.457109+0000","last_undegraded":"2023-12-19T17:53:15.457109+0000","last_fullsized":"2023-12-19T17:53:15.457109+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:57.956733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452156+0000","last_change":"2023-12-19T17:53:14.453222+0000","last_active":"2023-12-19T17:53:15.452156+0000","last_peered":"2023-12-19T17:53:15.452156+0000","last_clean":"2023-12-19T17:53:15.452156+0000","last_became_active":"2023-12-19T17:53:14.452961+0000","last_became_peered":"2023-12-19T17:53:14.452961+0000","last_unstale":"2023-12-19T17:53:15.452156+0000","last_undegraded":"2023-12-19T17:53:15.452156+0000","last_fullsized":"2023-12-19T17:53:15.452156+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457129+0000","last_change":"2023-12-19T17:53:14.474306+0000","last_active":"2023-12-19T17:53:15.457129+0000","last_peered":"2023-12-19T17:53:15.457129+0000","last_clean":"2023-12-19T17:53:15.457129+0000","last_became_active":"2023-12-19T17:53:14.474064+0000","last_became_peered":"2023-12-19T17:53:14.474064+0000","last_unstale":"2023-12-19T17:53:15.457129+0000","last_undegraded":"2023-12-19T17:53:15.457129+0000","last_fullsized":"2023-12-19T17:53:15.457129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457998+0000","last_change":"2023-12-19T17:53:13.984204+0000","last_active":"2023-12-19T17:53:15.457998+0000","last_peered":"2023-12-19T17:53:15.457998+0000","last_clean":"2023-12-19T17:53:15.457998+0000","last_became_active":"2023-12-19T17:53:13.983878+0000","last_became_peered":"2023-12-19T17:53:13.983878+0000","last_unstale":"2023-12-19T17:53:15.457998+0000","last_undegraded":"2023-12-19T17:53:15.457998+0000","last_fullsized":"2023-12-19T17:53:15.457998+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:01:53.371017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452888+0000","last_change":"2023-12-19T17:53:14.479730+0000","last_active":"2023-12-19T17:53:15.452888+0000","last_peered":"2023-12-19T17:53:15.452888+0000","last_clean":"2023-12-19T17:53:15.452888+0000","last_became_active":"2023-12-19T17:53:14.479276+0000","last_became_peered":"2023-12-19T17:53:14.479276+0000","last_unstale":"2023-12-19T17:53:15.452888+0000","last_undegraded":"2023-12-19T17:53:15.452888+0000","last_fullsized":"2023-12-19T17:53:15.452888+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735548+0000","last_change":"2023-12-19T17:53:13.980591+0000","last_active":"2023-12-19T17:53:15.735548+0000","last_peered":"2023-12-19T17:53:15.735548+0000","last_clean":"2023-12-19T17:53:15.735548+0000","last_became_active":"2023-12-19T17:53:13.979773+0000","last_became_peered":"2023-12-19T17:53:13.979773+0000","last_unstale":"2023-12-19T17:53:15.735548+0000","last_undegraded":"2023-12-19T17:53:15.735548+0000","last_fullsized":"2023-12-19T17:53:15.735548+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:43.232708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.477315+0000","last_change":"2023-12-19T17:53:14.473510+0000","last_active":"2023-12-19T17:53:14.477315+0000","last_peered":"2023-12-19T17:53:14.477315+0000","last_clean":"2023-12-19T17:53:14.477315+0000","last_became_active":"2023-12-19T17:53:14.473239+0000","last_became_peered":"2023-12-19T17:53:14.473239+0000","last_unstale":"2023-12-19T17:53:14.477315+0000","last_undegraded":"2023-12-19T17:53:14.477315+0000","last_fullsized":"2023-12-19T17:53:14.477315+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:15.749395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.453062+0000","last_change":"2023-12-19T17:53:13.983036+0000","last_active":"2023-12-19T17:53:15.453062+0000","last_peered":"2023-12-19T17:53:15.453062+0000","last_clean":"2023-12-19T17:53:15.453062+0000","last_became_active":"2023-12-19T17:53:13.982750+0000","last_became_peered":"2023-12-19T17:53:13.982750+0000","last_unstale":"2023-12-19T17:53:15.453062+0000","last_undegraded":"2023-12-19T17:53:15.453062+0000","last_fullsized":"2023-12-19T17:53:15.453062+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.827194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.481270+0000","last_change":"2023-12-19T17:53:14.478738+0000","last_active":"2023-12-19T17:53:14.481270+0000","last_peered":"2023-12-19T17:53:14.481270+0000","last_clean":"2023-12-19T17:53:14.481270+0000","last_became_active":"2023-12-19T17:53:14.478546+0000","last_became_peered":"2023-12-19T17:53:14.478546+0000","last_unstale":"2023-12-19T17:53:14.481270+0000","last_undegraded":"2023-12-19T17:53:14.481270+0000","last_fullsized":"2023-12-19T17:53:14.481270+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:56.461304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.474234+0000","last_change":"2023-12-19T17:53:13.984365+0000","last_active":"2023-12-19T17:53:14.474234+0000","last_peered":"2023-12-19T17:53:14.474234+0000","last_clean":"2023-12-19T17:53:14.474234+0000","last_became_active":"2023-12-19T17:53:13.984083+0000","last_became_peered":"2023-12-19T17:53:13.984083+0000","last_unstale":"2023-12-19T17:53:14.474234+0000","last_undegraded":"2023-12-19T17:53:14.474234+0000","last_fullsized":"2023-12-19T17:53:14.474234+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.827194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.734663+0000","last_change":"2023-12-19T17:53:14.459320+0000","last_active":"2023-12-19T17:53:15.734663+0000","last_peered":"2023-12-19T17:53:15.734663+0000","last_clean":"2023-12-19T17:53:15.734663+0000","last_became_active":"2023-12-19T17:53:14.458709+0000","last_became_peered":"2023-12-19T17:53:14.458709+0000","last_unstale":"2023-12-19T17:53:15.734663+0000","last_undegraded":"2023-12-19T17:53:15.734663+0000","last_fullsized":"2023-12-19T17:53:15.734663+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164623+0000","last_change":"2023-12-19T17:53:13.983065+0000","last_active":"2023-12-19T17:53:16.164623+0000","last_peered":"2023-12-19T17:53:16.164623+0000","last_clean":"2023-12-19T17:53:16.164623+0000","last_became_active":"2023-12-19T17:53:13.982795+0000","last_became_peered":"2023-12-19T17:53:13.982795+0000","last_unstale":"2023-12-19T17:53:16.164623+0000","last_undegraded":"2023-12-19T17:53:16.164623+0000","last_fullsized":"2023-12-19T17:53:16.164623+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:05.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164490+0000","last_change":"2023-12-19T17:53:14.469709+0000","last_active":"2023-12-19T17:53:16.164490+0000","last_peered":"2023-12-19T17:53:16.164490+0000","last_clean":"2023-12-19T17:53:16.164490+0000","last_became_active":"2023-12-19T17:53:14.465456+0000","last_became_peered":"2023-12-19T17:53:14.465456+0000","last_unstale":"2023-12-19T17:53:16.164490+0000","last_undegraded":"2023-12-19T17:53:16.164490+0000","last_fullsized":"2023-12-19T17:53:16.164490+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:42:15.657524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456944+0000","last_change":"2023-12-19T17:53:13.980483+0000","last_active":"2023-12-19T17:53:15.456944+0000","last_peered":"2023-12-19T17:53:15.456944+0000","last_clean":"2023-12-19T17:53:15.456944+0000","last_became_active":"2023-12-19T17:53:13.980171+0000","last_became_peered":"2023-12-19T17:53:13.980171+0000","last_unstale":"2023-12-19T17:53:15.456944+0000","last_undegraded":"2023-12-19T17:53:15.456944+0000","last_fullsized":"2023-12-19T17:53:15.456944+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:14:05.035898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.483073+0000","last_change":"2023-12-19T17:53:14.481442+0000","last_active":"2023-12-19T17:53:14.483073+0000","last_peered":"2023-12-19T17:53:14.483073+0000","last_clean":"2023-12-19T17:53:14.483073+0000","last_became_active":"2023-12-19T17:53:14.481182+0000","last_became_peered":"2023-12-19T17:53:14.481182+0000","last_unstale":"2023-12-19T17:53:14.483073+0000","last_undegraded":"2023-12-19T17:53:14.483073+0000","last_fullsized":"2023-12-19T17:53:14.483073+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452230+0000","last_change":"2023-12-19T17:53:13.978215+0000","last_active":"2023-12-19T17:53:15.452230+0000","last_peered":"2023-12-19T17:53:15.452230+0000","last_clean":"2023-12-19T17:53:15.452230+0000","last_became_active":"2023-12-19T17:53:13.977909+0000","last_became_peered":"2023-12-19T17:53:13.977909+0000","last_unstale":"2023-12-19T17:53:15.452230+0000","last_undegraded":"2023-12-19T17:53:15.452230+0000","last_fullsized":"2023-12-19T17:53:15.452230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:15.845900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478362+0000","last_change":"2023-12-19T17:53:14.468332+0000","last_active":"2023-12-19T17:53:14.478362+0000","last_peered":"2023-12-19T17:53:14.478362+0000","last_clean":"2023-12-19T17:53:14.478362+0000","last_became_active":"2023-12-19T17:53:14.468037+0000","last_became_peered":"2023-12-19T17:53:14.468037+0000","last_unstale":"2023-12-19T17:53:14.478362+0000","last_undegraded":"2023-12-19T17:53:14.478362+0000","last_fullsized":"2023-12-19T17:53:14.478362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:29:41.484396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.458656+0000","last_change":"2023-12-19T17:53:13.979970+0000","last_active":"2023-12-19T17:53:14.458656+0000","last_peered":"2023-12-19T17:53:14.458656+0000","last_clean":"2023-12-19T17:53:14.458656+0000","last_became_active":"2023-12-19T17:53:13.979426+0000","last_became_peered":"2023-12-19T17:53:13.979426+0000","last_unstale":"2023-12-19T17:53:14.458656+0000","last_undegraded":"2023-12-19T17:53:14.458656+0000","last_fullsized":"2023-12-19T17:53:14.458656+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:43.232708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157720+0000","last_change":"2023-12-19T17:53:14.476113+0000","last_active":"2023-12-19T17:53:16.157720+0000","last_peered":"2023-12-19T17:53:16.157720+0000","last_clean":"2023-12-19T17:53:16.157720+0000","last_became_active":"2023-12-19T17:53:14.475677+0000","last_became_peered":"2023-12-19T17:53:14.475677+0000","last_unstale":"2023-12-19T17:53:16.157720+0000","last_undegraded":"2023-12-19T17:53:16.157720+0000","last_fullsized":"2023-12-19T17:53:16.157720+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:44.246152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.465169+0000","last_change":"2023-12-19T17:53:13.984038+0000","last_active":"2023-12-19T17:53:14.465169+0000","last_peered":"2023-12-19T17:53:14.465169+0000","last_clean":"2023-12-19T17:53:14.465169+0000","last_became_active":"2023-12-19T17:53:13.983671+0000","last_became_peered":"2023-12-19T17:53:13.983671+0000","last_unstale":"2023-12-19T17:53:14.465169+0000","last_undegraded":"2023-12-19T17:53:14.465169+0000","last_fullsized":"2023-12-19T17:53:14.465169+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:58.116723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456938+0000","last_change":"2023-12-19T17:53:14.459497+0000","last_active":"2023-12-19T17:53:15.456938+0000","last_peered":"2023-12-19T17:53:15.456938+0000","last_clean":"2023-12-19T17:53:15.456938+0000","last_became_active":"2023-12-19T17:53:14.459206+0000","last_became_peered":"2023-12-19T17:53:14.459206+0000","last_unstale":"2023-12-19T17:53:15.456938+0000","last_undegraded":"2023-12-19T17:53:15.456938+0000","last_fullsized":"2023-12-19T17:53:15.456938+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165211+0000","last_change":"2023-12-19T17:53:13.986381+0000","last_active":"2023-12-19T17:53:16.165211+0000","last_peered":"2023-12-19T17:53:16.165211+0000","last_clean":"2023-12-19T17:53:16.165211+0000","last_became_active":"2023-12-19T17:53:13.985959+0000","last_became_peered":"2023-12-19T17:53:13.985959+0000","last_unstale":"2023-12-19T17:53:16.165211+0000","last_undegraded":"2023-12-19T17:53:16.165211+0000","last_fullsized":"2023-12-19T17:53:16.165211+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:57.073920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735371+0000","last_change":"2023-12-19T17:53:14.464438+0000","last_active":"2023-12-19T17:53:15.735371+0000","last_peered":"2023-12-19T17:53:15.735371+0000","last_clean":"2023-12-19T17:53:15.735371+0000","last_became_active":"2023-12-19T17:53:14.464140+0000","last_became_peered":"2023-12-19T17:53:14.464140+0000","last_unstale":"2023-12-19T17:53:15.735371+0000","last_undegraded":"2023-12-19T17:53:15.735371+0000","last_fullsized":"2023-12-19T17:53:15.735371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165060+0000","last_change":"2023-12-19T17:53:13.982049+0000","last_active":"2023-12-19T17:53:16.165060+0000","last_peered":"2023-12-19T17:53:16.165060+0000","last_clean":"2023-12-19T17:53:16.165060+0000","last_became_active":"2023-12-19T17:53:13.981593+0000","last_became_peered":"2023-12-19T17:53:13.981593+0000","last_unstale":"2023-12-19T17:53:16.165060+0000","last_undegraded":"2023-12-19T17:53:16.165060+0000","last_fullsized":"2023-12-19T17:53:16.165060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:36:36.600471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.476166+0000","last_change":"2023-12-19T17:53:14.473416+0000","last_active":"2023-12-19T17:53:14.476166+0000","last_peered":"2023-12-19T17:53:14.476166+0000","last_clean":"2023-12-19T17:53:14.476166+0000","last_became_active":"2023-12-19T17:53:14.472481+0000","last_became_peered":"2023-12-19T17:53:14.472481+0000","last_unstale":"2023-12-19T17:53:14.476166+0000","last_undegraded":"2023-12-19T17:53:14.476166+0000","last_fullsized":"2023-12-19T17:53:14.476166+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:59.130167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":16,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.484060+0000","last_change":"2023-12-19T17:53:13.980184+0000","last_active":"2023-12-19T17:53:14.484060+0000","last_peered":"2023-12-19T17:53:14.484060+0000","last_clean":"2023-12-19T17:53:14.484060+0000","last_became_active":"2023-12-19T17:53:13.979900+0000","last_became_peered":"2023-12-19T17:53:13.979900+0000","last_unstale":"2023-12-19T17:53:14.484060+0000","last_undegraded":"2023-12-19T17:53:14.484060+0000","last_fullsized":"2023-12-19T17:53:14.484060+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:47.592504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.734673+0000","last_change":"2023-12-19T17:53:14.470007+0000","last_active":"2023-12-19T17:53:15.734673+0000","last_peered":"2023-12-19T17:53:15.734673+0000","last_clean":"2023-12-19T17:53:15.734673+0000","last_became_active":"2023-12-19T17:53:14.469708+0000","last_became_peered":"2023-12-19T17:53:14.469708+0000","last_unstale":"2023-12-19T17:53:15.734673+0000","last_undegraded":"2023-12-19T17:53:15.734673+0000","last_fullsized":"2023-12-19T17:53:15.734673+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:11:52.591860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.473131+0000","last_change":"2023-12-19T17:53:13.984032+0000","last_active":"2023-12-19T17:53:14.473131+0000","last_peered":"2023-12-19T17:53:14.473131+0000","last_clean":"2023-12-19T17:53:14.473131+0000","last_became_active":"2023-12-19T17:53:13.983745+0000","last_became_peered":"2023-12-19T17:53:13.983745+0000","last_unstale":"2023-12-19T17:53:14.473131+0000","last_undegraded":"2023-12-19T17:53:14.473131+0000","last_fullsized":"2023-12-19T17:53:14.473131+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:42:14.644080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.476910+0000","last_change":"2023-12-19T17:53:14.464591+0000","last_active":"2023-12-19T17:53:14.476910+0000","last_peered":"2023-12-19T17:53:14.476910+0000","last_clean":"2023-12-19T17:53:14.476910+0000","last_became_active":"2023-12-19T17:53:14.462039+0000","last_became_peered":"2023-12-19T17:53:14.462039+0000","last_unstale":"2023-12-19T17:53:14.476910+0000","last_undegraded":"2023-12-19T17:53:14.476910+0000","last_fullsized":"2023-12-19T17:53:14.476910+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:42.150658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452413+0000","last_change":"2023-12-19T17:53:13.978479+0000","last_active":"2023-12-19T17:53:15.452413+0000","last_peered":"2023-12-19T17:53:15.452413+0000","last_clean":"2023-12-19T17:53:15.452413+0000","last_became_active":"2023-12-19T17:53:13.978228+0000","last_became_peered":"2023-12-19T17:53:13.978228+0000","last_unstale":"2023-12-19T17:53:15.452413+0000","last_undegraded":"2023-12-19T17:53:15.452413+0000","last_fullsized":"2023-12-19T17:53:15.452413+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:04.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456769+0000","last_change":"2023-12-19T17:53:14.453043+0000","last_active":"2023-12-19T17:53:15.456769+0000","last_peered":"2023-12-19T17:53:15.456769+0000","last_clean":"2023-12-19T17:53:15.456769+0000","last_became_active":"2023-12-19T17:53:14.452446+0000","last_became_peered":"2023-12-19T17:53:14.452446+0000","last_unstale":"2023-12-19T17:53:15.456769+0000","last_undegraded":"2023-12-19T17:53:15.456769+0000","last_fullsized":"2023-12-19T17:53:15.456769+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456541+0000","last_change":"2023-12-19T17:53:13.980434+0000","last_active":"2023-12-19T17:53:15.456541+0000","last_peered":"2023-12-19T17:53:15.456541+0000","last_clean":"2023-12-19T17:53:15.456541+0000","last_became_active":"2023-12-19T17:53:13.980155+0000","last_became_peered":"2023-12-19T17:53:13.980155+0000","last_unstale":"2023-12-19T17:53:15.456541+0000","last_undegraded":"2023-12-19T17:53:15.456541+0000","last_fullsized":"2023-12-19T17:53:15.456541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:56:04.816889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478137+0000","last_change":"2023-12-19T17:53:14.465344+0000","last_active":"2023-12-19T17:53:14.478137+0000","last_peered":"2023-12-19T17:53:14.478137+0000","last_clean":"2023-12-19T17:53:14.478137+0000","last_became_active":"2023-12-19T17:53:14.465024+0000","last_became_peered":"2023-12-19T17:53:14.465024+0000","last_unstale":"2023-12-19T17:53:14.478137+0000","last_undegraded":"2023-12-19T17:53:14.478137+0000","last_fullsized":"2023-12-19T17:53:14.478137+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:59:56.520373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457512+0000","last_change":"2023-12-19T17:53:13.979946+0000","last_active":"2023-12-19T17:53:15.457512+0000","last_peered":"2023-12-19T17:53:15.457512+0000","last_clean":"2023-12-19T17:53:15.457512+0000","last_became_active":"2023-12-19T17:53:13.979644+0000","last_became_peered":"2023-12-19T17:53:13.979644+0000","last_unstale":"2023-12-19T17:53:15.457512+0000","last_undegraded":"2023-12-19T17:53:15.457512+0000","last_fullsized":"2023-12-19T17:53:15.457512+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:52.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.480259+0000","last_change":"2023-12-19T17:53:14.478011+0000","last_active":"2023-12-19T17:53:14.480259+0000","last_peered":"2023-12-19T17:53:14.480259+0000","last_clean":"2023-12-19T17:53:14.480259+0000","last_became_active":"2023-12-19T17:53:14.477706+0000","last_became_peered":"2023-12-19T17:53:14.477706+0000","last_unstale":"2023-12-19T17:53:14.480259+0000","last_undegraded":"2023-12-19T17:53:14.480259+0000","last_fullsized":"2023-12-19T17:53:14.480259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:28:53.470910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165310+0000","last_change":"2023-12-19T17:53:13.981789+0000","last_active":"2023-12-19T17:53:16.165310+0000","last_peered":"2023-12-19T17:53:16.165310+0000","last_clean":"2023-12-19T17:53:16.165310+0000","last_became_active":"2023-12-19T17:53:13.981479+0000","last_became_peered":"2023-12-19T17:53:13.981479+0000","last_unstale":"2023-12-19T17:53:16.165310+0000","last_undegraded":"2023-12-19T17:53:16.165310+0000","last_fullsized":"2023-12-19T17:53:16.165310+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:11:52.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165075+0000","last_change":"2023-12-19T17:53:14.469503+0000","last_active":"2023-12-19T17:53:16.165075+0000","last_peered":"2023-12-19T17:53:16.165075+0000","last_clean":"2023-12-19T17:53:16.165075+0000","last_became_active":"2023-12-19T17:53:14.469257+0000","last_became_peered":"2023-12-19T17:53:14.469257+0000","last_unstale":"2023-12-19T17:53:16.165075+0000","last_undegraded":"2023-12-19T17:53:16.165075+0000","last_fullsized":"2023-12-19T17:53:16.165075+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:29:48.605948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.486194+0000","last_change":"2023-12-19T17:53:13.977647+0000","last_active":"2023-12-19T17:53:14.486194+0000","last_peered":"2023-12-19T17:53:14.486194+0000","last_clean":"2023-12-19T17:53:14.486194+0000","last_became_active":"2023-12-19T17:53:13.977331+0000","last_became_peered":"2023-12-19T17:53:13.977331+0000","last_unstale":"2023-12-19T17:53:14.486194+0000","last_undegraded":"2023-12-19T17:53:14.486194+0000","last_fullsized":"2023-12-19T17:53:14.486194+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:04.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.474793+0000","last_change":"2023-12-19T17:53:14.468444+0000","last_active":"2023-12-19T17:53:14.474793+0000","last_peered":"2023-12-19T17:53:14.474793+0000","last_clean":"2023-12-19T17:53:14.474793+0000","last_became_active":"2023-12-19T17:53:14.468165+0000","last_became_peered":"2023-12-19T17:53:14.468165+0000","last_unstale":"2023-12-19T17:53:14.474793+0000","last_undegraded":"2023-12-19T17:53:14.474793+0000","last_fullsized":"2023-12-19T17:53:14.474793+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.158061+0000","last_change":"2023-12-19T17:53:13.977508+0000","last_active":"2023-12-19T17:53:16.158061+0000","last_peered":"2023-12-19T17:53:16.158061+0000","last_clean":"2023-12-19T17:53:16.158061+0000","last_became_active":"2023-12-19T17:53:13.977215+0000","last_became_peered":"2023-12-19T17:53:13.977215+0000","last_unstale":"2023-12-19T17:53:16.158061+0000","last_undegraded":"2023-12-19T17:53:16.158061+0000","last_fullsized":"2023-12-19T17:53:16.158061+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:54:01.022462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157937+0000","last_change":"2023-12-19T17:53:14.475115+0000","last_active":"2023-12-19T17:53:16.157937+0000","last_peered":"2023-12-19T17:53:16.157937+0000","last_clean":"2023-12-19T17:53:16.157937+0000","last_became_active":"2023-12-19T17:53:14.474797+0000","last_became_peered":"2023-12-19T17:53:14.474797+0000","last_unstale":"2023-12-19T17:53:16.157937+0000","last_undegraded":"2023-12-19T17:53:16.157937+0000","last_fullsized":"2023-12-19T17:53:16.157937+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:28:00.824597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452598+0000","last_change":"2023-12-19T17:53:13.982351+0000","last_active":"2023-12-19T17:53:15.452598+0000","last_peered":"2023-12-19T17:53:15.452598+0000","last_clean":"2023-12-19T17:53:15.452598+0000","last_became_active":"2023-12-19T17:53:13.982024+0000","last_became_peered":"2023-12-19T17:53:13.982024+0000","last_unstale":"2023-12-19T17:53:15.452598+0000","last_undegraded":"2023-12-19T17:53:15.452598+0000","last_fullsized":"2023-12-19T17:53:15.452598+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:43.232708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457631+0000","last_change":"2023-12-19T17:53:14.454192+0000","last_active":"2023-12-19T17:53:15.457631+0000","last_peered":"2023-12-19T17:53:15.457631+0000","last_clean":"2023-12-19T17:53:15.457631+0000","last_became_active":"2023-12-19T17:53:14.453841+0000","last_became_peered":"2023-12-19T17:53:14.453841+0000","last_unstale":"2023-12-19T17:53:15.457631+0000","last_undegraded":"2023-12-19T17:53:15.457631+0000","last_fullsized":"2023-12-19T17:53:15.457631+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:08:59.625311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157333+0000","last_change":"2023-12-19T17:53:13.978031+0000","last_active":"2023-12-19T17:53:16.157333+0000","last_peered":"2023-12-19T17:53:16.157333+0000","last_clean":"2023-12-19T17:53:16.157333+0000","last_became_active":"2023-12-19T17:53:13.977681+0000","last_became_peered":"2023-12-19T17:53:13.977681+0000","last_unstale":"2023-12-19T17:53:16.157333+0000","last_undegraded":"2023-12-19T17:53:16.157333+0000","last_fullsized":"2023-12-19T17:53:16.157333+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:08:28.261390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.734827+0000","last_change":"2023-12-19T17:53:14.464069+0000","last_active":"2023-12-19T17:53:15.734827+0000","last_peered":"2023-12-19T17:53:15.734827+0000","last_clean":"2023-12-19T17:53:15.734827+0000","last_became_active":"2023-12-19T17:53:14.463738+0000","last_became_peered":"2023-12-19T17:53:14.463738+0000","last_unstale":"2023-12-19T17:53:15.734827+0000","last_undegraded":"2023-12-19T17:53:15.734827+0000","last_fullsized":"2023-12-19T17:53:15.734827+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:22.648642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157521+0000","last_change":"2023-12-19T17:53:13.980952+0000","last_active":"2023-12-19T17:53:16.157521+0000","last_peered":"2023-12-19T17:53:16.157521+0000","last_clean":"2023-12-19T17:53:16.157521+0000","last_became_active":"2023-12-19T17:53:13.980679+0000","last_became_peered":"2023-12-19T17:53:13.980679+0000","last_unstale":"2023-12-19T17:53:16.157521+0000","last_undegraded":"2023-12-19T17:53:16.157521+0000","last_fullsized":"2023-12-19T17:53:16.157521+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:35:19.460800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.164809+0000","last_change":"2023-12-19T17:53:14.465100+0000","last_active":"2023-12-19T17:53:16.164809+0000","last_peered":"2023-12-19T17:53:16.164809+0000","last_clean":"2023-12-19T17:53:16.164809+0000","last_became_active":"2023-12-19T17:53:14.464809+0000","last_became_peered":"2023-12-19T17:53:14.464809+0000","last_unstale":"2023-12-19T17:53:16.164809+0000","last_undegraded":"2023-12-19T17:53:16.164809+0000","last_fullsized":"2023-12-19T17:53:16.164809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:20:59.698917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457249+0000","last_change":"2023-12-19T17:53:13.978239+0000","last_active":"2023-12-19T17:53:15.457249+0000","last_peered":"2023-12-19T17:53:15.457249+0000","last_clean":"2023-12-19T17:53:15.457249+0000","last_became_active":"2023-12-19T17:53:13.977604+0000","last_became_peered":"2023-12-19T17:53:13.977604+0000","last_unstale":"2023-12-19T17:53:15.457249+0000","last_undegraded":"2023-12-19T17:53:15.457249+0000","last_fullsized":"2023-12-19T17:53:15.457249+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:29.892346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.478343+0000","last_change":"2023-12-19T17:53:14.468235+0000","last_active":"2023-12-19T17:53:14.478343+0000","last_peered":"2023-12-19T17:53:14.478343+0000","last_clean":"2023-12-19T17:53:14.478343+0000","last_became_active":"2023-12-19T17:53:14.467935+0000","last_became_peered":"2023-12-19T17:53:14.467935+0000","last_unstale":"2023-12-19T17:53:14.478343+0000","last_undegraded":"2023-12-19T17:53:14.478343+0000","last_fullsized":"2023-12-19T17:53:14.478343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:10.757413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.157733+0000","last_change":"2023-12-19T17:53:13.978374+0000","last_active":"2023-12-19T17:53:16.157733+0000","last_peered":"2023-12-19T17:53:16.157733+0000","last_clean":"2023-12-19T17:53:16.157733+0000","last_became_active":"2023-12-19T17:53:13.978102+0000","last_became_peered":"2023-12-19T17:53:13.978102+0000","last_unstale":"2023-12-19T17:53:16.157733+0000","last_undegraded":"2023-12-19T17:53:16.157733+0000","last_fullsized":"2023-12-19T17:53:16.157733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:40.727927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452476+0000","last_change":"2023-12-19T17:53:14.481471+0000","last_active":"2023-12-19T17:53:15.452476+0000","last_peered":"2023-12-19T17:53:15.452476+0000","last_clean":"2023-12-19T17:53:15.452476+0000","last_became_active":"2023-12-19T17:53:14.481191+0000","last_became_peered":"2023-12-19T17:53:14.481191+0000","last_unstale":"2023-12-19T17:53:15.452476+0000","last_undegraded":"2023-12-19T17:53:15.452476+0000","last_fullsized":"2023-12-19T17:53:15.452476+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165425+0000","last_change":"2023-12-19T17:53:13.982831+0000","last_active":"2023-12-19T17:53:16.165425+0000","last_peered":"2023-12-19T17:53:16.165425+0000","last_clean":"2023-12-19T17:53:16.165425+0000","last_became_active":"2023-12-19T17:53:13.982559+0000","last_became_peered":"2023-12-19T17:53:13.982559+0000","last_unstale":"2023-12-19T17:53:16.165425+0000","last_undegraded":"2023-12-19T17:53:16.165425+0000","last_fullsized":"2023-12-19T17:53:16.165425+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:29.892346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457038+0000","last_change":"2023-12-19T17:53:14.459872+0000","last_active":"2023-12-19T17:53:15.457038+0000","last_peered":"2023-12-19T17:53:15.457038+0000","last_clean":"2023-12-19T17:53:15.457038+0000","last_became_active":"2023-12-19T17:53:14.459587+0000","last_became_peered":"2023-12-19T17:53:14.459587+0000","last_unstale":"2023-12-19T17:53:15.457038+0000","last_undegraded":"2023-12-19T17:53:15.457038+0000","last_fullsized":"2023-12-19T17:53:15.457038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:00.318627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.162280+0000","last_change":"2023-12-19T17:53:13.974992+0000","last_active":"2023-12-19T17:53:16.162280+0000","last_peered":"2023-12-19T17:53:16.162280+0000","last_clean":"2023-12-19T17:53:16.162280+0000","last_became_active":"2023-12-19T17:53:13.974716+0000","last_became_peered":"2023-12-19T17:53:13.974716+0000","last_unstale":"2023-12-19T17:53:16.162280+0000","last_undegraded":"2023-12-19T17:53:16.162280+0000","last_fullsized":"2023-12-19T17:53:16.162280+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:22:23.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.480222+0000","last_change":"2023-12-19T17:53:14.478453+0000","last_active":"2023-12-19T17:53:14.480222+0000","last_peered":"2023-12-19T17:53:14.480222+0000","last_clean":"2023-12-19T17:53:14.480222+0000","last_became_active":"2023-12-19T17:53:14.477826+0000","last_became_peered":"2023-12-19T17:53:14.477826+0000","last_unstale":"2023-12-19T17:53:14.480222+0000","last_undegraded":"2023-12-19T17:53:14.480222+0000","last_fullsized":"2023-12-19T17:53:14.480222+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:58:46.449659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735336+0000","last_change":"2023-12-19T17:53:13.984259+0000","last_active":"2023-12-19T17:53:15.735336+0000","last_peered":"2023-12-19T17:53:15.735336+0000","last_clean":"2023-12-19T17:53:15.735336+0000","last_became_active":"2023-12-19T17:53:13.981333+0000","last_became_peered":"2023-12-19T17:53:13.981333+0000","last_unstale":"2023-12-19T17:53:15.735336+0000","last_undegraded":"2023-12-19T17:53:15.735336+0000","last_fullsized":"2023-12-19T17:53:15.735336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:02:04.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735021+0000","last_change":"2023-12-19T17:53:14.459490+0000","last_active":"2023-12-19T17:53:15.735021+0000","last_peered":"2023-12-19T17:53:15.735021+0000","last_clean":"2023-12-19T17:53:15.735021+0000","last_became_active":"2023-12-19T17:53:14.459048+0000","last_became_peered":"2023-12-19T17:53:14.459048+0000","last_unstale":"2023-12-19T17:53:15.735021+0000","last_undegraded":"2023-12-19T17:53:15.735021+0000","last_fullsized":"2023-12-19T17:53:15.735021+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:12.218638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.735241+0000","last_change":"2023-12-19T17:53:13.980171+0000","last_active":"2023-12-19T17:53:15.735241+0000","last_peered":"2023-12-19T17:53:15.735241+0000","last_clean":"2023-12-19T17:53:15.735241+0000","last_became_active":"2023-12-19T17:53:13.979375+0000","last_became_peered":"2023-12-19T17:53:13.979375+0000","last_unstale":"2023-12-19T17:53:15.735241+0000","last_undegraded":"2023-12-19T17:53:15.735241+0000","last_fullsized":"2023-12-19T17:53:15.735241+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:11:05.827194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.452052+0000","last_change":"2023-12-19T17:53:14.464644+0000","last_active":"2023-12-19T17:53:15.452052+0000","last_peered":"2023-12-19T17:53:15.452052+0000","last_clean":"2023-12-19T17:53:15.452052+0000","last_became_active":"2023-12-19T17:53:14.464400+0000","last_became_peered":"2023-12-19T17:53:14.464400+0000","last_unstale":"2023-12-19T17:53:15.452052+0000","last_undegraded":"2023-12-19T17:53:15.452052+0000","last_fullsized":"2023-12-19T17:53:15.452052+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:26:07.317795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.456770+0000","last_change":"2023-12-19T17:53:13.975777+0000","last_active":"2023-12-19T17:53:15.456770+0000","last_peered":"2023-12-19T17:53:15.456770+0000","last_clean":"2023-12-19T17:53:15.456770+0000","last_became_active":"2023-12-19T17:53:13.974298+0000","last_became_peered":"2023-12-19T17:53:13.974298+0000","last_unstale":"2023-12-19T17:53:15.456770+0000","last_undegraded":"2023-12-19T17:53:15.456770+0000","last_fullsized":"2023-12-19T17:53:15.456770+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:22:23.581209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.477286+0000","last_change":"2023-12-19T17:53:14.474336+0000","last_active":"2023-12-19T17:53:14.477286+0000","last_peered":"2023-12-19T17:53:14.477286+0000","last_clean":"2023-12-19T17:53:14.477286+0000","last_became_active":"2023-12-19T17:53:14.474069+0000","last_became_peered":"2023-12-19T17:53:14.474069+0000","last_unstale":"2023-12-19T17:53:14.477286+0000","last_undegraded":"2023-12-19T17:53:14.477286+0000","last_fullsized":"2023-12-19T17:53:14.477286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:07:20.800514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.458891+0000","last_change":"2023-12-19T17:53:13.982635+0000","last_active":"2023-12-19T17:53:14.458891+0000","last_peered":"2023-12-19T17:53:14.458891+0000","last_clean":"2023-12-19T17:53:14.458891+0000","last_became_active":"2023-12-19T17:53:13.982152+0000","last_became_peered":"2023-12-19T17:53:13.982152+0000","last_unstale":"2023-12-19T17:53:14.458891+0000","last_undegraded":"2023-12-19T17:53:14.458891+0000","last_fullsized":"2023-12-19T17:53:14.458891+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:01:15.845900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457180+0000","last_change":"2023-12-19T17:53:14.455151+0000","last_active":"2023-12-19T17:53:15.457180+0000","last_peered":"2023-12-19T17:53:15.457180+0000","last_clean":"2023-12-19T17:53:15.457180+0000","last_became_active":"2023-12-19T17:53:14.454873+0000","last_became_peered":"2023-12-19T17:53:14.454873+0000","last_unstale":"2023-12-19T17:53:15.457180+0000","last_undegraded":"2023-12-19T17:53:15.457180+0000","last_fullsized":"2023-12-19T17:53:15.457180+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:22.648642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.458165+0000","last_change":"2023-12-19T17:53:13.981158+0000","last_active":"2023-12-19T17:53:14.458165+0000","last_peered":"2023-12-19T17:53:14.458165+0000","last_clean":"2023-12-19T17:53:14.458165+0000","last_became_active":"2023-12-19T17:53:13.980889+0000","last_became_peered":"2023-12-19T17:53:13.980889+0000","last_unstale":"2023-12-19T17:53:14.458165+0000","last_undegraded":"2023-12-19T17:53:14.458165+0000","last_fullsized":"2023-12-19T17:53:14.458165+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:26:59.305183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:16.165182+0000","last_change":"2023-12-19T17:53:14.479499+0000","last_active":"2023-12-19T17:53:16.165182+0000","last_peered":"2023-12-19T17:53:16.165182+0000","last_clean":"2023-12-19T17:53:16.165182+0000","last_became_active":"2023-12-19T17:53:14.479253+0000","last_became_peered":"2023-12-19T17:53:14.479253+0000","last_unstale":"2023-12-19T17:53:16.165182+0000","last_undegraded":"2023-12-19T17:53:16.165182+0000","last_fullsized":"2023-12-19T17:53:16.165182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:13.935937+0000","last_clean_scrub_stamp":"2023-12-19T17:53:13.935937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:23:09.788883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-19T17:53:15.457271+0000","last_change":"2023-12-19T17:53:13.978411+0000","last_active":"2023-12-19T17:53:15.457271+0000","last_peered":"2023-12-19T17:53:15.457271+0000","last_clean":"2023-12-19T17:53:15.457271+0000","last_became_active":"2023-12-19T17:53:13.978094+0000","last_became_peered":"2023-12-19T17:53:13.978094+0000","last_unstale":"2023-12-19T17:53:15.457271+0000","last_undegraded":"2023-12-19T17:53:15.457271+0000","last_fullsized":"2023-12-19T17:53:15.457271+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:53:12.922493+0000","last_clean_scrub_stamp":"2023-12-19T17:53:12.922493+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:57.073920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":183,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-19T17:53:14.446198+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:53:14.446198+0000","last_peered":"2023-12-19T17:53:14.446198+0000","last_clean":"2023-12-19T17:53:14.446198+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:53:14.446198+0000","last_undegraded":"2023-12-19T17:53:14.446198+0000","last_fullsized":"2023-12-19T17:53:14.446198+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574872,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":1036,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":1060864,"data_stored":786279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.042},{"interface":"front","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.5589999999999999,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":0.95399999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.7250000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":1.1499999999999999},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":2.448,"5min":2.448,"15min":2.448},"last":0.84199999999999997}]},{"osd":2,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.872,"5min":0.872,"15min":0.872},"max":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.234}]},{"osd":3,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.421,"5min":1.421,"15min":1.421},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.7130000000000001,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":1.3089999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.8779999999999999,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.1720000000000002,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.0920000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.347},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.181}]},{"osd":6,"last update":"Tue Dec 19 17:52:31 2023","interfaces":[{"interface":"back","average":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"min":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":2.1429999999999998,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.119},{"interface":"front","average":{"1min":1.379,"5min":1.379,"15min":1.379},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.278}]}]},{"osd":6,"up_from":13,"seq":55834574873,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":4.5979999999999999,"5min":4.5979999999999999,"15min":4.5979999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.089}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.2109999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.90700000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":8.5470000000000006,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":4.6340000000000003,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.153}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":4.5380000000000003,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":4.508,"5min":4.508,"15min":4.508},"last":1.294}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.8360000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.125},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.70899999999999996}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1400000000000001,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.2470000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.214}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.83699999999999997},{"interface":"front","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"max":{"1min":2.2440000000000002,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.351}]}]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":187769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":0.70899999999999996}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.778,"5min":1.778,"15min":1.778},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.238,"5min":1.238,"15min":1.238},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.96799999999999997}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"max":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"last":0.995},{"interface":"front","average":{"1min":1.218,"5min":1.218,"15min":1.218},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":1.109}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0740000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.0819999999999999,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"min":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":3.2589999999999999,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"min":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"max":{"1min":3.21,"5min":3.21,"15min":3.21},"last":0.90500000000000003},{"interface":"front","average":{"1min":1.391,"5min":1.391,"15min":1.391},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.024}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.591,"5min":1.591,"15min":1.591},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.1099999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":1.046},{"interface":"front","average":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"min":{"1min":1.077,"5min":1.077,"15min":1.077},"max":{"1min":3.5680000000000001,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":1.1579999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":436,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":446464,"data_stored":188261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":5.4420000000000002,"5min":5.4420000000000002,"15min":5.4420000000000002},"last":1.123},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.3959999999999999,"15min":1.3959999999999999},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":5.5049999999999999,"5min":5.5049999999999999,"15min":5.5049999999999999},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"min":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"max":{"1min":4.6379999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":3.254,"5min":3.254,"15min":3.254},"last":1.0409999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.413,"15min":1.413},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":4.593,"5min":4.593,"15min":4.593},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.341,"5min":1.341,"15min":1.341},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":0.98499999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":1.258},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":5.5490000000000004,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":1.2849999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.946,"5min":1.946,"15min":1.946},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":2.157,"5min":2.157,"15min":2.157},"last":1.161}]},{"osd":6,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.268,"15min":1.268},"min":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"max":{"1min":2.1840000000000002,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"max":{"1min":2.1200000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":1.198}]},{"osd":7,"last update":"Tue Dec 19 17:52:26 2023","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.1030000000000002,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":1.302},{"interface":"front","average":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2290000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574874,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":189255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":2.9340000000000002,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":1.0129999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.54,"5min":1.54,"15min":1.54},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.091,"5min":1.091,"15min":1.091},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.78800000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":0.98099999999999998}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.306,"5min":1.306,"15min":1.306},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":1.121},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.4350000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.589}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.474,"5min":1.474,"15min":1.474},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.0389999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.754,"5min":2.754,"15min":2.754},"last":1.216}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.6880000000000002,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.651},{"interface":"front","average":{"1min":1.54,"5min":1.54,"15min":1.54},"min":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":2.6429999999999998,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.149}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.7849999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":442368,"data_stored":187727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":13.32,"5min":13.32,"15min":13.32},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.72,"5min":1.72,"15min":1.72},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":13.206,"5min":13.206,"15min":13.206},"last":0.91200000000000003}]},{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.4870000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.242,"5min":1.242,"15min":1.242},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.9430000000000001,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":1.861,"5min":1.861,"15min":1.861},"last":1.026}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.0659999999999998,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":3.7160000000000002,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":1.4239999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"max":{"1min":1.96,"5min":1.96,"15min":1.96},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.1379999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.1910000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.5309999999999999,"5min":1.5309999999999999,"15min":1.5309999999999999},"min":{"1min":1.228,"5min":1.228,"15min":1.228},"max":{"1min":2.363,"5min":2.363,"15min":2.363},"last":1.371},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.1629999999999998,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.4530000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":444,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":454656,"data_stored":194367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.931,"5min":1.931,"15min":1.931},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.999}]},{"osd":2,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":2.0590000000000002,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.93999999999999995},{"interface":"front","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":3.4199999999999999,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":0.91100000000000003}]},{"osd":3,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":3.4950000000000001,"5min":3.4950000000000001,"15min":3.4950000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.2030000000000003,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":1.1000000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":4.3869999999999996,"5min":4.3869999999999996,"15min":4.3869999999999996},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.081}]},{"osd":5,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.9249999999999998,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.03},{"interface":"front","average":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"min":{"1min":1.03,"5min":1.03,"15min":1.03},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":1.5249999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.698,"5min":1.698,"15min":1.698},"min":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":4.5780000000000003,"5min":4.5780000000000003,"15min":4.5780000000000003},"last":1.643},{"interface":"front","average":{"1min":1.716,"5min":1.716,"15min":1.716},"min":{"1min":1.153,"5min":1.153,"15min":1.153},"max":{"1min":3.214,"5min":3.214,"15min":3.214},"last":1.728}]},{"osd":7,"last update":"Tue Dec 19 17:52:29 2023","interfaces":[{"interface":"back","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"max":{"1min":4.0910000000000002,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":1.601},{"interface":"front","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":4.6390000000000002,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.8320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":777040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.29},{"interface":"front","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":2.3599999999999999,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.6279999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.6839999999999999,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.79300000000000004}]},{"osd":3,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":3.4399999999999999,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":0.98699999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"min":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"max":{"1min":1.78,"5min":1.78,"15min":1.78},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":1.1060000000000001},"max":{"1min":2.7799999999999998,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.353}]},{"osd":5,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.395,"15min":1.395},"min":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"max":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"last":1.2390000000000001},{"interface":"front","average":{"1min":1.385,"5min":1.385,"15min":1.385},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.153}]},{"osd":6,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.534,"15min":1.534},"min":{"1min":1.202,"5min":1.202,"15min":1.202},"max":{"1min":2.1000000000000001,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.4079999999999999},{"interface":"front","average":{"1min":1.5660000000000001,"5min":1.5660000000000001,"15min":1.5660000000000001},"min":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"max":{"1min":2.3889999999999998,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.5569999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:52:27 2023","interfaces":[{"interface":"back","average":{"1min":1.823,"5min":1.823,"15min":1.823},"min":{"1min":1.032,"5min":1.032,"15min":1.032},"max":{"1min":4.9400000000000004,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":1.47},{"interface":"front","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"max":{"1min":4.8250000000000002,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.4359999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:53:19.249 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T17:53:19.249 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T17:53:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.477+0000 7fb26592e700 1 Processor -- start 2023-12-19T17:53:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.477+0000 7fb26592e700 1 -- start start 2023-12-19T17:53:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.477+0000 7fb26592e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb260070ab0 0x7fb2600cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.477+0000 7fb26592e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2600b2040 0x7fb2600d2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.477+0000 7fb26592e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb260070e90 0x7fb2600b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb26592e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600d2b60 con 0x7fb2600b2040 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb26592e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2600d2190 con 0x7fb260070e90 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb26592e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600ce350 con 0x7fb260070ab0 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2600b2040 0x7fb2600d2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb2600b2040 0x7fb2600d2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56588/0 (socket says 172.21.15.45:56588) 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 -- 172.21.15.45:0/1420636583 learned_addr learned my addr 172.21.15.45:0/1420636583 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:19.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb26512d700 1 --2- 172.21.15.45:0/1420636583 >> v2:172.21.15.73:3300/0 conn(0x7fb260070e90 0x7fb2600b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb26492c700 1 --2- 172.21.15.45:0/1420636583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb260070ab0 0x7fb2600cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 -- 172.21.15.45:0/1420636583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb260070ab0 msgr2=0x7fb2600cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 --2- 172.21.15.45:0/1420636583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb260070ab0 0x7fb2600cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 -- 172.21.15.45:0/1420636583 >> v2:172.21.15.73:3300/0 conn(0x7fb260070e90 msgr2=0x7fb2600b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 --2- 172.21.15.45:0/1420636583 >> v2:172.21.15.73:3300/0 conn(0x7fb260070e90 0x7fb2600b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 -- 172.21.15.45:0/1420636583 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2600ce070 con 0x7fb2600b2040 2023-12-19T17:53:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb26512d700 1 --2- 172.21.15.45:0/1420636583 >> v2:172.21.15.73:3300/0 conn(0x7fb260070e90 0x7fb2600b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:19.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.481+0000 7fb25ffff700 1 --2- 172.21.15.45:0/1420636583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b2040 0x7fb2600d2620 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb2600718b0 tx=0x7fb24c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76cf0b344ad3e52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb25f7fe700 1 -- 172.21.15.45:0/1420636583 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00b8a0 con 0x7fb2600b2040 2023-12-19T17:53:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb25f7fe700 1 -- 172.21.15.45:0/1420636583 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb24c00ba00 con 0x7fb2600b2040 2023-12-19T17:53:19.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb25f7fe700 1 -- 172.21.15.45:0/1420636583 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb24c00bd90 con 0x7fb2600b2040 2023-12-19T17:53:19.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 -- 172.21.15.45:0/1420636583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b2040 msgr2=0x7fb2600d2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 --2- 172.21.15.45:0/1420636583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b2040 0x7fb2600d2620 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb2600718b0 tx=0x7fb24c009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 -- 172.21.15.45:0/1420636583 shutdown_connections 2023-12-19T17:53:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 --2- 172.21.15.45:0/1420636583 >> v2:172.21.15.73:3300/0 conn(0x7fb260070e90 0x7fb2600b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 --2- 172.21.15.45:0/1420636583 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb2600b2040 0x7fb2600d2620 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 --2- 172.21.15.45:0/1420636583 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb260070ab0 0x7fb2600cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 -- 172.21.15.45:0/1420636583 >> 172.21.15.45:0/1420636583 conn(0x7fb2600d2ca0 msgr2=0x7fb2600d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:19.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 -- 172.21.15.45:0/1420636583 shutdown_connections 2023-12-19T17:53:19.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.485+0000 7fb26592e700 1 -- 172.21.15.45:0/1420636583 wait complete. 2023-12-19T17:53:19.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 Processor -- start 2023-12-19T17:53:19.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 -- start start 2023-12-19T17:53:19.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 0x7fb2601f52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb260070e90 0x7fb2601f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2600b2040 0x7fb2600c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb26015aa60 con 0x7fb260070ab0 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2600c8150 con 0x7fb260070e90 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26592e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2601f5820 con 0x7fb2600b2040 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26492c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 0x7fb2601f52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26492c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 0x7fb2601f52e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56602/0 (socket says 172.21.15.45:56602) 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26492c700 1 -- 172.21.15.45:0/3095150043 learned_addr learned my addr 172.21.15.45:0/3095150043 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:19.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb260070e90 0x7fb2601f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.489+0000 7fb26512d700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2600b2040 0x7fb2600c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26492c700 1 -- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2600b2040 msgr2=0x7fb2600c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26492c700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2600b2040 0x7fb2600c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26492c700 1 -- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb260070e90 msgr2=0x7fb2601f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26492c700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb260070e90 0x7fb2601f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26492c700 1 -- 172.21.15.45:0/3095150043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb24c009570 con 0x7fb260070ab0 2023-12-19T17:53:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb260070e90 0x7fb2601f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26492c700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 0x7fb2601f52e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb25400d860 tx=0x7fb25400db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2540125f0 con 0x7fb260070ab0 2023-12-19T17:53:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb254012750 con 0x7fb260070ab0 2023-12-19T17:53:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2601f4e50 con 0x7fb260070ab0 2023-12-19T17:53:19.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254012b00 con 0x7fb260070ab0 2023-12-19T17:53:19.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2601f4520 con 0x7fb260070ab0 2023-12-19T17:53:19.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.493+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb260067760 con 0x7fb260070ab0 2023-12-19T17:53:19.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.497+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb254012c60 con 0x7fb260070ab0 2023-12-19T17:53:19.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.497+0000 7fb25d7fa700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb244065ad0 0x7fb244067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.497+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb254083700 con 0x7fb260070ab0 2023-12-19T17:53:19.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.497+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb244065ad0 0x7fb244067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.497+0000 7fb25ffff700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb244065ad0 0x7fb244067f90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2600b2440 tx=0x7fb24c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.501+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb254050ee0 con 0x7fb260070ab0 2023-12-19T17:53:19.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.741+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fb2600cdae0 con 0x7fb260070ab0 2023-12-19T17:53:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.749+0000 7fb25d7fa700 1 -- 172.21.15.45:0/3095150043 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7fb254054500 con 0x7fb260070ab0 2023-12-19T17:53:19.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb244065ad0 msgr2=0x7fb244067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb244065ad0 0x7fb244067f90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb2600b2440 tx=0x7fb24c008030 comp rx=0 tx=0).stop 2023-12-19T17:53:19.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 msgr2=0x7fb2601f52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 0x7fb2601f52e0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb25400d860 tx=0x7fb25400db70 comp rx=0 tx=0).stop 2023-12-19T17:53:19.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 shutdown_connections 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb244065ad0 0x7fb244067f90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb2600b2040 0x7fb2600c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb260070e90 0x7fb2601f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 --2- 172.21.15.45:0/3095150043 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb260070ab0 0x7fb2601f52e0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 >> 172.21.15.45:0/3095150043 conn(0x7fb2600d2ca0 msgr2=0x7fb2600b8240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 shutdown_connections 2023-12-19T17:53:19.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.753+0000 7fb26592e700 1 -- 172.21.15.45:0/3095150043 wait complete. 2023-12-19T17:53:19.761 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-19T17:53:19.780 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:19.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.949+0000 7f097ea20700 1 Processor -- start 2023-12-19T17:53:19.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.953+0000 7f097ea20700 1 -- start start 2023-12-19T17:53:19.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.953+0000 7f097ea20700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f097806ea90 0x7f09780d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.953+0000 7f097ea20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f097806fe80 0x7f09780b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.953+0000 7f097ea20700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09780d1820 con 0x7f09780b88b0 2023-12-19T17:53:19.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.953+0000 7f097ea20700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09780d1b00 con 0x7f097806ea90 2023-12-19T17:53:19.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.953+0000 7f097ea20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09780d1de0 con 0x7f097806fe80 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097d21d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f09780b88b0 0x7f09780b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53790/0 (socket says 172.21.15.45:53790) 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097d21d700 1 -- 172.21.15.45:0/1084397340 learned_addr learned my addr 172.21.15.45:0/1084397340 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097da1e700 1 --2- 172.21.15.45:0/1084397340 >> v2:172.21.15.73:3300/0 conn(0x7f097806ea90 0x7f09780d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097e21f700 1 --2- 172.21.15.45:0/1084397340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f097806fe80 0x7f09780b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ca1c700 1 -- 172.21.15.45:0/1084397340 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 18393261 0 0) 0x7f09780d1820 con 0x7f09780b88b0 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ca1c700 1 -- 172.21.15.45:0/1084397340 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09640035d0 con 0x7f09780b88b0 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097e21f700 1 -- 172.21.15.45:0/1084397340 >> v2:172.21.15.73:3300/0 conn(0x7f097806ea90 msgr2=0x7f09780d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097e21f700 1 --2- 172.21.15.45:0/1084397340 >> v2:172.21.15.73:3300/0 conn(0x7f097806ea90 0x7f09780d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097e21f700 1 -- 172.21.15.45:0/1084397340 >> v1:172.21.15.45:6789/0 conn(0x7f09780b88b0 legacy=0x7f09780b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097e21f700 1 -- 172.21.15.45:0/1084397340 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780d20c0 con 0x7f097806fe80 2023-12-19T17:53:19.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097da1e700 1 --2- 172.21.15.45:0/1084397340 >> v2:172.21.15.73:3300/0 conn(0x7f097806ea90 0x7f09780d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:19.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097e21f700 1 --2- 172.21.15.45:0/1084397340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f097806fe80 0x7f09780b6420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0970009d90 tx=0x7f097000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f474f5e383a64b26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ca1c700 1 -- 172.21.15.45:0/1084397340 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000e070 con 0x7f097806fe80 2023-12-19T17:53:19.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ca1c700 1 -- 172.21.15.45:0/1084397340 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097000bb20 con 0x7f097806fe80 2023-12-19T17:53:19.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ca1c700 1 -- 172.21.15.45:0/1084397340 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000be90 con 0x7f097806fe80 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ea20700 1 -- 172.21.15.45:0/1084397340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f097806fe80 msgr2=0x7f09780b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ea20700 1 --2- 172.21.15.45:0/1084397340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f097806fe80 0x7f09780b6420 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0970009d90 tx=0x7f097000b330 comp rx=0 tx=0).stop 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ea20700 1 -- 172.21.15.45:0/1084397340 shutdown_connections 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ea20700 1 --2- 172.21.15.45:0/1084397340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f097806fe80 0x7f09780b6420 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ea20700 1 --2- 172.21.15.45:0/1084397340 >> v2:172.21.15.73:3300/0 conn(0x7f097806ea90 0x7f09780d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.957+0000 7f097ea20700 1 -- 172.21.15.45:0/1084397340 >> 172.21.15.45:0/1084397340 conn(0x7f09780b46d0 msgr2=0x7f09780b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.961+0000 7f097ea20700 1 -- 172.21.15.45:0/1084397340 shutdown_connections 2023-12-19T17:53:19.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.961+0000 7f097ea20700 1 -- 172.21.15.45:0/1084397340 wait complete. 2023-12-19T17:53:19.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.961+0000 7f097ea20700 1 Processor -- start 2023-12-19T17:53:19.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.961+0000 7f097ea20700 1 -- start start 2023-12-19T17:53:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097ea20700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 0x7f09781f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097ea20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f097806fe80 0x7f097814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097ea20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09780b88b0 0x7f09780c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097ea20700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09780ca500 con 0x7f097806ea90 2023-12-19T17:53:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097ea20700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09781f6090 con 0x7f097806fe80 2023-12-19T17:53:19.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097ea20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09780ca730 con 0x7f09780b88b0 2023-12-19T17:53:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 0x7f09781f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 0x7f09781f6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56610/0 (socket says 172.21.15.45:56610) 2023-12-19T17:53:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 -- 172.21.15.45:0/490625240 learned_addr learned my addr 172.21.15.45:0/490625240 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097e21f700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09780b88b0 0x7f09780c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097d21d700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f097806fe80 0x7f097814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 -- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09780b88b0 msgr2=0x7f09780c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09780b88b0 0x7f09780c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 -- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f097806fe80 msgr2=0x7f097814c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f097806fe80 0x7f097814c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.965+0000 7f097da1e700 1 -- 172.21.15.45:0/490625240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09740094b0 con 0x7f097806ea90 2023-12-19T17:53:19.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f097da1e700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 0x7f09781f6520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f097400ebe0 tx=0x7f097400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0974009770 con 0x7f097806ea90 2023-12-19T17:53:19.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097400c850 con 0x7f097806ea90 2023-12-19T17:53:19.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097400cbe0 con 0x7f097806ea90 2023-12-19T17:53:19.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0970009a70 con 0x7f097806ea90 2023-12-19T17:53:19.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09781f5d20 con 0x7f097806ea90 2023-12-19T17:53:19.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.969+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0978067760 con 0x7f097806ea90 2023-12-19T17:53:19.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.973+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f097400cd40 con 0x7f097806ea90 2023-12-19T17:53:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.973+0000 7f096e7fc700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f095c065ad0 0x7f095c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.973+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0974083200 con 0x7f097806ea90 2023-12-19T17:53:19.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.973+0000 7f097d21d700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f095c065ad0 0x7f095c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:19.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.973+0000 7f097d21d700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f095c065ad0 0x7f095c067f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f09781e7680 tx=0x7f0968007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:19.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:19.981+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0974050b10 con 0x7f097806ea90 2023-12-19T17:53:20.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.189+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09780711c0 con 0x7f097806ea90 2023-12-19T17:53:20.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.189+0000 7f096e7fc700 1 -- 172.21.15.45:0/490625240 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f0974054130 con 0x7f097806ea90 2023-12-19T17:53:20.193 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:20.193 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:14.429162+0000","modified":"2023-12-19T17:53:17.452125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3731258594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3731258594},{"type":"v1","addr":"172.21.15.73:6835","nonce":3731258594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f095c065ad0 msgr2=0x7f095c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f095c065ad0 0x7f095c067f90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f09781e7680 tx=0x7f0968007de0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 msgr2=0x7f09781f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 0x7f09781f6520 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f097400ebe0 tx=0x7f097400eef0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 shutdown_connections 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f095c065ad0 0x7f095c067f90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09780b88b0 0x7f09780c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f097806fe80 0x7f097814c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 --2- 172.21.15.45:0/490625240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f097806ea90 0x7f09781f6520 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 >> 172.21.15.45:0/490625240 conn(0x7f09780b46d0 msgr2=0x7f09780b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 shutdown_connections 2023-12-19T17:53:20.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.193+0000 7f097ea20700 1 -- 172.21.15.45:0/490625240 wait complete. 2023-12-19T17:53:20.199 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 16 2023-12-19T17:53:20.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:53:14.429162+0000', 'modified': '2023-12-19T17:53:17.452125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5451': {'gid': 5451, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6835/3731258594', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6833', 'nonce': 3731258594}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3731258594}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:53:20.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:53:20.623 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T17:53:20.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.805+0000 7f2c51e8c700 1 Processor -- start 2023-12-19T17:53:20.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.805+0000 7f2c51e8c700 1 -- start start 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c51e8c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c4c15ade0 0x7f2c4c0b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c51e8c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c4c0b6540 0x7f2c4c0b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c51e8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b3fc0 0x7f2c4c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c51e8c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c0b69d0 con 0x7f2c4c15ade0 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c51e8c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c15b1c0 con 0x7f2c4c0b6540 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c51e8c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0cfc90 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c4c15ade0 0x7f2c4c0b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c4c15ade0 0x7f2c4c0b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56620/0 (socket says 172.21.15.45:56620) 2023-12-19T17:53:20.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 -- 172.21.15.45:0/277504503 learned_addr learned my addr 172.21.15.45:0/277504503 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:20.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/277504503 >> v2:172.21.15.73:3300/0 conn(0x7f2c4c0b6540 0x7f2c4c0b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c5168b700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b3fc0 0x7f2c4c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 -- 172.21.15.45:0/277504503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b3fc0 msgr2=0x7f2c4c0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b3fc0 0x7f2c4c0b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 -- 172.21.15.45:0/277504503 >> v2:172.21.15.73:3300/0 conn(0x7f2c4c0b6540 msgr2=0x7f2c4c0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/277504503 >> v2:172.21.15.73:3300/0 conn(0x7f2c4c0b6540 0x7f2c4c0b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c50e8a700 1 -- 172.21.15.45:0/277504503 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0cff70 con 0x7f2c4c15ade0 2023-12-19T17:53:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/277504503 >> v2:172.21.15.73:3300/0 conn(0x7f2c4c0b6540 0x7f2c4c0b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:20.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.809+0000 7f2c5168b700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b3fc0 0x7f2c4c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c0b1e40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009910 tx=0x7f2c40009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7239e1e9a3578768 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c4b7fe700 1 -- 172.21.15.45:0/277504503 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40011830 con 0x7f2c4c15ade0 2023-12-19T17:53:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c4b7fe700 1 -- 172.21.15.45:0/277504503 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40011990 con 0x7f2c4c15ade0 2023-12-19T17:53:20.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c4b7fe700 1 -- 172.21.15.45:0/277504503 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40011d40 con 0x7f2c4c15ade0 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 -- 172.21.15.45:0/277504503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c15ade0 msgr2=0x7f2c4c0b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c0b1e40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009910 tx=0x7f2c40009c20 comp rx=0 tx=0).stop 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 -- 172.21.15.45:0/277504503 shutdown_connections 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b3fc0 0x7f2c4c0b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/277504503 >> v2:172.21.15.73:3300/0 conn(0x7f2c4c0b6540 0x7f2c4c0b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/277504503 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c0b1e40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 -- 172.21.15.45:0/277504503 >> 172.21.15.45:0/277504503 conn(0x7f2c4c0b2540 msgr2=0x7f2c4c0b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 -- 172.21.15.45:0/277504503 shutdown_connections 2023-12-19T17:53:20.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.813+0000 7f2c51e8c700 1 -- 172.21.15.45:0/277504503 wait complete. 2023-12-19T17:53:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 Processor -- start 2023-12-19T17:53:20.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 -- start start 2023-12-19T17:53:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 0x7f2c4c06a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b6540 0x7f2c4c153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c154020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c156a10 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c156cf0 con 0x7f2c4c15ade0 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c51e8c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c156fd0 con 0x7f2c4c0b6540 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.817+0000 7f2c50e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 0x7f2c4c06a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 0x7f2c4c06a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56628/0 (socket says 172.21.15.45:56628) 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 -- 172.21.15.45:0/3531069242 learned_addr learned my addr 172.21.15.45:0/3531069242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b6540 0x7f2c4c153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c5168b700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c154020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 -- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b6540 msgr2=0x7f2c4c153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b6540 0x7f2c4c153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 -- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4c15ade0 msgr2=0x7f2c4c154020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c154020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 -- 172.21.15.45:0/3531069242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c380094b0 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 0x7f2c4c06a280 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c40000c00 tx=0x7f2c40004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c497fa700 1 -- 172.21.15.45:0/3531069242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40004510 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c497fa700 1 -- 172.21.15.45:0/3531069242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4001e070 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c40009570 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c497fa700 1 -- 172.21.15.45:0/3531069242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40003900 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.821+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c155320 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.825+0000 7f2c497fa700 1 -- 172.21.15.45:0/3531069242 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c40003a60 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.825+0000 7f2c497fa700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c30065ad0 0x7f2c30067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.825+0000 7f2c497fa700 1 -- 172.21.15.45:0/3531069242 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c400841a0 con 0x7f2c4c0b3fc0 2023-12-19T17:53:20.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.825+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c30065ad0 0x7f2c30067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 Processor -- start 2023-12-19T17:53:20.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 -- start start 2023-12-19T17:53:20.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c30065ad0 0x7f2c30067f90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c158c50 tx=0x7f2c38009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x133e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x133e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x13600c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x12835b0 con 0x133ebe0 2023-12-19T17:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1280d40 con 0x133a6a0 2023-12-19T17:53:20.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x127c630 con 0x1313ec0 2023-12-19T17:53:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x13600c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x13600c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56638/0 (socket says 172.21.15.45:56638) 2023-12-19T17:53:20.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 -- 172.21.15.45:0/1070673396 learned_addr learned my addr 172.21.15.45:0/1070673396 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x133e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x133e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 -- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 msgr2=0x133e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x133e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 -- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 msgr2=0x133e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x133e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 -- 172.21.15.45:0/1070673396 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10ef960 con 0x133ebe0 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x133e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x133e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:20.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c5168b700 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x13600c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c440074b0 tx=0x7f2c440077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0ce7ee606a3c728 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c367fc700 1 -- 172.21.15.45:0/1070673396 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44003c40 con 0x133ebe0 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c367fc700 1 -- 172.21.15.45:0/1070673396 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400f040 con 0x133ebe0 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.829+0000 7f2c367fc700 1 -- 172.21.15.45:0/1070673396 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44007e30 con 0x133ebe0 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 -- 172.21.15.45:0/1070673396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 msgr2=0x13600c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x13600c0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f2c440074b0 tx=0x7f2c440077c0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 -- 172.21.15.45:0/1070673396 shutdown_connections 2023-12-19T17:53:20.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x13600c0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x133e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 --2- 172.21.15.45:0/1070673396 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x133e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 -- 172.21.15.45:0/1070673396 >> 172.21.15.45:0/1070673396 conn(0x10a44d0 msgr2=0x1315c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 -- 172.21.15.45:0/1070673396 shutdown_connections 2023-12-19T17:53:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 -- 172.21.15.45:0/1070673396 wait complete. 2023-12-19T17:53:20.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 -- start start 2023-12-19T17:53:20.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.833+0000 7f2c5637c740 1 Processor -- start 2023-12-19T17:53:20.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x135d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x132d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x132d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1239c80 con 0x133ebe0 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x123fb00 con 0x133a6a0 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1128aa0 con 0x1313ec0 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 10 client.0 _ll_register_callbacks cb 0x1275f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x132d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x132d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56650/0 (socket says 172.21.15.45:56650) 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 -- 172.21.15.45:0/3424431293 learned_addr learned my addr 172.21.15.45:0/3424431293 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x135d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x132d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 -- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 msgr2=0x135d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x135d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 -- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 msgr2=0x132d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x132d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 -- 172.21.15.45:0/3424431293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c44009d80 con 0x133ebe0 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x135d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:20.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5168b700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x132d960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c44003fc0 tx=0x7f2c44004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16cf6244b73c0fff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/3424431293 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440174e0 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/3424431293 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c44017770 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x12756b0 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/3424431293 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c44017950 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 10 client.5613 fetch_fsmap learned FSMap version 16 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x1242770 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/3424431293 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x12756b0 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/3424431293 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2c4401c070 con 0x133ebe0 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 10 client.5613 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 10 client.5613 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 20 client.5613 populate_metadata read hostname 'smithi045' 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x133c470 0x1373d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 4 client.5613 mds_command: new command op to 5451 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:53:20.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.837+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 --> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1237a00 con 0x133c470 2023-12-19T17:53:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x133c470 0x1373d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x133c470 0x1373d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c263fbbf5ad67ef server_cookie=31ace7dfd6a35d01 in_seq=0 out_seq=0 2023-12-19T17:53:20.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c2b7fe700 10 client.5613 ms_handle_connect on v2:172.21.15.73:6833/3731258594 2023-12-19T17:53:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/3424431293 <== mds.0 v2:172.21.15.73:6833/3731258594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1237a00 con 0x133c470 2023-12-19T17:53:20.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c2b7fe700 10 client.5613 handle_command_reply: tid=0 2023-12-19T17:53:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c5637c740 1 client.5613 shutdown 2023-12-19T17:53:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 msgr2=0x132d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.841+0000 7f2c5637c740 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x132d960 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f2c44003fc0 tx=0x7f2c44004b60 comp rx=0 tx=0).stop 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 shutdown_connections 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x133c470 0x1373d50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x133ebe0 0x132d960 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133a6a0 0x132d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c2b7fe700 0 client.5613 ms_handle_reset on v2:172.21.15.73:6833/3731258594 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 --2- 172.21.15.45:0/3424431293 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1313ec0 0x135d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 >> 172.21.15.45:0/3424431293 conn(0x10a44d0 msgr2=0x135d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 shutdown_connections 2023-12-19T17:53:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 1 -- 172.21.15.45:0/3424431293 wait complete. 2023-12-19T17:53:20.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.845+0000 7f2c5637c740 20 client.5613 trim_cache size 0 max 16384 2023-12-19T17:53:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 Processor -- start 2023-12-19T17:53:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 -- start start 2023-12-19T17:53:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x136faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1370030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1367aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x12243d0 con 0x1313ec0 2023-12-19T17:53:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1246a40 con 0x133ebe0 2023-12-19T17:53:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1240200 con 0x133a6a0 2023-12-19T17:53:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x136faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x136faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56658/0 (socket says 172.21.15.45:56658) 2023-12-19T17:53:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 -- 172.21.15.45:0/842531020 learned_addr learned my addr 172.21.15.45:0/842531020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5168b700 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1367aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1370030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 -- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 msgr2=0x1370030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1370030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 -- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 msgr2=0x1367aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1367aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c50e8a700 1 -- 172.21.15.45:0/842531020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12289a0 con 0x1313ec0 2023-12-19T17:53:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.869+0000 7f2c5168b700 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1367aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x136faf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009f70 tx=0x7f2c40082450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffd009bc67221e86 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c36ffd700 1 -- 172.21.15.45:0/842531020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4005d770 con 0x1313ec0 2023-12-19T17:53:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c36ffd700 1 -- 172.21.15.45:0/842531020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c40006d50 con 0x1313ec0 2023-12-19T17:53:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c36ffd700 1 -- 172.21.15.45:0/842531020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c40009260 con 0x1313ec0 2023-12-19T17:53:20.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 -- 172.21.15.45:0/842531020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 msgr2=0x136faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x136faf0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009f70 tx=0x7f2c40082450 comp rx=0 tx=0).stop 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 -- 172.21.15.45:0/842531020 shutdown_connections 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1367aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1370030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 --2- 172.21.15.45:0/842531020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x136faf0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 -- 172.21.15.45:0/842531020 >> 172.21.15.45:0/842531020 conn(0x10a44d0 msgr2=0x133b310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 -- 172.21.15.45:0/842531020 shutdown_connections 2023-12-19T17:53:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.873+0000 7f2c5637c740 1 -- 172.21.15.45:0/842531020 wait complete. 2023-12-19T17:53:20.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 -- start start 2023-12-19T17:53:20.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 Processor -- start 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x13c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1362f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1363480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x13c4bf0 con 0x1313ec0 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x13705b0 con 0x133ebe0 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x135c730 con 0x133a6a0 2023-12-19T17:53:20.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5637c740 10 client.0 _ll_register_callbacks cb 0x11b5e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x13c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x13c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56664/0 (socket says 172.21.15.45:56664) 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 -- 172.21.15.45:0/634841064 learned_addr learned my addr 172.21.15.45:0/634841064 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c5168b700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1363480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1362f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 -- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 msgr2=0x1362f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1362f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 -- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 msgr2=0x1363480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1363480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c50e8a700 1 -- 172.21.15.45:0/634841064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1242770 con 0x1313ec0 2023-12-19T17:53:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.877+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1362f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c50e8a700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x13c46b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009f70 tx=0x7f2c44013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6608add5f144c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/634841064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4005d770 con 0x1313ec0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/634841064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c40082030 con 0x1313ec0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c4400f040 con 0x1313ec0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/634841064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c40009260 con 0x1313ec0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 10 client.5619 fetch_fsmap learned FSMap version 16 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x7f2c4c155320 con 0x1313ec0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/634841064 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400f040 con 0x1313ec0 2023-12-19T17:53:20.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/634841064 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 16) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2c40003d10 con 0x1313ec0 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 10 client.5619 fetch_fsmap finished waiting for FSMap version 16 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 10 client.5619 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 20 client.5619 populate_metadata read hostname 'smithi045' 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x135b350 0x135b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 4 client.5619 mds_command: new command op to 5451 tid=0[{"prefix": "status"}] 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 --> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] -- command(tid 0: {"prefix": "status"}) v1 -- 0x10fb460 con 0x135b350 2023-12-19T17:53:20.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x135b350 0x135b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:20.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 10 client.5619 ms_handle_connect on v2:172.21.15.73:6833/3731258594 2023-12-19T17:53:20.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c4bfff700 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x135b350 0x135b730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2cba4022bca8e2a6 server_cookie=8ebbafe54d45a6cb in_seq=0 out_seq=0 2023-12-19T17:53:20.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 1 -- 172.21.15.45:0/634841064 <== mds.0 v2:172.21.15.73:6833/3731258594 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x10fb460 con 0x135b350 2023-12-19T17:53:20.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.881+0000 7f2c2b7fe700 10 client.5619 handle_command_reply: tid=0 2023-12-19T17:53:20.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 client.5619 shutdown 2023-12-19T17:53:20.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 msgr2=0x13c46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x13c46b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009f70 tx=0x7f2c44013000 comp rx=0 tx=0).stop 2023-12-19T17:53:20.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 shutdown_connections 2023-12-19T17:53:20.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:6833/3731258594,v1:172.21.15.73:6835/3731258594] conn(0x135b350 0x135b730 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x133ebe0 0x1363480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x133a6a0 0x1362f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 --2- 172.21.15.45:0/634841064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1313ec0 0x13c46b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c2b7fe700 0 client.5619 ms_handle_reset on v2:172.21.15.73:6833/3731258594 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 >> 172.21.15.45:0/634841064 conn(0x10a44d0 msgr2=0x136faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 shutdown_connections 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 1 -- 172.21.15.45:0/634841064 wait complete. 2023-12-19T17:53:20.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c5637c740 20 client.5619 trim_cache size 0 max 16384 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5451, 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.4511997640000001, 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 16, 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 39, 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 39, 2023-12-19T17:53:20.889 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 14.739492257 2023-12-19T17:53:20.890 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:53:20.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c30065ad0 msgr2=0x7f2c30067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c30065ad0 0x7f2c30067f90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c158c50 tx=0x7f2c38009240 comp rx=0 tx=0).stop 2023-12-19T17:53:20.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 msgr2=0x7f2c4c06a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 0x7f2c4c06a280 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2c40000c00 tx=0x7f2c40004770 comp rx=0 tx=0).stop 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 shutdown_connections 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c30065ad0 0x7f2c30067f90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c4c15ade0 0x7f2c4c154020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c4c0b6540 0x7f2c4c153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 --2- 172.21.15.45:0/3531069242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c4c0b3fc0 0x7f2c4c06a280 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 >> 172.21.15.45:0/3531069242 conn(0x7f2c4c0b2540 msgr2=0x7f2c4c0cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 shutdown_connections 2023-12-19T17:53:20.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:20.885+0000 7f2c51e8c700 1 -- 172.21.15.45:0/3531069242 wait complete. 2023-12-19T17:53:20.915 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:53:21.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.089+0000 7f2c7173a700 1 Processor -- start 2023-12-19T17:53:21.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.089+0000 7f2c7173a700 1 -- start start 2023-12-19T17:53:21.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c7173a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:21.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c7173a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c6c06f3b0 0x7f2c6c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:21.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c7173a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6c0d1820 con 0x7f2c6c06ea90 2023-12-19T17:53:21.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c7173a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c6c0d1630 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c7173a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0d1b00 con 0x7f2c6c0b88b0 2023-12-19T17:53:21.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c6c06f3b0 0x7f2c6c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:21.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6a7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:21.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c6c06f3b0 0x7f2c6c06f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56676/0 (socket says 172.21.15.45:56676) 2023-12-19T17:53:21.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 -- 172.21.15.45:0/1254599602 learned_addr learned my addr 172.21.15.45:0/1254599602 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:21.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6affd700 1 --1- 172.21.15.45:0/1254599602 >> v1:172.21.15.73:6789/0 conn(0x7f2c6c06ea90 0x7f2c6c0d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:41778/0 (socket says 172.21.15.45:41778) 2023-12-19T17:53:21.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 -- 172.21.15.45:0/1254599602 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 msgr2=0x7f2c6c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:21.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 --2- 172.21.15.45:0/1254599602 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 -- 172.21.15.45:0/1254599602 >> v1:172.21.15.73:6789/0 conn(0x7f2c6c06ea90 legacy=0x7f2c6c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.093+0000 7f2c6b7fe700 1 -- 172.21.15.45:0/1254599602 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6c0d1de0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c6b7fe700 1 --2- 172.21.15.45:0/1254599602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c06f840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009e50 tx=0x7f2c6400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9d6608e4b78140 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c69ffb700 1 -- 172.21.15.45:0/1254599602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400e070 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c69ffb700 1 -- 172.21.15.45:0/1254599602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6400b910 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c69ffb700 1 -- 172.21.15.45:0/1254599602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400bcc0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 -- 172.21.15.45:0/1254599602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 msgr2=0x7f2c6c06f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:21.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 --2- 172.21.15.45:0/1254599602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c06f840 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2c64009e50 tx=0x7f2c6400b330 comp rx=0 tx=0).stop 2023-12-19T17:53:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 -- 172.21.15.45:0/1254599602 shutdown_connections 2023-12-19T17:53:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 --2- 172.21.15.45:0/1254599602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c06f840 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 --2- 172.21.15.45:0/1254599602 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 -- 172.21.15.45:0/1254599602 >> 172.21.15.45:0/1254599602 conn(0x7f2c6c0b46d0 msgr2=0x7f2c6c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 -- 172.21.15.45:0/1254599602 shutdown_connections 2023-12-19T17:53:21.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.097+0000 7f2c7173a700 1 -- 172.21.15.45:0/1254599602 wait complete. 2023-12-19T17:53:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 Processor -- start 2023-12-19T17:53:21.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 -- start start 2023-12-19T17:53:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c06ea90 0x7f2c6c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c1f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c1f7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0cb5b0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0cb890 con 0x7f2c6c06ea90 2023-12-19T17:53:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.101+0000 7f2c7173a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c0cbb70 con 0x7f2c6c0b88b0 2023-12-19T17:53:21.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c1f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c1f6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56690/0 (socket says 172.21.15.45:56690) 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 -- 172.21.15.45:0/2064458757 learned_addr learned my addr 172.21.15.45:0/2064458757 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6b7fe700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c1f7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6affd700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c06ea90 0x7f2c6c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 -- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 msgr2=0x7f2c6c1f7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c1f7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 -- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c06ea90 msgr2=0x7f2c6c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c06ea90 0x7f2c6c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 -- 172.21.15.45:0/2064458757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c64009b30 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c6a7fc700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c1f6d40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000e840 tx=0x7f2c6000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:21.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c600095a0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6000c690 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c0cbe50 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6000ca00 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c0cc8b0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.105+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6c0cb6f0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.109+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c6000cb60 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.109+0000 7f2c537fe700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c58065ad0 0x7f2c58067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:21.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.109+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c600832c0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.109+0000 7f2c6affd700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c58065ad0 0x7f2c58067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:21.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.113+0000 7f2c6affd700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c58065ad0 0x7f2c58067f90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c000f60 tx=0x7f2c5c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:21.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.113+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2c6c0cb6f0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.325+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2c6c0cb6f0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.325+0000 7f2c537fe700 1 -- 172.21.15.45:0/2064458757 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2c6c0cb6f0 con 0x7f2c6c06f3b0 2023-12-19T17:53:21.328 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c58065ad0 msgr2=0x7f2c58067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c58065ad0 0x7f2c58067f90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c000f60 tx=0x7f2c5c007d50 comp rx=0 tx=0).stop 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 msgr2=0x7f2c6c1f6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c1f6d40 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000e840 tx=0x7f2c6000ec00 comp rx=0 tx=0).stop 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 shutdown_connections 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c58065ad0 0x7f2c58067f90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c6c0b88b0 0x7f2c6c1f7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c6c06f3b0 0x7f2c6c1f6d40 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 --2- 172.21.15.45:0/2064458757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c6c06ea90 0x7f2c6c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 >> 172.21.15.45:0/2064458757 conn(0x7f2c6c0b46d0 msgr2=0x7f2c6c15c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 shutdown_connections 2023-12-19T17:53:21.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:21.329+0000 7f2c7173a700 1 -- 172.21.15.45:0/2064458757 wait complete. 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:53:21.357 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:53:21.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:21.361 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:53:21.378 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42264sec preferred_lft 42264sec 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:53:21.379 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T17:53:21.380 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.381 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:53:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T17:53:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T17:53:21.381 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:53:21.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:21.382 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:53:21.465 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:53:21.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:21.468 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:53:21.525 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:53:21.525 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:53:21.525 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:53:21.525 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:53:21.525 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:53:21.525 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:53:21.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:21.526 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:53:21.526 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:53:21.526 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:53:21.526 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:53:21.527 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:53:21.527 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:53:21.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:21.656 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:53:21.673 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:53:21.673 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T17:53:21.674 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:53:21.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:21.674 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:53:21.753 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T17:53:21.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:53:21.753 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:21.813 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:53:21.814 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:53:21.814 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:21.874 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:53:21.958 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:53:21.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:53:22.039 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:53:22.042 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:53:22.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:22.043 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:53:22.105 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:53:22.105 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T17:53:22.153 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:53:22.189 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:53:22.189 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:53:22.261 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:53:22.263 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:53:22.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:22.263 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:53:22.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T17:53:22.296+0000 7f98aa84a640 -1 init, newargv = 0x56348f738130 newargc=15 2023-12-19T17:53:22.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[46321]: starting ceph client 2023-12-19T17:53:22.313 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[46321]: starting fuse 2023-12-19T17:53:22.317 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:53:22.317 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:53:22.317 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:53:22.318 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T17:53:22.319 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:53:22.319 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T17:53:22.319 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:53:22.319 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:53:22.319 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:53:22.319 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:53:22.320 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:53:22.321 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:53:22.321 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:53:22.321 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:53:22.321 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:53:22.321 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T17:53:22.322 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:53:22.490 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.46321.asok 2023-12-19T17:53:22.670 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46321.asok 2023-12-19T17:53:22.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:22.670 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46321.asok status 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "46321", 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:53:22.875 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 5631, 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 5631 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 320088734 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:53:22.876 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 320088734 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.5631 192.168.0.1:0/320088734", 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/320088734", 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 16, 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 40, 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:53:22.877 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:53:22.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:22.890 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:53:22.891 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:22.911 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:53:22.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:22.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:22.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:22.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_extra --pg_num_min 64 2023-12-19T17:53:23.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.212+0000 7f245f7ea700 1 Processor -- start 2023-12-19T17:53:23.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.212+0000 7f245f7ea700 1 -- start start 2023-12-19T17:53:23.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245f7ea700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24580c2170 0x7f245806cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245f7ea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580cd4b0 0x7f24580ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245f7ea700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24580cae80 con 0x7f24580cd0d0 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245f7ea700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245806ec10 con 0x7f24580c2170 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245f7ea700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245806eef0 con 0x7f24580cd4b0 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24580c2170 0x7f245806cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f24580c2170 0x7f245806cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56702/0 (socket says 172.21.15.45:56702) 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 -- 172.21.15.45:0/568485447 learned_addr learned my addr 172.21.15.45:0/568485447 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245d586700 1 --1- 172.21.15.45:0/568485447 >> v1:172.21.15.45:6789/0 conn(0x7f24580cd0d0 0x7f24580c1a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53794/0 (socket says 172.21.15.45:53794) 2023-12-19T17:53:23.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245dd87700 1 --2- 172.21.15.45:0/568485447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580cd4b0 0x7f24580ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 -- 172.21.15.45:0/568485447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580cd4b0 msgr2=0x7f24580ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 --2- 172.21.15.45:0/568485447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580cd4b0 0x7f24580ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 -- 172.21.15.45:0/568485447 >> v1:172.21.15.45:6789/0 conn(0x7f24580cd0d0 legacy=0x7f24580c1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 -- 172.21.15.45:0/568485447 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245806f1d0 con 0x7f24580c2170 2023-12-19T17:53:23.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f245cd85700 1 --2- 172.21.15.45:0/568485447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580c2170 0x7f245806cc20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2448009910 tx=0x7f2448009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4b2c7d457f83dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f244ffff700 1 -- 172.21.15.45:0/568485447 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244800ba60 con 0x7f24580c2170 2023-12-19T17:53:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f244ffff700 1 -- 172.21.15.45:0/568485447 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244800bbc0 con 0x7f24580c2170 2023-12-19T17:53:23.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.216+0000 7f244ffff700 1 -- 172.21.15.45:0/568485447 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448009e60 con 0x7f24580c2170 2023-12-19T17:53:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 -- 172.21.15.45:0/568485447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580c2170 msgr2=0x7f245806cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 --2- 172.21.15.45:0/568485447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580c2170 0x7f245806cc20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2448009910 tx=0x7f2448009c20 comp rx=0 tx=0).stop 2023-12-19T17:53:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 -- 172.21.15.45:0/568485447 shutdown_connections 2023-12-19T17:53:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 --2- 172.21.15.45:0/568485447 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580cd4b0 0x7f24580ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 --2- 172.21.15.45:0/568485447 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580c2170 0x7f245806cc20 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:23.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 -- 172.21.15.45:0/568485447 >> 172.21.15.45:0/568485447 conn(0x7f24580cf0d0 msgr2=0x7f24580cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 -- 172.21.15.45:0/568485447 shutdown_connections 2023-12-19T17:53:23.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 -- 172.21.15.45:0/568485447 wait complete. 2023-12-19T17:53:23.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 Processor -- start 2023-12-19T17:53:23.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.220+0000 7f245f7ea700 1 -- start start 2023-12-19T17:53:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580c2170 0x7f245815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24580cd0d0 0x7f24580c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 0x7f24580b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c7470 con 0x7f24580cd4b0 2023-12-19T17:53:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c6580 con 0x7f24580cd0d0 2023-12-19T17:53:23.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24580c6860 con 0x7f24580c2170 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 0x7f24580b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 0x7f24580b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56718/0 (socket says 172.21.15.45:56718) 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 -- 172.21.15.45:0/1787590830 learned_addr learned my addr 172.21.15.45:0/1787590830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245d586700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580c2170 0x7f245815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245cd85700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24580cd0d0 0x7f24580c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 -- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580c2170 msgr2=0x7f245815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580c2170 0x7f245815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 -- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24580cd0d0 msgr2=0x7f24580c8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24580cd0d0 0x7f24580c8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 -- 172.21.15.45:0/1787590830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448009570 con 0x7f24580cd4b0 2023-12-19T17:53:23.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245cd85700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24580cd0d0 0x7f24580c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245dd87700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 0x7f24580b3900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2450007e60 tx=0x7f245000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245000ede0 con 0x7f24580cd4b0 2023-12-19T17:53:23.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2450014420 con 0x7f24580cd4b0 2023-12-19T17:53:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24500147d0 con 0x7f24580cd4b0 2023-12-19T17:53:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24580c6b40 con 0x7f24580cd4b0 2023-12-19T17:53:23.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.224+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24580c7100 con 0x7f24580cd4b0 2023-12-19T17:53:23.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.228+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24580b1700 con 0x7f24580cd4b0 2023-12-19T17:53:23.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.228+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2450014930 con 0x7f24580cd4b0 2023-12-19T17:53:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.232+0000 7f244dffb700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f243c065ad0 0x7f243c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.232+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2450083a40 con 0x7f24580cd4b0 2023-12-19T17:53:23.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.232+0000 7f245d586700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f243c065ad0 0x7f243c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:23.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.232+0000 7f245d586700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f243c065ad0 0x7f243c067f90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2454000f60 tx=0x7f2454007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:23.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.236+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f24580b1700 con 0x7f24580cd4b0 2023-12-19T17:53:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:23.420+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64} v 0) v1 -- 0x7f24580b1700 con 0x7f24580cd4b0 2023-12-19T17:53:24.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.356+0000 7f244dffb700 1 -- 172.21.15.45:0/1787590830 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64}]=0 pool 'cephfs_data_extra' created v42) v1 ==== 142+0+0 (secure 0 0 0) 0x7f24580b1700 con 0x7f24580cd4b0 2023-12-19T17:53:24.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.360+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f243c065ad0 msgr2=0x7f243c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.360+0000 7f245f7ea700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f243c065ad0 0x7f243c067f90 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2454000f60 tx=0x7f2454007ef0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.360+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 msgr2=0x7f24580b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.360+0000 7f245f7ea700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 0x7f24580b3900 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f2450007e60 tx=0x7f245000e3c0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 shutdown_connections 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f243c065ad0 0x7f243c067f90 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24580cd4b0 0x7f24580b3900 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24580cd0d0 0x7f24580c8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 --2- 172.21.15.45:0/1787590830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24580c2170 0x7f245815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 >> 172.21.15.45:0/1787590830 conn(0x7f24580cf0d0 msgr2=0x7f24580c4b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 shutdown_connections 2023-12-19T17:53:24.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.364+0000 7f245f7ea700 1 -- 172.21.15.45:0/1787590830 wait complete. 2023-12-19T17:53:24.374 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' created 2023-12-19T17:53:24.396 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_extra 2023-12-19T17:53:24.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.580+0000 7effde6e0700 1 Processor -- start 2023-12-19T17:53:24.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.580+0000 7effde6e0700 1 -- start start 2023-12-19T17:53:24.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effde6e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effd815b540 0x7effd81621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:24.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effde6e0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7effd8071ae0 0x7effd80af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:24.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effde6e0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effd8162700 con 0x7effd815b920 2023-12-19T17:53:24.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effde6e0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd80b2830 con 0x7effd815b540 2023-12-19T17:53:24.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effde6e0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effd80b1bb0 con 0x7effd8071ae0 2023-12-19T17:53:24.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effdd6de700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effd815b540 0x7effd81621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:24.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effdd6de700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7effd815b540 0x7effd81621c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56732/0 (socket says 172.21.15.45:56732) 2023-12-19T17:53:24.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effdd6de700 1 -- 172.21.15.45:0/3023137472 learned_addr learned my addr 172.21.15.45:0/3023137472 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:24.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effdcedd700 1 --1- 172.21.15.45:0/3023137472 >> v1:172.21.15.73:6789/0 conn(0x7effd815b920 0x7effd80713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:41784/0 (socket says 172.21.15.45:41784) 2023-12-19T17:53:24.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.584+0000 7effddedf700 1 --2- 172.21.15.45:0/3023137472 >> v2:172.21.15.73:3300/0 conn(0x7effd8071ae0 0x7effd80af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effcffff700 1 -- 172.21.15.45:0/3023137472 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 899651942 0 0) 0x7effd8162700 con 0x7effd815b920 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effcffff700 1 -- 172.21.15.45:0/3023137472 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effc40035d0 con 0x7effd815b920 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effdd6de700 1 -- 172.21.15.45:0/3023137472 >> v2:172.21.15.73:3300/0 conn(0x7effd8071ae0 msgr2=0x7effd80af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effdd6de700 1 --2- 172.21.15.45:0/3023137472 >> v2:172.21.15.73:3300/0 conn(0x7effd8071ae0 0x7effd80af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effdd6de700 1 -- 172.21.15.45:0/3023137472 >> v1:172.21.15.73:6789/0 conn(0x7effd815b920 legacy=0x7effd80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effdd6de700 1 -- 172.21.15.45:0/3023137472 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd80b1e90 con 0x7effd815b540 2023-12-19T17:53:24.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effdd6de700 1 --2- 172.21.15.45:0/3023137472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81621c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7effd80b1340 tx=0x7effd4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5669b8851424429 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:24.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effcffff700 1 -- 172.21.15.45:0/3023137472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd4005e50 con 0x7effd815b540 2023-12-19T17:53:24.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effcffff700 1 -- 172.21.15.45:0/3023137472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4006030 con 0x7effd815b540 2023-12-19T17:53:24.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effcffff700 1 -- 172.21.15.45:0/3023137472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40063c0 con 0x7effd815b540 2023-12-19T17:53:24.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 -- 172.21.15.45:0/3023137472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 msgr2=0x7effd81621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 --2- 172.21.15.45:0/3023137472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81621c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7effd80b1340 tx=0x7effd4009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 -- 172.21.15.45:0/3023137472 shutdown_connections 2023-12-19T17:53:24.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 --2- 172.21.15.45:0/3023137472 >> v2:172.21.15.73:3300/0 conn(0x7effd8071ae0 0x7effd80af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 --2- 172.21.15.45:0/3023137472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81621c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 -- 172.21.15.45:0/3023137472 >> 172.21.15.45:0/3023137472 conn(0x7effd80cf5a0 msgr2=0x7effd8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:24.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 -- 172.21.15.45:0/3023137472 shutdown_connections 2023-12-19T17:53:24.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.588+0000 7effde6e0700 1 -- 172.21.15.45:0/3023137472 wait complete. 2023-12-19T17:53:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 Processor -- start 2023-12-19T17:53:24.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 -- start start 2023-12-19T17:53:24.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81f7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:24.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effd815b920 0x7effd80b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:24.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effd81652b0 0x7effd81f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:24.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81fa610 con 0x7effd815b540 2023-12-19T17:53:24.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd81fa8f0 con 0x7effd815b920 2023-12-19T17:53:24.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effde6e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd81fabd0 con 0x7effd81652b0 2023-12-19T17:53:24.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.592+0000 7effdd6de700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81f7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:24.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81f7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56742/0 (socket says 172.21.15.45:56742) 2023-12-19T17:53:24.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 -- 172.21.15.45:0/2799507524 learned_addr learned my addr 172.21.15.45:0/2799507524 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:24.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdcedd700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effd815b920 0x7effd80b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:24.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effddedf700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effd81652b0 0x7effd81f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:24.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 -- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effd81652b0 msgr2=0x7effd81f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effd81652b0 0x7effd81f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 -- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effd815b920 msgr2=0x7effd80b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effd815b920 0x7effd80b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 -- 172.21.15.45:0/2799507524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd4009520 con 0x7effd815b540 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effddedf700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effd81652b0 0x7effd81f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effdd6de700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81f7c20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7effd4009c30 tx=0x7effd4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40093a0 con 0x7effd815b540 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effd4004050 con 0x7effd815b540 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd81f6b70 con 0x7effd815b540 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd40043e0 con 0x7effd815b540 2023-12-19T17:53:24.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd81faeb0 con 0x7effd815b540 2023-12-19T17:53:24.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.596+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd81f6db0 con 0x7effd815b540 2023-12-19T17:53:24.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.600+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7effd4022070 con 0x7effd815b540 2023-12-19T17:53:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.600+0000 7effcdffb700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7effbc065ad0 0x7effbc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:24.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.600+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6430+0+0 (secure 0 0 0) 0x7effd4084b90 con 0x7effd815b540 2023-12-19T17:53:24.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.604+0000 7effdcedd700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7effbc065ad0 0x7effbc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:24.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.604+0000 7effdcedd700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7effbc065ad0 0x7effbc067f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effd81f7bd0 tx=0x7effc8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:24.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.612+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7effd4052270 con 0x7effd815b540 2023-12-19T17:53:24.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.832+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"} v 0) v1 -- 0x7effd804ed30 con 0x7effd815b540 2023-12-19T17:53:24.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.844+0000 7effcdffb700 1 -- 172.21.15.45:0/2799507524 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"}]=0 added data pool 7 to fsmap v17) v1 ==== 140+0+0 (secure 0 0 0) 0x7effd40840b0 con 0x7effd815b540 2023-12-19T17:53:24.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7effbc065ad0 msgr2=0x7effbc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7effbc065ad0 0x7effbc067f90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effd81f7bd0 tx=0x7effc8007de0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 msgr2=0x7effd81f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81f7c20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7effd4009c30 tx=0x7effd4004770 comp rx=0 tx=0).stop 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 shutdown_connections 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7effbc065ad0 0x7effbc067f90 secure :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7effd81f7bd0 tx=0x7effc8007de0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7effd81652b0 0x7effd81f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7effd815b920 0x7effd80b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 --2- 172.21.15.45:0/2799507524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7effd815b540 0x7effd81f7c20 secure :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7effd4009c30 tx=0x7effd4004770 comp rx=0 tx=0).stop 2023-12-19T17:53:24.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 >> 172.21.15.45:0/2799507524 conn(0x7effd8071ae0 msgr2=0x7effd8155920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 shutdown_connections 2023-12-19T17:53:24.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:24.852+0000 7effde6e0700 1 -- 172.21.15.45:0/2799507524 wait complete. 2023-12-19T17:53:24.862 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 7 to fsmap 2023-12-19T17:53:24.882 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 Processor -- start 2023-12-19T17:53:25.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 -- start start 2023-12-19T17:53:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66881611c0 0x7f66880c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f66881615a0 0x7f668806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f668806dc80 con 0x7f66880af720 2023-12-19T17:53:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6688070340 con 0x7f66881611c0 2023-12-19T17:53:25.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668e93e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66880c3f90 con 0x7f66881615a0 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.048+0000 7f668d93c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66881611c0 0x7f66880c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f66881611c0 0x7f66880c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56748/0 (socket says 172.21.15.45:56748) 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 -- 172.21.15.45:0/4034326552 learned_addr learned my addr 172.21.15.45:0/4034326552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d13b700 1 --2- 172.21.15.45:0/4034326552 >> v2:172.21.15.73:3300/0 conn(0x7f66881615a0 0x7f668806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 -- 172.21.15.45:0/4034326552 >> v2:172.21.15.73:3300/0 conn(0x7f66881615a0 msgr2=0x7f668806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 --2- 172.21.15.45:0/4034326552 >> v2:172.21.15.73:3300/0 conn(0x7f66881615a0 0x7f668806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 -- 172.21.15.45:0/4034326552 >> v1:172.21.15.73:6789/0 conn(0x7f66880af720 legacy=0x7f6688164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 -- 172.21.15.45:0/4034326552 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66880c4270 con 0x7f66881611c0 2023-12-19T17:53:25.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668d93c700 1 --2- 172.21.15.45:0/4034326552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881611c0 0x7f66880c3920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f66880b1140 tx=0x7f6684009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978a3d420b50e210 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:25.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668c93a700 1 -- 172.21.15.45:0/4034326552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400b8a0 con 0x7f66881611c0 2023-12-19T17:53:25.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668c93a700 1 -- 172.21.15.45:0/4034326552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400ba00 con 0x7f66881611c0 2023-12-19T17:53:25.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668c93a700 1 -- 172.21.15.45:0/4034326552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400bd90 con 0x7f66881611c0 2023-12-19T17:53:25.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 -- 172.21.15.45:0/4034326552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881611c0 msgr2=0x7f66880c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 --2- 172.21.15.45:0/4034326552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881611c0 0x7f66880c3920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f66880b1140 tx=0x7f6684009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 -- 172.21.15.45:0/4034326552 shutdown_connections 2023-12-19T17:53:25.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 --2- 172.21.15.45:0/4034326552 >> v2:172.21.15.73:3300/0 conn(0x7f66881615a0 0x7f668806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 --2- 172.21.15.45:0/4034326552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881611c0 0x7f66880c3920 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 -- 172.21.15.45:0/4034326552 >> 172.21.15.45:0/4034326552 conn(0x7f66880cb900 msgr2=0x7f66880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:25.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 -- 172.21.15.45:0/4034326552 shutdown_connections 2023-12-19T17:53:25.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.052+0000 7f668e93e700 1 -- 172.21.15.45:0/4034326552 wait complete. 2023-12-19T17:53:25.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 Processor -- start 2023-12-19T17:53:25.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 -- start start 2023-12-19T17:53:25.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66880af720 0x7f66880b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66881611c0 0x7f66880c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 0x7f66881f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880b4200 con 0x7f66881615a0 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f668815f2d0 con 0x7f66880af720 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e93e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668815eff0 con 0x7f66881611c0 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e13d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 0x7f66881f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e13d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 0x7f66881f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56756/0 (socket says 172.21.15.45:56756) 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668e13d700 1 -- 172.21.15.45:0/2451387341 learned_addr learned my addr 172.21.15.45:0/2451387341 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668d93c700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66880af720 0x7f66880b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.056+0000 7f668d13b700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66881611c0 0x7f66880c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e13d700 1 -- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66881611c0 msgr2=0x7f66880c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e13d700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66881611c0 0x7f66880c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e13d700 1 -- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66880af720 msgr2=0x7f66880b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e13d700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66880af720 0x7f66880b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e13d700 1 -- 172.21.15.45:0/2451387341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6684009570 con 0x7f66881615a0 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e13d700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 0x7f66881f7750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f668000cba0 tx=0x7f668000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6680003c20 con 0x7f66881615a0 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6680003d80 con 0x7f66881615a0 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668000aae0 con 0x7f66881615a0 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880b1430 con 0x7f66881615a0 2023-12-19T17:53:25.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880b19f0 con 0x7f66881615a0 2023-12-19T17:53:25.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.060+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668806e760 con 0x7f66881615a0 2023-12-19T17:53:25.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.064+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f668000ac40 con 0x7f66881615a0 2023-12-19T17:53:25.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.064+0000 7f667e7fc700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f666c065ad0 0x7f666c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.064+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f6680083ed0 con 0x7f66881615a0 2023-12-19T17:53:25.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.064+0000 7f668d93c700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f666c065ad0 0x7f666c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.068+0000 7f668d93c700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f666c065ad0 0x7f666c067f90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6684000c00 tx=0x7f6684008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:25.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.068+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6680051580 con 0x7f66881615a0 2023-12-19T17:53:25.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.280+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6688067760 con 0x7f66881615a0 2023-12-19T17:53:25.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.284+0000 7f667e7fc700 1 -- 172.21.15.45:0/2451387341 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f6680054ba0 con 0x7f66881615a0 2023-12-19T17:53:25.287 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:25.287 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:14.429162+0000","modified":"2023-12-19T17:53:24.837019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3731258594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3731258594},{"type":"v1","addr":"172.21.15.73:6835","nonce":3731258594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f666c065ad0 msgr2=0x7f666c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f666c065ad0 0x7f666c067f90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f6684000c00 tx=0x7f6684008030 comp rx=0 tx=0).stop 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 msgr2=0x7f66881f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 0x7f66881f7750 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f668000cba0 tx=0x7f668000ceb0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 shutdown_connections 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f666c065ad0 0x7f666c067f90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f66881615a0 0x7f66881f7750 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f66881611c0 0x7f66880c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 --2- 172.21.15.45:0/2451387341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f66880af720 0x7f66880b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 >> 172.21.15.45:0/2451387341 conn(0x7f66880cb900 msgr2=0x7f6688163a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 shutdown_connections 2023-12-19T17:53:25.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.288+0000 7f668e93e700 1 -- 172.21.15.45:0/2451387341 wait complete. 2023-12-19T17:53:25.294 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2023-12-19T17:53:25.316 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:25.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 Processor -- start 2023-12-19T17:53:25.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 -- start start 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cf40b88b0 0x7f7cf40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf40b6df0 con 0x7f7cf40b6250 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf40d1820 con 0x7f7cf40b88b0 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.492+0000 7f7cfa784700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40d1b00 con 0x7f7cf406ea90 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cf40b88b0 0x7f7cf40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7cf40b88b0 0x7f7cf40b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56764/0 (socket says 172.21.15.45:56764) 2023-12-19T17:53:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 -- 172.21.15.45:0/3702706948 learned_addr learned my addr 172.21.15.45:0/3702706948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf9782700 1 --2- 172.21.15.45:0/3702706948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 -- 172.21.15.45:0/3702706948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 msgr2=0x7f7cf40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 --2- 172.21.15.45:0/3702706948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 -- 172.21.15.45:0/3702706948 >> v1:172.21.15.73:6789/0 conn(0x7f7cf40b6250 legacy=0x7f7cf40b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 -- 172.21.15.45:0/3702706948 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf40d1de0 con 0x7f7cf40b88b0 2023-12-19T17:53:25.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cf8f81700 1 --2- 172.21.15.45:0/3702706948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40b5d10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009910 tx=0x7f7ce4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bdcee197bcdd29 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cebfff700 1 -- 172.21.15.45:0/3702706948 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400ba60 con 0x7f7cf40b88b0 2023-12-19T17:53:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cebfff700 1 -- 172.21.15.45:0/3702706948 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce400bbc0 con 0x7f7cf40b88b0 2023-12-19T17:53:25.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cebfff700 1 -- 172.21.15.45:0/3702706948 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4009e60 con 0x7f7cf40b88b0 2023-12-19T17:53:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 -- 172.21.15.45:0/3702706948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b88b0 msgr2=0x7f7cf40b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 --2- 172.21.15.45:0/3702706948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40b5d10 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009910 tx=0x7f7ce4009c20 comp rx=0 tx=0).stop 2023-12-19T17:53:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 -- 172.21.15.45:0/3702706948 shutdown_connections 2023-12-19T17:53:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 --2- 172.21.15.45:0/3702706948 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40b5d10 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 --2- 172.21.15.45:0/3702706948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 -- 172.21.15.45:0/3702706948 >> 172.21.15.45:0/3702706948 conn(0x7f7cf40b46d0 msgr2=0x7f7cf40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:25.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 -- 172.21.15.45:0/3702706948 shutdown_connections 2023-12-19T17:53:25.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.496+0000 7f7cfa784700 1 -- 172.21.15.45:0/3702706948 wait complete. 2023-12-19T17:53:25.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 Processor -- start 2023-12-19T17:53:25.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 -- start start 2023-12-19T17:53:25.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf41f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 0x7f7cf40b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf406ca10 con 0x7f7cf40b6250 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf41f60c0 con 0x7f7cf40b88b0 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cfa784700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf406cc40 con 0x7f7cf406ea90 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cf8f81700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 0x7f7cf40b2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cf8f81700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 0x7f7cf40b2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:56772/0 (socket says 172.21.15.45:56772) 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cf8f81700 1 -- 172.21.15.45:0/746557630 learned_addr learned my addr 172.21.15.45:0/746557630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cf9782700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf41f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.500+0000 7f7cf9f83700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cf8f81700 1 -- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 msgr2=0x7f7cf41f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cf8f81700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf41f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cf8f81700 1 -- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40b88b0 msgr2=0x7f7cf40c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cf8f81700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cf8f81700 1 -- 172.21.15.45:0/746557630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce4009570 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cf8f81700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 0x7f7cf40b2bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4072a40 tx=0x7f7ce4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4004300 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce401f070 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce40036c0 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf406cf20 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf406d4e0 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.504+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4067760 con 0x7f7cf40b6250 2023-12-19T17:53:25.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.508+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ce4021030 con 0x7f7cf40b6250 2023-12-19T17:53:25.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.508+0000 7f7ce9ffb700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cd8065b50 0x7f7cd8068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:25.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.508+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f7ce4084580 con 0x7f7cf40b6250 2023-12-19T17:53:25.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.508+0000 7f7cf9782700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cd8065b50 0x7f7cd8068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:25.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.512+0000 7f7cf9782700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cd8065b50 0x7f7cd8068010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0007a60 tx=0x7f7cf0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:25.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.516+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7ce4051c40 con 0x7f7cf40b6250 2023-12-19T17:53:25.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.692+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cf4066a60 con 0x7f7cf40b6250 2023-12-19T17:53:25.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.696+0000 7f7ce9ffb700 1 -- 172.21.15.45:0/746557630 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+18051 (secure 0 0 0) 0x7f7ce4055260 con 0x7f7cf40b6250 2023-12-19T17:53:25.702 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:25.702 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":43,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:24.836272+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:25.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cd8065b50 msgr2=0x7f7cd8068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cd8065b50 0x7f7cd8068010 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0007a60 tx=0x7f7cf0008040 comp rx=0 tx=0).stop 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 msgr2=0x7f7cf40b2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 0x7f7cf40b2bf0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4072a40 tx=0x7f7ce4004770 comp rx=0 tx=0).stop 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 shutdown_connections 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7cd8065b50 0x7f7cd8068010 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7cf40b88b0 0x7f7cf40c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7cf40b6250 0x7f7cf40b2bf0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 --2- 172.21.15.45:0/746557630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7cf406ea90 0x7f7cf41f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 >> 172.21.15.45:0/746557630 conn(0x7f7cf40b46d0 msgr2=0x7f7cf40c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 shutdown_connections 2023-12-19T17:53:25.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:25.700+0000 7f7cfa784700 1 -- 172.21.15.45:0/746557630 wait complete. 2023-12-19T17:53:25.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:25.727 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v cephfs_data_extra .) 2023-12-19T17:53:25.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:25.760 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-12-19T17:53:25.836 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/0 2023-12-19T17:53:25.837 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:53:25.837 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:53:25.837 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/0" 2023-12-19T17:53:25.837 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:53:25.837 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:53:25.837 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:53:25.838 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:53:25.838 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:53:29.372 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/1 2023-12-19T17:53:29.372 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/1" 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:53:29.373 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:53:30.118 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:53:30.126 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:53:32.710 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/2 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/2" 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:53:32.710 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:53:35.991 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/3 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/3" 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:53:35.992 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:53:39.527 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/4 2023-12-19T17:53:39.527 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/4" 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:53:39.528 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:53:42.862 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:53:42.862 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:53:42.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:43.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.140+0000 7fde67184700 1 Processor -- start 2023-12-19T17:53:43.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.140+0000 7fde67184700 1 -- start start 2023-12-19T17:53:43.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.144+0000 7fde67184700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fde6015cff0 0x7fde60161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.144+0000 7fde67184700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600ca6f0 con 0x7fde600c3920 2023-12-19T17:53:43.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.144+0000 7fde67184700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde600c9220 con 0x7fde6006ddd0 2023-12-19T17:53:43.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.144+0000 7fde67184700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde6015d3d0 con 0x7fde6015cff0 2023-12-19T17:53:43.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66983700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fde600c3920 0x7fde6006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56252/0 (socket says 172.21.15.45:56252) 2023-12-19T17:53:43.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66983700 1 -- 172.21.15.45:0/2191319519 learned_addr learned my addr 172.21.15.45:0/2191319519 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:43.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66182700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fde6015cff0 0x7fde60161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde65180700 1 -- 172.21.15.45:0/2191319519 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2693519050 0 0) 0x7fde600ca6f0 con 0x7fde600c3920 2023-12-19T17:53:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde65180700 1 -- 172.21.15.45:0/2191319519 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde4c0035d0 con 0x7fde600c3920 2023-12-19T17:53:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66182700 1 -- 172.21.15.45:0/2191319519 >> v1:172.21.15.73:6789/0 conn(0x7fde6006ddd0 legacy=0x7fde600c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde65180700 1 -- 172.21.15.45:0/2191319519 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980404952 0 0) 0x7fde600c9220 con 0x7fde6006ddd0 2023-12-19T17:53:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66182700 1 -- 172.21.15.45:0/2191319519 >> v1:172.21.15.45:6789/0 conn(0x7fde600c3920 legacy=0x7fde6006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66182700 1 -- 172.21.15.45:0/2191319519 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600c9500 con 0x7fde6015cff0 2023-12-19T17:53:43.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde66182700 1 --2- 172.21.15.45:0/2191319519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde60161530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009850 tx=0x7fde5c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de347545132feb02 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde65180700 1 -- 172.21.15.45:0/2191319519 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c011830 con 0x7fde6015cff0 2023-12-19T17:53:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde65180700 1 -- 172.21.15.45:0/2191319519 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c011990 con 0x7fde6015cff0 2023-12-19T17:53:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde65180700 1 -- 172.21.15.45:0/2191319519 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c011d40 con 0x7fde6015cff0 2023-12-19T17:53:43.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde67184700 1 -- 172.21.15.45:0/2191319519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 msgr2=0x7fde60161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde67184700 1 --2- 172.21.15.45:0/2191319519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde60161530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fde5c009850 tx=0x7fde5c009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde67184700 1 -- 172.21.15.45:0/2191319519 shutdown_connections 2023-12-19T17:53:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde67184700 1 --2- 172.21.15.45:0/2191319519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde60161530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.148+0000 7fde67184700 1 -- 172.21.15.45:0/2191319519 >> 172.21.15.45:0/2191319519 conn(0x7fde600cb900 msgr2=0x7fde600b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:43.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.152+0000 7fde67184700 1 -- 172.21.15.45:0/2191319519 shutdown_connections 2023-12-19T17:53:43.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.152+0000 7fde67184700 1 -- 172.21.15.45:0/2191319519 wait complete. 2023-12-19T17:53:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.152+0000 7fde67184700 1 Processor -- start 2023-12-19T17:53:43.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 -- start start 2023-12-19T17:53:43.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 0x7fde601576f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde600c3920 0x7fde600b2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde6006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde600c6f90 con 0x7fde6006ddd0 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde60157c30 con 0x7fde6015cff0 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde600b3e60 con 0x7fde600c3920 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 0x7fde601576f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 0x7fde601576f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45860/0 (socket says 172.21.15.45:45860) 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 -- 172.21.15.45:0/1830043494 learned_addr learned my addr 172.21.15.45:0/1830043494 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde65981700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde600c3920 0x7fde600b2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66983700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde6006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 -- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde600c3920 msgr2=0x7fde600b2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde600c3920 0x7fde600b2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 -- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 msgr2=0x7fde6006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde6006ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 -- 172.21.15.45:0/1830043494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0094b0 con 0x7fde6006ddd0 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde66182700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 0x7fde601576f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fde6006abb0 tx=0x7fde5c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c01a990 con 0x7fde6006ddd0 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde600b4140 con 0x7fde6006ddd0 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5c01f070 con 0x7fde6006ddd0 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.156+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5c01ad50 con 0x7fde6006ddd0 2023-12-19T17:53:43.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.160+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde600c6bb0 con 0x7fde6006ddd0 2023-12-19T17:53:43.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.160+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde600c6d70 con 0x7fde6006ddd0 2023-12-19T17:53:43.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.160+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde5c01b430 con 0x7fde6006ddd0 2023-12-19T17:53:43.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.164+0000 7fde56ffd700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde44065ad0 0x7fde44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.164+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fde5c0844d0 con 0x7fde6006ddd0 2023-12-19T17:53:43.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.164+0000 7fde65981700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde44065ad0 0x7fde44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.164+0000 7fde65981700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde44065ad0 0x7fde44067f90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde601f5fd0 tx=0x7fde50009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.172+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fde5c051b10 con 0x7fde6006ddd0 2023-12-19T17:53:43.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.352+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde60067760 con 0x7fde6006ddd0 2023-12-19T17:53:43.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.356+0000 7fde56ffd700 1 -- 172.21.15.45:0/1830043494 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18038 (secure 0 0 0) 0x7fde5c055130 con 0x7fde6006ddd0 2023-12-19T17:53:43.360 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:43.360 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:25.841417+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.356+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde44065ad0 msgr2=0x7fde44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.356+0000 7fde67184700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde44065ad0 0x7fde44067f90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde601f5fd0 tx=0x7fde50009040 comp rx=0 tx=0).stop 2023-12-19T17:53:43.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.356+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 msgr2=0x7fde601576f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.356+0000 7fde67184700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 0x7fde601576f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fde6006abb0 tx=0x7fde5c004770 comp rx=0 tx=0).stop 2023-12-19T17:53:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 shutdown_connections 2023-12-19T17:53:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde44065ad0 0x7fde44067f90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde6015cff0 0x7fde6006ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde600c3920 0x7fde600b2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 --2- 172.21.15.45:0/1830043494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde6006ddd0 0x7fde601576f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 >> 172.21.15.45:0/1830043494 conn(0x7fde600cb900 msgr2=0x7fde600c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 shutdown_connections 2023-12-19T17:53:43.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.360+0000 7fde67184700 1 -- 172.21.15.45:0/1830043494 wait complete. 2023-12-19T17:53:43.384 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:53:12.347432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:53:13.452647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:53:23.494126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:53:43.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:53:43.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.564+0000 7ff3b700a700 1 Processor -- start 2023-12-19T17:53:43.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.564+0000 7ff3b700a700 1 -- start start 2023-12-19T17:53:43.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b700a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b00cff40 0x7ff3b0167d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b700a700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00d10e0 con 0x7ff3b015d090 2023-12-19T17:53:43.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b700a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b00d13c0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b700a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00b6040 con 0x7ff3b00cff40 2023-12-19T17:53:43.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b4da6700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff3b015d090 0x7ff3b00cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56258/0 (socket says 172.21.15.45:56258) 2023-12-19T17:53:43.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b4da6700 1 -- 172.21.15.45:0/2984313095 learned_addr learned my addr 172.21.15.45:0/2984313095 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b55a7700 1 --2- 172.21.15.45:0/2984313095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b00cff40 0x7ff3b0167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4151980859 0 0) 0x7ff3b00d10e0 con 0x7ff3b015d090 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3a00035d0 con 0x7ff3b015d090 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 668938002 0 0) 0x7ff3b00d13c0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3b00d10e0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2903167076 0 0) 0x7ff3a00035d0 con 0x7ff3b015d090 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b55a7700 1 -- 172.21.15.45:0/2984313095 >> v1:172.21.15.73:6789/0 conn(0x7ff3b00d0a50 legacy=0x7ff3b00cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b55a7700 1 -- 172.21.15.45:0/2984313095 >> v1:172.21.15.45:6789/0 conn(0x7ff3b015d090 legacy=0x7ff3b00cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b55a7700 1 -- 172.21.15.45:0/2984313095 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b00d16a0 con 0x7ff3b00cff40 2023-12-19T17:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3b55a7700 1 --2- 172.21.15.45:0/2984313095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b00cff40 0x7ff3b0167d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009dc0 tx=0x7ff3a800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12fa8f8bb3e4433 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a800e070 con 0x7ff3b00cff40 2023-12-19T17:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a8003a40 con 0x7ff3b00cff40 2023-12-19T17:53:43.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.568+0000 7ff3af7fe700 1 -- 172.21.15.45:0/2984313095 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4001670 con 0x7ff3b00cff40 2023-12-19T17:53:43.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 -- 172.21.15.45:0/2984313095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b00cff40 msgr2=0x7ff3b0167d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 --2- 172.21.15.45:0/2984313095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b00cff40 0x7ff3b0167d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff3a8009dc0 tx=0x7ff3a800b330 comp rx=0 tx=0).stop 2023-12-19T17:53:43.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 -- 172.21.15.45:0/2984313095 shutdown_connections 2023-12-19T17:53:43.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 --2- 172.21.15.45:0/2984313095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b00cff40 0x7ff3b0167d30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 -- 172.21.15.45:0/2984313095 >> 172.21.15.45:0/2984313095 conn(0x7ff3b00b4b90 msgr2=0x7ff3b00b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:43.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 -- 172.21.15.45:0/2984313095 shutdown_connections 2023-12-19T17:53:43.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 -- 172.21.15.45:0/2984313095 wait complete. 2023-12-19T17:53:43.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 Processor -- start 2023-12-19T17:53:43.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.572+0000 7ff3b700a700 1 -- start start 2023-12-19T17:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00cff40 0x7ff3b015ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 0x7ff3b01512d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b015d090 0x7ff3b0151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0143bc0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b01438e0 con 0x7ff3b00cff40 2023-12-19T17:53:43.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b00cb140 con 0x7ff3b015d090 2023-12-19T17:53:43.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 0x7ff3b01512d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 0x7ff3b01512d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45862/0 (socket says 172.21.15.45:45862) 2023-12-19T17:53:43.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 -- 172.21.15.45:0/1360407757 learned_addr learned my addr 172.21.15.45:0/1360407757 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:43.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b4da6700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00cff40 0x7ff3b015ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b55a7700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b015d090 0x7ff3b0151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 -- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b015d090 msgr2=0x7ff3b0151810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b015d090 0x7ff3b0151810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 -- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00cff40 msgr2=0x7ff3b015ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00cff40 0x7ff3b015ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 -- 172.21.15.45:0/1360407757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a8009a70 con 0x7ff3b00d0a50 2023-12-19T17:53:43.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b4da6700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00cff40 0x7ff3b015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3affff700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 0x7ff3b01512d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c730 tx=0x7ff39c00ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0052d0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39c005450 con 0x7ff3b00d0a50 2023-12-19T17:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c0038e0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b00cb420 con 0x7ff3b00d0a50 2023-12-19T17:53:43.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.576+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b01604e0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.580+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b00cafa0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.580+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff39c003a40 con 0x7ff3b00d0a50 2023-12-19T17:53:43.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.580+0000 7ff3ad7fa700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff394065ad0 0x7ff394067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.580+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7ff39c0828b0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.584+0000 7ff3b4da6700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff394065ad0 0x7ff394067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.584+0000 7ff3b4da6700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff394065ad0 0x7ff394067f90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4007fd0 tx=0x7ff3a4007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.588+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff3b00cafa0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.768+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff3b00cafa0 con 0x7ff3b00d0a50 2023-12-19T17:53:43.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3ad7fa700 1 -- 172.21.15.45:0/1360407757 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff39c017020 con 0x7ff3b00d0a50 2023-12-19T17:53:43.775 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:53:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff394065ad0 msgr2=0x7ff394067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff394065ad0 0x7ff394067f90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4007fd0 tx=0x7ff3a4007c00 comp rx=0 tx=0).stop 2023-12-19T17:53:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 msgr2=0x7ff3b01512d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 0x7ff3b01512d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7ff39c00c730 tx=0x7ff39c00ca40 comp rx=0 tx=0).stop 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 shutdown_connections 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff394065ad0 0x7ff394067f90 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff3b015d090 0x7ff3b0151810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff3b00d0a50 0x7ff3b01512d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 --2- 172.21.15.45:0/1360407757 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3b00cff40 0x7ff3b015ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 >> 172.21.15.45:0/1360407757 conn(0x7ff3b00b4b90 msgr2=0x7ff3b00b83c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 shutdown_connections 2023-12-19T17:53:43.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.772+0000 7ff3b700a700 1 -- 172.21.15.45:0/1360407757 wait complete. 2023-12-19T17:53:43.800 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:53:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.972+0000 7ff8ec746700 1 Processor -- start 2023-12-19T17:53:43.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.972+0000 7ff8ec746700 1 -- start start 2023-12-19T17:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ec746700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e415d170 0x7ff8e40ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ec746700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8e40b19f0 0x7ff8e406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ec746700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8e406efd0 0x7ff8e40acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ec746700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e4161710 con 0x7ff8e406efd0 2023-12-19T17:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ec746700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8e41619f0 con 0x7ff8e40b19f0 2023-12-19T17:53:43.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ec746700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e40ac520 con 0x7ff8e415d170 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8eace3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8e406efd0 0x7ff8e40acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8eace3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff8e406efd0 0x7ff8e40acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45874/0 (socket says 172.21.15.45:45874) 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8eace3700 1 -- 172.21.15.45:0/542662689 learned_addr learned my addr 172.21.15.45:0/542662689 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.976+0000 7ff8ea4e2700 1 --2- 172.21.15.45:0/542662689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e415d170 0x7ff8e40ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8e9ce1700 1 --2- 172.21.15.45:0/542662689 >> v2:172.21.15.73:3300/0 conn(0x7ff8e40b19f0 0x7ff8e406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8eace3700 1 -- 172.21.15.45:0/542662689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e415d170 msgr2=0x7ff8e40ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:43.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8eace3700 1 --2- 172.21.15.45:0/542662689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e415d170 0x7ff8e40ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8eace3700 1 -- 172.21.15.45:0/542662689 >> v2:172.21.15.73:3300/0 conn(0x7ff8e40b19f0 msgr2=0x7ff8e406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8eace3700 1 --2- 172.21.15.45:0/542662689 >> v2:172.21.15.73:3300/0 conn(0x7ff8e40b19f0 0x7ff8e406ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8eace3700 1 -- 172.21.15.45:0/542662689 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e40ac800 con 0x7ff8e406efd0 2023-12-19T17:53:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8eace3700 1 --2- 172.21.15.45:0/542662689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e406efd0 0x7ff8e40acd20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4070630 tx=0x7ff8dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd25d54e891aa9fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8e94e0700 1 -- 172.21.15.45:0/542662689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00e070 con 0x7ff8e406efd0 2023-12-19T17:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8e94e0700 1 -- 172.21.15.45:0/542662689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8dc00b9c0 con 0x7ff8e406efd0 2023-12-19T17:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8e94e0700 1 -- 172.21.15.45:0/542662689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc00bd70 con 0x7ff8e406efd0 2023-12-19T17:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 -- 172.21.15.45:0/542662689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e406efd0 msgr2=0x7ff8e40acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 --2- 172.21.15.45:0/542662689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e406efd0 0x7ff8e40acd20 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4070630 tx=0x7ff8dc00b330 comp rx=0 tx=0).stop 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 -- 172.21.15.45:0/542662689 shutdown_connections 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 --2- 172.21.15.45:0/542662689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e406efd0 0x7ff8e40acd20 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 --2- 172.21.15.45:0/542662689 >> v2:172.21.15.73:3300/0 conn(0x7ff8e40b19f0 0x7ff8e406ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 --2- 172.21.15.45:0/542662689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e415d170 0x7ff8e40ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 -- 172.21.15.45:0/542662689 >> 172.21.15.45:0/542662689 conn(0x7ff8e4071990 msgr2=0x7ff8e40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 -- 172.21.15.45:0/542662689 shutdown_connections 2023-12-19T17:53:43.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.980+0000 7ff8ec746700 1 -- 172.21.15.45:0/542662689 wait complete. 2023-12-19T17:53:43.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 Processor -- start 2023-12-19T17:53:43.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 -- start start 2023-12-19T17:53:43.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e406efd0 0x7ff8e414df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 0x7ff8e415f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8e415d170 0x7ff8e41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e4160810 con 0x7ff8e40b19f0 2023-12-19T17:53:43.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415fb90 con 0x7ff8e415d170 2023-12-19T17:53:43.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ec746700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8e415fe70 con 0x7ff8e406efd0 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8e9ce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 0x7ff8e415f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8e9ce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 0x7ff8e415f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45882/0 (socket says 172.21.15.45:45882) 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8e9ce1700 1 -- 172.21.15.45:0/2549152225 learned_addr learned my addr 172.21.15.45:0/2549152225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8ea4e2700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e406efd0 0x7ff8e414df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.984+0000 7ff8eace3700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8e415d170 0x7ff8e41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8e9ce1700 1 -- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e406efd0 msgr2=0x7ff8e414df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8e9ce1700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e406efd0 0x7ff8e414df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8e9ce1700 1 -- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8e415d170 msgr2=0x7ff8e41563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8e9ce1700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8e415d170 0x7ff8e41563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:43.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8e9ce1700 1 -- 172.21.15.45:0/2549152225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8dc009b30 con 0x7ff8e40b19f0 2023-12-19T17:53:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8e9ce1700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 0x7ff8e415f4d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400e810 tx=0x7ff8d400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d400c070 con 0x7ff8e40b19f0 2023-12-19T17:53:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d4013610 con 0x7ff8e40b19f0 2023-12-19T17:53:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d40139a0 con 0x7ff8e40b19f0 2023-12-19T17:53:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8e4160150 con 0x7ff8e40b19f0 2023-12-19T17:53:43.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8e4156900 con 0x7ff8e40b19f0 2023-12-19T17:53:43.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8e404ed30 con 0x7ff8e40b19f0 2023-12-19T17:53:43.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.988+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff8d4013b00 con 0x7ff8e40b19f0 2023-12-19T17:53:43.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.992+0000 7ff8daffd700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff8c8065b00 0x7ff8c8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:43.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.992+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7ff8d40830b0 con 0x7ff8e40b19f0 2023-12-19T17:53:43.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.992+0000 7ff8ea4e2700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff8c8065b00 0x7ff8c8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:43.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.992+0000 7ff8ea4e2700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff8c8065b00 0x7ff8c8067fc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0007a60 tx=0x7ff8e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:43.996+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff8d4050780 con 0x7ff8e40b19f0 2023-12-19T17:53:44.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.172+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff8e406cef0 con 0x7ff8e40b19f0 2023-12-19T17:53:44.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.172+0000 7ff8daffd700 1 -- 172.21.15.45:0/2549152225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff8d4013db0 con 0x7ff8e40b19f0 2023-12-19T17:53:44.178 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff8c8065b00 msgr2=0x7ff8c8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff8c8065b00 0x7ff8c8067fc0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0007a60 tx=0x7ff8e0008040 comp rx=0 tx=0).stop 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 msgr2=0x7ff8e415f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 0x7ff8e415f4d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff8d400e810 tx=0x7ff8d400eb20 comp rx=0 tx=0).stop 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 shutdown_connections 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff8c8065b00 0x7ff8c8067fc0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8e415d170 0x7ff8e41563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8e40b19f0 0x7ff8e415f4d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 --2- 172.21.15.45:0/2549152225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff8e406efd0 0x7ff8e414df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 >> 172.21.15.45:0/2549152225 conn(0x7ff8e4071990 msgr2=0x7ff8e41403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 shutdown_connections 2023-12-19T17:53:44.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.176+0000 7ff8ec746700 1 -- 172.21.15.45:0/2549152225 wait complete. 2023-12-19T17:53:44.203 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:53:44.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.400+0000 7fd53ea34700 1 Processor -- start 2023-12-19T17:53:44.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.400+0000 7fd53ea34700 1 -- start start 2023-12-19T17:53:44.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd5380b8910 0x7fd5380cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd5380d29e0 0x7fd5380ce190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5380d16b0 con 0x7fd53815d200 2023-12-19T17:53:44.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53815d5e0 con 0x7fd5380d29e0 2023-12-19T17:53:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5380d1940 con 0x7fd5380b8910 2023-12-19T17:53:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd537fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd53815d200 0x7fd5380d0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56266/0 (socket says 172.21.15.45:56266) 2023-12-19T17:53:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd537fff700 1 -- 172.21.15.45:0/3005067301 learned_addr learned my addr 172.21.15.45:0/3005067301 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53cfd1700 1 --2- 172.21.15.45:0/3005067301 >> v2:172.21.15.45:3300/0 conn(0x7fd5380d29e0 0x7fd5380ce190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd52f7fe700 1 --2- 172.21.15.45:0/3005067301 >> v2:172.21.15.73:3300/0 conn(0x7fd5380b8910 0x7fd5380cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd5377fe700 1 -- 172.21.15.45:0/3005067301 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3516065633 0 0) 0x7fd5380d16b0 con 0x7fd53815d200 2023-12-19T17:53:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd5377fe700 1 -- 172.21.15.45:0/3005067301 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240035d0 con 0x7fd53815d200 2023-12-19T17:53:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53cfd1700 1 -- 172.21.15.45:0/3005067301 >> v2:172.21.15.73:3300/0 conn(0x7fd5380b8910 msgr2=0x7fd5380cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53cfd1700 1 --2- 172.21.15.45:0/3005067301 >> v2:172.21.15.73:3300/0 conn(0x7fd5380b8910 0x7fd5380cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53cfd1700 1 -- 172.21.15.45:0/3005067301 >> v1:172.21.15.45:6789/0 conn(0x7fd53815d200 legacy=0x7fd5380d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53cfd1700 1 -- 172.21.15.45:0/3005067301 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380d1c20 con 0x7fd5380d29e0 2023-12-19T17:53:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53cfd1700 1 --2- 172.21.15.45:0/3005067301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380d29e0 0x7fd5380ce190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd5380d0540 tx=0x7fd53000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75c6d75f4bb1e129 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd5377fe700 1 -- 172.21.15.45:0/3005067301 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53000e070 con 0x7fd5380d29e0 2023-12-19T17:53:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd5377fe700 1 -- 172.21.15.45:0/3005067301 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53000bb20 con 0x7fd5380d29e0 2023-12-19T17:53:44.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd5377fe700 1 -- 172.21.15.45:0/3005067301 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530012430 con 0x7fd5380d29e0 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 -- 172.21.15.45:0/3005067301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380d29e0 msgr2=0x7fd5380ce190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.404+0000 7fd53ea34700 1 --2- 172.21.15.45:0/3005067301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380d29e0 0x7fd5380ce190 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd5380d0540 tx=0x7fd53000b330 comp rx=0 tx=0).stop 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 -- 172.21.15.45:0/3005067301 shutdown_connections 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 --2- 172.21.15.45:0/3005067301 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd5380d29e0 0x7fd5380ce190 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 --2- 172.21.15.45:0/3005067301 >> v2:172.21.15.73:3300/0 conn(0x7fd5380b8910 0x7fd5380cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 -- 172.21.15.45:0/3005067301 >> 172.21.15.45:0/3005067301 conn(0x7fd5380b4b90 msgr2=0x7fd5380b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 -- 172.21.15.45:0/3005067301 shutdown_connections 2023-12-19T17:53:44.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 -- 172.21.15.45:0/3005067301 wait complete. 2023-12-19T17:53:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 Processor -- start 2023-12-19T17:53:44.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.408+0000 7fd53ea34700 1 -- start start 2023-12-19T17:53:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5380b8910 0x7fd53815d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380d29e0 0x7fd538154f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 0x7fd5381559e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53815ae10 con 0x7fd53815d200 2023-12-19T17:53:44.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53815dca0 con 0x7fd5380d29e0 2023-12-19T17:53:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd538156640 con 0x7fd5380b8910 2023-12-19T17:53:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 0x7fd5381559e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 0x7fd5381559e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45904/0 (socket says 172.21.15.45:45904) 2023-12-19T17:53:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 -- 172.21.15.45:0/4033415285 learned_addr learned my addr 172.21.15.45:0/4033415285 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:44.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd52f7fe700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380d29e0 0x7fd538154f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd537fff700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5380b8910 0x7fd53815d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 -- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5380b8910 msgr2=0x7fd53815d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5380b8910 0x7fd53815d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 -- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380d29e0 msgr2=0x7fd538154f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380d29e0 0x7fd538154f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 -- 172.21.15.45:0/4033415285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd530009a70 con 0x7fd53815d200 2023-12-19T17:53:44.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53cfd1700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 0x7fd5381559e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd530014040 tx=0x7fd530004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530012430 con 0x7fd53815d200 2023-12-19T17:53:44.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd530020070 con 0x7fd53815d200 2023-12-19T17:53:44.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd538158750 con 0x7fd53815d200 2023-12-19T17:53:44.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd530004280 con 0x7fd53815d200 2023-12-19T17:53:44.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.412+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd538158ae0 con 0x7fd53815d200 2023-12-19T17:53:44.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.416+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53804ed30 con 0x7fd53815d200 2023-12-19T17:53:44.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.416+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5300043e0 con 0x7fd53815d200 2023-12-19T17:53:44.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.420+0000 7fd5357fa700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd518065ad0 0x7fd518067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.420+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fd530022070 con 0x7fd53815d200 2023-12-19T17:53:44.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.420+0000 7fd537fff700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd518065ad0 0x7fd518067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.420+0000 7fd537fff700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd518065ad0 0x7fd518067f90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5280011e0 tx=0x7fd528009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.428+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd530052710 con 0x7fd53815d200 2023-12-19T17:53:44.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.608+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5380b62c0 con 0x7fd53815d200 2023-12-19T17:53:44.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.608+0000 7fd5357fa700 1 -- 172.21.15.45:0/4033415285 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd530055d30 con 0x7fd53815d200 2023-12-19T17:53:44.614 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.612+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd518065ad0 msgr2=0x7fd518067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.612+0000 7fd53ea34700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd518065ad0 0x7fd518067f90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5280011e0 tx=0x7fd528009040 comp rx=0 tx=0).stop 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.612+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 msgr2=0x7fd5381559e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.612+0000 7fd53ea34700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 0x7fd5381559e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd530014040 tx=0x7fd530004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 shutdown_connections 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd518065ad0 0x7fd518067f90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53815d200 0x7fd5381559e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5380d29e0 0x7fd538154f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 --2- 172.21.15.45:0/4033415285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd5380b8910 0x7fd53815d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 >> 172.21.15.45:0/4033415285 conn(0x7fd5380b4b90 msgr2=0x7fd5380cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:44.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 shutdown_connections 2023-12-19T17:53:44.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.616+0000 7fd53ea34700 1 -- 172.21.15.45:0/4033415285 wait complete. 2023-12-19T17:53:44.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:53:44.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.828+0000 7f2f3db0c700 1 Processor -- start 2023-12-19T17:53:44.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.828+0000 7f2f3db0c700 1 -- start start 2023-12-19T17:53:44.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f3db0c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2f380d0a50 0x7f2f380cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f3db0c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f380d01e0 con 0x7f2f380cfd70 2023-12-19T17:53:44.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f3db0c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f380d10e0 con 0x7f2f3815d090 2023-12-19T17:53:44.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f3db0c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f380b6040 con 0x7f2f380d0a50 2023-12-19T17:53:44.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f37fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2f380cfd70 0x7f2f380b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56282/0 (socket says 172.21.15.45:56282) 2023-12-19T17:53:44.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f37fff700 1 -- 172.21.15.45:0/3847787665 learned_addr learned my addr 172.21.15.45:0/3847787665 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:44.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f36ffd700 1 --2- 172.21.15.45:0/3847787665 >> v2:172.21.15.45:3300/0 conn(0x7f2f380d0a50 0x7f2f380cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871233486 0 0) 0x7f2f30001490 con 0x7f2f380cfd70 2023-12-19T17:53:44.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f200035d0 con 0x7f2f380cfd70 2023-12-19T17:53:44.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1074261630 0 0) 0x7f2f380d10e0 con 0x7f2f3815d090 2023-12-19T17:53:44.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f30001490 con 0x7f2f3815d090 2023-12-19T17:53:44.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f36ffd700 1 -- 172.21.15.45:0/3847787665 >> v1:172.21.15.73:6789/0 conn(0x7f2f3815d090 legacy=0x7f2f380cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.832+0000 7f2f36ffd700 1 -- 172.21.15.45:0/3847787665 >> v1:172.21.15.45:6789/0 conn(0x7f2f380cfd70 legacy=0x7f2f380b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f36ffd700 1 -- 172.21.15.45:0/3847787665 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f380d13c0 con 0x7f2f380d0a50 2023-12-19T17:53:44.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f36ffd700 1 --2- 172.21.15.45:0/3847787665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f380d0a50 0x7f2f380cf830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009850 tx=0x7f2f2c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb7085bb63146c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c011830 con 0x7f2f380d0a50 2023-12-19T17:53:44.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f2c011990 con 0x7f2f380d0a50 2023-12-19T17:53:44.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f367fc700 1 -- 172.21.15.45:0/3847787665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2c011d40 con 0x7f2f380d0a50 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 -- 172.21.15.45:0/3847787665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f380d0a50 msgr2=0x7f2f380cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/3847787665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f380d0a50 0x7f2f380cf830 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009850 tx=0x7f2f2c009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 -- 172.21.15.45:0/3847787665 shutdown_connections 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/3847787665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f380d0a50 0x7f2f380cf830 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 -- 172.21.15.45:0/3847787665 >> 172.21.15.45:0/3847787665 conn(0x7f2f380b4b90 msgr2=0x7f2f380b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 -- 172.21.15.45:0/3847787665 shutdown_connections 2023-12-19T17:53:44.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.836+0000 7f2f3db0c700 1 -- 172.21.15.45:0/3847787665 wait complete. 2023-12-19T17:53:44.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 Processor -- start 2023-12-19T17:53:44.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 -- start start 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f380cfd70 0x7f2f380ca930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f380d0a50 0x7f2f3814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 0x7f2f381fa7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38150170 con 0x7f2f3815d090 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b7550 con 0x7f2f380d0a50 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f3db0c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f380b6fd0 con 0x7f2f380cfd70 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 0x7f2f381fa7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 0x7f2f381fa7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45918/0 (socket says 172.21.15.45:45918) 2023-12-19T17:53:44.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f37fff700 1 -- 172.21.15.45:0/704328015 learned_addr learned my addr 172.21.15.45:0/704328015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.840+0000 7f2f377fe700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f380cfd70 0x7f2f380ca930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f36ffd700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f380d0a50 0x7f2f3814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f37fff700 1 -- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f380cfd70 msgr2=0x7f2f380ca930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f37fff700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f380cfd70 0x7f2f380ca930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f37fff700 1 -- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f380d0a50 msgr2=0x7f2f3814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f37fff700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f380d0a50 0x7f2f3814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f37fff700 1 -- 172.21.15.45:0/704328015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c0094b0 con 0x7f2f3815d090 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f36ffd700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f380d0a50 0x7f2f3814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f37fff700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 0x7f2f381fa7f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f30001f50 tx=0x7f2f30002030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000aaa0 con 0x7f2f3815d090 2023-12-19T17:53:44.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3000ac00 con 0x7f2f3815d090 2023-12-19T17:53:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30012400 con 0x7f2f3815d090 2023-12-19T17:53:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f380b2ba0 con 0x7f2f3815d090 2023-12-19T17:53:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f381f9ff0 con 0x7f2f3815d090 2023-12-19T17:53:44.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.844+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f381f9e50 con 0x7f2f3815d090 2023-12-19T17:53:44.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.848+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2f3001b3b0 con 0x7f2f3815d090 2023-12-19T17:53:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.848+0000 7f2f1ffff700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f24065b00 0x7f2f24067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.848+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f2f30082ef0 con 0x7f2f3815d090 2023-12-19T17:53:44.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.848+0000 7f2f377fe700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f24065b00 0x7f2f24067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:44.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.848+0000 7f2f377fe700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f24065b00 0x7f2f24067fc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f280011e0 tx=0x7f2f28009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:44.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:44.856+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2f381f9e50 con 0x7f2f3815d090 2023-12-19T17:53:45.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.036+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f2f380d01e0 con 0x7f2f3815d090 2023-12-19T17:53:45.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.036+0000 7f2f1ffff700 1 -- 172.21.15.45:0/704328015 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v44) v1 ==== 106+0+11 (secure 0 0 0) 0x7f2f30017020 con 0x7f2f3815d090 2023-12-19T17:53:45.042 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:53:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f24065b00 msgr2=0x7f2f24067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f24065b00 0x7f2f24067fc0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2f280011e0 tx=0x7f2f28009040 comp rx=0 tx=0).stop 2023-12-19T17:53:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 msgr2=0x7f2f381fa7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 0x7f2f381fa7f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f2f30001f50 tx=0x7f2f30002030 comp rx=0 tx=0).stop 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 shutdown_connections 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2f24065b00 0x7f2f24067fc0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2f3815d090 0x7f2f381fa7f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2f380d0a50 0x7f2f3814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 --2- 172.21.15.45:0/704328015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2f380cfd70 0x7f2f380ca930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 >> 172.21.15.45:0/704328015 conn(0x7f2f380b4b90 msgr2=0x7f2f380b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:45.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 shutdown_connections 2023-12-19T17:53:45.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.040+0000 7f2f3db0c700 1 -- 172.21.15.45:0/704328015 wait complete. 2023-12-19T17:53:45.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:53:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.240+0000 7feebd394700 1 Processor -- start 2023-12-19T17:53:45.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.240+0000 7feebd394700 1 -- start start 2023-12-19T17:53:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebd394700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feeb806ea90 0x7feeb80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebd394700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b88b0 0x7feeb80b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebd394700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeb80b6df0 con 0x7feeb80b6250 2023-12-19T17:53:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebd394700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80d1820 con 0x7feeb806ea90 2023-12-19T17:53:45.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebd394700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80d1b00 con 0x7feeb80b88b0 2023-12-19T17:53:45.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feeb806ea90 0x7feeb80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebcb93700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feeb80b6250 0x7feeb80b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56296/0 (socket says 172.21.15.45:56296) 2023-12-19T17:53:45.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feebcb93700 1 -- 172.21.15.45:0/1786937475 learned_addr learned my addr 172.21.15.45:0/1786937475 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeaffff700 1 --2- 172.21.15.45:0/1786937475 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b88b0 0x7feeb80b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb7fff700 1 -- 172.21.15.45:0/1786937475 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b88b0 msgr2=0x7feeb80b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb7fff700 1 --2- 172.21.15.45:0/1786937475 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b88b0 0x7feeb80b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb7fff700 1 -- 172.21.15.45:0/1786937475 >> v1:172.21.15.45:6789/0 conn(0x7feeb80b6250 legacy=0x7feeb80b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb7fff700 1 -- 172.21.15.45:0/1786937475 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80d1de0 con 0x7feeb806ea90 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb77fe700 1 -- 172.21.15.45:0/1786937475 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673106389 0 0) 0x7feeb80b6df0 con 0x7feeb80b6250 2023-12-19T17:53:45.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.244+0000 7feeb7fff700 1 --2- 172.21.15.45:0/1786937475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb806ea90 0x7feeb80d0f20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feea8009850 tx=0x7feea8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fdf22282536593 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feeb77fe700 1 -- 172.21.15.45:0/1786937475 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8011830 con 0x7feeb806ea90 2023-12-19T17:53:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feeb77fe700 1 -- 172.21.15.45:0/1786937475 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8011990 con 0x7feeb806ea90 2023-12-19T17:53:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feeb77fe700 1 -- 172.21.15.45:0/1786937475 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8011d40 con 0x7feeb806ea90 2023-12-19T17:53:45.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 -- 172.21.15.45:0/1786937475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb806ea90 msgr2=0x7feeb80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 --2- 172.21.15.45:0/1786937475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb806ea90 0x7feeb80d0f20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7feea8009850 tx=0x7feea8009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 -- 172.21.15.45:0/1786937475 shutdown_connections 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 --2- 172.21.15.45:0/1786937475 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b88b0 0x7feeb80b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 --2- 172.21.15.45:0/1786937475 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb806ea90 0x7feeb80d0f20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 -- 172.21.15.45:0/1786937475 >> 172.21.15.45:0/1786937475 conn(0x7feeb80b46d0 msgr2=0x7feeb80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 -- 172.21.15.45:0/1786937475 shutdown_connections 2023-12-19T17:53:45.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 -- 172.21.15.45:0/1786937475 wait complete. 2023-12-19T17:53:45.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.248+0000 7feebd394700 1 Processor -- start 2023-12-19T17:53:45.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 -- start start 2023-12-19T17:53:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb806ea90 0x7feeb815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b6250 0x7feeb80b33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 0x7feeb8148c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb815f2a0 con 0x7feeb80b88b0 2023-12-19T17:53:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb814bc30 con 0x7feeb806ea90 2023-12-19T17:53:45.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb814b950 con 0x7feeb80b6250 2023-12-19T17:53:45.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 0x7feeb8148c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 0x7feeb8148c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45932/0 (socket says 172.21.15.45:45932) 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 -- 172.21.15.45:0/3838463346 learned_addr learned my addr 172.21.15.45:0/3838463346 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feeb7fff700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb806ea90 0x7feeb815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feeaffff700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b6250 0x7feeb80b33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 -- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b6250 msgr2=0x7feeb80b33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b6250 0x7feeb80b33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 -- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb806ea90 msgr2=0x7feeb815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb806ea90 0x7feeb815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 -- 172.21.15.45:0/3838463346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80094b0 con 0x7feeb80b88b0 2023-12-19T17:53:45.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebcb93700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 0x7feeb8148c40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feeb000cba0 tx=0x7feeb000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000aaa0 con 0x7feeb80b88b0 2023-12-19T17:53:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000ac20 con 0x7feeb80b88b0 2023-12-19T17:53:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb815f490 con 0x7feeb80b88b0 2023-12-19T17:53:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.252+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00070d0 con 0x7feeb80b88b0 2023-12-19T17:53:45.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.256+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb815f820 con 0x7feeb80b88b0 2023-12-19T17:53:45.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.256+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb815fc30 con 0x7feeb80b88b0 2023-12-19T17:53:45.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.256+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feeb0007230 con 0x7feeb80b88b0 2023-12-19T17:53:45.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.260+0000 7feeb57fa700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee9c065ad0 0x7fee9c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.260+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7feeb0082ea0 con 0x7feeb80b88b0 2023-12-19T17:53:45.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.260+0000 7feeb7fff700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee9c065ad0 0x7fee9c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.260+0000 7feeb7fff700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee9c065ad0 0x7fee9c067f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feea80090b0 tx=0x7feea801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:45.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.264+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feeb0050560 con 0x7feeb80b88b0 2023-12-19T17:53:45.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.456+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feeb8067760 con 0x7feeb80b88b0 2023-12-19T17:53:45.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feeb57fa700 1 -- 172.21.15.45:0/3838463346 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7feeb0018020 con 0x7feeb80b88b0 2023-12-19T17:53:45.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee9c065ad0 msgr2=0x7fee9c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee9c065ad0 0x7fee9c067f90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feea80090b0 tx=0x7feea801c040 comp rx=0 tx=0).stop 2023-12-19T17:53:45.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 msgr2=0x7feeb8148c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 0x7feeb8148c40 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7feeb000cba0 tx=0x7feeb000ceb0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 shutdown_connections 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee9c065ad0 0x7fee9c067f90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feeb80b88b0 0x7feeb8148c40 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feeb80b6250 0x7feeb80b33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 --2- 172.21.15.45:0/3838463346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feeb806ea90 0x7feeb815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.460+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 >> 172.21.15.45:0/3838463346 conn(0x7feeb80b46d0 msgr2=0x7feeb80b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.464+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 shutdown_connections 2023-12-19T17:53:45.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.464+0000 7feebd394700 1 -- 172.21.15.45:0/3838463346 wait complete. 2023-12-19T17:53:45.469 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:53:45.491 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:53:45.491 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:53:45.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:53:45.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.728+0000 7f9e80bfc700 1 Processor -- start 2023-12-19T17:53:45.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.728+0000 7f9e80bfc700 1 -- start start 2023-12-19T17:53:45.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e80bfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e7c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e80bfc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c06f0a0 con 0x7f9e7c06cad0 2023-12-19T17:53:45.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e80bfc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e7c06ea90 con 0x7f9e7c15ae20 2023-12-19T17:53:45.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e80bfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0c3f60 con 0x7f9e7c0afe30 2023-12-19T17:53:45.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7affd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9e7c06cad0 0x7f9e7c0af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56298/0 (socket says 172.21.15.45:56298) 2023-12-19T17:53:45.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7affd700 1 -- 172.21.15.45:0/2115636028 learned_addr learned my addr 172.21.15.45:0/2115636028 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:45.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e7c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095303409 0 0) 0x7f9e7c06f0a0 con 0x7f9e7c06cad0 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e640035d0 con 0x7f9e7c06cad0 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1230613976 0 0) 0x7f9e7c06ea90 con 0x7f9e7c15ae20 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e7c06f0a0 con 0x7f9e7c15ae20 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1532095758 0 0) 0x7f9e640035d0 con 0x7f9e7c06cad0 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 msgr2=0x7f9e7c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e7c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 >> v1:172.21.15.73:6789/0 conn(0x7f9e7c15ae20 legacy=0x7f9e7c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c0c4240 con 0x7f9e7c06cad0 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f9e70001670 con 0x7f9e7c06cad0 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.732+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e7c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 >> v1:172.21.15.45:6789/0 conn(0x7f9e7c06cad0 legacy=0x7f9e7c0af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e64003be0 0x7f9e64003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e64004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e64005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c0c3f60 con 0x7f9e64004db0 2023-12-19T17:53:45.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400ba30 con 0x7f9e64003be0 2023-12-19T17:53:45.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6400bbf0 con 0x7f9e7c0afe30 2023-12-19T17:53:45.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e64005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7b7fe700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e64003be0 0x7f9e64003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7affd700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e64004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 -- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 msgr2=0x7f9e64004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:45.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0afe30 0x7f9e64004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 -- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e64003be0 msgr2=0x7f9e64003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:45.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e64003be0 0x7f9e64003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 -- 172.21.15.45:0/2115636028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009a70 con 0x7f9e64004db0 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e64005230 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c072500 tx=0x7f9e640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be292e160aa34b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e7400ed00 con 0x7f9e64004db0 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e7400f040 con 0x7f9e64004db0 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7a7fc700 1 -- 172.21.15.45:0/2115636028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74003c60 con 0x7f9e64004db0 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e80bfc700 1 -- 172.21.15.45:0/2115636028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 msgr2=0x7f9e64005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/2115636028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e64005230 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c072500 tx=0x7f9e640058a0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e7bfff700 1 -- 172.21.15.45:0/2115636028 reap_dead start 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e80bfc700 1 -- 172.21.15.45:0/2115636028 shutdown_connections 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e80bfc700 1 -- 172.21.15.45:0/2115636028 >> 172.21.15.45:0/2115636028 conn(0x7f9e7c0cb900 msgr2=0x7f9e7c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e80bfc700 1 -- 172.21.15.45:0/2115636028 shutdown_connections 2023-12-19T17:53:45.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.736+0000 7f9e80bfc700 1 -- 172.21.15.45:0/2115636028 wait complete. 2023-12-19T17:53:45.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 Processor -- start 2023-12-19T17:53:45.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 -- start start 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e7c1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0cdf10 0x7f9e7c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c0ce390 0x7f9e7c15def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c157de0 con 0x7f9e64004db0 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c1fb4a0 con 0x7f9e7c0ce390 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e80bfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7c1fa5b0 con 0x7f9e7c0cdf10 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e7b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e7c1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e7b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e7c1578a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45958/0 (socket says 172.21.15.45:45958) 2023-12-19T17:53:45.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e7b7fe700 1 -- 172.21.15.45:0/1635289805 learned_addr learned my addr 172.21.15.45:0/1635289805 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e7bfff700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c0ce390 0x7f9e7c15def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.740+0000 7f9e7affd700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0cdf10 0x7f9e7c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e7b7fe700 1 -- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0cdf10 msgr2=0x7f9e7c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e7b7fe700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0cdf10 0x7f9e7c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e7b7fe700 1 -- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c0ce390 msgr2=0x7f9e7c15def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e7b7fe700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c0ce390 0x7f9e7c15def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e7b7fe700 1 -- 172.21.15.45:0/1635289805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c1fa890 con 0x7f9e64004db0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e7b7fe700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e7c1578a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00f7e0 tx=0x7f9e6c00fba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0052e0 con 0x7f9e64004db0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c005460 con 0x7f9e64004db0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c0038e0 con 0x7f9e64004db0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e7c1fab70 con 0x7f9e64004db0 2023-12-19T17:53:45.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e7c1fb130 con 0x7f9e64004db0 2023-12-19T17:53:45.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.744+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7c067760 con 0x7f9e64004db0 2023-12-19T17:53:45.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.748+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e6c003a40 con 0x7f9e64004db0 2023-12-19T17:53:45.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.748+0000 7f9e63fff700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e68065ad0 0x7f9e68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:45.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.748+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7f9e6c083420 con 0x7f9e64004db0 2023-12-19T17:53:45.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.748+0000 7f9e7affd700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e68065ad0 0x7f9e68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:45.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.748+0000 7f9e7affd700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e68065ad0 0x7f9e68067f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e70001050 tx=0x7f9e7000a040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:45.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.752+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9e6c050a70 con 0x7f9e64004db0 2023-12-19T17:53:45.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.928+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e7c06e060 con 0x7f9e64004db0 2023-12-19T17:53:45.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e63fff700 1 -- 172.21.15.45:0/1635289805 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+18038 (secure 0 0 0) 0x7f9e6c054090 con 0x7f9e64004db0 2023-12-19T17:53:45.936 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:45.936 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":44,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:53:25.841417+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:53:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e68065ad0 msgr2=0x7f9e68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e68065ad0 0x7f9e68067f90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f9e70001050 tx=0x7f9e7000a040 comp rx=0 tx=0).stop 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 msgr2=0x7f9e7c1578a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e7c1578a0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00f7e0 tx=0x7f9e6c00fba0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 shutdown_connections 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e68065ad0 0x7f9e68067f90 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e7c0ce390 0x7f9e7c15def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e7c0cdf10 0x7f9e7c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 --2- 172.21.15.45:0/1635289805 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e64004db0 0x7f9e7c1578a0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:45.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.932+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 >> 172.21.15.45:0/1635289805 conn(0x7f9e7c0cb900 msgr2=0x7f9e7c15c360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.936+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 shutdown_connections 2023-12-19T17:53:45.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:45.936+0000 7f9e80bfc700 1 -- 172.21.15.45:0/1635289805 wait complete. 2023-12-19T17:53:45.961 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:53:12.347432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:53:13.452647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:53:23.494126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:53:45.962 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:53:46.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 Processor -- start 2023-12-19T17:53:46.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 -- start start 2023-12-19T17:53:46.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fab980d0a50 0x7fab980cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fab980cfd70 0x7fab980b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980d01e0 con 0x7fab9815d090 2023-12-19T17:53:46.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980b6040 con 0x7fab980cfd70 2023-12-19T17:53:46.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7faba054d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab980d0ed0 con 0x7fab980d0a50 2023-12-19T17:53:46.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7fab9e2e9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fab9815d090 0x7fab980cdff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56300/0 (socket says 172.21.15.45:56300) 2023-12-19T17:53:46.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7fab9e2e9700 1 -- 172.21.15.45:0/242258908 learned_addr learned my addr 172.21.15.45:0/242258908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:46.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7fab9eaea700 1 --2- 172.21.15.45:0/242258908 >> v2:172.21.15.45:3300/0 conn(0x7fab980cfd70 0x7fab980b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7fab9dae8700 1 --2- 172.21.15.45:0/242258908 >> v2:172.21.15.73:3300/0 conn(0x7fab980d0a50 0x7fab980cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748712024 0 0) 0x7fab94001110 con 0x7fab9815d090 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.144+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab840035d0 con 0x7fab9815d090 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1957234029 0 0) 0x7fab840035d0 con 0x7fab9815d090 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 >> v2:172.21.15.73:3300/0 conn(0x7fab980d0a50 msgr2=0x7fab980cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 --2- 172.21.15.45:0/242258908 >> v2:172.21.15.73:3300/0 conn(0x7fab980d0a50 0x7fab980cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 >> v2:172.21.15.45:3300/0 conn(0x7fab980cfd70 msgr2=0x7fab980b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 --2- 172.21.15.45:0/242258908 >> v2:172.21.15.45:3300/0 conn(0x7fab980cfd70 0x7fab980b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980d10e0 con 0x7fab9815d090 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fab94001800 con 0x7fab9815d090 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 >> v1:172.21.15.45:6789/0 conn(0x7fab9815d090 legacy=0x7fab980cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab84003a70 0x7fab84003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84004870 0x7fab84004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab84005230 0x7fab8400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980b6040 con 0x7fab84003a70 2023-12-19T17:53:46.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980d0ed0 con 0x7fab84004870 2023-12-19T17:53:46.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8400c020 con 0x7fab84005230 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab84003a70 0x7fab84003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9dae8700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84004870 0x7fab84004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9eaea700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab84005230 0x7fab8400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 -- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab84005230 msgr2=0x7fab8400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab84005230 0x7fab8400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 -- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84004870 msgr2=0x7fab84004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84004870 0x7fab84004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 -- 172.21.15.45:0/242258908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab840035d0 con 0x7fab84003a70 2023-12-19T17:53:46.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9eaea700 1 -- 172.21.15.45:0/242258908 reap_dead start 2023-12-19T17:53:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.148+0000 7fab9e2e9700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab84003a70 0x7fab84003e90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c240 tx=0x7fab840058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=506e47392e541a93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94007d20 con 0x7fab84003a70 2023-12-19T17:53:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9400cd20 con 0x7fab84003a70 2023-12-19T17:53:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7fab9d2e7700 1 -- 172.21.15.45:0/242258908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94005bc0 con 0x7fab84003a70 2023-12-19T17:53:46.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 -- 172.21.15.45:0/242258908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab84003a70 msgr2=0x7fab84003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab84003a70 0x7fab84003e90 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fab9400c240 tx=0x7fab840058a0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 -- 172.21.15.45:0/242258908 shutdown_connections 2023-12-19T17:53:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 --2- 172.21.15.45:0/242258908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab84003a70 0x7fab84003e90 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 -- 172.21.15.45:0/242258908 >> 172.21.15.45:0/242258908 conn(0x7fab980b4b90 msgr2=0x7fab980b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 -- 172.21.15.45:0/242258908 shutdown_connections 2023-12-19T17:53:46.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.152+0000 7faba054d700 1 -- 172.21.15.45:0/242258908 wait complete. 2023-12-19T17:53:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 Processor -- start 2023-12-19T17:53:46.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 -- start start 2023-12-19T17:53:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84003a70 0x7fab98150f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab981f24d0 0x7fab98160190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 0x7fab981f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab981f64b0 con 0x7fab981f5ac0 2023-12-19T17:53:46.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980c79e0 con 0x7fab84003a70 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7faba054d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab981f2d00 con 0x7fab981f24d0 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 0x7fab981f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9e2e9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84003a70 0x7fab98150f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 0x7fab981f5f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45994/0 (socket says 172.21.15.45:45994) 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 -- 172.21.15.45:0/2336707861 learned_addr learned my addr 172.21.15.45:0/2336707861 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9dae8700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab981f24d0 0x7fab98160190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 -- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab981f24d0 msgr2=0x7fab98160190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab981f24d0 0x7fab98160190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 -- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84003a70 msgr2=0x7fab98150f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84003a70 0x7fab98150f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.156+0000 7fab9eaea700 1 -- 172.21.15.45:0/2336707861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab981f2fe0 con 0x7fab981f5ac0 2023-12-19T17:53:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7fab9eaea700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 0x7fab981f5f70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fab980b8ff0 tx=0x7fab90011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000e040 con 0x7fab981f5ac0 2023-12-19T17:53:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9000f040 con 0x7fab981f5ac0 2023-12-19T17:53:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab981f32c0 con 0x7fab981f5ac0 2023-12-19T17:53:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9000fbe0 con 0x7fab981f5ac0 2023-12-19T17:53:46.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab981606d0 con 0x7fab981f5ac0 2023-12-19T17:53:46.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab980c7e30 con 0x7fab981f5ac0 2023-12-19T17:53:46.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.160+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fab9000fd40 con 0x7fab981f5ac0 2023-12-19T17:53:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.164+0000 7fab8effd700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fab7c065ad0 0x7fab7c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.164+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fab900838f0 con 0x7fab981f5ac0 2023-12-19T17:53:46.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.164+0000 7fab9e2e9700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fab7c065ad0 0x7fab7c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.164+0000 7fab9e2e9700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fab7c065ad0 0x7fab7c067f90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab94008fd0 tx=0x7fab9400a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.172+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fab980c7e30 con 0x7fab981f5ac0 2023-12-19T17:53:46.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.352+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fab980c7e30 con 0x7fab981f5ac0 2023-12-19T17:53:46.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.352+0000 7fab8effd700 1 -- 172.21.15.45:0/2336707861 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7fab980c7e30 con 0x7fab981f5ac0 2023-12-19T17:53:46.357 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fab7c065ad0 msgr2=0x7fab7c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fab7c065ad0 0x7fab7c067f90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fab94008fd0 tx=0x7fab9400a000 comp rx=0 tx=0).stop 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 msgr2=0x7fab981f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 0x7fab981f5f70 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fab980b8ff0 tx=0x7fab90011ed0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 shutdown_connections 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fab7c065ad0 0x7fab7c067f90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fab981f5ac0 0x7fab981f5f70 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fab981f24d0 0x7fab98160190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 --2- 172.21.15.45:0/2336707861 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab84003a70 0x7fab98150f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 >> 172.21.15.45:0/2336707861 conn(0x7fab980b4b90 msgr2=0x7fab980d1cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:46.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 shutdown_connections 2023-12-19T17:53:46.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.356+0000 7faba054d700 1 -- 172.21.15.45:0/2336707861 wait complete. 2023-12-19T17:53:46.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:53:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.568+0000 7fdee86ee700 1 Processor -- start 2023-12-19T17:53:46.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.568+0000 7fdee86ee700 1 -- start start 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee86ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee006b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee86ee700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdee015a8b0 0x7fdee015ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee86ee700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee006b940 con 0x7fdee00ce8a0 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee86ee700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee00cfe30 con 0x7fdee015a8b0 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee86ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee00d0050 con 0x7fdee006b020 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5c89700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdee00ce8a0 0x7fdee00cf720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56310/0 (socket says 172.21.15.45:56310) 2023-12-19T17:53:46.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5c89700 1 -- 172.21.15.45:0/3406544184 learned_addr learned my addr 172.21.15.45:0/3406544184 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee6c8b700 1 --2- 172.21.15.45:0/3406544184 >> v2:172.21.15.45:3300/0 conn(0x7fdee015a8b0 0x7fdee015ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee648a700 1 --2- 172.21.15.45:0/3406544184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5488700 1 -- 172.21.15.45:0/3406544184 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008936497 0 0) 0x7fdee006b940 con 0x7fdee00ce8a0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5488700 1 -- 172.21.15.45:0/3406544184 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0035d0 con 0x7fdee00ce8a0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee6c8b700 1 -- 172.21.15.45:0/3406544184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 msgr2=0x7fdee006b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee6c8b700 1 --2- 172.21.15.45:0/3406544184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee006b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee6c8b700 1 -- 172.21.15.45:0/3406544184 >> v1:172.21.15.45:6789/0 conn(0x7fdee00ce8a0 legacy=0x7fdee00cf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee6c8b700 1 -- 172.21.15.45:0/3406544184 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee00d0330 con 0x7fdee015a8b0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee6c8b700 1 --2- 172.21.15.45:0/3406544184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee015ad60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fded8009d90 tx=0x7fded800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ca3d7291ea15f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5488700 1 -- 172.21.15.45:0/3406544184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded800e070 con 0x7fdee015a8b0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5488700 1 -- 172.21.15.45:0/3406544184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded800bb20 con 0x7fdee015a8b0 2023-12-19T17:53:46.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.572+0000 7fdee5488700 1 -- 172.21.15.45:0/3406544184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8012430 con 0x7fdee015a8b0 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 -- 172.21.15.45:0/3406544184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 msgr2=0x7fdee015ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 --2- 172.21.15.45:0/3406544184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee015ad60 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fded8009d90 tx=0x7fded800b330 comp rx=0 tx=0).stop 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 -- 172.21.15.45:0/3406544184 shutdown_connections 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 --2- 172.21.15.45:0/3406544184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee015ad60 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 --2- 172.21.15.45:0/3406544184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee006b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 -- 172.21.15.45:0/3406544184 >> 172.21.15.45:0/3406544184 conn(0x7fdee00cd6e0 msgr2=0x7fdee00cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 -- 172.21.15.45:0/3406544184 shutdown_connections 2023-12-19T17:53:46.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 -- 172.21.15.45:0/3406544184 wait complete. 2023-12-19T17:53:46.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 Processor -- start 2023-12-19T17:53:46.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.576+0000 7fdee86ee700 1 -- start start 2023-12-19T17:53:46.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee00c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee00ce8a0 0x7fdee015d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee0158300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee015dc90 con 0x7fdee015a8b0 2023-12-19T17:53:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee01f3e40 con 0x7fdee00ce8a0 2023-12-19T17:53:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee0158840 con 0x7fdee006b020 2023-12-19T17:53:46.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee0158300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee0158300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46004/0 (socket says 172.21.15.45:46004) 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 -- 172.21.15.45:0/931362165 learned_addr learned my addr 172.21.15.45:0/931362165 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee648a700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee00c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee5c89700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee00ce8a0 0x7fdee015d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 -- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 msgr2=0x7fdee00c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee00c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 -- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee00ce8a0 msgr2=0x7fdee015d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee00ce8a0 0x7fdee015d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 -- 172.21.15.45:0/931362165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fded8009a70 con 0x7fdee015a8b0 2023-12-19T17:53:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee6c8b700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee0158300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fded8014040 tx=0x7fded8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded8012430 con 0x7fdee015a8b0 2023-12-19T17:53:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded8020070 con 0x7fdee015a8b0 2023-12-19T17:53:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded80098f0 con 0x7fdee015a8b0 2023-12-19T17:53:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee00c71d0 con 0x7fdee015a8b0 2023-12-19T17:53:46.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.580+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee00c7790 con 0x7fdee015a8b0 2023-12-19T17:53:46.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.584+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee004ed30 con 0x7fdee015a8b0 2023-12-19T17:53:46.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.584+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fded8004040 con 0x7fdee015a8b0 2023-12-19T17:53:46.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.588+0000 7fded6ffd700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdec4065ad0 0x7fdec4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.588+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fded8022070 con 0x7fdee015a8b0 2023-12-19T17:53:46.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.588+0000 7fdee648a700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdec4065ad0 0x7fdec4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.588+0000 7fdee648a700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdec4065ad0 0x7fdec4067f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009a00 tx=0x7fdedc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.592+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fded8052770 con 0x7fdee015a8b0 2023-12-19T17:53:46.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.768+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdee00cf740 con 0x7fdee015a8b0 2023-12-19T17:53:46.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.768+0000 7fded6ffd700 1 -- 172.21.15.45:0/931362165 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v44) v1 ==== 104+0+11 (secure 0 0 0) 0x7fded802c020 con 0x7fdee015a8b0 2023-12-19T17:53:46.773 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdec4065ad0 msgr2=0x7fdec4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdec4065ad0 0x7fdec4067f90 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009a00 tx=0x7fdedc008040 comp rx=0 tx=0).stop 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 msgr2=0x7fdee0158300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee0158300 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fded8014040 tx=0x7fded8004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 shutdown_connections 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdec4065ad0 0x7fdec4067f90 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdee015a8b0 0x7fdee0158300 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdee00ce8a0 0x7fdee015d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 --2- 172.21.15.45:0/931362165 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdee006b020 0x7fdee00c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 >> 172.21.15.45:0/931362165 conn(0x7fdee00cd6e0 msgr2=0x7fdee00cbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 shutdown_connections 2023-12-19T17:53:46.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.772+0000 7fdee86ee700 1 -- 172.21.15.45:0/931362165 wait complete. 2023-12-19T17:53:46.799 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:53:46.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.980+0000 7fc712197700 1 Processor -- start 2023-12-19T17:53:46.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.980+0000 7fc712197700 1 -- start start 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc712197700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc70c0b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc712197700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc70c0d0df0 0x7fc70c0d1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc712197700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc70c06f4a0 con 0x7fc70c0cd940 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc712197700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70c070370 con 0x7fc70c0d0df0 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc712197700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c06f6f0 con 0x7fc70c15ccf0 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc710994700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc70c0cd940 0x7fc70c0cdda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56314/0 (socket says 172.21.15.45:56314) 2023-12-19T17:53:46.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc710994700 1 -- 172.21.15.45:0/1674690743 learned_addr learned my addr 172.21.15.45:0/1674690743 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc711996700 1 --2- 172.21.15.45:0/1674690743 >> v2:172.21.15.45:3300/0 conn(0x7fc70c0d0df0 0x7fc70c0d1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc711195700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc70c0b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838649174 0 0) 0x7fc70c06f4a0 con 0x7fc70c0cd940 2023-12-19T17:53:46.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc6f80035d0 con 0x7fc70c0cd940 2023-12-19T17:53:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561601120 0 0) 0x7fc6f80035d0 con 0x7fc70c0cd940 2023-12-19T17:53:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 msgr2=0x7fc70c0b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc70c0b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 >> v2:172.21.15.45:3300/0 conn(0x7fc70c0d0df0 msgr2=0x7fc70c0d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 --2- 172.21.15.45:0/1674690743 >> v2:172.21.15.45:3300/0 conn(0x7fc70c0d0df0 0x7fc70c0d1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c06f9d0 con 0x7fc70c0cd940 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fc6fc001670 con 0x7fc70c0cd940 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 >> v1:172.21.15.45:6789/0 conn(0x7fc70c0cd940 legacy=0x7fc70c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6f8003a20 0x7fc6f8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.984+0000 7fc711996700 1 --2- 172.21.15.45:0/1674690743 >> v2:172.21.15.45:3300/0 conn(0x7fc70c0d0df0 0x7fc70c0d1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc6f8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f8004db0 0x7fc6f8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c070370 con 0x7fc6f8003a20 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c06f6f0 con 0x7fc6f8004db0 2023-12-19T17:53:46.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f800ba30 con 0x7fc70c15ccf0 2023-12-19T17:53:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6f8003a20 0x7fc6f8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711996700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f8004db0 0x7fc6f8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc710994700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc6f8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 -- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 msgr2=0x7fc6f8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc6f8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 -- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f8004db0 msgr2=0x7fc6f8005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6f8004db0 0x7fc6f8005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 -- 172.21.15.45:0/1674690743 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80035d0 con 0x7fc6f8003a20 2023-12-19T17:53:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc710994700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc70c15ccf0 0x7fc6f8004870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:53:46.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711195700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6f8003a20 0x7fc6f8003e40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc708009b70 tx=0x7fc6f80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72e2493880e2d1eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800e6c0 con 0x7fc6f8003a20 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70800e820 con 0x7fc6f8003a20 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc703fff700 1 -- 172.21.15.45:0/1674690743 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70800eb90 con 0x7fc6f8003a20 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc712197700 1 -- 172.21.15.45:0/1674690743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6f8003a20 msgr2=0x7fc6f8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc712197700 1 --2- 172.21.15.45:0/1674690743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc6f8003a20 0x7fc6f8003e40 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fc708009b70 tx=0x7fc6f80058a0 comp rx=0 tx=0).stop 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc711996700 1 -- 172.21.15.45:0/1674690743 reap_dead start 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc712197700 1 -- 172.21.15.45:0/1674690743 shutdown_connections 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc712197700 1 -- 172.21.15.45:0/1674690743 >> 172.21.15.45:0/1674690743 conn(0x7fc70c0b46f0 msgr2=0x7fc70c0b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc712197700 1 -- 172.21.15.45:0/1674690743 shutdown_connections 2023-12-19T17:53:46.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.988+0000 7fc712197700 1 -- 172.21.15.45:0/1674690743 wait complete. 2023-12-19T17:53:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.992+0000 7fc712197700 1 Processor -- start 2023-12-19T17:53:46.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.992+0000 7fc712197700 1 -- start start 2023-12-19T17:53:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6f8003a20 0x7fc70c155b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 0x7fc70c1f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc70c1f5f50 0x7fc70c1f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c1f63d0 con 0x7fc70c1560a0 2023-12-19T17:53:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0cb7d0 con 0x7fc70c1f5f50 2023-12-19T17:53:47.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70c0cbab0 con 0x7fc6f8003a20 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 0x7fc70c1f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 0x7fc70c1f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46038/0 (socket says 172.21.15.45:46038) 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 -- 172.21.15.45:0/1949749065 learned_addr learned my addr 172.21.15.45:0/1949749065 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc711195700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6f8003a20 0x7fc70c155b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc711996700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc70c1f5f50 0x7fc70c1f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 -- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6f8003a20 msgr2=0x7fc70c155b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6f8003a20 0x7fc70c155b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 -- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc70c1f5f50 msgr2=0x7fc70c1f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc70c1f5f50 0x7fc70c1f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 -- 172.21.15.45:0/1949749065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70c0cbd90 con 0x7fc70c1560a0 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc711996700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc70c1f5f50 0x7fc70c1f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:47.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc710994700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 0x7fc70c1f5a10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00db10 tx=0x7fc6fc00de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc004ca0 con 0x7fc70c1560a0 2023-12-19T17:53:47.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc004e00 con 0x7fc70c1560a0 2023-12-19T17:53:47.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70c0cc070 con 0x7fc70c1560a0 2023-12-19T17:53:47.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:46.996+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc0072d0 con 0x7fc70c1560a0 2023-12-19T17:53:47.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.000+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70c1f6700 con 0x7fc70c1560a0 2023-12-19T17:53:47.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.000+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70c04ed30 con 0x7fc70c1560a0 2023-12-19T17:53:47.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.000+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc6fc007430 con 0x7fc70c1560a0 2023-12-19T17:53:47.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.004+0000 7fc701ffb700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc6f0065b00 0x7fc6f0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.004+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fc6fc082dd0 con 0x7fc70c1560a0 2023-12-19T17:53:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.004+0000 7fc711195700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc6f0065b00 0x7fc6f0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.004+0000 7fc711195700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc6f0065b00 0x7fc6f0067fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc7080090b0 tx=0x7fc70801e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.008+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc6fc050400 con 0x7fc70c1560a0 2023-12-19T17:53:47.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.188+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc70c153920 con 0x7fc70c1560a0 2023-12-19T17:53:47.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.188+0000 7fc701ffb700 1 -- 172.21.15.45:0/1949749065 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v44) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc6fc019020 con 0x7fc70c1560a0 2023-12-19T17:53:47.194 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:53:47.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc6f0065b00 msgr2=0x7fc6f0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc6f0065b00 0x7fc6f0067fc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc7080090b0 tx=0x7fc70801e040 comp rx=0 tx=0).stop 2023-12-19T17:53:47.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 msgr2=0x7fc70c1f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 0x7fc70c1f5a10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00db10 tx=0x7fc6fc00de20 comp rx=0 tx=0).stop 2023-12-19T17:53:47.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 shutdown_connections 2023-12-19T17:53:47.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc6f0065b00 0x7fc6f0067fc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc70c1f5f50 0x7fc70c1f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc70c1560a0 0x7fc70c1f5a10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 --2- 172.21.15.45:0/1949749065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc6f8003a20 0x7fc70c155b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 >> 172.21.15.45:0/1949749065 conn(0x7fc70c0b46f0 msgr2=0x7fc70c15d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:47.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 shutdown_connections 2023-12-19T17:53:47.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.192+0000 7fc712197700 1 -- 172.21.15.45:0/1949749065 wait complete. 2023-12-19T17:53:47.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:53:47.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.404+0000 7fbf81716700 1 Processor -- start 2023-12-19T17:53:47.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.404+0000 7fbf81716700 1 -- start start 2023-12-19T17:53:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.404+0000 7fbf81716700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.404+0000 7fbf81716700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c15d300 con 0x7fbf7c0b8580 2023-12-19T17:53:47.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.404+0000 7fbf81716700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf7c0d1550 con 0x7fbf7c15cf20 2023-12-19T17:53:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.404+0000 7fbf81716700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c0d1360 con 0x7fbf7c0cdfd0 2023-12-19T17:53:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbf7c0b8580 0x7fbf7c0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56328/0 (socket says 172.21.15.45:56328) 2023-12-19T17:53:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7b7fe700 1 -- 172.21.15.45:0/3691150313 learned_addr learned my addr 172.21.15.45:0/3691150313 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:47.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf80f15700 1 --2- 172.21.15.45:0/3691150313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7affd700 1 -- 172.21.15.45:0/3691150313 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2604789340 0 0) 0x7fbf7c15d300 con 0x7fbf7c0b8580 2023-12-19T17:53:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7affd700 1 -- 172.21.15.45:0/3691150313 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf640035d0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7affd700 1 -- 172.21.15.45:0/3691150313 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 560515136 0 0) 0x7fbf7c0d1550 con 0x7fbf7c15cf20 2023-12-19T17:53:47.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf80f15700 1 -- 172.21.15.45:0/3691150313 >> v1:172.21.15.73:6789/0 conn(0x7fbf7c15cf20 legacy=0x7fbf7c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf80f15700 1 -- 172.21.15.45:0/3691150313 >> v1:172.21.15.45:6789/0 conn(0x7fbf7c0b8580 legacy=0x7fbf7c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf80f15700 1 -- 172.21.15.45:0/3691150313 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf7c0d1830 con 0x7fbf7c0cdfd0 2023-12-19T17:53:47.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf80f15700 1 --2- 172.21.15.45:0/3691150313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c167a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009dc0 tx=0x7fbf7400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52094d96f9660d65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7affd700 1 -- 172.21.15.45:0/3691150313 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400e070 con 0x7fbf7c0cdfd0 2023-12-19T17:53:47.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7affd700 1 -- 172.21.15.45:0/3691150313 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf7400bb20 con 0x7fbf7c0cdfd0 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf7affd700 1 -- 172.21.15.45:0/3691150313 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf7400bed0 con 0x7fbf7c0cdfd0 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf81716700 1 -- 172.21.15.45:0/3691150313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 msgr2=0x7fbf7c167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf81716700 1 --2- 172.21.15.45:0/3691150313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c167a30 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbf74009dc0 tx=0x7fbf7400b330 comp rx=0 tx=0).stop 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf81716700 1 -- 172.21.15.45:0/3691150313 shutdown_connections 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf81716700 1 --2- 172.21.15.45:0/3691150313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c167a30 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.408+0000 7fbf81716700 1 -- 172.21.15.45:0/3691150313 >> 172.21.15.45:0/3691150313 conn(0x7fbf7c0b4670 msgr2=0x7fbf7c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.412+0000 7fbf81716700 1 -- 172.21.15.45:0/3691150313 shutdown_connections 2023-12-19T17:53:47.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.412+0000 7fbf81716700 1 -- 172.21.15.45:0/3691150313 wait complete. 2023-12-19T17:53:47.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.412+0000 7fbf81716700 1 Processor -- start 2023-12-19T17:53:47.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.412+0000 7fbf81716700 1 -- start start 2023-12-19T17:53:47.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 0x7fbf7c151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c14e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf7c15cf20 0x7fbf7c06efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c06b370 con 0x7fbf7c0b8580 2023-12-19T17:53:47.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1f7330 con 0x7fbf7c15cf20 2023-12-19T17:53:47.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7c1f7610 con 0x7fbf7c0cdfd0 2023-12-19T17:53:47.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 0x7fbf7c151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 0x7fbf7c151c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46054/0 (socket says 172.21.15.45:46054) 2023-12-19T17:53:47.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 -- 172.21.15.45:0/332524035 learned_addr learned my addr 172.21.15.45:0/332524035 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf80f15700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf7c15cf20 0x7fbf7c06efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7b7fe700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c14e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 -- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 msgr2=0x7fbf7c14e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c14e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 -- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf7c15cf20 msgr2=0x7fbf7c06efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf7c15cf20 0x7fbf7c06efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 -- 172.21.15.45:0/332524035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf74009a70 con 0x7fbf7c0b8580 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf7bfff700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 0x7fbf7c151c10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00c520 tx=0x7fbf6c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c0054e0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf6c0036a0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf6c003a50 con 0x7fbf7c0b8580 2023-12-19T17:53:47.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf7c151130 con 0x7fbf7c0b8580 2023-12-19T17:53:47.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.416+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf7c1516f0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.420+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf7c04ed30 con 0x7fbf7c0b8580 2023-12-19T17:53:47.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.420+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbf6c003bb0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.424+0000 7fbf78ff9700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbf68065ad0 0x7fbf68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.424+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fbf6c082970 con 0x7fbf7c0b8580 2023-12-19T17:53:47.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.424+0000 7fbf7b7fe700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbf68065ad0 0x7fbf68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.424+0000 7fbf7b7fe700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbf68065ad0 0x7fbf68067f90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c1556d0 tx=0x7fbf70009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.428+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbf6c04ffa0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.608+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7fbf7c070020 con 0x7fbf7c0b8580 2023-12-19T17:53:47.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.608+0000 7fbf78ff9700 1 -- 172.21.15.45:0/332524035 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v44) v1 ==== 106+0+11 (secure 0 0 0) 0x7fbf6c0170b0 con 0x7fbf7c0b8580 2023-12-19T17:53:47.612 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbf68065ad0 msgr2=0x7fbf68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbf68065ad0 0x7fbf68067f90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf7c1556d0 tx=0x7fbf70009040 comp rx=0 tx=0).stop 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 msgr2=0x7fbf7c151c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 0x7fbf7c151c10 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbf6c00c520 tx=0x7fbf6c00c830 comp rx=0 tx=0).stop 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 shutdown_connections 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbf68065ad0 0x7fbf68067f90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbf7c15cf20 0x7fbf7c06efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbf7c0cdfd0 0x7fbf7c14e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 --2- 172.21.15.45:0/332524035 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbf7c0b8580 0x7fbf7c151c10 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 >> 172.21.15.45:0/332524035 conn(0x7fbf7c0b4670 msgr2=0x7fbf7c0cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:47.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 shutdown_connections 2023-12-19T17:53:47.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.612+0000 7fbf81716700 1 -- 172.21.15.45:0/332524035 wait complete. 2023-12-19T17:53:47.638 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:53:47.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe431990700 1 Processor -- start 2023-12-19T17:53:47.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe431990700 1 -- start start 2023-12-19T17:53:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe431990700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe42c15e260 0x7fe42c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe431990700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c0ae1e0 con 0x7fe42c15ab50 2023-12-19T17:53:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe431990700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe42c15af30 con 0x7fe42c06efd0 2023-12-19T17:53:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe431990700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe42c0cd010 con 0x7fe42c15e260 2023-12-19T17:53:47.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe4227fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe42c15e260 0x7fe42c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe42affd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe42c15ab50 0x7fe42c0adad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56338/0 (socket says 172.21.15.45:56338) 2023-12-19T17:53:47.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.816+0000 7fe42affd700 1 -- 172.21.15.45:0/1977724785 learned_addr learned my addr 172.21.15.45:0/1977724785 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe4227fc700 1 -- 172.21.15.45:0/1977724785 >> v1:172.21.15.73:6789/0 conn(0x7fe42c06efd0 legacy=0x7fe42c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe4227fc700 1 -- 172.21.15.45:0/1977724785 >> v1:172.21.15.45:6789/0 conn(0x7fe42c15ab50 legacy=0x7fe42c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe4227fc700 1 -- 172.21.15.45:0/1977724785 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe42c0cd2f0 con 0x7fe42c15e260 2023-12-19T17:53:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe4227fc700 1 --2- 172.21.15.45:0/1977724785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c15e260 0x7fe42c06ea90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe414009850 tx=0x7fe414009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e507b3d12548970 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe42a7fc700 1 -- 172.21.15.45:0/1977724785 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414011830 con 0x7fe42c15e260 2023-12-19T17:53:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe42a7fc700 1 -- 172.21.15.45:0/1977724785 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe414011990 con 0x7fe42c15e260 2023-12-19T17:53:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe42a7fc700 1 -- 172.21.15.45:0/1977724785 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe414011d20 con 0x7fe42c15e260 2023-12-19T17:53:47.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 -- 172.21.15.45:0/1977724785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c15e260 msgr2=0x7fe42c06ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 --2- 172.21.15.45:0/1977724785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c15e260 0x7fe42c06ea90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fe414009850 tx=0x7fe414009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 -- 172.21.15.45:0/1977724785 shutdown_connections 2023-12-19T17:53:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 --2- 172.21.15.45:0/1977724785 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c15e260 0x7fe42c06ea90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 -- 172.21.15.45:0/1977724785 >> 172.21.15.45:0/1977724785 conn(0x7fe42c0cba40 msgr2=0x7fe42c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 -- 172.21.15.45:0/1977724785 shutdown_connections 2023-12-19T17:53:47.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.820+0000 7fe431990700 1 -- 172.21.15.45:0/1977724785 wait complete. 2023-12-19T17:53:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 Processor -- start 2023-12-19T17:53:47.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 -- start start 2023-12-19T17:53:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 0x7fe42c151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe42c15ab50 0x7fe42c140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe42c15e260 0x7fe42c140770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c0ab8a0 con 0x7fe42c06efd0 2023-12-19T17:53:47.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c13df10 con 0x7fe42c15e260 2023-12-19T17:53:47.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe431990700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c151b20 con 0x7fe42c15ab50 2023-12-19T17:53:47.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.824+0000 7fe42affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 0x7fe42c151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 0x7fe42c151050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46078/0 (socket says 172.21.15.45:46078) 2023-12-19T17:53:47.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 -- 172.21.15.45:0/1727765079 learned_addr learned my addr 172.21.15.45:0/1727765079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe4227fc700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe42c15ab50 0x7fe42c140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42b7fe700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe42c15e260 0x7fe42c140770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 -- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe42c15ab50 msgr2=0x7fe42c140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe42c15ab50 0x7fe42c140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 -- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe42c15e260 msgr2=0x7fe42c140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe42c15e260 0x7fe42c140770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:47.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 -- 172.21.15.45:0/1727765079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4140094b0 con 0x7fe42c06efd0 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe4227fc700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe42c15ab50 0x7fe42c140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe42affd700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 0x7fe42c151050 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c460 tx=0x7fe41c00c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c005d90 con 0x7fe42c06efd0 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41c0070d0 con 0x7fe42c06efd0 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c0af330 con 0x7fe42c06efd0 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c007460 con 0x7fe42c06efd0 2023-12-19T17:53:47.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c0af8f0 con 0x7fe42c06efd0 2023-12-19T17:53:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.828+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c0aba10 con 0x7fe42c06efd0 2023-12-19T17:53:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.832+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe41c0075c0 con 0x7fe42c06efd0 2023-12-19T17:53:47.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.832+0000 7fe428ff9700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe40c065ad0 0x7fe40c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:47.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.832+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fe41c082860 con 0x7fe42c06efd0 2023-12-19T17:53:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.836+0000 7fe4227fc700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe40c065ad0 0x7fe40c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.836+0000 7fe4227fc700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe40c065ad0 0x7fe40c067f90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe414009fd0 tx=0x7fe414008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:47.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:47.840+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe42c0aba10 con 0x7fe42c06efd0 2023-12-19T17:53:48.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.036+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe42c0ae1e0 con 0x7fe42c06efd0 2023-12-19T17:53:48.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.040+0000 7fe428ff9700 1 -- 172.21.15.45:0/1727765079 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v44) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe42c0ae1e0 con 0x7fe42c06efd0 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.040+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe40c065ad0 msgr2=0x7fe40c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.040+0000 7fe431990700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe40c065ad0 0x7fe40c067f90 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe414009fd0 tx=0x7fe414008030 comp rx=0 tx=0).stop 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.040+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 msgr2=0x7fe42c151050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.040+0000 7fe431990700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 0x7fe42c151050 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00c460 tx=0x7fe41c00c820 comp rx=0 tx=0).stop 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 shutdown_connections 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe40c065ad0 0x7fe40c067f90 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:48.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe42c15e260 0x7fe42c140770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe42c15ab50 0x7fe42c140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 --2- 172.21.15.45:0/1727765079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe42c06efd0 0x7fe42c151050 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 >> 172.21.15.45:0/1727765079 conn(0x7fe42c0cba40 msgr2=0x7fe42c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 shutdown_connections 2023-12-19T17:53:48.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:48.044+0000 7fe431990700 1 -- 172.21.15.45:0/1727765079 wait complete. 2023-12-19T17:53:48.050 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:53:48.073 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:53:48.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:48.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T17:53:48.108 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[46321]: fuse finished with error 0 and tester_r 0 2023-12-19T17:53:48.120 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:53:54.222 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:53:54.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:53:54.222 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T17:53:54.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 Processor -- start 2023-12-19T17:53:54.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 -- start start 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd381609b0 0x7fbd38160e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd380aeeb0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd3815d2a0 con 0x7fbd381609b0 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.468+0000 7fbd3ca09700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd38161520 con 0x7fbd3815cec0 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd381609b0 0x7fbd38160e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd381609b0 0x7fbd38160e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42858/0 (socket says 172.21.15.45:42858) 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 -- 172.21.15.45:0/1951016319 learned_addr learned my addr 172.21.15.45:0/1951016319 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:54.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd36d9d700 1 --2- 172.21.15.45:0/1951016319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:54.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 -- 172.21.15.45:0/1951016319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 msgr2=0x7fbd380cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:54.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 --2- 172.21.15.45:0/1951016319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 -- 172.21.15.45:0/1951016319 >> v1:172.21.15.73:6789/0 conn(0x7fbd380c9fa0 legacy=0x7fbd38070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 -- 172.21.15.45:0/1951016319 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd38070180 con 0x7fbd381609b0 2023-12-19T17:53:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3659c700 1 --2- 172.21.15.45:0/1951016319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd381609b0 0x7fbd38160e10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009910 tx=0x7fbd2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5b5bbb9e5c84b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd35d9b700 1 -- 172.21.15.45:0/1951016319 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c011830 con 0x7fbd381609b0 2023-12-19T17:53:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd35d9b700 1 -- 172.21.15.45:0/1951016319 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd2c011990 con 0x7fbd381609b0 2023-12-19T17:53:54.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd35d9b700 1 -- 172.21.15.45:0/1951016319 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd2c011d40 con 0x7fbd381609b0 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 -- 172.21.15.45:0/1951016319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd381609b0 msgr2=0x7fbd38160e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/1951016319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd381609b0 0x7fbd38160e10 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009910 tx=0x7fbd2c009c20 comp rx=0 tx=0).stop 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 -- 172.21.15.45:0/1951016319 shutdown_connections 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/1951016319 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd381609b0 0x7fbd38160e10 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/1951016319 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 -- 172.21.15.45:0/1951016319 >> 172.21.15.45:0/1951016319 conn(0x7fbd380cf950 msgr2=0x7fbd380cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 -- 172.21.15.45:0/1951016319 shutdown_connections 2023-12-19T17:53:54.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.472+0000 7fbd3ca09700 1 -- 172.21.15.45:0/1951016319 wait complete. 2023-12-19T17:53:54.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 Processor -- start 2023-12-19T17:53:54.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 -- start start 2023-12-19T17:53:54.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 0x7fbd3806a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:54.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:54.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd381609b0 0x7fbd380c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:54.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380c9a50 con 0x7fbd380c9fa0 2023-12-19T17:53:54.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd381f3720 con 0x7fbd381609b0 2023-12-19T17:53:54.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.476+0000 7fbd3ca09700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd380acb40 con 0x7fbd3815cec0 2023-12-19T17:53:54.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 0x7fbd3806a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 0x7fbd3806a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42868/0 (socket says 172.21.15.45:42868) 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:59036/0 (socket says 172.21.15.45:59036) 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3659c700 1 -- 172.21.15.45:0/4211104107 learned_addr learned my addr 172.21.15.45:0/4211104107 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3759e700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd381609b0 0x7fbd380c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 -- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 msgr2=0x7fbd380c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 -- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd381609b0 msgr2=0x7fbd380c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd381609b0 0x7fbd380c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 -- 172.21.15.45:0/4211104107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c009570 con 0x7fbd380c9fa0 2023-12-19T17:53:54.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3659c700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd36d9d700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 0x7fbd3806a280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800e930 tx=0x7fbd2800ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28013680 con 0x7fbd380c9fa0 2023-12-19T17:53:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd280137e0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd380ace20 con 0x7fbd380c9fa0 2023-12-19T17:53:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd28013b50 con 0x7fbd380c9fa0 2023-12-19T17:53:54.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd380ad3e0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.480+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38067760 con 0x7fbd380c9fa0 2023-12-19T17:53:54.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.484+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd28013cb0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.484+0000 7fbd1f7fe700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd24065ad0 0x7fbd24067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:54.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.484+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fbd28083480 con 0x7fbd380c9fa0 2023-12-19T17:53:54.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.484+0000 7fbd3659c700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd24065ad0 0x7fbd24067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:54.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.488+0000 7fbd3659c700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd24065ad0 0x7fbd24067f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd380703e0 tx=0x7fbd2c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:54.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.492+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd28050ab0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.704+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd380b58d0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd1f7fe700 1 -- 172.21.15.45:0/4211104107 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fbd280540d0 con 0x7fbd380c9fa0 2023-12-19T17:53:54.712 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:54.712 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:14.429162+0000","modified":"2023-12-19T17:53:24.837019+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5451":{"gid":5451,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3731258594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3731258594},{"type":"v1","addr":"172.21.15.73:6835","nonce":3731258594}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:54.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd24065ad0 msgr2=0x7fbd24067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:54.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd24065ad0 0x7fbd24067f90 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbd380703e0 tx=0x7fbd2c008030 comp rx=0 tx=0).stop 2023-12-19T17:53:54.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 msgr2=0x7fbd3806a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:54.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 0x7fbd3806a280 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800e930 tx=0x7fbd2800ec40 comp rx=0 tx=0).stop 2023-12-19T17:53:54.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 shutdown_connections 2023-12-19T17:53:54.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd24065ad0 0x7fbd24067f90 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd381609b0 0x7fbd380c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd3815cec0 0x7fbd380c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 --2- 172.21.15.45:0/4211104107 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd380c9fa0 0x7fbd3806a280 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:54.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.708+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 >> 172.21.15.45:0/4211104107 conn(0x7fbd380cf950 msgr2=0x7fbd380cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:54.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.712+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 shutdown_connections 2023-12-19T17:53:54.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:54.712+0000 7fbd3ca09700 1 -- 172.21.15.45:0/4211104107 wait complete. 2023-12-19T17:53:54.718 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 17 2023-12-19T17:53:54.737 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2023-12-19T17:53:54.946 INFO:teuthology.orchestra.run.smithi073.stdout:{"message":"","return_code":0} 2023-12-19T17:53:54.946 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-12-19T17:53:54.946 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T17:53:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.136+0000 7fd1e4aa7700 1 Processor -- start 2023-12-19T17:53:55.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.136+0000 7fd1e4aa7700 1 -- start start 2023-12-19T17:53:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1e4aa7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1e4aa7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1e006cad0 0x7fd1e00c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1e4aa7700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e006f0a0 con 0x7fd1e00af720 2023-12-19T17:53:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1e4aa7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e006ea90 con 0x7fd1e006cad0 2023-12-19T17:53:55.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1e4aa7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00c3f60 con 0x7fd1e015ae20 2023-12-19T17:53:55.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1ded9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd1e00af720 0x7fd1e015e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33484/0 (socket says 172.21.15.45:33484) 2023-12-19T17:53:55.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1ded9d700 1 -- 172.21.15.45:0/358490777 learned_addr learned my addr 172.21.15.45:0/358490777 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:55.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/358490777 >> v2:172.21.15.73:3300/0 conn(0x7fd1e006cad0 0x7fd1e00c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1de59c700 1 --2- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1d7fff700 1 -- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 msgr2=0x7fd1e015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:55.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1d7fff700 1 -- 172.21.15.45:0/358490777 >> v1:172.21.15.45:6789/0 conn(0x7fd1e00af720 legacy=0x7fd1e015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1ddd9b700 1 -- 172.21.15.45:0/358490777 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 806330489 0 0) 0x7fd1e006f0a0 con 0x7fd1e00af720 2023-12-19T17:53:55.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.140+0000 7fd1d7fff700 1 -- 172.21.15.45:0/358490777 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e00c4240 con 0x7fd1e006cad0 2023-12-19T17:53:55.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c3710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009850 tx=0x7fd1c8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3734a545e5cb5429 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1ddd9b700 1 -- 172.21.15.45:0/358490777 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8011830 con 0x7fd1e006cad0 2023-12-19T17:53:55.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1ddd9b700 1 -- 172.21.15.45:0/358490777 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c8011990 con 0x7fd1e006cad0 2023-12-19T17:53:55.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1ddd9b700 1 -- 172.21.15.45:0/358490777 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c8011d40 con 0x7fd1e006cad0 2023-12-19T17:53:55.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e006cad0 msgr2=0x7fd1e00c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c3710 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd1c8009850 tx=0x7fd1c8009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:55.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/358490777 shutdown_connections 2023-12-19T17:53:55.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c3710 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/358490777 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/358490777 >> 172.21.15.45:0/358490777 conn(0x7fd1e00cb900 msgr2=0x7fd1e00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:55.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/358490777 shutdown_connections 2023-12-19T17:53:55.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.144+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/358490777 wait complete. 2023-12-19T17:53:55.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 Processor -- start 2023-12-19T17:53:55.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 -- start start 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e00af720 0x7fd1e00b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e00b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e014bea0 con 0x7fd1e006cad0 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00ca9a0 con 0x7fd1e00af720 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1e4aa7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00c5dd0 con 0x7fd1e015ae20 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42882/0 (socket says 172.21.15.45:42882) 2023-12-19T17:53:55.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 -- 172.21.15.45:0/788695113 learned_addr learned my addr 172.21.15.45:0/788695113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1ded9d700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e00b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e00af720 0x7fd1e00b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 -- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 msgr2=0x7fd1e00b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e00b3270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 -- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e00af720 msgr2=0x7fd1e00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e00af720 0x7fd1e00b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 -- 172.21.15.45:0/788695113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80094b0 con 0x7fd1e006cad0 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e00af720 0x7fd1e00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:55.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1de59c700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c5890 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000e840 tx=0x7fd1d000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.148+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00095a0 con 0x7fd1e006cad0 2023-12-19T17:53:55.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.152+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0013680 con 0x7fd1e006cad0 2023-12-19T17:53:55.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.152+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00c9d90 con 0x7fd1e006cad0 2023-12-19T17:53:55.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.152+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00139f0 con 0x7fd1e006cad0 2023-12-19T17:53:55.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.152+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e00ca350 con 0x7fd1e006cad0 2023-12-19T17:53:55.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.152+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0067760 con 0x7fd1e006cad0 2023-12-19T17:53:55.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.152+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1d0013b50 con 0x7fd1e006cad0 2023-12-19T17:53:55.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.156+0000 7fd1d6ffd700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1c0065ad0 0x7fd1c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.156+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6462+0+0 (secure 0 0 0) 0x7fd1d00833b0 con 0x7fd1e006cad0 2023-12-19T17:53:55.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.156+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1c0065ad0 0x7fd1c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.156+0000 7fd1d7fff700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1c0065ad0 0x7fd1c0067f90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd1e006cf10 tx=0x7fd1c8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.164+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd1d00509e0 con 0x7fd1e006cad0 2023-12-19T17:53:55.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.376+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd1e00c5f40 con 0x7fd1e006cad0 2023-12-19T17:53:55.382 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:53:55.376+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:53:55.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.392+0000 7fd1d6ffd700 1 -- 172.21.15.45:0/788695113 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd1d0054000 con 0x7fd1e006cad0 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1c0065ad0 msgr2=0x7fd1c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1c0065ad0 0x7fd1c0067f90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd1e006cf10 tx=0x7fd1c8008030 comp rx=0 tx=0).stop 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 msgr2=0x7fd1e00c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c5890 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000e840 tx=0x7fd1d000eb50 comp rx=0 tx=0).stop 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 shutdown_connections 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1c0065ad0 0x7fd1c0067f90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1e015ae20 0x7fd1e00b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1e00af720 0x7fd1e00b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 --2- 172.21.15.45:0/788695113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1e006cad0 0x7fd1e00c5890 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.396+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 >> 172.21.15.45:0/788695113 conn(0x7fd1e00cb900 msgr2=0x7fd1e0155680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.400+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 shutdown_connections 2023-12-19T17:53:55.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.400+0000 7fd1e4aa7700 1 -- 172.21.15.45:0/788695113 wait complete. 2023-12-19T17:53:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T17:53:55.410 INFO:tasks.ceph.mds.d.smithi073.stderr: -7052> 2023-12-19T17:53:16.907+0000 7fc92a92f700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:53:55.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:53:55.431 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:53:55.469 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:53:55.494 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T17:53:55.494 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T17:53:55.494 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:53:55.494 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T17:53:55.494 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.495 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T17:53:55.496 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T17:53:55.497 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T17:53:55.498 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T17:53:55.499 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:53:55.500 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T17:53:55.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:53:55.502 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.503 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = True 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T17:53:55.504 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:53:55.505 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.505 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.506 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.507 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T17:53:55.508 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T17:53:55.509 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T17:53:55.510 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T17:53:55.511 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T17:53:55.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:53:55.513 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T17:53:55.514 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T17:53:55.515 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = True 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.516 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:53:55.537 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:53:55.604 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T17:53:55.604 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.605 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:53:55.606 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:53:55.607 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T17:53:55.608 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.609 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:53:55.610 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T17:53:55.611 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T17:53:55.612 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.613 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T17:53:55.614 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.615 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.634 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T17:53:55.635 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:53:55.636 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.637 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.638 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T17:53:55.639 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:53:55.640 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.641 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:53:55.642 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T17:53:55.643 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T17:53:55.644 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T17:53:55.645 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:53:55.645 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:53:55.645 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:53:55.653 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T17:53:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 Processor -- start 2023-12-19T17:53:55.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 -- start start 2023-12-19T17:53:55.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470719930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 0x56247066c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56247066ad90 0x562470684950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624705d2ce0 con 0x5624707169c0 2023-12-19T17:53:55.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56247058f250 con 0x56247066ece0 2023-12-19T17:53:55.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4aa6fa140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56247058eef0 con 0x56247066ad90 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 0x56247066c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 0x56247066c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42906/0 (socket says 172.21.15.45:42906) 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/421485794 learned_addr learned my addr 172.21.15.45:0/421485794 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56247066ad90 0x562470684950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a822f700 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470719930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56247066ad90 msgr2=0x562470684950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56247066ad90 0x562470684950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 msgr2=0x562470719930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470719930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/421485794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c005d80 con 0x5624707169c0 2023-12-19T17:53:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 0x56247066c620 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd49c000c00 tx=0x7fd49c00d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d117fea5384171a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.740+0000 7fd4a6a2c700 1 -- 172.21.15.45:0/421485794 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c008940 con 0x5624707169c0 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4a6a2c700 1 -- 172.21.15.45:0/421485794 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c008aa0 con 0x5624707169c0 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4a6a2c700 1 -- 172.21.15.45:0/421485794 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c008e50 con 0x5624707169c0 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/421485794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 msgr2=0x56247066c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 0x56247066c620 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd49c000c00 tx=0x7fd49c00d000 comp rx=0 tx=0).stop 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/421485794 shutdown_connections 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56247066ad90 0x562470684950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5624707169c0 0x56247066c620 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/421485794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470719930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/421485794 >> 172.21.15.45:0/421485794 conn(0x56247066b240 msgr2=0x562470643900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/421485794 shutdown_connections 2023-12-19T17:53:55.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/421485794 wait complete. 2023-12-19T17:53:55.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 Processor -- start 2023-12-19T17:53:55.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- start start 2023-12-19T17:53:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56247066ad90 0x562470715f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470687750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5624707169c0 0x562470718700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562470565240 con 0x56247066ad90 2023-12-19T17:53:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624706632a0 con 0x56247066ece0 2023-12-19T17:53:55.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.744+0000 7fd4aa6fa140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562470663540 con 0x5624707169c0 2023-12-19T17:53:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a7a2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470687750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56247066ad90 0x562470715f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a8a30700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5624707169c0 0x562470718700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a7a2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470687750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:39466/0 (socket says 172.21.15.45:39466) 2023-12-19T17:53:55.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 learned_addr learned my addr 172.21.15.45:0/3430658591 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5624707169c0 msgr2=0x562470718700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5624707169c0 0x562470718700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 msgr2=0x562470687750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56247066ece0 0x562470687750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56247057d470 con 0x56247066ad90 2023-12-19T17:53:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56247066ad90 0x562470715f60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd49800df70 tx=0x7fd49800b1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a5a2a700 1 -- 172.21.15.45:0/3430658591 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800b7d0 con 0x56247066ad90 2023-12-19T17:53:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a5a2a700 1 -- 172.21.15.45:0/3430658591 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd498008040 con 0x56247066ad90 2023-12-19T17:53:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4a5a2a700 1 -- 172.21.15.45:0/3430658591 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49800bb70 con 0x56247066ad90 2023-12-19T17:53:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624705708b0 con 0x56247066ad90 2023-12-19T17:53:55.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.748+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562470570310 con 0x56247066ad90 2023-12-19T17:53:55.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.752+0000 7fd4a5a2a700 1 -- 172.21.15.45:0/3430658591 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd49800bcd0 con 0x56247066ad90 2023-12-19T17:53:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.752+0000 7fd4a5a2a700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd494064400 0x7fd4940668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.752+0000 7fd4a5a2a700 1 -- 172.21.15.45:0/3430658591 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6548+0+0 (secure 0 0 0) 0x7fd498081c80 con 0x56247066ad90 2023-12-19T17:53:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.752+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd494064400 0x7fd4940668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.758 INFO:teuthology.orchestra.run.smithi045.stdout:Warning: using slow linear search 2023-12-19T17:53:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.752+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5624706651d0 0x5624707b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.752+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 5.0 5:00000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x5624706651d0 2023-12-19T17:53:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5624706651d0 0x5624707b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd494064400 0x7fd4940668c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00a5f0 tx=0x7fd49c010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5624706651d0 0x5624707b8df0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7fd4a00118c0 0x7fd4a0001510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:2 5.10 5:08000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a00118c0 2023-12-19T17:53:55.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.756+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7fd4a00118c0 0x7fd4a0001510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7fd4a00118c0 0x7fd4a0001510 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 45 out=177b] v44'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd4980532a0 0x7fd498058bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:3 5.8 5:10000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4980532a0 2023-12-19T17:53:55.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd4980532a0 0x7fd498058bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd4980532a0 0x7fd498058bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(3 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fd49c012030 0x7fd49c012410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.760+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:4 5.18 5:18000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c012030 2023-12-19T17:53:55.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.764+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fd49c012030 0x7fd49c012410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.764+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fd49c012030 0x7fd49c012410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.764+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(4 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c012030 2023-12-19T17:53:55.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.764+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 5.4 5:20000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a00118c0 2023-12-19T17:53:55.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.764+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(5 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.764+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 5.14 5:28000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x5624706651d0 2023-12-19T17:53:55.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(6 [pgnls start_epoch 45 out=149b] v44'35 uv35 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7fd4a0016040 0x7fd4a0019450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:7 5.c 5:30000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016040 2023-12-19T17:53:55.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7fd4a0016040 0x7fd4a0019450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7fd4a0016040 0x7fd4a0019450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(7 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a0016040 2023-12-19T17:53:55.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:8 5.1c 5:38000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c012030 2023-12-19T17:53:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(8 [pgnls start_epoch 45 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c012030 2023-12-19T17:53:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7fd4a0016420 0x7fd4a0016880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.768+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 5.2 5:40000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016420 2023-12-19T17:53:55.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.772+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7fd4a0016420 0x7fd4a0016880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.772+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7fd4a0016420 0x7fd4a0016880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.772+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(9 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4a0016420 2023-12-19T17:53:55.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.772+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:10 5.12 5:48000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016040 2023-12-19T17:53:55.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.772+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(10 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a0016040 2023-12-19T17:53:55.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.772+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:11 5.a 5:50000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4980532a0 2023-12-19T17:53:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(11 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:12 5.1a 5:58000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a00118c0 2023-12-19T17:53:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(12 [pgnls start_epoch 45 out=49b] v38'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:13 5.6 5:60000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4980532a0 2023-12-19T17:53:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(13 [pgnls start_epoch 45 out=77b] v44'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a7a2e700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fd49c02f910 0x7fd49c041400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 5.16 5:68000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c02f910 2023-12-19T17:53:55.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.776+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fd49c02f910 0x7fd49c041400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fd49c02f910 0x7fd49c041400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(14 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 5.e 5:70000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c012030 2023-12-19T17:53:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(15 [pgnls start_epoch 45 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c012030 2023-12-19T17:53:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a8a30700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd4a002b8e0 0x7fd4a00283c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:55.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:16 5.1e 5:78000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a002b8e0 2023-12-19T17:53:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd4a002b8e0 0x7fd4a00283c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:55.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.780+0000 7fd4a822f700 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd4a002b8e0 0x7fd4a00283c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(16 [pgnls start_epoch 45 out=49b] v38'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a002b8e0 2023-12-19T17:53:55.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:17 5.1 5:80000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c012030 2023-12-19T17:53:55.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(17 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c012030 2023-12-19T17:53:55.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 5.11 5:88000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016420 2023-12-19T17:53:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(18 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4a0016420 2023-12-19T17:53:55.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 5.9 5:90000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a00118c0 2023-12-19T17:53:55.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(19 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.784+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:20 5.19 5:98000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016040 2023-12-19T17:53:55.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(20 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a0016040 2023-12-19T17:53:55.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 5.5 5:a0000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a002b8e0 2023-12-19T17:53:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(21 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a002b8e0 2023-12-19T17:53:55.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:22 5.15 5:a8000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c02f910 2023-12-19T17:53:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(22 [pgnls start_epoch 45 out=97b] v38'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:23 5.d 5:b0000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4980532a0 2023-12-19T17:53:55.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(23 [pgnls start_epoch 45 out=74b] v38'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.788+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:24 5.1d 5:b8000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016040 2023-12-19T17:53:55.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(24 [pgnls start_epoch 45 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a0016040 2023-12-19T17:53:55.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 5.3 5:c0000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a002b8e0 2023-12-19T17:53:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(25 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a002b8e0 2023-12-19T17:53:55.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 5.13 5:c8000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x5624706651d0 2023-12-19T17:53:55.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(26 [pgnls start_epoch 45 out=98b] v44'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:27 5.b 5:d0000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4980532a0 2023-12-19T17:53:55.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(27 [pgnls start_epoch 45 out=76b] v44'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.792+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:28 5.1b 5:d8000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c02f910 2023-12-19T17:53:55.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.796+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(28 [pgnls start_epoch 45 out=49b] v38'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.796+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 5.7 5:e0000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c02f910 2023-12-19T17:53:55.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.796+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(29 [pgnls start_epoch 45 out=73b] v38'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.796+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:30 5.17 5:e8000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x5624706651d0 2023-12-19T17:53:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.796+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(30 [pgnls start_epoch 45 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.796+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:31 5.f 5:f0000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd49c02f910 2023-12-19T17:53:55.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(31 [pgnls start_epoch 45 out=73b] v38'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 5.1f 5:f8000000:%01:::head [pgnls start_epoch 45 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e45) v8 -- 0x5624706709a0 con 0x7fd4a0016420 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(32 [pgnls start_epoch 45 out=101b] v44'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4a0016420 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 5.10 5:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x562470664640 con 0x7fd4a00118c0 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:34 5.10 5:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707b9330 con 0x7fd4a00118c0 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:35 5.10 5:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707b9bd0 con 0x7fd4a00118c0 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:36 5.10 5:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707ba470 con 0x7fd4a00118c0 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:37 5.10 5:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bad10 con 0x7fd4a00118c0 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:38 5.14 5:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bb5b0 con 0x5624706651d0 2023-12-19T17:53:55.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:39 5.14 5:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bbe50 con 0x5624706651d0 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:40 5.14 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bc6f0 con 0x5624706651d0 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:41 5.14 5:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bcf90 con 0x5624706651d0 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:42 5.1c 5:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bd830 con 0x7fd49c012030 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:43 5.6 5:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707be0d0 con 0x7fd4980532a0 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:44 5.e 5:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707be9b0 con 0x7fd49c012030 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:45 5.15 5:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707bf540 con 0x7fd49c02f910 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:46 5.15 5:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c0050 con 0x7fd49c02f910 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:47 5.d 5:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c0be0 con 0x7fd4980532a0 2023-12-19T17:53:55.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.800+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:48 5.1d 5:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c1700 con 0x7fd4a0016040 2023-12-19T17:53:55.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.804+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(42 607.00000000 [delete] v45'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c012030 2023-12-19T17:53:55.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.804+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v45'9 uv9 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.804+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:49 5.13 5:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c1b00 con 0x5624706651d0 2023-12-19T17:53:55.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.804+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:50 5.13 5:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c1eb0 con 0x5624706651d0 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(48 605.00000000 [delete] v45'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a0016040 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:51 5.b 5:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c1b00 con 0x7fd4980532a0 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(45 604.00000000 [delete] v45'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:52 5.7 5:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c1eb0 con 0x7fd49c02f910 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(33 601.00000000 [delete] v45'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(44 608.00000000 [delete] v45'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c012030 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(47 mds_snaptable [delete] v45'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(34 602.00000000 [delete] v45'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(46 500.00000000 [delete] v45'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:53 5.f 5:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x562470664a20 con 0x7fd49c02f910 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:54 5.1f 5:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707be480 con 0x7fd4a0016420 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:55 5.1f 5:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e45) v8 -- 0x5624707c23a0 con 0x7fd4a0016420 2023-12-19T17:53:55.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(38 1.00000000.inode [delete] v45'36 uv36 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(35 10000000000.00000000 [delete] v45'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(39 200.00000000 [delete] v45'37 uv37 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(40 200.00000001 [delete] v45'38 uv38 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(41 606.00000000 [delete] v45'39 uv39 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(36 600.00000000 [delete] v45'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a822f700 1 -- 172.21.15.45:0/3430658591 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(37 603.00000000 [delete] v45'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd498017020 con 0x7fd4a00118c0 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(49 mds0_inotable [delete] v45'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.808+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(52 609.00000000 [delete] v45'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(53 400.00000000 [delete] v45'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x7fd49c02f910 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(51 mds0_sessionmap [delete] v45'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4980532a0 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(50 100.00000000 [delete] v45'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7fd4a0003450 con 0x5624706651d0 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(54 100.00000000.inode [delete] v45'7 uv7 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4a0016420 2023-12-19T17:53:55.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a7a2e700 1 -- 172.21.15.45:0/3430658591 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(55 1.00000000 [delete] v45'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7fd49c019040 con 0x7fd4a0016420 2023-12-19T17:53:55.817 INFO:teuthology.orchestra.run.smithi045.stdout:Removed 23 objects 2023-12-19T17:53:55.817 INFO:teuthology.orchestra.run.smithi045.stdout:successfully purged pool cephfs_metadata 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd4a002b8e0 msgr2=0x7fd4a00283c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd4a002b8e0 0x7fd4a00283c0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7fd4a0016040 msgr2=0x7fd4a0019450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7fd4a0016040 0x7fd4a0019450 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd4980532a0 msgr2=0x7fd498058bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7fd4980532a0 0x7fd498058bc0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5624706651d0 msgr2=0x5624707b8df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5624706651d0 0x5624707b8df0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fd49c012030 msgr2=0x7fd49c012410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fd49c012030 0x7fd49c012410 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 reap_dead start 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 reap_dead start 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fd49c02f910 msgr2=0x7fd49c041400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7fd49c02f910 0x7fd49c041400 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7fd4a0016420 msgr2=0x7fd4a0016880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7fd4a0016420 0x7fd4a0016880 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7fd4a00118c0 msgr2=0x7fd4a0001510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7fd4a00118c0 0x7fd4a0001510 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd494064400 msgr2=0x7fd4940668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd494064400 0x7fd4940668c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd49c00a5f0 tx=0x7fd49c010000 comp rx=0 tx=0).stop 2023-12-19T17:53:55.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56247066ad90 msgr2=0x562470715f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 --2- 172.21.15.45:0/3430658591 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56247066ad90 0x562470715f60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd49800df70 tx=0x7fd49800b1e0 comp rx=0 tx=0).stop 2023-12-19T17:53:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4a8a30700 1 -- 172.21.15.45:0/3430658591 reap_dead start 2023-12-19T17:53:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 shutdown_connections 2023-12-19T17:53:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 >> 172.21.15.45:0/3430658591 conn(0x56247066b240 msgr2=0x562470643900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 shutdown_connections 2023-12-19T17:53:55.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:55.812+0000 7fd4aa6fa140 1 -- 172.21.15.45:0/3430658591 wait complete. 2023-12-19T17:53:55.823 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2023-12-19T17:53:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 Processor -- start 2023-12-19T17:53:56.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 -- start start 2023-12-19T17:53:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f586c1443e0 0x7f586c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c071910 0x7f586c0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f586c071d70 con 0x7f586c0cb840 2023-12-19T17:53:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f586c0b1b80 con 0x7f586c1443e0 2023-12-19T17:53:56.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f58708e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c1447c0 con 0x7f586c071910 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f586b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f586c1443e0 0x7f586c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f586b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f586c1443e0 0x7f586c0713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42924/0 (socket says 172.21.15.45:42924) 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f586b7fe700 1 -- 172.21.15.45:0/272207387 learned_addr learned my addr 172.21.15.45:0/272207387 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.000+0000 7f5863fff700 1 --2- 172.21.15.45:0/272207387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c071910 0x7f586c0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586b7fe700 1 -- 172.21.15.45:0/272207387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c071910 msgr2=0x7f586c0cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586b7fe700 1 --2- 172.21.15.45:0/272207387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c071910 0x7f586c0cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586b7fe700 1 -- 172.21.15.45:0/272207387 >> v1:172.21.15.73:6789/0 conn(0x7f586c0cb840 legacy=0x7f586c15e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586b7fe700 1 -- 172.21.15.45:0/272207387 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f586c0b1830 con 0x7f586c1443e0 2023-12-19T17:53:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586b7fe700 1 --2- 172.21.15.45:0/272207387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c1443e0 0x7f586c0713d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f585c009910 tx=0x7f585c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f17b98760d6bc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586affd700 1 -- 172.21.15.45:0/272207387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c005e50 con 0x7f586c1443e0 2023-12-19T17:53:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586affd700 1 -- 172.21.15.45:0/272207387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c006030 con 0x7f586c1443e0 2023-12-19T17:53:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f586affd700 1 -- 172.21.15.45:0/272207387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c0063e0 con 0x7f586c1443e0 2023-12-19T17:53:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 -- 172.21.15.45:0/272207387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c1443e0 msgr2=0x7f586c0713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 --2- 172.21.15.45:0/272207387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c1443e0 0x7f586c0713d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f585c009910 tx=0x7f585c009c20 comp rx=0 tx=0).stop 2023-12-19T17:53:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 -- 172.21.15.45:0/272207387 shutdown_connections 2023-12-19T17:53:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 --2- 172.21.15.45:0/272207387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c071910 0x7f586c0cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 --2- 172.21.15.45:0/272207387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c1443e0 0x7f586c0713d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 -- 172.21.15.45:0/272207387 >> 172.21.15.45:0/272207387 conn(0x7f586c0cf5a0 msgr2=0x7f586c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 -- 172.21.15.45:0/272207387 shutdown_connections 2023-12-19T17:53:56.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.004+0000 7f58708e0700 1 -- 172.21.15.45:0/272207387 wait complete. 2023-12-19T17:53:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 Processor -- start 2023-12-19T17:53:56.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 -- start start 2023-12-19T17:53:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 0x7f586c0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c1443e0 0x7f586c141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1420a0 0x7f586c15d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0ca160 con 0x7f586c0cb840 2023-12-19T17:53:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0ca440 con 0x7f586c1420a0 2023-12-19T17:53:56.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f58708e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f586c0ca720 con 0x7f586c1443e0 2023-12-19T17:53:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 0x7f586c0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 0x7f586c0acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42928/0 (socket says 172.21.15.45:42928) 2023-12-19T17:53:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 -- 172.21.15.45:0/1674024907 learned_addr learned my addr 172.21.15.45:0/1674024907 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f5863fff700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c1443e0 0x7f586c141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586bfff700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1420a0 0x7f586c15d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 -- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c1443e0 msgr2=0x7f586c141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c1443e0 0x7f586c141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 -- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1420a0 msgr2=0x7f586c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1420a0 0x7f586c15d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 -- 172.21.15.45:0/1674024907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c009520 con 0x7f586c0cb840 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.008+0000 7f586b7fe700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 0x7f586c0acd10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f585c000c00 tx=0x7f585c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.012+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c006810 con 0x7f586c0cb840 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.012+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585c020070 con 0x7f586c0cb840 2023-12-19T17:53:56.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.012+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585c025670 con 0x7f586c0cb840 2023-12-19T17:53:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.012+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586c0caa00 con 0x7f586c0cb840 2023-12-19T17:53:56.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.012+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586c0c9e20 con 0x7f586c0cb840 2023-12-19T17:53:56.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.012+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f586c04ed30 con 0x7f586c0cb840 2023-12-19T17:53:56.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.016+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f585c022030 con 0x7f586c0cb840 2023-12-19T17:53:56.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.016+0000 7f5868ff9700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f584c065b00 0x7f584c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.016+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 6548+0+0 (secure 0 0 0) 0x7f585c084810 con 0x7f586c0cb840 2023-12-19T17:53:56.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.016+0000 7f5863fff700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f584c065b00 0x7f584c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.016+0000 7f5863fff700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f584c065b00 0x7f584c067fc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5854009b50 tx=0x7f5854009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.020+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f585c051f10 con 0x7f586c0cb840 2023-12-19T17:53:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.236+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f586c0ca2a0 con 0x7f586c0cb840 2023-12-19T17:53:56.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.400+0000 7f5868ff9700 1 -- 172.21.15.45:0/1674024907 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 107+0+0 (secure 0 0 0) 0x7f586c0ca2a0 con 0x7f586c0cb840 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f584c065b00 msgr2=0x7f584c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f584c065b00 0x7f584c067fc0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f5854009b50 tx=0x7f5854009240 comp rx=0 tx=0).stop 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 msgr2=0x7f586c0acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 0x7f586c0acd10 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f585c000c00 tx=0x7f585c004770 comp rx=0 tx=0).stop 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 shutdown_connections 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f584c065b00 0x7f584c067fc0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f586c1420a0 0x7f586c15d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f586c1443e0 0x7f586c141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 --2- 172.21.15.45:0/1674024907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f586c0cb840 0x7f586c0acd10 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 >> 172.21.15.45:0/1674024907 conn(0x7f586c071910 msgr2=0x7f586c15b280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 shutdown_connections 2023-12-19T17:53:56.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.404+0000 7f58708e0700 1 -- 172.21.15.45:0/1674024907 wait complete. 2023-12-19T17:53:56.419 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:53:56.414+0000 7f1ddb13d700 -1 mds.0.inotable: load_2 could not read table: -2 2023-12-19T17:53:56.419 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:53:56.414+0000 7f1ddb13d700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2023-12-19T17:53:56.422 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:53:56.416+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:53:56.422 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:53:56.416+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-12-19T17:53:56.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-12-19T17:53:56.438 INFO:tasks.ceph.mds.d.smithi073.stderr: -20> 2023-12-19T17:53:56.414+0000 7f1ddb13d700 -1 mds.0.inotable: load_2 could not read table: -2 2023-12-19T17:53:56.438 INFO:tasks.ceph.mds.d.smithi073.stderr: -19> 2023-12-19T17:53:56.414+0000 7f1ddb13d700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2023-12-19T17:53:56.487 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:53:56.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.624+0000 7f33b0db3700 1 Processor -- start 2023-12-19T17:53:56.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.624+0000 7f33b0db3700 1 -- start start 2023-12-19T17:53:56.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33b0db3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33ac15d090 0x7f33ac0d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33b0db3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0d10e0 con 0x7f33ac0cdff0 2023-12-19T17:53:56.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33b0db3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ac0d13c0 con 0x7f33ac0cff40 2023-12-19T17:53:56.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33b0db3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ac0b6040 con 0x7f33ac15d090 2023-12-19T17:53:56.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33aa59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f33ac15d090 0x7f33ac0d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33a9d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f33ac0cdff0 0x7f33ac0cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33512/0 (socket says 172.21.15.45:33512) 2023-12-19T17:53:56.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33a9d9b700 1 -- 172.21.15.45:0/1518731077 learned_addr learned my addr 172.21.15.45:0/1518731077 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33a959a700 1 -- 172.21.15.45:0/1518731077 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104954077 0 0) 0x7f33ac0d10e0 con 0x7f33ac0cdff0 2023-12-19T17:53:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33aa59c700 1 -- 172.21.15.45:0/1518731077 >> v1:172.21.15.73:6789/0 conn(0x7f33ac0cff40 legacy=0x7f33ac0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33aa59c700 1 -- 172.21.15.45:0/1518731077 >> v1:172.21.15.45:6789/0 conn(0x7f33ac0cdff0 legacy=0x7f33ac0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33aa59c700 1 -- 172.21.15.45:0/1518731077 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ac0d16a0 con 0x7f33ac15d090 2023-12-19T17:53:56.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33aa59c700 1 --2- 172.21.15.45:0/1518731077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac15d090 0x7f33ac0d0a50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f339c009850 tx=0x7f339c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d678442d09aa287d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:56.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33a959a700 1 -- 172.21.15.45:0/1518731077 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c011830 con 0x7f33ac15d090 2023-12-19T17:53:56.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33a959a700 1 -- 172.21.15.45:0/1518731077 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c011990 con 0x7f33ac15d090 2023-12-19T17:53:56.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.628+0000 7f33a959a700 1 -- 172.21.15.45:0/1518731077 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c011d20 con 0x7f33ac15d090 2023-12-19T17:53:56.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 -- 172.21.15.45:0/1518731077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac15d090 msgr2=0x7f33ac0d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 --2- 172.21.15.45:0/1518731077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac15d090 0x7f33ac0d0a50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f339c009850 tx=0x7f339c009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 -- 172.21.15.45:0/1518731077 shutdown_connections 2023-12-19T17:53:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 --2- 172.21.15.45:0/1518731077 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac15d090 0x7f33ac0d0a50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 -- 172.21.15.45:0/1518731077 >> 172.21.15.45:0/1518731077 conn(0x7f33ac0b4b90 msgr2=0x7f33ac0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 -- 172.21.15.45:0/1518731077 shutdown_connections 2023-12-19T17:53:56.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 -- 172.21.15.45:0/1518731077 wait complete. 2023-12-19T17:53:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 Processor -- start 2023-12-19T17:53:56.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.632+0000 7f33b0db3700 1 -- start start 2023-12-19T17:53:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ac0cdff0 0x7f33ac0c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac0cff40 0x7f33ac0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33ac15d090 0x7f33ac0cc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c8e20 con 0x7f33ac0cff40 2023-12-19T17:53:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c97f0 con 0x7f33ac0cdff0 2023-12-19T17:53:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ac0c8210 con 0x7f33ac15d090 2023-12-19T17:53:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac0cff40 0x7f33ac0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33aa59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ac0cdff0 0x7f33ac0c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33aad9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33ac15d090 0x7f33ac0cc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33aad9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33ac15d090 0x7f33ac0cc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:59118/0 (socket says 172.21.15.45:59118) 2023-12-19T17:53:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33aad9d700 1 -- 172.21.15.45:0/398831331 learned_addr learned my addr 172.21.15.45:0/398831331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:56.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33aa59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ac0cdff0 0x7f33ac0c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:39490/0 (socket says 172.21.15.45:39490) 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 -- 172.21.15.45:0/398831331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33ac15d090 msgr2=0x7f33ac0cc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33ac15d090 0x7f33ac0cc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 -- 172.21.15.45:0/398831331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ac0cdff0 msgr2=0x7f33ac0c92b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ac0cdff0 0x7f33ac0c92b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 -- 172.21.15.45:0/398831331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0094b0 con 0x7f33ac0cff40 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33a9d9b700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac0cff40 0x7f33ac0c79c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f33a000c550 tx=0x7f33a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0004ca0 con 0x7f33ac0cff40 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a0004e00 con 0x7f33ac0cff40 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a0007310 con 0x7f33ac0cff40 2023-12-19T17:53:56.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ac0c84f0 con 0x7f33ac0cff40 2023-12-19T17:53:56.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.636+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ac0c8ab0 con 0x7f33ac0cff40 2023-12-19T17:53:56.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.640+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ac0c8fd0 con 0x7f33ac0cff40 2023-12-19T17:53:56.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.640+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33a0007470 con 0x7f33ac0cff40 2023-12-19T17:53:56.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.644+0000 7f339affd700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f338c065b20 0x7f338c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:56.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.644+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7f33a0082fc0 con 0x7f33ac0cff40 2023-12-19T17:53:56.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.644+0000 7f33aa59c700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f338c065b20 0x7f338c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:56.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.644+0000 7f33aa59c700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f338c065b20 0x7f338c067fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f339c0090b0 tx=0x7f339c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:56.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.648+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f33ac0c8fd0 con 0x7f33ac0cff40 2023-12-19T17:53:56.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:56.860+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f33ac0c8fd0 con 0x7f33ac0cff40 2023-12-19T17:53:57.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.504+0000 7f339affd700 1 -- 172.21.15.45:0/398831331 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v22) v1 ==== 162+0+0 (secure 0 0 0) 0x7f33ac0c8fd0 con 0x7f33ac0cff40 2023-12-19T17:53:57.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f338c065b20 msgr2=0x7f338c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f338c065b20 0x7f338c067fe0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f339c0090b0 tx=0x7f339c01c040 comp rx=0 tx=0).stop 2023-12-19T17:53:57.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac0cff40 msgr2=0x7f33ac0c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac0cff40 0x7f33ac0c79c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f33a000c550 tx=0x7f33a000c860 comp rx=0 tx=0).stop 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 shutdown_connections 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f338c065b20 0x7f338c067fe0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33ac15d090 0x7f33ac0cc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33ac0cff40 0x7f33ac0c79c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 --2- 172.21.15.45:0/398831331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ac0cdff0 0x7f33ac0c92b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 >> 172.21.15.45:0/398831331 conn(0x7f33ac0b4b90 msgr2=0x7f33ac0b8870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 shutdown_connections 2023-12-19T17:53:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.512+0000 7f33b0db3700 1 -- 172.21.15.45:0/398831331 wait complete. 2023-12-19T17:53:57.518 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-12-19T17:53:57.544 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:57.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.720+0000 7f7a20482700 1 Processor -- start 2023-12-19T17:53:57.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.720+0000 7f7a20482700 1 -- start start 2023-12-19T17:53:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a20482700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815ab50 0x7f7a180adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a20482700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a1815af30 con 0x7f7a1815e260 2023-12-19T17:53:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a20482700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a180cd010 con 0x7f7a180cddd0 2023-12-19T17:53:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a20482700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180cd2f0 con 0x7f7a1815ab50 2023-12-19T17:53:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1da1d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7a1815e260 0x7f7a1806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33524/0 (socket says 172.21.15.45:33524) 2023-12-19T17:53:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1da1d700 1 -- 172.21.15.45:0/3085482072 learned_addr learned my addr 172.21.15.45:0/3085482072 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1e21e700 1 --2- 172.21.15.45:0/3085482072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815ab50 0x7f7a180adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1d21c700 1 -- 172.21.15.45:0/3085482072 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1850914187 0 0) 0x7f7a1815af30 con 0x7f7a1815e260 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1d21c700 1 -- 172.21.15.45:0/3085482072 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7a040035d0 con 0x7f7a1815e260 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1e21e700 1 -- 172.21.15.45:0/3085482072 >> v1:172.21.15.73:6789/0 conn(0x7f7a180cddd0 legacy=0x7f7a180c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1d21c700 1 -- 172.21.15.45:0/3085482072 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170556117 0 0) 0x7f7a180cd010 con 0x7f7a180cddd0 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1e21e700 1 -- 172.21.15.45:0/3085482072 >> v1:172.21.15.45:6789/0 conn(0x7f7a1815e260 legacy=0x7f7a1806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1e21e700 1 -- 172.21.15.45:0/3085482072 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a180cd5d0 con 0x7f7a1815ab50 2023-12-19T17:53:57.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.724+0000 7f7a1e21e700 1 --2- 172.21.15.45:0/3085482072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815ab50 0x7f7a180adad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009880 tx=0x7f7a14009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=221a732664926143 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a1d21c700 1 -- 172.21.15.45:0/3085482072 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011830 con 0x7f7a1815ab50 2023-12-19T17:53:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a1d21c700 1 -- 172.21.15.45:0/3085482072 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a14011990 con 0x7f7a1815ab50 2023-12-19T17:53:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a1d21c700 1 -- 172.21.15.45:0/3085482072 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a14011d20 con 0x7f7a1815ab50 2023-12-19T17:53:57.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 -- 172.21.15.45:0/3085482072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815ab50 msgr2=0x7f7a180adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 --2- 172.21.15.45:0/3085482072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815ab50 0x7f7a180adad0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7a14009880 tx=0x7f7a14009b90 comp rx=0 tx=0).stop 2023-12-19T17:53:57.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 -- 172.21.15.45:0/3085482072 shutdown_connections 2023-12-19T17:53:57.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 --2- 172.21.15.45:0/3085482072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815ab50 0x7f7a180adad0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 -- 172.21.15.45:0/3085482072 >> 172.21.15.45:0/3085482072 conn(0x7f7a180cba40 msgr2=0x7f7a180ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:57.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 -- 172.21.15.45:0/3085482072 shutdown_connections 2023-12-19T17:53:57.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.728+0000 7f7a20482700 1 -- 172.21.15.45:0/3085482072 wait complete. 2023-12-19T17:53:57.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 Processor -- start 2023-12-19T17:53:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 -- start start 2023-12-19T17:53:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a180cddd0 0x7f7a1815efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 0x7f7a180b3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815e260 0x7f7a180b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180b3bc0 con 0x7f7a1815ab50 2023-12-19T17:53:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a181f58c0 con 0x7f7a180cddd0 2023-12-19T17:53:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a20482700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a180ae020 con 0x7f7a1815e260 2023-12-19T17:53:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 0x7f7a180b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 0x7f7a180b3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42956/0 (socket says 172.21.15.45:42956) 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 -- 172.21.15.45:0/205548838 learned_addr learned my addr 172.21.15.45:0/205548838 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1e21e700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a180cddd0 0x7f7a1815efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1ea1f700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815e260 0x7f7a180b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 -- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815e260 msgr2=0x7f7a180b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815e260 0x7f7a180b3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 -- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a180cddd0 msgr2=0x7f7a1815efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a180cddd0 0x7f7a1815efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.732+0000 7f7a1da1d700 1 -- 172.21.15.45:0/205548838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a140094b0 con 0x7f7a1815ab50 2023-12-19T17:53:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a1da1d700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 0x7f7a180b3140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c4d0 tx=0x7f7a0800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08005d90 con 0x7f7a1815ab50 2023-12-19T17:53:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a080070d0 con 0x7f7a1815ab50 2023-12-19T17:53:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a181f5b10 con 0x7f7a1815ab50 2023-12-19T17:53:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a08007480 con 0x7f7a1815ab50 2023-12-19T17:53:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a181f60d0 con 0x7f7a1815ab50 2023-12-19T17:53:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.736+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a181f62f0 con 0x7f7a1815ab50 2023-12-19T17:53:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.740+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7a080075e0 con 0x7f7a1815ab50 2023-12-19T17:53:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.740+0000 7f7a0effd700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f79fc065ad0 0x7f79fc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.740+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7f7a08082900 con 0x7f7a1815ab50 2023-12-19T17:53:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.740+0000 7f7a1e21e700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f79fc065ad0 0x7f79fc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:57.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.744+0000 7f7a1e21e700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f79fc065ad0 0x7f79fc067f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a140090b0 tx=0x7f7a1401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.748+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7a0804ff10 con 0x7f7a1815ab50 2023-12-19T17:53:57.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.956+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7a1804ed30 con 0x7f7a1815ab50 2023-12-19T17:53:57.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.956+0000 7f7a0effd700 1 -- 172.21.15.45:0/205548838 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f7a08053530 con 0x7f7a1815ab50 2023-12-19T17:53:57.961 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:57.962 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":55247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3331996662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3331996662},{"type":"v1","addr":"172.21.15.73:6835","nonce":3331996662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:53:57.501240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f79fc065ad0 msgr2=0x7f79fc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f79fc065ad0 0x7f79fc067f90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7a140090b0 tx=0x7f7a1401c040 comp rx=0 tx=0).stop 2023-12-19T17:53:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 msgr2=0x7f7a180b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:57.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 0x7f7a180b3140 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7a0800c4d0 tx=0x7f7a0800c7e0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 shutdown_connections 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f79fc065ad0 0x7f79fc067f90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7a1815e260 0x7f7a180b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7a1815ab50 0x7f7a180b3140 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 --2- 172.21.15.45:0/205548838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a180cddd0 0x7f7a1815efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 >> 172.21.15.45:0/205548838 conn(0x7f7a180cba40 msgr2=0x7f7a18160000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 shutdown_connections 2023-12-19T17:53:57.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:57.960+0000 7f7a20482700 1 -- 172.21.15.45:0/205548838 wait complete. 2023-12-19T17:53:57.967 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-19T17:53:57.986 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T17:53:57.986 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:58.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 Processor -- start 2023-12-19T17:53:58.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 -- start start 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165806a720 0x7f16580cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16580cbe00 0x7f1658070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1658070fd0 con 0x7f165815e170 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16580aebe0 con 0x7f165806a720 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ecb1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580aeec0 con 0x7f16580cbe00 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165d4ae700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f165806a720 0x7f16580cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165dcaf700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f165815e170 0x7f165806a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33526/0 (socket says 172.21.15.45:33526) 2023-12-19T17:53:58.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165dcaf700 1 -- 172.21.15.45:0/1853213715 learned_addr learned my addr 172.21.15.45:0/1853213715 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:53:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165e4b0700 1 --2- 172.21.15.45:0/1853213715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16580cbe00 0x7f1658070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165d4ae700 1 -- 172.21.15.45:0/1853213715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16580cbe00 msgr2=0x7f1658070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:58.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165d4ae700 1 --2- 172.21.15.45:0/1853213715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16580cbe00 0x7f1658070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165d4ae700 1 -- 172.21.15.45:0/1853213715 >> v1:172.21.15.45:6789/0 conn(0x7f165815e170 legacy=0x7f165806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165d4ae700 1 -- 172.21.15.45:0/1853213715 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1658070290 con 0x7f165806a720 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.164+0000 7f165ccad700 1 -- 172.21.15.45:0/1853213715 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759584905 0 0) 0x7f1658070fd0 con 0x7f165815e170 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165d4ae700 1 --2- 172.21.15.45:0/1853213715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580cb2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1648009850 tx=0x7f1648009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6cc4c780232df18 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ccad700 1 -- 172.21.15.45:0/1853213715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648011830 con 0x7f165806a720 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ccad700 1 -- 172.21.15.45:0/1853213715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1648011990 con 0x7f165806a720 2023-12-19T17:53:58.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ccad700 1 -- 172.21.15.45:0/1853213715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1648011d20 con 0x7f165806a720 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 -- 172.21.15.45:0/1853213715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 msgr2=0x7f16580cb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1853213715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580cb2f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f1648009850 tx=0x7f1648009b60 comp rx=0 tx=0).stop 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 -- 172.21.15.45:0/1853213715 shutdown_connections 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1853213715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16580cbe00 0x7f1658070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1853213715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580cb2f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 -- 172.21.15.45:0/1853213715 >> 172.21.15.45:0/1853213715 conn(0x7f16580cf960 msgr2=0x7f16580cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 -- 172.21.15.45:0/1853213715 shutdown_connections 2023-12-19T17:53:58.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.168+0000 7f165ecb1700 1 -- 172.21.15.45:0/1853213715 wait complete. 2023-12-19T17:53:58.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 Processor -- start 2023-12-19T17:53:58.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 -- start start 2023-12-19T17:53:58.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16580cbe00 0x7f165815d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f165815e170 0x7f165814fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c7c20 con 0x7f165806a720 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c7010 con 0x7f16580cbe00 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165ecb1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16580c72f0 con 0x7f165815e170 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580c6a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42962/0 (socket says 172.21.15.45:42962) 2023-12-19T17:53:58.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 -- 172.21.15.45:0/1375151830 learned_addr learned my addr 172.21.15.45:0/1375151830 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165d4ae700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16580cbe00 0x7f165815d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165e4b0700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f165815e170 0x7f165814fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 -- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f165815e170 msgr2=0x7f165814fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f165815e170 0x7f165814fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 -- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16580cbe00 msgr2=0x7f165815d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.172+0000 7f165dcaf700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16580cbe00 0x7f165815d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f165dcaf700 1 -- 172.21.15.45:0/1375151830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16480094b0 con 0x7f165806a720 2023-12-19T17:53:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f165dcaf700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580c6a30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f165400c4e0 tx=0x7f165400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654004ca0 con 0x7f165806a720 2023-12-19T17:53:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1654004e20 con 0x7f165806a720 2023-12-19T17:53:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654007310 con 0x7f165806a720 2023-12-19T17:53:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16580c75d0 con 0x7f165806a720 2023-12-19T17:53:58.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165815d700 con 0x7f165806a720 2023-12-19T17:53:58.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.176+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1658067760 con 0x7f165806a720 2023-12-19T17:53:58.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.180+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1654007470 con 0x7f165806a720 2023-12-19T17:53:58.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.180+0000 7f164e7fc700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f163c065ad0 0x7f163c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.180+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7f16540831a0 con 0x7f165806a720 2023-12-19T17:53:58.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.180+0000 7f165d4ae700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f163c065ad0 0x7f163c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.180+0000 7f165d4ae700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f163c065ad0 0x7f163c067f90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1648000c00 tx=0x7f1648008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:58.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.188+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16540506a0 con 0x7f165806a720 2023-12-19T17:53:58.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.400+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f165806b090 con 0x7f165806a720 2023-12-19T17:53:58.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f164e7fc700 1 -- 172.21.15.45:0/1375151830 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f1654007720 con 0x7f165806a720 2023-12-19T17:53:58.407 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:58.407 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":55247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3331996662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3331996662},{"type":"v1","addr":"172.21.15.73:6835","nonce":3331996662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:53:57.501240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:58.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f163c065ad0 msgr2=0x7f163c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f163c065ad0 0x7f163c067f90 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1648000c00 tx=0x7f1648008030 comp rx=0 tx=0).stop 2023-12-19T17:53:58.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 msgr2=0x7f16580c6a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580c6a30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f165400c4e0 tx=0x7f165400c7f0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 shutdown_connections 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f163c065ad0 0x7f163c067f90 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f165815e170 0x7f165814fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16580cbe00 0x7f165815d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 --2- 172.21.15.45:0/1375151830 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f165806a720 0x7f16580c6a30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 >> 172.21.15.45:0/1375151830 conn(0x7f16580cf960 msgr2=0x7f16580b3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 shutdown_connections 2023-12-19T17:53:58.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.404+0000 7f165ecb1700 1 -- 172.21.15.45:0/1375151830 wait complete. 2023-12-19T17:53:58.412 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-19T17:53:58.434 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 Processor -- start 2023-12-19T17:53:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 -- start start 2023-12-19T17:53:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5ec15cff0 0x7ff5ec161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5ec0c3920 0x7ff5ec0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ec0ca6f0 con 0x7ff5ec06ddd0 2023-12-19T17:53:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec15d3d0 con 0x7ff5ec0c3920 2023-12-19T17:53:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f1577700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ec0c42f0 con 0x7ff5ec15cff0 2023-12-19T17:53:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f0d76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5ec0c3920 0x7ff5ec0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f0d76700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5ec0c3920 0x7ff5ec0c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42964/0 (socket says 172.21.15.45:42964) 2023-12-19T17:53:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.616+0000 7ff5f0d76700 1 -- 172.21.15.45:0/2945012562 learned_addr learned my addr 172.21.15.45:0/2945012562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f0d76700 1 -- 172.21.15.45:0/2945012562 >> v2:172.21.15.73:3300/0 conn(0x7ff5ec15cff0 msgr2=0x7ff5ec161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f0d76700 1 --2- 172.21.15.45:0/2945012562 >> v2:172.21.15.73:3300/0 conn(0x7ff5ec15cff0 0x7ff5ec161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f0d76700 1 -- 172.21.15.45:0/2945012562 >> v1:172.21.15.45:6789/0 conn(0x7ff5ec06ddd0 legacy=0x7ff5ec0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f0d76700 1 -- 172.21.15.45:0/2945012562 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ec0c9220 con 0x7ff5ec0c3920 2023-12-19T17:53:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f0d76700 1 --2- 172.21.15.45:0/2945012562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec0c3db0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0721d0 tx=0x7ff5e400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3859c6643aa6e77 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5eb7fe700 1 -- 172.21.15.45:0/2945012562 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e400e070 con 0x7ff5ec0c3920 2023-12-19T17:53:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5eb7fe700 1 -- 172.21.15.45:0/2945012562 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e4003a40 con 0x7ff5ec0c3920 2023-12-19T17:53:58.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5eb7fe700 1 -- 172.21.15.45:0/2945012562 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4003df0 con 0x7ff5ec0c3920 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 -- 172.21.15.45:0/2945012562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec0c3920 msgr2=0x7ff5ec0c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 --2- 172.21.15.45:0/2945012562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec0c3db0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0721d0 tx=0x7ff5e400b330 comp rx=0 tx=0).stop 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 -- 172.21.15.45:0/2945012562 shutdown_connections 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 --2- 172.21.15.45:0/2945012562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec0c3db0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 --2- 172.21.15.45:0/2945012562 >> v2:172.21.15.73:3300/0 conn(0x7ff5ec15cff0 0x7ff5ec161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 -- 172.21.15.45:0/2945012562 >> 172.21.15.45:0/2945012562 conn(0x7ff5ec0cb900 msgr2=0x7ff5ec0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 -- 172.21.15.45:0/2945012562 shutdown_connections 2023-12-19T17:53:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.620+0000 7ff5f1577700 1 -- 172.21.15.45:0/2945012562 wait complete. 2023-12-19T17:53:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 Processor -- start 2023-12-19T17:53:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 -- start start 2023-12-19T17:53:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5ec06ddd0 0x7ff5ec0c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 0x7ff5ec0b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec0b3bc0 con 0x7ff5ec15cff0 2023-12-19T17:53:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec0c69a0 con 0x7ff5ec0c3920 2023-12-19T17:53:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f1577700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ec1f36e0 con 0x7ff5ec06ddd0 2023-12-19T17:53:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 0x7ff5ec0b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 0x7ff5ec0b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42980/0 (socket says 172.21.15.45:42980) 2023-12-19T17:53:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 -- 172.21.15.45:0/1050533997 learned_addr learned my addr 172.21.15.45:0/1050533997 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5ebfff700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5ec06ddd0 0x7ff5ec0c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5e37fe700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 -- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5ec06ddd0 msgr2=0x7ff5ec0c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5ec06ddd0 0x7ff5ec0c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 -- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0c3920 msgr2=0x7ff5ec1f31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec1f31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.624+0000 7ff5f0d76700 1 -- 172.21.15.45:0/1050533997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e4009b30 con 0x7ff5ec15cff0 2023-12-19T17:53:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5f0d76700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 0x7ff5ec0b2b70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4015040 tx=0x7ff5e4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4004440 con 0x7ff5ec15cff0 2023-12-19T17:53:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e40045c0 con 0x7ff5ec15cff0 2023-12-19T17:53:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ec0c5d90 con 0x7ff5ec15cff0 2023-12-19T17:53:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e4004970 con 0x7ff5ec15cff0 2023-12-19T17:53:58.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ec0c6350 con 0x7ff5ec15cff0 2023-12-19T17:53:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.628+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ec0c6b30 con 0x7ff5ec15cff0 2023-12-19T17:53:58.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.632+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff5e4012430 con 0x7ff5ec15cff0 2023-12-19T17:53:58.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.632+0000 7ff5e97fa700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5cc065ad0 0x7ff5cc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:58.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.632+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7ff5e40849f0 con 0x7ff5ec15cff0 2023-12-19T17:53:58.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.632+0000 7ff5ebfff700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5cc065ad0 0x7ff5cc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:58.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.632+0000 7ff5ebfff700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5cc065ad0 0x7ff5cc067f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0ca0b0 tx=0x7ff5dc009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:58.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.640+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff5e4055a10 con 0x7ff5ec15cff0 2023-12-19T17:53:58.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.852+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5ec067760 con 0x7ff5ec15cff0 2023-12-19T17:53:58.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.856+0000 7ff5e97fa700 1 -- 172.21.15.45:0/1050533997 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4701 (secure 0 0 0) 0x7ff5e40555a0 con 0x7ff5ec15cff0 2023-12-19T17:53:58.859 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:58.859 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":55247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3331996662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3331996662},{"type":"v1","addr":"172.21.15.73:6835","nonce":3331996662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:53:57.501240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:58.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5cc065ad0 msgr2=0x7ff5cc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5cc065ad0 0x7ff5cc067f90 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec0ca0b0 tx=0x7ff5dc009110 comp rx=0 tx=0).stop 2023-12-19T17:53:58.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 msgr2=0x7ff5ec0b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:58.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 0x7ff5ec0b2b70 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4015040 tx=0x7ff5e4004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 shutdown_connections 2023-12-19T17:53:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff5cc065ad0 0x7ff5cc067f90 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5ec15cff0 0x7ff5ec0b2b70 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5ec0c3920 0x7ff5ec1f31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 --2- 172.21.15.45:0/1050533997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5ec06ddd0 0x7ff5ec0c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:58.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 >> 172.21.15.45:0/1050533997 conn(0x7ff5ec0cb900 msgr2=0x7ff5ec06ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:58.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 shutdown_connections 2023-12-19T17:53:58.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:58.860+0000 7ff5f1577700 1 -- 172.21.15.45:0/1050533997 wait complete. 2023-12-19T17:53:58.867 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-19T17:53:58.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 Processor -- start 2023-12-19T17:53:59.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 -- start start 2023-12-19T17:53:59.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f333015cfe0 0x7f33300d2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f33300b8560 0x7f33300d0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33300d2070 con 0x7f33300cd910 2023-12-19T17:53:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300d11c0 con 0x7f333015cfe0 2023-12-19T17:53:59.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f3334ed8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33300d1460 con 0x7f33300b8560 2023-12-19T17:53:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f332f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f333015cfe0 0x7f33300d2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f332f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f333015cfe0 0x7f33300d2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43128/0 (socket says 172.21.15.45:43128) 2023-12-19T17:53:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f332f7fe700 1 -- 172.21.15.45:0/3743292675 learned_addr learned my addr 172.21.15.45:0/3743292675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.072+0000 7f332effd700 1 --2- 172.21.15.45:0/3743292675 >> v2:172.21.15.73:3300/0 conn(0x7f33300b8560 0x7f33300d0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332f7fe700 1 -- 172.21.15.45:0/3743292675 >> v2:172.21.15.73:3300/0 conn(0x7f33300b8560 msgr2=0x7f33300d0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332f7fe700 1 --2- 172.21.15.45:0/3743292675 >> v2:172.21.15.73:3300/0 conn(0x7f33300b8560 0x7f33300d0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332f7fe700 1 -- 172.21.15.45:0/3743292675 >> v1:172.21.15.45:6789/0 conn(0x7f33300cd910 legacy=0x7f33300b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332f7fe700 1 -- 172.21.15.45:0/3743292675 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33300d1740 con 0x7f333015cfe0 2023-12-19T17:53:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332f7fe700 1 --2- 172.21.15.45:0/3743292675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333015cfe0 0x7f33300d2500 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f33300b5740 tx=0x7f332000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97e5b6ca74f2dd63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332e7fc700 1 -- 172.21.15.45:0/3743292675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000e070 con 0x7f333015cfe0 2023-12-19T17:53:59.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332e7fc700 1 -- 172.21.15.45:0/3743292675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f332000b9c0 con 0x7f333015cfe0 2023-12-19T17:53:59.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f332e7fc700 1 -- 172.21.15.45:0/3743292675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332000bd70 con 0x7f333015cfe0 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 -- 172.21.15.45:0/3743292675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333015cfe0 msgr2=0x7f33300d2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3743292675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333015cfe0 0x7f33300d2500 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f33300b5740 tx=0x7f332000b330 comp rx=0 tx=0).stop 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 -- 172.21.15.45:0/3743292675 shutdown_connections 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3743292675 >> v2:172.21.15.73:3300/0 conn(0x7f33300b8560 0x7f33300d0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3743292675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f333015cfe0 0x7f33300d2500 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 -- 172.21.15.45:0/3743292675 >> 172.21.15.45:0/3743292675 conn(0x7f33300b46c0 msgr2=0x7f33300b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 -- 172.21.15.45:0/3743292675 shutdown_connections 2023-12-19T17:53:59.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.076+0000 7f3334ed8700 1 -- 172.21.15.45:0/3743292675 wait complete. 2023-12-19T17:53:59.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 Processor -- start 2023-12-19T17:53:59.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 -- start start 2023-12-19T17:53:59.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 0x7f33301f2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33300cd910 0x7f33301565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f333015cfe0 0x7f33300c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333015d730 con 0x7f33300b8560 2023-12-19T17:53:59.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333015da10 con 0x7f333015cfe0 2023-12-19T17:53:59.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f3334ed8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333015dcf0 con 0x7f33300cd910 2023-12-19T17:53:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f332f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 0x7f33301f2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f332f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 0x7f33301f2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43138/0 (socket says 172.21.15.45:43138) 2023-12-19T17:53:59.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.080+0000 7f332f7fe700 1 -- 172.21.15.45:0/3643031935 learned_addr learned my addr 172.21.15.45:0/3643031935 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332effd700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33300cd910 0x7f33301565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332ffff700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f333015cfe0 0x7f33300c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332f7fe700 1 -- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33300cd910 msgr2=0x7f33301565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332f7fe700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33300cd910 0x7f33301565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332f7fe700 1 -- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f333015cfe0 msgr2=0x7f33300c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332f7fe700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f333015cfe0 0x7f33300c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332f7fe700 1 -- 172.21.15.45:0/3643031935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3320009b30 con 0x7f33300b8560 2023-12-19T17:53:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f332f7fe700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 0x7f33301f2560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3330072a90 tx=0x7f3320004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33200048c0 con 0x7f33300b8560 2023-12-19T17:53:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33200099b0 con 0x7f33300b8560 2023-12-19T17:53:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f332001b670 con 0x7f33300b8560 2023-12-19T17:53:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333015dfd0 con 0x7f33300b8560 2023-12-19T17:53:59.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333015d3c0 con 0x7f33300b8560 2023-12-19T17:53:59.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.084+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3330067760 con 0x7f33300b8560 2023-12-19T17:53:59.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.088+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f332001b7d0 con 0x7f33300b8560 2023-12-19T17:53:59.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.092+0000 7f3317fff700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f331c065ad0 0x7f331c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.092+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7f3320084ac0 con 0x7f33300b8560 2023-12-19T17:53:59.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.092+0000 7f332effd700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f331c065ad0 0x7f331c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.092+0000 7f332effd700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f331c065ad0 0x7f331c067f90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33300c5f10 tx=0x7f3324008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.096+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f33200520d0 con 0x7f33300b8560 2023-12-19T17:53:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33300d1a20 con 0x7f33300b8560 2023-12-19T17:53:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3317fff700 1 -- 172.21.15.45:0/3643031935 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f33200556f0 con 0x7f33300b8560 2023-12-19T17:53:59.308 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:59.308 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":55247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3331996662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3331996662},{"type":"v1","addr":"172.21.15.73:6835","nonce":3331996662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:53:57.501240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f331c065ad0 msgr2=0x7f331c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f331c065ad0 0x7f331c067f90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33300c5f10 tx=0x7f3324008040 comp rx=0 tx=0).stop 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 msgr2=0x7f33301f2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 0x7f33301f2560 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f3330072a90 tx=0x7f3320004af0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.304+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 shutdown_connections 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f331c065ad0 0x7f331c067f90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f333015cfe0 0x7f33300c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f33300cd910 0x7f33301565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 --2- 172.21.15.45:0/3643031935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f33300b8560 0x7f33301f2560 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 >> 172.21.15.45:0/3643031935 conn(0x7f33300b46c0 msgr2=0x7f33300b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 shutdown_connections 2023-12-19T17:53:59.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.308+0000 7f3334ed8700 1 -- 172.21.15.45:0/3643031935 wait complete. 2023-12-19T17:53:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-19T17:53:59.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:53:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.508+0000 7efc5759e700 1 Processor -- start 2023-12-19T17:53:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.508+0000 7efc5759e700 1 -- start start 2023-12-19T17:53:59.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc581592b0 0x7efc5815a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc580cd830 0x7efc580ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efc580cdc90 0x7efc580cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580ce1b0 con 0x7efc581592b0 2023-12-19T17:53:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc580ce490 con 0x7efc580cdc90 2023-12-19T17:53:59.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc581599c0 con 0x7efc580cd830 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc581592b0 0x7efc5815a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efc581592b0 0x7efc5815a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43144/0 (socket says 172.21.15.45:43144) 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 -- 172.21.15.45:0/4228154015 learned_addr learned my addr 172.21.15.45:0/4228154015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc55d9b700 1 --2- 172.21.15.45:0/4228154015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc580cd830 0x7efc580ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc56d9d700 1 --2- 172.21.15.45:0/4228154015 >> v2:172.21.15.73:3300/0 conn(0x7efc580cdc90 0x7efc580cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 -- 172.21.15.45:0/4228154015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc580cd830 msgr2=0x7efc580ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 --2- 172.21.15.45:0/4228154015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc580cd830 0x7efc580ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 -- 172.21.15.45:0/4228154015 >> v2:172.21.15.73:3300/0 conn(0x7efc580cdc90 msgr2=0x7efc580cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 --2- 172.21.15.45:0/4228154015 >> v2:172.21.15.73:3300/0 conn(0x7efc580cdc90 0x7efc580cd1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 -- 172.21.15.45:0/4228154015 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc58159ca0 con 0x7efc581592b0 2023-12-19T17:53:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5659c700 1 --2- 172.21.15.45:0/4228154015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc581592b0 0x7efc5815a1c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efc5806ceb0 tx=0x7efc48009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d869e122c06d94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.512+0000 7efc5559a700 1 -- 172.21.15.45:0/4228154015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48011830 con 0x7efc581592b0 2023-12-19T17:53:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5559a700 1 -- 172.21.15.45:0/4228154015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc48011990 con 0x7efc581592b0 2023-12-19T17:53:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5559a700 1 -- 172.21.15.45:0/4228154015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc48011d20 con 0x7efc581592b0 2023-12-19T17:53:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 -- 172.21.15.45:0/4228154015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc581592b0 msgr2=0x7efc5815a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 --2- 172.21.15.45:0/4228154015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc581592b0 0x7efc5815a1c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7efc5806ceb0 tx=0x7efc48009bf0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 -- 172.21.15.45:0/4228154015 shutdown_connections 2023-12-19T17:53:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 --2- 172.21.15.45:0/4228154015 >> v2:172.21.15.73:3300/0 conn(0x7efc580cdc90 0x7efc580cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 --2- 172.21.15.45:0/4228154015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc580cd830 0x7efc580ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 --2- 172.21.15.45:0/4228154015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc581592b0 0x7efc5815a1c0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 -- 172.21.15.45:0/4228154015 >> 172.21.15.45:0/4228154015 conn(0x7efc580cbb40 msgr2=0x7efc580cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 -- 172.21.15.45:0/4228154015 shutdown_connections 2023-12-19T17:53:59.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.516+0000 7efc5759e700 1 -- 172.21.15.45:0/4228154015 wait complete. 2023-12-19T17:53:59.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 Processor -- start 2023-12-19T17:53:59.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 -- start start 2023-12-19T17:53:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc580cd830 0x7efc580c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 0x7efc5806f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc581592b0 0x7efc58149ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc580c5af0 con 0x7efc580cdc90 2023-12-19T17:53:59.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc580c5810 con 0x7efc580cd830 2023-12-19T17:53:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc5759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc580c2d00 con 0x7efc581592b0 2023-12-19T17:53:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc55d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 0x7efc5806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc55d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 0x7efc5806f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43148/0 (socket says 172.21.15.45:43148) 2023-12-19T17:53:59.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.520+0000 7efc55d9b700 1 -- 172.21.15.45:0/3660628978 learned_addr learned my addr 172.21.15.45:0/3660628978 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc5659c700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc580cd830 0x7efc580c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc56d9d700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc581592b0 0x7efc58149ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc55d9b700 1 -- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc581592b0 msgr2=0x7efc58149ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc55d9b700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc581592b0 0x7efc58149ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc55d9b700 1 -- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc580cd830 msgr2=0x7efc580c6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc55d9b700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc580cd830 0x7efc580c6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc55d9b700 1 -- 172.21.15.45:0/3660628978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc48009570 con 0x7efc580cdc90 2023-12-19T17:53:59.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc55d9b700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 0x7efc5806f840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00ebe0 tx=0x7efc4c00eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c009740 con 0x7efc580cdc90 2023-12-19T17:53:59.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc4c00c850 con 0x7efc580cdc90 2023-12-19T17:53:59.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc580c2fe0 con 0x7efc580cdc90 2023-12-19T17:53:59.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc4c00cbe0 con 0x7efc580cdc90 2023-12-19T17:53:59.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc580c32c0 con 0x7efc580cdc90 2023-12-19T17:53:59.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.524+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc58067760 con 0x7efc580cdc90 2023-12-19T17:53:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.528+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efc4c00cd40 con 0x7efc580cdc90 2023-12-19T17:53:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.528+0000 7efc46ffd700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc38065ad0 0x7efc38067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.528+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7efc4c0835b0 con 0x7efc580cdc90 2023-12-19T17:53:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.528+0000 7efc5659c700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc38065ad0 0x7efc38067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.532+0000 7efc5659c700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc38065ad0 0x7efc38067f90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc48000c00 tx=0x7efc48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.536+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efc4c050bc0 con 0x7efc580cdc90 2023-12-19T17:53:59.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.748+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efc58070390 con 0x7efc580cdc90 2023-12-19T17:53:59.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.748+0000 7efc46ffd700 1 -- 172.21.15.45:0/3660628978 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4701 (secure 0 0 0) 0x7efc4c0541e0 con 0x7efc580cdc90 2023-12-19T17:53:59.753 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:59.753 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5398,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1022171082","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1022171082},{"type":"v1","addr":"172.21.15.73:6834","nonce":1022171082}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5436,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/4216208538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":4216208538},{"type":"v1","addr":"172.21.15.45:6836","nonce":4216208538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5439,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/430539147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":430539147},{"type":"v1","addr":"172.21.15.45:6837","nonce":430539147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":55247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3331996662","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3331996662},{"type":"v1","addr":"172.21.15.73:6835","nonce":3331996662}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:53:57.501240+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc38065ad0 msgr2=0x7efc38067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc38065ad0 0x7efc38067f90 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7efc48000c00 tx=0x7efc48008030 comp rx=0 tx=0).stop 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 msgr2=0x7efc5806f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 0x7efc5806f840 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7efc4c00ebe0 tx=0x7efc4c00eef0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 shutdown_connections 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc38065ad0 0x7efc38067f90 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc581592b0 0x7efc58149ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc580cdc90 0x7efc5806f840 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 --2- 172.21.15.45:0/3660628978 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc580cd830 0x7efc580c6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 >> 172.21.15.45:0/3660628978 conn(0x7efc580cbb40 msgr2=0x7efc580aef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 shutdown_connections 2023-12-19T17:53:59.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.752+0000 7efc5759e700 1 -- 172.21.15.45:0/3660628978 wait complete. 2023-12-19T17:53:59.758 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 22 2023-12-19T17:53:59.778 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset session 2023-12-19T17:53:59.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 -- start start 2023-12-19T17:53:59.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 Processor -- start 2023-12-19T17:53:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da3bf800 0x5600da464580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da3bf400 0x5600da464b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 0x5600da465080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600da3f5e00 con 0x5600da3bf000 2023-12-19T17:53:59.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600da43ea00 con 0x5600da3bf400 2023-12-19T17:53:59.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600da43e640 con 0x5600da3bf800 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ac38f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 0x5600da465080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ac38f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 0x5600da465080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43154/0 (socket says 172.21.15.45:43154) 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ac38f700 1 -- 172.21.15.45:0/4219801468 learned_addr learned my addr 172.21.15.45:0/4219801468 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57abb8e700 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da3bf800 0x5600da464580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.836+0000 7f57ab38d700 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da3bf400 0x5600da464b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57abb8e700 1 -- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da3bf400 msgr2=0x5600da464b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57abb8e700 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da3bf400 0x5600da464b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57abb8e700 1 -- 172.21.15.45:0/4219801468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 msgr2=0x5600da465080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57abb8e700 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 0x5600da465080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57abb8e700 1 -- 172.21.15.45:0/4219801468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600da3e0b60 con 0x5600da3bf800 2023-12-19T17:53:59.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ac38f700 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 0x5600da465080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:59.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57abb8e700 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da3bf800 0x5600da464580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5600db198b70 tx=0x5600db130e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5bd19d4ace4f2b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57a9389700 1 -- 172.21.15.45:0/4219801468 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600da3ef600 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57a9389700 1 -- 172.21.15.45:0/4219801468 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600da40a900 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57a9389700 1 -- 172.21.15.45:0/4219801468 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600da3ef1e0 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600da3e0340 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5600da3e0000 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 4 waiting for MDS map... 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57a9389700 1 -- 172.21.15.45:0/4219801468 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x5600da3f8c40 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57a9389700 1 -- 172.21.15.45:0/4219801468 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x5600db1a6000 con 0x5600da3bf800 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 4 Got MDS map 22 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 10 main: main 2023-12-19T17:53:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 4 main: connecting to RADOS... 2023-12-19T17:53:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 1 Processor -- start 2023-12-19T17:53:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.840+0000 7f57ad3d4380 1 -- start start 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2800 0x5600da465600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 0x5600da465b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600da43e500 con 0x5600da6b2c00 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600da43e3c0 con 0x5600da6b3000 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600da43ea00 con 0x5600da6b2800 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 0x5600da465b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 0x5600da465b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43168/0 (socket says 172.21.15.45:43168) 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 -- 172.21.15.45:0/1058997992 learned_addr learned my addr 172.21.15.45:0/1058997992 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ab38d700 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ac38f700 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2800 0x5600da465600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 -- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2800 msgr2=0x5600da465600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2800 0x5600da465600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 -- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 msgr2=0x5600da466100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 -- 172.21.15.45:0/1058997992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600da3e0ea0 con 0x5600da6b2c00 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57abb8e700 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 0x5600da465b80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5600db19c090 tx=0x5600db130d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8073e6b672d2de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57a7385700 1 -- 172.21.15.45:0/1058997992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600da3eef20 con 0x5600da6b2c00 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57a7385700 1 -- 172.21.15.45:0/1058997992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600db1a4300 con 0x5600da6b2c00 2023-12-19T17:53:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57a7385700 1 -- 172.21.15.45:0/1058997992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600da3ef600 con 0x5600da6b2c00 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- 172.21.15.45:0/1058997992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 msgr2=0x5600da465b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 0x5600da465b80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x5600db19c090 tx=0x5600db130d80 comp rx=0 tx=0).stop 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- 172.21.15.45:0/1058997992 shutdown_connections 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2c00 0x5600da465b80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/1058997992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2800 0x5600da465600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- 172.21.15.45:0/1058997992 >> 172.21.15.45:0/1058997992 conn(0x5600da3bec00 msgr2=0x5600da48d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- 172.21.15.45:0/1058997992 shutdown_connections 2023-12-19T17:53:59.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.844+0000 7f57ad3d4380 1 -- 172.21.15.45:0/1058997992 wait complete. 2023-12-19T17:53:59.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 Processor -- start 2023-12-19T17:53:59.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 -- start start 2023-12-19T17:53:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2800 0x5600da467180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2c00 0x5600da466c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600da43e280 con 0x5600da6b2800 2023-12-19T17:53:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600da43e140 con 0x5600da6b3000 2023-12-19T17:53:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ad3d4380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600da43e000 con 0x5600da6b2c00 2023-12-19T17:53:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2800 0x5600da467180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2800 0x5600da467180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43174/0 (socket says 172.21.15.45:43174) 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 -- 172.21.15.45:0/3468128953 learned_addr learned my addr 172.21.15.45:0/3468128953 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57abb8e700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2c00 0x5600da466c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ab38d700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 -- 172.21.15.45:0/3468128953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2c00 msgr2=0x5600da466c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da6b2c00 0x5600da466c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 -- 172.21.15.45:0/3468128953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 msgr2=0x5600da466680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da6b3000 0x5600da466680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.848+0000 7f57ac38f700 1 -- 172.21.15.45:0/3468128953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600da3e0b60 con 0x5600da6b2800 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57ac38f700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2800 0x5600da467180 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x5600db19ced0 tx=0x5600da6c0e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57a5b82700 1 -- 172.21.15.45:0/3468128953 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600da3eef20 con 0x5600da6b2800 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57a5b82700 1 -- 172.21.15.45:0/3468128953 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600db1a5680 con 0x5600da6b2800 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5600da3e0340 con 0x5600da6b2800 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57a5b82700 1 -- 172.21.15.45:0/3468128953 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600da3ef600 con 0x5600da6b2800 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600da3e0000 con 0x5600da6b2800 2023-12-19T17:53:59.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57ad3d4380 4 main: resolving pool 5 2023-12-19T17:53:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.852+0000 7f57a5b82700 1 -- 172.21.15.45:0/3468128953 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5600da43c840 con 0x5600da6b2800 2023-12-19T17:53:59.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57a5b82700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5600da722800 0x5600da467700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57a5b82700 1 -- 172.21.15.45:0/3468128953 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x5600da3f8a80 con 0x5600da6b2800 2023-12-19T17:53:59.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57ad3d4380 4 main: creating IoCtx.. 2023-12-19T17:53:59.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57abb8e700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5600da722800 0x5600da467700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5600da6b3400 0x5600da466100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 5.b 5:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x5600da6b3800 con 0x5600da6b3400 2023-12-19T17:53:59.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57ab38d700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5600da6b3400 0x5600da466100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57abb8e700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5600da722800 0x5600da467700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5600db19c090 tx=0x5600da6c0c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.856+0000 7f57ab38d700 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5600da6b3400 0x5600da466100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ab38d700 1 -- 172.21.15.45:0/3468128953 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v46'5 uv5 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x5600db12eb40 con 0x5600da6b3400 2023-12-19T17:53:59.864 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:53:59.864 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T17:53:59.864 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T17:53:59.864 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T17:53:59.865 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:53:59.865 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:53:59.865 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5600da6b3400 msgr2=0x5600da466100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5600da6b3400 0x5600da466100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5600da722800 msgr2=0x5600da467700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5600da722800 0x5600da467700 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x5600db19c090 tx=0x5600da6c0c00 comp rx=0 tx=0).stop 2023-12-19T17:53:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2800 msgr2=0x5600da467180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/3468128953 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da6b2800 0x5600da467180 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x5600db19ced0 tx=0x5600da6c0e40 comp rx=0 tx=0).stop 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ab38d700 1 -- 172.21.15.45:0/3468128953 reap_dead start 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 shutdown_connections 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 >> 172.21.15.45:0/3468128953 conn(0x5600da3bec00 msgr2=0x5600da48d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 shutdown_connections 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/3468128953 wait complete. 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da3bf800 msgr2=0x5600da464580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da3bf800 0x5600da464580 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x5600db198b70 tx=0x5600db130e40 comp rx=0 tx=0).stop 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 shutdown_connections 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5600da3bf000 0x5600da465080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5600da3bf400 0x5600da464b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 --2- 172.21.15.45:0/4219801468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5600da3bf800 0x5600da464580 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 >> 172.21.15.45:0/4219801468 conn(0x5600da3bfc00 msgr2=0x5600da48d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 shutdown_connections 2023-12-19T17:53:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.860+0000 7f57ad3d4380 1 -- 172.21.15.45:0/4219801468 wait complete. 2023-12-19T17:53:59.873 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'session'] in time 0:00:00.095374, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T17:53:59.874 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset snap 2023-12-19T17:53:59.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.928+0000 7f6d0ed95380 1 -- start start 2023-12-19T17:53:59.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.928+0000 7f6d0ed95380 1 Processor -- start 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcaf4b800 0x55fdcaff0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcaf4b400 0x55fdcaff0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 0x55fdcaff1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafca780 con 0x55fdcaf4b000 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafcaa00 con 0x55fdcaf4b400 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafca640 con 0x55fdcaf4b800 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 0x55fdcaff1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 0x55fdcaff1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43190/0 (socket says 172.21.15.45:43190) 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 -- 172.21.15.45:0/430711269 learned_addr learned my addr 172.21.15.45:0/430711269 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcaf4b800 0x55fdcaff0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcaf4b400 0x55fdcaff0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 -- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcaf4b800 msgr2=0x55fdcaff0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcaf4b800 0x55fdcaff0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 -- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcaf4b400 msgr2=0x55fdcaff0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcaf4b400 0x55fdcaff0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 -- 172.21.15.45:0/430711269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdcaf6cb60 con 0x55fdcaf4b000 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0dd50700 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 0x55fdcaff1080 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd28c30 tx=0x55fdcbd4cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936641516efdf8cc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ad4a700 1 -- 172.21.15.45:0/430711269 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fdcaf7b080 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ad4a700 1 -- 172.21.15.45:0/430711269 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fdcbd46300 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ad4a700 1 -- 172.21.15.45:0/430711269 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fdcaf7b600 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdcaf6d1e0 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fdcaf6cb60 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 4 waiting for MDS map... 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ad4a700 1 -- 172.21.15.45:0/430711269 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55fdcaf84c40 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ad4a700 1 -- 172.21.15.45:0/430711269 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x55fdcaf8cf00 con 0x55fdcaf4b000 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 4 Got MDS map 22 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 10 main: main 2023-12-19T17:53:59.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.932+0000 7f6d0ed95380 4 main: connecting to RADOS... 2023-12-19T17:53:59.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 Processor -- start 2023-12-19T17:53:59.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 -- start start 2023-12-19T17:53:59.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 0x55fdcaff1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23cc00 0x55fdcaff2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdcaf81e00 con 0x55fdcb23c800 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafcaa00 con 0x55fdcb23c400 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafca780 con 0x55fdcb23cc00 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 0x55fdcaff1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 0x55fdcaff1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43200/0 (socket says 172.21.15.45:43200) 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 -- 172.21.15.45:0/923785849 learned_addr learned my addr 172.21.15.45:0/923785849 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23cc00 0x55fdcaff2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 -- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23cc00 msgr2=0x55fdcaff2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23cc00 0x55fdcaff2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 -- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 msgr2=0x55fdcaff1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0d54f700 1 -- 172.21.15.45:0/923785849 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdcaf6c340 con 0x55fdcb23c800 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.936+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23cc00 0x55fdcaff2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:53:59.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 0x55fdcaff1b80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd26150 tx=0x55fdcb24ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eea41e22f6f08df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d08d46700 1 -- 172.21.15.45:0/923785849 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fdcaf7b080 con 0x55fdcb23c800 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d08d46700 1 -- 172.21.15.45:0/923785849 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fdcbd46a80 con 0x55fdcb23c800 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d08d46700 1 -- 172.21.15.45:0/923785849 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fdcaf7b600 con 0x55fdcb23c800 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- 172.21.15.45:0/923785849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 msgr2=0x55fdcaff1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 0x55fdcaff1b80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd26150 tx=0x55fdcb24ad20 comp rx=0 tx=0).stop 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- 172.21.15.45:0/923785849 shutdown_connections 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23cc00 0x55fdcaff2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23c800 0x55fdcaff1b80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/923785849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- 172.21.15.45:0/923785849 >> 172.21.15.45:0/923785849 conn(0x55fdcaf4ac00 msgr2=0x55fdcb019800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- 172.21.15.45:0/923785849 shutdown_connections 2023-12-19T17:53:59.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- 172.21.15.45:0/923785849 wait complete. 2023-12-19T17:53:59.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 Processor -- start 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- start start 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23c800 0x55fdcaff2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23cc00 0x55fdcaff2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafca500 con 0x55fdcb23cc00 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafca3c0 con 0x55fdcb23c400 2023-12-19T17:53:59.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.940+0000 7f6d0ed95380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fdcafca280 con 0x55fdcb23c800 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23c800 0x55fdcaff2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0cd4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23cc00 0x55fdcaff2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23c800 0x55fdcaff2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38380/0 (socket says 172.21.15.45:38380) 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 -- 172.21.15.45:0/1682811275 learned_addr learned my addr 172.21.15.45:0/1682811275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 -- 172.21.15.45:0/1682811275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 msgr2=0x55fdcaff3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcb23c400 0x55fdcaff3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 -- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23cc00 msgr2=0x55fdcaff2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23cc00 0x55fdcaff2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 -- 172.21.15.45:0/1682811275 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fdcaf6c000 con 0x55fdcb23c800 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcb23cc00 0x55fdcaff2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0d54f700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23c800 0x55fdcaff2c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd26e10 tx=0x55fdcb021260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d07543700 1 -- 172.21.15.45:0/1682811275 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fdcaf7adc0 con 0x55fdcb23c800 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d07543700 1 -- 172.21.15.45:0/1682811275 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fdcaf96480 con 0x55fdcb23c800 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fdcaf6cea0 con 0x55fdcb23c800 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d07543700 1 -- 172.21.15.45:0/1682811275 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fdcaf7b080 con 0x55fdcb23c800 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fdcaf6d520 con 0x55fdcb23c800 2023-12-19T17:53:59.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.944+0000 7f6d0ed95380 4 main: resolving pool 5 2023-12-19T17:53:59.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d07543700 1 -- 172.21.15.45:0/1682811275 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55fdcafc8840 con 0x55fdcb23c800 2023-12-19T17:53:59.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d07543700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55fdcb2b6400 0x55fdcaff3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d07543700 1 -- 172.21.15.45:0/1682811275 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55fdcaf84a80 con 0x55fdcb23c800 2023-12-19T17:53:59.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d0ed95380 4 main: creating IoCtx.. 2023-12-19T17:53:59.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55fdcb2b6400 0x55fdcaff3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55fdcb23d000 0x55fdcaff2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:53:59.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 5.d 5:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55fdcb23d400 con 0x55fdcb23d000 2023-12-19T17:53:59.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.948+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55fdcb23d000 0x55fdcaff2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:53:59.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.952+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55fdcb2b6400 0x55fdcaff3700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd28b10 tx=0x55fdcb24ade0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.952+0000 7f6d0cd4e700 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55fdcb23d000 0x55fdcaff2100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:53:59.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0cd4e700 1 -- 172.21.15.45:0/1682811275 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v46'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55fdcbcc0b40 con 0x55fdcb23d000 2023-12-19T17:53:59.959 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:53:59.959 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T17:53:59.959 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:53:59.959 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55fdcb23d000 msgr2=0x55fdcaff2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55fdcb23d000 0x55fdcaff2100 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55fdcb2b6400 msgr2=0x55fdcaff3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55fdcb2b6400 0x55fdcaff3700 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd28b10 tx=0x55fdcb24ade0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23c800 msgr2=0x55fdcaff2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/1682811275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcb23c800 0x55fdcaff2c00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd26e10 tx=0x55fdcb021260 comp rx=0 tx=0).stop 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0d54f700 1 -- 172.21.15.45:0/1682811275 reap_dead start 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 shutdown_connections 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 >> 172.21.15.45:0/1682811275 conn(0x55fdcaf4ac00 msgr2=0x55fdcb019800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 shutdown_connections 2023-12-19T17:53:59.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/1682811275 wait complete. 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 msgr2=0x55fdcaff1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 0x55fdcaff1080 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x55fdcbd28c30 tx=0x55fdcbd4cc60 comp rx=0 tx=0).stop 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 shutdown_connections 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55fdcaf4b000 0x55fdcaff1080 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55fdcaf4b400 0x55fdcaff0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 --2- 172.21.15.45:0/430711269 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55fdcaf4b800 0x55fdcaff0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 >> 172.21.15.45:0/430711269 conn(0x55fdcaf4bc00 msgr2=0x55fdcb019000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 shutdown_connections 2023-12-19T17:53:59.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:53:59.956+0000 7f6d0ed95380 1 -- 172.21.15.45:0/430711269 wait complete. 2023-12-19T17:53:59.967 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'snap'] in time 0:00:00.093851, result: { "result": 0 } 2023-12-19T17:53:59.968 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset inode 2023-12-19T17:54:00.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.024+0000 7fbe00939380 1 -- start start 2023-12-19T17:54:00.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.024+0000 7fbe00939380 1 Processor -- start 2023-12-19T17:54:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 0x562d0980e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09769400 0x562d0980eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09769800 0x562d0980f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8a00 con 0x562d09769000 2023-12-19T17:54:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8780 con 0x562d09769800 2023-12-19T17:54:00.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8640 con 0x562d09769400 2023-12-19T17:54:00.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 0x562d0980e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 0x562d0980e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43204/0 (socket says 172.21.15.45:43204) 2023-12-19T17:54:00.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 -- 172.21.15.45:0/2255703390 learned_addr learned my addr 172.21.15.45:0/2255703390 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09769800 0x562d0980f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdfe8f2700 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09769400 0x562d0980eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 -- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09769400 msgr2=0x562d0980eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09769400 0x562d0980eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 -- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09769800 msgr2=0x562d0980f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09769800 0x562d0980f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 -- 172.21.15.45:0/2255703390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d0978ab60 con 0x562d09769000 2023-12-19T17:54:00.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 0x562d0980e580 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x562d0a544780 tx=0x562d0a552060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ae020bb75a8087 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdfc8ee700 1 -- 172.21.15.45:0/2255703390 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562d09799080 con 0x562d09769000 2023-12-19T17:54:00.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdfc8ee700 1 -- 172.21.15.45:0/2255703390 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562d0a55e300 con 0x562d09769000 2023-12-19T17:54:00.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdfc8ee700 1 -- 172.21.15.45:0/2255703390 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562d09799600 con 0x562d09769000 2023-12-19T17:54:00.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d0978b1e0 con 0x562d09769000 2023-12-19T17:54:00.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562d0978ab60 con 0x562d09769000 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbe00939380 4 waiting for MDS map... 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdfc8ee700 1 -- 172.21.15.45:0/2255703390 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x562d097a2c40 con 0x562d09769000 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.028+0000 7fbdfc8ee700 1 -- 172.21.15.45:0/2255703390 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x562d097aaf00 con 0x562d09769000 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 4 Got MDS map 22 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 10 main: main 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 4 main: connecting to RADOS... 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 Processor -- start 2023-12-19T17:54:00.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 -- start start 2023-12-19T17:54:00.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d0980f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d0980fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d0979fe00 con 0x562d09aac400 2023-12-19T17:54:00.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8780 con 0x562d09aacc00 2023-12-19T17:54:00.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbe00939380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8a00 con 0x562d09aac800 2023-12-19T17:54:00.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbdff8f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d0980f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbdff8f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d0980f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43210/0 (socket says 172.21.15.45:43210) 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbdff8f4700 1 -- 172.21.15.45:0/475292841 learned_addr learned my addr 172.21.15.45:0/475292841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d0980fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.032+0000 7fbdfe8f2700 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff8f4700 1 -- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 msgr2=0x562d0980fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d0980fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff8f4700 1 -- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 msgr2=0x562d09810100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff8f4700 1 -- 172.21.15.45:0/475292841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d0978a340 con 0x562d09aac400 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d0980fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d0980f600 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x562d0a545c80 tx=0x562d0a54ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8312907b634f068b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdfa8ea700 1 -- 172.21.15.45:0/475292841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562d09799080 con 0x562d09aac400 2023-12-19T17:54:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdfa8ea700 1 -- 172.21.15.45:0/475292841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562d0a55f080 con 0x562d09aac400 2023-12-19T17:54:00.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbdfa8ea700 1 -- 172.21.15.45:0/475292841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562d09799600 con 0x562d09aac400 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 -- 172.21.15.45:0/475292841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 msgr2=0x562d0980f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d0980f600 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x562d0a545c80 tx=0x562d0a54ac00 comp rx=0 tx=0).stop 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 -- 172.21.15.45:0/475292841 shutdown_connections 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d0980fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 --2- 172.21.15.45:0/475292841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d0980f600 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 -- 172.21.15.45:0/475292841 >> 172.21.15.45:0/475292841 conn(0x562d09aac000 msgr2=0x562d09825800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 -- 172.21.15.45:0/475292841 shutdown_connections 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 -- 172.21.15.45:0/475292841 wait complete. 2023-12-19T17:54:00.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 Processor -- start 2023-12-19T17:54:00.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.036+0000 7fbe00939380 1 -- start start 2023-12-19T17:54:00.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d09811180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d09810c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8500 con 0x562d09aac400 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d097e83c0 con 0x562d09aacc00 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562d097e8280 con 0x562d09aac800 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d09811180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d09811180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43226/0 (socket says 172.21.15.45:43226) 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 -- 172.21.15.45:0/3612761550 learned_addr learned my addr 172.21.15.45:0/3612761550 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d09810c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdfe8f2700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 -- 172.21.15.45:0/3612761550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 msgr2=0x562d09810c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09aac800 0x562d09810c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 -- 172.21.15.45:0/3612761550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 msgr2=0x562d09810680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09aacc00 0x562d09810680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 -- 172.21.15.45:0/3612761550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d0978a000 con 0x562d09aac400 2023-12-19T17:54:00.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdff8f4700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d09811180 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x562d09ad0c00 tx=0x562d0a552000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdf90e7700 1 -- 172.21.15.45:0/3612761550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562d09798dc0 con 0x562d09aac400 2023-12-19T17:54:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdf90e7700 1 -- 172.21.15.45:0/3612761550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562d0a55e480 con 0x562d09aac400 2023-12-19T17:54:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562d0978aea0 con 0x562d09aac400 2023-12-19T17:54:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbdf90e7700 1 -- 172.21.15.45:0/3612761550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562d09799080 con 0x562d09aac400 2023-12-19T17:54:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562d0978b520 con 0x562d09aac400 2023-12-19T17:54:00.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.040+0000 7fbe00939380 4 main: resolving pool 5 2023-12-19T17:54:00.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbdf90e7700 1 -- 172.21.15.45:0/3612761550 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x562d097e6840 con 0x562d09aac400 2023-12-19T17:54:00.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbdf90e7700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562d09aad400 0x562d09811700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbdf90e7700 1 -- 172.21.15.45:0/3612761550 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x562d097a2a80 con 0x562d09aac400 2023-12-19T17:54:00.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbe00939380 4 main: creating IoCtx.. 2023-12-19T17:54:00.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562d09aad400 0x562d09811700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbe00939380 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562d09aad800 0x562d09810100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 5.13 5:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562d09aadc00 con 0x562d09aad800 2023-12-19T17:54:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.044+0000 7fbdfe8f2700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562d09aad800 0x562d09810100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbdff0f3700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562d09aad400 0x562d09811700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x562d0a544ab0 tx=0x562d0a552180 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbdfe8f2700 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562d09aad800 0x562d09810100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbdfe8f2700 1 -- 172.21.15.45:0/3612761550 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v46'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x562d0a5eeb40 con 0x562d09aad800 2023-12-19T17:54:00.054 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:54:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T17:54:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T17:54:00.054 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T17:54:00.055 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:54:00.055 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:54:00.055 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:54:00.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562d09aad800 msgr2=0x562d09810100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbe00939380 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562d09aad800 0x562d09810100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562d09aad400 msgr2=0x562d09811700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbe00939380 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562d09aad400 0x562d09811700 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x562d0a544ab0 tx=0x562d0a552180 comp rx=0 tx=0).stop 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 msgr2=0x562d09811180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbe00939380 1 --2- 172.21.15.45:0/3612761550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09aac400 0x562d09811180 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x562d09ad0c00 tx=0x562d0a552000 comp rx=0 tx=0).stop 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.048+0000 7fbdfe8f2700 1 -- 172.21.15.45:0/3612761550 reap_dead start 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 shutdown_connections 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 >> 172.21.15.45:0/3612761550 conn(0x562d09aac000 msgr2=0x562d09825800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 shutdown_connections 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/3612761550 wait complete. 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 msgr2=0x562d0980e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 0x562d0980e580 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x562d0a544780 tx=0x562d0a552060 comp rx=0 tx=0).stop 2023-12-19T17:54:00.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 shutdown_connections 2023-12-19T17:54:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562d09769800 0x562d0980f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562d09769400 0x562d0980eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 --2- 172.21.15.45:0/2255703390 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562d09769000 0x562d0980e580 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 >> 172.21.15.45:0/2255703390 conn(0x562d09768c00 msgr2=0x562d09825000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 shutdown_connections 2023-12-19T17:54:00.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.052+0000 7fbe00939380 1 -- 172.21.15.45:0/2255703390 wait complete. 2023-12-19T17:54:00.063 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'inode'] in time 0:00:00.095386, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T17:54:00.063 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2023-12-19T17:54:00.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.128+0000 7f92f4397380 1 -- start start 2023-12-19T17:54:00.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 Processor -- start 2023-12-19T17:54:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 0x55bf4996c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf498c7400 0x55bf4996cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf498c7000 0x55bf4996d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946a00 con 0x55bf498c7800 2023-12-19T17:54:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946780 con 0x55bf498c7000 2023-12-19T17:54:00.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946640 con 0x55bf498c7400 2023-12-19T17:54:00.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 0x55bf4996c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 0x55bf4996c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43252/0 (socket says 172.21.15.45:43252) 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 -- 172.21.15.45:0/3961045411 learned_addr learned my addr 172.21.15.45:0/3961045411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f3352700 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf498c7000 0x55bf4996d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2350700 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf498c7400 0x55bf4996cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 -- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf498c7400 msgr2=0x55bf4996cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf498c7400 0x55bf4996cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 -- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf498c7000 msgr2=0x55bf4996d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf498c7000 0x55bf4996d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 -- 172.21.15.45:0/3961045411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf498e8b60 con 0x55bf498c7800 2023-12-19T17:54:00.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 0x55bf4996c580 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55bf4a6a0d80 tx=0x55bf4a6a6c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be509eb4c4874fba server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f034c700 1 -- 172.21.15.45:0/3961045411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f7600 con 0x55bf498c7800 2023-12-19T17:54:00.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f034c700 1 -- 172.21.15.45:0/3961045411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf49912180 con 0x55bf498c7800 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f034c700 1 -- 172.21.15.45:0/3961045411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f71e0 con 0x55bf498c7800 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf498e8340 con 0x55bf498c7800 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55bf498e8000 con 0x55bf498c7800 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.132+0000 7f92f4397380 4 waiting for MDS map... 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f034c700 1 -- 172.21.15.45:0/3961045411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55bf49900c40 con 0x55bf498c7800 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f034c700 1 -- 172.21.15.45:0/3961045411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x55bf4a6b2300 con 0x55bf498c7800 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 4 Got MDS map 22 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 10 main: JournalTool::main 2023-12-19T17:54:00.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 4 main: JournalTool: connecting to RADOS... 2023-12-19T17:54:00.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 Processor -- start 2023-12-19T17:54:00.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 -- start start 2023-12-19T17:54:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bba400 0x55bf4996d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 0x55bf4996db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bbac00 0x55bf4996e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf498fde00 con 0x55bf49bba800 2023-12-19T17:54:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946780 con 0x55bf49bba400 2023-12-19T17:54:00.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946500 con 0x55bf49bbac00 2023-12-19T17:54:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f2b51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 0x55bf4996db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f2b51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 0x55bf4996db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43262/0 (socket says 172.21.15.45:43262) 2023-12-19T17:54:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f2b51700 1 -- 172.21.15.45:0/3690612913 learned_addr learned my addr 172.21.15.45:0/3690612913 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f3352700 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bba400 0x55bf4996d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.136+0000 7f92f2350700 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bbac00 0x55bf4996e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2b51700 1 -- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bbac00 msgr2=0x55bf4996e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bbac00 0x55bf4996e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2b51700 1 -- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bba400 msgr2=0x55bf4996d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bba400 0x55bf4996d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2b51700 1 -- 172.21.15.45:0/3690612913 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf498e8ea0 con 0x55bf49bba800 2023-12-19T17:54:00.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2350700 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bbac00 0x55bf4996e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 0x55bf4996db80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55bf49c160f0 tx=0x55bf4a6a6ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4275e4b38a5b0e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92ee348700 1 -- 172.21.15.45:0/3690612913 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f6f20 con 0x55bf49bba800 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92ee348700 1 -- 172.21.15.45:0/3690612913 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf4a6bef00 con 0x55bf49bba800 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92ee348700 1 -- 172.21.15.45:0/3690612913 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f7600 con 0x55bf49bba800 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 -- 172.21.15.45:0/3690612913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 msgr2=0x55bf4996db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 0x55bf4996db80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55bf49c160f0 tx=0x55bf4a6a6ba0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 -- 172.21.15.45:0/3690612913 shutdown_connections 2023-12-19T17:54:00.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bbac00 0x55bf4996e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba800 0x55bf4996db80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 --2- 172.21.15.45:0/3690612913 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bba400 0x55bf4996d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 -- 172.21.15.45:0/3690612913 >> 172.21.15.45:0/3690612913 conn(0x55bf498c6c00 msgr2=0x55bf499b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 -- 172.21.15.45:0/3690612913 shutdown_connections 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 -- 172.21.15.45:0/3690612913 wait complete. 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.140+0000 7f92f4397380 1 Processor -- start 2023-12-19T17:54:00.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 -- start start 2023-12-19T17:54:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 0x55bf4996f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bba800 0x55bf4996ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbac00 0x55bf4996e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf499463c0 con 0x55bf49bba400 2023-12-19T17:54:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946280 con 0x55bf49bbac00 2023-12-19T17:54:00.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946140 con 0x55bf49bba800 2023-12-19T17:54:00.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 0x55bf4996f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 0x55bf4996f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43276/0 (socket says 172.21.15.45:43276) 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 -- 172.21.15.45:0/3582994672 learned_addr learned my addr 172.21.15.45:0/3582994672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f2350700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbac00 0x55bf4996e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bba800 0x55bf4996ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 -- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bba800 msgr2=0x55bf4996ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bba800 0x55bf4996ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 -- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbac00 msgr2=0x55bf4996e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbac00 0x55bf4996e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 -- 172.21.15.45:0/3582994672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf498e8b60 con 0x55bf49bba400 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f2350700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbac00 0x55bf4996e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f3352700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 0x55bf4996f180 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55bf49c17440 tx=0x55bf49bc4e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92ecb45700 1 -- 172.21.15.45:0/3582994672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f6f20 con 0x55bf49bba400 2023-12-19T17:54:00.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92ecb45700 1 -- 172.21.15.45:0/3582994672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf49912180 con 0x55bf49bba400 2023-12-19T17:54:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92ecb45700 1 -- 172.21.15.45:0/3582994672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f7600 con 0x55bf49bba400 2023-12-19T17:54:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bf498e8340 con 0x55bf49bba400 2023-12-19T17:54:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf498e8000 con 0x55bf49bba400 2023-12-19T17:54:00.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.144+0000 7f92f4397380 4 main: JournalTool: resolving pool 5 2023-12-19T17:54:00.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.148+0000 7f92ecb45700 1 -- 172.21.15.45:0/3582994672 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55bf49944840 con 0x55bf49bba400 2023-12-19T17:54:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.148+0000 7f92ecb45700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55bf49d14000 0x55bf4996f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.148+0000 7f92ecb45700 1 -- 172.21.15.45:0/3582994672 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55bf49900a80 con 0x55bf49bba400 2023-12-19T17:54:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.148+0000 7f92f4397380 4 main: JournalTool: creating IoCtx.. 2023-12-19T17:54:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.148+0000 7f92f4397380 4 main: Executing for rank 0 2023-12-19T17:54:00.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.148+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55bf49d14000 0x55bf4996f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f2b51700 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55bf49d14000 0x55bf4996f700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55bf49c160f0 tx=0x55bf49bc4c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 -- start start 2023-12-19T17:54:00.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 Processor -- start 2023-12-19T17:54:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 0x55bf4996e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbb800 0x55bf4996db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49d14400 0x55bf4996d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946280 con 0x55bf49bbb400 2023-12-19T17:54:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946a00 con 0x55bf49bbb800 2023-12-19T17:54:00.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f4397380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bf49946500 con 0x55bf49d14400 2023-12-19T17:54:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f3352700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 0x55bf4996e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.152+0000 7f92f3352700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 0x55bf4996e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43290/0 (socket says 172.21.15.45:43290) 2023-12-19T17:54:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 -- 172.21.15.45:0/2776334361 learned_addr learned my addr 172.21.15.45:0/2776334361 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f2b51700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbb800 0x55bf4996db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f2350700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49d14400 0x55bf4996d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49d14400 msgr2=0x55bf4996d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49d14400 0x55bf4996d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbb800 msgr2=0x55bf4996db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbb800 0x55bf4996db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf49c60ea0 con 0x55bf49bbb400 2023-12-19T17:54:00.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 0x55bf4996e100 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55bf49ce8e40 tx=0x55bf49bc5740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f25b62bed20e6f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92e9b3f700 1 -- 172.21.15.45:0/2776334361 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f6420 con 0x55bf49bbb400 2023-12-19T17:54:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92e9b3f700 1 -- 172.21.15.45:0/2776334361 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bf49912480 con 0x55bf49bbb400 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92e9b3f700 1 -- 172.21.15.45:0/2776334361 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55bf498f66e0 con 0x55bf49bbb400 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bf49c60d00 con 0x55bf49bbb400 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55bf49c60b60 con 0x55bf49bbb400 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f4397380 4 waiting for MDS map... 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92e9b3f700 1 -- 172.21.15.45:0/2776334361 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55bf499008c0 con 0x55bf49bbb400 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92e9b3f700 1 -- 172.21.15.45:0/2776334361 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x55bf49d17b00 con 0x55bf49bbb400 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f4397380 4 Got MDS map 22 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55bf49d14800 0x55bf49d98000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:1 5.f 5:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d14c00 con 0x55bf49d14800 2023-12-19T17:54:00.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.156+0000 7f92f2b51700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55bf49d14800 0x55bf49d98000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.160+0000 7f92f2b51700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55bf49d14800 0x55bf49d98000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=10f84407f294155f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.164+0000 7f92f2b51700 1 -- 172.21.15.45:0/2776334361 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v46'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634b40 con 0x55bf49d14800 2023-12-19T17:54:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.164+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55bf49d15000 0x55bf49d98580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.164+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:2 5.14 5:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d15400 con 0x55bf49d15000 2023-12-19T17:54:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.164+0000 7f92f2350700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55bf49d15000 0x55bf49d98580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.164+0000 7f92f2350700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55bf49d15000 0x55bf49d98580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=2cd8f300fb107297 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f2350700 1 -- 172.21.15.45:0/2776334361 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v46'40 uv40 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634d80 con 0x55bf49d15000 2023-12-19T17:54:00.172 INFO:teuthology.orchestra.run.smithi045.stdout:writing EResetJournal entry 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:3 5.14 5:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d15800 con 0x55bf49d15000 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:4 5.1b 5:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d15c00 con 0x55bf49d14800 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55bf49d7a800 0x55bf49d98b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:5 5.b 5:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d7ac00 con 0x55bf49d7a800 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55bf49d7b000 0x55bf49d99080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:6 5.1f 5:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d7b400 con 0x55bf49d7b000 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55bf49d7b800 0x55bf49d99600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 5.1a 5:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d7bc00 con 0x55bf49d7b800 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55bf49d15400 0x55bf49d99b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:8 5.1e 5:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d15800 con 0x55bf49d15400 2023-12-19T17:54:00.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55bf49d7a800 0x55bf49d98b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f2b51700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55bf49d7b000 0x55bf49d99080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f2350700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55bf49d7b800 0x55bf49d99600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55bf49d15400 0x55bf49d99b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.168+0000 7f92f2350700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55bf49d7b800 0x55bf49d99600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=df7c65a7c1fdd04b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f2b51700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55bf49d7b000 0x55bf49d99080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=8f0d6e123937657b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f2350700 1 -- 172.21.15.45:0/2776334361 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(3 200.00000001 [delete] v46'41 uv40 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634d80 con 0x55bf49d15000 2023-12-19T17:54:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55bf49d7a800 0x55bf49d98b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=cc97f208e4c9f3f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f3352700 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55bf49d15400 0x55bf49d99b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=a60720e7a3e8b0e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f2b51700 1 -- 172.21.15.45:0/2776334361 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(4 200.00000002 [delete] v46'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634b40 con 0x55bf49d14800 2023-12-19T17:54:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92e833c700 1 -- 172.21.15.45:0/2776334361 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:9 5.14 5:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55bf49d14c00 con 0x55bf49d15000 2023-12-19T17:54:00.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f2350700 1 -- 172.21.15.45:0/2776334361 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(7 200.00000005 [delete] v46'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634d80 con 0x55bf49d7b800 2023-12-19T17:54:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f3352700 1 -- 172.21.15.45:0/2776334361 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(8 200.00000006 [delete] v46'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a6358c0 con 0x55bf49d15400 2023-12-19T17:54:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f3352700 1 -- 172.21.15.45:0/2776334361 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(5 200.00000003 [delete] v46'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a6358c0 con 0x55bf49d7a800 2023-12-19T17:54:00.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f2b51700 1 -- 172.21.15.45:0/2776334361 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(6 200.00000004 [delete] v46'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634b40 con 0x55bf49d7b000 2023-12-19T17:54:00.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f2350700 1 -- 172.21.15.45:0/2776334361 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v46'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55bf4a634d80 con 0x55bf49d15000 2023-12-19T17:54:00.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.172+0000 7f92f4397380 4 Successfully wrote new journal pointer and header for rank 2:0 2023-12-19T17:54:00.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55bf49d15400 msgr2=0x55bf49d99b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55bf49d15400 0x55bf49d99b80 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55bf49d7a800 msgr2=0x55bf49d98b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55bf49d7a800 0x55bf49d98b00 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55bf49d15000 msgr2=0x55bf49d98580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55bf49d15000 0x55bf49d98580 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55bf49d14800 msgr2=0x55bf49d98000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55bf49d14800 0x55bf49d98000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f2350700 1 -- 172.21.15.45:0/2776334361 reap_dead start 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55bf49d7b000 msgr2=0x55bf49d99080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55bf49d7b000 0x55bf49d99080 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55bf49d7b800 msgr2=0x55bf49d99600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55bf49d7b800 0x55bf49d99600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 msgr2=0x55bf4996e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 0x55bf4996e100 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x55bf49ce8e40 tx=0x55bf49bc5740 comp rx=0 tx=0).stop 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 shutdown_connections 2023-12-19T17:54:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55bf49d7b800 0x55bf49d99600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55bf49d14800 0x55bf49d98000 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55bf49d7b000 0x55bf49d99080 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/2776334361 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bbb400 0x55bf4996e100 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 >> 172.21.15.45:0/2776334361 conn(0x55bf49bbb000 msgr2=0x55bf499b8000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 shutdown_connections 2023-12-19T17:54:00.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/2776334361 wait complete. 2023-12-19T17:54:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55bf49d14000 msgr2=0x55bf4996f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55bf49d14000 0x55bf4996f700 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55bf49c160f0 tx=0x55bf49bc4c00 comp rx=0 tx=0).stop 2023-12-19T17:54:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 msgr2=0x55bf4996f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 0x55bf4996f180 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55bf49c17440 tx=0x55bf49bc4e40 comp rx=0 tx=0).stop 2023-12-19T17:54:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 shutdown_connections 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55bf49d14000 0x55bf4996f700 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf49bbac00 0x55bf4996e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf49bba800 0x55bf4996ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3582994672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf49bba400 0x55bf4996f180 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 >> 172.21.15.45:0/3582994672 conn(0x55bf498c6c00 msgr2=0x55bf499b7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 shutdown_connections 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3582994672 wait complete. 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 msgr2=0x55bf4996c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 0x55bf4996c580 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x55bf4a6a0d80 tx=0x55bf4a6a6c60 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 shutdown_connections 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55bf498c7000 0x55bf4996d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55bf498c7400 0x55bf4996cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 --2- 172.21.15.45:0/3961045411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55bf498c7800 0x55bf4996c580 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 >> 172.21.15.45:0/3961045411 conn(0x55bf498c7c00 msgr2=0x55bf499b7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 shutdown_connections 2023-12-19T17:54:00.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.176+0000 7f92f4397380 1 -- 172.21.15.45:0/3961045411 wait complete. 2023-12-19T17:54:00.188 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.124673, result: writing EResetJournal entry 2023-12-19T17:54:00.188 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init 2023-12-19T17:54:00.200 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:54:00.246 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:54:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.252+0000 7f5df4e74840 1 -- start start 2023-12-19T17:54:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.252+0000 7f5df4e74840 1 Processor -- start 2023-12-19T17:54:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 0x55a771571080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b2800 0x55a771570b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b2c00 0x55a771570580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a771501e00 con 0x55a7714cbc00 2023-12-19T17:54:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a3c0 con 0x55a7722b2800 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a500 con 0x55a7722b2c00 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 0x55a771571080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 0x55a771571080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43312/0 (socket says 172.21.15.45:43312) 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 -- 172.21.15.45:0/397108803 learned_addr learned my addr 172.21.15.45:0/397108803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df2e2f700 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b2800 0x55a771570b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3e31700 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b2c00 0x55a771570580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 -- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b2c00 msgr2=0x55a771570580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b2c00 0x55a771570580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 -- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b2800 msgr2=0x55a771570b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b2800 0x55a771570b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 -- 172.21.15.45:0/397108803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7714ec000 con 0x55a7714cbc00 2023-12-19T17:54:00.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df3630700 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 0x55a771571080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55a7715d2a20 tx=0x55a77223a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c718db4b457a8af server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df0e2b700 1 -- 172.21.15.45:0/397108803 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a7714fb080 con 0x55a7714cbc00 2023-12-19T17:54:00.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df0e2b700 1 -- 172.21.15.45:0/397108803 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a771516180 con 0x55a7714cbc00 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7714ecb60 con 0x55a7714cbc00 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a7714ed1e0 con 0x55a7714cbc00 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 4 waiting for MDS map... 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df0e2b700 1 -- 172.21.15.45:0/397108803 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a7714fb600 con 0x55a7714cbc00 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df0e2b700 1 -- 172.21.15.45:0/397108803 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55a771504c40 con 0x55a7714cbc00 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df0e2b700 1 -- 172.21.15.45:0/397108803 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x55a77150cf00 con 0x55a7714cbc00 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 4 Got MDS map 22 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 4 datascan.main: Using metadata pool output 2023-12-19T17:54:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.256+0000 7f5df4e74840 4 datascan.main: connecting to RADOS... 2023-12-19T17:54:00.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 Processor -- start 2023-12-19T17:54:00.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 -- start start 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cb400 0x55a771571b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 0x55a771572100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3800 0x55a771572680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a640 con 0x55a7714cb400 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a780 con 0x55a7722b3400 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df4e74840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a77154aa00 con 0x55a7722b3800 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 0x55a771572100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 0x55a771572100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:35442/0 (socket says 172.21.15.45:35442) 2023-12-19T17:54:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 -- 172.21.15.45:0/2704266825 learned_addr learned my addr 172.21.15.45:0/2704266825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cb400 0x55a771571b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df2e2f700 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3800 0x55a771572680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 -- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3800 msgr2=0x55a771572680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3800 0x55a771572680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 -- 172.21.15.45:0/2704266825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cb400 msgr2=0x55a771571b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cb400 0x55a771571b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 -- 172.21.15.45:0/2704266825 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7714ec9c0 con 0x55a7722b3400 2023-12-19T17:54:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5df3630700 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 0x55a771572100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55a7717de8a0 tx=0x55a77223a1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4680e8f0587a882 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.260+0000 7f5deee27700 1 -- 172.21.15.45:0/2704266825 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a7714fb1e0 con 0x55a7722b3400 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5deee27700 1 -- 172.21.15.45:0/2704266825 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a7722b8c00 con 0x55a7722b3400 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5deee27700 1 -- 172.21.15.45:0/2704266825 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a7714fb080 con 0x55a7722b3400 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 msgr2=0x55a771572100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 0x55a771572100 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x55a7717de8a0 tx=0x55a77223a1e0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- 172.21.15.45:0/2704266825 shutdown_connections 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3800 0x55a771572680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b3400 0x55a771572100 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2704266825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cb400 0x55a771571b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- 172.21.15.45:0/2704266825 >> 172.21.15.45:0/2704266825 conn(0x55a7714cb800 msgr2=0x55a7715ba800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- 172.21.15.45:0/2704266825 shutdown_connections 2023-12-19T17:54:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- 172.21.15.45:0/2704266825 wait complete. 2023-12-19T17:54:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 Processor -- start 2023-12-19T17:54:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- start start 2023-12-19T17:54:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7714cb400 0x55a771573700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3400 0x55a771573180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7722b3800 0x55a771572c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a500 con 0x55a7722b3800 2023-12-19T17:54:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a3c0 con 0x55a7714cb400 2023-12-19T17:54:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df4e74840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a77154a280 con 0x55a7722b3400 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7722b3800 0x55a771572c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7722b3800 0x55a771572c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43342/0 (socket says 172.21.15.45:43342) 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 -- 172.21.15.45:0/2778427220 learned_addr learned my addr 172.21.15.45:0/2778427220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7714cb400 0x55a771573700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df3630700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3400 0x55a771573180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 -- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3400 msgr2=0x55a771573180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b3400 0x55a771573180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 -- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7714cb400 msgr2=0x55a771573700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7714cb400 0x55a771573700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df2e2f700 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7714ec000 con 0x55a7722b3800 2023-12-19T17:54:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.264+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7714cb400 0x55a771573700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5df2e2f700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7722b3800 0x55a771572c00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55a7717df6e0 tx=0x55a7717e6e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5ded624700 1 -- 172.21.15.45:0/2778427220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a7714fb1e0 con 0x55a7722b3800 2023-12-19T17:54:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5ded624700 1 -- 172.21.15.45:0/2778427220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a771516180 con 0x55a7722b3800 2023-12-19T17:54:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a7714ecea0 con 0x55a7722b3800 2023-12-19T17:54:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5ded624700 1 -- 172.21.15.45:0/2778427220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a7714fb080 con 0x55a7722b3800 2023-12-19T17:54:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7714ed520 con 0x55a7722b3800 2023-12-19T17:54:00.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5df4e74840 4 datascan.init: resolving metadata pool 5 2023-12-19T17:54:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.268+0000 7f5ded624700 1 -- 172.21.15.45:0/2778427220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55a771528840 con 0x55a7722b3800 2023-12-19T17:54:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5ded624700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a77191c000 0x55a771922000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5ded624700 1 -- 172.21.15.45:0/2778427220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55a771504a80 con 0x55a7722b3800 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df4e74840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a77191c000 0x55a771922000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55a7722b3c00 0x55a771572680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 5.14 5:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a77191c400 con 0x55a7722b3c00 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df3630700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55a7722b3c00 0x55a771572680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a77191c000 0x55a771922000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55a7715d2a50 tx=0x55a77192c000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df3630700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55a7722b3c00 0x55a771572680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df3630700 1 -- 172.21.15.45:0/2778427220 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 160+0+0 (crc 0 0 0) 0x55a772354b40 con 0x55a7722b3c00 2023-12-19T17:54:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.272+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:2 5.14 5:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a77191c800 con 0x55a7722b3c00 2023-12-19T17:54:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df3630700 1 -- 172.21.15.45:0/2778427220 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v46'43 uv43 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x55a772354b40 con 0x55a7722b3c00 2023-12-19T17:54:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a77191cc00 0x55a771572100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:3 5.1f 5:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a77191d000 con 0x55a77191cc00 2023-12-19T17:54:00.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a77191cc00 0x55a771572100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df3e31700 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a77191cc00 0x55a771572100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df3e31700 1 -- 172.21.15.45:0/2778427220 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 162+0+0 (crc 0 0 0) 0x55a772355200 con 0x55a77191cc00 2023-12-19T17:54:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.276+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:4 5.1f 5:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a77191d400 con 0x55a77191cc00 2023-12-19T17:54:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.280+0000 7f5df3e31700 1 -- 172.21.15.45:0/2778427220 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v46'10 uv10 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x55a772355200 con 0x55a77191cc00 2023-12-19T17:54:00.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.280+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 5.13 5:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a77191d800 con 0x55a7722b3c00 2023-12-19T17:54:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.280+0000 7f5df3630700 1 -- 172.21.15.45:0/2778427220 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55a772354b40 con 0x55a7722b3c00 2023-12-19T17:54:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.280+0000 7f5df4e74840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T17:54:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.280+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 5.13 5:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55a77191c400 con 0x55a7722b3c00 2023-12-19T17:54:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df3630700 1 -- 172.21.15.45:0/2778427220 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v46'7 uv7 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x55a772354b40 con 0x55a7722b3c00 2023-12-19T17:54:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2023-12-19T17:54:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55a7722b3c00 msgr2=0x55a771572680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55a7722b3c00 0x55a771572680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a77191cc00 msgr2=0x55a771572100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a77191cc00 0x55a771572100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a77191c000 msgr2=0x55a771922000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a77191c000 0x55a771922000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x55a7715d2a50 tx=0x55a77192c000 comp rx=0 tx=0).stop 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7722b3800 msgr2=0x55a771572c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/2778427220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7722b3800 0x55a771572c00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x55a7717df6e0 tx=0x55a7717e6e40 comp rx=0 tx=0).stop 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df2e2f700 1 -- 172.21.15.45:0/2778427220 reap_dead start 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df2e2f700 1 -- 172.21.15.45:0/2778427220 reap_dead start 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 shutdown_connections 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 >> 172.21.15.45:0/2778427220 conn(0x55a7714cb800 msgr2=0x55a7715ba800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 shutdown_connections 2023-12-19T17:54:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/2778427220 wait complete. 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 msgr2=0x55a771571080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 0x55a771571080 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x55a7715d2a20 tx=0x55a77223a180 comp rx=0 tx=0).stop 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 shutdown_connections 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a7722b2c00 0x55a771570580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a7722b2800 0x55a771570b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 --2- 172.21.15.45:0/397108803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a7714cbc00 0x55a771571080 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 >> 172.21.15.45:0/397108803 conn(0x55a7714cac00 msgr2=0x55a7715bb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 shutdown_connections 2023-12-19T17:54:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.284+0000 7f5df4e74840 1 -- 172.21.15.45:0/397108803 wait complete. 2023-12-19T17:54:00.299 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init'] in time 0:00:00.111298, result: 2023-12-19T17:54:00.300 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents 2023-12-19T17:54:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.412+0000 7f5cec434840 1 -- start start 2023-12-19T17:54:00.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.412+0000 7f5cec434840 1 Processor -- start 2023-12-19T17:54:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1918b800 0x563b19230580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 0x563b19230b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1918b000 0x563b19231080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b191c1e00 con 0x563b1918b400 2023-12-19T17:54:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1920aa00 con 0x563b1918b000 2023-12-19T17:54:00.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b1920a640 con 0x563b1918b800 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 0x563b19230b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 0x563b19230b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43344/0 (socket says 172.21.15.45:43344) 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 -- 172.21.15.45:0/1086805547 learned_addr learned my addr 172.21.15.45:0/1086805547 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1918b800 0x563b19230580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1918b000 0x563b19231080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 -- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1918b800 msgr2=0x563b19230580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1918b800 0x563b19230580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 -- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1918b000 msgr2=0x563b19231080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1918b000 0x563b19231080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 -- 172.21.15.45:0/1086805547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b191acb60 con 0x563b1918b400 2023-12-19T17:54:00.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1918b000 0x563b19231080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 0x563b19230b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x563b19299380 tx=0x563b19280e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb110cc2ac78fafa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ce83eb700 1 -- 172.21.15.45:0/1086805547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563b191bb600 con 0x563b1918b400 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ce83eb700 1 -- 172.21.15.45:0/1086805547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563b191d6900 con 0x563b1918b400 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ce83eb700 1 -- 172.21.15.45:0/1086805547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563b191bb1e0 con 0x563b1918b400 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b191ac340 con 0x563b1918b400 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x563b191ac000 con 0x563b1918b400 2023-12-19T17:54:00.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 4 waiting for MDS map... 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ce83eb700 1 -- 172.21.15.45:0/1086805547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x563b191c4c40 con 0x563b1918b400 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5ce83eb700 1 -- 172.21.15.45:0/1086805547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x563b1a002300 con 0x563b1918b400 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 4 Got MDS map 22 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 4 datascan.main: Using metadata pool output 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.416+0000 7f5cec434840 4 datascan.main: connecting to RADOS... 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 Processor -- start 2023-12-19T17:54:00.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 -- start start 2023-12-19T17:54:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014400 0x563b19231600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 0x563b19231b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014c00 0x563b19232100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1920a500 con 0x563b1a014800 2023-12-19T17:54:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1920a3c0 con 0x563b1a014c00 2023-12-19T17:54:00.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cec434840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b1920aa00 con 0x563b1a014400 2023-12-19T17:54:00.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 0x563b19231b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 0x563b19231b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43360/0 (socket says 172.21.15.45:43360) 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 -- 172.21.15.45:0/2657443074 learned_addr learned my addr 172.21.15.45:0/2657443074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014400 0x563b19231600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014c00 0x563b19232100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 -- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014400 msgr2=0x563b19231600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014400 0x563b19231600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 -- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014c00 msgr2=0x563b19232100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014c00 0x563b19232100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 -- 172.21.15.45:0/2657443074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b191acea0 con 0x563b1a014800 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014400 0x563b19231600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014c00 0x563b19232100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 0x563b19231b80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x563b19482630 tx=0x563b192615c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa8b0afb92de779 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ce63e7700 1 -- 172.21.15.45:0/2657443074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563b191bb080 con 0x563b1a014800 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ce63e7700 1 -- 172.21.15.45:0/2657443074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563b1a000300 con 0x563b1a014800 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.420+0000 7f5ce63e7700 1 -- 172.21.15.45:0/2657443074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563b191bb600 con 0x563b1a014800 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- 172.21.15.45:0/2657443074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 msgr2=0x563b19231b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 0x563b19231b80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x563b19482630 tx=0x563b192615c0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- 172.21.15.45:0/2657443074 shutdown_connections 2023-12-19T17:54:00.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014c00 0x563b19232100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014800 0x563b19231b80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- 172.21.15.45:0/2657443074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014400 0x563b19231600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- 172.21.15.45:0/2657443074 >> 172.21.15.45:0/2657443074 conn(0x563b1918ac00 msgr2=0x563b19259800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- 172.21.15.45:0/2657443074 shutdown_connections 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- 172.21.15.45:0/2657443074 wait complete. 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 Processor -- start 2023-12-19T17:54:00.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- start start 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014400 0x563b19233180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014800 0x563b19232c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014c00 0x563b19232680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1920a280 con 0x563b1a014400 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563b1920a140 con 0x563b1a014800 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cec434840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563b1920a000 con 0x563b1a014c00 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5ceb3f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014400 0x563b19233180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5ceb3f1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014400 0x563b19233180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43370/0 (socket says 172.21.15.45:43370) 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 learned_addr learned my addr 172.21.15.45:0/3459805752 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014800 0x563b19232c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.424+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014c00 0x563b19232680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014800 msgr2=0x563b19232c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1a014800 0x563b19232c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014400 msgr2=0x563b19233180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014400 0x563b19233180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563b191ad1e0 con 0x563b1a014c00 2023-12-19T17:54:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1a014400 0x563b19233180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014c00 0x563b19232680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x563b19483470 tx=0x563b19280c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5ce4be4700 1 -- 172.21.15.45:0/3459805752 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563b191baf20 con 0x563b1a014c00 2023-12-19T17:54:00.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5ce4be4700 1 -- 172.21.15.45:0/3459805752 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563b1a000a80 con 0x563b1a014c00 2023-12-19T17:54:00.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5ce4be4700 1 -- 172.21.15.45:0/3459805752 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563b191bb080 con 0x563b1a014c00 2023-12-19T17:54:00.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563b191acea0 con 0x563b1a014c00 2023-12-19T17:54:00.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563b191acb60 con 0x563b1a014c00 2023-12-19T17:54:00.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.428+0000 7f5cec434840 4 datascan.init: resolving metadata pool 5 2023-12-19T17:54:00.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ce4be4700 1 -- 172.21.15.45:0/3459805752 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x563b191e8840 con 0x563b1a014c00 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ce4be4700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563b194f0400 0x563b19233700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ce4be4700 1 -- 172.21.15.45:0/3459805752 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x563b191c4a80 con 0x563b1a014c00 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 4 datascan.main: data pool 'cephfs_data' has ID 6 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 4 datascan.main: data pool 'cephfs_data_extra' has ID 7 2023-12-19T17:54:00.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:54:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563b1a015000 0x563b19232100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:1 6.0 6:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015400 con 0x563b1a015000 2023-12-19T17:54:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563b194f0400 0x563b19233700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563b1a015000 0x563b19232100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563b194f0400 0x563b19233700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x563b19483410 tx=0x563b19485c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.432+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563b1a015000 0x563b19232100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(1 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ce5be6700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563b194f0800 0x563b195ee000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 6.20 6:04000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f0c00 con 0x563b194f0800 2023-12-19T17:54:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563b194f0800 0x563b195ee000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563b194f0800 0x563b195ee000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(2 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 6.10 6:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1400 con 0x563b1a015000 2023-12-19T17:54:00.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(3 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ce5be6700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563b194f1000 0x563b195ee580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.436+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:4 6.30 6:0c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1400 con 0x563b194f1000 2023-12-19T17:54:00.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563b194f1000 0x563b195ee580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563b194f1000 0x563b195ee580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(4 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 6.8 6:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1c00 con 0x563b194f1000 2023-12-19T17:54:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(5 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ce5be6700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563b194f1800 0x563b195eeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.440+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:6 6.28 6:14000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015400 con 0x563b194f1800 2023-12-19T17:54:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563b194f1800 0x563b195eeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563b194f1800 0x563b195eeb00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(6 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 6.18 6:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fe000 con 0x563b1a015000 2023-12-19T17:54:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(7 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5ce5be6700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563b195fe000 0x563b195ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 6.38 6:1c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b195fe000 2023-12-19T17:54:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563b195fe000 0x563b195ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.444+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563b195fe000 0x563b195ef080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(8 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:9 6.4 6:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fe400 con 0x563b194f0800 2023-12-19T17:54:00.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(9 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ce5be6700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563b194f1400 0x563b195ef600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:10 6.24 6:24000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1c00 con 0x563b194f1400 2023-12-19T17:54:00.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563b194f1400 0x563b195ef600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ceabf0700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563b194f1400 0x563b195ef600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(10 [pgnls start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:11 6.14 6:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fe800 con 0x563b194f1800 2023-12-19T17:54:00.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.448+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(11 [pgnls start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 6.34 6:2c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b1a015000 2023-12-19T17:54:00.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(12 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:13 6.c 6:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff800 con 0x563b195fe000 2023-12-19T17:54:00.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(13 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ce5be6700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563b195fe400 0x563b195efb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:14 6.2c 6:34000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b195fe400 2023-12-19T17:54:00.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563b195fe400 0x563b195efb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5cea3ef700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563b195fe400 0x563b195efb80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(14 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.452+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 6.1c 6:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b194f1000 2023-12-19T17:54:00.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(15 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:16 6.3c 6:3c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b194f1800 2023-12-19T17:54:00.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(16 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ce63e7700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563b195fe800 0x563b195f0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:17 6.2 6:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b195fe800 2023-12-19T17:54:00.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563b195fe800 0x563b195f0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ceb3f1700 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563b195fe800 0x563b195f0100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(17 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.456+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 6.22 6:44000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f0c00 con 0x563b195fe400 2023-12-19T17:54:00.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(18 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 6.12 6:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b194f1000 2023-12-19T17:54:00.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(19 [pgnls start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:20 6.32 6:4c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b195fe800 2023-12-19T17:54:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(20 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:21 6.a 6:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015400 con 0x563b194f1400 2023-12-19T17:54:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(21 [pgnls start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.460+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:22 6.2a 6:54000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b195fe800 2023-12-19T17:54:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.464+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(22 [pgnls start_epoch 46 out=81b] v44'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.464+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:23 6.2a 6:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015800 con 0x563b195fe800 2023-12-19T17:54:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.464+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(23 100000001f6.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.464+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T17:54:00.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.464+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:24 6.2a 6:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff800 con 0x563b195fe800 2023-12-19T17:54:00.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(24 100000001f6.00000000 [call] v46'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:25 6.1a 6:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b195fe800 2023-12-19T17:54:00.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(25 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:26 6.3a 6:5c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b194f0800 2023-12-19T17:54:00.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(26 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 6.6 6:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b195fe000 2023-12-19T17:54:00.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(27 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.468+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:28 6.26 6:64000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1c00 con 0x563b194f0800 2023-12-19T17:54:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(28 [pgnls start_epoch 46 out=49b] v44'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 6.16 6:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620400 con 0x563b1a015000 2023-12-19T17:54:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(29 [pgnls start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:30 6.36 6:6c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b194f1400 2023-12-19T17:54:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(30 [pgnls start_epoch 46 out=101b] v44'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:31 6.36 6:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b194f1400 2023-12-19T17:54:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(31 100000001f9.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T17:54:00.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.472+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:32 6.36 6:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b194f1400 2023-12-19T17:54:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.476+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(32 100000001f9.00000000 [call] v46'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.476+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:33 6.36 6:6fe38dc2::::head [pgnls start_epoch 46 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b194f1400 2023-12-19T17:54:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.480+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(33 [pgnls start_epoch 46 out=81b] v46'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.480+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:34 6.36 6:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b194f1400 2023-12-19T17:54:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.480+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(34 100000001f7.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.480+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T17:54:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.480+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:35 6.36 6:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620400 con 0x563b194f1400 2023-12-19T17:54:00.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.480+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(35 100000001f7.00000000 [call] v46'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:36 6.e 6:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b195fe800 2023-12-19T17:54:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(36 [pgnls start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:37 6.2e 6:74000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620800 con 0x563b195fe400 2023-12-19T17:54:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(37 [pgnls start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:38 6.1e 6:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621800 con 0x563b195fe800 2023-12-19T17:54:00.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(38 [pgnls start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.484+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:39 6.3e 6:7c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620c00 con 0x563b195fe000 2023-12-19T17:54:00.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(39 [pgnls start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:40 6.1 6:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621c00 con 0x563b194f0800 2023-12-19T17:54:00.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(40 [pgnls start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:41 6.21 6:84000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621000 con 0x563b194f1000 2023-12-19T17:54:00.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(41 [pgnls start_epoch 46 out=49b] v44'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:42 6.11 6:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff800 con 0x563b195fe000 2023-12-19T17:54:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(42 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.488+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:43 6.31 6:8c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621400 con 0x563b194f1400 2023-12-19T17:54:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(43 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:44 6.9 6:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b1a015000 2023-12-19T17:54:00.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(44 [pgnls start_epoch 46 out=49b] v44'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:45 6.29 6:94000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620400 con 0x563b194f1000 2023-12-19T17:54:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(45 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:46 6.19 6:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b194f1400 2023-12-19T17:54:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(46 [pgnls start_epoch 46 out=81b] v44'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.492+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:47 6.19 6:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015400 con 0x563b194f1400 2023-12-19T17:54:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.496+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(47 100000001f8.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.496+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T17:54:00.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.496+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:48 6.19 6:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b194f1400 2023-12-19T17:54:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.496+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(48 100000001f8.00000000 [call] v46'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.496+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:49 6.39 6:9c000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b194f1400 2023-12-19T17:54:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 13 ==== osd_op_reply(49 [pgnls start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:50 6.5 6:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015800 con 0x563b194f1000 2023-12-19T17:54:00.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(50 [pgnls start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:51 6.25 6:a4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621000 con 0x563b195fe400 2023-12-19T17:54:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(51 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:52 6.15 6:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c000 con 0x563b194f1000 2023-12-19T17:54:00.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(52 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.500+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:53 6.35 6:ac000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621400 con 0x563b194f1400 2023-12-19T17:54:00.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 14 ==== osd_op_reply(53 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:54 6.d 6:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c400 con 0x563b1a015000 2023-12-19T17:54:00.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(54 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:55 6.2d 6:b4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b194f1800 2023-12-19T17:54:00.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(55 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:56 6.1d 6:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c800 con 0x563b194f0800 2023-12-19T17:54:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(56 [pgnls start_epoch 46 out=49b] v44'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.504+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:57 6.3d 6:bc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621800 con 0x563b1a015000 2023-12-19T17:54:00.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(57 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:58 6.3 6:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962cc00 con 0x563b194f1000 2023-12-19T17:54:00.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(58 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:59 6.23 6:c4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620c00 con 0x563b195fe400 2023-12-19T17:54:00.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(59 [pgnls start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:60 6.13 6:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d000 con 0x563b195fe000 2023-12-19T17:54:00.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(60 [pgnls start_epoch 46 out=49b] v44'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.508+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:61 6.33 6:cc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1c00 con 0x563b194f1400 2023-12-19T17:54:00.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 15 ==== osd_op_reply(61 [pgnls start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:62 6.b 6:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d400 con 0x563b195fe000 2023-12-19T17:54:00.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(62 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:63 6.2b 6:d4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b194f1400 2023-12-19T17:54:00.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 16 ==== osd_op_reply(63 [pgnls start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:64 6.1b 6:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d800 con 0x563b195fe000 2023-12-19T17:54:00.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(64 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.512+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:65 6.3b 6:dc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b194f1800 2023-12-19T17:54:00.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(65 [pgnls start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:66 6.7 6:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962dc00 con 0x563b194f1400 2023-12-19T17:54:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 17 ==== osd_op_reply(66 [pgnls start_epoch 46 out=81b] v44'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:67 6.7 6:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b194f1400 2023-12-19T17:54:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 18 ==== osd_op_reply(67 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5cec434840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T17:54:00.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.516+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:68 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff800 con 0x563b194f1400 2023-12-19T17:54:00.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.520+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 19 ==== osd_op_reply(68 10000000001.00000000 [call] v46'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.520+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:69 6.27 6:e4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621c00 con 0x563b195fe400 2023-12-19T17:54:00.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.520+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(69 [pgnls start_epoch 46 out=49b] v44'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.520+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:70 6.17 6:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c400 con 0x563b195fe800 2023-12-19T17:54:00.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(70 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:71 6.37 6:ec000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620800 con 0x563b1a015000 2023-12-19T17:54:00.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(71 [pgnls start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:72 6.f 6:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015400 con 0x563b194f1800 2023-12-19T17:54:00.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(72 [pgnls start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:73 6.2f 6:f4000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621000 con 0x563b194f1000 2023-12-19T17:54:00.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(73 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.524+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:74 6.1f 6:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015800 con 0x563b195fe000 2023-12-19T17:54:00.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.528+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(74 [pgnls start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.528+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:75 6.3f 6:fc000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b195fe000 2023-12-19T17:54:00.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.528+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(75 [pgnls start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.528+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:76 7.0 7:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b194f1400 2023-12-19T17:54:00.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.528+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 20 ==== osd_op_reply(76 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.528+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:77 7.10 7:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620c00 con 0x563b195fe000 2023-12-19T17:54:00.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(77 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:78 7.8 7:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b194f1800 2023-12-19T17:54:00.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(78 [pgnls start_epoch 46 out=81b] v44'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:79 7.8 7:1247e94b:::100000001f9.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015800 con 0x563b194f1800 2023-12-19T17:54:00.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(79 100000001f9.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628281.1 2023-12-19T17:54:00.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.532+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:80 6.36 6:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c000 con 0x563b194f1400 2023-12-19T17:54:00.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 21 ==== osd_op_reply(80 100000001f9.00000000 [call,setxattr (8)] v46'20 uv20 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:81 7.18 7:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c400 con 0x563b1a015000 2023-12-19T17:54:00.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(81 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:82 7.4 7:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b1a015000 2023-12-19T17:54:00.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(82 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:83 7.14 7:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620400 con 0x563b195fe000 2023-12-19T17:54:00.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(83 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.536+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:84 7.c 7:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b195fe400 2023-12-19T17:54:00.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(84 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:85 7.1c 7:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f0c00 con 0x563b194f1400 2023-12-19T17:54:00.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 22 ==== osd_op_reply(85 [pgnls start_epoch 46 out=81b] v44'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:86 7.1c 7:3d6db04b:::100000001f6.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c800 con 0x563b194f1400 2023-12-19T17:54:00.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 23 ==== osd_op_reply(86 100000001f6.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628278.1 2023-12-19T17:54:00.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.540+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:87 6.2a 6:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962cc00 con 0x563b195fe800 2023-12-19T17:54:00.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(87 100000001f6.00000000 [call,setxattr (8)] v46'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:88 7.2 7:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d000 con 0x563b195fe000 2023-12-19T17:54:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(88 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:89 7.12 7:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015400 con 0x563b195fe400 2023-12-19T17:54:00.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(89 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:90 7.a 7:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1c00 con 0x563b195fe000 2023-12-19T17:54:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(90 [pgnls start_epoch 46 out=81b] v44'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.544+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:91 7.a 7:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d400 con 0x563b195fe000 2023-12-19T17:54:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(91 100000001f6.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T17:54:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:92 6.2a 6:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d800 con 0x563b195fe800 2023-12-19T17:54:00.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(92 100000001f6.00000000 [call,setxattr (8)] v46'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:93 7.1a 7:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962dc00 con 0x563b195fe800 2023-12-19T17:54:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(93 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.548+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:94 7.6 7:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621400 con 0x563b1a015000 2023-12-19T17:54:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(94 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:95 7.16 7:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620800 con 0x563b195fe800 2023-12-19T17:54:00.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(95 [pgnls start_epoch 46 out=101b] v44'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:96 7.16 7:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff800 con 0x563b195fe800 2023-12-19T17:54:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(96 100000001f9.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T17:54:00.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.552+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:97 6.36 6:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff000 con 0x563b194f1400 2023-12-19T17:54:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 24 ==== osd_op_reply(97 100000001f9.00000000 [call,setxattr (8)] v46'21 uv21 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:98 7.16 7:6fe38dc2::::head [pgnls start_epoch 46 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195fec00 con 0x563b195fe800 2023-12-19T17:54:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(98 [pgnls start_epoch 46 out=81b] v44'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:99 7.16 7:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1a015800 con 0x563b195fe800 2023-12-19T17:54:00.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 16 ==== osd_op_reply(99 100000001f7.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T17:54:00.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.556+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:100 6.36 6:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962cc00 con 0x563b194f1400 2023-12-19T17:54:00.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.560+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 25 ==== osd_op_reply(100 100000001f7.00000000 [call,setxattr (8)] v46'22 uv22 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.560+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:101 7.e 7:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d000 con 0x563b194f1800 2023-12-19T17:54:00.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.560+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(101 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b194f1800 2023-12-19T17:54:00.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.560+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:102 7.1e 7:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621800 con 0x563b194f0800 2023-12-19T17:54:00.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(102 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:103 7.1 7:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621000 con 0x563b195fe800 2023-12-19T17:54:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 17 ==== osd_op_reply(103 [pgnls start_epoch 46 out=81b] v44'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:104 7.1 7:848ebb0b:::100000001f7.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d400 con 0x563b195fe800 2023-12-19T17:54:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.4 v2:172.21.15.73:6805/36536 18 ==== osd_op_reply(104 100000001f7.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe800 2023-12-19T17:54:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628279.1 2023-12-19T17:54:00.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.564+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:105 6.36 6:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962d800 con 0x563b194f1400 2023-12-19T17:54:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 26 ==== osd_op_reply(105 100000001f7.00000000 [call,setxattr (8)] v46'23 uv23 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:106 7.11 7:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962dc00 con 0x563b194f1000 2023-12-19T17:54:00.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(106 [pgnls start_epoch 46 out=81b] v44'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:107 7.11 7:893be98d:::100000001f8.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b194f1c00 con 0x563b194f1000 2023-12-19T17:54:00.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(107 100000001f8.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628280.1 2023-12-19T17:54:00.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.568+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:108 6.19 6:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620c00 con 0x563b194f1400 2023-12-19T17:54:00.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.572+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 27 ==== osd_op_reply(108 100000001f8.00000000 [call,setxattr (8)] v46'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.572+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:109 7.9 7:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620400 con 0x563b1a015000 2023-12-19T17:54:00.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.572+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(109 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.572+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:110 7.19 7:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ff400 con 0x563b195fe400 2023-12-19T17:54:00.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.576+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(110 [pgnls start_epoch 46 out=81b] v44'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.576+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:111 7.19 7:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19648000 con 0x563b195fe400 2023-12-19T17:54:00.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.576+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(111 100000001f8.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.576+0000 7f5cec434840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T17:54:00.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.576+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:112 6.19 6:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19648400 con 0x563b194f1400 2023-12-19T17:54:00.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 28 ==== osd_op_reply(112 100000001f8.00000000 [call,setxattr (8)] v46'14 uv14 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:113 7.5 7:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19648800 con 0x563b194f1000 2023-12-19T17:54:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(113 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:114 7.15 7:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b195ffc00 con 0x563b194f1000 2023-12-19T17:54:00.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(114 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:115 7.d 7:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b195fe400 2023-12-19T17:54:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(115 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.580+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:116 7.1d 7:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19648400 con 0x563b194f0800 2023-12-19T17:54:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(116 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:117 7.3 7:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621c00 con 0x563b195fe000 2023-12-19T17:54:00.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(117 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b195fe000 2023-12-19T17:54:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:118 7.13 7:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19648800 con 0x563b1a015000 2023-12-19T17:54:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(118 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:119 7.b 7:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c000 con 0x563b194f0800 2023-12-19T17:54:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ceb3f1700 1 -- 172.21.15.45:0/3459805752 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(119 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6ed80 con 0x563b194f0800 2023-12-19T17:54:00.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.584+0000 7f5ce5be6700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:120 7.1b 7:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19621400 con 0x563b1a015000 2023-12-19T17:54:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(120 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:121 7.7 7:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c400 con 0x563b195fe400 2023-12-19T17:54:00.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(121 [pgnls start_epoch 46 out=81b] v44'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:122 7.7 7:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19648c00 con 0x563b195fe400 2023-12-19T17:54:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(122 10000000001.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5cec434840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T17:54:00.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.588+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:123 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19649000 con 0x563b194f1400 2023-12-19T17:54:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.592+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 29 ==== osd_op_reply(123 10000000001.00000000 [call,setxattr (8)] v46'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.592+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:124 7.17 7:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19649400 con 0x563b194f1000 2023-12-19T17:54:00.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(124 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1000 2023-12-19T17:54:00.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5ce63e7700 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:125 7.f 7:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b1962c800 con 0x563b1a015000 2023-12-19T17:54:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(125 [pgnls start_epoch 46 out=81b] v44'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:126 7.f 7:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19649800 con 0x563b1a015000 2023-12-19T17:54:00.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(126 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563b19f6eb40 con 0x563b1a015000 2023-12-19T17:54:00.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5cec434840 10 datascan.operator(): handling object 1099511627777.1 2023-12-19T17:54:00.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.596+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:127 6.7 6:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19649c00 con 0x563b194f1400 2023-12-19T17:54:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 <== osd.5 v2:172.21.15.73:6824/36539 30 ==== osd_op_reply(127 10000000001.00000000 [call,setxattr (8)] v46'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563b19f6eb40 con 0x563b194f1400 2023-12-19T17:54:00.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:128 7.1f 7:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x563b19620000 con 0x563b195fe400 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cea3ef700 1 -- 172.21.15.45:0/3459805752 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(128 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563b19f6efc0 con 0x563b195fe400 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563b1a015000 msgr2=0x563b19232100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563b1a015000 0x563b19232100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563b194f0800 msgr2=0x563b195ee000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563b194f0800 0x563b195ee000 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563b194f1800 msgr2=0x563b195eeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563b194f1800 0x563b195eeb00 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563b195fe000 msgr2=0x563b195ef080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563b195fe000 0x563b195ef080 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563b195fe800 msgr2=0x563b195f0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563b195fe800 0x563b195f0100 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563b194f1400 msgr2=0x563b195ef600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563b194f1400 0x563b195ef600 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563b195fe400 msgr2=0x563b195efb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563b195fe400 0x563b195efb80 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563b194f1000 msgr2=0x563b195ee580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563b194f1000 0x563b195ee580 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 reap_dead start 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 reap_dead start 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5ceabf0700 1 -- 172.21.15.45:0/3459805752 reap_dead start 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563b194f0400 msgr2=0x563b19233700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563b194f0400 0x563b19233700 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x563b19483410 tx=0x563b19485c20 comp rx=0 tx=0).stop 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014c00 msgr2=0x563b19232680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014c00 0x563b19232680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x563b19483470 tx=0x563b19280c60 comp rx=0 tx=0).stop 2023-12-19T17:54:00.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 shutdown_connections 2023-12-19T17:54:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563b194f0400 0x563b19233700 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 --2- 172.21.15.45:0/3459805752 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1a014c00 0x563b19232680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 >> 172.21.15.45:0/3459805752 conn(0x563b1918ac00 msgr2=0x563b19259800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 shutdown_connections 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.600+0000 7f5cec434840 1 -- 172.21.15.45:0/3459805752 wait complete. 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 msgr2=0x563b19230b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 0x563b19230b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x563b19299380 tx=0x563b19280e40 comp rx=0 tx=0).stop 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 shutdown_connections 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b1918b000 0x563b19231080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563b1918b400 0x563b19230b00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 --2- 172.21.15.45:0/1086805547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563b1918b800 0x563b19230580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 >> 172.21.15.45:0/1086805547 conn(0x563b1918bc00 msgr2=0x563b19259000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 shutdown_connections 2023-12-19T17:54:00.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.604+0000 7f5cec434840 1 -- 172.21.15.45:0/1086805547 wait complete. 2023-12-19T17:54:00.617 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents'] in time 0:00:00.317272, result: 2023-12-19T17:54:00.617 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes 2023-12-19T17:54:00.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 -- start start 2023-12-19T17:54:00.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 Processor -- start 2023-12-19T17:54:00.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15635800 0x562e156da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 0x562e156dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15635000 0x562e156db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e1566be00 con 0x562e15635400 2023-12-19T17:54:00.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4a00 con 0x562e15635800 2023-12-19T17:54:00.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3966ab6840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4640 con 0x562e15635000 2023-12-19T17:54:00.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 0x562e156dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 0x562e156dab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43376/0 (socket says 172.21.15.45:43376) 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 -- 172.21.15.45:0/4027731695 learned_addr learned my addr 172.21.15.45:0/4027731695 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3965a73700 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15635000 0x562e156db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3965272700 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15635800 0x562e156da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 -- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15635000 msgr2=0x562e156db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15635000 0x562e156db080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 -- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15635800 msgr2=0x562e156da580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15635800 0x562e156da580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.676+0000 7f3964a71700 1 -- 172.21.15.45:0/4027731695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e15656b60 con 0x562e15635400 2023-12-19T17:54:00.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3964a71700 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 0x562e156dab00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x562e15743380 tx=0x562e164ace40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3398bbae15dd1e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3962a6d700 1 -- 172.21.15.45:0/4027731695 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562e15665600 con 0x562e15635400 2023-12-19T17:54:00.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3962a6d700 1 -- 172.21.15.45:0/4027731695 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e15680480 con 0x562e15635400 2023-12-19T17:54:00.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3962a6d700 1 -- 172.21.15.45:0/4027731695 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562e156651e0 con 0x562e15635400 2023-12-19T17:54:00.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e15656340 con 0x562e15635400 2023-12-19T17:54:00.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562e15656000 con 0x562e15635400 2023-12-19T17:54:00.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 4 waiting for MDS map... 2023-12-19T17:54:00.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3962a6d700 1 -- 172.21.15.45:0/4027731695 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x562e1566ec40 con 0x562e15635400 2023-12-19T17:54:00.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3962a6d700 1 -- 172.21.15.45:0/4027731695 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x562e164bc000 con 0x562e15635400 2023-12-19T17:54:00.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 4 Got MDS map 22 2023-12-19T17:54:00.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 4 datascan.main: Using metadata pool output 2023-12-19T17:54:00.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 4 datascan.main: connecting to RADOS... 2023-12-19T17:54:00.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 1 Processor -- start 2023-12-19T17:54:00.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.680+0000 7f3966ab6840 1 -- start start 2023-12-19T17:54:00.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 0x562e156db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 0x562e156dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932c00 0x562e156dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4500 con 0x562e15932800 2023-12-19T17:54:00.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e156b43c0 con 0x562e15932c00 2023-12-19T17:54:00.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4a00 con 0x562e15932400 2023-12-19T17:54:00.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 0x562e156db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3964a71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932c00 0x562e156dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965272700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 0x562e156dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 0x562e156db600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38566/0 (socket says 172.21.15.45:38566) 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 -- 172.21.15.45:0/2203183253 learned_addr learned my addr 172.21.15.45:0/2203183253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965272700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 0x562e156dbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43390/0 (socket says 172.21.15.45:43390) 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 -- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932c00 msgr2=0x562e156dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932c00 0x562e156dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 -- 172.21.15.45:0/2203183253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 msgr2=0x562e156dbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 0x562e156dbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 -- 172.21.15.45:0/2203183253 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e15656ea0 con 0x562e15932400 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965272700 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 0x562e156dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3965a73700 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 0x562e156db600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x562e164b2840 tx=0x562e1592cc00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12484083c1e68690 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3960a69700 1 -- 172.21.15.45:0/2203183253 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562e15665600 con 0x562e15932400 2023-12-19T17:54:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3960a69700 1 -- 172.21.15.45:0/2203183253 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e15680900 con 0x562e15932400 2023-12-19T17:54:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3960a69700 1 -- 172.21.15.45:0/2203183253 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562e156651e0 con 0x562e15932400 2023-12-19T17:54:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 msgr2=0x562e156db600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 0x562e156db600 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x562e164b2840 tx=0x562e1592cc00 comp rx=0 tx=0).stop 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- 172.21.15.45:0/2203183253 shutdown_connections 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932c00 0x562e156dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932800 0x562e156dbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 --2- 172.21.15.45:0/2203183253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932400 0x562e156db600 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- 172.21.15.45:0/2203183253 >> 172.21.15.45:0/2203183253 conn(0x562e15634c00 msgr2=0x562e15703800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- 172.21.15.45:0/2203183253 shutdown_connections 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.684+0000 7f3966ab6840 1 -- 172.21.15.45:0/2203183253 wait complete. 2023-12-19T17:54:00.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 Processor -- start 2023-12-19T17:54:00.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 -- start start 2023-12-19T17:54:00.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932400 0x562e156dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932800 0x562e156dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 0x562e156dc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4280 con 0x562e15932c00 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4140 con 0x562e15932400 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562e156b4000 con 0x562e15932800 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 0x562e156dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 0x562e156dc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43394/0 (socket says 172.21.15.45:43394) 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 learned_addr learned my addr 172.21.15.45:0/390226097 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932800 0x562e156dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932400 0x562e156dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932800 msgr2=0x562e156dcc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15932800 0x562e156dcc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932400 msgr2=0x562e156dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932400 0x562e156dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e15656b60 con 0x562e15932c00 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15932400 0x562e156dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 0x562e156dc680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x562e164b26f0 tx=0x562e164acc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f395f266700 1 -- 172.21.15.45:0/390226097 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562e15664f20 con 0x562e15932c00 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f395f266700 1 -- 172.21.15.45:0/390226097 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562e16418a80 con 0x562e15932c00 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562e15656340 con 0x562e15932c00 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f395f266700 1 -- 172.21.15.45:0/390226097 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562e15665600 con 0x562e15932c00 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562e15657520 con 0x562e15932c00 2023-12-19T17:54:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.688+0000 7f3966ab6840 4 datascan.init: resolving metadata pool 5 2023-12-19T17:54:00.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f395f266700 1 -- 172.21.15.45:0/390226097 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x562e15692840 con 0x562e15932c00 2023-12-19T17:54:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f395f266700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562e15a88000 0x562e156dd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f395f266700 1 -- 172.21.15.45:0/390226097 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x562e1566ea80 con 0x562e15932c00 2023-12-19T17:54:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f3966ab6840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:54:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f3966ab6840 4 datascan.main: data pool 'cephfs_data' has ID 6 2023-12-19T17:54:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f3966ab6840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:54:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562e15933000 0x562e156dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562e15a88000 0x562e156dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.692+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 5.14 5:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15933400 con 0x562e15933000 2023-12-19T17:54:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562e15933000 0x562e156dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562e15a88000 0x562e156dd700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x562e164b2840 tx=0x562e164acde0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562e15933000 0x562e156dc100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv43 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562e15933800 0x562e156dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:2 5.1f 5:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88400 con 0x562e15933800 2023-12-19T17:54:00.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562e15933800 0x562e156dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.696+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562e15933800 0x562e156dbb80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562e15a88800 0x562e156db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 6.0 6:00000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88c00 con 0x562e15a88800 2023-12-19T17:54:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562e15a88800 0x562e156db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562e15a88800 0x562e156db600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3960268700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562e15933400 0x562e15aa4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 6.20 6:04000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88c00 con 0x562e15933400 2023-12-19T17:54:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.700+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562e15933400 0x562e15aa4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562e15933400 0x562e15aa4000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 6.10 6:08000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0000 con 0x562e15a88800 2023-12-19T17:54:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3960268700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562e15ab0400 0x562e15aa4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:6 6.30 6:0c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0800 con 0x562e15ab0400 2023-12-19T17:54:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562e15ab0400 0x562e15aa4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.704+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562e15ab0400 0x562e15aa4580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 6.8 6:10000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0800 con 0x562e15ab0400 2023-12-19T17:54:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3960268700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562e15ab0c00 0x562e15aa4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:8 6.28 6:14000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15ab0c00 2023-12-19T17:54:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562e15ab0c00 0x562e15aa4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3965272700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562e15ab0c00 0x562e15aa4b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(8 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:9 6.18 6:18000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88400 con 0x562e15a88800 2023-12-19T17:54:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.708+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:10 6.38 6:1c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1400 con 0x562e15933000 2023-12-19T17:54:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:11 6.4 6:20000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88400 con 0x562e15933400 2023-12-19T17:54:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3960268700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562e15ab1800 0x562e15aa5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:12 6.24 6:24000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15ab1800 2023-12-19T17:54:00.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562e15ab1800 0x562e15aa5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.712+0000 7f3964a71700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562e15ab1800 0x562e15aa5080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(12 [pgnls-filter start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:13 6.14 6:28000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0000 con 0x562e15ab0c00 2023-12-19T17:54:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:14 6.34 6:2c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15a88800 2023-12-19T17:54:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(14 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:15 6.c 6:30000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15933000 2023-12-19T17:54:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:16 6.2c 6:34000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe400 con 0x562e15933800 2023-12-19T17:54:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(16 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.716+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 6.1c 6:38000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15ab0400 2023-12-19T17:54:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(17 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:18 6.3c 6:3c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe800 con 0x562e15ab0c00 2023-12-19T17:54:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(18 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3960a69700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562e15ab1400 0x562e15aa6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:19 6.2 6:40000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0000 con 0x562e15ab1400 2023-12-19T17:54:00.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562e15ab1400 0x562e15aa6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.720+0000 7f3965a73700 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562e15ab1400 0x562e15aa6100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(19 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:20 6.22 6:44000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15933800 2023-12-19T17:54:00.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:21 6.12 6:48000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15ab0400 2023-12-19T17:54:00.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(21 [pgnls-filter start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:22 6.32 6:4c000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15ab1400 2023-12-19T17:54:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(22 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.724+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:23 6.a 6:50000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab1800 2023-12-19T17:54:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.728+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(23 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.728+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:24 6.2a 6:54000000::::head [pgnls-filter start_epoch 46 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab1400 2023-12-19T17:54:00.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.728+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(24 [pgnls-filter start_epoch 46 out=81b] v46'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.728+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 6.0 6:00000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89000 con 0x562e15a88800 2023-12-19T17:54:00.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.728+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(25 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.728+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:26 6.20 6:04000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe400 con 0x562e15933400 2023-12-19T17:54:00.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(26 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 6.10 6:08000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15a88800 2023-12-19T17:54:00.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(27 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:28 6.30 6:0c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15ab0400 2023-12-19T17:54:00.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:29 6.8 6:10000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0000 con 0x562e15ab0400 2023-12-19T17:54:00.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(29 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:30 6.28 6:14000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15ab0c00 2023-12-19T17:54:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(30 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.732+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:31 6.18 6:18000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15a88800 2023-12-19T17:54:00.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(31 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:32 6.38 6:1c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88c00 con 0x562e15933000 2023-12-19T17:54:00.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(32 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:33 6.4 6:20000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0800 con 0x562e15933400 2023-12-19T17:54:00.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(33 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:34 6.24 6:24000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88400 con 0x562e15ab1800 2023-12-19T17:54:00.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(34 [pgnls-filter start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.736+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:35 6.14 6:28000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe800 con 0x562e15ab0c00 2023-12-19T17:54:00.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(35 [pgnls-filter start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:36 6.34 6:2c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf800 con 0x562e15a88800 2023-12-19T17:54:00.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(36 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:37 6.c 6:30000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15933000 2023-12-19T17:54:00.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(37 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:38 6.2c 6:34000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abfc00 con 0x562e15933800 2023-12-19T17:54:00.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:39 6.1c 6:38000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf400 con 0x562e15ab0400 2023-12-19T17:54:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.740+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(39 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:40 6.3c 6:3c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab0c00 2023-12-19T17:54:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(40 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:41 6.2 6:40000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15ab1400 2023-12-19T17:54:00.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(41 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:42 6.22 6:44000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15933800 2023-12-19T17:54:00.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(42 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.744+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:43 6.12 6:48000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15ab0400 2023-12-19T17:54:00.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(43 [pgnls-filter start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:44 6.32 6:4c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abfc00 con 0x562e15ab1400 2023-12-19T17:54:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(44 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:45 6.a 6:50000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89000 con 0x562e15ab1800 2023-12-19T17:54:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(45 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:46 6.2a 6:54000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf400 con 0x562e15ab1400 2023-12-19T17:54:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(46 [pgnls-filter start_epoch 46 out=81b] v46'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3966ab6840 20 datascan.forall_objects: OSD matched oid 100000001f6.00000000 2023-12-19T17:54:00.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3966ab6840 10 datascan.operator(): handling object 100000001f6.0 2023-12-19T17:54:00.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.748+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:47 6.2a 6:57fe7535:::100000001f6.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89400 con 0x562e15ab1400 2023-12-19T17:54:00.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(47 100000001f6.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:48 7.a 7:57fe7535:::100000001f6.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89800 con 0x562e15933000 2023-12-19T17:54:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(48 100000001f6.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 20 datascan.operator(): loaded layout from xattr: pi: 7 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:54:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f6 2023-12-19T17:54:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/1 2023-12-19T17:54:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=1 2023-12-19T17:54:00.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:49 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89c00 con 0x562e15ab0400 2023-12-19T17:54:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(49 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2023-12-19T17:54:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/1, will insert to root 2023-12-19T17:54:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:50 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe800 con 0x562e15ab0400 2023-12-19T17:54:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(50 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.752+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T17:54:00.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.756+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:51 5.10 5:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf800 con 0x562e15ab0400 2023-12-19T17:54:00.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.756+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(51 10000000000.00000000 [create,omap-set-header] v46'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.756+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-12-19T17:54:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.756+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:52 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15ab0400 2023-12-19T17:54:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 20 datascan.read_dentry: oid=10000000000.00000000 dname=1 frag=*, r=0 2023-12-19T17:54:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 20 datascan.read_dentry: 1_head not found in result 2023-12-19T17:54:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f6 at 0x0x10000000000/1 with size=6291456 bytes 2023-12-19T17:54:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:53 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab0400 2023-12-19T17:54:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(53 10000000000.00000000 [omap-set-vals] v46'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x100000001f6 2023-12-19T17:54:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-12-19T17:54:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-12-19T17:54:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.760+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:54 5.1f 5:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15933800 2023-12-19T17:54:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(54 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3966ab6840 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2023-12-19T17:54:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3966ab6840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-12-19T17:54:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:55 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abfc00 con 0x562e15933800 2023-12-19T17:54:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(55 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T17:54:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:56 5.1f 5:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15933800 2023-12-19T17:54:00.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.764+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(56 1.00000000 [create,omap-set-header] v46'11 uv11 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2023-12-19T17:54:00.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:57 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15933800 2023-12-19T17:54:00.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(57 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T17:54:00.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 20 datascan.read_dentry: subdir_head not found in result 2023-12-19T17:54:00.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2023-12-19T17:54:00.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:58 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89c00 con 0x562e15933800 2023-12-19T17:54:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(58 1.00000000 [omap-set-vals] v46'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-12-19T17:54:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.768+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:59 6.1a 6:58000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88c00 con 0x562e15ab1400 2023-12-19T17:54:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(59 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:60 6.3a 6:5c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0000 con 0x562e15933400 2023-12-19T17:54:00.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(60 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:61 6.6 6:60000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88400 con 0x562e15933000 2023-12-19T17:54:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(61 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:62 6.26 6:64000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6000 con 0x562e15933400 2023-12-19T17:54:00.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(62 [pgnls-filter start_epoch 46 out=49b] v44'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.772+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:63 6.16 6:68000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89000 con 0x562e15a88800 2023-12-19T17:54:00.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(63 [pgnls-filter start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:64 6.36 6:6c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6400 con 0x562e15ab1800 2023-12-19T17:54:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(64 [pgnls-filter start_epoch 46 out=101b] v46'23 uv23 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3966ab6840 20 datascan.forall_objects: OSD matched oid 100000001f9.00000000 2023-12-19T17:54:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3966ab6840 10 datascan.operator(): handling object 100000001f9.0 2023-12-19T17:54:00.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:65 6.36 6:6ee5e2c4:::100000001f9.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe800 con 0x562e15ab1800 2023-12-19T17:54:00.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(65 100000001f9.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv21 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.776+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:66 7.16 7:6ee5e2c4:::100000001f9.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf800 con 0x562e15ab1400 2023-12-19T17:54:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(66 100000001f9.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 20 datascan.operator(): loaded layout from xattr: pi: 7 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:54:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f9 2023-12-19T17:54:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/4 2023-12-19T17:54:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=4 2023-12-19T17:54:00.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:67 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15ab0400 2023-12-19T17:54:00.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(67 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:54:00.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:54:00.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/4, will insert to root 2023-12-19T17:54:00.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:68 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab0400 2023-12-19T17:54:00.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(68 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-12-19T17:54:00.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:54:00.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:69 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15ab0400 2023-12-19T17:54:00.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(69 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 20 datascan.read_dentry: oid=10000000000.00000000 dname=4 frag=*, r=0 2023-12-19T17:54:00.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 20 datascan.read_dentry: 4_head not found in result 2023-12-19T17:54:00.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f9 at 0x0x10000000000/4 with size=6291456 bytes 2023-12-19T17:54:00.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.780+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:70 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abfc00 con 0x562e15ab0400 2023-12-19T17:54:00.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(70 10000000000.00000000 [omap-set-vals] v46'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3966ab6840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x100000001f9 2023-12-19T17:54:00.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:71 6.36 6:6fe38dc2::::head [pgnls-filter start_epoch 46 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf400 con 0x562e15ab1800 2023-12-19T17:54:00.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 46 out=81b] v46'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3966ab6840 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2023-12-19T17:54:00.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3966ab6840 10 datascan.operator(): handling object 100000001f7.0 2023-12-19T17:54:00.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.784+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:72 6.36 6:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf800 con 0x562e15ab1800 2023-12-19T17:54:00.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(72 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv23 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:73 7.16 7:6fe38dc2:::100000001f7.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15ab1400 2023-12-19T17:54:00.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(73 100000001f7.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 20 datascan.operator(): loaded layout from xattr: pi: 7 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/2 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=2 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:74 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab0400 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(74 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:54:00.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:54:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/2, will insert to root 2023-12-19T17:54:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:75 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15ab0400 2023-12-19T17:54:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(75 10000000000.00000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-12-19T17:54:00.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:54:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.788+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:76 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89c00 con 0x562e15ab0400 2023-12-19T17:54:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(76 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3966ab6840 20 datascan.read_dentry: oid=10000000000.00000000 dname=2 frag=*, r=0 2023-12-19T17:54:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3966ab6840 20 datascan.read_dentry: 2_head not found in result 2023-12-19T17:54:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3966ab6840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000000/2 with size=6291456 bytes 2023-12-19T17:54:00.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:77 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88c00 con 0x562e15ab0400 2023-12-19T17:54:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 21 ==== osd_op_reply(77 10000000000.00000000 [omap-set-vals] v46'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3966ab6840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x100000001f7 2023-12-19T17:54:00.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.792+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:78 6.e 6:70000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15ab1400 2023-12-19T17:54:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(78 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:79 6.2e 6:74000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89800 con 0x562e15933800 2023-12-19T17:54:00.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(79 [pgnls-filter start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:80 6.1e 6:78000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6800 con 0x562e15ab1400 2023-12-19T17:54:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(80 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:81 6.3e 6:7c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89400 con 0x562e15933000 2023-12-19T17:54:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(81 [pgnls-filter start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:82 6.1 6:80000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6c00 con 0x562e15933400 2023-12-19T17:54:00.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(82 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.796+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:83 6.21 6:84000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0800 con 0x562e15ab0400 2023-12-19T17:54:00.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 22 ==== osd_op_reply(83 [pgnls-filter start_epoch 46 out=49b] v44'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:84 6.11 6:88000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad7000 con 0x562e15933000 2023-12-19T17:54:00.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(84 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:85 6.31 6:8c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0000 con 0x562e15ab1800 2023-12-19T17:54:00.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(85 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:86 6.9 6:90000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad7400 con 0x562e15a88800 2023-12-19T17:54:00.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(86 [pgnls-filter start_epoch 46 out=49b] v44'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.800+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:87 6.29 6:94000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe400 con 0x562e15ab0400 2023-12-19T17:54:00.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 23 ==== osd_op_reply(87 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:88 6.19 6:98000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad7800 con 0x562e15ab1800 2023-12-19T17:54:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(88 [pgnls-filter start_epoch 46 out=81b] v46'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3966ab6840 20 datascan.forall_objects: OSD matched oid 100000001f8.00000000 2023-12-19T17:54:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3966ab6840 10 datascan.operator(): handling object 100000001f8.0 2023-12-19T17:54:00.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:89 6.19 6:997b7129:::100000001f8.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1000 con 0x562e15ab1800 2023-12-19T17:54:00.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(89 100000001f8.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.804+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:90 7.19 7:997b7129:::100000001f8.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89c00 con 0x562e15933800 2023-12-19T17:54:00.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(90 100000001f8.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 20 datascan.operator(): loaded layout from xattr: pi: 7 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:54:00.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f8 2023-12-19T17:54:00.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/3 2023-12-19T17:54:00.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=3 2023-12-19T17:54:00.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:91 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88c00 con 0x562e15ab0400 2023-12-19T17:54:00.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 24 ==== osd_op_reply(91 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:54:00.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:54:00.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/3, will insert to root 2023-12-19T17:54:00.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:92 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89800 con 0x562e15ab0400 2023-12-19T17:54:00.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 25 ==== osd_op_reply(92 10000000000.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T17:54:00.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:54:00.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:93 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15ab0400 2023-12-19T17:54:00.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 26 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 20 datascan.read_dentry: oid=10000000000.00000000 dname=3 frag=*, r=0 2023-12-19T17:54:00.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 20 datascan.read_dentry: 3_head not found in result 2023-12-19T17:54:00.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f8 at 0x0x10000000000/3 with size=6291456 bytes 2023-12-19T17:54:00.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.808+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:94 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe800 con 0x562e15ab0400 2023-12-19T17:54:00.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.812+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 27 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v46'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.812+0000 7f3966ab6840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x100000001f8 2023-12-19T17:54:00.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.812+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:95 6.39 6:9c000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf400 con 0x562e15ab1800 2023-12-19T17:54:00.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.812+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(95 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:96 6.5 6:a0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad7c00 con 0x562e15ab0400 2023-12-19T17:54:00.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 28 ==== osd_op_reply(96 [pgnls-filter start_epoch 46 out=49b] v44'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:97 6.25 6:a4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6000 con 0x562e15933800 2023-12-19T17:54:00.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(97 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:98 6.15 6:a8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0000 con 0x562e15ab0400 2023-12-19T17:54:00.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 29 ==== osd_op_reply(98 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.816+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:99 6.35 6:ac000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6400 con 0x562e15ab1800 2023-12-19T17:54:00.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 13 ==== osd_op_reply(99 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:100 6.d 6:b0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0400 con 0x562e15a88800 2023-12-19T17:54:00.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(100 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:101 6.2d 6:b4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6c00 con 0x562e15ab0c00 2023-12-19T17:54:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(101 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:102 6.1d 6:b8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0800 con 0x562e15933400 2023-12-19T17:54:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.820+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(102 [pgnls-filter start_epoch 46 out=49b] v44'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15933400 2023-12-19T17:54:00.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:103 6.3d 6:bc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6800 con 0x562e15a88800 2023-12-19T17:54:00.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(103 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:104 6.3 6:c0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0c00 con 0x562e15ab0400 2023-12-19T17:54:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 30 ==== osd_op_reply(104 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:105 6.23 6:c4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe400 con 0x562e15933800 2023-12-19T17:54:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(105 [pgnls-filter start_epoch 46 out=49b] v44'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.824+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:106 6.13 6:c8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae1000 con 0x562e15933000 2023-12-19T17:54:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(106 [pgnls-filter start_epoch 46 out=49b] v44'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:107 6.33 6:cc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab0800 con 0x562e15ab1800 2023-12-19T17:54:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 14 ==== osd_op_reply(107 [pgnls-filter start_epoch 46 out=49b] v44'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:108 6.b 6:d0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae1400 con 0x562e15933000 2023-12-19T17:54:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(108 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:109 6.2b 6:d4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ab1c00 con 0x562e15ab1800 2023-12-19T17:54:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 15 ==== osd_op_reply(109 [pgnls-filter start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.828+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:110 6.1b 6:d8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae1800 con 0x562e15933000 2023-12-19T17:54:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(110 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:111 6.3b 6:dc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a88400 con 0x562e15ab0c00 2023-12-19T17:54:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(111 [pgnls-filter start_epoch 46 out=49b] v44'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:112 6.7 6:e0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae1c00 con 0x562e15ab1800 2023-12-19T17:54:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 16 ==== osd_op_reply(112 [pgnls-filter start_epoch 46 out=81b] v46'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3966ab6840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-12-19T17:54:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3966ab6840 10 datascan.operator(): handling object 10000000001.0 2023-12-19T17:54:00.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:113 6.7 6:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf800 con 0x562e15ab1800 2023-12-19T17:54:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.832+0000 7f3964a71700 1 -- 172.21.15.45:0/390226097 <== osd.5 v2:172.21.15.73:6824/36539 17 ==== osd_op_reply(113 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562e1641cfc0 con 0x562e15ab1800 2023-12-19T17:54:00.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:114 7.7 7:e2e07930:::10000000001.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abfc00 con 0x562e15933800 2023-12-19T17:54:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(114 10000000001.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 20 datascan.operator(): loaded layout from xattr: pi: 7 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:54:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-12-19T17:54:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/0 2023-12-19T17:54:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=0 2023-12-19T17:54:00.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:115 5.10 5:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abf000 con 0x562e15ab0400 2023-12-19T17:54:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 31 ==== osd_op_reply(115 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:54:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:54:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/0, will insert to root 2023-12-19T17:54:00.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:116 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abec00 con 0x562e15ab0400 2023-12-19T17:54:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 32 ==== osd_op_reply(116 10000000000.00000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-12-19T17:54:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:54:00.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.836+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:117 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15abe000 con 0x562e15ab0400 2023-12-19T17:54:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 33 ==== osd_op_reply(117 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3966ab6840 20 datascan.read_dentry: oid=10000000000.00000000 dname=0 frag=*, r=0 2023-12-19T17:54:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3966ab6840 20 datascan.read_dentry: 0_head not found in result 2023-12-19T17:54:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3966ab6840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/0 with size=6291456 bytes 2023-12-19T17:54:00.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:118 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad7800 con 0x562e15ab0400 2023-12-19T17:54:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 34 ==== osd_op_reply(118 10000000000.00000000 [omap-set-vals] v46'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3966ab6840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-12-19T17:54:00.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.840+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:119 6.27 6:e4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ad6400 con 0x562e15933800 2023-12-19T17:54:00.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.6 v2:172.21.15.73:6816/36537 16 ==== osd_op_reply(119 [pgnls-filter start_epoch 46 out=49b] v44'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15933800 2023-12-19T17:54:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:120 6.17 6:e8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0800 con 0x562e15ab1400 2023-12-19T17:54:00.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(120 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab1400 2023-12-19T17:54:00.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:121 6.37 6:ec000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89000 con 0x562e15a88800 2023-12-19T17:54:00.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(121 [pgnls-filter start_epoch 46 out=49b] v44'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15a88800 2023-12-19T17:54:00.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:122 6.f 6:f0000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0400 con 0x562e15ab0c00 2023-12-19T17:54:00.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.844+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(122 [pgnls-filter start_epoch 46 out=49b] v44'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15ab0c00 2023-12-19T17:54:00.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:123 6.2f 6:f4000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89400 con 0x562e15ab0400 2023-12-19T17:54:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3965a73700 1 -- 172.21.15.45:0/390226097 <== osd.7 v2:172.21.15.73:6800/36538 35 ==== osd_op_reply(123 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cd80 con 0x562e15ab0400 2023-12-19T17:54:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3960268700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:124 6.1f 6:f8000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15ae0000 con 0x562e15933000 2023-12-19T17:54:00.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(124 [pgnls-filter start_epoch 46 out=49b] v44'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3960a69700 1 -- 172.21.15.45:0/390226097 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:125 6.3f 6:fc000000::::head [pgnls-filter start_epoch 46 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x562e15a89c00 con 0x562e15933000 2023-12-19T17:54:00.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(125 [pgnls-filter start_epoch 46 out=49b] v44'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562e1641cb40 con 0x562e15933000 2023-12-19T17:54:00.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562e15a88800 msgr2=0x562e156db600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562e15a88800 0x562e156db600 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562e15933400 msgr2=0x562e15aa4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562e15933400 0x562e15aa4000 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562e15ab0c00 msgr2=0x562e15aa4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562e15ab0c00 0x562e15aa4b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562e15933000 msgr2=0x562e156dc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562e15933000 0x562e156dc100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562e15ab1400 msgr2=0x562e15aa6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562e15ab1400 0x562e15aa6100 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 reap_dead start 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562e15ab1800 msgr2=0x562e15aa5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562e15ab1800 0x562e15aa5080 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562e15933800 msgr2=0x562e156dbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562e15933800 0x562e156dbb80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562e15ab0400 msgr2=0x562e15aa4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562e15ab0400 0x562e15aa4580 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3965272700 1 -- 172.21.15.45:0/390226097 reap_dead start 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562e15a88000 msgr2=0x562e156dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562e15a88000 0x562e156dd700 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x562e164b2840 tx=0x562e164acde0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 msgr2=0x562e156dc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.848+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 0x562e156dc680 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x562e164b26f0 tx=0x562e164acc60 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 shutdown_connections 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562e15a88000 0x562e156dd700 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 --2- 172.21.15.45:0/390226097 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15932c00 0x562e156dc680 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 >> 172.21.15.45:0/390226097 conn(0x562e15634c00 msgr2=0x562e15703800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 shutdown_connections 2023-12-19T17:54:00.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/390226097 wait complete. 2023-12-19T17:54:00.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 msgr2=0x562e156dab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 0x562e156dab00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x562e15743380 tx=0x562e164ace40 comp rx=0 tx=0).stop 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 shutdown_connections 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562e15635000 0x562e156db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562e15635400 0x562e156dab00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 --2- 172.21.15.45:0/4027731695 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562e15635800 0x562e156da580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 >> 172.21.15.45:0/4027731695 conn(0x562e15635c00 msgr2=0x562e15703000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 shutdown_connections 2023-12-19T17:54:00.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.852+0000 7f3966ab6840 1 -- 172.21.15.45:0/4027731695 wait complete. 2023-12-19T17:54:00.865 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes'] in time 0:00:00.247553, result: 2023-12-19T17:54:00.865 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-12-19T17:54:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 -- start start 2023-12-19T17:54:00.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 Processor -- start 2023-12-19T17:54:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b3d19800 0x55c7b3dbe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 0x55c7b3dbeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b3d19000 0x55c7b3dbf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98780 con 0x55c7b3d19400 2023-12-19T17:54:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98a00 con 0x55c7b3d19000 2023-12-19T17:54:00.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f645b8f3840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98640 con 0x55c7b3d19800 2023-12-19T17:54:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f64598ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 0x55c7b3dbeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f64598ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 0x55c7b3dbeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43398/0 (socket says 172.21.15.45:43398) 2023-12-19T17:54:00.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.924+0000 7f64598ae700 1 -- 172.21.15.45:0/1130361145 learned_addr learned my addr 172.21.15.45:0/1130361145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645a0af700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b3d19800 0x55c7b3dbe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645a8b0700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b3d19000 0x55c7b3dbf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64598ae700 1 -- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b3d19800 msgr2=0x55c7b3dbe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64598ae700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b3d19800 0x55c7b3dbe580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64598ae700 1 -- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b3d19000 msgr2=0x55c7b3dbf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64598ae700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b3d19000 0x55c7b3dbf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64598ae700 1 -- 172.21.15.45:0/1130361145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7b3d3ab60 con 0x55c7b3d19400 2023-12-19T17:54:00.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645a0af700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b3d19800 0x55c7b3dbe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645a8b0700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b3d19000 0x55c7b3dbf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64598ae700 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 0x55c7b3dbeb00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x55c7b3e27350 tx=0x55c7b4b10ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd169fedfc647811 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64578aa700 1 -- 172.21.15.45:0/1130361145 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c7b3d49080 con 0x55c7b3d19400 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64578aa700 1 -- 172.21.15.45:0/1130361145 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7b4b0e300 con 0x55c7b3d19400 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64578aa700 1 -- 172.21.15.45:0/1130361145 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c7b3d49600 con 0x55c7b3d19400 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7b3d3b1e0 con 0x55c7b3d19400 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c7b3d3ab60 con 0x55c7b3d19400 2023-12-19T17:54:00.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 4 waiting for MDS map... 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64578aa700 1 -- 172.21.15.45:0/1130361145 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55c7b3d52c40 con 0x55c7b3d19400 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f64578aa700 1 -- 172.21.15.45:0/1130361145 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 22) v1 ==== 3126+0+0 (secure 0 0 0) 0x55c7b3d5af00 con 0x55c7b3d19400 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 4 Got MDS map 22 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 4 datascan.main: Using metadata pool output 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 4 datascan.main: connecting to RADOS... 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 1 Processor -- start 2023-12-19T17:54:00.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.928+0000 7f645b8f3840 1 -- start start 2023-12-19T17:54:00.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 0x55c7b3dbf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2800 0x55c7b3dbfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d4fe00 con 0x55c7b4ba2400 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98a00 con 0x55c7b4ba2c00 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98780 con 0x55c7b4ba2800 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 0x55c7b3dbf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 0x55c7b3dbf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43406/0 (socket says 172.21.15.45:43406) 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 -- 172.21.15.45:0/3502201677 learned_addr learned my addr 172.21.15.45:0/3502201677 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a0af700 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2800 0x55c7b3dbfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f64598ae700 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 -- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2800 msgr2=0x55c7b3dbfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2800 0x55c7b3dbfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 -- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 msgr2=0x55c7b3dc0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 -- 172.21.15.45:0/3502201677 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7b3d3a340 con 0x55c7b4ba2400 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f64598ae700 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645a8b0700 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 0x55c7b3dbf600 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55c7b400c690 tx=0x55c7b400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa1ec7700d2b547 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f64558a6700 1 -- 172.21.15.45:0/3502201677 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c7b3d49080 con 0x55c7b4ba2400 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f64558a6700 1 -- 172.21.15.45:0/3502201677 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7b3d64900 con 0x55c7b4ba2400 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f64558a6700 1 -- 172.21.15.45:0/3502201677 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c7b3d49600 con 0x55c7b4ba2400 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 -- 172.21.15.45:0/3502201677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 msgr2=0x55c7b3dbf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 0x55c7b3dbf600 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x55c7b400c690 tx=0x55c7b400ecc0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 -- 172.21.15.45:0/3502201677 shutdown_connections 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2800 0x55c7b3dbfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 --2- 172.21.15.45:0/3502201677 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2400 0x55c7b3dbf600 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.932+0000 7f645b8f3840 1 -- 172.21.15.45:0/3502201677 >> 172.21.15.45:0/3502201677 conn(0x55c7b3d18c00 msgr2=0x55c7b3e09800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 -- 172.21.15.45:0/3502201677 shutdown_connections 2023-12-19T17:54:00.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 -- 172.21.15.45:0/3502201677 wait complete. 2023-12-19T17:54:00.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 Processor -- start 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 -- start start 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2400 0x55c7b3dc1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 0x55c7b3dc0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98500 con 0x55c7b4ba2800 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d983c0 con 0x55c7b4ba2c00 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645b8f3840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c7b3d98280 con 0x55c7b4ba2400 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 0x55c7b3dc0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 0x55c7b3dc0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43408/0 (socket says 172.21.15.45:43408) 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 learned_addr learned my addr 172.21.15.45:0/541881933 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2400 0x55c7b3dc1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2400 msgr2=0x55c7b3dc1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b4ba2400 0x55c7b3dc1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 msgr2=0x55c7b3dc0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b4ba2c00 0x55c7b3dc0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.936+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7b3d3a000 con 0x55c7b4ba2800 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 0x55c7b3dc0c00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55c7b400d350 tx=0x55c7b400ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f64540a3700 1 -- 172.21.15.45:0/541881933 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c7b3d49080 con 0x55c7b4ba2800 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f64540a3700 1 -- 172.21.15.45:0/541881933 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7b3d64480 con 0x55c7b4ba2800 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7b3d3aea0 con 0x55c7b4ba2800 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f64540a3700 1 -- 172.21.15.45:0/541881933 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c7b3d49600 con 0x55c7b4ba2800 2023-12-19T17:54:00.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7b3d3b520 con 0x55c7b4ba2800 2023-12-19T17:54:00.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f645b8f3840 4 datascan.init: resolving metadata pool 5 2023-12-19T17:54:00.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.940+0000 7f64540a3700 1 -- 172.21.15.45:0/541881933 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55c7b3d76840 con 0x55c7b4ba2800 2023-12-19T17:54:00.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64540a3700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c7b4166000 0x55c7b3dc1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64540a3700 1 -- 172.21.15.45:0/541881933 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x55c7b3d52a80 con 0x55c7b4ba2800 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f645b8f3840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f645b8f3840 4 datascan.main: resolving metadata pool 5 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c7b4ba3000 0x55c7b3dc0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c7b4166000 0x55c7b3dc1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 5.0 5:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4ba3400 con 0x55c7b4ba3000 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c7b4ba3000 0x55c7b3dc0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c7b4166000 0x55c7b3dc1700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55c7b400c690 tx=0x55c7b400ec00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c7b4ba3000 0x55c7b3dc0100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55c7b4ba3400 0x55c7b4174000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.944+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:2 5.10 5:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4166400 con 0x55c7b4ba3400 2023-12-19T17:54:00.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55c7b4ba3400 0x55c7b4174000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55c7b4ba3400 0x55c7b4174000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 46 out=81b] v46'21 uv21 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55c7b4166400 0x55c7b4174580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:3 5.8 5:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4166c00 con 0x55c7b4166400 2023-12-19T17:54:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55c7b4166400 0x55c7b4174580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.948+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55c7b4166400 0x55c7b4174580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(3 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55c7b4166c00 0x55c7b4174b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:4 5.18 5:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167000 con 0x55c7b4166c00 2023-12-19T17:54:00.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55c7b4166c00 0x55c7b4174b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55c7b4166c00 0x55c7b4174b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(4 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:00.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.952+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 5.4 5:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167000 con 0x55c7b4ba3400 2023-12-19T17:54:00.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(5 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 5.14 5:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167000 con 0x55c7b4ba3000 2023-12-19T17:54:00.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(6 [pgnls start_epoch 46 out=125b] v46'43 uv43 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:00.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55c7b4167000 0x55c7b4175080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:7 5.c 5:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4166800 con 0x55c7b4167000 2023-12-19T17:54:00.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55c7b4167000 0x55c7b4175080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55c7b4167000 0x55c7b4175080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(7 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:00.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.956+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:8 5.1c 5:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4166800 con 0x55c7b4166c00 2023-12-19T17:54:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(8 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55c7b4166800 0x55c7b4175600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 5.2 5:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167800 con 0x55c7b4166800 2023-12-19T17:54:00.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55c7b4166800 0x55c7b4175600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55c7b4166800 0x55c7b4175600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(9 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.960+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:10 5.12 5:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167800 con 0x55c7b4167000 2023-12-19T17:54:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(10 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:11 5.a 5:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167800 con 0x55c7b4166400 2023-12-19T17:54:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(11 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:12 5.1a 5:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167800 con 0x55c7b4ba3400 2023-12-19T17:54:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(12 [pgnls start_epoch 46 out=49b] v46'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:13 5.6 5:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167800 con 0x55c7b4166400 2023-12-19T17:54:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(13 [pgnls start_epoch 46 out=49b] v45'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a0af700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55c7b4167800 0x55c7b4175b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 5.16 5:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167400 con 0x55c7b4167800 2023-12-19T17:54:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.964+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55c7b4167800 0x55c7b4175b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55c7b4167800 0x55c7b4175b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(14 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:00.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 5.e 5:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167400 con 0x55c7b4166c00 2023-12-19T17:54:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(15 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f64598ae700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c7b4167400 0x55c7b4176680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:16 5.1e 5:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167400 2023-12-19T17:54:00.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c7b4167400 0x55c7b4176680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:00.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.968+0000 7f645a8b0700 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c7b4167400 0x55c7b4176680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.972+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(16 [pgnls start_epoch 46 out=49b] v46'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167400 2023-12-19T17:54:00.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.972+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:17 5.1 5:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4166c00 2023-12-19T17:54:00.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.972+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(17 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:00.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.972+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 5.11 5:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4166800 2023-12-19T17:54:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.972+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(18 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:00.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.972+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 5.9 5:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4ba3400 2023-12-19T17:54:00.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(19 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:20 5.19 5:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167000 2023-12-19T17:54:00.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(20 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:00.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 5.5 5:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167400 2023-12-19T17:54:00.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(21 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167400 2023-12-19T17:54:00.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:22 5.15 5:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167800 2023-12-19T17:54:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(22 [pgnls start_epoch 46 out=73b] v45'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:00.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:23 5.d 5:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4166400 2023-12-19T17:54:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(23 [pgnls start_epoch 46 out=74b] v46'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:00.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.976+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:24 5.1d 5:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167000 2023-12-19T17:54:00.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(24 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:00.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 5.3 5:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167400 2023-12-19T17:54:00.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(25 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167400 2023-12-19T17:54:00.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 5.13 5:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4ba3000 2023-12-19T17:54:00.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(26 [pgnls start_epoch 46 out=98b] v46'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:00.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:27 5.b 5:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4166400 2023-12-19T17:54:00.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(27 [pgnls start_epoch 46 out=76b] v46'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:00.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.980+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:28 5.1b 5:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167800 2023-12-19T17:54:00.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(28 [pgnls start_epoch 46 out=49b] v46'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:00.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 5.7 5:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167800 2023-12-19T17:54:00.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(29 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:00.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:30 5.17 5:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4ba3000 2023-12-19T17:54:00.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(30 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:00.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:31 5.f 5:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4167800 2023-12-19T17:54:00.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(31 [pgnls start_epoch 46 out=73b] v46'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:00.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.984+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 5.1f 5:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4166800 2023-12-19T17:54:00.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(32 [pgnls start_epoch 46 out=101b] v46'12 uv12 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:00.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-12-19T17:54:00.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4ba3800 con 0x55c7b4ba3400 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=2495b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+2495 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:00.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-12-19T17:54:00.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:34 5.13 5:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c000 con 0x55c7b4ba3000 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-12-19T17:54:00.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:35 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c400 con 0x55c7b4166800 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=508b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.988+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:36 5.0 5:00000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3000 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(36 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:00.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:37 5.10 5:08000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3400 2023-12-19T17:54:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(37 [pgnls start_epoch 46 out=81b] v46'21 uv21 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:38 5.8 5:10000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166400 2023-12-19T17:54:00.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(38 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:00.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:39 5.18 5:18000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166c00 2023-12-19T17:54:00.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(39 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:00.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.992+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:40 5.4 5:20000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3400 2023-12-19T17:54:00.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(40 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:00.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:41 5.14 5:28000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3000 2023-12-19T17:54:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(41 [pgnls start_epoch 46 out=125b] v46'43 uv43 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:01.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:42 5.c 5:30000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167000 2023-12-19T17:54:01.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(42 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:01.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:43 5.1c 5:38000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166c00 2023-12-19T17:54:01.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(43 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:01.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:00.996+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:44 5.2 5:40000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166800 2023-12-19T17:54:01.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(44 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:01.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:45 5.12 5:48000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167000 2023-12-19T17:54:01.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(45 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:01.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:46 5.a 5:50000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166400 2023-12-19T17:54:01.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(46 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:01.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:47 5.1a 5:58000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3400 2023-12-19T17:54:01.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(47 [pgnls start_epoch 46 out=49b] v46'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.000+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:48 5.6 5:60000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166400 2023-12-19T17:54:01.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(48 [pgnls start_epoch 46 out=49b] v45'9 uv9 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:01.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:49 5.16 5:68000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167800 2023-12-19T17:54:01.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(49 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:01.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:50 5.e 5:70000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166c00 2023-12-19T17:54:01.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(50 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:01.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:51 5.1e 5:78000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167400 2023-12-19T17:54:01.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(51 [pgnls start_epoch 46 out=49b] v46'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167400 2023-12-19T17:54:01.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.004+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:52 5.1 5:80000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166c00 2023-12-19T17:54:01.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(52 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4166c00 2023-12-19T17:54:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:53 5.11 5:88000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166800 2023-12-19T17:54:01.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(53 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:01.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:54 5.9 5:90000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3400 2023-12-19T17:54:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(54 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:55 5.19 5:98000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167000 2023-12-19T17:54:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(55 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.008+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:56 5.5 5:a0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167400 2023-12-19T17:54:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(56 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167400 2023-12-19T17:54:01.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:57 5.15 5:a8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167800 2023-12-19T17:54:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(57 [pgnls start_epoch 46 out=73b] v45'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:58 5.d 5:b0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166400 2023-12-19T17:54:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(58 [pgnls start_epoch 46 out=74b] v46'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:01.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:59 5.1d 5:b8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167000 2023-12-19T17:54:01.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(59 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167000 2023-12-19T17:54:01.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:60 5.3 5:c0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167400 2023-12-19T17:54:01.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(60 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4167400 2023-12-19T17:54:01.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.012+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:61 5.13 5:c8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3000 2023-12-19T17:54:01.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(61 [pgnls start_epoch 46 out=98b] v46'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:01.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:62 5.b 5:d0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166400 2023-12-19T17:54:01.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(62 [pgnls start_epoch 46 out=76b] v46'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:01.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:63 5.1b 5:d8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167800 2023-12-19T17:54:01.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(63 [pgnls start_epoch 46 out=49b] v46'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:01.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:64 5.7 5:e0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167800 2023-12-19T17:54:01.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(64 [pgnls start_epoch 46 out=49b] v45'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:01.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.016+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:65 5.17 5:e8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3000 2023-12-19T17:54:01.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(65 [pgnls start_epoch 46 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:01.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:66 5.f 5:f0000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4167800 2023-12-19T17:54:01.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(66 [pgnls start_epoch 46 out=73b] v46'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4167800 2023-12-19T17:54:01.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:67 5.1f 5:f8000000::::head [pgnls start_epoch 46 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4166800 2023-12-19T17:54:01.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(67 [pgnls start_epoch 46 out=101b] v46'12 uv12 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:01.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-12-19T17:54:01.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:68 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419cc00 con 0x55c7b4ba3400 2023-12-19T17:54:01.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=2495b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+2495 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: adding 0x100000001f6 for future processing to fix dnfirst 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: adding 0x100000001f8 for future processing to fix dnfirst 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 20 datascan.scan_links: adding 0x100000001f9 for future processing to fix dnfirst 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-12-19T17:54:01.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.020+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-12-19T17:54:01.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:69 5.13 5:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419d000 con 0x55c7b4ba3000 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T17:54:01.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:70 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419d400 con 0x55c7b4166800 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=508b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 20 datascan.scan_links: injected ino detected 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: processing 6 injected_inos 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 10 datascan.scan_links: handling injected_ino 0x10000000000 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2023-12-19T17:54:01.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:71 5.1f 5:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419d800 con 0x55c7b4166800 2023-12-19T17:54:01.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:01.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T17:54:01.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 20 datascan.scan_links: first is now 2 2023-12-19T17:54:01.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.024+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:72 5.1f 5:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c400 con 0x55c7b4166800 2023-12-19T17:54:01.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v46'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166800 2023-12-19T17:54:01.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-12-19T17:54:01.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-12-19T17:54:01.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:0 2023-12-19T17:54:01.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:73 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3400 2023-12-19T17:54:01.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 20 datascan.read_dentry: oid=10000000000.00000000 dname=0 frag=*, r=0 2023-12-19T17:54:01.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 20 datascan.scan_links: first is now 2 2023-12-19T17:54:01.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.028+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:74 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419d400 con 0x55c7b4ba3400 2023-12-19T17:54:01.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v46'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-12-19T17:54:01.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 10 datascan.scan_links: handling injected_ino 0x100000001f6 2023-12-19T17:54:01.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:1 2023-12-19T17:54:01.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:75 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419dc00 con 0x55c7b4ba3400 2023-12-19T17:54:01.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(75 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 20 datascan.read_dentry: oid=10000000000.00000000 dname=1 frag=*, r=0 2023-12-19T17:54:01.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 20 datascan.scan_links: first is now 2 2023-12-19T17:54:01.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.032+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:76 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4ba3400 2023-12-19T17:54:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(76 10000000000.00000000 [omap-set-vals] v46'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x100000001f6 2023-12-19T17:54:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 10 datascan.scan_links: handling injected_ino 0x100000001f7 2023-12-19T17:54:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:2 2023-12-19T17:54:01.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:77 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419cc00 con 0x55c7b4ba3400 2023-12-19T17:54:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(77 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 20 datascan.read_dentry: oid=10000000000.00000000 dname=2 frag=*, r=0 2023-12-19T17:54:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 20 datascan.scan_links: first is now 2 2023-12-19T17:54:01.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:78 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3400 2023-12-19T17:54:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.040+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(78 10000000000.00000000 [omap-set-vals] v46'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x100000001f7 2023-12-19T17:54:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 10 datascan.scan_links: handling injected_ino 0x100000001f8 2023-12-19T17:54:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:3 2023-12-19T17:54:01.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:79 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4ba3800 con 0x55c7b4ba3400 2023-12-19T17:54:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(79 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 20 datascan.read_dentry: oid=10000000000.00000000 dname=3 frag=*, r=0 2023-12-19T17:54:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 20 datascan.scan_links: first is now 2 2023-12-19T17:54:01.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:80 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419d400 con 0x55c7b4ba3400 2023-12-19T17:54:01.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(80 10000000000.00000000 [omap-set-vals] v46'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x100000001f8 2023-12-19T17:54:01.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 10 datascan.scan_links: handling injected_ino 0x100000001f9 2023-12-19T17:54:01.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:4 2023-12-19T17:54:01.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.044+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:81 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419dc00 con 0x55c7b4ba3400 2023-12-19T17:54:01.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.048+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.048+0000 7f645b8f3840 20 datascan.read_dentry: oid=10000000000.00000000 dname=4 frag=*, r=0 2023-12-19T17:54:01.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.048+0000 7f645b8f3840 20 datascan.scan_links: first is now 2 2023-12-19T17:54:01.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.048+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:82 5.10 5:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419cc00 con 0x55c7b4ba3400 2023-12-19T17:54:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645a8b0700 1 -- 172.21.15.45:0/541881933 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(82 10000000000.00000000 [omap-set-vals] v46'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55c7b4b08d80 con 0x55c7b4ba3400 2023-12-19T17:54:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645b8f3840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x100000001f9 2023-12-19T17:54:01.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645b8f3840 10 datascan.scan_links: updating inotable 2023-12-19T17:54:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:83 5.13 5:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b4167c00 con 0x55c7b4ba3000 2023-12-19T17:54:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(83 mds0_inotable [read 0~34 out=34b] v0'0 uv6 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645b8f3840 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2023-12-19T17:54:01.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645b8f3840 10 mds.0.inotable: skip_inos now [0x100000001fa~0xfffffffe06] 2023-12-19T17:54:01.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.052+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:84 5.13 5:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419c800 con 0x55c7b4ba3000 2023-12-19T17:54:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f64598ae700 1 -- 172.21.15.45:0/541881933 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(84 mds0_inotable [writefull 0~34] v46'8 uv8 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55c7b4b08b40 con 0x55c7b4ba3000 2023-12-19T17:54:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 10 datascan.scan_links: updating snaptable 2023-12-19T17:54:01.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:85 5.d 5:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x55c7b419d400 con 0x55c7b4166400 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(85 mds_snaptable [read 0~70 out=70b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55c7b4b08fc0 con 0x55c7b4166400 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c7b4167400 msgr2=0x55c7b4176680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c7b4167400 0x55c7b4176680 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55c7b4167000 msgr2=0x55c7b4175080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55c7b4167000 0x55c7b4175080 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55c7b4166400 msgr2=0x55c7b4174580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55c7b4166400 0x55c7b4174580 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c7b4ba3000 msgr2=0x55c7b3dc0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c7b4ba3000 0x55c7b3dc0100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55c7b4166c00 msgr2=0x55c7b4174b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55c7b4166c00 0x55c7b4174b00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 reap_dead start 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55c7b4167800 msgr2=0x55c7b4175b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55c7b4167800 0x55c7b4175b80 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55c7b4166800 msgr2=0x55c7b4175600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55c7b4166800 0x55c7b4175600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55c7b4ba3400 msgr2=0x55c7b4174000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55c7b4ba3400 0x55c7b4174000 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 reap_dead start 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645a0af700 1 -- 172.21.15.45:0/541881933 reap_dead start 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c7b4166000 msgr2=0x55c7b3dc1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c7b4166000 0x55c7b3dc1700 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x55c7b400c690 tx=0x55c7b400ec00 comp rx=0 tx=0).stop 2023-12-19T17:54:01.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 msgr2=0x55c7b3dc0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.056+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 0x55c7b3dc0c00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x55c7b400d350 tx=0x55c7b400ede0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 shutdown_connections 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c7b4166000 0x55c7b3dc1700 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 --2- 172.21.15.45:0/541881933 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b4ba2800 0x55c7b3dc0c00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 >> 172.21.15.45:0/541881933 conn(0x55c7b3d18c00 msgr2=0x55c7b3e09800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 shutdown_connections 2023-12-19T17:54:01.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/541881933 wait complete. 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 msgr2=0x55c7b3dbeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 0x55c7b3dbeb00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x55c7b3e27350 tx=0x55c7b4b10ba0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 shutdown_connections 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c7b3d19000 0x55c7b3dbf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c7b3d19400 0x55c7b3dbeb00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 --2- 172.21.15.45:0/1130361145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c7b3d19800 0x55c7b3dbe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 >> 172.21.15.45:0/1130361145 conn(0x55c7b3d19c00 msgr2=0x55c7b3e09000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 shutdown_connections 2023-12-19T17:54:01.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.060+0000 7f645b8f3840 1 -- 172.21.15.45:0/1130361145 wait complete. 2023-12-19T17:54:01.073 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.207726, result: 2023-12-19T17:54:01.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-12-19T17:54:01.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.260+0000 7f582d6b5700 1 Processor -- start 2023-12-19T17:54:01.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f582d6b5700 1 -- start start 2023-12-19T17:54:01.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f582d6b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58280d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f582d6b5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f582806fe80 0x7f58280b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f582d6b5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58280d1820 con 0x7f58280b88b0 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f582d6b5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58280d1b00 con 0x7f582806fe80 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f582d6b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280d1de0 con 0x7f582806ea90 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f581e7fc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f58280b88b0 0x7f58280b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57588/0 (socket says 172.21.15.45:57588) 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f581e7fc700 1 -- 172.21.15.45:0/3486630977 learned_addr learned my addr 172.21.15.45:0/3486630977 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:01.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58277fe700 1 --2- 172.21.15.45:0/3486630977 >> v2:172.21.15.45:3300/0 conn(0x7f582806fe80 0x7f58280b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f5826ffd700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58280d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58267fc700 1 -- 172.21.15.45:0/3486630977 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043150146 0 0) 0x7f58280d1820 con 0x7f58280b88b0 2023-12-19T17:54:01.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58267fc700 1 -- 172.21.15.45:0/3486630977 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58140035d0 con 0x7f58280b88b0 2023-12-19T17:54:01.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58277fe700 1 -- 172.21.15.45:0/3486630977 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 msgr2=0x7f58280d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58277fe700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58280d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58277fe700 1 -- 172.21.15.45:0/3486630977 >> v1:172.21.15.45:6789/0 conn(0x7f58280b88b0 legacy=0x7f58280b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f58277fe700 1 -- 172.21.15.45:0/3486630977 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58280d20c0 con 0x7f582806fe80 2023-12-19T17:54:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.264+0000 7f5826ffd700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58280d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f58277fe700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f582806fe80 0x7f58280b6420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5820009850 tx=0x7f5820009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d9451e8b2d3e63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:01.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f58267fc700 1 -- 172.21.15.45:0/3486630977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011830 con 0x7f582806fe80 2023-12-19T17:54:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f58267fc700 1 -- 172.21.15.45:0/3486630977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5820011990 con 0x7f582806fe80 2023-12-19T17:54:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f58267fc700 1 -- 172.21.15.45:0/3486630977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820011d40 con 0x7f582806fe80 2023-12-19T17:54:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 -- 172.21.15.45:0/3486630977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f582806fe80 msgr2=0x7f58280b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f582806fe80 0x7f58280b6420 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5820009850 tx=0x7f5820009b60 comp rx=0 tx=0).stop 2023-12-19T17:54:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 -- 172.21.15.45:0/3486630977 shutdown_connections 2023-12-19T17:54:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f582806fe80 0x7f58280b6420 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3486630977 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58280d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 -- 172.21.15.45:0/3486630977 >> 172.21.15.45:0/3486630977 conn(0x7f58280b46d0 msgr2=0x7f58280b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 -- 172.21.15.45:0/3486630977 shutdown_connections 2023-12-19T17:54:01.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.268+0000 7f582d6b5700 1 -- 172.21.15.45:0/3486630977 wait complete. 2023-12-19T17:54:01.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 Processor -- start 2023-12-19T17:54:01.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 -- start start 2023-12-19T17:54:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58281fa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f582806fe80 0x7f58280cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 0x7f58280c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280cc530 con 0x7f58280b88b0 2023-12-19T17:54:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58280cc810 con 0x7f582806fe80 2023-12-19T17:54:01.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f582d6b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58280ccaf0 con 0x7f582806ea90 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f58277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 0x7f58280c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f58277fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 0x7f58280c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43426/0 (socket says 172.21.15.45:43426) 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f58277fe700 1 -- 172.21.15.45:0/3139688160 learned_addr learned my addr 172.21.15.45:0/3139688160 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f5826ffd700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58281fa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.272+0000 7f581e7fc700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f582806fe80 0x7f58280cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f58277fe700 1 -- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 msgr2=0x7f58281fa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f58277fe700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58281fa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f58277fe700 1 -- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f582806fe80 msgr2=0x7f58280cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f58277fe700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f582806fe80 0x7f58280cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f58277fe700 1 -- 172.21.15.45:0/3139688160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58200094b0 con 0x7f58280b88b0 2023-12-19T17:54:01.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f581e7fc700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f582806fe80 0x7f58280cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:01.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f58277fe700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 0x7f58280c9f20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f58200090b0 tx=0x7f5820004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:01.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58200036c0 con 0x7f58280b88b0 2023-12-19T17:54:01.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582001e070 con 0x7f58280b88b0 2023-12-19T17:54:01.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58281f9dc0 con 0x7f58280b88b0 2023-12-19T17:54:01.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5820003a60 con 0x7f58280b88b0 2023-12-19T17:54:01.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58281fab00 con 0x7f58280b88b0 2023-12-19T17:54:01.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.276+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5828067760 con 0x7f58280b88b0 2023-12-19T17:54:01.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.280+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5820003bc0 con 0x7f58280b88b0 2023-12-19T17:54:01.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.280+0000 7f581ffff700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5808065b00 0x7f5808067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.280+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6634+0+0 (secure 0 0 0) 0x7f5820020070 con 0x7f58280b88b0 2023-12-19T17:54:01.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.280+0000 7f5826ffd700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5808065b00 0x7f5808067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.284+0000 7f5826ffd700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5808065b00 0x7f5808067fc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f581800c960 tx=0x7f5818008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:01.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.288+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5820052000 con 0x7f58280b88b0 2023-12-19T17:54:01.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.528+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7f58280b2ca0 con 0x7f58280b88b0 2023-12-19T17:54:01.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.552+0000 7f581ffff700 1 -- 172.21.15.45:0/3139688160 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 2:0 v23) v1 ==== 101+0+0 (secure 0 0 0) 0x7f5820055620 con 0x7f58280b88b0 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5808065b00 msgr2=0x7f5808067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5808065b00 0x7f5808067fc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f581800c960 tx=0x7f5818008040 comp rx=0 tx=0).stop 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 msgr2=0x7f58280c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 0x7f58280c9f20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f58200090b0 tx=0x7f5820004770 comp rx=0 tx=0).stop 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 shutdown_connections 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5808065b00 0x7f5808067fc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f58280b88b0 0x7f58280c9f20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f582806fe80 0x7f58280cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 --2- 172.21.15.45:0/3139688160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f582806ea90 0x7f58281fa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 >> 172.21.15.45:0/3139688160 conn(0x7f58280b46d0 msgr2=0x7f582815c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 shutdown_connections 2023-12-19T17:54:01.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.556+0000 7f582d6b5700 1 -- 172.21.15.45:0/3139688160 wait complete. 2023-12-19T17:54:01.562 INFO:teuthology.orchestra.run.smithi045.stderr:repaired: restoring rank 2:0 2023-12-19T17:54:01.567 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:01.562+0000 7f3bb1d07700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:54:01.583 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T17:54:01.583 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T17:54:01.583 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T17:54:01.584 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:54:01.584 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T17:54:01.584 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T17:54:01.584 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T17:54:01.584 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:54:01.584 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T17:54:01.584 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T17:54:01.585 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T17:54:01.585 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:54:01.585 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T17:54:01.585 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T17:54:01.585 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T17:54:01.585 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:54:01.601 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T17:54:01.602 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T17:54:01.604 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T17:54:01.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T17:54:01.610 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T17:54:01.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T17:54:01.610 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T17:54:01.611 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T17:54:01.652 INFO:tasks.ceph.mds.c:Started 2023-12-19T17:54:01.653 DEBUG:teuthology.parallel:result is None 2023-12-19T17:54:01.658 INFO:tasks.ceph.mds.a:Started 2023-12-19T17:54:01.659 DEBUG:teuthology.parallel:result is None 2023-12-19T17:54:01.662 INFO:tasks.ceph.mds.d:Started 2023-12-19T17:54:01.663 DEBUG:teuthology.parallel:result is None 2023-12-19T17:54:01.666 INFO:tasks.ceph.mds.b:Started 2023-12-19T17:54:01.667 DEBUG:teuthology.parallel:result is None 2023-12-19T17:54:01.667 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:54:01.773 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:54:01.785 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T17:54:01.794 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:54:01.799 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:54:01.817 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:54:01.812+0000 7f4a6b7ef700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:54:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 Processor -- start 2023-12-19T17:54:01.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 -- start start 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdac406fe80 0x7fdac40b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac40d1820 con 0x7fdac40b88b0 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac40d1b00 con 0x7fdac406fe80 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac8c9f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40d1de0 con 0x7fdac406ea90 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac2ffd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fdac40b88b0 0x7fdac40b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34944/0 (socket says 172.21.15.45:34944) 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac2ffd700 1 -- 172.21.15.45:0/1429040202 learned_addr learned my addr 172.21.15.45:0/1429040202 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:01.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac3fff700 1 --2- 172.21.15.45:0/1429040202 >> v2:172.21.15.73:3300/0 conn(0x7fdac406fe80 0x7fdac40b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac37fe700 1 -- 172.21.15.45:0/1429040202 >> v2:172.21.15.73:3300/0 conn(0x7fdac406fe80 msgr2=0x7fdac40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac37fe700 1 --2- 172.21.15.45:0/1429040202 >> v2:172.21.15.73:3300/0 conn(0x7fdac406fe80 0x7fdac40b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac37fe700 1 -- 172.21.15.45:0/1429040202 >> v1:172.21.15.73:6789/0 conn(0x7fdac40b88b0 legacy=0x7fdac40b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac27fc700 1 -- 172.21.15.45:0/1429040202 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261062184 0 0) 0x7fdac40d1820 con 0x7fdac40b88b0 2023-12-19T17:54:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac37fe700 1 -- 172.21.15.45:0/1429040202 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac40d20c0 con 0x7fdac406ea90 2023-12-19T17:54:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac37fe700 1 --2- 172.21.15.45:0/1429040202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40d0f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009850 tx=0x7fdab4009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7a89ae45e027d21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac27fc700 1 -- 172.21.15.45:0/1429040202 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4011830 con 0x7fdac406ea90 2023-12-19T17:54:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac27fc700 1 -- 172.21.15.45:0/1429040202 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab4011990 con 0x7fdac406ea90 2023-12-19T17:54:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.836+0000 7fdac27fc700 1 -- 172.21.15.45:0/1429040202 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4011d40 con 0x7fdac406ea90 2023-12-19T17:54:01.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 -- 172.21.15.45:0/1429040202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 msgr2=0x7fdac40d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/1429040202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40d0f20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdab4009850 tx=0x7fdab4009b60 comp rx=0 tx=0).stop 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 -- 172.21.15.45:0/1429040202 shutdown_connections 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/1429040202 >> v2:172.21.15.73:3300/0 conn(0x7fdac406fe80 0x7fdac40b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/1429040202 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40d0f20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 -- 172.21.15.45:0/1429040202 >> 172.21.15.45:0/1429040202 conn(0x7fdac40b46d0 msgr2=0x7fdac40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 -- 172.21.15.45:0/1429040202 shutdown_connections 2023-12-19T17:54:01.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 -- 172.21.15.45:0/1429040202 wait complete. 2023-12-19T17:54:01.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.840+0000 7fdac8c9f700 1 Processor -- start 2023-12-19T17:54:01.847 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:01.842+0000 7f09ab37a700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:54:01.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 -- start start 2023-12-19T17:54:01.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40b7370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac406fe80 0x7fdac40c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac40b88b0 0x7fdac40ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac41f1e00 con 0x7fdac40b88b0 2023-12-19T17:54:01.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40cb240 con 0x7fdac406fe80 2023-12-19T17:54:01.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac8c9f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac40ca900 con 0x7fdac406ea90 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40b7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac40b88b0 0x7fdac40ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40b7370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38688/0 (socket says 172.21.15.45:38688) 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 -- 172.21.15.45:0/990886465 learned_addr learned my addr 172.21.15.45:0/990886465 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac2ffd700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac406fe80 0x7fdac40c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 -- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac406fe80 msgr2=0x7fdac40c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac406fe80 0x7fdac40c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 -- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac40b88b0 msgr2=0x7fdac40ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac40b88b0 0x7fdac40ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 -- 172.21.15.45:0/990886465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab40094b0 con 0x7fdac406ea90 2023-12-19T17:54:01.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac3fff700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac40b88b0 0x7fdac40ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdac37fe700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40b7370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdab4014040 tx=0x7fdab4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.844+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4019980 con 0x7fdac406ea90 2023-12-19T17:54:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.848+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab401e070 con 0x7fdac406ea90 2023-12-19T17:54:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.848+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab4019d20 con 0x7fdac406ea90 2023-12-19T17:54:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.848+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac40cabe0 con 0x7fdac406ea90 2023-12-19T17:54:01.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.848+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac40cb490 con 0x7fdac406ea90 2023-12-19T17:54:01.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.848+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac4067760 con 0x7fdac406ea90 2023-12-19T17:54:01.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.848+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdab402d450 con 0x7fdac406ea90 2023-12-19T17:54:01.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.852+0000 7fdaabfff700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdab0065ad0 0x7fdab0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:01.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.852+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fdab40848d0 con 0x7fdac406ea90 2023-12-19T17:54:01.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.852+0000 7fdac2ffd700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdab0065ad0 0x7fdab0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:01.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.852+0000 7fdac2ffd700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdab0065ad0 0x7fdab0067f90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdac40b3030 tx=0x7fdab8007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:01.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:01.856+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdab4051f30 con 0x7fdac406ea90 2023-12-19T17:54:02.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.072+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdac40cb680 con 0x7fdac406ea90 2023-12-19T17:54:02.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.076+0000 7fdaabfff700 1 -- 172.21.15.45:0/990886465 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fdab4055550 con 0x7fdac406ea90 2023-12-19T17:54:02.080 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:54:02.080 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":26,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:01.830300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:54:02.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdab0065ad0 msgr2=0x7fdab0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdab0065ad0 0x7fdab0067f90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdac40b3030 tx=0x7fdab8007e00 comp rx=0 tx=0).stop 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 msgr2=0x7fdac40b7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40b7370 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fdab4014040 tx=0x7fdab4004770 comp rx=0 tx=0).stop 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 shutdown_connections 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdab0065ad0 0x7fdab0067f90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdac40b88b0 0x7fdac40ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdac406fe80 0x7fdac40c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 --2- 172.21.15.45:0/990886465 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdac406ea90 0x7fdac40b7370 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 >> 172.21.15.45:0/990886465 conn(0x7fdac40b46d0 msgr2=0x7fdac40b1d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:02.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 shutdown_connections 2023-12-19T17:54:02.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:02.080+0000 7fdac8c9f700 1 -- 172.21.15.45:0/990886465 wait complete. 2023-12-19T17:54:02.087 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 26 2023-12-19T17:54:02.507 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:53:56.240467+0000', 'modified': '2023-12-19T17:54:01.830300+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 50, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 55385}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_55385': {'gid': 55385, 'name': 'd', 'rank': 0, 'incarnation': 26, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.73:6835/3950826099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 3950826099}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3950826099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6, 7], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:54:02.507 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_55385:up:replay 2023-12-19T17:54:03.508 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:54:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.688+0000 7f6383f35700 1 Processor -- start 2023-12-19T17:54:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6383f35700 1 -- start start 2023-12-19T17:54:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6383f35700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f637c0cddd0 0x7f637c0ce1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6383f35700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c0ae1e0 con 0x7f637c15ab50 2023-12-19T17:54:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6383f35700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f637c15af30 con 0x7f637c15e260 2023-12-19T17:54:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6383f35700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f637c0ce720 con 0x7f637c0cddd0 2023-12-19T17:54:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6381cd1700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f637c15ab50 0x7f637c0adad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57604/0 (socket says 172.21.15.45:57604) 2023-12-19T17:54:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6381cd1700 1 -- 172.21.15.45:0/2127073264 learned_addr learned my addr 172.21.15.45:0/2127073264 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f63824d2700 1 --2- 172.21.15.45:0/2127073264 >> v2:172.21.15.73:3300/0 conn(0x7f637c0cddd0 0x7f637c0ce1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.692+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3152404315 0 0) 0x7f637c15af30 con 0x7f637c15e260 2023-12-19T17:54:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63680035d0 con 0x7f637c15e260 2023-12-19T17:54:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 62165855 0 0) 0x7f6378001110 con 0x7f637c15ab50 2023-12-19T17:54:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f637c15af30 con 0x7f637c15ab50 2023-12-19T17:54:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f63824d2700 1 -- 172.21.15.45:0/2127073264 >> v1:172.21.15.73:6789/0 conn(0x7f637c15e260 legacy=0x7f637c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f63824d2700 1 -- 172.21.15.45:0/2127073264 >> v1:172.21.15.45:6789/0 conn(0x7f637c15ab50 legacy=0x7f637c0adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f63824d2700 1 -- 172.21.15.45:0/2127073264 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f637c0cd010 con 0x7f637c0cddd0 2023-12-19T17:54:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f63824d2700 1 --2- 172.21.15.45:0/2127073264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0cddd0 0x7f637c0ce1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6374009d90 tx=0x7f637400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4e55a5b878c2aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400e070 con 0x7f637c0cddd0 2023-12-19T17:54:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f637400bb20 con 0x7f637c0cddd0 2023-12-19T17:54:03.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6380ccf700 1 -- 172.21.15.45:0/2127073264 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f637400be90 con 0x7f637c0cddd0 2023-12-19T17:54:03.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 -- 172.21.15.45:0/2127073264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0cddd0 msgr2=0x7f637c0ce1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 --2- 172.21.15.45:0/2127073264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0cddd0 0x7f637c0ce1e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6374009d90 tx=0x7f637400b330 comp rx=0 tx=0).stop 2023-12-19T17:54:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 -- 172.21.15.45:0/2127073264 shutdown_connections 2023-12-19T17:54:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 --2- 172.21.15.45:0/2127073264 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c0cddd0 0x7f637c0ce1e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 -- 172.21.15.45:0/2127073264 >> 172.21.15.45:0/2127073264 conn(0x7f637c0cba40 msgr2=0x7f637c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 -- 172.21.15.45:0/2127073264 shutdown_connections 2023-12-19T17:54:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.696+0000 7f6383f35700 1 -- 172.21.15.45:0/2127073264 wait complete. 2023-12-19T17:54:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.700+0000 7f6383f35700 1 Processor -- start 2023-12-19T17:54:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.700+0000 7f6383f35700 1 -- start start 2023-12-19T17:54:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 0x7f637c143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f637c15ab50 0x7f637c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c15e260 0x7f637c0af470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:03.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c158700 con 0x7f637c0cddd0 2023-12-19T17:54:03.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637c1589e0 con 0x7f637c15e260 2023-12-19T17:54:03.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637c158cc0 con 0x7f637c15ab50 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 0x7f637c143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 0x7f637c143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43476/0 (socket says 172.21.15.45:43476) 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 -- 172.21.15.45:0/3528489881 learned_addr learned my addr 172.21.15.45:0/3528489881 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f63824d2700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c15e260 0x7f637c0af470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f63814d0700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f637c15ab50 0x7f637c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 -- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f637c15ab50 msgr2=0x7f637c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f637c15ab50 0x7f637c1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 -- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c15e260 msgr2=0x7f637c0af470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c15e260 0x7f637c0af470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 -- 172.21.15.45:0/3528489881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6374009a70 con 0x7f637c0cddd0 2023-12-19T17:54:03.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6381cd1700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 0x7f637c143370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f637800c730 tx=0x7f637800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378005d90 con 0x7f637c0cddd0 2023-12-19T17:54:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63780070d0 con 0x7f637c0cddd0 2023-12-19T17:54:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6378007440 con 0x7f637c0cddd0 2023-12-19T17:54:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637c158fa0 con 0x7f637c0cddd0 2023-12-19T17:54:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.704+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f637c15d020 con 0x7f637c0cddd0 2023-12-19T17:54:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.708+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f637c04ed30 con 0x7f637c0cddd0 2023-12-19T17:54:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.708+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f63780075a0 con 0x7f637c0cddd0 2023-12-19T17:54:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.708+0000 7f63727fc700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6360065ad0 0x7f6360067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.708+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f6378082870 con 0x7f637c0cddd0 2023-12-19T17:54:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.712+0000 7f63814d0700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6360065ad0 0x7f6360067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.712+0000 7f63814d0700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6360065ad0 0x7f6360067f90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f637c0cc920 tx=0x7f636c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.716+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f637804fe80 con 0x7f637c0cddd0 2023-12-19T17:54:03.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.936+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f637c0ae1e0 con 0x7f637c0cddd0 2023-12-19T17:54:03.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.936+0000 7f63727fc700 1 -- 172.21.15.45:0/3528489881 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f637c0ae1e0 con 0x7f637c0cddd0 2023-12-19T17:54:03.943 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:54:03.943 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":28,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:03.844702+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6360065ad0 msgr2=0x7f6360067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6360065ad0 0x7f6360067f90 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f637c0cc920 tx=0x7f636c009040 comp rx=0 tx=0).stop 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 msgr2=0x7f637c143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 0x7f637c143370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f637800c730 tx=0x7f637800ca40 comp rx=0 tx=0).stop 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 shutdown_connections 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6360065ad0 0x7f6360067f90 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f637c15e260 0x7f637c0af470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f637c15ab50 0x7f637c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 --2- 172.21.15.45:0/3528489881 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f637c0cddd0 0x7f637c143370 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 >> 172.21.15.45:0/3528489881 conn(0x7f637c0cba40 msgr2=0x7f637c0ce920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 shutdown_connections 2023-12-19T17:54:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:03.944+0000 7f6383f35700 1 -- 172.21.15.45:0/3528489881 wait complete. 2023-12-19T17:54:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 28 2023-12-19T17:54:04.372 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:53:56.240467+0000', 'modified': '2023-12-19T17:54:03.844702+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 50, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 55385}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_55385': {'gid': 55385, 'name': 'd', 'rank': 0, 'incarnation': 26, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.73:6835/3950826099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 3950826099}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3950826099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6, 7], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:54:04.372 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_55385:up:rejoin 2023-12-19T17:54:05.373 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:54:05.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.548+0000 7f4d62def700 1 Processor -- start 2023-12-19T17:54:05.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.548+0000 7f4d62def700 1 -- start start 2023-12-19T17:54:05.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d62def700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d5c1615a0 0x7f4d5c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:05.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d62def700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d5c0af720 0x7f4d5c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:05.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d62def700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d5c0c3f90 con 0x7f4d5c1611c0 2023-12-19T17:54:05.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d62def700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c0b00f0 con 0x7f4d5c1615a0 2023-12-19T17:54:05.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d62def700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d5c070340 con 0x7f4d5c0af720 2023-12-19T17:54:05.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d61ded700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4d5c1611c0 0x7f4d5c06d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57612/0 (socket says 172.21.15.45:57612) 2023-12-19T17:54:05.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d61ded700 1 -- 172.21.15.45:0/778351023 learned_addr learned my addr 172.21.15.45:0/778351023 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:05.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d615ec700 1 --2- 172.21.15.45:0/778351023 >> v2:172.21.15.45:3300/0 conn(0x7f4d5c1615a0 0x7f4d5c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:05.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d625ee700 1 --2- 172.21.15.45:0/778351023 >> v2:172.21.15.73:3300/0 conn(0x7f4d5c0af720 0x7f4d5c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:05.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d615ec700 1 -- 172.21.15.45:0/778351023 >> v2:172.21.15.73:3300/0 conn(0x7f4d5c0af720 msgr2=0x7f4d5c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:05.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d615ec700 1 --2- 172.21.15.45:0/778351023 >> v2:172.21.15.73:3300/0 conn(0x7f4d5c0af720 0x7f4d5c0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d615ec700 1 -- 172.21.15.45:0/778351023 >> v1:172.21.15.45:6789/0 conn(0x7f4d5c1611c0 legacy=0x7f4d5c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:05.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d615ec700 1 -- 172.21.15.45:0/778351023 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d5c0c4270 con 0x7f4d5c1615a0 2023-12-19T17:54:05.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.552+0000 7f4d60deb700 1 -- 172.21.15.45:0/778351023 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944434912 0 0) 0x7f4d5c0c3f90 con 0x7f4d5c1611c0 2023-12-19T17:54:05.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d615ec700 1 --2- 172.21.15.45:0/778351023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c3920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b1140 tx=0x7f4d4c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0d0ec5f455c98ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:05.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d60deb700 1 -- 172.21.15.45:0/778351023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011830 con 0x7f4d5c1615a0 2023-12-19T17:54:05.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d60deb700 1 -- 172.21.15.45:0/778351023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d4c011990 con 0x7f4d5c1615a0 2023-12-19T17:54:05.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d60deb700 1 -- 172.21.15.45:0/778351023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c011d20 con 0x7f4d5c1615a0 2023-12-19T17:54:05.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 -- 172.21.15.45:0/778351023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c1615a0 msgr2=0x7f4d5c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:05.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 --2- 172.21.15.45:0/778351023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c3920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b1140 tx=0x7f4d4c009b30 comp rx=0 tx=0).stop 2023-12-19T17:54:05.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 -- 172.21.15.45:0/778351023 shutdown_connections 2023-12-19T17:54:05.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 --2- 172.21.15.45:0/778351023 >> v2:172.21.15.73:3300/0 conn(0x7f4d5c0af720 0x7f4d5c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 --2- 172.21.15.45:0/778351023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c3920 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 -- 172.21.15.45:0/778351023 >> 172.21.15.45:0/778351023 conn(0x7f4d5c0cb900 msgr2=0x7f4d5c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:05.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 -- 172.21.15.45:0/778351023 shutdown_connections 2023-12-19T17:54:05.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.556+0000 7f4d62def700 1 -- 172.21.15.45:0/778351023 wait complete. 2023-12-19T17:54:05.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 Processor -- start 2023-12-19T17:54:05.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 -- start start 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 0x7f4d5c162470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d5c1611c0 0x7f4d5c152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0c6d20 con 0x7f4d5c0af720 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c1629b0 con 0x7f4d5c1615a0 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d62def700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5c0c61a0 con 0x7f4d5c1611c0 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 0x7f4d5c162470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 0x7f4d5c162470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43498/0 (socket says 172.21.15.45:43498) 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 -- 172.21.15.45:0/2010633556 learned_addr learned my addr 172.21.15.45:0/2010633556 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:05.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d625ee700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:05.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d615ec700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d5c1611c0 0x7f4d5c152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:05.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 -- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d5c1611c0 msgr2=0x7f4d5c152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d5c1611c0 0x7f4d5c152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 -- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5c1615a0 msgr2=0x7f4d5c0c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.560+0000 7f4d61ded700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d61ded700 1 -- 172.21.15.45:0/2010633556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d4c0094b0 con 0x7f4d5c0af720 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d625ee700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d61ded700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 0x7f4d5c162470 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800c580 tx=0x7f4d5800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58004ca0 con 0x7f4d5c0af720 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58004e20 con 0x7f4d5c0af720 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5c0c6480 con 0x7f4d5c0af720 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58007310 con 0x7f4d5c0af720 2023-12-19T17:54:05.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d5c0c6a40 con 0x7f4d5c0af720 2023-12-19T17:54:05.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.564+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5c06e760 con 0x7f4d5c0af720 2023-12-19T17:54:05.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.568+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d58007470 con 0x7f4d5c0af720 2023-12-19T17:54:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.568+0000 7f4d527fc700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d40065b50 0x7f4d40068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.568+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f4d58083280 con 0x7f4d5c0af720 2023-12-19T17:54:05.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.568+0000 7f4d615ec700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d40065b50 0x7f4d40068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:05.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.568+0000 7f4d615ec700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d40065b50 0x7f4d40068010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b1140 tx=0x7f4d4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:05.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.576+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4d580508e0 con 0x7f4d5c0af720 2023-12-19T17:54:05.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.792+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d5c162c90 con 0x7f4d5c0af720 2023-12-19T17:54:05.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.792+0000 7f4d527fc700 1 -- 172.21.15.45:0/2010633556 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f4d5c162c90 con 0x7f4d5c0af720 2023-12-19T17:54:05.796 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:54:05.797 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:04.849464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:54:05.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d40065b50 msgr2=0x7f4d40068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:05.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d40065b50 0x7f4d40068010 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4d5c0b1140 tx=0x7f4d4c008030 comp rx=0 tx=0).stop 2023-12-19T17:54:05.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 msgr2=0x7f4d5c162470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 0x7f4d5c162470 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800c580 tx=0x7f4d5800c940 comp rx=0 tx=0).stop 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 shutdown_connections 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d40065b50 0x7f4d40068010 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d5c1615a0 0x7f4d5c0c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d5c1611c0 0x7f4d5c152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 --2- 172.21.15.45:0/2010633556 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d5c0af720 0x7f4d5c162470 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 >> 172.21.15.45:0/2010633556 conn(0x7f4d5c0cb900 msgr2=0x7f4d5c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 shutdown_connections 2023-12-19T17:54:05.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:05.796+0000 7f4d62def700 1 -- 172.21.15.45:0/2010633556 wait complete. 2023-12-19T17:54:05.804 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-12-19T17:54:06.232 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:53:56.240467+0000', 'modified': '2023-12-19T17:54:04.849464+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 50, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 55385}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_55385': {'gid': 55385, 'name': 'd', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6835/3950826099', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 3950826099}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3950826099}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6, 7], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:54:06.233 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:54:06.233 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-19T17:54:06.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.416+0000 7ff0e93a0700 1 Processor -- start 2023-12-19T17:54:06.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.416+0000 7ff0e93a0700 1 -- start start 2023-12-19T17:54:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e93a0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0e415cff0 0x7ff0e4161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e93a0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e40c3920 0x7ff0e40c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e93a0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e40ca6f0 con 0x7ff0e406ddd0 2023-12-19T17:54:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e93a0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e415d3d0 con 0x7ff0e40c3920 2023-12-19T17:54:06.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e93a0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e40c42f0 con 0x7ff0e415cff0 2023-12-19T17:54:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e40c3920 0x7ff0e40c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e2ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0e415cff0 0x7ff0e4161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff0e40c3920 0x7ff0e40c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43510/0 (socket says 172.21.15.45:43510) 2023-12-19T17:54:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 -- 172.21.15.45:0/3752755899 learned_addr learned my addr 172.21.15.45:0/3752755899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 -- 172.21.15.45:0/3752755899 >> v2:172.21.15.73:3300/0 conn(0x7ff0e415cff0 msgr2=0x7ff0e4161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/3752755899 >> v2:172.21.15.73:3300/0 conn(0x7ff0e415cff0 0x7ff0e4161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 -- 172.21.15.45:0/3752755899 >> v1:172.21.15.73:6789/0 conn(0x7ff0e406ddd0 legacy=0x7ff0e40c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.420+0000 7ff0e37fe700 1 -- 172.21.15.45:0/3752755899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40c9220 con 0x7ff0e40c3920 2023-12-19T17:54:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/3752755899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e40c3920 0x7ff0e40c3db0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40721d0 tx=0x7ff0dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e32807412562666 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e27fc700 1 -- 172.21.15.45:0/3752755899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00e070 con 0x7ff0e40c3920 2023-12-19T17:54:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e27fc700 1 -- 172.21.15.45:0/3752755899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc00b910 con 0x7ff0e40c3920 2023-12-19T17:54:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e27fc700 1 -- 172.21.15.45:0/3752755899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc00bcc0 con 0x7ff0e40c3920 2023-12-19T17:54:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 -- 172.21.15.45:0/3752755899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e40c3920 msgr2=0x7ff0e40c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/3752755899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e40c3920 0x7ff0e40c3db0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7ff0e40721d0 tx=0x7ff0dc00b330 comp rx=0 tx=0).stop 2023-12-19T17:54:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 -- 172.21.15.45:0/3752755899 shutdown_connections 2023-12-19T17:54:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/3752755899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e40c3920 0x7ff0e40c3db0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/3752755899 >> v2:172.21.15.73:3300/0 conn(0x7ff0e415cff0 0x7ff0e4161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 -- 172.21.15.45:0/3752755899 >> 172.21.15.45:0/3752755899 conn(0x7ff0e40cb900 msgr2=0x7ff0e40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 -- 172.21.15.45:0/3752755899 shutdown_connections 2023-12-19T17:54:06.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.424+0000 7ff0e93a0700 1 -- 172.21.15.45:0/3752755899 wait complete. 2023-12-19T17:54:06.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.428+0000 7ff0e93a0700 1 Processor -- start 2023-12-19T17:54:06.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.428+0000 7ff0e93a0700 1 -- start start 2023-12-19T17:54:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0e406ddd0 0x7ff0e41548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0e40c3920 0x7ff0e40b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 0x7ff0e40b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41f3af0 con 0x7ff0e415cff0 2023-12-19T17:54:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41f3d60 con 0x7ff0e40c3920 2023-12-19T17:54:06.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41f4040 con 0x7ff0e406ddd0 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 0x7ff0e40b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 0x7ff0e40b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43520/0 (socket says 172.21.15.45:43520) 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2149508682 learned_addr learned my addr 172.21.15.45:0/2149508682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0e406ddd0 0x7ff0e41548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0dbfff700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0e40c3920 0x7ff0e40b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0e406ddd0 msgr2=0x7ff0e41548e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0e406ddd0 0x7ff0e41548e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0e40c3920 msgr2=0x7ff0e40b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0e40c3920 0x7ff0e40b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2149508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0dc009b30 con 0x7ff0e415cff0 2023-12-19T17:54:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0e406ddd0 0x7ff0e41548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 0x7ff0e40b4350 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff0e406abb0 tx=0x7ff0dc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0db7fe700 1 -- 172.21.15.45:0/2149508682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc004930 con 0x7ff0e415cff0 2023-12-19T17:54:06.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0db7fe700 1 -- 172.21.15.45:0/2149508682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc0099b0 con 0x7ff0e415cff0 2023-12-19T17:54:06.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0db7fe700 1 -- 172.21.15.45:0/2149508682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc01c680 con 0x7ff0e415cff0 2023-12-19T17:54:06.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e41f4320 con 0x7ff0e415cff0 2023-12-19T17:54:06.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.432+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40b1840 con 0x7ff0e415cff0 2023-12-19T17:54:06.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.436+0000 7ff0db7fe700 1 -- 172.21.15.45:0/2149508682 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff0dc01c7e0 con 0x7ff0e415cff0 2023-12-19T17:54:06.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.436+0000 7ff0db7fe700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff0c4065ad0 0x7ff0c4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.436+0000 7ff0db7fe700 1 -- 172.21.15.45:0/2149508682 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7ff0dc0851e0 con 0x7ff0e415cff0 2023-12-19T17:54:06.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.436+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff0c4065ad0 0x7ff0c4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.440+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff0c4065ad0 0x7ff0c4067f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009ba0 tx=0x7ff0d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.440+0000 7ff0ec62d740 1 Processor -- start 2023-12-19T17:54:06.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.440+0000 7ff0ec62d740 1 -- start start 2023-12-19T17:54:06.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ee290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x29155b0 con 0x29ee7d0 2023-12-19T17:54:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2912d40 con 0x29cc430 2023-12-19T17:54:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x290e630 con 0x29edeb0 2023-12-19T17:54:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43524/0 (socket says 172.21.15.45:43524) 2023-12-19T17:54:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 -- 172.21.15.45:0/763472418 learned_addr learned my addr 172.21.15.45:0/763472418 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0dbfff700 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ee290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 -- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 msgr2=0x29a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 -- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 msgr2=0x29ee290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ee290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 -- 172.21.15.45:0/763472418 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2781960 con 0x29ee7d0 2023-12-19T17:54:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29a18c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0832a0 tx=0x7ff0dc056380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=471198810c2167c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0d8ff9700 1 -- 172.21.15.45:0/763472418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc056480 con 0x29ee7d0 2023-12-19T17:54:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0d8ff9700 1 -- 172.21.15.45:0/763472418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc05a2b0 con 0x29ee7d0 2023-12-19T17:54:06.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0d8ff9700 1 -- 172.21.15.45:0/763472418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc05e460 con 0x29ee7d0 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- 172.21.15.45:0/763472418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 msgr2=0x29a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29a18c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc0832a0 tx=0x7ff0dc056380 comp rx=0 tx=0).stop 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- 172.21.15.45:0/763472418 shutdown_connections 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29a18c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ee290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/763472418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- 172.21.15.45:0/763472418 >> 172.21.15.45:0/763472418 conn(0x27364d0 msgr2=0x29a7d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- 172.21.15.45:0/763472418 shutdown_connections 2023-12-19T17:54:06.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.444+0000 7ff0ec62d740 1 -- 172.21.15.45:0/763472418 wait complete. 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 -- start start 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 Processor -- start 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ed1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a7070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cbc80 con 0x29ee7d0 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d1b00 con 0x29cc430 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x27baaa0 con 0x29edeb0 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0ec62d740 10 client.0 _ll_register_callbacks cb 0x2907f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a7070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38724/0 (socket says 172.21.15.45:38724) 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0dbfff700 1 -- 172.21.15.45:0/2655430332 learned_addr learned my addr 172.21.15.45:0/2655430332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ed1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 msgr2=0x29a7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 msgr2=0x29ed1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ed1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 -- 172.21.15.45:0/2655430332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e40b1840 con 0x29ee7d0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cee70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc052980 tx=0x7ff0dc009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78405bfd31af135f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.448+0000 7ff0c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/2655430332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0dc072070 con 0x29ee7d0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/2655430332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7ff0dc0092e0 con 0x29ee7d0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29076b0 con 0x29ee7d0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/2655430332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0dc082070 con 0x29ee7d0 2023-12-19T17:54:06.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 10 client.5994 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x28d4770 con 0x29ee7d0 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/2655430332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29076b0 con 0x29ee7d0 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/2655430332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff0dc055970 con 0x29ee7d0 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 10 client.5994 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 10 client.5994 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 20 client.5994 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29a5c30 0x29a6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 4 client.5994 mds_command: new command op to 55385 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28c9a00 con 0x29a5c30 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29a5c30 0x29a6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29a5c30 0x29a6010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a309df672f4162 server_cookie=6b54381a1f0f3bda in_seq=0 out_seq=0 2023-12-19T17:54:06.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.452+0000 7ff0c1ffb700 10 client.5994 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:06.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/2655430332 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x28c9a00 con 0x29a5c30 2023-12-19T17:54:06.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0c1ffb700 10 client.5994 handle_command_reply: tid=0 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 client.5994 shutdown 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 msgr2=0x29cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cee70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc052980 tx=0x7ff0dc009810 comp rx=0 tx=0).stop 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 shutdown_connections 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29a5c30 0x29a6010 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cee70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29a7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/2655430332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29cc430 0x29ed1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0c1ffb700 0 client.5994 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 >> 172.21.15.45:0/2655430332 conn(0x27364d0 msgr2=0x29c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 shutdown_connections 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 1 -- 172.21.15.45:0/2655430332 wait complete. 2023-12-19T17:54:06.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.456+0000 7ff0ec62d740 20 client.5994 trim_cache size 0 max 16384 2023-12-19T17:54:06.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 Processor -- start 2023-12-19T17:54:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 -- start start 2023-12-19T17:54:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 0x29a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29fd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29ee7d0 0x29fd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2899480 con 0x29cc430 2023-12-19T17:54:06.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x28dc670 con 0x29ee7d0 2023-12-19T17:54:06.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.476+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x290ccf0 con 0x29edeb0 2023-12-19T17:54:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 0x29a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 0x29a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43530/0 (socket says 172.21.15.45:43530) 2023-12-19T17:54:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 -- 172.21.15.45:0/570512341 learned_addr learned my addr 172.21.15.45:0/570512341 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0dbfff700 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29fd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29ee7d0 0x29fd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 -- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 msgr2=0x29fd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29fd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 -- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29ee7d0 msgr2=0x29fd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29ee7d0 0x29fd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 -- 172.21.15.45:0/570512341 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28ba9a0 con 0x29cc430 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29ee7d0 0x29fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:06.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 0x29a3e30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x29a6610 tx=0x7ff0d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c36e7fbf895344cf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0d97fa700 1 -- 172.21.15.45:0/570512341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d402e030 con 0x29cc430 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0d97fa700 1 -- 172.21.15.45:0/570512341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d40036c0 con 0x29cc430 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0d97fa700 1 -- 172.21.15.45:0/570512341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4003a30 con 0x29cc430 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 -- 172.21.15.45:0/570512341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 msgr2=0x29a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 0x29a3e30 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x29a6610 tx=0x7ff0d4014000 comp rx=0 tx=0).stop 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 -- 172.21.15.45:0/570512341 shutdown_connections 2023-12-19T17:54:06.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29ee7d0 0x29fd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29edeb0 0x29fd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/570512341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29cc430 0x29a3e30 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 -- 172.21.15.45:0/570512341 >> 172.21.15.45:0/570512341 conn(0x27364d0 msgr2=0x29ec450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 -- 172.21.15.45:0/570512341 shutdown_connections 2023-12-19T17:54:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.480+0000 7ff0ec62d740 1 -- 172.21.15.45:0/570512341 wait complete. 2023-12-19T17:54:06.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 -- start start 2023-12-19T17:54:06.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 Processor -- start 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29edeb0 0x29cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a4d600 0x2a4d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f4520 con 0x29ee7d0 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x29f4030 con 0x29edeb0 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x29eff80 con 0x2a4d600 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0ec62d740 10 client.0 _ll_register_callbacks cb 0x2847e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0dbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43538/0 (socket says 172.21.15.45:43538) 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0dbfff700 1 -- 172.21.15.45:0/938664600 learned_addr learned my addr 172.21.15.45:0/938664600 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29edeb0 0x29cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.484+0000 7ff0e37fe700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a4d600 0x2a4d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0dbfff700 1 -- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a4d600 msgr2=0x2a4d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0dbfff700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a4d600 0x2a4d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0dbfff700 1 -- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29edeb0 msgr2=0x29cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0dbfff700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29edeb0 0x29cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0dbfff700 1 -- 172.21.15.45:0/938664600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40041f0 con 0x29ee7d0 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29edeb0 0x29cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:06.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0dbfff700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cbba0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc016720 tx=0x7ff0cc016a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee02b96331ab05e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/938664600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc01b070 con 0x29ee7d0 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/938664600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7ff0cc01dd10 con 0x29ee7d0 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0dc05a2b0 con 0x29ee7d0 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/938664600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0cc0052e0 con 0x29ee7d0 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 10 client.6000 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:06.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x28aec70 con 0x29ee7d0 2023-12-19T17:54:06.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/938664600 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0dc05a2b0 con 0x29ee7d0 2023-12-19T17:54:06.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/938664600 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff0cc012070 con 0x29ee7d0 2023-12-19T17:54:06.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 10 client.6000 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:06.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 10 client.6000 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-19T17:54:06.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 20 client.6000 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:06.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29f0f70 0x29f1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 4 client.6000 mds_command: new command op to 55385 tid=0[{"prefix": "status"}] 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "status"}) v1 -- 0x278d460 con 0x29f0f70 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.488+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29f0f70 0x29f1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e2ffd700 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29f0f70 0x29f1350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c931e3f8b02a269 server_cookie=ad8f63908b68787d in_seq=0 out_seq=0 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0c1ffb700 10 client.6000 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0c1ffb700 1 -- 172.21.15.45:0/938664600 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x278d460 con 0x29f0f70 2023-12-19T17:54:06.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0c1ffb700 10 client.6000 handle_command_reply: tid=0 2023-12-19T17:54:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 client.6000 shutdown 2023-12-19T17:54:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 msgr2=0x29cbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cbba0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc016720 tx=0x7ff0cc016a30 comp rx=0 tx=0).stop 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 shutdown_connections 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x29f0f70 0x29f1350 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a4d600 0x2a4d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29ee7d0 0x29cbba0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 --2- 172.21.15.45:0/938664600 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29edeb0 0x29cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0c1ffb700 0 client.6000 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 >> 172.21.15.45:0/938664600 conn(0x27364d0 msgr2=0x29ec450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 shutdown_connections 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 1 -- 172.21.15.45:0/938664600 wait complete. 2023-12-19T17:54:06.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0ec62d740 20 client.6000 trim_cache size 0 max 16384 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 55385, 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.6575596260000003, 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 29, 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 50, 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 50, 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 4.6915356839999998 2023-12-19T17:54:06.498 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:54:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff0c4065ad0 msgr2=0x7ff0c4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff0c4065ad0 0x7ff0c4067f90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4009ba0 tx=0x7ff0d4008040 comp rx=0 tx=0).stop 2023-12-19T17:54:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 msgr2=0x7ff0e40b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 0x7ff0e40b4350 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7ff0e406abb0 tx=0x7ff0dc004af0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 shutdown_connections 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff0c4065ad0 0x7ff0c4067f90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0e415cff0 0x7ff0e40b4350 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0e40c3920 0x7ff0e40b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 --2- 172.21.15.45:0/2149508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0e406ddd0 0x7ff0e41548e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 >> 172.21.15.45:0/2149508682 conn(0x7ff0e40cb900 msgr2=0x7ff0e4160750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 shutdown_connections 2023-12-19T17:54:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.492+0000 7ff0e93a0700 1 -- 172.21.15.45:0/2149508682 wait complete. 2023-12-19T17:54:06.522 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:54:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.708+0000 7fce3a08a700 1 Processor -- start 2023-12-19T17:54:06.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce3a08a700 1 -- start start 2023-12-19T17:54:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce3a08a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 0x7fce3406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce3a08a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce3406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce3a08a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3406cbb0 con 0x7fce3415ab50 2023-12-19T17:54:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce3a08a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3406fa10 con 0x7fce340cd480 2023-12-19T17:54:06.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce3a08a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3406fcf0 con 0x7fce3415af30 2023-12-19T17:54:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce2bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 0x7fce3406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce2bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 0x7fce3406d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:35674/0 (socket says 172.21.15.45:35674) 2023-12-19T17:54:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce33fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce3406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce2bfff700 1 -- 172.21.15.45:0/2005058300 learned_addr learned my addr 172.21.15.45:0/2005058300 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.712+0000 7fce337fe700 1 --1- 172.21.15.45:0/2005058300 >> v1:172.21.15.73:6789/0 conn(0x7fce3415ab50 0x7fce340ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34964/0 (socket says 172.21.15.45:34964) 2023-12-19T17:54:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce33fff700 1 -- 172.21.15.45:0/2005058300 >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 msgr2=0x7fce3406d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce33fff700 1 --2- 172.21.15.45:0/2005058300 >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 0x7fce3406d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce33fff700 1 -- 172.21.15.45:0/2005058300 >> v1:172.21.15.73:6789/0 conn(0x7fce3415ab50 legacy=0x7fce340ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce33fff700 1 -- 172.21.15.45:0/2005058300 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3406ffd0 con 0x7fce3415af30 2023-12-19T17:54:06.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce2bfff700 1 --2- 172.21.15.45:0/2005058300 >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 0x7fce3406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:06.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce33fff700 1 --2- 172.21.15.45:0/2005058300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce3406d5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009d90 tx=0x7fce2c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=251b20ca1b9f81c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce32ffd700 1 -- 172.21.15.45:0/2005058300 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c00e070 con 0x7fce3415af30 2023-12-19T17:54:06.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce32ffd700 1 -- 172.21.15.45:0/2005058300 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c00bb20 con 0x7fce3415af30 2023-12-19T17:54:06.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce32ffd700 1 -- 172.21.15.45:0/2005058300 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c012430 con 0x7fce3415af30 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 -- 172.21.15.45:0/2005058300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 msgr2=0x7fce3406d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2005058300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce3406d5d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fce2c009d90 tx=0x7fce2c00b330 comp rx=0 tx=0).stop 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 -- 172.21.15.45:0/2005058300 shutdown_connections 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2005058300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce3406d5d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2005058300 >> v2:172.21.15.73:3300/0 conn(0x7fce340cd480 0x7fce3406d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 -- 172.21.15.45:0/2005058300 >> 172.21.15.45:0/2005058300 conn(0x7fce340cba40 msgr2=0x7fce340ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 -- 172.21.15.45:0/2005058300 shutdown_connections 2023-12-19T17:54:06.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.716+0000 7fce3a08a700 1 -- 172.21.15.45:0/2005058300 wait complete. 2023-12-19T17:54:06.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 Processor -- start 2023-12-19T17:54:06.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 -- start start 2023-12-19T17:54:06.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 0x7fce340c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce3415ab50 0x7fce34159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce340c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340c6370 con 0x7fce340cd480 2023-12-19T17:54:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce340c5a60 con 0x7fce3415ab50 2023-12-19T17:54:06.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce3a08a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce340c7de0 con 0x7fce3415af30 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce337fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 0x7fce340c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce337fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 0x7fce340c6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43552/0 (socket says 172.21.15.45:43552) 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce337fe700 1 -- 172.21.15.45:0/2458303982 learned_addr learned my addr 172.21.15.45:0/2458303982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce33fff700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce340c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.720+0000 7fce2bfff700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce3415ab50 0x7fce34159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce337fe700 1 -- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 msgr2=0x7fce340c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce337fe700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce340c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce337fe700 1 -- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce3415ab50 msgr2=0x7fce34159400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce337fe700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce3415ab50 0x7fce34159400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce337fe700 1 -- 172.21.15.45:0/2458303982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c009570 con 0x7fce340cd480 2023-12-19T17:54:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce337fe700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 0x7fce340c6800 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c700 tx=0x7fce2400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24005cd0 con 0x7fce340cd480 2023-12-19T17:54:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce24005e30 con 0x7fce340cd480 2023-12-19T17:54:06.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce240072d0 con 0x7fce340cd480 2023-12-19T17:54:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c009a70 con 0x7fce340cd480 2023-12-19T17:54:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce340c6000 con 0x7fce340cd480 2023-12-19T17:54:06.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.724+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3404ed30 con 0x7fce340cd480 2023-12-19T17:54:06.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.728+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce24007430 con 0x7fce340cd480 2023-12-19T17:54:06.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.728+0000 7fce30ff9700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce14065ad0 0x7fce14067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:06.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.728+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fce240828a0 con 0x7fce340cd480 2023-12-19T17:54:06.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.728+0000 7fce2bfff700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce14065ad0 0x7fce14067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:06.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.728+0000 7fce2bfff700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce14065ad0 0x7fce14067f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fce341f5dd0 tx=0x7fce1c0092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:06.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.736+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fce2404fe20 con 0x7fce340cd480 2023-12-19T17:54:06.840 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:06.834+0000 7f09aeb81700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:54:06.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.956+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce3406f430 con 0x7fce340cd480 2023-12-19T17:54:06.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.956+0000 7fce30ff9700 1 -- 172.21.15.45:0/2458303982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fce24017090 con 0x7fce340cd480 2023-12-19T17:54:06.960 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:54:06.961 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:04.849464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce14065ad0 msgr2=0x7fce14067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce14065ad0 0x7fce14067f90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fce341f5dd0 tx=0x7fce1c0092e0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 msgr2=0x7fce340c6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 0x7fce340c6800 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fce2400c700 tx=0x7fce2400ca10 comp rx=0 tx=0).stop 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 shutdown_connections 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce14065ad0 0x7fce14067f90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce3415af30 0x7fce340c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce3415ab50 0x7fce34159400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 --2- 172.21.15.45:0/2458303982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce340cd480 0x7fce340c6800 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:06.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 >> 172.21.15.45:0/2458303982 conn(0x7fce340cba40 msgr2=0x7fce3406d270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:06.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 shutdown_connections 2023-12-19T17:54:06.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:06.960+0000 7fce3a08a700 1 -- 172.21.15.45:0/2458303982 wait complete. 2023-12-19T17:54:06.965 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-12-19T17:54:06.983 INFO:tasks.cephfs.test_data_scan:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 2, "epoch": 29, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-12-19T17:53:56.240467+0000", "damaged": [], "data_pools": [ 6, 7 ], "enabled": true, "epoch": 29, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_55385": { "addr": "172.21.15.73:6835/3950826099", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6834", "nonce": 3950826099, "type": "v2" }, { "addr": "172.21.15.73:6835", "nonce": 3950826099, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 55385, "incarnation": 26, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 50, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 5, "modified": "2023-12-19T17:54:04.849464+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 55385 } } } ], "standbys": [ { "addr": "172.21.15.73:6833/662383788", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6832", "nonce": 662383788, "type": "v2" }, { "addr": "172.21.15.73:6833", "nonce": 662383788, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 25, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5869, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.45:6835/2130056318", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6834", "nonce": 2130056318, "type": "v2" }, { "addr": "172.21.15.45:6835", "nonce": 2130056318, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 25, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5949, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.45:6837/2260120300", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6836", "nonce": 2260120300, "type": "v2" }, { "addr": "172.21.15.45:6837", "nonce": 2260120300, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 25, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 5961, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-12-19T17:54:06.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:54:07.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 Processor -- start 2023-12-19T17:54:07.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 -- start start 2023-12-19T17:54:07.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d00ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:07.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67d006e0a0 0x7f67d00cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:07.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67d006cbb0 con 0x7f67d015af30 2023-12-19T17:54:07.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67d006fa10 con 0x7f67d006e0a0 2023-12-19T17:54:07.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67d6017700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d006fcf0 con 0x7f67d015ab50 2023-12-19T17:54:07.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67cffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f67d006e0a0 0x7f67d00cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:07.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d00ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:07.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d00ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38770/0 (socket says 172.21.15.45:38770) 2023-12-19T17:54:07.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.164+0000 7f67cf7fe700 1 -- 172.21.15.45:0/4020386460 learned_addr learned my addr 172.21.15.45:0/4020386460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:07.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67ce7fc700 1 -- 172.21.15.45:0/4020386460 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301386480 0 0) 0x7f67d006cbb0 con 0x7f67d015af30 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67ce7fc700 1 -- 172.21.15.45:0/4020386460 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67b80035d0 con 0x7f67d015af30 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67cffff700 1 -- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 msgr2=0x7f67d00ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67cffff700 1 --2- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d00ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67cffff700 1 -- 172.21.15.45:0/4020386460 >> v1:172.21.15.73:6789/0 conn(0x7f67d015af30 legacy=0x7f67d015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67cffff700 1 -- 172.21.15.45:0/4020386460 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67d006ffd0 con 0x7f67d006e0a0 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67cf7fe700 1 --2- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d00ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67cffff700 1 --2- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d00cd2b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009d90 tx=0x7f67c800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f693c5b364e5cf73 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:07.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67ce7fc700 1 -- 172.21.15.45:0/4020386460 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c800e070 con 0x7f67d006e0a0 2023-12-19T17:54:07.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67ce7fc700 1 -- 172.21.15.45:0/4020386460 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c800bb20 con 0x7f67d006e0a0 2023-12-19T17:54:07.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67ce7fc700 1 -- 172.21.15.45:0/4020386460 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8012430 con 0x7f67d006e0a0 2023-12-19T17:54:07.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 -- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 msgr2=0x7f67d00cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:07.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 --2- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d00cd2b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f67c8009d90 tx=0x7f67c800b330 comp rx=0 tx=0).stop 2023-12-19T17:54:07.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 -- 172.21.15.45:0/4020386460 shutdown_connections 2023-12-19T17:54:07.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 --2- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d00cd2b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 --2- 172.21.15.45:0/4020386460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d00ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 -- 172.21.15.45:0/4020386460 >> 172.21.15.45:0/4020386460 conn(0x7f67d00cba40 msgr2=0x7f67d00ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.168+0000 7f67d6017700 1 -- 172.21.15.45:0/4020386460 shutdown_connections 2023-12-19T17:54:07.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.172+0000 7f67d6017700 1 -- 172.21.15.45:0/4020386460 wait complete. 2023-12-19T17:54:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.172+0000 7f67d6017700 1 Processor -- start 2023-12-19T17:54:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.172+0000 7f67d6017700 1 -- start start 2023-12-19T17:54:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d01e8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 0x7f67d01f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d00c8700 con 0x7f67d015af30 2023-12-19T17:54:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67d014ca60 con 0x7f67d006e0a0 2023-12-19T17:54:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67d01f7630 con 0x7f67d015ab50 2023-12-19T17:54:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 0x7f67d01f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:07.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 0x7f67d01f70f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43568/0 (socket says 172.21.15.45:43568) 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 -- 172.21.15.45:0/311794280 learned_addr learned my addr 172.21.15.45:0/311794280 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cf7fe700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d01e8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67ceffd700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 -- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 msgr2=0x7f67d014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 -- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 msgr2=0x7f67d01e8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d01e8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 -- 172.21.15.45:0/311794280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c0009570 con 0x7f67d015af30 2023-12-19T17:54:07.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67cffff700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 0x7f67d01f70f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b370 tx=0x7f67c8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8012d20 con 0x7f67d015af30 2023-12-19T17:54:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67c8020070 con 0x7f67d015af30 2023-12-19T17:54:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c8009a70 con 0x7f67d015af30 2023-12-19T17:54:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67c8012ea0 con 0x7f67d015af30 2023-12-19T17:54:07.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.176+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67d01e9030 con 0x7f67d015af30 2023-12-19T17:54:07.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.180+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67d004ed30 con 0x7f67d015af30 2023-12-19T17:54:07.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.180+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f67c8004280 con 0x7f67d015af30 2023-12-19T17:54:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.180+0000 7f67b7fff700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f67bc065ad0 0x7f67bc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.180+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f67c8022070 con 0x7f67d015af30 2023-12-19T17:54:07.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.180+0000 7f67cf7fe700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f67bc065ad0 0x7f67bc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:07.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.184+0000 7f67cf7fe700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f67bc065ad0 0x7f67bc067f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f67c0006d50 tx=0x7f67c00092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:07.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.188+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f67c8052ad0 con 0x7f67d015af30 2023-12-19T17:54:07.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.404+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f67d006c990 con 0x7f67d015af30 2023-12-19T17:54:07.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67b7fff700 1 -- 172.21.15.45:0/311794280 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) v1 ==== 53+0+91 (secure 0 0 0) 0x7f67c80560f0 con 0x7f67d015af30 2023-12-19T17:54:07.411 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_extra ] 2023-12-19T17:54:07.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f67bc065ad0 msgr2=0x7f67bc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f67bc065ad0 0x7f67bc067f90 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f67c0006d50 tx=0x7f67c00092e0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 msgr2=0x7f67d01f70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 0x7f67d01f70f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f67c800b370 tx=0x7f67c8004b40 comp rx=0 tx=0).stop 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 shutdown_connections 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f67bc065ad0 0x7f67bc067f90 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f67d015af30 0x7f67d01f70f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f67d015ab50 0x7f67d014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 --2- 172.21.15.45:0/311794280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67d006e0a0 0x7f67d01e8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:07.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 >> 172.21.15.45:0/311794280 conn(0x7f67d00cba40 msgr2=0x7f67d0156ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 shutdown_connections 2023-12-19T17:54:07.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:07.408+0000 7f67d6017700 1 -- 172.21.15.45:0/311794280 wait complete. 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:54:07.436 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:54:07.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:07.437 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:54:07.457 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42218sec preferred_lft 42218sec 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:54:07.458 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:54:07.459 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T17:54:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T17:54:07.460 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:54:07.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:07.461 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:54:07.541 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:54:07.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:07.544 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:54:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:54:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:54:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:54:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:54:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:54:07.606 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:54:07.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:07.607 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:54:07.607 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:54:07.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:54:07.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:54:07.608 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:54:07.608 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:54:07.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:07.755 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:54:07.775 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:54:07.775 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T17:54:07.776 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:54:07.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:07.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:54:07.863 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T17:54:07.864 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:54:07.864 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:07.926 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:54:07.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:54:07.926 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:07.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:54:08.065 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:54:08.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:54:08.148 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:54:08.150 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:54:08.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:08.151 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:54:08.216 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:54:08.216 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T17:54:08.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:54:08.300 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:54:08.300 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:54:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:54:08.382 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:54:08.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:08.382 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:54:08.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T17:54:08.408+0000 7f5dd05d7640 -1 init, newargv = 0x561df2146430 newargc=15 2023-12-19T17:54:08.412 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[47628]: starting ceph client 2023-12-19T17:54:08.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[47628]: starting fuse 2023-12-19T17:54:08.426 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:54:08.427 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T17:54:08.427 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T17:54:08.428 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:54:08.591 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.47628.asok 2023-12-19T17:54:08.775 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47628.asok 2023-12-19T17:54:08.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:08.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47628.asok status 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "47628", 2023-12-19T17:54:08.984 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 55427, 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 55427 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3436971360 2023-12-19T17:54:08.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "172.21.15.45:0", 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3436971360 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.55427 172.21.15.45:0/3436971360", 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "172.21.15.45:0/3436971360", 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 29, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 50, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:54:08.986 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:54:09.000 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:09.000 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:54:09.000 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:09.022 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:54:09.023 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:09.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:09.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:09.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub start / repair,recursive 2023-12-19T17:54:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 Processor -- start 2023-12-19T17:54:09.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 -- start start 2023-12-19T17:54:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe86815ccb0 0x7fe8680b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe8680d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8680d15b0 con 0x7fe8680d0e40 2023-12-19T17:54:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8680d2b90 con 0x7fe86815ccb0 2023-12-19T17:54:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e935700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680d1890 con 0x7fe86815d090 2023-12-19T17:54:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86d933700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe86815ccb0 0x7fe8680b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e134700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8680d0e40 0x7fe868070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45030/0 (socket says 172.21.15.45:45030) 2023-12-19T17:54:09.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86e134700 1 -- 172.21.15.45:0/3866181053 learned_addr learned my addr 172.21.15.45:0/3866181053 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.335+0000 7fe86d132700 1 --2- 172.21.15.45:0/3866181053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe8680d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86d933700 1 -- 172.21.15.45:0/3866181053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 msgr2=0x7fe8680d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86d933700 1 --2- 172.21.15.45:0/3866181053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe8680d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86d933700 1 -- 172.21.15.45:0/3866181053 >> v1:172.21.15.45:6789/0 conn(0x7fe8680d0e40 legacy=0x7fe868070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86d933700 1 -- 172.21.15.45:0/3866181053 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8680d1b70 con 0x7fe86815ccb0 2023-12-19T17:54:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86d933700 1 --2- 172.21.15.45:0/3866181053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe86815ccb0 0x7fe8680b8900 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe864009850 tx=0x7fe864009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efa1e7881e4b4d40 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86c931700 1 -- 172.21.15.45:0/3866181053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864011830 con 0x7fe86815ccb0 2023-12-19T17:54:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86c931700 1 -- 172.21.15.45:0/3866181053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe864011990 con 0x7fe86815ccb0 2023-12-19T17:54:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86c931700 1 -- 172.21.15.45:0/3866181053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864011d40 con 0x7fe86815ccb0 2023-12-19T17:54:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 -- 172.21.15.45:0/3866181053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe86815ccb0 msgr2=0x7fe8680b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 --2- 172.21.15.45:0/3866181053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe86815ccb0 0x7fe8680b8900 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fe864009850 tx=0x7fe864009b60 comp rx=0 tx=0).stop 2023-12-19T17:54:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 -- 172.21.15.45:0/3866181053 shutdown_connections 2023-12-19T17:54:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 --2- 172.21.15.45:0/3866181053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe8680d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 --2- 172.21.15.45:0/3866181053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe86815ccb0 0x7fe8680b8900 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 -- 172.21.15.45:0/3866181053 >> 172.21.15.45:0/3866181053 conn(0x7fe8680d2f50 msgr2=0x7fe8680d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 -- 172.21.15.45:0/3866181053 shutdown_connections 2023-12-19T17:54:09.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.339+0000 7fe86e935700 1 -- 172.21.15.45:0/3866181053 wait complete. 2023-12-19T17:54:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.343+0000 7fe86e935700 1 Processor -- start 2023-12-19T17:54:09.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.343+0000 7fe86e935700 1 -- start start 2023-12-19T17:54:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 0x7fe8681566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86815ccb0 0x7fe8681e88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe86815b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe868156bf0 con 0x7fe8680d0e40 2023-12-19T17:54:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe868153810 con 0x7fe86815ccb0 2023-12-19T17:54:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8680cb6a0 con 0x7fe86815d090 2023-12-19T17:54:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 0x7fe8681566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 0x7fe8681566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57698/0 (socket says 172.21.15.45:57698) 2023-12-19T17:54:09.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 -- 172.21.15.45:0/2419597059 learned_addr learned my addr 172.21.15.45:0/2419597059 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d132700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86815ccb0 0x7fe8681e88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e134700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe86815b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 -- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 msgr2=0x7fe86815b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe86815b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 -- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86815ccb0 msgr2=0x7fe8681e88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86815ccb0 0x7fe8681e88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 -- 172.21.15.45:0/2419597059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8640094b0 con 0x7fe8680d0e40 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e134700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe86815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86d933700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 0x7fe8681566b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe8640090b0 tx=0x7fe864004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe85e7fc700 1 -- 172.21.15.45:0/2419597059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864004590 con 0x7fe8680d0e40 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe85e7fc700 1 -- 172.21.15.45:0/2419597059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86401f070 con 0x7fe8680d0e40 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe85e7fc700 1 -- 172.21.15.45:0/2419597059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864003900 con 0x7fe8680d0e40 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe868153a60 con 0x7fe8680d0e40 2023-12-19T17:54:09.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.347+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8680cb960 con 0x7fe8680d0e40 2023-12-19T17:54:09.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.351+0000 7fe85e7fc700 1 -- 172.21.15.45:0/2419597059 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe864003a60 con 0x7fe8680d0e40 2023-12-19T17:54:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.351+0000 7fe85e7fc700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe84c065ad0 0x7fe84c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.351+0000 7fe85e7fc700 1 -- 172.21.15.45:0/2419597059 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fe864021070 con 0x7fe8680d0e40 2023-12-19T17:54:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.351+0000 7fe86d132700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe84c065ad0 0x7fe84c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe86d132700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe84c065ad0 0x7fe84c067f90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe868153300 tx=0x7fe858008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 Processor -- start 2023-12-19T17:54:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 -- start start 2023-12-19T17:54:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 0x1ca3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1ca3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1ca48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c03cf0 con 0x1ca36a0 2023-12-19T17:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c01480 con 0x1cbae40 2023-12-19T17:54:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.355+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bfcd70 con 0x1ca4500 2023-12-19T17:54:09.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 0x1ca3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 0x1ca3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57712/0 (socket says 172.21.15.45:57712) 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 -- 172.21.15.45:0/3235149577 learned_addr learned my addr 172.21.15.45:0/3235149577 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86e134700 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1ca48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d132700 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1ca3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 -- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 msgr2=0x1ca48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1ca48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 -- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 msgr2=0x1ca3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1ca3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 -- 172.21.15.45:0/3235149577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1aefee0 con 0x1ca36a0 2023-12-19T17:54:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d132700 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1ca3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe86d933700 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 0x1ca3a80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe86405daf0 tx=0x7fe8640524b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fb21f410f858d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe84b7fe700 1 -- 172.21.15.45:0/3235149577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864059e70 con 0x1ca36a0 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe84b7fe700 1 -- 172.21.15.45:0/3235149577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86405e020 con 0x1ca36a0 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe84b7fe700 1 -- 172.21.15.45:0/3235149577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe864052750 con 0x1ca36a0 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 -- 172.21.15.45:0/3235149577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 msgr2=0x1ca3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 0x1ca3a80 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fe86405daf0 tx=0x7fe8640524b0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 -- 172.21.15.45:0/3235149577 shutdown_connections 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1ca48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1ca3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 --2- 172.21.15.45:0/3235149577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca36a0 0x1ca3a80 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 -- 172.21.15.45:0/3235149577 >> 172.21.15.45:0/3235149577 conn(0x1a24780 msgr2=0x1cbde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 -- 172.21.15.45:0/3235149577 shutdown_connections 2023-12-19T17:54:09.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.359+0000 7fe872e23740 1 -- 172.21.15.45:0/3235149577 wait complete. 2023-12-19T17:54:09.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 -- start start 2023-12-19T17:54:09.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 Processor -- start 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca36a0 0x1ce5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1c95350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1c95890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bbfe70 con 0x1ca4500 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bbfb10 con 0x1cbae40 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b92360 con 0x1ca36a0 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe872e23740 10 client.0 _ll_register_callbacks cb 0x1bf66b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1c95350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1c95350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57728/0 (socket says 172.21.15.45:57728) 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 -- 172.21.15.45:0/2553300520 learned_addr learned my addr 172.21.15.45:0/2553300520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d933700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca36a0 0x1ce5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86e134700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1c95890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 -- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca36a0 msgr2=0x1ce5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca36a0 0x1ce5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 -- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 msgr2=0x1c95890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1c95890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86d132700 1 -- 172.21.15.45:0/2553300520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8680cb960 con 0x1ca4500 2023-12-19T17:54:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.363+0000 7fe86e134700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1c95890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe86d132700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1c95350 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe858011f60 tx=0x7fe858004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32d2ae6e80560c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 1 -- 172.21.15.45:0/2553300520 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe858015e80 con 0x1ca4500 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 1 -- 172.21.15.45:0/2553300520 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fe858022420 con 0x1ca4500 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bc6810 con 0x1ca4500 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 1 -- 172.21.15.45:0/2553300520 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8580225e0 con 0x1ca4500 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 10 client.6030 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x1bc2b50 con 0x1ca4500 2023-12-19T17:54:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 1 -- 172.21.15.45:0/2553300520 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bc6810 con 0x1ca4500 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 1 -- 172.21.15.45:0/2553300520 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fe858022740 con 0x1ca4500 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 10 client.6030 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 10 client.6030 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 20 client.6030 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1c920f0 0x1c924d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 4 client.6030 mds_command: new command op to 55385 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1bb9980 con 0x1c920f0 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe86d933700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1c920f0 0x1c924d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe848ff9700 10 client.6030 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.367+0000 7fe86d933700 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1c920f0 0x1c924d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8aa934a4ab0cfb6 server_cookie=e894ee527104dc0e in_seq=0 out_seq=0 2023-12-19T17:54:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe848ff9700 1 -- 172.21.15.45:0/2553300520 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1bb9980 con 0x1c920f0 2023-12-19T17:54:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe848ff9700 10 client.6030 handle_command_reply: tid=0 2023-12-19T17:54:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 client.6030 shutdown 2023-12-19T17:54:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 msgr2=0x1c95350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1c95350 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fe858011f60 tx=0x7fe858004770 comp rx=0 tx=0).stop 2023-12-19T17:54:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 shutdown_connections 2023-12-19T17:54:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1c920f0 0x1c924d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1cbae40 0x1c95890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1c95350 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 --2- 172.21.15.45:0/2553300520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca36a0 0x1ce5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe848ff9700 0 client.6030 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 >> 172.21.15.45:0/2553300520 conn(0x1a24780 msgr2=0x1cd7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 shutdown_connections 2023-12-19T17:54:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 1 -- 172.21.15.45:0/2553300520 wait complete. 2023-12-19T17:54:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.371+0000 7fe872e23740 20 client.6030 trim_cache size 0 max 16384 2023-12-19T17:54:09.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.391+0000 7fe872e23740 1 Processor -- start 2023-12-19T17:54:09.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.391+0000 7fe872e23740 1 -- start start 2023-12-19T17:54:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1ca51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1c91740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe872e23740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 0x1ce21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe872e23740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bcd980 con 0x1cbae40 2023-12-19T17:54:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c04f80 con 0x1ca36a0 2023-12-19T17:54:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bfa170 con 0x1ca4500 2023-12-19T17:54:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 0x1ce21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 0x1ce21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57732/0 (socket says 172.21.15.45:57732) 2023-12-19T17:54:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 -- 172.21.15.45:0/1067023152 learned_addr learned my addr 172.21.15.45:0/1067023152 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86d132700 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1c91740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86d933700 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1ca51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 -- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 msgr2=0x1c91740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1c91740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 -- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 msgr2=0x1ca51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1ca51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 -- 172.21.15.45:0/1067023152 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1ba8d80 con 0x1cbae40 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86d933700 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1ca51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:09.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe86e134700 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 0x1ce21b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe860002090 tx=0x7fe8600020c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a86ad8555ba386c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe84bfff700 1 -- 172.21.15.45:0/1067023152 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860007a10 con 0x1cbae40 2023-12-19T17:54:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe84bfff700 1 -- 172.21.15.45:0/1067023152 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86000d030 con 0x1cbae40 2023-12-19T17:54:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.395+0000 7fe84bfff700 1 -- 172.21.15.45:0/1067023152 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860015680 con 0x1cbae40 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 -- 172.21.15.45:0/1067023152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 msgr2=0x1ce21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 0x1ce21b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe860002090 tx=0x7fe8600020c0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 -- 172.21.15.45:0/1067023152 shutdown_connections 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1cbae40 0x1ce21b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ca4500 0x1c91740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 --2- 172.21.15.45:0/1067023152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1ca51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 -- 172.21.15.45:0/1067023152 >> 172.21.15.45:0/1067023152 conn(0x1a24780 msgr2=0x1ca48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 -- 172.21.15.45:0/1067023152 shutdown_connections 2023-12-19T17:54:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 -- 172.21.15.45:0/1067023152 wait complete. 2023-12-19T17:54:09.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 -- start start 2023-12-19T17:54:09.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.399+0000 7fe872e23740 1 Processor -- start 2023-12-19T17:54:09.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1cf1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1cf0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1cbae40 0x1ce20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cbe7d0 con 0x1ca4500 2023-12-19T17:54:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1cbea00 con 0x1ca36a0 2023-12-19T17:54:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1ca63a0 con 0x1cbae40 2023-12-19T17:54:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe872e23740 10 client.0 _ll_register_callbacks cb 0x1bc3f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1cf0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1cf0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57748/0 (socket says 172.21.15.45:57748) 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 -- 172.21.15.45:0/2330933551 learned_addr learned my addr 172.21.15.45:0/2330933551 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d933700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1cf1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86e134700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1cbae40 0x1ce20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 -- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1cbae40 msgr2=0x1ce20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1cbae40 0x1ce20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 -- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 msgr2=0x1cf1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1cf1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 -- 172.21.15.45:0/2330933551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1aefee0 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe86d132700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1cf0880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe858022700 tx=0x7fe858018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87b233916a1c805 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe848ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.403+0000 7fe848ff9700 1 -- 172.21.15.45:0/2330933551 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8580046f0 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe848ff9700 1 -- 172.21.15.45:0/2330933551 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fe858022ca0 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe86405e020 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe848ff9700 1 -- 172.21.15.45:0/2330933551 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe858009750 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 10 client.6036 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x7fe8680d15b0 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe848ff9700 1 -- 172.21.15.45:0/2330933551 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe86405e020 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe848ff9700 1 -- 172.21.15.45:0/2330933551 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fe85802b650 con 0x1ca4500 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 10 client.6036 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 10 client.6036 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 20 client.6036 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1ce25e0 0x1d39360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 4 client.6036 mds_command: new command op to 55385 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-12-19T17:54:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x1a7b710 con 0x1ce25e0 2023-12-19T17:54:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe86d933700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1ce25e0 0x1d39360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe86d933700 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1ce25e0 0x1d39360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=417d17d4f15beab2 server_cookie=47069a57e8e4f4e4 in_seq=0 out_seq=0 2023-12-19T17:54:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.407+0000 7fe848ff9700 10 client.6036 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe848ff9700 1 -- 172.21.15.45:0/2330933551 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1a7b710 con 0x1ce25e0 2023-12-19T17:54:09.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe848ff9700 10 client.6036 handle_command_reply: tid=0 2023-12-19T17:54:09.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 client.6036 shutdown 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 msgr2=0x1cf0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1cf0880 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fe858022700 tx=0x7fe858018000 comp rx=0 tx=0).stop 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 shutdown_connections 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x1ce25e0 0x1d39360 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1cbae40 0x1ce20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1ca4500 0x1cf0880 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 --2- 172.21.15.45:0/2330933551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ca36a0 0x1cf1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 >> 172.21.15.45:0/2330933551 conn(0x1a24780 msgr2=0x1cbd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe848ff9700 0 client.6036 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.417 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.410+0000 7f09ab37a700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 shutdown_connections 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 1 -- 172.21.15.45:0/2330933551 wait complete. 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe872e23740 20 client.6036 trim_cache size 0 max 16384 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "fe29b988-0514-4006-8a46-630f806949fa", 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2023-12-19T17:54:09.418 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:54:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe84c065ad0 msgr2=0x7fe84c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe84c065ad0 0x7fe84c067f90 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe868153300 tx=0x7fe858008040 comp rx=0 tx=0).stop 2023-12-19T17:54:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 msgr2=0x7fe8681566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 0x7fe8681566b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe8640090b0 tx=0x7fe864004770 comp rx=0 tx=0).stop 2023-12-19T17:54:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 shutdown_connections 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe84c065ad0 0x7fe84c067f90 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe86815d090 0x7fe86815b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe86815ccb0 0x7fe8681e88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 --2- 172.21.15.45:0/2419597059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8680d0e40 0x7fe8681566b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 >> 172.21.15.45:0/2419597059 conn(0x7fe8680d2f50 msgr2=0x7fe8680cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 shutdown_connections 2023-12-19T17:54:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.411+0000 7fe86e935700 1 -- 172.21.15.45:0/2419597059 wait complete. 2023-12-19T17:54:09.421 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55cf85efe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(5)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:54:09.421 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f7 [2,head] /subdir/2 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f57180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f7:[<0x10000000000/2 v32>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f7:[<0x10000000000/2 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:54:09.421 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [2,head] /subdir/3 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f56c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f8:[<0x10000000000/3 v38>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f8:[<0x10000000000/3 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:54:09.421 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f6 [2,head] /subdir/1 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f57700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f6:[<0x10000000000/1 v26>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f6:[<0x10000000000/1 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:54:09.421 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f9 [2,head] /subdir/4 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f56680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f9:[<0x10000000000/4 v40>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f9:[<0x10000000000/4 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:54:09.421 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/0 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85fa1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x10000000001:[<0x10000000000/0 v16>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x10000000001:[<0x10000000000/0 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:54:09.428 INFO:tasks.ceph.mds.d.smithi073.stderr:2023-12-19T17:54:09.422+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v5 ap=5 snaprealm=0x55cf85f04900 DIRTYPARENT f(v1 1=0+1) n(v0 rc2023-12-19T17:54:09.105054+0000 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={55427=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55cf85efd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(5)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-19T17:54:09.105054+0000 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:54:09.442 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-12-19T17:54:09.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.627+0000 7f006a145700 1 Processor -- start 2023-12-19T17:54:09.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.627+0000 7f006a145700 1 -- start start 2023-12-19T17:54:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f006a145700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00640cdfd0 0x7f0064167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f006a145700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f006415d300 con 0x7f00640b8580 2023-12-19T17:54:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f006a145700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00640d1550 con 0x7f006415cf20 2023-12-19T17:54:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f006a145700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00640d1360 con 0x7f00640cdfd0 2023-12-19T17:54:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00640cdfd0 0x7f0064167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00640cdfd0 0x7f0064167a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57762/0 (socket says 172.21.15.45:57762) 2023-12-19T17:54:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 -- 172.21.15.45:0/583270271 learned_addr learned my addr 172.21.15.45:0/583270271 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 -- 172.21.15.45:0/583270271 >> v1:172.21.15.73:6789/0 conn(0x7f006415cf20 legacy=0x7f00640d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 -- 172.21.15.45:0/583270271 >> v1:172.21.15.45:6789/0 conn(0x7f00640b8580 legacy=0x7f00640cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 -- 172.21.15.45:0/583270271 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00640d1830 con 0x7f00640cdfd0 2023-12-19T17:54:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.631+0000 7f0069944700 1 --2- 172.21.15.45:0/583270271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f0064167a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f005c009e50 tx=0x7f005c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84e2e6e085f2429 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f005bfff700 1 -- 172.21.15.45:0/583270271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00e070 con 0x7f00640cdfd0 2023-12-19T17:54:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f005bfff700 1 -- 172.21.15.45:0/583270271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c00b9c0 con 0x7f00640cdfd0 2023-12-19T17:54:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f005bfff700 1 -- 172.21.15.45:0/583270271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00bd70 con 0x7f00640cdfd0 2023-12-19T17:54:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 -- 172.21.15.45:0/583270271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 msgr2=0x7f0064167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 --2- 172.21.15.45:0/583270271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f0064167a30 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f005c009e50 tx=0x7f005c00b330 comp rx=0 tx=0).stop 2023-12-19T17:54:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 -- 172.21.15.45:0/583270271 shutdown_connections 2023-12-19T17:54:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 --2- 172.21.15.45:0/583270271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f0064167a30 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 -- 172.21.15.45:0/583270271 >> 172.21.15.45:0/583270271 conn(0x7f00640b4670 msgr2=0x7f00640b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 -- 172.21.15.45:0/583270271 shutdown_connections 2023-12-19T17:54:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.635+0000 7f006a145700 1 -- 172.21.15.45:0/583270271 wait complete. 2023-12-19T17:54:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 Processor -- start 2023-12-19T17:54:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 -- start start 2023-12-19T17:54:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00640b8580 0x7f00641f3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f006415dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f006415cf20 0x7f006415f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006406a010 con 0x7f00640cdfd0 2023-12-19T17:54:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006415e850 con 0x7f00640b8580 2023-12-19T17:54:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.639+0000 7f006a145700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006415eb30 con 0x7f006415cf20 2023-12-19T17:54:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f006415dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f006415dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57774/0 (socket says 172.21.15.45:57774) 2023-12-19T17:54:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 -- 172.21.15.45:0/3295375299 learned_addr learned my addr 172.21.15.45:0/3295375299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0069143700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00640b8580 0x7f00641f3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0069944700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f006415cf20 0x7f006415f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 -- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f006415cf20 msgr2=0x7f006415f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f006415cf20 0x7f006415f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 -- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00640b8580 msgr2=0x7f00641f3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00640b8580 0x7f00641f3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 -- 172.21.15.45:0/3295375299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c009b30 con 0x7f00640cdfd0 2023-12-19T17:54:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0068942700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f006415dee0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f005400c4d0 tx=0x7f005400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0059ffb700 1 -- 172.21.15.45:0/3295375299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005400cea0 con 0x7f00640cdfd0 2023-12-19T17:54:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0059ffb700 1 -- 172.21.15.45:0/3295375299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00540052f0 con 0x7f00640cdfd0 2023-12-19T17:54:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f0059ffb700 1 -- 172.21.15.45:0/3295375299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540036a0 con 0x7f00640cdfd0 2023-12-19T17:54:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f006415ee10 con 0x7f00640cdfd0 2023-12-19T17:54:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.643+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00641f4150 con 0x7f00640cdfd0 2023-12-19T17:54:09.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.647+0000 7f0059ffb700 1 -- 172.21.15.45:0/3295375299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0054003800 con 0x7f00640cdfd0 2023-12-19T17:54:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0059ffb700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0048065ad0 0x7f0048067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0059ffb700 1 -- 172.21.15.45:0/3295375299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f0054082990 con 0x7f00640cdfd0 2023-12-19T17:54:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069143700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0048065ad0 0x7f0048067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 Processor -- start 2023-12-19T17:54:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 -- start start 2023-12-19T17:54:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069143700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0048065ad0 0x7f0048067f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0060000f60 tx=0x7f0060009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x107b5c0 0x10a56f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a5290 0x107b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x107c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xfa11f0 con 0x10a8560 2023-12-19T17:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0xf9b890 con 0x107b5c0 2023-12-19T17:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0xfee640 con 0x10a5290 2023-12-19T17:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x107c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x107c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57776/0 (socket says 172.21.15.45:57776) 2023-12-19T17:54:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 -- 172.21.15.45:0/3447086646 learned_addr learned my addr 172.21.15.45:0/3447086646 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0068942700 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a5290 0x107b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069143700 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x107b5c0 0x10a56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 -- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a5290 msgr2=0x107b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a5290 0x107b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 -- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x107b5c0 msgr2=0x10a56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x107b5c0 0x10a56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.651+0000 7f0069944700 1 -- 172.21.15.45:0/3447086646 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x100c6e0 con 0x10a8560 2023-12-19T17:54:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f0069944700 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x107c5d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f005c00b730 tx=0x7f005c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dd5f95d3e755e32 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f0046ffd700 1 -- 172.21.15.45:0/3447086646 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c003a40 con 0x10a8560 2023-12-19T17:54:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f0046ffd700 1 -- 172.21.15.45:0/3447086646 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c021070 con 0x10a8560 2023-12-19T17:54:09.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f0046ffd700 1 -- 172.21.15.45:0/3447086646 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c003dc0 con 0x10a8560 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 -- 172.21.15.45:0/3447086646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 msgr2=0x107c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x107c5d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f005c00b730 tx=0x7f005c010000 comp rx=0 tx=0).stop 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 -- 172.21.15.45:0/3447086646 shutdown_connections 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x107c5d0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a5290 0x107b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 --2- 172.21.15.45:0/3447086646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x107b5c0 0x10a56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 -- 172.21.15.45:0/3447086646 >> 172.21.15.45:0/3447086646 conn(0xe0f5b0 msgr2=0x10a7e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 -- 172.21.15.45:0/3447086646 shutdown_connections 2023-12-19T17:54:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 -- 172.21.15.45:0/3447086646 wait complete. 2023-12-19T17:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 -- start start 2023-12-19T17:54:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.655+0000 7f006e63b740 1 Processor -- start 2023-12-19T17:54:09.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x107b5c0 0x10922a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x10a4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x10d02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe9960 con 0x10a8560 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0xfe76c0 con 0x10a4cd0 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0xfa4e30 con 0x107b5c0 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 10 client.0 _ll_register_callbacks cb 0x1037e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x10a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x10a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57778/0 (socket says 172.21.15.45:57778) 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 -- 172.21.15.45:0/1064699188 learned_addr learned my addr 172.21.15.45:0/1064699188 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0069944700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x10d02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0069143700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x107b5c0 0x10922a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 -- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x107b5c0 msgr2=0x10922a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x107b5c0 0x10922a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 -- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 msgr2=0x10d02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x10d02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 -- 172.21.15.45:0/1064699188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00640d1830 con 0x10a8560 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f0068942700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x10a4790 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f005404ffd0 tx=0x7f0054053ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52edea4f37adc525 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f003ffff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f003ffff700 1 -- 172.21.15.45:0/1064699188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054053210 con 0x10a8560 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0xfe0740 con 0x10a8560 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f003ffff700 1 -- 172.21.15.45:0/1064699188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f005405b670 con 0x10a8560 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f003ffff700 1 -- 172.21.15.45:0/1064699188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f005406b160 con 0x10a8560 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 10 client.6051 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0xe5aa40 con 0x10a8560 2023-12-19T17:54:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f003ffff700 1 -- 172.21.15.45:0/1064699188 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0xfe0740 con 0x10a8560 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f003ffff700 1 -- 172.21.15.45:0/1064699188 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f005407ab90 con 0x10a8560 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 10 client.6051 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 10 client.6051 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 20 client.6051 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x108f300 0x108f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 4 client.6051 mds_command: new command op to 55385 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.659+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0xfa4150 con 0x108f300 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f0069143700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x108f300 0x108f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f0069143700 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x108f300 0x108f710 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cec5beb0f5ddcf6 server_cookie=304e2d6677d547fa in_seq=0 out_seq=0 2023-12-19T17:54:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f003ffff700 10 client.6051 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f003ffff700 1 -- 172.21.15.45:0/1064699188 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0xfa4150 con 0x108f300 2023-12-19T17:54:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f003ffff700 10 client.6051 handle_command_reply: tid=0 2023-12-19T17:54:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 client.6051 shutdown 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 msgr2=0x10a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x10a4790 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f005404ffd0 tx=0x7f0054053ba0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 shutdown_connections 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x108f300 0x108f710 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x10d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x10a8560 0x10a4790 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f006e63b740 1 --2- 172.21.15.45:0/1064699188 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x107b5c0 0x10922a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.663+0000 7f003ffff700 0 client.6051 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.667+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 >> 172.21.15.45:0/1064699188 conn(0xe0f5b0 msgr2=0x1080630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.667+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 shutdown_connections 2023-12-19T17:54:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.667+0000 7f006e63b740 1 -- 172.21.15.45:0/1064699188 wait complete. 2023-12-19T17:54:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.667+0000 7f006e63b740 20 client.6051 trim_cache size 0 max 16384 2023-12-19T17:54:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 Processor -- start 2023-12-19T17:54:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 -- start start 2023-12-19T17:54:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x10c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x107ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x10cf1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xe93b80 con 0x107b5c0 2023-12-19T17:54:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0xfb18e0 con 0x10a4cd0 2023-12-19T17:54:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x10c7050 con 0x10a8560 2023-12-19T17:54:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f0069143700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x10c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f0069143700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x10c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57780/0 (socket says 172.21.15.45:57780) 2023-12-19T17:54:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f0069143700 1 -- 172.21.15.45:0/3603202062 learned_addr learned my addr 172.21.15.45:0/3603202062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f0068942700 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x107ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.687+0000 7f0069944700 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x10cf1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f0068942700 1 -- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 msgr2=0x10cf1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f0068942700 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x10cf1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f0068942700 1 -- 172.21.15.45:0/3603202062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 msgr2=0x10c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f0068942700 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x10c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f0068942700 1 -- 172.21.15.45:0/3603202062 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0xfad7e0 con 0x10a4cd0 2023-12-19T17:54:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f0068942700 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x107ab40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0054053410 tx=0x7f0054013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d97f17e3e7fa037e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f00477fe700 1 -- 172.21.15.45:0/3603202062 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005406b160 con 0x10a4cd0 2023-12-19T17:54:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f00477fe700 1 -- 172.21.15.45:0/3603202062 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0054054240 con 0x10a4cd0 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f00477fe700 1 -- 172.21.15.45:0/3603202062 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0054001220 con 0x10a4cd0 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 -- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 msgr2=0x107ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x107ab40 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0054053410 tx=0x7f0054013000 comp rx=0 tx=0).stop 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 -- 172.21.15.45:0/3603202062 shutdown_connections 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x10cf1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x107ab40 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 --2- 172.21.15.45:0/3603202062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x10c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 -- 172.21.15.45:0/3603202062 >> 172.21.15.45:0/3603202062 conn(0xe0f5b0 msgr2=0x107fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 -- 172.21.15.45:0/3603202062 shutdown_connections 2023-12-19T17:54:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 -- 172.21.15.45:0/3603202062 wait complete. 2023-12-19T17:54:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 -- start start 2023-12-19T17:54:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.691+0000 7f006e63b740 1 Processor -- start 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x1126bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x1079b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x107a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xfea620 con 0x107b5c0 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0xf85b70 con 0x10a4cd0 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x10ae200 con 0x10a8560 2023-12-19T17:54:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 10 client.0 _ll_register_callbacks cb 0x7f005c009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x1126bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x1126bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57782/0 (socket says 172.21.15.45:57782) 2023-12-19T17:54:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0068942700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x1079b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069944700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x107a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 -- 172.21.15.45:0/1031022903 learned_addr learned my addr 172.21.15.45:0/1031022903 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 -- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 msgr2=0x107a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x107a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 -- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 msgr2=0x1079b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x1079b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 -- 172.21.15.45:0/1031022903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0xe5aa40 con 0x107b5c0 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f0069143700 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x1126bc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00600274b0 tx=0x7f0060000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd941ddc18758c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f003ffff700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f003ffff700 1 -- 172.21.15.45:0/1031022903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006002c070 con 0x107b5c0 2023-12-19T17:54:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f003ffff700 1 -- 172.21.15.45:0/1031022903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f006001c040 con 0x107b5c0 2023-12-19T17:54:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f005c021070 con 0x107b5c0 2023-12-19T17:54:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f003ffff700 1 -- 172.21.15.45:0/1031022903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f006000f900 con 0x107b5c0 2023-12-19T17:54:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 10 client.6057 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0xf93a10 con 0x107b5c0 2023-12-19T17:54:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f003ffff700 1 -- 172.21.15.45:0/1031022903 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f005c021070 con 0x107b5c0 2023-12-19T17:54:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f003ffff700 1 -- 172.21.15.45:0/1031022903 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f006000fa60 con 0x107b5c0 2023-12-19T17:54:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 10 client.6057 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 10 client.6057 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.695+0000 7f006e63b740 20 client.6057 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x10a9080 0x10a9490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 4 client.6057 mds_command: new command op to 55385 tid=0[{"prefix": "scrub status"}] 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xe66540 con 0x10a9080 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f0068942700 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x10a9080 0x10a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f0068942700 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x10a9080 0x10a9490 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5328af73db8c6f6e server_cookie=a24279c46b893248 in_seq=0 out_seq=0 2023-12-19T17:54:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f003ffff700 10 client.6057 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f003ffff700 1 -- 172.21.15.45:0/1031022903 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0xe66540 con 0x10a9080 2023-12-19T17:54:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f003ffff700 10 client.6057 handle_command_reply: tid=0 2023-12-19T17:54:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 client.6057 shutdown 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 msgr2=0x1126bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x1126bc0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f00600274b0 tx=0x7f0060000ed0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 shutdown_connections 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x10a9080 0x10a9490 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x10a8560 0x107a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x10a4cd0 0x1079b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 --2- 172.21.15.45:0/1031022903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x107b5c0 0x1126bc0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f003ffff700 0 client.6057 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 >> 172.21.15.45:0/1031022903 conn(0xe0f5b0 msgr2=0x107fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 shutdown_connections 2023-12-19T17:54:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 1 -- 172.21.15.45:0/1031022903 wait complete. 2023-12-19T17:54:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.699+0000 7f006e63b740 20 client.6057 trim_cache size 0 max 16384 2023-12-19T17:54:09.713 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:54:09.713 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-19T17:54:09.713 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout: "fe29b988-0514-4006-8a46-630f806949fa": { 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "fe29b988-0514-4006-8a46-630f806949fa", 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,repair" 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:54:09.714 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:54:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0048065ad0 msgr2=0x7f0048067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0048065ad0 0x7f0048067f90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f0060000f60 tx=0x7f0060009040 comp rx=0 tx=0).stop 2023-12-19T17:54:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 msgr2=0x7f006415dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f006415dee0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f005400c4d0 tx=0x7f005400c7e0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 shutdown_connections 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0048065ad0 0x7f0048067f90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f006415cf20 0x7f006415f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00640cdfd0 0x7f006415dee0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 --2- 172.21.15.45:0/3295375299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00640b8580 0x7f00641f3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 >> 172.21.15.45:0/3295375299 conn(0x7f00640b4670 msgr2=0x7f00640d0a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 shutdown_connections 2023-12-19T17:54:09.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:09.703+0000 7f006a145700 1 -- 172.21.15.45:0/3295375299 wait complete. 2023-12-19T17:54:09.730 INFO:tasks.cephfs.filesystem:scrub status for tag:fe29b988-0514-4006-8a46-630f806949fa - {'path': '/', 'tag': 'fe29b988-0514-4006-8a46-630f806949fa', 'options': 'recursive,repair'} 2023-12-19T17:54:30.333 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:54:30.341 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:54:39.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.2:0 scrub status 2023-12-19T17:54:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 Processor -- start 2023-12-19T17:54:39.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 -- start start 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f840815d170 0x7f84080ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84080ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8408161710 con 0x7f84080b19f0 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84081619f0 con 0x7f840815d170 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840ede6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84080ac520 con 0x7f84080acd20 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840cb82700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f840815d170 0x7f84080ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840cb82700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f840815d170 0x7f84080ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57726/0 (socket says 172.21.15.45:57726) 2023-12-19T17:54:39.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840cb82700 1 -- 172.21.15.45:0/256944971 learned_addr learned my addr 172.21.15.45:0/256944971 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840d383700 1 --2- 172.21.15.45:0/256944971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84080ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840cb82700 1 -- 172.21.15.45:0/256944971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 msgr2=0x7f84080ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.915+0000 7f840cb82700 1 --2- 172.21.15.45:0/256944971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84080ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840cb82700 1 -- 172.21.15.45:0/256944971 >> v1:172.21.15.73:6789/0 conn(0x7f84080b19f0 legacy=0x7f840806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840cb82700 1 -- 172.21.15.45:0/256944971 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080ac800 con 0x7f840815d170 2023-12-19T17:54:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840cb82700 1 --2- 172.21.15.45:0/256944971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f84080ada60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009910 tx=0x7f83fc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a7553a90ff4afc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f84077fe700 1 -- 172.21.15.45:0/256944971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc00ba60 con 0x7f840815d170 2023-12-19T17:54:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f84077fe700 1 -- 172.21.15.45:0/256944971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc00bbc0 con 0x7f840815d170 2023-12-19T17:54:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f84077fe700 1 -- 172.21.15.45:0/256944971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc009e60 con 0x7f840815d170 2023-12-19T17:54:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 -- 172.21.15.45:0/256944971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 msgr2=0x7f84080ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 --2- 172.21.15.45:0/256944971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f84080ada60 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f83fc009910 tx=0x7f83fc009c20 comp rx=0 tx=0).stop 2023-12-19T17:54:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 -- 172.21.15.45:0/256944971 shutdown_connections 2023-12-19T17:54:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 --2- 172.21.15.45:0/256944971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84080ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 --2- 172.21.15.45:0/256944971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f84080ada60 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 -- 172.21.15.45:0/256944971 >> 172.21.15.45:0/256944971 conn(0x7f8408071990 msgr2=0x7f84080b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 -- 172.21.15.45:0/256944971 shutdown_connections 2023-12-19T17:54:39.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.919+0000 7f840ede6700 1 -- 172.21.15.45:0/256944971 wait complete. 2023-12-19T17:54:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 Processor -- start 2023-12-19T17:54:39.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 -- start start 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84081597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080b19f0 0x7f840815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f840814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840814cb00 con 0x7f840815d170 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840815aa90 con 0x7f84080b19f0 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840ede6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8408149d70 con 0x7f84080acd20 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f840814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f840814a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57738/0 (socket says 172.21.15.45:57738) 2023-12-19T17:54:39.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 -- 172.21.15.45:0/43752747 learned_addr learned my addr 172.21.15.45:0/43752747 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f8407fff700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080b19f0 0x7f840815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840cb82700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84081597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 -- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 msgr2=0x7f84081597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84081597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 -- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080b19f0 msgr2=0x7f840815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080b19f0 0x7f840815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.923+0000 7f840d383700 1 -- 172.21.15.45:0/43752747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83fc009570 con 0x7f840815d170 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f840d383700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f840814a530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8400007e40 tx=0x7f840000e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f84057fa700 1 -- 172.21.15.45:0/43752747 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000eea0 con 0x7f840815d170 2023-12-19T17:54:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f84057fa700 1 -- 172.21.15.45:0/43752747 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400014420 con 0x7f840815d170 2023-12-19T17:54:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f84057fa700 1 -- 172.21.15.45:0/43752747 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84000147b0 con 0x7f840815d170 2023-12-19T17:54:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840815c2d0 con 0x7f840815d170 2023-12-19T17:54:39.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840815c890 con 0x7f840815d170 2023-12-19T17:54:39.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.927+0000 7f84057fa700 1 -- 172.21.15.45:0/43752747 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8400014910 con 0x7f840815d170 2023-12-19T17:54:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.931+0000 7f84057fa700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83ec065ad0 0x7f83ec067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.931+0000 7f84057fa700 1 -- 172.21.15.45:0/43752747 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f8400083db0 con 0x7f840815d170 2023-12-19T17:54:39.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.931+0000 7f840cb82700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83ec065ad0 0x7f83ec067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.931+0000 7f840cb82700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83ec065ad0 0x7f83ec067f90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83fc000c00 tx=0x7f83fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 Processor -- start 2023-12-19T17:54:39.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 -- start start 2023-12-19T17:54:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11945c0 0x11be0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 0x11949a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11e0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x10ba1f0 con 0x11be6a0 2023-12-19T17:54:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x10b4890 con 0x11945c0 2023-12-19T17:54:39.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1107640 con 0x11d73e0 2023-12-19T17:54:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 0x11949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 0x11949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57750/0 (socket says 172.21.15.45:57750) 2023-12-19T17:54:39.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 -- 172.21.15.45:0/223832554 learned_addr learned my addr 172.21.15.45:0/223832554 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f840d383700 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11e0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f840cb82700 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11945c0 0x11be0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 -- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 msgr2=0x11e0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11e0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 -- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11945c0 msgr2=0x11be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11945c0 0x11be0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 -- 172.21.15.45:0/223832554 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x11256e0 con 0x11be6a0 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.935+0000 7f8407fff700 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 0x11949a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f83f4001640 tx=0x7f83f4001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7770d4494340bc82 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f83f27fc700 1 -- 172.21.15.45:0/223832554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40052e0 con 0x11be6a0 2023-12-19T17:54:39.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f83f27fc700 1 -- 172.21.15.45:0/223832554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4005440 con 0x11be6a0 2023-12-19T17:54:39.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f83f27fc700 1 -- 172.21.15.45:0/223832554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f40038a0 con 0x11be6a0 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 -- 172.21.15.45:0/223832554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 msgr2=0x11949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 0x11949a0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f83f4001640 tx=0x7f83f4001950 comp rx=0 tx=0).stop 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 -- 172.21.15.45:0/223832554 shutdown_connections 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11e0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11be6a0 0x11949a0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 --2- 172.21.15.45:0/223832554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11945c0 0x11be0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 -- 172.21.15.45:0/223832554 >> 172.21.15.45:0/223832554 conn(0xf285b0 msgr2=0x11c0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 -- 172.21.15.45:0/223832554 shutdown_connections 2023-12-19T17:54:39.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 -- 172.21.15.45:0/223832554 wait complete. 2023-12-19T17:54:39.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.939+0000 7f8412075740 1 -- start start 2023-12-19T17:54:39.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 Processor -- start 2023-12-19T17:54:39.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11945c0 0x11bd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1199400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 0x1198470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1102960 con 0x11d73e0 2023-12-19T17:54:39.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x11006c0 con 0x11be6a0 2023-12-19T17:54:39.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x10bde30 con 0x11945c0 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8412075740 10 client.0 _ll_register_callbacks cb 0x1150e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 0x1198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 0x1198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57752/0 (socket says 172.21.15.45:57752) 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 -- 172.21.15.45:0/2101847185 learned_addr learned my addr 172.21.15.45:0/2101847185 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840cb82700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11945c0 0x11bd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f8407fff700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 -- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11945c0 msgr2=0x11bd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11945c0 0x11bd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 -- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 msgr2=0x1199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 -- 172.21.15.45:0/2101847185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f400f040 con 0x11d73e0 2023-12-19T17:54:39.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840cb82700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11945c0 0x11bd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f840d383700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 0x1198470 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f840000c040 tx=0x7f8400054fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3ac7d57b4040f86 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.943+0000 7f83e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f83e77fe700 1 -- 172.21.15.45:0/2101847185 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84000546c0 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f83e77fe700 1 -- 172.21.15.45:0/2101847185 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f840005cfb0 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x10f9740 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f83e77fe700 1 -- 172.21.15.45:0/2101847185 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f840005cb20 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 10 client.6069 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0xf73a40 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f83e77fe700 1 -- 172.21.15.45:0/2101847185 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8400080020 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f83e77fe700 1 -- 172.21.15.45:0/2101847185 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f8400014bc0 con 0x11d73e0 2023-12-19T17:54:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 10 client.6069 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 10 client.6069 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 20 client.6069 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11c3aa0 0x11c2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 4 client.6069 mds_command: new command op to 55385 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x10bd150 con 0x11c3aa0 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f840cb82700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11c3aa0 0x11c2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f83e77fe700 10 client.6069 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.947+0000 7f840cb82700 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11c3aa0 0x11c2080 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=359e21c96b009b0b server_cookie=fcbe4bfdefe8c6cf in_seq=0 out_seq=0 2023-12-19T17:54:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f83e77fe700 1 -- 172.21.15.45:0/2101847185 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x10bd150 con 0x11c3aa0 2023-12-19T17:54:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f83e77fe700 10 client.6069 handle_command_reply: tid=0 2023-12-19T17:54:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 client.6069 shutdown 2023-12-19T17:54:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 msgr2=0x1198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 0x1198470 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f840000c040 tx=0x7f8400054fd0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 shutdown_connections 2023-12-19T17:54:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11c3aa0 0x11c2080 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11d73e0 0x1198470 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f83e77fe700 0 client.6069 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 --2- 172.21.15.45:0/2101847185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11945c0 0x11bd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 >> 172.21.15.45:0/2101847185 conn(0xf285b0 msgr2=0x1192b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 shutdown_connections 2023-12-19T17:54:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 1 -- 172.21.15.45:0/2101847185 wait complete. 2023-12-19T17:54:39.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.951+0000 7f8412075740 20 client.6069 trim_cache size 0 max 16384 2023-12-19T17:54:39.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 Processor -- start 2023-12-19T17:54:39.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 -- start start 2023-12-19T17:54:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 0x1193450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1193990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11971a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0xfacb80 con 0x11945c0 2023-12-19T17:54:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x108abf0 con 0x11be6a0 2023-12-19T17:54:39.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.975+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x11c4570 con 0x11d73e0 2023-12-19T17:54:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 0x1193450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840d383700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 0x1193450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57758/0 (socket says 172.21.15.45:57758) 2023-12-19T17:54:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 -- 172.21.15.45:0/4065222368 learned_addr learned my addr 172.21.15.45:0/4065222368 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840d383700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:37290/0 (socket says 172.21.15.45:37290) 2023-12-19T17:54:39.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8407fff700 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1193990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 -- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 msgr2=0x11971a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11971a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 -- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 msgr2=0x1193990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1193990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 -- 172.21.15.45:0/4065222368 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x10c67e0 con 0x11945c0 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f840cb82700 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 0x1193450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f83fc014040 tx=0x7f83fc010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a05531fff3ef96 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f83f2ffd700 1 -- 172.21.15.45:0/4065222368 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc004420 con 0x11945c0 2023-12-19T17:54:39.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f83f2ffd700 1 -- 172.21.15.45:0/4065222368 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83fc004580 con 0x11945c0 2023-12-19T17:54:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f83f2ffd700 1 -- 172.21.15.45:0/4065222368 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83fc0038e0 con 0x11945c0 2023-12-19T17:54:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 -- 172.21.15.45:0/4065222368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 msgr2=0x1193450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 0x1193450 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f83fc014040 tx=0x7f83fc010000 comp rx=0 tx=0).stop 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 -- 172.21.15.45:0/4065222368 shutdown_connections 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11d73e0 0x11971a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11be6a0 0x1193990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 --2- 172.21.15.45:0/4065222368 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11945c0 0x1193450 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 -- 172.21.15.45:0/4065222368 >> 172.21.15.45:0/4065222368 conn(0xf285b0 msgr2=0x11f05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 -- 172.21.15.45:0/4065222368 shutdown_connections 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.979+0000 7f8412075740 1 -- 172.21.15.45:0/4065222368 wait complete. 2023-12-19T17:54:39.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 -- start start 2023-12-19T17:54:39.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 Processor -- start 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11be6a0 0x1240730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11d73e0 0x11fcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 0x1197580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x11c48b0 con 0x11971a0 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x10fc030 con 0x11d73e0 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1124930 con 0x11be6a0 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8412075740 10 client.0 _ll_register_callbacks cb 0x7f83f4007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 0x1197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 0x1197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57768/0 (socket says 172.21.15.45:57768) 2023-12-19T17:54:39.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 -- 172.21.15.45:0/214387737 learned_addr learned my addr 172.21.15.45:0/214387737 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:39.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840cb82700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11be6a0 0x1240730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f8407fff700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11d73e0 0x11fcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 -- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11be6a0 msgr2=0x1240730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11be6a0 0x1240730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 -- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11d73e0 msgr2=0x11fcd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:39.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11d73e0 0x11fcd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.983+0000 7f840d383700 1 -- 172.21.15.45:0/214387737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84080ac800 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f840d383700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 0x1197580 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f840000c040 tx=0x7f8400081dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40fa8ce37e866d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 1 -- 172.21.15.45:0/214387737 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8400051310 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 1 -- 172.21.15.45:0/214387737 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f8400081080 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f83f4005440 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 1 -- 172.21.15.45:0/214387737 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8400054da0 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 10 client.6075 fetch_fsmap learned FSMap version 29 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=2+}) v3 -- 0x10aca10 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 1 -- 172.21.15.45:0/214387737 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4005440 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 1 -- 172.21.15.45:0/214387737 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 29) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f8400059b40 con 0x11971a0 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 10 client.6075 fetch_fsmap finished waiting for FSMap version 29 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 10 client.6075 resolve_mds: resolved 2:0 to role '2:0' aka daemon mds.d 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 20 client.6075 populate_metadata read hostname 'smithi045' 2023-12-19T17:54:39.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11f5190 0x11f5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 4 client.6075 mds_command: new command op to 55385 tid=0[{"prefix": "scrub status"}] 2023-12-19T17:54:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 --> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0xf7f540 con 0x11f5190 2023-12-19T17:54:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f840cb82700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11f5190 0x11f5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f840cb82700 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11f5190 0x11f5570 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=786b4c41370b5333 server_cookie=fddaaf50c8f0f6f1 in_seq=0 out_seq=0 2023-12-19T17:54:39.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.987+0000 7f83e77fe700 10 client.6075 ms_handle_connect on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f83e77fe700 1 -- 172.21.15.45:0/214387737 <== mds.0 v2:172.21.15.73:6834/3950826099 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0xf7f540 con 0x11f5190 2023-12-19T17:54:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f83e77fe700 10 client.6075 handle_command_reply: tid=0 2023-12-19T17:54:39.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 client.6075 shutdown 2023-12-19T17:54:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 msgr2=0x1197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 0x1197580 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f840000c040 tx=0x7f8400081dd0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 shutdown_connections 2023-12-19T17:54:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:6834/3950826099,v1:172.21.15.73:6835/3950826099] conn(0x11f5190 0x11f5570 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x11971a0 0x1197580 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x11d73e0 0x11fcd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 --2- 172.21.15.45:0/214387737 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x11be6a0 0x1240730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f83e77fe700 0 client.6075 ms_handle_reset on v2:172.21.15.73:6834/3950826099 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 >> 172.21.15.45:0/214387737 conn(0xf285b0 msgr2=0x11bd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 shutdown_connections 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 1 -- 172.21.15.45:0/214387737 wait complete. 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f8412075740 20 client.6075 trim_cache size 0 max 16384 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2023-12-19T17:54:39.997 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83ec065ad0 msgr2=0x7f83ec067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83ec065ad0 0x7f83ec067f90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f83fc000c00 tx=0x7f83fc008030 comp rx=0 tx=0).stop 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 msgr2=0x7f840814a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f840814a530 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f8400007e40 tx=0x7f840000e3c0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 shutdown_connections 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83ec065ad0 0x7f83ec067f90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f840815d170 0x7f840814a530 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84080b19f0 0x7f840815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 --2- 172.21.15.45:0/43752747 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84080acd20 0x7f84081597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 >> 172.21.15.45:0/43752747 conn(0x7f8408071990 msgr2=0x7f84080aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 shutdown_connections 2023-12-19T17:54:39.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:39.991+0000 7f840ede6700 1 -- 172.21.15.45:0/43752747 wait complete. 2023-12-19T17:54:40.022 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-19T17:54:40.022 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/0 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/0" 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:54:40.023 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:54:43.530 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/1 2023-12-19T17:54:43.530 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/1" 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:54:43.531 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:54:43.532 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:54:43.532 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:54:43.532 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:54:46.876 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/2 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/2" 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:54:46.877 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:54:46.878 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:54:46.878 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:54:46.878 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:54:46.878 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:54:46.878 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:54:50.229 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/3 2023-12-19T17:54:50.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:54:50.229 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:54:50.229 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/3" 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:54:50.230 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:54:53.578 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/4 2023-12-19T17:54:53.578 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:54:53.578 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:54:53.578 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/4" 2023-12-19T17:54:53.578 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:54:53.578 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:54:53.578 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:54:53.579 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:54:56.928 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T17:54:56.928 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:54:57.018 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:54:57.062 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T17:54:57.063 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:54:57.063 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:54:57.081 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:54:57.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.310+0000 7fbc8b8b5700 1 Processor -- start 2023-12-19T17:54:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.310+0000 7fbc8b8b5700 1 -- start start 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc84164a70 0x7fbc840cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc840c4510 0x7fbc840cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc840cd8b0 con 0x7fbc84164690 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840cdb80 con 0x7fbc840c4510 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc840cde60 con 0x7fbc84164a70 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89651700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbc84164690 0x7fbc840c3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60352/0 (socket says 172.21.15.45:60352) 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89651700 1 -- 172.21.15.45:0/23969083 learned_addr learned my addr 172.21.15.45:0/23969083 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89e52700 1 --2- 172.21.15.45:0/23969083 >> v2:172.21.15.45:3300/0 conn(0x7fbc840c4510 0x7fbc840cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc88e50700 1 --2- 172.21.15.45:0/23969083 >> v2:172.21.15.73:3300/0 conn(0x7fbc84164a70 0x7fbc840cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc7bfff700 1 -- 172.21.15.45:0/23969083 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3057367039 0 0) 0x7fbc840cd8b0 con 0x7fbc84164690 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc7bfff700 1 -- 172.21.15.45:0/23969083 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc700035d0 con 0x7fbc84164690 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89e52700 1 -- 172.21.15.45:0/23969083 >> v2:172.21.15.73:3300/0 conn(0x7fbc84164a70 msgr2=0x7fbc840cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89e52700 1 --2- 172.21.15.45:0/23969083 >> v2:172.21.15.73:3300/0 conn(0x7fbc84164a70 0x7fbc840cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89e52700 1 -- 172.21.15.45:0/23969083 >> v1:172.21.15.45:6789/0 conn(0x7fbc84164690 legacy=0x7fbc840c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89e52700 1 -- 172.21.15.45:0/23969083 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc840ce140 con 0x7fbc840c4510 2023-12-19T17:54:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc89e52700 1 --2- 172.21.15.45:0/23969083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc840c4510 0x7fbc840cd370 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbc840b4b60 tx=0x7fbc7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c68ecf487a2ddd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc7bfff700 1 -- 172.21.15.45:0/23969083 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c00e070 con 0x7fbc840c4510 2023-12-19T17:54:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc7bfff700 1 -- 172.21.15.45:0/23969083 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7c00bb20 con 0x7fbc840c4510 2023-12-19T17:54:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc7bfff700 1 -- 172.21.15.45:0/23969083 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7c012430 con 0x7fbc840c4510 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/23969083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc840c4510 msgr2=0x7fbc840cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.314+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/23969083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc840c4510 0x7fbc840cd370 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fbc840b4b60 tx=0x7fbc7c00b330 comp rx=0 tx=0).stop 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/23969083 shutdown_connections 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/23969083 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc840c4510 0x7fbc840cd370 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/23969083 >> v2:172.21.15.73:3300/0 conn(0x7fbc84164a70 0x7fbc840cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/23969083 >> 172.21.15.45:0/23969083 conn(0x7fbc840cba40 msgr2=0x7fbc840ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:57.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/23969083 shutdown_connections 2023-12-19T17:54:57.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/23969083 wait complete. 2023-12-19T17:54:57.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 Processor -- start 2023-12-19T17:54:57.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.318+0000 7fbc8b8b5700 1 -- start start 2023-12-19T17:54:57.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc840c4510 0x7fbc8415a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 0x7fbc840b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc84164a70 0x7fbc840b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc840b3330 con 0x7fbc84164690 2023-12-19T17:54:57.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415d550 con 0x7fbc840c4510 2023-12-19T17:54:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8415a6e0 con 0x7fbc84164a70 2023-12-19T17:54:57.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 0x7fbc840b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 0x7fbc840b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35160/0 (socket says 172.21.15.45:35160) 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 -- 172.21.15.45:0/1846976180 learned_addr learned my addr 172.21.15.45:0/1846976180 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc89651700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc840c4510 0x7fbc8415a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc89e52700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc84164a70 0x7fbc840b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 -- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc84164a70 msgr2=0x7fbc840b3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc84164a70 0x7fbc840b3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 -- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc840c4510 msgr2=0x7fbc8415a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc840c4510 0x7fbc8415a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 -- 172.21.15.45:0/1846976180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc7c009a70 con 0x7fbc84164690 2023-12-19T17:54:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc88e50700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 0x7fbc840b36b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400e840 tx=0x7fbc7400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740095a0 con 0x7fbc84164690 2023-12-19T17:54:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc74013680 con 0x7fbc84164690 2023-12-19T17:54:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740139f0 con 0x7fbc84164690 2023-12-19T17:54:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.322+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc8415c940 con 0x7fbc84164690 2023-12-19T17:54:57.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.326+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc8415cf00 con 0x7fbc84164690 2023-12-19T17:54:57.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.326+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8404ed30 con 0x7fbc84164690 2023-12-19T17:54:57.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.330+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc74013b50 con 0x7fbc84164690 2023-12-19T17:54:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.330+0000 7fbc79ffb700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc68065b20 0x7fbc68067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.330+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fbc74083290 con 0x7fbc84164690 2023-12-19T17:54:57.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.330+0000 7fbc89651700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc68065b20 0x7fbc68067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.330+0000 7fbc89651700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc68065b20 0x7fbc68067fe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007fd0 tx=0x7fbc80007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:57.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.338+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbc74050960 con 0x7fbc84164690 2023-12-19T17:54:57.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.510+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbc8406e6d0 con 0x7fbc84164690 2023-12-19T17:54:57.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.514+0000 7fbc79ffb700 1 -- 172.21.15.45:0/1846976180 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18427 (secure 0 0 0) 0x7fbc74053f80 con 0x7fbc84164690 2023-12-19T17:54:57.519 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:54:57.519 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:54:01.816974+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6835/3731258594":"2023-12-20T17:53:55.381131+0000","172.21.15.73:6835/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6833/3731258594":"2023-12-20T17:53:55.381131+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:54:57.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc68065b20 msgr2=0x7fbc68067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc68065b20 0x7fbc68067fe0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fbc80007fd0 tx=0x7fbc80007de0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 msgr2=0x7fbc840b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 0x7fbc840b36b0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400e840 tx=0x7fbc7400eb50 comp rx=0 tx=0).stop 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 shutdown_connections 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc68065b20 0x7fbc68067fe0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc84164a70 0x7fbc840b3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc84164690 0x7fbc840b36b0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 --2- 172.21.15.45:0/1846976180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc840c4510 0x7fbc8415a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 >> 172.21.15.45:0/1846976180 conn(0x7fbc840cba40 msgr2=0x7fbc840af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 shutdown_connections 2023-12-19T17:54:57.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.522+0000 7fbc8b8b5700 1 -- 172.21.15.45:0/1846976180 wait complete. 2023-12-19T17:54:57.546 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:53:12.347432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:53:13.452647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:53:23.494126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:54:57.546 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:54:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.734+0000 7f57b0e8a700 1 Processor -- start 2023-12-19T17:54:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.734+0000 7f57b0e8a700 1 -- start start 2023-12-19T17:54:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57b0e8a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f57ac0cff40 0x7f57ac167d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57b0e8a700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0d10e0 con 0x7f57ac0d0a50 2023-12-19T17:54:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57b0e8a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57ac0d13c0 con 0x7f57ac15d090 2023-12-19T17:54:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57b0e8a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57ac0b6040 con 0x7f57ac0cff40 2023-12-19T17:54:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a9d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f57ac0d0a50 0x7f57ac0cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60360/0 (socket says 172.21.15.45:60360) 2023-12-19T17:54:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a9d9b700 1 -- 172.21.15.45:0/1060881598 learned_addr learned my addr 172.21.15.45:0/1060881598 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:57.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57aad9d700 1 --2- 172.21.15.45:0/1060881598 >> v2:172.21.15.73:3300/0 conn(0x7f57ac0cff40 0x7f57ac167d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612588377 0 0) 0x7f57ac0d10e0 con 0x7f57ac0d0a50 2023-12-19T17:54:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57940035d0 con 0x7f57ac0d0a50 2023-12-19T17:54:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603525745 0 0) 0x7f57ac0d13c0 con 0x7f57ac15d090 2023-12-19T17:54:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57ac0d10e0 con 0x7f57ac15d090 2023-12-19T17:54:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57aad9d700 1 -- 172.21.15.45:0/1060881598 >> v1:172.21.15.73:6789/0 conn(0x7f57ac15d090 legacy=0x7f57ac0cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57aad9d700 1 -- 172.21.15.45:0/1060881598 >> v1:172.21.15.45:6789/0 conn(0x7f57ac0d0a50 legacy=0x7f57ac0cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57aad9d700 1 -- 172.21.15.45:0/1060881598 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57ac0d16a0 con 0x7f57ac0cff40 2023-12-19T17:54:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57aad9d700 1 --2- 172.21.15.45:0/1060881598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0cff40 0x7f57ac167d30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009d90 tx=0x7f57a400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fde980c1e26654aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a400e070 con 0x7f57ac0cff40 2023-12-19T17:54:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a400bb20 con 0x7f57ac0cff40 2023-12-19T17:54:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.738+0000 7f57a959a700 1 -- 172.21.15.45:0/1060881598 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4012430 con 0x7f57ac0cff40 2023-12-19T17:54:57.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 -- 172.21.15.45:0/1060881598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0cff40 msgr2=0x7f57ac167d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/1060881598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0cff40 0x7f57ac167d30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f57a4009d90 tx=0x7f57a400b330 comp rx=0 tx=0).stop 2023-12-19T17:54:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 -- 172.21.15.45:0/1060881598 shutdown_connections 2023-12-19T17:54:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/1060881598 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0cff40 0x7f57ac167d30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 -- 172.21.15.45:0/1060881598 >> 172.21.15.45:0/1060881598 conn(0x7f57ac0b4b90 msgr2=0x7f57ac0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 -- 172.21.15.45:0/1060881598 shutdown_connections 2023-12-19T17:54:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 -- 172.21.15.45:0/1060881598 wait complete. 2023-12-19T17:54:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 Processor -- start 2023-12-19T17:54:57.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.742+0000 7f57b0e8a700 1 -- start start 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57ac0cff40 0x7f57ac160230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0d0a50 0x7f57ac1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 0x7f57ac0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac160770 con 0x7f57ac15d090 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac151e20 con 0x7f57ac0d0a50 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57ac0c8030 con 0x7f57ac0cff40 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 0x7f57ac0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 0x7f57ac0c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35162/0 (socket says 172.21.15.45:35162) 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 -- 172.21.15.45:0/3008100072 learned_addr learned my addr 172.21.15.45:0/3008100072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57a9d9b700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0d0a50 0x7f57ac1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aa59c700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57ac0cff40 0x7f57ac160230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 -- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57ac0cff40 msgr2=0x7f57ac160230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57ac0cff40 0x7f57ac160230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 -- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0d0a50 msgr2=0x7f57ac1518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0d0a50 0x7f57ac1518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 -- 172.21.15.45:0/3008100072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a4009a70 con 0x7f57ac15d090 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57aad9d700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 0x7f57ac0c90d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f57a4014040 tx=0x7f57a4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a4012430 con 0x7f57ac15d090 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a4020070 con 0x7f57ac15d090 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57ac0c8310 con 0x7f57ac15d090 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a401ba30 con 0x7f57ac15d090 2023-12-19T17:54:57.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.746+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57ac0c88d0 con 0x7f57ac15d090 2023-12-19T17:54:57.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.750+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57ac04ed30 con 0x7f57ac15d090 2023-12-19T17:54:57.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.750+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f57a401bb90 con 0x7f57ac15d090 2023-12-19T17:54:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.750+0000 7f579affd700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f578c065b00 0x7f578c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.754+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f57a4022070 con 0x7f57ac15d090 2023-12-19T17:54:57.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.754+0000 7f57aa59c700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f578c065b00 0x7f578c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:57.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.754+0000 7f57aa59c700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f578c065b00 0x7f578c067fc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f579c0011e0 tx=0x7f579c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:57.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.758+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57a40528e0 con 0x7f57ac15d090 2023-12-19T17:54:57.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.938+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f57ac0b7e50 con 0x7f57ac15d090 2023-12-19T17:54:57.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.938+0000 7f579affd700 1 -- 172.21.15.45:0/3008100072 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f57a4055f00 con 0x7f57ac15d090 2023-12-19T17:54:57.941 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:54:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f578c065b00 msgr2=0x7f578c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f578c065b00 0x7f578c067fc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f579c0011e0 tx=0x7f579c009040 comp rx=0 tx=0).stop 2023-12-19T17:54:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 msgr2=0x7f57ac0c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:57.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 0x7f57ac0c90d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f57a4014040 tx=0x7f57a4004af0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 shutdown_connections 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f578c065b00 0x7f578c067fc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f57ac15d090 0x7f57ac0c90d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57ac0d0a50 0x7f57ac1518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 --2- 172.21.15.45:0/3008100072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57ac0cff40 0x7f57ac160230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 >> 172.21.15.45:0/3008100072 conn(0x7f57ac0b4b90 msgr2=0x7f57ac0b6e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 shutdown_connections 2023-12-19T17:54:57.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:57.942+0000 7f57b0e8a700 1 -- 172.21.15.45:0/3008100072 wait complete. 2023-12-19T17:54:57.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:54:58.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.138+0000 7f7fb241e700 1 Processor -- start 2023-12-19T17:54:58.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.138+0000 7f7fb241e700 1 -- start start 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb241e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7fac06e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb241e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7fac06d160 0x7f7fac06d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb241e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fac06f050 con 0x7f7fac159c80 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb241e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fac06db30 con 0x7f7fac06d160 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb241e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0cd540 con 0x7f7fac0c9940 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fabfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7fac159c80 0x7f7fac0cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60376/0 (socket says 172.21.15.45:60376) 2023-12-19T17:54:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fabfff700 1 -- 172.21.15.45:0/2766606201 learned_addr learned my addr 172.21.15.45:0/2766606201 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fa3fff700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7fac06e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb09bb700 1 --2- 172.21.15.45:0/2766606201 >> v2:172.21.15.73:3300/0 conn(0x7f7fac06d160 0x7f7fac06d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259279355 0 0) 0x7f7fac06f050 con 0x7f7fac159c80 2023-12-19T17:54:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f980034d0 con 0x7f7fac159c80 2023-12-19T17:54:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2398770802 0 0) 0x7f7f980034d0 con 0x7f7fac159c80 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 msgr2=0x7f7fac06e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7fac06e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 >> v2:172.21.15.73:3300/0 conn(0x7f7fac06d160 msgr2=0x7f7fac06d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 --2- 172.21.15.45:0/2766606201 >> v2:172.21.15.73:3300/0 conn(0x7f7fac06d160 0x7f7fac06d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac15e5e0 con 0x7f7fac159c80 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f7f9c0017f0 con 0x7f7fac159c80 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fa3fff700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7fac06e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 >> v1:172.21.15.45:6789/0 conn(0x7f7fac159c80 legacy=0x7f7fac0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7f98004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98005090 0x7f7f98003710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f98003c50 0x7f7f980040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac06db30 con 0x7f7f98003c50 2023-12-19T17:54:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0cd540 con 0x7f7f98005090 2023-12-19T17:54:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9800fe00 con 0x7f7fac0c9940 2023-12-19T17:54:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fb09bb700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f98003c50 0x7f7f980040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fabfff700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7f98004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.142+0000 7f7fa3fff700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98005090 0x7f7f98003710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 -- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 msgr2=0x7f7f98004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac0c9940 0x7f7f98004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 -- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98005090 msgr2=0x7f7f98003710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98005090 0x7f7f98003710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 -- 172.21.15.45:0/2766606201 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f940094b0 con 0x7f7f98003c50 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f98003c50 0x7f7f980040d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009fc0 tx=0x7f7f98004790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f1317cc40b2e824 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa400ec30 con 0x7f7f98003c50 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400f040 con 0x7f7f98003c50 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fab7fe700 1 -- 172.21.15.45:0/2766606201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4014480 con 0x7f7f98003c50 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb241e700 1 -- 172.21.15.45:0/2766606201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f98003c50 msgr2=0x7f7f980040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2766606201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7f98003c50 0x7f7f980040d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009fc0 tx=0x7f7f98004790 comp rx=0 tx=0).stop 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb09bb700 1 -- 172.21.15.45:0/2766606201 reap_dead start 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb241e700 1 -- 172.21.15.45:0/2766606201 shutdown_connections 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb241e700 1 -- 172.21.15.45:0/2766606201 >> 172.21.15.45:0/2766606201 conn(0x7f7fac0cf260 msgr2=0x7f7fac0cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb241e700 1 -- 172.21.15.45:0/2766606201 shutdown_connections 2023-12-19T17:54:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.146+0000 7f7fb241e700 1 -- 172.21.15.45:0/2766606201 wait complete. 2023-12-19T17:54:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 Processor -- start 2023-12-19T17:54:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 -- start start 2023-12-19T17:54:58.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98003c50 0x7f7fac155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 0x7f7fac0c4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac15a620 0x7f7fac09f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c6460 con 0x7f7fac15a1a0 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c6700 con 0x7f7f98003c50 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb241e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fac0c69e0 con 0x7f7fac15a620 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 0x7f7fac0c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 0x7f7fac0c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35170/0 (socket says 172.21.15.45:35170) 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 -- 172.21.15.45:0/2114790136 learned_addr learned my addr 172.21.15.45:0/2114790136 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fabfff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98003c50 0x7f7fac155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fb09bb700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac15a620 0x7f7fac09f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 -- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac15a620 msgr2=0x7f7fac09f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac15a620 0x7f7fac09f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 -- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98003c50 msgr2=0x7f7fac155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98003c50 0x7f7fac155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fa3fff700 1 -- 172.21.15.45:0/2114790136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fac0c6cc0 con 0x7f7fac15a1a0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.150+0000 7f7fabfff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98003c50 0x7f7fac155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fa3fff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 0x7f7fac0c4460 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7f94011ca0 tx=0x7f7f9400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9400fb30 con 0x7f7fac15a1a0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f9400fc90 con 0x7f7fac15a1a0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac0c6fa0 con 0x7f7fac15a1a0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f94014440 con 0x7f7fac15a1a0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fac1565d0 con 0x7f7fac15a1a0 2023-12-19T17:54:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fac06d950 con 0x7f7fac15a1a0 2023-12-19T17:54:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.154+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7f940145a0 con 0x7f7fac15a1a0 2023-12-19T17:54:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.158+0000 7f7fa97fa700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7f8c065ad0 0x7f7f8c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.158+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f7f94083eb0 con 0x7f7fac15a1a0 2023-12-19T17:54:58.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.158+0000 7f7fabfff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7f8c065ad0 0x7f7f8c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.158+0000 7f7fabfff700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7f8c065ad0 0x7f7f8c067f90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0011d0 tx=0x7f7f9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.162+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7f94051490 con 0x7f7fac15a1a0 2023-12-19T17:54:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.342+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7fac0c7130 con 0x7f7fac15a1a0 2023-12-19T17:54:58.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.342+0000 7f7fa97fa700 1 -- 172.21.15.45:0/2114790136 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f94054ab0 con 0x7f7fac15a1a0 2023-12-19T17:54:58.346 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:54:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7f8c065ad0 msgr2=0x7f7f8c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7f8c065ad0 0x7f7f8c067f90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c0011d0 tx=0x7f7f9c009040 comp rx=0 tx=0).stop 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 msgr2=0x7f7fac0c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 0x7f7fac0c4460 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f7f94011ca0 tx=0x7f7f9400f520 comp rx=0 tx=0).stop 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 shutdown_connections 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7f8c065ad0 0x7f7f8c067f90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7fac15a620 0x7f7fac09f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7fac15a1a0 0x7f7fac0c4460 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 --2- 172.21.15.45:0/2114790136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7f98003c50 0x7f7fac155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 >> 172.21.15.45:0/2114790136 conn(0x7f7fac0cf260 msgr2=0x7f7fac09da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 shutdown_connections 2023-12-19T17:54:58.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.346+0000 7f7fb241e700 1 -- 172.21.15.45:0/2114790136 wait complete. 2023-12-19T17:54:58.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:54:58.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08e0d8700 1 Processor -- start 2023-12-19T17:54:58.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08e0d8700 1 -- start start 2023-12-19T17:54:58.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08e0d8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb08815cf20 0x7fb0880d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08e0d8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb08815d300 con 0x7fb0880b8580 2023-12-19T17:54:58.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08e0d8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0880d1550 con 0x7fb0880cdfd0 2023-12-19T17:54:58.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08e0d8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0880d1830 con 0x7fb08815cf20 2023-12-19T17:54:58.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08d0d6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb08815cf20 0x7fb0880d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08c8d5700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb0880b8580 0x7fb0880cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60388/0 (socket says 172.21.15.45:60388) 2023-12-19T17:54:58.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.550+0000 7fb08c8d5700 1 -- 172.21.15.45:0/4167435259 learned_addr learned my addr 172.21.15.45:0/4167435259 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:58.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb07ffff700 1 -- 172.21.15.45:0/4167435259 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 232491225 0 0) 0x7fb0880d1550 con 0x7fb0880cdfd0 2023-12-19T17:54:58.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb07ffff700 1 -- 172.21.15.45:0/4167435259 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0740035d0 con 0x7fb0880cdfd0 2023-12-19T17:54:58.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08d0d6700 1 -- 172.21.15.45:0/4167435259 >> v1:172.21.15.73:6789/0 conn(0x7fb0880cdfd0 legacy=0x7fb0880b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08d0d6700 1 -- 172.21.15.45:0/4167435259 >> v1:172.21.15.45:6789/0 conn(0x7fb0880b8580 legacy=0x7fb0880cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb07ffff700 1 -- 172.21.15.45:0/4167435259 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868554746 0 0) 0x7fb08815d300 con 0x7fb0880b8580 2023-12-19T17:54:58.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08d0d6700 1 -- 172.21.15.45:0/4167435259 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0880d1b10 con 0x7fb08815cf20 2023-12-19T17:54:58.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08d0d6700 1 --2- 172.21.15.45:0/4167435259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08815cf20 0x7fb0880d0c50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb084009850 tx=0x7fb084009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3aa838dd09ec898 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb07ffff700 1 -- 172.21.15.45:0/4167435259 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011830 con 0x7fb08815cf20 2023-12-19T17:54:58.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb07ffff700 1 -- 172.21.15.45:0/4167435259 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb084011990 con 0x7fb08815cf20 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb07ffff700 1 -- 172.21.15.45:0/4167435259 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb084011d40 con 0x7fb08815cf20 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 -- 172.21.15.45:0/4167435259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08815cf20 msgr2=0x7fb0880d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/4167435259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08815cf20 0x7fb0880d0c50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fb084009850 tx=0x7fb084009b60 comp rx=0 tx=0).stop 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 -- 172.21.15.45:0/4167435259 shutdown_connections 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/4167435259 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb08815cf20 0x7fb0880d0c50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 -- 172.21.15.45:0/4167435259 >> 172.21.15.45:0/4167435259 conn(0x7fb0880b4670 msgr2=0x7fb0880b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 -- 172.21.15.45:0/4167435259 shutdown_connections 2023-12-19T17:54:58.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.554+0000 7fb08e0d8700 1 -- 172.21.15.45:0/4167435259 wait complete. 2023-12-19T17:54:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 Processor -- start 2023-12-19T17:54:58.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 -- start start 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0880b8580 0x7fb0880cc740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 0x7fb088150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb08815cf20 0x7fb0880ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cc2b0 con 0x7fb0880cdfd0 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb088151180 con 0x7fb08815cf20 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08e0d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0880cb6a0 con 0x7fb0880b8580 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08c8d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 0x7fb088150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08c8d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 0x7fb088150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35194/0 (socket says 172.21.15.45:35194) 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08c8d5700 1 -- 172.21.15.45:0/2774502074 learned_addr learned my addr 172.21.15.45:0/2774502074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d8d7700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb08815cf20 0x7fb0880ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d0d6700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0880b8580 0x7fb0880cc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d8d7700 1 -- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0880b8580 msgr2=0x7fb0880cc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d8d7700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0880b8580 0x7fb0880cc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d8d7700 1 -- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 msgr2=0x7fb088150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d8d7700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 0x7fb088150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08d8d7700 1 -- 172.21.15.45:0/2774502074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0840094b0 con 0x7fb08815cf20 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.558+0000 7fb08c8d5700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 0x7fb088150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb08d8d7700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb08815cf20 0x7fb0880ca660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb08000cbc0 tx=0x7fb08000ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb080003c20 con 0x7fb08815cf20 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb080003da0 con 0x7fb08815cf20 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb08000aa20 con 0x7fb08815cf20 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0880cb980 con 0x7fb08815cf20 2023-12-19T17:54:58.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0880cbf40 con 0x7fb08815cf20 2023-12-19T17:54:58.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.562+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0880cc420 con 0x7fb08815cf20 2023-12-19T17:54:58.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.566+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb08000ab80 con 0x7fb08815cf20 2023-12-19T17:54:58.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.566+0000 7fb07dffb700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.566+0000 7fb08d0d6700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.566+0000 7fb08d0d6700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0840090b0 tx=0x7fb08401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.566+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fb08000ae30 con 0x7fb08815cf20 2023-12-19T17:54:58.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.578+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb080050a50 con 0x7fb08815cf20 2023-12-19T17:54:58.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.754+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb08804ed30 con 0x7fb08815cf20 2023-12-19T17:54:58.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.758+0000 7fb07dffb700 1 -- 172.21.15.45:0/2774502074 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb080054070 con 0x7fb08815cf20 2023-12-19T17:54:58.760 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:54:58.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 msgr2=0x7fb06c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb0840090b0 tx=0x7fb08401c040 comp rx=0 tx=0).stop 2023-12-19T17:54:58.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb08815cf20 msgr2=0x7fb0880ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb08815cf20 0x7fb0880ca660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb08000cbc0 tx=0x7fb08000ced0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 shutdown_connections 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb06c065ad0 0x7fb06c067f90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb08815cf20 0x7fb0880ca660 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0880cdfd0 0x7fb088150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 --2- 172.21.15.45:0/2774502074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0880b8580 0x7fb0880cc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 >> 172.21.15.45:0/2774502074 conn(0x7fb0880b4670 msgr2=0x7fb08815bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 shutdown_connections 2023-12-19T17:54:58.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.762+0000 7fb08e0d8700 1 -- 172.21.15.45:0/2774502074 wait complete. 2023-12-19T17:54:58.792 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:54:58.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 Processor -- start 2023-12-19T17:54:58.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 -- start start 2023-12-19T17:54:58.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbbe415d090 0x7fbbe40d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe40cff40 0x7fbbe40b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbe40d10e0 con 0x7fbbe40cdff0 2023-12-19T17:54:58.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40b6040 con 0x7fbbe40cff40 2023-12-19T17:54:58.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbea742700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40d13c0 con 0x7fbbe415d090 2023-12-19T17:54:58.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbe8cdf700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbbe40cff40 0x7fbbe40b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.982+0000 7fbbe3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbbe415d090 0x7fbbe40d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbdb7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fbbe40cdff0 0x7fbbe40cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34550/0 (socket says 172.21.15.45:34550) 2023-12-19T17:54:58.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe3fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbbe415d090 0x7fbbe40d0a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:53500/0 (socket says 172.21.15.45:53500) 2023-12-19T17:54:58.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbdb7fe700 1 -- 172.21.15.45:0/2977994675 learned_addr learned my addr 172.21.15.45:0/2977994675 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe37fe700 1 -- 172.21.15.45:0/2977994675 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069951980 0 0) 0x7fbbe40d10e0 con 0x7fbbe40cdff0 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe37fe700 1 -- 172.21.15.45:0/2977994675 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbd00035d0 con 0x7fbbe40cdff0 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe3fff700 1 -- 172.21.15.45:0/2977994675 >> v2:172.21.15.45:3300/0 conn(0x7fbbe40cff40 msgr2=0x7fbbe40b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe3fff700 1 --2- 172.21.15.45:0/2977994675 >> v2:172.21.15.45:3300/0 conn(0x7fbbe40cff40 0x7fbbe40b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe3fff700 1 -- 172.21.15.45:0/2977994675 >> v1:172.21.15.73:6789/0 conn(0x7fbbe40cdff0 legacy=0x7fbbe40cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe3fff700 1 -- 172.21.15.45:0/2977994675 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40d16a0 con 0x7fbbe415d090 2023-12-19T17:54:58.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe8cdf700 1 --2- 172.21.15.45:0/2977994675 >> v2:172.21.15.45:3300/0 conn(0x7fbbe40cff40 0x7fbbe40b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:54:58.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe3fff700 1 --2- 172.21.15.45:0/2977994675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe415d090 0x7fbbe40d0a50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40b6180 tx=0x7fbbd4009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=448159b1fe4b5052 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe37fe700 1 -- 172.21.15.45:0/2977994675 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4004020 con 0x7fbbe415d090 2023-12-19T17:54:58.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe37fe700 1 -- 172.21.15.45:0/2977994675 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd4004180 con 0x7fbbe415d090 2023-12-19T17:54:58.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbe37fe700 1 -- 172.21.15.45:0/2977994675 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd4004530 con 0x7fbbe415d090 2023-12-19T17:54:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 -- 172.21.15.45:0/2977994675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe415d090 msgr2=0x7fbbe40d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 --2- 172.21.15.45:0/2977994675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe415d090 0x7fbbe40d0a50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40b6180 tx=0x7fbbd4009b30 comp rx=0 tx=0).stop 2023-12-19T17:54:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 -- 172.21.15.45:0/2977994675 shutdown_connections 2023-12-19T17:54:58.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 --2- 172.21.15.45:0/2977994675 >> v2:172.21.15.45:3300/0 conn(0x7fbbe40cff40 0x7fbbe40b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 --2- 172.21.15.45:0/2977994675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe415d090 0x7fbbe40d0a50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 -- 172.21.15.45:0/2977994675 >> 172.21.15.45:0/2977994675 conn(0x7fbbe40b4b90 msgr2=0x7fbbe40b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 -- 172.21.15.45:0/2977994675 shutdown_connections 2023-12-19T17:54:58.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.986+0000 7fbbea742700 1 -- 172.21.15.45:0/2977994675 wait complete. 2023-12-19T17:54:58.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 Processor -- start 2023-12-19T17:54:58.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 -- start start 2023-12-19T17:54:58.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40cdff0 0x7fbbe40c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 0x7fbbe41502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbbe415d090 0x7fbbe415fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40c6ed0 con 0x7fbbe40cff40 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe41607b0 con 0x7fbbe40cdff0 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbea742700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40cb2b0 con 0x7fbbe415d090 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbdb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 0x7fbbe41502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbdb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 0x7fbbe41502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43164/0 (socket says 172.21.15.45:43164) 2023-12-19T17:54:58.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.990+0000 7fbbdb7fe700 1 -- 172.21.15.45:0/831629411 learned_addr learned my addr 172.21.15.45:0/831629411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe8cdf700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbbe415d090 0x7fbbe415fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe3fff700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40cdff0 0x7fbbe40c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbdb7fe700 1 -- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbbe415d090 msgr2=0x7fbbe415fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbdb7fe700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbbe415d090 0x7fbbe415fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbdb7fe700 1 -- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40cdff0 msgr2=0x7fbbe40c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbdb7fe700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40cdff0 0x7fbbe40c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbdb7fe700 1 -- 172.21.15.45:0/831629411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbdc009a70 con 0x7fbbe40cff40 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe8cdf700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbbe415d090 0x7fbbe415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe3fff700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40cdff0 0x7fbbe40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbdb7fe700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 0x7fbbe41502f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00c700 tx=0x7fbbcc00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc005d90 con 0x7fbbe40cff40 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0070d0 con 0x7fbbe40cff40 2023-12-19T17:54:58.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd40094b0 con 0x7fbbe40cff40 2023-12-19T17:54:58.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc007480 con 0x7fbbe40cff40 2023-12-19T17:54:58.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe40cb870 con 0x7fbbe40cff40 2023-12-19T17:54:58.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.994+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe404ed30 con 0x7fbbe40cff40 2023-12-19T17:54:58.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.998+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbbcc0075e0 con 0x7fbbe40cff40 2023-12-19T17:54:59.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.998+0000 7fbbe17fa700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbbc4065ad0 0x7fbbc4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:59.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.998+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fbbcc082bd0 con 0x7fbbe40cff40 2023-12-19T17:54:59.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.998+0000 7fbbe3fff700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbbc4065ad0 0x7fbbc4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:59.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:58.998+0000 7fbbe3fff700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbbc4065ad0 0x7fbbc4067f90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40090b0 tx=0x7fbbd4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:59.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.006+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbbcc050130 con 0x7fbbe40cff40 2023-12-19T17:54:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.182+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7fbbe40b81a0 con 0x7fbbe40cff40 2023-12-19T17:54:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbe17fa700 1 -- 172.21.15.45:0/831629411 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v50) v1 ==== 106+0+11 (secure 0 0 0) 0x7fbbcc053750 con 0x7fbbe40cff40 2023-12-19T17:54:59.187 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:54:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbbc4065ad0 msgr2=0x7fbbc4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbbc4065ad0 0x7fbbc4067f90 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fbbd40090b0 tx=0x7fbbd4008030 comp rx=0 tx=0).stop 2023-12-19T17:54:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 msgr2=0x7fbbe41502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 0x7fbbe41502f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00c700 tx=0x7fbbcc00cac0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 shutdown_connections 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbbc4065ad0 0x7fbbc4067f90 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbbe415d090 0x7fbbe415fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbbe40cff40 0x7fbbe41502f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 --2- 172.21.15.45:0/831629411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbbe40cdff0 0x7fbbe40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.186+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 >> 172.21.15.45:0/831629411 conn(0x7fbbe40b4b90 msgr2=0x7fbbe4152430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.190+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 shutdown_connections 2023-12-19T17:54:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.190+0000 7fbbea742700 1 -- 172.21.15.45:0/831629411 wait complete. 2023-12-19T17:54:59.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:54:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.398+0000 7f31bb59e700 1 Processor -- start 2023-12-19T17:54:59.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.398+0000 7f31bb59e700 1 -- start start 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31bb59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31bc06cad0 0x7f31bc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31bb59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc06f0a0 con 0x7f31bc15ae20 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31bb59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31bc06ea90 con 0x7f31bc0af720 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31bb59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31bc0c3f60 con 0x7f31bc06cad0 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b9d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31bc06cad0 0x7f31bc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b9d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31bc06cad0 0x7f31bc15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43176/0 (socket says 172.21.15.45:43176) 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b9d9b700 1 -- 172.21.15.45:0/86659626 learned_addr learned my addr 172.21.15.45:0/86659626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b9d9b700 1 -- 172.21.15.45:0/86659626 >> v1:172.21.15.73:6789/0 conn(0x7f31bc0af720 legacy=0x7f31bc06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b9d9b700 1 -- 172.21.15.45:0/86659626 >> v1:172.21.15.45:6789/0 conn(0x7f31bc15ae20 legacy=0x7f31bc0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b9d9b700 1 -- 172.21.15.45:0/86659626 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31bc0c4240 con 0x7f31bc06cad0 2023-12-19T17:54:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.402+0000 7f31b959a700 1 -- 172.21.15.45:0/86659626 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2905790012 0 0) 0x7f31bc06f0a0 con 0x7f31bc15ae20 2023-12-19T17:54:59.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31b9d9b700 1 --2- 172.21.15.45:0/86659626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc06cad0 0x7f31bc15be40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009910 tx=0x7f31b0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=146738c637e45376 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31b959a700 1 -- 172.21.15.45:0/86659626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b000ba60 con 0x7f31bc06cad0 2023-12-19T17:54:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31b959a700 1 -- 172.21.15.45:0/86659626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b000bbc0 con 0x7f31bc06cad0 2023-12-19T17:54:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31b959a700 1 -- 172.21.15.45:0/86659626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b0009e60 con 0x7f31bc06cad0 2023-12-19T17:54:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 -- 172.21.15.45:0/86659626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc06cad0 msgr2=0x7f31bc15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 --2- 172.21.15.45:0/86659626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc06cad0 0x7f31bc15be40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f31b0009910 tx=0x7f31b0009c20 comp rx=0 tx=0).stop 2023-12-19T17:54:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 -- 172.21.15.45:0/86659626 shutdown_connections 2023-12-19T17:54:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 --2- 172.21.15.45:0/86659626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc06cad0 0x7f31bc15be40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 -- 172.21.15.45:0/86659626 >> 172.21.15.45:0/86659626 conn(0x7f31bc0cb900 msgr2=0x7f31bc0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 -- 172.21.15.45:0/86659626 shutdown_connections 2023-12-19T17:54:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.406+0000 7f31bb59e700 1 -- 172.21.15.45:0/86659626 wait complete. 2023-12-19T17:54:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 Processor -- start 2023-12-19T17:54:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 -- start start 2023-12-19T17:54:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31bc06cad0 0x7f31bc1efd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31bc0af720 0x7f31bc06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 0x7f31bc06d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1f3a10 con 0x7f31bc15ae20 2023-12-19T17:54:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc0b3f60 con 0x7f31bc06cad0 2023-12-19T17:54:59.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bb59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31bc1f3c60 con 0x7f31bc0af720 2023-12-19T17:54:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 0x7f31bc06d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 0x7f31bc06d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43188/0 (socket says 172.21.15.45:43188) 2023-12-19T17:54:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31bad9d700 1 -- 172.21.15.45:0/196278171 learned_addr learned my addr 172.21.15.45:0/196278171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:54:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31b9d9b700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31bc0af720 0x7f31bc06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:59.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.410+0000 7f31ba59c700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31bc06cad0 0x7f31bc1efd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bad9d700 1 -- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31bc0af720 msgr2=0x7f31bc06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bad9d700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31bc0af720 0x7f31bc06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bad9d700 1 -- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31bc06cad0 msgr2=0x7f31bc1efd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bad9d700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31bc06cad0 0x7f31bc1efd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bad9d700 1 -- 172.21.15.45:0/196278171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009570 con 0x7f31bc15ae20 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bad9d700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 0x7f31bc06d480 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f31b400cc50 tx=0x7f31b400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b4003c20 con 0x7f31bc15ae20 2023-12-19T17:54:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b4003d80 con 0x7f31bc15ae20 2023-12-19T17:54:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc1f3f40 con 0x7f31bc15ae20 2023-12-19T17:54:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b400aab0 con 0x7f31bc15ae20 2023-12-19T17:54:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31bc1f4500 con 0x7f31bc15ae20 2023-12-19T17:54:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.414+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31bc067760 con 0x7f31bc15ae20 2023-12-19T17:54:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.418+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31b400ac10 con 0x7f31bc15ae20 2023-12-19T17:54:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.418+0000 7f31aaffd700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f319c065ad0 0x7f319c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:54:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.418+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f31b4083540 con 0x7f31bc15ae20 2023-12-19T17:54:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.418+0000 7f31ba59c700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f319c065ad0 0x7f319c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:54:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.418+0000 7f31ba59c700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f319c065ad0 0x7f319c067f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f31ac000f60 tx=0x7f31ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:54:59.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.426+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31b4050b20 con 0x7f31bc15ae20 2023-12-19T17:54:59.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.618+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31bc15ebc0 con 0x7f31bc15ae20 2023-12-19T17:54:59.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.618+0000 7f31aaffd700 1 -- 172.21.15.45:0/196278171 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v50) v1 ==== 80+0+366 (secure 0 0 0) 0x7f31b4054140 con 0x7f31bc15ae20 2023-12-19T17:54:59.622 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6835/3331996662 2023-12-20T17:54:01.816945+0000 2023-12-19T17:54:59.622 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6833/3331996662 2023-12-20T17:54:01.816945+0000 2023-12-19T17:54:59.622 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6833/2739747419 2023-12-20T17:53:56.420995+0000 2023-12-19T17:54:59.622 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6835/3731258594 2023-12-20T17:53:55.381131+0000 2023-12-19T17:54:59.623 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6835/2739747419 2023-12-20T17:53:56.420995+0000 2023-12-19T17:54:59.623 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6833/3731258594 2023-12-20T17:53:55.381131+0000 2023-12-19T17:54:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f319c065ad0 msgr2=0x7f319c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f319c065ad0 0x7f319c067f90 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f31ac000f60 tx=0x7f31ac009040 comp rx=0 tx=0).stop 2023-12-19T17:54:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 msgr2=0x7f31bc06d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:54:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 0x7f31bc06d480 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f31b400cc50 tx=0x7f31b400cf60 comp rx=0 tx=0).stop 2023-12-19T17:54:59.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 shutdown_connections 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f319c065ad0 0x7f319c067f90 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31bc15ae20 0x7f31bc06d480 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31bc0af720 0x7f31bc06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 --2- 172.21.15.45:0/196278171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31bc06cad0 0x7f31bc1efd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 >> 172.21.15.45:0/196278171 conn(0x7f31bc0cb900 msgr2=0x7f31bc15f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 shutdown_connections 2023-12-19T17:54:59.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:54:59.622+0000 7f31bb59e700 1 -- 172.21.15.45:0/196278171 wait complete. 2023-12-19T17:54:59.627 INFO:teuthology.orchestra.run.smithi045.stderr:listed 6 entries 2023-12-19T17:54:59.646 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:54:59.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:59.646 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T17:54:59.683 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[47628]: fuse finished with error 0 and tester_r 0 2023-12-19T17:54:59.696 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:54:59.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:59.696 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T17:54:59.866 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:54:59.866 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:54:59.887 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:54:59.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:54:59.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:59.887 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T17:54:59.950 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T17:54:59.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:54:59.952 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:54:59.952 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:54:59.973 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T17:54:59.973 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:54:59.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:54:59.973 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T17:55:00.040 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T17:55:00.041 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:55:00.041 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:55:00.042 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:55:00.060 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:55:00.060 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:55:00.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:00.061 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T17:55:00.129 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T17:55:00.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:55:00.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.302+0000 7f1bbd3ac700 1 Processor -- start 2023-12-19T17:55:00.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.302+0000 7f1bbd3ac700 1 -- start start 2023-12-19T17:55:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bbd3ac700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1bb806a720 0x7f1bb80b5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bbd3ac700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8071650 0x7f1bb80cd530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bbd3ac700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb80b57a0 con 0x7f1bb8157590 2023-12-19T17:55:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bbd3ac700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb80cc200 con 0x7f1bb806a720 2023-12-19T17:55:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bbd3ac700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb815b230 con 0x7f1bb8071650 2023-12-19T17:55:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bb6ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1bb8157590 0x7f1bb806a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44070/0 (socket says 172.21.15.45:44070) 2023-12-19T17:55:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.306+0000 7f1bb6ffd700 1 -- 172.21.15.45:0/1409882345 learned_addr learned my addr 172.21.15.45:0/1409882345 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:00.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb67fc700 1 --2- 172.21.15.45:0/1409882345 >> v2:172.21.15.73:3300/0 conn(0x7f1bb806a720 0x7f1bb80b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb77fe700 1 --2- 172.21.15.45:0/1409882345 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8071650 0x7f1bb80cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb5ffb700 1 -- 172.21.15.45:0/1409882345 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441722508 0 0) 0x7f1bb80b57a0 con 0x7f1bb8157590 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb5ffb700 1 -- 172.21.15.45:0/1409882345 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ba00035d0 con 0x7f1bb8157590 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb77fe700 1 -- 172.21.15.45:0/1409882345 >> v2:172.21.15.73:3300/0 conn(0x7f1bb806a720 msgr2=0x7f1bb80b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb77fe700 1 --2- 172.21.15.45:0/1409882345 >> v2:172.21.15.73:3300/0 conn(0x7f1bb806a720 0x7f1bb80b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb77fe700 1 -- 172.21.15.45:0/1409882345 >> v1:172.21.15.45:6789/0 conn(0x7f1bb8157590 legacy=0x7f1bb806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb77fe700 1 -- 172.21.15.45:0/1409882345 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb80ceaa0 con 0x7f1bb8071650 2023-12-19T17:55:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb77fe700 1 --2- 172.21.15.45:0/1409882345 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8071650 0x7f1bb80cd530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009d90 tx=0x7f1bb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13504bb7abf51f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb5ffb700 1 -- 172.21.15.45:0/1409882345 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000e070 con 0x7f1bb8071650 2023-12-19T17:55:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb5ffb700 1 -- 172.21.15.45:0/1409882345 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000bb20 con 0x7f1bb8071650 2023-12-19T17:55:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bb5ffb700 1 -- 172.21.15.45:0/1409882345 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0012430 con 0x7f1bb8071650 2023-12-19T17:55:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/1409882345 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8071650 msgr2=0x7f1bb80cd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/1409882345 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8071650 0x7f1bb80cd530 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009d90 tx=0x7f1bb000b330 comp rx=0 tx=0).stop 2023-12-19T17:55:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/1409882345 shutdown_connections 2023-12-19T17:55:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/1409882345 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8071650 0x7f1bb80cd530 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/1409882345 >> v2:172.21.15.73:3300/0 conn(0x7f1bb806a720 0x7f1bb80b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/1409882345 >> 172.21.15.45:0/1409882345 conn(0x7f1bb80cf960 msgr2=0x7f1bb80cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/1409882345 shutdown_connections 2023-12-19T17:55:00.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.310+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/1409882345 wait complete. 2023-12-19T17:55:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.314+0000 7f1bbd3ac700 1 Processor -- start 2023-12-19T17:55:00.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.314+0000 7f1bbd3ac700 1 -- start start 2023-12-19T17:55:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 0x7f1bb814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb8071650 0x7f1bb80b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8157590 0x7f1bb80b40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80ac2f0 con 0x7f1bb806a720 2023-12-19T17:55:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb81503b0 con 0x7f1bb8071650 2023-12-19T17:55:00.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb80ab950 con 0x7f1bb8157590 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 0x7f1bb814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 0x7f1bb814fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43202/0 (socket says 172.21.15.45:43202) 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 -- 172.21.15.45:0/3758882578 learned_addr learned my addr 172.21.15.45:0/3758882578 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb67fc700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb8071650 0x7f1bb80b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb77fe700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8157590 0x7f1bb80b40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 -- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8157590 msgr2=0x7f1bb80b40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8157590 0x7f1bb80b40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 -- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb8071650 msgr2=0x7f1bb80b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb8071650 0x7f1bb80b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 -- 172.21.15.45:0/3758882578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb0009a70 con 0x7f1bb806a720 2023-12-19T17:55:00.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bb6ffd700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 0x7f1bb814fe70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800c700 tx=0x7f1ba800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:00.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8005d90 con 0x7f1bb806a720 2023-12-19T17:55:00.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba80070d0 con 0x7f1bb806a720 2023-12-19T17:55:00.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb80abc30 con 0x7f1bb806a720 2023-12-19T17:55:00.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba8007480 con 0x7f1bb806a720 2023-12-19T17:55:00.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.318+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb80ac710 con 0x7f1bb806a720 2023-12-19T17:55:00.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.322+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb8067760 con 0x7f1bb806a720 2023-12-19T17:55:00.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.322+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1ba80075e0 con 0x7f1bb806a720 2023-12-19T17:55:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.326+0000 7f1b9f7fe700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba4065b00 0x7f1ba4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.326+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f1ba8082980 con 0x7f1bb806a720 2023-12-19T17:55:00.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.326+0000 7f1bb67fc700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba4065b00 0x7f1ba4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.326+0000 7f1bb67fc700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba4065b00 0x7f1ba4067fc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80c64b0 tx=0x7f1bac009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:00.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.330+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1ba804fed0 con 0x7f1bb806a720 2023-12-19T17:55:00.420 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:55:00.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:55:00.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.546+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bb806b220 con 0x7f1bb806a720 2023-12-19T17:55:00.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1b9f7fe700 1 -- 172.21.15.45:0/3758882578 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f1ba8017090 con 0x7f1bb806a720 2023-12-19T17:55:00.551 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:00.551 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:04.849464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba4065b00 msgr2=0x7f1ba4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba4065b00 0x7f1ba4067fc0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80c64b0 tx=0x7f1bac009240 comp rx=0 tx=0).stop 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 msgr2=0x7f1bb814fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 0x7f1bb814fe70 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1ba800c700 tx=0x7f1ba800ca10 comp rx=0 tx=0).stop 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 shutdown_connections 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba4065b00 0x7f1ba4067fc0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bb8157590 0x7f1bb80b40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bb8071650 0x7f1bb80b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 --2- 172.21.15.45:0/3758882578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bb806a720 0x7f1bb814fe70 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 >> 172.21.15.45:0/3758882578 conn(0x7f1bb80cf960 msgr2=0x7f1bb80b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 shutdown_connections 2023-12-19T17:55:00.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.550+0000 7f1bbd3ac700 1 -- 172.21.15.45:0/3758882578 wait complete. 2023-12-19T17:55:00.556 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-12-19T17:55:00.579 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:00.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 Processor -- start 2023-12-19T17:55:00.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 -- start start 2023-12-19T17:55:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc858098e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8580acca0 0x7fc8580ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8580993d0 con 0x7fc85815ac00 2023-12-19T17:55:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8580b4c20 con 0x7fc8580acca0 2023-12-19T17:55:00.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.758+0000 7fc85d74d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85806be80 con 0x7fc858098a30 2023-12-19T17:55:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8580acca0 0x7fc8580ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc8580acca0 0x7fc8580ad130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43214/0 (socket says 172.21.15.45:43214) 2023-12-19T17:55:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 -- 172.21.15.45:0/3565606096 learned_addr learned my addr 172.21.15.45:0/3565606096 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:00.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc84e7fc700 1 --2- 172.21.15.45:0/3565606096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc858098e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc8567fc700 1 -- 172.21.15.45:0/3565606096 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1866366042 0 0) 0x7fc8580993d0 con 0x7fc85815ac00 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc8567fc700 1 -- 172.21.15.45:0/3565606096 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8440035d0 con 0x7fc85815ac00 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 -- 172.21.15.45:0/3565606096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 msgr2=0x7fc858098e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 --2- 172.21.15.45:0/3565606096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc858098e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 -- 172.21.15.45:0/3565606096 >> v1:172.21.15.73:6789/0 conn(0x7fc85815ac00 legacy=0x7fc8580b4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 -- 172.21.15.45:0/3565606096 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85806ade0 con 0x7fc8580acca0 2023-12-19T17:55:00.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc857fff700 1 --2- 172.21.15.45:0/3565606096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8580acca0 0x7fc8580ad130 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc850009e50 tx=0x7fc85000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e823dc0ff3fd8ce1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc8567fc700 1 -- 172.21.15.45:0/3565606096 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000e070 con 0x7fc8580acca0 2023-12-19T17:55:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc8567fc700 1 -- 172.21.15.45:0/3565606096 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85000b910 con 0x7fc8580acca0 2023-12-19T17:55:00.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc8567fc700 1 -- 172.21.15.45:0/3565606096 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85000bcc0 con 0x7fc8580acca0 2023-12-19T17:55:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc85d74d700 1 -- 172.21.15.45:0/3565606096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8580acca0 msgr2=0x7fc8580ad130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc85d74d700 1 --2- 172.21.15.45:0/3565606096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8580acca0 0x7fc8580ad130 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc850009e50 tx=0x7fc85000b330 comp rx=0 tx=0).stop 2023-12-19T17:55:00.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc85d74d700 1 -- 172.21.15.45:0/3565606096 shutdown_connections 2023-12-19T17:55:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc85d74d700 1 --2- 172.21.15.45:0/3565606096 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc8580acca0 0x7fc8580ad130 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc85d74d700 1 --2- 172.21.15.45:0/3565606096 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc858098e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.762+0000 7fc85d74d700 1 -- 172.21.15.45:0/3565606096 >> 172.21.15.45:0/3565606096 conn(0x7fc8580d0310 msgr2=0x7fc8580d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.766+0000 7fc85d74d700 1 -- 172.21.15.45:0/3565606096 shutdown_connections 2023-12-19T17:55:00.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.766+0000 7fc85d74d700 1 -- 172.21.15.45:0/3565606096 wait complete. 2023-12-19T17:55:00.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.766+0000 7fc85d74d700 1 Processor -- start 2023-12-19T17:55:00.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.766+0000 7fc85d74d700 1 -- start start 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc85814b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8580acca0 0x7fc85815ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 0x7fc8580c5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc858071910 con 0x7fc85815ac00 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580cdd60 con 0x7fc8580acca0 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8580cdf70 con 0x7fc858098a30 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 0x7fc8580c5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 0x7fc8580c5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43230/0 (socket says 172.21.15.45:43230) 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 -- 172.21.15.45:0/1453837918 learned_addr learned my addr 172.21.15.45:0/1453837918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc856ffd700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc85814b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc84e7fc700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8580acca0 0x7fc85815ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 -- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 msgr2=0x7fc85814b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc85814b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 -- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8580acca0 msgr2=0x7fc85815ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8580acca0 0x7fc85815ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 -- 172.21.15.45:0/1453837918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc850009b30 con 0x7fc85815ac00 2023-12-19T17:55:00.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc857fff700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 0x7fc8580c5e70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc85806e2e0 tx=0x7fc850004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8500047c0 con 0x7fc85815ac00 2023-12-19T17:55:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc850004940 con 0x7fc85815ac00 2023-12-19T17:55:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85001c680 con 0x7fc85815ac00 2023-12-19T17:55:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8580ce250 con 0x7fc85815ac00 2023-12-19T17:55:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.770+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8580ce810 con 0x7fc85815ac00 2023-12-19T17:55:00.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.774+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85804ed30 con 0x7fc85815ac00 2023-12-19T17:55:00.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.774+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc85001c7e0 con 0x7fc85815ac00 2023-12-19T17:55:00.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.774+0000 7fc84ffff700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc838065b00 0x7fc838067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:00.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.774+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7fc850084c60 con 0x7fc85815ac00 2023-12-19T17:55:00.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.774+0000 7fc856ffd700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc838065b00 0x7fc838067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:00.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.778+0000 7fc856ffd700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc838065b00 0x7fc838067fc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8480011e0 tx=0x7fc848009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:00.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.782+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc850052230 con 0x7fc85815ac00 2023-12-19T17:55:00.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.962+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc85806a7f0 con 0x7fc85815ac00 2023-12-19T17:55:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.962+0000 7fc84ffff700 1 -- 172.21.15.45:0/1453837918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18427 (secure 0 0 0) 0x7fc850055850 con 0x7fc85815ac00 2023-12-19T17:55:00.967 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:00.967 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:54:01.816974+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6835/3731258594":"2023-12-20T17:53:55.381131+0000","172.21.15.73:6835/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6833/3731258594":"2023-12-20T17:53:55.381131+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc838065b00 msgr2=0x7fc838067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc838065b00 0x7fc838067fc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc8480011e0 tx=0x7fc848009040 comp rx=0 tx=0).stop 2023-12-19T17:55:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 msgr2=0x7fc8580c5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 0x7fc8580c5e70 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fc85806e2e0 tx=0x7fc850004af0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 shutdown_connections 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc838065b00 0x7fc838067fc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc85815ac00 0x7fc8580c5e70 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc8580acca0 0x7fc85815ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 --2- 172.21.15.45:0/1453837918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc858098a30 0x7fc85814b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:00.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 >> 172.21.15.45:0/1453837918 conn(0x7fc8580d0310 msgr2=0x7fc8580cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 shutdown_connections 2023-12-19T17:55:00.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:00.966+0000 7fc85d74d700 1 -- 172.21.15.45:0/1453837918 wait complete. 2023-12-19T17:55:00.994 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:53:12.347432+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:53:13.452647+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:53:23.494126+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:55:00.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:55:01.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.178+0000 7f9e85a8a700 1 Processor -- start 2023-12-19T17:55:01.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.178+0000 7f9e85a8a700 1 -- start start 2023-12-19T17:55:01.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e85a8a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e8015d090 0x7f9e800d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e85a8a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 0x7f9e800cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e85a8a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e800d01e0 con 0x7f9e800cfd70 2023-12-19T17:55:01.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e85a8a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e800b6040 con 0x7f9e8015d090 2023-12-19T17:55:01.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e85a8a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800d10e0 con 0x7f9e800cdff0 2023-12-19T17:55:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9e8015d090 0x7f9e800d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 0x7f9e800cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 0x7f9e800cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:37934/0 (socket says 172.21.15.45:37934) 2023-12-19T17:55:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 -- 172.21.15.45:0/2259480210 learned_addr learned my addr 172.21.15.45:0/2259480210 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 -- 172.21.15.45:0/2259480210 >> v2:172.21.15.73:3300/0 conn(0x7f9e8015d090 msgr2=0x7f9e800d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 --2- 172.21.15.45:0/2259480210 >> v2:172.21.15.73:3300/0 conn(0x7f9e8015d090 0x7f9e800d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 -- 172.21.15.45:0/2259480210 >> v1:172.21.15.73:6789/0 conn(0x7f9e800cfd70 legacy=0x7f9e8006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 -- 172.21.15.45:0/2259480210 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e800d13c0 con 0x7f9e800cdff0 2023-12-19T17:55:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.182+0000 7f9e7effd700 1 --2- 172.21.15.45:0/2259480210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 0x7f9e800cf830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009910 tx=0x7f9e74009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f271969434f1913 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e7e7fc700 1 -- 172.21.15.45:0/2259480210 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74011830 con 0x7f9e800cdff0 2023-12-19T17:55:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e7e7fc700 1 -- 172.21.15.45:0/2259480210 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e74011990 con 0x7f9e800cdff0 2023-12-19T17:55:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e7e7fc700 1 -- 172.21.15.45:0/2259480210 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e74011d40 con 0x7f9e800cdff0 2023-12-19T17:55:01.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 -- 172.21.15.45:0/2259480210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 msgr2=0x7f9e800cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/2259480210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 0x7f9e800cf830 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9e74009910 tx=0x7f9e74009c20 comp rx=0 tx=0).stop 2023-12-19T17:55:01.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 -- 172.21.15.45:0/2259480210 shutdown_connections 2023-12-19T17:55:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/2259480210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cdff0 0x7f9e800cf830 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/2259480210 >> v2:172.21.15.73:3300/0 conn(0x7f9e8015d090 0x7f9e800d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 -- 172.21.15.45:0/2259480210 >> 172.21.15.45:0/2259480210 conn(0x7f9e800b4b90 msgr2=0x7f9e800b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 -- 172.21.15.45:0/2259480210 shutdown_connections 2023-12-19T17:55:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 -- 172.21.15.45:0/2259480210 wait complete. 2023-12-19T17:55:01.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.186+0000 7f9e85a8a700 1 Processor -- start 2023-12-19T17:55:01.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 -- start start 2023-12-19T17:55:01.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 0x7f9e80158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cfd70 0x7f9e80157cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8015d090 0x7f9e8015e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8015a910 con 0x7f9e800cdff0 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e8015ea90 con 0x7f9e8015d090 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e800c7f10 con 0x7f9e800cfd70 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 0x7f9e80158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 0x7f9e80158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43238/0 (socket says 172.21.15.45:43238) 2023-12-19T17:55:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 -- 172.21.15.45:0/3300079801 learned_addr learned my addr 172.21.15.45:0/3300079801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7effd700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cfd70 0x7f9e80157cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7ffff700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8015d090 0x7f9e8015e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 -- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cfd70 msgr2=0x7f9e80157cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cfd70 0x7f9e80157cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 -- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8015d090 msgr2=0x7f9e8015e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8015d090 0x7f9e8015e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 -- 172.21.15.45:0/3300079801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e74009570 con 0x7f9e800cdff0 2023-12-19T17:55:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7ffff700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8015d090 0x7f9e8015e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e7f7fe700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 0x7f9e80158500 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000e840 tx=0x7f9e7000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700095a0 con 0x7f9e800cdff0 2023-12-19T17:55:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e70013680 con 0x7f9e800cdff0 2023-12-19T17:55:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e800c81f0 con 0x7f9e800cdff0 2023-12-19T17:55:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.190+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e700139f0 con 0x7f9e800cdff0 2023-12-19T17:55:01.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.194+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e8015ed70 con 0x7f9e800cdff0 2023-12-19T17:55:01.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.194+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e800c8710 con 0x7f9e800cdff0 2023-12-19T17:55:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.194+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9e70013b50 con 0x7f9e800cdff0 2023-12-19T17:55:01.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.198+0000 7f9e67fff700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e6c065ad0 0x7f9e6c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.198+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f9e70083450 con 0x7f9e800cdff0 2023-12-19T17:55:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.198+0000 7f9e7effd700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e6c065ad0 0x7f9e6c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.198+0000 7f9e7effd700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e6c065ad0 0x7f9e6c067f90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000c00 tx=0x7f9e74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:01.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.202+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9e800c8710 con 0x7f9e800cdff0 2023-12-19T17:55:01.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.382+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9e800c8710 con 0x7f9e800cdff0 2023-12-19T17:55:01.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.382+0000 7f9e67fff700 1 -- 172.21.15.45:0/3300079801 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9e800c8710 con 0x7f9e800cdff0 2023-12-19T17:55:01.385 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e6c065ad0 msgr2=0x7f9e6c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e6c065ad0 0x7f9e6c067f90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9e74000c00 tx=0x7f9e74008030 comp rx=0 tx=0).stop 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 msgr2=0x7f9e80158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 0x7f9e80158500 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9e7000e840 tx=0x7f9e7000eb50 comp rx=0 tx=0).stop 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 shutdown_connections 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9e6c065ad0 0x7f9e6c067f90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e8015d090 0x7f9e8015e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9e800cfd70 0x7f9e80157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 --2- 172.21.15.45:0/3300079801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9e800cdff0 0x7f9e80158500 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 >> 172.21.15.45:0/3300079801 conn(0x7f9e800b4b90 msgr2=0x7f9e800cc770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 shutdown_connections 2023-12-19T17:55:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.386+0000 7f9e85a8a700 1 -- 172.21.15.45:0/3300079801 wait complete. 2023-12-19T17:55:01.411 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:55:01.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.606+0000 7f483e47e700 1 Processor -- start 2023-12-19T17:55:01.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.606+0000 7f483e47e700 1 -- start start 2023-12-19T17:55:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483e47e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f483815cf20 0x7f48380d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483e47e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48380b8580 0x7f48380cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483e47e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f483815d300 con 0x7f48380d25f0 2023-12-19T17:55:01.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483e47e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48380d1550 con 0x7f483815cf20 2023-12-19T17:55:01.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483e47e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380d1830 con 0x7f48380b8580 2023-12-19T17:55:01.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483d47c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f483815cf20 0x7f48380d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483dc7d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f48380d25f0 0x7f483806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44086/0 (socket says 172.21.15.45:44086) 2023-12-19T17:55:01.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483dc7d700 1 -- 172.21.15.45:0/175911813 learned_addr learned my addr 172.21.15.45:0/175911813 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:01.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483cc7b700 1 --2- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48380b8580 0x7f48380cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f482ffff700 1 -- 172.21.15.45:0/175911813 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2701512934 0 0) 0x7f483815d300 con 0x7f48380d25f0 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f482ffff700 1 -- 172.21.15.45:0/175911813 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48240035d0 con 0x7f48380d25f0 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483d47c700 1 -- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48380b8580 msgr2=0x7f48380cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483d47c700 1 --2- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48380b8580 0x7f48380cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483d47c700 1 -- 172.21.15.45:0/175911813 >> v1:172.21.15.45:6789/0 conn(0x7f48380d25f0 legacy=0x7f483806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.610+0000 7f483d47c700 1 -- 172.21.15.45:0/175911813 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48380d1b10 con 0x7f483815cf20 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483d47c700 1 --2- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f483815cf20 0x7f48380d0c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4834009850 tx=0x7f4834009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7d1ed142f000d74 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f482ffff700 1 -- 172.21.15.45:0/175911813 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834011830 con 0x7f483815cf20 2023-12-19T17:55:01.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f482ffff700 1 -- 172.21.15.45:0/175911813 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4834011990 con 0x7f483815cf20 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f482ffff700 1 -- 172.21.15.45:0/175911813 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834011d40 con 0x7f483815cf20 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 -- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f483815cf20 msgr2=0x7f48380d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 --2- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f483815cf20 0x7f48380d0c50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4834009850 tx=0x7f4834009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 -- 172.21.15.45:0/175911813 shutdown_connections 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 --2- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f48380b8580 0x7f48380cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 --2- 172.21.15.45:0/175911813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f483815cf20 0x7f48380d0c50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 -- 172.21.15.45:0/175911813 >> 172.21.15.45:0/175911813 conn(0x7f48380b4670 msgr2=0x7f48380b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 -- 172.21.15.45:0/175911813 shutdown_connections 2023-12-19T17:55:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.614+0000 7f483e47e700 1 -- 172.21.15.45:0/175911813 wait complete. 2023-12-19T17:55:01.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 Processor -- start 2023-12-19T17:55:01.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 -- start start 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 0x7f48381e7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48380d25f0 0x7f48381e6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f483815cf20 0x7f483814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381e6c70 con 0x7f48380b8580 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48381e7700 con 0x7f48380d25f0 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483e47e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48380ca660 con 0x7f483815cf20 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483d47c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 0x7f48381e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483d47c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 0x7f48381e7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43246/0 (socket says 172.21.15.45:43246) 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483d47c700 1 -- 172.21.15.45:0/4244157686 learned_addr learned my addr 172.21.15.45:0/4244157686 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.618+0000 7f483dc7d700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f483815cf20 0x7f483814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483cc7b700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48380d25f0 0x7f48381e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483d47c700 1 -- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f483815cf20 msgr2=0x7f483814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483d47c700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f483815cf20 0x7f483814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483d47c700 1 -- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48380d25f0 msgr2=0x7f48381e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483d47c700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48380d25f0 0x7f48381e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483d47c700 1 -- 172.21.15.45:0/4244157686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340094b0 con 0x7f48380b8580 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483d47c700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 0x7f48381e7090 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f48340090b0 tx=0x7f4834004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834004480 con 0x7f48380b8580 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483401f070 con 0x7f48380b8580 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4834003900 con 0x7f48380b8580 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48380ca940 con 0x7f48380b8580 2023-12-19T17:55:01.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48380caf00 con 0x7f48380b8580 2023-12-19T17:55:01.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.622+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483804ed30 con 0x7f48380b8580 2023-12-19T17:55:01.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.626+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4834021030 con 0x7f48380b8580 2023-12-19T17:55:01.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.626+0000 7f482dffb700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065ad0 0x7f481c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.630+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f48340848b0 con 0x7f48380b8580 2023-12-19T17:55:01.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.630+0000 7f483cc7b700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065ad0 0x7f481c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:01.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.630+0000 7f483cc7b700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065ad0 0x7f481c067f90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4838150a10 tx=0x7f4828008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:01.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.634+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4834051fb0 con 0x7f48380b8580 2023-12-19T17:55:01.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.814+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f48380b32a0 con 0x7f48380b8580 2023-12-19T17:55:01.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.814+0000 7f482dffb700 1 -- 172.21.15.45:0/4244157686 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v50) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4834006ce0 con 0x7f48380b8580 2023-12-19T17:55:01.816 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065ad0 msgr2=0x7f481c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065ad0 0x7f481c067f90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4838150a10 tx=0x7f4828008040 comp rx=0 tx=0).stop 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 msgr2=0x7f48381e7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 0x7f48381e7090 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f48340090b0 tx=0x7f4834004770 comp rx=0 tx=0).stop 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 shutdown_connections 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f481c065ad0 0x7f481c067f90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f483815cf20 0x7f483814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48380d25f0 0x7f48381e6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 --2- 172.21.15.45:0/4244157686 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f48380b8580 0x7f48381e7090 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:01.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 >> 172.21.15.45:0/4244157686 conn(0x7f48380b4670 msgr2=0x7f48381520c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:01.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 shutdown_connections 2023-12-19T17:55:01.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:01.818+0000 7f483e47e700 1 -- 172.21.15.45:0/4244157686 wait complete. 2023-12-19T17:55:01.843 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:55:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.018+0000 7f10591ef700 1 Processor -- start 2023-12-19T17:55:02.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.018+0000 7f10591ef700 1 -- start start 2023-12-19T17:55:02.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10591ef700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1054071ae0 0x7f10540cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10591ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10540cb840 0x7f10540b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10591ef700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10540b1b80 con 0x7f10541443e0 2023-12-19T17:55:02.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10591ef700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10541447c0 con 0x7f1054071ae0 2023-12-19T17:55:02.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10591ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10540b1830 con 0x7f10540cb840 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1054071ae0 0x7f10540cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f1053fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f10541443e0 0x7f10540713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44088/0 (socket says 172.21.15.45:44088) 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1054071ae0 0x7f10540cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43260/0 (socket says 172.21.15.45:43260) 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f1053fff700 1 -- 172.21.15.45:0/3076185045 learned_addr learned my addr 172.21.15.45:0/3076185045 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10589ee700 1 --2- 172.21.15.45:0/3076185045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10540cb840 0x7f10540b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 -- 172.21.15.45:0/3076185045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10540cb840 msgr2=0x7f10540b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 --2- 172.21.15.45:0/3076185045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10540cb840 0x7f10540b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 -- 172.21.15.45:0/3076185045 >> v1:172.21.15.45:6789/0 conn(0x7f10541443e0 legacy=0x7f10540713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 -- 172.21.15.45:0/3076185045 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10540cc070 con 0x7f1054071ae0 2023-12-19T17:55:02.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10537fe700 1 -- 172.21.15.45:0/3076185045 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 958080291 0 0) 0x7f10540b1b80 con 0x7f10541443e0 2023-12-19T17:55:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f104b7fe700 1 --2- 172.21.15.45:0/3076185045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054071ae0 0x7f10540cb300 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f103c009850 tx=0x7f103c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42500dc8a232e013 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10537fe700 1 -- 172.21.15.45:0/3076185045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c011830 con 0x7f1054071ae0 2023-12-19T17:55:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10537fe700 1 -- 172.21.15.45:0/3076185045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103c011990 con 0x7f1054071ae0 2023-12-19T17:55:02.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.022+0000 7f10537fe700 1 -- 172.21.15.45:0/3076185045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103c011d40 con 0x7f1054071ae0 2023-12-19T17:55:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 -- 172.21.15.45:0/3076185045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054071ae0 msgr2=0x7f10540cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 --2- 172.21.15.45:0/3076185045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054071ae0 0x7f10540cb300 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f103c009850 tx=0x7f103c009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 -- 172.21.15.45:0/3076185045 shutdown_connections 2023-12-19T17:55:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 --2- 172.21.15.45:0/3076185045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10540cb840 0x7f10540b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 --2- 172.21.15.45:0/3076185045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1054071ae0 0x7f10540cb300 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 -- 172.21.15.45:0/3076185045 >> 172.21.15.45:0/3076185045 conn(0x7f10540cf5a0 msgr2=0x7f1054070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 -- 172.21.15.45:0/3076185045 shutdown_connections 2023-12-19T17:55:02.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 -- 172.21.15.45:0/3076185045 wait complete. 2023-12-19T17:55:02.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.026+0000 7f10591ef700 1 Processor -- start 2023-12-19T17:55:02.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 -- start start 2023-12-19T17:55:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10540cb840 0x7f105415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10541443e0 0x7f10541411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 0x7f10541f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105415c070 con 0x7f105415c500 2023-12-19T17:55:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10541f69b0 con 0x7f10540cb840 2023-12-19T17:55:02.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105415b460 con 0x7f10541443e0 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 0x7f10541f5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 0x7f10541f5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43262/0 (socket says 172.21.15.45:43262) 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 -- 172.21.15.45:0/3703739184 learned_addr learned my addr 172.21.15.45:0/3703739184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f1053fff700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10540cb840 0x7f105415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f104b7fe700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10541443e0 0x7f10541411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 -- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10541443e0 msgr2=0x7f10541411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10541443e0 0x7f10541411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 -- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10540cb840 msgr2=0x7f105415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10540cb840 0x7f105415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 -- 172.21.15.45:0/3703739184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103c0094b0 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10589ee700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 0x7f10541f5b60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f104c00efc0 tx=0x7f104c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c009ea0 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f104c00f040 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104c014480 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.030+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105415b740 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.034+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105415bd00 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.034+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105415c1e0 con 0x7f105415c500 2023-12-19T17:55:02.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.034+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f104c0145e0 con 0x7f105415c500 2023-12-19T17:55:02.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.034+0000 7f10517fa700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1038065ad0 0x7f1038067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.034+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f104c006e40 con 0x7f105415c500 2023-12-19T17:55:02.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.034+0000 7f1053fff700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1038065ad0 0x7f1038067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.038+0000 7f1053fff700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1038065ad0 0x7f1038067f90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1044004920 tx=0x7f1044009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.038+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f104c088070 con 0x7f105415c500 2023-12-19T17:55:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.230+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f105404ed30 con 0x7f105415c500 2023-12-19T17:55:02.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.230+0000 7f10517fa700 1 -- 172.21.15.45:0/3703739184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v50) v1 ==== 100+0+11 (secure 0 0 0) 0x7f104c0180a0 con 0x7f105415c500 2023-12-19T17:55:02.233 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1038065ad0 msgr2=0x7f1038067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1038065ad0 0x7f1038067f90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1044004920 tx=0x7f1044009190 comp rx=0 tx=0).stop 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 msgr2=0x7f10541f5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 0x7f10541f5b60 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f104c00efc0 tx=0x7f104c00c3a0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 shutdown_connections 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1038065ad0 0x7f1038067f90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f105415c500 0x7f10541f5b60 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f10541443e0 0x7f10541411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 --2- 172.21.15.45:0/3703739184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f10540cb840 0x7f105415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 >> 172.21.15.45:0/3703739184 conn(0x7f1054071ae0 msgr2=0x7f1054070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 shutdown_connections 2023-12-19T17:55:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.234+0000 7f10591ef700 1 -- 172.21.15.45:0/3703739184 wait complete. 2023-12-19T17:55:02.258 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:55:02.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.434+0000 7f6341eb1700 1 Processor -- start 2023-12-19T17:55:02.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.438+0000 7f6341eb1700 1 -- start start 2023-12-19T17:55:02.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.438+0000 7f6341eb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c159a40 0x7f633c0ae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.438+0000 7f6341eb1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f633c071830 0x7f633c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.438+0000 7f6341eb1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c0b2a40 con 0x7f633c0713d0 2023-12-19T17:55:02.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.438+0000 7f6341eb1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c0ccb50 con 0x7f633c071830 2023-12-19T17:55:02.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.438+0000 7f6341eb1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c0ae5d0 con 0x7f633c159a40 2023-12-19T17:55:02.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f633bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f633c0713d0 0x7f633c0aecf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44098/0 (socket says 172.21.15.45:44098) 2023-12-19T17:55:02.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f633bfff700 1 -- 172.21.15.45:0/2728457411 learned_addr learned my addr 172.21.15.45:0/2728457411 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6340eaf700 1 --2- 172.21.15.45:0/2728457411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c159a40 0x7f633c0ae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f63416b0700 1 --2- 172.21.15.45:0/2728457411 >> v2:172.21.15.73:3300/0 conn(0x7f633c071830 0x7f633c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6340eaf700 1 -- 172.21.15.45:0/2728457411 >> v2:172.21.15.73:3300/0 conn(0x7f633c071830 msgr2=0x7f633c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6340eaf700 1 --2- 172.21.15.45:0/2728457411 >> v2:172.21.15.73:3300/0 conn(0x7f633c071830 0x7f633c0af400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6340eaf700 1 -- 172.21.15.45:0/2728457411 >> v1:172.21.15.45:6789/0 conn(0x7f633c0713d0 legacy=0x7f633c0aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f633b7fe700 1 -- 172.21.15.45:0/2728457411 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881098135 0 0) 0x7f633c0b2a40 con 0x7f633c0713d0 2023-12-19T17:55:02.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6340eaf700 1 -- 172.21.15.45:0/2728457411 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0b2c90 con 0x7f633c159a40 2023-12-19T17:55:02.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6340eaf700 1 --2- 172.21.15.45:0/2728457411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c159a40 0x7f633c0ae090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6330009840 tx=0x7f6330009b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4a4860fe82cbdb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f633b7fe700 1 -- 172.21.15.45:0/2728457411 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6330005e50 con 0x7f633c159a40 2023-12-19T17:55:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f633b7fe700 1 -- 172.21.15.45:0/2728457411 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6330006030 con 0x7f633c159a40 2023-12-19T17:55:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f633b7fe700 1 -- 172.21.15.45:0/2728457411 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63300063c0 con 0x7f633c159a40 2023-12-19T17:55:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6341eb1700 1 -- 172.21.15.45:0/2728457411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c159a40 msgr2=0x7f633c0ae090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6341eb1700 1 --2- 172.21.15.45:0/2728457411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c159a40 0x7f633c0ae090 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6330009840 tx=0x7f6330009b50 comp rx=0 tx=0).stop 2023-12-19T17:55:02.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6341eb1700 1 -- 172.21.15.45:0/2728457411 shutdown_connections 2023-12-19T17:55:02.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6341eb1700 1 --2- 172.21.15.45:0/2728457411 >> v2:172.21.15.73:3300/0 conn(0x7f633c071830 0x7f633c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6341eb1700 1 --2- 172.21.15.45:0/2728457411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c159a40 0x7f633c0ae090 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.442+0000 7f6341eb1700 1 -- 172.21.15.45:0/2728457411 >> 172.21.15.45:0/2728457411 conn(0x7f633c0cf5a0 msgr2=0x7f633c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:02.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 -- 172.21.15.45:0/2728457411 shutdown_connections 2023-12-19T17:55:02.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 -- 172.21.15.45:0/2728457411 wait complete. 2023-12-19T17:55:02.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 Processor -- start 2023-12-19T17:55:02.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 -- start start 2023-12-19T17:55:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c071830 0x7f633c158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f633c159a40 0x7f633c148290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 0x7f633c0a8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1487d0 con 0x7f633c155950 2023-12-19T17:55:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c155ec0 con 0x7f633c159a40 2023-12-19T17:55:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f6341eb1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c1561a0 con 0x7f633c071830 2023-12-19T17:55:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f63416b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 0x7f633c0a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f63416b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 0x7f633c0a8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43278/0 (socket says 172.21.15.45:43278) 2023-12-19T17:55:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.446+0000 7f63416b0700 1 -- 172.21.15.45:0/3340639930 learned_addr learned my addr 172.21.15.45:0/3340639930 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f633bfff700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f633c159a40 0x7f633c148290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f6340eaf700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c071830 0x7f633c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63416b0700 1 -- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c071830 msgr2=0x7f633c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63416b0700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c071830 0x7f633c158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63416b0700 1 -- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f633c159a40 msgr2=0x7f633c148290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63416b0700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f633c159a40 0x7f633c148290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63416b0700 1 -- 172.21.15.45:0/3340639930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6330009450 con 0x7f633c155950 2023-12-19T17:55:02.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63416b0700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 0x7f633c0a8540 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f633400efc0 tx=0x7f633400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334009ea0 con 0x7f633c155950 2023-12-19T17:55:02.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400f040 con 0x7f633c155950 2023-12-19T17:55:02.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400ced0 con 0x7f633c155950 2023-12-19T17:55:02.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c156480 con 0x7f633c155950 2023-12-19T17:55:02.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c156a40 con 0x7f633c155950 2023-12-19T17:55:02.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.450+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c0cbbb0 con 0x7f633c155950 2023-12-19T17:55:02.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.454+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6334014480 con 0x7f633c155950 2023-12-19T17:55:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.454+0000 7f63397fa700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6320065ad0 0x7f6320067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.454+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f6334006e40 con 0x7f633c155950 2023-12-19T17:55:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.454+0000 7f6340eaf700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6320065ad0 0x7f6320067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.454+0000 7f6340eaf700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6320065ad0 0x7f6320067f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6330009b90 tx=0x7f6330008070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.462+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6334051700 con 0x7f633c155950 2023-12-19T17:55:02.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.638+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f633c0b3500 con 0x7f633c155950 2023-12-19T17:55:02.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.638+0000 7f63397fa700 1 -- 172.21.15.45:0/3340639930 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v50) v1 ==== 106+0+11 (secure 0 0 0) 0x7f6334018020 con 0x7f633c155950 2023-12-19T17:55:02.641 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:55:02.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6320065ad0 msgr2=0x7f6320067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6320065ad0 0x7f6320067f90 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6330009b90 tx=0x7f6330008070 comp rx=0 tx=0).stop 2023-12-19T17:55:02.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 msgr2=0x7f633c0a8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 0x7f633c0a8540 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f633400efc0 tx=0x7f633400c3a0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 shutdown_connections 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6320065ad0 0x7f6320067f90 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f633c155950 0x7f633c0a8540 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f633c159a40 0x7f633c148290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 --2- 172.21.15.45:0/3340639930 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f633c071830 0x7f633c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 >> 172.21.15.45:0/3340639930 conn(0x7f633c0713d0 msgr2=0x7f633c15be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 shutdown_connections 2023-12-19T17:55:02.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.642+0000 7f6341eb1700 1 -- 172.21.15.45:0/3340639930 wait complete. 2023-12-19T17:55:02.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:02.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.842+0000 7f1c6a5d2700 1 Processor -- start 2023-12-19T17:55:02.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.842+0000 7f1c6a5d2700 1 -- start start 2023-12-19T17:55:02.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c6a5d2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1c64159a50 0x7f1c640c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c6a5d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c6406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c6a5d2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c640c3c50 con 0x7f1c640af720 2023-12-19T17:55:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c6a5d2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c64070540 con 0x7f1c64159a50 2023-12-19T17:55:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c6a5d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6406c760 con 0x7f1c6415e450 2023-12-19T17:55:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c69dd1700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1c640af720 0x7f1c6406d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44104/0 (socket says 172.21.15.45:44104) 2023-12-19T17:55:02.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c69dd1700 1 -- 172.21.15.45:0/471418706 learned_addr learned my addr 172.21.15.45:0/471418706 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:02.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c695d0700 1 --2- 172.21.15.45:0/471418706 >> v2:172.21.15.73:3300/0 conn(0x7f1c64159a50 0x7f1c640c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c68dcf700 1 --2- 172.21.15.45:0/471418706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c6406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c5bfff700 1 -- 172.21.15.45:0/471418706 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804700462 0 0) 0x7f1c640c3c50 con 0x7f1c640af720 2023-12-19T17:55:02.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c5bfff700 1 -- 172.21.15.45:0/471418706 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c500035d0 con 0x7f1c640af720 2023-12-19T17:55:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c68dcf700 1 -- 172.21.15.45:0/471418706 >> v2:172.21.15.73:3300/0 conn(0x7f1c64159a50 msgr2=0x7f1c640c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c68dcf700 1 --2- 172.21.15.45:0/471418706 >> v2:172.21.15.73:3300/0 conn(0x7f1c64159a50 0x7f1c640c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c68dcf700 1 -- 172.21.15.45:0/471418706 >> v1:172.21.15.45:6789/0 conn(0x7f1c640af720 legacy=0x7f1c6406d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c68dcf700 1 -- 172.21.15.45:0/471418706 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c6406ca40 con 0x7f1c6415e450 2023-12-19T17:55:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c695d0700 1 --2- 172.21.15.45:0/471418706 >> v2:172.21.15.73:3300/0 conn(0x7f1c64159a50 0x7f1c640c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:02.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c68dcf700 1 --2- 172.21.15.45:0/471418706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c6406fba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009850 tx=0x7f1c54009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3a7e1c9d7156e75 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.846+0000 7f1c5bfff700 1 -- 172.21.15.45:0/471418706 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54011830 con 0x7f1c6415e450 2023-12-19T17:55:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c5bfff700 1 -- 172.21.15.45:0/471418706 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c54011990 con 0x7f1c6415e450 2023-12-19T17:55:02.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c5bfff700 1 -- 172.21.15.45:0/471418706 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c54011d40 con 0x7f1c6415e450 2023-12-19T17:55:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/471418706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 msgr2=0x7f1c6406fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/471418706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c6406fba0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1c54009850 tx=0x7f1c54009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/471418706 shutdown_connections 2023-12-19T17:55:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/471418706 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c6406fba0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/471418706 >> v2:172.21.15.73:3300/0 conn(0x7f1c64159a50 0x7f1c640c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/471418706 >> 172.21.15.45:0/471418706 conn(0x7f1c640cb900 msgr2=0x7f1c640b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/471418706 shutdown_connections 2023-12-19T17:55:02.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/471418706 wait complete. 2023-12-19T17:55:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.850+0000 7f1c6a5d2700 1 Processor -- start 2023-12-19T17:55:02.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 -- start start 2023-12-19T17:55:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 0x7f1c641529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c64159a50 0x7f1c6406efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c640c7070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64152f30 con 0x7f1c640af720 2023-12-19T17:55:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640c8040 con 0x7f1c64159a50 2023-12-19T17:55:02.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640c8320 con 0x7f1c6415e450 2023-12-19T17:55:02.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 0x7f1c641529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 0x7f1c641529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43280/0 (socket says 172.21.15.45:43280) 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 -- 172.21.15.45:0/3034451215 learned_addr learned my addr 172.21.15.45:0/3034451215 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c69dd1700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c640c7070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c68dcf700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c64159a50 0x7f1c6406efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 -- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 msgr2=0x7f1c640c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c640c7070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 -- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c64159a50 msgr2=0x7f1c6406efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c64159a50 0x7f1c6406efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 -- 172.21.15.45:0/3034451215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600094b0 con 0x7f1c640af720 2023-12-19T17:55:02.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c69dd1700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c640c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c695d0700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 0x7f1c641529f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000ebe0 tx=0x7f1c6000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000c890 con 0x7f1c640af720 2023-12-19T17:55:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c6000c9f0 con 0x7f1c640af720 2023-12-19T17:55:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c540094b0 con 0x7f1c640af720 2023-12-19T17:55:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.854+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6000cd80 con 0x7f1c640af720 2023-12-19T17:55:02.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.858+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c640c6b70 con 0x7f1c640af720 2023-12-19T17:55:02.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.858+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c640c66d0 con 0x7f1c640af720 2023-12-19T17:55:02.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.858+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1c60013470 con 0x7f1c640af720 2023-12-19T17:55:02.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.862+0000 7f1c59ffb700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1c48065ad0 0x7f1c48067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:02.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.862+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f1c600836c0 con 0x7f1c640af720 2023-12-19T17:55:02.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.862+0000 7f1c68dcf700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1c48065ad0 0x7f1c48067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:02.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.862+0000 7f1c68dcf700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1c48065ad0 0x7f1c48067f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1c6415e830 tx=0x7f1c5401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:02.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:02.866+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1c60050c10 con 0x7f1c640af720 2023-12-19T17:55:03.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.082+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c6406ccf0 con 0x7f1c640af720 2023-12-19T17:55:03.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.082+0000 7f1c59ffb700 1 -- 172.21.15.45:0/3034451215 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f1c60054230 con 0x7f1c640af720 2023-12-19T17:55:03.086 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:03.087 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:04.849464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1c48065ad0 msgr2=0x7f1c48067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1c48065ad0 0x7f1c48067f90 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1c6415e830 tx=0x7f1c5401c040 comp rx=0 tx=0).stop 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 msgr2=0x7f1c641529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 0x7f1c641529f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1c6000ebe0 tx=0x7f1c6000eef0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 shutdown_connections 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1c48065ad0 0x7f1c48067f90 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1c6415e450 0x7f1c640c7070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c64159a50 0x7f1c6406efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 --2- 172.21.15.45:0/3034451215 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1c640af720 0x7f1c641529f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 >> 172.21.15.45:0/3034451215 conn(0x7f1c640cb900 msgr2=0x7f1c640c3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 shutdown_connections 2023-12-19T17:55:03.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.086+0000 7f1c6a5d2700 1 -- 172.21.15.45:0/3034451215 wait complete. 2023-12-19T17:55:03.092 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-12-19T17:55:03.113 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:03.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.286+0000 7f1d3b6e0700 1 Processor -- start 2023-12-19T17:55:03.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.290+0000 7f1d3b6e0700 1 -- start start 2023-12-19T17:55:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.290+0000 7f1d3b6e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d340c4510 0x7f1d340cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.290+0000 7f1d3b6e0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340cdb80 con 0x7f1d34164a70 2023-12-19T17:55:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.290+0000 7f1d3b6e0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d340cde60 con 0x7f1d34164690 2023-12-19T17:55:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.290+0000 7f1d3b6e0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d340ce140 con 0x7f1d340c4510 2023-12-19T17:55:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d38c7b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1d34164a70 0x7f1d340cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44116/0 (socket says 172.21.15.45:44116) 2023-12-19T17:55:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d39c7d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d340c4510 0x7f1d340cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d38c7b700 1 -- 172.21.15.45:0/226066989 learned_addr learned my addr 172.21.15.45:0/226066989 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d39c7d700 1 -- 172.21.15.45:0/226066989 >> v1:172.21.15.73:6789/0 conn(0x7f1d34164690 legacy=0x7f1d340c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d39c7d700 1 -- 172.21.15.45:0/226066989 >> v1:172.21.15.45:6789/0 conn(0x7f1d34164a70 legacy=0x7f1d340cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d39c7d700 1 -- 172.21.15.45:0/226066989 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d340ce420 con 0x7f1d340c4510 2023-12-19T17:55:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d2bfff700 1 -- 172.21.15.45:0/226066989 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923375492 0 0) 0x7f1d340cdb80 con 0x7f1d34164a70 2023-12-19T17:55:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d39c7d700 1 --2- 172.21.15.45:0/226066989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d340cd540 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009d90 tx=0x7f1d2c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d57b74d3627b6b1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d2bfff700 1 -- 172.21.15.45:0/226066989 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00e070 con 0x7f1d340c4510 2023-12-19T17:55:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d2bfff700 1 -- 172.21.15.45:0/226066989 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00bbd0 con 0x7f1d340c4510 2023-12-19T17:55:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d2bfff700 1 -- 172.21.15.45:0/226066989 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c012430 con 0x7f1d340c4510 2023-12-19T17:55:03.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/226066989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 msgr2=0x7f1d340cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/226066989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d340cd540 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009d90 tx=0x7f1d2c00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:03.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/226066989 shutdown_connections 2023-12-19T17:55:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/226066989 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d340cd540 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.294+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/226066989 >> 172.21.15.45:0/226066989 conn(0x7f1d340cba40 msgr2=0x7f1d340ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.298+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/226066989 shutdown_connections 2023-12-19T17:55:03.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.298+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/226066989 wait complete. 2023-12-19T17:55:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.298+0000 7f1d3b6e0700 1 Processor -- start 2023-12-19T17:55:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.298+0000 7f1d3b6e0700 1 -- start start 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d3414cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d34164690 0x7f1d340b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d34164a70 0x7f1d340ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3414d0d0 con 0x7f1d340c4510 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340b2150 con 0x7f1d34164690 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d340b2430 con 0x7f1d34164a70 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d3414cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d3414cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43298/0 (socket says 172.21.15.45:43298) 2023-12-19T17:55:03.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 -- 172.21.15.45:0/1132527267 learned_addr learned my addr 172.21.15.45:0/1132527267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d39c7d700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d34164a70 0x7f1d340ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d38c7b700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d34164690 0x7f1d340b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 -- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d34164a70 msgr2=0x7f1d340ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d34164a70 0x7f1d340ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 -- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d34164690 msgr2=0x7f1d340b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d34164690 0x7f1d340b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 -- 172.21.15.45:0/1132527267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009a70 con 0x7f1d340c4510 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d38c7b700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d34164690 0x7f1d340b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3947c700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d3414cb90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c500 tx=0x7f1d3000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300052d0 con 0x7f1d340c4510 2023-12-19T17:55:03.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d30005430 con 0x7f1d340c4510 2023-12-19T17:55:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d340b2710 con 0x7f1d340c4510 2023-12-19T17:55:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d300055a0 con 0x7f1d340c4510 2023-12-19T17:55:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.302+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d340b29f0 con 0x7f1d340c4510 2023-12-19T17:55:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.306+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d341610f0 con 0x7f1d340c4510 2023-12-19T17:55:03.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.306+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d300038e0 con 0x7f1d340c4510 2023-12-19T17:55:03.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.306+0000 7f1d29ffb700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d18065b00 0x7f1d18067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.310+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f1d30082ae0 con 0x7f1d340c4510 2023-12-19T17:55:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.310+0000 7f1d38c7b700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d18065b00 0x7f1d18067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.310+0000 7f1d38c7b700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d18065b00 0x7f1d18067fc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1d24007fd0 tx=0x7f1d24009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.314+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d341610f0 con 0x7f1d340c4510 2023-12-19T17:55:03.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.494+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d341614d0 con 0x7f1d340c4510 2023-12-19T17:55:03.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.498+0000 7f1d29ffb700 1 -- 172.21.15.45:0/1132527267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f1d341614d0 con 0x7f1d340c4510 2023-12-19T17:55:03.501 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:03.501 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:54:01.816974+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6835/3731258594":"2023-12-20T17:53:55.381131+0000","172.21.15.73:6835/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6833/3731258594":"2023-12-20T17:53:55.381131+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d18065b00 msgr2=0x7f1d18067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d18065b00 0x7f1d18067fc0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1d24007fd0 tx=0x7f1d24009040 comp rx=0 tx=0).stop 2023-12-19T17:55:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 msgr2=0x7f1d3414cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d3414cb90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000c500 tx=0x7f1d3000c8c0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 shutdown_connections 2023-12-19T17:55:03.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d18065b00 0x7f1d18067fc0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d34164a70 0x7f1d340ca3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d34164690 0x7f1d340b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 --2- 172.21.15.45:0/1132527267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d340c4510 0x7f1d3414cb90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 >> 172.21.15.45:0/1132527267 conn(0x7f1d340cba40 msgr2=0x7f1d340ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 shutdown_connections 2023-12-19T17:55:03.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.502+0000 7f1d3b6e0700 1 -- 172.21.15.45:0/1132527267 wait complete. 2023-12-19T17:55:03.526 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T17:55:03.526 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:03.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f341e54d700 1 Processor -- start 2023-12-19T17:55:03.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f341e54d700 1 -- start start 2023-12-19T17:55:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f341e54d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f341815d040 0x7f34180cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f341e54d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34180b6060 con 0x7f341806f4a0 2023-12-19T17:55:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f341e54d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f341806f930 con 0x7f341815d420 2023-12-19T17:55:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f341e54d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f341806fc10 con 0x7f341815d040 2023-12-19T17:55:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f340f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f341806f4a0 0x7f34180d21a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44120/0 (socket says 172.21.15.45:44120) 2023-12-19T17:55:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f340f7fe700 1 -- 172.21.15.45:0/2942891121 learned_addr learned my addr 172.21.15.45:0/2942891121 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f3417fff700 1 --2- 172.21.15.45:0/2942891121 >> v2:172.21.15.73:3300/0 conn(0x7f341815d040 0x7f34180cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.706+0000 7f34177fe700 1 -- 172.21.15.45:0/2942891121 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1487196604 0 0) 0x7f34180b6060 con 0x7f341806f4a0 2023-12-19T17:55:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f34177fe700 1 -- 172.21.15.45:0/2942891121 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34040035d0 con 0x7f341806f4a0 2023-12-19T17:55:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f3417fff700 1 -- 172.21.15.45:0/2942891121 >> v1:172.21.15.73:6789/0 conn(0x7f341815d420 legacy=0x7f34180b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f34177fe700 1 -- 172.21.15.45:0/2942891121 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2656480702 0 0) 0x7f34040035d0 con 0x7f341806f4a0 2023-12-19T17:55:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f3417fff700 1 -- 172.21.15.45:0/2942891121 >> v1:172.21.15.45:6789/0 conn(0x7f341806f4a0 legacy=0x7f34180d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f3417fff700 1 -- 172.21.15.45:0/2942891121 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341806fef0 con 0x7f341815d040 2023-12-19T17:55:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f3417fff700 1 --2- 172.21.15.45:0/2942891121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180cdf20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3408009d90 tx=0x7f340800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7739bd3702bb320 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f34177fe700 1 -- 172.21.15.45:0/2942891121 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f340800e070 con 0x7f341815d040 2023-12-19T17:55:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f34177fe700 1 -- 172.21.15.45:0/2942891121 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3408003a40 con 0x7f341815d040 2023-12-19T17:55:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f34177fe700 1 -- 172.21.15.45:0/2942891121 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3400001670 con 0x7f341815d040 2023-12-19T17:55:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 -- 172.21.15.45:0/2942891121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 msgr2=0x7f34180cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 --2- 172.21.15.45:0/2942891121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180cdf20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f3408009d90 tx=0x7f340800b330 comp rx=0 tx=0).stop 2023-12-19T17:55:03.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 -- 172.21.15.45:0/2942891121 shutdown_connections 2023-12-19T17:55:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 --2- 172.21.15.45:0/2942891121 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180cdf20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 -- 172.21.15.45:0/2942891121 >> 172.21.15.45:0/2942891121 conn(0x7f34180d2e50 msgr2=0x7f34180d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 -- 172.21.15.45:0/2942891121 shutdown_connections 2023-12-19T17:55:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.710+0000 7f341e54d700 1 -- 172.21.15.45:0/2942891121 wait complete. 2023-12-19T17:55:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.714+0000 7f341e54d700 1 Processor -- start 2023-12-19T17:55:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.714+0000 7f341e54d700 1 -- start start 2023-12-19T17:55:03.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f341815d420 0x7f34180c9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 0x7f341815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341815e2e0 con 0x7f34180c9560 2023-12-19T17:55:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f341815e5c0 con 0x7f341815d040 2023-12-19T17:55:03.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f341815e8a0 con 0x7f341815d420 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 0x7f341815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 0x7f341815bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43310/0 (socket says 172.21.15.45:43310) 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 -- 172.21.15.45:0/861767042 learned_addr learned my addr 172.21.15.45:0/861767042 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f3417fff700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f340f7fe700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f341815d420 0x7f34180c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 -- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f341815d420 msgr2=0x7f34180c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f341815d420 0x7f34180c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 -- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 msgr2=0x7f34180c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 -- 172.21.15.45:0/861767042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3408009a70 con 0x7f34180c9560 2023-12-19T17:55:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341caea700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 0x7f341815bbb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f341000c400 tx=0x7f341000c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100052d0 con 0x7f34180c9560 2023-12-19T17:55:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3410005430 con 0x7f34180c9560 2023-12-19T17:55:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f341815eb80 con 0x7f34180c9560 2023-12-19T17:55:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34100055a0 con 0x7f34180c9560 2023-12-19T17:55:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.718+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34180c84f0 con 0x7f34180c9560 2023-12-19T17:55:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.722+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f341815f0a0 con 0x7f34180c9560 2023-12-19T17:55:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.722+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f34100038e0 con 0x7f34180c9560 2023-12-19T17:55:03.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.726+0000 7f34157fa700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f33f8065b00 0x7f33f8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.726+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f3410082840 con 0x7f34180c9560 2023-12-19T17:55:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.726+0000 7f3417fff700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f33f8065b00 0x7f33f8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.726+0000 7f3417fff700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f33f8065b00 0x7f33f8067fc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3408000f80 tx=0x7f3408011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.734+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f341815f0a0 con 0x7f34180c9560 2023-12-19T17:55:03.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.946+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f341815f0a0 con 0x7f34180c9560 2023-12-19T17:55:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f34157fa700 1 -- 172.21.15.45:0/861767042 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f341815f0a0 con 0x7f34180c9560 2023-12-19T17:55:03.952 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:03.952 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:04.849464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:55:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f33f8065b00 msgr2=0x7f33f8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f33f8065b00 0x7f33f8067fc0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f3408000f80 tx=0x7f3408011000 comp rx=0 tx=0).stop 2023-12-19T17:55:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 msgr2=0x7f341815bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 0x7f341815bbb0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f341000c400 tx=0x7f341000c710 comp rx=0 tx=0).stop 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 shutdown_connections 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f33f8065b00 0x7f33f8067fc0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34180c9560 0x7f341815bbb0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f341815d420 0x7f34180c9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 --2- 172.21.15.45:0/861767042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f341815d040 0x7f34180c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 >> 172.21.15.45:0/861767042 conn(0x7f34180d2e50 msgr2=0x7f341815aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 shutdown_connections 2023-12-19T17:55:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:03.950+0000 7f341e54d700 1 -- 172.21.15.45:0/861767042 wait complete. 2023-12-19T17:55:03.956 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-12-19T17:55:03.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 Processor -- start 2023-12-19T17:55:04.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 -- start start 2023-12-19T17:55:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5c480340d0 0x7f5c480eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c48047de0 0x7f5c48053090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4804ff40 con 0x7f5c48048330 2023-12-19T17:55:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c4804fca0 con 0x7f5c48047de0 2023-12-19T17:55:04.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c55cb0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480503d0 con 0x7f5c480340d0 2023-12-19T17:55:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c48047de0 0x7f5c48053090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c48047de0 0x7f5c48053090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43312/0 (socket says 172.21.15.45:43312) 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 -- 172.21.15.45:0/9139731 learned_addr learned my addr 172.21.15.45:0/9139731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c4ffff700 1 --1- 172.21.15.45:0/9139731 >> v1:172.21.15.45:6789/0 conn(0x7f5c48048330 0x7f5c480eb880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44130/0 (socket says 172.21.15.45:44130) 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c54cae700 1 --2- 172.21.15.45:0/9139731 >> v2:172.21.15.73:3300/0 conn(0x7f5c480340d0 0x7f5c480eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 -- 172.21.15.45:0/9139731 >> v2:172.21.15.73:3300/0 conn(0x7f5c480340d0 msgr2=0x7f5c480eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 --2- 172.21.15.45:0/9139731 >> v2:172.21.15.73:3300/0 conn(0x7f5c480340d0 0x7f5c480eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 -- 172.21.15.45:0/9139731 >> v1:172.21.15.45:6789/0 conn(0x7f5c48048330 legacy=0x7f5c480eb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 -- 172.21.15.45:0/9139731 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480ebf90 con 0x7f5c48047de0 2023-12-19T17:55:04.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.142+0000 7f5c554af700 1 --2- 172.21.15.45:0/9139731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48047de0 0x7f5c48053090 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5c50068950 tx=0x7f5c50074400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbb680eca6dda90 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:04.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c4f7fe700 1 -- 172.21.15.45:0/9139731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50067050 con 0x7f5c48047de0 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c4f7fe700 1 -- 172.21.15.45:0/9139731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c500671b0 con 0x7f5c48047de0 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c4f7fe700 1 -- 172.21.15.45:0/9139731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500729f0 con 0x7f5c48047de0 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 -- 172.21.15.45:0/9139731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48047de0 msgr2=0x7f5c48053090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/9139731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48047de0 0x7f5c48053090 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f5c50068950 tx=0x7f5c50074400 comp rx=0 tx=0).stop 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 -- 172.21.15.45:0/9139731 shutdown_connections 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/9139731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48047de0 0x7f5c48053090 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/9139731 >> v2:172.21.15.73:3300/0 conn(0x7f5c480340d0 0x7f5c480eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 -- 172.21.15.45:0/9139731 >> 172.21.15.45:0/9139731 conn(0x7f5c48054c90 msgr2=0x7f5c480550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 -- 172.21.15.45:0/9139731 shutdown_connections 2023-12-19T17:55:04.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.146+0000 7f5c55cb0700 1 -- 172.21.15.45:0/9139731 wait complete. 2023-12-19T17:55:04.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 Processor -- start 2023-12-19T17:55:04.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 -- start start 2023-12-19T17:55:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c480340d0 0x7f5c480d3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c48047de0 0x7f5c480ea320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 0x7f5c480d9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480d3ec0 con 0x7f5c48048330 2023-12-19T17:55:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4804dde0 con 0x7f5c48047de0 2023-12-19T17:55:04.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c55cb0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c480e9020 con 0x7f5c480340d0 2023-12-19T17:55:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c554af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 0x7f5c480d9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c554af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 0x7f5c480d9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43314/0 (socket says 172.21.15.45:43314) 2023-12-19T17:55:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c554af700 1 -- 172.21.15.45:0/3503459833 learned_addr learned my addr 172.21.15.45:0/3503459833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:04.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c54cae700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c480340d0 0x7f5c480d3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.150+0000 7f5c4ffff700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c48047de0 0x7f5c480ea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c554af700 1 -- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c480340d0 msgr2=0x7f5c480d3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c554af700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c480340d0 0x7f5c480d3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c554af700 1 -- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c48047de0 msgr2=0x7f5c480ea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c554af700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c48047de0 0x7f5c480ea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c554af700 1 -- 172.21.15.45:0/3503459833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480e92c0 con 0x7f5c48048330 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c554af700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 0x7f5c480d9c90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5c50069a70 tx=0x7f5c50067dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5006e560 con 0x7f5c48048330 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5006e6c0 con 0x7f5c48048330 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500722c0 con 0x7f5c48048330 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c480e9560 con 0x7f5c48048330 2023-12-19T17:55:04.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c480e9b20 con 0x7f5c48048330 2023-12-19T17:55:04.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.154+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c48005460 con 0x7f5c48048330 2023-12-19T17:55:04.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.158+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5c50072420 con 0x7f5c48048330 2023-12-19T17:55:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.158+0000 7f5c4d7fa700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c34065b00 0x7f5c34067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.158+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f5c500fdfb0 con 0x7f5c48048330 2023-12-19T17:55:04.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.158+0000 7f5c54cae700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c34065b00 0x7f5c34067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.158+0000 7f5c54cae700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c34065b00 0x7f5c34067fc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c44007a60 tx=0x7f5c44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:04.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.162+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5c500cb590 con 0x7f5c48048330 2023-12-19T17:55:04.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.374+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c4804ed90 con 0x7f5c48048330 2023-12-19T17:55:04.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.378+0000 7f5c4d7fa700 1 -- 172.21.15.45:0/3503459833 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f5c50073aa0 con 0x7f5c48048330 2023-12-19T17:55:04.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:04.380 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":29,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:53:56.240467+0000","modified":"2023-12-19T17:54:04.849464+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":50,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":55385},"failed":[],"damaged":[],"stopped":[],"info":{"gid_55385":{"gid":55385,"name":"d","rank":0,"incarnation":26,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3950826099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3950826099},{"type":"v1","addr":"172.21.15.73:6835","nonce":3950826099}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6,7],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-19T17:55:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c34065b00 msgr2=0x7f5c34067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c34065b00 0x7f5c34067fc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5c44007a60 tx=0x7f5c44008040 comp rx=0 tx=0).stop 2023-12-19T17:55:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 msgr2=0x7f5c480d9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 0x7f5c480d9c90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f5c50069a70 tx=0x7f5c50067dd0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 shutdown_connections 2023-12-19T17:55:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c34065b00 0x7f5c34067fc0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c48048330 0x7f5c480d9c90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c48047de0 0x7f5c480ea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 --2- 172.21.15.45:0/3503459833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c480340d0 0x7f5c480d3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 >> 172.21.15.45:0/3503459833 conn(0x7f5c48054c90 msgr2=0x7f5c480eb340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 shutdown_connections 2023-12-19T17:55:04.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.382+0000 7f5c55cb0700 1 -- 172.21.15.45:0/3503459833 wait complete. 2023-12-19T17:55:04.388 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 29 2023-12-19T17:55:04.415 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:04.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.582+0000 7f694ffff700 1 Processor -- start 2023-12-19T17:55:04.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.582+0000 7f694ffff700 1 -- start start 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f695015ae20 0x7f695015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 0x7f69500c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694ffff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f695006f0a0 con 0x7f69500af720 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694ffff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f695006ea90 con 0x7f695015ae20 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69500c3f60 con 0x7f695006cad0 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f695015ae20 0x7f695015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 0x7f69500c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 0x7f69500c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38066/0 (socket says 172.21.15.45:38066) 2023-12-19T17:55:04.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 -- 172.21.15.45:0/1061528948 learned_addr learned my addr 172.21.15.45:0/1061528948 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:04.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 -- 172.21.15.45:0/1061528948 >> v2:172.21.15.73:3300/0 conn(0x7f695015ae20 msgr2=0x7f695015be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:04.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 --2- 172.21.15.45:0/1061528948 >> v2:172.21.15.73:3300/0 conn(0x7f695015ae20 0x7f695015be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 -- 172.21.15.45:0/1061528948 >> v1:172.21.15.73:6789/0 conn(0x7f69500af720 legacy=0x7f695015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 -- 172.21.15.45:0/1061528948 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69500c4240 con 0x7f695006cad0 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694dffb700 1 -- 172.21.15.45:0/1061528948 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827009186 0 0) 0x7f695006f0a0 con 0x7f69500af720 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694e7fc700 1 --2- 172.21.15.45:0/1061528948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 0x7f69500c3710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6944009910 tx=0x7f6944009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29407b63ebc88485 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694dffb700 1 -- 172.21.15.45:0/1061528948 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944011830 con 0x7f695006cad0 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694dffb700 1 -- 172.21.15.45:0/1061528948 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6944011990 con 0x7f695006cad0 2023-12-19T17:55:04.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694dffb700 1 -- 172.21.15.45:0/1061528948 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944011d40 con 0x7f695006cad0 2023-12-19T17:55:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.586+0000 7f694ffff700 1 -- 172.21.15.45:0/1061528948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 msgr2=0x7f69500c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 --2- 172.21.15.45:0/1061528948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 0x7f69500c3710 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6944009910 tx=0x7f6944009c20 comp rx=0 tx=0).stop 2023-12-19T17:55:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 -- 172.21.15.45:0/1061528948 shutdown_connections 2023-12-19T17:55:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 --2- 172.21.15.45:0/1061528948 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f695006cad0 0x7f69500c3710 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 --2- 172.21.15.45:0/1061528948 >> v2:172.21.15.73:3300/0 conn(0x7f695015ae20 0x7f695015be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 -- 172.21.15.45:0/1061528948 >> 172.21.15.45:0/1061528948 conn(0x7f69500cb900 msgr2=0x7f69500b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 -- 172.21.15.45:0/1061528948 shutdown_connections 2023-12-19T17:55:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 -- 172.21.15.45:0/1061528948 wait complete. 2023-12-19T17:55:04.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 Processor -- start 2023-12-19T17:55:04.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.590+0000 7f694ffff700 1 -- start start 2023-12-19T17:55:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695006cad0 0x7f695014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 0x7f69500c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f695015ae20 0x7f69500c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695014f590 con 0x7f695015ae20 2023-12-19T17:55:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695014bc20 con 0x7f695006cad0 2023-12-19T17:55:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695014ecf0 con 0x7f69500af720 2023-12-19T17:55:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 0x7f69500c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694effd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695006cad0 0x7f695014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f695015ae20 0x7f69500c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 0x7f69500c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38082/0 (socket says 172.21.15.45:38082) 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 -- 172.21.15.45:0/1086795750 learned_addr learned my addr 172.21.15.45:0/1086795750 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 -- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695006cad0 msgr2=0x7f695014b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695006cad0 0x7f695014b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 -- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f695015ae20 msgr2=0x7f69500c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f695015ae20 0x7f69500c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 -- 172.21.15.45:0/1086795750 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6944009570 con 0x7f69500af720 2023-12-19T17:55:04.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694effd700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695006cad0 0x7f695014b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694e7fc700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 0x7f69500c7bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6944013000 tx=0x7f6944004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694400b970 con 0x7f69500af720 2023-12-19T17:55:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694401f070 con 0x7f69500af720 2023-12-19T17:55:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694400bcf0 con 0x7f69500af720 2023-12-19T17:55:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695014efd0 con 0x7f69500af720 2023-12-19T17:55:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.594+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69500c8fb0 con 0x7f69500af720 2023-12-19T17:55:04.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.598+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69500c8e10 con 0x7f69500af720 2023-12-19T17:55:04.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.598+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f694401a430 con 0x7f69500af720 2023-12-19T17:55:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.602+0000 7f69377fe700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f693c065ad0 0x7f693c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.602+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f6944021070 con 0x7f69500af720 2023-12-19T17:55:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.602+0000 7f694effd700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f693c065ad0 0x7f693c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.602+0000 7f694effd700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f693c065ad0 0x7f693c067f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6940009f40 tx=0x7f6940009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.610+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f69500c8e10 con 0x7f69500af720 2023-12-19T17:55:04.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.806+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69500c8e10 con 0x7f69500af720 2023-12-19T17:55:04.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.810+0000 7f69377fe700 1 -- 172.21.15.45:0/1086795750 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f69500c8e10 con 0x7f69500af720 2023-12-19T17:55:04.812 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:04.812 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":50,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:54:01.816974+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:53:12.347432+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-19T17:53:13.452647+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:53:23.494126+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/3331996662":"2023-12-20T17:54:01.816945+0000","172.21.15.73:6833/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6835/3731258594":"2023-12-20T17:53:55.381131+0000","172.21.15.73:6835/2739747419":"2023-12-20T17:53:56.420995+0000","172.21.15.73:6833/3731258594":"2023-12-20T17:53:55.381131+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f693c065ad0 msgr2=0x7f693c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f693c065ad0 0x7f693c067f90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6940009f40 tx=0x7f6940009240 comp rx=0 tx=0).stop 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 msgr2=0x7f69500c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 0x7f69500c7bf0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6944013000 tx=0x7f6944004770 comp rx=0 tx=0).stop 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 shutdown_connections 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f693c065ad0 0x7f693c067f90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f695015ae20 0x7f69500c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69500af720 0x7f69500c7bf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 --2- 172.21.15.45:0/1086795750 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f695006cad0 0x7f695014b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 >> 172.21.15.45:0/1086795750 conn(0x7f69500cb900 msgr2=0x7f695006f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 shutdown_connections 2023-12-19T17:55:04.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:04.814+0000 7f694ffff700 1 -- 172.21.15.45:0/1086795750 wait complete. 2023-12-19T17:55:04.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T17:55:05.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.022+0000 7f9b8d3ef700 1 Processor -- start 2023-12-19T17:55:05.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.022+0000 7f9b8d3ef700 1 -- start start 2023-12-19T17:55:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b8d3ef700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b881591b0 0x7f9b8806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b8d3ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b88159590 0x7f9b880c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b8d3ef700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b880ca7f0 con 0x7f9b880c4120 2023-12-19T17:55:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b8d3ef700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b880cadb0 con 0x7f9b881591b0 2023-12-19T17:55:05.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b8d3ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b880caad0 con 0x7f9b88159590 2023-12-19T17:55:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b87fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b881591b0 0x7f9b8806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b87fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b881591b0 0x7f9b8806ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43324/0 (socket says 172.21.15.45:43324) 2023-12-19T17:55:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b87fff700 1 -- 172.21.15.45:0/2305045145 learned_addr learned my addr 172.21.15.45:0/2305045145 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/2305045145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b88159590 0x7f9b880c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b7ffff700 1 -- 172.21.15.45:0/2305045145 >> v2:172.21.15.45:3300/0 conn(0x7f9b881591b0 msgr2=0x7f9b8806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:05.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/2305045145 >> v2:172.21.15.45:3300/0 conn(0x7f9b881591b0 0x7f9b8806ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b7ffff700 1 -- 172.21.15.45:0/2305045145 >> v1:172.21.15.73:6789/0 conn(0x7f9b880c4120 legacy=0x7f9b8806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b7ffff700 1 -- 172.21.15.45:0/2305045145 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8806d100 con 0x7f9b88159590 2023-12-19T17:55:05.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/2305045145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b88159590 0x7f9b880c3710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009850 tx=0x7f9b70009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93db2d8965aae974 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:05.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b877fe700 1 -- 172.21.15.45:0/2305045145 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70011830 con 0x7f9b88159590 2023-12-19T17:55:05.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b877fe700 1 -- 172.21.15.45:0/2305045145 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b70011990 con 0x7f9b88159590 2023-12-19T17:55:05.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.026+0000 7f9b877fe700 1 -- 172.21.15.45:0/2305045145 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b70011d40 con 0x7f9b88159590 2023-12-19T17:55:05.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/2305045145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b88159590 msgr2=0x7f9b880c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/2305045145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b88159590 0x7f9b880c3710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9b70009850 tx=0x7f9b70009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/2305045145 shutdown_connections 2023-12-19T17:55:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/2305045145 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b88159590 0x7f9b880c3710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/2305045145 >> v2:172.21.15.45:3300/0 conn(0x7f9b881591b0 0x7f9b8806ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/2305045145 >> 172.21.15.45:0/2305045145 conn(0x7f9b880cb900 msgr2=0x7f9b880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/2305045145 shutdown_connections 2023-12-19T17:55:05.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/2305045145 wait complete. 2023-12-19T17:55:05.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 Processor -- start 2023-12-19T17:55:05.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.030+0000 7f9b8d3ef700 1 -- start start 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 0x7f9b881edd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b881591b0 0x7f9b8815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b8815afa0 0x7f9b881e1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8815c1a0 con 0x7f9b880c4120 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b881ee240 con 0x7f9b881591b0 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b8814adf0 con 0x7f9b8815afa0 2023-12-19T17:55:05.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 0x7f9b881edd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 0x7f9b881edd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43332/0 (socket says 172.21.15.45:43332) 2023-12-19T17:55:05.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 -- 172.21.15.45:0/4044458130 learned_addr learned my addr 172.21.15.45:0/4044458130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8cbee700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b8815afa0 0x7f9b881e1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b881591b0 0x7f9b8815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 -- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b8815afa0 msgr2=0x7f9b881e1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b8815afa0 0x7f9b881e1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 -- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b881591b0 msgr2=0x7f9b8815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b881591b0 0x7f9b8815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 -- 172.21.15.45:0/4044458130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b700094b0 con 0x7f9b880c4120 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b881591b0 0x7f9b8815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b87fff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 0x7f9b881edd00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800dd90 tx=0x7f9b780103a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:05.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78012040 con 0x7f9b880c4120 2023-12-19T17:55:05.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b8815b520 con 0x7f9b880c4120 2023-12-19T17:55:05.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b78010d60 con 0x7f9b880c4120 2023-12-19T17:55:05.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b78018630 con 0x7f9b880c4120 2023-12-19T17:55:05.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.034+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b8815bae0 con 0x7f9b880c4120 2023-12-19T17:55:05.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.038+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b88067760 con 0x7f9b880c4120 2023-12-19T17:55:05.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.038+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b78018790 con 0x7f9b880c4120 2023-12-19T17:55:05.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.038+0000 7f9b857fa700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b68065ad0 0x7f9b68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.042+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 6720+0+0 (secure 0 0 0) 0x7f9b78085b30 con 0x7f9b880c4120 2023-12-19T17:55:05.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.042+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b68065ad0 0x7f9b68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.042+0000 7f9b7ffff700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b68065ad0 0x7f9b68067f90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b880b4140 tx=0x7f9b70008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:05.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.046+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b78053110 con 0x7f9b880c4120 2023-12-19T17:55:05.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.258+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9b8806cb10 con 0x7f9b880c4120 2023-12-19T17:55:05.265 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:55:05.262+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:55:05.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.282+0000 7f9b857fa700 1 -- 172.21.15.45:0/4044458130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v30) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9b78056730 con 0x7f9b880c4120 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b68065ad0 msgr2=0x7f9b68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b68065ad0 0x7f9b68067f90 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9b880b4140 tx=0x7f9b70008030 comp rx=0 tx=0).stop 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 msgr2=0x7f9b881edd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 0x7f9b881edd00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800dd90 tx=0x7f9b780103a0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 shutdown_connections 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b68065ad0 0x7f9b68067f90 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b8815afa0 0x7f9b881e1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b881591b0 0x7f9b8815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 --2- 172.21.15.45:0/4044458130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b880c4120 0x7f9b881edd00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 >> 172.21.15.45:0/4044458130 conn(0x7f9b880cb900 msgr2=0x7f9b880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:05.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 shutdown_connections 2023-12-19T17:55:05.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.286+0000 7f9b8d3ef700 1 -- 172.21.15.45:0/4044458130 wait complete. 2023-12-19T17:55:05.292 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T17:55:05.292 INFO:tasks.ceph.mds.d.smithi073.stderr: -5754> 2023-12-19T17:54:01.842+0000 7f09ab37a700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:55:05.296 INFO:tasks.ceph.mds.d.smithi073.stderr: -4303> 2023-12-19T17:54:06.834+0000 7f09aeb81700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:55:05.297 INFO:tasks.ceph.mds.d.smithi073.stderr: -3909> 2023-12-19T17:54:09.410+0000 7f09ab37a700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T17:55:05.297 INFO:tasks.ceph.mds.d.smithi073.stderr: -3724> 2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55cf85efe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(5)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:55:05.298 INFO:tasks.ceph.mds.d.smithi073.stderr: -3587> 2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f7 [2,head] /subdir/2 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f57180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f7:[<0x10000000000/2 v32>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f7:[<0x10000000000/2 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:55:05.298 INFO:tasks.ceph.mds.d.smithi073.stderr: -3564> 2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [2,head] /subdir/3 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f56c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f8:[<0x10000000000/3 v38>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f8:[<0x10000000000/3 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:55:05.298 INFO:tasks.ceph.mds.d.smithi073.stderr: -3548> 2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f6 [2,head] /subdir/1 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f57700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f6:[<0x10000000000/1 v26>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f6:[<0x10000000000/1 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:55:05.298 INFO:tasks.ceph.mds.d.smithi073.stderr: -3532> 2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f9 [2,head] /subdir/4 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85f56680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x100000001f9:[<0x10000000000/4 v40>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x100000001f9:[<0x10000000000/4 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:55:05.298 INFO:tasks.ceph.mds.d.smithi073.stderr: -3515> 2023-12-19T17:54:09.414+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/0 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cf85fa1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(7)0x10000000001:[<0x10000000000/0 v16>,<0x1/subdir v44>]//[6]","memoryvalue":"(7)0x10000000001:[<0x10000000000/0 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:55:05.299 INFO:tasks.ceph.mds.d.smithi073.stderr: -3236> 2023-12-19T17:54:09.422+0000 7f09ab37a700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v5 ap=5 snaprealm=0x55cf85f04900 DIRTYPARENT f(v1 1=0+1) n(v0 rc2023-12-19T17:54:09.105054+0000 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={55427=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55cf85efd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(5)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-19T17:54:09.105054+0000 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:55:05.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T17:55:05.361 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:55:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 Processor -- start 2023-12-19T17:55:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 -- start start 2023-12-19T17:55:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b101621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b1015b920 0x7f4b100713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b10162700 con 0x7f4b10071910 2023-12-19T17:55:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b100b2830 con 0x7f4b1015b920 2023-12-19T17:55:05.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.490+0000 7f4b16d7d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b10071da0 con 0x7f4b1015b540 2023-12-19T17:55:05.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b1557a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b1015b920 0x7f4b100713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b1657c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b10071910 0x7f4b10164d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44132/0 (socket says 172.21.15.45:44132) 2023-12-19T17:55:05.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b15d7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b101621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b1657c700 1 -- 172.21.15.45:0/285582594 learned_addr learned my addr 172.21.15.45:0/285582594 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b15d7b700 1 -- 172.21.15.45:0/285582594 >> v2:172.21.15.45:3300/0 conn(0x7f4b1015b920 msgr2=0x7f4b100713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b15d7b700 1 --2- 172.21.15.45:0/285582594 >> v2:172.21.15.45:3300/0 conn(0x7f4b1015b920 0x7f4b100713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b15d7b700 1 -- 172.21.15.45:0/285582594 >> v1:172.21.15.45:6789/0 conn(0x7f4b10071910 legacy=0x7f4b10164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b15d7b700 1 -- 172.21.15.45:0/285582594 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100b08f0 con 0x7f4b1015b540 2023-12-19T17:55:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b15d7b700 1 --2- 172.21.15.45:0/285582594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b101621c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009de0 tx=0x7f4b0c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=657bb186219a9313 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:05.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b14d79700 1 -- 172.21.15.45:0/285582594 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00e070 con 0x7f4b1015b540 2023-12-19T17:55:05.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b14d79700 1 -- 172.21.15.45:0/285582594 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c00b910 con 0x7f4b1015b540 2023-12-19T17:55:05.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b14d79700 1 -- 172.21.15.45:0/285582594 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c00bcc0 con 0x7f4b1015b540 2023-12-19T17:55:05.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 -- 172.21.15.45:0/285582594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 msgr2=0x7f4b101621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/285582594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b101621c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009de0 tx=0x7f4b0c00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:05.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 -- 172.21.15.45:0/285582594 shutdown_connections 2023-12-19T17:55:05.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/285582594 >> v2:172.21.15.45:3300/0 conn(0x7f4b1015b920 0x7f4b100713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/285582594 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b101621c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 -- 172.21.15.45:0/285582594 >> 172.21.15.45:0/285582594 conn(0x7f4b100cf5a0 msgr2=0x7f4b10070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:05.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 -- 172.21.15.45:0/285582594 shutdown_connections 2023-12-19T17:55:05.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.494+0000 7f4b16d7d700 1 -- 172.21.15.45:0/285582594 wait complete. 2023-12-19T17:55:05.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.498+0000 7f4b16d7d700 1 Processor -- start 2023-12-19T17:55:05.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.498+0000 7f4b16d7d700 1 -- start start 2023-12-19T17:55:05.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.498+0000 7f4b16d7d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b10164790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.498+0000 7f4b16d7d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 0x7f4b101fa8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.498+0000 7f4b16d7d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b101f6030 0x7f4b100af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b16d7d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b101fae00 con 0x7f4b1015b920 2023-12-19T17:55:05.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b16d7d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1015c3f0 con 0x7f4b101f6030 2023-12-19T17:55:05.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b16d7d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b10164e50 con 0x7f4b1015b540 2023-12-19T17:55:05.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 0x7f4b101fa8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 0x7f4b101fa8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43360/0 (socket says 172.21.15.45:43360) 2023-12-19T17:55:05.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 -- 172.21.15.45:0/4283252666 learned_addr learned my addr 172.21.15.45:0/4283252666 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b15d7b700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b10164790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1657c700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b101f6030 0x7f4b100af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 -- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 msgr2=0x7f4b10164790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b10164790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 -- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b101f6030 msgr2=0x7f4b100af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b101f6030 0x7f4b100af8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 -- 172.21.15.45:0/4283252666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009a70 con 0x7f4b1015b920 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b1557a700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 0x7f4b101fa8c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e840 tx=0x7f4b0000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:05.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000095a0 con 0x7f4b1015b920 2023-12-19T17:55:05.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b00013680 con 0x7f4b1015b920 2023-12-19T17:55:05.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b10165130 con 0x7f4b1015b920 2023-12-19T17:55:05.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000139f0 con 0x7f4b1015b920 2023-12-19T17:55:05.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b101656f0 con 0x7f4b1015b920 2023-12-19T17:55:05.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.502+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b1015c580 con 0x7f4b1015b920 2023-12-19T17:55:05.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.506+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b00013b50 con 0x7f4b1015b920 2023-12-19T17:55:05.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.506+0000 7f4b067fc700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4af4065ad0 0x7f4af4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:05.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.506+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6806+0+0 (secure 0 0 0) 0x7f4b000833e0 con 0x7f4b1015b920 2023-12-19T17:55:05.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.506+0000 7f4b15d7b700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4af4065ad0 0x7f4af4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:05.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.510+0000 7f4b15d7b700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4af4065ad0 0x7f4af4067f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c014040 tx=0x7f4b0c011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:05.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.514+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4b00050940 con 0x7f4b1015b920 2023-12-19T17:55:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:05.730+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4b1004ed30 con 0x7f4b1015b920 2023-12-19T17:55:06.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.286+0000 7f4b067fc700 1 -- 172.21.15.45:0/4283252666 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4b0005a070 con 0x7f4b1015b920 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4af4065ad0 msgr2=0x7f4af4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4af4065ad0 0x7f4af4067f90 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c014040 tx=0x7f4b0c011000 comp rx=0 tx=0).stop 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 msgr2=0x7f4b101fa8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 0x7f4b101fa8c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e840 tx=0x7f4b0000eb50 comp rx=0 tx=0).stop 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 shutdown_connections 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4af4065ad0 0x7f4af4067f90 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b101f6030 0x7f4b100af8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b1015b920 0x7f4b101fa8c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 --2- 172.21.15.45:0/4283252666 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b1015b540 0x7f4b10164790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 >> 172.21.15.45:0/4283252666 conn(0x7f4b10071910 msgr2=0x7f4b1015f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 shutdown_connections 2023-12-19T17:55:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.290+0000 7f4b16d7d700 1 -- 172.21.15.45:0/4283252666 wait complete. 2023-12-19T17:55:06.316 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T17:55:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.494+0000 7f0a9dc19700 1 Processor -- start 2023-12-19T17:55:06.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.494+0000 7f0a9dc19700 1 -- start start 2023-12-19T17:55:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a98071160 0x7f0a980b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a9815d090 0x7f0a980d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:06.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a980d15b0 con 0x7f0a9815ccb0 2023-12-19T17:55:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980d2b90 con 0x7f0a98071160 2023-12-19T17:55:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a980d1890 con 0x7f0a9815d090 2023-12-19T17:55:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a97fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0a98071160 0x7f0a980b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9cc17700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0a9815ccb0 0x7f0a98070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34616/0 (socket says 172.21.15.45:34616) 2023-12-19T17:55:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9cc17700 1 -- 172.21.15.45:0/2441753433 learned_addr learned my addr 172.21.15.45:0/2441753433 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:06.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9d418700 1 --2- 172.21.15.45:0/2441753433 >> v2:172.21.15.73:3300/0 conn(0x7f0a9815d090 0x7f0a980d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:06.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a97fff700 1 -- 172.21.15.45:0/2441753433 >> v2:172.21.15.73:3300/0 conn(0x7f0a9815d090 msgr2=0x7f0a980d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:06.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a97fff700 1 --2- 172.21.15.45:0/2441753433 >> v2:172.21.15.73:3300/0 conn(0x7f0a9815d090 0x7f0a980d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a97fff700 1 -- 172.21.15.45:0/2441753433 >> v1:172.21.15.73:6789/0 conn(0x7f0a9815ccb0 legacy=0x7f0a98070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:06.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a97fff700 1 -- 172.21.15.45:0/2441753433 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980d1b70 con 0x7f0a98071160 2023-12-19T17:55:06.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a97fff700 1 --2- 172.21.15.45:0/2441753433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980b8900 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0a980cf190 tx=0x7f0a84009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75168eb0638b50de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:06.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a977fe700 1 -- 172.21.15.45:0/2441753433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011830 con 0x7f0a98071160 2023-12-19T17:55:06.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a977fe700 1 -- 172.21.15.45:0/2441753433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a84011990 con 0x7f0a98071160 2023-12-19T17:55:06.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a977fe700 1 -- 172.21.15.45:0/2441753433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011d20 con 0x7f0a98071160 2023-12-19T17:55:06.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 -- 172.21.15.45:0/2441753433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 msgr2=0x7f0a980b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/2441753433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980b8900 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0a980cf190 tx=0x7f0a84009b30 comp rx=0 tx=0).stop 2023-12-19T17:55:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 -- 172.21.15.45:0/2441753433 shutdown_connections 2023-12-19T17:55:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/2441753433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980b8900 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.498+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/2441753433 >> v2:172.21.15.73:3300/0 conn(0x7f0a9815d090 0x7f0a980d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.502+0000 7f0a9dc19700 1 -- 172.21.15.45:0/2441753433 >> 172.21.15.45:0/2441753433 conn(0x7f0a980d2f50 msgr2=0x7f0a980d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:06.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.502+0000 7f0a9dc19700 1 -- 172.21.15.45:0/2441753433 shutdown_connections 2023-12-19T17:55:06.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.502+0000 7f0a9dc19700 1 -- 172.21.15.45:0/2441753433 wait complete. 2023-12-19T17:55:06.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.502+0000 7f0a9dc19700 1 Processor -- start 2023-12-19T17:55:06.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 -- start start 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a9815ccb0 0x7f0a981f1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a9815d090 0x7f0a980c78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980ccec0 con 0x7f0a98071160 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a981555e0 con 0x7f0a9815d090 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9dc19700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980ca8a0 con 0x7f0a9815ccb0 2023-12-19T17:55:06.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9cc17700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:06.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9cc17700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980cc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43384/0 (socket says 172.21.15.45:43384) 2023-12-19T17:55:06.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9cc17700 1 -- 172.21.15.45:0/324559801 learned_addr learned my addr 172.21.15.45:0/324559801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a97fff700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a9815ccb0 0x7f0a981f1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.506+0000 7f0a9d418700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a9815d090 0x7f0a980c78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9cc17700 1 -- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a9815ccb0 msgr2=0x7f0a981f1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9cc17700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a9815ccb0 0x7f0a981f1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9cc17700 1 -- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a9815d090 msgr2=0x7f0a980c78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9cc17700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a9815d090 0x7f0a980c78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9cc17700 1 -- 172.21.15.45:0/324559801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a840094b0 con 0x7f0a98071160 2023-12-19T17:55:06.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9cc17700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980cc980 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00c700 tx=0x7f0a8c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:06.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c005d90 con 0x7f0a98071160 2023-12-19T17:55:06.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c0070d0 con 0x7f0a98071160 2023-12-19T17:55:06.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c007440 con 0x7f0a98071160 2023-12-19T17:55:06.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a98155020 con 0x7f0a98071160 2023-12-19T17:55:06.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a980ca530 con 0x7f0a98071160 2023-12-19T17:55:06.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.510+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a98067c10 con 0x7f0a98071160 2023-12-19T17:55:06.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.514+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a8c0075a0 con 0x7f0a98071160 2023-12-19T17:55:06.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.514+0000 7f0a957fa700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065ad0 0x7f0a7c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:06.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.514+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6806+0+0 (secure 0 0 0) 0x7f0a8c0828b0 con 0x7f0a98071160 2023-12-19T17:55:06.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.514+0000 7f0a97fff700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065ad0 0x7f0a7c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:06.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.518+0000 7f0a97fff700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065ad0 0x7f0a7c067f90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a84000c00 tx=0x7f0a84008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:06.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.522+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0a8c04fe30 con 0x7f0a98071160 2023-12-19T17:55:06.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:06.706+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0a9804ed30 con 0x7f0a98071160 2023-12-19T17:55:07.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.646+0000 7f0a957fa700 1 -- 172.21.15.45:0/324559801 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v52) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0a8c0170d0 con 0x7f0a98071160 2023-12-19T17:55:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.650+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065ad0 msgr2=0x7f0a7c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.650+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065ad0 0x7f0a7c067f90 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0a84000c00 tx=0x7f0a84008030 comp rx=0 tx=0).stop 2023-12-19T17:55:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.650+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 msgr2=0x7f0a980cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.650+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980cc980 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c00c700 tx=0x7f0a8c00ca10 comp rx=0 tx=0).stop 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 shutdown_connections 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065ad0 0x7f0a7c067f90 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a9815d090 0x7f0a980c78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a9815ccb0 0x7f0a981f1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 --2- 172.21.15.45:0/324559801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98071160 0x7f0a980cc980 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 >> 172.21.15.45:0/324559801 conn(0x7f0a980d2f50 msgr2=0x7f0a98157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 shutdown_connections 2023-12-19T17:55:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.654+0000 7f0a9dc19700 1 -- 172.21.15.45:0/324559801 wait complete. 2023-12-19T17:55:07.657 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-19T17:55:07.677 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T17:55:07.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.866+0000 7f284a1a0700 1 Processor -- start 2023-12-19T17:55:07.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.866+0000 7f284a1a0700 1 -- start start 2023-12-19T17:55:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f284a1a0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2844161340 0x7f2844167f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f284a1a0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284406fe80 con 0x7f284415cf40 2023-12-19T17:55:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f284a1a0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2844070160 con 0x7f284415d320 2023-12-19T17:55:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f284a1a0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2844070440 con 0x7f2844161340 2023-12-19T17:55:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f28437fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f284415cf40 0x7f28440b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:44140/0 (socket says 172.21.15.45:44140) 2023-12-19T17:55:07.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f28437fe700 1 -- 172.21.15.45:0/715125515 learned_addr learned my addr 172.21.15.45:0/715125515 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.870+0000 7f2843fff700 1 --2- 172.21.15.45:0/715125515 >> v2:172.21.15.73:3300/0 conn(0x7f2844161340 0x7f2844167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245898545 0 0) 0x7f284406fe80 con 0x7f284415cf40 2023-12-19T17:55:07.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28300035d0 con 0x7f284415cf40 2023-12-19T17:55:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 951777994 0 0) 0x7f2844070160 con 0x7f284415d320 2023-12-19T17:55:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f284406fe80 con 0x7f284415d320 2023-12-19T17:55:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2843fff700 1 -- 172.21.15.45:0/715125515 >> v1:172.21.15.73:6789/0 conn(0x7f284415d320 legacy=0x7f2844160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2843fff700 1 -- 172.21.15.45:0/715125515 >> v1:172.21.15.45:6789/0 conn(0x7f284415cf40 legacy=0x7f28440b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2843fff700 1 -- 172.21.15.45:0/715125515 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28440d1030 con 0x7f2844161340 2023-12-19T17:55:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2843fff700 1 --2- 172.21.15.45:0/715125515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2844161340 0x7f2844167f60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f283c009d90 tx=0x7f283c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c173f252409e6d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:07.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c00e070 con 0x7f2844161340 2023-12-19T17:55:07.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f283c00bb20 con 0x7f2844161340 2023-12-19T17:55:07.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f2842ffd700 1 -- 172.21.15.45:0/715125515 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c012430 con 0x7f2844161340 2023-12-19T17:55:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 -- 172.21.15.45:0/715125515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2844161340 msgr2=0x7f2844167f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 --2- 172.21.15.45:0/715125515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2844161340 0x7f2844167f60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f283c009d90 tx=0x7f283c00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:07.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 -- 172.21.15.45:0/715125515 shutdown_connections 2023-12-19T17:55:07.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 --2- 172.21.15.45:0/715125515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2844161340 0x7f2844167f60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 -- 172.21.15.45:0/715125515 >> 172.21.15.45:0/715125515 conn(0x7f28440d2e50 msgr2=0x7f28440d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:07.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 -- 172.21.15.45:0/715125515 shutdown_connections 2023-12-19T17:55:07.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.874+0000 7f284a1a0700 1 -- 172.21.15.45:0/715125515 wait complete. 2023-12-19T17:55:07.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 Processor -- start 2023-12-19T17:55:07.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 -- start start 2023-12-19T17:55:07.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f284415cf40 0x7f2844156ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:07.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 0x7f284415ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:07.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2844161340 0x7f284415f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:07.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2844152f90 con 0x7f284415d320 2023-12-19T17:55:07.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28441559c0 con 0x7f284415cf40 2023-12-19T17:55:07.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f284a1a0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2844155ca0 con 0x7f2844161340 2023-12-19T17:55:07.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f283bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 0x7f284415ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:07.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f283bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 0x7f284415ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43398/0 (socket says 172.21.15.45:43398) 2023-12-19T17:55:07.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f283bfff700 1 -- 172.21.15.45:0/3420919028 learned_addr learned my addr 172.21.15.45:0/3420919028 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f28437fe700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f284415cf40 0x7f2844156ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.878+0000 7f2843fff700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2844161340 0x7f284415f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f283bfff700 1 -- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2844161340 msgr2=0x7f284415f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f283bfff700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2844161340 0x7f284415f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f283bfff700 1 -- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f284415cf40 msgr2=0x7f2844156ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f283bfff700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f284415cf40 0x7f2844156ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f283bfff700 1 -- 172.21.15.45:0/3420919028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c009a70 con 0x7f284415d320 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f283bfff700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 0x7f284415ede0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c730 tx=0x7f282c00caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0052d0 con 0x7f284415d320 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f282c005430 con 0x7f284415d320 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2844155f80 con 0x7f284415d320 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f282c0055a0 con 0x7f284415d320 2023-12-19T17:55:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28441570e0 con 0x7f284415d320 2023-12-19T17:55:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.882+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284404ed30 con 0x7f284415d320 2023-12-19T17:55:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.886+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f282c0038e0 con 0x7f284415d320 2023-12-19T17:55:07.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.886+0000 7f2840ff9700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2824065ad0 0x7f2824067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:07.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.886+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6368+0+0 (secure 0 0 0) 0x7f282c082990 con 0x7f284415d320 2023-12-19T17:55:07.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.886+0000 7f28437fe700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2824065ad0 0x7f2824067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:07.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.886+0000 7f28437fe700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2824065ad0 0x7f2824067f90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f28340011e0 tx=0x7f2834009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:07.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:07.894+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f282c0500d0 con 0x7f284415d320 2023-12-19T17:55:08.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.074+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f28440d0a40 con 0x7f284415d320 2023-12-19T17:55:08.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.662+0000 7f2840ff9700 1 -- 172.21.15.45:0/3420919028 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v53) v1 ==== 169+0+0 (secure 0 0 0) 0x7f282c0536f0 con 0x7f284415d320 2023-12-19T17:55:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2824065ad0 msgr2=0x7f2824067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2824065ad0 0x7f2824067f90 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f28340011e0 tx=0x7f2834009040 comp rx=0 tx=0).stop 2023-12-19T17:55:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 msgr2=0x7f284415ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 0x7f284415ede0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f282c00c730 tx=0x7f282c00caf0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 shutdown_connections 2023-12-19T17:55:08.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2824065ad0 0x7f2824067f90 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2844161340 0x7f284415f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f284415d320 0x7f284415ede0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 --2- 172.21.15.45:0/3420919028 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f284415cf40 0x7f2844156ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 >> 172.21.15.45:0/3420919028 conn(0x7f28440d2e50 msgr2=0x7f284415dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 shutdown_connections 2023-12-19T17:55:08.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.666+0000 7f284a1a0700 1 -- 172.21.15.45:0/3420919028 wait complete. 2023-12-19T17:55:08.673 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-19T17:55:08.695 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_extra cephfs_data_extra --yes-i-really-really-mean-it 2023-12-19T17:55:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 Processor -- start 2023-12-19T17:55:08.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 -- start start 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d4c143750 0x7f7d4c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7d4c143b30 0x7f7d4c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d4c0b1430 con 0x7f7d4c0b03e0 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0c38d0 con 0x7f7d4c143750 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d52dbc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d4c0b1150 con 0x7f7d4c143b30 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d51dba700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d4c143750 0x7f7d4c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d51dba700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7d4c143750 0x7f7d4c06eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48574/0 (socket says 172.21.15.45:48574) 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.874+0000 7f7d51dba700 1 -- 172.21.15.45:0/1238072136 learned_addr learned my addr 172.21.15.45:0/1238072136 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:08.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d515b9700 1 --2- 172.21.15.45:0/1238072136 >> v2:172.21.15.73:3300/0 conn(0x7f7d4c143b30 0x7f7d4c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d51dba700 1 -- 172.21.15.45:0/1238072136 >> v2:172.21.15.73:3300/0 conn(0x7f7d4c143b30 msgr2=0x7f7d4c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d51dba700 1 --2- 172.21.15.45:0/1238072136 >> v2:172.21.15.73:3300/0 conn(0x7f7d4c143b30 0x7f7d4c06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d51dba700 1 -- 172.21.15.45:0/1238072136 >> v1:172.21.15.73:6789/0 conn(0x7f7d4c0b03e0 legacy=0x7f7d4c0b0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:08.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d51dba700 1 -- 172.21.15.45:0/1238072136 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c0c3b70 con 0x7f7d4c143750 2023-12-19T17:55:08.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d51dba700 1 --2- 172.21.15.45:0/1238072136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c06eeb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0cb330 tx=0x7f7d48009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0ac728550abc61 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:08.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d50db8700 1 -- 172.21.15.45:0/1238072136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48011830 con 0x7f7d4c143750 2023-12-19T17:55:08.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d50db8700 1 -- 172.21.15.45:0/1238072136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d48011990 con 0x7f7d4c143750 2023-12-19T17:55:08.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d50db8700 1 -- 172.21.15.45:0/1238072136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d48011d20 con 0x7f7d4c143750 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 -- 172.21.15.45:0/1238072136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 msgr2=0x7f7d4c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/1238072136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c06eeb0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c0cb330 tx=0x7f7d48009bf0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 -- 172.21.15.45:0/1238072136 shutdown_connections 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/1238072136 >> v2:172.21.15.73:3300/0 conn(0x7f7d4c143b30 0x7f7d4c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/1238072136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c06eeb0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 -- 172.21.15.45:0/1238072136 >> 172.21.15.45:0/1238072136 conn(0x7f7d4c0cecd0 msgr2=0x7f7d4c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 -- 172.21.15.45:0/1238072136 shutdown_connections 2023-12-19T17:55:08.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.878+0000 7f7d52dbc700 1 -- 172.21.15.45:0/1238072136 wait complete. 2023-12-19T17:55:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 Processor -- start 2023-12-19T17:55:08.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 -- start start 2023-12-19T17:55:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d4c0b03e0 0x7f7d4c13d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c0b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c15a2a0 0x7f7d4c0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c0b1620 con 0x7f7d4c143750 2023-12-19T17:55:08.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c13d870 con 0x7f7d4c15a2a0 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d52dbc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d4c13daf0 con 0x7f7d4c0b03e0 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d515b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c0b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d515b9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c0b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48580/0 (socket says 172.21.15.45:48580) 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d515b9700 1 -- 172.21.15.45:0/4056367182 learned_addr learned my addr 172.21.15.45:0/4056367182 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d525bb700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c15a2a0 0x7f7d4c0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.882+0000 7f7d51dba700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d4c0b03e0 0x7f7d4c13d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d515b9700 1 -- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d4c0b03e0 msgr2=0x7f7d4c13d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:08.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d515b9700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d4c0b03e0 0x7f7d4c13d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d515b9700 1 -- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c15a2a0 msgr2=0x7f7d4c0acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d515b9700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c15a2a0 0x7f7d4c0acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d515b9700 1 -- 172.21.15.45:0/4056367182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d48009570 con 0x7f7d4c143750 2023-12-19T17:55:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d515b9700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c0b2010 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009fd0 tx=0x7f7d3c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c0095a0 con 0x7f7d4c143750 2023-12-19T17:55:08.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d3c013680 con 0x7f7d4c143750 2023-12-19T17:55:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d3c013a30 con 0x7f7d4c143750 2023-12-19T17:55:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d4c13ddd0 con 0x7f7d4c143750 2023-12-19T17:55:08.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d4c0b1b10 con 0x7f7d4c143750 2023-12-19T17:55:08.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.886+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d4c04ed30 con 0x7f7d4c143750 2023-12-19T17:55:08.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.890+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7d3c013b90 con 0x7f7d4c143750 2023-12-19T17:55:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.890+0000 7f7d427fc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d30065ad0 0x7f7d30067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:08.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.890+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f7d3c083110 con 0x7f7d4c143750 2023-12-19T17:55:08.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.890+0000 7f7d51dba700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d30065ad0 0x7f7d30067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:08.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.894+0000 7f7d51dba700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d30065ad0 0x7f7d30067f90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c00 tx=0x7f7d48008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:08.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:08.898+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7d3c050950 con 0x7f7d4c143750 2023-12-19T17:55:09.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.070+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7d4c0ae3b0 con 0x7f7d4c143750 2023-12-19T17:55:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.666+0000 7f7d427fc700 1 -- 172.21.15.45:0/4056367182 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_extra' removed v54) v1 ==== 187+0+0 (secure 0 0 0) 0x7f7d3c0170e0 con 0x7f7d4c143750 2023-12-19T17:55:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d30065ad0 msgr2=0x7f7d30067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d30065ad0 0x7f7d30067f90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7d48000c00 tx=0x7f7d48008030 comp rx=0 tx=0).stop 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 msgr2=0x7f7d4c0b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c0b2010 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7d3c009fd0 tx=0x7f7d3c00eb20 comp rx=0 tx=0).stop 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 shutdown_connections 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7d30065ad0 0x7f7d30067f90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d4c15a2a0 0x7f7d4c0acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7d4c143750 0x7f7d4c0b2010 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 --2- 172.21.15.45:0/4056367182 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7d4c0b03e0 0x7f7d4c13d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 >> 172.21.15.45:0/4056367182 conn(0x7f7d4c0cecd0 msgr2=0x7f7d4c143f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 shutdown_connections 2023-12-19T17:55:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.670+0000 7f7d52dbc700 1 -- 172.21.15.45:0/4056367182 wait complete. 2023-12-19T17:55:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' removed 2023-12-19T17:55:09.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T17:55:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.882+0000 7f5e5de37700 1 Processor -- start 2023-12-19T17:55:09.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.882+0000 7f5e5de37700 1 -- start start 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e5de37700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e580cb8d0 0x7f5e5815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e5de37700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5e580ce350 0x7f5e5806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e5de37700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5806ea90 con 0x7f5e580cc690 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e5de37700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5815c340 con 0x7f5e580cb8d0 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e5de37700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e5815baa0 con 0x7f5e580ce350 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e577fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5e580cc690 0x7f5e580cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55894/0 (socket says 172.21.15.45:55894) 2023-12-19T17:55:09.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e577fe700 1 -- 172.21.15.45:0/1271109828 learned_addr learned my addr 172.21.15.45:0/1271109828 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e56ffd700 1 --2- 172.21.15.45:0/1271109828 >> v2:172.21.15.45:3300/0 conn(0x7f5e580cb8d0 0x7f5e5815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:09.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e57fff700 1 --2- 172.21.15.45:0/1271109828 >> v2:172.21.15.73:3300/0 conn(0x7f5e580ce350 0x7f5e5806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e567fc700 1 -- 172.21.15.45:0/1271109828 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743787230 0 0) 0x7f5e5806ea90 con 0x7f5e580cc690 2023-12-19T17:55:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e567fc700 1 -- 172.21.15.45:0/1271109828 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e400035d0 con 0x7f5e580cc690 2023-12-19T17:55:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e56ffd700 1 -- 172.21.15.45:0/1271109828 >> v2:172.21.15.73:3300/0 conn(0x7f5e580ce350 msgr2=0x7f5e5806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e56ffd700 1 --2- 172.21.15.45:0/1271109828 >> v2:172.21.15.73:3300/0 conn(0x7f5e580ce350 0x7f5e5806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e56ffd700 1 -- 172.21.15.45:0/1271109828 >> v1:172.21.15.45:6789/0 conn(0x7f5e580cc690 legacy=0x7f5e580cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:09.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e56ffd700 1 -- 172.21.15.45:0/1271109828 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5815bd80 con 0x7f5e580cb8d0 2023-12-19T17:55:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.886+0000 7f5e56ffd700 1 --2- 172.21.15.45:0/1271109828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580cb8d0 0x7f5e5815b410 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5e580cdb00 tx=0x7f5e4c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9bb300079aeed59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e567fc700 1 -- 172.21.15.45:0/1271109828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c011830 con 0x7f5e580cb8d0 2023-12-19T17:55:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e567fc700 1 -- 172.21.15.45:0/1271109828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e4c011990 con 0x7f5e580cb8d0 2023-12-19T17:55:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e567fc700 1 -- 172.21.15.45:0/1271109828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4c011d20 con 0x7f5e580cb8d0 2023-12-19T17:55:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 -- 172.21.15.45:0/1271109828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580cb8d0 msgr2=0x7f5e5815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:09.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 --2- 172.21.15.45:0/1271109828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580cb8d0 0x7f5e5815b410 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5e580cdb00 tx=0x7f5e4c009b30 comp rx=0 tx=0).stop 2023-12-19T17:55:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 -- 172.21.15.45:0/1271109828 shutdown_connections 2023-12-19T17:55:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 --2- 172.21.15.45:0/1271109828 >> v2:172.21.15.73:3300/0 conn(0x7f5e580ce350 0x7f5e5806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 --2- 172.21.15.45:0/1271109828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580cb8d0 0x7f5e5815b410 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 -- 172.21.15.45:0/1271109828 >> 172.21.15.45:0/1271109828 conn(0x7f5e58071990 msgr2=0x7f5e580b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 -- 172.21.15.45:0/1271109828 shutdown_connections 2023-12-19T17:55:09.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.890+0000 7f5e5de37700 1 -- 172.21.15.45:0/1271109828 wait complete. 2023-12-19T17:55:09.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 Processor -- start 2023-12-19T17:55:09.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 -- start start 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e580cb8d0 0x7f5e581593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e580cc690 0x7f5e5814d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 0x7f5e5815ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5814dd40 con 0x7f5e580ce350 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5815b2f0 con 0x7f5e580cb8d0 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5815d410 con 0x7f5e580cc690 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 0x7f5e5815ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:09.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 0x7f5e5815ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48592/0 (socket says 172.21.15.45:48592) 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 -- 172.21.15.45:0/3382630442 learned_addr learned my addr 172.21.15.45:0/3382630442 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e577fe700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e580cb8d0 0x7f5e581593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e56ffd700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e580cc690 0x7f5e5814d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 -- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e580cc690 msgr2=0x7f5e5814d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e580cc690 0x7f5e5814d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 -- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e580cb8d0 msgr2=0x7f5e581593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e580cb8d0 0x7f5e581593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 -- 172.21.15.45:0/3382630442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4c0094b0 con 0x7f5e580ce350 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e577fe700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e580cb8d0 0x7f5e581593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e57fff700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 0x7f5e5815ced0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009dd0 tx=0x7f5e5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e50009c40 con 0x7f5e580ce350 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5000f040 con 0x7f5e580ce350 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5000ceb0 con 0x7f5e580ce350 2023-12-19T17:55:09.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.894+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e5815b010 con 0x7f5e580ce350 2023-12-19T17:55:09.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.898+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e5815e100 con 0x7f5e580ce350 2023-12-19T17:55:09.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.898+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5804ed30 con 0x7f5e580ce350 2023-12-19T17:55:09.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.898+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5e50014480 con 0x7f5e580ce350 2023-12-19T17:55:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.902+0000 7f5e3ffff700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e44065ad0 0x7f5e44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:09.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.902+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f5e50083ae0 con 0x7f5e580ce350 2023-12-19T17:55:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.902+0000 7f5e577fe700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e44065ad0 0x7f5e44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:09.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.902+0000 7f5e577fe700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e44065ad0 0x7f5e44067f90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e48007fd0 tx=0x7f5e48007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:09.910+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5e500515e0 con 0x7f5e580ce350 2023-12-19T17:55:10.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.082+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e580ade70 con 0x7f5e580ce350 2023-12-19T17:55:10.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.094+0000 7f5e3ffff700 1 -- 172.21.15.45:0/3382630442 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e500180a0 con 0x7f5e580ce350 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e44065ad0 msgr2=0x7f5e44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e44065ad0 0x7f5e44067f90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f5e48007fd0 tx=0x7f5e48007de0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 msgr2=0x7f5e5815ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 0x7f5e5815ced0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5e50009dd0 tx=0x7f5e5000c3a0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 shutdown_connections 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e44065ad0 0x7f5e44067f90 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e580ce350 0x7f5e5815ced0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e580cc690 0x7f5e5814d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 --2- 172.21.15.45:0/3382630442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e580cb8d0 0x7f5e581593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.098+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 >> 172.21.15.45:0/3382630442 conn(0x7f5e58071990 msgr2=0x7f5e580ae4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.102+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 shutdown_connections 2023-12-19T17:55:10.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.102+0000 7f5e5de37700 1 -- 172.21.15.45:0/3382630442 wait complete. 2023-12-19T17:55:10.130 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files' 2023-12-19T17:55:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693359e700 1 Processor -- start 2023-12-19T17:55:10.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693359e700 1 -- start start 2023-12-19T17:55:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f69340afe30 0x7f693415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693406f0a0 con 0x7f693415ae20 2023-12-19T17:55:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f693406ea90 con 0x7f693406cad0 2023-12-19T17:55:10.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693359e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69340c3f60 con 0x7f69340afe30 2023-12-19T17:55:10.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f693415ae20 0x7f69340c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55902/0 (socket says 172.21.15.45:55902) 2023-12-19T17:55:10.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f693259c700 1 -- 172.21.15.45:0/710073044 learned_addr learned my addr 172.21.15.45:0/710073044 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:10.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.302+0000 7f6932d9d700 1 --2- 172.21.15.45:0/710073044 >> v2:172.21.15.45:3300/0 conn(0x7f69340afe30 0x7f693415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6931d9b700 1 -- 172.21.15.45:0/710073044 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3646789193 0 0) 0x7f693406f0a0 con 0x7f693415ae20 2023-12-19T17:55:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6931d9b700 1 -- 172.21.15.45:0/710073044 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69200035d0 con 0x7f693415ae20 2023-12-19T17:55:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6932d9d700 1 -- 172.21.15.45:0/710073044 >> v1:172.21.15.73:6789/0 conn(0x7f693406cad0 legacy=0x7f69340af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6932d9d700 1 -- 172.21.15.45:0/710073044 >> v1:172.21.15.45:6789/0 conn(0x7f693415ae20 legacy=0x7f69340c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6932d9d700 1 -- 172.21.15.45:0/710073044 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69340c4240 con 0x7f69340afe30 2023-12-19T17:55:10.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6932d9d700 1 --2- 172.21.15.45:0/710073044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69340afe30 0x7f693415be40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f692c009d90 tx=0x7f692c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df510f4d08508ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6931d9b700 1 -- 172.21.15.45:0/710073044 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c00e070 con 0x7f69340afe30 2023-12-19T17:55:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6931d9b700 1 -- 172.21.15.45:0/710073044 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692c00bb20 con 0x7f69340afe30 2023-12-19T17:55:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f6931d9b700 1 -- 172.21.15.45:0/710073044 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692c012430 con 0x7f69340afe30 2023-12-19T17:55:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 -- 172.21.15.45:0/710073044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69340afe30 msgr2=0x7f693415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 --2- 172.21.15.45:0/710073044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69340afe30 0x7f693415be40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f692c009d90 tx=0x7f692c00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 -- 172.21.15.45:0/710073044 shutdown_connections 2023-12-19T17:55:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 --2- 172.21.15.45:0/710073044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f69340afe30 0x7f693415be40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 -- 172.21.15.45:0/710073044 >> 172.21.15.45:0/710073044 conn(0x7f69340cb900 msgr2=0x7f69340b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 -- 172.21.15.45:0/710073044 shutdown_connections 2023-12-19T17:55:10.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.306+0000 7f693359e700 1 -- 172.21.15.45:0/710073044 wait complete. 2023-12-19T17:55:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 Processor -- start 2023-12-19T17:55:10.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 -- start start 2023-12-19T17:55:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 0x7f6934144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69340afe30 0x7f6934163d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f693415ae20 0x7f69341642a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6934144cb0 con 0x7f693406cad0 2023-12-19T17:55:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6934155db0 con 0x7f693415ae20 2023-12-19T17:55:10.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6934158bc0 con 0x7f69340afe30 2023-12-19T17:55:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 0x7f6934144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 0x7f6934144770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48610/0 (socket says 172.21.15.45:48610) 2023-12-19T17:55:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f693259c700 1 -- 172.21.15.45:0/1321032076 learned_addr learned my addr 172.21.15.45:0/1321032076 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f692bfff700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69340afe30 0x7f6934163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.310+0000 7f6932d9d700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f693415ae20 0x7f69341642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693259c700 1 -- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69340afe30 msgr2=0x7f6934163d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693259c700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69340afe30 0x7f6934163d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693259c700 1 -- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f693415ae20 msgr2=0x7f69341642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693259c700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f693415ae20 0x7f69341642a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693259c700 1 -- 172.21.15.45:0/1321032076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c009a70 con 0x7f693406cad0 2023-12-19T17:55:10.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693259c700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 0x7f6934144770 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f692400c500 tx=0x7f692400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924005d90 con 0x7f693406cad0 2023-12-19T17:55:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692400ce70 con 0x7f693406cad0 2023-12-19T17:55:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240072f0 con 0x7f693406cad0 2023-12-19T17:55:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6934156000 con 0x7f693406cad0 2023-12-19T17:55:10.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6934158850 con 0x7f693406cad0 2023-12-19T17:55:10.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.314+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6934070360 con 0x7f693406cad0 2023-12-19T17:55:10.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.318+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6924007450 con 0x7f693406cad0 2023-12-19T17:55:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.318+0000 7f692affd700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6914065ad0 0x7f6914067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.318+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f6924082460 con 0x7f693406cad0 2023-12-19T17:55:10.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.318+0000 7f692bfff700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6914065ad0 0x7f6914067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.318+0000 7f692bfff700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6914065ad0 0x7f6914067f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f69341f5e00 tx=0x7f691c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:10.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.326+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f692404fec0 con 0x7f693406cad0 2023-12-19T17:55:10.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.582+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files"]} v 0) v1 -- 0x7f6934067760 con 0x7f693406cad0 2023-12-19T17:55:10.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.686+0000 7f692affd700 1 -- 172.21.15.45:0/1321032076 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_few_files"]}]=0 v193) v1 ==== 158+0+0 (secure 0 0 0) 0x7f69240534e0 con 0x7f693406cad0 2023-12-19T17:55:10.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6914065ad0 msgr2=0x7f6914067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6914065ad0 0x7f6914067f90 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f69341f5e00 tx=0x7f691c009040 comp rx=0 tx=0).stop 2023-12-19T17:55:10.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 msgr2=0x7f6934144770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 0x7f6934144770 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f692400c500 tx=0x7f692400c810 comp rx=0 tx=0).stop 2023-12-19T17:55:10.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 shutdown_connections 2023-12-19T17:55:10.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6914065ad0 0x7f6914067f90 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f693415ae20 0x7f69341642a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f69340afe30 0x7f6934163d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 --2- 172.21.15.45:0/1321032076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f693406cad0 0x7f6934144770 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 >> 172.21.15.45:0/1321032076 conn(0x7f69340cb900 msgr2=0x7f69340c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:10.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 shutdown_connections 2023-12-19T17:55:10.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.690+0000 7f693359e700 1 -- 172.21.15.45:0/1321032076 wait complete. 2023-12-19T17:55:10.716 INFO:tasks.cephfs_test_runner:test_extra_data_pool_rebuild_few_files (tasks.cephfs.test_data_scan.TestDataScan) ... ok 2023-12-19T17:55:10.716 INFO:tasks.cephfs_test_runner:Starting test: test_extra_data_pool_rebuild_many_files_many_workers (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T17:55:10.717 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_many_files_many_workers' 2023-12-19T17:55:10.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 Processor -- start 2023-12-19T17:55:10.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 -- start start 2023-12-19T17:55:10.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f428815cff0 0x7f4288161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f428806ddd0 0x7f42880c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42880ca520 0x7f42880c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428815d3d0 con 0x7f428806ddd0 2023-12-19T17:55:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42880c9220 con 0x7f42880ca520 2023-12-19T17:55:10.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428ed77700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880c9500 con 0x7f428815cff0 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428d574700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f428806ddd0 0x7f42880c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428d574700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f428806ddd0 0x7f42880c9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48626/0 (socket says 172.21.15.45:48626) 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.902+0000 7f428d574700 1 -- 172.21.15.45:0/3536055813 learned_addr learned my addr 172.21.15.45:0/3536055813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428d574700 1 -- 172.21.15.45:0/3536055813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f428815cff0 msgr2=0x7f4288161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428d574700 1 --2- 172.21.15.45:0/3536055813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f428815cff0 0x7f4288161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428d574700 1 -- 172.21.15.45:0/3536055813 >> v2:172.21.15.73:3300/0 conn(0x7f42880ca520 msgr2=0x7f42880c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428d574700 1 --2- 172.21.15.45:0/3536055813 >> v2:172.21.15.73:3300/0 conn(0x7f42880ca520 0x7f42880c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428d574700 1 -- 172.21.15.45:0/3536055813 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42880c97e0 con 0x7f428806ddd0 2023-12-19T17:55:10.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428d574700 1 --2- 172.21.15.45:0/3536055813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428806ddd0 0x7f42880c9fe0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f42880cc290 tx=0x7f4278009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2f0a6bf7ef0840 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428cd73700 1 -- 172.21.15.45:0/3536055813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800b8a0 con 0x7f428806ddd0 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428cd73700 1 -- 172.21.15.45:0/3536055813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427800ba00 con 0x7f428806ddd0 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428cd73700 1 -- 172.21.15.45:0/3536055813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427800bd90 con 0x7f428806ddd0 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 -- 172.21.15.45:0/3536055813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428806ddd0 msgr2=0x7f42880c9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 --2- 172.21.15.45:0/3536055813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428806ddd0 0x7f42880c9fe0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f42880cc290 tx=0x7f4278009bf0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 -- 172.21.15.45:0/3536055813 shutdown_connections 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 --2- 172.21.15.45:0/3536055813 >> v2:172.21.15.73:3300/0 conn(0x7f42880ca520 0x7f42880c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 --2- 172.21.15.45:0/3536055813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428806ddd0 0x7f42880c9fe0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 --2- 172.21.15.45:0/3536055813 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f428815cff0 0x7f4288161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 -- 172.21.15.45:0/3536055813 >> 172.21.15.45:0/3536055813 conn(0x7f42880cb900 msgr2=0x7f42880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 -- 172.21.15.45:0/3536055813 shutdown_connections 2023-12-19T17:55:10.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.906+0000 7f428ed77700 1 -- 172.21.15.45:0/3536055813 wait complete. 2023-12-19T17:55:10.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 Processor -- start 2023-12-19T17:55:10.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 -- start start 2023-12-19T17:55:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806ddd0 0x7f42880c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 0x7f428815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42880c63c0 0x7f428815fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b1950 con 0x7f428815cff0 2023-12-19T17:55:10.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428814a930 con 0x7f428806ddd0 2023-12-19T17:55:10.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428ed77700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42880b40c0 con 0x7f42880c63c0 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 0x7f428815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 0x7f428815f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48628/0 (socket says 172.21.15.45:48628) 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 -- 172.21.15.45:0/1319992056 learned_addr learned my addr 172.21.15.45:0/1319992056 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428dd75700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806ddd0 0x7f42880c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428e576700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42880c63c0 0x7f428815fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 -- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42880c63c0 msgr2=0x7f428815fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42880c63c0 0x7f428815fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 -- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806ddd0 msgr2=0x7f42880c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806ddd0 0x7f42880c5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:10.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 -- 172.21.15.45:0/1319992056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4278009570 con 0x7f428815cff0 2023-12-19T17:55:10.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.910+0000 7f428d574700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 0x7f428815f660 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f428806abb0 tx=0x7f4278004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.914+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42780038c0 con 0x7f428815cff0 2023-12-19T17:55:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.914+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f427801f070 con 0x7f428815cff0 2023-12-19T17:55:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.914+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42880b43a0 con 0x7f428815cff0 2023-12-19T17:55:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.914+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4278003c60 con 0x7f428815cff0 2023-12-19T17:55:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.914+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428815f140 con 0x7f428815cff0 2023-12-19T17:55:10.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.914+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428815f330 con 0x7f428815cff0 2023-12-19T17:55:10.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.918+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f427801a430 con 0x7f428815cff0 2023-12-19T17:55:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.918+0000 7f427e7fc700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f426c065ad0 0x7f426c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:10.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.918+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f4278021070 con 0x7f428815cff0 2023-12-19T17:55:10.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.918+0000 7f428dd75700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f426c065ad0 0x7f426c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:10.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.918+0000 7f428dd75700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f426c065ad0 0x7f426c067f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4284006fd0 tx=0x7f4284008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:10.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:10.926+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f42780527c0 con 0x7f428815cff0 2023-12-19T17:55:11.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.166+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_many_files_many_workers"]} v 0) v1 -- 0x7f4288067760 con 0x7f428815cff0 2023-12-19T17:55:11.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.690+0000 7f427e7fc700 1 -- 172.21.15.45:0/1319992056 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_many_files_many_workers"]}]=0 v194) v1 ==== 175+0+0 (secure 0 0 0) 0x7f4278055de0 con 0x7f428815cff0 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f426c065ad0 msgr2=0x7f426c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f426c065ad0 0x7f426c067f90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4284006fd0 tx=0x7f4284008040 comp rx=0 tx=0).stop 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 msgr2=0x7f428815f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 0x7f428815f660 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f428806abb0 tx=0x7f4278004770 comp rx=0 tx=0).stop 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 shutdown_connections 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f426c065ad0 0x7f426c067f90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42880c63c0 0x7f428815fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f428815cff0 0x7f428815f660 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 --2- 172.21.15.45:0/1319992056 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f428806ddd0 0x7f42880c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 >> 172.21.15.45:0/1319992056 conn(0x7f42880cb900 msgr2=0x7f428815c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 shutdown_connections 2023-12-19T17:55:11.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.694+0000 7f428ed77700 1 -- 172.21.15.45:0/1319992056 wait complete. 2023-12-19T17:55:11.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T17:55:11.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.902+0000 7fd0993b3700 1 Processor -- start 2023-12-19T17:55:11.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.902+0000 7fd0993b3700 1 -- start start 2023-12-19T17:55:11.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0993b3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd0940cdfd0 0x7fd094167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:11.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0993b3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd09415d300 con 0x7fd09415cf20 2023-12-19T17:55:11.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0993b3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0940d1550 con 0x7fd0940b8580 2023-12-19T17:55:11.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0993b3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0940d1360 con 0x7fd0940cdfd0 2023-12-19T17:55:11.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd092ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd09415cf20 0x7fd0940d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55914/0 (socket says 172.21.15.45:55914) 2023-12-19T17:55:11.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd092ffd700 1 -- 172.21.15.45:0/1000445567 learned_addr learned my addr 172.21.15.45:0/1000445567 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:11.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0937fe700 1 --2- 172.21.15.45:0/1000445567 >> v2:172.21.15.45:3300/0 conn(0x7fd0940cdfd0 0x7fd094167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:11.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0937fe700 1 -- 172.21.15.45:0/1000445567 >> v1:172.21.15.73:6789/0 conn(0x7fd0940b8580 legacy=0x7fd0940cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0937fe700 1 -- 172.21.15.45:0/1000445567 >> v1:172.21.15.45:6789/0 conn(0x7fd09415cf20 legacy=0x7fd0940d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.906+0000 7fd0937fe700 1 -- 172.21.15.45:0/1000445567 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0940d1830 con 0x7fd0940cdfd0 2023-12-19T17:55:11.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0937fe700 1 --2- 172.21.15.45:0/1000445567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940cdfd0 0x7fd094167a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009d90 tx=0x7fd08c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a78ff6391aa1a11 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:11.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd091ffb700 1 -- 172.21.15.45:0/1000445567 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c00e070 con 0x7fd0940cdfd0 2023-12-19T17:55:11.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd091ffb700 1 -- 172.21.15.45:0/1000445567 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd08c00bbd0 con 0x7fd0940cdfd0 2023-12-19T17:55:11.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd091ffb700 1 -- 172.21.15.45:0/1000445567 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd08c012430 con 0x7fd0940cdfd0 2023-12-19T17:55:11.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 -- 172.21.15.45:0/1000445567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940cdfd0 msgr2=0x7fd094167a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1000445567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940cdfd0 0x7fd094167a30 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fd08c009d90 tx=0x7fd08c00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:11.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 -- 172.21.15.45:0/1000445567 shutdown_connections 2023-12-19T17:55:11.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1000445567 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940cdfd0 0x7fd094167a30 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 -- 172.21.15.45:0/1000445567 >> 172.21.15.45:0/1000445567 conn(0x7fd0940b4670 msgr2=0x7fd0940b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:11.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 -- 172.21.15.45:0/1000445567 shutdown_connections 2023-12-19T17:55:11.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.910+0000 7fd0993b3700 1 -- 172.21.15.45:0/1000445567 wait complete. 2023-12-19T17:55:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 Processor -- start 2023-12-19T17:55:11.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 -- start start 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 0x7fd0941600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0940cdfd0 0x7fd094159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd09415cf20 0x7fd094155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd094156120 con 0x7fd0940b8580 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd09415f050 con 0x7fd0940cdfd0 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd0993b3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd09415f330 con 0x7fd09415cf20 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.914+0000 7fd092ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 0x7fd0941600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 0x7fd0941600f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48638/0 (socket says 172.21.15.45:48638) 2023-12-19T17:55:11.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 -- 172.21.15.45:0/1031687787 learned_addr learned my addr 172.21.15.45:0/1031687787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd0937fe700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd09415cf20 0x7fd094155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd0927fc700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0940cdfd0 0x7fd094159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 -- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd09415cf20 msgr2=0x7fd094155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd09415cf20 0x7fd094155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 -- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0940cdfd0 msgr2=0x7fd094159870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0940cdfd0 0x7fd094159870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 -- 172.21.15.45:0/1031687787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd08c009a70 con 0x7fd0940b8580 2023-12-19T17:55:11.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd092ffd700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 0x7fd0941600f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c460 tx=0x7fd08400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084005d90 con 0x7fd0940b8580 2023-12-19T17:55:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0840070d0 con 0x7fd0940b8580 2023-12-19T17:55:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd09415f610 con 0x7fd0940b8580 2023-12-19T17:55:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd084007460 con 0x7fd0940b8580 2023-12-19T17:55:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd09415fbd0 con 0x7fd0940b8580 2023-12-19T17:55:11.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.918+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd09404ed30 con 0x7fd0940b8580 2023-12-19T17:55:11.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.922+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0840075c0 con 0x7fd0940b8580 2023-12-19T17:55:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.922+0000 7fd07b7fe700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd080065ad0 0x7fd080067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.922+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fd084082650 con 0x7fd0940b8580 2023-12-19T17:55:11.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.922+0000 7fd0927fc700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd080065ad0 0x7fd080067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:11.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.926+0000 7fd0927fc700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd080065ad0 0x7fd080067f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd094159470 tx=0x7fd088009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:11.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:11.930+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd08404ffa0 con 0x7fd0940b8580 2023-12-19T17:55:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.106+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd0940ccf40 con 0x7fd0940b8580 2023-12-19T17:55:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.114+0000 7fd07b7fe700 1 -- 172.21.15.45:0/1031687787 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd0840535c0 con 0x7fd0940b8580 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd080065ad0 msgr2=0x7fd080067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd080065ad0 0x7fd080067f90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd094159470 tx=0x7fd088009040 comp rx=0 tx=0).stop 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 msgr2=0x7fd0941600f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 0x7fd0941600f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd08400c460 tx=0x7fd08400c820 comp rx=0 tx=0).stop 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 shutdown_connections 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd080065ad0 0x7fd080067f90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd09415cf20 0x7fd094155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0940cdfd0 0x7fd094159870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 --2- 172.21.15.45:0/1031687787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd0940b8580 0x7fd0941600f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 >> 172.21.15.45:0/1031687787 conn(0x7fd0940b4670 msgr2=0x7fd0940b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 shutdown_connections 2023-12-19T17:55:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.118+0000 7fd0993b3700 1 -- 172.21.15.45:0/1031687787 wait complete. 2023-12-19T17:55:12.146 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T17:55:12.146 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:55:12.192 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:55:12.234 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T17:55:12.235 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:55:12.235 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:55:12.258 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T17:55:12.259 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:55:12.259 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:55:12.294 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:55:12.294 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:55:12.294 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:55:12.325 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T17:55:12.325 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:55:12.326 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:55:12.359 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:55:12.359 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T17:55:12.359 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.574+0000 7f80e33d2700 1 Processor -- start 2023-12-19T17:55:12.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e33d2700 1 -- start start 2023-12-19T17:55:12.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e33d2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80dc06ea90 0x7f80dc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:12.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e33d2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80dc06fe80 0x7f80dc0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:12.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e33d2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80dc0d1820 con 0x7f80dc0b88b0 2023-12-19T17:55:12.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e33d2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0d1b00 con 0x7f80dc06ea90 2023-12-19T17:55:12.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e33d2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80dc0d1de0 con 0x7f80dc06fe80 2023-12-19T17:55:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e23d0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80dc06ea90 0x7f80dc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e1bcf700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f80dc0b88b0 0x7f80dc0b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55922/0 (socket says 172.21.15.45:55922) 2023-12-19T17:55:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e1bcf700 1 -- 172.21.15.45:0/1295690272 learned_addr learned my addr 172.21.15.45:0/1295690272 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:12.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.578+0000 7f80e2bd1700 1 --2- 172.21.15.45:0/1295690272 >> v2:172.21.15.73:3300/0 conn(0x7f80dc06fe80 0x7f80dc0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:12.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e13ce700 1 -- 172.21.15.45:0/1295690272 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4108009839 0 0) 0x7f80dc0d1820 con 0x7f80dc0b88b0 2023-12-19T17:55:12.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e23d0700 1 -- 172.21.15.45:0/1295690272 >> v2:172.21.15.73:3300/0 conn(0x7f80dc06fe80 msgr2=0x7f80dc0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:12.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e23d0700 1 --2- 172.21.15.45:0/1295690272 >> v2:172.21.15.73:3300/0 conn(0x7f80dc06fe80 0x7f80dc0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e23d0700 1 -- 172.21.15.45:0/1295690272 >> v1:172.21.15.45:6789/0 conn(0x7f80dc0b88b0 legacy=0x7f80dc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e23d0700 1 -- 172.21.15.45:0/1295690272 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80dc0d20c0 con 0x7f80dc06ea90 2023-12-19T17:55:12.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e23d0700 1 --2- 172.21.15.45:0/1295690272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0d0f20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80dc08bc60 tx=0x7f80d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3e56bd1069707f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:12.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e13ce700 1 -- 172.21.15.45:0/1295690272 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8011830 con 0x7f80dc06ea90 2023-12-19T17:55:12.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e13ce700 1 -- 172.21.15.45:0/1295690272 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d8011990 con 0x7f80dc06ea90 2023-12-19T17:55:12.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e13ce700 1 -- 172.21.15.45:0/1295690272 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8011d20 con 0x7f80dc06ea90 2023-12-19T17:55:12.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 -- 172.21.15.45:0/1295690272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 msgr2=0x7f80dc0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1295690272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0d0f20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f80dc08bc60 tx=0x7f80d8009b30 comp rx=0 tx=0).stop 2023-12-19T17:55:12.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 -- 172.21.15.45:0/1295690272 shutdown_connections 2023-12-19T17:55:12.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1295690272 >> v2:172.21.15.73:3300/0 conn(0x7f80dc06fe80 0x7f80dc0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1295690272 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0d0f20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 -- 172.21.15.45:0/1295690272 >> 172.21.15.45:0/1295690272 conn(0x7f80dc0b46d0 msgr2=0x7f80dc0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:12.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 -- 172.21.15.45:0/1295690272 shutdown_connections 2023-12-19T17:55:12.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.582+0000 7f80e33d2700 1 -- 172.21.15.45:0/1295690272 wait complete. 2023-12-19T17:55:12.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 Processor -- start 2023-12-19T17:55:12.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 -- start start 2023-12-19T17:55:12.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:12.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80dc06fe80 0x7f80dc1f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:12.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80dc0b88b0 0x7f80dc159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:12.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc0ccc60 con 0x7f80dc06ea90 2023-12-19T17:55:12.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc149770 con 0x7f80dc0b88b0 2023-12-19T17:55:12.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e33d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80dc1f2a80 con 0x7f80dc06fe80 2023-12-19T17:55:12.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.586+0000 7f80e23d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:12.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48652/0 (socket says 172.21.15.45:48652) 2023-12-19T17:55:12.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 -- 172.21.15.45:0/1372418878 learned_addr learned my addr 172.21.15.45:0/1372418878 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:12.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e1bcf700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80dc06fe80 0x7f80dc1f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:12.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e2bd1700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80dc0b88b0 0x7f80dc159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 -- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80dc06fe80 msgr2=0x7f80dc1f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80dc06fe80 0x7f80dc1f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 -- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80dc0b88b0 msgr2=0x7f80dc159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80dc0b88b0 0x7f80dc159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 -- 172.21.15.45:0/1372418878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d80094b0 con 0x7f80dc06ea90 2023-12-19T17:55:12.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e23d0700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0ca910 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80d8014040 tx=0x7f80d8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d8004610 con 0x7f80dc06ea90 2023-12-19T17:55:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80d801e070 con 0x7f80dc06ea90 2023-12-19T17:55:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80d80038e0 con 0x7f80dc06ea90 2023-12-19T17:55:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80dc156e10 con 0x7f80dc06ea90 2023-12-19T17:55:12.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80dc0ca110 con 0x7f80dc06ea90 2023-12-19T17:55:12.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.590+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80dc0c9c90 con 0x7f80dc06ea90 2023-12-19T17:55:12.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.594+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80d8003a40 con 0x7f80dc06ea90 2023-12-19T17:55:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.594+0000 7f80d2ffd700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80c0065ad0 0x7f80c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.594+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f80d8083ea0 con 0x7f80dc06ea90 2023-12-19T17:55:12.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.594+0000 7f80e1bcf700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80c0065ad0 0x7f80c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:12.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.598+0000 7f80e1bcf700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80c0065ad0 0x7f80c0067f90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f80dc157440 tx=0x7f80cc007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:12.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.602+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80dc0c9c90 con 0x7f80dc06ea90 2023-12-19T17:55:12.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.814+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80dc0c9c90 con 0x7f80dc06ea90 2023-12-19T17:55:12.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80d2ffd700 1 -- 172.21.15.45:0/1372418878 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+3527 (secure 0 0 0) 0x7f80dc0c9c90 con 0x7f80dc06ea90 2023-12-19T17:55:12.820 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:12.820 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":31,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5869,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/662383788","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":662383788},{"type":"v1","addr":"172.21.15.73:6833","nonce":662383788}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5949,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2130056318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2130056318},{"type":"v1","addr":"172.21.15.45:6835","nonce":2130056318}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5961,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2260120300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":2260120300},{"type":"v1","addr":"172.21.15.45:6837","nonce":2260120300}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":55562,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/2590863968","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2590863968},{"type":"v1","addr":"172.21.15.73:6835","nonce":2590863968}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":31}],"filesystems":[]} 2023-12-19T17:55:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80c0065ad0 msgr2=0x7f80c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80c0065ad0 0x7f80c0067f90 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f80dc157440 tx=0x7f80cc007e90 comp rx=0 tx=0).stop 2023-12-19T17:55:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 msgr2=0x7f80dc0ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0ca910 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f80d8014040 tx=0x7f80d8004770 comp rx=0 tx=0).stop 2023-12-19T17:55:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 shutdown_connections 2023-12-19T17:55:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80c0065ad0 0x7f80c0067f90 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80dc0b88b0 0x7f80dc159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80dc06fe80 0x7f80dc1f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 --2- 172.21.15.45:0/1372418878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80dc06ea90 0x7f80dc0ca910 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:12.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 >> 172.21.15.45:0/1372418878 conn(0x7f80dc0b46d0 msgr2=0x7f80dc070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:12.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 shutdown_connections 2023-12-19T17:55:12.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:12.818+0000 7f80e33d2700 1 -- 172.21.15.45:0/1372418878 wait complete. 2023-12-19T17:55:12.824 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 31 2023-12-19T17:55:12.844 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T17:55:12.844 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T17:55:12.844 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T17:55:12.844 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:55:12.844 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T17:55:12.845 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T17:55:12.845 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T17:55:12.845 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:55:12.845 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T17:55:12.845 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T17:55:12.845 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T17:55:12.845 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:55:12.846 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T17:55:12.846 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T17:55:12.846 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T17:55:12.846 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:55:12.867 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T17:55:12.867 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T17:55:12.868 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T17:55:12.868 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T17:55:12.870 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T17:55:12.870 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T17:55:12.872 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T17:55:12.872 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T17:55:12.918 INFO:tasks.ceph.mds.b:Started 2023-12-19T17:55:12.919 DEBUG:teuthology.parallel:result is None 2023-12-19T17:55:12.920 INFO:tasks.ceph.mds.c:Started 2023-12-19T17:55:12.921 DEBUG:teuthology.parallel:result is None 2023-12-19T17:55:12.922 INFO:tasks.ceph.mds.d:Started 2023-12-19T17:55:12.922 DEBUG:teuthology.parallel:result is None 2023-12-19T17:55:12.926 INFO:tasks.ceph.mds.a:Started 2023-12-19T17:55:12.927 DEBUG:teuthology.parallel:result is None 2023-12-19T17:55:12.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T17:55:13.041 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T17:55:13.042 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:55:13.048 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:55:13.053 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:55:13.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.094+0000 7f2bd4911700 1 Processor -- start 2023-12-19T17:55:13.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.094+0000 7f2bd4911700 1 -- start start 2023-12-19T17:55:13.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bd4911700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 0x7f2bd00c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:13.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bd4911700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bd00af720 0x7f2bd00afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:13.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bd4911700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd00c3c50 con 0x7f2bd015e450 2023-12-19T17:55:13.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bd4911700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd0070540 con 0x7f2bd00af720 2023-12-19T17:55:13.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bd4911700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00b0110 con 0x7f2bd0159a50 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 0x7f2bd00c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bcf59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2bd00af720 0x7f2bd00afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 0x7f2bd00c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:51530/0 (socket says 172.21.15.45:51530) 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 -- 172.21.15.45:0/1167012356 learned_addr learned my addr 172.21.15.45:0/1167012356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bce59c700 1 --1- 172.21.15.45:0/1167012356 >> v1:172.21.15.73:6789/0 conn(0x7f2bd015e450 0x7f2bd006fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56690/0 (socket says 172.21.15.45:56690) 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 -- 172.21.15.45:0/1167012356 >> v2:172.21.15.45:3300/0 conn(0x7f2bd00af720 msgr2=0x7f2bd00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 --2- 172.21.15.45:0/1167012356 >> v2:172.21.15.45:3300/0 conn(0x7f2bd00af720 0x7f2bd00afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 -- 172.21.15.45:0/1167012356 >> v1:172.21.15.73:6789/0 conn(0x7f2bd015e450 legacy=0x7f2bd006fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 -- 172.21.15.45:0/1167012356 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd00702b0 con 0x7f2bd0159a50 2023-12-19T17:55:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bcdd9b700 1 -- 172.21.15.45:0/1167012356 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1816490295 0 0) 0x7f2bd00c3c50 con 0x7f2bd015e450 2023-12-19T17:55:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bced9d700 1 --2- 172.21.15.45:0/1167012356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 0x7f2bd00c3710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009910 tx=0x7f2bc0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d47467217a6f5e99 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bcdd9b700 1 -- 172.21.15.45:0/1167012356 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011830 con 0x7f2bd0159a50 2023-12-19T17:55:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bcdd9b700 1 -- 172.21.15.45:0/1167012356 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc0011990 con 0x7f2bd0159a50 2023-12-19T17:55:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.098+0000 7f2bcdd9b700 1 -- 172.21.15.45:0/1167012356 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc0011d40 con 0x7f2bd0159a50 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 -- 172.21.15.45:0/1167012356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 msgr2=0x7f2bd00c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 --2- 172.21.15.45:0/1167012356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 0x7f2bd00c3710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0009910 tx=0x7f2bc0009c20 comp rx=0 tx=0).stop 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 -- 172.21.15.45:0/1167012356 shutdown_connections 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 --2- 172.21.15.45:0/1167012356 >> v2:172.21.15.45:3300/0 conn(0x7f2bd00af720 0x7f2bd00afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 --2- 172.21.15.45:0/1167012356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd0159a50 0x7f2bd00c3710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 -- 172.21.15.45:0/1167012356 >> 172.21.15.45:0/1167012356 conn(0x7f2bd00cb900 msgr2=0x7f2bd00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:13.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 -- 172.21.15.45:0/1167012356 shutdown_connections 2023-12-19T17:55:13.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 -- 172.21.15.45:0/1167012356 wait complete. 2023-12-19T17:55:13.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 Processor -- start 2023-12-19T17:55:13.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.102+0000 7f2bd4911700 1 -- start start 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 0x7f2bd00ac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bd0159a50 0x7f2bd014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd015e450 0x7f2bd01f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd00acf20 con 0x7f2bd00af720 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd014e8e0 con 0x7f2bd0159a50 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd01f6500 con 0x7f2bd015e450 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 0x7f2bd00ac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 0x7f2bd00ac9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48696/0 (socket says 172.21.15.45:48696) 2023-12-19T17:55:13.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 -- 172.21.15.45:0/4234252705 learned_addr learned my addr 172.21.15.45:0/4234252705 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bce59c700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bd0159a50 0x7f2bd014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:13.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bcf59e700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd015e450 0x7f2bd01f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 -- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd015e450 msgr2=0x7f2bd01f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd015e450 0x7f2bd01f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 -- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bd0159a50 msgr2=0x7f2bd014e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bd0159a50 0x7f2bd014e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 -- 172.21.15.45:0/4234252705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0009570 con 0x7f2bd00af720 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bcf59e700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd015e450 0x7f2bd01f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bced9d700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 0x7f2bd00ac9e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0011db0 tx=0x7f2bc0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000b970 con 0x7f2bd00af720 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc001f070 con 0x7f2bd00af720 2023-12-19T17:55:13.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc000bd30 con 0x7f2bd00af720 2023-12-19T17:55:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd01f67e0 con 0x7f2bd00af720 2023-12-19T17:55:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.106+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd00c5930 con 0x7f2bd00af720 2023-12-19T17:55:13.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.110+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd0067760 con 0x7f2bd00af720 2023-12-19T17:55:13.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.110+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2bc0026480 con 0x7f2bd00af720 2023-12-19T17:55:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.110+0000 7f2bb77fe700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bbc065ad0 0x7f2bbc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.114+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f2bc0021070 con 0x7f2bd00af720 2023-12-19T17:55:13.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.114+0000 7f2bce59c700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bbc065ad0 0x7f2bbc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:13.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.114+0000 7f2bce59c700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bbc065ad0 0x7f2bbc067f90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2bd01f6d20 tx=0x7f2bc4007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:13.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.118+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2bc0052460 con 0x7f2bd00af720 2023-12-19T17:55:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:13.298+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2bd00b0c40 con 0x7f2bd00af720 2023-12-19T17:55:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.126+0000 7f2bb77fe700 1 -- 172.21.15.45:0/4234252705 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2bc0006da0 con 0x7f2bd00af720 2023-12-19T17:55:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bbc065ad0 msgr2=0x7f2bbc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bbc065ad0 0x7f2bbc067f90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f2bd01f6d20 tx=0x7f2bc4007e90 comp rx=0 tx=0).stop 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 msgr2=0x7f2bd00ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 0x7f2bd00ac9e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f2bc0011db0 tx=0x7f2bc0004770 comp rx=0 tx=0).stop 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 shutdown_connections 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2bbc065ad0 0x7f2bbc067f90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2bd015e450 0x7f2bd01f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bd0159a50 0x7f2bd014e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 --2- 172.21.15.45:0/4234252705 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2bd00af720 0x7f2bd00ac9e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 >> 172.21.15.45:0/4234252705 conn(0x7f2bd00cb900 msgr2=0x7f2bd00c3e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 shutdown_connections 2023-12-19T17:55:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.130+0000 7f2bd4911700 1 -- 172.21.15.45:0/4234252705 wait complete. 2023-12-19T17:55:14.137 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-19T17:55:14.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T17:55:14.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.342+0000 7f837917d700 1 Processor -- start 2023-12-19T17:55:14.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f837917d700 1 -- start start 2023-12-19T17:55:14.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f837917d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83740cd480 0x7f837406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f837917d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837406cbb0 con 0x7f837415af30 2023-12-19T17:55:14.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f837917d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837406fa10 con 0x7f837415ab50 2023-12-19T17:55:14.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f837917d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837406fcf0 con 0x7f83740cd480 2023-12-19T17:55:14.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f8372d9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f837415ab50 0x7f83740ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56694/0 (socket says 172.21.15.45:56694) 2023-12-19T17:55:14.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f8372d9d700 1 -- 172.21.15.45:0/553839874 learned_addr learned my addr 172.21.15.45:0/553839874 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:14.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f837359e700 1 --1- 172.21.15.45:0/553839874 >> v1:172.21.15.45:6789/0 conn(0x7f837415af30 0x7f837406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55938/0 (socket says 172.21.15.45:55938) 2023-12-19T17:55:14.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.346+0000 7f836bfff700 1 --2- 172.21.15.45:0/553839874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83740cd480 0x7f837406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f836bfff700 1 -- 172.21.15.45:0/553839874 >> v1:172.21.15.73:6789/0 conn(0x7f837415ab50 legacy=0x7f83740ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837259c700 1 -- 172.21.15.45:0/553839874 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2318980755 0 0) 0x7f837406fa10 con 0x7f837415ab50 2023-12-19T17:55:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f836bfff700 1 -- 172.21.15.45:0/553839874 >> v1:172.21.15.45:6789/0 conn(0x7f837415af30 legacy=0x7f837406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f836bfff700 1 -- 172.21.15.45:0/553839874 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837406ffd0 con 0x7f83740cd480 2023-12-19T17:55:14.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f836bfff700 1 --2- 172.21.15.45:0/553839874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83740cd480 0x7f837406d090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f835c009880 tx=0x7f835c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da0b06692b7b4725 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:14.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837259c700 1 -- 172.21.15.45:0/553839874 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c011830 con 0x7f83740cd480 2023-12-19T17:55:14.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837259c700 1 -- 172.21.15.45:0/553839874 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c011990 con 0x7f83740cd480 2023-12-19T17:55:14.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837259c700 1 -- 172.21.15.45:0/553839874 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c011d20 con 0x7f83740cd480 2023-12-19T17:55:14.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 -- 172.21.15.45:0/553839874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83740cd480 msgr2=0x7f837406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 --2- 172.21.15.45:0/553839874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83740cd480 0x7f837406d090 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f835c009880 tx=0x7f835c009b90 comp rx=0 tx=0).stop 2023-12-19T17:55:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 -- 172.21.15.45:0/553839874 shutdown_connections 2023-12-19T17:55:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 --2- 172.21.15.45:0/553839874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83740cd480 0x7f837406d090 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 -- 172.21.15.45:0/553839874 >> 172.21.15.45:0/553839874 conn(0x7f83740cba40 msgr2=0x7f83740ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 -- 172.21.15.45:0/553839874 shutdown_connections 2023-12-19T17:55:14.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.350+0000 7f837917d700 1 -- 172.21.15.45:0/553839874 wait complete. 2023-12-19T17:55:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 Processor -- start 2023-12-19T17:55:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 -- start start 2023-12-19T17:55:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83740cd480 0x7f83740c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 0x7f8374155050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f837415af30 0x7f83740ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740c3880 con 0x7f837415ab50 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83740c7e30 con 0x7f83740cd480 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.354+0000 7f837917d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83740c8110 con 0x7f837415af30 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 0x7f8374155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 0x7f8374155050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48706/0 (socket says 172.21.15.45:48706) 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 -- 172.21.15.45:0/3993787220 learned_addr learned my addr 172.21.15.45:0/3993787220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f8372d9d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83740cd480 0x7f83740c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f837359e700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f837415af30 0x7f83740ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 -- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f837415af30 msgr2=0x7f83740ab8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f837415af30 0x7f83740ab8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 -- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83740cd480 msgr2=0x7f83740c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83740cd480 0x7f83740c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 -- 172.21.15.45:0/3993787220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f835c0094b0 con 0x7f837415ab50 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836bfff700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 0x7f8374155050 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f835c0090b0 tx=0x7f835c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00bab0 con 0x7f837415ab50 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f835c01f070 con 0x7f837415ab50 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f835c00be10 con 0x7f837415ab50 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83740c83f0 con 0x7f837415ab50 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.358+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83740c7b00 con 0x7f837415ab50 2023-12-19T17:55:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.362+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83740c39c0 con 0x7f837415ab50 2023-12-19T17:55:14.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.362+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f835c01a430 con 0x7f837415ab50 2023-12-19T17:55:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.362+0000 7f836b7fe700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8354065ad0 0x7f8354067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.362+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f835c021070 con 0x7f837415ab50 2023-12-19T17:55:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.366+0000 7f8372d9d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8354065ad0 0x7f8354067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.366+0000 7f8372d9d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8354065ad0 0x7f8354067f90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8364000f60 tx=0x7f8364007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:14.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.370+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f83740c39c0 con 0x7f837415ab50 2023-12-19T17:55:14.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.610+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f83740c39c0 con 0x7f837415ab50 2023-12-19T17:55:14.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.610+0000 7f836b7fe700 1 -- 172.21.15.45:0/3993787220 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f83740c39c0 con 0x7f837415ab50 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A==", 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.614 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg==", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA==", 2023-12-19T17:55:14.615 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ==", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.616 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg==", 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.617 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA==", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w==", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.618 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ==", 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg==", 2023-12-19T17:55:14.619 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA==", 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.620 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w==", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA==", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:55:14.621 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA==", 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A==", 2023-12-19T17:55:14.622 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ==", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:55:14.623 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ==", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl3IfBDBAAsKhx3aytTBDBVKorcbcCHw==", 2023-12-19T17:55:14.624 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA==", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.625 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q==", 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-19T17:55:14.626 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8354065ad0 msgr2=0x7f8354067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8354065ad0 0x7f8354067f90 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f8364000f60 tx=0x7f8364007e00 comp rx=0 tx=0).stop 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 msgr2=0x7f8374155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 0x7f8374155050 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f835c0090b0 tx=0x7f835c004770 comp rx=0 tx=0).stop 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 shutdown_connections 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8354065ad0 0x7f8354067f90 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f837415af30 0x7f83740ab8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f837415ab50 0x7f8374155050 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 --2- 172.21.15.45:0/3993787220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83740cd480 0x7f83740c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 >> 172.21.15.45:0/3993787220 conn(0x7f83740cba40 msgr2=0x7f837406ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 shutdown_connections 2023-12-19T17:55:14.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.614+0000 7f837917d700 1 -- 172.21.15.45:0/3993787220 wait complete. 2023-12-19T17:55:14.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.818+0000 7f2aeb4d8700 1 Processor -- start 2023-12-19T17:55:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.818+0000 7f2aeb4d8700 1 -- start start 2023-12-19T17:55:14.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeb4d8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2ae41611c0 0x7f2ae40c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeb4d8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ae41615a0 0x7f2ae406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeb4d8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae406dc80 con 0x7f2ae40af720 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeb4d8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae4070340 con 0x7f2ae41615a0 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeb4d8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ae40c3f90 con 0x7f2ae41611c0 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae9cd5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2ae41615a0 0x7f2ae406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeacd7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2ae40af720 0x7f2ae4164f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55948/0 (socket says 172.21.15.45:55948) 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aeacd7700 1 -- 172.21.15.45:0/2087914812 learned_addr learned my addr 172.21.15.45:0/2087914812 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:14.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aea4d6700 1 --2- 172.21.15.45:0/2087914812 >> v2:172.21.15.73:3300/0 conn(0x7f2ae41611c0 0x7f2ae40c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae94d4700 1 -- 172.21.15.45:0/2087914812 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1526440303 0 0) 0x7f2ae406dc80 con 0x7f2ae40af720 2023-12-19T17:55:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae94d4700 1 -- 172.21.15.45:0/2087914812 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ad00035d0 con 0x7f2ae40af720 2023-12-19T17:55:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aea4d6700 1 -- 172.21.15.45:0/2087914812 >> v2:172.21.15.45:3300/0 conn(0x7f2ae41615a0 msgr2=0x7f2ae406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aea4d6700 1 --2- 172.21.15.45:0/2087914812 >> v2:172.21.15.45:3300/0 conn(0x7f2ae41615a0 0x7f2ae406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aea4d6700 1 -- 172.21.15.45:0/2087914812 >> v1:172.21.15.45:6789/0 conn(0x7f2ae40af720 legacy=0x7f2ae4164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aea4d6700 1 -- 172.21.15.45:0/2087914812 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40c4270 con 0x7f2ae41611c0 2023-12-19T17:55:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae9cd5700 1 --2- 172.21.15.45:0/2087914812 >> v2:172.21.15.45:3300/0 conn(0x7f2ae41615a0 0x7f2ae406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2aea4d6700 1 --2- 172.21.15.45:0/2087914812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae40c3920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4072080 tx=0x7f2ae0009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dad0e08da34d03fd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae94d4700 1 -- 172.21.15.45:0/2087914812 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011830 con 0x7f2ae41611c0 2023-12-19T17:55:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae94d4700 1 -- 172.21.15.45:0/2087914812 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae0011990 con 0x7f2ae41611c0 2023-12-19T17:55:14.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.822+0000 7f2ae94d4700 1 -- 172.21.15.45:0/2087914812 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0011d20 con 0x7f2ae41611c0 2023-12-19T17:55:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/2087914812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 msgr2=0x7f2ae40c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/2087914812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae40c3920 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4072080 tx=0x7f2ae0009b30 comp rx=0 tx=0).stop 2023-12-19T17:55:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/2087914812 shutdown_connections 2023-12-19T17:55:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/2087914812 >> v2:172.21.15.45:3300/0 conn(0x7f2ae41615a0 0x7f2ae406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/2087914812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae40c3920 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/2087914812 >> 172.21.15.45:0/2087914812 conn(0x7f2ae40cb900 msgr2=0x7f2ae40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/2087914812 shutdown_connections 2023-12-19T17:55:14.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.826+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/2087914812 wait complete. 2023-12-19T17:55:14.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 Processor -- start 2023-12-19T17:55:14.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 -- start start 2023-12-19T17:55:14.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 0x7f2ae41563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae415dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ae41615a0 0x7f2ae40b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae40c8380 con 0x7f2ae40af720 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae40c7490 con 0x7f2ae41611c0 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeb4d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae40c7770 con 0x7f2ae41615a0 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aea4d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 0x7f2ae41563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aea4d6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 0x7f2ae41563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48732/0 (socket says 172.21.15.45:48732) 2023-12-19T17:55:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aea4d6700 1 -- 172.21.15.45:0/1462412768 learned_addr learned my addr 172.21.15.45:0/1462412768 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2ae9cd5700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae415dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.830+0000 7f2aeacd7700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ae41615a0 0x7f2ae40b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aea4d6700 1 -- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ae41615a0 msgr2=0x7f2ae40b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aea4d6700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ae41615a0 0x7f2ae40b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aea4d6700 1 -- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 msgr2=0x7f2ae415dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aea4d6700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae415dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aea4d6700 1 -- 172.21.15.45:0/1462412768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad40094b0 con 0x7f2ae40af720 2023-12-19T17:55:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aea4d6700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 0x7f2ae41563c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009b70 tx=0x7f2ae0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae0004380 con 0x7f2ae40af720 2023-12-19T17:55:14.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae001f070 con 0x7f2ae40af720 2023-12-19T17:55:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae00094b0 con 0x7f2ae40af720 2023-12-19T17:55:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae00036c0 con 0x7f2ae40af720 2023-12-19T17:55:14.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae40c7d30 con 0x7f2ae40af720 2023-12-19T17:55:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae406e760 con 0x7f2ae40af720 2023-12-19T17:55:14.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.834+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ae0021030 con 0x7f2ae40af720 2023-12-19T17:55:14.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.838+0000 7f2adaffd700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ac8065ad0 0x7f2ac8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.838+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2ae00842d0 con 0x7f2ae40af720 2023-12-19T17:55:14.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.838+0000 7f2ae9cd5700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ac8065ad0 0x7f2ac8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:14.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.838+0000 7f2ae9cd5700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ac8065ad0 0x7f2ac8067f90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4160720 tx=0x7f2ad4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:14.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:14.846+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2ae0051f30 con 0x7f2ae40af720 2023-12-19T17:55:15.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.022+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ae4067760 con 0x7f2ae40af720 2023-12-19T17:55:15.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.022+0000 7f2adaffd700 1 -- 172.21.15.45:0/1462412768 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+12546 (secure 0 0 0) 0x7f2ae0055550 con 0x7f2ae40af720 2023-12-19T17:55:15.027 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:15.027 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":59,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:14.119563+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:15.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ac8065ad0 msgr2=0x7f2ac8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ac8065ad0 0x7f2ac8067f90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4160720 tx=0x7f2ad4009240 comp rx=0 tx=0).stop 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 msgr2=0x7f2ae41563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 0x7f2ae41563c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f2ae0009b70 tx=0x7f2ae0004770 comp rx=0 tx=0).stop 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 shutdown_connections 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ac8065ad0 0x7f2ac8067f90 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ae41615a0 0x7f2ae40b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ae41611c0 0x7f2ae415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 --2- 172.21.15.45:0/1462412768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ae40af720 0x7f2ae41563c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 >> 172.21.15.45:0/1462412768 conn(0x7f2ae40cb900 msgr2=0x7f2ae40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 shutdown_connections 2023-12-19T17:55:15.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.030+0000 7f2aeb4d8700 1 -- 172.21.15.45:0/1462412768 wait complete. 2023-12-19T17:55:15.054 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:55:15.054 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:55:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.234+0000 7ff154a9b700 1 Processor -- start 2023-12-19T17:55:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.234+0000 7ff154a9b700 1 -- start start 2023-12-19T17:55:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1500cb8d0 0x7ff15015b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500ce350 0x7ff15006d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15006ea90 con 0x7ff1500cc690 2023-12-19T17:55:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15015c340 con 0x7ff1500cb8d0 2023-12-19T17:55:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff15015baa0 con 0x7ff1500ce350 2023-12-19T17:55:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1500cb8d0 0x7ff15015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff1500cb8d0 0x7ff15015b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48742/0 (socket says 172.21.15.45:48742) 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 -- 172.21.15.45:0/3155309038 learned_addr learned my addr 172.21.15.45:0/3155309038 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff14ed9d700 1 --2- 172.21.15.45:0/3155309038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500ce350 0x7ff15006d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 -- 172.21.15.45:0/3155309038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500ce350 msgr2=0x7ff15006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 --2- 172.21.15.45:0/3155309038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500ce350 0x7ff15006d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 -- 172.21.15.45:0/3155309038 >> v1:172.21.15.73:6789/0 conn(0x7ff1500cc690 legacy=0x7ff1500cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 -- 172.21.15.45:0/3155309038 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15015bd80 con 0x7ff1500cb8d0 2023-12-19T17:55:15.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff147fff700 1 --2- 172.21.15.45:0/3155309038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cb8d0 0x7ff15015b410 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff138009910 tx=0x7ff138009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc23b0ab45d17ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:15.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff14dd9b700 1 -- 172.21.15.45:0/3155309038 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800ba60 con 0x7ff1500cb8d0 2023-12-19T17:55:15.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff14dd9b700 1 -- 172.21.15.45:0/3155309038 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800bbc0 con 0x7ff1500cb8d0 2023-12-19T17:55:15.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff14dd9b700 1 -- 172.21.15.45:0/3155309038 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138009e60 con 0x7ff1500cb8d0 2023-12-19T17:55:15.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- 172.21.15.45:0/3155309038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cb8d0 msgr2=0x7ff15015b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 --2- 172.21.15.45:0/3155309038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cb8d0 0x7ff15015b410 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff138009910 tx=0x7ff138009c20 comp rx=0 tx=0).stop 2023-12-19T17:55:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- 172.21.15.45:0/3155309038 shutdown_connections 2023-12-19T17:55:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 --2- 172.21.15.45:0/3155309038 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500ce350 0x7ff15006d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 --2- 172.21.15.45:0/3155309038 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cb8d0 0x7ff15015b410 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- 172.21.15.45:0/3155309038 >> 172.21.15.45:0/3155309038 conn(0x7ff150071990 msgr2=0x7ff1500b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- 172.21.15.45:0/3155309038 shutdown_connections 2023-12-19T17:55:15.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.238+0000 7ff154a9b700 1 -- 172.21.15.45:0/3155309038 wait complete. 2023-12-19T17:55:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.242+0000 7ff154a9b700 1 Processor -- start 2023-12-19T17:55:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 -- start start 2023-12-19T17:55:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500cb8d0 0x7ff1501f6720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 0x7ff1501f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1500ce350 0x7ff150151010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1501f6c60 con 0x7ff1500cc690 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1501f25b0 con 0x7ff1500ce350 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff154a9b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff150151550 con 0x7ff1500cb8d0 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 0x7ff1501f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 0x7ff1501f2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48746/0 (socket says 172.21.15.45:48746) 2023-12-19T17:55:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 -- 172.21.15.45:0/2182003113 learned_addr learned my addr 172.21.15.45:0/2182003113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff14e59c700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500cb8d0 0x7ff1501f6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff14ed9d700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1500ce350 0x7ff150151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 -- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500cb8d0 msgr2=0x7ff1501f6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500cb8d0 0x7ff1501f6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 -- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1500ce350 msgr2=0x7ff150151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1500ce350 0x7ff150151010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 -- 172.21.15.45:0/2182003113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff138009570 con 0x7ff1500cc690 2023-12-19T17:55:15.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.246+0000 7ff147fff700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 0x7ff1501f2070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff15006ec40 tx=0x7ff138004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:15.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138004510 con 0x7ff1500cc690 2023-12-19T17:55:15.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13801f070 con 0x7ff1500cc690 2023-12-19T17:55:15.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138003900 con 0x7ff1500cc690 2023-12-19T17:55:15.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15015b620 con 0x7ff1500cc690 2023-12-19T17:55:15.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff150159280 con 0x7ff1500cc690 2023-12-19T17:55:15.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15004ed30 con 0x7ff1500cc690 2023-12-19T17:55:15.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.250+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff138003a60 con 0x7ff1500cc690 2023-12-19T17:55:15.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.254+0000 7ff146ffd700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff130065ad0 0x7ff130067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.254+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff138021070 con 0x7ff1500cc690 2023-12-19T17:55:15.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.254+0000 7ff14e59c700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff130065ad0 0x7ff130067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.254+0000 7ff14e59c700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff130065ad0 0x7ff130067f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff140000f60 tx=0x7ff140009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:15.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.262+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff1380522a0 con 0x7ff1500cc690 2023-12-19T17:55:15.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff1500ade70 con 0x7ff1500cc690 2023-12-19T17:55:15.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff146ffd700 1 -- 172.21.15.45:0/2182003113 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff13802b020 con 0x7ff1500cc690 2023-12-19T17:55:15.443 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:55:15.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff130065ad0 msgr2=0x7ff130067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff130065ad0 0x7ff130067f90 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff140000f60 tx=0x7ff140009040 comp rx=0 tx=0).stop 2023-12-19T17:55:15.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 msgr2=0x7ff1501f2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 0x7ff1501f2070 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ff15006ec40 tx=0x7ff138004770 comp rx=0 tx=0).stop 2023-12-19T17:55:15.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 shutdown_connections 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff130065ad0 0x7ff130067f90 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1500ce350 0x7ff150151010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff1500cc690 0x7ff1501f2070 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 --2- 172.21.15.45:0/2182003113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff1500cb8d0 0x7ff1501f6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.438+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 >> 172.21.15.45:0/2182003113 conn(0x7ff150071990 msgr2=0x7ff150153550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.442+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 shutdown_connections 2023-12-19T17:55:15.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.442+0000 7ff154a9b700 1 -- 172.21.15.45:0/2182003113 wait complete. 2023-12-19T17:55:15.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T17:55:15.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.638+0000 7f346b2c4700 1 Processor -- start 2023-12-19T17:55:15.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.642+0000 7f346b2c4700 1 -- start start 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.642+0000 7f346b2c4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34641591b0 0x7f346406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.642+0000 7f346b2c4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640c4120 0x7f34640c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640c3e20 con 0x7f3464159590 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640cadb0 con 0x7f34641591b0 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c4ae0 con 0x7f34640c4120 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34641591b0 0x7f346406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f34641591b0 0x7f346406ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48760/0 (socket says 172.21.15.45:48760) 2023-12-19T17:55:15.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 -- 172.21.15.45:0/1010938911 learned_addr learned my addr 172.21.15.45:0/1010938911 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:15.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346aac3700 1 --2- 172.21.15.45:0/1010938911 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640c4120 0x7f34640c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 -- 172.21.15.45:0/1010938911 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640c4120 msgr2=0x7f34640c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:15.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 --2- 172.21.15.45:0/1010938911 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640c4120 0x7f34640c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 -- 172.21.15.45:0/1010938911 >> v1:172.21.15.73:6789/0 conn(0x7f3464159590 legacy=0x7f34640c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 -- 172.21.15.45:0/1010938911 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640ca7f0 con 0x7f34641591b0 2023-12-19T17:55:15.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346a2c2700 1 --2- 172.21.15.45:0/1010938911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34641591b0 0x7f346406ea90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3460009e50 tx=0x7f346000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509f35fec6a87202 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:15.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f34692c0700 1 -- 172.21.15.45:0/1010938911 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000e070 con 0x7f34641591b0 2023-12-19T17:55:15.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f34692c0700 1 -- 172.21.15.45:0/1010938911 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f346000b9c0 con 0x7f34641591b0 2023-12-19T17:55:15.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f34692c0700 1 -- 172.21.15.45:0/1010938911 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346000bd70 con 0x7f34641591b0 2023-12-19T17:55:15.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 -- 172.21.15.45:0/1010938911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34641591b0 msgr2=0x7f346406ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 --2- 172.21.15.45:0/1010938911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34641591b0 0x7f346406ea90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3460009e50 tx=0x7f346000b330 comp rx=0 tx=0).stop 2023-12-19T17:55:15.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 -- 172.21.15.45:0/1010938911 shutdown_connections 2023-12-19T17:55:15.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 --2- 172.21.15.45:0/1010938911 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640c4120 0x7f34640c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 --2- 172.21.15.45:0/1010938911 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34641591b0 0x7f346406ea90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.646+0000 7f346b2c4700 1 -- 172.21.15.45:0/1010938911 >> 172.21.15.45:0/1010938911 conn(0x7f34640cb900 msgr2=0x7f34640b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:15.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 -- 172.21.15.45:0/1010938911 shutdown_connections 2023-12-19T17:55:15.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 -- 172.21.15.45:0/1010938911 wait complete. 2023-12-19T17:55:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 Processor -- start 2023-12-19T17:55:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 -- start start 2023-12-19T17:55:15.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 0x7f34640b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641591b0 0x7f346414bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640b2500 0x7f34641f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640b20e0 con 0x7f34640c4120 2023-12-19T17:55:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c5d50 con 0x7f34641591b0 2023-12-19T17:55:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346b2c4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640c8870 con 0x7f34640b2500 2023-12-19T17:55:15.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346a2c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 0x7f34640b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.650+0000 7f346a2c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 0x7f34640b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48774/0 (socket says 172.21.15.45:48774) 2023-12-19T17:55:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346aac3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640b2500 0x7f34641f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 -- 172.21.15.45:0/2216244128 learned_addr learned my addr 172.21.15.45:0/2216244128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f3469ac1700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641591b0 0x7f346414bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 -- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640b2500 msgr2=0x7f34641f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640b2500 0x7f34641f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 -- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641591b0 msgr2=0x7f346414bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641591b0 0x7f346414bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 -- 172.21.15.45:0/2216244128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3460009b30 con 0x7f34640c4120 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346a2c2700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 0x7f34640b3e60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f346406aa70 tx=0x7f3460004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3460004800 con 0x7f34640c4120 2023-12-19T17:55:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34600092e0 con 0x7f34640c4120 2023-12-19T17:55:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34640b3ae0 con 0x7f34640c4120 2023-12-19T17:55:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f346001c680 con 0x7f34640c4120 2023-12-19T17:55:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34640b43a0 con 0x7f34640c4120 2023-12-19T17:55:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.654+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640b2350 con 0x7f34640c4120 2023-12-19T17:55:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.658+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f346001c7e0 con 0x7f34640c4120 2023-12-19T17:55:15.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.658+0000 7f345affd700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3448065ad0 0x7f3448067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:15.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.658+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3460084b10 con 0x7f34640c4120 2023-12-19T17:55:15.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.658+0000 7f3469ac1700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3448065ad0 0x7f3448067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.662+0000 7f3469ac1700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3448065ad0 0x7f3448067f90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f34640b3170 tx=0x7f3454009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:15.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.666+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f34600526d0 con 0x7f34640c4120 2023-12-19T17:55:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.846+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3464067760 con 0x7f34640c4120 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.846+0000 7f345affd700 1 -- 172.21.15.45:0/2216244128 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3460055cf0 con 0x7f34640c4120 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:15.851 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.850+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3448065ad0 msgr2=0x7f3448067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.850+0000 7f346b2c4700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3448065ad0 0x7f3448067f90 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f34640b3170 tx=0x7f3454009040 comp rx=0 tx=0).stop 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.850+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 msgr2=0x7f34640b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.850+0000 7f346b2c4700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 0x7f34640b3e60 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f346406aa70 tx=0x7f3460004af0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 shutdown_connections 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3448065ad0 0x7f3448067f90 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f34640b2500 0x7f34641f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f34641591b0 0x7f346414bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 --2- 172.21.15.45:0/2216244128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f34640c4120 0x7f34640b3e60 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:15.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 >> 172.21.15.45:0/2216244128 conn(0x7f34640cb900 msgr2=0x7f346415c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:15.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 shutdown_connections 2023-12-19T17:55:15.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:15.854+0000 7f346b2c4700 1 -- 172.21.15.45:0/2216244128 wait complete. 2023-12-19T17:55:15.878 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T17:55:15.878 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T17:55:16.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.062+0000 7f25c5b64700 1 Processor -- start 2023-12-19T17:55:16.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.062+0000 7f25c5b64700 1 -- start start 2023-12-19T17:55:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c5b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c5b64700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c015db40 con 0x7f25c015d2c0 2023-12-19T17:55:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c5b64700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c00c9a80 con 0x7f25c00ca130 2023-12-19T17:55:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c5b64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c01615e0 con 0x7f25c015cee0 2023-12-19T17:55:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25bffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f25c015d2c0 0x7f25c0160a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55956/0 (socket says 172.21.15.45:55956) 2023-12-19T17:55:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25bffff700 1 -- 172.21.15.45:0/432533928 learned_addr learned my addr 172.21.15.45:0/432533928 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c4b62700 1 --2- 172.21.15.45:0/432533928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25bf7fe700 1 -- 172.21.15.45:0/432533928 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1535205517 0 0) 0x7f25c015db40 con 0x7f25c015d2c0 2023-12-19T17:55:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25bf7fe700 1 -- 172.21.15.45:0/432533928 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25b00035d0 con 0x7f25c015d2c0 2023-12-19T17:55:16.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c4b62700 1 -- 172.21.15.45:0/432533928 >> v1:172.21.15.73:6789/0 conn(0x7f25c00ca130 legacy=0x7f25c006ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c4b62700 1 -- 172.21.15.45:0/432533928 >> v1:172.21.15.45:6789/0 conn(0x7f25c015d2c0 legacy=0x7f25c0160a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.066+0000 7f25c4b62700 1 -- 172.21.15.45:0/432533928 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c01618c0 con 0x7f25c015cee0 2023-12-19T17:55:16.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c4b62700 1 --2- 172.21.15.45:0/432533928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c015dfd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009880 tx=0x7f25b4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2634f3a2a3fb3ef6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:16.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25bf7fe700 1 -- 172.21.15.45:0/432533928 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011830 con 0x7f25c015cee0 2023-12-19T17:55:16.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25bf7fe700 1 -- 172.21.15.45:0/432533928 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4011990 con 0x7f25c015cee0 2023-12-19T17:55:16.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25bf7fe700 1 -- 172.21.15.45:0/432533928 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4011d20 con 0x7f25c015cee0 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 -- 172.21.15.45:0/432533928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 msgr2=0x7f25c015dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 --2- 172.21.15.45:0/432533928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c015dfd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f25b4009880 tx=0x7f25b4009b90 comp rx=0 tx=0).stop 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 -- 172.21.15.45:0/432533928 shutdown_connections 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 --2- 172.21.15.45:0/432533928 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c015dfd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 -- 172.21.15.45:0/432533928 >> 172.21.15.45:0/432533928 conn(0x7f25c00b0ca0 msgr2=0x7f25c00b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 -- 172.21.15.45:0/432533928 shutdown_connections 2023-12-19T17:55:16.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.070+0000 7f25c5b64700 1 -- 172.21.15.45:0/432533928 wait complete. 2023-12-19T17:55:16.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.074+0000 7f25c5b64700 1 Processor -- start 2023-12-19T17:55:16.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.074+0000 7f25c5b64700 1 -- start start 2023-12-19T17:55:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 0x7f25c01f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c00b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c015d2c0 0x7f25c00b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c0155f40 con 0x7f25c00ca130 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00c8160 con 0x7f25c015d2c0 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c00c8440 con 0x7f25c015cee0 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 0x7f25c01f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 0x7f25c01f2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48780/0 (socket says 172.21.15.45:48780) 2023-12-19T17:55:16.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 -- 172.21.15.45:0/1058905665 learned_addr learned my addr 172.21.15.45:0/1058905665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5363700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c015d2c0 0x7f25c00b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25bffff700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c00b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 -- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 msgr2=0x7f25c00b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c00b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 -- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c015d2c0 msgr2=0x7f25c00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c015d2c0 0x7f25c00b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 -- 172.21.15.45:0/1058905665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40094b0 con 0x7f25c00ca130 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25bffff700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c4b62700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 0x7f25c01f2130 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f25b4013040 tx=0x7f25b4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b40038c0 con 0x7f25c00ca130 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4003a40 con 0x7f25c00ca130 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c00c8720 con 0x7f25c00ca130 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4003df0 con 0x7f25c00ca130 2023-12-19T17:55:16.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.078+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c00c8ce0 con 0x7f25c00ca130 2023-12-19T17:55:16.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.082+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25c00c8ed0 con 0x7f25c00ca130 2023-12-19T17:55:16.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.082+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f25b401b400 con 0x7f25c00ca130 2023-12-19T17:55:16.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.082+0000 7f25bd7fa700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f25a4065ad0 0x7f25a4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.082+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f25b4084610 con 0x7f25c00ca130 2023-12-19T17:55:16.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.082+0000 7f25bffff700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f25a4065ad0 0x7f25a4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.086+0000 7f25bffff700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f25a4065ad0 0x7f25a4067f90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f25c0070bc0 tx=0x7f25ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:16.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.090+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f25b40521d0 con 0x7f25c00ca130 2023-12-19T17:55:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.262+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f25c004ed30 con 0x7f25c00ca130 2023-12-19T17:55:16.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.726+0000 7f25bd7fa700 1 -- 172.21.15.45:0/1058905665 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 138+0+0 (secure 0 0 0) 0x7f25b40557f0 con 0x7f25c00ca130 2023-12-19T17:55:16.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f25a4065ad0 msgr2=0x7f25a4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f25a4065ad0 0x7f25a4067f90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f25c0070bc0 tx=0x7f25ac009040 comp rx=0 tx=0).stop 2023-12-19T17:55:16.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 msgr2=0x7f25c01f2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 0x7f25c01f2130 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f25b4013040 tx=0x7f25b4004770 comp rx=0 tx=0).stop 2023-12-19T17:55:16.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 shutdown_connections 2023-12-19T17:55:16.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f25a4065ad0 0x7f25a4067f90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25c015d2c0 0x7f25c00b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25c015cee0 0x7f25c00b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 --2- 172.21.15.45:0/1058905665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25c00ca130 0x7f25c01f2130 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 >> 172.21.15.45:0/1058905665 conn(0x7f25c00b0ca0 msgr2=0x7f25c00aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:16.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 shutdown_connections 2023-12-19T17:55:16.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.734+0000 7f25c5b64700 1 -- 172.21.15.45:0/1058905665 wait complete. 2023-12-19T17:55:16.741 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-19T17:55:16.760 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T17:55:16.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.946+0000 7f02fc225700 1 Processor -- start 2023-12-19T17:55:16.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.946+0000 7f02fc225700 1 -- start start 2023-12-19T17:55:16.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fc225700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f02f415d0b0 0x7f02f40b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fc225700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f40b8b90 0x7f02f4160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fc225700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02f41610c0 0x7f02f406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fc225700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f4161550 con 0x7f02f41610c0 2023-12-19T17:55:16.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fc225700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02f40b5dd0 con 0x7f02f415d0b0 2023-12-19T17:55:16.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fc225700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40d1240 con 0x7f02f40b8b90 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02f41610c0 0x7f02f406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f02f41610c0 0x7f02f406ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48782/0 (socket says 172.21.15.45:48782) 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 -- 172.21.15.45:0/2370802584 learned_addr learned my addr 172.21.15.45:0/2370802584 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02f97c0700 1 --2- 172.21.15.45:0/2370802584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f40b8b90 0x7f02f4160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02f9fc1700 1 --2- 172.21.15.45:0/2370802584 >> v2:172.21.15.73:3300/0 conn(0x7f02f415d0b0 0x7f02f40b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 -- 172.21.15.45:0/2370802584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f40b8b90 msgr2=0x7f02f4160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 --2- 172.21.15.45:0/2370802584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f40b8b90 0x7f02f4160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 -- 172.21.15.45:0/2370802584 >> v2:172.21.15.73:3300/0 conn(0x7f02f415d0b0 msgr2=0x7f02f40b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 --2- 172.21.15.45:0/2370802584 >> v2:172.21.15.73:3300/0 conn(0x7f02f415d0b0 0x7f02f40b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 -- 172.21.15.45:0/2370802584 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02f415d490 con 0x7f02f41610c0 2023-12-19T17:55:16.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02fa7c2700 1 --2- 172.21.15.45:0/2370802584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f41610c0 0x7f02f406ea90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f02f40d3ac0 tx=0x7f02ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64462d94e59dd986 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:16.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02f8fbf700 1 -- 172.21.15.45:0/2370802584 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00e070 con 0x7f02f41610c0 2023-12-19T17:55:16.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02f8fbf700 1 -- 172.21.15.45:0/2370802584 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02ec00b9c0 con 0x7f02f41610c0 2023-12-19T17:55:16.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.950+0000 7f02f8fbf700 1 -- 172.21.15.45:0/2370802584 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02ec00bd70 con 0x7f02f41610c0 2023-12-19T17:55:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 -- 172.21.15.45:0/2370802584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f41610c0 msgr2=0x7f02f406ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 --2- 172.21.15.45:0/2370802584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f41610c0 0x7f02f406ea90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f02f40d3ac0 tx=0x7f02ec00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 -- 172.21.15.45:0/2370802584 shutdown_connections 2023-12-19T17:55:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 --2- 172.21.15.45:0/2370802584 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f41610c0 0x7f02f406ea90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 --2- 172.21.15.45:0/2370802584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f40b8b90 0x7f02f4160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 --2- 172.21.15.45:0/2370802584 >> v2:172.21.15.73:3300/0 conn(0x7f02f415d0b0 0x7f02f40b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 -- 172.21.15.45:0/2370802584 >> 172.21.15.45:0/2370802584 conn(0x7f02f40d2e10 msgr2=0x7f02f40d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 -- 172.21.15.45:0/2370802584 shutdown_connections 2023-12-19T17:55:16.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.954+0000 7f02fc225700 1 -- 172.21.15.45:0/2370802584 wait complete. 2023-12-19T17:55:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 Processor -- start 2023-12-19T17:55:16.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 -- start start 2023-12-19T17:55:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 0x7f02f40b2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f415d0b0 0x7f02f40cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f41610c0 0x7f02f415f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40b2b60 con 0x7f02f40b8b90 2023-12-19T17:55:16.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02f40caa20 con 0x7f02f415d0b0 2023-12-19T17:55:16.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fc225700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02f41f35b0 con 0x7f02f41610c0 2023-12-19T17:55:16.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 0x7f02f40b2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 0x7f02f40b2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48798/0 (socket says 172.21.15.45:48798) 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 -- 172.21.15.45:0/2506330815 learned_addr learned my addr 172.21.15.45:0/2506330815 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f97c0700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f415d0b0 0x7f02f40cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02fa7c2700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f41610c0 0x7f02f415f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 -- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f41610c0 msgr2=0x7f02f415f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f41610c0 0x7f02f415f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 -- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f415d0b0 msgr2=0x7f02f40cba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f415d0b0 0x7f02f40cba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:16.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.958+0000 7f02f9fc1700 1 -- 172.21.15.45:0/2506330815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02ec009b30 con 0x7f02f40b8b90 2023-12-19T17:55:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02f9fc1700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 0x7f02f40b2620 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f02f000e760 tx=0x7f02f000ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f000c070 con 0x7f02f40b8b90 2023-12-19T17:55:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02f0013610 con 0x7f02f40b8b90 2023-12-19T17:55:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02f0013980 con 0x7f02f40b8b90 2023-12-19T17:55:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02f40cbfc0 con 0x7f02f40b8b90 2023-12-19T17:55:16.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02f40cafa0 con 0x7f02f40b8b90 2023-12-19T17:55:16.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.962+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02f404ed30 con 0x7f02f40b8b90 2023-12-19T17:55:16.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.966+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f02f0013ae0 con 0x7f02f40b8b90 2023-12-19T17:55:16.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.966+0000 7f02ea7fc700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02d8065ad0 0x7f02d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.966+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f02f0082e20 con 0x7f02f40b8b90 2023-12-19T17:55:16.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.966+0000 7f02f97c0700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02d8065ad0 0x7f02d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:16.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.970+0000 7f02f97c0700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02d8065ad0 0x7f02d8067f90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02f415f150 tx=0x7f02e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:16.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:16.974+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f02f0050870 con 0x7f02f40b8b90 2023-12-19T17:55:17.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.154+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f02f40d09e0 con 0x7f02f40b8b90 2023-12-19T17:55:17.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.742+0000 7f02ea7fc700 1 -- 172.21.15.45:0/2506330815 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f02f0053e90 con 0x7f02f40b8b90 2023-12-19T17:55:17.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.758+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02d8065ad0 msgr2=0x7f02d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.758+0000 7f02fc225700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02d8065ad0 0x7f02d8067f90 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f02f415f150 tx=0x7f02e4008040 comp rx=0 tx=0).stop 2023-12-19T17:55:17.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.758+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 msgr2=0x7f02f40b2620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.758+0000 7f02fc225700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 0x7f02f40b2620 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f02f000e760 tx=0x7f02f000ea70 comp rx=0 tx=0).stop 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 shutdown_connections 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f02d8065ad0 0x7f02d8067f90 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f02f41610c0 0x7f02f415f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02f415d0b0 0x7f02f40cba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 --2- 172.21.15.45:0/2506330815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f02f40b8b90 0x7f02f40b2620 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 >> 172.21.15.45:0/2506330815 conn(0x7f02f40d2e10 msgr2=0x7f02f415ab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:17.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 shutdown_connections 2023-12-19T17:55:17.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.762+0000 7f02fc225700 1 -- 172.21.15.45:0/2506330815 wait complete. 2023-12-19T17:55:17.769 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-19T17:55:17.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T17:55:17.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.966+0000 7f820974d700 1 Processor -- start 2023-12-19T17:55:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.966+0000 7f820974d700 1 -- start start 2023-12-19T17:55:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f820974d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f820415d0a0 0x7f820406f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f820974d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f820415aab0 con 0x7f82040cce30 2023-12-19T17:55:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f820974d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82040cf030 con 0x7f8204159810 2023-12-19T17:55:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f820974d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f820415a210 con 0x7f820415d0a0 2023-12-19T17:55:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f8202ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f82040cce30 0x7f82040cd210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55962/0 (socket says 172.21.15.45:55962) 2023-12-19T17:55:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f8202ffd700 1 -- 172.21.15.45:0/3152492376 learned_addr learned my addr 172.21.15.45:0/3152492376 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f82027fc700 1 --2- 172.21.15.45:0/3152492376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f820415d0a0 0x7f820406f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:17.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f8201ffb700 1 -- 172.21.15.45:0/3152492376 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172160242 0 0) 0x7f820415aab0 con 0x7f82040cce30 2023-12-19T17:55:17.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f8201ffb700 1 -- 172.21.15.45:0/3152492376 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f81ec0035d0 con 0x7f82040cce30 2023-12-19T17:55:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f8201ffb700 1 -- 172.21.15.45:0/3152492376 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1771157493 0 0) 0x7f81ec0035d0 con 0x7f82040cce30 2023-12-19T17:55:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f82027fc700 1 -- 172.21.15.45:0/3152492376 >> v1:172.21.15.73:6789/0 conn(0x7f8204159810 legacy=0x7f8204071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f82027fc700 1 -- 172.21.15.45:0/3152492376 >> v1:172.21.15.45:6789/0 conn(0x7f82040cce30 legacy=0x7f82040cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f82027fc700 1 -- 172.21.15.45:0/3152492376 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820415a4f0 con 0x7f820415d0a0 2023-12-19T17:55:17.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f82027fc700 1 --2- 172.21.15.45:0/3152492376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f820415d0a0 0x7f820406f320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009880 tx=0x7f81f8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9261ae3a4c66ae1b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.970+0000 7f8201ffb700 1 -- 172.21.15.45:0/3152492376 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40017f0 con 0x7f820415d0a0 2023-12-19T17:55:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f8201ffb700 1 -- 172.21.15.45:0/3152492376 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f8004030 con 0x7f820415d0a0 2023-12-19T17:55:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f8201ffb700 1 -- 172.21.15.45:0/3152492376 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f80043c0 con 0x7f820415d0a0 2023-12-19T17:55:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- 172.21.15.45:0/3152492376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f820415d0a0 msgr2=0x7f820406f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 --2- 172.21.15.45:0/3152492376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f820415d0a0 0x7f820406f320 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f81f8009880 tx=0x7f81f8009b90 comp rx=0 tx=0).stop 2023-12-19T17:55:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- 172.21.15.45:0/3152492376 shutdown_connections 2023-12-19T17:55:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 --2- 172.21.15.45:0/3152492376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f820415d0a0 0x7f820406f320 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- 172.21.15.45:0/3152492376 >> 172.21.15.45:0/3152492376 conn(0x7f82040cf260 msgr2=0x7f82040cf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- 172.21.15.45:0/3152492376 shutdown_connections 2023-12-19T17:55:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- 172.21.15.45:0/3152492376 wait complete. 2023-12-19T17:55:17.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 Processor -- start 2023-12-19T17:55:17.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- start start 2023-12-19T17:55:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 0x7f820409fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8204159810 0x7f820415b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f820415d0a0 0x7f820409f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040a0220 con 0x7f82040cce30 2023-12-19T17:55:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c88d0 con 0x7f820415d0a0 2023-12-19T17:55:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.974+0000 7f820974d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82040c8bb0 con 0x7f8204159810 2023-12-19T17:55:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 0x7f820409fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:17.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 0x7f820409fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48804/0 (socket says 172.21.15.45:48804) 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 -- 172.21.15.45:0/1992525560 learned_addr learned my addr 172.21.15.45:0/1992525560 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f82037fe700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f820415d0a0 0x7f820409f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f82027fc700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8204159810 0x7f820415b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 -- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8204159810 msgr2=0x7f820415b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8204159810 0x7f820415b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 -- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f820415d0a0 msgr2=0x7f820409f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f820415d0a0 0x7f820409f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 -- 172.21.15.45:0/1992525560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f80094b0 con 0x7f82040cce30 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f82027fc700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8204159810 0x7f820415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f82037fe700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f820415d0a0 0x7f820409f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f8202ffd700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 0x7f820409fce0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c520 tx=0x7f81f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f40074e0 con 0x7f82040cce30 2023-12-19T17:55:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81f4007640 con 0x7f82040cce30 2023-12-19T17:55:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82040c8e90 con 0x7f82040cce30 2023-12-19T17:55:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4005a90 con 0x7f82040cce30 2023-12-19T17:55:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.978+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f820409d3e0 con 0x7f82040cce30 2023-12-19T17:55:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.982+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8204168330 con 0x7f82040cce30 2023-12-19T17:55:17.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.982+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f81f4005bf0 con 0x7f82040cce30 2023-12-19T17:55:17.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.986+0000 7f81eb7fe700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81f0065ad0 0x7f81f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:17.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.986+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f81f4082bd0 con 0x7f82040cce30 2023-12-19T17:55:17.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.986+0000 7f82027fc700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81f0065ad0 0x7f81f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.986+0000 7f82027fc700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81f0065ad0 0x7f81f0067f90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f81f80090b0 tx=0x7f81f8010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:17.990+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f81f4050520 con 0x7f82040cce30 2023-12-19T17:55:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.206+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8204070ae0 con 0x7f82040cce30 2023-12-19T17:55:18.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.222+0000 7f81eb7fe700 1 -- 172.21.15.45:0/1992525560 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v33) v1 ==== 172+0+0 (secure 0 0 0) 0x7f81f40170c0 con 0x7f82040cce30 2023-12-19T17:55:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.230+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81f0065ad0 msgr2=0x7f81f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.230+0000 7f820974d700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81f0065ad0 0x7f81f0067f90 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f81f80090b0 tx=0x7f81f8010000 comp rx=0 tx=0).stop 2023-12-19T17:55:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.230+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 msgr2=0x7f820409fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.230+0000 7f820974d700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 0x7f820409fce0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f81f400c520 tx=0x7f81f400c8e0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 shutdown_connections 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81f0065ad0 0x7f81f0067f90 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f820415d0a0 0x7f820409f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8204159810 0x7f820415b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 --2- 172.21.15.45:0/1992525560 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82040cce30 0x7f820409fce0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 >> 172.21.15.45:0/1992525560 conn(0x7f82040cf260 msgr2=0x7f820415c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 shutdown_connections 2023-12-19T17:55:18.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.234+0000 7f820974d700 1 -- 172.21.15.45:0/1992525560 wait complete. 2023-12-19T17:55:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 8 and data pool 9 2023-12-19T17:55:18.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.438+0000 7f80b8815700 1 Processor -- start 2023-12-19T17:55:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 -- start start 2023-12-19T17:55:18.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80b4159a50 0x7f80b40c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f80b415e450 0x7f80b406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b4070540 con 0x7f80b4159a50 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b40b0110 con 0x7f80b415e450 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b8815700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40c3c50 con 0x7f80b40af720 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b2d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80b4159a50 0x7f80b40c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b2d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f80b4159a50 0x7f80b40c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48806/0 (socket says 172.21.15.45:48806) 2023-12-19T17:55:18.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b2d9d700 1 -- 172.21.15.45:0/364577539 learned_addr learned my addr 172.21.15.45:0/364577539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.442+0000 7f80b259c700 1 --2- 172.21.15.45:0/364577539 >> v2:172.21.15.73:3300/0 conn(0x7f80b415e450 0x7f80b406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b359e700 1 -- 172.21.15.45:0/364577539 >> v2:172.21.15.73:3300/0 conn(0x7f80b415e450 msgr2=0x7f80b406fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b359e700 1 --2- 172.21.15.45:0/364577539 >> v2:172.21.15.73:3300/0 conn(0x7f80b415e450 0x7f80b406fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b359e700 1 -- 172.21.15.45:0/364577539 >> v2:172.21.15.45:3300/0 conn(0x7f80b4159a50 msgr2=0x7f80b40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b359e700 1 --2- 172.21.15.45:0/364577539 >> v2:172.21.15.45:3300/0 conn(0x7f80b4159a50 0x7f80b40c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b359e700 1 -- 172.21.15.45:0/364577539 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b406c760 con 0x7f80b40af720 2023-12-19T17:55:18.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b359e700 1 --2- 172.21.15.45:0/364577539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b40afbd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80b4071fc0 tx=0x7f80ac00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cb97d8058d7b9d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:18.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b1d9b700 1 -- 172.21.15.45:0/364577539 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00e070 con 0x7f80b40af720 2023-12-19T17:55:18.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b1d9b700 1 -- 172.21.15.45:0/364577539 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00bb20 con 0x7f80b40af720 2023-12-19T17:55:18.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b1d9b700 1 -- 172.21.15.45:0/364577539 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac012430 con 0x7f80b40af720 2023-12-19T17:55:18.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 -- 172.21.15.45:0/364577539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 msgr2=0x7f80b40afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 --2- 172.21.15.45:0/364577539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b40afbd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f80b4071fc0 tx=0x7f80ac00b330 comp rx=0 tx=0).stop 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 -- 172.21.15.45:0/364577539 shutdown_connections 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 --2- 172.21.15.45:0/364577539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b40afbd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 --2- 172.21.15.45:0/364577539 >> v2:172.21.15.73:3300/0 conn(0x7f80b415e450 0x7f80b406fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 --2- 172.21.15.45:0/364577539 >> v2:172.21.15.45:3300/0 conn(0x7f80b4159a50 0x7f80b40c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 -- 172.21.15.45:0/364577539 >> 172.21.15.45:0/364577539 conn(0x7f80b40cb900 msgr2=0x7f80b40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 -- 172.21.15.45:0/364577539 shutdown_connections 2023-12-19T17:55:18.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.446+0000 7f80b8815700 1 -- 172.21.15.45:0/364577539 wait complete. 2023-12-19T17:55:18.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.450+0000 7f80b8815700 1 Processor -- start 2023-12-19T17:55:18.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.450+0000 7f80b8815700 1 -- start start 2023-12-19T17:55:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b414e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b4159a50 0x7f80b4158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 0x7f80b414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40b3470 con 0x7f80b415e450 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b414f950 con 0x7f80b4159a50 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b40ce250 con 0x7f80b40af720 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 0x7f80b414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 0x7f80b414ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:48814/0 (socket says 172.21.15.45:48814) 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 -- 172.21.15.45:0/2317035985 learned_addr learned my addr 172.21.15.45:0/2317035985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b2d9d700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b414e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b259c700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b4159a50 0x7f80b4158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 -- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 msgr2=0x7f80b414e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b414e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 -- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b4159a50 msgr2=0x7f80b4158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b4159a50 0x7f80b4158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 -- 172.21.15.45:0/2317035985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac009a70 con 0x7f80b415e450 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b2d9d700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b359e700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 0x7f80b414ce10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f80ac014040 tx=0x7f80ac004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac004960 con 0x7f80b415e450 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac020070 con 0x7f80b415e450 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b414fbf0 con 0x7f80b415e450 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0276e0 con 0x7f80b415e450 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.454+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b406f220 con 0x7f80b415e450 2023-12-19T17:55:18.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.458+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b4156d60 con 0x7f80b415e450 2023-12-19T17:55:18.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.458+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f80ac012430 con 0x7f80b415e450 2023-12-19T17:55:18.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.458+0000 7f809b7fe700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80a0065ad0 0x7f80a0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.458+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f80ac022070 con 0x7f80b415e450 2023-12-19T17:55:18.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.462+0000 7f80b2d9d700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80a0065ad0 0x7f80a0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.462+0000 7f80b2d9d700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80a0065ad0 0x7f80a0067f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009c40 tx=0x7f80a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.462+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f80ac0527c0 con 0x7f80b415e450 2023-12-19T17:55:18.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.638+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80b4067760 con 0x7f80b415e450 2023-12-19T17:55:18.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.642+0000 7f809b7fe700 1 -- 172.21.15.45:0/2317035985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16267 (secure 0 0 0) 0x7f80ac02c020 con 0x7f80b415e450 2023-12-19T17:55:18.646 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:18.646 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":62,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:18.209603+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80a0065ad0 msgr2=0x7f80a0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80a0065ad0 0x7f80a0067f90 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f80a4009c40 tx=0x7f80a4008040 comp rx=0 tx=0).stop 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 msgr2=0x7f80b414ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 0x7f80b414ce10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f80ac014040 tx=0x7f80ac004af0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 shutdown_connections 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f80a0065ad0 0x7f80a0067f90 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80b415e450 0x7f80b414ce10 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f80b4159a50 0x7f80b4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 --2- 172.21.15.45:0/2317035985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f80b40af720 0x7f80b414e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 >> 172.21.15.45:0/2317035985 conn(0x7f80b40cb900 msgr2=0x7f80b40ca180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:18.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 shutdown_connections 2023-12-19T17:55:18.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.646+0000 7f80b8815700 1 -- 172.21.15.45:0/2317035985 wait complete. 2023-12-19T17:55:18.676 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:18.707 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T17:55:18.702+0000 7f0f40153700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:55:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.858+0000 7ff85f59e700 1 Processor -- start 2023-12-19T17:55:18.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.858+0000 7ff85f59e700 1 -- start start 2023-12-19T17:55:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff8600c4030 0x7ff86006ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85f59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86006e310 con 0x7ff86015cff0 2023-12-19T17:55:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff860161990 con 0x7ff860161530 2023-12-19T17:55:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86015d3d0 con 0x7ff8600c4030 2023-12-19T17:55:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85e59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff86015cff0 0x7ff8600c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51744/0 (socket says 172.21.15.45:51744) 2023-12-19T17:55:18.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85e59c700 1 -- 172.21.15.45:0/295447994 learned_addr learned my addr 172.21.15.45:0/295447994 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:18.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85ed9d700 1 --2- 172.21.15.45:0/295447994 >> v2:172.21.15.73:3300/0 conn(0x7ff8600c4030 0x7ff86006ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748982006 0 0) 0x7ff86006e310 con 0x7ff86015cff0 2023-12-19T17:55:18.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8480035d0 con 0x7ff86015cff0 2023-12-19T17:55:18.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570327948 0 0) 0x7ff860161990 con 0x7ff860161530 2023-12-19T17:55:18.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff86006e310 con 0x7ff860161530 2023-12-19T17:55:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1377670198 0 0) 0x7ff8480035d0 con 0x7ff86015cff0 2023-12-19T17:55:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85ed9d700 1 -- 172.21.15.45:0/295447994 >> v1:172.21.15.73:6789/0 conn(0x7ff860161530 legacy=0x7ff8600c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85ed9d700 1 -- 172.21.15.45:0/295447994 >> v1:172.21.15.45:6789/0 conn(0x7ff86015cff0 legacy=0x7ff8600c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.862+0000 7ff85ed9d700 1 -- 172.21.15.45:0/295447994 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8600ca6f0 con 0x7ff8600c4030 2023-12-19T17:55:18.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85ed9d700 1 --2- 172.21.15.45:0/295447994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8600c4030 0x7ff86006ddd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff858009850 tx=0x7ff858009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=861a3230ab43a89e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500019f0 con 0x7ff8600c4030 2023-12-19T17:55:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff858004030 con 0x7ff8600c4030 2023-12-19T17:55:18.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85d59a700 1 -- 172.21.15.45:0/295447994 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8580043c0 con 0x7ff8600c4030 2023-12-19T17:55:18.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 -- 172.21.15.45:0/295447994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8600c4030 msgr2=0x7ff86006ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 --2- 172.21.15.45:0/295447994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8600c4030 0x7ff86006ddd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff858009850 tx=0x7ff858009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:18.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 -- 172.21.15.45:0/295447994 shutdown_connections 2023-12-19T17:55:18.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 --2- 172.21.15.45:0/295447994 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8600c4030 0x7ff86006ddd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 -- 172.21.15.45:0/295447994 >> 172.21.15.45:0/295447994 conn(0x7ff8600cb900 msgr2=0x7ff8600b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:18.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 -- 172.21.15.45:0/295447994 shutdown_connections 2023-12-19T17:55:18.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.866+0000 7ff85f59e700 1 -- 172.21.15.45:0/295447994 wait complete. 2023-12-19T17:55:18.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.870+0000 7ff85f59e700 1 Processor -- start 2023-12-19T17:55:18.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.870+0000 7ff85f59e700 1 -- start start 2023-12-19T17:55:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 0x7ff860151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff86015cff0 0x7ff8601f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff860161530 0x7ff8600cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600b2bc0 con 0x7ff8600c4030 2023-12-19T17:55:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600c69c0 con 0x7ff860161530 2023-12-19T17:55:18.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff860152480 con 0x7ff86015cff0 2023-12-19T17:55:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 0x7ff860151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff860161530 0x7ff8600cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 0x7ff860151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43116/0 (socket says 172.21.15.45:43116) 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85e59c700 1 -- 172.21.15.45:0/2500990201 learned_addr learned my addr 172.21.15.45:0/2500990201 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85dd9b700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff86015cff0 0x7ff8601f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 -- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff86015cff0 msgr2=0x7ff8601f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff86015cff0 0x7ff8601f6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 -- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 msgr2=0x7ff860151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 0x7ff860151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 -- 172.21.15.45:0/2500990201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580094b0 con 0x7ff860161530 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85e59c700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 0x7ff860151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:18.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85dd9b700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff86015cff0 0x7ff8601f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85ed9d700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff860161530 0x7ff8600cc830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8600721d0 tx=0x7ff858004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858003c00 con 0x7ff860161530 2023-12-19T17:55:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85801f070 con 0x7ff860161530 2023-12-19T17:55:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600c6c60 con 0x7ff860161530 2023-12-19T17:55:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff858011630 con 0x7ff860161530 2023-12-19T17:55:18.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.874+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8600b2320 con 0x7ff860161530 2023-12-19T17:55:18.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.878+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8600c6df0 con 0x7ff860161530 2023-12-19T17:55:18.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.878+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff858011790 con 0x7ff860161530 2023-12-19T17:55:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.882+0000 7ff84effd700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff840065ad0 0x7ff840067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.882+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff858021070 con 0x7ff860161530 2023-12-19T17:55:18.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.882+0000 7ff85e59c700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff840065ad0 0x7ff840067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:18.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.882+0000 7ff85e59c700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff840065ad0 0x7ff840067f90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff850001b20 tx=0x7ff8500015b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:18.894+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff858052340 con 0x7ff860161530 2023-12-19T17:55:19.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.074+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff860067760 con 0x7ff860161530 2023-12-19T17:55:19.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.078+0000 7ff84effd700 1 -- 172.21.15.45:0/2500990201 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+16267 (secure 0 0 0) 0x7ff858055960 con 0x7ff860161530 2023-12-19T17:55:19.080 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:19.080 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":62,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:18.209603+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:19.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff840065ad0 msgr2=0x7ff840067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:19.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff840065ad0 0x7ff840067f90 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff850001b20 tx=0x7ff8500015b0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff860161530 msgr2=0x7ff8600cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:19.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff860161530 0x7ff8600cc830 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff8600721d0 tx=0x7ff858004770 comp rx=0 tx=0).stop 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 shutdown_connections 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff840065ad0 0x7ff840067f90 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff860161530 0x7ff8600cc830 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff86015cff0 0x7ff8601f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 --2- 172.21.15.45:0/2500990201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff8600c4030 0x7ff860151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 >> 172.21.15.45:0/2500990201 conn(0x7ff8600cb900 msgr2=0x7ff860160ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 shutdown_connections 2023-12-19T17:55:19.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.082+0000 7ff85f59e700 1 -- 172.21.15.45:0/2500990201 wait complete. 2023-12-19T17:55:19.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T17:55:19.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.334+0000 7eff846ae700 1 Processor -- start 2023-12-19T17:55:19.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.334+0000 7eff846ae700 1 -- start start 2023-12-19T17:55:19.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff846ae700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff7c06fba0 0x7eff7c06ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff846ae700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7eff7c06d690 0x7eff7c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff846ae700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7c0cceb0 con 0x7eff7c15d840 2023-12-19T17:55:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff846ae700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c0cddd0 con 0x7eff7c06fba0 2023-12-19T17:55:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff846ae700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff7c0704c0 con 0x7eff7c06d690 2023-12-19T17:55:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff8244a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7eff7c06fba0 0x7eff7c06ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:19.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff82c4b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7eff7c15d840 0x7eff7c15dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51752/0 (socket says 172.21.15.45:51752) 2023-12-19T17:55:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff82c4b700 1 -- 172.21.15.45:0/427081928 learned_addr learned my addr 172.21.15.45:0/427081928 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:19.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff81c49700 1 --2- 172.21.15.45:0/427081928 >> v2:172.21.15.73:3300/0 conn(0x7eff7c06d690 0x7eff7c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:19.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff8244a700 1 -- 172.21.15.45:0/427081928 >> v2:172.21.15.73:3300/0 conn(0x7eff7c06d690 msgr2=0x7eff7c0b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff8244a700 1 --2- 172.21.15.45:0/427081928 >> v2:172.21.15.73:3300/0 conn(0x7eff7c06d690 0x7eff7c0b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff8244a700 1 -- 172.21.15.45:0/427081928 >> v1:172.21.15.45:6789/0 conn(0x7eff7c15d840 legacy=0x7eff7c15dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff8244a700 1 -- 172.21.15.45:0/427081928 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff7c0b2a00 con 0x7eff7c06fba0 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.338+0000 7eff81448700 1 -- 172.21.15.45:0/427081928 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3999600803 0 0) 0x7eff7c0cceb0 con 0x7eff7c15d840 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff8244a700 1 --2- 172.21.15.45:0/427081928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c06ff80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff7c06aa60 tx=0x7eff78009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2864dd974a8cff7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff81448700 1 -- 172.21.15.45:0/427081928 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78011830 con 0x7eff7c06fba0 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff81448700 1 -- 172.21.15.45:0/427081928 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff78011990 con 0x7eff7c06fba0 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff81448700 1 -- 172.21.15.45:0/427081928 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78011d20 con 0x7eff7c06fba0 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 -- 172.21.15.45:0/427081928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 msgr2=0x7eff7c06ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:19.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 --2- 172.21.15.45:0/427081928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c06ff80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7eff7c06aa60 tx=0x7eff78009b30 comp rx=0 tx=0).stop 2023-12-19T17:55:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 -- 172.21.15.45:0/427081928 shutdown_connections 2023-12-19T17:55:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 --2- 172.21.15.45:0/427081928 >> v2:172.21.15.73:3300/0 conn(0x7eff7c06d690 0x7eff7c0b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 --2- 172.21.15.45:0/427081928 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c06ff80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 -- 172.21.15.45:0/427081928 >> 172.21.15.45:0/427081928 conn(0x7eff7c071990 msgr2=0x7eff7c0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 -- 172.21.15.45:0/427081928 shutdown_connections 2023-12-19T17:55:19.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.342+0000 7eff846ae700 1 -- 172.21.15.45:0/427081928 wait complete. 2023-12-19T17:55:19.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 Processor -- start 2023-12-19T17:55:19.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 -- start start 2023-12-19T17:55:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff7c06d690 0x7eff7c159380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:19.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c1f0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff7c15d840 0x7eff7c13f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c1598c0 con 0x7eff7c06fba0 2023-12-19T17:55:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c13caf0 con 0x7eff7c06d690 2023-12-19T17:55:19.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.346+0000 7eff846ae700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7c13a460 con 0x7eff7c15d840 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c1f0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c1f0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43134/0 (socket says 172.21.15.45:43134) 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 -- 172.21.15.45:0/2741228625 learned_addr learned my addr 172.21.15.45:0/2741228625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff8244a700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff7c06d690 0x7eff7c159380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff82c4b700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff7c15d840 0x7eff7c13f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 -- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff7c15d840 msgr2=0x7eff7c13f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff7c15d840 0x7eff7c13f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 -- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff7c06d690 msgr2=0x7eff7c159380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff7c06d690 0x7eff7c159380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:19.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 -- 172.21.15.45:0/2741228625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff780094b0 con 0x7eff7c06fba0 2023-12-19T17:55:19.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff81c49700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c1f0cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e840 tx=0x7eff6c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:19.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0095a0 con 0x7eff7c06fba0 2023-12-19T17:55:19.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6c013680 con 0x7eff7c06fba0 2023-12-19T17:55:19.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6c0139f0 con 0x7eff7c06fba0 2023-12-19T17:55:19.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff7c13cd40 con 0x7eff7c06fba0 2023-12-19T17:55:19.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.350+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff7c13d300 con 0x7eff7c06fba0 2023-12-19T17:55:19.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.354+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff7c04ed30 con 0x7eff7c06fba0 2023-12-19T17:55:19.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.354+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7eff6c013b50 con 0x7eff7c06fba0 2023-12-19T17:55:19.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.354+0000 7eff72ffd700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff60065b20 0x7eff60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:19.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.354+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7eff6c082f50 con 0x7eff7c06fba0 2023-12-19T17:55:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.354+0000 7eff8244a700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff60065b20 0x7eff60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.358+0000 7eff8244a700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff60065b20 0x7eff60067fe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7eff78009fd0 tx=0x7eff78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:19.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.362+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7eff6c0b40a0 con 0x7eff7c06fba0 2023-12-19T17:55:19.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:19.570+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7eff7c143080 con 0x7eff7c06fba0 2023-12-19T17:55:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.238+0000 7eff72ffd700 1 -- 172.21.15.45:0/2741228625 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v35) v1 ==== 118+0+0 (secure 0 0 0) 0x7eff6c0170b0 con 0x7eff7c06fba0 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff60065b20 msgr2=0x7eff60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff60065b20 0x7eff60067fe0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7eff78009fd0 tx=0x7eff78008030 comp rx=0 tx=0).stop 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 msgr2=0x7eff7c1f0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c1f0cb0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7eff6c00e840 tx=0x7eff6c00eb50 comp rx=0 tx=0).stop 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 shutdown_connections 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7eff60065b20 0x7eff60067fe0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7eff7c15d840 0x7eff7c13f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7eff7c06fba0 0x7eff7c1f0cb0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 --2- 172.21.15.45:0/2741228625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7eff7c06d690 0x7eff7c159380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 >> 172.21.15.45:0/2741228625 conn(0x7eff7c071990 msgr2=0x7eff7c15a750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:20.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 shutdown_connections 2023-12-19T17:55:20.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.242+0000 7eff846ae700 1 -- 172.21.15.45:0/2741228625 wait complete. 2023-12-19T17:55:20.270 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T17:55:20.270 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T17:55:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.466+0000 7fd01cd01700 1 Processor -- start 2023-12-19T17:55:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.466+0000 7fd01cd01700 1 -- start start 2023-12-19T17:55:20.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd01cd01700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd0180d0a50 0x7fd0180cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd01cd01700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0180d01e0 con 0x7fd0180cfd70 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd01cd01700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0180d10e0 con 0x7fd01815d090 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd01cd01700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0180b6040 con 0x7fd0180d0a50 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd016d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd0180cfd70 0x7fd0180b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51768/0 (socket says 172.21.15.45:51768) 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd016d9d700 1 -- 172.21.15.45:0/639602768 learned_addr learned my addr 172.21.15.45:0/639602768 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd00ffff700 1 --2- 172.21.15.45:0/639602768 >> v2:172.21.15.73:3300/0 conn(0x7fd0180d0a50 0x7fd0180cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609423535 0 0) 0x7fd010001490 con 0x7fd0180cfd70 2023-12-19T17:55:20.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0040035d0 con 0x7fd0180cfd70 2023-12-19T17:55:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3251470022 0 0) 0x7fd0180d10e0 con 0x7fd01815d090 2023-12-19T17:55:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd010001490 con 0x7fd01815d090 2023-12-19T17:55:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 835631701 0 0) 0x7fd0040035d0 con 0x7fd0180cfd70 2023-12-19T17:55:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 >> v2:172.21.15.73:3300/0 conn(0x7fd0180d0a50 msgr2=0x7fd0180cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 --2- 172.21.15.45:0/639602768 >> v2:172.21.15.73:3300/0 conn(0x7fd0180d0a50 0x7fd0180cf830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 >> v1:172.21.15.73:6789/0 conn(0x7fd01815d090 legacy=0x7fd0180cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0180d13c0 con 0x7fd0180cfd70 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fd010001b80 con 0x7fd0180cfd70 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd00ffff700 1 --2- 172.21.15.45:0/639602768 >> v2:172.21.15.73:3300/0 conn(0x7fd0180d0a50 0x7fd0180cf830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 >> v1:172.21.15.45:6789/0 conn(0x7fd0180cfd70 legacy=0x7fd0180b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd004003c00 0x7fd004004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd004004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd004005230 0x7fd00400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180b6040 con 0x7fd004004870 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd00400c100 con 0x7fd004003c00 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd00400c2c0 con 0x7fd004005230 2023-12-19T17:55:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd00ffff700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd004004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd01659c700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd004003c00 0x7fd004004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd016d9d700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd004005230 0x7fd00400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.470+0000 7fd00ffff700 1 -- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd004005230 msgr2=0x7fd00400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd00ffff700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd004005230 0x7fd00400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd00ffff700 1 -- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd004003c00 msgr2=0x7fd004004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd00ffff700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd004003c00 0x7fd004004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd00ffff700 1 -- 172.21.15.45:0/639602768 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0040035d0 con 0x7fd004004870 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01659c700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd004003c00 0x7fd004004000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd016d9d700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd004005230 0x7fd00400ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd016d9d700 1 -- 172.21.15.45:0/639602768 reap_dead start 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd00ffff700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd004004cf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d40 tx=0x7fd0040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ffcf2618f61004 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd000009e90 con 0x7fd004004870 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00000e9a0 con 0x7fd004004870 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd015d9b700 1 -- 172.21.15.45:0/639602768 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00000ed10 con 0x7fd004004870 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 -- 172.21.15.45:0/639602768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 msgr2=0x7fd004004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd004004cf0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd000009d40 tx=0x7fd0040058a0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 -- 172.21.15.45:0/639602768 shutdown_connections 2023-12-19T17:55:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 --2- 172.21.15.45:0/639602768 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd004004cf0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 -- 172.21.15.45:0/639602768 >> 172.21.15.45:0/639602768 conn(0x7fd0180b4b90 msgr2=0x7fd0180b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 -- 172.21.15.45:0/639602768 shutdown_connections 2023-12-19T17:55:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.474+0000 7fd01cd01700 1 -- 172.21.15.45:0/639602768 wait complete. 2023-12-19T17:55:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 Processor -- start 2023-12-19T17:55:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 -- start start 2023-12-19T17:55:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd0180b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd018152170 0x7fd018160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0181e6b10 0x7fd0181e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0181e74d0 con 0x7fd004004870 2023-12-19T17:55:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd018151a50 con 0x7fd018152170 2023-12-19T17:55:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01cd01700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0180b35b0 con 0x7fd0181e6b10 2023-12-19T17:55:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd00ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd018152170 0x7fd018160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.478+0000 7fd01659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd0180b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd0180b3070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43152/0 (socket says 172.21.15.45:43152) 2023-12-19T17:55:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 -- 172.21.15.45:0/3846201614 learned_addr learned my addr 172.21.15.45:0/3846201614 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd016d9d700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0181e6b10 0x7fd0181e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 -- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0181e6b10 msgr2=0x7fd0181e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0181e6b10 0x7fd0181e6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 -- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd018152170 msgr2=0x7fd018160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd018152170 0x7fd018160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 -- 172.21.15.45:0/3846201614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd018151ee0 con 0x7fd004004870 2023-12-19T17:55:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd00ffff700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd018152170 0x7fd018160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.482+0000 7fd01659c700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd0180b3070 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd00800e7b0 tx=0x7fd00800eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.486+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080052e0 con 0x7fd004004870 2023-12-19T17:55:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.486+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd008005440 con 0x7fd004004870 2023-12-19T17:55:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.486+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0080038c0 con 0x7fd004004870 2023-12-19T17:55:20.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.486+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd018160590 con 0x7fd004004870 2023-12-19T17:55:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.486+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd018151120 con 0x7fd004004870 2023-12-19T17:55:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.486+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd01804ed30 con 0x7fd004004870 2023-12-19T17:55:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.490+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd008003a20 con 0x7fd004004870 2023-12-19T17:55:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.490+0000 7fd00effd700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcff8065b20 0x7fcff8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.490+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd008082900 con 0x7fd004004870 2023-12-19T17:55:20.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.490+0000 7fd00ffff700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcff8065b20 0x7fcff8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:20.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.490+0000 7fd00ffff700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcff8065b20 0x7fcff8067fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd0000090b0 tx=0x7fd00001e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:20.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.494+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd0080503a0 con 0x7fd004004870 2023-12-19T17:55:20.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:20.710+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fd0181e8b30 con 0x7fd004004870 2023-12-19T17:55:21.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.250+0000 7fd00effd700 1 -- 172.21.15.45:0/3846201614 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v36) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd0080539c0 con 0x7fd004004870 2023-12-19T17:55:21.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcff8065b20 msgr2=0x7fcff8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcff8065b20 0x7fcff8067fe0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd0000090b0 tx=0x7fd00001e040 comp rx=0 tx=0).stop 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 msgr2=0x7fd0180b3070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd0180b3070 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd00800e7b0 tx=0x7fd00800eac0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 shutdown_connections 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcff8065b20 0x7fcff8067fe0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd0181e6b10 0x7fd0181e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd018152170 0x7fd018160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 --2- 172.21.15.45:0/3846201614 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd004004870 0x7fd0180b3070 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 >> 172.21.15.45:0/3846201614 conn(0x7fd0180b4b90 msgr2=0x7fd0180cdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 shutdown_connections 2023-12-19T17:55:21.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.254+0000 7fd01cd01700 1 -- 172.21.15.45:0/3846201614 wait complete. 2023-12-19T17:55:21.283 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T17:55:21.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:21.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.462+0000 7f935e984700 1 Processor -- start 2023-12-19T17:55:21.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.462+0000 7f935e984700 1 -- start start 2023-12-19T17:55:21.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.462+0000 7f935e984700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93581611c0 0x7f93580c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.462+0000 7f935e984700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580c3f90 con 0x7f93580af720 2023-12-19T17:55:21.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.462+0000 7f935e984700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93580c4270 con 0x7f93581615a0 2023-12-19T17:55:21.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.462+0000 7f935e984700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935806eb30 con 0x7f93581611c0 2023-12-19T17:55:21.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e183700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f93580af720 0x7f935806f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51774/0 (socket says 172.21.15.45:51774) 2023-12-19T17:55:21.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e183700 1 -- 172.21.15.45:0/1475976225 learned_addr learned my addr 172.21.15.45:0/1475976225 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:21.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935d982700 1 --2- 172.21.15.45:0/1475976225 >> v2:172.21.15.45:3300/0 conn(0x7f93581611c0 0x7f93580c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935c980700 1 -- 172.21.15.45:0/1475976225 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1921450511 0 0) 0x7f93580c3f90 con 0x7f93580af720 2023-12-19T17:55:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935c980700 1 -- 172.21.15.45:0/1475976225 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93440035d0 con 0x7f93580af720 2023-12-19T17:55:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935c980700 1 -- 172.21.15.45:0/1475976225 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769157110 0 0) 0x7f93580c4270 con 0x7f93581615a0 2023-12-19T17:55:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935d982700 1 -- 172.21.15.45:0/1475976225 >> v1:172.21.15.73:6789/0 conn(0x7f93581615a0 legacy=0x7f935806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935d982700 1 -- 172.21.15.45:0/1475976225 >> v1:172.21.15.45:6789/0 conn(0x7f93580af720 legacy=0x7f935806f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935d982700 1 -- 172.21.15.45:0/1475976225 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935806ee10 con 0x7f93581611c0 2023-12-19T17:55:21.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935d982700 1 --2- 172.21.15.45:0/1475976225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f93580c3920 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9354009850 tx=0x7f9354009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ad3410e5b92b95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:21.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935c980700 1 -- 172.21.15.45:0/1475976225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354011830 con 0x7f93581611c0 2023-12-19T17:55:21.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935c980700 1 -- 172.21.15.45:0/1475976225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354011990 con 0x7f93581611c0 2023-12-19T17:55:21.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935c980700 1 -- 172.21.15.45:0/1475976225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354011d40 con 0x7f93581611c0 2023-12-19T17:55:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 -- 172.21.15.45:0/1475976225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 msgr2=0x7f93580c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 --2- 172.21.15.45:0/1475976225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f93580c3920 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f9354009850 tx=0x7f9354009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 -- 172.21.15.45:0/1475976225 shutdown_connections 2023-12-19T17:55:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 --2- 172.21.15.45:0/1475976225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f93580c3920 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 -- 172.21.15.45:0/1475976225 >> 172.21.15.45:0/1475976225 conn(0x7f93580cb900 msgr2=0x7f93580b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 -- 172.21.15.45:0/1475976225 shutdown_connections 2023-12-19T17:55:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.466+0000 7f935e984700 1 -- 172.21.15.45:0/1475976225 wait complete. 2023-12-19T17:55:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 Processor -- start 2023-12-19T17:55:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 -- start start 2023-12-19T17:55:21.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93580af720 0x7f9358156000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f9358152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93581615a0 0x7f9358163c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9358156540 con 0x7f93581611c0 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93580c5890 con 0x7f93581615a0 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.470+0000 7f935e984700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93581602e0 con 0x7f93580af720 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f9358152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f9358152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43162/0 (socket says 172.21.15.45:43162) 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 -- 172.21.15.45:0/3290209557 learned_addr learned my addr 172.21.15.45:0/3290209557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d982700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93580af720 0x7f9358156000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935e183700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93581615a0 0x7f9358163c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 -- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93580af720 msgr2=0x7f9358156000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93580af720 0x7f9358156000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 -- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93581615a0 msgr2=0x7f9358163c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93581615a0 0x7f9358163c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 -- 172.21.15.45:0/3290209557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93540094b0 con 0x7f93581611c0 2023-12-19T17:55:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935d181700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f9358152420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f934800c4a0 tx=0x7f934800c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93480054e0 con 0x7f93581611c0 2023-12-19T17:55:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93480036a0 con 0x7f93581611c0 2023-12-19T17:55:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93581605c0 con 0x7f93581611c0 2023-12-19T17:55:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348003a50 con 0x7f93581611c0 2023-12-19T17:55:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93580c5e30 con 0x7f93581611c0 2023-12-19T17:55:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.474+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935806e760 con 0x7f93581611c0 2023-12-19T17:55:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.478+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9348003bb0 con 0x7f93581611c0 2023-12-19T17:55:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.478+0000 7f934e7fc700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f933c065b00 0x7f933c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.478+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9348082570 con 0x7f93581611c0 2023-12-19T17:55:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.478+0000 7f935d982700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f933c065b00 0x7f933c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.482+0000 7f935d982700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f933c065b00 0x7f933c067fc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93540090b0 tx=0x7f9354008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:21.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.486+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f934804fe80 con 0x7f93581611c0 2023-12-19T17:55:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.702+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9358071bb0 con 0x7f93581611c0 2023-12-19T17:55:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.702+0000 7f934e7fc700 1 -- 172.21.15.45:0/3290209557 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f9348003e60 con 0x7f93581611c0 2023-12-19T17:55:21.705 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:21.707 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:55:18.210618+0000","modified":"2023-12-19T17:55:21.235777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/4130274339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4130274339},{"type":"v1","addr":"172.21.15.45:6837","nonce":4130274339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:55:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f933c065b00 msgr2=0x7f933c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f933c065b00 0x7f933c067fc0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f93540090b0 tx=0x7f9354008030 comp rx=0 tx=0).stop 2023-12-19T17:55:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 msgr2=0x7f9358152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f9358152420 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f934800c4a0 tx=0x7f934800c7b0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 shutdown_connections 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f933c065b00 0x7f933c067fc0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93581615a0 0x7f9358163c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93581611c0 0x7f9358152420 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 --2- 172.21.15.45:0/3290209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93580af720 0x7f9358156000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 >> 172.21.15.45:0/3290209557 conn(0x7f93580cb900 msgr2=0x7f93580ca070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 shutdown_connections 2023-12-19T17:55:21.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.706+0000 7f935e984700 1 -- 172.21.15.45:0/3290209557 wait complete. 2023-12-19T17:55:21.712 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-12-19T17:55:21.734 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 Processor -- start 2023-12-19T17:55:21.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 -- start start 2023-12-19T17:55:21.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9dc164690 0x7fd9dc0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9dc164a70 0x7fd9dc0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9dc0cdb80 con 0x7fd9dc0cce30 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc0cd970 con 0x7fd9dc164690 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.922+0000 7fd9e2399700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9dc0cde60 con 0x7fd9dc164a70 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9dc164690 0x7fd9dc0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd9dc164690 0x7fd9dc0c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43172/0 (socket says 172.21.15.45:43172) 2023-12-19T17:55:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 -- 172.21.15.45:0/3200393397 learned_addr learned my addr 172.21.15.45:0/3200393397 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9db7fe700 1 --2- 172.21.15.45:0/3200393397 >> v2:172.21.15.73:3300/0 conn(0x7fd9dc164a70 0x7fd9dc0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 -- 172.21.15.45:0/3200393397 >> v2:172.21.15.73:3300/0 conn(0x7fd9dc164a70 msgr2=0x7fd9dc0c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 --2- 172.21.15.45:0/3200393397 >> v2:172.21.15.73:3300/0 conn(0x7fd9dc164a70 0x7fd9dc0c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 -- 172.21.15.45:0/3200393397 >> v1:172.21.15.73:6789/0 conn(0x7fd9dc0cce30 legacy=0x7fd9dc0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 -- 172.21.15.45:0/3200393397 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9dc0ce140 con 0x7fd9dc164690 2023-12-19T17:55:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9dbfff700 1 --2- 172.21.15.45:0/3200393397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164690 0x7fd9dc0c3e00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0b4b60 tx=0x7fd9cc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900797ab84d0f95b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9daffd700 1 -- 172.21.15.45:0/3200393397 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00b8a0 con 0x7fd9dc164690 2023-12-19T17:55:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9daffd700 1 -- 172.21.15.45:0/3200393397 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9cc00ba00 con 0x7fd9dc164690 2023-12-19T17:55:21.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9daffd700 1 -- 172.21.15.45:0/3200393397 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9cc00bd90 con 0x7fd9dc164690 2023-12-19T17:55:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 -- 172.21.15.45:0/3200393397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164690 msgr2=0x7fd9dc0c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 --2- 172.21.15.45:0/3200393397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164690 0x7fd9dc0c3e00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc0b4b60 tx=0x7fd9cc009bf0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 -- 172.21.15.45:0/3200393397 shutdown_connections 2023-12-19T17:55:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 --2- 172.21.15.45:0/3200393397 >> v2:172.21.15.73:3300/0 conn(0x7fd9dc164a70 0x7fd9dc0c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 --2- 172.21.15.45:0/3200393397 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164690 0x7fd9dc0c3e00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 -- 172.21.15.45:0/3200393397 >> 172.21.15.45:0/3200393397 conn(0x7fd9dc0cba40 msgr2=0x7fd9dc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 -- 172.21.15.45:0/3200393397 shutdown_connections 2023-12-19T17:55:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.926+0000 7fd9e2399700 1 -- 172.21.15.45:0/3200393397 wait complete. 2023-12-19T17:55:21.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.930+0000 7fd9e2399700 1 Processor -- start 2023-12-19T17:55:21.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.930+0000 7fd9e2399700 1 -- start start 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9dc0cce30 0x7fd9dc0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9dc164690 0x7fd9dc0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 0x7fd9dc1608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc14d650 con 0x7fd9dc164a70 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc14df20 con 0x7fd9dc164690 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc14dc40 con 0x7fd9dc0cce30 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 0x7fd9dc1608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 0x7fd9dc1608e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43178/0 (socket says 172.21.15.45:43178) 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 -- 172.21.15.45:0/1346030668 learned_addr learned my addr 172.21.15.45:0/1346030668 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9db7fe700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9dc164690 0x7fd9dc0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9dbfff700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9dc0cce30 0x7fd9dc0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 -- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9dc0cce30 msgr2=0x7fd9dc0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9dc0cce30 0x7fd9dc0c8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 -- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9dc164690 msgr2=0x7fd9dc0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9dc164690 0x7fd9dc0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 -- 172.21.15.45:0/1346030668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9cc009570 con 0x7fd9dc164a70 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e0936700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 0x7fd9dc1608e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400cb50 tx=0x7fd9d400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d4003c70 con 0x7fd9dc164a70 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d4003dd0 con 0x7fd9dc164a70 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d400aa20 con 0x7fd9dc164a70 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc0c7560 con 0x7fd9dc164a70 2023-12-19T17:55:21.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.934+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc0c7b20 con 0x7fd9dc164a70 2023-12-19T17:55:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.938+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc0c7d40 con 0x7fd9dc164a70 2023-12-19T17:55:21.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.938+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd9d400ab80 con 0x7fd9dc164a70 2023-12-19T17:55:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.942+0000 7fd9d8ff9700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9c8065ad0 0x7fd9c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.942+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd9d4083280 con 0x7fd9dc164a70 2023-12-19T17:55:21.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.942+0000 7fd9dbfff700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9c8065ad0 0x7fd9c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:21.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.942+0000 7fd9dbfff700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9c8065ad0 0x7fd9c8067f90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc000c00 tx=0x7fd9cc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:21.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:21.946+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd9d4050b00 con 0x7fd9dc164a70 2023-12-19T17:55:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.122+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9dc04ed30 con 0x7fd9dc164a70 2023-12-19T17:55:22.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.126+0000 7fd9d8ff9700 1 -- 172.21.15.45:0/1346030668 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+16254 (secure 0 0 0) 0x7fd9d4054120 con 0x7fd9dc164a70 2023-12-19T17:55:22.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:22.129 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:19.217149+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:22.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9c8065ad0 msgr2=0x7fd9c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9c8065ad0 0x7fd9c8067f90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd9cc000c00 tx=0x7fd9cc008030 comp rx=0 tx=0).stop 2023-12-19T17:55:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 msgr2=0x7fd9dc1608e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 0x7fd9dc1608e0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fd9d400cb50 tx=0x7fd9d400ce60 comp rx=0 tx=0).stop 2023-12-19T17:55:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 shutdown_connections 2023-12-19T17:55:22.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9c8065ad0 0x7fd9c8067f90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9dc164a70 0x7fd9dc1608e0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9dc164690 0x7fd9dc0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 --2- 172.21.15.45:0/1346030668 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9dc0cce30 0x7fd9dc0c8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 >> 172.21.15.45:0/1346030668 conn(0x7fd9dc0cba40 msgr2=0x7fd9dc0c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 shutdown_connections 2023-12-19T17:55:22.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.130+0000 7fd9e2399700 1 -- 172.21.15.45:0/1346030668 wait complete. 2023-12-19T17:55:22.155 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T17:55:22.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:55:22.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.334+0000 7fb0d8757700 1 Processor -- start 2023-12-19T17:55:22.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.334+0000 7fb0d8757700 1 -- start start 2023-12-19T17:55:22.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.338+0000 7fb0d8757700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 0x7fb0d00cc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.338+0000 7fb0d8757700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d00c5870 con 0x7fb0d006c850 2023-12-19T17:55:22.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.338+0000 7fb0d8757700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0d015e6d0 con 0x7fb0d0159dd0 2023-12-19T17:55:22.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.338+0000 7fb0d8757700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00c4ca0 con 0x7fb0d00ade00 2023-12-19T17:55:22.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.338+0000 7fb0d6cf4700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb0d006c850 0x7fb0d006cce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51786/0 (socket says 172.21.15.45:51786) 2023-12-19T17:55:22.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.338+0000 7fb0d6cf4700 1 -- 172.21.15.45:0/572152870 learned_addr learned my addr 172.21.15.45:0/572152870 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d5cf2700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 0x7fb0d00cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1802215147 0 0) 0x7fb0d00c5870 con 0x7fb0d006c850 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0bc0057e0 con 0x7fb0d006c850 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 591763929 0 0) 0x7fb0d015e6d0 con 0x7fb0d0159dd0 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0d00c5870 con 0x7fb0d0159dd0 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477786798 0 0) 0x7fb0bc0057e0 con 0x7fb0d006c850 2023-12-19T17:55:22.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 msgr2=0x7fb0d00cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 0x7fb0d00cc560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 >> v1:172.21.15.73:6789/0 conn(0x7fb0d0159dd0 legacy=0x7fb0d00c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d0070110 con 0x7fb0d006c850 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fb0c8001a40 con 0x7fb0d006c850 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 >> v1:172.21.15.45:6789/0 conn(0x7fb0d006c850 legacy=0x7fb0d006cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc005df0 0x7fb0bc0061f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 0x7fb0bc006a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0bc006fc0 0x7fb0bc007440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00c4ca0 con 0x7fb0bc006fc0 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc00dd40 con 0x7fb0bc005df0 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0bc00df00 con 0x7fb0d00ade00 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0bc006fc0 0x7fb0bc007440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d5cf2700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 0x7fb0bc006a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d64f3700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc005df0 0x7fb0bc0061f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 -- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 msgr2=0x7fb0bc006a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:22.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00ade00 0x7fb0bc006a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 -- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc005df0 msgr2=0x7fb0bc0061f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:22.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc005df0 0x7fb0bc0061f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 -- 172.21.15.45:0/572152870 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0bc0057e0 con 0x7fb0bc006fc0 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d64f3700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc005df0 0x7fb0bc0061f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d6cf4700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0bc006fc0 0x7fb0bc007440 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800a760 tx=0x7fb0bc007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8936c8c2b5cfb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80072d0 con 0x7fb0bc006fc0 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c8007430 con 0x7fb0bc006fc0 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.342+0000 7fb0d54f1700 1 -- 172.21.15.45:0/572152870 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c80077e0 con 0x7fb0bc006fc0 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 -- 172.21.15.45:0/572152870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0bc006fc0 msgr2=0x7fb0bc007440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 --2- 172.21.15.45:0/572152870 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0bc006fc0 0x7fb0bc007440 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb0c800a760 tx=0x7fb0bc007ab0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d6cf4700 1 -- 172.21.15.45:0/572152870 reap_dead start 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 -- 172.21.15.45:0/572152870 shutdown_connections 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 -- 172.21.15.45:0/572152870 >> 172.21.15.45:0/572152870 conn(0x7fb0d00cba40 msgr2=0x7fb0d00ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 -- 172.21.15.45:0/572152870 shutdown_connections 2023-12-19T17:55:22.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 -- 172.21.15.45:0/572152870 wait complete. 2023-12-19T17:55:22.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 Processor -- start 2023-12-19T17:55:22.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.346+0000 7fb0d8757700 1 -- start start 2023-12-19T17:55:22.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc006fc0 0x7fb0d0149460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 0x7fb0d00ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00aecf0 0x7fb0d00b3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d00af1a0 con 0x7fb0d00ae330 2023-12-19T17:55:22.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d015ab70 con 0x7fb0bc006fc0 2023-12-19T17:55:22.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d015ae50 con 0x7fb0d00aecf0 2023-12-19T17:55:22.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 0x7fb0d00ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 0x7fb0d00ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43194/0 (socket says 172.21.15.45:43194) 2023-12-19T17:55:22.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 -- 172.21.15.45:0/2512453478 learned_addr learned my addr 172.21.15.45:0/2512453478 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:22.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d64f3700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc006fc0 0x7fb0d0149460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d6cf4700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00aecf0 0x7fb0d00b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 -- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00aecf0 msgr2=0x7fb0d00b3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00aecf0 0x7fb0d00b3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 -- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc006fc0 msgr2=0x7fb0d0149460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc006fc0 0x7fb0d0149460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 -- 172.21.15.45:0/2512453478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0d015b130 con 0x7fb0d00ae330 2023-12-19T17:55:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d5cf2700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 0x7fb0d00ae7b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0011a20 tx=0x7fb0c0011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c0011ec0 con 0x7fb0d00ae330 2023-12-19T17:55:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0c000f940 con 0x7fb0d00ae330 2023-12-19T17:55:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d015b410 con 0x7fb0d00ae330 2023-12-19T17:55:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0c000fcd0 con 0x7fb0d00ae330 2023-12-19T17:55:22.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.350+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d01499a0 con 0x7fb0d00ae330 2023-12-19T17:55:22.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.354+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0d00c48a0 con 0x7fb0d00ae330 2023-12-19T17:55:22.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.354+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb0c0014440 con 0x7fb0d00ae330 2023-12-19T17:55:22.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.358+0000 7fb0c6ffd700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb0b4065b00 0x7fb0b4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.358+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb0c00838e0 con 0x7fb0d00ae330 2023-12-19T17:55:22.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.358+0000 7fb0d64f3700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb0b4065b00 0x7fb0b4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.358+0000 7fb0d64f3700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb0b4065b00 0x7fb0b4067fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006f8f0 tx=0x7fb0cc0012d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:22.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.366+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb0d00c48a0 con 0x7fb0d00ae330 2023-12-19T17:55:22.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.534+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0d00703f0 con 0x7fb0b4065b00 2023-12-19T17:55:22.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.546+0000 7fb0c6ffd700 1 -- 172.21.15.45:0/2512453478 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286740 (secure 0 0 0) 0x7fb0cc011710 con 0x7fb0b4065b00 2023-12-19T17:55:22.556 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb0b4065b00 msgr2=0x7fb0b4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb0b4065b00 0x7fb0b4067fc0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb0d006f8f0 tx=0x7fb0cc0012d0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 msgr2=0x7fb0d00ae7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 0x7fb0d00ae7b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fb0c0011a20 tx=0x7fb0c0011d30 comp rx=0 tx=0).stop 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 shutdown_connections 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb0b4065b00 0x7fb0b4067fc0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb0d00aecf0 0x7fb0d00b3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb0d00ae330 0x7fb0d00ae7b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 --2- 172.21.15.45:0/2512453478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb0bc006fc0 0x7fb0d0149460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 >> 172.21.15.45:0/2512453478 conn(0x7fb0d00cba40 msgr2=0x7fb0d006db00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 shutdown_connections 2023-12-19T17:55:22.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.554+0000 7fb0d8757700 1 -- 172.21.15.45:0/2512453478 wait complete. 2023-12-19T17:55:22.560 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:55:22.582 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-12-19T17:55:22.275917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239140,"kb_used_data":7140,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735580,"statfs":{"total":773094113280,"available":772849233920,"internally_reserved":0,"allocated":7311360,"data_stored":3992721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.548728"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487637+0000","last_change":"2023-12-19T17:55:18.251892+0000","last_active":"2023-12-19T17:55:20.487637+0000","last_peered":"2023-12-19T17:55:20.487637+0000","last_clean":"2023-12-19T17:55:20.487637+0000","last_became_active":"2023-12-19T17:55:18.251684+0000","last_became_peered":"2023-12-19T17:55:18.251684+0000","last_unstale":"2023-12-19T17:55:20.487637+0000","last_undegraded":"2023-12-19T17:55:20.487637+0000","last_fullsized":"2023-12-19T17:55:20.487637+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486668+0000","last_change":"2023-12-19T17:55:18.244171+0000","last_active":"2023-12-19T17:55:20.486668+0000","last_peered":"2023-12-19T17:55:20.486668+0000","last_clean":"2023-12-19T17:55:20.486668+0000","last_became_active":"2023-12-19T17:55:18.243932+0000","last_became_peered":"2023-12-19T17:55:18.243932+0000","last_unstale":"2023-12-19T17:55:20.486668+0000","last_undegraded":"2023-12-19T17:55:20.486668+0000","last_fullsized":"2023-12-19T17:55:20.486668+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:45.075256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240320+0000","last_change":"2023-12-19T17:55:18.249971+0000","last_active":"2023-12-19T17:55:19.240320+0000","last_peered":"2023-12-19T17:55:19.240320+0000","last_clean":"2023-12-19T17:55:19.240320+0000","last_became_active":"2023-12-19T17:55:18.247351+0000","last_became_peered":"2023-12-19T17:55:18.247351+0000","last_unstale":"2023-12-19T17:55:19.240320+0000","last_undegraded":"2023-12-19T17:55:19.240320+0000","last_fullsized":"2023-12-19T17:55:19.240320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:58.514888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238428+0000","last_change":"2023-12-19T17:55:18.242650+0000","last_active":"2023-12-19T17:55:19.238428+0000","last_peered":"2023-12-19T17:55:19.238428+0000","last_clean":"2023-12-19T17:55:19.238428+0000","last_became_active":"2023-12-19T17:55:18.242417+0000","last_became_peered":"2023-12-19T17:55:18.242417+0000","last_unstale":"2023-12-19T17:55:19.238428+0000","last_undegraded":"2023-12-19T17:55:19.238428+0000","last_fullsized":"2023-12-19T17:55:19.238428+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:19.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487155+0000","last_change":"2023-12-19T17:55:18.247728+0000","last_active":"2023-12-19T17:55:20.487155+0000","last_peered":"2023-12-19T17:55:20.487155+0000","last_clean":"2023-12-19T17:55:20.487155+0000","last_became_active":"2023-12-19T17:55:18.245555+0000","last_became_peered":"2023-12-19T17:55:18.245555+0000","last_unstale":"2023-12-19T17:55:20.487155+0000","last_undegraded":"2023-12-19T17:55:20.487155+0000","last_fullsized":"2023-12-19T17:55:20.487155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:45.289604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488709+0000","last_change":"2023-12-19T17:55:18.260983+0000","last_active":"2023-12-19T17:55:20.488709+0000","last_peered":"2023-12-19T17:55:20.488709+0000","last_clean":"2023-12-19T17:55:20.488709+0000","last_became_active":"2023-12-19T17:55:18.256823+0000","last_became_peered":"2023-12-19T17:55:18.256823+0000","last_unstale":"2023-12-19T17:55:20.488709+0000","last_undegraded":"2023-12-19T17:55:20.488709+0000","last_fullsized":"2023-12-19T17:55:20.488709+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:02:28.018362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487796+0000","last_change":"2023-12-19T17:55:18.239836+0000","last_active":"2023-12-19T17:55:20.487796+0000","last_peered":"2023-12-19T17:55:20.487796+0000","last_clean":"2023-12-19T17:55:20.487796+0000","last_became_active":"2023-12-19T17:55:18.239555+0000","last_became_peered":"2023-12-19T17:55:18.239555+0000","last_unstale":"2023-12-19T17:55:20.487796+0000","last_undegraded":"2023-12-19T17:55:20.487796+0000","last_fullsized":"2023-12-19T17:55:20.487796+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:25.506293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487544+0000","last_change":"2023-12-19T17:55:18.251815+0000","last_active":"2023-12-19T17:55:20.487544+0000","last_peered":"2023-12-19T17:55:20.487544+0000","last_clean":"2023-12-19T17:55:20.487544+0000","last_became_active":"2023-12-19T17:55:18.251568+0000","last_became_peered":"2023-12-19T17:55:18.251568+0000","last_unstale":"2023-12-19T17:55:20.487544+0000","last_undegraded":"2023-12-19T17:55:20.487544+0000","last_fullsized":"2023-12-19T17:55:20.487544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:45.724115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488396+0000","last_change":"2023-12-19T17:55:18.263099+0000","last_active":"2023-12-19T17:55:20.488396+0000","last_peered":"2023-12-19T17:55:20.488396+0000","last_clean":"2023-12-19T17:55:20.488396+0000","last_became_active":"2023-12-19T17:55:18.262812+0000","last_became_peered":"2023-12-19T17:55:18.262812+0000","last_unstale":"2023-12-19T17:55:20.488396+0000","last_undegraded":"2023-12-19T17:55:20.488396+0000","last_fullsized":"2023-12-19T17:55:20.488396+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:59.319307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487736+0000","last_change":"2023-12-19T17:55:18.246594+0000","last_active":"2023-12-19T17:55:20.487736+0000","last_peered":"2023-12-19T17:55:20.487736+0000","last_clean":"2023-12-19T17:55:20.487736+0000","last_became_active":"2023-12-19T17:55:18.246354+0000","last_became_peered":"2023-12-19T17:55:18.246354+0000","last_unstale":"2023-12-19T17:55:20.487736+0000","last_undegraded":"2023-12-19T17:55:20.487736+0000","last_fullsized":"2023-12-19T17:55:20.487736+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486687+0000","last_change":"2023-12-19T17:55:18.253372+0000","last_active":"2023-12-19T17:55:20.486687+0000","last_peered":"2023-12-19T17:55:20.486687+0000","last_clean":"2023-12-19T17:55:20.486687+0000","last_became_active":"2023-12-19T17:55:18.252840+0000","last_became_peered":"2023-12-19T17:55:18.252840+0000","last_unstale":"2023-12-19T17:55:20.486687+0000","last_undegraded":"2023-12-19T17:55:20.486687+0000","last_fullsized":"2023-12-19T17:55:20.486687+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:51.030123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238604+0000","last_change":"2023-12-19T17:55:18.236730+0000","last_active":"2023-12-19T17:55:19.238604+0000","last_peered":"2023-12-19T17:55:19.238604+0000","last_clean":"2023-12-19T17:55:19.238604+0000","last_became_active":"2023-12-19T17:55:18.236414+0000","last_became_peered":"2023-12-19T17:55:18.236414+0000","last_unstale":"2023-12-19T17:55:19.238604+0000","last_undegraded":"2023-12-19T17:55:19.238604+0000","last_fullsized":"2023-12-19T17:55:19.238604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:17.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240656+0000","last_change":"2023-12-19T17:55:18.259970+0000","last_active":"2023-12-19T17:55:19.240656+0000","last_peered":"2023-12-19T17:55:19.240656+0000","last_clean":"2023-12-19T17:55:19.240656+0000","last_became_active":"2023-12-19T17:55:18.259577+0000","last_became_peered":"2023-12-19T17:55:18.259577+0000","last_unstale":"2023-12-19T17:55:19.240656+0000","last_undegraded":"2023-12-19T17:55:19.240656+0000","last_fullsized":"2023-12-19T17:55:19.240656+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:53.873021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487894+0000","last_change":"2023-12-19T17:55:18.247564+0000","last_active":"2023-12-19T17:55:20.487894+0000","last_peered":"2023-12-19T17:55:20.487894+0000","last_clean":"2023-12-19T17:55:20.487894+0000","last_became_active":"2023-12-19T17:55:18.247057+0000","last_became_peered":"2023-12-19T17:55:18.247057+0000","last_unstale":"2023-12-19T17:55:20.487894+0000","last_undegraded":"2023-12-19T17:55:20.487894+0000","last_fullsized":"2023-12-19T17:55:20.487894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487963+0000","last_change":"2023-12-19T17:55:18.243756+0000","last_active":"2023-12-19T17:55:20.487963+0000","last_peered":"2023-12-19T17:55:20.487963+0000","last_clean":"2023-12-19T17:55:20.487963+0000","last_became_active":"2023-12-19T17:55:18.243395+0000","last_became_peered":"2023-12-19T17:55:18.243395+0000","last_unstale":"2023-12-19T17:55:20.487963+0000","last_undegraded":"2023-12-19T17:55:20.487963+0000","last_fullsized":"2023-12-19T17:55:20.487963+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:20.744879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486442+0000","last_change":"2023-12-19T17:55:18.257215+0000","last_active":"2023-12-19T17:55:20.486442+0000","last_peered":"2023-12-19T17:55:20.486442+0000","last_clean":"2023-12-19T17:55:20.486442+0000","last_became_active":"2023-12-19T17:55:18.256890+0000","last_became_peered":"2023-12-19T17:55:18.256890+0000","last_unstale":"2023-12-19T17:55:20.486442+0000","last_undegraded":"2023-12-19T17:55:20.486442+0000","last_fullsized":"2023-12-19T17:55:20.486442+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:35.799571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487871+0000","last_change":"2023-12-19T17:55:18.242029+0000","last_active":"2023-12-19T17:55:20.487871+0000","last_peered":"2023-12-19T17:55:20.487871+0000","last_clean":"2023-12-19T17:55:20.487871+0000","last_became_active":"2023-12-19T17:55:18.241704+0000","last_became_peered":"2023-12-19T17:55:18.241704+0000","last_unstale":"2023-12-19T17:55:20.487871+0000","last_undegraded":"2023-12-19T17:55:20.487871+0000","last_fullsized":"2023-12-19T17:55:20.487871+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:02.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240874+0000","last_change":"2023-12-19T17:55:18.261651+0000","last_active":"2023-12-19T17:55:19.240874+0000","last_peered":"2023-12-19T17:55:19.240874+0000","last_clean":"2023-12-19T17:55:19.240874+0000","last_became_active":"2023-12-19T17:55:18.261306+0000","last_became_peered":"2023-12-19T17:55:18.261306+0000","last_unstale":"2023-12-19T17:55:19.240874+0000","last_undegraded":"2023-12-19T17:55:19.240874+0000","last_fullsized":"2023-12-19T17:55:19.240874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:08.057743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487541+0000","last_change":"2023-12-19T17:55:18.254025+0000","last_active":"2023-12-19T17:55:20.487541+0000","last_peered":"2023-12-19T17:55:20.487541+0000","last_clean":"2023-12-19T17:55:20.487541+0000","last_became_active":"2023-12-19T17:55:18.253745+0000","last_became_peered":"2023-12-19T17:55:18.253745+0000","last_unstale":"2023-12-19T17:55:20.487541+0000","last_undegraded":"2023-12-19T17:55:20.487541+0000","last_fullsized":"2023-12-19T17:55:20.487541+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:32.622524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487353+0000","last_change":"2023-12-19T17:55:18.262825+0000","last_active":"2023-12-19T17:55:20.487353+0000","last_peered":"2023-12-19T17:55:20.487353+0000","last_clean":"2023-12-19T17:55:20.487353+0000","last_became_active":"2023-12-19T17:55:18.262589+0000","last_became_peered":"2023-12-19T17:55:18.262589+0000","last_unstale":"2023-12-19T17:55:20.487353+0000","last_undegraded":"2023-12-19T17:55:20.487353+0000","last_fullsized":"2023-12-19T17:55:20.487353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:16.952866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239865+0000","last_change":"2023-12-19T17:55:18.239837+0000","last_active":"2023-12-19T17:55:19.239865+0000","last_peered":"2023-12-19T17:55:19.239865+0000","last_clean":"2023-12-19T17:55:19.239865+0000","last_became_active":"2023-12-19T17:55:18.239569+0000","last_became_peered":"2023-12-19T17:55:18.239569+0000","last_unstale":"2023-12-19T17:55:19.239865+0000","last_undegraded":"2023-12-19T17:55:19.239865+0000","last_fullsized":"2023-12-19T17:55:19.239865+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:28.439890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487170+0000","last_change":"2023-12-19T17:55:18.253471+0000","last_active":"2023-12-19T17:55:20.487170+0000","last_peered":"2023-12-19T17:55:20.487170+0000","last_clean":"2023-12-19T17:55:20.487170+0000","last_became_active":"2023-12-19T17:55:18.253203+0000","last_became_peered":"2023-12-19T17:55:18.253203+0000","last_unstale":"2023-12-19T17:55:20.487170+0000","last_undegraded":"2023-12-19T17:55:20.487170+0000","last_fullsized":"2023-12-19T17:55:20.487170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:17.789720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239669+0000","last_change":"2023-12-19T17:55:18.252965+0000","last_active":"2023-12-19T17:55:19.239669+0000","last_peered":"2023-12-19T17:55:19.239669+0000","last_clean":"2023-12-19T17:55:19.239669+0000","last_became_active":"2023-12-19T17:55:18.252207+0000","last_became_peered":"2023-12-19T17:55:18.252207+0000","last_unstale":"2023-12-19T17:55:19.239669+0000","last_undegraded":"2023-12-19T17:55:19.239669+0000","last_fullsized":"2023-12-19T17:55:19.239669+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:57.908847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240156+0000","last_change":"2023-12-19T17:55:18.259959+0000","last_active":"2023-12-19T17:55:19.240156+0000","last_peered":"2023-12-19T17:55:19.240156+0000","last_clean":"2023-12-19T17:55:19.240156+0000","last_became_active":"2023-12-19T17:55:18.259459+0000","last_became_peered":"2023-12-19T17:55:18.259459+0000","last_unstale":"2023-12-19T17:55:19.240156+0000","last_undegraded":"2023-12-19T17:55:19.240156+0000","last_fullsized":"2023-12-19T17:55:19.240156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:55.682253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488117+0000","last_change":"2023-12-19T17:55:18.248233+0000","last_active":"2023-12-19T17:55:20.488117+0000","last_peered":"2023-12-19T17:55:20.488117+0000","last_clean":"2023-12-19T17:55:20.488117+0000","last_became_active":"2023-12-19T17:55:18.247987+0000","last_became_peered":"2023-12-19T17:55:18.247987+0000","last_unstale":"2023-12-19T17:55:20.488117+0000","last_undegraded":"2023-12-19T17:55:20.488117+0000","last_fullsized":"2023-12-19T17:55:20.488117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:08.230886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238630+0000","last_change":"2023-12-19T17:55:18.255489+0000","last_active":"2023-12-19T17:55:19.238630+0000","last_peered":"2023-12-19T17:55:19.238630+0000","last_clean":"2023-12-19T17:55:19.238630+0000","last_became_active":"2023-12-19T17:55:18.255204+0000","last_became_peered":"2023-12-19T17:55:18.255204+0000","last_unstale":"2023-12-19T17:55:19.238630+0000","last_undegraded":"2023-12-19T17:55:19.238630+0000","last_fullsized":"2023-12-19T17:55:19.238630+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:58.514888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488884+0000","last_change":"2023-12-19T17:55:18.257284+0000","last_active":"2023-12-19T17:55:20.488884+0000","last_peered":"2023-12-19T17:55:20.488884+0000","last_clean":"2023-12-19T17:55:20.488884+0000","last_became_active":"2023-12-19T17:55:18.257019+0000","last_became_peered":"2023-12-19T17:55:18.257019+0000","last_unstale":"2023-12-19T17:55:20.488884+0000","last_undegraded":"2023-12-19T17:55:20.488884+0000","last_fullsized":"2023-12-19T17:55:20.488884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:19.086583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487325+0000","last_change":"2023-12-19T17:55:18.241647+0000","last_active":"2023-12-19T17:55:20.487325+0000","last_peered":"2023-12-19T17:55:20.487325+0000","last_clean":"2023-12-19T17:55:20.487325+0000","last_became_active":"2023-12-19T17:55:18.241398+0000","last_became_peered":"2023-12-19T17:55:18.241398+0000","last_unstale":"2023-12-19T17:55:20.487325+0000","last_undegraded":"2023-12-19T17:55:20.487325+0000","last_fullsized":"2023-12-19T17:55:20.487325+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:29.088748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487322+0000","last_change":"2023-12-19T17:55:18.249643+0000","last_active":"2023-12-19T17:55:20.487322+0000","last_peered":"2023-12-19T17:55:20.487322+0000","last_clean":"2023-12-19T17:55:20.487322+0000","last_became_active":"2023-12-19T17:55:18.249219+0000","last_became_peered":"2023-12-19T17:55:18.249219+0000","last_unstale":"2023-12-19T17:55:20.487322+0000","last_undegraded":"2023-12-19T17:55:20.487322+0000","last_fullsized":"2023-12-19T17:55:20.487322+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:38.494974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239857+0000","last_change":"2023-12-19T17:55:18.245660+0000","last_active":"2023-12-19T17:55:19.239857+0000","last_peered":"2023-12-19T17:55:19.239857+0000","last_clean":"2023-12-19T17:55:19.239857+0000","last_became_active":"2023-12-19T17:55:18.245315+0000","last_became_peered":"2023-12-19T17:55:18.245315+0000","last_unstale":"2023-12-19T17:55:19.239857+0000","last_undegraded":"2023-12-19T17:55:19.239857+0000","last_fullsized":"2023-12-19T17:55:19.239857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:39.410616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487022+0000","last_change":"2023-12-19T17:55:18.248489+0000","last_active":"2023-12-19T17:55:20.487022+0000","last_peered":"2023-12-19T17:55:20.487022+0000","last_clean":"2023-12-19T17:55:20.487022+0000","last_became_active":"2023-12-19T17:55:18.246595+0000","last_became_peered":"2023-12-19T17:55:18.246595+0000","last_unstale":"2023-12-19T17:55:20.487022+0000","last_undegraded":"2023-12-19T17:55:20.487022+0000","last_fullsized":"2023-12-19T17:55:20.487022+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:43.684105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486529+0000","last_change":"2023-12-19T17:55:18.261826+0000","last_active":"2023-12-19T17:55:20.486529+0000","last_peered":"2023-12-19T17:55:20.486529+0000","last_clean":"2023-12-19T17:55:20.486529+0000","last_became_active":"2023-12-19T17:55:18.261544+0000","last_became_peered":"2023-12-19T17:55:18.261544+0000","last_unstale":"2023-12-19T17:55:20.486529+0000","last_undegraded":"2023-12-19T17:55:20.486529+0000","last_fullsized":"2023-12-19T17:55:20.486529+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:11.437430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489302+0000","last_change":"2023-12-19T17:55:18.260189+0000","last_active":"2023-12-19T17:55:20.489302+0000","last_peered":"2023-12-19T17:55:20.489302+0000","last_clean":"2023-12-19T17:55:20.489302+0000","last_became_active":"2023-12-19T17:55:18.259935+0000","last_became_peered":"2023-12-19T17:55:18.259935+0000","last_unstale":"2023-12-19T17:55:20.489302+0000","last_undegraded":"2023-12-19T17:55:20.489302+0000","last_fullsized":"2023-12-19T17:55:20.489302+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:07:30.237965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489674+0000","last_change":"2023-12-19T17:55:17.767635+0000","last_active":"2023-12-19T17:55:20.489674+0000","last_peered":"2023-12-19T17:55:20.489674+0000","last_clean":"2023-12-19T17:55:20.489674+0000","last_became_active":"2023-12-19T17:55:17.767359+0000","last_became_peered":"2023-12-19T17:55:17.767359+0000","last_unstale":"2023-12-19T17:55:20.489674+0000","last_undegraded":"2023-12-19T17:55:20.489674+0000","last_fullsized":"2023-12-19T17:55:20.489674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:12.184942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488130+0000","last_change":"2023-12-19T17:55:18.236470+0000","last_active":"2023-12-19T17:55:20.488130+0000","last_peered":"2023-12-19T17:55:20.488130+0000","last_clean":"2023-12-19T17:55:20.488130+0000","last_became_active":"2023-12-19T17:55:18.236212+0000","last_became_peered":"2023-12-19T17:55:18.236212+0000","last_unstale":"2023-12-19T17:55:20.488130+0000","last_undegraded":"2023-12-19T17:55:20.488130+0000","last_fullsized":"2023-12-19T17:55:20.488130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:10.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486774+0000","last_change":"2023-12-19T17:55:17.758562+0000","last_active":"2023-12-19T17:55:20.486774+0000","last_peered":"2023-12-19T17:55:20.486774+0000","last_clean":"2023-12-19T17:55:20.486774+0000","last_became_active":"2023-12-19T17:55:17.758267+0000","last_became_peered":"2023-12-19T17:55:17.758267+0000","last_unstale":"2023-12-19T17:55:20.486774+0000","last_undegraded":"2023-12-19T17:55:20.486774+0000","last_fullsized":"2023-12-19T17:55:20.486774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:24.015088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488795+0000","last_change":"2023-12-19T17:55:18.253444+0000","last_active":"2023-12-19T17:55:20.488795+0000","last_peered":"2023-12-19T17:55:20.488795+0000","last_clean":"2023-12-19T17:55:20.488795+0000","last_became_active":"2023-12-19T17:55:18.253203+0000","last_became_peered":"2023-12-19T17:55:18.253203+0000","last_unstale":"2023-12-19T17:55:20.488795+0000","last_undegraded":"2023-12-19T17:55:20.488795+0000","last_fullsized":"2023-12-19T17:55:20.488795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:22.197372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489155+0000","last_change":"2023-12-19T17:55:17.760137+0000","last_active":"2023-12-19T17:55:20.489155+0000","last_peered":"2023-12-19T17:55:20.489155+0000","last_clean":"2023-12-19T17:55:20.489155+0000","last_became_active":"2023-12-19T17:55:17.759868+0000","last_became_peered":"2023-12-19T17:55:17.759868+0000","last_unstale":"2023-12-19T17:55:20.489155+0000","last_undegraded":"2023-12-19T17:55:20.489155+0000","last_fullsized":"2023-12-19T17:55:20.489155+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:52.174805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489104+0000","last_change":"2023-12-19T17:55:18.257228+0000","last_active":"2023-12-19T17:55:20.489104+0000","last_peered":"2023-12-19T17:55:20.489104+0000","last_clean":"2023-12-19T17:55:20.489104+0000","last_became_active":"2023-12-19T17:55:18.256910+0000","last_became_peered":"2023-12-19T17:55:18.256910+0000","last_unstale":"2023-12-19T17:55:20.489104+0000","last_undegraded":"2023-12-19T17:55:20.489104+0000","last_fullsized":"2023-12-19T17:55:20.489104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:35:56.251006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238795+0000","last_change":"2023-12-19T17:55:17.764741+0000","last_active":"2023-12-19T17:55:19.238795+0000","last_peered":"2023-12-19T17:55:19.238795+0000","last_clean":"2023-12-19T17:55:19.238795+0000","last_became_active":"2023-12-19T17:55:17.764378+0000","last_became_peered":"2023-12-19T17:55:17.764378+0000","last_unstale":"2023-12-19T17:55:19.238795+0000","last_undegraded":"2023-12-19T17:55:19.238795+0000","last_fullsized":"2023-12-19T17:55:19.238795+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:50.699133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486889+0000","last_change":"2023-12-19T17:55:18.246805+0000","last_active":"2023-12-19T17:55:20.486889+0000","last_peered":"2023-12-19T17:55:20.486889+0000","last_clean":"2023-12-19T17:55:20.486889+0000","last_became_active":"2023-12-19T17:55:18.246486+0000","last_became_peered":"2023-12-19T17:55:18.246486+0000","last_unstale":"2023-12-19T17:55:20.486889+0000","last_undegraded":"2023-12-19T17:55:20.486889+0000","last_fullsized":"2023-12-19T17:55:20.486889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:55.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488157+0000","last_change":"2023-12-19T17:55:17.762133+0000","last_active":"2023-12-19T17:55:20.488157+0000","last_peered":"2023-12-19T17:55:20.488157+0000","last_clean":"2023-12-19T17:55:20.488157+0000","last_became_active":"2023-12-19T17:55:17.761864+0000","last_became_peered":"2023-12-19T17:55:17.761864+0000","last_unstale":"2023-12-19T17:55:20.488157+0000","last_undegraded":"2023-12-19T17:55:20.488157+0000","last_fullsized":"2023-12-19T17:55:20.488157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:07.217975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487209+0000","last_change":"2023-12-19T17:55:18.264006+0000","last_active":"2023-12-19T17:55:20.487209+0000","last_peered":"2023-12-19T17:55:20.487209+0000","last_clean":"2023-12-19T17:55:20.487209+0000","last_became_active":"2023-12-19T17:55:18.263735+0000","last_became_peered":"2023-12-19T17:55:18.263735+0000","last_unstale":"2023-12-19T17:55:20.487209+0000","last_undegraded":"2023-12-19T17:55:20.487209+0000","last_fullsized":"2023-12-19T17:55:20.487209+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:15.849126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488856+0000","last_change":"2023-12-19T17:55:17.768334+0000","last_active":"2023-12-19T17:55:20.488856+0000","last_peered":"2023-12-19T17:55:20.488856+0000","last_clean":"2023-12-19T17:55:20.488856+0000","last_became_active":"2023-12-19T17:55:17.768077+0000","last_became_peered":"2023-12-19T17:55:17.768077+0000","last_unstale":"2023-12-19T17:55:20.488856+0000","last_undegraded":"2023-12-19T17:55:20.488856+0000","last_fullsized":"2023-12-19T17:55:20.488856+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:57.501977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240172+0000","last_change":"2023-12-19T17:55:18.259783+0000","last_active":"2023-12-19T17:55:19.240172+0000","last_peered":"2023-12-19T17:55:19.240172+0000","last_clean":"2023-12-19T17:55:19.240172+0000","last_became_active":"2023-12-19T17:55:18.258668+0000","last_became_peered":"2023-12-19T17:55:18.258668+0000","last_unstale":"2023-12-19T17:55:19.240172+0000","last_undegraded":"2023-12-19T17:55:19.240172+0000","last_fullsized":"2023-12-19T17:55:19.240172+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:59.998197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.237902+0000","last_change":"2023-12-19T17:55:17.766323+0000","last_active":"2023-12-19T17:55:19.237902+0000","last_peered":"2023-12-19T17:55:19.237902+0000","last_clean":"2023-12-19T17:55:19.237902+0000","last_became_active":"2023-12-19T17:55:17.765966+0000","last_became_peered":"2023-12-19T17:55:17.765966+0000","last_unstale":"2023-12-19T17:55:19.237902+0000","last_undegraded":"2023-12-19T17:55:19.237902+0000","last_fullsized":"2023-12-19T17:55:19.237902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:24.493382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486959+0000","last_change":"2023-12-19T17:55:18.245480+0000","last_active":"2023-12-19T17:55:20.486959+0000","last_peered":"2023-12-19T17:55:20.486959+0000","last_clean":"2023-12-19T17:55:20.486959+0000","last_became_active":"2023-12-19T17:55:18.241016+0000","last_became_peered":"2023-12-19T17:55:18.241016+0000","last_unstale":"2023-12-19T17:55:20.486959+0000","last_undegraded":"2023-12-19T17:55:20.486959+0000","last_fullsized":"2023-12-19T17:55:20.486959+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:22.305160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487745+0000","last_change":"2023-12-19T17:55:17.758319+0000","last_active":"2023-12-19T17:55:20.487745+0000","last_peered":"2023-12-19T17:55:20.487745+0000","last_clean":"2023-12-19T17:55:20.487745+0000","last_became_active":"2023-12-19T17:55:17.757866+0000","last_became_peered":"2023-12-19T17:55:17.757866+0000","last_unstale":"2023-12-19T17:55:20.487745+0000","last_undegraded":"2023-12-19T17:55:20.487745+0000","last_fullsized":"2023-12-19T17:55:20.487745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:31.008216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488565+0000","last_change":"2023-12-19T17:55:18.245403+0000","last_active":"2023-12-19T17:55:20.488565+0000","last_peered":"2023-12-19T17:55:20.488565+0000","last_clean":"2023-12-19T17:55:20.488565+0000","last_became_active":"2023-12-19T17:55:18.245022+0000","last_became_peered":"2023-12-19T17:55:18.245022+0000","last_unstale":"2023-12-19T17:55:20.488565+0000","last_undegraded":"2023-12-19T17:55:20.488565+0000","last_fullsized":"2023-12-19T17:55:20.488565+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:51.712043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240713+0000","last_change":"2023-12-19T17:55:17.769193+0000","last_active":"2023-12-19T17:55:19.240713+0000","last_peered":"2023-12-19T17:55:19.240713+0000","last_clean":"2023-12-19T17:55:19.240713+0000","last_became_active":"2023-12-19T17:55:17.768870+0000","last_became_peered":"2023-12-19T17:55:17.768870+0000","last_unstale":"2023-12-19T17:55:19.240713+0000","last_undegraded":"2023-12-19T17:55:19.240713+0000","last_fullsized":"2023-12-19T17:55:19.240713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:54.669343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240620+0000","last_change":"2023-12-19T17:55:18.244693+0000","last_active":"2023-12-19T17:55:19.240620+0000","last_peered":"2023-12-19T17:55:19.240620+0000","last_clean":"2023-12-19T17:55:19.240620+0000","last_became_active":"2023-12-19T17:55:18.244282+0000","last_became_peered":"2023-12-19T17:55:18.244282+0000","last_unstale":"2023-12-19T17:55:19.240620+0000","last_undegraded":"2023-12-19T17:55:19.240620+0000","last_fullsized":"2023-12-19T17:55:19.240620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:16:58.374282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486889+0000","last_change":"2023-12-19T17:55:17.756435+0000","last_active":"2023-12-19T17:55:20.486889+0000","last_peered":"2023-12-19T17:55:20.486889+0000","last_clean":"2023-12-19T17:55:20.486889+0000","last_became_active":"2023-12-19T17:55:17.756150+0000","last_became_peered":"2023-12-19T17:55:17.756150+0000","last_unstale":"2023-12-19T17:55:20.486889+0000","last_undegraded":"2023-12-19T17:55:20.486889+0000","last_fullsized":"2023-12-19T17:55:20.486889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:18.073672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486378+0000","last_change":"2023-12-19T17:55:18.261028+0000","last_active":"2023-12-19T17:55:20.486378+0000","last_peered":"2023-12-19T17:55:20.486378+0000","last_clean":"2023-12-19T17:55:20.486378+0000","last_became_active":"2023-12-19T17:55:18.260774+0000","last_became_peered":"2023-12-19T17:55:18.260774+0000","last_unstale":"2023-12-19T17:55:20.486378+0000","last_undegraded":"2023-12-19T17:55:20.486378+0000","last_fullsized":"2023-12-19T17:55:20.486378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240486+0000","last_change":"2023-12-19T17:55:17.769056+0000","last_active":"2023-12-19T17:55:19.240486+0000","last_peered":"2023-12-19T17:55:19.240486+0000","last_clean":"2023-12-19T17:55:19.240486+0000","last_became_active":"2023-12-19T17:55:17.768754+0000","last_became_peered":"2023-12-19T17:55:17.768754+0000","last_unstale":"2023-12-19T17:55:19.240486+0000","last_undegraded":"2023-12-19T17:55:19.240486+0000","last_fullsized":"2023-12-19T17:55:19.240486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:52.860111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240417+0000","last_change":"2023-12-19T17:55:18.247603+0000","last_active":"2023-12-19T17:55:19.240417+0000","last_peered":"2023-12-19T17:55:19.240417+0000","last_clean":"2023-12-19T17:55:19.240417+0000","last_became_active":"2023-12-19T17:55:18.247000+0000","last_became_peered":"2023-12-19T17:55:18.247000+0000","last_unstale":"2023-12-19T17:55:19.240417+0000","last_undegraded":"2023-12-19T17:55:19.240417+0000","last_fullsized":"2023-12-19T17:55:19.240417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:17.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488359+0000","last_change":"2023-12-19T17:55:17.764039+0000","last_active":"2023-12-19T17:55:20.488359+0000","last_peered":"2023-12-19T17:55:20.488359+0000","last_clean":"2023-12-19T17:55:20.488359+0000","last_became_active":"2023-12-19T17:55:17.763682+0000","last_became_peered":"2023-12-19T17:55:17.763682+0000","last_unstale":"2023-12-19T17:55:20.488359+0000","last_undegraded":"2023-12-19T17:55:20.488359+0000","last_fullsized":"2023-12-19T17:55:20.488359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:58.985286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.237975+0000","last_change":"2023-12-19T17:55:18.244656+0000","last_active":"2023-12-19T17:55:19.237975+0000","last_peered":"2023-12-19T17:55:19.237975+0000","last_clean":"2023-12-19T17:55:19.237975+0000","last_became_active":"2023-12-19T17:55:18.244366+0000","last_became_peered":"2023-12-19T17:55:18.244366+0000","last_unstale":"2023-12-19T17:55:19.237975+0000","last_undegraded":"2023-12-19T17:55:19.237975+0000","last_fullsized":"2023-12-19T17:55:19.237975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:16:58.374282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488262+0000","last_change":"2023-12-19T17:55:17.756300+0000","last_active":"2023-12-19T17:55:20.488262+0000","last_peered":"2023-12-19T17:55:20.488262+0000","last_clean":"2023-12-19T17:55:20.488262+0000","last_became_active":"2023-12-19T17:55:17.755793+0000","last_became_peered":"2023-12-19T17:55:17.755793+0000","last_unstale":"2023-12-19T17:55:20.488262+0000","last_undegraded":"2023-12-19T17:55:20.488262+0000","last_fullsized":"2023-12-19T17:55:20.488262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:58.361501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240264+0000","last_change":"2023-12-19T17:55:18.241304+0000","last_active":"2023-12-19T17:55:19.240264+0000","last_peered":"2023-12-19T17:55:19.240264+0000","last_clean":"2023-12-19T17:55:19.240264+0000","last_became_active":"2023-12-19T17:55:18.241041+0000","last_became_peered":"2023-12-19T17:55:18.241041+0000","last_unstale":"2023-12-19T17:55:19.240264+0000","last_undegraded":"2023-12-19T17:55:19.240264+0000","last_fullsized":"2023-12-19T17:55:19.240264+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:30.809783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240506+0000","last_change":"2023-12-19T17:55:17.760120+0000","last_active":"2023-12-19T17:55:19.240506+0000","last_peered":"2023-12-19T17:55:19.240506+0000","last_clean":"2023-12-19T17:55:19.240506+0000","last_became_active":"2023-12-19T17:55:17.759823+0000","last_became_peered":"2023-12-19T17:55:17.759823+0000","last_unstale":"2023-12-19T17:55:19.240506+0000","last_undegraded":"2023-12-19T17:55:19.240506+0000","last_fullsized":"2023-12-19T17:55:19.240506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:42.671194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487654+0000","last_change":"2023-12-19T17:55:18.251804+0000","last_active":"2023-12-19T17:55:20.487654+0000","last_peered":"2023-12-19T17:55:20.487654+0000","last_clean":"2023-12-19T17:55:20.487654+0000","last_became_active":"2023-12-19T17:55:18.251519+0000","last_became_peered":"2023-12-19T17:55:18.251519+0000","last_unstale":"2023-12-19T17:55:20.487654+0000","last_undegraded":"2023-12-19T17:55:20.487654+0000","last_fullsized":"2023-12-19T17:55:20.487654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:58.098436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238109+0000","last_change":"2023-12-19T17:55:17.765145+0000","last_active":"2023-12-19T17:55:19.238109+0000","last_peered":"2023-12-19T17:55:19.238109+0000","last_clean":"2023-12-19T17:55:19.238109+0000","last_became_active":"2023-12-19T17:55:17.764520+0000","last_became_peered":"2023-12-19T17:55:17.764520+0000","last_unstale":"2023-12-19T17:55:19.238109+0000","last_undegraded":"2023-12-19T17:55:19.238109+0000","last_fullsized":"2023-12-19T17:55:19.238109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:45.356145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239810+0000","last_change":"2023-12-19T17:55:18.253139+0000","last_active":"2023-12-19T17:55:19.239810+0000","last_peered":"2023-12-19T17:55:19.239810+0000","last_clean":"2023-12-19T17:55:19.239810+0000","last_became_active":"2023-12-19T17:55:18.252627+0000","last_became_peered":"2023-12-19T17:55:18.252627+0000","last_unstale":"2023-12-19T17:55:19.239810+0000","last_undegraded":"2023-12-19T17:55:19.239810+0000","last_fullsized":"2023-12-19T17:55:19.239810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:10.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239639+0000","last_change":"2023-12-19T17:55:17.757464+0000","last_active":"2023-12-19T17:55:19.239639+0000","last_peered":"2023-12-19T17:55:19.239639+0000","last_clean":"2023-12-19T17:55:19.239639+0000","last_became_active":"2023-12-19T17:55:17.757172+0000","last_became_peered":"2023-12-19T17:55:17.757172+0000","last_unstale":"2023-12-19T17:55:19.239639+0000","last_undegraded":"2023-12-19T17:55:19.239639+0000","last_fullsized":"2023-12-19T17:55:19.239639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:58.985286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240873+0000","last_change":"2023-12-19T17:55:18.254870+0000","last_active":"2023-12-19T17:55:19.240873+0000","last_peered":"2023-12-19T17:55:19.240873+0000","last_clean":"2023-12-19T17:55:19.240873+0000","last_became_active":"2023-12-19T17:55:18.254600+0000","last_became_peered":"2023-12-19T17:55:18.254600+0000","last_unstale":"2023-12-19T17:55:19.240873+0000","last_undegraded":"2023-12-19T17:55:19.240873+0000","last_fullsized":"2023-12-19T17:55:19.240873+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488000+0000","last_change":"2023-12-19T17:55:17.765131+0000","last_active":"2023-12-19T17:55:20.488000+0000","last_peered":"2023-12-19T17:55:20.488000+0000","last_clean":"2023-12-19T17:55:20.488000+0000","last_became_active":"2023-12-19T17:55:17.764848+0000","last_became_peered":"2023-12-19T17:55:17.764848+0000","last_unstale":"2023-12-19T17:55:20.488000+0000","last_undegraded":"2023-12-19T17:55:20.488000+0000","last_fullsized":"2023-12-19T17:55:20.488000+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:10.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238211+0000","last_change":"2023-12-19T17:55:18.244472+0000","last_active":"2023-12-19T17:55:19.238211+0000","last_peered":"2023-12-19T17:55:19.238211+0000","last_clean":"2023-12-19T17:55:19.238211+0000","last_became_active":"2023-12-19T17:55:18.243554+0000","last_became_peered":"2023-12-19T17:55:18.243554+0000","last_unstale":"2023-12-19T17:55:19.238211+0000","last_undegraded":"2023-12-19T17:55:19.238211+0000","last_fullsized":"2023-12-19T17:55:19.238211+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:28:48.880083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489454+0000","last_change":"2023-12-19T17:55:17.766391+0000","last_active":"2023-12-19T17:55:20.489454+0000","last_peered":"2023-12-19T17:55:20.489454+0000","last_clean":"2023-12-19T17:55:20.489454+0000","last_became_active":"2023-12-19T17:55:17.760938+0000","last_became_peered":"2023-12-19T17:55:17.760938+0000","last_unstale":"2023-12-19T17:55:20.489454+0000","last_undegraded":"2023-12-19T17:55:20.489454+0000","last_fullsized":"2023-12-19T17:55:20.489454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:23.500267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487499+0000","last_change":"2023-12-19T17:55:18.250913+0000","last_active":"2023-12-19T17:55:20.487499+0000","last_peered":"2023-12-19T17:55:20.487499+0000","last_clean":"2023-12-19T17:55:20.487499+0000","last_became_active":"2023-12-19T17:55:18.250606+0000","last_became_peered":"2023-12-19T17:55:18.250606+0000","last_unstale":"2023-12-19T17:55:20.487499+0000","last_undegraded":"2023-12-19T17:55:20.487499+0000","last_fullsized":"2023-12-19T17:55:20.487499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:31:57.845797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238449+0000","last_change":"2023-12-19T17:55:17.763724+0000","last_active":"2023-12-19T17:55:19.238449+0000","last_peered":"2023-12-19T17:55:19.238449+0000","last_clean":"2023-12-19T17:55:19.238449+0000","last_became_active":"2023-12-19T17:55:17.763466+0000","last_became_peered":"2023-12-19T17:55:17.763466+0000","last_unstale":"2023-12-19T17:55:19.238449+0000","last_undegraded":"2023-12-19T17:55:19.238449+0000","last_fullsized":"2023-12-19T17:55:19.238449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:28:53.876618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240393+0000","last_change":"2023-12-19T17:55:18.246035+0000","last_active":"2023-12-19T17:55:19.240393+0000","last_peered":"2023-12-19T17:55:19.240393+0000","last_clean":"2023-12-19T17:55:19.240393+0000","last_became_active":"2023-12-19T17:55:18.243147+0000","last_became_peered":"2023-12-19T17:55:18.243147+0000","last_unstale":"2023-12-19T17:55:19.240393+0000","last_undegraded":"2023-12-19T17:55:19.240393+0000","last_fullsized":"2023-12-19T17:55:19.240393+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:54:05.369657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488969+0000","last_change":"2023-12-19T17:55:17.754756+0000","last_active":"2023-12-19T17:55:20.488969+0000","last_peered":"2023-12-19T17:55:20.488969+0000","last_clean":"2023-12-19T17:55:20.488969+0000","last_became_active":"2023-12-19T17:55:17.754482+0000","last_became_peered":"2023-12-19T17:55:17.754482+0000","last_unstale":"2023-12-19T17:55:20.488969+0000","last_undegraded":"2023-12-19T17:55:20.488969+0000","last_fullsized":"2023-12-19T17:55:20.488969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:09.759098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238068+0000","last_change":"2023-12-19T17:55:18.245173+0000","last_active":"2023-12-19T17:55:19.238068+0000","last_peered":"2023-12-19T17:55:19.238068+0000","last_clean":"2023-12-19T17:55:19.238068+0000","last_became_active":"2023-12-19T17:55:18.241410+0000","last_became_peered":"2023-12-19T17:55:18.241410+0000","last_unstale":"2023-12-19T17:55:19.238068+0000","last_undegraded":"2023-12-19T17:55:19.238068+0000","last_fullsized":"2023-12-19T17:55:19.238068+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:54:05.369657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487414+0000","last_change":"2023-12-19T17:55:17.757007+0000","last_active":"2023-12-19T17:55:20.487414+0000","last_peered":"2023-12-19T17:55:20.487414+0000","last_clean":"2023-12-19T17:55:20.487414+0000","last_became_active":"2023-12-19T17:55:17.755420+0000","last_became_peered":"2023-12-19T17:55:17.755420+0000","last_unstale":"2023-12-19T17:55:20.487414+0000","last_undegraded":"2023-12-19T17:55:20.487414+0000","last_fullsized":"2023-12-19T17:55:20.487414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:21.184462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489173+0000","last_change":"2023-12-19T17:55:18.264427+0000","last_active":"2023-12-19T17:55:20.489173+0000","last_peered":"2023-12-19T17:55:20.489173+0000","last_clean":"2023-12-19T17:55:20.489173+0000","last_became_active":"2023-12-19T17:55:18.257463+0000","last_became_peered":"2023-12-19T17:55:18.257463+0000","last_unstale":"2023-12-19T17:55:20.489173+0000","last_undegraded":"2023-12-19T17:55:20.489173+0000","last_fullsized":"2023-12-19T17:55:20.489173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.374412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486059+0000","last_change":"2023-12-19T17:55:17.770046+0000","last_active":"2023-12-19T17:55:20.486059+0000","last_peered":"2023-12-19T17:55:20.486059+0000","last_clean":"2023-12-19T17:55:20.486059+0000","last_became_active":"2023-12-19T17:55:17.769763+0000","last_became_peered":"2023-12-19T17:55:17.769763+0000","last_unstale":"2023-12-19T17:55:20.486059+0000","last_undegraded":"2023-12-19T17:55:20.486059+0000","last_fullsized":"2023-12-19T17:55:20.486059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:10.770738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488599+0000","last_change":"2023-12-19T17:55:18.255869+0000","last_active":"2023-12-19T17:55:20.488599+0000","last_peered":"2023-12-19T17:55:20.488599+0000","last_clean":"2023-12-19T17:55:20.488599+0000","last_became_active":"2023-12-19T17:55:18.255594+0000","last_became_peered":"2023-12-19T17:55:18.255594+0000","last_unstale":"2023-12-19T17:55:20.488599+0000","last_undegraded":"2023-12-19T17:55:20.488599+0000","last_fullsized":"2023-12-19T17:55:20.488599+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:44:54.830555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.237420+0000","last_change":"2023-12-19T17:55:17.769749+0000","last_active":"2023-12-19T17:55:19.237420+0000","last_peered":"2023-12-19T17:55:19.237420+0000","last_clean":"2023-12-19T17:55:19.237420+0000","last_became_active":"2023-12-19T17:55:17.768275+0000","last_became_peered":"2023-12-19T17:55:17.768275+0000","last_unstale":"2023-12-19T17:55:19.237420+0000","last_undegraded":"2023-12-19T17:55:19.237420+0000","last_fullsized":"2023-12-19T17:55:19.237420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:19.731969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238622+0000","last_change":"2023-12-19T17:55:18.243644+0000","last_active":"2023-12-19T17:55:19.238622+0000","last_peered":"2023-12-19T17:55:19.238622+0000","last_clean":"2023-12-19T17:55:19.238622+0000","last_became_active":"2023-12-19T17:55:18.242870+0000","last_became_peered":"2023-12-19T17:55:18.242870+0000","last_unstale":"2023-12-19T17:55:19.238622+0000","last_undegraded":"2023-12-19T17:55:19.238622+0000","last_fullsized":"2023-12-19T17:55:19.238622+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:28.439890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488219+0000","last_change":"2023-12-19T17:55:17.768897+0000","last_active":"2023-12-19T17:55:20.488219+0000","last_peered":"2023-12-19T17:55:20.488219+0000","last_clean":"2023-12-19T17:55:20.488219+0000","last_became_active":"2023-12-19T17:55:17.768561+0000","last_became_peered":"2023-12-19T17:55:17.768561+0000","last_unstale":"2023-12-19T17:55:20.488219+0000","last_undegraded":"2023-12-19T17:55:20.488219+0000","last_fullsized":"2023-12-19T17:55:20.488219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:26.210834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238338+0000","last_change":"2023-12-19T17:55:18.236834+0000","last_active":"2023-12-19T17:55:19.238338+0000","last_peered":"2023-12-19T17:55:19.238338+0000","last_clean":"2023-12-19T17:55:19.238338+0000","last_became_active":"2023-12-19T17:55:18.236546+0000","last_became_peered":"2023-12-19T17:55:18.236546+0000","last_unstale":"2023-12-19T17:55:19.238338+0000","last_undegraded":"2023-12-19T17:55:19.238338+0000","last_fullsized":"2023-12-19T17:55:19.238338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:30.809783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489538+0000","last_change":"2023-12-19T17:55:17.762997+0000","last_active":"2023-12-19T17:55:20.489538+0000","last_peered":"2023-12-19T17:55:20.489538+0000","last_clean":"2023-12-19T17:55:20.489538+0000","last_became_active":"2023-12-19T17:55:17.762618+0000","last_became_peered":"2023-12-19T17:55:17.762618+0000","last_unstale":"2023-12-19T17:55:20.489538+0000","last_undegraded":"2023-12-19T17:55:20.489538+0000","last_fullsized":"2023-12-19T17:55:20.489538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:56.895936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486943+0000","last_change":"2023-12-19T17:55:18.245676+0000","last_active":"2023-12-19T17:55:20.486943+0000","last_peered":"2023-12-19T17:55:20.486943+0000","last_clean":"2023-12-19T17:55:20.486943+0000","last_became_active":"2023-12-19T17:55:18.245426+0000","last_became_peered":"2023-12-19T17:55:18.245426+0000","last_unstale":"2023-12-19T17:55:20.486943+0000","last_undegraded":"2023-12-19T17:55:20.486943+0000","last_fullsized":"2023-12-19T17:55:20.486943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:08.057743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240712+0000","last_change":"2023-12-19T17:55:17.762794+0000","last_active":"2023-12-19T17:55:19.240712+0000","last_peered":"2023-12-19T17:55:19.240712+0000","last_clean":"2023-12-19T17:55:19.240712+0000","last_became_active":"2023-12-19T17:55:17.762460+0000","last_became_peered":"2023-12-19T17:55:17.762460+0000","last_unstale":"2023-12-19T17:55:19.240712+0000","last_undegraded":"2023-12-19T17:55:19.240712+0000","last_fullsized":"2023-12-19T17:55:19.240712+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:44.276693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489086+0000","last_change":"2023-12-19T17:55:18.259818+0000","last_active":"2023-12-19T17:55:20.489086+0000","last_peered":"2023-12-19T17:55:20.489086+0000","last_clean":"2023-12-19T17:55:20.489086+0000","last_became_active":"2023-12-19T17:55:18.257480+0000","last_became_peered":"2023-12-19T17:55:18.257480+0000","last_unstale":"2023-12-19T17:55:20.489086+0000","last_undegraded":"2023-12-19T17:55:20.489086+0000","last_fullsized":"2023-12-19T17:55:20.489086+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:51.810761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238783+0000","last_change":"2023-12-19T17:55:17.761115+0000","last_active":"2023-12-19T17:55:19.238783+0000","last_peered":"2023-12-19T17:55:19.238783+0000","last_clean":"2023-12-19T17:55:19.238783+0000","last_became_active":"2023-12-19T17:55:17.760816+0000","last_became_peered":"2023-12-19T17:55:17.760816+0000","last_unstale":"2023-12-19T17:55:19.238783+0000","last_undegraded":"2023-12-19T17:55:19.238783+0000","last_fullsized":"2023-12-19T17:55:19.238783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:58.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486995+0000","last_change":"2023-12-19T17:55:18.245014+0000","last_active":"2023-12-19T17:55:20.486995+0000","last_peered":"2023-12-19T17:55:20.486995+0000","last_clean":"2023-12-19T17:55:20.486995+0000","last_became_active":"2023-12-19T17:55:18.244739+0000","last_became_peered":"2023-12-19T17:55:18.244739+0000","last_unstale":"2023-12-19T17:55:20.486995+0000","last_undegraded":"2023-12-19T17:55:20.486995+0000","last_fullsized":"2023-12-19T17:55:20.486995+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:28.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486174+0000","last_change":"2023-12-19T17:55:17.757115+0000","last_active":"2023-12-19T17:55:20.486174+0000","last_peered":"2023-12-19T17:55:20.486174+0000","last_clean":"2023-12-19T17:55:20.486174+0000","last_became_active":"2023-12-19T17:55:17.756837+0000","last_became_peered":"2023-12-19T17:55:17.756837+0000","last_unstale":"2023-12-19T17:55:20.486174+0000","last_undegraded":"2023-12-19T17:55:20.486174+0000","last_fullsized":"2023-12-19T17:55:20.486174+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:54.669343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240082+0000","last_change":"2023-12-19T17:55:18.253958+0000","last_active":"2023-12-19T17:55:19.240082+0000","last_peered":"2023-12-19T17:55:19.240082+0000","last_clean":"2023-12-19T17:55:19.240082+0000","last_became_active":"2023-12-19T17:55:18.250016+0000","last_became_peered":"2023-12-19T17:55:18.250016+0000","last_unstale":"2023-12-19T17:55:19.240082+0000","last_undegraded":"2023-12-19T17:55:19.240082+0000","last_fullsized":"2023-12-19T17:55:19.240082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:24.513177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487983+0000","last_change":"2023-12-19T17:55:17.762899+0000","last_active":"2023-12-19T17:55:20.487983+0000","last_peered":"2023-12-19T17:55:20.487983+0000","last_clean":"2023-12-19T17:55:20.487983+0000","last_became_active":"2023-12-19T17:55:17.762620+0000","last_became_peered":"2023-12-19T17:55:17.762620+0000","last_unstale":"2023-12-19T17:55:20.487983+0000","last_undegraded":"2023-12-19T17:55:20.487983+0000","last_fullsized":"2023-12-19T17:55:20.487983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:32.512488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.485869+0000","last_change":"2023-12-19T17:55:18.247182+0000","last_active":"2023-12-19T17:55:20.485869+0000","last_peered":"2023-12-19T17:55:20.485869+0000","last_clean":"2023-12-19T17:55:20.485869+0000","last_became_active":"2023-12-19T17:55:18.246907+0000","last_became_peered":"2023-12-19T17:55:18.246907+0000","last_unstale":"2023-12-19T17:55:20.485869+0000","last_undegraded":"2023-12-19T17:55:20.485869+0000","last_fullsized":"2023-12-19T17:55:20.485869+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:53.187715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486043+0000","last_change":"2023-12-19T17:55:17.762546+0000","last_active":"2023-12-19T17:55:20.486043+0000","last_peered":"2023-12-19T17:55:20.486043+0000","last_clean":"2023-12-19T17:55:20.486043+0000","last_became_active":"2023-12-19T17:55:17.762255+0000","last_became_peered":"2023-12-19T17:55:17.762255+0000","last_unstale":"2023-12-19T17:55:20.486043+0000","last_undegraded":"2023-12-19T17:55:20.486043+0000","last_fullsized":"2023-12-19T17:55:20.486043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:53.889214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487127+0000","last_change":"2023-12-19T17:55:18.249747+0000","last_active":"2023-12-19T17:55:20.487127+0000","last_peered":"2023-12-19T17:55:20.487127+0000","last_clean":"2023-12-19T17:55:20.487127+0000","last_became_active":"2023-12-19T17:55:18.249487+0000","last_became_peered":"2023-12-19T17:55:18.249487+0000","last_unstale":"2023-12-19T17:55:20.487127+0000","last_undegraded":"2023-12-19T17:55:20.487127+0000","last_fullsized":"2023-12-19T17:55:20.487127+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:27:09.649971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487629+0000","last_change":"2023-12-19T17:55:17.761541+0000","last_active":"2023-12-19T17:55:20.487629+0000","last_peered":"2023-12-19T17:55:20.487629+0000","last_clean":"2023-12-19T17:55:20.487629+0000","last_became_active":"2023-12-19T17:55:17.761218+0000","last_became_peered":"2023-12-19T17:55:17.761218+0000","last_unstale":"2023-12-19T17:55:20.487629+0000","last_undegraded":"2023-12-19T17:55:20.487629+0000","last_fullsized":"2023-12-19T17:55:20.487629+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:42:00.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487453+0000","last_change":"2023-12-19T17:55:18.262846+0000","last_active":"2023-12-19T17:55:20.487453+0000","last_peered":"2023-12-19T17:55:20.487453+0000","last_clean":"2023-12-19T17:55:20.487453+0000","last_became_active":"2023-12-19T17:55:18.262415+0000","last_became_peered":"2023-12-19T17:55:18.262415+0000","last_unstale":"2023-12-19T17:55:20.487453+0000","last_undegraded":"2023-12-19T17:55:20.487453+0000","last_fullsized":"2023-12-19T17:55:20.487453+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:26.777467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240261+0000","last_change":"2023-12-19T17:55:17.762178+0000","last_active":"2023-12-19T17:55:19.240261+0000","last_peered":"2023-12-19T17:55:19.240261+0000","last_clean":"2023-12-19T17:55:19.240261+0000","last_became_active":"2023-12-19T17:55:17.761905+0000","last_became_peered":"2023-12-19T17:55:17.761905+0000","last_unstale":"2023-12-19T17:55:19.240261+0000","last_undegraded":"2023-12-19T17:55:19.240261+0000","last_fullsized":"2023-12-19T17:55:19.240261+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:35.273533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-19T17:55:18.229164+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:55:18.229164+0000","last_peered":"2023-12-19T17:55:18.229164+0000","last_clean":"2023-12-19T17:55:18.229164+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:55:18.229164+0000","last_undegraded":"2023-12-19T17:55:18.229164+0000","last_fullsized":"2023-12-19T17:55:18.229164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1359872,"data_stored":941563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.0589999999999999,"15min":1.0529999999999999},"min":{"1min":0.67900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.427,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.96499999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.458,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.506}]},{"osd":1,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.083,"15min":1.0900000000000001},"min":{"1min":0.76100000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.3720000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.871},{"interface":"front","average":{"1min":1.113,"5min":1.119,"15min":1.151},"min":{"1min":0.86499999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.552,"5min":2.448,"15min":2.448},"last":1.385}]},{"osd":2,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3340000000000001,"5min":2.069,"15min":2.069},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1399999999999999,"15min":1.141},"min":{"1min":0.76300000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.504,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.04}]},{"osd":3,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1100000000000001,"15min":1.141},"min":{"1min":0.86199999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.2230000000000001},"min":{"1min":0.97399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.679,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1850000000000001,"15min":1.2370000000000001},"min":{"1min":0.76300000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.712,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.272,"15min":1.296},"min":{"1min":1.034,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8120000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.2529999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.212,"15min":1.2490000000000001},"min":{"1min":0.78900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.601,"5min":1.97,"15min":1.97},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.86399999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.861,"5min":2.02,"15min":2.02},"last":1.552}]},{"osd":6,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":1.1559999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.9650000000000001,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":1.0309999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0049999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.3540000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":757760,"data_stored":351035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.163,"15min":1.2330000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3200000000000001,"5min":4.5979999999999999,"15min":4.5979999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.109,"15min":1.115},"min":{"1min":0.64000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.496,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.089,"15min":1.1000000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5029999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.68799999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5960000000000001,"5min":1.621,"15min":1.621},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.4099999999999999,"15min":1.5209999999999999},"min":{"1min":0.78000000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.597,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":1.208},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.2669999999999999,"15min":1.327},"min":{"1min":0.73199999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.532,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.3}]},{"osd":3,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3180000000000001,"15min":1.3520000000000001},"min":{"1min":0.90300000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.627,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.357,"15min":1.4139999999999999},"min":{"1min":0.874,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6479999999999999,"5min":4.508,"15min":4.508},"last":1.911}]},{"osd":4,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1319999999999999,"15min":1.1419999999999999},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4910000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.339},{"interface":"front","average":{"1min":1.179,"5min":1.24,"15min":1.2709999999999999},"min":{"1min":0.81699999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.627,"5min":1.899,"15min":1.899},"last":1.6519999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.83499999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5529999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.829},{"interface":"front","average":{"1min":1.264,"5min":1.266,"15min":1.274},"min":{"1min":0.90200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7150000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.694}]},{"osd":7,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.357,"15min":1.355},"min":{"1min":0.86599999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.738,"5min":1.8,"15min":1.8},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3959999999999999,"15min":1.421},"min":{"1min":1.087,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6539999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.9670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":351687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.745,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.81799999999999995}]},{"osd":1,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.117,"15min":1.095},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.472,"5min":1.778,"15min":1.778},"last":1.071},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.204,"15min":1.226},"min":{"1min":0.70199999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.825,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.194,"15min":1.226},"min":{"1min":0.754,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.353,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.149,"5min":1.177,"15min":1.204},"min":{"1min":0.80000000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.999}]},{"osd":3,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.298,"15min":1.3360000000000001},"min":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.649,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3879999999999999,"15min":1.4219999999999999},"min":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5409999999999999,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.135}]},{"osd":4,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2969999999999999,"15min":1.3160000000000001},"min":{"1min":0.79000000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.851,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3859999999999999,"15min":1.4339999999999999},"min":{"1min":0.90600000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.7370000000000001,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3959999999999999,"15min":1.45},"min":{"1min":0.88,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.78,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3580000000000001,"15min":1.3799999999999999},"min":{"1min":0.91300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8819999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2989999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.484,"15min":1.5549999999999999},"min":{"1min":0.96799999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9019999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.5980000000000001,"15min":1.6719999999999999},"min":{"1min":1.097,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.952,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":1.24}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":352599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.234,"15min":1.302},"min":{"1min":0.85599999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3939999999999999,"5min":5.4420000000000002,"15min":5.4420000000000002},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2889999999999999,"15min":1.3600000000000001},"min":{"1min":0.80300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4059999999999999,"5min":5.5049999999999999,"15min":5.5049999999999999},"last":4.5019999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.214,"15min":1.3140000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3109999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.222,"15min":1.2490000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4239999999999999,"5min":3.254,"15min":3.254},"last":3.137}]},{"osd":2,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.266,"15min":1.3640000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.3620000000000001,"5min":4.593,"15min":4.593},"last":2.1070000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.242,"15min":1.3080000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.3560000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.9570000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2829999999999999,"15min":1.353},"min":{"1min":0.71899999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4470000000000001,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":2.4750000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3680000000000001,"15min":1.46},"min":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4710000000000001,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":5.633}]},{"osd":5,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.1919999999999999,"15min":1.232},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.234,"5min":1.946,"15min":1.946},"last":2.5649999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.143,"15min":1.163},"min":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.407,"5min":2.157,"15min":2.157},"last":0.752}]},{"osd":6,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2410000000000001,"15min":1.2589999999999999},"min":{"1min":0.70999999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5489999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":2.5910000000000002},{"interface":"front","average":{"1min":1.282,"5min":1.391,"15min":1.429},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.4950000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":2.5299999999999998}]},{"osd":7,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2949999999999999,"15min":1.331},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.504,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":2.4340000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.331,"15min":1.361},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5469999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":5.6859999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":351091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91500000000000004,"15min":0.95099999999999996},"min":{"1min":0.56499999999999995,"5min":0.37,"15min":0.37},"max":{"1min":1.454,"5min":1.825,"15min":1.825},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":1.03},"min":{"1min":0.626,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.327,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.61099999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.63900000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3160000000000001,"5min":1.54,"15min":1.54},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0369999999999999,"15min":1.073},"min":{"1min":0.59599999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.353,"5min":1.702,"15min":1.702},"last":0.997}]},{"osd":2,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.129,"15min":1.1359999999999999},"min":{"1min":0.878,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5389999999999999,"5min":2.177,"15min":2.177},"last":1.206},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2829999999999999},"min":{"1min":0.89500000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.72,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.099}]},{"osd":4,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2589999999999999,"15min":1.29},"min":{"1min":0.92300000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.109,"5min":2.234,"15min":2.234},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.325,"15min":1.353},"min":{"1min":0.98899999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6950000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.397}]},{"osd":5,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.4039999999999999,"15min":1.45},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.823,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.298},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.381,"15min":1.417},"min":{"1min":0.94999999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9330000000000001,"5min":2.754,"15min":2.754},"last":0.92100000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.431,"15min":1.454},"min":{"1min":0.99299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.72,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.264},{"interface":"front","average":{"1min":1.385,"5min":1.4630000000000001,"15min":1.514},"min":{"1min":1.0620000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9770000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.409}]},{"osd":7,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4690000000000001,"15min":1.514},"min":{"1min":1.1100000000000001,"5min":0.88,"15min":0.88},"max":{"1min":2.0419999999999998,"5min":3.02,"15min":3.02},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.5069999999999999,"15min":1.5309999999999999},"min":{"1min":1.0980000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.798,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.3440000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":351091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.306,"15min":1.488},"min":{"1min":0.49199999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2669999999999999,"5min":13.32,"15min":13.32},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.4690000000000001,"15min":1.6359999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.5740000000000001,"5min":13.206,"15min":13.206},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.91000000000000003,"15min":0.90200000000000002},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2370000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0209999999999999,"15min":1.0229999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3879999999999999,"5min":1.948,"15min":1.948},"last":1.4570000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.431,"5min":1.79,"15min":1.79},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.179,"5min":1.232,"15min":1.2509999999999999},"min":{"1min":0.81799999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6259999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.232}]},{"osd":4,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.242},"min":{"1min":1.018,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.498,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.111},{"interface":"front","average":{"1min":1.234,"5min":1.302,"15min":1.3260000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.603,"5min":2.024,"15min":2.024},"last":1.607}]},{"osd":5,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2929999999999999,"15min":1.325},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.448,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.5309999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5089999999999999,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":1.3959999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.4219999999999999,"15min":1.466},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.653,"5min":2.081,"15min":2.081},"last":2.0489999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.365,"15min":1.383},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.581,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.4259999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.482,"15min":1.514},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.546,"5min":2.363,"15min":2.363},"last":1.841},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.4059999999999999,"15min":1.429},"min":{"1min":0.83299999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.6140000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":761856,"data_stored":351125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.96399999999999997,"15min":1.012},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.931,"15min":1.931},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.0609999999999999},"min":{"1min":0.75,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.294,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.0149999999999999,"15min":1.081},"min":{"1min":0.59399999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.353,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.1559999999999999,"15min":1.224},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.345,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":1.123}]},{"osd":3,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.274,"15min":1.3460000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.498,"5min":3.4950000000000001,"15min":3.4950000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.194,"15min":1.2729999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.468},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.514,"5min":4.3869999999999996,"15min":4.3869999999999996},"last":1.468},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.3779999999999999,"15min":1.46},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.5369999999999999,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.198}]},{"osd":5,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.373,"15min":1.4630000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4319999999999999,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.524,"15min":1.6120000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.4910000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":1.506}]},{"osd":6,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.546,"15min":1.647},"min":{"1min":1.0209999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7210000000000001,"5min":4.5780000000000003,"15min":4.5780000000000003},"last":1.349},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.577,"15min":1.669},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6040000000000001,"5min":3.214,"15min":3.214},"last":1.2949999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.647,"15min":1.7490000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.7170000000000001,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.5589999999999999,"15min":1.633},"min":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.548,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.577}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":942530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.236,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.2050000000000001,"15min":1.2849999999999999},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.421,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.018}]},{"osd":2,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.0529999999999999},"min":{"1min":0.53400000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.323,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.75900000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.1220000000000001},"min":{"1min":0.66200000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5700000000000001,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.212,"5min":1.282,"15min":1.3380000000000001},"min":{"1min":0.91700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6850000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.254}]},{"osd":4,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3959999999999999,"15min":1.4299999999999999},"min":{"1min":0.82799999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6240000000000001,"5min":1.78,"15min":1.78},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4139999999999999,"15min":1.4790000000000001},"min":{"1min":0.99099999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.944,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.234}]},{"osd":5,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3180000000000001,"15min":1.369},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3500000000000001,"15min":1.373},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.726,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.389}]},{"osd":6,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4670000000000001,"15min":1.5109999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.04,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.552},{"interface":"front","average":{"1min":1.413,"5min":1.4750000000000001,"15min":1.5349999999999999},"min":{"1min":1.099,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.984,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.5009999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.6339999999999999,"15min":1.76},"min":{"1min":1.0649999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.792,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.593,"15min":1.712},"min":{"1min":1.046,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.1339999999999999,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.0860000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:55:22.588 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:55:22.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.798+0000 7fce47f1e700 1 Processor -- start 2023-12-19T17:55:22.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.798+0000 7fce47f1e700 1 -- start start 2023-12-19T17:55:22.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce47f1e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fce400c4510 0x7fce400cd540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce47f1e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce400cdb80 con 0x7fce40164690 2023-12-19T17:55:22.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce47f1e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce400cde60 con 0x7fce40164a70 2023-12-19T17:55:22.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce47f1e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce400ce140 con 0x7fce400c4510 2023-12-19T17:55:22.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce45cba700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce40164690 0x7fce400c3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51800/0 (socket says 172.21.15.45:51800) 2023-12-19T17:55:22.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce45cba700 1 -- 172.21.15.45:0/3774704694 learned_addr learned my addr 172.21.15.45:0/3774704694 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:22.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.802+0000 7fce464bb700 1 --2- 172.21.15.45:0/3774704694 >> v2:172.21.15.73:3300/0 conn(0x7fce400c4510 0x7fce400cd540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2619142402 0 0) 0x7fce400cdb80 con 0x7fce40164690 2023-12-19T17:55:22.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce2c0035d0 con 0x7fce40164690 2023-12-19T17:55:22.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618906322 0 0) 0x7fce400cde60 con 0x7fce40164a70 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce400cdb80 con 0x7fce40164a70 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce464bb700 1 -- 172.21.15.45:0/3774704694 >> v1:172.21.15.73:6789/0 conn(0x7fce40164a70 legacy=0x7fce400cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce464bb700 1 -- 172.21.15.45:0/3774704694 >> v1:172.21.15.45:6789/0 conn(0x7fce40164690 legacy=0x7fce400c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce464bb700 1 -- 172.21.15.45:0/3774704694 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce400ce420 con 0x7fce400c4510 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce464bb700 1 --2- 172.21.15.45:0/3774704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce400c4510 0x7fce400cd540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce38009d90 tx=0x7fce3800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=212bd59c84fb7a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3800e070 con 0x7fce400c4510 2023-12-19T17:55:22.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3800bb20 con 0x7fce400c4510 2023-12-19T17:55:22.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce44cb8700 1 -- 172.21.15.45:0/3774704694 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce38012430 con 0x7fce400c4510 2023-12-19T17:55:22.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 -- 172.21.15.45:0/3774704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce400c4510 msgr2=0x7fce400cd540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 --2- 172.21.15.45:0/3774704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce400c4510 0x7fce400cd540 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fce38009d90 tx=0x7fce3800b330 comp rx=0 tx=0).stop 2023-12-19T17:55:22.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 -- 172.21.15.45:0/3774704694 shutdown_connections 2023-12-19T17:55:22.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 --2- 172.21.15.45:0/3774704694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce400c4510 0x7fce400cd540 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 -- 172.21.15.45:0/3774704694 >> 172.21.15.45:0/3774704694 conn(0x7fce400cba40 msgr2=0x7fce400ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:22.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 -- 172.21.15.45:0/3774704694 shutdown_connections 2023-12-19T17:55:22.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.806+0000 7fce47f1e700 1 -- 172.21.15.45:0/3774704694 wait complete. 2023-12-19T17:55:22.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 Processor -- start 2023-12-19T17:55:22.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 -- start start 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 0x7fce400c7160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce40164690 0x7fce400c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce40164a70 0x7fce401eace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400b4870 con 0x7fce400c4510 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce400c9bf0 con 0x7fce40164690 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce47f1e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce400c77f0 con 0x7fce40164a70 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 0x7fce400c7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 0x7fce400c7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43198/0 (socket says 172.21.15.45:43198) 2023-12-19T17:55:22.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 -- 172.21.15.45:0/979535442 learned_addr learned my addr 172.21.15.45:0/979535442 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce454b9700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce40164690 0x7fce400c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce464bb700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce40164a70 0x7fce401eace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 -- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce40164a70 msgr2=0x7fce401eace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce40164a70 0x7fce401eace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 -- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce40164690 msgr2=0x7fce400c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce40164690 0x7fce400c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 -- 172.21.15.45:0/979535442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce38009a70 con 0x7fce400c4510 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.810+0000 7fce45cba700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 0x7fce400c7160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c560 tx=0x7fce3c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c005d90 con 0x7fce400c4510 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c0070d0 con 0x7fce400c4510 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c007460 con 0x7fce400c4510 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce400c7b30 con 0x7fce400c4510 2023-12-19T17:55:22.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce400b22c0 con 0x7fce400c4510 2023-12-19T17:55:22.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce400ad890 con 0x7fce400c4510 2023-12-19T17:55:22.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.814+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce3c0075c0 con 0x7fce400c4510 2023-12-19T17:55:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.818+0000 7fce367fc700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce24065ad0 0x7fce24067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.818+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fce3c082800 con 0x7fce400c4510 2023-12-19T17:55:22.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.818+0000 7fce454b9700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce24065ad0 0x7fce24067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:22.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.818+0000 7fce454b9700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce24065ad0 0x7fce24067f90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fce300017b0 tx=0x7fce30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:22.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.822+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fce3c04ffe0 con 0x7fce400c4510 2023-12-19T17:55:22.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:22.994+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce4004ed30 con 0x7fce24065ad0 2023-12-19T17:55:23.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.010+0000 7fce367fc700 1 -- 172.21.15.45:0/979535442 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286740 (secure 0 0 0) 0x7fce4004ed30 con 0x7fce24065ad0 2023-12-19T17:55:23.016 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:23.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce24065ad0 msgr2=0x7fce24067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce24065ad0 0x7fce24067f90 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fce300017b0 tx=0x7fce30009040 comp rx=0 tx=0).stop 2023-12-19T17:55:23.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 msgr2=0x7fce400c7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 0x7fce400c7160 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00c560 tx=0x7fce3c00c870 comp rx=0 tx=0).stop 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 shutdown_connections 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce24065ad0 0x7fce24067f90 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce40164a70 0x7fce401eace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce40164690 0x7fce400c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 --2- 172.21.15.45:0/979535442 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce400c4510 0x7fce400c7160 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 >> 172.21.15.45:0/979535442 conn(0x7fce400cba40 msgr2=0x7fce4015ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 shutdown_connections 2023-12-19T17:55:23.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.014+0000 7fce47f1e700 1 -- 172.21.15.45:0/979535442 wait complete. 2023-12-19T17:55:23.020 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:55:23.041 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2023-12-19T17:55:22.275917+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239140,"kb_used_data":7140,"kb_used_omap":0,"kb_used_meta":231936,"kb_avail":754735580,"statfs":{"total":773094113280,"available":772849233920,"internally_reserved":0,"allocated":7311360,"data_stored":3992721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":237502464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.548728"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487637+0000","last_change":"2023-12-19T17:55:18.251892+0000","last_active":"2023-12-19T17:55:20.487637+0000","last_peered":"2023-12-19T17:55:20.487637+0000","last_clean":"2023-12-19T17:55:20.487637+0000","last_became_active":"2023-12-19T17:55:18.251684+0000","last_became_peered":"2023-12-19T17:55:18.251684+0000","last_unstale":"2023-12-19T17:55:20.487637+0000","last_undegraded":"2023-12-19T17:55:20.487637+0000","last_fullsized":"2023-12-19T17:55:20.487637+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:32.021126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486668+0000","last_change":"2023-12-19T17:55:18.244171+0000","last_active":"2023-12-19T17:55:20.486668+0000","last_peered":"2023-12-19T17:55:20.486668+0000","last_clean":"2023-12-19T17:55:20.486668+0000","last_became_active":"2023-12-19T17:55:18.243932+0000","last_became_peered":"2023-12-19T17:55:18.243932+0000","last_unstale":"2023-12-19T17:55:20.486668+0000","last_undegraded":"2023-12-19T17:55:20.486668+0000","last_fullsized":"2023-12-19T17:55:20.486668+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:45.075256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240320+0000","last_change":"2023-12-19T17:55:18.249971+0000","last_active":"2023-12-19T17:55:19.240320+0000","last_peered":"2023-12-19T17:55:19.240320+0000","last_clean":"2023-12-19T17:55:19.240320+0000","last_became_active":"2023-12-19T17:55:18.247351+0000","last_became_peered":"2023-12-19T17:55:18.247351+0000","last_unstale":"2023-12-19T17:55:19.240320+0000","last_undegraded":"2023-12-19T17:55:19.240320+0000","last_fullsized":"2023-12-19T17:55:19.240320+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:58.514888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238428+0000","last_change":"2023-12-19T17:55:18.242650+0000","last_active":"2023-12-19T17:55:19.238428+0000","last_peered":"2023-12-19T17:55:19.238428+0000","last_clean":"2023-12-19T17:55:19.238428+0000","last_became_active":"2023-12-19T17:55:18.242417+0000","last_became_peered":"2023-12-19T17:55:18.242417+0000","last_unstale":"2023-12-19T17:55:19.238428+0000","last_undegraded":"2023-12-19T17:55:19.238428+0000","last_fullsized":"2023-12-19T17:55:19.238428+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:37:19.665678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487155+0000","last_change":"2023-12-19T17:55:18.247728+0000","last_active":"2023-12-19T17:55:20.487155+0000","last_peered":"2023-12-19T17:55:20.487155+0000","last_clean":"2023-12-19T17:55:20.487155+0000","last_became_active":"2023-12-19T17:55:18.245555+0000","last_became_peered":"2023-12-19T17:55:18.245555+0000","last_unstale":"2023-12-19T17:55:20.487155+0000","last_undegraded":"2023-12-19T17:55:20.487155+0000","last_fullsized":"2023-12-19T17:55:20.487155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:45.289604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488709+0000","last_change":"2023-12-19T17:55:18.260983+0000","last_active":"2023-12-19T17:55:20.488709+0000","last_peered":"2023-12-19T17:55:20.488709+0000","last_clean":"2023-12-19T17:55:20.488709+0000","last_became_active":"2023-12-19T17:55:18.256823+0000","last_became_peered":"2023-12-19T17:55:18.256823+0000","last_unstale":"2023-12-19T17:55:20.488709+0000","last_undegraded":"2023-12-19T17:55:20.488709+0000","last_fullsized":"2023-12-19T17:55:20.488709+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:02:28.018362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487796+0000","last_change":"2023-12-19T17:55:18.239836+0000","last_active":"2023-12-19T17:55:20.487796+0000","last_peered":"2023-12-19T17:55:20.487796+0000","last_clean":"2023-12-19T17:55:20.487796+0000","last_became_active":"2023-12-19T17:55:18.239555+0000","last_became_peered":"2023-12-19T17:55:18.239555+0000","last_unstale":"2023-12-19T17:55:20.487796+0000","last_undegraded":"2023-12-19T17:55:20.487796+0000","last_fullsized":"2023-12-19T17:55:20.487796+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:25.506293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487544+0000","last_change":"2023-12-19T17:55:18.251815+0000","last_active":"2023-12-19T17:55:20.487544+0000","last_peered":"2023-12-19T17:55:20.487544+0000","last_clean":"2023-12-19T17:55:20.487544+0000","last_became_active":"2023-12-19T17:55:18.251568+0000","last_became_peered":"2023-12-19T17:55:18.251568+0000","last_unstale":"2023-12-19T17:55:20.487544+0000","last_undegraded":"2023-12-19T17:55:20.487544+0000","last_fullsized":"2023-12-19T17:55:20.487544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:39:45.724115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488396+0000","last_change":"2023-12-19T17:55:18.263099+0000","last_active":"2023-12-19T17:55:20.488396+0000","last_peered":"2023-12-19T17:55:20.488396+0000","last_clean":"2023-12-19T17:55:20.488396+0000","last_became_active":"2023-12-19T17:55:18.262812+0000","last_became_peered":"2023-12-19T17:55:18.262812+0000","last_unstale":"2023-12-19T17:55:20.488396+0000","last_undegraded":"2023-12-19T17:55:20.488396+0000","last_fullsized":"2023-12-19T17:55:20.488396+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:59.319307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487736+0000","last_change":"2023-12-19T17:55:18.246594+0000","last_active":"2023-12-19T17:55:20.487736+0000","last_peered":"2023-12-19T17:55:20.487736+0000","last_clean":"2023-12-19T17:55:20.487736+0000","last_became_active":"2023-12-19T17:55:18.246354+0000","last_became_peered":"2023-12-19T17:55:18.246354+0000","last_unstale":"2023-12-19T17:55:20.487736+0000","last_undegraded":"2023-12-19T17:55:20.487736+0000","last_fullsized":"2023-12-19T17:55:20.487736+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486687+0000","last_change":"2023-12-19T17:55:18.253372+0000","last_active":"2023-12-19T17:55:20.486687+0000","last_peered":"2023-12-19T17:55:20.486687+0000","last_clean":"2023-12-19T17:55:20.486687+0000","last_became_active":"2023-12-19T17:55:18.252840+0000","last_became_peered":"2023-12-19T17:55:18.252840+0000","last_unstale":"2023-12-19T17:55:20.486687+0000","last_undegraded":"2023-12-19T17:55:20.486687+0000","last_fullsized":"2023-12-19T17:55:20.486687+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:51.030123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238604+0000","last_change":"2023-12-19T17:55:18.236730+0000","last_active":"2023-12-19T17:55:19.238604+0000","last_peered":"2023-12-19T17:55:19.238604+0000","last_clean":"2023-12-19T17:55:19.238604+0000","last_became_active":"2023-12-19T17:55:18.236414+0000","last_became_peered":"2023-12-19T17:55:18.236414+0000","last_unstale":"2023-12-19T17:55:19.238604+0000","last_undegraded":"2023-12-19T17:55:19.238604+0000","last_fullsized":"2023-12-19T17:55:19.238604+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:17.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240656+0000","last_change":"2023-12-19T17:55:18.259970+0000","last_active":"2023-12-19T17:55:19.240656+0000","last_peered":"2023-12-19T17:55:19.240656+0000","last_clean":"2023-12-19T17:55:19.240656+0000","last_became_active":"2023-12-19T17:55:18.259577+0000","last_became_peered":"2023-12-19T17:55:18.259577+0000","last_unstale":"2023-12-19T17:55:19.240656+0000","last_undegraded":"2023-12-19T17:55:19.240656+0000","last_fullsized":"2023-12-19T17:55:19.240656+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:53.873021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487894+0000","last_change":"2023-12-19T17:55:18.247564+0000","last_active":"2023-12-19T17:55:20.487894+0000","last_peered":"2023-12-19T17:55:20.487894+0000","last_clean":"2023-12-19T17:55:20.487894+0000","last_became_active":"2023-12-19T17:55:18.247057+0000","last_became_peered":"2023-12-19T17:55:18.247057+0000","last_unstale":"2023-12-19T17:55:20.487894+0000","last_undegraded":"2023-12-19T17:55:20.487894+0000","last_fullsized":"2023-12-19T17:55:20.487894+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:00:56.885433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487963+0000","last_change":"2023-12-19T17:55:18.243756+0000","last_active":"2023-12-19T17:55:20.487963+0000","last_peered":"2023-12-19T17:55:20.487963+0000","last_clean":"2023-12-19T17:55:20.487963+0000","last_became_active":"2023-12-19T17:55:18.243395+0000","last_became_peered":"2023-12-19T17:55:18.243395+0000","last_unstale":"2023-12-19T17:55:20.487963+0000","last_undegraded":"2023-12-19T17:55:20.487963+0000","last_fullsized":"2023-12-19T17:55:20.487963+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:20.744879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486442+0000","last_change":"2023-12-19T17:55:18.257215+0000","last_active":"2023-12-19T17:55:20.486442+0000","last_peered":"2023-12-19T17:55:20.486442+0000","last_clean":"2023-12-19T17:55:20.486442+0000","last_became_active":"2023-12-19T17:55:18.256890+0000","last_became_peered":"2023-12-19T17:55:18.256890+0000","last_unstale":"2023-12-19T17:55:20.486442+0000","last_undegraded":"2023-12-19T17:55:20.486442+0000","last_fullsized":"2023-12-19T17:55:20.486442+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:35.799571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487871+0000","last_change":"2023-12-19T17:55:18.242029+0000","last_active":"2023-12-19T17:55:20.487871+0000","last_peered":"2023-12-19T17:55:20.487871+0000","last_clean":"2023-12-19T17:55:20.487871+0000","last_became_active":"2023-12-19T17:55:18.241704+0000","last_became_peered":"2023-12-19T17:55:18.241704+0000","last_unstale":"2023-12-19T17:55:20.487871+0000","last_undegraded":"2023-12-19T17:55:20.487871+0000","last_fullsized":"2023-12-19T17:55:20.487871+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:02.003405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240874+0000","last_change":"2023-12-19T17:55:18.261651+0000","last_active":"2023-12-19T17:55:19.240874+0000","last_peered":"2023-12-19T17:55:19.240874+0000","last_clean":"2023-12-19T17:55:19.240874+0000","last_became_active":"2023-12-19T17:55:18.261306+0000","last_became_peered":"2023-12-19T17:55:18.261306+0000","last_unstale":"2023-12-19T17:55:19.240874+0000","last_undegraded":"2023-12-19T17:55:19.240874+0000","last_fullsized":"2023-12-19T17:55:19.240874+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:08.057743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487541+0000","last_change":"2023-12-19T17:55:18.254025+0000","last_active":"2023-12-19T17:55:20.487541+0000","last_peered":"2023-12-19T17:55:20.487541+0000","last_clean":"2023-12-19T17:55:20.487541+0000","last_became_active":"2023-12-19T17:55:18.253745+0000","last_became_peered":"2023-12-19T17:55:18.253745+0000","last_unstale":"2023-12-19T17:55:20.487541+0000","last_undegraded":"2023-12-19T17:55:20.487541+0000","last_fullsized":"2023-12-19T17:55:20.487541+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:25:32.622524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487353+0000","last_change":"2023-12-19T17:55:18.262825+0000","last_active":"2023-12-19T17:55:20.487353+0000","last_peered":"2023-12-19T17:55:20.487353+0000","last_clean":"2023-12-19T17:55:20.487353+0000","last_became_active":"2023-12-19T17:55:18.262589+0000","last_became_peered":"2023-12-19T17:55:18.262589+0000","last_unstale":"2023-12-19T17:55:20.487353+0000","last_undegraded":"2023-12-19T17:55:20.487353+0000","last_fullsized":"2023-12-19T17:55:20.487353+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:18:16.952866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239865+0000","last_change":"2023-12-19T17:55:18.239837+0000","last_active":"2023-12-19T17:55:19.239865+0000","last_peered":"2023-12-19T17:55:19.239865+0000","last_clean":"2023-12-19T17:55:19.239865+0000","last_became_active":"2023-12-19T17:55:18.239569+0000","last_became_peered":"2023-12-19T17:55:18.239569+0000","last_unstale":"2023-12-19T17:55:19.239865+0000","last_undegraded":"2023-12-19T17:55:19.239865+0000","last_fullsized":"2023-12-19T17:55:19.239865+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:28.439890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487170+0000","last_change":"2023-12-19T17:55:18.253471+0000","last_active":"2023-12-19T17:55:20.487170+0000","last_peered":"2023-12-19T17:55:20.487170+0000","last_clean":"2023-12-19T17:55:20.487170+0000","last_became_active":"2023-12-19T17:55:18.253203+0000","last_became_peered":"2023-12-19T17:55:18.253203+0000","last_unstale":"2023-12-19T17:55:20.487170+0000","last_undegraded":"2023-12-19T17:55:20.487170+0000","last_fullsized":"2023-12-19T17:55:20.487170+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:26:17.789720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239669+0000","last_change":"2023-12-19T17:55:18.252965+0000","last_active":"2023-12-19T17:55:19.239669+0000","last_peered":"2023-12-19T17:55:19.239669+0000","last_clean":"2023-12-19T17:55:19.239669+0000","last_became_active":"2023-12-19T17:55:18.252207+0000","last_became_peered":"2023-12-19T17:55:18.252207+0000","last_unstale":"2023-12-19T17:55:19.239669+0000","last_undegraded":"2023-12-19T17:55:19.239669+0000","last_fullsized":"2023-12-19T17:55:19.239669+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:57.908847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240156+0000","last_change":"2023-12-19T17:55:18.259959+0000","last_active":"2023-12-19T17:55:19.240156+0000","last_peered":"2023-12-19T17:55:19.240156+0000","last_clean":"2023-12-19T17:55:19.240156+0000","last_became_active":"2023-12-19T17:55:18.259459+0000","last_became_peered":"2023-12-19T17:55:18.259459+0000","last_unstale":"2023-12-19T17:55:19.240156+0000","last_undegraded":"2023-12-19T17:55:19.240156+0000","last_fullsized":"2023-12-19T17:55:19.240156+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:55.682253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488117+0000","last_change":"2023-12-19T17:55:18.248233+0000","last_active":"2023-12-19T17:55:20.488117+0000","last_peered":"2023-12-19T17:55:20.488117+0000","last_clean":"2023-12-19T17:55:20.488117+0000","last_became_active":"2023-12-19T17:55:18.247987+0000","last_became_peered":"2023-12-19T17:55:18.247987+0000","last_unstale":"2023-12-19T17:55:20.488117+0000","last_undegraded":"2023-12-19T17:55:20.488117+0000","last_fullsized":"2023-12-19T17:55:20.488117+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:08.230886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238630+0000","last_change":"2023-12-19T17:55:18.255489+0000","last_active":"2023-12-19T17:55:19.238630+0000","last_peered":"2023-12-19T17:55:19.238630+0000","last_clean":"2023-12-19T17:55:19.238630+0000","last_became_active":"2023-12-19T17:55:18.255204+0000","last_became_peered":"2023-12-19T17:55:18.255204+0000","last_unstale":"2023-12-19T17:55:19.238630+0000","last_undegraded":"2023-12-19T17:55:19.238630+0000","last_fullsized":"2023-12-19T17:55:19.238630+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:58.514888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488884+0000","last_change":"2023-12-19T17:55:18.257284+0000","last_active":"2023-12-19T17:55:20.488884+0000","last_peered":"2023-12-19T17:55:20.488884+0000","last_clean":"2023-12-19T17:55:20.488884+0000","last_became_active":"2023-12-19T17:55:18.257019+0000","last_became_peered":"2023-12-19T17:55:18.257019+0000","last_unstale":"2023-12-19T17:55:20.488884+0000","last_undegraded":"2023-12-19T17:55:20.488884+0000","last_fullsized":"2023-12-19T17:55:20.488884+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:19.086583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487325+0000","last_change":"2023-12-19T17:55:18.241647+0000","last_active":"2023-12-19T17:55:20.487325+0000","last_peered":"2023-12-19T17:55:20.487325+0000","last_clean":"2023-12-19T17:55:20.487325+0000","last_became_active":"2023-12-19T17:55:18.241398+0000","last_became_peered":"2023-12-19T17:55:18.241398+0000","last_unstale":"2023-12-19T17:55:20.487325+0000","last_undegraded":"2023-12-19T17:55:20.487325+0000","last_fullsized":"2023-12-19T17:55:20.487325+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:43:29.088748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487322+0000","last_change":"2023-12-19T17:55:18.249643+0000","last_active":"2023-12-19T17:55:20.487322+0000","last_peered":"2023-12-19T17:55:20.487322+0000","last_clean":"2023-12-19T17:55:20.487322+0000","last_became_active":"2023-12-19T17:55:18.249219+0000","last_became_peered":"2023-12-19T17:55:18.249219+0000","last_unstale":"2023-12-19T17:55:20.487322+0000","last_undegraded":"2023-12-19T17:55:20.487322+0000","last_fullsized":"2023-12-19T17:55:20.487322+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:53:38.494974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239857+0000","last_change":"2023-12-19T17:55:18.245660+0000","last_active":"2023-12-19T17:55:19.239857+0000","last_peered":"2023-12-19T17:55:19.239857+0000","last_clean":"2023-12-19T17:55:19.239857+0000","last_became_active":"2023-12-19T17:55:18.245315+0000","last_became_peered":"2023-12-19T17:55:18.245315+0000","last_unstale":"2023-12-19T17:55:19.239857+0000","last_undegraded":"2023-12-19T17:55:19.239857+0000","last_fullsized":"2023-12-19T17:55:19.239857+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:25:39.410616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487022+0000","last_change":"2023-12-19T17:55:18.248489+0000","last_active":"2023-12-19T17:55:20.487022+0000","last_peered":"2023-12-19T17:55:20.487022+0000","last_clean":"2023-12-19T17:55:20.487022+0000","last_became_active":"2023-12-19T17:55:18.246595+0000","last_became_peered":"2023-12-19T17:55:18.246595+0000","last_unstale":"2023-12-19T17:55:20.487022+0000","last_undegraded":"2023-12-19T17:55:20.487022+0000","last_fullsized":"2023-12-19T17:55:20.487022+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:43.684105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486529+0000","last_change":"2023-12-19T17:55:18.261826+0000","last_active":"2023-12-19T17:55:20.486529+0000","last_peered":"2023-12-19T17:55:20.486529+0000","last_clean":"2023-12-19T17:55:20.486529+0000","last_became_active":"2023-12-19T17:55:18.261544+0000","last_became_peered":"2023-12-19T17:55:18.261544+0000","last_unstale":"2023-12-19T17:55:20.486529+0000","last_undegraded":"2023-12-19T17:55:20.486529+0000","last_fullsized":"2023-12-19T17:55:20.486529+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:11.437430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489302+0000","last_change":"2023-12-19T17:55:18.260189+0000","last_active":"2023-12-19T17:55:20.489302+0000","last_peered":"2023-12-19T17:55:20.489302+0000","last_clean":"2023-12-19T17:55:20.489302+0000","last_became_active":"2023-12-19T17:55:18.259935+0000","last_became_peered":"2023-12-19T17:55:18.259935+0000","last_unstale":"2023-12-19T17:55:20.489302+0000","last_undegraded":"2023-12-19T17:55:20.489302+0000","last_fullsized":"2023-12-19T17:55:20.489302+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:07:30.237965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"62'4","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489674+0000","last_change":"2023-12-19T17:55:17.767635+0000","last_active":"2023-12-19T17:55:20.489674+0000","last_peered":"2023-12-19T17:55:20.489674+0000","last_clean":"2023-12-19T17:55:20.489674+0000","last_became_active":"2023-12-19T17:55:17.767359+0000","last_became_peered":"2023-12-19T17:55:17.767359+0000","last_unstale":"2023-12-19T17:55:20.489674+0000","last_undegraded":"2023-12-19T17:55:20.489674+0000","last_fullsized":"2023-12-19T17:55:20.489674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:12.184942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488130+0000","last_change":"2023-12-19T17:55:18.236470+0000","last_active":"2023-12-19T17:55:20.488130+0000","last_peered":"2023-12-19T17:55:20.488130+0000","last_clean":"2023-12-19T17:55:20.488130+0000","last_became_active":"2023-12-19T17:55:18.236212+0000","last_became_peered":"2023-12-19T17:55:18.236212+0000","last_unstale":"2023-12-19T17:55:20.488130+0000","last_undegraded":"2023-12-19T17:55:20.488130+0000","last_fullsized":"2023-12-19T17:55:20.488130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:10.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486774+0000","last_change":"2023-12-19T17:55:17.758562+0000","last_active":"2023-12-19T17:55:20.486774+0000","last_peered":"2023-12-19T17:55:20.486774+0000","last_clean":"2023-12-19T17:55:20.486774+0000","last_became_active":"2023-12-19T17:55:17.758267+0000","last_became_peered":"2023-12-19T17:55:17.758267+0000","last_unstale":"2023-12-19T17:55:20.486774+0000","last_undegraded":"2023-12-19T17:55:20.486774+0000","last_fullsized":"2023-12-19T17:55:20.486774+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:46:24.015088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488795+0000","last_change":"2023-12-19T17:55:18.253444+0000","last_active":"2023-12-19T17:55:20.488795+0000","last_peered":"2023-12-19T17:55:20.488795+0000","last_clean":"2023-12-19T17:55:20.488795+0000","last_became_active":"2023-12-19T17:55:18.253203+0000","last_became_peered":"2023-12-19T17:55:18.253203+0000","last_unstale":"2023-12-19T17:55:20.488795+0000","last_undegraded":"2023-12-19T17:55:20.488795+0000","last_fullsized":"2023-12-19T17:55:20.488795+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:22.197372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489155+0000","last_change":"2023-12-19T17:55:17.760137+0000","last_active":"2023-12-19T17:55:20.489155+0000","last_peered":"2023-12-19T17:55:20.489155+0000","last_clean":"2023-12-19T17:55:20.489155+0000","last_became_active":"2023-12-19T17:55:17.759868+0000","last_became_peered":"2023-12-19T17:55:17.759868+0000","last_unstale":"2023-12-19T17:55:20.489155+0000","last_undegraded":"2023-12-19T17:55:20.489155+0000","last_fullsized":"2023-12-19T17:55:20.489155+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:52.174805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489104+0000","last_change":"2023-12-19T17:55:18.257228+0000","last_active":"2023-12-19T17:55:20.489104+0000","last_peered":"2023-12-19T17:55:20.489104+0000","last_clean":"2023-12-19T17:55:20.489104+0000","last_became_active":"2023-12-19T17:55:18.256910+0000","last_became_peered":"2023-12-19T17:55:18.256910+0000","last_unstale":"2023-12-19T17:55:20.489104+0000","last_undegraded":"2023-12-19T17:55:20.489104+0000","last_fullsized":"2023-12-19T17:55:20.489104+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:35:56.251006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238795+0000","last_change":"2023-12-19T17:55:17.764741+0000","last_active":"2023-12-19T17:55:19.238795+0000","last_peered":"2023-12-19T17:55:19.238795+0000","last_clean":"2023-12-19T17:55:19.238795+0000","last_became_active":"2023-12-19T17:55:17.764378+0000","last_became_peered":"2023-12-19T17:55:17.764378+0000","last_unstale":"2023-12-19T17:55:19.238795+0000","last_undegraded":"2023-12-19T17:55:19.238795+0000","last_fullsized":"2023-12-19T17:55:19.238795+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:50.699133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486889+0000","last_change":"2023-12-19T17:55:18.246805+0000","last_active":"2023-12-19T17:55:20.486889+0000","last_peered":"2023-12-19T17:55:20.486889+0000","last_clean":"2023-12-19T17:55:20.486889+0000","last_became_active":"2023-12-19T17:55:18.246486+0000","last_became_peered":"2023-12-19T17:55:18.246486+0000","last_unstale":"2023-12-19T17:55:20.486889+0000","last_undegraded":"2023-12-19T17:55:20.486889+0000","last_fullsized":"2023-12-19T17:55:20.486889+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:15:55.790061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488157+0000","last_change":"2023-12-19T17:55:17.762133+0000","last_active":"2023-12-19T17:55:20.488157+0000","last_peered":"2023-12-19T17:55:20.488157+0000","last_clean":"2023-12-19T17:55:20.488157+0000","last_became_active":"2023-12-19T17:55:17.761864+0000","last_became_peered":"2023-12-19T17:55:17.761864+0000","last_unstale":"2023-12-19T17:55:20.488157+0000","last_undegraded":"2023-12-19T17:55:20.488157+0000","last_fullsized":"2023-12-19T17:55:20.488157+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:07:07.217975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487209+0000","last_change":"2023-12-19T17:55:18.264006+0000","last_active":"2023-12-19T17:55:20.487209+0000","last_peered":"2023-12-19T17:55:20.487209+0000","last_clean":"2023-12-19T17:55:20.487209+0000","last_became_active":"2023-12-19T17:55:18.263735+0000","last_became_peered":"2023-12-19T17:55:18.263735+0000","last_unstale":"2023-12-19T17:55:20.487209+0000","last_undegraded":"2023-12-19T17:55:20.487209+0000","last_fullsized":"2023-12-19T17:55:20.487209+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:44:15.849126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488856+0000","last_change":"2023-12-19T17:55:17.768334+0000","last_active":"2023-12-19T17:55:20.488856+0000","last_peered":"2023-12-19T17:55:20.488856+0000","last_clean":"2023-12-19T17:55:20.488856+0000","last_became_active":"2023-12-19T17:55:17.768077+0000","last_became_peered":"2023-12-19T17:55:17.768077+0000","last_unstale":"2023-12-19T17:55:20.488856+0000","last_undegraded":"2023-12-19T17:55:20.488856+0000","last_fullsized":"2023-12-19T17:55:20.488856+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:02:57.501977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240172+0000","last_change":"2023-12-19T17:55:18.259783+0000","last_active":"2023-12-19T17:55:19.240172+0000","last_peered":"2023-12-19T17:55:19.240172+0000","last_clean":"2023-12-19T17:55:19.240172+0000","last_became_active":"2023-12-19T17:55:18.258668+0000","last_became_peered":"2023-12-19T17:55:18.258668+0000","last_unstale":"2023-12-19T17:55:19.240172+0000","last_undegraded":"2023-12-19T17:55:19.240172+0000","last_fullsized":"2023-12-19T17:55:19.240172+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:59.998197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.237902+0000","last_change":"2023-12-19T17:55:17.766323+0000","last_active":"2023-12-19T17:55:19.237902+0000","last_peered":"2023-12-19T17:55:19.237902+0000","last_clean":"2023-12-19T17:55:19.237902+0000","last_became_active":"2023-12-19T17:55:17.765966+0000","last_became_peered":"2023-12-19T17:55:17.765966+0000","last_unstale":"2023-12-19T17:55:19.237902+0000","last_undegraded":"2023-12-19T17:55:19.237902+0000","last_fullsized":"2023-12-19T17:55:19.237902+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:33:24.493382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486959+0000","last_change":"2023-12-19T17:55:18.245480+0000","last_active":"2023-12-19T17:55:20.486959+0000","last_peered":"2023-12-19T17:55:20.486959+0000","last_clean":"2023-12-19T17:55:20.486959+0000","last_became_active":"2023-12-19T17:55:18.241016+0000","last_became_peered":"2023-12-19T17:55:18.241016+0000","last_unstale":"2023-12-19T17:55:20.486959+0000","last_undegraded":"2023-12-19T17:55:20.486959+0000","last_fullsized":"2023-12-19T17:55:20.486959+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:02:22.305160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487745+0000","last_change":"2023-12-19T17:55:17.758319+0000","last_active":"2023-12-19T17:55:20.487745+0000","last_peered":"2023-12-19T17:55:20.487745+0000","last_clean":"2023-12-19T17:55:20.487745+0000","last_became_active":"2023-12-19T17:55:17.757866+0000","last_became_peered":"2023-12-19T17:55:17.757866+0000","last_unstale":"2023-12-19T17:55:20.487745+0000","last_undegraded":"2023-12-19T17:55:20.487745+0000","last_fullsized":"2023-12-19T17:55:20.487745+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:31.008216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488565+0000","last_change":"2023-12-19T17:55:18.245403+0000","last_active":"2023-12-19T17:55:20.488565+0000","last_peered":"2023-12-19T17:55:20.488565+0000","last_clean":"2023-12-19T17:55:20.488565+0000","last_became_active":"2023-12-19T17:55:18.245022+0000","last_became_peered":"2023-12-19T17:55:18.245022+0000","last_unstale":"2023-12-19T17:55:20.488565+0000","last_undegraded":"2023-12-19T17:55:20.488565+0000","last_fullsized":"2023-12-19T17:55:20.488565+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:26:51.712043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240713+0000","last_change":"2023-12-19T17:55:17.769193+0000","last_active":"2023-12-19T17:55:19.240713+0000","last_peered":"2023-12-19T17:55:19.240713+0000","last_clean":"2023-12-19T17:55:19.240713+0000","last_became_active":"2023-12-19T17:55:17.768870+0000","last_became_peered":"2023-12-19T17:55:17.768870+0000","last_unstale":"2023-12-19T17:55:19.240713+0000","last_undegraded":"2023-12-19T17:55:19.240713+0000","last_fullsized":"2023-12-19T17:55:19.240713+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:54.669343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240620+0000","last_change":"2023-12-19T17:55:18.244693+0000","last_active":"2023-12-19T17:55:19.240620+0000","last_peered":"2023-12-19T17:55:19.240620+0000","last_clean":"2023-12-19T17:55:19.240620+0000","last_became_active":"2023-12-19T17:55:18.244282+0000","last_became_peered":"2023-12-19T17:55:18.244282+0000","last_unstale":"2023-12-19T17:55:19.240620+0000","last_undegraded":"2023-12-19T17:55:19.240620+0000","last_fullsized":"2023-12-19T17:55:19.240620+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:16:58.374282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486889+0000","last_change":"2023-12-19T17:55:17.756435+0000","last_active":"2023-12-19T17:55:20.486889+0000","last_peered":"2023-12-19T17:55:20.486889+0000","last_clean":"2023-12-19T17:55:20.486889+0000","last_became_active":"2023-12-19T17:55:17.756150+0000","last_became_peered":"2023-12-19T17:55:17.756150+0000","last_unstale":"2023-12-19T17:55:20.486889+0000","last_undegraded":"2023-12-19T17:55:20.486889+0000","last_fullsized":"2023-12-19T17:55:20.486889+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:02:18.073672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486378+0000","last_change":"2023-12-19T17:55:18.261028+0000","last_active":"2023-12-19T17:55:20.486378+0000","last_peered":"2023-12-19T17:55:20.486378+0000","last_clean":"2023-12-19T17:55:20.486378+0000","last_became_active":"2023-12-19T17:55:18.260774+0000","last_became_peered":"2023-12-19T17:55:18.260774+0000","last_unstale":"2023-12-19T17:55:20.486378+0000","last_undegraded":"2023-12-19T17:55:20.486378+0000","last_fullsized":"2023-12-19T17:55:20.486378+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"62'3","reported_seq":14,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240486+0000","last_change":"2023-12-19T17:55:17.769056+0000","last_active":"2023-12-19T17:55:19.240486+0000","last_peered":"2023-12-19T17:55:19.240486+0000","last_clean":"2023-12-19T17:55:19.240486+0000","last_became_active":"2023-12-19T17:55:17.768754+0000","last_became_peered":"2023-12-19T17:55:17.768754+0000","last_unstale":"2023-12-19T17:55:19.240486+0000","last_undegraded":"2023-12-19T17:55:19.240486+0000","last_fullsized":"2023-12-19T17:55:19.240486+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:52.860111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240417+0000","last_change":"2023-12-19T17:55:18.247603+0000","last_active":"2023-12-19T17:55:19.240417+0000","last_peered":"2023-12-19T17:55:19.240417+0000","last_clean":"2023-12-19T17:55:19.240417+0000","last_became_active":"2023-12-19T17:55:18.247000+0000","last_became_peered":"2023-12-19T17:55:18.247000+0000","last_unstale":"2023-12-19T17:55:19.240417+0000","last_undegraded":"2023-12-19T17:55:19.240417+0000","last_fullsized":"2023-12-19T17:55:19.240417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:17.076246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"62'6","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488359+0000","last_change":"2023-12-19T17:55:17.764039+0000","last_active":"2023-12-19T17:55:20.488359+0000","last_peered":"2023-12-19T17:55:20.488359+0000","last_clean":"2023-12-19T17:55:20.488359+0000","last_became_active":"2023-12-19T17:55:17.763682+0000","last_became_peered":"2023-12-19T17:55:17.763682+0000","last_unstale":"2023-12-19T17:55:20.488359+0000","last_undegraded":"2023-12-19T17:55:20.488359+0000","last_fullsized":"2023-12-19T17:55:20.488359+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:58.985286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.237975+0000","last_change":"2023-12-19T17:55:18.244656+0000","last_active":"2023-12-19T17:55:19.237975+0000","last_peered":"2023-12-19T17:55:19.237975+0000","last_clean":"2023-12-19T17:55:19.237975+0000","last_became_active":"2023-12-19T17:55:18.244366+0000","last_became_peered":"2023-12-19T17:55:18.244366+0000","last_unstale":"2023-12-19T17:55:19.237975+0000","last_undegraded":"2023-12-19T17:55:19.237975+0000","last_fullsized":"2023-12-19T17:55:19.237975+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:16:58.374282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488262+0000","last_change":"2023-12-19T17:55:17.756300+0000","last_active":"2023-12-19T17:55:20.488262+0000","last_peered":"2023-12-19T17:55:20.488262+0000","last_clean":"2023-12-19T17:55:20.488262+0000","last_became_active":"2023-12-19T17:55:17.755793+0000","last_became_peered":"2023-12-19T17:55:17.755793+0000","last_unstale":"2023-12-19T17:55:20.488262+0000","last_undegraded":"2023-12-19T17:55:20.488262+0000","last_fullsized":"2023-12-19T17:55:20.488262+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:58.361501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240264+0000","last_change":"2023-12-19T17:55:18.241304+0000","last_active":"2023-12-19T17:55:19.240264+0000","last_peered":"2023-12-19T17:55:19.240264+0000","last_clean":"2023-12-19T17:55:19.240264+0000","last_became_active":"2023-12-19T17:55:18.241041+0000","last_became_peered":"2023-12-19T17:55:18.241041+0000","last_unstale":"2023-12-19T17:55:19.240264+0000","last_undegraded":"2023-12-19T17:55:19.240264+0000","last_fullsized":"2023-12-19T17:55:19.240264+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:30.809783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240506+0000","last_change":"2023-12-19T17:55:17.760120+0000","last_active":"2023-12-19T17:55:19.240506+0000","last_peered":"2023-12-19T17:55:19.240506+0000","last_clean":"2023-12-19T17:55:19.240506+0000","last_became_active":"2023-12-19T17:55:17.759823+0000","last_became_peered":"2023-12-19T17:55:17.759823+0000","last_unstale":"2023-12-19T17:55:19.240506+0000","last_undegraded":"2023-12-19T17:55:19.240506+0000","last_fullsized":"2023-12-19T17:55:19.240506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:23:42.671194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487654+0000","last_change":"2023-12-19T17:55:18.251804+0000","last_active":"2023-12-19T17:55:20.487654+0000","last_peered":"2023-12-19T17:55:20.487654+0000","last_clean":"2023-12-19T17:55:20.487654+0000","last_became_active":"2023-12-19T17:55:18.251519+0000","last_became_peered":"2023-12-19T17:55:18.251519+0000","last_unstale":"2023-12-19T17:55:20.487654+0000","last_undegraded":"2023-12-19T17:55:20.487654+0000","last_fullsized":"2023-12-19T17:55:20.487654+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:58.098436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238109+0000","last_change":"2023-12-19T17:55:17.765145+0000","last_active":"2023-12-19T17:55:19.238109+0000","last_peered":"2023-12-19T17:55:19.238109+0000","last_clean":"2023-12-19T17:55:19.238109+0000","last_became_active":"2023-12-19T17:55:17.764520+0000","last_became_peered":"2023-12-19T17:55:17.764520+0000","last_unstale":"2023-12-19T17:55:19.238109+0000","last_undegraded":"2023-12-19T17:55:19.238109+0000","last_fullsized":"2023-12-19T17:55:19.238109+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:46:45.356145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239810+0000","last_change":"2023-12-19T17:55:18.253139+0000","last_active":"2023-12-19T17:55:19.239810+0000","last_peered":"2023-12-19T17:55:19.239810+0000","last_clean":"2023-12-19T17:55:19.239810+0000","last_became_active":"2023-12-19T17:55:18.252627+0000","last_became_peered":"2023-12-19T17:55:18.252627+0000","last_unstale":"2023-12-19T17:55:19.239810+0000","last_undegraded":"2023-12-19T17:55:19.239810+0000","last_fullsized":"2023-12-19T17:55:19.239810+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:10.772009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"62'8","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.239639+0000","last_change":"2023-12-19T17:55:17.757464+0000","last_active":"2023-12-19T17:55:19.239639+0000","last_peered":"2023-12-19T17:55:19.239639+0000","last_clean":"2023-12-19T17:55:19.239639+0000","last_became_active":"2023-12-19T17:55:17.757172+0000","last_became_peered":"2023-12-19T17:55:17.757172+0000","last_unstale":"2023-12-19T17:55:19.239639+0000","last_undegraded":"2023-12-19T17:55:19.239639+0000","last_fullsized":"2023-12-19T17:55:19.239639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:58.985286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240873+0000","last_change":"2023-12-19T17:55:18.254870+0000","last_active":"2023-12-19T17:55:19.240873+0000","last_peered":"2023-12-19T17:55:19.240873+0000","last_clean":"2023-12-19T17:55:19.240873+0000","last_became_active":"2023-12-19T17:55:18.254600+0000","last_became_peered":"2023-12-19T17:55:18.254600+0000","last_unstale":"2023-12-19T17:55:19.240873+0000","last_undegraded":"2023-12-19T17:55:19.240873+0000","last_fullsized":"2023-12-19T17:55:19.240873+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:13.197853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488000+0000","last_change":"2023-12-19T17:55:17.765131+0000","last_active":"2023-12-19T17:55:20.488000+0000","last_peered":"2023-12-19T17:55:20.488000+0000","last_clean":"2023-12-19T17:55:20.488000+0000","last_became_active":"2023-12-19T17:55:17.764848+0000","last_became_peered":"2023-12-19T17:55:17.764848+0000","last_unstale":"2023-12-19T17:55:20.488000+0000","last_undegraded":"2023-12-19T17:55:20.488000+0000","last_fullsized":"2023-12-19T17:55:20.488000+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:40:10.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238211+0000","last_change":"2023-12-19T17:55:18.244472+0000","last_active":"2023-12-19T17:55:19.238211+0000","last_peered":"2023-12-19T17:55:19.238211+0000","last_clean":"2023-12-19T17:55:19.238211+0000","last_became_active":"2023-12-19T17:55:18.243554+0000","last_became_peered":"2023-12-19T17:55:18.243554+0000","last_unstale":"2023-12-19T17:55:19.238211+0000","last_undegraded":"2023-12-19T17:55:19.238211+0000","last_fullsized":"2023-12-19T17:55:19.238211+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:28:48.880083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489454+0000","last_change":"2023-12-19T17:55:17.766391+0000","last_active":"2023-12-19T17:55:20.489454+0000","last_peered":"2023-12-19T17:55:20.489454+0000","last_clean":"2023-12-19T17:55:20.489454+0000","last_became_active":"2023-12-19T17:55:17.760938+0000","last_became_peered":"2023-12-19T17:55:17.760938+0000","last_unstale":"2023-12-19T17:55:20.489454+0000","last_undegraded":"2023-12-19T17:55:20.489454+0000","last_fullsized":"2023-12-19T17:55:20.489454+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:23.500267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487499+0000","last_change":"2023-12-19T17:55:18.250913+0000","last_active":"2023-12-19T17:55:20.487499+0000","last_peered":"2023-12-19T17:55:20.487499+0000","last_clean":"2023-12-19T17:55:20.487499+0000","last_became_active":"2023-12-19T17:55:18.250606+0000","last_became_peered":"2023-12-19T17:55:18.250606+0000","last_unstale":"2023-12-19T17:55:20.487499+0000","last_undegraded":"2023-12-19T17:55:20.487499+0000","last_fullsized":"2023-12-19T17:55:20.487499+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:31:57.845797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"62'1","reported_seq":12,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238449+0000","last_change":"2023-12-19T17:55:17.763724+0000","last_active":"2023-12-19T17:55:19.238449+0000","last_peered":"2023-12-19T17:55:19.238449+0000","last_clean":"2023-12-19T17:55:19.238449+0000","last_became_active":"2023-12-19T17:55:17.763466+0000","last_became_peered":"2023-12-19T17:55:17.763466+0000","last_unstale":"2023-12-19T17:55:19.238449+0000","last_undegraded":"2023-12-19T17:55:19.238449+0000","last_fullsized":"2023-12-19T17:55:19.238449+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:28:53.876618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240393+0000","last_change":"2023-12-19T17:55:18.246035+0000","last_active":"2023-12-19T17:55:19.240393+0000","last_peered":"2023-12-19T17:55:19.240393+0000","last_clean":"2023-12-19T17:55:19.240393+0000","last_became_active":"2023-12-19T17:55:18.243147+0000","last_became_peered":"2023-12-19T17:55:18.243147+0000","last_unstale":"2023-12-19T17:55:19.240393+0000","last_undegraded":"2023-12-19T17:55:19.240393+0000","last_fullsized":"2023-12-19T17:55:19.240393+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:54:05.369657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488969+0000","last_change":"2023-12-19T17:55:17.754756+0000","last_active":"2023-12-19T17:55:20.488969+0000","last_peered":"2023-12-19T17:55:20.488969+0000","last_clean":"2023-12-19T17:55:20.488969+0000","last_became_active":"2023-12-19T17:55:17.754482+0000","last_became_peered":"2023-12-19T17:55:17.754482+0000","last_unstale":"2023-12-19T17:55:20.488969+0000","last_undegraded":"2023-12-19T17:55:20.488969+0000","last_fullsized":"2023-12-19T17:55:20.488969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:08:09.759098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238068+0000","last_change":"2023-12-19T17:55:18.245173+0000","last_active":"2023-12-19T17:55:19.238068+0000","last_peered":"2023-12-19T17:55:19.238068+0000","last_clean":"2023-12-19T17:55:19.238068+0000","last_became_active":"2023-12-19T17:55:18.241410+0000","last_became_peered":"2023-12-19T17:55:18.241410+0000","last_unstale":"2023-12-19T17:55:19.238068+0000","last_undegraded":"2023-12-19T17:55:19.238068+0000","last_fullsized":"2023-12-19T17:55:19.238068+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:54:05.369657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487414+0000","last_change":"2023-12-19T17:55:17.757007+0000","last_active":"2023-12-19T17:55:20.487414+0000","last_peered":"2023-12-19T17:55:20.487414+0000","last_clean":"2023-12-19T17:55:20.487414+0000","last_became_active":"2023-12-19T17:55:17.755420+0000","last_became_peered":"2023-12-19T17:55:17.755420+0000","last_unstale":"2023-12-19T17:55:20.487414+0000","last_undegraded":"2023-12-19T17:55:20.487414+0000","last_fullsized":"2023-12-19T17:55:20.487414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:21.184462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489173+0000","last_change":"2023-12-19T17:55:18.264427+0000","last_active":"2023-12-19T17:55:20.489173+0000","last_peered":"2023-12-19T17:55:20.489173+0000","last_clean":"2023-12-19T17:55:20.489173+0000","last_became_active":"2023-12-19T17:55:18.257463+0000","last_became_peered":"2023-12-19T17:55:18.257463+0000","last_unstale":"2023-12-19T17:55:20.489173+0000","last_undegraded":"2023-12-19T17:55:20.489173+0000","last_fullsized":"2023-12-19T17:55:20.489173+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:10:59.374412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486059+0000","last_change":"2023-12-19T17:55:17.770046+0000","last_active":"2023-12-19T17:55:20.486059+0000","last_peered":"2023-12-19T17:55:20.486059+0000","last_clean":"2023-12-19T17:55:20.486059+0000","last_became_active":"2023-12-19T17:55:17.769763+0000","last_became_peered":"2023-12-19T17:55:17.769763+0000","last_unstale":"2023-12-19T17:55:20.486059+0000","last_undegraded":"2023-12-19T17:55:20.486059+0000","last_fullsized":"2023-12-19T17:55:20.486059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:11:10.770738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488599+0000","last_change":"2023-12-19T17:55:18.255869+0000","last_active":"2023-12-19T17:55:20.488599+0000","last_peered":"2023-12-19T17:55:20.488599+0000","last_clean":"2023-12-19T17:55:20.488599+0000","last_became_active":"2023-12-19T17:55:18.255594+0000","last_became_peered":"2023-12-19T17:55:18.255594+0000","last_unstale":"2023-12-19T17:55:20.488599+0000","last_undegraded":"2023-12-19T17:55:20.488599+0000","last_fullsized":"2023-12-19T17:55:20.488599+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:44:54.830555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.237420+0000","last_change":"2023-12-19T17:55:17.769749+0000","last_active":"2023-12-19T17:55:19.237420+0000","last_peered":"2023-12-19T17:55:19.237420+0000","last_clean":"2023-12-19T17:55:19.237420+0000","last_became_active":"2023-12-19T17:55:17.768275+0000","last_became_peered":"2023-12-19T17:55:17.768275+0000","last_unstale":"2023-12-19T17:55:19.237420+0000","last_undegraded":"2023-12-19T17:55:19.237420+0000","last_fullsized":"2023-12-19T17:55:19.237420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:59:19.731969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238622+0000","last_change":"2023-12-19T17:55:18.243644+0000","last_active":"2023-12-19T17:55:19.238622+0000","last_peered":"2023-12-19T17:55:19.238622+0000","last_clean":"2023-12-19T17:55:19.238622+0000","last_became_active":"2023-12-19T17:55:18.242870+0000","last_became_peered":"2023-12-19T17:55:18.242870+0000","last_unstale":"2023-12-19T17:55:19.238622+0000","last_undegraded":"2023-12-19T17:55:19.238622+0000","last_fullsized":"2023-12-19T17:55:19.238622+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:28.439890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"62'2","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.488219+0000","last_change":"2023-12-19T17:55:17.768897+0000","last_active":"2023-12-19T17:55:20.488219+0000","last_peered":"2023-12-19T17:55:20.488219+0000","last_clean":"2023-12-19T17:55:20.488219+0000","last_became_active":"2023-12-19T17:55:17.768561+0000","last_became_peered":"2023-12-19T17:55:17.768561+0000","last_unstale":"2023-12-19T17:55:20.488219+0000","last_undegraded":"2023-12-19T17:55:20.488219+0000","last_fullsized":"2023-12-19T17:55:20.488219+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:26.210834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238338+0000","last_change":"2023-12-19T17:55:18.236834+0000","last_active":"2023-12-19T17:55:19.238338+0000","last_peered":"2023-12-19T17:55:19.238338+0000","last_clean":"2023-12-19T17:55:19.238338+0000","last_became_active":"2023-12-19T17:55:18.236546+0000","last_became_peered":"2023-12-19T17:55:18.236546+0000","last_unstale":"2023-12-19T17:55:19.238338+0000","last_undegraded":"2023-12-19T17:55:19.238338+0000","last_fullsized":"2023-12-19T17:55:19.238338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:30.809783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489538+0000","last_change":"2023-12-19T17:55:17.762997+0000","last_active":"2023-12-19T17:55:20.489538+0000","last_peered":"2023-12-19T17:55:20.489538+0000","last_clean":"2023-12-19T17:55:20.489538+0000","last_became_active":"2023-12-19T17:55:17.762618+0000","last_became_peered":"2023-12-19T17:55:17.762618+0000","last_unstale":"2023-12-19T17:55:20.489538+0000","last_undegraded":"2023-12-19T17:55:20.489538+0000","last_fullsized":"2023-12-19T17:55:20.489538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:56.895936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486943+0000","last_change":"2023-12-19T17:55:18.245676+0000","last_active":"2023-12-19T17:55:20.486943+0000","last_peered":"2023-12-19T17:55:20.486943+0000","last_clean":"2023-12-19T17:55:20.486943+0000","last_became_active":"2023-12-19T17:55:18.245426+0000","last_became_peered":"2023-12-19T17:55:18.245426+0000","last_unstale":"2023-12-19T17:55:20.486943+0000","last_undegraded":"2023-12-19T17:55:20.486943+0000","last_fullsized":"2023-12-19T17:55:20.486943+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:57:08.057743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240712+0000","last_change":"2023-12-19T17:55:17.762794+0000","last_active":"2023-12-19T17:55:19.240712+0000","last_peered":"2023-12-19T17:55:19.240712+0000","last_clean":"2023-12-19T17:55:19.240712+0000","last_became_active":"2023-12-19T17:55:17.762460+0000","last_became_peered":"2023-12-19T17:55:17.762460+0000","last_unstale":"2023-12-19T17:55:19.240712+0000","last_undegraded":"2023-12-19T17:55:19.240712+0000","last_fullsized":"2023-12-19T17:55:19.240712+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:12:44.276693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.489086+0000","last_change":"2023-12-19T17:55:18.259818+0000","last_active":"2023-12-19T17:55:20.489086+0000","last_peered":"2023-12-19T17:55:20.489086+0000","last_clean":"2023-12-19T17:55:20.489086+0000","last_became_active":"2023-12-19T17:55:18.257480+0000","last_became_peered":"2023-12-19T17:55:18.257480+0000","last_unstale":"2023-12-19T17:55:20.489086+0000","last_undegraded":"2023-12-19T17:55:20.489086+0000","last_fullsized":"2023-12-19T17:55:20.489086+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:40:51.810761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.238783+0000","last_change":"2023-12-19T17:55:17.761115+0000","last_active":"2023-12-19T17:55:19.238783+0000","last_peered":"2023-12-19T17:55:19.238783+0000","last_clean":"2023-12-19T17:55:19.238783+0000","last_became_active":"2023-12-19T17:55:17.760816+0000","last_became_peered":"2023-12-19T17:55:17.760816+0000","last_unstale":"2023-12-19T17:55:19.238783+0000","last_undegraded":"2023-12-19T17:55:19.238783+0000","last_fullsized":"2023-12-19T17:55:19.238783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:58.306397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486995+0000","last_change":"2023-12-19T17:55:18.245014+0000","last_active":"2023-12-19T17:55:20.486995+0000","last_peered":"2023-12-19T17:55:20.486995+0000","last_clean":"2023-12-19T17:55:20.486995+0000","last_became_active":"2023-12-19T17:55:18.244739+0000","last_became_peered":"2023-12-19T17:55:18.244739+0000","last_unstale":"2023-12-19T17:55:20.486995+0000","last_undegraded":"2023-12-19T17:55:20.486995+0000","last_fullsized":"2023-12-19T17:55:20.486995+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:45:28.204575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486174+0000","last_change":"2023-12-19T17:55:17.757115+0000","last_active":"2023-12-19T17:55:20.486174+0000","last_peered":"2023-12-19T17:55:20.486174+0000","last_clean":"2023-12-19T17:55:20.486174+0000","last_became_active":"2023-12-19T17:55:17.756837+0000","last_became_peered":"2023-12-19T17:55:17.756837+0000","last_unstale":"2023-12-19T17:55:20.486174+0000","last_undegraded":"2023-12-19T17:55:20.486174+0000","last_fullsized":"2023-12-19T17:55:20.486174+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:39:54.669343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240082+0000","last_change":"2023-12-19T17:55:18.253958+0000","last_active":"2023-12-19T17:55:19.240082+0000","last_peered":"2023-12-19T17:55:19.240082+0000","last_clean":"2023-12-19T17:55:19.240082+0000","last_became_active":"2023-12-19T17:55:18.250016+0000","last_became_peered":"2023-12-19T17:55:18.250016+0000","last_unstale":"2023-12-19T17:55:19.240082+0000","last_undegraded":"2023-12-19T17:55:19.240082+0000","last_fullsized":"2023-12-19T17:55:19.240082+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:55:24.513177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487983+0000","last_change":"2023-12-19T17:55:17.762899+0000","last_active":"2023-12-19T17:55:20.487983+0000","last_peered":"2023-12-19T17:55:20.487983+0000","last_clean":"2023-12-19T17:55:20.487983+0000","last_became_active":"2023-12-19T17:55:17.762620+0000","last_became_peered":"2023-12-19T17:55:17.762620+0000","last_unstale":"2023-12-19T17:55:20.487983+0000","last_undegraded":"2023-12-19T17:55:20.487983+0000","last_fullsized":"2023-12-19T17:55:20.487983+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:32.512488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.485869+0000","last_change":"2023-12-19T17:55:18.247182+0000","last_active":"2023-12-19T17:55:20.485869+0000","last_peered":"2023-12-19T17:55:20.485869+0000","last_clean":"2023-12-19T17:55:20.485869+0000","last_became_active":"2023-12-19T17:55:18.246907+0000","last_became_peered":"2023-12-19T17:55:18.246907+0000","last_unstale":"2023-12-19T17:55:20.485869+0000","last_undegraded":"2023-12-19T17:55:20.485869+0000","last_fullsized":"2023-12-19T17:55:20.485869+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:38:53.187715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.486043+0000","last_change":"2023-12-19T17:55:17.762546+0000","last_active":"2023-12-19T17:55:20.486043+0000","last_peered":"2023-12-19T17:55:20.486043+0000","last_clean":"2023-12-19T17:55:20.486043+0000","last_became_active":"2023-12-19T17:55:17.762255+0000","last_became_peered":"2023-12-19T17:55:17.762255+0000","last_unstale":"2023-12-19T17:55:20.486043+0000","last_undegraded":"2023-12-19T17:55:20.486043+0000","last_fullsized":"2023-12-19T17:55:20.486043+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:53.889214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487127+0000","last_change":"2023-12-19T17:55:18.249747+0000","last_active":"2023-12-19T17:55:20.487127+0000","last_peered":"2023-12-19T17:55:20.487127+0000","last_clean":"2023-12-19T17:55:20.487127+0000","last_became_active":"2023-12-19T17:55:18.249487+0000","last_became_peered":"2023-12-19T17:55:18.249487+0000","last_unstale":"2023-12-19T17:55:20.487127+0000","last_undegraded":"2023-12-19T17:55:20.487127+0000","last_fullsized":"2023-12-19T17:55:20.487127+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:27:09.649971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487629+0000","last_change":"2023-12-19T17:55:17.761541+0000","last_active":"2023-12-19T17:55:20.487629+0000","last_peered":"2023-12-19T17:55:20.487629+0000","last_clean":"2023-12-19T17:55:20.487629+0000","last_became_active":"2023-12-19T17:55:17.761218+0000","last_became_peered":"2023-12-19T17:55:17.761218+0000","last_unstale":"2023-12-19T17:55:20.487629+0000","last_undegraded":"2023-12-19T17:55:20.487629+0000","last_fullsized":"2023-12-19T17:55:20.487629+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:42:00.925880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:20.487453+0000","last_change":"2023-12-19T17:55:18.262846+0000","last_active":"2023-12-19T17:55:20.487453+0000","last_peered":"2023-12-19T17:55:20.487453+0000","last_clean":"2023-12-19T17:55:20.487453+0000","last_became_active":"2023-12-19T17:55:18.262415+0000","last_became_peered":"2023-12-19T17:55:18.262415+0000","last_unstale":"2023-12-19T17:55:20.487453+0000","last_undegraded":"2023-12-19T17:55:20.487453+0000","last_fullsized":"2023-12-19T17:55:20.487453+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:17.725085+0000","last_clean_scrub_stamp":"2023-12-19T17:55:17.725085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:33:26.777467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-12-19T17:55:19.240261+0000","last_change":"2023-12-19T17:55:17.762178+0000","last_active":"2023-12-19T17:55:19.240261+0000","last_peered":"2023-12-19T17:55:19.240261+0000","last_clean":"2023-12-19T17:55:19.240261+0000","last_became_active":"2023-12-19T17:55:17.761905+0000","last_became_peered":"2023-12-19T17:55:17.761905+0000","last_unstale":"2023-12-19T17:55:19.240261+0000","last_undegraded":"2023-12-19T17:55:19.240261+0000","last_fullsized":"2023-12-19T17:55:19.240261+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:55:16.712174+0000","last_clean_scrub_stamp":"2023-12-19T17:55:16.712174+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:41:35.273533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-12-19T17:55:18.229164+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:55:18.229164+0000","last_peered":"2023-12-19T17:55:18.229164+0000","last_clean":"2023-12-19T17:55:18.229164+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:55:18.229164+0000","last_undegraded":"2023-12-19T17:55:18.229164+0000","last_fullsized":"2023-12-19T17:55:18.229164+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574897,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28280,"kb_used_data":1328,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94343560,"statfs":{"total":96636764160,"available":96607805440,"internally_reserved":0,"allocated":1359872,"data_stored":941563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1599999999999999,"5min":1.0589999999999999,"15min":1.0529999999999999},"min":{"1min":0.67900000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.427,"5min":1.8089999999999999,"15min":1.8089999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.212,"5min":1.1259999999999999,"15min":1.1299999999999999},"min":{"1min":0.96499999999999997,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.458,"5min":1.5589999999999999,"15min":1.5589999999999999},"last":1.506}]},{"osd":1,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.083,"15min":1.0900000000000001},"min":{"1min":0.76100000000000001,"5min":0.62,"15min":0.62},"max":{"1min":1.3720000000000001,"5min":1.7250000000000001,"15min":1.7250000000000001},"last":0.871},{"interface":"front","average":{"1min":1.113,"5min":1.119,"15min":1.151},"min":{"1min":0.86499999999999999,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.552,"5min":2.448,"15min":2.448},"last":1.385}]},{"osd":2,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.0580000000000001,"15min":1.0660000000000001},"min":{"1min":0.72299999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.3340000000000001,"5min":2.069,"15min":2.069},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1399999999999999,"15min":1.141},"min":{"1min":0.76300000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.504,"5min":1.5660000000000001,"15min":1.5660000000000001},"last":1.04}]},{"osd":3,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.1100000000000001,"15min":1.141},"min":{"1min":0.86199999999999999,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.643,"5min":1.643,"15min":1.643},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.1970000000000001,"15min":1.2230000000000001},"min":{"1min":0.97399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.679,"5min":1.7130000000000001,"15min":1.7130000000000001},"last":0.96199999999999997}]},{"osd":4,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1850000000000001,"15min":1.2370000000000001},"min":{"1min":0.76300000000000001,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.712,"5min":1.8779999999999999,"15min":1.8779999999999999},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.272,"15min":1.296},"min":{"1min":1.034,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8120000000000001,"5min":2.1720000000000002,"15min":2.1720000000000002},"last":1.2529999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1639999999999999,"5min":1.212,"15min":1.2490000000000001},"min":{"1min":0.78900000000000003,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.601,"5min":1.97,"15min":1.97},"last":1.2090000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2649999999999999,"15min":1.2949999999999999},"min":{"1min":0.86399999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.861,"5min":2.02,"15min":2.02},"last":1.552}]},{"osd":6,"last update":"Tue Dec 19 17:54:35 2023","interfaces":[{"interface":"back","average":{"1min":1.391,"5min":1.381,"15min":1.3999999999999999},"min":{"1min":1.1559999999999999,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.9650000000000001,"5min":2.1429999999999998,"15min":2.1429999999999998},"last":1.5960000000000001},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.323,"15min":1.3600000000000001},"min":{"1min":1.0309999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":2.0049999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.3540000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574898,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":757760,"data_stored":351035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":1.163,"15min":1.2330000000000001},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.3200000000000001,"5min":4.5979999999999999,"15min":4.5979999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.05,"5min":1.109,"15min":1.115},"min":{"1min":0.64000000000000001,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.496,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.97499999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.089,"15min":1.1000000000000001},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.5029999999999999,"5min":2.2109999999999999,"15min":2.2109999999999999},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.1399999999999999,"15min":1.1439999999999999},"min":{"1min":0.68799999999999994,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.5960000000000001,"5min":1.621,"15min":1.621},"last":1.0189999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.4099999999999999,"15min":1.5209999999999999},"min":{"1min":0.78000000000000003,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.597,"5min":8.5470000000000006,"15min":8.5470000000000006},"last":1.208},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.2669999999999999,"15min":1.327},"min":{"1min":0.73199999999999998,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.532,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.3}]},{"osd":3,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.3180000000000001,"15min":1.3520000000000001},"min":{"1min":0.90300000000000002,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.627,"5min":4.5380000000000003,"15min":4.5380000000000003},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.357,"15min":1.4139999999999999},"min":{"1min":0.874,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6479999999999999,"5min":4.508,"15min":4.508},"last":1.911}]},{"osd":4,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.1319999999999999,"15min":1.1419999999999999},"min":{"1min":0.50900000000000001,"5min":0.438,"15min":0.438},"max":{"1min":1.4910000000000001,"5min":1.8360000000000001,"15min":1.8360000000000001},"last":1.339},{"interface":"front","average":{"1min":1.179,"5min":1.24,"15min":1.2709999999999999},"min":{"1min":0.81699999999999995,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.627,"5min":1.899,"15min":1.899},"last":1.6519999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.226,"5min":1.2569999999999999,"15min":1.2829999999999999},"min":{"1min":0.83499999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5529999999999999,"5min":2.1400000000000001,"15min":2.1400000000000001},"last":1.829},{"interface":"front","average":{"1min":1.264,"5min":1.266,"15min":1.274},"min":{"1min":0.90200000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7150000000000001,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.694}]},{"osd":7,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.357,"15min":1.355},"min":{"1min":0.86599999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.738,"5min":1.8,"15min":1.8},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3959999999999999,"15min":1.421},"min":{"1min":1.087,"5min":0.92000000000000004,"15min":0.92000000000000004},"max":{"1min":1.6539999999999999,"5min":2.2440000000000002,"15min":2.2440000000000002},"last":1.9670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574898,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":765952,"data_stored":351687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":0.997,"15min":0.99399999999999999},"min":{"1min":0.59999999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.69499999999999995},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.1040000000000001,"15min":1.0840000000000001},"min":{"1min":0.745,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.7849999999999999,"5min":2.9369999999999998,"15min":2.9369999999999998},"last":0.81799999999999995}]},{"osd":1,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.117,"15min":1.095},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.472,"5min":1.778,"15min":1.778},"last":1.071},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.204,"15min":1.226},"min":{"1min":0.70199999999999996,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.825,"5min":2.0329999999999999,"15min":2.0329999999999999},"last":0.91300000000000003}]},{"osd":2,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.194,"15min":1.226},"min":{"1min":0.754,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.353,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.149,"5min":1.177,"15min":1.204},"min":{"1min":0.80000000000000004,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.671,"5min":1.671,"15min":1.671},"last":0.999}]},{"osd":3,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.298,"15min":1.3360000000000001},"min":{"1min":0.76600000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.649,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":1.018},{"interface":"front","average":{"1min":1.2969999999999999,"5min":1.3879999999999999,"15min":1.4219999999999999},"min":{"1min":0.81100000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.5409999999999999,"5min":3.0350000000000001,"15min":3.0350000000000001},"last":1.135}]},{"osd":4,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.2969999999999999,"15min":1.3160000000000001},"min":{"1min":0.79000000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"max":{"1min":1.851,"5min":2.0819999999999999,"15min":2.0819999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3859999999999999,"15min":1.4339999999999999},"min":{"1min":0.90600000000000003,"5min":0.747,"15min":0.747},"max":{"1min":1.7370000000000001,"5min":3.2589999999999999,"15min":3.2589999999999999},"last":0.84899999999999998}]},{"osd":6,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.3959999999999999,"15min":1.45},"min":{"1min":0.88,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.78,"5min":3.3010000000000002,"15min":3.3010000000000002},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.3580000000000001,"15min":1.3799999999999999},"min":{"1min":0.91300000000000003,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":1.8819999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"last":1.2989999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.484,"15min":1.5549999999999999},"min":{"1min":0.96799999999999997,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9019999999999999,"5min":3.1099999999999999,"15min":3.1099999999999999},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.5980000000000001,"15min":1.6719999999999999},"min":{"1min":1.097,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.952,"5min":3.5680000000000001,"15min":3.5680000000000001},"last":1.24}]}]},{"osd":4,"up_from":13,"seq":55834574898,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":770048,"data_stored":352599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,2],"upper_bound":32},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.234,"15min":1.302},"min":{"1min":0.85599999999999998,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3939999999999999,"5min":5.4420000000000002,"15min":5.4420000000000002},"last":2.7069999999999999},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.2889999999999999,"15min":1.3600000000000001},"min":{"1min":0.80300000000000005,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.4059999999999999,"5min":5.5049999999999999,"15min":5.5049999999999999},"last":4.5019999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":1.214,"15min":1.3140000000000001},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.3109999999999999,"5min":4.6379999999999999,"15min":4.6379999999999999},"last":1.8180000000000001},{"interface":"front","average":{"1min":1.1259999999999999,"5min":1.222,"15min":1.2490000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.4239999999999999,"5min":3.254,"15min":3.254},"last":3.137}]},{"osd":2,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.266,"15min":1.3640000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.3620000000000001,"5min":4.593,"15min":4.593},"last":2.1070000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.242,"15min":1.3080000000000001},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.3560000000000001,"5min":2.3799999999999999,"15min":2.3799999999999999},"last":1.9570000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1759999999999999,"5min":1.2829999999999999,"15min":1.353},"min":{"1min":0.71899999999999997,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4470000000000001,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":2.4750000000000001},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.3680000000000001,"15min":1.46},"min":{"1min":0.78900000000000003,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.4710000000000001,"5min":5.5490000000000004,"15min":5.5490000000000004},"last":5.633}]},{"osd":5,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.1919999999999999,"15min":1.232},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.234,"5min":1.946,"15min":1.946},"last":2.5649999999999999},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.143,"15min":1.163},"min":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.407,"5min":2.157,"15min":2.157},"last":0.752}]},{"osd":6,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2410000000000001,"15min":1.2589999999999999},"min":{"1min":0.70999999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.5489999999999999,"5min":2.1840000000000002,"15min":2.1840000000000002},"last":2.5910000000000002},{"interface":"front","average":{"1min":1.282,"5min":1.391,"15min":1.429},"min":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"max":{"1min":1.4950000000000001,"5min":2.1200000000000001,"15min":2.1200000000000001},"last":2.5299999999999998}]},{"osd":7,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.2949999999999999,"15min":1.331},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.504,"5min":2.1030000000000002,"15min":2.1030000000000002},"last":2.4340000000000002},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.331,"15min":1.361},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.5469999999999999,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":5.6859999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":351091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.91500000000000004,"15min":0.95099999999999996},"min":{"1min":0.56499999999999995,"5min":0.37,"15min":0.37},"max":{"1min":1.454,"5min":1.825,"15min":1.825},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.98399999999999999,"15min":1.03},"min":{"1min":0.626,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.327,"5min":2.9340000000000002,"15min":2.9340000000000002},"last":0.61099999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.92700000000000005,"15min":0.94099999999999995},"min":{"1min":0.63900000000000001,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.3160000000000001,"5min":1.54,"15min":1.54},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.95499999999999996,"5min":1.0369999999999999,"15min":1.073},"min":{"1min":0.59599999999999997,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.353,"5min":1.702,"15min":1.702},"last":0.997}]},{"osd":2,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.129,"15min":1.1359999999999999},"min":{"1min":0.878,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.5389999999999999,"5min":2.177,"15min":2.177},"last":1.206},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.2450000000000001,"15min":1.2829999999999999},"min":{"1min":0.89500000000000002,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.72,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.099}]},{"osd":4,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.244,"5min":1.2589999999999999,"15min":1.29},"min":{"1min":0.92300000000000004,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.109,"5min":2.234,"15min":2.234},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.325,"15min":1.353},"min":{"1min":0.98899999999999999,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.6950000000000001,"5min":2.4350000000000001,"15min":2.4350000000000001},"last":1.397}]},{"osd":5,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.4039999999999999,"15min":1.45},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":1.823,"5min":2.5419999999999998,"15min":2.5419999999999998},"last":1.298},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.381,"15min":1.417},"min":{"1min":0.94999999999999996,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":1.9330000000000001,"5min":2.754,"15min":2.754},"last":0.92100000000000004}]},{"osd":6,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.431,"15min":1.454},"min":{"1min":0.99299999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.72,"5min":2.6880000000000002,"15min":2.6880000000000002},"last":1.264},{"interface":"front","average":{"1min":1.385,"5min":1.4630000000000001,"15min":1.514},"min":{"1min":1.0620000000000001,"5min":0.94699999999999995,"15min":0.94699999999999995},"max":{"1min":1.9770000000000001,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":1.409}]},{"osd":7,"last update":"Tue Dec 19 17:54:30 2023","interfaces":[{"interface":"back","average":{"1min":1.413,"5min":1.4690000000000001,"15min":1.514},"min":{"1min":1.1100000000000001,"5min":0.88,"15min":0.88},"max":{"1min":2.0419999999999998,"5min":3.02,"15min":3.02},"last":1.1180000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.5069999999999999,"15min":1.5309999999999999},"min":{"1min":1.0980000000000001,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":1.798,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.3440000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574898,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":748,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":765952,"data_stored":351091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.874,"5min":1.306,"15min":1.488},"min":{"1min":0.49199999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.2669999999999999,"5min":13.32,"15min":13.32},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.99299999999999999,"5min":1.4690000000000001,"15min":1.6359999999999999},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.5740000000000001,"5min":13.206,"15min":13.206},"last":1.357}]},{"osd":1,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.91000000000000003,"15min":0.90200000000000002},"min":{"1min":0.626,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.2370000000000001,"5min":1.5509999999999999,"15min":1.5509999999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":1.0209999999999999,"15min":1.0229999999999999},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.3879999999999999,"5min":1.948,"15min":1.948},"last":1.4570000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.996,"15min":0.97999999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.431,"5min":1.79,"15min":1.79},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.179,"5min":1.232,"15min":1.2509999999999999},"min":{"1min":0.81799999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.6259999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.232}]},{"osd":4,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.2430000000000001,"15min":1.242},"min":{"1min":1.018,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.498,"5min":1.9430000000000001,"15min":1.9430000000000001},"last":1.111},{"interface":"front","average":{"1min":1.234,"5min":1.302,"15min":1.3260000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":1.603,"5min":2.024,"15min":2.024},"last":1.607}]},{"osd":5,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.151,"5min":1.2929999999999999,"15min":1.325},"min":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"max":{"1min":1.448,"5min":4.0659999999999998,"15min":4.0659999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.4630000000000001,"15min":1.5309999999999999},"min":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"max":{"1min":1.5089999999999999,"5min":3.7160000000000002,"15min":3.7160000000000002},"last":1.3959999999999999}]},{"osd":6,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.4219999999999999,"15min":1.466},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.653,"5min":2.081,"15min":2.081},"last":2.0489999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.365,"15min":1.383},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.581,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.4259999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:31 2023","interfaces":[{"interface":"back","average":{"1min":1.3169999999999999,"5min":1.482,"15min":1.514},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":1.546,"5min":2.363,"15min":2.363},"last":1.841},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.4059999999999999,"15min":1.429},"min":{"1min":0.83299999999999996,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.6140000000000001,"5min":2.1629999999999998,"15min":2.1629999999999998},"last":1.2649999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31792,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94340048,"statfs":{"total":96636764160,"available":96604209152,"internally_reserved":0,"allocated":761856,"data_stored":351125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.96399999999999997,"15min":1.012},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.931,"15min":1.931},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0329999999999999,"15min":1.0609999999999999},"min":{"1min":0.75,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.294,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.59999999999999998}]},{"osd":2,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":1.0149999999999999,"15min":1.081},"min":{"1min":0.59399999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.353,"5min":2.0590000000000002,"15min":2.0590000000000002},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.94599999999999995,"5min":1.1559999999999999,"15min":1.224},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.345,"5min":3.4199999999999999,"15min":3.4199999999999999},"last":1.123}]},{"osd":3,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.274,"15min":1.3460000000000001},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.498,"5min":3.4950000000000001,"15min":3.4950000000000001},"last":1.2390000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.194,"15min":1.2729999999999999},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.6100000000000001,"5min":4.2030000000000003,"15min":4.2030000000000003},"last":0.84599999999999997}]},{"osd":4,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.2929999999999999,"5min":1.4159999999999999,"15min":1.468},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.514,"5min":4.3869999999999996,"15min":4.3869999999999996},"last":1.468},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.3779999999999999,"15min":1.46},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.5369999999999999,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":1.198}]},{"osd":5,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.373,"15min":1.4630000000000001},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4319999999999999,"5min":2.9249999999999998,"15min":2.9249999999999998},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.524,"15min":1.6120000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.4910000000000001,"5min":3.8420000000000001,"15min":3.8420000000000001},"last":1.506}]},{"osd":6,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.546,"15min":1.647},"min":{"1min":1.0209999999999999,"5min":0.92600000000000005,"15min":0.92600000000000005},"max":{"1min":1.7210000000000001,"5min":4.5780000000000003,"15min":4.5780000000000003},"last":1.349},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.577,"15min":1.669},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":1.6040000000000001,"5min":3.214,"15min":3.214},"last":1.2949999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.375,"5min":1.647,"15min":1.7490000000000001},"min":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"max":{"1min":1.7170000000000001,"5min":4.0910000000000002,"15min":4.0910000000000002},"last":1.3999999999999999},{"interface":"front","average":{"1min":1.341,"5min":1.5589999999999999,"15min":1.633},"min":{"1min":1.0589999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":1.548,"5min":4.6390000000000002,"15min":4.6390000000000002},"last":1.577}]}]},{"osd":0,"up_from":13,"seq":55834574898,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1332,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1363968,"data_stored":942530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":1.0229999999999999,"15min":1.079},"min":{"1min":0.57399999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.236,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.2050000000000001,"15min":1.2849999999999999},"min":{"1min":0.69799999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.421,"5min":2.3599999999999999,"15min":2.3599999999999999},"last":1.018}]},{"osd":2,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.0529999999999999},"min":{"1min":0.53400000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.323,"5min":1.6839999999999999,"15min":1.6839999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0129999999999999,"15min":1.0329999999999999},"min":{"1min":0.57399999999999995,"5min":0.504,"15min":0.504},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":0.75900000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":0.94799999999999995,"5min":1.0569999999999999,"15min":1.1220000000000001},"min":{"1min":0.66200000000000003,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.5700000000000001,"5min":3.4399999999999999,"15min":3.4399999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.212,"5min":1.282,"15min":1.3380000000000001},"min":{"1min":0.91700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.6850000000000001,"5min":2.5369999999999999,"15min":2.5369999999999999},"last":1.254}]},{"osd":4,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.3959999999999999,"15min":1.4299999999999999},"min":{"1min":0.82799999999999996,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.6240000000000001,"5min":1.78,"15min":1.78},"last":1.3300000000000001},{"interface":"front","average":{"1min":1.288,"5min":1.4139999999999999,"15min":1.4790000000000001},"min":{"1min":0.99099999999999999,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.944,"5min":2.7799999999999998,"15min":2.7799999999999998},"last":1.234}]},{"osd":5,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.3180000000000001,"15min":1.369},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.3500000000000001,"15min":1.373},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":1.726,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":1.389}]},{"osd":6,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3640000000000001,"5min":1.4670000000000001,"15min":1.5109999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.04,"5min":2.1000000000000001,"15min":2.1000000000000001},"last":1.552},{"interface":"front","average":{"1min":1.413,"5min":1.4750000000000001,"15min":1.5349999999999999},"min":{"1min":1.099,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":1.984,"5min":2.3889999999999998,"15min":2.3889999999999998},"last":1.5009999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:54:34 2023","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.6339999999999999,"15min":1.76},"min":{"1min":1.0649999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.792,"5min":4.9400000000000004,"15min":4.9400000000000004},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.593,"15min":1.712},"min":{"1min":1.046,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":2.1339999999999999,"5min":4.8250000000000002,"15min":4.8250000000000002},"last":1.0860000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:55:23.045 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T17:55:23.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T17:55:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.282+0000 7f51ce397700 1 Processor -- start 2023-12-19T17:55:23.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.282+0000 7f51ce397700 1 -- start start 2023-12-19T17:55:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.282+0000 7f51ce397700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51c8070ab0 0x7f51c80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f51c80d2620 0x7f51c80b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51c80d2190 con 0x7f51c80b2040 2023-12-19T17:55:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c80ce350 con 0x7f51c8070ab0 2023-12-19T17:55:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51c80d2a70 con 0x7f51c80d2620 2023-12-19T17:55:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51c8070ab0 0x7f51c80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51c8070ab0 0x7f51c80cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43206/0 (socket says 172.21.15.45:43206) 2023-12-19T17:55:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 -- 172.21.15.45:0/3766092672 learned_addr learned my addr 172.21.15.45:0/3766092672 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cdb96700 1 --2- 172.21.15.45:0/3766092672 >> v2:172.21.15.73:3300/0 conn(0x7f51c80d2620 0x7f51c80b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 -- 172.21.15.45:0/3766092672 >> v2:172.21.15.73:3300/0 conn(0x7f51c80d2620 msgr2=0x7f51c80b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 --2- 172.21.15.45:0/3766092672 >> v2:172.21.15.73:3300/0 conn(0x7f51c80d2620 0x7f51c80b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 -- 172.21.15.45:0/3766092672 >> v1:172.21.15.73:6789/0 conn(0x7f51c80b2040 legacy=0x7f51c8070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 -- 172.21.15.45:0/3766092672 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c80ce070 con 0x7f51c8070ab0 2023-12-19T17:55:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51cd395700 1 --2- 172.21.15.45:0/3766092672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c80cd500 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f51c80c65b0 tx=0x7f51c4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee7a3467782a73b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51bffff700 1 -- 172.21.15.45:0/3766092672 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400b8a0 con 0x7f51c8070ab0 2023-12-19T17:55:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51bffff700 1 -- 172.21.15.45:0/3766092672 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c400ba00 con 0x7f51c8070ab0 2023-12-19T17:55:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51bffff700 1 -- 172.21.15.45:0/3766092672 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c400bd90 con 0x7f51c8070ab0 2023-12-19T17:55:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- 172.21.15.45:0/3766092672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 msgr2=0x7f51c80cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 --2- 172.21.15.45:0/3766092672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c80cd500 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f51c80c65b0 tx=0x7f51c4009bf0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- 172.21.15.45:0/3766092672 shutdown_connections 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 --2- 172.21.15.45:0/3766092672 >> v2:172.21.15.73:3300/0 conn(0x7f51c80d2620 0x7f51c80b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 --2- 172.21.15.45:0/3766092672 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c80cd500 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- 172.21.15.45:0/3766092672 >> 172.21.15.45:0/3766092672 conn(0x7f51c80d2ca0 msgr2=0x7f51c80d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- 172.21.15.45:0/3766092672 shutdown_connections 2023-12-19T17:55:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.286+0000 7f51ce397700 1 -- 172.21.15.45:0/3766092672 wait complete. 2023-12-19T17:55:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.290+0000 7f51ce397700 1 Processor -- start 2023-12-19T17:55:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.290+0000 7f51ce397700 1 -- start start 2023-12-19T17:55:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c81f30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51c80b2040 0x7f51c8157180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51c80d2620 0x7f51c80cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c8157f50 con 0x7f51c8070ab0 2023-12-19T17:55:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80ca8f0 con 0x7f51c80b2040 2023-12-19T17:55:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51c80c9d70 con 0x7f51c80d2620 2023-12-19T17:55:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c81f30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c81f30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43220/0 (socket says 172.21.15.45:43220) 2023-12-19T17:55:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 -- 172.21.15.45:0/1761993806 learned_addr learned my addr 172.21.15.45:0/1761993806 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cdb96700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51c80d2620 0x7f51c80cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ccb94700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51c80b2040 0x7f51c8157180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 -- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51c80d2620 msgr2=0x7f51c80cb9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51c80d2620 0x7f51c80cb9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 -- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51c80b2040 msgr2=0x7f51c8157180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51c80b2040 0x7f51c8157180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 -- 172.21.15.45:0/1761993806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51c4009570 con 0x7f51c8070ab0 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ccb94700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51c80b2040 0x7f51c8157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51cd395700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c81f30d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f51c4000c00 tx=0x7f51c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c40038c0 con 0x7f51c8070ab0 2023-12-19T17:55:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c401e070 con 0x7f51c8070ab0 2023-12-19T17:55:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51c80c9f50 con 0x7f51c8070ab0 2023-12-19T17:55:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4003c80 con 0x7f51c8070ab0 2023-12-19T17:55:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.294+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51c80ca510 con 0x7f51c8070ab0 2023-12-19T17:55:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.298+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51c80caa30 con 0x7f51c8070ab0 2023-12-19T17:55:23.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.298+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51c4011420 con 0x7f51c8070ab0 2023-12-19T17:55:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.302+0000 7f51bdffb700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51ac065ad0 0x7f51ac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.302+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f51c4020070 con 0x7f51c8070ab0 2023-12-19T17:55:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.302+0000 7f51ccb94700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51ac065ad0 0x7f51ac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.302+0000 7f51ccb94700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51ac065ad0 0x7f51ac067f90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f51c815c2c0 tx=0x7f51b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:23.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.306+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f51c80caa30 con 0x7f51c8070ab0 2023-12-19T17:55:23.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.554+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f51c8067760 con 0x7f51c8070ab0 2023-12-19T17:55:23.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51bdffb700 1 -- 172.21.15.45:0/1761993806 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7f51c40522d0 con 0x7f51c8070ab0 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51ac065ad0 msgr2=0x7f51ac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51ac065ad0 0x7f51ac067f90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f51c815c2c0 tx=0x7f51b8009040 comp rx=0 tx=0).stop 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 msgr2=0x7f51c81f30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c81f30d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f51c4000c00 tx=0x7f51c4004770 comp rx=0 tx=0).stop 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 shutdown_connections 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51ac065ad0 0x7f51ac067f90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51c80d2620 0x7f51c80cb9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51c80b2040 0x7f51c8157180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 --2- 172.21.15.45:0/1761993806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51c8070ab0 0x7f51c81f30d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 >> 172.21.15.45:0/1761993806 conn(0x7f51c80d2ca0 msgr2=0x7f51c8065e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 shutdown_connections 2023-12-19T17:55:23.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.566+0000 7f51ce397700 1 -- 172.21.15.45:0/1761993806 wait complete. 2023-12-19T17:55:23.573 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-19T17:55:23.594 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:23.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 Processor -- start 2023-12-19T17:55:23.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 -- start start 2023-12-19T17:55:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f921406cad0 0x7f92140c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f921406f0a0 con 0x7f92140af720 2023-12-19T17:55:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f921406ea90 con 0x7f921406cad0 2023-12-19T17:55:23.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9218c98700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c3f60 con 0x7f921415ae20 2023-12-19T17:55:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9213fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92140af720 0x7f921415e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51804/0 (socket says 172.21.15.45:51804) 2023-12-19T17:55:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9213fff700 1 -- 172.21.15.45:0/116878987 learned_addr learned my addr 172.21.15.45:0/116878987 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f9212ffd700 1 --2- 172.21.15.45:0/116878987 >> v2:172.21.15.45:3300/0 conn(0x7f921406cad0 0x7f92140c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f92137fe700 1 --2- 172.21.15.45:0/116878987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f92127fc700 1 -- 172.21.15.45:0/116878987 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555233825 0 0) 0x7f921406f0a0 con 0x7f92140af720 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.778+0000 7f92127fc700 1 -- 172.21.15.45:0/116878987 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91fc0035d0 con 0x7f92140af720 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92137fe700 1 -- 172.21.15.45:0/116878987 >> v2:172.21.15.45:3300/0 conn(0x7f921406cad0 msgr2=0x7f92140c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92137fe700 1 --2- 172.21.15.45:0/116878987 >> v2:172.21.15.45:3300/0 conn(0x7f921406cad0 0x7f92140c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92137fe700 1 -- 172.21.15.45:0/116878987 >> v1:172.21.15.45:6789/0 conn(0x7f92140af720 legacy=0x7f921415e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92137fe700 1 -- 172.21.15.45:0/116878987 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92140c4240 con 0x7f921415ae20 2023-12-19T17:55:23.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9212ffd700 1 --2- 172.21.15.45:0/116878987 >> v2:172.21.15.45:3300/0 conn(0x7f921406cad0 0x7f92140c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92137fe700 1 --2- 172.21.15.45:0/116878987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921415be40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9204009850 tx=0x7f9204009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f71dae1d1eb0faff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92127fc700 1 -- 172.21.15.45:0/116878987 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204011830 con 0x7f921415ae20 2023-12-19T17:55:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92127fc700 1 -- 172.21.15.45:0/116878987 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9204011990 con 0x7f921415ae20 2023-12-19T17:55:23.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f92127fc700 1 -- 172.21.15.45:0/116878987 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204011d40 con 0x7f921415ae20 2023-12-19T17:55:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 -- 172.21.15.45:0/116878987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 msgr2=0x7f921415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 --2- 172.21.15.45:0/116878987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921415be40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9204009850 tx=0x7f9204009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:23.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 -- 172.21.15.45:0/116878987 shutdown_connections 2023-12-19T17:55:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 --2- 172.21.15.45:0/116878987 >> v2:172.21.15.45:3300/0 conn(0x7f921406cad0 0x7f92140c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 --2- 172.21.15.45:0/116878987 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921415be40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 -- 172.21.15.45:0/116878987 >> 172.21.15.45:0/116878987 conn(0x7f92140cb900 msgr2=0x7f92140b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 -- 172.21.15.45:0/116878987 shutdown_connections 2023-12-19T17:55:23.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.782+0000 7f9218c98700 1 -- 172.21.15.45:0/116878987 wait complete. 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 Processor -- start 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 -- start start 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 0x7f9214152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92140af720 0x7f92140c7f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140c6f60 con 0x7f921406cad0 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92140abc40 con 0x7f92140af720 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9218c98700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92140abf20 con 0x7f921415ae20 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 0x7f9214152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 0x7f9214152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43252/0 (socket says 172.21.15.45:43252) 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 -- 172.21.15.45:0/1877671184 learned_addr learned my addr 172.21.15.45:0/1877671184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:23.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9212ffd700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92140af720 0x7f92140c7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9213fff700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 -- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 msgr2=0x7f921406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 -- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92140af720 msgr2=0x7f92140c7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92140af720 0x7f92140c7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 -- 172.21.15.45:0/1877671184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92080094b0 con 0x7f921406cad0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f9212ffd700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92140af720 0x7f92140c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.786+0000 7f92137fe700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 0x7f9214152a80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9204014040 tx=0x7f9204004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.790+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9204004610 con 0x7f921406cad0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.790+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920401e070 con 0x7f921406cad0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.790+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92040038e0 con 0x7f921406cad0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.790+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92040094b0 con 0x7f921406cad0 2023-12-19T17:55:23.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.790+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92140ac4e0 con 0x7f921406cad0 2023-12-19T17:55:23.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.790+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9214067760 con 0x7f921406cad0 2023-12-19T17:55:23.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.794+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9204003a40 con 0x7f921406cad0 2023-12-19T17:55:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.794+0000 7f91fbfff700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9200065ad0 0x7f9200067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:23.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.794+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9204020070 con 0x7f921406cad0 2023-12-19T17:55:23.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.794+0000 7f9212ffd700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9200065ad0 0x7f9200067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:23.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.794+0000 7f9212ffd700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9200065ad0 0x7f9200067f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f92140cde50 tx=0x7f9208008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:23.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:23.802+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9204052060 con 0x7f921406cad0 2023-12-19T17:55:24.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.014+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f921415f430 con 0x7f921406cad0 2023-12-19T17:55:24.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.014+0000 7f91fbfff700 1 -- 172.21.15.45:0/1877671184 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 36 v36) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f9204055680 con 0x7f921406cad0 2023-12-19T17:55:24.018 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:24.018 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":36,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:55:18.210618+0000","modified":"2023-12-19T17:55:21.235777+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/4130274339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4130274339},{"type":"v1","addr":"172.21.15.45:6837","nonce":4130274339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:55:24.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9200065ad0 msgr2=0x7f9200067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9200065ad0 0x7f9200067f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f92140cde50 tx=0x7f9208008040 comp rx=0 tx=0).stop 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 msgr2=0x7f9214152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 0x7f9214152a80 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9204014040 tx=0x7f9204004770 comp rx=0 tx=0).stop 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 shutdown_connections 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9200065ad0 0x7f9200067f90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f921415ae20 0x7f921406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f92140af720 0x7f92140c7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 --2- 172.21.15.45:0/1877671184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f921406cad0 0x7f9214152a80 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 >> 172.21.15.45:0/1877671184 conn(0x7f92140cb900 msgr2=0x7f921406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 shutdown_connections 2023-12-19T17:55:24.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.018+0000 7f9218c98700 1 -- 172.21.15.45:0/1877671184 wait complete. 2023-12-19T17:55:24.023 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 36 2023-12-19T17:55:24.448 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 36, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:55:18.210618+0000', 'modified': '2023-12-19T17:55:21.235777+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6294}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6294': {'gid': 6294, 'name': 'c', 'rank': 0, 'incarnation': 33, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6837/4130274339', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6836', 'nonce': 4130274339}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 4130274339}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:55:24.448 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:55:24.448 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T17:55:24.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.630+0000 7f8e854b1700 1 Processor -- start 2023-12-19T17:55:24.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.630+0000 7f8e854b1700 1 -- start start 2023-12-19T17:55:24.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e854b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e8006ea90 0x7f8e800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e854b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e800b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e854b1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800d1820 con 0x7f8e800b88b0 2023-12-19T17:55:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e854b1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800d1b00 con 0x7f8e8006ea90 2023-12-19T17:55:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e854b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800d1de0 con 0x7f8e8006fe80 2023-12-19T17:55:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e777fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8e800b88b0 0x7f8e800b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51814/0 (socket says 172.21.15.45:51814) 2023-12-19T17:55:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e777fe700 1 -- 172.21.15.45:0/2060909382 learned_addr learned my addr 172.21.15.45:0/2060909382 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:24.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2060909382 >> v2:172.21.15.73:3300/0 conn(0x7f8e8006ea90 0x7f8e800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e800b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7f7fe700 1 -- 172.21.15.45:0/2060909382 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636061907 0 0) 0x7f8e800d1820 con 0x7f8e800b88b0 2023-12-19T17:55:24.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7f7fe700 1 -- 172.21.15.45:0/2060909382 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e6c0035d0 con 0x7f8e800b88b0 2023-12-19T17:55:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7ffff700 1 -- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 msgr2=0x7f8e800b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e800b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7ffff700 1 -- 172.21.15.45:0/2060909382 >> v1:172.21.15.45:6789/0 conn(0x7f8e800b88b0 legacy=0x7f8e800b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7ffff700 1 -- 172.21.15.45:0/2060909382 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800d20c0 con 0x7f8e8006ea90 2023-12-19T17:55:24.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8006ea90 0x7f8e800d0f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009850 tx=0x7f8e70009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ea5e771e164f01a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7f7fe700 1 -- 172.21.15.45:0/2060909382 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011830 con 0x7f8e8006ea90 2023-12-19T17:55:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7f7fe700 1 -- 172.21.15.45:0/2060909382 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70011990 con 0x7f8e8006ea90 2023-12-19T17:55:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.634+0000 7f8e7f7fe700 1 -- 172.21.15.45:0/2060909382 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70011d40 con 0x7f8e8006ea90 2023-12-19T17:55:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 -- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8006ea90 msgr2=0x7f8e800d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 --2- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8006ea90 0x7f8e800d0f20 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009850 tx=0x7f8e70009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 -- 172.21.15.45:0/2060909382 shutdown_connections 2023-12-19T17:55:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 --2- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e800b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 --2- 172.21.15.45:0/2060909382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e8006ea90 0x7f8e800d0f20 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 -- 172.21.15.45:0/2060909382 >> 172.21.15.45:0/2060909382 conn(0x7f8e800b46d0 msgr2=0x7f8e800b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 -- 172.21.15.45:0/2060909382 shutdown_connections 2023-12-19T17:55:24.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.638+0000 7f8e854b1700 1 -- 172.21.15.45:0/2060909382 wait complete. 2023-12-19T17:55:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 Processor -- start 2023-12-19T17:55:24.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 -- start start 2023-12-19T17:55:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 0x7f8e800a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e801f17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e800b88b0 0x7f8e800b3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800aa750 con 0x7f8e8006ea90 2023-12-19T17:55:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800aa4d0 con 0x7f8e800b88b0 2023-12-19T17:55:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e854b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e80158720 con 0x7f8e8006fe80 2023-12-19T17:55:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 0x7f8e800a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 0x7f8e800a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43264/0 (socket says 172.21.15.45:43264) 2023-12-19T17:55:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 -- 172.21.15.45:0/96257931 learned_addr learned my addr 172.21.15.45:0/96257931 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e777fe700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e801f17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e800b88b0 0x7f8e800b3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 -- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 msgr2=0x7f8e801f17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e801f17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 -- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e800b88b0 msgr2=0x7f8e800b3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e800b88b0 0x7f8e800b3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.642+0000 7f8e7ffff700 1 -- 172.21.15.45:0/96257931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700094b0 con 0x7f8e8006ea90 2023-12-19T17:55:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.646+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 0x7f8e800a9f90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8e70014040 tx=0x7f8e70004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.646+0000 7f8e7d7fa700 1 -- 172.21.15.45:0/96257931 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70004510 con 0x7f8e8006ea90 2023-12-19T17:55:24.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.646+0000 7f8e7d7fa700 1 -- 172.21.15.45:0/96257931 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7001e070 con 0x7f8e8006ea90 2023-12-19T17:55:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.646+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e80158a00 con 0x7f8e8006ea90 2023-12-19T17:55:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.646+0000 7f8e7d7fa700 1 -- 172.21.15.45:0/96257931 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70003900 con 0x7f8e8006ea90 2023-12-19T17:55:24.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.646+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e801f1d20 con 0x7f8e8006ea90 2023-12-19T17:55:24.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e7d7fa700 1 -- 172.21.15.45:0/96257931 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e70003a60 con 0x7f8e8006ea90 2023-12-19T17:55:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 Processor -- start 2023-12-19T17:55:24.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 -- start start 2023-12-19T17:55:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e7d7fa700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e60065ad0 0x7f8e60067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e7d7fa700 1 -- 172.21.15.45:0/96257931 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e70020070 con 0x7f8e8006ea90 2023-12-19T17:55:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e60065ad0 0x7f8e60067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19c98c0 0x19c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 0x19ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x19ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x193d5b0 con 0x19f4920 2023-12-19T17:55:24.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x193ad40 con 0x19f4390 2023-12-19T17:55:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.650+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1936630 con 0x19c98c0 2023-12-19T17:55:24.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 0x19ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 0x19ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43266/0 (socket says 172.21.15.45:43266) 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 -- 172.21.15.45:0/2252019956 learned_addr learned my addr 172.21.15.45:0/2252019956 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x19ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19c98c0 0x19c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e60065ad0 0x7f8e60067f90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009fd0 tx=0x7f8e78009750 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 -- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19c98c0 msgr2=0x19c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19c98c0 0x19c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 -- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 msgr2=0x19ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x19ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 -- 172.21.15.45:0/2252019956 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x17a9960 con 0x19f4920 2023-12-19T17:55:24.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e777fe700 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 0x19ca1e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8e68000f60 tx=0x7f8e68007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03dc8040f389f20 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e75ffb700 1 -- 172.21.15.45:0/2252019956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68007820 con 0x19f4920 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e75ffb700 1 -- 172.21.15.45:0/2252019956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68001390 con 0x19f4920 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e75ffb700 1 -- 172.21.15.45:0/2252019956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68001700 con 0x19f4920 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 -- 172.21.15.45:0/2252019956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 msgr2=0x19ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 0x19ca1e0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8e68000f60 tx=0x7f8e68007320 comp rx=0 tx=0).stop 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 -- 172.21.15.45:0/2252019956 shutdown_connections 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x19ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4920 0x19ca1e0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2252019956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19c98c0 0x19c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 -- 172.21.15.45:0/2252019956 >> 172.21.15.45:0/2252019956 conn(0x175e4d0 msgr2=0x19cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 -- 172.21.15.45:0/2252019956 shutdown_connections 2023-12-19T17:55:24.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.654+0000 7f8e899a2740 1 -- 172.21.15.45:0/2252019956 wait complete. 2023-12-19T17:55:24.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 -- start start 2023-12-19T17:55:24.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 Processor -- start 2023-12-19T17:55:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19c98c0 0x19e18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 0x19f8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f6fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x18f3c80 con 0x19f4390 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x18f9b00 con 0x19c98c0 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.658+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x17e2aa0 con 0x1a1bba0 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 10 client.0 _ll_register_callbacks cb 0x192ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 0x19f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 0x19f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43282/0 (socket says 172.21.15.45:43282) 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 -- 172.21.15.45:0/2429590007 learned_addr learned my addr 172.21.15.45:0/2429590007 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f6fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19c98c0 0x19e18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 -- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 msgr2=0x19f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f6fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 -- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19c98c0 msgr2=0x19e18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19c98c0 0x19e18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 -- 172.21.15.45:0/2429590007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e6c0035d0 con 0x19f4390 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e777fe700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 0x19f8920 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8e68007670 tx=0x7f8e68000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60219e9d7de3db3b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e5effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e5effd700 1 -- 172.21.15.45:0/2429590007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680064d0 con 0x19f4390 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e5effd700 1 -- 172.21.15.45:0/2429590007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e68006630 con 0x19f4390 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x192f6b0 con 0x19f4390 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e5effd700 1 -- 172.21.15.45:0/2429590007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e680067f0 con 0x19f4390 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 10 client.6429 fetch_fsmap learned FSMap version 36 2023-12-19T17:55:24.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x18fc770 con 0x19f4390 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e5effd700 1 -- 172.21.15.45:0/2429590007 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x192f6b0 con 0x19f4390 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e5effd700 1 -- 172.21.15.45:0/2429590007 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8e68012070 con 0x19f4390 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 10 client.6429 fetch_fsmap finished waiting for FSMap version 36 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 10 client.6429 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 20 client.6429 populate_metadata read hostname 'smithi045' 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x1a27950 0x1a29d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 4 client.6429 mds_command: new command op to 6294 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 --> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x18f1a00 con 0x1a27950 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.662+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x1a27950 0x1a29d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e5effd700 10 client.6429 ms_handle_connect on v2:172.21.15.45:6836/4130274339 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x1a27950 0x1a29d40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d968fde7924c168 server_cookie=634ea7d0749de1e1 in_seq=0 out_seq=0 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e5effd700 1 -- 172.21.15.45:0/2429590007 <== mds.0 v2:172.21.15.45:6836/4130274339 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x18f1a00 con 0x1a27950 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e5effd700 10 client.6429 handle_command_reply: tid=0 2023-12-19T17:55:24.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 client.6429 shutdown 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 msgr2=0x19f8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 0x19f8920 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f8e68007670 tx=0x7f8e68000ed0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 shutdown_connections 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x1a27950 0x1a29d40 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19f4390 0x19f8920 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e5effd700 0 client.6429 ms_handle_reset on v2:172.21.15.45:6836/4130274339 2023-12-19T17:55:24.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 --2- 172.21.15.45:0/2429590007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19c98c0 0x19e18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 >> 172.21.15.45:0/2429590007 conn(0x175e4d0 msgr2=0x19cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 shutdown_connections 2023-12-19T17:55:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 1 -- 172.21.15.45:0/2429590007 wait complete. 2023-12-19T17:55:24.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.666+0000 7f8e899a2740 20 client.6429 trim_cache size 0 max 16384 2023-12-19T17:55:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.690+0000 7f8e899a2740 1 Processor -- start 2023-12-19T17:55:24.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 -- start start 2023-12-19T17:55:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19f4390 0x19f6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a1bba0 0x19e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1933e40 con 0x19c98c0 2023-12-19T17:55:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x18d49c0 con 0x1a1bba0 2023-12-19T17:55:24.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1933a30 con 0x19f4390 2023-12-19T17:55:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43284/0 (socket says 172.21.15.45:43284) 2023-12-19T17:55:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e7ffff700 1 -- 172.21.15.45:0/1614544317 learned_addr learned my addr 172.21.15.45:0/1614544317 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19f4390 0x19f6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a1bba0 0x19e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 -- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a1bba0 msgr2=0x19e0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a1bba0 0x19e0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 -- 172.21.15.45:0/1614544317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 msgr2=0x19f34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 -- 172.21.15.45:0/1614544317 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x18e29a0 con 0x19f4390 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19f4390 0x19f6ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8e68001200 tx=0x7f8e68006050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8adf17f74dc2ac63 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e767fc700 1 -- 172.21.15.45:0/1614544317 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e680077a0 con 0x19f4390 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e767fc700 1 -- 172.21.15.45:0/1614544317 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68022070 con 0x19f4390 2023-12-19T17:55:24.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.694+0000 7f8e767fc700 1 -- 172.21.15.45:0/1614544317 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e68006510 con 0x19f4390 2023-12-19T17:55:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 -- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19f4390 msgr2=0x19f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19f4390 0x19f6ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8e68001200 tx=0x7f8e68006050 comp rx=0 tx=0).stop 2023-12-19T17:55:24.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 -- 172.21.15.45:0/1614544317 shutdown_connections 2023-12-19T17:55:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a1bba0 0x19e0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x19f4390 0x19f6ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1614544317 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 -- 172.21.15.45:0/1614544317 >> 172.21.15.45:0/1614544317 conn(0x175e4d0 msgr2=0x1a1eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 -- 172.21.15.45:0/1614544317 shutdown_connections 2023-12-19T17:55:24.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 -- 172.21.15.45:0/1614544317 wait complete. 2023-12-19T17:55:24.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.698+0000 7f8e899a2740 1 -- start start 2023-12-19T17:55:24.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 Processor -- start 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f6e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x1a725e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x19f7390 con 0x19c98c0 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a72b20 con 0x19f4390 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x19d01a0 con 0x1a1bba0 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e899a2740 10 client.0 _ll_register_callbacks cb 0x186fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43292/0 (socket says 172.21.15.45:43292) 2023-12-19T17:55:24.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 -- 172.21.15.45:0/1097074299 learned_addr learned my addr 172.21.15.45:0/1097074299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x1a725e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e84cb0700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 -- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 msgr2=0x19f24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 -- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 msgr2=0x1a725e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x1a725e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.702+0000 7f8e7ffff700 1 -- 172.21.15.45:0/1097074299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e801f1d20 con 0x19c98c0 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e7ffff700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f6e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8e700090b0 tx=0x7f8e70084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b991d8c74a02f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 1 -- 172.21.15.45:0/1097074299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7006d130 con 0x19c98c0 2023-12-19T17:55:24.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 1 -- 172.21.15.45:0/1097074299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8e70059940 con 0x19c98c0 2023-12-19T17:55:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e68001390 con 0x19c98c0 2023-12-19T17:55:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 1 -- 172.21.15.45:0/1097074299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e7005daf0 con 0x19c98c0 2023-12-19T17:55:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 10 client.6435 fetch_fsmap learned FSMap version 36 2023-12-19T17:55:24.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) v3 -- 0x18fc770 con 0x19c98c0 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 1 -- 172.21.15.45:0/1097074299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e68001390 con 0x19c98c0 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 1 -- 172.21.15.45:0/1097074299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 36) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8e70078020 con 0x19c98c0 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 10 client.6435 fetch_fsmap finished waiting for FSMap version 36 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 10 client.6435 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 20 client.6435 populate_metadata read hostname 'smithi045' 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x19e5810 0x19f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 4 client.6435 mds_command: new command op to 6294 tid=0[{"prefix": "status"}] 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 --> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] -- command(tid 0: {"prefix": "status"}) v1 -- 0x17b5460 con 0x19e5810 2023-12-19T17:55:24.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x19e5810 0x19f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e777fe700 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x19e5810 0x19f5ac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5837b9cc04307a0e server_cookie=694c844497cefd8e in_seq=0 out_seq=0 2023-12-19T17:55:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 10 client.6435 ms_handle_connect on v2:172.21.15.45:6836/4130274339 2023-12-19T17:55:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 1 -- 172.21.15.45:0/1097074299 <== mds.0 v2:172.21.15.45:6836/4130274339 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x17b5460 con 0x19e5810 2023-12-19T17:55:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e5effd700 10 client.6435 handle_command_reply: tid=0 2023-12-19T17:55:24.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.706+0000 7f8e899a2740 1 client.6435 shutdown 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 msgr2=0x19f6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f6e50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f8e700090b0 tx=0x7f8e70084040 comp rx=0 tx=0).stop 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 shutdown_connections 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:6836/4130274339,v1:172.21.15.45:6837/4130274339] conn(0x19e5810 0x19f5ac0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a1bba0 0x19f24d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x19f4390 0x1a725e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e5effd700 0 client.6435 ms_handle_reset on v2:172.21.15.45:6836/4130274339 2023-12-19T17:55:24.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 --2- 172.21.15.45:0/1097074299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x19c98c0 0x19f6e50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 >> 172.21.15.45:0/1097074299 conn(0x175e4d0 msgr2=0x1a1a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 shutdown_connections 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 1 -- 172.21.15.45:0/1097074299 wait complete. 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e899a2740 20 client.6435 trim_cache size 0 max 16384 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6294, 2023-12-19T17:55:24.713 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.4930783620000003, 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 36, 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 63, 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 63, 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.655096349000001 2023-12-19T17:55:24.714 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e60065ad0 msgr2=0x7f8e60067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e60065ad0 0x7f8e60067f90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009fd0 tx=0x7f8e78009750 comp rx=0 tx=0).stop 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 msgr2=0x7f8e800a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 0x7f8e800a9f90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f8e70014040 tx=0x7f8e70004770 comp rx=0 tx=0).stop 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 shutdown_connections 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e60065ad0 0x7f8e60067f90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e800b88b0 0x7f8e800b3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e8006fe80 0x7f8e801f17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 --2- 172.21.15.45:0/96257931 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e8006ea90 0x7f8e800a9f90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 >> 172.21.15.45:0/96257931 conn(0x7f8e800b46d0 msgr2=0x7f8e800b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 shutdown_connections 2023-12-19T17:55:24.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.710+0000 7f8e854b1700 1 -- 172.21.15.45:0/96257931 wait complete. 2023-12-19T17:55:24.739 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:55:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 Processor -- start 2023-12-19T17:55:24.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 -- start start 2023-12-19T17:55:24.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3fb406ea90 0x7f3fb40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fb40b88b0 0x7f3fb40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb40b6dd0 con 0x7f3fb40b6250 2023-12-19T17:55:24.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40d1820 con 0x7f3fb40b88b0 2023-12-19T17:55:24.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.926+0000 7f3fb95fc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40d1b00 con 0x7f3fb406ea90 2023-12-19T17:55:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fb40b88b0 0x7f3fb40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fb40b88b0 0x7f3fb40b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43302/0 (socket says 172.21.15.45:43302) 2023-12-19T17:55:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 -- 172.21.15.45:0/2685293196 learned_addr learned my addr 172.21.15.45:0/2685293196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb3fff700 1 --2- 172.21.15.45:0/2685293196 >> v2:172.21.15.73:3300/0 conn(0x7f3fb406ea90 0x7f3fb40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 -- 172.21.15.45:0/2685293196 >> v2:172.21.15.73:3300/0 conn(0x7f3fb406ea90 msgr2=0x7f3fb40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 --2- 172.21.15.45:0/2685293196 >> v2:172.21.15.73:3300/0 conn(0x7f3fb406ea90 0x7f3fb40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 -- 172.21.15.45:0/2685293196 >> v1:172.21.15.73:6789/0 conn(0x7f3fb40b6250 legacy=0x7f3fb40b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 -- 172.21.15.45:0/2685293196 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40d1de0 con 0x7f3fb40b88b0 2023-12-19T17:55:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb3fff700 1 --2- 172.21.15.45:0/2685293196 >> v2:172.21.15.73:3300/0 conn(0x7f3fb406ea90 0x7f3fb40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb37fe700 1 --2- 172.21.15.45:0/2685293196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb40b88b0 0x7f3fb40b5d10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40b57b0 tx=0x7f3fa8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca55f64979e42dc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb2ffd700 1 -- 172.21.15.45:0/2685293196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800b8a0 con 0x7f3fb40b88b0 2023-12-19T17:55:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb2ffd700 1 -- 172.21.15.45:0/2685293196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa800ba00 con 0x7f3fb40b88b0 2023-12-19T17:55:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb2ffd700 1 -- 172.21.15.45:0/2685293196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa800bd90 con 0x7f3fb40b88b0 2023-12-19T17:55:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 -- 172.21.15.45:0/2685293196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb40b88b0 msgr2=0x7f3fb40b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/2685293196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb40b88b0 0x7f3fb40b5d10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40b57b0 tx=0x7f3fa8009bf0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 -- 172.21.15.45:0/2685293196 shutdown_connections 2023-12-19T17:55:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/2685293196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb40b88b0 0x7f3fb40b5d10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/2685293196 >> v2:172.21.15.73:3300/0 conn(0x7f3fb406ea90 0x7f3fb40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 -- 172.21.15.45:0/2685293196 >> 172.21.15.45:0/2685293196 conn(0x7f3fb40b46d0 msgr2=0x7f3fb40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 -- 172.21.15.45:0/2685293196 shutdown_connections 2023-12-19T17:55:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.930+0000 7f3fb95fc700 1 -- 172.21.15.45:0/2685293196 wait complete. 2023-12-19T17:55:24.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.934+0000 7f3fb95fc700 1 Processor -- start 2023-12-19T17:55:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.934+0000 7f3fb95fc700 1 -- start start 2023-12-19T17:55:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 0x7f3fb4158c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb40b6250 0x7f3fb40ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb40b88b0 0x7f3fb40b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40c8310 con 0x7f3fb406ea90 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb415e280 con 0x7f3fb40b6250 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb40c7760 con 0x7f3fb40b88b0 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 0x7f3fb4158c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 0x7f3fb4158c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43316/0 (socket says 172.21.15.45:43316) 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 -- 172.21.15.45:0/1136639958 learned_addr learned my addr 172.21.15.45:0/1136639958 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb37fe700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb40b6250 0x7f3fb40ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb8dfb700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb40b88b0 0x7f3fb40b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 -- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb40b88b0 msgr2=0x7f3fb40b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb40b88b0 0x7f3fb40b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 -- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb40b6250 msgr2=0x7f3fb40ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:24.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb40b6250 0x7f3fb40ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 -- 172.21.15.45:0/1136639958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa8009570 con 0x7f3fb406ea90 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb3fff700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 0x7f3fb4158c00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e810 tx=0x7f3fa400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4004230 con 0x7f3fb406ea90 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4004390 con 0x7f3fb406ea90 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb40c7970 con 0x7f3fb406ea90 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa40036c0 con 0x7f3fb406ea90 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.938+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb40c7f30 con 0x7f3fb406ea90 2023-12-19T17:55:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.942+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb4067760 con 0x7f3fb406ea90 2023-12-19T17:55:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.942+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3fa4003840 con 0x7f3fb406ea90 2023-12-19T17:55:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.946+0000 7f3fb0ff9700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fa0065ad0 0x7f3fa0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.946+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3fa4082c20 con 0x7f3fb406ea90 2023-12-19T17:55:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.946+0000 7f3fb37fe700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fa0065ad0 0x7f3fa0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.946+0000 7f3fb37fe700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fa0065ad0 0x7f3fa0067f90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8000c00 tx=0x7f3fa8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:24.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:24.950+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3fa4050530 con 0x7f3fb406ea90 2023-12-19T17:55:25.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.158+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3fb406f210 con 0x7f3fb406ea90 2023-12-19T17:55:25.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.158+0000 7f3fb0ff9700 1 -- 172.21.15.45:0/1136639958 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v36) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3fa4053b50 con 0x7f3fb406ea90 2023-12-19T17:55:25.161 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fa0065ad0 msgr2=0x7f3fa0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fa0065ad0 0x7f3fa0067f90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3fa8000c00 tx=0x7f3fa8008030 comp rx=0 tx=0).stop 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 msgr2=0x7f3fb4158c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 0x7f3fb4158c00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400e810 tx=0x7f3fa400ebd0 comp rx=0 tx=0).stop 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 shutdown_connections 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fa0065ad0 0x7f3fa0067f90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb40b88b0 0x7f3fb40b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:25.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb40b6250 0x7f3fb40ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 --2- 172.21.15.45:0/1136639958 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb406ea90 0x7f3fb4158c00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 >> 172.21.15.45:0/1136639958 conn(0x7f3fb40b46d0 msgr2=0x7f3fb40b66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 shutdown_connections 2023-12-19T17:55:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:25.162+0000 7f3fb95fc700 1 -- 172.21.15.45:0/1136639958 wait complete. 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:55:25.185 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:55:25.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.186 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:55:25.202 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:55:25.202 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:55:25.202 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:55:25.202 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.202 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:55:25.202 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42140sec preferred_lft 42140sec 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:55:25.203 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.204 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T17:55:25.205 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T17:55:25.206 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:55:25.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.207 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:55:25.283 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:55:25.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.286 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:55:25.347 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:55:25.347 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:55:25.347 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:55:25.347 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:55:25.347 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:55:25.347 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:55:25.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.348 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:55:25.348 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:55:25.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:55:25.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:55:25.348 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:55:25.348 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:55:25.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.484 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:55:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:55:25.501 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T17:55:25.502 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:55:25.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.502 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:55:25.582 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T17:55:25.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:55:25.582 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T17:55:25.645 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:55:25.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:55:25.645 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:55:25.709 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:55:25.789 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:55:25.789 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:55:25.868 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:55:25.872 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:55:25.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:25.873 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:55:25.933 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:55:25.934 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T17:55:25.982 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:55:26.016 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:55:26.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:55:26.095 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:55:26.097 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:55:26.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:26.098 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:55:26.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T17:55:26.122+0000 7fb14c16b640 -1 init, newargv = 0x562b2beca000 newargc=15 2023-12-19T17:55:26.126 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[49261]: starting ceph client 2023-12-19T17:55:26.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[49261]: starting fuse 2023-12-19T17:55:26.139 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:55:26.139 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:55:26.140 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T17:55:26.141 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:26.307 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.49261.asok 2023-12-19T17:55:26.492 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49261.asok 2023-12-19T17:55:26.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:26.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49261.asok status 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:55:26.694 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "49261", 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6450, 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:55:26.695 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 6450 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2962178256 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 2962178256 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.6450 192.168.0.1:0/2962178256", 2023-12-19T17:55:26.696 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/2962178256", 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 36, 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 63, 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:55:26.697 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:55:26.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:26.709 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:55:26.709 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T17:55:26.730 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:55:26.730 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T17:55:26.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:26.731 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:55:26.810 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_extra --pg_num_min 64 2023-12-19T17:55:27.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.038+0000 7fb17d93e700 1 Processor -- start 2023-12-19T17:55:27.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.038+0000 7fb17d93e700 1 -- start start 2023-12-19T17:55:27.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d93e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb1781614b0 0x7fb17806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d93e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1780caa80 0x7fb1780c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d93e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1780c5350 con 0x7fb17806f3f0 2023-12-19T17:55:27.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d93e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb17806f880 con 0x7fb1780caa80 2023-12-19T17:55:27.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d93e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1780cb050 con 0x7fb1781614b0 2023-12-19T17:55:27.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1780caa80 0x7fb1780c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb1780caa80 0x7fb1780c37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43334/0 (socket says 172.21.15.45:43334) 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 -- 172.21.15.45:0/1269040536 learned_addr learned my addr 172.21.15.45:0/1269040536 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17c93c700 1 --2- 172.21.15.45:0/1269040536 >> v2:172.21.15.73:3300/0 conn(0x7fb1781614b0 0x7fb17806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 -- 172.21.15.45:0/1269040536 >> v2:172.21.15.73:3300/0 conn(0x7fb1781614b0 msgr2=0x7fb17806eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 --2- 172.21.15.45:0/1269040536 >> v2:172.21.15.73:3300/0 conn(0x7fb1781614b0 0x7fb17806eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 -- 172.21.15.45:0/1269040536 >> v1:172.21.15.73:6789/0 conn(0x7fb17806f3f0 legacy=0x7fb1780ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 -- 172.21.15.45:0/1269040536 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb178161c80 con 0x7fb1780caa80 2023-12-19T17:55:27.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17c93c700 1 --2- 172.21.15.45:0/1269040536 >> v2:172.21.15.73:3300/0 conn(0x7fb1781614b0 0x7fb17806eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:55:27.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb17d13d700 1 --2- 172.21.15.45:0/1269040536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1780caa80 0x7fb1780c37a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb178072180 tx=0x7fb17000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf3cf49cf8cdddbc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:27.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb1777fe700 1 -- 172.21.15.45:0/1269040536 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17000e070 con 0x7fb1780caa80 2023-12-19T17:55:27.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb1777fe700 1 -- 172.21.15.45:0/1269040536 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17000b9c0 con 0x7fb1780caa80 2023-12-19T17:55:27.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.042+0000 7fb1777fe700 1 -- 172.21.15.45:0/1269040536 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17000bd70 con 0x7fb1780caa80 2023-12-19T17:55:27.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 -- 172.21.15.45:0/1269040536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1780caa80 msgr2=0x7fb1780c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 --2- 172.21.15.45:0/1269040536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1780caa80 0x7fb1780c37a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb178072180 tx=0x7fb17000b330 comp rx=0 tx=0).stop 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 -- 172.21.15.45:0/1269040536 shutdown_connections 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 --2- 172.21.15.45:0/1269040536 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1780caa80 0x7fb1780c37a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 --2- 172.21.15.45:0/1269040536 >> v2:172.21.15.73:3300/0 conn(0x7fb1781614b0 0x7fb17806eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 -- 172.21.15.45:0/1269040536 >> 172.21.15.45:0/1269040536 conn(0x7fb1780cecd0 msgr2=0x7fb1780cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 -- 172.21.15.45:0/1269040536 shutdown_connections 2023-12-19T17:55:27.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.046+0000 7fb17d93e700 1 -- 172.21.15.45:0/1269040536 wait complete. 2023-12-19T17:55:27.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 Processor -- start 2023-12-19T17:55:27.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 -- start start 2023-12-19T17:55:27.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17806f3f0 0x7fb178162760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1780caa80 0x7fb1781fa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 0x7fb1781fa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb178165600 con 0x7fb1781614b0 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781630d0 con 0x7fb17806f3f0 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d93e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1781633b0 con 0x7fb1780caa80 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 0x7fb1781fa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 0x7fb1781fa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43336/0 (socket says 172.21.15.45:43336) 2023-12-19T17:55:27.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 -- 172.21.15.45:0/3326893986 learned_addr learned my addr 172.21.15.45:0/3326893986 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb177fff700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1780caa80 0x7fb1781fa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17c93c700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17806f3f0 0x7fb178162760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 -- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1780caa80 msgr2=0x7fb1781fa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1780caa80 0x7fb1781fa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 -- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17806f3f0 msgr2=0x7fb178162760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17806f3f0 0x7fb178162760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 -- 172.21.15.45:0/3326893986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb170009b30 con 0x7fb1781614b0 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17c93c700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17806f3f0 0x7fb178162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.050+0000 7fb17d13d700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 0x7fb1781fa680 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b370 tx=0x7fb170004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170004930 con 0x7fb1781614b0 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1700092e0 con 0x7fb1781614b0 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb178163690 con 0x7fb1781614b0 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17001c660 con 0x7fb1781614b0 2023-12-19T17:55:27.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1780b2ad0 con 0x7fb1781614b0 2023-12-19T17:55:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb17804ed30 con 0x7fb1781614b0 2023-12-19T17:55:27.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.054+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb17001c7c0 con 0x7fb1781614b0 2023-12-19T17:55:27.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.058+0000 7fb1757fa700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb15c065ad0 0x7fb15c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.058+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb170084c20 con 0x7fb1781614b0 2023-12-19T17:55:27.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.058+0000 7fb17c93c700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb15c065ad0 0x7fb15c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.058+0000 7fb17c93c700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb15c065ad0 0x7fb15c067f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb16c006fd0 tx=0x7fb16c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:27.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.062+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb170052530 con 0x7fb1781614b0 2023-12-19T17:55:27.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.246+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64} v 0) v1 -- 0x7fb1780c48f0 con 0x7fb1781614b0 2023-12-19T17:55:27.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.586+0000 7fb1757fa700 1 -- 172.21.15.45:0/3326893986 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64}]=0 pool 'cephfs_data_extra' created v64) v1 ==== 142+0+0 (secure 0 0 0) 0x7fb170055b50 con 0x7fb1781614b0 2023-12-19T17:55:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb15c065ad0 msgr2=0x7fb15c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb15c065ad0 0x7fb15c067f90 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb16c006fd0 tx=0x7fb16c008040 comp rx=0 tx=0).stop 2023-12-19T17:55:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 msgr2=0x7fb1781fa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 0x7fb1781fa680 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb17000b370 tx=0x7fb170004af0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 shutdown_connections 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb15c065ad0 0x7fb15c067f90 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb1781614b0 0x7fb1781fa680 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb1780caa80 0x7fb1781fa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 --2- 172.21.15.45:0/3326893986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb17806f3f0 0x7fb178162760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 >> 172.21.15.45:0/3326893986 conn(0x7fb1780cecd0 msgr2=0x7fb1780cdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 shutdown_connections 2023-12-19T17:55:27.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.594+0000 7fb17d93e700 1 -- 172.21.15.45:0/3326893986 wait complete. 2023-12-19T17:55:27.602 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' created 2023-12-19T17:55:27.620 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_extra 2023-12-19T17:55:27.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.806+0000 7f1ae8037700 1 Processor -- start 2023-12-19T17:55:27.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.806+0000 7f1ae8037700 1 -- start start 2023-12-19T17:55:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae8037700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1ae015d090 0x7f1ae00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae8037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae00cff40 0x7f1ae00b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae8037700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ae00d10e0 con 0x7f1ae00cdff0 2023-12-19T17:55:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae8037700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ae00b6040 con 0x7f1ae015d090 2023-12-19T17:55:27.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae8037700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae00d13c0 con 0x7f1ae00cff40 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae55d2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1ae00cdff0 0x7f1ae00cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51818/0 (socket says 172.21.15.45:51818) 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae55d2700 1 -- 172.21.15.45:0/1075920397 learned_addr learned my addr 172.21.15.45:0/1075920397 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae5dd3700 1 --2- 172.21.15.45:0/1075920397 >> v2:172.21.15.73:3300/0 conn(0x7f1ae015d090 0x7f1ae00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.810+0000 7f1ae65d4700 1 --2- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae00cff40 0x7f1ae00b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae4dd1700 1 -- 172.21.15.45:0/1075920397 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4272715514 0 0) 0x7f1ae00d10e0 con 0x7f1ae00cdff0 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae4dd1700 1 -- 172.21.15.45:0/1075920397 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1acc0035d0 con 0x7f1ae00cdff0 2023-12-19T17:55:27.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae00cff40 msgr2=0x7f1ae00b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae5dd3700 1 --2- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae00cff40 0x7f1ae00b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/1075920397 >> v1:172.21.15.45:6789/0 conn(0x7f1ae00cdff0 legacy=0x7f1ae00cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/1075920397 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ae00d16a0 con 0x7f1ae015d090 2023-12-19T17:55:27.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae5dd3700 1 --2- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae015d090 0x7f1ae00d0a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009850 tx=0x7f1adc009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2f2e11763679093 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae4dd1700 1 -- 172.21.15.45:0/1075920397 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc011830 con 0x7f1ae015d090 2023-12-19T17:55:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae4dd1700 1 -- 172.21.15.45:0/1075920397 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc011990 con 0x7f1ae015d090 2023-12-19T17:55:27.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae4dd1700 1 -- 172.21.15.45:0/1075920397 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc011d40 con 0x7f1ae015d090 2023-12-19T17:55:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 -- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae015d090 msgr2=0x7f1ae00d0a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 --2- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae015d090 0x7f1ae00d0a50 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f1adc009850 tx=0x7f1adc009b60 comp rx=0 tx=0).stop 2023-12-19T17:55:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 -- 172.21.15.45:0/1075920397 shutdown_connections 2023-12-19T17:55:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 --2- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae00cff40 0x7f1ae00b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 --2- 172.21.15.45:0/1075920397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae015d090 0x7f1ae00d0a50 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 -- 172.21.15.45:0/1075920397 >> 172.21.15.45:0/1075920397 conn(0x7f1ae00b4b90 msgr2=0x7f1ae00b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 -- 172.21.15.45:0/1075920397 shutdown_connections 2023-12-19T17:55:27.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.814+0000 7f1ae8037700 1 -- 172.21.15.45:0/1075920397 wait complete. 2023-12-19T17:55:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.818+0000 7f1ae8037700 1 Processor -- start 2023-12-19T17:55:27.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.818+0000 7f1ae8037700 1 -- start start 2023-12-19T17:55:27.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 0x7f1ae0159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae00cff40 0x7f1ae015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae015d090 0x7f1ae01f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0147fc0 con 0x7f1ae00cdff0 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0147080 con 0x7f1ae00cff40 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ae0147340 con 0x7f1ae015d090 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 0x7f1ae0159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 0x7f1ae0159ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43350/0 (socket says 172.21.15.45:43350) 2023-12-19T17:55:27.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/4074449134 learned_addr learned my addr 172.21.15.45:0/4074449134 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae55d2700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae00cff40 0x7f1ae015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae65d4700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae015d090 0x7f1ae01f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae015d090 msgr2=0x7f1ae01f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae015d090 0x7f1ae01f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae00cff40 msgr2=0x7f1ae015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae00cff40 0x7f1ae015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:27.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 -- 172.21.15.45:0/4074449134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0094b0 con 0x7f1ae00cdff0 2023-12-19T17:55:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae5dd3700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 0x7f1ae0159ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1adc014040 tx=0x7f1adc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc004510 con 0x7f1ae00cdff0 2023-12-19T17:55:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1adc01e070 con 0x7f1ae00cdff0 2023-12-19T17:55:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ae0147620 con 0x7f1ae00cdff0 2023-12-19T17:55:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.822+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1adc003900 con 0x7f1ae00cdff0 2023-12-19T17:55:27.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.826+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ae0147be0 con 0x7f1ae00cdff0 2023-12-19T17:55:27.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.826+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ae004ed30 con 0x7f1ae00cdff0 2023-12-19T17:55:27.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.830+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1adc003a60 con 0x7f1ae00cdff0 2023-12-19T17:55:27.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.830+0000 7f1ad67fc700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ac4065ad0 0x7f1ac4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:27.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.830+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f1adc020070 con 0x7f1ae00cdff0 2023-12-19T17:55:27.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.830+0000 7f1ae55d2700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ac4065ad0 0x7f1ac4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:27.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.834+0000 7f1ae55d2700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ac4065ad0 0x7f1ac4067f90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0157430 tx=0x7f1ad0007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:27.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:27.834+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1adc052570 con 0x7f1ae00cdff0 2023-12-19T17:55:28.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.050+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"} v 0) v1 -- 0x7f1ae00b7f00 con 0x7f1ae00cdff0 2023-12-19T17:55:28.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.066+0000 7f1ad67fc700 1 -- 172.21.15.45:0/4074449134 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"}]=0 added data pool 10 to fsmap v37) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1adc0150b0 con 0x7f1ae00cdff0 2023-12-19T17:55:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.070+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ac4065ad0 msgr2=0x7f1ac4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.070+0000 7f1ae8037700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ac4065ad0 0x7f1ac4067f90 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0157430 tx=0x7f1ad0007de0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.070+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 msgr2=0x7f1ae0159ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.070+0000 7f1ae8037700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 0x7f1ae0159ee0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f1adc014040 tx=0x7f1adc004770 comp rx=0 tx=0).stop 2023-12-19T17:55:28.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 shutdown_connections 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ac4065ad0 0x7f1ac4067f90 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1ae015d090 0x7f1ae01f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1ae00cff40 0x7f1ae015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 --2- 172.21.15.45:0/4074449134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1ae00cdff0 0x7f1ae0159ee0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 >> 172.21.15.45:0/4074449134 conn(0x7f1ae00b4b90 msgr2=0x7f1ae015af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 shutdown_connections 2023-12-19T17:55:28.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.074+0000 7f1ae8037700 1 -- 172.21.15.45:0/4074449134 wait complete. 2023-12-19T17:55:28.083 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 10 to fsmap 2023-12-19T17:55:28.102 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:55:28.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 Processor -- start 2023-12-19T17:55:28.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 -- start start 2023-12-19T17:55:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cc006ea90 0x7f6cc00d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6cc00b88b0 0x7f6cc00b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc00b6dd0 con 0x7f6cc00b6250 2023-12-19T17:55:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc00d1820 con 0x7f6cc006ea90 2023-12-19T17:55:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cc54c8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc00d1b00 con 0x7f6cc00b88b0 2023-12-19T17:55:28.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cbeffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cc006ea90 0x7f6cc00d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cbeffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6cc006ea90 0x7f6cc00d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43364/0 (socket says 172.21.15.45:43364) 2023-12-19T17:55:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cbeffd700 1 -- 172.21.15.45:0/3674538986 learned_addr learned my addr 172.21.15.45:0/3674538986 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.286+0000 7f6cb7fff700 1 --2- 172.21.15.45:0/3674538986 >> v2:172.21.15.73:3300/0 conn(0x7f6cc00b88b0 0x7f6cc00b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbeffd700 1 -- 172.21.15.45:0/3674538986 >> v2:172.21.15.73:3300/0 conn(0x7f6cc00b88b0 msgr2=0x7f6cc00b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:28.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbeffd700 1 --2- 172.21.15.45:0/3674538986 >> v2:172.21.15.73:3300/0 conn(0x7f6cc00b88b0 0x7f6cc00b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbe7fc700 1 -- 172.21.15.45:0/3674538986 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283069564 0 0) 0x7f6cc00b6dd0 con 0x7f6cc00b6250 2023-12-19T17:55:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbeffd700 1 -- 172.21.15.45:0/3674538986 >> v1:172.21.15.73:6789/0 conn(0x7f6cc00b6250 legacy=0x7f6cc00b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbeffd700 1 -- 172.21.15.45:0/3674538986 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc00d1de0 con 0x7f6cc006ea90 2023-12-19T17:55:28.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbeffd700 1 --2- 172.21.15.45:0/3674538986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00d0f20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00b2610 tx=0x7f6cb0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d314492e656d427 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbe7fc700 1 -- 172.21.15.45:0/3674538986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011830 con 0x7f6cc006ea90 2023-12-19T17:55:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbe7fc700 1 -- 172.21.15.45:0/3674538986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb0011990 con 0x7f6cc006ea90 2023-12-19T17:55:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cbe7fc700 1 -- 172.21.15.45:0/3674538986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0011d20 con 0x7f6cc006ea90 2023-12-19T17:55:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 -- 172.21.15.45:0/3674538986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 msgr2=0x7f6cc00d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/3674538986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00d0f20 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00b2610 tx=0x7f6cb0009bf0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 -- 172.21.15.45:0/3674538986 shutdown_connections 2023-12-19T17:55:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/3674538986 >> v2:172.21.15.73:3300/0 conn(0x7f6cc00b88b0 0x7f6cc00b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/3674538986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00d0f20 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 -- 172.21.15.45:0/3674538986 >> 172.21.15.45:0/3674538986 conn(0x7f6cc00b46d0 msgr2=0x7f6cc00b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 -- 172.21.15.45:0/3674538986 shutdown_connections 2023-12-19T17:55:28.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.290+0000 7f6cc54c8700 1 -- 172.21.15.45:0/3674538986 wait complete. 2023-12-19T17:55:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.294+0000 7f6cc54c8700 1 Processor -- start 2023-12-19T17:55:28.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.294+0000 7f6cc54c8700 1 -- start start 2023-12-19T17:55:28.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6cc00b6250 0x7f6cc01f2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cc00b88b0 0x7f6cc015a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00cc6a0 con 0x7f6cc006ea90 2023-12-19T17:55:28.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00cba20 con 0x7f6cc00b88b0 2023-12-19T17:55:28.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc00cbd00 con 0x7f6cc00b6250 2023-12-19T17:55:28.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00cb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43374/0 (socket says 172.21.15.45:43374) 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 -- 172.21.15.45:0/2459949902 learned_addr learned my addr 172.21.15.45:0/2459949902 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cb7fff700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6cc00b6250 0x7f6cc01f2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbf7fe700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cc00b88b0 0x7f6cc015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 -- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6cc00b6250 msgr2=0x7f6cc01f2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6cc00b6250 0x7f6cc01f2320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 -- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cc00b88b0 msgr2=0x7f6cc015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cc00b88b0 0x7f6cc015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 -- 172.21.15.45:0/2459949902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb0009570 con 0x7f6cc006ea90 2023-12-19T17:55:28.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cbeffd700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00cb390 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0000c00 tx=0x7f6cb0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb0004610 con 0x7f6cc006ea90 2023-12-19T17:55:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb001e070 con 0x7f6cc006ea90 2023-12-19T17:55:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb00038e0 con 0x7f6cc006ea90 2023-12-19T17:55:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc00cbfe0 con 0x7f6cc006ea90 2023-12-19T17:55:28.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc0159b80 con 0x7f6cc006ea90 2023-12-19T17:55:28.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.298+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc00cc7e0 con 0x7f6cc006ea90 2023-12-19T17:55:28.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.302+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6cb0003a40 con 0x7f6cc006ea90 2023-12-19T17:55:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.306+0000 7f6cb77fe700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6ca0065ad0 0x7f6ca0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.306+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f6cb0083fe0 con 0x7f6cc006ea90 2023-12-19T17:55:28.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.306+0000 7f6cb7fff700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6ca0065ad0 0x7f6ca0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.306+0000 7f6cb7fff700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6ca0065ad0 0x7f6ca0067f90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0156490 tx=0x7f6ca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:28.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.310+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6cc00cc7e0 con 0x7f6cc006ea90 2023-12-19T17:55:28.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.522+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6cc00cc7e0 con 0x7f6cc006ea90 2023-12-19T17:55:28.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.526+0000 7f6cb77fe700 1 -- 172.21.15.45:0/2459949902 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f6cc00cc7e0 con 0x7f6cc006ea90 2023-12-19T17:55:28.528 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:28.528 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:55:18.210618+0000","modified":"2023-12-19T17:55:28.055250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/4130274339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4130274339},{"type":"v1","addr":"172.21.15.45:6837","nonce":4130274339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:55:28.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.526+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6ca0065ad0 msgr2=0x7f6ca0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.526+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6ca0065ad0 0x7f6ca0067f90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0156490 tx=0x7f6ca8008040 comp rx=0 tx=0).stop 2023-12-19T17:55:28.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.526+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 msgr2=0x7f6cc00cb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.526+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00cb390 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f6cb0000c00 tx=0x7f6cb0004770 comp rx=0 tx=0).stop 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 shutdown_connections 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6ca0065ad0 0x7f6ca0067f90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cc00b88b0 0x7f6cc015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6cc00b6250 0x7f6cc01f2320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 --2- 172.21.15.45:0/2459949902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6cc006ea90 0x7f6cc00cb390 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 >> 172.21.15.45:0/2459949902 conn(0x7f6cc00b46d0 msgr2=0x7f6cc00b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 shutdown_connections 2023-12-19T17:55:28.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.530+0000 7f6cc54c8700 1 -- 172.21.15.45:0/2459949902 wait complete. 2023-12-19T17:55:28.533 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 37 2023-12-19T17:55:28.555 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:55:28.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.738+0000 7f119d942700 1 Processor -- start 2023-12-19T17:55:28.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.738+0000 7f119d942700 1 -- start start 2023-12-19T17:55:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f119815aed0 0x7f11980cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11980b5aa0 0x7f11980c4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11980b5f00 0x7f11980c4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11980b5680 con 0x7f11980b5f00 2023-12-19T17:55:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11980c5090 con 0x7f11980b5aa0 2023-12-19T17:55:28.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980cc0b0 con 0x7f119815aed0 2023-12-19T17:55:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11980b5f00 0x7f11980c4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11980b5f00 0x7f11980c4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43390/0 (socket says 172.21.15.45:43390) 2023-12-19T17:55:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 -- 172.21.15.45:0/31451766 learned_addr learned my addr 172.21.15.45:0/31451766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f1196ffd700 1 --2- 172.21.15.45:0/31451766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f119815aed0 0x7f11980cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11967fc700 1 --2- 172.21.15.45:0/31451766 >> v2:172.21.15.73:3300/0 conn(0x7f11980b5aa0 0x7f11980c4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 -- 172.21.15.45:0/31451766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f119815aed0 msgr2=0x7f11980cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 --2- 172.21.15.45:0/31451766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f119815aed0 0x7f11980cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 -- 172.21.15.45:0/31451766 >> v2:172.21.15.73:3300/0 conn(0x7f11980b5aa0 msgr2=0x7f11980c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:55:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 --2- 172.21.15.45:0/31451766 >> v2:172.21.15.73:3300/0 conn(0x7f11980b5aa0 0x7f11980c4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 -- 172.21.15.45:0/31451766 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11980b4fc0 con 0x7f11980b5f00 2023-12-19T17:55:28.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f11977fe700 1 --2- 172.21.15.45:0/31451766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5f00 0x7f11980c4b50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1198067d10 tx=0x7f119000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40d515c047bad299 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f1195ffb700 1 -- 172.21.15.45:0/31451766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000e070 con 0x7f11980b5f00 2023-12-19T17:55:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f1195ffb700 1 -- 172.21.15.45:0/31451766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119000b910 con 0x7f11980b5f00 2023-12-19T17:55:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f1195ffb700 1 -- 172.21.15.45:0/31451766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000bcc0 con 0x7f11980b5f00 2023-12-19T17:55:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 -- 172.21.15.45:0/31451766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5f00 msgr2=0x7f11980c4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.742+0000 7f119d942700 1 --2- 172.21.15.45:0/31451766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5f00 0x7f11980c4b50 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f1198067d10 tx=0x7f119000b330 comp rx=0 tx=0).stop 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 -- 172.21.15.45:0/31451766 shutdown_connections 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 --2- 172.21.15.45:0/31451766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5f00 0x7f11980c4b50 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 --2- 172.21.15.45:0/31451766 >> v2:172.21.15.73:3300/0 conn(0x7f11980b5aa0 0x7f11980c4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 --2- 172.21.15.45:0/31451766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f119815aed0 0x7f11980cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 -- 172.21.15.45:0/31451766 >> 172.21.15.45:0/31451766 conn(0x7f11980d0ac0 msgr2=0x7f11980d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 -- 172.21.15.45:0/31451766 shutdown_connections 2023-12-19T17:55:28.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 -- 172.21.15.45:0/31451766 wait complete. 2023-12-19T17:55:28.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 Processor -- start 2023-12-19T17:55:28.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.746+0000 7f119d942700 1 -- start start 2023-12-19T17:55:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 0x7f1198159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11980b5f00 0x7f11980a7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119815aed0 0x7f11980a7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815c800 con 0x7f11980b5aa0 2023-12-19T17:55:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119815bf10 con 0x7f119815aed0 2023-12-19T17:55:28.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11980a85f0 con 0x7f11980b5f00 2023-12-19T17:55:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 0x7f1198159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 0x7f1198159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43400/0 (socket says 172.21.15.45:43400) 2023-12-19T17:55:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 -- 172.21.15.45:0/2059788166 learned_addr learned my addr 172.21.15.45:0/2059788166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:55:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f11967fc700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11980b5f00 0x7f11980a7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f11977fe700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119815aed0 0x7f11980a7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 -- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11980b5f00 msgr2=0x7f11980a7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11980b5f00 0x7f11980a7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 -- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119815aed0 msgr2=0x7f11980a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119815aed0 0x7f11980a7ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 -- 172.21.15.45:0/2059788166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1190009b30 con 0x7f11980b5aa0 2023-12-19T17:55:28.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f1196ffd700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 0x7f1198159270 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f118800ebe0 tx=0x7f118800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1188009740 con 0x7f11980b5aa0 2023-12-19T17:55:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118800c850 con 0x7f11980b5aa0 2023-12-19T17:55:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119815c1b0 con 0x7f11980b5aa0 2023-12-19T17:55:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118800cbe0 con 0x7f11980b5aa0 2023-12-19T17:55:28.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.750+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11981597b0 con 0x7f11980b5aa0 2023-12-19T17:55:28.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.754+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11980b5280 con 0x7f11980b5aa0 2023-12-19T17:55:28.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.754+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f118800cd40 con 0x7f11980b5aa0 2023-12-19T17:55:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.754+0000 7f117ffff700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065b00 0x7f1184067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:55:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.758+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f11880834c0 con 0x7f11980b5aa0 2023-12-19T17:55:28.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.758+0000 7f11967fc700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065b00 0x7f1184067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:55:28.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.758+0000 7f11967fc700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065b00 0x7f1184067fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f11980b0dc0 tx=0x7f118c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:55:28.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.762+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11980b5280 con 0x7f11980b5aa0 2023-12-19T17:55:28.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.942+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f11980b5280 con 0x7f11980b5aa0 2023-12-19T17:55:28.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.942+0000 7f117ffff700 1 -- 172.21.15.45:0/2059788166 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+18053 (secure 0 0 0) 0x7f11980b5280 con 0x7f11980b5aa0 2023-12-19T17:55:28.947 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:55:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":65,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:28.054907+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:55:28.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065b00 msgr2=0x7f1184067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065b00 0x7f1184067fc0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f11980b0dc0 tx=0x7f118c009240 comp rx=0 tx=0).stop 2023-12-19T17:55:28.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 msgr2=0x7f1198159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 0x7f1198159270 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f118800ebe0 tx=0x7f118800eef0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 shutdown_connections 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1184065b00 0x7f1184067fc0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f119815aed0 0x7f11980a7ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11980b5f00 0x7f11980a7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 --2- 172.21.15.45:0/2059788166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11980b5aa0 0x7f1198159270 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 >> 172.21.15.45:0/2059788166 conn(0x7f11980d0ac0 msgr2=0x7f119806b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 shutdown_connections 2023-12-19T17:55:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:55:28.946+0000 7f119d942700 1 -- 172.21.15.45:0/2059788166 wait complete. 2023-12-19T17:55:28.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:28.975 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v cephfs_data_extra .) 2023-12-19T17:55:29.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:55:29.005 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-12-19T17:55:29.088 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/0 2023-12-19T17:55:29.088 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:29.088 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:29.088 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/0" 2023-12-19T17:55:29.088 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:29.088 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:29.088 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:29.089 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:29.089 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:30.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:55:30.505 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:55:32.628 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/1 2023-12-19T17:55:32.629 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:32.629 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:32.629 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/1" 2023-12-19T17:55:32.629 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:32.629 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:32.629 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:32.630 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:32.630 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:35.921 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/2 2023-12-19T17:55:36.038 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:36.038 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:36.038 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/2" 2023-12-19T17:55:36.039 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:36.039 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:36.039 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:36.039 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:36.039 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:39.327 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/3 2023-12-19T17:55:39.327 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/3" 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:39.328 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:42.861 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/4 2023-12-19T17:55:42.861 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:42.861 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:42.861 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/4" 2023-12-19T17:55:42.861 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:42.861 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:42.862 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:42.862 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:42.862 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:46.390 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/5 2023-12-19T17:55:46.390 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:46.390 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:46.391 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/5" 2023-12-19T17:55:46.391 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:46.391 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:46.391 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:46.391 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:46.391 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:49.725 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/6 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/6" 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:49.725 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:53.254 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/7 2023-12-19T17:55:53.254 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/7" 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:53.255 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:55:56.786 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/8 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/8" 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:55:56.787 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:00.321 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/9 2023-12-19T17:56:00.321 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/9" 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:00.322 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:00.576 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:56:00.584 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:56:03.854 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/10 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/10" 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:03.854 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:07.140 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/11 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/11" 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:07.140 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:10.469 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/12 2023-12-19T17:56:10.470 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:10.470 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:10.470 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/12" 2023-12-19T17:56:10.470 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:10.471 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:10.471 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:10.471 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:10.471 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:14.003 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/13 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/13" 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:14.003 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:14.004 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:17.539 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/14 2023-12-19T17:56:17.539 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/14" 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:17.540 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:21.072 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/15 2023-12-19T17:56:21.072 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:21.072 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:21.072 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/15" 2023-12-19T17:56:21.072 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:21.072 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:21.073 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:21.073 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:21.073 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:24.401 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/16 2023-12-19T17:56:24.401 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:24.401 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:24.402 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/16" 2023-12-19T17:56:24.402 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:24.402 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:24.402 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:24.402 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:24.402 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:27.932 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/17 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/17" 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:27.933 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:30.730 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:56:30.736 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:56:31.470 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/18 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/18" 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:31.470 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:31.471 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:34.765 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/19 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/19" 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:34.766 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:38.100 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/20 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/20" 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:38.100 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:41.631 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/21 2023-12-19T17:56:41.631 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/21" 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:41.632 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:45.172 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/22 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/22" 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:45.173 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:48.714 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/23 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/23" 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:48.714 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:52.244 INFO:tasks.cephfs.mount:Writing 6291456 bytes to subdir/24 2023-12-19T17:56:52.244 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/24" 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 6291456): 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T17:56:52.245 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:56:55.777 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:56:55.777 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:56:55.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:56:56.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.048+0000 7f53f6076700 1 Processor -- start 2023-12-19T17:56:56.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.048+0000 7f53f6076700 1 -- start start 2023-12-19T17:56:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f6076700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f53f00c4d20 0x7f53f0165ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f6076700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f00cbe80 con 0x7f53f015aed0 2023-12-19T17:56:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f6076700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f00b61b0 con 0x7f53f00cba20 2023-12-19T17:56:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f6076700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f00b5680 con 0x7f53f00c4d20 2023-12-19T17:56:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5074700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f53f015aed0 0x7f53f00b5aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45890/0 (socket says 172.21.15.45:45890) 2023-12-19T17:56:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5074700 1 -- 172.21.15.45:0/2309852295 learned_addr learned my addr 172.21.15.45:0/2309852295 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:56.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5875700 1 --2- 172.21.15.45:0/2309852295 >> v2:172.21.15.45:3300/0 conn(0x7f53f00c4d20 0x7f53f0165ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028776769 0 0) 0x7f53f00cbe80 con 0x7f53f015aed0 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53dc0035d0 con 0x7f53f015aed0 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262952390 0 0) 0x7f53f00b61b0 con 0x7f53f00cba20 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53f00cbe80 con 0x7f53f00cba20 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5875700 1 -- 172.21.15.45:0/2309852295 >> v1:172.21.15.73:6789/0 conn(0x7f53f00cba20 legacy=0x7f53f00c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5875700 1 -- 172.21.15.45:0/2309852295 >> v1:172.21.15.45:6789/0 conn(0x7f53f015aed0 legacy=0x7f53f00b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5875700 1 -- 172.21.15.45:0/2309852295 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00cc0b0 con 0x7f53f00c4d20 2023-12-19T17:56:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53f5875700 1 --2- 172.21.15.45:0/2309852295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00c4d20 0x7f53f0165ac0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009d90 tx=0x7f53e800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b586a0d55d3a859b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.052+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e800e070 con 0x7f53f00c4d20 2023-12-19T17:56:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e800bb20 con 0x7f53f00c4d20 2023-12-19T17:56:56.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53e7fff700 1 -- 172.21.15.45:0/2309852295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e8012430 con 0x7f53f00c4d20 2023-12-19T17:56:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 -- 172.21.15.45:0/2309852295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00c4d20 msgr2=0x7f53f0165ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 --2- 172.21.15.45:0/2309852295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00c4d20 0x7f53f0165ac0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f53e8009d90 tx=0x7f53e800b330 comp rx=0 tx=0).stop 2023-12-19T17:56:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 -- 172.21.15.45:0/2309852295 shutdown_connections 2023-12-19T17:56:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 --2- 172.21.15.45:0/2309852295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00c4d20 0x7f53f0165ac0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 -- 172.21.15.45:0/2309852295 >> 172.21.15.45:0/2309852295 conn(0x7f53f00d0ac0 msgr2=0x7f53f00d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:56.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 -- 172.21.15.45:0/2309852295 shutdown_connections 2023-12-19T17:56:56.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.056+0000 7f53f6076700 1 -- 172.21.15.45:0/2309852295 wait complete. 2023-12-19T17:56:56.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 Processor -- start 2023-12-19T17:56:56.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 -- start start 2023-12-19T17:56:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f00c4d20 0x7f53f0152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 0x7f53f015ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53f015aed0 0x7f53f00ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015d380 con 0x7f53f00cba20 2023-12-19T17:56:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00abdf0 con 0x7f53f00c4d20 2023-12-19T17:56:56.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f015c9b0 con 0x7f53f015aed0 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 0x7f53f015ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 0x7f53f015ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41000/0 (socket says 172.21.15.45:41000) 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 -- 172.21.15.45:0/65194859 learned_addr learned my addr 172.21.15.45:0/65194859 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f5074700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f00c4d20 0x7f53f0152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f5875700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53f015aed0 0x7f53f00ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 -- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53f015aed0 msgr2=0x7f53f00ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53f015aed0 0x7f53f00ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 -- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f00c4d20 msgr2=0x7f53f0152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f00c4d20 0x7f53f0152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 -- 172.21.15.45:0/65194859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e8009a70 con 0x7f53f00cba20 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f5074700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f00c4d20 0x7f53f0152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:56:56.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f5875700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53f015aed0 0x7f53f00ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:56:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f4873700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 0x7f53f015ce40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c730 tx=0x7f53e000caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e00052d0 con 0x7f53f00cba20 2023-12-19T17:56:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.060+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f015e180 con 0x7f53f00cba20 2023-12-19T17:56:56.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.064+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e0005450 con 0x7f53f00cba20 2023-12-19T17:56:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.064+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e00038e0 con 0x7f53f00cba20 2023-12-19T17:56:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.064+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f015c360 con 0x7f53f00cba20 2023-12-19T17:56:56.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.064+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f0067760 con 0x7f53f00cba20 2023-12-19T17:56:56.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.064+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53e0003a40 con 0x7f53f00cba20 2023-12-19T17:56:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.068+0000 7f53e5ffb700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f53d4065ad0 0x7f53d4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.068+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f53e0082aa0 con 0x7f53f00cba20 2023-12-19T17:56:56.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.068+0000 7f53f5074700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f53d4065ad0 0x7f53d4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.068+0000 7f53f5074700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f53d4065ad0 0x7f53d4067f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0011e0 tx=0x7f53ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.076+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53e0050060 con 0x7f53f00cba20 2023-12-19T17:56:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.252+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53f015caf0 con 0x7f53f00cba20 2023-12-19T17:56:56.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.256+0000 7f53e5ffb700 1 -- 172.21.15.45:0/65194859 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18040 (secure 0 0 0) 0x7f53e0053680 con 0x7f53f00cba20 2023-12-19T17:56:56.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:56:56.263 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":66,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:29.060761+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f53d4065ad0 msgr2=0x7f53d4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f53d4065ad0 0x7f53d4067f90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f53ec0011e0 tx=0x7f53ec009040 comp rx=0 tx=0).stop 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 msgr2=0x7f53f015ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 0x7f53f015ce40 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f53e000c730 tx=0x7f53e000caf0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 shutdown_connections 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f53d4065ad0 0x7f53d4067f90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53f015aed0 0x7f53f00ab8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f53f00cba20 0x7f53f015ce40 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 --2- 172.21.15.45:0/65194859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53f00c4d20 0x7f53f0152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 >> 172.21.15.45:0/65194859 conn(0x7f53f00d0ac0 msgr2=0x7f53f006b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:56.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 shutdown_connections 2023-12-19T17:56:56.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.260+0000 7f53f6076700 1 -- 172.21.15.45:0/65194859 wait complete. 2023-12-19T17:56:56.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:55:16.332981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:55:17.225656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:55:27.316408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:56:56.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:56:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a5ffc700 1 Processor -- start 2023-12-19T17:56:56.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a5ffc700 1 -- start start 2023-12-19T17:56:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a5ffc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a0071ae0 0x7f56a00cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a5ffc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a00b1b80 con 0x7f56a00cb840 2023-12-19T17:56:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a5ffc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56a01447c0 con 0x7f56a01443e0 2023-12-19T17:56:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a5ffc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00b1830 con 0x7f56a0071ae0 2023-12-19T17:56:56.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a57fb700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f56a00cb840 0x7f56a00b2010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45900/0 (socket says 172.21.15.45:45900) 2023-12-19T17:56:56.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f56a57fb700 1 -- 172.21.15.45:0/448478556 learned_addr learned my addr 172.21.15.45:0/448478556 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:56.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f569ffff700 1 --2- 172.21.15.45:0/448478556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a0071ae0 0x7f56a00cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720572562 0 0) 0x7f56a00b1b80 con 0x7f56a00cb840 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.472+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56900035d0 con 0x7f56a00cb840 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3170952111 0 0) 0x7f56a01447c0 con 0x7f56a01443e0 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56a00b1b80 con 0x7f56a01443e0 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569ffff700 1 -- 172.21.15.45:0/448478556 >> v1:172.21.15.73:6789/0 conn(0x7f56a01443e0 legacy=0x7f56a00713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569ffff700 1 -- 172.21.15.45:0/448478556 >> v1:172.21.15.45:6789/0 conn(0x7f56a00cb840 legacy=0x7f56a00b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569ffff700 1 -- 172.21.15.45:0/448478556 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a00cc070 con 0x7f56a0071ae0 2023-12-19T17:56:56.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569ffff700 1 --2- 172.21.15.45:0/448478556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a0071ae0 0x7f56a00cb300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f568c009880 tx=0x7f568c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b3dcc791f995a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c011830 con 0x7f56a0071ae0 2023-12-19T17:56:56.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f568c011990 con 0x7f56a0071ae0 2023-12-19T17:56:56.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f569f7fe700 1 -- 172.21.15.45:0/448478556 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568c011d20 con 0x7f56a0071ae0 2023-12-19T17:56:56.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 -- 172.21.15.45:0/448478556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a0071ae0 msgr2=0x7f56a00cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/448478556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a0071ae0 0x7f56a00cb300 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f568c009880 tx=0x7f568c009b90 comp rx=0 tx=0).stop 2023-12-19T17:56:56.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 -- 172.21.15.45:0/448478556 shutdown_connections 2023-12-19T17:56:56.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/448478556 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a0071ae0 0x7f56a00cb300 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 -- 172.21.15.45:0/448478556 >> 172.21.15.45:0/448478556 conn(0x7f56a00cf5a0 msgr2=0x7f56a0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:56.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 -- 172.21.15.45:0/448478556 shutdown_connections 2023-12-19T17:56:56.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.476+0000 7f56a5ffc700 1 -- 172.21.15.45:0/448478556 wait complete. 2023-12-19T17:56:56.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.480+0000 7f56a5ffc700 1 Processor -- start 2023-12-19T17:56:56.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.480+0000 7f56a5ffc700 1 -- start start 2023-12-19T17:56:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 0x7f56a00c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56a01443e0 0x7f56a00afdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a00b0330 0x7f56a006d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00aed50 con 0x7f56a00cb840 2023-12-19T17:56:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00af030 con 0x7f56a01443e0 2023-12-19T17:56:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56a00af310 con 0x7f56a00b0330 2023-12-19T17:56:56.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 0x7f56a00c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 0x7f56a00c37a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41002/0 (socket says 172.21.15.45:41002) 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 -- 172.21.15.45:0/3204657014 learned_addr learned my addr 172.21.15.45:0/3204657014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f569ffff700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56a01443e0 0x7f56a00afdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a57fb700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a00b0330 0x7f56a006d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 -- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a00b0330 msgr2=0x7f56a006d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a00b0330 0x7f56a006d0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 -- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56a01443e0 msgr2=0x7f56a00afdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56a01443e0 0x7f56a00afdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 -- 172.21.15.45:0/3204657014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c0094b0 con 0x7f56a00cb840 2023-12-19T17:56:56.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a4ffa700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 0x7f56a00c37a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f569400c4d0 tx=0x7f569400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569400cea0 con 0x7f56a00cb840 2023-12-19T17:56:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56940052d0 con 0x7f56a00cb840 2023-12-19T17:56:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56a00af5f0 con 0x7f56a00cb840 2023-12-19T17:56:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56940036f0 con 0x7f56a00cb840 2023-12-19T17:56:56.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.484+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56a00aea00 con 0x7f56a00cb840 2023-12-19T17:56:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.488+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56a004ed30 con 0x7f56a00cb840 2023-12-19T17:56:56.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.488+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5694003850 con 0x7f56a00cb840 2023-12-19T17:56:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.492+0000 7f569d7fa700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5684065ad0 0x7f5684067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.492+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f5694082840 con 0x7f56a00cb840 2023-12-19T17:56:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.492+0000 7f569ffff700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5684065ad0 0x7f5684067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.492+0000 7f569ffff700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5684065ad0 0x7f5684067f90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f568c0090b0 tx=0x7f568c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.500+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f569404ff10 con 0x7f56a00cb840 2023-12-19T17:56:56.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.676+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f56a00b0ce0 con 0x7f56a00cb840 2023-12-19T17:56:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.676+0000 7f569d7fa700 1 -- 172.21.15.45:0/3204657014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5694053530 con 0x7f56a00cb840 2023-12-19T17:56:56.680 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:56:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5684065ad0 msgr2=0x7f5684067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5684065ad0 0x7f5684067f90 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f568c0090b0 tx=0x7f568c01c040 comp rx=0 tx=0).stop 2023-12-19T17:56:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 msgr2=0x7f56a00c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 0x7f56a00c37a0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f569400c4d0 tx=0x7f569400c7e0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 shutdown_connections 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5684065ad0 0x7f5684067f90 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f56a00b0330 0x7f56a006d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56a01443e0 0x7f56a00afdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 --2- 172.21.15.45:0/3204657014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f56a00cb840 0x7f56a00c37a0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 >> 172.21.15.45:0/3204657014 conn(0x7f56a0071ae0 msgr2=0x7f56a00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 shutdown_connections 2023-12-19T17:56:56.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.680+0000 7f56a5ffc700 1 -- 172.21.15.45:0/3204657014 wait complete. 2023-12-19T17:56:56.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:56:56.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.880+0000 7f6de66cf700 1 Processor -- start 2023-12-19T17:56:56.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.880+0000 7f6de66cf700 1 -- start start 2023-12-19T17:56:56.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6de015d0a0 0x7f6de00d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00b4fd0 0x7f6de00b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6de00d1960 con 0x7f6de00d1470 2023-12-19T17:56:56.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6de00d1c40 con 0x7f6de015d0a0 2023-12-19T17:56:56.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00d1f20 con 0x7f6de00b4fd0 2023-12-19T17:56:56.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6de015d0a0 0x7f6de00d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6de015d0a0 0x7f6de00d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41014/0 (socket says 172.21.15.45:41014) 2023-12-19T17:56:56.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 -- 172.21.15.45:0/77665405 learned_addr learned my addr 172.21.15.45:0/77665405 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:56.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 -- 172.21.15.45:0/77665405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00b4fd0 msgr2=0x7f6de00b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:56.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de4c6c700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00b4fd0 0x7f6de00b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00b4fd0 0x7f6de00b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 -- 172.21.15.45:0/77665405 >> v1:172.21.15.73:6789/0 conn(0x7f6de00d1470 legacy=0x7f6de00b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 -- 172.21.15.45:0/77665405 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de00d2200 con 0x7f6de015d0a0 2023-12-19T17:56:56.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de4c6c700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00b4fd0 0x7f6de00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:56:56.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddffff700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de015d0a0 0x7f6de00d0f30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009910 tx=0x7f6dd0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9d80007e07f2b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddf7fe700 1 -- 172.21.15.45:0/77665405 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd000ba60 con 0x7f6de015d0a0 2023-12-19T17:56:56.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddf7fe700 1 -- 172.21.15.45:0/77665405 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd000bbc0 con 0x7f6de015d0a0 2023-12-19T17:56:56.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6ddf7fe700 1 -- 172.21.15.45:0/77665405 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0009e60 con 0x7f6de015d0a0 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 -- 172.21.15.45:0/77665405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de015d0a0 msgr2=0x7f6de00d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.884+0000 7f6de66cf700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de015d0a0 0x7f6de00d0f30 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0009910 tx=0x7f6dd0009c20 comp rx=0 tx=0).stop 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 -- 172.21.15.45:0/77665405 shutdown_connections 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00b4fd0 0x7f6de00b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 --2- 172.21.15.45:0/77665405 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de015d0a0 0x7f6de00d0f30 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 -- 172.21.15.45:0/77665405 >> 172.21.15.45:0/77665405 conn(0x7f6de00cf8c0 msgr2=0x7f6de00cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 -- 172.21.15.45:0/77665405 shutdown_connections 2023-12-19T17:56:56.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 -- 172.21.15.45:0/77665405 wait complete. 2023-12-19T17:56:56.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 Processor -- start 2023-12-19T17:56:56.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.888+0000 7f6de66cf700 1 -- start start 2023-12-19T17:56:56.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 0x7f6de00c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00d1470 0x7f6de014e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de015d0a0 0x7f6de00c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de00c7940 con 0x7f6de00b4fd0 2023-12-19T17:56:56.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6de015e6f0 con 0x7f6de015d0a0 2023-12-19T17:56:56.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6de015e9d0 con 0x7f6de00d1470 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 0x7f6de00c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 0x7f6de00c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41030/0 (socket says 172.21.15.45:41030) 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 -- 172.21.15.45:0/867385115 learned_addr learned my addr 172.21.15.45:0/867385115 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6dd7fff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00d1470 0x7f6de014e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de4c6c700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de015d0a0 0x7f6de00c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 -- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00d1470 msgr2=0x7f6de014e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00d1470 0x7f6de014e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 -- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de015d0a0 msgr2=0x7f6de00c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de015d0a0 0x7f6de00c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 -- 172.21.15.45:0/867385115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009570 con 0x7f6de00b4fd0 2023-12-19T17:56:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6dd7fff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00d1470 0x7f6de014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:56:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de4c6c700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de015d0a0 0x7f6de00c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:56:56.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddffff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 0x7f6de00c7340 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0014040 tx=0x7f6dd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00036c0 con 0x7f6de00b4fd0 2023-12-19T17:56:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dd001e070 con 0x7f6de00b4fd0 2023-12-19T17:56:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6de015ecb0 con 0x7f6de00b4fd0 2023-12-19T17:56:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0003a80 con 0x7f6de00b4fd0 2023-12-19T17:56:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6de014ee00 con 0x7f6de00b4fd0 2023-12-19T17:56:56.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.892+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6de015e550 con 0x7f6de00b4fd0 2023-12-19T17:56:56.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.896+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6dd0003be0 con 0x7f6de00b4fd0 2023-12-19T17:56:56.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.896+0000 7f6ddd7fa700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6dc0065ad0 0x7f6dc0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:56.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.896+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f6dd0020070 con 0x7f6de00b4fd0 2023-12-19T17:56:56.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.896+0000 7f6dd7fff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6dc0065ad0 0x7f6dc0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:56.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.900+0000 7f6dd7fff700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6dc0065ad0 0x7f6dc0067f90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6de0159da0 tx=0x7f6dc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:56.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:56.904+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6de015e550 con 0x7f6de00b4fd0 2023-12-19T17:56:57.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.084+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6de015e550 con 0x7f6de00b4fd0 2023-12-19T17:56:57.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.084+0000 7f6ddd7fa700 1 -- 172.21.15.45:0/867385115 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6dd0015020 con 0x7f6de00b4fd0 2023-12-19T17:56:57.090 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:56:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6dc0065ad0 msgr2=0x7f6dc0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6dc0065ad0 0x7f6dc0067f90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6de0159da0 tx=0x7f6dc8009040 comp rx=0 tx=0).stop 2023-12-19T17:56:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 msgr2=0x7f6de00c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 0x7f6de00c7340 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f6dd0014040 tx=0x7f6dd0004770 comp rx=0 tx=0).stop 2023-12-19T17:56:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 shutdown_connections 2023-12-19T17:56:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6dc0065ad0 0x7f6dc0067f90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de015d0a0 0x7f6de00c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6de00d1470 0x7f6de014e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 --2- 172.21.15.45:0/867385115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6de00b4fd0 0x7f6de00c7340 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 >> 172.21.15.45:0/867385115 conn(0x7f6de00cf8c0 msgr2=0x7f6de00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 shutdown_connections 2023-12-19T17:56:57.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.088+0000 7f6de66cf700 1 -- 172.21.15.45:0/867385115 wait complete. 2023-12-19T17:56:57.115 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:56:57.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.292+0000 7f37fa239700 1 Processor -- start 2023-12-19T17:56:57.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.292+0000 7f37fa239700 1 -- start start 2023-12-19T17:56:57.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37fa239700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f415cf20 0x7f37f40d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37fa239700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f415d300 con 0x7f37f40cdfd0 2023-12-19T17:56:57.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37fa239700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37f40d1550 con 0x7f37f40b8580 2023-12-19T17:56:57.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37fa239700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40d1830 con 0x7f37f415cf20 2023-12-19T17:56:57.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9a38700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f37f40cdfd0 0x7f37f40b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45914/0 (socket says 172.21.15.45:45914) 2023-12-19T17:56:57.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9a38700 1 -- 172.21.15.45:0/149992249 learned_addr learned my addr 172.21.15.45:0/149992249 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:57.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9237700 1 --2- 172.21.15.45:0/149992249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f415cf20 0x7f37f40d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37ebfff700 1 -- 172.21.15.45:0/149992249 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2876289228 0 0) 0x7f37f415d300 con 0x7f37f40cdfd0 2023-12-19T17:56:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37ebfff700 1 -- 172.21.15.45:0/149992249 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37e00035d0 con 0x7f37f40cdfd0 2023-12-19T17:56:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9237700 1 -- 172.21.15.45:0/149992249 >> v1:172.21.15.73:6789/0 conn(0x7f37f40b8580 legacy=0x7f37f40cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9237700 1 -- 172.21.15.45:0/149992249 >> v1:172.21.15.45:6789/0 conn(0x7f37f40cdfd0 legacy=0x7f37f40b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9237700 1 -- 172.21.15.45:0/149992249 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f40d1b10 con 0x7f37f415cf20 2023-12-19T17:56:57.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.296+0000 7f37f9237700 1 --2- 172.21.15.45:0/149992249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f415cf20 0x7f37f40d0c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009880 tx=0x7f37f0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bdf1b7cf98fa9d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37ebfff700 1 -- 172.21.15.45:0/149992249 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0011830 con 0x7f37f415cf20 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37ebfff700 1 -- 172.21.15.45:0/149992249 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f0011990 con 0x7f37f415cf20 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37ebfff700 1 -- 172.21.15.45:0/149992249 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0011d20 con 0x7f37f415cf20 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 -- 172.21.15.45:0/149992249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f415cf20 msgr2=0x7f37f40d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 --2- 172.21.15.45:0/149992249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f415cf20 0x7f37f40d0c50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37f0009880 tx=0x7f37f0009b90 comp rx=0 tx=0).stop 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 -- 172.21.15.45:0/149992249 shutdown_connections 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 --2- 172.21.15.45:0/149992249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f415cf20 0x7f37f40d0c50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 -- 172.21.15.45:0/149992249 >> 172.21.15.45:0/149992249 conn(0x7f37f40b4670 msgr2=0x7f37f40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 -- 172.21.15.45:0/149992249 shutdown_connections 2023-12-19T17:56:57.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.300+0000 7f37fa239700 1 -- 172.21.15.45:0/149992249 wait complete. 2023-12-19T17:56:57.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 Processor -- start 2023-12-19T17:56:57.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 -- start start 2023-12-19T17:56:57.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 0x7f37f4152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f40cdfd0 0x7f37f40b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f415cf20 0x7f37f40cc610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f4152550 con 0x7f37f40b8580 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40cb0f0 con 0x7f37f415cf20 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37fa239700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37f40cb3d0 con 0x7f37f40cdfd0 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 0x7f37f4152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 0x7f37f4152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41032/0 (socket says 172.21.15.45:41032) 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 -- 172.21.15.45:0/260257865 learned_addr learned my addr 172.21.15.45:0/260257865 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f8a36700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f40cdfd0 0x7f37f40b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9a38700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f415cf20 0x7f37f40cc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 -- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f40cdfd0 msgr2=0x7f37f40b7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f40cdfd0 0x7f37f40b7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 -- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f415cf20 msgr2=0x7f37f40cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f415cf20 0x7f37f40cc610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 -- 172.21.15.45:0/260257865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37f00094b0 con 0x7f37f40b8580 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.304+0000 7f37f9237700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 0x7f37f4152010 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097d0 tx=0x7f37f0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0004610 con 0x7f37f40b8580 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f00036c0 con 0x7f37f40b8580 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f0003a70 con 0x7f37f40b8580 2023-12-19T17:56:57.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37f40cb6b0 con 0x7f37f40b8580 2023-12-19T17:56:57.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37f40cbc70 con 0x7f37f40b8580 2023-12-19T17:56:57.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37f406a010 con 0x7f37f40b8580 2023-12-19T17:56:57.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.308+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f37f0003bd0 con 0x7f37f40b8580 2023-12-19T17:56:57.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.312+0000 7f37e9ffb700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37d8065ad0 0x7f37d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.312+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f37f0084b80 con 0x7f37f40b8580 2023-12-19T17:56:57.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.312+0000 7f37f8a36700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37d8065ad0 0x7f37d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.312+0000 7f37f8a36700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37d8065ad0 0x7f37d8067f90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f37f415c4d0 tx=0x7f37e4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:57.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.320+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f37f406a010 con 0x7f37f40b8580 2023-12-19T17:56:57.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.512+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f37f406a010 con 0x7f37f40b8580 2023-12-19T17:56:57.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.512+0000 7f37e9ffb700 1 -- 172.21.15.45:0/260257865 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f37f406a010 con 0x7f37f40b8580 2023-12-19T17:56:57.517 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:56:57.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37d8065ad0 msgr2=0x7f37d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37d8065ad0 0x7f37d8067f90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f37f415c4d0 tx=0x7f37e4009040 comp rx=0 tx=0).stop 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 msgr2=0x7f37f4152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 0x7f37f4152010 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f37f00097d0 tx=0x7f37f0004770 comp rx=0 tx=0).stop 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 shutdown_connections 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37d8065ad0 0x7f37d8067f90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37f415cf20 0x7f37f40cc610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37f40cdfd0 0x7f37f40b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 --2- 172.21.15.45:0/260257865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37f40b8580 0x7f37f4152010 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 >> 172.21.15.45:0/260257865 conn(0x7f37f40b4670 msgr2=0x7f37f40cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 shutdown_connections 2023-12-19T17:56:57.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.516+0000 7f37fa239700 1 -- 172.21.15.45:0/260257865 wait complete. 2023-12-19T17:56:57.540 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:56:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84cb6c6700 1 Processor -- start 2023-12-19T17:56:57.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84cb6c6700 1 -- start start 2023-12-19T17:56:57.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84cb6c6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f84c40cb8d0 0x7f84c415b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84cb6c6700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c406ea90 con 0x7f84c40cc690 2023-12-19T17:56:57.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84cb6c6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c415c340 con 0x7f84c40ce350 2023-12-19T17:56:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84cb6c6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c415baa0 con 0x7f84c40cb8d0 2023-12-19T17:56:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84c9462700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84c40cc690 0x7f84c40cb1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45924/0 (socket says 172.21.15.45:45924) 2023-12-19T17:56:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84c9462700 1 -- 172.21.15.45:0/3017298024 learned_addr learned my addr 172.21.15.45:0/3017298024 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:57.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.720+0000 7f84c8c61700 1 --2- 172.21.15.45:0/3017298024 >> v2:172.21.15.73:3300/0 conn(0x7f84c40cb8d0 0x7f84c415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84bbfff700 1 -- 172.21.15.45:0/3017298024 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1248095811 0 0) 0x7f84c415c340 con 0x7f84c40ce350 2023-12-19T17:56:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84bbfff700 1 -- 172.21.15.45:0/3017298024 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b00035d0 con 0x7f84c40ce350 2023-12-19T17:56:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84bbfff700 1 -- 172.21.15.45:0/3017298024 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 587432520 0 0) 0x7f84c406ea90 con 0x7f84c40cc690 2023-12-19T17:56:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84c8c61700 1 -- 172.21.15.45:0/3017298024 >> v1:172.21.15.73:6789/0 conn(0x7f84c40ce350 legacy=0x7f84c406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84c8c61700 1 -- 172.21.15.45:0/3017298024 >> v1:172.21.15.45:6789/0 conn(0x7f84c40cc690 legacy=0x7f84c40cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84c8c61700 1 -- 172.21.15.45:0/3017298024 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c415bd80 con 0x7f84c40cb8d0 2023-12-19T17:56:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84c8c61700 1 --2- 172.21.15.45:0/3017298024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cb8d0 0x7f84c415b410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009850 tx=0x7f84b4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d5af345e6c87a2e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84bbfff700 1 -- 172.21.15.45:0/3017298024 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4011830 con 0x7f84c40cb8d0 2023-12-19T17:56:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84bbfff700 1 -- 172.21.15.45:0/3017298024 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84b4011990 con 0x7f84c40cb8d0 2023-12-19T17:56:57.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84bbfff700 1 -- 172.21.15.45:0/3017298024 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84b4011d40 con 0x7f84c40cb8d0 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 -- 172.21.15.45:0/3017298024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cb8d0 msgr2=0x7f84c415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/3017298024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cb8d0 0x7f84c415b410 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f84b4009850 tx=0x7f84b4009b60 comp rx=0 tx=0).stop 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 -- 172.21.15.45:0/3017298024 shutdown_connections 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/3017298024 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cb8d0 0x7f84c415b410 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 -- 172.21.15.45:0/3017298024 >> 172.21.15.45:0/3017298024 conn(0x7f84c4071990 msgr2=0x7f84c40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 -- 172.21.15.45:0/3017298024 shutdown_connections 2023-12-19T17:56:57.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.724+0000 7f84cb6c6700 1 -- 172.21.15.45:0/3017298024 wait complete. 2023-12-19T17:56:57.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.728+0000 7f84cb6c6700 1 Processor -- start 2023-12-19T17:56:57.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.728+0000 7f84cb6c6700 1 -- start start 2023-12-19T17:56:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84c40cb8d0 0x7f84c414e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cc690 0x7f84c415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 0x7f84c40ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c415cf50 con 0x7f84c40ce350 2023-12-19T17:56:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c415a140 con 0x7f84c40cc690 2023-12-19T17:56:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c415a420 con 0x7f84c40cb8d0 2023-12-19T17:56:57.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 0x7f84c40ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9462700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84c40cb8d0 0x7f84c414e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 0x7f84c40ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41036/0 (socket says 172.21.15.45:41036) 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 -- 172.21.15.45:0/154074344 learned_addr learned my addr 172.21.15.45:0/154074344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c8c61700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cc690 0x7f84c415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 -- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84c40cb8d0 msgr2=0x7f84c414e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84c40cb8d0 0x7f84c414e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 -- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cc690 msgr2=0x7f84c415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cc690 0x7f84c415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 -- 172.21.15.45:0/154074344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b40094b0 con 0x7f84c40ce350 2023-12-19T17:56:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84c9c63700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 0x7f84c40ae540 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00cbc0 tx=0x7f84bc00ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc003c20 con 0x7f84c40ce350 2023-12-19T17:56:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c415a700 con 0x7f84c40ce350 2023-12-19T17:56:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc003d80 con 0x7f84c40ce350 2023-12-19T17:56:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.732+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00aaa0 con 0x7f84c40ce350 2023-12-19T17:56:57.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.736+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c415af00 con 0x7f84c40ce350 2023-12-19T17:56:57.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.736+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c404ed30 con 0x7f84c40ce350 2023-12-19T17:56:57.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.736+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f84bc00ac00 con 0x7f84c40ce350 2023-12-19T17:56:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.740+0000 7f84b9ffb700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f84a8065ad0 0x7f84a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.740+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f84bc083520 con 0x7f84c40ce350 2023-12-19T17:56:57.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.740+0000 7f84c9462700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f84a8065ad0 0x7f84a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:57.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.740+0000 7f84c9462700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f84a8065ad0 0x7f84a8067f90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84c0000f60 tx=0x7f84c0007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:57.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.744+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f84bc050ae0 con 0x7f84c40ce350 2023-12-19T17:56:57.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.924+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f84c406cae0 con 0x7f84c40ce350 2023-12-19T17:56:57.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.924+0000 7f84b9ffb700 1 -- 172.21.15.45:0/154074344 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v66) v1 ==== 106+0+11 (secure 0 0 0) 0x7f84bc054100 con 0x7f84c40ce350 2023-12-19T17:56:57.930 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:56:57.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f84a8065ad0 msgr2=0x7f84a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f84a8065ad0 0x7f84a8067f90 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f84c0000f60 tx=0x7f84c0007e00 comp rx=0 tx=0).stop 2023-12-19T17:56:57.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 msgr2=0x7f84c40ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:57.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 0x7f84c40ae540 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f84bc00cbc0 tx=0x7f84bc00ced0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 shutdown_connections 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f84a8065ad0 0x7f84a8067f90 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84c40ce350 0x7f84c40ae540 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84c40cc690 0x7f84c415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 --2- 172.21.15.45:0/154074344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84c40cb8d0 0x7f84c414e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 >> 172.21.15.45:0/154074344 conn(0x7f84c4071990 msgr2=0x7f84c406fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:57.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 shutdown_connections 2023-12-19T17:56:57.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:57.928+0000 7f84cb6c6700 1 -- 172.21.15.45:0/154074344 wait complete. 2023-12-19T17:56:57.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:56:58.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.132+0000 7f15372c7700 1 Processor -- start 2023-12-19T17:56:58.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.132+0000 7f15372c7700 1 -- start start 2023-12-19T17:56:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15372c7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1530159a50 0x7f15300c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15372c7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f153015e450 0x7f153006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15372c7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f15300af720 0x7f15300afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15372c7700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1530070540 con 0x7f153015e450 2023-12-19T17:56:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15372c7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15300b0110 con 0x7f15300af720 2023-12-19T17:56:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15372c7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300c3c50 con 0x7f1530159a50 2023-12-19T17:56:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f1535ac4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f153015e450 0x7f153006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f15362c5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1530159a50 0x7f15300c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f1535ac4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f153015e450 0x7f153006fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41052/0 (socket says 172.21.15.45:41052) 2023-12-19T17:56:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f1535ac4700 1 -- 172.21.15.45:0/3810303760 learned_addr learned my addr 172.21.15.45:0/3810303760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.136+0000 7f1536ac6700 1 --2- 172.21.15.45:0/3810303760 >> v2:172.21.15.73:3300/0 conn(0x7f15300af720 0x7f15300afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f1535ac4700 1 -- 172.21.15.45:0/3810303760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1530159a50 msgr2=0x7f15300c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f1535ac4700 1 --2- 172.21.15.45:0/3810303760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1530159a50 0x7f15300c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f1535ac4700 1 -- 172.21.15.45:0/3810303760 >> v2:172.21.15.73:3300/0 conn(0x7f15300af720 msgr2=0x7f15300afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f1535ac4700 1 --2- 172.21.15.45:0/3810303760 >> v2:172.21.15.73:3300/0 conn(0x7f15300af720 0x7f15300afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f1535ac4700 1 -- 172.21.15.45:0/3810303760 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f153006c760 con 0x7f153015e450 2023-12-19T17:56:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f1535ac4700 1 --2- 172.21.15.45:0/3810303760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f153015e450 0x7f153006fba0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f15300b40a0 tx=0x7f152000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9553c07105eb080 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15352c3700 1 -- 172.21.15.45:0/3810303760 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152000dd30 con 0x7f153015e450 2023-12-19T17:56:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15352c3700 1 -- 172.21.15.45:0/3810303760 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f152000de90 con 0x7f153015e450 2023-12-19T17:56:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15352c3700 1 -- 172.21.15.45:0/3810303760 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520010690 con 0x7f153015e450 2023-12-19T17:56:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 -- 172.21.15.45:0/3810303760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f153015e450 msgr2=0x7f153006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 --2- 172.21.15.45:0/3810303760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f153015e450 0x7f153006fba0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f15300b40a0 tx=0x7f152000be90 comp rx=0 tx=0).stop 2023-12-19T17:56:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 -- 172.21.15.45:0/3810303760 shutdown_connections 2023-12-19T17:56:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 --2- 172.21.15.45:0/3810303760 >> v2:172.21.15.73:3300/0 conn(0x7f15300af720 0x7f15300afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 --2- 172.21.15.45:0/3810303760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f153015e450 0x7f153006fba0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 --2- 172.21.15.45:0/3810303760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1530159a50 0x7f15300c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 -- 172.21.15.45:0/3810303760 >> 172.21.15.45:0/3810303760 conn(0x7f15300cb900 msgr2=0x7f15300b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 -- 172.21.15.45:0/3810303760 shutdown_connections 2023-12-19T17:56:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.140+0000 7f15372c7700 1 -- 172.21.15.45:0/3810303760 wait complete. 2023-12-19T17:56:58.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 Processor -- start 2023-12-19T17:56:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 -- start start 2023-12-19T17:56:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15300af720 0x7f153015cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 0x7f15300c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f153015e450 0x7f15300c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300c6e10 con 0x7f1530159a50 2023-12-19T17:56:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300b2940 con 0x7f15300af720 2023-12-19T17:56:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15372c7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15300c6200 con 0x7f153015e450 2023-12-19T17:56:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f1535ac4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 0x7f15300c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f1535ac4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 0x7f15300c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41064/0 (socket says 172.21.15.45:41064) 2023-12-19T17:56:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f1535ac4700 1 -- 172.21.15.45:0/1936314555 learned_addr learned my addr 172.21.15.45:0/1936314555 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f15362c5700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15300af720 0x7f153015cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.144+0000 7f1536ac6700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f153015e450 0x7f15300c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1535ac4700 1 -- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f153015e450 msgr2=0x7f15300c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1535ac4700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f153015e450 0x7f15300c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1535ac4700 1 -- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15300af720 msgr2=0x7f153015cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1535ac4700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15300af720 0x7f153015cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1535ac4700 1 -- 172.21.15.45:0/1936314555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f152000b810 con 0x7f1530159a50 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1535ac4700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 0x7f15300c5890 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1520015000 tx=0x7f1520004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152001f070 con 0x7f1530159a50 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15200038d0 con 0x7f1530159a50 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15300c64e0 con 0x7f1530159a50 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1520003c60 con 0x7f1530159a50 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15300c6aa0 con 0x7f1530159a50 2023-12-19T17:56:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.148+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300c6fc0 con 0x7f1530159a50 2023-12-19T17:56:58.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.152+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1520019400 con 0x7f1530159a50 2023-12-19T17:56:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.152+0000 7f1526ffd700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1514065ad0 0x7f1514067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.152+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f15200869d0 con 0x7f1530159a50 2023-12-19T17:56:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.152+0000 7f15362c5700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1514065ad0 0x7f1514067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.156+0000 7f15362c5700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1514065ad0 0x7f1514067f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f152c0113e0 tx=0x7f152c00b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:58.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.160+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1520054140 con 0x7f1530159a50 2023-12-19T17:56:58.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.348+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1530067760 con 0x7f1530159a50 2023-12-19T17:56:58.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.348+0000 7f1526ffd700 1 -- 172.21.15.45:0/1936314555 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1520029080 con 0x7f1530159a50 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1514065ad0 msgr2=0x7f1514067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1514065ad0 0x7f1514067f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f152c0113e0 tx=0x7f152c00b040 comp rx=0 tx=0).stop 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 msgr2=0x7f15300c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 0x7f15300c5890 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1520015000 tx=0x7f1520004770 comp rx=0 tx=0).stop 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 shutdown_connections 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1514065ad0 0x7f1514067f90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f153015e450 0x7f15300c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1530159a50 0x7f15300c5890 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 --2- 172.21.15.45:0/1936314555 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15300af720 0x7f153015cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.352+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 >> 172.21.15.45:0/1936314555 conn(0x7f15300cb900 msgr2=0x7f15300c4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.356+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 shutdown_connections 2023-12-19T17:56:58.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.356+0000 7f15372c7700 1 -- 172.21.15.45:0/1936314555 wait complete. 2023-12-19T17:56:58.362 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:56:58.382 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:56:58.382 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:56:58.397 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:56:58.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.608+0000 7fde82676700 1 Processor -- start 2023-12-19T17:56:58.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.608+0000 7fde82676700 1 -- start start 2023-12-19T17:56:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde82676700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c06cad0 0x7fde7c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde82676700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fde7c0af720 0x7fde7c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde82676700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7c06f0a0 con 0x7fde7c15ae20 2023-12-19T17:56:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde82676700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde7c0b0110 con 0x7fde7c0af720 2023-12-19T17:56:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde82676700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c06ea90 con 0x7fde7c06cad0 2023-12-19T17:56:58.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde81674700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fde7c15ae20 0x7fde7c0c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:45934/0 (socket says 172.21.15.45:45934) 2023-12-19T17:56:58.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde81674700 1 -- 172.21.15.45:0/2039649425 learned_addr learned my addr 172.21.15.45:0/2039649425 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:58.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde80e73700 1 --2- 172.21.15.45:0/2039649425 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c06cad0 0x7fde7c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde81e75700 1 --2- 172.21.15.45:0/2039649425 >> v2:172.21.15.73:3300/0 conn(0x7fde7c0af720 0x7fde7c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde80e73700 1 -- 172.21.15.45:0/2039649425 >> v2:172.21.15.73:3300/0 conn(0x7fde7c0af720 msgr2=0x7fde7c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:58.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde80e73700 1 --2- 172.21.15.45:0/2039649425 >> v2:172.21.15.73:3300/0 conn(0x7fde7c0af720 0x7fde7c0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde80e73700 1 -- 172.21.15.45:0/2039649425 >> v1:172.21.15.45:6789/0 conn(0x7fde7c15ae20 legacy=0x7fde7c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde80e73700 1 -- 172.21.15.45:0/2039649425 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0c3f60 con 0x7fde7c06cad0 2023-12-19T17:56:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde73fff700 1 -- 172.21.15.45:0/2039649425 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2734619583 0 0) 0x7fde7c06f0a0 con 0x7fde7c15ae20 2023-12-19T17:56:58.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde80e73700 1 --2- 172.21.15.45:0/2039649425 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c06cad0 0x7fde7c15be40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009850 tx=0x7fde6c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84c59cec806eb599 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde73fff700 1 -- 172.21.15.45:0/2039649425 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c011830 con 0x7fde7c06cad0 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde73fff700 1 -- 172.21.15.45:0/2039649425 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c011990 con 0x7fde7c06cad0 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.612+0000 7fde73fff700 1 -- 172.21.15.45:0/2039649425 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c011d40 con 0x7fde7c06cad0 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 -- 172.21.15.45:0/2039649425 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c06cad0 msgr2=0x7fde7c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 --2- 172.21.15.45:0/2039649425 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c06cad0 0x7fde7c15be40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009850 tx=0x7fde6c009b60 comp rx=0 tx=0).stop 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 -- 172.21.15.45:0/2039649425 shutdown_connections 2023-12-19T17:56:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 --2- 172.21.15.45:0/2039649425 >> v2:172.21.15.73:3300/0 conn(0x7fde7c0af720 0x7fde7c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 --2- 172.21.15.45:0/2039649425 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c06cad0 0x7fde7c15be40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 -- 172.21.15.45:0/2039649425 >> 172.21.15.45:0/2039649425 conn(0x7fde7c0cb900 msgr2=0x7fde7c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 -- 172.21.15.45:0/2039649425 shutdown_connections 2023-12-19T17:56:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.616+0000 7fde82676700 1 -- 172.21.15.45:0/2039649425 wait complete. 2023-12-19T17:56:58.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 Processor -- start 2023-12-19T17:56:58.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 -- start start 2023-12-19T17:56:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde7c06cad0 0x7fde7c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 0x7fde7c15b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c15ae20 0x7fde7c15b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0cd370 con 0x7fde7c0af720 2023-12-19T17:56:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0cd090 con 0x7fde7c06cad0 2023-12-19T17:56:58.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde82676700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7c0c7420 con 0x7fde7c15ae20 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde80e73700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 0x7fde7c15b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde80e73700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 0x7fde7c15b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41072/0 (socket says 172.21.15.45:41072) 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde80e73700 1 -- 172.21.15.45:0/2684281585 learned_addr learned my addr 172.21.15.45:0/2684281585 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde81674700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde7c06cad0 0x7fde7c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.620+0000 7fde81e75700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c15ae20 0x7fde7c15b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde80e73700 1 -- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c15ae20 msgr2=0x7fde7c15b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde80e73700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c15ae20 0x7fde7c15b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde80e73700 1 -- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde7c06cad0 msgr2=0x7fde7c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde80e73700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde7c06cad0 0x7fde7c0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde80e73700 1 -- 172.21.15.45:0/2684281585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c0094b0 con 0x7fde7c0af720 2023-12-19T17:56:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde80e73700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 0x7fde7c15b2a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0090b0 tx=0x7fde6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:58.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c01a990 con 0x7fde7c0af720 2023-12-19T17:56:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c01f070 con 0x7fde7c0af720 2023-12-19T17:56:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c01ad30 con 0x7fde7c0af720 2023-12-19T17:56:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde7c0c7700 con 0x7fde7c0af720 2023-12-19T17:56:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde7c0ae770 con 0x7fde7c0af720 2023-12-19T17:56:58.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.624+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7c06f510 con 0x7fde7c0af720 2023-12-19T17:56:58.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.628+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde6c02e450 con 0x7fde7c0af720 2023-12-19T17:56:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.628+0000 7fde71ffb700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde60065ad0 0x7fde60067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.628+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fde6c0843b0 con 0x7fde7c0af720 2023-12-19T17:56:58.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.628+0000 7fde81674700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde60065ad0 0x7fde60067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:58.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.628+0000 7fde81674700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde60065ad0 0x7fde60067f90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fde780012e0 tx=0x7fde78001aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:58.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.636+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fde7c06f510 con 0x7fde7c0af720 2023-12-19T17:56:58.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.816+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7c0b1200 con 0x7fde7c0af720 2023-12-19T17:56:58.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.820+0000 7fde71ffb700 1 -- 172.21.15.45:0/2684281585 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v66) v1 ==== 74+0+18040 (secure 0 0 0) 0x7fde7c0b1200 con 0x7fde7c0af720 2023-12-19T17:56:58.825 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:56:58.826 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":66,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:55:29.060761+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:56:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.820+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde60065ad0 msgr2=0x7fde60067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.820+0000 7fde82676700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde60065ad0 0x7fde60067f90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fde780012e0 tx=0x7fde78001aa0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.820+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 msgr2=0x7fde7c15b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.820+0000 7fde82676700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 0x7fde7c15b2a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fde6c0090b0 tx=0x7fde6c004770 comp rx=0 tx=0).stop 2023-12-19T17:56:58.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 shutdown_connections 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde60065ad0 0x7fde60067f90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde7c15ae20 0x7fde7c15b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde7c0af720 0x7fde7c15b2a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 --2- 172.21.15.45:0/2684281585 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde7c06cad0 0x7fde7c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 >> 172.21.15.45:0/2684281585 conn(0x7fde7c0cb900 msgr2=0x7fde7c06db90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 shutdown_connections 2023-12-19T17:56:58.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:58.824+0000 7fde82676700 1 -- 172.21.15.45:0/2684281585 wait complete. 2023-12-19T17:56:58.858 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:55:16.332981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:55:17.225656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:55:27.316408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:56:58.858 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:56:59.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.036+0000 7febdffe6700 1 Processor -- start 2023-12-19T17:56:59.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.036+0000 7febdffe6700 1 -- start start 2023-12-19T17:56:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdffe6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 0x7febd80b2d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdffe6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7febd8165db0 0x7febd80ccfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdffe6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febd80ca0b0 con 0x7febd80cb870 2023-12-19T17:56:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdffe6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febd80c94e0 con 0x7febd8165db0 2023-12-19T17:56:59.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdffe6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c9780 con 0x7febd81614e0 2023-12-19T17:56:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 0x7febd80b2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 0x7febd80b2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:35766/0 (socket says 172.21.15.45:35766) 2023-12-19T17:56:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 -- 172.21.15.45:0/3611719479 learned_addr learned my addr 172.21.15.45:0/3611719479 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:59.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdd581700 1 --2- 172.21.15.45:0/3611719479 >> v2:172.21.15.73:3300/0 conn(0x7febd8165db0 0x7febd80ccfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 -- 172.21.15.45:0/3611719479 >> v2:172.21.15.73:3300/0 conn(0x7febd8165db0 msgr2=0x7febd80ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 --2- 172.21.15.45:0/3611719479 >> v2:172.21.15.73:3300/0 conn(0x7febd8165db0 0x7febd80ccfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 -- 172.21.15.45:0/3611719479 >> v1:172.21.15.73:6789/0 conn(0x7febd80cb870 legacy=0x7febd80ca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdcd80700 1 -- 172.21.15.45:0/3611719479 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944303636 0 0) 0x7febd80ca0b0 con 0x7febd80cb870 2023-12-19T17:56:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 -- 172.21.15.45:0/3611719479 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd80c9a60 con 0x7febd81614e0 2023-12-19T17:56:59.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febddd82700 1 --2- 172.21.15.45:0/3611719479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 0x7febd80b2d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7febd4009910 tx=0x7febd4009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e984debbfe665803 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdcd80700 1 -- 172.21.15.45:0/3611719479 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011830 con 0x7febd81614e0 2023-12-19T17:56:59.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdcd80700 1 -- 172.21.15.45:0/3611719479 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd4011990 con 0x7febd81614e0 2023-12-19T17:56:59.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.040+0000 7febdcd80700 1 -- 172.21.15.45:0/3611719479 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4011d40 con 0x7febd81614e0 2023-12-19T17:56:59.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 -- 172.21.15.45:0/3611719479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 msgr2=0x7febd80b2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 --2- 172.21.15.45:0/3611719479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 0x7febd80b2d80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7febd4009910 tx=0x7febd4009c20 comp rx=0 tx=0).stop 2023-12-19T17:56:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 -- 172.21.15.45:0/3611719479 shutdown_connections 2023-12-19T17:56:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 --2- 172.21.15.45:0/3611719479 >> v2:172.21.15.73:3300/0 conn(0x7febd8165db0 0x7febd80ccfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 --2- 172.21.15.45:0/3611719479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd81614e0 0x7febd80b2d80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 -- 172.21.15.45:0/3611719479 >> 172.21.15.45:0/3611719479 conn(0x7febd80b1d50 msgr2=0x7febd80b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:59.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 -- 172.21.15.45:0/3611719479 shutdown_connections 2023-12-19T17:56:59.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.044+0000 7febdffe6700 1 -- 172.21.15.45:0/3611719479 wait complete. 2023-12-19T17:56:59.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 Processor -- start 2023-12-19T17:56:59.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 -- start start 2023-12-19T17:56:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 0x7febd81f7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd81614e0 0x7febd806d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febd8165db0 0x7febd806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81f7c80 con 0x7febd8165db0 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd81646f0 con 0x7febd81614e0 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.048+0000 7febdffe6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd80c3bf0 con 0x7febd80cb870 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febddd82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 0x7febd81f7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febd8165db0 0x7febd806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febddd82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 0x7febd81f7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:35768/0 (socket says 172.21.15.45:35768) 2023-12-19T17:56:59.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febddd82700 1 -- 172.21.15.45:0/2831747725 learned_addr learned my addr 172.21.15.45:0/2831747725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:59.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febdd581700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd81614e0 0x7febd806d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 -- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 msgr2=0x7febd81f7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 0x7febd81f7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 -- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd81614e0 msgr2=0x7febd806d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd81614e0 0x7febd806d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 -- 172.21.15.45:0/2831747725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd4009570 con 0x7febd8165db0 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febddd82700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 0x7febd81f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febde583700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febd8165db0 0x7febd806dda0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7febd0002230 tx=0x7febd000ce10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0003e50 con 0x7febd8165db0 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd0005070 con 0x7febd8165db0 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd0005420 con 0x7febd8165db0 2023-12-19T17:56:59.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd81fa800 con 0x7febd8165db0 2023-12-19T17:56:59.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.052+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd81fadc0 con 0x7febd8165db0 2023-12-19T17:56:59.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.056+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd80c3da0 con 0x7febd8165db0 2023-12-19T17:56:59.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.056+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7febd0005580 con 0x7febd8165db0 2023-12-19T17:56:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.056+0000 7febce7fc700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7febbc065ad0 0x7febbc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.056+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7febd0082da0 con 0x7febd8165db0 2023-12-19T17:56:59.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.060+0000 7febddd82700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7febbc065ad0 0x7febbc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.060+0000 7febddd82700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7febbc065ad0 0x7febbc067f90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7febd4009c60 tx=0x7febd401d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.064+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7febd80c3da0 con 0x7febd8165db0 2023-12-19T17:56:59.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.236+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febd80cde10 con 0x7febd8165db0 2023-12-19T17:56:59.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febce7fc700 1 -- 172.21.15.45:0/2831747725 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v66) v1 ==== 93+0+10 (secure 0 0 0) 0x7febd0017020 con 0x7febd8165db0 2023-12-19T17:56:59.244 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7febbc065ad0 msgr2=0x7febbc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7febbc065ad0 0x7febbc067f90 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7febd4009c60 tx=0x7febd401d040 comp rx=0 tx=0).stop 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febd8165db0 msgr2=0x7febd806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febd8165db0 0x7febd806dda0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7febd0002230 tx=0x7febd000ce10 comp rx=0 tx=0).stop 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 shutdown_connections 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7febbc065ad0 0x7febbc067f90 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7febd8165db0 0x7febd806dda0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febd81614e0 0x7febd806d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 --2- 172.21.15.45:0/2831747725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7febd80cb870 0x7febd81f7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 >> 172.21.15.45:0/2831747725 conn(0x7febd80b1d50 msgr2=0x7febd80b3630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 shutdown_connections 2023-12-19T17:56:59.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.240+0000 7febdffe6700 1 -- 172.21.15.45:0/2831747725 wait complete. 2023-12-19T17:56:59.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:56:59.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.440+0000 7fada5d42700 1 Processor -- start 2023-12-19T17:56:59.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.440+0000 7fada5d42700 1 -- start start 2023-12-19T17:56:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fada5d42700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada015d090 0x7fada00d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fada5d42700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fada00cff40 0x7fada00b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fada5d42700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fada00d10e0 con 0x7fada00cdff0 2023-12-19T17:56:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fada5d42700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fada00b6040 con 0x7fada00cff40 2023-12-19T17:56:59.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fada5d42700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada00d13c0 con 0x7fada015d090 2023-12-19T17:56:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9effd700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fada00cdff0 0x7fada00cf830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:46950/0 (socket says 172.21.15.45:46950) 2023-12-19T17:56:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9effd700 1 -- 172.21.15.45:0/3134685997 learned_addr learned my addr 172.21.15.45:0/3134685997 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9ffff700 1 --2- 172.21.15.45:0/3134685997 >> v2:172.21.15.73:3300/0 conn(0x7fada00cff40 0x7fada00b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9f7fe700 1 --2- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada015d090 0x7fada00d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9ffff700 1 -- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada015d090 msgr2=0x7fada00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9ffff700 1 --2- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada015d090 0x7fada00d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9ffff700 1 -- 172.21.15.45:0/3134685997 >> v1:172.21.15.73:6789/0 conn(0x7fada00cdff0 legacy=0x7fada00cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9ffff700 1 -- 172.21.15.45:0/3134685997 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00d16a0 con 0x7fada00cff40 2023-12-19T17:56:59.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9ffff700 1 --2- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada00cff40 0x7fada00b6490 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad98009d90 tx=0x7fad9800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d809236b1fc76c04 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.444+0000 7fad9e7fc700 1 -- 172.21.15.45:0/3134685997 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9800e070 con 0x7fada00cff40 2023-12-19T17:56:59.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fad9e7fc700 1 -- 172.21.15.45:0/3134685997 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9800bb20 con 0x7fada00cff40 2023-12-19T17:56:59.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fad9e7fc700 1 -- 172.21.15.45:0/3134685997 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad98012430 con 0x7fada00cff40 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 -- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada00cff40 msgr2=0x7fada00b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 --2- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada00cff40 0x7fada00b6490 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fad98009d90 tx=0x7fad9800b330 comp rx=0 tx=0).stop 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 -- 172.21.15.45:0/3134685997 shutdown_connections 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 --2- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada00cff40 0x7fada00b6490 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 --2- 172.21.15.45:0/3134685997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada015d090 0x7fada00d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 -- 172.21.15.45:0/3134685997 >> 172.21.15.45:0/3134685997 conn(0x7fada00b4b90 msgr2=0x7fada00b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 -- 172.21.15.45:0/3134685997 shutdown_connections 2023-12-19T17:56:59.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.448+0000 7fada5d42700 1 -- 172.21.15.45:0/3134685997 wait complete. 2023-12-19T17:56:59.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 Processor -- start 2023-12-19T17:56:59.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 -- start start 2023-12-19T17:56:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 0x7fada015d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada00cff40 0x7fada014dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada015d090 0x7fada00ca4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada015dd30 con 0x7fada00cdff0 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fada015df60 con 0x7fada015d090 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fada5d42700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fada015e240 con 0x7fada00cff40 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 0x7fada015d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 0x7fada015d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41738/0 (socket says 172.21.15.45:41738) 2023-12-19T17:56:59.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9f7fe700 1 -- 172.21.15.45:0/1403936356 learned_addr learned my addr 172.21.15.45:0/1403936356 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9effd700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada00cff40 0x7fada014dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9ffff700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada015d090 0x7fada00ca4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9f7fe700 1 -- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada00cff40 msgr2=0x7fada014dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.452+0000 7fad9f7fe700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada00cff40 0x7fada014dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad9f7fe700 1 -- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada015d090 msgr2=0x7fada00ca4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad9f7fe700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada015d090 0x7fada00ca4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad9f7fe700 1 -- 172.21.15.45:0/1403936356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad98009a70 con 0x7fada00cdff0 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad9ffff700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada015d090 0x7fada00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:56:59.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad9f7fe700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 0x7fada015d7f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e840 tx=0x7fad9000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900095a0 con 0x7fada00cdff0 2023-12-19T17:56:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad9000c690 con 0x7fada00cdff0 2023-12-19T17:56:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000ca00 con 0x7fada00cdff0 2023-12-19T17:56:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fada015e520 con 0x7fada00cdff0 2023-12-19T17:56:59.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fada015eae0 con 0x7fada00cdff0 2023-12-19T17:56:59.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.456+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fada004ed30 con 0x7fada00cdff0 2023-12-19T17:56:59.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.460+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fad9000cb60 con 0x7fada00cdff0 2023-12-19T17:56:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.460+0000 7fad87fff700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fad8c065ad0 0x7fad8c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.460+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fad90083470 con 0x7fada00cdff0 2023-12-19T17:56:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.460+0000 7fad9effd700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fad8c065ad0 0x7fad8c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.460+0000 7fad9effd700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fad8c065ad0 0x7fad8c067f90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fada00cb160 tx=0x7fad94009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.468+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fad90050b50 con 0x7fada00cdff0 2023-12-19T17:56:59.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.644+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fada00cbe20 con 0x7fada00cdff0 2023-12-19T17:56:59.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.644+0000 7fad87fff700 1 -- 172.21.15.45:0/1403936356 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v66) v1 ==== 104+0+11 (secure 0 0 0) 0x7fad90054170 con 0x7fada00cdff0 2023-12-19T17:56:59.650 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fad8c065ad0 msgr2=0x7fad8c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fad8c065ad0 0x7fad8c067f90 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fada00cb160 tx=0x7fad94009040 comp rx=0 tx=0).stop 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 msgr2=0x7fada015d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 0x7fada015d7f0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fad9000e840 tx=0x7fad9000ec00 comp rx=0 tx=0).stop 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 shutdown_connections 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fad8c065ad0 0x7fad8c067f90 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fada015d090 0x7fada00ca4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fada00cff40 0x7fada014dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 --2- 172.21.15.45:0/1403936356 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fada00cdff0 0x7fada015d7f0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 >> 172.21.15.45:0/1403936356 conn(0x7fada00b4b90 msgr2=0x7fada00b4f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 shutdown_connections 2023-12-19T17:56:59.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.648+0000 7fada5d42700 1 -- 172.21.15.45:0/1403936356 wait complete. 2023-12-19T17:56:59.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:56:59.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.856+0000 7f12c0818700 1 Processor -- start 2023-12-19T17:56:59.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.856+0000 7f12c0818700 1 -- start start 2023-12-19T17:56:59.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12c0818700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc15cf20 0x7f12bc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12c0818700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f12bc0cdfd0 0x7f12bc0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12c0818700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12bc15d300 con 0x7f12bc0b8580 2023-12-19T17:56:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12c0818700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12bc0d1550 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12c0818700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0d1830 con 0x7f12bc15cf20 2023-12-19T17:56:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12ba59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f12bc0b8580 0x7f12bc0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41942/0 (socket says 172.21.15.45:41942) 2023-12-19T17:56:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12ba59c700 1 -- 172.21.15.45:0/161620686 learned_addr learned my addr 172.21.15.45:0/161620686 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:56:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bad9d700 1 --2- 172.21.15.45:0/161620686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc15cf20 0x7f12bc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bb59e700 1 --2- 172.21.15.45:0/161620686 >> v2:172.21.15.73:3300/0 conn(0x7f12bc0cdfd0 0x7f12bc0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12b9d9b700 1 -- 172.21.15.45:0/161620686 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3662518411 0 0) 0x7f12bc15d300 con 0x7f12bc0b8580 2023-12-19T17:56:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12b9d9b700 1 -- 172.21.15.45:0/161620686 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a40035d0 con 0x7f12bc0b8580 2023-12-19T17:56:59.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bad9d700 1 -- 172.21.15.45:0/161620686 >> v2:172.21.15.73:3300/0 conn(0x7f12bc0cdfd0 msgr2=0x7f12bc0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:56:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bad9d700 1 --2- 172.21.15.45:0/161620686 >> v2:172.21.15.73:3300/0 conn(0x7f12bc0cdfd0 0x7f12bc0b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bad9d700 1 -- 172.21.15.45:0/161620686 >> v1:172.21.15.45:6789/0 conn(0x7f12bc0b8580 legacy=0x7f12bc0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bad9d700 1 -- 172.21.15.45:0/161620686 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12bc0d1b10 con 0x7f12bc15cf20 2023-12-19T17:56:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.860+0000 7f12bad9d700 1 --2- 172.21.15.45:0/161620686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc15cf20 0x7f12bc0d0c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009850 tx=0x7f12ac009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=209c003ec138b250 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12b9d9b700 1 -- 172.21.15.45:0/161620686 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011830 con 0x7f12bc15cf20 2023-12-19T17:56:59.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12b9d9b700 1 -- 172.21.15.45:0/161620686 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac011990 con 0x7f12bc15cf20 2023-12-19T17:56:59.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12b9d9b700 1 -- 172.21.15.45:0/161620686 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac011d00 con 0x7f12bc15cf20 2023-12-19T17:56:59.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 -- 172.21.15.45:0/161620686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc15cf20 msgr2=0x7f12bc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 --2- 172.21.15.45:0/161620686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc15cf20 0x7f12bc0d0c50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f12ac009850 tx=0x7f12ac009b60 comp rx=0 tx=0).stop 2023-12-19T17:56:59.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 -- 172.21.15.45:0/161620686 shutdown_connections 2023-12-19T17:56:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 --2- 172.21.15.45:0/161620686 >> v2:172.21.15.73:3300/0 conn(0x7f12bc0cdfd0 0x7f12bc0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 --2- 172.21.15.45:0/161620686 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc15cf20 0x7f12bc0d0c50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 -- 172.21.15.45:0/161620686 >> 172.21.15.45:0/161620686 conn(0x7f12bc0b4670 msgr2=0x7f12bc0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:56:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 -- 172.21.15.45:0/161620686 shutdown_connections 2023-12-19T17:56:59.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 -- 172.21.15.45:0/161620686 wait complete. 2023-12-19T17:56:59.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 Processor -- start 2023-12-19T17:56:59.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.864+0000 7f12c0818700 1 -- start start 2023-12-19T17:56:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc0b8580 0x7f12bc1f5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 0x7f12bc0ab190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc15cf20 0x7f12bc0b4a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0aa350 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc1f5540 con 0x7f12bc15cf20 2023-12-19T17:56:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12bc0a9710 con 0x7f12bc0b8580 2023-12-19T17:56:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 0x7f12bc0ab190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 0x7f12bc0ab190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41748/0 (socket says 172.21.15.45:41748) 2023-12-19T17:56:59.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 -- 172.21.15.45:0/3596489239 learned_addr learned my addr 172.21.15.45:0/3596489239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12bad9d700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc0b8580 0x7f12bc1f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12bb59e700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc15cf20 0x7f12bc0b4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 -- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc0b8580 msgr2=0x7f12bc1f5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc0b8580 0x7f12bc1f5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 -- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc15cf20 msgr2=0x7f12bc0b4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc15cf20 0x7f12bc0b4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 -- 172.21.15.45:0/3596489239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ac0094b0 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12ba59c700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 0x7f12bc0ab190 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f12b00010e0 tx=0x7f12b000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0005d90 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b00070d0 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0007460 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12bc0a99b0 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.868+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12bc0a9f70 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.872+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12bc0aa490 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.872+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12b00075c0 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.876+0000 7f12a37fe700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12a8065ad0 0x7f12a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:56:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.876+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f12b00829a0 con 0x7f12bc0cdfd0 2023-12-19T17:56:59.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.876+0000 7f12bad9d700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12a8065ad0 0x7f12a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:56:59.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.876+0000 7f12bad9d700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12a8065ad0 0x7f12a8067f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0090b0 tx=0x7f12ac008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:56:59.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:56:59.880+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f12bc0aa490 con 0x7f12bc0cdfd0 2023-12-19T17:57:00.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.056+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12bc0aa490 con 0x7f12bc0cdfd0 2023-12-19T17:57:00.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.056+0000 7f12a37fe700 1 -- 172.21.15.45:0/3596489239 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v66) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12bc0aa490 con 0x7f12bc0cdfd0 2023-12-19T17:57:00.061 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:57:00.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12a8065ad0 msgr2=0x7f12a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12a8065ad0 0x7f12a8067f90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f12ac0090b0 tx=0x7f12ac008030 comp rx=0 tx=0).stop 2023-12-19T17:57:00.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 msgr2=0x7f12bc0ab190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 0x7f12bc0ab190 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f12b00010e0 tx=0x7f12b000c880 comp rx=0 tx=0).stop 2023-12-19T17:57:00.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 shutdown_connections 2023-12-19T17:57:00.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12a8065ad0 0x7f12a8067f90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12bc15cf20 0x7f12bc0b4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12bc0cdfd0 0x7f12bc0ab190 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 --2- 172.21.15.45:0/3596489239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12bc0b8580 0x7f12bc1f5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 >> 172.21.15.45:0/3596489239 conn(0x7f12bc0b4670 msgr2=0x7f12bc0b3c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:00.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 shutdown_connections 2023-12-19T17:57:00.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.060+0000 7f12c0818700 1 -- 172.21.15.45:0/3596489239 wait complete. 2023-12-19T17:57:00.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:57:00.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.276+0000 7feb661c3700 1 Processor -- start 2023-12-19T17:57:00.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.276+0000 7feb661c3700 1 -- start start 2023-12-19T17:57:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb661c3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7feb60071ae0 0x7feb600cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb661c3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7feb600cb840 0x7feb600b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb661c3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb600b1b80 con 0x7feb601443e0 2023-12-19T17:57:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb661c3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb601447c0 con 0x7feb600cb840 2023-12-19T17:57:00.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb661c3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb600b1830 con 0x7feb60071ae0 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb651c1700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feb601443e0 0x7feb600713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41950/0 (socket says 172.21.15.45:41950) 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb651c1700 1 -- 172.21.15.45:0/2319095102 learned_addr learned my addr 172.21.15.45:0/2319095102 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb659c2700 1 --2- 172.21.15.45:0/2319095102 >> v2:172.21.15.45:3300/0 conn(0x7feb600cb840 0x7feb600b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb649c0700 1 --2- 172.21.15.45:0/2319095102 >> v2:172.21.15.73:3300/0 conn(0x7feb60071ae0 0x7feb600cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb57fff700 1 -- 172.21.15.45:0/2319095102 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435429922 0 0) 0x7feb600b1b80 con 0x7feb601443e0 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb57fff700 1 -- 172.21.15.45:0/2319095102 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb4c0035d0 con 0x7feb601443e0 2023-12-19T17:57:00.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb659c2700 1 -- 172.21.15.45:0/2319095102 >> v2:172.21.15.73:3300/0 conn(0x7feb60071ae0 msgr2=0x7feb600cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb659c2700 1 --2- 172.21.15.45:0/2319095102 >> v2:172.21.15.73:3300/0 conn(0x7feb60071ae0 0x7feb600cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb659c2700 1 -- 172.21.15.45:0/2319095102 >> v1:172.21.15.45:6789/0 conn(0x7feb601443e0 legacy=0x7feb600713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb659c2700 1 -- 172.21.15.45:0/2319095102 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600cc070 con 0x7feb600cb840 2023-12-19T17:57:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.280+0000 7feb659c2700 1 --2- 172.21.15.45:0/2319095102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb600b2010 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feb6006c630 tx=0x7feb5800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab5fb30b824b60cd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:00.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb57fff700 1 -- 172.21.15.45:0/2319095102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800e070 con 0x7feb600cb840 2023-12-19T17:57:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb57fff700 1 -- 172.21.15.45:0/2319095102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5800bb20 con 0x7feb600cb840 2023-12-19T17:57:00.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb57fff700 1 -- 172.21.15.45:0/2319095102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5800be90 con 0x7feb600cb840 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 -- 172.21.15.45:0/2319095102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 msgr2=0x7feb600b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 --2- 172.21.15.45:0/2319095102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb600b2010 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7feb6006c630 tx=0x7feb5800b330 comp rx=0 tx=0).stop 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 -- 172.21.15.45:0/2319095102 shutdown_connections 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 --2- 172.21.15.45:0/2319095102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb600b2010 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 --2- 172.21.15.45:0/2319095102 >> v2:172.21.15.73:3300/0 conn(0x7feb60071ae0 0x7feb600cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 -- 172.21.15.45:0/2319095102 >> 172.21.15.45:0/2319095102 conn(0x7feb600cf5a0 msgr2=0x7feb60070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 -- 172.21.15.45:0/2319095102 shutdown_connections 2023-12-19T17:57:00.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.284+0000 7feb661c3700 1 -- 172.21.15.45:0/2319095102 wait complete. 2023-12-19T17:57:00.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 Processor -- start 2023-12-19T17:57:00.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 -- start start 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb60134850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feb601443e0 0x7feb601efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb6006c680 0x7feb6006cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6006d070 con 0x7feb600cb840 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb60134d90 con 0x7feb6006c680 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb661c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb600a9840 con 0x7feb601443e0 2023-12-19T17:57:00.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb60134850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb60134850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41754/0 (socket says 172.21.15.45:41754) 2023-12-19T17:57:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 -- 172.21.15.45:0/936248985 learned_addr learned my addr 172.21.15.45:0/936248985 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb649c0700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feb601443e0 0x7feb601efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb659c2700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb6006c680 0x7feb6006cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 -- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feb601443e0 msgr2=0x7feb601efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feb601443e0 0x7feb601efad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 -- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb6006c680 msgr2=0x7feb6006cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb6006c680 0x7feb6006cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 -- 172.21.15.45:0/936248985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58009a70 con 0x7feb600cb840 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.288+0000 7feb651c1700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb60134850 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c450 tx=0x7feb5c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0074e0 con 0x7feb600cb840 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb600a9b20 con 0x7feb600cb840 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c007660 con 0x7feb600cb840 2023-12-19T17:57:00.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c005a90 con 0x7feb600cb840 2023-12-19T17:57:00.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb600aa0e0 con 0x7feb600cb840 2023-12-19T17:57:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feb5c005bf0 con 0x7feb600cb840 2023-12-19T17:57:00.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6004ed30 con 0x7feb600cb840 2023-12-19T17:57:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.292+0000 7feb55ffb700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7feb44065ad0 0x7feb44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.296+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7feb5c082860 con 0x7feb600cb840 2023-12-19T17:57:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.296+0000 7feb649c0700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7feb44065ad0 0x7feb44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.296+0000 7feb649c0700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7feb44065ad0 0x7feb44067f90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feb600aa8e0 tx=0x7feb50009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:00.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.300+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feb5c04fec0 con 0x7feb600cb840 2023-12-19T17:57:00.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.476+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7feb600b0ce0 con 0x7feb600cb840 2023-12-19T17:57:00.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.480+0000 7feb55ffb700 1 -- 172.21.15.45:0/936248985 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v66) v1 ==== 106+0+11 (secure 0 0 0) 0x7feb5c00ce60 con 0x7feb600cb840 2023-12-19T17:57:00.484 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7feb44065ad0 msgr2=0x7feb44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7feb44065ad0 0x7feb44067f90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7feb600aa8e0 tx=0x7feb50009240 comp rx=0 tx=0).stop 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 msgr2=0x7feb60134850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb60134850 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7feb5c00c450 tx=0x7feb5c00c760 comp rx=0 tx=0).stop 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 shutdown_connections 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7feb44065ad0 0x7feb44067f90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feb6006c680 0x7feb6006cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feb601443e0 0x7feb601efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 --2- 172.21.15.45:0/936248985 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feb600cb840 0x7feb60134850 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 >> 172.21.15.45:0/936248985 conn(0x7feb60071ae0 msgr2=0x7feb600caa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 shutdown_connections 2023-12-19T17:57:00.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.484+0000 7feb661c3700 1 -- 172.21.15.45:0/936248985 wait complete. 2023-12-19T17:57:00.512 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:57:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.688+0000 7f4c388a2700 1 Processor -- start 2023-12-19T17:57:00.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 -- start start 2023-12-19T17:57:00.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c340b88b0 0x7f4c340b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c340b6250 0x7f4c340b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c340d1820 con 0x7f4c340b6250 2023-12-19T17:57:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c340d1b00 con 0x7f4c340b88b0 2023-12-19T17:57:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c388a2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340d1de0 con 0x7f4c3406ea90 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c340b88b0 0x7f4c340b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c32d9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c340b6250 0x7f4c340b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4c340b88b0 0x7f4c340b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:44040/0 (socket says 172.21.15.45:44040) 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 -- 172.21.15.45:0/1206413419 learned_addr learned my addr 172.21.15.45:0/1206413419 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 -- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 msgr2=0x7f4c340d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 --2- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 -- 172.21.15.45:0/1206413419 >> v2:172.21.15.45:3300/0 conn(0x7f4c340b6250 msgr2=0x7f4c340b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 --2- 172.21.15.45:0/1206413419 >> v2:172.21.15.45:3300/0 conn(0x7f4c340b6250 0x7f4c340b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.692+0000 7f4c3259c700 1 -- 172.21.15.45:0/1206413419 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340d20c0 con 0x7f4c340b88b0 2023-12-19T17:57:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c3259c700 1 --2- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c340b5d10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c34070650 tx=0x7f4c28009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38a7f90954fe96a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c31d9b700 1 -- 172.21.15.45:0/1206413419 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28011830 con 0x7f4c340b88b0 2023-12-19T17:57:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c31d9b700 1 -- 172.21.15.45:0/1206413419 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28011990 con 0x7f4c340b88b0 2023-12-19T17:57:00.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c31d9b700 1 -- 172.21.15.45:0/1206413419 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28011d20 con 0x7f4c340b88b0 2023-12-19T17:57:00.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 -- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 msgr2=0x7f4c340b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c340b5d10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4c34070650 tx=0x7f4c28009bf0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 -- 172.21.15.45:0/1206413419 shutdown_connections 2023-12-19T17:57:00.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1206413419 >> v2:172.21.15.45:3300/0 conn(0x7f4c340b6250 0x7f4c340b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c340b5d10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1206413419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 -- 172.21.15.45:0/1206413419 >> 172.21.15.45:0/1206413419 conn(0x7f4c340b46d0 msgr2=0x7f4c340b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 -- 172.21.15.45:0/1206413419 shutdown_connections 2023-12-19T17:57:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.696+0000 7f4c388a2700 1 -- 172.21.15.45:0/1206413419 wait complete. 2023-12-19T17:57:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 Processor -- start 2023-12-19T17:57:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 -- start start 2023-12-19T17:57:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 0x7f4c340aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c3415a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340aa680 con 0x7f4c340b6250 2023-12-19T17:57:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340aa8f0 con 0x7f4c340b88b0 2023-12-19T17:57:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.700+0000 7f4c388a2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c340aabd0 con 0x7f4c3406ea90 2023-12-19T17:57:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 0x7f4c340aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 0x7f4c340aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41774/0 (socket says 172.21.15.45:41774) 2023-12-19T17:57:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 -- 172.21.15.45:0/1401653945 learned_addr learned my addr 172.21.15.45:0/1401653945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3359e700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c3415a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c32d9d700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 -- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 msgr2=0x7f4c340cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340cc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 -- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 msgr2=0x7f4c3415a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c3415a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 -- 172.21.15.45:0/1401653945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c28009570 con 0x7f4c340b6250 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3359e700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c3415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:00.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c3259c700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 0x7f4c340aa140 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4c28000c00 tx=0x7f4c28004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28004450 con 0x7f4c340b6250 2023-12-19T17:57:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c280045b0 con 0x7f4c340b6250 2023-12-19T17:57:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c3415d330 con 0x7f4c340b6250 2023-12-19T17:57:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28003900 con 0x7f4c340b6250 2023-12-19T17:57:00.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.704+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c340cc2b0 con 0x7f4c340b6250 2023-12-19T17:57:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.708+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c340cc4a0 con 0x7f4c340b6250 2023-12-19T17:57:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.708+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c28003a60 con 0x7f4c340b6250 2023-12-19T17:57:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.708+0000 7f4c1b7fe700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c20065ad0 0x7f4c20067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.708+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f4c28021030 con 0x7f4c340b6250 2023-12-19T17:57:00.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.708+0000 7f4c32d9d700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c20065ad0 0x7f4c20067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:00.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.712+0000 7f4c32d9d700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c20065ad0 0x7f4c20067f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009a60 tx=0x7f4c24008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:00.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.716+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4c28052080 con 0x7f4c340b6250 2023-12-19T17:57:00.803 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:57:00.809 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:57:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.904+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4c34067760 con 0x7f4c340b6250 2023-12-19T17:57:00.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.904+0000 7f4c1b7fe700 1 -- 172.21.15.45:0/1401653945 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v66) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4c280556a0 con 0x7f4c340b6250 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c20065ad0 msgr2=0x7f4c20067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c20065ad0 0x7f4c20067f90 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4c24009a60 tx=0x7f4c24008040 comp rx=0 tx=0).stop 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 msgr2=0x7f4c340aa140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 0x7f4c340aa140 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4c28000c00 tx=0x7f4c28004770 comp rx=0 tx=0).stop 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 shutdown_connections 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c20065ad0 0x7f4c20067f90 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c340b88b0 0x7f4c3415a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c340b6250 0x7f4c340aa140 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 --2- 172.21.15.45:0/1401653945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c3406ea90 0x7f4c340cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 >> 172.21.15.45:0/1401653945 conn(0x7f4c340b46d0 msgr2=0x7f4c340b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 shutdown_connections 2023-12-19T17:57:00.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:00.908+0000 7f4c388a2700 1 -- 172.21.15.45:0/1401653945 wait complete. 2023-12-19T17:57:00.915 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:57:00.934 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:57:00.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:00.934 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:01.007 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[49261]: fuse finished with error 0 and tester_r 0 2023-12-19T17:57:01.078 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:57:07.179 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:57:07.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:07.180 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T17:57:07.202 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:07.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 Processor -- start 2023-12-19T17:57:07.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 -- start start 2023-12-19T17:57:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f902c15ab50 0x7f902c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c06e0a0 0x7f902c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f902c06cbb0 con 0x7f902c15af30 2023-12-19T17:57:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902c06fa10 con 0x7f902c15ab50 2023-12-19T17:57:07.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9033037700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c06fcf0 con 0x7f902c06e0a0 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9030dd3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f902c15ab50 0x7f902c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9030dd3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f902c15ab50 0x7f902c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41778/0 (socket says 172.21.15.45:41778) 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.496+0000 7f9030dd3700 1 -- 172.21.15.45:0/3078395956 learned_addr learned my addr 172.21.15.45:0/3078395956 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f90315d4700 1 --2- 172.21.15.45:0/3078395956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c06e0a0 0x7f902c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9030dd3700 1 -- 172.21.15.45:0/3078395956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c06e0a0 msgr2=0x7f902c0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9030dd3700 1 --2- 172.21.15.45:0/3078395956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c06e0a0 0x7f902c0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9030dd3700 1 -- 172.21.15.45:0/3078395956 >> v1:172.21.15.73:6789/0 conn(0x7f902c15af30 legacy=0x7f902c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:07.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9030dd3700 1 -- 172.21.15.45:0/3078395956 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f902c06ffd0 con 0x7f902c15ab50 2023-12-19T17:57:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9030dd3700 1 --2- 172.21.15.45:0/3078395956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c15ab50 0x7f902c0ccd70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9020009910 tx=0x7f9020009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca859766e72e565 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f902b7fe700 1 -- 172.21.15.45:0/3078395956 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020011830 con 0x7f902c15ab50 2023-12-19T17:57:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f902b7fe700 1 -- 172.21.15.45:0/3078395956 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9020011990 con 0x7f902c15ab50 2023-12-19T17:57:07.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f902b7fe700 1 -- 172.21.15.45:0/3078395956 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020011d40 con 0x7f902c15ab50 2023-12-19T17:57:07.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 -- 172.21.15.45:0/3078395956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c15ab50 msgr2=0x7f902c0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:07.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 --2- 172.21.15.45:0/3078395956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c15ab50 0x7f902c0ccd70 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f9020009910 tx=0x7f9020009c20 comp rx=0 tx=0).stop 2023-12-19T17:57:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 -- 172.21.15.45:0/3078395956 shutdown_connections 2023-12-19T17:57:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 --2- 172.21.15.45:0/3078395956 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c06e0a0 0x7f902c0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 --2- 172.21.15.45:0/3078395956 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c15ab50 0x7f902c0ccd70 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 -- 172.21.15.45:0/3078395956 >> 172.21.15.45:0/3078395956 conn(0x7f902c0cba40 msgr2=0x7f902c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 -- 172.21.15.45:0/3078395956 shutdown_connections 2023-12-19T17:57:07.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.500+0000 7f9033037700 1 -- 172.21.15.45:0/3078395956 wait complete. 2023-12-19T17:57:07.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.504+0000 7f9033037700 1 Processor -- start 2023-12-19T17:57:07.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.504+0000 7f9033037700 1 -- start start 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 0x7f902c153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902c15ab50 0x7f902c0c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c15af30 0x7f902c0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c6cc0 con 0x7f902c06e0a0 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c6fa0 con 0x7f902c15ab50 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f902c0c7280 con 0x7f902c15af30 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 0x7f902c153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 0x7f902c153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41780/0 (socket says 172.21.15.45:41780) 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 -- 172.21.15.45:0/2431863639 learned_addr learned my addr 172.21.15.45:0/2431863639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:07.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f902bfff700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902c15ab50 0x7f902c0c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f90315d4700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c15af30 0x7f902c0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 -- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c15af30 msgr2=0x7f902c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c15af30 0x7f902c0c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 -- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902c15ab50 msgr2=0x7f902c0c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902c15ab50 0x7f902c0c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 -- 172.21.15.45:0/2431863639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009570 con 0x7f902c06e0a0 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9030dd3700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 0x7f902c153570 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9020000c00 tx=0x7f9020004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020004510 con 0x7f902c06e0a0 2023-12-19T17:57:07.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90200036c0 con 0x7f902c06e0a0 2023-12-19T17:57:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9020003a70 con 0x7f902c06e0a0 2023-12-19T17:57:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f902c0c7560 con 0x7f902c06e0a0 2023-12-19T17:57:07.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.508+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902c0c7d60 con 0x7f902c06e0a0 2023-12-19T17:57:07.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.512+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902c0c7a80 con 0x7f902c06e0a0 2023-12-19T17:57:07.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.512+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9020003bd0 con 0x7f902c06e0a0 2023-12-19T17:57:07.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.516+0000 7f90297fa700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9010065ad0 0x7f9010067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:07.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.516+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f9020021030 con 0x7f902c06e0a0 2023-12-19T17:57:07.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.516+0000 7f902bfff700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9010065ad0 0x7f9010067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:07.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.516+0000 7f902bfff700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9010065ad0 0x7f9010067f90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f902c06f8e0 tx=0x7f9018009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:07.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.524+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f902c0c7a80 con 0x7f902c06e0a0 2023-12-19T17:57:07.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.732+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f902c0c7a80 con 0x7f902c06e0a0 2023-12-19T17:57:07.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.732+0000 7f90297fa700 1 -- 172.21.15.45:0/2431863639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f902c0c7a80 con 0x7f902c06e0a0 2023-12-19T17:57:07.739 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:07.739 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":37,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:55:18.210618+0000","modified":"2023-12-19T17:55:28.055250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6294":{"gid":6294,"name":"c","rank":0,"incarnation":33,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/4130274339","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4130274339},{"type":"v1","addr":"172.21.15.45:6837","nonce":4130274339}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.736+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9010065ad0 msgr2=0x7f9010067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.736+0000 7f9033037700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9010065ad0 0x7f9010067f90 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f902c06f8e0 tx=0x7f9018009040 comp rx=0 tx=0).stop 2023-12-19T17:57:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.736+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 msgr2=0x7f902c153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.736+0000 7f9033037700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 0x7f902c153570 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f9020000c00 tx=0x7f9020004770 comp rx=0 tx=0).stop 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 shutdown_connections 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9010065ad0 0x7f9010067f90 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f902c15af30 0x7f902c0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f902c15ab50 0x7f902c0c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 --2- 172.21.15.45:0/2431863639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f902c06e0a0 0x7f902c153570 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 >> 172.21.15.45:0/2431863639 conn(0x7f902c0cba40 msgr2=0x7f902c0ca380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 shutdown_connections 2023-12-19T17:57:07.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:07.740+0000 7f9033037700 1 -- 172.21.15.45:0/2431863639 wait complete. 2023-12-19T17:57:07.747 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 37 2023-12-19T17:57:07.768 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-12-19T17:57:07.999 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-12-19T17:57:08.000 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-12-19T17:57:08.000 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T17:57:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.176+0000 7f646f4eb700 1 Processor -- start 2023-12-19T17:57:08.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.176+0000 7f646f4eb700 1 -- start start 2023-12-19T17:57:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.176+0000 7f646f4eb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f646806cad0 0x7f646815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.176+0000 7f646f4eb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646806f0a0 con 0x7f646815ae20 2023-12-19T17:57:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.176+0000 7f646f4eb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f646806ea90 con 0x7f64680af720 2023-12-19T17:57:08.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.176+0000 7f646f4eb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64680c3f60 con 0x7f646806cad0 2023-12-19T17:57:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646dce8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f646806cad0 0x7f646815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646e4e9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f646815ae20 0x7f64680c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41952/0 (socket says 172.21.15.45:41952) 2023-12-19T17:57:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646e4e9700 1 -- 172.21.15.45:0/2053938903 learned_addr learned my addr 172.21.15.45:0/2053938903 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:08.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646ecea700 1 --1- 172.21.15.45:0/2053938903 >> v1:172.21.15.73:6789/0 conn(0x7f64680af720 0x7f646806f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:46970/0 (socket says 172.21.15.45:46970) 2023-12-19T17:57:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646dce8700 1 -- 172.21.15.45:0/2053938903 >> v1:172.21.15.73:6789/0 conn(0x7f64680af720 legacy=0x7f646806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646dce8700 1 -- 172.21.15.45:0/2053938903 >> v1:172.21.15.45:6789/0 conn(0x7f646815ae20 legacy=0x7f64680c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646dce8700 1 -- 172.21.15.45:0/2053938903 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64680c4240 con 0x7f646806cad0 2023-12-19T17:57:08.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646d4e7700 1 -- 172.21.15.45:0/2053938903 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2684565917 0 0) 0x7f646806f0a0 con 0x7f646815ae20 2023-12-19T17:57:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646dce8700 1 --2- 172.21.15.45:0/2053938903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f646815be40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f64580097d0 tx=0x7f6458009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1912b5d052729b24 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646d4e7700 1 -- 172.21.15.45:0/2053938903 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6458004230 con 0x7f646806cad0 2023-12-19T17:57:08.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646d4e7700 1 -- 172.21.15.45:0/2053938903 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6458004390 con 0x7f646806cad0 2023-12-19T17:57:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646d4e7700 1 -- 172.21.15.45:0/2053938903 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64580036c0 con 0x7f646806cad0 2023-12-19T17:57:08.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 -- 172.21.15.45:0/2053938903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 msgr2=0x7f646815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 --2- 172.21.15.45:0/2053938903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f646815be40 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f64580097d0 tx=0x7f6458009ae0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 -- 172.21.15.45:0/2053938903 shutdown_connections 2023-12-19T17:57:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 --2- 172.21.15.45:0/2053938903 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f646815be40 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 -- 172.21.15.45:0/2053938903 >> 172.21.15.45:0/2053938903 conn(0x7f64680cb900 msgr2=0x7f64680b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 -- 172.21.15.45:0/2053938903 shutdown_connections 2023-12-19T17:57:08.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.180+0000 7f646f4eb700 1 -- 172.21.15.45:0/2053938903 wait complete. 2023-12-19T17:57:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 Processor -- start 2023-12-19T17:57:08.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 -- start start 2023-12-19T17:57:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f64680c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64680af720 0x7f64680c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646815ae20 0x7f64680c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64680c7cf0 con 0x7f646806cad0 2023-12-19T17:57:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64680c6710 con 0x7f646815ae20 2023-12-19T17:57:08.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646f4eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64680c69f0 con 0x7f64680af720 2023-12-19T17:57:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.184+0000 7f646e4e9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f64680c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646ecea700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646815ae20 0x7f64680c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f64680c77b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41808/0 (socket says 172.21.15.45:41808) 2023-12-19T17:57:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 -- 172.21.15.45:0/507124548 learned_addr learned my addr 172.21.15.45:0/507124548 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646dce8700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64680af720 0x7f64680c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 -- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64680af720 msgr2=0x7f64680c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64680af720 0x7f64680c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 -- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646815ae20 msgr2=0x7f64680c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646815ae20 0x7f64680c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 -- 172.21.15.45:0/507124548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64580094b0 con 0x7f646806cad0 2023-12-19T17:57:08.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646e4e9700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f64680c77b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f646400c4e0 tx=0x7f646400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464004ca0 con 0x7f646806cad0 2023-12-19T17:57:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64680c6cd0 con 0x7f646806cad0 2023-12-19T17:57:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6464004e20 con 0x7f646806cad0 2023-12-19T17:57:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6464007310 con 0x7f646806cad0 2023-12-19T17:57:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64680c7290 con 0x7f646806cad0 2023-12-19T17:57:08.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.188+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6468067760 con 0x7f646806cad0 2023-12-19T17:57:08.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.192+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6464007470 con 0x7f646806cad0 2023-12-19T17:57:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.192+0000 7f645effd700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f644c065b00 0x7f644c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.192+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f6464082ff0 con 0x7f646806cad0 2023-12-19T17:57:08.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.192+0000 7f646dce8700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f644c065b00 0x7f644c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.192+0000 7f646dce8700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f644c065b00 0x7f644c067fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64580097d0 tx=0x7f6458010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.200+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f64640b40a0 con 0x7f646806cad0 2023-12-19T17:57:08.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.412+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f646815e850 con 0x7f646806cad0 2023-12-19T17:57:08.418 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:57:08.412+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:57:08.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.428+0000 7f645effd700 1 -- 172.21.15.45:0/507124548 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6464050660 con 0x7f646806cad0 2023-12-19T17:57:08.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f644c065b00 msgr2=0x7f644c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f644c065b00 0x7f644c067fc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f64580097d0 tx=0x7f6458010000 comp rx=0 tx=0).stop 2023-12-19T17:57:08.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 msgr2=0x7f64680c77b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f64680c77b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f646400c4e0 tx=0x7f646400c7f0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 shutdown_connections 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f644c065b00 0x7f644c067fc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f646815ae20 0x7f64680c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f64680af720 0x7f64680c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 --2- 172.21.15.45:0/507124548 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f646806cad0 0x7f64680c77b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 >> 172.21.15.45:0/507124548 conn(0x7f64680cb900 msgr2=0x7f646806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 shutdown_connections 2023-12-19T17:57:08.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.432+0000 7f646f4eb700 1 -- 172.21.15.45:0/507124548 wait complete. 2023-12-19T17:57:08.440 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T17:57:08.465 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:57:08.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:57:08.516 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:57:08.537 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T17:57:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T17:57:08.537 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:57:08.538 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:57:08.539 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T17:57:08.540 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T17:57:08.541 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.542 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:57:08.543 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T17:57:08.544 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:57:08.545 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T17:57:08.546 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T17:57:08.547 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.548 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T17:57:08.549 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T17:57:08.550 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.551 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T17:57:08.552 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:57:08.553 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:57:08.554 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:57:08.555 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:57:08.556 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T17:57:08.557 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T17:57:08.558 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.559 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.575 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:57:08.610 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T17:57:08.684 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T17:57:08.684 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T17:57:08.685 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:57:08.686 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:57:08.687 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T17:57:08.688 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T17:57:08.689 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:57:08.690 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.691 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:08.692 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.693 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T17:57:08.694 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T17:57:08.695 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T17:57:08.696 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T17:57:08.697 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T17:57:08.698 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T17:57:08.699 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T17:57:08.700 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.701 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T17:57:08.702 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T17:57:08.703 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T17:57:08.704 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T17:57:08.705 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T17:57:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T17:57:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T17:57:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T17:57:08.706 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T17:57:08.712 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T17:57:08.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 Processor -- start 2023-12-19T17:57:08.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 -- start start 2023-12-19T17:57:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01987db0 0x559e01a59330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e019cc490 0x559e01a57660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 0x559e01a55d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e018d1250 con 0x559e01987db0 2023-12-19T17:57:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e018d0ef0 con 0x559e01a587a0 2023-12-19T17:57:08.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.776+0000 7f1a8f9dd140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e018a7240 con 0x559e019cc490 2023-12-19T17:57:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8d512700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01987db0 0x559e01a59330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 0x559e01a55d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 0x559e01a55d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:44116/0 (socket says 172.21.15.45:44116) 2023-12-19T17:57:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 -- 172.21.15.45:0/3922700067 learned_addr learned my addr 172.21.15.45:0/3922700067 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e019cc490 0x559e01a57660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 -- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e019cc490 msgr2=0x559e01a57660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e019cc490 0x559e01a57660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 -- 172.21.15.45:0/3922700067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01987db0 msgr2=0x559e01a59330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01987db0 0x559e01a59330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 -- 172.21.15.45:0/3922700067 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a88005d20 con 0x559e01a587a0 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8d512700 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01987db0 0x559e01a59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 0x559e01a55d40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800ac00 tx=0x7f1a8800d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12c3991983e2a2c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a7f7fe700 1 -- 172.21.15.45:0/3922700067 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88008b60 con 0x559e01a587a0 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a7f7fe700 1 -- 172.21.15.45:0/3922700067 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88008ce0 con 0x559e01a587a0 2023-12-19T17:57:08.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a7f7fe700 1 -- 172.21.15.45:0/3922700067 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a8801c650 con 0x559e01a587a0 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 msgr2=0x559e01a55d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 0x559e01a55d40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800ac00 tx=0x7f1a8800d000 comp rx=0 tx=0).stop 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/3922700067 shutdown_connections 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e01a587a0 0x559e01a55d40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e019cc490 0x559e01a57660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/3922700067 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01987db0 0x559e01a59330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/3922700067 >> 172.21.15.45:0/3922700067 conn(0x559e01986b80 msgr2=0x559e01a5bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/3922700067 shutdown_connections 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.780+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/3922700067 wait complete. 2023-12-19T17:57:08.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 Processor -- start 2023-12-19T17:57:08.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 -- start start 2023-12-19T17:57:08.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e01987db0 0x559e019c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e019cc490 0x559e01a3c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 0x559e01a3c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e019c79c0 con 0x559e01a587a0 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e01a3d7e0 con 0x559e019cc490 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8f9dd140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559e01a3d000 con 0x559e01987db0 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8dd13700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 0x559e01a3c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8dd13700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 0x559e01a3c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42624/0 (socket says 172.21.15.45:42624) 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 learned_addr learned my addr 172.21.15.45:0/2003064432 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e019cc490 0x559e01a3c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.784+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e01987db0 0x559e019c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e01987db0 msgr2=0x559e019c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559e01987db0 0x559e019c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e019cc490 msgr2=0x559e01a3c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559e019cc490 0x559e01a3c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a8000b320 con 0x559e01a587a0 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 0x559e01a3c810 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800a4f0 tx=0x7f1a88003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a7e7fc700 1 -- 172.21.15.45:0/2003064432 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88012bd0 con 0x559e01a587a0 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a7e7fc700 1 -- 172.21.15.45:0/2003064432 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88012d30 con 0x559e01a587a0 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a7e7fc700 1 -- 172.21.15.45:0/2003064432 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88012ea0 con 0x559e01a587a0 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559e018d9610 con 0x559e01a587a0 2023-12-19T17:57:08.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.788+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559e018bf470 con 0x559e01a587a0 2023-12-19T17:57:08.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.792+0000 7f1a7e7fc700 1 -- 172.21.15.45:0/2003064432 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a88019030 con 0x559e01a587a0 2023-12-19T17:57:08.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.792+0000 7f1a7e7fc700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a70064400 0x7f1a700668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.792+0000 7f1a7e7fc700 1 -- 172.21.15.45:0/2003064432 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f1a88084b20 con 0x559e01a587a0 2023-12-19T17:57:08.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.792+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a70064400 0x7f1a700668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.799 INFO:teuthology.orchestra.run.smithi045.stdout:Warning: using slow linear search 2023-12-19T17:57:08.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.792+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559e019c5f00 0x559e019c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.792+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 8.0 8:00000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x559e019c5f00 2023-12-19T17:57:08.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559e019c5f00 0x559e019c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a70064400 0x7f1a700668c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1a80005780 tx=0x7f1a80005d80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559e019c5f00 0x559e019c8a50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f1a84011a70 0x7f1a8400e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:2 8.10 8:08000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84011a70 2023-12-19T17:57:08.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.796+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f1a84011a70 0x7f1a8400e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f1a84011a70 0x7f1a8400e300 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 67 out=177b] v66'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f1a80021040 0x7f1a80014930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:3 8.8 8:10000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a80021040 2023-12-19T17:57:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f1a80021040 0x7f1a80014930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f1a80021040 0x7f1a80014930 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(3 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f1a8401d7d0 0x7f1a8400b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.800+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:4 8.18 8:18000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.804+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f1a8401d7d0 0x7f1a8400b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.804+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f1a8401d7d0 0x7f1a8400b270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.808+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(4 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.808+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:5 8.4 8:20000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a80021040 2023-12-19T17:57:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(5 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:6 8.14 8:28000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(6 [pgnls start_epoch 67 out=149b] v66'92 uv92 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f1a88036060 0x7f1a88056890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 8.c 8:30000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88036060 2023-12-19T17:57:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f1a88036060 0x7f1a88056890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.812+0000 7f1a8d512700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f1a88036060 0x7f1a88056890 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(7 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:8 8.1c 8:38000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a80021040 2023-12-19T17:57:08.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(8 [pgnls start_epoch 67 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 8.2 8:40000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(9 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f1a88056160 0x7f1a8806d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.820+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:10 8.12 8:48000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88056160 2023-12-19T17:57:08.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.824+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f1a88056160 0x7f1a8806d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.824+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f1a88056160 0x7f1a8806d0c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.828+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(10 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a88056160 2023-12-19T17:57:08.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.828+0000 7f1a8cd11700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f1a84024950 0x7f1a84023450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:08.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.828+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:11 8.a 8:50000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84024950 2023-12-19T17:57:08.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.828+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f1a84024950 0x7f1a84023450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:08.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.832+0000 7f1a8dd13700 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f1a84024950 0x7f1a84023450 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.836+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(11 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a84024950 2023-12-19T17:57:08.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.836+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 8.1a 8:58000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88036060 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.836+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(12 [pgnls start_epoch 67 out=49b] v62'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.836+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 8.6 8:60000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88036060 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(13 [pgnls start_epoch 67 out=77b] v66'21 uv21 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 8.16 8:68000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x559e019c5f00 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(14 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:15 8.e 8:70000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88036060 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(15 [pgnls start_epoch 67 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:16 8.1e 8:78000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x559e019c5f00 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(16 [pgnls start_epoch 67 out=49b] v62'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:17 8.1 8:80000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84024950 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(17 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a84024950 2023-12-19T17:57:08.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.840+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:18 8.11 8:88000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a80021040 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(18 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:19 8.9 8:90000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88056160 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(19 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a88056160 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:20 8.19 8:98000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a80021040 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(20 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:21 8.5 8:a0000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88056160 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(21 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a88056160 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.844+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 8.15 8:a8000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84011a70 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.848+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(22 [pgnls start_epoch 67 out=97b] v62'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.848+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:23 8.d 8:b0000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a80021040 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.848+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(23 [pgnls start_epoch 67 out=74b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.848+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:24 8.1d 8:b8000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88036060 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.848+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(24 [pgnls start_epoch 67 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.848+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:25 8.3 8:c0000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84024950 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(25 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a84024950 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 8.13 8:c8000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x559e019c5f00 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(26 [pgnls start_epoch 67 out=98b] v66'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 8.b 8:d0000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x559e019c5f00 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(27 [pgnls start_epoch 67 out=76b] v66'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:28 8.1b 8:d8000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(28 [pgnls start_epoch 67 out=49b] v62'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:29 8.7 8:e0000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84024950 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(29 [pgnls start_epoch 67 out=73b] v62'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a84024950 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.852+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 8.17 8:e8000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a84011a70 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(30 [pgnls start_epoch 67 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:31 8.f 8:f0000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x559e019c5f00 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(31 [pgnls start_epoch 67 out=73b] v62'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 8.1f 8:f8000000:%01:::head [pgnls start_epoch 67 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e67) v8 -- 0x559e019c8f90 con 0x7f1a88036060 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(32 [pgnls start_epoch 67 out=101b] v66'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 8.10 8:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01af1500 con 0x7f1a84011a70 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:34 8.10 8:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afacc0 con 0x7f1a84011a70 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:35 8.10 8:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afb560 con 0x7f1a84011a70 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:36 8.10 8:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afbe00 con 0x7f1a84011a70 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:37 8.10 8:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afc6a0 con 0x7f1a84011a70 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:38 8.14 8:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afcf40 con 0x7f1a8401d7d0 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:39 8.14 8:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afd7e0 con 0x7f1a8401d7d0 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:40 8.14 8:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afe080 con 0x7f1a8401d7d0 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:41 8.14 8:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01afe920 con 0x7f1a8401d7d0 2023-12-19T17:57:08.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:42 8.1c 8:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01aff1c0 con 0x7f1a80021040 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:43 8.6 8:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01affa60 con 0x7f1a88036060 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:44 8.e 8:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b00300 con 0x7f1a88036060 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:45 8.15 8:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b00e00 con 0x7f1a84011a70 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:46 8.15 8:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b018e0 con 0x7f1a84011a70 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:47 8.d 8:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b02180 con 0x7f1a80021040 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.856+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 8.1d 8:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b018e0 con 0x7f1a88036060 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.860+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(44 608.00000000 [delete] v67'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.860+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:49 8.13 8:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b018e0 con 0x559e019c5f00 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.860+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(48 605.00000000 [delete] v67'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.860+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:50 8.13 8:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b02ab0 con 0x559e019c5f00 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(38 1.00000000.inode [delete] v67'93 uv93 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v67'22 uv22 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:51 8.b 8:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01aff570 con 0x559e019c5f00 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:52 8.7 8:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b033d0 con 0x7f1a84024950 2023-12-19T17:57:08.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(39 200.00000000 [delete] v67'94 uv94 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:53 8.f 8:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b037d0 con 0x559e019c5f00 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(33 601.00000000 [delete] v67'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(45 604.00000000 [delete] v67'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:54 8.1f 8:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b008a0 con 0x7f1a88036060 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:55 8.1f 8:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e67) v8 -- 0x559e01b041a0 con 0x7f1a88036060 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(42 607.00000000 [delete] v67'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(40 200.00000001 [delete] v67'95 uv95 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.864+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(41 606.00000000 [delete] v67'96 uv96 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a8401d7d0 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(49 mds0_inotable [delete] v67'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(50 100.00000000 [delete] v67'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(46 500.00000000 [delete] v67'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(47 mds_snaptable [delete] v67'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a8400f840 con 0x7f1a80021040 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(34 602.00000000 [delete] v67'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(35 10000000000.00000000 [delete] v67'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(36 600.00000000 [delete] v67'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(53 400.00000000 [delete] v67'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8cd11700 1 -- 172.21.15.45:0/2003064432 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(51 mds0_sessionmap [delete] v67'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f1a8400f840 con 0x559e019c5f00 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(37 603.00000000 [delete] v67'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a84011a70 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(54 100.00000000.inode [delete] v67'7 uv7 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(52 609.00000000 [delete] v67'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f1a88082d90 con 0x7f1a84024950 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8d512700 1 -- 172.21.15.45:0/2003064432 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(55 1.00000000 [delete] v67'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f1a800139b0 con 0x7f1a88036060 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stdout:Removed 23 objects 2023-12-19T17:57:08.990 INFO:teuthology.orchestra.run.smithi045.stdout:successfully purged pool cephfs_metadata 2023-12-19T17:57:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f1a88036060 msgr2=0x7f1a88056890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f1a88036060 0x7f1a88056890 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f1a84024950 msgr2=0x7f1a84023450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f1a84024950 0x7f1a84023450 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559e019c5f00 msgr2=0x559e019c8a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559e019c5f00 0x559e019c8a50 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f1a8401d7d0 msgr2=0x7f1a8400b270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7f1a8401d7d0 0x7f1a8400b270 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f1a80021040 msgr2=0x7f1a80014930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f1a80021040 0x7f1a80014930 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f1a88056160 msgr2=0x7f1a8806d0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f1a88056160 0x7f1a8806d0c0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f1a84011a70 msgr2=0x7f1a8400e300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f1a84011a70 0x7f1a8400e300 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 reap_dead start 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 reap_dead start 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8dd13700 1 -- 172.21.15.45:0/2003064432 reap_dead start 2023-12-19T17:57:08.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a70064400 msgr2=0x7f1a700668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a70064400 0x7f1a700668c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f1a80005780 tx=0x7f1a80005d80 comp rx=0 tx=0).stop 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 msgr2=0x559e01a3c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 0x559e01a3c810 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800a4f0 tx=0x7f1a88003020 comp rx=0 tx=0).stop 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 shutdown_connections 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a70064400 0x7f1a700668c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 --2- 172.21.15.45:0/2003064432 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559e01a587a0 0x559e01a3c810 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 >> 172.21.15.45:0/2003064432 conn(0x559e01986b80 msgr2=0x559e019af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 shutdown_connections 2023-12-19T17:57:08.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:08.868+0000 7f1a8f9dd140 1 -- 172.21.15.45:0/2003064432 wait complete. 2023-12-19T17:57:08.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2023-12-19T17:57:09.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.188+0000 7f59ce839700 1 Processor -- start 2023-12-19T17:57:09.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.188+0000 7f59ce839700 1 -- start start 2023-12-19T17:57:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce839700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c815cf20 0x7f59c80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce839700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59c80b8580 0x7f59c80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce839700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59c815d300 con 0x7f59c80d25f0 2023-12-19T17:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce839700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59c80d1550 con 0x7f59c80b8580 2023-12-19T17:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce839700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c80d1830 con 0x7f59c815cf20 2023-12-19T17:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cd036700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59c80b8580 0x7f59c80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce038700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f59c80d25f0 0x7f59c806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53452/0 (socket says 172.21.15.45:53452) 2023-12-19T17:57:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59ce038700 1 -- 172.21.15.45:0/3471185844 learned_addr learned my addr 172.21.15.45:0/3471185844 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cd837700 1 --2- 172.21.15.45:0/3471185844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c815cf20 0x7f59c80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cd036700 1 -- 172.21.15.45:0/3471185844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c815cf20 msgr2=0x7f59c80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cd036700 1 --2- 172.21.15.45:0/3471185844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c815cf20 0x7f59c80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cc835700 1 -- 172.21.15.45:0/3471185844 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4181138881 0 0) 0x7f59c815d300 con 0x7f59c80d25f0 2023-12-19T17:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cd036700 1 -- 172.21.15.45:0/3471185844 >> v1:172.21.15.45:6789/0 conn(0x7f59c80d25f0 legacy=0x7f59c806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.192+0000 7f59cd036700 1 -- 172.21.15.45:0/3471185844 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c80d1b10 con 0x7f59c80b8580 2023-12-19T17:57:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59cd036700 1 --2- 172.21.15.45:0/3471185844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80b8580 0x7f59c80cd8c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009850 tx=0x7f59b8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82854b77f0284877 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59cc835700 1 -- 172.21.15.45:0/3471185844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011830 con 0x7f59c80b8580 2023-12-19T17:57:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59cc835700 1 -- 172.21.15.45:0/3471185844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b8011990 con 0x7f59c80b8580 2023-12-19T17:57:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59cc835700 1 -- 172.21.15.45:0/3471185844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8011d40 con 0x7f59c80b8580 2023-12-19T17:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 -- 172.21.15.45:0/3471185844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80b8580 msgr2=0x7f59c80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 --2- 172.21.15.45:0/3471185844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80b8580 0x7f59c80cd8c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009850 tx=0x7f59b8009b60 comp rx=0 tx=0).stop 2023-12-19T17:57:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 -- 172.21.15.45:0/3471185844 shutdown_connections 2023-12-19T17:57:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 --2- 172.21.15.45:0/3471185844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80b8580 0x7f59c80cd8c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 --2- 172.21.15.45:0/3471185844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c815cf20 0x7f59c80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 -- 172.21.15.45:0/3471185844 >> 172.21.15.45:0/3471185844 conn(0x7f59c80b4670 msgr2=0x7f59c80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 -- 172.21.15.45:0/3471185844 shutdown_connections 2023-12-19T17:57:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.196+0000 7f59ce839700 1 -- 172.21.15.45:0/3471185844 wait complete. 2023-12-19T17:57:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 Processor -- start 2023-12-19T17:57:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 -- start start 2023-12-19T17:57:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c80b8580 0x7f59c815d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 0x7f59c80aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c815cf20 0x7f59c81f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81f6350 con 0x7f59c80d25f0 2023-12-19T17:57:09.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c815de10 con 0x7f59c815cf20 2023-12-19T17:57:09.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce839700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59c81f6580 con 0x7f59c80b8580 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 0x7f59c80aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 0x7f59c80aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42648/0 (socket says 172.21.15.45:42648) 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 -- 172.21.15.45:0/2119984014 learned_addr learned my addr 172.21.15.45:0/2119984014 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd837700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c80b8580 0x7f59c815d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59ce038700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c815cf20 0x7f59c81f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 -- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c80b8580 msgr2=0x7f59c815d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c80b8580 0x7f59c815d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 -- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c815cf20 msgr2=0x7f59c81f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c815cf20 0x7f59c81f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 -- 172.21.15.45:0/2119984014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80094b0 con 0x7f59c80d25f0 2023-12-19T17:57:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.200+0000 7f59cd036700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 0x7f59c80aaf10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000c00 tx=0x7f59b8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:09.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8019a00 con 0x7f59c80d25f0 2023-12-19T17:57:09.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59b801e070 con 0x7f59c80d25f0 2023-12-19T17:57:09.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c81f6860 con 0x7f59c80d25f0 2023-12-19T17:57:09.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59b8019da0 con 0x7f59c80d25f0 2023-12-19T17:57:09.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c815b260 con 0x7f59c80d25f0 2023-12-19T17:57:09.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c81f6d80 con 0x7f59c80d25f0 2023-12-19T17:57:09.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.204+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59b802d450 con 0x7f59c80d25f0 2023-12-19T17:57:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.208+0000 7f59be7fc700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59ac065ad0 0x7f59ac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.208+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f59b8084550 con 0x7f59c80d25f0 2023-12-19T17:57:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.208+0000 7f59cd837700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59ac065ad0 0x7f59ac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.208+0000 7f59cd837700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59ac065ad0 0x7f59ac067f90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59c80c95a0 tx=0x7f59c4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:09.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.216+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f59b8051b50 con 0x7f59c80d25f0 2023-12-19T17:57:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.420+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f59c815dfd0 con 0x7f59c80d25f0 2023-12-19T17:57:09.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.476+0000 7f59be7fc700 1 -- 172.21.15.45:0/2119984014 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 107+0+0 (secure 0 0 0) 0x7f59b8055170 con 0x7f59c80d25f0 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.480+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59ac065ad0 msgr2=0x7f59ac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59ac065ad0 0x7f59ac067f90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f59c80c95a0 tx=0x7f59c4009240 comp rx=0 tx=0).stop 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 msgr2=0x7f59c80aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 0x7f59c80aaf10 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f59b8000c00 tx=0x7f59b8004770 comp rx=0 tx=0).stop 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 shutdown_connections 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59ac065ad0 0x7f59ac067f90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59c815cf20 0x7f59c81f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59c80d25f0 0x7f59c80aaf10 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 --2- 172.21.15.45:0/2119984014 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59c80b8580 0x7f59c815d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 >> 172.21.15.45:0/2119984014 conn(0x7f59c80b4670 msgr2=0x7f59c815c0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:09.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 shutdown_connections 2023-12-19T17:57:09.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.484+0000 7f59ce839700 1 -- 172.21.15.45:0/2119984014 wait complete. 2023-12-19T17:57:09.498 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T17:57:09.492+0000 7f6cc20ff700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:57:09.499 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T17:57:09.492+0000 7f6cc20ff700 -1 mds.0.inotable: load_2 could not read table: -2 2023-12-19T17:57:09.499 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T17:57:09.492+0000 7f6cc20ff700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2023-12-19T17:57:09.501 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:57:09.496+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:57:09.501 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:57:09.496+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-12-19T17:57:09.514 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-12-19T17:57:09.519 INFO:tasks.ceph.mds.c.smithi045.stderr: -37> 2023-12-19T17:57:09.492+0000 7f6cc20ff700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:57:09.519 INFO:tasks.ceph.mds.c.smithi045.stderr: -23> 2023-12-19T17:57:09.492+0000 7f6cc20ff700 -1 mds.0.inotable: load_2 could not read table: -2 2023-12-19T17:57:09.519 INFO:tasks.ceph.mds.c.smithi045.stderr: -21> 2023-12-19T17:57:09.492+0000 7f6cc20ff700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds0_inotable' -2 ((2) No such file or directory) 2023-12-19T17:57:09.569 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:57:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.684+0000 7fbc2af46700 1 Processor -- start 2023-12-19T17:57:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.684+0000 7fbc2af46700 1 -- start start 2023-12-19T17:57:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc2af46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc2415d090 0x7fbc240d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc2af46700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc240cdff0 0x7fbc240cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc2af46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc240d01e0 con 0x7fbc240cfd70 2023-12-19T17:57:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc2af46700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc240b6040 con 0x7fbc240cdff0 2023-12-19T17:57:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc2af46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240d10e0 con 0x7fbc2415d090 2023-12-19T17:57:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc23fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc240cdff0 0x7fbc240cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc294e3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbc240cfd70 0x7fbc2406ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53472/0 (socket says 172.21.15.45:53472) 2023-12-19T17:57:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc294e3700 1 -- 172.21.15.45:0/2202474766 learned_addr learned my addr 172.21.15.45:0/2202474766 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc28ce2700 1 --2- 172.21.15.45:0/2202474766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc2415d090 0x7fbc240d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc237fe700 1 -- 172.21.15.45:0/2202474766 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815957512 0 0) 0x7fbc1c001490 con 0x7fbc240cfd70 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc23fff700 1 -- 172.21.15.45:0/2202474766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc2415d090 msgr2=0x7fbc240d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2202474766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc2415d090 0x7fbc240d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.688+0000 7fbc23fff700 1 -- 172.21.15.45:0/2202474766 >> v1:172.21.15.45:6789/0 conn(0x7fbc240cfd70 legacy=0x7fbc2406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc23fff700 1 -- 172.21.15.45:0/2202474766 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc240d13c0 con 0x7fbc240cdff0 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc23fff700 1 --2- 172.21.15.45:0/2202474766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240cdff0 0x7fbc240cf830 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009850 tx=0x7fbc10009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d231981623510a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc237fe700 1 -- 172.21.15.45:0/2202474766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10011830 con 0x7fbc240cdff0 2023-12-19T17:57:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc237fe700 1 -- 172.21.15.45:0/2202474766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc10011990 con 0x7fbc240cdff0 2023-12-19T17:57:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc237fe700 1 -- 172.21.15.45:0/2202474766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc10011d40 con 0x7fbc240cdff0 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 -- 172.21.15.45:0/2202474766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240cdff0 msgr2=0x7fbc240cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 --2- 172.21.15.45:0/2202474766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240cdff0 0x7fbc240cf830 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fbc10009850 tx=0x7fbc10009b60 comp rx=0 tx=0).stop 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 -- 172.21.15.45:0/2202474766 shutdown_connections 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 --2- 172.21.15.45:0/2202474766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc240cdff0 0x7fbc240cf830 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 --2- 172.21.15.45:0/2202474766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc2415d090 0x7fbc240d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 -- 172.21.15.45:0/2202474766 >> 172.21.15.45:0/2202474766 conn(0x7fbc240b4b90 msgr2=0x7fbc240b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 -- 172.21.15.45:0/2202474766 shutdown_connections 2023-12-19T17:57:09.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.692+0000 7fbc2af46700 1 -- 172.21.15.45:0/2202474766 wait complete. 2023-12-19T17:57:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 Processor -- start 2023-12-19T17:57:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 -- start start 2023-12-19T17:57:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240cdff0 0x7fbc241503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240cfd70 0x7fbc240b2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 0x7fbc240b34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240c8060 con 0x7fbc2415d090 2023-12-19T17:57:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240c9c20 con 0x7fbc240cdff0 2023-12-19T17:57:09.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc2af46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc240c9010 con 0x7fbc240cfd70 2023-12-19T17:57:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 0x7fbc240b34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 0x7fbc240b34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42680/0 (socket says 172.21.15.45:42680) 2023-12-19T17:57:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 -- 172.21.15.45:0/1361090582 learned_addr learned my addr 172.21.15.45:0/1361090582 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc23fff700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240cfd70 0x7fbc240b2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc28ce2700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240cdff0 0x7fbc241503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 -- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240cfd70 msgr2=0x7fbc240b2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240cfd70 0x7fbc240b2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 -- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240cdff0 msgr2=0x7fbc241503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240cdff0 0x7fbc241503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.696+0000 7fbc294e3700 1 -- 172.21.15.45:0/1361090582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc100094b0 con 0x7fbc2415d090 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc294e3700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 0x7fbc240b34a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00ccd0 tx=0x7fbc1c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00ad40 con 0x7fbc2415d090 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc1c0070d0 con 0x7fbc2415d090 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc1c00aea0 con 0x7fbc2415d090 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc240c92f0 con 0x7fbc2415d090 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc240c98b0 con 0x7fbc2415d090 2023-12-19T17:57:09.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2404ed30 con 0x7fbc2415d090 2023-12-19T17:57:09.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.700+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc1c007480 con 0x7fbc2415d090 2023-12-19T17:57:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.704+0000 7fbc217fa700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.704+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fbc1c082fa0 con 0x7fbc2415d090 2023-12-19T17:57:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.704+0000 7fbc28ce2700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.704+0000 7fbc28ce2700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009ae0 tx=0x7fbc18008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:09.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.708+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbc1c050540 con 0x7fbc2415d090 2023-12-19T17:57:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:09.932+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fbc240d01e0 con 0x7fbc2415d090 2023-12-19T17:57:10.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.516+0000 7fbc217fa700 1 -- 172.21.15.45:0/1361090582 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v42) v1 ==== 162+0+0 (secure 0 0 0) 0x7fbc240d01e0 con 0x7fbc2415d090 2023-12-19T17:57:10.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 msgr2=0x7fbc08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fbc18009ae0 tx=0x7fbc18008040 comp rx=0 tx=0).stop 2023-12-19T17:57:10.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 msgr2=0x7fbc240b34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 0x7fbc240b34a0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c00ccd0 tx=0x7fbc1c00a340 comp rx=0 tx=0).stop 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 shutdown_connections 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc08065ad0 0x7fbc08067f90 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc2415d090 0x7fbc240b34a0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc240cfd70 0x7fbc240b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 --2- 172.21.15.45:0/1361090582 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc240cdff0 0x7fbc241503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 >> 172.21.15.45:0/1361090582 conn(0x7fbc240b4b90 msgr2=0x7fbc2406ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 shutdown_connections 2023-12-19T17:57:10.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.520+0000 7fbc2af46700 1 -- 172.21.15.45:0/1361090582 wait complete. 2023-12-19T17:57:10.529 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-12-19T17:57:10.551 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:10.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.752+0000 7ff94359e700 1 Processor -- start 2023-12-19T17:57:10.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.752+0000 7ff94359e700 1 -- start start 2023-12-19T17:57:10.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff9440b88b0 0x7ff94406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:10.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440d1820 con 0x7ff94406ea90 2023-12-19T17:57:10.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9440d1b00 con 0x7ff94406f3b0 2023-12-19T17:57:10.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9440d1630 con 0x7ff9440b88b0 2023-12-19T17:57:10.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff94406ea90 0x7ff9440d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53482/0 (socket says 172.21.15.45:53482) 2023-12-19T17:57:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94259c700 1 -- 172.21.15.45:0/2971722634 learned_addr learned my addr 172.21.15.45:0/2971722634 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff941d9b700 1 --2- 172.21.15.45:0/2971722634 >> v2:172.21.15.73:3300/0 conn(0x7ff9440b88b0 0x7ff94406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94159a700 1 -- 172.21.15.45:0/2971722634 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105884434 0 0) 0x7ff9440d1820 con 0x7ff94406ea90 2023-12-19T17:57:10.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff94159a700 1 -- 172.21.15.45:0/2971722634 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9300035d0 con 0x7ff94406ea90 2023-12-19T17:57:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff941d9b700 1 -- 172.21.15.45:0/2971722634 >> v1:172.21.15.73:6789/0 conn(0x7ff94406f3b0 legacy=0x7ff94406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff941d9b700 1 -- 172.21.15.45:0/2971722634 >> v1:172.21.15.45:6789/0 conn(0x7ff94406ea90 legacy=0x7ff9440d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff941d9b700 1 -- 172.21.15.45:0/2971722634 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9440d1de0 con 0x7ff9440b88b0 2023-12-19T17:57:10.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.756+0000 7ff941d9b700 1 --2- 172.21.15.45:0/2971722634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff94406ee70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009850 tx=0x7ff92c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13246b5f2b78fbbf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94159a700 1 -- 172.21.15.45:0/2971722634 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011830 con 0x7ff9440b88b0 2023-12-19T17:57:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94159a700 1 -- 172.21.15.45:0/2971722634 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff92c011990 con 0x7ff9440b88b0 2023-12-19T17:57:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94159a700 1 -- 172.21.15.45:0/2971722634 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff92c011d40 con 0x7ff9440b88b0 2023-12-19T17:57:10.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 -- 172.21.15.45:0/2971722634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 msgr2=0x7ff94406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 --2- 172.21.15.45:0/2971722634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff94406ee70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7ff92c009850 tx=0x7ff92c009b60 comp rx=0 tx=0).stop 2023-12-19T17:57:10.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 -- 172.21.15.45:0/2971722634 shutdown_connections 2023-12-19T17:57:10.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 --2- 172.21.15.45:0/2971722634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff94406ee70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 -- 172.21.15.45:0/2971722634 >> 172.21.15.45:0/2971722634 conn(0x7ff9440b46d0 msgr2=0x7ff9440b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:10.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 -- 172.21.15.45:0/2971722634 shutdown_connections 2023-12-19T17:57:10.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.760+0000 7ff94359e700 1 -- 172.21.15.45:0/2971722634 wait complete. 2023-12-19T17:57:10.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 Processor -- start 2023-12-19T17:57:10.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 -- start start 2023-12-19T17:57:10.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 0x7ff944159170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:10.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff94406f3b0 0x7ff9441e2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:10.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff9441e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:10.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9441596b0 con 0x7ff94406ea90 2023-12-19T17:57:10.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440c8400 con 0x7ff9440b88b0 2023-12-19T17:57:10.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9440c86e0 con 0x7ff94406f3b0 2023-12-19T17:57:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 0x7ff944159170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 0x7ff944159170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42692/0 (socket says 172.21.15.45:42692) 2023-12-19T17:57:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff94259c700 1 -- 172.21.15.45:0/2155564571 learned_addr learned my addr 172.21.15.45:0/2155564571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff942d9d700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff9441e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.764+0000 7ff941d9b700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff94406f3b0 0x7ff9441e2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:10.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94259c700 1 -- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff94406f3b0 msgr2=0x7ff9441e2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94259c700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff94406f3b0 0x7ff9441e2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94259c700 1 -- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 msgr2=0x7ff9441e29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94259c700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff9441e29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94259c700 1 -- 172.21.15.45:0/2155564571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff92c0094b0 con 0x7ff94406ea90 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff941d9b700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff94406f3b0 0x7ff9441e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff942d9d700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff9441e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:10.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94259c700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 0x7ff944159170 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff93400cbc0 tx=0x7ff93400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:10.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400a9e0 con 0x7ff94406ea90 2023-12-19T17:57:10.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff93400ab40 con 0x7ff94406ea90 2023-12-19T17:57:10.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9440c89c0 con 0x7ff94406ea90 2023-12-19T17:57:10.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93400ce80 con 0x7ff94406ea90 2023-12-19T17:57:10.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9440c8f80 con 0x7ff94406ea90 2023-12-19T17:57:10.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.768+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944067760 con 0x7ff94406ea90 2023-12-19T17:57:10.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.772+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff93401b3b0 con 0x7ff94406ea90 2023-12-19T17:57:10.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.772+0000 7ff93affd700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff924065ad0 0x7ff924067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:10.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.772+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7ff934082f20 con 0x7ff94406ea90 2023-12-19T17:57:10.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.772+0000 7ff941d9b700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff924065ad0 0x7ff924067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:10.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.772+0000 7ff941d9b700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff924065ad0 0x7ff924067f90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0090b0 tx=0x7ff92c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:10.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.776+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff9340505f0 con 0x7ff94406ea90 2023-12-19T17:57:10.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.992+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff944066a60 con 0x7ff94406ea90 2023-12-19T17:57:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.992+0000 7ff93affd700 1 -- 172.21.15.45:0/2155564571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4701 (secure 0 0 0) 0x7ff934053c10 con 0x7ff94406ea90 2023-12-19T17:57:10.998 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:10.998 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6594,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/642740092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":642740092},{"type":"v1","addr":"172.21.15.45:6837","nonce":642740092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:10.511369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:11.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff924065ad0 msgr2=0x7ff924067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff924065ad0 0x7ff924067f90 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff92c0090b0 tx=0x7ff92c008030 comp rx=0 tx=0).stop 2023-12-19T17:57:11.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 msgr2=0x7ff944159170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 0x7ff944159170 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff93400cbc0 tx=0x7ff93400cca0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 shutdown_connections 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff924065ad0 0x7ff924067f90 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff9440b88b0 0x7ff9441e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff94406f3b0 0x7ff9441e2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 --2- 172.21.15.45:0/2155564571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff94406ea90 0x7ff944159170 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 >> 172.21.15.45:0/2155564571 conn(0x7ff9440b46d0 msgr2=0x7ff944071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 shutdown_connections 2023-12-19T17:57:11.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:10.996+0000 7ff94359e700 1 -- 172.21.15.45:0/2155564571 wait complete. 2023-12-19T17:57:11.004 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-12-19T17:57:11.025 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T17:57:11.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.208+0000 7f7983fff700 1 Processor -- start 2023-12-19T17:57:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.208+0000 7f7983fff700 1 -- start start 2023-12-19T17:57:11.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7983fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f798406ea90 0x7f79840d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7983fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b88b0 0x7f79840b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7983fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f79840b6250 0x7f79840b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7983fff700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840d1820 con 0x7f798406ea90 2023-12-19T17:57:11.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7983fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79840d1b00 con 0x7f79840b6250 2023-12-19T17:57:11.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7983fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79840d1de0 con 0x7f79840b88b0 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7982ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f798406ea90 0x7f79840d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7982ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f798406ea90 0x7f79840d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42696/0 (socket says 172.21.15.45:42696) 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f7982ffd700 1 -- 172.21.15.45:0/2210159636 learned_addr learned my addr 172.21.15.45:0/2210159636 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f79827fc700 1 --2- 172.21.15.45:0/2210159636 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b88b0 0x7f79840b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.212+0000 7f79837fe700 1 --2- 172.21.15.45:0/2210159636 >> v2:172.21.15.73:3300/0 conn(0x7f79840b6250 0x7f79840b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7982ffd700 1 -- 172.21.15.45:0/2210159636 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b88b0 msgr2=0x7f79840b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7982ffd700 1 --2- 172.21.15.45:0/2210159636 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b88b0 0x7f79840b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7982ffd700 1 -- 172.21.15.45:0/2210159636 >> v2:172.21.15.73:3300/0 conn(0x7f79840b6250 msgr2=0x7f79840b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7982ffd700 1 --2- 172.21.15.45:0/2210159636 >> v2:172.21.15.73:3300/0 conn(0x7f79840b6250 0x7f79840b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7982ffd700 1 -- 172.21.15.45:0/2210159636 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840d20c0 con 0x7f798406ea90 2023-12-19T17:57:11.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7982ffd700 1 --2- 172.21.15.45:0/2210159636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79840d0f20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f79840cd5f0 tx=0x7f7974009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7e73051f690b788 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:11.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7981ffb700 1 -- 172.21.15.45:0/2210159636 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400b8a0 con 0x7f798406ea90 2023-12-19T17:57:11.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7981ffb700 1 -- 172.21.15.45:0/2210159636 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797400ba00 con 0x7f798406ea90 2023-12-19T17:57:11.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7981ffb700 1 -- 172.21.15.45:0/2210159636 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797400bd90 con 0x7f798406ea90 2023-12-19T17:57:11.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 -- 172.21.15.45:0/2210159636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 msgr2=0x7f79840d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 --2- 172.21.15.45:0/2210159636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79840d0f20 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f79840cd5f0 tx=0x7f7974009bf0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 -- 172.21.15.45:0/2210159636 shutdown_connections 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 --2- 172.21.15.45:0/2210159636 >> v2:172.21.15.73:3300/0 conn(0x7f79840b6250 0x7f79840b66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 --2- 172.21.15.45:0/2210159636 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b88b0 0x7f79840b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 --2- 172.21.15.45:0/2210159636 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79840d0f20 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 -- 172.21.15.45:0/2210159636 >> 172.21.15.45:0/2210159636 conn(0x7f79840b46d0 msgr2=0x7f79840b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 -- 172.21.15.45:0/2210159636 shutdown_connections 2023-12-19T17:57:11.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.216+0000 7f7983fff700 1 -- 172.21.15.45:0/2210159636 wait complete. 2023-12-19T17:57:11.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 Processor -- start 2023-12-19T17:57:11.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 -- start start 2023-12-19T17:57:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79841603b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b6250 0x7f79841f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79840b88b0 0x7f79840cba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798415f660 con 0x7f798406ea90 2023-12-19T17:57:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79840cc880 con 0x7f79840b88b0 2023-12-19T17:57:11.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.220+0000 7f7983fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7984157a00 con 0x7f79840b6250 2023-12-19T17:57:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79841603b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79841603b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42712/0 (socket says 172.21.15.45:42712) 2023-12-19T17:57:11.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 -- 172.21.15.45:0/3426141360 learned_addr learned my addr 172.21.15.45:0/3426141360 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f79827fc700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b6250 0x7f79841f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f79837fe700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79840b88b0 0x7f79840cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 -- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b6250 msgr2=0x7f79841f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b6250 0x7f79841f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 -- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79840b88b0 msgr2=0x7f79840cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79840b88b0 0x7f79840cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 -- 172.21.15.45:0/3426141360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7974009570 con 0x7f798406ea90 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f79827fc700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b6250 0x7f79841f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f79837fe700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79840b88b0 0x7f79840cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7982ffd700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79841603b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7974014040 tx=0x7f7974004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79740038c0 con 0x7f798406ea90 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797401e070 con 0x7f798406ea90 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974003c60 con 0x7f798406ea90 2023-12-19T17:57:11.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798415d330 con 0x7f798406ea90 2023-12-19T17:57:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.224+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79840b4170 con 0x7f798406ea90 2023-12-19T17:57:11.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.228+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7984067760 con 0x7f798406ea90 2023-12-19T17:57:11.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.228+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7974011420 con 0x7f798406ea90 2023-12-19T17:57:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.228+0000 7f796b7fe700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7970065ad0 0x7f7970067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.228+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f7974020070 con 0x7f798406ea90 2023-12-19T17:57:11.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.228+0000 7f79827fc700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7970065ad0 0x7f7970067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.232+0000 7f79827fc700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7970065ad0 0x7f7970067f90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f798415beb0 tx=0x7f7978008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:11.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.236+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f79740523f0 con 0x7f798406ea90 2023-12-19T17:57:11.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.448+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f798415c6d0 con 0x7f798406ea90 2023-12-19T17:57:11.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.448+0000 7f796b7fe700 1 -- 172.21.15.45:0/3426141360 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f7974055a10 con 0x7f798406ea90 2023-12-19T17:57:11.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:11.454 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6594,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/642740092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":642740092},{"type":"v1","addr":"172.21.15.45:6837","nonce":642740092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:10.511369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:11.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.448+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7970065ad0 msgr2=0x7f7970067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7970065ad0 0x7f7970067f90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f798415beb0 tx=0x7f7978008040 comp rx=0 tx=0).stop 2023-12-19T17:57:11.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 msgr2=0x7f79841603b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79841603b0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7974014040 tx=0x7f7974004770 comp rx=0 tx=0).stop 2023-12-19T17:57:11.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 shutdown_connections 2023-12-19T17:57:11.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7970065ad0 0x7f7970067f90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f79840b88b0 0x7f79840cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f79840b6250 0x7f79841f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 --2- 172.21.15.45:0/3426141360 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f798406ea90 0x7f79841603b0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 >> 172.21.15.45:0/3426141360 conn(0x7f79840b46d0 msgr2=0x7f79840b6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 shutdown_connections 2023-12-19T17:57:11.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.452+0000 7f7983fff700 1 -- 172.21.15.45:0/3426141360 wait complete. 2023-12-19T17:57:11.459 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-12-19T17:57:11.478 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:11.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.652+0000 7f9420bfc700 1 Processor -- start 2023-12-19T17:57:11.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.652+0000 7f9420bfc700 1 -- start start 2023-12-19T17:57:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f9420bfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c06cad0 0x7f941c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f9420bfc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f941c0af720 0x7f941c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f9420bfc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c06f0a0 con 0x7f941c15ae20 2023-12-19T17:57:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f9420bfc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0b0110 con 0x7f941c0af720 2023-12-19T17:57:11.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f9420bfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c06ea90 con 0x7f941c06cad0 2023-12-19T17:57:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f941c0af720 0x7f941c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f941c15ae20 0x7f941c0c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:33812/0 (socket says 172.21.15.45:33812) 2023-12-19T17:57:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941b7fe700 1 -- 172.21.15.45:0/253354490 learned_addr learned my addr 172.21.15.45:0/253354490 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f941c0af720 0x7f941c0afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42722/0 (socket says 172.21.15.45:42722) 2023-12-19T17:57:11.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941affd700 1 --2- 172.21.15.45:0/253354490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c06cad0 0x7f941c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941bfff700 1 -- 172.21.15.45:0/253354490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c06cad0 msgr2=0x7f941c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941bfff700 1 --2- 172.21.15.45:0/253354490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c06cad0 0x7f941c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941bfff700 1 -- 172.21.15.45:0/253354490 >> v1:172.21.15.73:6789/0 conn(0x7f941c15ae20 legacy=0x7f941c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941bfff700 1 -- 172.21.15.45:0/253354490 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c3f60 con 0x7f941c0af720 2023-12-19T17:57:11.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.656+0000 7f941a7fc700 1 -- 172.21.15.45:0/253354490 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3173680979 0 0) 0x7f941c06f0a0 con 0x7f941c15ae20 2023-12-19T17:57:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f941bfff700 1 --2- 172.21.15.45:0/253354490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c0af720 0x7f941c0afbd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9414009d90 tx=0x7f941400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cd3996c5caf2a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f941a7fc700 1 -- 172.21.15.45:0/253354490 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941400e070 con 0x7f941c0af720 2023-12-19T17:57:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f941a7fc700 1 -- 172.21.15.45:0/253354490 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941400bb20 con 0x7f941c0af720 2023-12-19T17:57:11.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f941a7fc700 1 -- 172.21.15.45:0/253354490 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9414012430 con 0x7f941c0af720 2023-12-19T17:57:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 -- 172.21.15.45:0/253354490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c0af720 msgr2=0x7f941c0afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 --2- 172.21.15.45:0/253354490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c0af720 0x7f941c0afbd0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9414009d90 tx=0x7f941400b330 comp rx=0 tx=0).stop 2023-12-19T17:57:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 -- 172.21.15.45:0/253354490 shutdown_connections 2023-12-19T17:57:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 --2- 172.21.15.45:0/253354490 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c0af720 0x7f941c0afbd0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 --2- 172.21.15.45:0/253354490 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c06cad0 0x7f941c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 -- 172.21.15.45:0/253354490 >> 172.21.15.45:0/253354490 conn(0x7f941c0cb900 msgr2=0x7f941c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:11.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 -- 172.21.15.45:0/253354490 shutdown_connections 2023-12-19T17:57:11.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.660+0000 7f9420bfc700 1 -- 172.21.15.45:0/253354490 wait complete. 2023-12-19T17:57:11.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 Processor -- start 2023-12-19T17:57:11.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 -- start start 2023-12-19T17:57:11.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 0x7f941c1efc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0af720 0x7f941c0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c15ae20 0x7f941c0ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c144c30 con 0x7f941c06cad0 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c143c60 con 0x7f941c0af720 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f9420bfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c1447a0 con 0x7f941c15ae20 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 0x7f941c1efc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.664+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 0x7f941c1efc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42732/0 (socket says 172.21.15.45:42732) 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 -- 172.21.15.45:0/623635699 learned_addr learned my addr 172.21.15.45:0/623635699 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941affd700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0af720 0x7f941c0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941bfff700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c15ae20 0x7f941c0ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 -- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c15ae20 msgr2=0x7f941c0ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c15ae20 0x7f941c0ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 -- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0af720 msgr2=0x7f941c0cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0af720 0x7f941c0cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 -- 172.21.15.45:0/623635699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9414009a70 con 0x7f941c06cad0 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941affd700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0af720 0x7f941c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f941b7fe700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 0x7f941c1efc40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f940c00c4a0 tx=0x7f940c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c004ca0 con 0x7f941c06cad0 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c143e70 con 0x7f941c06cad0 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c004e00 con 0x7f941c06cad0 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c007310 con 0x7f941c06cad0 2023-12-19T17:57:11.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c144430 con 0x7f941c06cad0 2023-12-19T17:57:11.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.668+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c06f510 con 0x7f941c06cad0 2023-12-19T17:57:11.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.672+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f940c007470 con 0x7f941c06cad0 2023-12-19T17:57:11.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.672+0000 7f9403fff700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9408065ad0 0x7f9408067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:11.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.672+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f940c083300 con 0x7f941c06cad0 2023-12-19T17:57:11.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.672+0000 7f941affd700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9408065ad0 0x7f9408067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:11.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.672+0000 7f941affd700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9408065ad0 0x7f9408067f90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f941c0c6f20 tx=0x7f9410008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:11.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.680+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f941c06f510 con 0x7f941c06cad0 2023-12-19T17:57:11.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.892+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f941c06f510 con 0x7f941c06cad0 2023-12-19T17:57:11.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9403fff700 1 -- 172.21.15.45:0/623635699 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f941c06f510 con 0x7f941c06cad0 2023-12-19T17:57:11.900 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:11.900 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6594,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/642740092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":642740092},{"type":"v1","addr":"172.21.15.45:6837","nonce":642740092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:10.511369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:11.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9408065ad0 msgr2=0x7f9408067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9408065ad0 0x7f9408067f90 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f941c0c6f20 tx=0x7f9410008040 comp rx=0 tx=0).stop 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 msgr2=0x7f941c1efc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 0x7f941c1efc40 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f940c00c4a0 tx=0x7f940c00c860 comp rx=0 tx=0).stop 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 shutdown_connections 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9408065ad0 0x7f9408067f90 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f941c15ae20 0x7f941c0ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941c0af720 0x7f941c0cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 --2- 172.21.15.45:0/623635699 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941c06cad0 0x7f941c1efc40 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 >> 172.21.15.45:0/623635699 conn(0x7f941c0cb900 msgr2=0x7f941c06f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:11.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 shutdown_connections 2023-12-19T17:57:11.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:11.896+0000 7f9420bfc700 1 -- 172.21.15.45:0/623635699 wait complete. 2023-12-19T17:57:11.905 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-12-19T17:57:11.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:12.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfdc08700 1 Processor -- start 2023-12-19T17:57:12.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfdc08700 1 -- start start 2023-12-19T17:57:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfdc08700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815ee20 0x7f7df8165aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfdc08700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df80ce790 con 0x7f7df815abe0 2023-12-19T17:57:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfdc08700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df80b1380 con 0x7f7df815f320 2023-12-19T17:57:12.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfdc08700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df815afc0 con 0x7f7df815ee20 2023-12-19T17:57:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfcc06700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7df815abe0 0x7f7df80b0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53494/0 (socket says 172.21.15.45:53494) 2023-12-19T17:57:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfcc06700 1 -- 172.21.15.45:0/2694380353 learned_addr learned my addr 172.21.15.45:0/2694380353 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.100+0000 7f7dfd407700 1 --2- 172.21.15.45:0/2694380353 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815ee20 0x7f7df8165aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfd407700 1 -- 172.21.15.45:0/2694380353 >> v1:172.21.15.73:6789/0 conn(0x7f7df815f320 legacy=0x7f7df815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfd407700 1 -- 172.21.15.45:0/2694380353 >> v1:172.21.15.45:6789/0 conn(0x7f7df815abe0 legacy=0x7f7df80b0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7def7fe700 1 -- 172.21.15.45:0/2694380353 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961029769 0 0) 0x7f7df80b1380 con 0x7f7df815f320 2023-12-19T17:57:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfd407700 1 -- 172.21.15.45:0/2694380353 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df80b15e0 con 0x7f7df815ee20 2023-12-19T17:57:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfd407700 1 --2- 172.21.15.45:0/2694380353 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815ee20 0x7f7df8165aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009880 tx=0x7f7df0009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5552bba9fff5a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7def7fe700 1 -- 172.21.15.45:0/2694380353 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0004230 con 0x7f7df815ee20 2023-12-19T17:57:12.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7def7fe700 1 -- 172.21.15.45:0/2694380353 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df0004390 con 0x7f7df815ee20 2023-12-19T17:57:12.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7def7fe700 1 -- 172.21.15.45:0/2694380353 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00036c0 con 0x7f7df815ee20 2023-12-19T17:57:12.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2694380353 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815ee20 msgr2=0x7f7df8165aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2694380353 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815ee20 0x7f7df8165aa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009880 tx=0x7f7df0009b90 comp rx=0 tx=0).stop 2023-12-19T17:57:12.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2694380353 shutdown_connections 2023-12-19T17:57:12.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2694380353 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815ee20 0x7f7df8165aa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2694380353 >> 172.21.15.45:0/2694380353 conn(0x7f7df80b2540 msgr2=0x7f7df80b2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2694380353 shutdown_connections 2023-12-19T17:57:12.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.104+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2694380353 wait complete. 2023-12-19T17:57:12.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 Processor -- start 2023-12-19T17:57:12.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 -- start start 2023-12-19T17:57:12.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 0x7f7df80c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df815ee20 0x7f7df80b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815f320 0x7f7df8146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80c9030 con 0x7f7df815abe0 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80c6830 con 0x7f7df815ee20 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.108+0000 7f7dfdc08700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df80b5c00 con 0x7f7df815f320 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 0x7f7df80c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 0x7f7df80c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42740/0 (socket says 172.21.15.45:42740) 2023-12-19T17:57:12.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 -- 172.21.15.45:0/2648538233 learned_addr learned my addr 172.21.15.45:0/2648538233 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfd407700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815f320 0x7f7df8146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7deffff700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df815ee20 0x7f7df80b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 -- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815f320 msgr2=0x7f7df8146610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815f320 0x7f7df8146610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 -- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df815ee20 msgr2=0x7f7df80b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df815ee20 0x7f7df80b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 -- 172.21.15.45:0/2648538233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df00094b0 con 0x7f7df815abe0 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfcc06700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 0x7f7df80c62f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7df4002000 tx=0x7f7df400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400acd0 con 0x7f7df815abe0 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df40020f0 con 0x7f7df815abe0 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df40072f0 con 0x7f7df815abe0 2023-12-19T17:57:12.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df80c8790 con 0x7f7df815abe0 2023-12-19T17:57:12.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df80c8d50 con 0x7f7df815abe0 2023-12-19T17:57:12.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.112+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df8067760 con 0x7f7df815abe0 2023-12-19T17:57:12.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.116+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7df4007450 con 0x7f7df815abe0 2023-12-19T17:57:12.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.116+0000 7f7ded7fa700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7de4065b20 0x7f7de4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.116+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f7df40834c0 con 0x7f7df815abe0 2023-12-19T17:57:12.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.116+0000 7f7deffff700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7de4065b20 0x7f7de4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.120+0000 7f7deffff700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7de4065b20 0x7f7de4067fe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b13c0 tx=0x7f7de8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.120+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7df4050a50 con 0x7f7df815abe0 2023-12-19T17:57:12.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.348+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7df80ce570 con 0x7f7df815abe0 2023-12-19T17:57:12.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.348+0000 7f7ded7fa700 1 -- 172.21.15.45:0/2648538233 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f7df4018020 con 0x7f7df815abe0 2023-12-19T17:57:12.353 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:12.353 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6594,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/642740092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":642740092},{"type":"v1","addr":"172.21.15.45:6837","nonce":642740092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:10.511369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:12.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.348+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7de4065b20 msgr2=0x7f7de4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.348+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7de4065b20 0x7f7de4067fe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7df80b13c0 tx=0x7f7de8009040 comp rx=0 tx=0).stop 2023-12-19T17:57:12.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.348+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 msgr2=0x7f7df80c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.348+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 0x7f7df80c62f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f7df4002000 tx=0x7f7df400a340 comp rx=0 tx=0).stop 2023-12-19T17:57:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 shutdown_connections 2023-12-19T17:57:12.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7de4065b20 0x7f7de4067fe0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7df815f320 0x7f7df8146610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7df815ee20 0x7f7df80b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 --2- 172.21.15.45:0/2648538233 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7df815abe0 0x7f7df80c62f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 >> 172.21.15.45:0/2648538233 conn(0x7f7df80b2540 msgr2=0x7f7df80b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 shutdown_connections 2023-12-19T17:57:12.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.352+0000 7f7dfdc08700 1 -- 172.21.15.45:0/2648538233 wait complete. 2023-12-19T17:57:12.358 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-12-19T17:57:12.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:12.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.548+0000 7f37eb2eb700 1 Processor -- start 2023-12-19T17:57:12.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.548+0000 7f37eb2eb700 1 -- start start 2023-12-19T17:57:12.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.548+0000 7f37eb2eb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37e406cad0 0x7f37e415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.548+0000 7f37eb2eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e40af720 0x7f37e40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.548+0000 7f37eb2eb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e406f0a0 con 0x7f37e415ae20 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.548+0000 7f37eb2eb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e40b0110 con 0x7f37e406cad0 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37eb2eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e406ea90 con 0x7f37e40af720 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37eaaea700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e40af720 0x7f37e40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37e406cad0 0x7f37e415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37ea2e9700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f37e415ae20 0x7f37e40c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:33834/0 (socket says 172.21.15.45:33834) 2023-12-19T17:57:12.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f37e406cad0 0x7f37e415be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47362/0 (socket says 172.21.15.45:47362) 2023-12-19T17:57:12.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37ea2e9700 1 -- 172.21.15.45:0/221888697 learned_addr learned my addr 172.21.15.45:0/221888697 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:12.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 -- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e40af720 msgr2=0x7f37e40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 --2- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e40af720 0x7f37e40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 -- 172.21.15.45:0/221888697 >> v1:172.21.15.73:6789/0 conn(0x7f37e415ae20 legacy=0x7f37e40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 -- 172.21.15.45:0/221888697 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e40c3f60 con 0x7f37e406cad0 2023-12-19T17:57:12.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e9ae8700 1 --2- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e415be40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009850 tx=0x7f37d4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3649ad07e4d7d74c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e92e7700 1 -- 172.21.15.45:0/221888697 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4011830 con 0x7f37e406cad0 2023-12-19T17:57:12.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e92e7700 1 -- 172.21.15.45:0/221888697 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d4011990 con 0x7f37e406cad0 2023-12-19T17:57:12.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37e92e7700 1 -- 172.21.15.45:0/221888697 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4011d40 con 0x7f37e406cad0 2023-12-19T17:57:12.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37eb2eb700 1 -- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 msgr2=0x7f37e415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.552+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e415be40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f37d4009850 tx=0x7f37d4009b60 comp rx=0 tx=0).stop 2023-12-19T17:57:12.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 -- 172.21.15.45:0/221888697 shutdown_connections 2023-12-19T17:57:12.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e40af720 0x7f37e40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/221888697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e415be40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 -- 172.21.15.45:0/221888697 >> 172.21.15.45:0/221888697 conn(0x7f37e40cb900 msgr2=0x7f37e40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 -- 172.21.15.45:0/221888697 shutdown_connections 2023-12-19T17:57:12.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 -- 172.21.15.45:0/221888697 wait complete. 2023-12-19T17:57:12.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 Processor -- start 2023-12-19T17:57:12.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.556+0000 7f37eb2eb700 1 -- start start 2023-12-19T17:57:12.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e414b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 0x7f37e40c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e415ae20 0x7f37e4154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e40c6fa0 con 0x7f37e40af720 2023-12-19T17:57:12.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e414bb90 con 0x7f37e406cad0 2023-12-19T17:57:12.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e40c8260 con 0x7f37e415ae20 2023-12-19T17:57:12.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 0x7f37e40c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 0x7f37e40c7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42748/0 (socket says 172.21.15.45:42748) 2023-12-19T17:57:12.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 -- 172.21.15.45:0/1738702826 learned_addr learned my addr 172.21.15.45:0/1738702826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37ea2e9700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e414b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eaaea700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e415ae20 0x7f37e4154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 -- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e415ae20 msgr2=0x7f37e4154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e415ae20 0x7f37e4154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 -- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 msgr2=0x7f37e414b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e414b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 -- 172.21.15.45:0/1738702826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d40094b0 con 0x7f37e40af720 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eaaea700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e415ae20 0x7f37e4154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37e9ae8700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 0x7f37e40c7d20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f37d40090b0 tx=0x7f37d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4004570 con 0x7f37e40af720 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37d401f070 con 0x7f37e40af720 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4003900 con 0x7f37e40af720 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e40c6470 con 0x7f37e40af720 2023-12-19T17:57:12.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e40c7240 con 0x7f37e40af720 2023-12-19T17:57:12.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.560+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e4067760 con 0x7f37e40af720 2023-12-19T17:57:12.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.564+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f37d4021030 con 0x7f37e40af720 2023-12-19T17:57:12.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.564+0000 7f37daffd700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37c8065ad0 0x7f37c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.564+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f37d4084970 con 0x7f37e40af720 2023-12-19T17:57:12.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.564+0000 7f37ea2e9700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37c8065ad0 0x7f37c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.564+0000 7f37ea2e9700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37c8065ad0 0x7f37c8067f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f37e0005930 tx=0x7f37e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.568+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f37d40520c0 con 0x7f37e40af720 2023-12-19T17:57:12.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.776+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37e40c4730 con 0x7f37e40af720 2023-12-19T17:57:12.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.780+0000 7f37daffd700 1 -- 172.21.15.45:0/1738702826 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) v1 ==== 94+0+4701 (secure 0 0 0) 0x7f37d40556e0 con 0x7f37e40af720 2023-12-19T17:57:12.785 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:12.785 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":42,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6291,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/2972777232","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2972777232},{"type":"v1","addr":"172.21.15.45:6835","nonce":2972777232}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6594,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/642740092","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":642740092},{"type":"v1","addr":"172.21.15.45:6837","nonce":642740092}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":42,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:10.511369+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":68,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37c8065ad0 msgr2=0x7f37c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37c8065ad0 0x7f37c8067f90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f37e0005930 tx=0x7f37e0009040 comp rx=0 tx=0).stop 2023-12-19T17:57:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 msgr2=0x7f37e40c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 0x7f37e40c7d20 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f37d40090b0 tx=0x7f37d4004770 comp rx=0 tx=0).stop 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 shutdown_connections 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f37c8065ad0 0x7f37c8067f90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f37e415ae20 0x7f37e4154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f37e40af720 0x7f37e40c7d20 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 --2- 172.21.15.45:0/1738702826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f37e406cad0 0x7f37e414b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 >> 172.21.15.45:0/1738702826 conn(0x7f37e40cb900 msgr2=0x7f37e40cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 shutdown_connections 2023-12-19T17:57:12.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.784+0000 7f37eb2eb700 1 -- 172.21.15.45:0/1738702826 wait complete. 2023-12-19T17:57:12.790 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 42 2023-12-19T17:57:12.812 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset session 2023-12-19T17:57:12.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 -- start start 2023-12-19T17:57:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 Processor -- start 2023-12-19T17:57:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 0x55c7967b2580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c79670d400 0x55c7967b2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c79670d000 0x55c7967b3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c796743e00 con 0x55c79670d800 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79678ca00 con 0x55c79670d400 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b011a0380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c79678c640 con 0x55c79670d000 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 0x55c7967b2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 0x55c7967b2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42752/0 (socket says 172.21.15.45:42752) 2023-12-19T17:57:12.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b0015b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c79670d000 0x55c7967b3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 -- 172.21.15.45:0/2511578623 learned_addr learned my addr 172.21.15.45:0/2511578623 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff159700 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c79670d400 0x55c7967b2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 -- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c79670d000 msgr2=0x55c7967b3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c79670d000 0x55c7967b3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 -- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c79670d400 msgr2=0x55c7967b2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c79670d400 0x55c7967b2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5aff95a700 1 -- 172.21.15.45:0/2511578623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c79672eb60 con 0x55c79670d800 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.876+0000 7f5b0015b700 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c79670d000 0x55c7967b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5aff95a700 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 0x55c7967b2580 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55c79686cc30 tx=0x55c797584e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3592c2bf1614c276 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5afd155700 1 -- 172.21.15.45:0/2511578623 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c79673d600 con 0x55c79670d800 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5afd155700 1 -- 172.21.15.45:0/2511578623 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c796758900 con 0x55c79670d800 2023-12-19T17:57:12.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5afd155700 1 -- 172.21.15.45:0/2511578623 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c79673d1e0 con 0x55c79670d800 2023-12-19T17:57:12.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c79672e340 con 0x55c79670d800 2023-12-19T17:57:12.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c79672e000 con 0x55c79670d800 2023-12-19T17:57:12.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 4 waiting for MDS map... 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5afd155700 1 -- 172.21.15.45:0/2511578623 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55c796746c40 con 0x55c79670d800 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5afd155700 1 -- 172.21.15.45:0/2511578623 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55c796a04000 con 0x55c79670d800 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 4 Got MDS map 42 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 10 main: main 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 4 main: connecting to RADOS... 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 Processor -- start 2023-12-19T17:57:12.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 -- start start 2023-12-19T17:57:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 0x55c7967b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a06c00 0x55c7967b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a07000 0x55c7967b4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79678c500 con 0x55c796a06800 2023-12-19T17:57:12.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79678c3c0 con 0x55c796a07000 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b011a0380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c79678ca00 con 0x55c796a06c00 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b0015b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 0x55c7967b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.880+0000 7f5b0015b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 0x55c7967b3600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42758/0 (socket says 172.21.15.45:42758) 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 -- 172.21.15.45:0/3399056510 learned_addr learned my addr 172.21.15.45:0/3399056510 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5aff95a700 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a06c00 0x55c7967b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5aff159700 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a07000 0x55c7967b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 -- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a06c00 msgr2=0x55c7967b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a06c00 0x55c7967b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 -- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a07000 msgr2=0x55c7967b4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a07000 0x55c7967b4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 -- 172.21.15.45:0/3399056510 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c79672eea0 con 0x55c796a06800 2023-12-19T17:57:12.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5aff159700 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a07000 0x55c7967b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:12.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b0015b700 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 0x55c7967b3600 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55c796a5a0f0 tx=0x55c7974f4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5c3461e177b642 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5afb151700 1 -- 172.21.15.45:0/3399056510 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c79673d600 con 0x55c796a06800 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5afb151700 1 -- 172.21.15.45:0/3399056510 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c796758900 con 0x55c796a06800 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5afb151700 1 -- 172.21.15.45:0/3399056510 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c79673d1e0 con 0x55c796a06800 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 -- 172.21.15.45:0/3399056510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 msgr2=0x55c7967b3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 0x55c7967b3600 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x55c796a5a0f0 tx=0x55c7974f4c00 comp rx=0 tx=0).stop 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 -- 172.21.15.45:0/3399056510 shutdown_connections 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a07000 0x55c7967b4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a06c00 0x55c7967b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 --2- 172.21.15.45:0/3399056510 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06800 0x55c7967b3600 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 -- 172.21.15.45:0/3399056510 >> 172.21.15.45:0/3399056510 conn(0x55c79670cc00 msgr2=0x55c7967db800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 -- 172.21.15.45:0/3399056510 shutdown_connections 2023-12-19T17:57:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 -- 172.21.15.45:0/3399056510 wait complete. 2023-12-19T17:57:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 Processor -- start 2023-12-19T17:57:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.884+0000 7f5b011a0380 1 -- start start 2023-12-19T17:57:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a06800 0x55c7967b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06c00 0x55c7967b4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a07000 0x55c7967b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79678c280 con 0x55c796a06c00 2023-12-19T17:57:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c79678c140 con 0x55c796a06800 2023-12-19T17:57:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c79678c000 con 0x55c796a07000 2023-12-19T17:57:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06c00 0x55c7967b4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06c00 0x55c7967b4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42774/0 (socket says 172.21.15.45:42774) 2023-12-19T17:57:12.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 -- 172.21.15.45:0/641306006 learned_addr learned my addr 172.21.15.45:0/641306006 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff159700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a07000 0x55c7967b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b0015b700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a06800 0x55c7967b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 -- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a07000 msgr2=0x55c7967b4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a07000 0x55c7967b4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 -- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a06800 msgr2=0x55c7967b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a06800 0x55c7967b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 -- 172.21.15.45:0/641306006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c79672eb60 con 0x55c796a06c00 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b0015b700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c796a06800 0x55c7967b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff159700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c796a07000 0x55c7967b4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5aff95a700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06c00 0x55c7967b4c00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x55c796a5ad20 tx=0x55c797584cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5af994e700 1 -- 172.21.15.45:0/641306006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c79673cf20 con 0x55c796a06c00 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5af994e700 1 -- 172.21.15.45:0/641306006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c7974ed380 con 0x55c796a06c00 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c79672e340 con 0x55c796a06c00 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5af994e700 1 -- 172.21.15.45:0/641306006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c79673d600 con 0x55c796a06c00 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c79672e000 con 0x55c796a06c00 2023-12-19T17:57:12.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.888+0000 7f5b011a0380 4 main: resolving pool 8 2023-12-19T17:57:12.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5af994e700 1 -- 172.21.15.45:0/641306006 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55c79678a840 con 0x55c796a06c00 2023-12-19T17:57:12.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5af994e700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c796a74800 0x55c7967b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5af994e700 1 -- 172.21.15.45:0/641306006 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55c796746a80 con 0x55c796a06c00 2023-12-19T17:57:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5b011a0380 4 main: creating IoCtx.. 2023-12-19T17:57:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5b0015b700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c796a74800 0x55c7967b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5b011a0380 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c796a07400 0x55c7967b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 8.b 8:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55c796a07800 con 0x55c796a07400 2023-12-19T17:57:12.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.892+0000 7f5aff159700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c796a07400 0x55c7967b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b0015b700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c796a74800 0x55c7967b5700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55c796a5a0f0 tx=0x55c797584de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5aff159700 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c796a07400 0x55c7967b4100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5aff159700 1 -- 172.21.15.45:0/641306006 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v68'5 uv5 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x55c7974eab40 con 0x55c796a07400 2023-12-19T17:57:12.903 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:12.903 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T17:57:12.903 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T17:57:12.903 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T17:57:12.903 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:57:12.904 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:12.904 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c796a07400 msgr2=0x55c7967b4100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55c796a07400 0x55c7967b4100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c796a74800 msgr2=0x55c7967b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c796a74800 0x55c7967b5700 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x55c796a5a0f0 tx=0x55c797584de0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06c00 msgr2=0x55c7967b4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 --2- 172.21.15.45:0/641306006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c796a06c00 0x55c7967b4c00 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x55c796a5ad20 tx=0x55c797584cc0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5aff159700 1 -- 172.21.15.45:0/641306006 reap_dead start 2023-12-19T17:57:12.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 shutdown_connections 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.896+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 >> 172.21.15.45:0/641306006 conn(0x55c79670cc00 msgr2=0x55c7967db800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 shutdown_connections 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/641306006 wait complete. 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 msgr2=0x55c7967b2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 0x55c7967b2580 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x55c79686cc30 tx=0x55c797584e40 comp rx=0 tx=0).stop 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 shutdown_connections 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c79670d000 0x55c7967b3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c79670d400 0x55c7967b2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 --2- 172.21.15.45:0/2511578623 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c79670d800 0x55c7967b2580 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 >> 172.21.15.45:0/2511578623 conn(0x55c79670dc00 msgr2=0x55c7967db000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 shutdown_connections 2023-12-19T17:57:12.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.900+0000 7f5b011a0380 1 -- 172.21.15.45:0/2511578623 wait complete. 2023-12-19T17:57:12.912 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'session'] in time 0:00:00.100718, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T17:57:12.913 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset snap 2023-12-19T17:57:12.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.972+0000 7ff3b59b3380 1 -- start start 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.972+0000 7ff3b59b3380 1 Processor -- start 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba31b800 0x55d5ba3c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba31b400 0x55d5ba3c1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 0x55d5ba3c1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39aa00 con 0x55d5ba31b000 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a640 con 0x55d5ba31b400 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a500 con 0x55d5ba31b800 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 0x55d5ba3c1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 0x55d5ba3c1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42778/0 (socket says 172.21.15.45:42778) 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 -- 172.21.15.45:0/2755482222 learned_addr learned my addr 172.21.15.45:0/2755482222 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b416d700 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba31b800 0x55d5ba3c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b396c700 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba31b400 0x55d5ba3c1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 -- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba31b800 msgr2=0x55d5ba3c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba31b800 0x55d5ba3c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 -- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba31b400 msgr2=0x55d5ba3c1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba31b400 0x55d5ba3c1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 -- 172.21.15.45:0/2755482222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5ba33cb60 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b396c700 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba31b400 0x55d5ba3c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b496e700 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 0x55d5ba3c1080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f8bd0 tx=0x55d5bb114d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca0832961844c115 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b1968700 1 -- 172.21.15.45:0/2755482222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d5ba34b080 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b1968700 1 -- 172.21.15.45:0/2755482222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d5ba366900 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b1968700 1 -- 172.21.15.45:0/2755482222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d5ba34b600 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5ba33d1e0 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d5ba33cb60 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 4 waiting for MDS map... 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b1968700 1 -- 172.21.15.45:0/2755482222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d5ba354c40 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b1968700 1 -- 172.21.15.45:0/2755482222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55d5ba35cf00 con 0x55d5ba31b000 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 4 Got MDS map 42 2023-12-19T17:57:12.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 10 main: main 2023-12-19T17:57:12.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.976+0000 7ff3b59b3380 4 main: connecting to RADOS... 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 Processor -- start 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 -- start start 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba351e00 con 0x55d5ba60e400 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a500 con 0x55d5ba60e800 2023-12-19T17:57:12.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a640 con 0x55d5ba60ec00 2023-12-19T17:57:12.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42784/0 (socket says 172.21.15.45:42784) 2023-12-19T17:57:12.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 -- 172.21.15.45:0/3389849247 learned_addr learned my addr 172.21.15.45:0/3389849247 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b416d700 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 -- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 msgr2=0x55d5ba3c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 -- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 msgr2=0x55d5ba3c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 -- 172.21.15.45:0/3389849247 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5ba33c340 con 0x55d5ba60e400 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3b396c700 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f4180 tx=0x55d5bb10ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9e87aa91403636 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3af964700 1 -- 172.21.15.45:0/3389849247 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d5ba34b080 con 0x55d5ba60e400 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3af964700 1 -- 172.21.15.45:0/3389849247 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d5ba606300 con 0x55d5ba60e400 2023-12-19T17:57:12.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.980+0000 7ff3af964700 1 -- 172.21.15.45:0/3389849247 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d5ba34b600 con 0x55d5ba60e400 2023-12-19T17:57:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- 172.21.15.45:0/3389849247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 msgr2=0x55d5ba3c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f4180 tx=0x55d5bb10ac60 comp rx=0 tx=0).stop 2023-12-19T17:57:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- 172.21.15.45:0/3389849247 shutdown_connections 2023-12-19T17:57:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/3389849247 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- 172.21.15.45:0/3389849247 >> 172.21.15.45:0/3389849247 conn(0x55d5ba31ac00 msgr2=0x55d5ba3e9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- 172.21.15.45:0/3389849247 shutdown_connections 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- 172.21.15.45:0/3389849247 wait complete. 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 Processor -- start 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- start start 2023-12-19T17:57:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a3c0 con 0x55d5ba60e400 2023-12-19T17:57:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a280 con 0x55d5ba60e800 2023-12-19T17:57:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b59b3380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5ba39a140 con 0x55d5ba60ec00 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b396c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b396c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42792/0 (socket says 172.21.15.45:42792) 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b396c700 1 -- 172.21.15.45:0/440684712 learned_addr learned my addr 172.21.15.45:0/440684712 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.984+0000 7ff3b416d700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 -- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 msgr2=0x55d5ba3c2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba60ec00 0x55d5ba3c2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 -- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 msgr2=0x55d5ba3c0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba60e800 0x55d5ba3c0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 -- 172.21.15.45:0/440684712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5ba33c000 con 0x55d5ba60e400 2023-12-19T17:57:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b396c700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f4e40 tx=0x55d5bb10ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3ae161700 1 -- 172.21.15.45:0/440684712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d5ba34adc0 con 0x55d5ba60e400 2023-12-19T17:57:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3ae161700 1 -- 172.21.15.45:0/440684712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d5ba606000 con 0x55d5ba60e400 2023-12-19T17:57:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3ae161700 1 -- 172.21.15.45:0/440684712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d5ba34b080 con 0x55d5ba60e400 2023-12-19T17:57:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5ba33cea0 con 0x55d5ba60e400 2023-12-19T17:57:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5ba33d520 con 0x55d5ba60e400 2023-12-19T17:57:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3b59b3380 4 main: resolving pool 8 2023-12-19T17:57:12.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.988+0000 7ff3ae161700 1 -- 172.21.15.45:0/440684712 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55d5ba398840 con 0x55d5ba60e400 2023-12-19T17:57:12.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3ae161700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d5ba762000 0x55d5ba764000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3ae161700 1 -- 172.21.15.45:0/440684712 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d5ba354a80 con 0x55d5ba60e400 2023-12-19T17:57:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b59b3380 4 main: creating IoCtx.. 2023-12-19T17:57:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d5ba60f000 0x55d5ba3c2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b416d700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d5ba762000 0x55d5ba764000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:1 8.d 8:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d5ba60f400 con 0x55d5ba60f000 2023-12-19T17:57:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b396c700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d5ba60f000 0x55d5ba3c2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:12.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b416d700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d5ba762000 0x55d5ba764000 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f80f0 tx=0x55d5bb114c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:12.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.992+0000 7ff3b396c700 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d5ba60f000 0x55d5ba3c2680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b396c700 1 -- 172.21.15.45:0/440684712 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v68'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55d5bb0fab40 con 0x55d5ba60f000 2023-12-19T17:57:13.002 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:13.003 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T17:57:13.003 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:13.003 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d5ba60f000 msgr2=0x55d5ba3c2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d5ba60f000 0x55d5ba3c2680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d5ba762000 msgr2=0x55d5ba764000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d5ba762000 0x55d5ba764000 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f80f0 tx=0x55d5bb114c60 comp rx=0 tx=0).stop 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 msgr2=0x55d5ba3c0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/440684712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba60e400 0x55d5ba3c0b00 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f4e40 tx=0x55d5bb10ac00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b416d700 1 -- 172.21.15.45:0/440684712 reap_dead start 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 shutdown_connections 2023-12-19T17:57:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 >> 172.21.15.45:0/440684712 conn(0x55d5ba31ac00 msgr2=0x55d5ba3e9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 shutdown_connections 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:12.996+0000 7ff3b59b3380 1 -- 172.21.15.45:0/440684712 wait complete. 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 msgr2=0x55d5ba3c1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 0x55d5ba3c1080 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x55d5bb0f8bd0 tx=0x55d5bb114d20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 shutdown_connections 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d5ba31b000 0x55d5ba3c1080 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5ba31b400 0x55d5ba3c1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 --2- 172.21.15.45:0/2755482222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d5ba31b800 0x55d5ba3c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 >> 172.21.15.45:0/2755482222 conn(0x55d5ba31bc00 msgr2=0x55d5ba3e9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 shutdown_connections 2023-12-19T17:57:13.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.000+0000 7ff3b59b3380 1 -- 172.21.15.45:0/2755482222 wait complete. 2023-12-19T17:57:13.013 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'snap'] in time 0:00:00.099992, result: { "result": 0 } 2023-12-19T17:57:13.013 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset inode 2023-12-19T17:57:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 -- start start 2023-12-19T17:57:13.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 Processor -- start 2023-12-19T17:57:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 0x563484f22580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563484e7d400 0x563484f22b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563484e7d000 0x563484f23080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563484eb3e00 con 0x563484e7d800 2023-12-19T17:57:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563484efca00 con 0x563484e7d000 2023-12-19T17:57:13.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.072+0000 7fa767183380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563484efc640 con 0x563484e7d400 2023-12-19T17:57:13.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 0x563484f22580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 0x563484f22580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42820/0 (socket says 172.21.15.45:42820) 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 -- 172.21.15.45:0/2104361593 learned_addr learned my addr 172.21.15.45:0/2104361593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76613e700 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563484e7d000 0x563484f23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76513c700 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563484e7d400 0x563484f22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 -- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563484e7d400 msgr2=0x563484f22b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563484e7d400 0x563484f22b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 -- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563484e7d000 msgr2=0x563484f23080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563484e7d000 0x563484f23080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 -- 172.21.15.45:0/2104361593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563484e9eb60 con 0x563484e7d800 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76513c700 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563484e7d400 0x563484f22b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa76593d700 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 0x563484f22580 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x563484fdcba0 tx=0x563485cfed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43702b8e64b78cd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa763138700 1 -- 172.21.15.45:0/2104361593 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563484ead600 con 0x563484e7d800 2023-12-19T17:57:13.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa763138700 1 -- 172.21.15.45:0/2104361593 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563484ec8180 con 0x563484e7d800 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa763138700 1 -- 172.21.15.45:0/2104361593 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563484ead1e0 con 0x563484e7d800 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563484e9e340 con 0x563484e7d800 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x563484e9e000 con 0x563484e7d800 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 4 waiting for MDS map... 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa763138700 1 -- 172.21.15.45:0/2104361593 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x563484eb6c40 con 0x563484e7d800 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa763138700 1 -- 172.21.15.45:0/2104361593 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x563485d02000 con 0x563484e7d800 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 4 Got MDS map 42 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 10 main: main 2023-12-19T17:57:13.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 4 main: connecting to RADOS... 2023-12-19T17:57:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 1 Processor -- start 2023-12-19T17:57:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.076+0000 7fa767183380 1 -- start start 2023-12-19T17:57:13.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a400 0x563484f23600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a800 0x563484f23b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563484efc500 con 0x56348517ac00 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563484efc3c0 con 0x56348517a400 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563484efca00 con 0x56348517a800 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42824/0 (socket says 172.21.15.45:42824) 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 -- 172.21.15.45:0/390755775 learned_addr learned my addr 172.21.15.45:0/390755775 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76613e700 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a400 0x563484f23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76593d700 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a800 0x563484f23b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 -- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a800 msgr2=0x563484f23b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a800 0x563484f23b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 -- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a400 msgr2=0x563484f23600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a400 0x563484f23600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 -- 172.21.15.45:0/390755775 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563484e9eea0 con 0x56348517ac00 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa76513c700 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24100 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x5634851ce090 tx=0x563485184cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af7fcef121ebd95 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa761134700 1 -- 172.21.15.45:0/390755775 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563484ead600 con 0x56348517ac00 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa761134700 1 -- 172.21.15.45:0/390755775 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563484ec8900 con 0x56348517ac00 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa761134700 1 -- 172.21.15.45:0/390755775 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563484ead1e0 con 0x56348517ac00 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- 172.21.15.45:0/390755775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 msgr2=0x563484f24100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24100 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x5634851ce090 tx=0x563485184cc0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- 172.21.15.45:0/390755775 shutdown_connections 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24100 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a800 0x563484f23b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 --2- 172.21.15.45:0/390755775 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a400 0x563484f23600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- 172.21.15.45:0/390755775 >> 172.21.15.45:0/390755775 conn(0x563484e7cc00 msgr2=0x563484f39800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- 172.21.15.45:0/390755775 shutdown_connections 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.080+0000 7fa767183380 1 -- 172.21.15.45:0/390755775 wait complete. 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 Processor -- start 2023-12-19T17:57:13.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 -- start start 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a400 0x563484f25180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a800 0x563484f24c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563484efc280 con 0x56348517ac00 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563484efc140 con 0x56348517a800 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa767183380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563484efc000 con 0x56348517a400 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42826/0 (socket says 172.21.15.45:42826) 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 -- 172.21.15.45:0/3725482509 learned_addr learned my addr 172.21.15.45:0/3725482509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76613e700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a400 0x563484f25180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76593d700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a800 0x563484f24c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 -- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a400 msgr2=0x563484f25180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a400 0x563484f25180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 -- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a800 msgr2=0x563484f24c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56348517a800 0x563484f24c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76513c700 1 -- 172.21.15.45:0/3725482509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563484e9eb60 con 0x56348517ac00 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.084+0000 7fa76613e700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56348517a400 0x563484f25180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa76513c700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24680 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x5634851ced50 tx=0x563485184c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa75f931700 1 -- 172.21.15.45:0/3725482509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563484eacdc0 con 0x56348517ac00 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa75f931700 1 -- 172.21.15.45:0/3725482509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563485c60a80 con 0x56348517ac00 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa75f931700 1 -- 172.21.15.45:0/3725482509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563484ead600 con 0x56348517ac00 2023-12-19T17:57:13.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563484e9e340 con 0x56348517ac00 2023-12-19T17:57:13.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563484e9e000 con 0x56348517ac00 2023-12-19T17:57:13.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa767183380 4 main: resolving pool 8 2023-12-19T17:57:13.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.088+0000 7fa75f931700 1 -- 172.21.15.45:0/3725482509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x563484efa840 con 0x56348517ac00 2023-12-19T17:57:13.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa75f931700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5634852d0000 0x563484f25700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa75f931700 1 -- 172.21.15.45:0/3725482509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x563484eb6a80 con 0x56348517ac00 2023-12-19T17:57:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa767183380 4 main: creating IoCtx.. 2023-12-19T17:57:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa767183380 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56348517b000 0x563484f24100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa76613e700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5634852d0000 0x563484f25700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 8.13 8:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x56348517b400 con 0x56348517b000 2023-12-19T17:57:13.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa76593d700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56348517b000 0x563484f24100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa76613e700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5634852d0000 0x563484f25700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x563484ed3350 tx=0x563484f53380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.092+0000 7fa76593d700 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56348517b000 0x563484f24100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa76593d700 1 -- 172.21.15.45:0/3725482509 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v68'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x563485cf2b40 con 0x56348517b000 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:13.100 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56348517b000 msgr2=0x563484f24100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56348517b000 0x563484f24100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5634852d0000 msgr2=0x563484f25700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5634852d0000 0x563484f25700 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x563484ed3350 tx=0x563484f53380 comp rx=0 tx=0).stop 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 msgr2=0x563484f24680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/3725482509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56348517ac00 0x563484f24680 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x5634851ced50 tx=0x563485184c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa76513c700 1 -- 172.21.15.45:0/3725482509 reap_dead start 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 shutdown_connections 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 >> 172.21.15.45:0/3725482509 conn(0x563484e7cc00 msgr2=0x563484f39800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 shutdown_connections 2023-12-19T17:57:13.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/3725482509 wait complete. 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 msgr2=0x563484f22580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 0x563484f22580 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x563484fdcba0 tx=0x563485cfed80 comp rx=0 tx=0).stop 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 shutdown_connections 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563484e7d000 0x563484f23080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563484e7d400 0x563484f22b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 --2- 172.21.15.45:0/2104361593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563484e7d800 0x563484f22580 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 >> 172.21.15.45:0/2104361593 conn(0x563484e7dc00 msgr2=0x563484f39000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 shutdown_connections 2023-12-19T17:57:13.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.096+0000 7fa767183380 1 -- 172.21.15.45:0/2104361593 wait complete. 2023-12-19T17:57:13.109 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'inode'] in time 0:00:00.096169, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T17:57:13.109 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2023-12-19T17:57:13.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.172+0000 7f7b936ea380 1 -- start start 2023-12-19T17:57:13.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.172+0000 7f7b936ea380 1 Processor -- start 2023-12-19T17:57:13.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 0x55f880620580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f88057b400 0x55f880620b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f88057b800 0x55f880621080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805b1e00 con 0x55f88057b000 2023-12-19T17:57:13.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa780 con 0x55f88057b400 2023-12-19T17:57:13.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa640 con 0x55f88057b800 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 0x55f880620580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 0x55f880620580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42854/0 (socket says 172.21.15.45:42854) 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 -- 172.21.15.45:0/286164568 learned_addr learned my addr 172.21.15.45:0/286164568 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b916a3700 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f88057b400 0x55f880620b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b926a5700 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f88057b800 0x55f880621080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 -- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f88057b800 msgr2=0x55f880621080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f88057b800 0x55f880621080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 -- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f88057b400 msgr2=0x55f880620b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f88057b400 0x55f880620b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 -- 172.21.15.45:0/286164568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f88059cb60 con 0x55f88057b000 2023-12-19T17:57:13.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 0x55f880620580 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55f8812ead80 tx=0x55f881364000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d42e02c0e444c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b8f69f700 1 -- 172.21.15.45:0/286164568 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805ab080 con 0x55f88057b000 2023-12-19T17:57:13.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b8f69f700 1 -- 172.21.15.45:0/286164568 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8805c6480 con 0x55f88057b000 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f88059d1e0 con 0x55f88057b000 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b8f69f700 1 -- 172.21.15.45:0/286164568 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805ab600 con 0x55f88057b000 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55f88059cb60 con 0x55f88057b000 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.176+0000 7f7b936ea380 4 waiting for MDS map... 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b8f69f700 1 -- 172.21.15.45:0/286164568 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55f8805b4c40 con 0x55f88057b000 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b8f69f700 1 -- 172.21.15.45:0/286164568 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55f8805bcf00 con 0x55f88057b000 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 4 Got MDS map 42 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 10 main: JournalTool::main 2023-12-19T17:57:13.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 4 main: JournalTool: connecting to RADOS... 2023-12-19T17:57:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 Processor -- start 2023-12-19T17:57:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 -- start start 2023-12-19T17:57:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be400 0x55f880621600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 0x55f880621b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa500 con 0x55f8808be800 2023-12-19T17:57:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa3c0 con 0x55f8808be400 2023-12-19T17:57:13.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa640 con 0x55f8808bec00 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b91ea4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 0x55f880621b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b91ea4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 0x55f880621b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42860/0 (socket says 172.21.15.45:42860) 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b91ea4700 1 -- 172.21.15.45:0/3874048901 learned_addr learned my addr 172.21.15.45:0/3874048901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b916a3700 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.180+0000 7f7b926a5700 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be400 0x55f880621600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b91ea4700 1 -- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 msgr2=0x55f880622100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b91ea4700 1 -- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be400 msgr2=0x55f880621600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be400 0x55f880621600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b91ea4700 1 -- 172.21.15.45:0/3874048901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f88059c340 con 0x55f8808be800 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 0x55f880621b80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55f8808c8120 tx=0x55f881364060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a0ccd8a75212e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b8d69b700 1 -- 172.21.15.45:0/3874048901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805ab1e0 con 0x55f8808be800 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b8d69b700 1 -- 172.21.15.45:0/3874048901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f88135ea80 con 0x55f8808be800 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b8d69b700 1 -- 172.21.15.45:0/3874048901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805aaf20 con 0x55f8808be800 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 -- 172.21.15.45:0/3874048901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 msgr2=0x55f880621b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 0x55f880621b80 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x55f8808c8120 tx=0x55f881364060 comp rx=0 tx=0).stop 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 -- 172.21.15.45:0/3874048901 shutdown_connections 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be800 0x55f880621b80 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 --2- 172.21.15.45:0/3874048901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be400 0x55f880621600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 -- 172.21.15.45:0/3874048901 >> 172.21.15.45:0/3874048901 conn(0x55f8808be000 msgr2=0x55f88066b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 -- 172.21.15.45:0/3874048901 shutdown_connections 2023-12-19T17:57:13.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 -- 172.21.15.45:0/3874048901 wait complete. 2023-12-19T17:57:13.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 Processor -- start 2023-12-19T17:57:13.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.184+0000 7f7b936ea380 1 -- start start 2023-12-19T17:57:13.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 0x55f880623180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be800 0x55f880622c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa280 con 0x55f8808be400 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa140 con 0x55f8808be800 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa000 con 0x55f8808bec00 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 0x55f880623180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 0x55f880623180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42874/0 (socket says 172.21.15.45:42874) 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 -- 172.21.15.45:0/4283321084 learned_addr learned my addr 172.21.15.45:0/4283321084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be800 0x55f880622c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b916a3700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 -- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 msgr2=0x55f880622680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 -- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be800 msgr2=0x55f880622c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be800 0x55f880622c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 -- 172.21.15.45:0/4283321084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f88059d1e0 con 0x55f8808be400 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b926a5700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 0x55f880623180 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55f8808c94d0 tx=0x55f881358e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b8be98700 1 -- 172.21.15.45:0/4283321084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805ab1e0 con 0x55f8808be400 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b8be98700 1 -- 172.21.15.45:0/4283321084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f88135e600 con 0x55f8808be400 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b8be98700 1 -- 172.21.15.45:0/4283321084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805aaf20 con 0x55f8808be400 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f88059cb60 con 0x55f8808be400 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f88059c340 con 0x55f8808be400 2023-12-19T17:57:13.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.188+0000 7f7b936ea380 4 main: JournalTool: resolving pool 8 2023-12-19T17:57:13.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b8be98700 1 -- 172.21.15.45:0/4283321084 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55f8805f8840 con 0x55f8808be400 2023-12-19T17:57:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b8be98700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f8808bf400 0x55f880623700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b8be98700 1 -- 172.21.15.45:0/4283321084 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55f8805b4a80 con 0x55f8808be400 2023-12-19T17:57:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b936ea380 4 main: JournalTool: creating IoCtx.. 2023-12-19T17:57:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b936ea380 4 main: Executing for rank 0 2023-12-19T17:57:13.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f8808bf400 0x55f880623700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.192+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f8808bf400 0x55f880623700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55f8808c8120 tx=0x55f881358c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 -- start start 2023-12-19T17:57:13.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 Processor -- start 2023-12-19T17:57:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bfc00 0x55f880622100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f880a2c000 0x55f880621b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 0x55f880621600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fb040 con 0x55f880a2c400 2023-12-19T17:57:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa000 con 0x55f880a2c000 2023-12-19T17:57:13.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b936ea380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8805fa140 con 0x55f8808bfc00 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 0x55f880621600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 0x55f880621600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42878/0 (socket says 172.21.15.45:42878) 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 -- 172.21.15.45:0/872993227 learned_addr learned my addr 172.21.15.45:0/872993227 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b926a5700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bfc00 0x55f880622100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f880a2c000 0x55f880621b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 -- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bfc00 msgr2=0x55f880622100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bfc00 0x55f880622100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 -- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f880a2c000 msgr2=0x55f880621b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f880a2c000 0x55f880621b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f880926b60 con 0x55f880a2c400 2023-12-19T17:57:13.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f880a2c000 0x55f880621b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.196+0000 7f7b916a3700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 0x55f880621600 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55f880997140 tx=0x55f8809dd800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8a9b61cb96e1fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b88e92700 1 -- 172.21.15.45:0/872993227 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805aadc0 con 0x55f880a2c400 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b88e92700 1 -- 172.21.15.45:0/872993227 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f88135f980 con 0x55f880a2c400 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b88e92700 1 -- 172.21.15.45:0/872993227 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f8805aa420 con 0x55f880a2c400 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8809269c0 con 0x55f880a2c400 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55f880926820 con 0x55f880a2c400 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b936ea380 4 waiting for MDS map... 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b88e92700 1 -- 172.21.15.45:0/872993227 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55f8805b48c0 con 0x55f880a2c400 2023-12-19T17:57:13.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b88e92700 1 -- 172.21.15.45:0/872993227 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55f880a23500 con 0x55f880a2c400 2023-12-19T17:57:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b936ea380 4 Got MDS map 42 2023-12-19T17:57:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f880a2c800 0x55f880a4e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 8.f 8:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a2cc00 con 0x55f880a2c800 2023-12-19T17:57:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b926a5700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f880a2c800 0x55f880a4e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.200+0000 7f7b926a5700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f880a2c800 0x55f880a4e000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=fa7777d888e04122 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.204+0000 7f7b926a5700 1 -- 172.21.15.45:0/872993227 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v68'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cb40 con 0x55f880a2c800 2023-12-19T17:57:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.204+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f880a2d000 0x55f880a4e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.204+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:2 8.14 8:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a2d400 con 0x55f880a2d000 2023-12-19T17:57:13.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.204+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f880a2d000 0x55f880a4e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.204+0000 7f7b91ea4700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f880a2d000 0x55f880a4e580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=5bd0424e1c22796 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b91ea4700 1 -- 172.21.15.45:0/872993227 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v68'97 uv97 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cd80 con 0x55f880a2d000 2023-12-19T17:57:13.213 INFO:teuthology.orchestra.run.smithi045.stdout:writing EResetJournal entry 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:3 8.14 8:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a2dc00 con 0x55f880a2d000 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:4 8.1b 8:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a5a000 con 0x55f880a2d000 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 8.b 8:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a5a400 con 0x55f880a2c800 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f880a5a800 0x55f880a4eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:6 8.1f 8:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a5ac00 con 0x55f880a5a800 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 8.1a 8:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a5b000 con 0x55f880a5a800 2023-12-19T17:57:13.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 8.1e 8:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a5b400 con 0x55f880a2c800 2023-12-19T17:57:13.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b926a5700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f880a5a800 0x55f880a4eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.208+0000 7f7b926a5700 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f880a5a800 0x55f880a4eb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=40c0c61a5d19da88 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b91ea4700 1 -- 172.21.15.45:0/872993227 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(3 200.00000001 [delete] v68'98 uv97 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cd80 con 0x55f880a2d000 2023-12-19T17:57:13.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b926a5700 1 -- 172.21.15.45:0/872993227 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(8 200.00000006 [delete] v68'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cb40 con 0x55f880a2c800 2023-12-19T17:57:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b91ea4700 1 -- 172.21.15.45:0/872993227 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(4 200.00000002 [delete] v68'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cd80 con 0x55f880a2d000 2023-12-19T17:57:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b926a5700 1 -- 172.21.15.45:0/872993227 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(5 200.00000003 [delete] v68'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cb40 con 0x55f880a2c800 2023-12-19T17:57:13.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b8768f700 1 -- 172.21.15.45:0/872993227 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 8.14 8:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55f880a2cc00 con 0x55f880a2d000 2023-12-19T17:57:13.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b926a5700 1 -- 172.21.15.45:0/872993227 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(7 200.00000005 [delete] v68'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cb40 con 0x55f880a5a800 2023-12-19T17:57:13.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.212+0000 7f7b926a5700 1 -- 172.21.15.45:0/872993227 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(6 200.00000004 [delete] v68'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cb40 con 0x55f880a5a800 2023-12-19T17:57:13.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b91ea4700 1 -- 172.21.15.45:0/872993227 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v68'99 uv99 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x55f88135cd80 con 0x55f880a2d000 2023-12-19T17:57:13.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 4 Successfully wrote new journal pointer and header for rank 3:0 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f880a5a800 msgr2=0x55f880a4eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f880a5a800 0x55f880a4eb00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f880a2c800 msgr2=0x55f880a4e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f880a2c800 0x55f880a4e000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f880a2d000 msgr2=0x55f880a4e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f880a2d000 0x55f880a4e580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b916a3700 1 -- 172.21.15.45:0/872993227 reap_dead start 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 msgr2=0x55f880621600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 0x55f880621600 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x55f880997140 tx=0x55f8809dd800 comp rx=0 tx=0).stop 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 shutdown_connections 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/872993227 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f880a2c400 0x55f880621600 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 >> 172.21.15.45:0/872993227 conn(0x55f8808bf800 msgr2=0x55f88066c000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 shutdown_connections 2023-12-19T17:57:13.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/872993227 wait complete. 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f8808bf400 msgr2=0x55f880623700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f8808bf400 0x55f880623700 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x55f8808c8120 tx=0x55f881358c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 msgr2=0x55f880623180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 0x55f880623180 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x55f8808c94d0 tx=0x55f881358e40 comp rx=0 tx=0).stop 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 shutdown_connections 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f8808bf400 0x55f880623700 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f8808bec00 0x55f880622680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f8808be800 0x55f880622c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/4283321084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f8808be400 0x55f880623180 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 >> 172.21.15.45:0/4283321084 conn(0x55f8808be000 msgr2=0x55f88066b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 shutdown_connections 2023-12-19T17:57:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/4283321084 wait complete. 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 msgr2=0x55f880620580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 0x55f880620580 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x55f8812ead80 tx=0x55f881364000 comp rx=0 tx=0).stop 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 shutdown_connections 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f88057b800 0x55f880621080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f88057b400 0x55f880620b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 --2- 172.21.15.45:0/286164568 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f88057b000 0x55f880620580 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 >> 172.21.15.45:0/286164568 conn(0x55f88057ac00 msgr2=0x55f88066b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 shutdown_connections 2023-12-19T17:57:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.216+0000 7f7b936ea380 1 -- 172.21.15.45:0/286164568 wait complete. 2023-12-19T17:57:13.230 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.120773, result: writing EResetJournal entry 2023-12-19T17:57:13.230 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init 2023-12-19T17:57:13.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.292+0000 7f9f26bb0840 1 -- start start 2023-12-19T17:57:13.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.292+0000 7f9f26bb0840 1 Processor -- start 2023-12-19T17:57:13.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.292+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484c003400 0x56484c0a8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.292+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 0x56484c0a9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.292+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484c003c00 0x56484c0a9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484c082a00 con 0x56484c003800 2023-12-19T17:57:13.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484c082780 con 0x56484c003c00 2023-12-19T17:57:13.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56484c082640 con 0x56484c003400 2023-12-19T17:57:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 0x56484c0a9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 0x56484c0a9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42896/0 (socket says 172.21.15.45:42896) 2023-12-19T17:57:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 -- 172.21.15.45:0/1335897736 learned_addr learned my addr 172.21.15.45:0/1335897736 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f2536c700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484c003400 0x56484c0a8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 -- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484c003400 msgr2=0x56484c0a8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484c003c00 0x56484c0a9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484c003400 0x56484c0a8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 -- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484c003c00 msgr2=0x56484c0a9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484c003c00 0x56484c0a9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 -- 172.21.15.45:0/1335897736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56484c024b60 con 0x56484c003800 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f2536c700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484c003400 0x56484c0a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484c003c00 0x56484c0a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 0x56484c0a9080 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x56484c1113b0 tx=0x56484cdf8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bba8d307a61d34 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f22b67700 1 -- 172.21.15.45:0/1335897736 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56484c033600 con 0x56484c003800 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f22b67700 1 -- 172.21.15.45:0/1335897736 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56484c04e180 con 0x56484c003800 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f22b67700 1 -- 172.21.15.45:0/1335897736 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56484c0331e0 con 0x56484c003800 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56484c024340 con 0x56484c003800 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56484c024000 con 0x56484c003800 2023-12-19T17:57:13.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 4 waiting for MDS map... 2023-12-19T17:57:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f22b67700 1 -- 172.21.15.45:0/1335897736 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x56484c03cc40 con 0x56484c003800 2023-12-19T17:57:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f22b67700 1 -- 172.21.15.45:0/1335897736 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x56484c2f8000 con 0x56484c003800 2023-12-19T17:57:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 4 Got MDS map 42 2023-12-19T17:57:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.296+0000 7f9f26bb0840 1 Processor -- start 2023-12-19T17:57:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- start start 2023-12-19T17:57:13.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484c082500 con 0x56484cd79000 2023-12-19T17:57:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484c082780 con 0x56484cd78800 2023-12-19T17:57:13.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56484c0823c0 con 0x56484cd78c00 2023-12-19T17:57:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f25b6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42908/0 (socket says 172.21.15.45:42908) 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2031989815 learned_addr learned my addr 172.21.15.45:0/2031989815 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f2536c700 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78c00 msgr2=0x56484c0aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78800 msgr2=0x56484c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2031989815 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56484c024ea0 con 0x56484cd79000 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x56484c2fc840 tx=0x56484c0d92c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7df4598c729e0f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f20b63700 1 -- 172.21.15.45:0/2031989815 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56484c032f20 con 0x56484cd79000 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f20b63700 1 -- 172.21.15.45:0/2031989815 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56484cd7c000 con 0x56484cd79000 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f20b63700 1 -- 172.21.15.45:0/2031989815 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56484c033600 con 0x56484cd79000 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2031989815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 msgr2=0x56484c0aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x56484c2fc840 tx=0x56484c0d92c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2031989815 shutdown_connections 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2031989815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.300+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2031989815 >> 172.21.15.45:0/2031989815 conn(0x56484cd78400 msgr2=0x56484c0d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2031989815 shutdown_connections 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2031989815 wait complete. 2023-12-19T17:57:13.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 Processor -- start 2023-12-19T17:57:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 -- start start 2023-12-19T17:57:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484c082280 con 0x56484cd79000 2023-12-19T17:57:13.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56484c082140 con 0x56484cd78c00 2023-12-19T17:57:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f26bb0840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56484c082000 con 0x56484cd78800 2023-12-19T17:57:13.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f24b6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f24b6b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42924/0 (socket says 172.21.15.45:42924) 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2567759625 learned_addr learned my addr 172.21.15.45:0/2567759625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.304+0000 7f9f2536c700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78800 msgr2=0x56484c0a9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484cd78800 0x56484c0a9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78c00 msgr2=0x56484c0aa100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484cd78c00 0x56484c0aa100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f24b6b700 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56484c024b60 con 0x56484cd79000 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f24b6b700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x56484c2fcab0 tx=0x56484c306c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f1f360700 1 -- 172.21.15.45:0/2567759625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56484c0331e0 con 0x56484cd79000 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f1f360700 1 -- 172.21.15.45:0/2567759625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56484cd7c180 con 0x56484cd79000 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f1f360700 1 -- 172.21.15.45:0/2567759625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56484c032dc0 con 0x56484cd79000 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56484c024340 con 0x56484cd79000 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56484c025520 con 0x56484cd79000 2023-12-19T17:57:13.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.308+0000 7f9f26bb0840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f1f360700 1 -- 172.21.15.45:0/2567759625 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x56484c060840 con 0x56484cd79000 2023-12-19T17:57:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f1f360700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x56484cd79c00 0x56484c0ab700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f1f360700 1 -- 172.21.15.45:0/2567759625 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x56484c03ca80 con 0x56484cd79000 2023-12-19T17:57:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f26bb0840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x56484c458000 0x56484c0aac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56484c458400 con 0x56484c458000 2023-12-19T17:57:13.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x56484cd79c00 0x56484c0ab700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f2536c700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x56484c458000 0x56484c0aac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x56484cd79c00 0x56484c0ab700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x56484c110750 tx=0x56484c307c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f2536c700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x56484c458000 0x56484c0aac00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.312+0000 7f9f2536c700 1 -- 172.21.15.45:0/2567759625 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 160+0+0 (crc 0 0 0) 0x56484cde6b40 con 0x56484c458000 2023-12-19T17:57:13.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.316+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:2 8.14 8:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x56484c458800 con 0x56484c458000 2023-12-19T17:57:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.316+0000 7f9f2536c700 1 -- 172.21.15.45:0/2567759625 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v68'100 uv100 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x56484cde6b40 con 0x56484c458000 2023-12-19T17:57:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.316+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x56484c458c00 0x56484c0ab180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.316+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56484c459000 con 0x56484c458c00 2023-12-19T17:57:13.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.320+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x56484c458c00 0x56484c0ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.320+0000 7f9f25b6d700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x56484c458c00 0x56484c0ab180 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.320+0000 7f9f25b6d700 1 -- 172.21.15.45:0/2567759625 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 162+0+0 (crc 0 0 0) 0x56484cde7200 con 0x56484c458c00 2023-12-19T17:57:13.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.320+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:4 8.1f 8:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x56484c458400 con 0x56484c458c00 2023-12-19T17:57:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f25b6d700 1 -- 172.21.15.45:0/2567759625 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v68'10 uv10 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x56484cde7200 con 0x56484c458c00 2023-12-19T17:57:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56484c459400 0x56484c466000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 8.13 8:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56484c459800 con 0x56484c459400 2023-12-19T17:57:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f2536c700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56484c459400 0x56484c466000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f2536c700 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56484c459400 0x56484c466000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f2536c700 1 -- 172.21.15.45:0/2567759625 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56484cde6b40 con 0x56484c459400 2023-12-19T17:57:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f26bb0840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T17:57:13.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.324+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 8.13 8:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x56484c459c00 con 0x56484c459400 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f2536c700 1 -- 172.21.15.45:0/2567759625 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v68'7 uv7 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x56484cde6b40 con 0x56484c459400 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x56484c458c00 msgr2=0x56484c0ab180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x56484c458c00 0x56484c0ab180 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56484c459400 msgr2=0x56484c466000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56484c459400 0x56484c466000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x56484c458000 msgr2=0x56484c0aac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x56484c458000 0x56484c0aac00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x56484cd79c00 msgr2=0x56484c0ab700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f2536c700 1 -- 172.21.15.45:0/2567759625 reap_dead start 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x56484cd79c00 0x56484c0ab700 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x56484c110750 tx=0x56484c307c20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 msgr2=0x56484c0aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x56484c2fcab0 tx=0x56484c306c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 shutdown_connections 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x56484cd79c00 0x56484c0ab700 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/2567759625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484cd79000 0x56484c0aa680 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 >> 172.21.15.45:0/2567759625 conn(0x56484cd78400 msgr2=0x56484c0d1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 shutdown_connections 2023-12-19T17:57:13.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/2567759625 wait complete. 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 msgr2=0x56484c0a9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 0x56484c0a9080 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x56484c1113b0 tx=0x56484cdf8d80 comp rx=0 tx=0).stop 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 shutdown_connections 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56484c003c00 0x56484c0a9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56484c003800 0x56484c0a9080 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 --2- 172.21.15.45:0/1335897736 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56484c003400 0x56484c0a8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 >> 172.21.15.45:0/1335897736 conn(0x56484c002c00 msgr2=0x56484c0d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 shutdown_connections 2023-12-19T17:57:13.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.328+0000 7f9f26bb0840 1 -- 172.21.15.45:0/1335897736 wait complete. 2023-12-19T17:57:13.343 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init'] in time 0:00:00.113181, result: 2023-12-19T17:57:13.344 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 0 --worker_m 7 2023-12-19T17:57:13.344 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 1 --worker_m 7 2023-12-19T17:57:13.345 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 2 --worker_m 7 2023-12-19T17:57:13.346 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 3 --worker_m 7 2023-12-19T17:57:13.346 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 4 --worker_m 7 2023-12-19T17:57:13.347 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 5 --worker_m 7 2023-12-19T17:57:13.347 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents --worker_n 6 --worker_m 7 2023-12-19T17:57:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 -- start start 2023-12-19T17:57:13.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 Processor -- start 2023-12-19T17:57:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643298a1800 0x564329946580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 0x564329946b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643298a1000 0x564329947080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643298d7e00 con 0x5643298a1400 2023-12-19T17:57:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x564329920a00 con 0x5643298a1800 2023-12-19T17:57:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.416+0000 7f9834d18840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564329920640 con 0x5643298a1000 2023-12-19T17:57:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f98334d4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643298a1800 0x564329946580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 0x564329946b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 0x564329946b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42940/0 (socket says 172.21.15.45:42940) 2023-12-19T17:57:13.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 -- 172.21.15.45:0/1904124724 learned_addr learned my addr 172.21.15.45:0/1904124724 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 -- 172.21.15.45:0/1904124724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643298a1000 msgr2=0x564329947080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643298a1000 0x564329947080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 -- 172.21.15.45:0/1904124724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643298a1800 msgr2=0x564329946580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643298a1800 0x564329946580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 -- 172.21.15.45:0/1904124724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643298c2b60 con 0x5643298a1400 2023-12-19T17:57:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 0x564329946b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x5643299a9410 tx=0x56432a70ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbfe5ec242085ddf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9830ccf700 1 -- 172.21.15.45:0/1904124724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643298d1600 con 0x5643298a1400 2023-12-19T17:57:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9830ccf700 1 -- 172.21.15.45:0/1904124724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643298ec900 con 0x5643298a1400 2023-12-19T17:57:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9830ccf700 1 -- 172.21.15.45:0/1904124724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643298d11e0 con 0x5643298a1400 2023-12-19T17:57:13.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643298c2340 con 0x5643298a1400 2023-12-19T17:57:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5643298c2000 con 0x5643298a1400 2023-12-19T17:57:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9834d18840 4 waiting for MDS map... 2023-12-19T17:57:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.420+0000 7f9830ccf700 1 -- 172.21.15.45:0/1904124724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5643298dac40 con 0x5643298a1400 2023-12-19T17:57:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9830ccf700 1 -- 172.21.15.45:0/1904124724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x564329b8c300 con 0x5643298a1400 2023-12-19T17:57:13.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 4 Got MDS map 42 2023-12-19T17:57:13.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 Processor -- start 2023-12-19T17:57:13.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 -- start start 2023-12-19T17:57:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 0x564329947600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329947b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98c00 0x564329948100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564329920500 con 0x564329b98800 2023-12-19T17:57:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643299203c0 con 0x564329b98c00 2023-12-19T17:57:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9834d18840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564329920a00 con 0x564329b98400 2023-12-19T17:57:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9833cd5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 0x564329947600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9833cd5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 0x564329947600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39216/0 (socket says 172.21.15.45:39216) 2023-12-19T17:57:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f9833cd5700 1 -- 172.21.15.45:0/142459934 learned_addr learned my addr 172.21.15.45:0/142459934 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.424+0000 7f98334d4700 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329947b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9832cd3700 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98c00 0x564329948100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9833cd5700 1 -- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98c00 msgr2=0x564329948100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9833cd5700 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98c00 0x564329948100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9833cd5700 1 -- 172.21.15.45:0/142459934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 msgr2=0x564329947b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9833cd5700 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329947b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9833cd5700 1 -- 172.21.15.45:0/142459934 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643298c2ea0 con 0x564329b98400 2023-12-19T17:57:13.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f98334d4700 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329947b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9833cd5700 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 0x564329947600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x56432a71e840 tx=0x5643299772c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=924dcb051962a00f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f982eccb700 1 -- 172.21.15.45:0/142459934 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643298d1080 con 0x564329b98400 2023-12-19T17:57:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f982eccb700 1 -- 172.21.15.45:0/142459934 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564329b8ea80 con 0x564329b98400 2023-12-19T17:57:13.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f982eccb700 1 -- 172.21.15.45:0/142459934 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643298d1600 con 0x564329b98400 2023-12-19T17:57:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 -- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 msgr2=0x564329947600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 0x564329947600 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x56432a71e840 tx=0x5643299772c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 -- 172.21.15.45:0/142459934 shutdown_connections 2023-12-19T17:57:13.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98c00 0x564329948100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329947b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 --2- 172.21.15.45:0/142459934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98400 0x564329947600 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 -- 172.21.15.45:0/142459934 >> 172.21.15.45:0/142459934 conn(0x5643298a0c00 msgr2=0x564329995800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 -- 172.21.15.45:0/142459934 shutdown_connections 2023-12-19T17:57:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.428+0000 7f9834d18840 1 -- 172.21.15.45:0/142459934 wait complete. 2023-12-19T17:57:13.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 Processor -- start 2023-12-19T17:57:13.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 -- start start 2023-12-19T17:57:13.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98400 0x564329949180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329948c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98c00 0x564329948680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x564329920280 con 0x564329b98800 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x564329920140 con 0x564329b98400 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9834d18840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x564329920000 con 0x564329b98c00 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9833cd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98400 0x564329949180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9833cd5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98400 0x564329949180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47568/0 (socket says 172.21.15.45:47568) 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 learned_addr learned my addr 172.21.15.45:0/1710086844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98c00 0x564329948680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329948c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98400 msgr2=0x564329949180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98400 0x564329949180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 msgr2=0x564329948c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x564329b98800 0x564329948c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.432+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643298c31e0 con 0x564329b98c00 2023-12-19T17:57:13.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564329b98400 0x564329949180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98c00 0x564329948680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5643299a97a0 tx=0x56432a70ecc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f982d4c8700 1 -- 172.21.15.45:0/1710086844 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643298d0f20 con 0x564329b98c00 2023-12-19T17:57:13.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f982d4c8700 1 -- 172.21.15.45:0/1710086844 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564329b8f200 con 0x564329b98c00 2023-12-19T17:57:13.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f982d4c8700 1 -- 172.21.15.45:0/1710086844 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643298d1080 con 0x564329b98c00 2023-12-19T17:57:13.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643298c2ea0 con 0x564329b98c00 2023-12-19T17:57:13.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643298c2b60 con 0x564329b98c00 2023-12-19T17:57:13.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.436+0000 7f9834d18840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f982d4c8700 1 -- 172.21.15.45:0/1710086844 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5643298fe840 con 0x564329b98c00 2023-12-19T17:57:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f982d4c8700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x564329c0a400 0x564329949700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f982d4c8700 1 -- 172.21.15.45:0/1710086844 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5643298daa80 con 0x564329b98c00 2023-12-19T17:57:13.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x564329b99000 0x564329948100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:1 9.0 9:00000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329b99400 con 0x564329b99000 2023-12-19T17:57:13.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x564329b99000 0x564329948100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.440+0000 7f17e6644840 1 -- start start 2023-12-19T17:57:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 Processor -- start 2023-12-19T17:57:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 -- start start 2023-12-19T17:57:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 Processor -- start 2023-12-19T17:57:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x564329c0a400 0x564329949700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x564329b99000 0x564329948100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598913b9c00 0x55989145f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598913b9800 0x55989145fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 0x55989145f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598914383c0 con 0x5598921b4000 2023-12-19T17:57:13.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559891438500 con 0x5598913b9800 2023-12-19T17:57:13.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f423b840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559891438640 con 0x5598913b9c00 2023-12-19T17:57:13.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x564329c0a400 0x564329949700 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x56432a71ea50 tx=0x5643299773e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4ded57800 0x55d4dedfc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 0x55d4dedfcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4ded57000 0x55d4dedfd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ded8de00 con 0x55d4ded57800 2023-12-19T17:57:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6a00 con 0x55d4ded57000 2023-12-19T17:57:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e6644840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6640 con 0x55d4ded57400 2023-12-19T17:57:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=81b] v66'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99000 2023-12-19T17:57:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 0x55989145f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 0x55989145f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42990/0 (socket says 172.21.15.45:42990) 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 -- 172.21.15.45:0/1232598177 learned_addr learned my addr 172.21.15.45:0/1232598177 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f29f7700 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598913b9c00 0x55989145f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f21f6700 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598913b9800 0x55989145fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 0x55d4dedfcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 0x55d4dedfcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39258/0 (socket says 172.21.15.45:39258) 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 -- 172.21.15.45:0/1066735982 learned_addr learned my addr 172.21.15.45:0/1066735982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 9.0 9:012cdbc7:::10000000206.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329b99800 con 0x564329b99000 2023-12-19T17:57:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e4e00700 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4ded57800 0x55d4dedfc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 -- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4ded57000 msgr2=0x55d4dedfd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4ded57000 0x55d4dedfd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 -- 172.21.15.45:0/1066735982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4ded57800 msgr2=0x55d4dedfc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4ded57800 0x55d4dedfc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f17e45ff700 1 -- 172.21.15.45:0/1066735982 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ded78b60 con 0x55d4ded57400 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 -- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598913b9c00 msgr2=0x55989145f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598913b9c00 0x55989145f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 -- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598913b9800 msgr2=0x55989145fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598913b9800 0x55989145fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.444+0000 7f05f31f8700 1 -- 172.21.15.45:0/1232598177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598913db520 con 0x5598921b4000 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e45ff700 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 0x55d4dedfcb00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55d4dee652f0 tx=0x55d4dfbdad20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fed7436e51bee0fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(2 10000000206.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99000 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628294.0 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:012cdbc7:::10000000206.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0a800 con 0x564329b99000 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f31f8700 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 0x55989145f600 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x55989151f380 tx=0x55989219e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7301fa6f41e53f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e25fb700 1 -- 172.21.15.45:0/1066735982 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ded87600 con 0x55d4ded57400 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e25fb700 1 -- 172.21.15.45:0/1066735982 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4deda2900 con 0x55d4ded57400 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e25fb700 1 -- 172.21.15.45:0/1066735982 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ded871e0 con 0x55d4ded57400 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ded78340 con 0x55d4ded57400 2023-12-19T17:57:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d4ded78000 con 0x55d4ded57400 2023-12-19T17:57:13.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e6644840 4 waiting for MDS map... 2023-12-19T17:57:13.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f01f2700 1 -- 172.21.15.45:0/1232598177 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5598913e9600 con 0x5598921b4000 2023-12-19T17:57:13.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f01f2700 1 -- 172.21.15.45:0/1232598177 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559891404480 con 0x5598921b4000 2023-12-19T17:57:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f01f2700 1 -- 172.21.15.45:0/1232598177 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5598913e9080 con 0x5598921b4000 2023-12-19T17:57:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598913da340 con 0x5598921b4000 2023-12-19T17:57:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5598913db1e0 con 0x5598921b4000 2023-12-19T17:57:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f423b840 4 waiting for MDS map... 2023-12-19T17:57:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e25fb700 1 -- 172.21.15.45:0/1066735982 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d4ded90c40 con 0x55d4ded57400 2023-12-19T17:57:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f01f2700 1 -- 172.21.15.45:0/1232598177 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5598913f2c40 con 0x5598921b4000 2023-12-19T17:57:13.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7fad9b7b7840 1 -- start start 2023-12-19T17:57:13.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7fad9b7b7840 1 Processor -- start 2023-12-19T17:57:13.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e25fb700 1 -- 172.21.15.45:0/1066735982 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55d4df057200 con 0x55d4ded57400 2023-12-19T17:57:13.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e6644840 4 Got MDS map 42 2023-12-19T17:57:13.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f01f2700 1 -- 172.21.15.45:0/1232598177 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55989225e000 con 0x5598921b4000 2023-12-19T17:57:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(3 10000000206.00000000 [call] v68'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99000 2023-12-19T17:57:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x564329c0ac00 0x564329947b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:4 9.20 9:04000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b000 con 0x564329c0ac00 2023-12-19T17:57:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f423b840 4 Got MDS map 42 2023-12-19T17:57:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f423b840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f05f423b840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e6644840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.448+0000 7f17e6644840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x564329c0ac00 0x564329947b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f17e6644840 1 Processor -- start 2023-12-19T17:57:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 Processor -- start 2023-12-19T17:57:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 -- start start 2023-12-19T17:57:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 Processor -- start 2023-12-19T17:57:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f17e6644840 1 -- start start 2023-12-19T17:57:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 -- start start 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x564329c0ac00 0x564329947b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bbe3000 0x558e6bc88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bbe3400 0x558e6bc88b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bbe3800 0x558e6bc89080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc19e00 con 0x558e6bbe3400 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62780 con 0x558e6bbe3000 2023-12-19T17:57:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62640 con 0x558e6bbe3800 2023-12-19T17:57:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 0x55d277c32580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277b8d400 0x55d277c32b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277b8d000 0x55d277c33080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7ff5141dc840 1 -- start start 2023-12-19T17:57:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7ff5141dc840 1 Processor -- start 2023-12-19T17:57:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b5000 0x559891460680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598913efe00 con 0x5598921b4800 2023-12-19T17:57:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559891438500 con 0x5598921b5000 2023-12-19T17:57:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f423b840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5598914383c0 con 0x5598921b4c00 2023-12-19T17:57:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad99772700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bbe3400 0x558e6bc88b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad99772700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bbe3400 0x558e6bc88b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43018/0 (socket says 172.21.15.45:43018) 2023-12-19T17:57:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad99772700 1 -- 172.21.15.45:0/1445215382 learned_addr learned my addr 172.21.15.45:0/1445215382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9a774700 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bbe3800 0x558e6bc89080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad99f73700 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bbe3000 0x558e6bc88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(4 [pgnls start_epoch 68 out=81b] v66'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f4b45587840 1 -- start start 2023-12-19T17:57:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f4b45587840 1 Processor -- start 2023-12-19T17:57:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277bc3e00 con 0x55d277b8d400 2023-12-19T17:57:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0ca00 con 0x55d277b8d000 2023-12-19T17:57:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614c351840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0c640 con 0x55d277b8d800 2023-12-19T17:57:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614ab0d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 0x55d277c32580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 9.20 9:05552577:::1000000020b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b400 con 0x564329c0ac00 2023-12-19T17:57:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614ab0d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 0x55d277c32580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39286/0 (socket says 172.21.15.45:39286) 2023-12-19T17:57:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614ab0d700 1 -- 172.21.15.45:0/3550120849 learned_addr learned my addr 172.21.15.45:0/3550120849 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f29f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f29f7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39294/0 (socket says 172.21.15.45:39294) 2023-12-19T17:57:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f29f7700 1 -- 172.21.15.45:0/242756660 learned_addr learned my addr 172.21.15.45:0/242756660 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f614b30e700 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277b8d000 0x55d277c33080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f21f6700 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b5000 0x559891460680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(5 1000000020b.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f17e6644840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 0x55d4dedfd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628299.0 2023-12-19T17:57:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:6 9.20 9:05552577:::1000000020b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b800 con 0x564329c0ac00 2023-12-19T17:57:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7f05f21f6700 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e6644840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054800 0x55d4dedfdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9a774700 1 -- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bbe3000 msgr2=0x558e6bc88580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9a774700 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bbe3000 0x558e6bc88580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9a774700 1 -- 172.21.15.45:0/1445215382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bbe3400 msgr2=0x558e6bc88b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9a774700 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bbe3400 0x558e6bc88b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.452+0000 7fad9a774700 1 -- 172.21.15.45:0/1445215382 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e6bc04b60 con 0x558e6bbe3800 2023-12-19T17:57:13.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e6644840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054c00 0x55d4dedfe100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614ab0d700 1 -- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277b8d000 msgr2=0x55d277c33080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614ab0d700 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277b8d000 0x55d277c33080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614ab0d700 1 -- 172.21.15.45:0/3550120849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277b8d400 msgr2=0x55d277c32b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614a30c700 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277b8d400 0x55d277c32b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecae2f000 0x558ecaed4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 0x558ecaed4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecae2f800 0x558ecaed5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b45587840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685ce1800 0x55b685d86b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b45587840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 0x55b685d86580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b45587840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685ce1000 0x55b685d87080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b45587840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b685d17e00 con 0x55b685ce1800 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b45587840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60a00 con 0x55b685ce1000 2023-12-19T17:57:13.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b45587840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60640 con 0x55b685ce1400 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05f21f6700 1 -- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4c00 msgr2=0x559891460100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05f21f6700 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05f21f6700 1 -- 172.21.15.45:0/242756660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4800 msgr2=0x55989145eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05f21f6700 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05f21f6700 1 -- 172.21.15.45:0/242756660 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598913daea0 con 0x5598921b5000 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e6644840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6500 con 0x55d4df054c00 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e6644840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd63c0 con 0x55d4df054400 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e6644840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6a00 con 0x55d4df054800 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 0x55d4dedfd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 0x55d4dedfd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47646/0 (socket says 172.21.15.45:47646) 2023-12-19T17:57:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 -- 172.21.15.45:0/3383784113 learned_addr learned my addr 172.21.15.45:0/3383784113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614ab0d700 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277b8d400 0x55d277c32b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614ab0d700 1 -- 172.21.15.45:0/3550120849 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d277baeb60 con 0x55d277b8d800 2023-12-19T17:57:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614a30c700 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277b8d400 0x55d277c32b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 0x55b685d86580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 0x55b685d86580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39320/0 (socket says 172.21.15.45:39320) 2023-12-19T17:57:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 -- 172.21.15.45:0/1930122586 learned_addr learned my addr 172.21.15.45:0/1930122586 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054800 0x55d4dedfdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeaea00 con 0x558ecae2f400 2023-12-19T17:57:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ecae65e00 con 0x558ecae2f000 2023-12-19T17:57:13.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae640 con 0x558ecae2f800 2023-12-19T17:57:13.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9a774700 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bbe3800 0x558e6bc89080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x558e6bd48ae0 tx=0x558e6c9c4000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb36c2ed039762ea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 0x558ecaed4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 0x558ecaed4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43052/0 (socket says 172.21.15.45:43052) 2023-12-19T17:57:13.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 -- 172.21.15.45:0/4226271823 learned_addr learned my addr 172.21.15.45:0/4226271823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff513199700 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecae2f800 0x558ecaed5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685ce1800 0x55b685d86b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05f21f6700 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b5000 0x559891460680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55989226e750 tx=0x559892270c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5539abe425a2b9ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05ee1ee700 1 -- 172.21.15.45:0/242756660 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5598913e9600 con 0x5598921b5000 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05ee1ee700 1 -- 172.21.15.45:0/242756660 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559892262d80 con 0x5598921b5000 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f05ee1ee700 1 -- 172.21.15.45:0/242756660 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5598913e9080 con 0x5598921b5000 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9776e700 1 -- 172.21.15.45:0/1445215382 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e6bc13080 con 0x558e6bbe3800 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9776e700 1 -- 172.21.15.45:0/1445215382 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e6bc2e900 con 0x558e6bbe3800 2023-12-19T17:57:13.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9776e700 1 -- 172.21.15.45:0/1445215382 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e6bc13600 con 0x558e6bbe3800 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e6bc051e0 con 0x558e6bbe3800 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054c00 0x55d4dedfe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 -- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054800 msgr2=0x55d4dedfdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054800 0x55d4dedfdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 -- 172.21.15.45:0/3383784113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054c00 msgr2=0x55d4dedfe100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054c00 0x55d4dedfe100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 -- 172.21.15.45:0/3383784113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ded78ea0 con 0x55d4df054400 2023-12-19T17:57:13.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512998700 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecae2f000 0x558ecaed4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 -- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecae2f800 msgr2=0x558ecaed5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecae2f800 0x558ecaed5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 -- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecae2f000 msgr2=0x558ecaed4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecae2f000 0x558ecaed4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 -- 172.21.15.45:0/4226271823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ecae50340 con 0x558ecae2f400 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614ab0d700 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 0x55d277c32580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55d277c8b380 tx=0x55d277cf2300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9204a9f11851d3fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f6148308700 1 -- 172.21.15.45:0/3550120849 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d277bbd600 con 0x55d277b8d800 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f6148308700 1 -- 172.21.15.45:0/3550120849 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d277bd8900 con 0x55d277b8d800 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f6148308700 1 -- 172.21.15.45:0/3550120849 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d277bbd1e0 con 0x55d277b8d800 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d277bae340 con 0x55d277b8d800 2023-12-19T17:57:13.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d277bae000 con 0x55d277b8d800 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614c351840 4 waiting for MDS map... 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b44544700 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685ce1000 0x55b685d87080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 -- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685ce1000 msgr2=0x55b685d87080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685ce1000 0x55b685d87080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 -- 172.21.15.45:0/1930122586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685ce1800 msgr2=0x55b685d86b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685ce1800 0x55b685d86b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 -- 172.21.15.45:0/1930122586 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b685d031e0 con 0x55b685ce1400 2023-12-19T17:57:13.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685ce1800 0x55b685d86b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(6 1000000020b.00000000 [call] v68'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff512197700 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 0x558ecaed4b00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x558ecaf35500 tx=0x558ecbc26000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23e95df2ccbc732 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x564329b99400 0x564329947600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f6148308700 1 -- 172.21.15.45:0/3550120849 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d277bc6c40 con 0x55d277b8d800 2023-12-19T17:57:13.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:7 9.10 9:08000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329b99800 con 0x564329b99400 2023-12-19T17:57:13.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558e6bc04b60 con 0x558e6bbe3800 2023-12-19T17:57:13.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7fad9b7b7840 4 waiting for MDS map... 2023-12-19T17:57:13.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e5601700 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 0x55d4dedfd600 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55d4df0668a0 tx=0x55d4df068d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b79fb3d34d31ff2e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f6148308700 1 -- 172.21.15.45:0/3550120849 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55d277e7f200 con 0x55d277b8d800 2023-12-19T17:57:13.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f614c351840 4 Got MDS map 42 2023-12-19T17:57:13.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff510193700 1 -- 172.21.15.45:0/4226271823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ecae5f600 con 0x558ecae2f400 2023-12-19T17:57:13.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff510193700 1 -- 172.21.15.45:0/4226271823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ecae7a180 con 0x558ecae2f400 2023-12-19T17:57:13.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f4b43542700 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 0x55b685d86580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55b685de93e0 tx=0x55b686b64e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=681d0e7d76d21bd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff510193700 1 -- 172.21.15.45:0/4226271823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ecae5f1e0 con 0x558ecae2f400 2023-12-19T17:57:13.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ecae511e0 con 0x558ecae2f400 2023-12-19T17:57:13.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x564329b99400 0x564329947600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 -- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b5000 msgr2=0x559891460680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b5000 0x559891460680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x55989226e750 tx=0x559892270c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 -- 172.21.15.45:0/242756660 shutdown_connections 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b5000 0x559891460680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 --2- 172.21.15.45:0/242756660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 -- 172.21.15.45:0/242756660 >> 172.21.15.45:0/242756660 conn(0x5598921b4400 msgr2=0x5598914ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7fad9776e700 1 -- 172.21.15.45:0/1445215382 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x558e6bc1cc40 con 0x558e6bbe3800 2023-12-19T17:57:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7fad9776e700 1 -- 172.21.15.45:0/1445215382 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x558e6bc24f00 con 0x558e6bbe3800 2023-12-19T17:57:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7f17e05f7700 1 -- 172.21.15.45:0/3383784113 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ded87600 con 0x55d4df054400 2023-12-19T17:57:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e05f7700 1 -- 172.21.15.45:0/3383784113 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4df062c00 con 0x55d4df054400 2023-12-19T17:57:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e05f7700 1 -- 172.21.15.45:0/3383784113 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ded871e0 con 0x55d4df054400 2023-12-19T17:57:13.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558ecae50ea0 con 0x558ecae2f400 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.456+0000 7ff5141dc840 4 waiting for MDS map... 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b4153e700 1 -- 172.21.15.45:0/1930122586 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b685d11600 con 0x55b685ce1400 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b4153e700 1 -- 172.21.15.45:0/1930122586 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b685d2c480 con 0x55b685ce1400 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b4153e700 1 -- 172.21.15.45:0/1930122586 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b685d111e0 con 0x55b685ce1400 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b685d02b60 con 0x55b685ce1400 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b685d02340 con 0x55b685ce1400 2023-12-19T17:57:13.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 4 waiting for MDS map... 2023-12-19T17:57:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff510193700 1 -- 172.21.15.45:0/4226271823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x558ecae68c40 con 0x558ecae2f400 2023-12-19T17:57:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 -- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 msgr2=0x55d4dedfd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff510193700 1 -- 172.21.15.45:0/4226271823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x558ecae70f00 con 0x558ecae2f400 2023-12-19T17:57:13.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff5141dc840 4 Got MDS map 42 2023-12-19T17:57:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 0x55d4dedfd600 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x55d4df0668a0 tx=0x55d4df068d20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff5141dc840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff5141dc840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 Processor -- start 2023-12-19T17:57:13.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x564329b99400 0x564329947600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 -- 172.21.15.45:0/242756660 shutdown_connections 2023-12-19T17:57:13.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 -- 172.21.15.45:0/242756660 wait complete. 2023-12-19T17:57:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b4153e700 1 -- 172.21.15.45:0/1930122586 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55b685d1ac40 con 0x55b685ce1400 2023-12-19T17:57:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b4153e700 1 -- 172.21.15.45:0/1930122586 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55b685ff8000 con 0x55b685ce1400 2023-12-19T17:57:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 4 Got MDS map 42 2023-12-19T17:57:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(7 [pgnls start_epoch 68 out=81b] v66'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99400 2023-12-19T17:57:13.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 -- 172.21.15.45:0/3383784113 shutdown_connections 2023-12-19T17:57:13.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054c00 0x55d4dedfe100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054800 0x55d4dedfdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 --2- 172.21.15.45:0/3383784113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054400 0x55d4dedfd600 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 -- 172.21.15.45:0/3383784113 >> 172.21.15.45:0/3383784113 conn(0x55d4ded56c00 msgr2=0x55d4dee47800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff5141dc840 1 Processor -- start 2023-12-19T17:57:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7fad9b7b7840 4 Got MDS map 42 2023-12-19T17:57:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7fad9b7b7840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7fad9b7b7840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7fad9b7b7840 1 Processor -- start 2023-12-19T17:57:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 -- 172.21.15.45:0/3383784113 shutdown_connections 2023-12-19T17:57:13.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f17e6644840 1 -- 172.21.15.45:0/3383784113 wait complete. 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7ff5141dc840 1 -- start start 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 -- start start 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88400 0x55d277c33600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 0x55d277c33b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88c00 0x55d277c34100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0c500 con 0x55d277e88800 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0c3c0 con 0x55d277e88400 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614c351840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0ca00 con 0x55d277e88c00 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 0x55d277c33b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614b30e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88400 0x55d277c33600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 0x55d277c33b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43068/0 (socket says 172.21.15.45:43068) 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 -- 172.21.15.45:0/3496729072 learned_addr learned my addr 172.21.15.45:0/3496729072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 -- 172.21.15.45:0/3496729072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88c00 msgr2=0x55d277c34100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88c00 0x55d277c34100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 -- 172.21.15.45:0/3496729072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88400 msgr2=0x55d277c33600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88400 0x55d277c33600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 -- 172.21.15.45:0/3496729072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d277baeea0 con 0x55d277e88800 2023-12-19T17:57:13.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 Processor -- start 2023-12-19T17:57:13.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f614ab0d700 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 0x55d277c33b80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55d277ea4870 tx=0x55d277c3ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2612d2fca368dcd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:8 9.10 9:08b99fea:::100000001fd.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b000 con 0x564329b99400 2023-12-19T17:57:13.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f05f423b840 1 -- start start 2023-12-19T17:57:13.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.460+0000 7f4b45587840 1 Processor -- start 2023-12-19T17:57:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 Processor -- start 2023-12-19T17:57:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 -- start start 2023-12-19T17:57:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 -- start start 2023-12-19T17:57:13.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(8 100000001fd.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99400 2023-12-19T17:57:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628285.0 2023-12-19T17:57:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 9.10 9:08b99fea:::100000001fd.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b400 con 0x564329b99400 2023-12-19T17:57:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 -- start start 2023-12-19T17:57:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28800 0x558ecaed5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f6146304700 1 -- 172.21.15.45:0/3496729072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d277bbcf20 con 0x55d277e88800 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f6146304700 1 -- 172.21.15.45:0/3496729072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d277ea0a80 con 0x55d277e88800 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f6146304700 1 -- 172.21.15.45:0/3496729072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d277bbd600 con 0x55d277e88800 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28c00 0x558ecaed6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff5141dc840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae500 con 0x558ecbd28c00 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff5141dc840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae780 con 0x558ecbd28800 2023-12-19T17:57:13.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff5141dc840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae3c0 con 0x558ecbd28400 2023-12-19T17:57:13.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054400 0x55d4dedff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054800 0x55d4dedfec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 -- 172.21.15.45:0/3496729072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 msgr2=0x55d277c33b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 0x55d277c33b80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x55d277ea4870 tx=0x55d277c3ea80 comp rx=0 tx=0).stop 2023-12-19T17:57:13.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054c00 0x55d4dedfe680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6280 con 0x55d4df054400 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6140 con 0x55d4df054800 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e6644840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4dedd6000 con 0x55d4df054c00 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512998700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28800 0x558ecaed5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff513199700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60500 con 0x55b685fed000 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b685d603c0 con 0x55b685fecc00 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f423b840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f423b840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f423b840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b5000 0x559891460680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f423b840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559891438280 con 0x5598921b5000 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f423b840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559891438140 con 0x5598921b4c00 2023-12-19T17:57:13.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b45587840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60a00 con 0x55b685fec800 2023-12-19T17:57:13.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f423b840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559891438000 con 0x5598921b4800 2023-12-19T17:57:13.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 -- 172.21.15.45:0/3496729072 shutdown_connections 2023-12-19T17:57:13.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88c00 0x55d277c34100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88800 0x55d277c33b80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 --2- 172.21.15.45:0/3496729072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88400 0x55d277c33600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 -- 172.21.15.45:0/3496729072 >> 172.21.15.45:0/3496729072 conn(0x55d277b8cc00 msgr2=0x55d277c6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 0x559891460100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47704/0 (socket says 172.21.15.45:47704) 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 learned_addr learned my addr 172.21.15.45:0/3684686009 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34400 0x558e6bc89600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054800 0x55d4dedfec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054800 0x55d4dedfec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47690/0 (socket says 172.21.15.45:47690) 2023-12-19T17:57:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 learned_addr learned my addr 172.21.15.45:0/3597000239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054c00 0x55d4dedfe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff513199700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39338/0 (socket says 172.21.15.45:39338) 2023-12-19T17:57:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff513199700 1 -- 172.21.15.45:0/2507456896 learned_addr learned my addr 172.21.15.45:0/2507456896 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 -- 172.21.15.45:0/3496729072 shutdown_connections 2023-12-19T17:57:13.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 -- 172.21.15.45:0/3496729072 wait complete. 2023-12-19T17:57:13.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47720/0 (socket says 172.21.15.45:47720) 2023-12-19T17:57:13.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 -- 172.21.15.45:0/4111115872 learned_addr learned my addr 172.21.15.45:0/4111115872 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 0x558e6bc89b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054c00 msgr2=0x55d4dedfe680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4df054c00 0x55d4dedfe680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054400 msgr2=0x55d4dedff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4df054400 0x55d4dedff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ded78b60 con 0x55d4df054800 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43542700 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34c00 0x558e6bc8a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 Processor -- start 2023-12-19T17:57:13.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62500 con 0x558e6bf34c00 2023-12-19T17:57:13.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512197700 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28c00 0x558ecaed6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b5000 0x559891460680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b44544700 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4800 msgr2=0x55989145eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054800 0x55d4dedfec00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55d4df067590 tx=0x55d4dee2d2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(9 100000001fd.00000000 [call] v68'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99400 2023-12-19T17:57:13.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:10 9.30 9:0c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b800 con 0x564329c0ac00 2023-12-19T17:57:13.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598921b4800 0x55989145eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b5000 msgr2=0x559891460680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b5000 0x559891460680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598913db520 con 0x5598921b4c00 2023-12-19T17:57:13.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc623c0 con 0x558e6bf34800 2023-12-19T17:57:13.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62780 con 0x558e6bf34400 2023-12-19T17:57:13.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 0x558e6bc89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 0x558e6bc89b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47724/0 (socket says 172.21.15.45:47724) 2023-12-19T17:57:13.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 -- 172.21.15.45:0/3868208184 learned_addr learned my addr 172.21.15.45:0/3868208184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f17dedf4700 1 -- 172.21.15.45:0/3597000239 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ded87080 con 0x55d4df054800 2023-12-19T17:57:13.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512998700 1 -- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 msgr2=0x558ecaed5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512998700 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512998700 1 -- 172.21.15.45:0/2507456896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28c00 msgr2=0x558ecaed6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512998700 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28c00 0x558ecaed6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7ff512998700 1 -- 172.21.15.45:0/2507456896 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ecae51520 con 0x558ecbd28800 2023-12-19T17:57:13.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f614c351840 1 -- start start 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 -- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 msgr2=0x55b685d87600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 -- 172.21.15.45:0/4111115872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fed000 msgr2=0x55b685d88100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.464+0000 7f4b43d43700 1 -- 172.21.15.45:0/4111115872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b685d02000 con 0x55b685fecc00 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d4ded78340 con 0x55d4df054800 2023-12-19T17:57:13.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f17dedf4700 1 -- 172.21.15.45:0/3597000239 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4deda2480 con 0x55d4df054800 2023-12-19T17:57:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ded78000 con 0x55d4df054800 2023-12-19T17:57:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f17e6644840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff512998700 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28800 0x558ecaed5b80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x558ecaf35410 tx=0x558ecbcdec00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64be99caa7ce4d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 0x559891460100 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55989226e6f0 tx=0x55989219e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b43d43700 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 0x55b685d87b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55b685ffe8a0 tx=0x55b686002c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d83cb0780fdbd8fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(10 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05ec9eb700 1 -- 172.21.15.45:0/3684686009 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5598913e91e0 con 0x5598921b4c00 2023-12-19T17:57:13.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f17dedf4700 1 -- 172.21.15.45:0/3597000239 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d4ded87600 con 0x55d4df054800 2023-12-19T17:57:13.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05ec9eb700 1 -- 172.21.15.45:0/3684686009 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559892263680 con 0x5598921b4c00 2023-12-19T17:57:13.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05ec9eb700 1 -- 172.21.15.45:0/3684686009 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5598913e9600 con 0x5598921b4c00 2023-12-19T17:57:13.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88400 0x55d277c35180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88800 0x55d277c34c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f982eccb700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x564329b99800 0x564329d22000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f982eccb700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:11 9.8 9:10000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0a800 con 0x564329b99800 2023-12-19T17:57:13.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5598913db6c0 con 0x5598921b4c00 2023-12-19T17:57:13.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88c00 0x55d277c34680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0c280 con 0x55d277e88400 2023-12-19T17:57:13.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0c140 con 0x55d277e88c00 2023-12-19T17:57:13.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d277c0c000 con 0x55d277e88800 2023-12-19T17:57:13.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598913db860 con 0x5598921b4c00 2023-12-19T17:57:13.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f05f423b840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff50e18f700 1 -- 172.21.15.45:0/2507456896 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ecae5f600 con 0x558ecbd28800 2023-12-19T17:57:13.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99772700 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34c00 0x558e6bc8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99772700 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34400 0x558e6bc89600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88800 0x55d277c34c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614a30c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88c00 0x55d277c34680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614a30c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88c00 0x55d277c34680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47728/0 (socket says 172.21.15.45:47728) 2023-12-19T17:57:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 learned_addr learned my addr 172.21.15.45:0/1153605050 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x564329b99800 0x564329d22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff50e18f700 1 -- 172.21.15.45:0/2507456896 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ecae7a900 con 0x558ecbd28800 2023-12-19T17:57:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88400 0x55d277c35180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff50e18f700 1 -- 172.21.15.45:0/2507456896 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ecae5f600 con 0x558ecbd28800 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 -- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34400 msgr2=0x558e6bc89600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34400 0x558e6bc89600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 -- 172.21.15.45:0/3868208184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34c00 msgr2=0x558e6bc8a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34c00 0x558e6bc8a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 -- 172.21.15.45:0/3868208184 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e6bc04340 con 0x558e6bf34800 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99772700 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34c00 0x558e6bc8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b3f53a700 1 -- 172.21.15.45:0/4111115872 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b685d11600 con 0x55b685fecc00 2023-12-19T17:57:13.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b3f53a700 1 -- 172.21.15.45:0/4111115872 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b685d2c480 con 0x55b685fecc00 2023-12-19T17:57:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b3f53a700 1 -- 172.21.15.45:0/4111115872 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b685d111e0 con 0x55b685fecc00 2023-12-19T17:57:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88c00 msgr2=0x55d277c34680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277e88c00 0x55d277c34680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88400 msgr2=0x55d277c35180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277e88400 0x55d277c35180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d277baeb60 con 0x55d277e88800 2023-12-19T17:57:13.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 -- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28800 msgr2=0x558ecaed5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28800 0x558ecaed5b80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x558ecaf35410 tx=0x558ecbcdec00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad99f73700 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 0x558e6bc89b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x558e6bed8900 tx=0x558e6bef2d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c7815b98dd58928 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 -- 172.21.15.45:0/2507456896 shutdown_connections 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28c00 0x558ecaed6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28800 0x558ecaed5b80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2507456896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 -- 172.21.15.45:0/2507456896 >> 172.21.15.45:0/2507456896 conn(0x558ecbd28000 msgr2=0x558ecaeeb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 -- 172.21.15.45:0/2507456896 shutdown_connections 2023-12-19T17:57:13.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88800 0x55d277c34c00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55d277ea4ab0 tx=0x55d277ea8c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7ff5141dc840 1 -- 172.21.15.45:0/2507456896 wait complete. 2023-12-19T17:57:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x564329b99800 0x564329d22000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad9576a700 1 -- 172.21.15.45:0/3868208184 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e6bc13080 con 0x558e6bf34800 2023-12-19T17:57:13.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(11 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cfc0 con 0x564329b99800 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f982e4ca700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x564329d26000 0x564329d22580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f982e4ca700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:12 9.28 9:14000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26400 con 0x564329d26000 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad9576a700 1 -- 172.21.15.45:0/3868208184 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e6ca68c00 con 0x558e6bf34800 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7fad9576a700 1 -- 172.21.15.45:0/3868208184 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e6bc13600 con 0x558e6bf34800 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 -- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 msgr2=0x558e6bc89b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 0x558e6bc89b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x558e6bed8900 tx=0x558e6bef2d20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 -- 172.21.15.45:0/3868208184 shutdown_connections 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34c00 0x558e6bc8a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34800 0x558e6bc89b80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/3868208184 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34400 0x558e6bc89600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 -- 172.21.15.45:0/3868208184 >> 172.21.15.45:0/3868208184 conn(0x558e6bf34000 msgr2=0x558e6bcf7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17dedf4700 1 -- 172.21.15.45:0/3597000239 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55d4dedb4840 con 0x55d4df054800 2023-12-19T17:57:13.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 Processor -- start 2023-12-19T17:57:13.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 -- start start 2023-12-19T17:57:13.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f6144b01700 1 -- 172.21.15.45:0/1153605050 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d277bbd1e0 con 0x55d277e88800 2023-12-19T17:57:13.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f6144b01700 1 -- 172.21.15.45:0/1153605050 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d277ea0300 con 0x55d277e88800 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d277bae340 con 0x55d277e88800 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f6144b01700 1 -- 172.21.15.45:0/1153605050 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d277bbcdc0 con 0x55d277e88800 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d277baf520 con 0x55d277e88800 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f614c351840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 -- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 msgr2=0x55b685d87b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 0x55b685d87b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x55b685ffe8a0 tx=0x55b686002c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 -- 172.21.15.45:0/4111115872 shutdown_connections 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 --2- 172.21.15.45:0/4111115872 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.468+0000 7f4b45587840 1 -- 172.21.15.45:0/4111115872 >> 172.21.15.45:0/4111115872 conn(0x55b685ce0c00 msgr2=0x55b685d9d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f4b45587840 1 -- 172.21.15.45:0/4111115872 shutdown_connections 2023-12-19T17:57:13.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x564329d26000 0x564329d22580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 -- 172.21.15.45:0/3868208184 shutdown_connections 2023-12-19T17:57:13.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f4b45587840 1 -- 172.21.15.45:0/4111115872 wait complete. 2023-12-19T17:57:13.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f4b45587840 1 Processor -- start 2023-12-19T17:57:13.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17dedf4700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d4df1b2000 0x55d4dedff700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17dedf4700 1 -- 172.21.15.45:0/3597000239 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d4ded90a80 con 0x55d4df054800 2023-12-19T17:57:13.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05ec9eb700 1 -- 172.21.15.45:0/3684686009 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x559891416840 con 0x5598921b4c00 2023-12-19T17:57:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f9833cd5700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x564329d26000 0x564329d22580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d4df1b2000 0x55d4dedff700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d4df055000 0x55d4dedfe100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:1 9.36 9:6db6db6d::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df055400 con 0x55d4df055000 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 -- 172.21.15.45:0/3868208184 wait complete. 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 Processor -- start 2023-12-19T17:57:13.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f6144b01700 1 -- 172.21.15.45:0/1153605050 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55d277bea840 con 0x55d277e88800 2023-12-19T17:57:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05ec9eb700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5598921b5800 0x559891461700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05ec9eb700 1 -- 172.21.15.45:0/3684686009 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5598913f2a80 con 0x5598921b4c00 2023-12-19T17:57:13.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(12 [pgnls start_epoch 68 out=101b] v66'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d4df055000 0x55d4dedfe100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28800 0x558ecaed6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28c00 0x558ecaed6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39380/0 (socket says 172.21.15.45:39380) 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 learned_addr learned my addr 172.21.15.45:0/2750985134 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5598921b5c00 0x559891460c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 9.24 9:24924924::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716000 con 0x5598921b5c00 2023-12-19T17:57:13.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5598921b5800 0x559891461700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 9.28 9:15246602:::10000000202.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0bc00 con 0x564329d26000 2023-12-19T17:57:13.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7fad9b7b7840 1 -- start start 2023-12-19T17:57:13.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d4df1b2000 0x55d4dedff700 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55d4df0668a0 tx=0x55d4df068c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae3c0 con 0x558ecbd28800 2023-12-19T17:57:13.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae500 con 0x558ecbd28c00 2023-12-19T17:57:13.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ecaeae780 con 0x558ecbd28400 2023-12-19T17:57:13.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f4b45587840 1 -- start start 2023-12-19T17:57:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f6144b01700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d277ff0000 0x55d277c35700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f6144b01700 1 -- 172.21.15.45:0/1153605050 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d277bc6a80 con 0x55d277e88800 2023-12-19T17:57:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d4df055000 0x55d4dedfe100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f614c351840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f614c351840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(13 10000000202.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f614c351840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f614c351840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28c00 msgr2=0x558ecaed6680 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-19T17:57:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecbd28c00 0x558ecaed6680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28800 msgr2=0x558ecaed6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7f614c351840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecbd28800 0x558ecaed6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.472+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ecae50340 con 0x558ecbd28400 2023-12-19T17:57:13.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d277e89000 0x55d277c34100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 9.2d 9:b6db6db6::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277e89400 con 0x55d277e89000 2023-12-19T17:57:13.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed7180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x558ecbc3b770 tx=0x558ecbcded20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628290.0 2023-12-19T17:57:13.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:14 9.28 9:15246602:::10000000202.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26c00 con 0x564329d26000 2023-12-19T17:57:13.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5598921b5c00 0x559891460c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614a30c700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d277e89000 0x55d277c34100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d277ff0000 0x55d277c35700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff50c98c700 1 -- 172.21.15.45:0/2750985134 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ecae5f600 con 0x558ecbd28400 2023-12-19T17:57:13.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff50c98c700 1 -- 172.21.15.45:0/2750985134 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ecbc2f680 con 0x558ecbd28400 2023-12-19T17:57:13.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff50c98c700 1 -- 172.21.15.45:0/2750985134 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ecae5ef20 con 0x558ecbd28400 2023-12-19T17:57:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b45587840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b45587840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b45587840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b45587840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60280 con 0x55b685fecc00 2023-12-19T17:57:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b45587840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60140 con 0x55b685fed000 2023-12-19T17:57:13.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b45587840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b685d60000 con 0x55b685fec800 2023-12-19T17:57:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ecae511e0 con 0x558ecbd28400 2023-12-19T17:57:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ecae50ea0 con 0x558ecbd28400 2023-12-19T17:57:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7ff5141dc840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5598921b5800 0x559891461700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55989226e930 tx=0x559892270c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39382/0 (socket says 172.21.15.45:39382) 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 learned_addr learned my addr 172.21.15.45:0/1620142690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=101b] v66'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 9.36 9:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df055800 con 0x55d4df055000 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(2 100000001f9.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.36 9:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b2400 con 0x55d4df055000 2023-12-19T17:57:13.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5598921b5c00 0x559891460c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fed000 msgr2=0x55b685d88100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685fed000 0x55b685d88100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fecc00 msgr2=0x55b685d87b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d277ff0000 0x55d277c35700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55d277c8b200 tx=0x55d277ea9c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34400 0x558e6bc8b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34800 0x558e6bc8ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad9b7b7840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34c00 0x558e6bc8a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62280 con 0x558e6bf34400 2023-12-19T17:57:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62140 con 0x558e6bf34c00 2023-12-19T17:57:13.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad9b7b7840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558e6bc62000 con 0x558e6bf34800 2023-12-19T17:57:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad99772700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34400 0x558e6bc8b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=49b] v66'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cb40 con 0x5598921b5c00 2023-12-19T17:57:13.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b685d031e0 con 0x55b685fec800 2023-12-19T17:57:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad99772700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34400 0x558e6bc8b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43162/0 (socket says 172.21.15.45:43162) 2023-12-19T17:57:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 learned_addr learned my addr 172.21.15.45:0/4127395730 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f05ed9ed700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x559891717c00 0x55989171c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34800 0x558e6bc8ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34c00 0x558e6bc8a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685fecc00 0x55b685d87b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f05ed9ed700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 9.14 9:28000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891726000 con 0x559891717c00 2023-12-19T17:57:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614a30c700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d277e89000 0x55d277c34100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.476+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12b40 con 0x55d277e89000 2023-12-19T17:57:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05f31f8700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x559891717c00 0x55989171c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34800 msgr2=0x558e6bc8ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bf34800 0x558e6bc8ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34400 msgr2=0x558e6bc8b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bf34400 0x558e6bc8b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558e6bc04000 con 0x558e6bf34c00 2023-12-19T17:57:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff50c98c700 1 -- 172.21.15.45:0/2750985134 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x558ecae8c840 con 0x558ecbd28400 2023-12-19T17:57:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55b685fff560 tx=0x55b685db7380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(14 10000000202.00000000 [call] v68'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f6145b03700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d277ff0400 0x55d27800c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f6145b03700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 9.1d 9:b8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0800 con 0x55d277ff0400 2023-12-19T17:57:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:15 9.28 9:177a762d::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27000 con 0x564329d26000 2023-12-19T17:57:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b3dd37700 1 -- 172.21.15.45:0/1620142690 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b685d11080 con 0x55b685fec800 2023-12-19T17:57:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b3dd37700 1 -- 172.21.15.45:0/1620142690 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b686ac6300 con 0x55b685fec800 2023-12-19T17:57:13.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b3dd37700 1 -- 172.21.15.45:0/1620142690 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b685d11600 con 0x55b685fec800 2023-12-19T17:57:13.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05f31f8700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x559891717c00 0x55989171c000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b685d02b60 con 0x55b685fec800 2023-12-19T17:57:13.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d277ff0400 0x55d27800c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34c00 0x558e6bc8a680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x558e6bed9620 tx=0x558e6c9c42a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(2 [pgnls start_epoch 68 out=49b] v66'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cd80 con 0x559891717c00 2023-12-19T17:57:13.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05ee1ee700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559891726800 0x55989171c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05ee1ee700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:3 9.34 9:2c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891726c00 con 0x559891726800 2023-12-19T17:57:13.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(3 100000001f9.00000000 [call] v68'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad93f67700 1 -- 172.21.15.45:0/4127395730 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e6bc13080 con 0x558e6bf34c00 2023-12-19T17:57:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad93f67700 1 -- 172.21.15.45:0/4127395730 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558e6ca69380 con 0x558e6bf34c00 2023-12-19T17:57:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad93f67700 1 -- 172.21.15.45:0/4127395730 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558e6bc13600 con 0x558e6bf34c00 2023-12-19T17:57:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(15 [pgnls start_epoch 68 out=81b] v68'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 9.36 9:6fe38dc2::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b2800 con 0x55d4df055000 2023-12-19T17:57:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:16 9.28 9:177a762d:::10000000201.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27400 con 0x564329d26000 2023-12-19T17:57:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558e6bc04ea0 con 0x558e6bf34c00 2023-12-19T17:57:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558e6bc05520 con 0x558e6bf34c00 2023-12-19T17:57:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7fad9b7b7840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff50c98c700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558ecbd29400 0x558ecaed7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff50c98c700 1 -- 172.21.15.45:0/2750985134 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x558ecae68a80 con 0x558ecbd28400 2023-12-19T17:57:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff512998700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558ecbd29400 0x558ecaed7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b685d02ea0 con 0x55b685fec800 2023-12-19T17:57:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f4b45587840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(4 [pgnls start_epoch 68 out=81b] v68'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(16 10000000201.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:5 9.36 9:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b2c00 con 0x55d4df055000 2023-12-19T17:57:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628289.0 2023-12-19T17:57:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:17 9.28 9:177a762d:::10000000201.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27800 con 0x564329d26000 2023-12-19T17:57:13.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558ecbd29800 0x558ecaed6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559891726800 0x55989171c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff512998700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558ecbd29400 0x558ecaed7700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x558ecaf35410 tx=0x558ecbc26420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d277ff0400 0x55d27800c000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:1 9.9 9:92492492::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecbd29c00 con 0x558ecbd29800 2023-12-19T17:57:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(5 100000001f7.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T17:57:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:6 9.36 9:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3000 con 0x55d4df055000 2023-12-19T17:57:13.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7ff512197700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558ecbd29800 0x558ecaed6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 [pgnls start_epoch 68 out=49b] v66'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12d80 con 0x55d277ff0400 2023-12-19T17:57:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f6146304700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d277ff1000 0x55d27800c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f6146304700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:3 9.3d 9:bc000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff1400 con 0x55d277ff1000 2023-12-19T17:57:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.480+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559891726800 0x55989171c580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d277ff1000 0x55d27800c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(3 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cfc0 con 0x559891726800 2023-12-19T17:57:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05ed9ed700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559891726400 0x55989171cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05ed9ed700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:4 9.c 9:30000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727400 con 0x559891726400 2023-12-19T17:57:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7ff512197700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558ecbd29800 0x558ecaed6100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7fad93f67700 1 -- 172.21.15.45:0/4127395730 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x558e6bc40840 con 0x558e6bf34c00 2023-12-19T17:57:13.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559891726400 0x55989171cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(17 10000000201.00000000 [call] v68'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(6 100000001f7.00000000 [call] v68'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b3dd37700 1 -- 172.21.15.45:0/1620142690 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55b685d3f600 con 0x55b685fec800 2023-12-19T17:57:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 9.18 9:18000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27c00 con 0x564329d26000 2023-12-19T17:57:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d4df1b3400 0x55d4dedfdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 9.e 9:70000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3800 con 0x55d4df1b3400 2023-12-19T17:57:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecbd29800 2023-12-19T17:57:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559891726400 0x55989171cb00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d4df1b3400 0x55d4dedfdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7ff50d98e700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x558ecb1a6000 0x558ecb1ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7ff50d98e700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:2 9.29 9:94000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a6400 con 0x558ecb1a6000 2023-12-19T17:57:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d277ff1000 0x55d27800c580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(3 [pgnls start_epoch 68 out=81b] v66'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b3dd37700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b68605a400 0x55b685d89180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b3dd37700 1 -- 172.21.15.45:0/1620142690 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55b685d1aa80 con 0x55b685fec800 2023-12-19T17:57:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(18 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f982eccb700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:19 9.38 9:1c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b000 con 0x564329b99800 2023-12-19T17:57:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7fad93f67700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558e6bf35400 0x558e6bc8b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7fad93f67700 1 -- 172.21.15.45:0/4127395730 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x558e6bc1ca80 con 0x558e6bf34c00 2023-12-19T17:57:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558e6bf35400 0x558e6bc8b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:4 9.3d 9:bfcd3380:::10000000205.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277e89800 con 0x55d277ff1000 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b68605a400 0x55b685d89180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b685fed400 0x55b685d88680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 9.1b 9:db6db6db::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b685fed800 con 0x55b685fed400 2023-12-19T17:57:13.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x558ecb1a6000 0x558ecb1ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(4 10000000205.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(4 [pgnls start_epoch 68 out=81b] v66'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d4df1b3400 0x55d4dedfdb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614c351840 10 datascan.operator(): handling object 1099511628293.0 2023-12-19T17:57:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 9.3d 9:bfcd3380:::10000000205.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff1c00 con 0x55d277ff1000 2023-12-19T17:57:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(19 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cfc0 con 0x564329b99800 2023-12-19T17:57:13.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f982e4ca700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:20 9.4 9:20000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26800 con 0x564329b99000 2023-12-19T17:57:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.484+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 9.c 9:30604137:::100000001fc.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716400 con 0x559891726400 2023-12-19T17:57:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558e6bf35400 0x558e6bc8b700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x558e6bed8900 tx=0x558e6c9c4420 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(7 [pgnls start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1b3400 2023-12-19T17:57:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b68605a400 0x55b685d89180 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55b685ffe8a0 tx=0x55b686b64de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b685fed400 0x55b685d88680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 4 datascan.main: data pool 'cephfs_data_extra' has ID 10 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558e6bf35800 0x558e6bc8a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:1 9.12 9:49249249::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6bf35c00 con 0x558e6bf35800 2023-12-19T17:57:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(5 100000001fc.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628284.0 2023-12-19T17:57:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 9.c 9:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716800 con 0x559891726400 2023-12-19T17:57:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17dfdf6700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 9.2e 9:74000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df055400 con 0x55d4df1b3400 2023-12-19T17:57:13.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558e6bf35800 0x558e6bc8a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x558ecb1a6000 0x558ecb1ac000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(20 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99000 2023-12-19T17:57:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f982eccb700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x564329d26400 0x564329d22b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f982eccb700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:21 9.24 9:24000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b800 con 0x564329d26400 2023-12-19T17:57:13.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b685fed400 0x55b685d88680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(8 [pgnls start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1b3400 2023-12-19T17:57:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17e05f7700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d4df055400 0x55d4df1d2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17e05f7700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:9 9.1e 9:78000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3800 con 0x55d4df055400 2023-12-19T17:57:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x564329d26400 0x564329d22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b686b58b40 con 0x55b685fed400 2023-12-19T17:57:13.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7ff50e18f700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558ecb1a6c00 0x558ecb1ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558e6bf35800 0x558e6bc8a100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7ff50e18f700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:3 9.19 9:98000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7000 con 0x558ecb1a6c00 2023-12-19T17:57:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d4df055400 0x55d4df1d2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b3ed39700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b68605a800 0x55b685d89700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b3ed39700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:2 9.3b 9:dc000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605ac00 con 0x55b68605a800 2023-12-19T17:57:13.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7ff512998700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558ecb1a6c00 0x558ecb1ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(5 10000000205.00000000 [call] v68'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f98334d4700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x564329d26400 0x564329d22b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b68605a800 0x55b685d89700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:6 9.3 9:c0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c000 con 0x55d277ff1000 2023-12-19T17:57:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad94f69700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558e6c04e000 0x558e6c054000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad94f69700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:2 9.32 9:4c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04e400 con 0x558e6c04e000 2023-12-19T17:57:13.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d4df055400 0x55d4df1d2000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(21 [pgnls start_epoch 68 out=49b] v66'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cb40 con 0x564329d26400 2023-12-19T17:57:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(6 100000001fc.00000000 [call] v68'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:22 10.0 10:00000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26c00 con 0x564329d26000 2023-12-19T17:57:13.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(6 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b68605a800 0x55b685d89700 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.2c 9:34000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716c00 con 0x559891726400 2023-12-19T17:57:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7ff512998700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558ecb1a6c00 0x558ecb1ac580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7f6146304700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d277ff1800 0x55d27800cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f6146304700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.23 9:c4000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff1400 con 0x55d277ff1800 2023-12-19T17:57:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.488+0000 7fad9a774700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558e6c04e000 0x558e6c054000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(9 [pgnls start_epoch 68 out=81b] v66'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:10 9.1e 9:789b801b:::1000000020c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3c00 con 0x55d4df055400 2023-12-19T17:57:13.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(7 [pgnls start_epoch 68 out=81b] v66'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 9.2c 9:37389ade:::10000000209.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891717000 con 0x559891726400 2023-12-19T17:57:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f614a30c700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d277ff1800 0x55d27800cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(2 [pgnls start_epoch 68 out=81b] v66'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad9a774700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558e6c04e000 0x558e6c054000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:3 9.3b 9:deccbd37:::100000001fe.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b685fedc00 con 0x55b68605a800 2023-12-19T17:57:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(22 [pgnls start_epoch 68 out=101b] v66'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(10 1000000020c.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628300.0 2023-12-19T17:57:13.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:11 9.1e 9:789b801b:::1000000020c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b2400 con 0x55d4df055400 2023-12-19T17:57:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:23 10.0 10:012cdbc7:::10000000206.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27000 con 0x564329d26000 2023-12-19T17:57:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(3 [pgnls start_epoch 68 out=101b] v66'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:4 9.19 9:992a6246:::10000000200.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7800 con 0x558ecb1a6c00 2023-12-19T17:57:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad9a774700 1 -- 172.21.15.45:0/4127395730 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(2 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52d80 con 0x558e6c04e000 2023-12-19T17:57:13.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad9576a700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:3 9.a 9:50000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04ec00 con 0x558e6bf35800 2023-12-19T17:57:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(3 100000001fe.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628286.0 2023-12-19T17:57:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:4 9.3b 9:deccbd37:::100000001fe.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605b400 con 0x55b68605a800 2023-12-19T17:57:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(8 10000000209.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628297.0 2023-12-19T17:57:13.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:9 9.2c 9:37389ade:::10000000209.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891717400 con 0x559891726400 2023-12-19T17:57:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(23 10000000206.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628294.0 2023-12-19T17:57:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:24 9.0 9:012cdbc7:::10000000206.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27400 con 0x564329b99000 2023-12-19T17:57:13.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(4 10000000200.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(3 [pgnls start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628288.0 2023-12-19T17:57:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 9.19 9:992a6246:::10000000200.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7c00 con 0x558ecb1a6c00 2023-12-19T17:57:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad94f69700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558e6c04e800 0x558e6c054580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad94f69700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:4 9.2a 9:54000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04f000 con 0x558e6c04e800 2023-12-19T17:57:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f614a30c700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d277ff1800 0x55d27800cb00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558e6c04e800 0x558e6c054580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(7 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12b40 con 0x55d277ff1800 2023-12-19T17:57:13.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f6145b03700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 9.13 9:c8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0c00 con 0x55d277ff1000 2023-12-19T17:57:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558e6c04e800 0x558e6c054580 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(8 [pgnls start_epoch 68 out=81b] v66'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.492+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 9.13 9:ca8fdbba:::100000001fb.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c400 con 0x55d277ff1000 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(11 1000000020c.00000000 [call] v68'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d4df1b3800 0x55d4dedfd600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:12 9.3e 9:7c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3c00 con 0x55d4df1b3800 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(4 [pgnls start_epoch 68 out=101b] v66'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(9 100000001fb.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614c351840 10 datascan.operator(): handling object 1099511628283.0 2023-12-19T17:57:13.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 9.13 9:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c800 con 0x55d277ff1000 2023-12-19T17:57:13.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(24 10000000206.00000000 [call,setxattr (8)] v68'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99000 2023-12-19T17:57:13.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 10.0 10:04f22c1d::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27800 con 0x564329d26000 2023-12-19T17:57:13.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 9.2a 9:55a6cd83:::1000000020a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04fc00 con 0x558e6c04e800 2023-12-19T17:57:13.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d4df1b3800 0x55d4dedfd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(5 1000000020a.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628298.0 2023-12-19T17:57:13.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 9.2a 9:55a6cd83:::1000000020a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04f000 con 0x558e6c04e800 2023-12-19T17:57:13.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(4 100000001fe.00000000 [call] v68'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(25 [pgnls start_epoch 68 out=101b] v66'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 10.0 10:04f22c1d:::1000000020a.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27c00 con 0x564329d26000 2023-12-19T17:57:13.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b68605b800 0x55b685d88c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(9 10000000209.00000000 [call] v68'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559891717800 0x559891461180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:5 9.7 9:e0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605bc00 con 0x55b68605b800 2023-12-19T17:57:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d4df1b3800 0x55d4dedfd600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(26 1000000020a.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628298.1 2023-12-19T17:57:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 9.2a 9:55a6cd83:::1000000020a.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26c00 con 0x564329b99800 2023-12-19T17:57:13.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:10 9.1c 9:38000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727400 con 0x559891717800 2023-12-19T17:57:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(5 10000000200.00000000 [call] v68'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f05f31f8700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559891717800 0x559891461180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 9.19 9:997b7129::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7000 con 0x558ecb1a6c00 2023-12-19T17:57:13.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(10 100000001fb.00000000 [call] v68'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b68605b800 0x55b685d88c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(12 [pgnls start_epoch 68 out=49b] v66'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b3800 2023-12-19T17:57:13.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d27801cc00 0x55d277c33b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e05f7700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:13 9.1 9:80000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df055800 con 0x55d4df1b3800 2023-12-19T17:57:13.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:11 9.33 9:cc000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d000 con 0x55d27801cc00 2023-12-19T17:57:13.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(6 [pgnls start_epoch 68 out=81b] v68'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d27801cc00 0x55d277c33b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b68605b800 0x55b685d88c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.19 9:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7800 con 0x558ecb1a6c00 2023-12-19T17:57:13.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(13 [pgnls start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b3800 2023-12-19T17:57:13.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f05f31f8700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559891717800 0x559891461180 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(6 1000000020a.00000000 [call] v68'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.2a 9:57fe7535::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04fc00 con 0x558e6c04e800 2023-12-19T17:57:13.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17dfdf6700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d4df1b2800 0x55d4df1d2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.496+0000 7f17dfdf6700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:14 9.21 9:84000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b2c00 con 0x55d4df1b2800 2023-12-19T17:57:13.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(7 100000001f8.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T17:57:13.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d4df1b2800 0x55d4df1d2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 9.19 9:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7c00 con 0x558ecb1a6c00 2023-12-19T17:57:13.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614b30e700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d27801cc00 0x55d277c33b80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(5 [pgnls start_epoch 68 out=101b] v66'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:6 9.7 9:e15a914f:::10000000207.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605ac00 con 0x55b68605b800 2023-12-19T17:57:13.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(10 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cd80 con 0x559891717800 2023-12-19T17:57:13.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05ee1ee700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:11 9.3c 9:3c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727000 con 0x559891726800 2023-12-19T17:57:13.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(11 [pgnls start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f6145b03700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 9.b 9:d0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0800 con 0x55d277ff0400 2023-12-19T17:57:13.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(6 10000000207.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(7 [pgnls start_epoch 68 out=81b] v68'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d4df1b2800 0x55d4df1d2580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(11 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cfc0 con 0x559891726800 2023-12-19T17:57:13.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 9.2a 9:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064000 con 0x558e6c04e800 2023-12-19T17:57:13.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628295.0 2023-12-19T17:57:13.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(12 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12d80 con 0x55d277ff0400 2023-12-19T17:57:13.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f6146304700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:13 9.2b 9:d4000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff1c00 con 0x55d277ff1000 2023-12-19T17:57:13.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05ed9ed700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:12 9.2 9:40000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727800 con 0x559891726400 2023-12-19T17:57:13.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:7 9.7 9:e15a914f:::10000000207.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605b400 con 0x55b68605b800 2023-12-19T17:57:13.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(8 100000001f6.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T17:57:13.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:9 9.2a 9:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064400 con 0x558e6c04e800 2023-12-19T17:57:13.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(12 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(14 [pgnls start_epoch 68 out=49b] v66'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1b2800 2023-12-19T17:57:13.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17e05f7700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 9.11 9:88000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3000 con 0x55d4df1b3400 2023-12-19T17:57:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(8 100000001f8.00000000 [call] v68'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558ecb1a7000 0x558ecaed5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(13 [pgnls start_epoch 68 out=81b] v66'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:14 9.2b 9:d4a58307:::10000000203.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d400 con 0x55d277ff1000 2023-12-19T17:57:13.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 9.39 9:9c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7800 con 0x558ecb1a7000 2023-12-19T17:57:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05ee1ee700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x559891726000 0x55989171d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05ee1ee700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:13 9.22 9:44000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727400 con 0x559891726000 2023-12-19T17:57:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(27 1000000020a.00000000 [call,setxattr (8)] v68'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cfc0 con 0x564329b99800 2023-12-19T17:57:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:28 10.0 10:05552577::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26800 con 0x564329d26000 2023-12-19T17:57:13.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x559891726000 0x55989171d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(15 [pgnls start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1b3400 2023-12-19T17:57:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7ff512197700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558ecb1a7000 0x558ecaed5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(14 10000000203.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17dfdf6700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d4df1ea000 0x55d4df1d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f17dfdf6700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:16 9.31 9:8c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ea400 con 0x55d4df1ea000 2023-12-19T17:57:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614c351840 10 datascan.operator(): handling object 1099511628291.0 2023-12-19T17:57:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.500+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 9.2b 9:d4a58307:::10000000203.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d800 con 0x55d277ff1000 2023-12-19T17:57:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(28 [pgnls start_epoch 68 out=81b] v66'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(9 100000001f6.00000000 [call] v68'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d4df1ea000 0x55d4df1d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:29 10.0 10:05552577:::1000000020b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27400 con 0x564329d26000 2023-12-19T17:57:13.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05f29f7700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x559891726000 0x55989171d600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:10 9.1a 9:58000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064800 con 0x558e6c04e800 2023-12-19T17:57:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff512197700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558ecb1a7000 0x558ecaed5b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(10 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(7 10000000207.00000000 [call] v68'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:8 9.7 9:e2e07930::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b685fedc00 con 0x55b68605b800 2023-12-19T17:57:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad9576a700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558e6c04f000 0x558e6c055080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad9576a700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:11 9.3a 9:5c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04fc00 con 0x558e6c04f000 2023-12-19T17:57:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(29 1000000020b.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628299.0 2023-12-19T17:57:13.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:30 9.20 9:05552577:::1000000020b.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b400 con 0x564329c0ac00 2023-12-19T17:57:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(13 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cfc0 con 0x559891726000 2023-12-19T17:57:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e4e00700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d4df1ea000 0x55d4df1d2b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05ed9ed700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 9.12 9:48000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727c00 con 0x559891726800 2023-12-19T17:57:13.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(9 [pgnls start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecb1a7000 2023-12-19T17:57:13.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558e6c04f000 0x558e6c055080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff50d98e700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:10 9.5 9:a0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a6800 con 0x558ecbd29800 2023-12-19T17:57:13.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(8 [pgnls start_epoch 68 out=81b] v68'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(16 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df1ea000 2023-12-19T17:57:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e05f7700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:17 9.9 9:90000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3c00 con 0x55d4df055400 2023-12-19T17:57:13.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(14 [pgnls start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cfc0 con 0x559891726800 2023-12-19T17:57:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(10 [pgnls start_epoch 68 out=81b] v66'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecbd29800 2023-12-19T17:57:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:11 9.5 9:a0beda95:::10000000204.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7800 con 0x558ecbd29800 2023-12-19T17:57:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:9 9.7 9:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605bc00 con 0x55b68605b800 2023-12-19T17:57:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad99772700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558e6c04f000 0x558e6c055080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:15 10.4 10:24924924::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716400 con 0x559891717800 2023-12-19T17:57:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(17 [pgnls start_epoch 68 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(9 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b45587840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T17:57:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:10 9.7 9:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605ac00 con 0x55b68605b800 2023-12-19T17:57:13.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(15 10000000203.00000000 [call] v68'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(15 [pgnls start_epoch 68 out=81b] v66'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55989219cd80 con 0x559891717800 2023-12-19T17:57:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(11 10000000204.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecbd29800 2023-12-19T17:57:13.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:16 9.1b 9:d8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801dc00 con 0x55d277ff1800 2023-12-19T17:57:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d4df1b2400 0x55d4df1d3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 10.16 10:6db6db6d::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eac00 con 0x55d4df1b2400 2023-12-19T17:57:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:16 10.4 10:24ae92ec:::100000001fb.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716800 con 0x559891717800 2023-12-19T17:57:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(30 1000000020b.00000000 [call,setxattr (8)] v68'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(11 [pgnls start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6c04f000 2023-12-19T17:57:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628292.0 2023-12-19T17:57:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 9.5 9:a0beda95:::10000000204.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a6800 con 0x558ecbd29800 2023-12-19T17:57:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:31 10.10 10:08000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b800 con 0x564329b99400 2023-12-19T17:57:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7fad94f69700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:12 9.6 9:60000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04f400 con 0x558e6bf35800 2023-12-19T17:57:13.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.504+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d4df1b2400 0x55d4df1d3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(16 100000001fb.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cd80 con 0x559891717800 2023-12-19T17:57:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628283.1 2023-12-19T17:57:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 9.13 9:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716c00 con 0x559891726000 2023-12-19T17:57:13.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(16 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12b40 con 0x55d277ff1800 2023-12-19T17:57:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(31 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99400 2023-12-19T17:57:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:32 10.10 10:08b99fea:::100000001fd.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0b400 con 0x564329b99400 2023-12-19T17:57:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:17 10.d 10:b6db6db6::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c400 con 0x55d27801cc00 2023-12-19T17:57:13.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f17e45ff700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d4df1b2400 0x55d4df1d3600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(12 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad9576a700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:13 9.26 9:64000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04ec00 con 0x558e6bf35800 2023-12-19T17:57:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(17 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f6145b03700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d277ff1400 0x55d27800d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f6145b03700 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:18 10.1d 10:b8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277e89400 con 0x55d277ff1400 2023-12-19T17:57:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(32 100000001fd.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99400 2023-12-19T17:57:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628285.0 2023-12-19T17:57:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(18 [pgnls start_epoch 68 out=101b] v66'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b2400 2023-12-19T17:57:13.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:33 9.10 9:08b99fea:::100000001fd.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27000 con 0x564329b99400 2023-12-19T17:57:13.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:19 10.16 10:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb000 con 0x55d4df1b2400 2023-12-19T17:57:13.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d277ff1400 0x55d27800d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(13 [pgnls start_epoch 68 out=81b] v66'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 9.26 9:658f2455:::100000001ff.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064c00 con 0x558e6bf35800 2023-12-19T17:57:13.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(10 10000000001.00000000 [call] v68'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:11 9.27 9:e4000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605b400 con 0x55b68605a800 2023-12-19T17:57:13.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(19 100000001f9.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b2400 2023-12-19T17:57:13.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T17:57:13.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:20 9.36 9:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb400 con 0x55d4df055000 2023-12-19T17:57:13.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(14 100000001ff.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628287.0 2023-12-19T17:57:13.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:15 9.26 9:658f2455:::100000001ff.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065000 con 0x558e6bf35800 2023-12-19T17:57:13.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614ab0d700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d277ff1400 0x55d27800d600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(12 10000000204.00000000 [call] v68'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecbd29800 2023-12-19T17:57:13.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 9.25 9:a4000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecbd29c00 con 0x558ecbd29800 2023-12-19T17:57:13.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(11 [pgnls start_epoch 68 out=81b] v66'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:12 9.27 9:e5993619:::10000000208.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616a000 con 0x55b68605a800 2023-12-19T17:57:13.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(17 100000001fb.00000000 [call,setxattr (8)] v68'18 uv18 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55989219cfc0 con 0x559891726000 2023-12-19T17:57:13.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:18 10.14 10:28000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716000 con 0x559891717c00 2023-12-19T17:57:13.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(13 [pgnls start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecbd29800 2023-12-19T17:57:13.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7ff50d98e700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:14 9.15 9:a8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1be000 con 0x558ecb1a6000 2023-12-19T17:57:13.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(12 10000000208.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628296.0 2023-12-19T17:57:13.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:13 9.27 9:e5993619:::10000000208.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616a400 con 0x55b68605a800 2023-12-19T17:57:13.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(18 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1400 2023-12-19T17:57:13.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.508+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:19 10.1d 10:b9a363c8:::1000000020d.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c800 con 0x55d277ff1400 2023-12-19T17:57:13.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(18 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cd80 con 0x559891717c00 2023-12-19T17:57:13.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05ee1ee700 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 10.c 10:30000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5598913b9400 con 0x559891726000 2023-12-19T17:57:13.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(14 [pgnls start_epoch 68 out=81b] v66'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 9.15 9:a8e69ea8:::1000000020d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bec00 con 0x558ecb1a6000 2023-12-19T17:57:13.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(19 1000000020d.00000001 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1400 2023-12-19T17:57:13.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f614c351840 10 datascan.operator(): handling object 1099511628301.1 2023-12-19T17:57:13.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(20 100000001f9.00000000 [call,setxattr (8)] v68'20 uv20 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:20 9.15 9:a8e69ea8:::1000000020d.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d400 con 0x55d277ff1000 2023-12-19T17:57:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:21 10.16 10:6fe38dc2::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb800 con 0x55d4df1b2400 2023-12-19T17:57:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(15 1000000020d.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(33 100000001fd.00000000 [call,setxattr (8)] v68'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99400 2023-12-19T17:57:13.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628301.0 2023-12-19T17:57:13.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 9.15 9:a8e69ea8:::1000000020d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bf000 con 0x558ecb1a6000 2023-12-19T17:57:13.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:34 10.8 10:10000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27800 con 0x564329c0ac00 2023-12-19T17:57:13.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(19 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55989219cfc0 con 0x559891726000 2023-12-19T17:57:13.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:20 10.c 10:30604137:::100000001fc.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891726c00 con 0x559891726000 2023-12-19T17:57:13.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(21 [pgnls start_epoch 68 out=81b] v66'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b2400 2023-12-19T17:57:13.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:22 10.16 10:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ebc00 con 0x55d4df1b2400 2023-12-19T17:57:13.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(15 100000001ff.00000000 [call] v68'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(34 [pgnls start_epoch 68 out=101b] v66'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(20 100000001fc.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cfc0 con 0x559891726000 2023-12-19T17:57:13.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628284.0 2023-12-19T17:57:13.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:21 9.c 9:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727000 con 0x559891726400 2023-12-19T17:57:13.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:16 9.16 9:68000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065400 con 0x558e6c04e000 2023-12-19T17:57:13.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:35 10.8 10:101c2845:::100000001fe.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27c00 con 0x564329c0ac00 2023-12-19T17:57:13.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(22 100000001f7.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b2400 2023-12-19T17:57:13.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(13 10000000208.00000000 [call] v68'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T17:57:13.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:23 9.36 9:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eac00 con 0x55d4df055000 2023-12-19T17:57:13.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(35 100000001fe.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7fad9a774700 1 -- 172.21.15.45:0/4127395730 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(16 [pgnls start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52d80 con 0x558e6c04e000 2023-12-19T17:57:13.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b68616a800 0x55b686170000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:14 9.17 9:e8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616ac00 con 0x55b68616a800 2023-12-19T17:57:13.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628286.1 2023-12-19T17:57:13.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:36 9.3b 9:deccbd37:::100000001fe.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d26800 con 0x564329d26400 2023-12-19T17:57:13.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7fad9576a700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558e6c04fc00 0x558e6c055600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7fad9576a700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:17 9.36 9:6c000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6bf35c00 con 0x558e6c04fc00 2023-12-19T17:57:13.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b68616a800 0x55b686170000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.512+0000 7fad9a774700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558e6c04fc00 0x558e6c055600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(21 100000001fc.00000000 [call,setxattr (8)] v68'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 10.c 10:37389ade::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727400 con 0x559891726000 2023-12-19T17:57:13.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(20 1000000020d.00000000 [call,setxattr (8)] v68'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:21 10.1d 10:bbb18289::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d000 con 0x55d277ff1400 2023-12-19T17:57:13.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b68616a800 0x55b686170000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7fad9a774700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558e6c04fc00 0x558e6c055600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(36 100000001fe.00000000 [call,setxattr (8)] v68'7 uv7 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cb40 con 0x564329d26400 2023-12-19T17:57:13.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(21 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1400 2023-12-19T17:57:13.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(22 [pgnls start_epoch 68 out=81b] v66'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55989219cfc0 con 0x559891726000 2023-12-19T17:57:13.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:37 10.8 10:1247e94b::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27400 con 0x564329c0ac00 2023-12-19T17:57:13.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:23 10.c 10:37389ade:::10000000209.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727800 con 0x559891726000 2023-12-19T17:57:13.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(23 10000000209.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cfc0 con 0x559891726000 2023-12-19T17:57:13.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7fad9a774700 1 -- 172.21.15.45:0/4127395730 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(17 [pgnls start_epoch 68 out=101b] v68'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558e6ca52d80 con 0x558e6c04fc00 2023-12-19T17:57:13.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558e6c065800 0x558e6bc89b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 10.12 10:49249249::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065c00 con 0x558e6c065800 2023-12-19T17:57:13.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(23 100000001f7.00000000 [call,setxattr (8)] v68'21 uv21 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:24 10.e 10:70000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb000 con 0x55d4df1ea000 2023-12-19T17:57:13.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:22 10.1d 10:bbb18289:::10000000204.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c000 con 0x55d277ff1400 2023-12-19T17:57:13.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(22 10000000204.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1400 2023-12-19T17:57:13.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(14 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b686b58b40 con 0x55b68616a800 2023-12-19T17:57:13.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f4b3f53a700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b686178000 0x55b686171b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f4b3f53a700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 9.37 9:ec000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178400 con 0x55b686178000 2023-12-19T17:57:13.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614c351840 10 datascan.operator(): handling object 1099511628292.1 2023-12-19T17:57:13.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:23 9.5 9:a0beda95:::10000000204.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0c00 con 0x55d277ff0400 2023-12-19T17:57:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628297.0 2023-12-19T17:57:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:24 9.2c 9:37389ade:::10000000209.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891727000 con 0x559891726400 2023-12-19T17:57:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558e6c065800 0x558e6bc89b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(16 1000000020d.00000000 [call] v68'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b686178000 0x55b686171b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(24 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df1ea000 2023-12-19T17:57:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f17e05f7700 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 10.1e 10:78000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ec000 con 0x55d4df055400 2023-12-19T17:57:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(37 [pgnls start_epoch 68 out=101b] v66'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:38 10.8 10:1247e94b:::100000001f9.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3e000 con 0x564329c0ac00 2023-12-19T17:57:13.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7fad99f73700 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558e6c065800 0x558e6bc89b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558ecb1bf400 0x558ecaed5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:17 9.35 9:ac000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bf800 con 0x558ecb1bf400 2023-12-19T17:57:13.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(25 [pgnls start_epoch 68 out=101b] v66'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.516+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558ecb1bf400 0x558ecaed5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(18 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(38 100000001f9.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628281.1 2023-12-19T17:57:13.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:39 9.36 9:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3e400 con 0x564329b99000 2023-12-19T17:57:13.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558ecb1bf400 0x558ecaed5600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:26 10.1e 10:789b801b:::1000000020c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb400 con 0x55d4df055400 2023-12-19T17:57:13.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad9576a700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:19 10.a 10:50000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04e400 con 0x558e6c065800 2023-12-19T17:57:13.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(26 1000000020c.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b44544700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b686178000 0x55b686171b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(17 [pgnls start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1bf400 2023-12-19T17:57:13.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628300.0 2023-12-19T17:57:13.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 9.1e 9:789b801b:::1000000020c.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb800 con 0x55d4df055400 2023-12-19T17:57:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff50d98e700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 9.d 9:b0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1be400 con 0x558ecb1a6000 2023-12-19T17:57:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(23 10000000204.00000000 [call,setxattr (8)] v68'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12d80 con 0x55d277ff0400 2023-12-19T17:57:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(15 [pgnls start_epoch 68 out=49b] v66'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b686b58d80 con 0x55b686178000 2023-12-19T17:57:13.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:24 10.1d 10:bfcd3380::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff1c00 con 0x55d277ff1400 2023-12-19T17:57:13.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(19 [pgnls start_epoch 68 out=101b] v66'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b3ed39700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:16 9.f 9:f0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605b000 con 0x55b68605b800 2023-12-19T17:57:13.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:20 10.a 10:5097359c:::100000001fd.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064400 con 0x558e6c065800 2023-12-19T17:57:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(18 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(16 [pgnls start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff50e18f700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558ecb1a7400 0x558ecb1acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff50e18f700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:19 9.2d 9:b4000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1be000 con 0x558ecb1a7400 2023-12-19T17:57:13.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(20 100000001fd.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628285.1 2023-12-19T17:57:13.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:21 9.10 9:08b99fea:::100000001fd.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064800 con 0x558e6c04e000 2023-12-19T17:57:13.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(24 10000000209.00000000 [call,setxattr (8)] v68'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(24 [pgnls start_epoch 68 out=81b] v66'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1400 2023-12-19T17:57:13.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:25 10.1d 10:bfcd3380:::10000000205.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c400 con 0x55d277ff1400 2023-12-19T17:57:13.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b3f53a700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:17 9.2f 9:f4000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178800 con 0x55b685fed400 2023-12-19T17:57:13.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x559891727c00 0x55989171e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 10.1c 10:38000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891726c00 con 0x559891727c00 2023-12-19T17:57:13.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(39 100000001f9.00000000 [call,setxattr (8)] v68'22 uv22 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cb40 con 0x564329b99000 2023-12-19T17:57:13.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:40 10.8 10:15246602::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3e800 con 0x564329c0ac00 2023-12-19T17:57:13.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff512998700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558ecb1a7400 0x558ecb1acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(25 10000000205.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1400 2023-12-19T17:57:13.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614c351840 10 datascan.operator(): handling object 1099511628293.0 2023-12-19T17:57:13.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:26 9.3d 9:bfcd3380:::10000000205.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d800 con 0x55d277ff1000 2023-12-19T17:57:13.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x559891727c00 0x55989171e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(17 [pgnls start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b686b58b40 con 0x55b685fed400 2023-12-19T17:57:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b3ed39700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b68605bc00 0x55b686172100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b3ed39700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:18 9.1f 9:f8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b685fed800 con 0x55b68605bc00 2023-12-19T17:57:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff512998700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558ecb1a7400 0x558ecb1acb00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(40 [pgnls start_epoch 68 out=101b] v66'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:41 10.8 10:15246602:::10000000202.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3ec00 con 0x564329c0ac00 2023-12-19T17:57:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b68605bc00 0x55b686172100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(41 10000000202.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.520+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(19 [pgnls start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a7400 2023-12-19T17:57:13.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628290.0 2023-12-19T17:57:13.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(27 1000000020c.00000000 [call,setxattr (8)] v68'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:42 9.28 9:15246602:::10000000202.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3f000 con 0x564329d26000 2023-12-19T17:57:13.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:28 10.1e 10:7ac44a97::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df055800 con 0x55d4df055400 2023-12-19T17:57:13.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558ecb1bfc00 0x558ecb1ad600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:20 10.9 10:92492492::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c8000 con 0x558ecb1bfc00 2023-12-19T17:57:13.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f05f21f6700 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x559891727c00 0x55989171e100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b43d43700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b68605bc00 0x55b686172100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad9a774700 1 -- 172.21.15.45:0/4127395730 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(21 100000001fd.00000000 [call,setxattr (8)] v68'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558e6ca52d80 con 0x558e6c04e000 2023-12-19T17:57:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:22 10.a 10:55a6cd83::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065c00 con 0x558e6c065800 2023-12-19T17:57:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7ff512197700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558ecb1bfc00 0x558ecb1ad600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(28 [pgnls start_epoch 68 out=81b] v66'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 10.1e 10:7ac44a97:::10000000207.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ec000 con 0x55d4df055400 2023-12-19T17:57:13.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(18 [pgnls start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605bc00 2023-12-19T17:57:13.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(25 [pgnls start_epoch 68 out=81b] v66'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55989219cb40 con 0x559891727c00 2023-12-19T17:57:13.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 10.1c 10:3d6db04b:::100000001f6.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5598913b9400 con 0x559891727c00 2023-12-19T17:57:13.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b3f53a700 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:19 9.3f 9:fc000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68605ac00 con 0x55b68605a800 2023-12-19T17:57:13.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(26 10000000205.00000000 [call,setxattr (8)] v68'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(29 10000000207.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:27 10.3 10:c0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c800 con 0x55d277e89000 2023-12-19T17:57:13.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(22 [pgnls start_epoch 68 out=101b] v66'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628295.1 2023-12-19T17:57:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d4df1ed000 0x55d4df1d3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:30 9.7 9:e15a914f:::10000000207.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ed400 con 0x55d4df1ed000 2023-12-19T17:57:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(26 100000001f6.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cb40 con 0x559891727c00 2023-12-19T17:57:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628278.1 2023-12-19T17:57:13.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 9.2a 9:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891717000 con 0x559891726400 2023-12-19T17:57:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:23 10.a 10:55a6cd83:::1000000020a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065400 con 0x558e6c065800 2023-12-19T17:57:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(19 [pgnls start_epoch 68 out=81b] v66'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:20 9.3f 9:feb1c803:::100000001fa.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616b000 con 0x55b68605a800 2023-12-19T17:57:13.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d4df1ed000 0x55d4df1d3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7ff512197700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558ecb1bfc00 0x558ecb1ad600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(20 100000001fa.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(23 1000000020a.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628282.0 2023-12-19T17:57:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:21 9.3f 9:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616b400 con 0x55b68605a800 2023-12-19T17:57:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(42 10000000202.00000000 [call,setxattr (8)] v68'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628298.0 2023-12-19T17:57:13.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:24 9.2a 9:55a6cd83:::1000000020a.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064c00 con 0x558e6c04e800 2023-12-19T17:57:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(20 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecb1bfc00 2023-12-19T17:57:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:43 10.8 10:177a762d::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3f400 con 0x564329c0ac00 2023-12-19T17:57:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7ff50e18f700 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:21 10.19 10:98000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bec00 con 0x558ecb1bf400 2023-12-19T17:57:13.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f17e5601700 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d4df1ed000 0x55d4df1d3b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(27 [pgnls start_epoch 68 out=81b] v66'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12b40 con 0x55d277e89000 2023-12-19T17:57:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(43 [pgnls start_epoch 68 out=81b] v66'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:44 10.8 10:177a762d:::10000000201.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3f800 con 0x564329c0ac00 2023-12-19T17:57:13.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.524+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:28 10.3 10:c1028715:::10000000202.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d400 con 0x55d277e89000 2023-12-19T17:57:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(44 10000000201.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628289.0 2023-12-19T17:57:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:45 9.28 9:177a762d:::10000000201.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3fc00 con 0x564329d26000 2023-12-19T17:57:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(21 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1bf400 2023-12-19T17:57:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:22 10.19 10:992a6246:::10000000200.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c8400 con 0x558ecb1bf400 2023-12-19T17:57:13.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(28 10000000202.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12b40 con 0x55d277e89000 2023-12-19T17:57:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f614c351840 10 datascan.operator(): handling object 1099511628290.1 2023-12-19T17:57:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(22 10000000200.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1bf400 2023-12-19T17:57:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628288.0 2023-12-19T17:57:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:23 9.19 9:992a6246:::10000000200.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c8800 con 0x558ecb1a6c00 2023-12-19T17:57:13.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:29 9.28 9:15246602:::10000000202.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d000 con 0x55d27801cc00 2023-12-19T17:57:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(21 100000001fa.00000000 [call] v68'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:22 10.1b 10:db6db6db::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616b800 con 0x55b685fed400 2023-12-19T17:57:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(27 100000001f6.00000000 [call,setxattr (8)] v68'15 uv15 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:28 10.2 10:40000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891717400 con 0x559891717c00 2023-12-19T17:57:13.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(30 10000000207.00000000 [call,setxattr (8)] v68'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1ed000 2023-12-19T17:57:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:31 10.1 10:80000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ed800 con 0x55d4df1ea000 2023-12-19T17:57:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(22 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58b40 con 0x55b685fed400 2023-12-19T17:57:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:23 10.1b 10:deccbd37:::100000001fe.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616bc00 con 0x55b685fed400 2023-12-19T17:57:13.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(28 [pgnls start_epoch 68 out=81b] v66'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55989219cd80 con 0x559891717c00 2023-12-19T17:57:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(24 1000000020a.00000000 [call,setxattr (8)] v68'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:29 10.2 10:40d56c48:::100000001fc.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716c00 con 0x559891717c00 2023-12-19T17:57:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 10.a 10:57fe7535::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065000 con 0x558e6c065800 2023-12-19T17:57:13.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(23 100000001fe.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58b40 con 0x55b685fed400 2023-12-19T17:57:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628286.0 2023-12-19T17:57:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:24 9.3b 9:deccbd37:::100000001fe.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178800 con 0x55b68605a800 2023-12-19T17:57:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f31f8700 1 -- 172.21.15.45:0/3684686009 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(29 100000001fc.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55989219cd80 con 0x559891717c00 2023-12-19T17:57:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f423b840 10 datascan.operator(): handling object 1099511628284.1 2023-12-19T17:57:13.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:30 9.c 9:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716400 con 0x559891726400 2023-12-19T17:57:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(31 [pgnls start_epoch 68 out=101b] v66'2 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df1ea000 2023-12-19T17:57:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:32 10.1 10:8410d73e:::10000000201.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1edc00 con 0x55d4df1ea000 2023-12-19T17:57:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(32 10000000201.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df1ea000 2023-12-19T17:57:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628289.1 2023-12-19T17:57:13.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.528+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:33 9.28 9:177a762d:::10000000201.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ea400 con 0x55d4df1b2400 2023-12-19T17:57:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(25 [pgnls start_epoch 68 out=81b] v66'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 10.a 10:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064000 con 0x558e6c065800 2023-12-19T17:57:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(26 100000001f6.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T17:57:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(45 10000000201.00000000 [call,setxattr (8)] v68'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cd80 con 0x564329d26000 2023-12-19T17:57:13.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(24 100000001fe.00000000 [call,setxattr (8)] v68'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:46 10.18 10:18000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3e000 con 0x564329d26400 2023-12-19T17:57:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 9.2a 9:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04e400 con 0x558e6c04e800 2023-12-19T17:57:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b686178400 0x55b686170580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 10.7 10:e0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178c00 con 0x55b686178400 2023-12-19T17:57:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(46 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x56432a70cb40 con 0x564329d26400 2023-12-19T17:57:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f982eccb700 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:47 10.4 10:20000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329c0bc00 con 0x564329c0ac00 2023-12-19T17:57:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b686178400 0x55b686170580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(29 10000000202.00000000 [call,setxattr (8)] v68'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d27801c000 0x55d277c33600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:30 10.13 10:c8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277e89400 con 0x55d27801c000 2023-12-19T17:57:13.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(30 100000001fc.00000000 [call,setxattr (8)] v68'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55989219cb40 con 0x559891726400 2023-12-19T17:57:13.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:31 10.12 10:48000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x559891716800 con 0x559891727c00 2023-12-19T17:57:13.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(23 10000000200.00000000 [call,setxattr (8)] v68'15 uv15 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:24 10.19 10:997b7129::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c8c00 con 0x558ecb1bf400 2023-12-19T17:57:13.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(33 10000000201.00000000 [call,setxattr (8)] v68'14 uv14 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b2400 2023-12-19T17:57:13.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:34 10.1 10:848ebb0b::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb000 con 0x55d4df1ea000 2023-12-19T17:57:13.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f4b43542700 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b686178400 0x55b686170580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f614a30c700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d27801c000 0x55d277c33600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f21f6700 1 -- 172.21.15.45:0/3684686009 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(31 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55989219cb40 con 0x559891727c00 2023-12-19T17:57:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559891717800 msgr2=0x559891461180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559891717800 0x559891461180 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(27 100000001f6.00000000 [call,setxattr (8)] v68'17 uv17 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c04e800 2023-12-19T17:57:13.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(47 [pgnls start_epoch 68 out=101b] v66'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x559891717c00 msgr2=0x55989171c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x559891717c00 0x55989171c000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5598921b5c00 msgr2=0x559891460c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5598921b5c00 0x559891460c00 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559891726400 msgr2=0x55989171cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x559891726400 0x55989171cb00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559891726800 msgr2=0x55989171c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 reap_dead start 2023-12-19T17:57:13.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559891726800 0x55989171c580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 10.4 10:2057972a:::100000001ff.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3e800 con 0x564329c0ac00 2023-12-19T17:57:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:28 10.1a 10:58000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064400 con 0x558e6c065800 2023-12-19T17:57:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x559891727c00 msgr2=0x55989171e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x559891727c00 0x55989171e100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x559891726000 msgr2=0x55989171d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x559891726000 0x55989171d600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(24 [pgnls start_epoch 68 out=81b] v66'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1bf400 2023-12-19T17:57:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(34 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df1ea000 2023-12-19T17:57:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5598921b5800 msgr2=0x559891461700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5598921b5800 0x559891461700 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55989226e930 tx=0x559892270c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 msgr2=0x559891460100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 0x559891460100 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55989226e6f0 tx=0x55989219e0c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:35 10.1 10:848ebb0b:::100000001f7.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3c00 con 0x55d4df1ea000 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 shutdown_connections 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5598921b5800 0x559891461700 secure :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55989226e930 tx=0x559892270c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x559891727c00 0x55989171e100 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598921b4c00 0x559891460100 secure :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0x55989226e6f0 tx=0x55989219e0c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x559891726000 0x55989171d600 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/3684686009 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559891726800 0x55989171c580 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 >> 172.21.15.45:0/3684686009 conn(0x5598921b4400 msgr2=0x5598914ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(25 [pgnls start_epoch 68 out=101b] v66'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(28 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.532+0000 7f614a30c700 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d27801c000 0x55d277c33600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad9576a700 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 10.6 10:60000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c04f400 con 0x558e6bf35800 2023-12-19T17:57:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 10.7 10:e15a914f:::10000000207.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179000 con 0x55b686178400 2023-12-19T17:57:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(48 100000001ff.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628287.1 2023-12-19T17:57:13.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:25 10.19 10:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c9000 con 0x558ecb1bf400 2023-12-19T17:57:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x564329d3ec00 0x564329d23600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:49 9.26 9:658f2455:::100000001ff.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3f000 con 0x564329d3ec00 2023-12-19T17:57:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f29f7700 1 -- 172.21.15.45:0/3684686009 reap_dead start 2023-12-19T17:57:13.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(35 100000001f7.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df1ea000 2023-12-19T17:57:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628279.1 2023-12-19T17:57:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:36 9.36 9:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ec000 con 0x55d4df055000 2023-12-19T17:57:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 shutdown_connections 2023-12-19T17:57:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/3684686009 wait complete. 2023-12-19T17:57:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(30 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d278a12b40 con 0x55d27801c000 2023-12-19T17:57:13.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(25 100000001f8.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1bf400 2023-12-19T17:57:13.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T17:57:13.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:31 10.13 10:ca8fdbba:::100000001fb.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0800 con 0x55d27801c000 2023-12-19T17:57:13.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 9.19 9:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c9400 con 0x558ecb1a6c00 2023-12-19T17:57:13.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x564329d3ec00 0x564329d23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(26 10000000207.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628295.0 2023-12-19T17:57:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:27 9.7 9:e15a914f:::10000000207.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179400 con 0x55b68605b800 2023-12-19T17:57:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(29 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:30 10.6 10:658f2455:::100000001ff.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065c00 con 0x558e6bf35800 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(31 100000001fb.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12b40 con 0x55d27801c000 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f614c351840 10 datascan.operator(): handling object 1099511628283.0 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:32 9.13 9:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0c00 con 0x55d277ff1000 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 msgr2=0x55989145f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 0x55989145f600 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x55989151f380 tx=0x55989219e120 comp rx=0 tx=0).stop 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(30 100000001ff.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628287.0 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:31 9.26 9:658f2455:::100000001ff.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065400 con 0x558e6bf35800 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 shutdown_connections 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5598921b4000 0x55989145f600 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5598913b9800 0x55989145fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 --2- 172.21.15.45:0/1232598177 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5598913b9c00 0x55989145f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 >> 172.21.15.45:0/1232598177 conn(0x5598913b8c00 msgr2=0x5598914cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 shutdown_connections 2023-12-19T17:57:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f9832cd3700 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x564329d3ec00 0x564329d23600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f05f423b840 1 -- 172.21.15.45:0/1232598177 wait complete. 2023-12-19T17:57:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(36 100000001f7.00000000 [call,setxattr (8)] v68'23 uv23 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df055000 2023-12-19T17:57:13.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.536+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:37 10.11 10:88000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ed800 con 0x55d4df1ed000 2023-12-19T17:57:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(27 10000000207.00000000 [call,setxattr (8)] v68'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:28 10.7 10:e2e07930::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179800 con 0x55b686178400 2023-12-19T17:57:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(37 [pgnls start_epoch 68 out=101b] v66'2 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1ed000 2023-12-19T17:57:13.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(26 100000001f8.00000000 [call,setxattr (8)] v68'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:38 10.11 10:893be98d:::100000001f8.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1ed400 con 0x55d4df1ed000 2023-12-19T17:57:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:27 10.5 10:a0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c9800 con 0x558ecb1a7400 2023-12-19T17:57:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(28 [pgnls start_epoch 68 out=101b] v66'7 uv7 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(38 100000001f8.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1ed000 2023-12-19T17:57:13.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628280.1 2023-12-19T17:57:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:29 10.7 10:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179c00 con 0x55b686178400 2023-12-19T17:57:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:39 9.19 9:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b2c00 con 0x55d4df1b3800 2023-12-19T17:57:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(27 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a7400 2023-12-19T17:57:13.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:28 10.5 10:a0beda95:::10000000204.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c9c00 con 0x558ecb1a7400 2023-12-19T17:57:13.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(29 10000000001.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b45587840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T17:57:13.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:30 9.7 9:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616ac00 con 0x55b68605b800 2023-12-19T17:57:13.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(28 10000000204.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a7400 2023-12-19T17:57:13.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628292.0 2023-12-19T17:57:13.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 9.5 9:a0beda95:::10000000204.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c8800 con 0x558ecbd29800 2023-12-19T17:57:13.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(32 100000001fb.00000000 [call,setxattr (8)] v68'19 uv19 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:33 10.13 10:cb24bee2::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801dc00 con 0x55d27801c000 2023-12-19T17:57:13.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7fad99772700 1 -- 172.21.15.45:0/4127395730 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(31 100000001ff.00000000 [call,setxattr (8)] v68'18 uv18 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558e6ca52b40 con 0x558e6bf35800 2023-12-19T17:57:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 10.16 10:68000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c064c00 con 0x558e6c065800 2023-12-19T17:57:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(33 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d278a12b40 con 0x55d27801c000 2023-12-19T17:57:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:34 10.13 10:cb24bee2:::100000001fa.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c800 con 0x55d27801c000 2023-12-19T17:57:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(32 [pgnls start_epoch 68 out=101b] v66'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:33 10.16 10:6bb58479:::10000000206.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c065000 con 0x558e6c065800 2023-12-19T17:57:13.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(34 100000001fa.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12b40 con 0x55d27801c000 2023-12-19T17:57:13.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614c351840 10 datascan.operator(): handling object 1099511628282.1 2023-12-19T17:57:13.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.540+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:35 9.3f 9:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801d400 con 0x55d277e89000 2023-12-19T17:57:13.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(33 10000000206.00000001 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558e6ca52fc0 con 0x558e6c065800 2023-12-19T17:57:13.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7fad9b7b7840 10 datascan.operator(): handling object 1099511628294.1 2023-12-19T17:57:13.709 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '1', '--worker_m', '7'] in time 0:00:00.365229, result: 2023-12-19T17:57:13.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:34 9.0 9:012cdbc7:::10000000206.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558e6c07e000 con 0x558e6c04fc00 2023-12-19T17:57:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e45ff700 1 -- 172.21.15.45:0/3597000239 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(39 100000001f8.00000000 [call,setxattr (8)] v68'17 uv17 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8b40 con 0x55d4df1b3800 2023-12-19T17:57:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(30 10000000001.00000000 [call,setxattr (8)] v68'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:31 10.7 10:e5993619::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616a000 con 0x55b686178400 2023-12-19T17:57:13.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:40 10.11 10:8f3fbbd0::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1b3000 con 0x55d4df1ed000 2023-12-19T17:57:13.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff512197700 1 -- 172.21.15.45:0/2750985134 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(29 10000000204.00000000 [call,setxattr (8)] v68'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558ecbc36b40 con 0x558ecbd29800 2023-12-19T17:57:13.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(35 100000001fa.00000000 [call,setxattr (8)] v68'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12b40 con 0x55d277e89000 2023-12-19T17:57:13.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:36 10.13 10:cc6bf2c4::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801dc00 con 0x55d27801c000 2023-12-19T17:57:13.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:30 10.15 10:a8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c9400 con 0x558ecb1a6c00 2023-12-19T17:57:13.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(31 [pgnls start_epoch 68 out=81b] v66'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(40 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1ed000 2023-12-19T17:57:13.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 10.7 10:e5993619:::10000000208.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616a400 con 0x55b686178400 2023-12-19T17:57:13.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:41 10.11 10:8f3fbbd0:::1000000020c.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df055800 con 0x55d4df1ed000 2023-12-19T17:57:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(36 [pgnls start_epoch 68 out=81b] v66'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12b40 con 0x55d27801c000 2023-12-19T17:57:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:37 10.13 10:cc6bf2c4:::1000000020b.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d27801c800 con 0x55d27801c000 2023-12-19T17:57:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(32 10000000208.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628296.0 2023-12-19T17:57:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(41 1000000020c.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1ed000 2023-12-19T17:57:13.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e6644840 10 datascan.operator(): handling object 1099511628300.1 2023-12-19T17:57:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:33 9.27 9:e5993619:::10000000208.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178c00 con 0x55b68605a800 2023-12-19T17:57:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(30 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:42 9.1e 9:789b801b:::1000000020c.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb400 con 0x55d4df055400 2023-12-19T17:57:13.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:31 10.15 10:a8e69ea8:::1000000020d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1c8000 con 0x558ecb1a6c00 2023-12-19T17:57:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(37 1000000020b.00000001 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12b40 con 0x55d27801c000 2023-12-19T17:57:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614c351840 10 datascan.operator(): handling object 1099511628299.1 2023-12-19T17:57:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:38 9.20 9:05552577:::1000000020b.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277ff0800 con 0x55d277ff0400 2023-12-19T17:57:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(31 1000000020d.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628301.0 2023-12-19T17:57:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.544+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:32 9.15 9:a8e69ea8:::1000000020d.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecbd29c00 con 0x558ecb1a6000 2023-12-19T17:57:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(49 100000001ff.00000000 [call,setxattr (8)] v68'19 uv19 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cfc0 con 0x564329d3ec00 2023-12-19T17:57:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:50 10.4 10:218dfa3a::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d3e400 con 0x564329c0ac00 2023-12-19T17:57:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9a774700 1 -- 172.21.15.45:0/4127395730 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(34 10000000206.00000000 [call,setxattr (8)] v68'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558e6ca52d80 con 0x558e6c04fc00 2023-12-19T17:57:13.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558e6c04f000 msgr2=0x558e6c055080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(50 [pgnls start_epoch 68 out=101b] v66'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558e6c04f000 0x558e6c055080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558e6c04fc00 msgr2=0x558e6c055600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558e6c04fc00 0x558e6c055600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558e6c04e800 msgr2=0x558e6c054580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558e6c04e800 0x558e6c054580 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558e6c04e000 msgr2=0x558e6c054000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558e6c04e000 0x558e6c054000 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558e6bf35800 msgr2=0x558e6bc8a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558e6bf35800 0x558e6bc8a100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558e6c065800 msgr2=0x558e6bc89b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558e6c065800 0x558e6bc89b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558e6bf35400 msgr2=0x558e6bc8b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558e6bf35400 0x558e6bc8b700 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x558e6bed8900 tx=0x558e6c9c4420 comp rx=0 tx=0).stop 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34c00 msgr2=0x558e6bc8a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/4127395730 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bf34c00 0x558e6bc8a680 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x558e6bed9620 tx=0x558e6c9c42a0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 reap_dead start 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 reap_dead start 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 reap_dead start 2023-12-19T17:57:13.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad99f73700 1 -- 172.21.15.45:0/4127395730 reap_dead start 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:51 10.4 10:218dfa3a:::10000000200.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27800 con 0x564329c0ac00 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(42 1000000020c.00000000 [call,setxattr (8)] v68'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d4dfbd8fc0 con 0x55d4df055400 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:43 10.9 10:90000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d4df1eb800 con 0x55d4df1ed000 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 shutdown_connections 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 >> 172.21.15.45:0/4127395730 conn(0x558e6bf34000 msgr2=0x558e6bcf7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 shutdown_connections 2023-12-19T17:57:13.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/4127395730 wait complete. 2023-12-19T17:57:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9833cd5700 1 -- 172.21.15.45:0/1710086844 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(51 10000000200.00000001 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x56432a70cd80 con 0x564329c0ac00 2023-12-19T17:57:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9834d18840 10 datascan.operator(): handling object 1099511628288.1 2023-12-19T17:57:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:52 9.19 9:992a6246:::10000000200.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x564329d27c00 con 0x564329b99800 2023-12-19T17:57:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e5601700 1 -- 172.21.15.45:0/3597000239 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(43 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d4dfbd8d80 con 0x55d4df1ed000 2023-12-19T17:57:13.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(38 1000000020b.00000000 [call,setxattr (8)] v68'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12d80 con 0x55d277ff0400 2023-12-19T17:57:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:39 10.b 10:d0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d277e89400 con 0x55d27801cc00 2023-12-19T17:57:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(33 10000000208.00000000 [call,setxattr (8)] v68'5 uv5 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:34 10.17 10:e8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179000 con 0x55b686178000 2023-12-19T17:57:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bbe3800 msgr2=0x558e6bc89080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bbe3800 0x558e6bc89080 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x558e6bd48ae0 tx=0x558e6c9c4000 comp rx=0 tx=0).stop 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d4df055400 msgr2=0x55d4df1d2000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d4df055400 0x55d4df1d2000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d4df055000 msgr2=0x55d4dedfe100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d4df055000 0x55d4dedfe100 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d4df1b2800 msgr2=0x55d4df1d2580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d4df1b2800 0x55d4df1d2580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d4df1b3800 msgr2=0x55d4dedfd600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d4df1b3800 0x55d4dedfd600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d4df1ea000 msgr2=0x55d4df1d2b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d4df1ea000 0x55d4df1d2b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d4df1ed000 msgr2=0x55d4df1d3b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55d4df1ed000 0x55d4df1d3b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d4df1b2400 msgr2=0x55d4df1d3600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d4df1b2400 0x55d4df1d3600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d4df1b3400 msgr2=0x55d4dedfdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d4df1b3400 0x55d4dedfdb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d4df1b2000 msgr2=0x55d4dedff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d4df1b2000 0x55d4dedff700 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55d4df0668a0 tx=0x55d4df068c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054800 msgr2=0x55d4dedfec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 --2- 172.21.15.45:0/3597000239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4df054800 0x55d4dedfec00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x55d4df067590 tx=0x55d4dee2d2c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 reap_dead start 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 reap_dead start 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 reap_dead start 2023-12-19T17:57:13.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e4e00700 1 -- 172.21.15.45:0/3597000239 reap_dead start 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 shutdown_connections 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558e6bbe3800 0x558e6bc89080 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558e6bbe3400 0x558e6bc88b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 --2- 172.21.15.45:0/1445215382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558e6bbe3000 0x558e6bc88580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 >> 172.21.15.45:0/1445215382 conn(0x558e6bbe2c00 msgr2=0x558e6bcf7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 shutdown_connections 2023-12-19T17:57:13.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 >> 172.21.15.45:0/3597000239 conn(0x55d4ded56c00 msgr2=0x55d4dee47800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 shutdown_connections 2023-12-19T17:57:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7fad9b7b7840 1 -- 172.21.15.45:0/1445215382 wait complete. 2023-12-19T17:57:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(39 [pgnls start_epoch 68 out=101b] v66'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(34 [pgnls start_epoch 68 out=81b] v66'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58d80 con 0x55b686178000 2023-12-19T17:57:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 shutdown_connections 2023-12-19T17:57:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:40 10.b 10:d2952c40:::10000000208.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d278026000 con 0x55d27801cc00 2023-12-19T17:57:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:35 10.17 10:e88218fc:::10000000209.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616b800 con 0x55b686178000 2023-12-19T17:57:13.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.548+0000 7f17e6644840 1 -- 172.21.15.45:0/3597000239 wait complete. 2023-12-19T17:57:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(40 10000000208.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(32 1000000020d.00000000 [call,setxattr (8)] v68'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:33 10.15 10:ab3d427d::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7c00 con 0x558ecb1a6c00 2023-12-19T17:57:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f614c351840 10 datascan.operator(): handling object 1099511628296.1 2023-12-19T17:57:13.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:41 9.27 9:e5993619:::10000000208.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d278026400 con 0x55d277e89000 2023-12-19T17:57:13.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(35 10000000209.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58d80 con 0x55b686178000 2023-12-19T17:57:13.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628297.1 2023-12-19T17:57:13.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:36 9.2c 9:37389ade:::10000000209.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616bc00 con 0x55b685fed400 2023-12-19T17:57:13.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 msgr2=0x55d4dedfcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 0x55d4dedfcb00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55d4dee652f0 tx=0x55d4dfbdad20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 shutdown_connections 2023-12-19T17:57:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d4ded57000 0x55d4dedfd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d4ded57400 0x55d4dedfcb00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 --2- 172.21.15.45:0/1066735982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d4ded57800 0x55d4dedfc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 >> 172.21.15.45:0/1066735982 conn(0x55d4ded57c00 msgr2=0x55d4dee47000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9832cd3700 1 -- 172.21.15.45:0/1710086844 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(52 10000000200.00000000 [call,setxattr (8)] v68'18 uv18 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x56432a70cfc0 con 0x564329b99800 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x564329c0ac00 msgr2=0x564329947b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x564329c0ac00 0x564329947b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x564329b99000 msgr2=0x564329948100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x564329b99000 0x564329948100 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x564329d26400 msgr2=0x564329d22b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x564329d26400 0x564329d22b00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x564329b99800 msgr2=0x564329d22000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x564329b99800 0x564329d22000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x564329b99400 msgr2=0x564329947600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x564329b99400 0x564329947600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x564329d3ec00 msgr2=0x564329d23600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x564329d3ec00 0x564329d23600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x564329d26000 msgr2=0x564329d22580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x564329d26000 0x564329d22580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 reap_dead start 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 reap_dead start 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 reap_dead start 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f98334d4700 1 -- 172.21.15.45:0/1710086844 reap_dead start 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 shutdown_connections 2023-12-19T17:57:13.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f17e6644840 1 -- 172.21.15.45:0/1066735982 wait complete. 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x564329c0a400 msgr2=0x564329949700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x564329c0a400 0x564329949700 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x56432a71ea50 tx=0x5643299773e0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98c00 msgr2=0x564329948680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98c00 0x564329948680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x5643299a97a0 tx=0x56432a70ecc0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 shutdown_connections 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x564329c0a400 0x564329949700 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1710086844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x564329b98c00 0x564329948680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 >> 172.21.15.45:0/1710086844 conn(0x5643298a0c00 msgr2=0x564329995800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(33 [pgnls start_epoch 68 out=101b] v66'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:34 10.15 10:ab3d427d:::10000000203.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a7800 con 0x558ecb1a6c00 2023-12-19T17:57:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 shutdown_connections 2023-12-19T17:57:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1710086844 wait complete. 2023-12-19T17:57:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(34 10000000203.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628291.1 2023-12-19T17:57:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:35 9.2b 9:d4a58307:::10000000203.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1a6800 con 0x558ecb1a6000 2023-12-19T17:57:13.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(36 10000000209.00000000 [call,setxattr (8)] v68'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58b40 con 0x55b685fed400 2023-12-19T17:57:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 msgr2=0x564329946b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 0x564329946b00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x5643299a9410 tx=0x56432a70ee40 comp rx=0 tx=0).stop 2023-12-19T17:57:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:37 10.f 10:f0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179800 con 0x55b686178400 2023-12-19T17:57:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 shutdown_connections 2023-12-19T17:57:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643298a1000 0x564329947080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643298a1400 0x564329946b00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 --2- 172.21.15.45:0/1904124724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643298a1800 0x564329946580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 >> 172.21.15.45:0/1904124724 conn(0x5643298a1c00 msgr2=0x564329995000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(41 10000000208.00000000 [call,setxattr (8)] v68'6 uv6 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12b40 con 0x55d277e89000 2023-12-19T17:57:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 shutdown_connections 2023-12-19T17:57:13.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:42 10.b 10:d4a58307::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d278026800 con 0x55d27801cc00 2023-12-19T17:57:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.552+0000 7f9834d18840 1 -- 172.21.15.45:0/1904124724 wait complete. 2023-12-19T17:57:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(37 [pgnls start_epoch 68 out=81b] v66'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:38 10.f 10:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686179c00 con 0x55b686178400 2023-12-19T17:57:13.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(42 [pgnls start_epoch 68 out=81b] v66'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:43 10.b 10:d4a58307:::10000000203.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d278026c00 con 0x55d27801cc00 2023-12-19T17:57:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(38 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58b40 con 0x55b686178400 2023-12-19T17:57:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f4b45587840 10 datascan.operator(): handling object 1099511627777.1 2023-12-19T17:57:13.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(35 10000000203.00000000 [call,setxattr (8)] v68'14 uv14 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:39 9.7 9:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178800 con 0x55b68605b800 2023-12-19T17:57:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:36 10.15 10:ab9be7ec::::head [pgnls start_epoch 68 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1be000 con 0x558ecb1a6c00 2023-12-19T17:57:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f614b30e700 1 -- 172.21.15.45:0/1153605050 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(43 10000000203.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55d278a12d80 con 0x55d27801cc00 2023-12-19T17:57:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f614c351840 10 datascan.operator(): handling object 1099511628291.0 2023-12-19T17:57:13.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:44 9.2b 9:d4a58307:::10000000203.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d278027000 con 0x55d277ff1000 2023-12-19T17:57:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(36 [pgnls start_epoch 68 out=81b] v66'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:37 10.15 10:ab9be7ec:::10000000205.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bf000 con 0x558ecb1a6c00 2023-12-19T17:57:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(37 10000000205.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x558ecbc36fc0 con 0x558ecb1a6c00 2023-12-19T17:57:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff5141dc840 10 datascan.operator(): handling object 1099511628293.1 2023-12-19T17:57:13.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.556+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:38 9.3d 9:bfcd3380:::10000000205.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bf800 con 0x558ecb1a6000 2023-12-19T17:57:13.740 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '2', '--worker_m', '7'] in time 0:00:00.394589, result: 2023-12-19T17:57:13.741 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '3', '--worker_m', '7'] in time 0:00:00.394896, result: 2023-12-19T17:57:13.741 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '0', '--worker_m', '7'] in time 0:00:00.397930, result: 2023-12-19T17:57:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614ab0d700 1 -- 172.21.15.45:0/1153605050 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(44 10000000203.00000000 [call,setxattr (8)] v68'15 uv15 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55d278a12fc0 con 0x55d277ff1000 2023-12-19T17:57:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:45 10.1b 10:d8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d278027400 con 0x55d277ff1800 2023-12-19T17:57:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(38 10000000205.00000000 [call,setxattr (8)] v68'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1a6000 2023-12-19T17:57:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558ecb1be400 0x558ecb1adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:39 10.d 10:b0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x558ecb1bec00 con 0x558ecb1be400 2023-12-19T17:57:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(39 10000000001.00000000 [call,setxattr (8)] v68'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58fc0 con 0x55b68605b800 2023-12-19T17:57:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:40 10.1f 10:f8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b686178c00 con 0x55b68616a800 2023-12-19T17:57:13.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(45 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d278a12b40 con 0x55d277ff1800 2023-12-19T17:57:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d277ff0400 msgr2=0x55d27800c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d277ff0400 0x55d27800c000 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d27801c000 msgr2=0x55d277c33600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d27801c000 0x55d277c33600 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558ecb1be400 0x558ecb1adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d277e89000 msgr2=0x55d277c34100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d277e89000 0x55d277c34100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d277ff1800 msgr2=0x55d27800cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d277ff1800 0x55d27800cb00 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d277ff1400 msgr2=0x55d27800d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d277ff1400 0x55d27800d600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d27801cc00 msgr2=0x55d277c33b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d27801cc00 0x55d277c33b80 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d277ff1000 msgr2=0x55d27800c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d277ff1000 0x55d27800c580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 reap_dead start 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 reap_dead start 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d277ff0000 msgr2=0x55d277c35700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d277ff0000 0x55d277c35700 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x55d277c8b200 tx=0x55d277ea9c20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88800 msgr2=0x55d277c34c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 --2- 172.21.15.45:0/1153605050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277e88800 0x55d277c34c00 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55d277ea4ab0 tx=0x55d277ea8c00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614a30c700 1 -- 172.21.15.45:0/1153605050 reap_dead start 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 shutdown_connections 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 >> 172.21.15.45:0/1153605050 conn(0x55d277b8cc00 msgr2=0x55d277c6d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(40 [pgnls start_epoch 68 out=81b] v66'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b686b58b40 con 0x55b68616a800 2023-12-19T17:57:13.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:41 10.1f 10:feb1c803:::100000001fa.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616a000 con 0x55b68616a800 2023-12-19T17:57:13.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 shutdown_connections 2023-12-19T17:57:13.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f614c351840 1 -- 172.21.15.45:0/1153605050 wait complete. 2023-12-19T17:57:13.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7ff513199700 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558ecb1be400 0x558ecb1adb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.560+0000 7f4b43542700 1 -- 172.21.15.45:0/1620142690 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(41 100000001fa.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b686b58b40 con 0x55b68616a800 2023-12-19T17:57:13.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 10 datascan.operator(): handling object 1099511628282.0 2023-12-19T17:57:13.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:42 9.3f 9:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55b68616a400 con 0x55b68605a800 2023-12-19T17:57:13.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 msgr2=0x55d277c32580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 0x55d277c32580 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x55d277c8b380 tx=0x55d277cf2300 comp rx=0 tx=0).stop 2023-12-19T17:57:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff513199700 1 -- 172.21.15.45:0/2750985134 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(39 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x558ecbc36d80 con 0x558ecb1be400 2023-12-19T17:57:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 shutdown_connections 2023-12-19T17:57:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d277b8d000 0x55d277c33080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d277b8d400 0x55d277c32b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 --2- 172.21.15.45:0/3550120849 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d277b8d800 0x55d277c32580 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 >> 172.21.15.45:0/3550120849 conn(0x55d277b8dc00 msgr2=0x55d277c6d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558ecbd29800 msgr2=0x558ecaed6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x558ecbd29800 0x558ecaed6100 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558ecb1bf400 msgr2=0x558ecaed5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x558ecb1bf400 0x558ecaed5600 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558ecb1a7400 msgr2=0x558ecb1acb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558ecb1a7400 0x558ecb1acb00 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558ecb1a6c00 msgr2=0x558ecb1ac580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x558ecb1a6c00 0x558ecb1ac580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558ecb1a7000 msgr2=0x558ecaed5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x558ecb1a7000 0x558ecaed5b80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558ecb1bfc00 msgr2=0x558ecb1ad600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x558ecb1bfc00 0x558ecb1ad600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558ecb1be400 msgr2=0x558ecb1adb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x558ecb1be400 0x558ecb1adb80 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x558ecb1a6000 msgr2=0x558ecb1ac000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x558ecb1a6000 0x558ecb1ac000 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 shutdown_connections 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558ecbd29400 msgr2=0x558ecaed7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 reap_dead start 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558ecbd29400 0x558ecaed7700 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x558ecaf35410 tx=0x558ecbc26420 comp rx=0 tx=0).stop 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 msgr2=0x558ecaed7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/2750985134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecbd28400 0x558ecaed7180 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x558ecbc3b770 tx=0x558ecbcded20 comp rx=0 tx=0).stop 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 reap_dead start 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff512998700 1 -- 172.21.15.45:0/2750985134 reap_dead start 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 shutdown_connections 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 >> 172.21.15.45:0/2750985134 conn(0x558ecbd28000 msgr2=0x558ecaeeb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f614c351840 1 -- 172.21.15.45:0/3550120849 wait complete. 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 shutdown_connections 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/2750985134 wait complete. 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 msgr2=0x558ecaed4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 0x558ecaed4b00 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x558ecaf35500 tx=0x558ecbc26000 comp rx=0 tx=0).stop 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 shutdown_connections 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558ecae2f800 0x558ecaed5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558ecae2f400 0x558ecaed4b00 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 --2- 172.21.15.45:0/4226271823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558ecae2f000 0x558ecaed4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 >> 172.21.15.45:0/4226271823 conn(0x558ecae2ec00 msgr2=0x558ecaeeb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b44544700 1 -- 172.21.15.45:0/1620142690 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(42 100000001fa.00000000 [call,setxattr (8)] v68'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b686b58d80 con 0x55b68605a800 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b68605bc00 msgr2=0x55b686172100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b68605bc00 0x55b686172100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b68605a800 msgr2=0x55b685d89700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b68605a800 0x55b685d89700 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b685fed400 msgr2=0x55b685d88680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b685fed400 0x55b685d88680 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 shutdown_connections 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b686178000 msgr2=0x55b686171b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b686178000 0x55b686171b80 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b68605b800 msgr2=0x55b685d88c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b68605b800 0x55b685d88c00 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b686178400 msgr2=0x55b686170580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b686178400 0x55b686170580 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b68616a800 msgr2=0x55b686170000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b68616a800 0x55b686170000 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 reap_dead start 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 reap_dead start 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b43d43700 1 -- 172.21.15.45:0/1620142690 reap_dead start 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b68605a400 msgr2=0x55b685d89180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b68605a400 0x55b685d89180 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x55b685ffe8a0 tx=0x55b686b64de0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 msgr2=0x55b685d87600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55b685fff560 tx=0x55b685db7380 comp rx=0 tx=0).stop 2023-12-19T17:57:13.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7ff5141dc840 1 -- 172.21.15.45:0/4226271823 wait complete. 2023-12-19T17:57:13.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 shutdown_connections 2023-12-19T17:57:13.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b68605a400 0x55b685d89180 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1620142690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685fec800 0x55b685d87600 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 >> 172.21.15.45:0/1620142690 conn(0x55b685ce0c00 msgr2=0x55b685d9d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 shutdown_connections 2023-12-19T17:57:13.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1620142690 wait complete. 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 msgr2=0x55b685d86580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 0x55b685d86580 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55b685de93e0 tx=0x55b686b64e40 comp rx=0 tx=0).stop 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 shutdown_connections 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b685ce1000 0x55b685d87080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b685ce1400 0x55b685d86580 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 --2- 172.21.15.45:0/1930122586 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b685ce1800 0x55b685d86b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 >> 172.21.15.45:0/1930122586 conn(0x55b685ce1c00 msgr2=0x55b685d9d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.564+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 shutdown_connections 2023-12-19T17:57:13.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.568+0000 7f4b45587840 1 -- 172.21.15.45:0/1930122586 wait complete. 2023-12-19T17:57:13.759 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '5', '--worker_m', '7'] in time 0:00:00.412258, result: 2023-12-19T17:57:13.759 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '4', '--worker_m', '7'] in time 0:00:00.413345, result: 2023-12-19T17:57:13.760 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', '--worker_n', '6', '--worker_m', '7'] in time 0:00:00.413208, result: 2023-12-19T17:57:13.760 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 0 --worker_m 7 2023-12-19T17:57:13.761 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 1 --worker_m 7 2023-12-19T17:57:13.761 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 2 --worker_m 7 2023-12-19T17:57:13.762 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 3 --worker_m 7 2023-12-19T17:57:13.762 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 4 --worker_m 7 2023-12-19T17:57:13.762 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 5 --worker_m 7 2023-12-19T17:57:13.763 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --worker_n 6 --worker_m 7 2023-12-19T17:57:13.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 -- start start 2023-12-19T17:57:13.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 Processor -- start 2023-12-19T17:57:13.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 0x557315052580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557314fad400 0x557315052b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557314fad000 0x557315053080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x557314fe3e00 con 0x557314fad000 2023-12-19T17:57:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731502ca00 con 0x557314fad800 2023-12-19T17:57:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bef66a840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55731502c640 con 0x557314fad400 2023-12-19T17:57:13.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 0x557315052580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bed625700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557314fad400 0x557315052b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 0x557315052580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47752/0 (socket says 172.21.15.45:47752) 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 -- 172.21.15.45:0/3147280198 learned_addr learned my addr 172.21.15.45:0/3147280198 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bee627700 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557314fad000 0x557315053080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 -- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557314fad400 msgr2=0x557315052b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557314fad400 0x557315052b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 -- 172.21.15.45:0/3147280198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557314fad000 msgr2=0x557315053080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557314fad000 0x557315053080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.840+0000 7f7bede26700 1 -- 172.21.15.45:0/3147280198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557314fceb60 con 0x557314fad800 2023-12-19T17:57:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bede26700 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 0x557315052580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5573150bf320 tx=0x55731508d440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26d23f604f351cde server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7beb621700 1 -- 172.21.15.45:0/3147280198 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557314fdd080 con 0x557314fad800 2023-12-19T17:57:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7beb621700 1 -- 172.21.15.45:0/3147280198 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557314ff8900 con 0x557314fad800 2023-12-19T17:57:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557314fcf1e0 con 0x557314fad800 2023-12-19T17:57:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x557314fceb60 con 0x557314fad800 2023-12-19T17:57:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 4 waiting for MDS map... 2023-12-19T17:57:13.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7beb621700 1 -- 172.21.15.45:0/3147280198 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557314fdd600 con 0x557314fad800 2023-12-19T17:57:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7beb621700 1 -- 172.21.15.45:0/3147280198 <== mon.1 v2:172.21.15.73:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x557314fe6c40 con 0x557314fad800 2023-12-19T17:57:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7beb621700 1 -- 172.21.15.45:0/3147280198 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x557314feef00 con 0x557314fad800 2023-12-19T17:57:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 4 Got MDS map 42 2023-12-19T17:57:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.844+0000 7f7bef66a840 1 Processor -- start 2023-12-19T17:57:13.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 -- start start 2023-12-19T17:57:13.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 0x557315053600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315053b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bee627700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 0x557315053600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bee627700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 0x557315053600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43186/0 (socket says 172.21.15.45:43186) 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8c00 0x557315054100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731502c500 con 0x5573152a8400 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731502c3c0 con 0x5573152a8800 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bef66a840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55731502c640 con 0x5573152a8c00 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bede26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315053b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bede26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315053b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47776/0 (socket says 172.21.15.45:47776) 2023-12-19T17:57:13.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.848+0000 7f7bede26700 1 -- 172.21.15.45:0/1830049587 learned_addr learned my addr 172.21.15.45:0/1830049587 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bede26700 1 -- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8c00 msgr2=0x557315054100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bed625700 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8c00 0x557315054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bede26700 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8c00 0x557315054100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bede26700 1 -- 172.21.15.45:0/1830049587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 msgr2=0x557315053600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bede26700 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 0x557315053600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bede26700 1 -- 172.21.15.45:0/1830049587 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557314fce340 con 0x5573152a8800 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bee627700 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 0x557315053600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bed625700 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8c00 0x557315054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bede26700 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315053b80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5573152b4210 tx=0x55731508d5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8af504fc0c62beec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7be961d700 1 -- 172.21.15.45:0/1830049587 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557314fdd1e0 con 0x5573152a8800 2023-12-19T17:57:13.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7be961d700 1 -- 172.21.15.45:0/1830049587 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557315e22d80 con 0x5573152a8800 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7be961d700 1 -- 172.21.15.45:0/1830049587 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557314fdcf20 con 0x5573152a8800 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 -- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 msgr2=0x557315053b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315053b80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x5573152b4210 tx=0x55731508d5c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 -- 172.21.15.45:0/1830049587 shutdown_connections 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8c00 0x557315054100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315053b80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1830049587 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8400 0x557315053600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.852+0000 7f7bef66a840 1 -- 172.21.15.45:0/1830049587 >> 172.21.15.45:0/1830049587 conn(0x557314facc00 msgr2=0x55731508f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 -- 172.21.15.45:0/1830049587 shutdown_connections 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 -- 172.21.15.45:0/1830049587 wait complete. 2023-12-19T17:57:13.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 Processor -- start 2023-12-19T17:57:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7fa1d7f84840 1 -- start start 2023-12-19T17:57:13.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7fa1d7f84840 1 Processor -- start 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 -- start start 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8400 0x557315055180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315054c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8c00 0x557315054680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731502c280 con 0x5573152a8c00 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55731502c140 con 0x5573152a8800 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bef66a840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55731502c000 con 0x5573152a8400 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.856+0000 7f7bede26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315054c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315054c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47782/0 (socket says 172.21.15.45:47782) 2023-12-19T17:57:13.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 learned_addr learned my addr 172.21.15.45:0/1039258945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8400 0x557315055180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87779000 0x562a8781e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 0x562a8781eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87779800 0x562a8781f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8a00 con 0x562a87779400 2023-12-19T17:57:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8780 con 0x562a87779800 2023-12-19T17:57:13.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8640 con 0x562a87779000 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8400 msgr2=0x557315055180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5573152a8400 0x557315055180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8c00 msgr2=0x557315054680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 0x562a8781eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 0x562a8781eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43236/0 (socket says 172.21.15.45:43236) 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/1065391932 learned_addr learned my addr 172.21.15.45:0/1065391932 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87779800 0x562a8781f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d6740700 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87779000 0x562a8781e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8c00 0x557315054680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8c00 0x557315054680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557314fcf1e0 con 0x5573152a8800 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5573152a8c00 0x557315054680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87779000 msgr2=0x562a8781e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87779000 0x562a8781e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87779800 msgr2=0x562a8781f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87779800 0x562a8781f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/1065391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a8779ab60 con 0x562a87779400 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 0x562a8781eb00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x562a878df5f0 tx=0x562a88568480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c2fcb8d9b0669d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87779800 0x562a8781f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.860+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315054c00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5573152b54d0 tx=0x5573152b6c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f7be7e1a700 1 -- 172.21.15.45:0/1039258945 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557314fdd1e0 con 0x5573152a8800 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f7be7e1a700 1 -- 172.21.15.45:0/1039258945 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557315e22c00 con 0x5573152a8800 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f7be7e1a700 1 -- 172.21.15.45:0/1039258945 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x557314fdcf20 con 0x5573152a8800 2023-12-19T17:57:13.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557314fceb60 con 0x5573152a8800 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d3f3b700 1 -- 172.21.15.45:0/1065391932 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a877a9600 con 0x562a87779400 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a8779a340 con 0x562a87779400 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562a8779a000 con 0x562a87779400 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d7f84840 4 waiting for MDS map... 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557314fce340 con 0x5573152a8800 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f7bef66a840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 -- start start 2023-12-19T17:57:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 Processor -- start 2023-12-19T17:57:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d3f3b700 1 -- 172.21.15.45:0/1065391932 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a877c4480 con 0x562a87779400 2023-12-19T17:57:13.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d3f3b700 1 -- 172.21.15.45:0/1065391932 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a877a91e0 con 0x562a87779400 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d3f3b700 1 -- 172.21.15.45:0/1065391932 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x562a877b2c40 con 0x562a87779400 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d3f3b700 1 -- 172.21.15.45:0/1065391932 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x562a88578000 con 0x562a87779400 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d7f84840 4 Got MDS map 42 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d7f84840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fa1d7f84840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 0x55d211a6e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d2119c9400 0x55d211a6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d2119c9000 0x55d211a6f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b13296700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 0x55d211a6e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b13296700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 0x55d211a6e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39460/0 (socket says 172.21.15.45:39460) 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b13296700 1 -- 172.21.15.45:0/4019061113 learned_addr learned my addr 172.21.15.45:0/4019061113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2119ffe00 con 0x55d2119c9400 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48a00 con 0x55d2119c9000 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48640 con 0x55d2119c9800 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b12a95700 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d2119c9400 0x55d211a6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fba4bf3f840 1 -- start start 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7fba4bf3f840 1 Processor -- start 2023-12-19T17:57:13.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.864+0000 7f9b13a97700 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d2119c9000 0x55d211a6f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f7be7e1a700 1 -- 172.21.15.45:0/1039258945 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55731500a840 con 0x5573152a8800 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b12a95700 1 -- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 msgr2=0x55d211a6e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b12a95700 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 0x55d211a6e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b12a95700 1 -- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d2119c9000 msgr2=0x55d211a6f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b12a95700 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d2119c9000 0x55d211a6f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b12a95700 1 -- 172.21.15.45:0/4019061113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2119eab60 con 0x55d2119c9400 2023-12-19T17:57:13.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b13296700 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 0x55d211a6e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 Processor -- start 2023-12-19T17:57:13.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b12a95700 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d2119c9400 0x55d211a6eb00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55d211ada9f0 tx=0x55d211aa9440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95a021123175f78 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 -- start start 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b10a91700 1 -- 172.21.15.45:0/4019061113 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2119f9080 con 0x55d2119c9400 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b10a91700 1 -- 172.21.15.45:0/4019061113 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2127ac900 con 0x55d2119c9400 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b10a91700 1 -- 172.21.15.45:0/4019061113 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2119f9600 con 0x55d2119c9400 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2119eb1e0 con 0x55d2119c9400 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55d2119eab60 con 0x55d2119c9400 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b14ada840 4 waiting for MDS map... 2023-12-19T17:57:13.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 -- start start 2023-12-19T17:57:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 Processor -- start 2023-12-19T17:57:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87605800 0x555a876abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87605400 0x555a876ab600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87605000 0x555a876ab080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f1eb4cba840 1 -- start start 2023-12-19T17:57:13.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f1eb4cba840 1 Processor -- start 2023-12-19T17:57:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b10a91700 1 -- 172.21.15.45:0/4019061113 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d211a02c40 con 0x55d2119c9400 2023-12-19T17:57:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b10a91700 1 -- 172.21.15.45:0/4019061113 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55d211a0af00 con 0x55d2119c9400 2023-12-19T17:57:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a87684a00 con 0x555a87605400 2023-12-19T17:57:13.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a87684780 con 0x555a87605000 2023-12-19T17:57:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a87684640 con 0x555a87605800 2023-12-19T17:57:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f7be7e1a700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5573153fe000 0x557315055700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b14ada840 4 Got MDS map 42 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4aefc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87605000 0x555a876ab080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4aefc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87605000 0x555a876ab080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47840/0 (socket says 172.21.15.45:47840) 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4aefc700 1 -- 172.21.15.45:0/1317426896 learned_addr learned my addr 172.21.15.45:0/1317426896 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba49efa700 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87605400 0x555a876ab600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87605800 0x555a876abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2400 0x562a8781f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 0x562a8781fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b14ada840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f9b14ada840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a877afe00 con 0x562a87ac2c00 2023-12-19T17:57:13.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8780 con 0x562a87ac2400 2023-12-19T17:57:13.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8500 con 0x562a87ac2800 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ec89f000 0x55e4ec944580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ec89f400 0x55e4ec944b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 0x55e4ec945080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91ea00 con 0x55e4ec89f800 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91e780 con 0x55e4ec89f400 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79d00f7840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91e640 con 0x55e4ec89f000 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f79cf0b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 0x55e4ec945080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 0x55e4ec945080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43290/0 (socket says 172.21.15.45:43290) 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 -- 172.21.15.45:0/2192491825 learned_addr learned my addr 172.21.15.45:0/2192491825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba49efa700 1 -- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87605800 msgr2=0x555a876abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba49efa700 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87605800 0x555a876abb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba49efa700 1 -- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87605000 msgr2=0x555a876ab080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba49efa700 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87605000 0x555a876ab080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fba49efa700 1 -- 172.21.15.45:0/1317426896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a87626b60 con 0x555a87605400 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7f7be7e1a700 1 -- 172.21.15.45:0/1039258945 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x557314fe6a80 con 0x5573152a8800 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bef66a840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bef66a840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bef66a840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5573152a9000 0x557315054100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573152a9400 con 0x5573152a9000 2023-12-19T17:57:13.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ec89f400 0x55e4ec944b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785c01800 0x562785ca6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.868+0000 7fa1d5f3f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d6740700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 0x562a8781fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d6740700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 0x562a8781fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39490/0 (socket says 172.21.15.45:39490) 2023-12-19T17:57:13.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d6740700 1 -- 172.21.15.45:0/3144720135 learned_addr learned my addr 172.21.15.45:0/3144720135 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2400 0x562a8781f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5573153fe000 0x557315055700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 Processor -- start 2023-12-19T17:57:13.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 -- start start 2023-12-19T17:57:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785c01400 0x562785ca6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785c01000 0x562785ca7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562785c80a00 con 0x562785c01400 2023-12-19T17:57:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562785c80780 con 0x562785c01800 2023-12-19T17:57:13.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562785c80640 con 0x562785c01000 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ec89f000 0x55e4ec944580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 -- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ec89f000 msgr2=0x55e4ec944580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ec89f000 0x55e4ec944580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 -- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ec89f400 msgr2=0x55e4ec944b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ec89f400 0x55e4ec944b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 -- 172.21.15.45:0/2192491825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ec8c0b60 con 0x55e4ec89f800 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 0x55e4ec945080 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55e4eca05500 tx=0x55e4ed60e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88177fd75d72868 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 msgr2=0x562a8781fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 0x562a8781fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2400 msgr2=0x562a8781f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2400 0x562a8781f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3144720135 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a8779aea0 con 0x562a87ac2c00 2023-12-19T17:57:13.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 0x562a8781fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba49efa700 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87605400 0x555a876ab600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x555a877173e0 tx=0x555a883fee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e18140545355d15 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3c77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785c01000 0x562785ca7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785c01800 0x562785ca6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3c77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785c01000 0x562785ca7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39506/0 (socket says 172.21.15.45:39506) 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3c77700 1 -- 172.21.15.45:0/274005588 learned_addr learned my addr 172.21.15.45:0/274005588 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785c01400 0x562785ca6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 -- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785c01000 msgr2=0x562785ca7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785c01000 0x562785ca7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 -- 172.21.15.45:0/274005588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785c01400 msgr2=0x562785ca6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785c01400 0x562785ca6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cc0ae700 1 -- 172.21.15.45:0/2192491825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e4ec8cf080 con 0x55e4ec89f800 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cc0ae700 1 -- 172.21.15.45:0/2192491825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4ed696300 con 0x55e4ec89f800 2023-12-19T17:57:13.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cc0ae700 1 -- 172.21.15.45:0/2192491825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e4ec8cf600 con 0x55e4ec89f800 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4ec8c11e0 con 0x55e4ec89f800 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55e4ec8c0b60 con 0x55e4ec89f800 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 4 waiting for MDS map... 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 0x55d211a6f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a6fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc9000 0x55d211a70100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48500 con 0x55d211cc8800 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211a483c0 con 0x55d211cc9000 2023-12-19T17:57:13.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b14ada840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48640 con 0x55d211cc8c00 2023-12-19T17:57:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba47ef6700 1 -- 172.21.15.45:0/1317426896 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555a87635600 con 0x555a87605400 2023-12-19T17:57:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba47ef6700 1 -- 172.21.15.45:0/1317426896 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a878f0000 con 0x555a87605400 2023-12-19T17:57:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba47ef6700 1 -- 172.21.15.45:0/1317426896 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555a876351e0 con 0x555a87605400 2023-12-19T17:57:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 -- 172.21.15.45:0/274005588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562785c22b60 con 0x562785c01800 2023-12-19T17:57:13.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5573152a9000 0x557315054100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a87626340 con 0x555a87605400 2023-12-19T17:57:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555a87626000 con 0x555a87605400 2023-12-19T17:57:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba4bf3f840 4 waiting for MDS map... 2023-12-19T17:57:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785c01400 0x562785ca6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb3476700 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785c01800 0x562785ca6580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x562785d13320 tx=0x5627869ead80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d4fad52bedd564 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820100 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x562a878dfa70 tx=0x562a885683c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f515066c9a612e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 0x55d211a6f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 0x55d211a6f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43310/0 (socket says 172.21.15.45:43310) 2023-12-19T17:57:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 -- 172.21.15.45:0/1928945626 learned_addr learned my addr 172.21.15.45:0/1928945626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13296700 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a6fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5573153fe000 0x557315055700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x5573150be870 tx=0x5573152b7c20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb0c71700 1 -- 172.21.15.45:0/274005588 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562785c31600 con 0x562785c01800 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb0c71700 1 -- 172.21.15.45:0/274005588 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562785c4c480 con 0x562785c01800 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb0c71700 1 -- 172.21.15.45:0/274005588 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562785c311e0 con 0x562785c01800 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562785c22340 con 0x562785c01800 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x562785c22000 con 0x562785c01800 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f1eb4cba840 4 waiting for MDS map... 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 -- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 msgr2=0x55d211a6fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a6fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 -- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc9000 msgr2=0x55d211a70100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc9000 0x55d211a70100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cc0ae700 1 -- 172.21.15.45:0/2192491825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55e4ec8d8c40 con 0x55e4ec89f800 2023-12-19T17:57:13.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79cc0ae700 1 -- 172.21.15.45:0/2192491825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x55e4ec8e0f00 con 0x55e4ec89f800 2023-12-19T17:57:13.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 4 Got MDS map 42 2023-12-19T17:57:13.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba47ef6700 1 -- 172.21.15.45:0/1317426896 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x555a8763ec40 con 0x555a87605400 2023-12-19T17:57:13.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d1f37700 1 -- 172.21.15.45:0/3144720135 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a877a8f20 con 0x562a87ac2c00 2023-12-19T17:57:13.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d1f37700 1 -- 172.21.15.45:0/3144720135 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a8857a600 con 0x562a87ac2c00 2023-12-19T17:57:13.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fa1d1f37700 1 -- 172.21.15.45:0/3144720135 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a877a8f20 con 0x562a87ac2c00 2023-12-19T17:57:13.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc9000 0x55d211a70100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b13a97700 1 -- 172.21.15.45:0/1928945626 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2119ea340 con 0x55d211cc8800 2023-12-19T17:57:13.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba47ef6700 1 -- 172.21.15.45:0/1317426896 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x555a878f0000 con 0x555a87605400 2023-12-19T17:57:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc9000 0x55d211a70100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7f79d00f7840 1 Processor -- start 2023-12-19T17:57:13.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 -- start start 2023-12-19T17:57:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 0x55d211a6f600 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55d21283c8d0 tx=0x55d21283ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b743d693b06c8bf5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.872+0000 7fba4bf3f840 4 Got MDS map 42 2023-12-19T17:57:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3144720135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 msgr2=0x562a87820100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820100 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x562a878dfa70 tx=0x562a885683c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb0c71700 1 -- 172.21.15.45:0/274005588 <== mon.1 v2:172.21.15.73:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x562785c3ac40 con 0x562785c01800 2023-12-19T17:57:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1928945626 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2119f9080 con 0x55d211cc8800 2023-12-19T17:57:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb0c71700 1 -- 172.21.15.45:0/274005588 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x5627869d2000 con 0x562785c01800 2023-12-19T17:57:13.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb4cba840 4 Got MDS map 42 2023-12-19T17:57:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5573152a9000 0x557315054100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3144720135 shutdown_connections 2023-12-19T17:57:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820100 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2800 0x562a8781fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3144720135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2400 0x562a8781f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3144720135 >> 172.21.15.45:0/3144720135 conn(0x562a87ac2000 msgr2=0x562a8788d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb4cba840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1928945626 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2127ac480 con 0x55d211cc8800 2023-12-19T17:57:13.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb4cba840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1928945626 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2119f9600 con 0x55d211cc8800 2023-12-19T17:57:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 Processor -- start 2023-12-19T17:57:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3144720135 shutdown_connections 2023-12-19T17:57:13.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x557315e1eb40 con 0x5573152a9000 2023-12-19T17:57:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5573152a9800 0x557315053b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153fe400 con 0x5573152a9800 2023-12-19T17:57:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3144720135 wait complete. 2023-12-19T17:57:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5573152a9800 0x557315053b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec945600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6800 0x55e4ec945b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 0x55e4ec946100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec8d5e00 con 0x55e4ecbe6400 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91e780 con 0x55e4ecbe6c00 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79d00f7840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91ea00 con 0x55e4ecbe6800 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 0x55e4ec946100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 0x55e4ec946100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47876/0 (socket says 172.21.15.45:47876) 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 -- 172.21.15.45:0/982284256 learned_addr learned my addr 172.21.15.45:0/982284256 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec945600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 -- 172.21.15.45:0/1928945626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 msgr2=0x55d211a6f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 0x55d211a6f600 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x55d21283c8d0 tx=0x55d21283ec00 comp rx=0 tx=0).stop 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 -- 172.21.15.45:0/1928945626 shutdown_connections 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc9000 0x55d211a70100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a6fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1928945626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc8800 0x55d211a6f600 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 -- 172.21.15.45:0/1928945626 >> 172.21.15.45:0/1928945626 conn(0x55d2119c8c00 msgr2=0x55d211aab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 -- start start 2023-12-19T17:57:13.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb4cba840 1 Processor -- start 2023-12-19T17:57:13.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6800 0x55e4ec945b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 -- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6800 msgr2=0x55e4ec945b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6800 0x55e4ec945b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 -- 172.21.15.45:0/982284256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 msgr2=0x55e4ec945600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec945600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 -- 172.21.15.45:0/982284256 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ec8c0340 con 0x55e4ecbe6c00 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 -- 172.21.15.45:0/1928945626 shutdown_connections 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a87684500 con 0x555a87902800 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a87684780 con 0x555a87902c00 2023-12-19T17:57:13.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a876843c0 con 0x555a87902400 2023-12-19T17:57:13.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 Processor -- start 2023-12-19T17:57:13.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f1eb4cba840 1 -- start start 2023-12-19T17:57:13.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 0x55e4ec946100 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55e4ed7248a0 tx=0x55e4ecb9ccc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd65ccb7d7332b3f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4aefc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4aefc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39532/0 (socket says 172.21.15.45:39532) 2023-12-19T17:57:13.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4aefc700 1 -- 172.21.15.45:0/1999834003 learned_addr learned my addr 172.21.15.45:0/1999834003 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba49efa700 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5573152a9800 0x557315053b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 -- 172.21.15.45:0/1928945626 wait complete. 2023-12-19T17:57:13.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f9b14ada840 1 Processor -- start 2023-12-19T17:57:13.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7fa1d7f84840 1 -- start start 2023-12-19T17:57:13.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4a6fb700 1 -- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902400 msgr2=0x555a876aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4a6fb700 1 -- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902c00 msgr2=0x555a876ac100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4a6fb700 1 -- 172.21.15.45:0/1999834003 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a87626ea0 con 0x555a87902800 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2400 0x562a87821180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2800 0x562a87820c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d7f84840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a877f83c0 con 0x562a87ac2c00 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8280 con 0x562a87ac2800 2023-12-19T17:57:13.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d7f84840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562a877f8140 con 0x562a87ac2400 2023-12-19T17:57:13.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.876+0000 7f79ca0aa700 1 -- 172.21.15.45:0/982284256 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e4ec8cf080 con 0x55e4ecbe6c00 2023-12-19T17:57:13.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79ca0aa700 1 -- 172.21.15.45:0/982284256 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4ed696a80 con 0x55e4ecbe6c00 2023-12-19T17:57:13.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79ca0aa700 1 -- 172.21.15.45:0/982284256 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e4ec8cf600 con 0x55e4ecbe6c00 2023-12-19T17:57:13.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 -- start start 2023-12-19T17:57:13.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902800 0x555a876aa580 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x555a8765ae40 tx=0x555a876e5440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee357286352a532 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba45ef2700 1 -- 172.21.15.45:0/1999834003 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555a87635080 con 0x555a87902800 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba45ef2700 1 -- 172.21.15.45:0/1999834003 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a878f2f00 con 0x555a87902800 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba45ef2700 1 -- 172.21.15.45:0/1999834003 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555a87635600 con 0x555a87902800 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 0x562785ca7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4c00 0x562785ca7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef5000 0x562785ca8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb4cba840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562785c37e00 con 0x562785ef5000 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 0x562785ca7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb4cba840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562785c80a00 con 0x562785ef4c00 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb4cba840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562785c80500 con 0x562785ef4800 2023-12-19T17:57:13.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 0x562785ca7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39544/0 (socket says 172.21.15.45:39544) 2023-12-19T17:57:13.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 -- 172.21.15.45:0/54771626 learned_addr learned my addr 172.21.15.45:0/54771626 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d6f41700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2400 0x562a87821180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 -- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 msgr2=0x55e4ec946100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 0x55e4ec946100 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x55e4ed7248a0 tx=0x55e4ecb9ccc0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d6740700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2800 0x562a87820c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d6f41700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2400 0x562a87821180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39552/0 (socket says 172.21.15.45:39552) 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 learned_addr learned my addr 172.21.15.45:0/3190738841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5573153fe800 0x557315053600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153fec00 con 0x5573153fe800 2023-12-19T17:57:13.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 -- 172.21.15.45:0/982284256 shutdown_connections 2023-12-19T17:57:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6c00 0x55e4ec946100 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6800 0x55e4ec945b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 --2- 172.21.15.45:0/982284256 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec945600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 -- 172.21.15.45:0/982284256 >> 172.21.15.45:0/982284256 conn(0x55e4ecbe6000 msgr2=0x55e4ec993800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 -- 172.21.15.45:0/982284256 shutdown_connections 2023-12-19T17:57:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1999834003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902800 msgr2=0x555a876aa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902800 0x555a876aa580 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x555a8765ae40 tx=0x555a876e5440 comp rx=0 tx=0).stop 2023-12-19T17:57:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1999834003 shutdown_connections 2023-12-19T17:57:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 -- 172.21.15.45:0/982284256 wait complete. 2023-12-19T17:57:13.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1999834003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1999834003 >> 172.21.15.45:0/1999834003 conn(0x555a87604c00 msgr2=0x555a876e7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3476700 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4c00 0x562785ca7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 0x55d211a71180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2400 msgr2=0x562a87821180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87ac2400 0x562a87821180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2800 msgr2=0x562a87820c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87ac2800 0x562a87820c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a8779ab60 con 0x562a87ac2c00 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a70c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc9000 0x55d211a70680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1999834003 shutdown_connections 2023-12-19T17:57:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef5000 0x562785ca8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5573153fe800 0x557315053600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1999834003 wait complete. 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820680 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x562a87a7cbd0 tx=0x562a87a74c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 Processor -- start 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f79d00f7840 1 -- start start 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48280 con 0x55d211cc9000 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48140 con 0x55d211cc8800 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b14ada840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d211a48000 con 0x55d211cc8c00 2023-12-19T17:57:13.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 0x55d211a71180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 0x55d211a71180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47918/0 (socket says 172.21.15.45:47918) 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 learned_addr learned my addr 172.21.15.45:0/1496362593 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a70c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc9000 0x55d211a70680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 -- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4c00 msgr2=0x562785ca7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4c00 0x562785ca7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 -- 172.21.15.45:0/54771626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef5000 msgr2=0x562785ca8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef5000 0x562785ca8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 -- 172.21.15.45:0/54771626 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562785c22ea0 con 0x562785ef4800 2023-12-19T17:57:13.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fa1d0734700 1 -- 172.21.15.45:0/3190738841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a877a8f20 con 0x562a87ac2c00 2023-12-19T17:57:13.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7fba4bf3f840 1 Processor -- start 2023-12-19T17:57:13.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 0x562785ca7600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5627869e4690 tx=0x562785ce15c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ec91aaa4ec75604 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 msgr2=0x55d211a70c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a70c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc9000 msgr2=0x55d211a70680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc9000 0x55d211a70680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fa1d0734700 1 -- 172.21.15.45:0/3190738841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562a8857a780 con 0x562a87ac2c00 2023-12-19T17:57:13.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fa1d0734700 1 -- 172.21.15.45:0/3190738841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562a877a9600 con 0x562a87ac2c00 2023-12-19T17:57:13.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2119ea000 con 0x55d211cc8800 2023-12-19T17:57:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562a8779a340 con 0x562a87ac2c00 2023-12-19T17:57:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5573153fe800 0x557315053600 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d211cc9000 0x55d211a70680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d211cc8c00 0x55d211a70c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 -- start start 2023-12-19T17:57:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec947180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6800 0x55e4ec946c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6c00 0x55e4ec946680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91e500 con 0x55e4ecbe6400 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91e3c0 con 0x55e4ecbe6800 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e4ec91e280 con 0x55e4ecbe6c00 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f1eaec6d700 1 -- 172.21.15.45:0/54771626 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562785c31080 con 0x562785ef4800 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eaec6d700 1 -- 172.21.15.45:0/54771626 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627869f1080 con 0x562785ef4800 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eaec6d700 1 -- 172.21.15.45:0/54771626 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562785c31600 con 0x562785ef4800 2023-12-19T17:57:13.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.880+0000 7f2ba753a840 1 -- 172.21.15.45:0/3608223964 wait complete. 2023-12-19T17:57:13.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a8779b520 con 0x562a87ac2c00 2023-12-19T17:57:13.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fa1d7f84840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce0b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec947180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce0b2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec947180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43382/0 (socket says 172.21.15.45:43382) 2023-12-19T17:57:13.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 learned_addr learned my addr 172.21.15.45:0/4169426698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6800 0x55e4ec946c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 0x55d211a71180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55d21283d590 tx=0x55d2127aee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a87684280 con 0x555a87902400 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x555a87684140 con 0x555a87902800 2023-12-19T17:57:13.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x555a87684000 con 0x555a87902c00 2023-12-19T17:57:13.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x557315e1efc0 con 0x5573153fe800 2023-12-19T17:57:13.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5573153ff000 0x557315434000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6c00 0x55e4ec946680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b0d28a700 1 -- 172.21.15.45:0/1496362593 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2119f8dc0 con 0x55d211cc8800 2023-12-19T17:57:13.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b0d28a700 1 -- 172.21.15.45:0/1496362593 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d2127ac300 con 0x55d211cc8800 2023-12-19T17:57:13.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b0d28a700 1 -- 172.21.15.45:0/1496362593 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55d2119f9080 con 0x55d211cc8800 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4a6fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4a6fb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47940/0 (socket says 172.21.15.45:47940) 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 learned_addr learned my addr 172.21.15.45:0/2138239300 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 -- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 msgr2=0x562785ca7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 0x562785ca7600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x5627869e4690 tx=0x562785ce15c0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 -- 172.21.15.45:0/54771626 shutdown_connections 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef5000 0x562785ca8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4c00 0x562785ca7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/54771626 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef4800 0x562785ca7600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 -- 172.21.15.45:0/54771626 >> 172.21.15.45:0/54771626 conn(0x562785c00c00 msgr2=0x562785ce3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 -- start start 2023-12-19T17:57:13.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 Processor -- start 2023-12-19T17:57:13.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 -- 172.21.15.45:0/54771626 shutdown_connections 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:4 9.24 9:24924924::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153ff400 con 0x5573153ff000 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5573153ff000 0x557315434000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5573153ff000 0x557315434000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6c00 msgr2=0x55e4ec946680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6c00 0x55e4ec946680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 msgr2=0x55e4ec947180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ecbe6400 0x55e4ec947180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ec8c0000 con 0x55e4ecbe6800 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6800 0x55e4ec946c00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55e4ed7256e0 tx=0x55e4ecb9cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ecbe6c00 0x55e4ec946680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79c88a7700 1 -- 172.21.15.45:0/4169426698 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e4ec8cf080 con 0x55e4ecbe6800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79c88a7700 1 -- 172.21.15.45:0/4169426698 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e4ec8ea180 con 0x55e4ecbe6800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79c88a7700 1 -- 172.21.15.45:0/4169426698 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55e4ec8cf600 con 0x55e4ecbe6800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e4ec8c0ea0 con 0x55e4ecbe6800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4ec8c1520 con 0x55e4ecbe6800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f79d00f7840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d2119eaea0 con 0x55d211cc8800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d2119eb520 con 0x55d211cc8800 2023-12-19T17:57:13.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f9b14ada840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902800 msgr2=0x555a876aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87902800 0x555a876aa580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902400 msgr2=0x555a876aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555a876271e0 con 0x555a87902c00 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87902400 0x555a876aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba49efa700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902c00 0x555a876ac100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x555a878fd590 tx=0x555a883fed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba446ef700 1 -- 172.21.15.45:0/2138239300 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555a87634f20 con 0x555a87902c00 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555a87626ea0 con 0x555a87902c00 2023-12-19T17:57:13.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301c00 0x5643e33a7b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e6800 0x5643e33a7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 0x5643e33a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e3337e00 con 0x5643e40e6400 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e3380280 con 0x5643e40e6800 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba753a840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643e33803c0 con 0x5643e3301c00 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba64f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 0x5643e33a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba64f7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 0x5643e33a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43390/0 (socket says 172.21.15.45:43390) 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba64f7700 1 -- 172.21.15.45:0/1199157949 learned_addr learned my addr 172.21.15.45:0/1199157949 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301c00 0x5643e33a7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555a87626b60 con 0x555a87902c00 2023-12-19T17:57:13.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fba4bf3f840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fba446ef700 1 -- 172.21.15.45:0/2138239300 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555a878f2600 con 0x555a87902c00 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fba446ef700 1 -- 172.21.15.45:0/2138239300 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555a87634f20 con 0x555a87902c00 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba64f7700 1 -- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301c00 msgr2=0x5643e33a7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301c00 0x5643e33a7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba64f7700 1 -- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e6800 msgr2=0x5643e33a7600 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e6800 0x5643e33a7600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba64f7700 1 -- 172.21.15.45:0/1199157949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e3322ea0 con 0x5643e40e6400 2023-12-19T17:57:13.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301c00 0x5643e33a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:13.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d0734700 1 -- 172.21.15.45:0/3190738841 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x562a877d6840 con 0x562a87ac2c00 2023-12-19T17:57:13.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.884+0000 7f1eb4cba840 1 -- 172.21.15.45:0/54771626 wait complete. 2023-12-19T17:57:13.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=49b] v66'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ff000 2023-12-19T17:57:13.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f7be961d700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:5 9.14 9:28000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573152a9400 con 0x5573153fe800 2023-12-19T17:57:13.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f1eb4cba840 1 Processor -- start 2023-12-19T17:57:13.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 68 out=49b] v66'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1efc0 con 0x5573153fe800 2023-12-19T17:57:13.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f1eb4cba840 1 -- start start 2023-12-19T17:57:13.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f7be8e1c700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5573153ff400 0x557315436680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d0734700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562a87ac3800 0x562a87821700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d0734700 1 -- 172.21.15.45:0/3190738841 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x562a877b2a80 con 0x562a87ac2c00 2023-12-19T17:57:13.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 0x5643e33a6b00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5643e3413320 tx=0x5643e40e0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d91d4848c0f8c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d7f84840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d7f84840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d7f84840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562a87ac3c00 0x562a87820100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be2000 con 0x562a87ac3c00 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f7be8e1c700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:6 9.34 9:2c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c000 con 0x5573153ff400 2023-12-19T17:57:13.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5573153ff400 0x557315436680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f9b0d28a700 1 -- 172.21.15.45:0/1496362593 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55d211a26840 con 0x55d211cc8800 2023-12-19T17:57:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562a87ac3800 0x562a87821700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562a87ac3c00 0x562a87820100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba34f1700 1 -- 172.21.15.45:0/1199157949 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643e33311e0 con 0x5643e40e6400 2023-12-19T17:57:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba34f1700 1 -- 172.21.15.45:0/1199157949 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643e334c180 con 0x5643e40e6400 2023-12-19T17:57:13.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba34f1700 1 -- 172.21.15.45:0/1199157949 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643e3331600 con 0x5643e40e6400 2023-12-19T17:57:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643e3323520 con 0x5643e40e6400 2023-12-19T17:57:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5643e33236c0 con 0x5643e40e6400 2023-12-19T17:57:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba753a840 4 waiting for MDS map... 2023-12-19T17:57:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4800 0x562785ca9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f1eb4cba840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef4c00 0x562785ca8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f79c88a7700 1 -- 172.21.15.45:0/4169426698 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55e4ec8fc840 con 0x55e4ecbe6800 2023-12-19T17:57:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f1eb3c77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4800 0x562785ca9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f1eb3c77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4800 0x562785ca9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:47948/0 (socket says 172.21.15.45:47948) 2023-12-19T17:57:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f9b0d28a700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d211d1ec00 0x55d211a71700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562a87ac3800 0x562a87821700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x562a878deb70 tx=0x562a88568000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7fba446ef700 1 -- 172.21.15.45:0/2138239300 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x555a87662840 con 0x555a87902c00 2023-12-19T17:57:13.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.888+0000 7f2ba34f1700 1 -- 172.21.15.45:0/1199157949 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5643e333ac40 con 0x5643e40e6400 2023-12-19T17:57:13.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 learned_addr learned my addr 172.21.15.45:0/3290806850 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef5000 0x562785ca8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562a87ac3c00 0x562a87820100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba34f1700 1 -- 172.21.15.45:0/1199157949 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x5643e35f2000 con 0x5643e40e6400 2023-12-19T17:57:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 4 Got MDS map 42 2023-12-19T17:57:13.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b0d28a700 1 -- 172.21.15.45:0/1496362593 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55d211a02a80 con 0x55d211cc8800 2023-12-19T17:57:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef4c00 0x562785ca8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79c88a7700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55e4ecbe7400 0x55e4ec947700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x562785c803c0 con 0x562785ef4c00 2023-12-19T17:57:13.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f7bee627700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5573153ff400 0x557315436680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b14ada840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:13.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79c88a7700 1 -- 172.21.15.45:0/4169426698 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x55e4ec8d8a80 con 0x55e4ecbe6800 2023-12-19T17:57:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79d00f7840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x562785c80280 con 0x562785ef4800 2023-12-19T17:57:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79d00f7840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b14ada840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b14ada840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d211cc9400 0x55d211a70100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211cc9800 con 0x55d211cc9400 2023-12-19T17:57:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79d00f7840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x562785c80140 con 0x562785ef5000 2023-12-19T17:57:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba446ef700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555a87a5e000 0x555a87a64000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x562a87a64b40 con 0x562a87ac3c00 2023-12-19T17:57:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562a87be2400 0x562a8781fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55e4ecbe7800 0x55e4ec946100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecbe7c00 con 0x55e4ecbe7800 2023-12-19T17:57:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef5000 0x562785ca8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be2800 con 0x562a87be2400 2023-12-19T17:57:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55e4ecbe7400 0x55e4ec947700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d211cc9400 0x55d211a70100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef5000 msgr2=0x562785ca8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785ef5000 0x562785ca8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4800 msgr2=0x562785ca9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785ef4800 0x562785ca9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562785c231e0 con 0x562785ef4c00 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 Processor -- start 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba446ef700 1 -- 172.21.15.45:0/2138239300 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x555a8763ea80 con 0x555a87902c00 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4bf3f840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4bf3f840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4bf3f840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555a87903000 0x555a876ac680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87903400 con 0x555a87903000 2023-12-19T17:57:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d211d1ec00 0x55d211a71700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555a87a5e000 0x555a87a64000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1ed80 con 0x5573153ff400 2023-12-19T17:57:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f7be961d700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55731543c000 0x557315436c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f7be961d700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.c 9:30000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153fe400 con 0x55731543c000 2023-12-19T17:57:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562a87be2400 0x562a8781fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555a87903000 0x555a876ac680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 -- start start 2023-12-19T17:57:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55e4ecbe7800 0x55e4ec946100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555a87a5e000 0x555a87a64000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x555a878fc8a0 tx=0x555a884014a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55731543c000 0x557315436c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55e4ecbe7400 0x55e4ec947700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55e4ecc4ed80 tx=0x55e4ed60e180 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d211d1ec00 0x55d211a71700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55d211adb380 tx=0x55d21283fec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef4c00 0x562785ca8c00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x5627869e53b0 tx=0x5627869eafc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d211cc9400 0x55d211a70100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562a87be2400 0x562a8781fb80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e3380500 con 0x5643e3301800 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e3380780 con 0x5643e40e7000 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba753a840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643e3380280 con 0x5643e40e7400 2023-12-19T17:57:13.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55e4ecbe7800 0x55e4ec946100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f7bede26700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55731543c000 0x557315436c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f1ead46a700 1 -- 172.21.15.45:0/3290806850 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562785c30f20 con 0x562785ef4c00 2023-12-19T17:57:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b12a95700 1 -- 172.21.15.45:0/1496362593 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55d2127a6b40 con 0x55d211cc9400 2023-12-19T17:57:13.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be2400 2023-12-19T17:57:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba54f5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562a87be2c00 0x562a8781f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3000 con 0x562a87be2c00 2023-12-19T17:57:13.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d211cc9c00 0x55d211a6fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555a87903000 0x555a876ac680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.892+0000 7f2ba5cf6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43410/0 (socket says 172.21.15.45:43410) 2023-12-19T17:57:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 -- 172.21.15.45:0/538656731 learned_addr learned my addr 172.21.15.45:0/538656731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1f000 con 0x55d211cc9c00 2023-12-19T17:57:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f1ead46a700 1 -- 172.21.15.45:0/3290806850 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5627869f0780 con 0x562785ef4c00 2023-12-19T17:57:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f1ead46a700 1 -- 172.21.15.45:0/3290806850 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x562785c31080 con 0x562785ef4c00 2023-12-19T17:57:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecbe7800 2023-12-19T17:57:13.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562a87be2c00 0x562a8781f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55e4ecd08000 0x55e4ec945b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08400 con 0x55e4ecd08000 2023-12-19T17:57:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x555a8848eb40 con 0x555a87903000 2023-12-19T17:57:13.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562785c22ea0 con 0x562785ef4c00 2023-12-19T17:57:13.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562785c22b60 con 0x562785ef4c00 2023-12-19T17:57:13.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f1eb4cba840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d211cc9c00 0x55d211a6fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555a87903800 0x555a876acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55e4ecd08000 0x55e4ec945b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5e400 con 0x555a87903800 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 -- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e40e7400 msgr2=0x5643e33a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 -- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7000 msgr2=0x5643e33a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 -- 172.21.15.45:0/538656731 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e3323860 con 0x5643e3301800 2023-12-19T17:57:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 68 out=81b] v68'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x557315e1efc0 con 0x55731543c000 2023-12-19T17:57:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bef66a840 20 datascan.forall_objects: OSD matched oid 100000001fc.00000000 2023-12-19T17:57:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bef66a840 10 datascan.operator(): handling object 100000001fc.0 2023-12-19T17:57:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 9.c 9:30604137:::100000001fc.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153ff800 con 0x55731543c000 2023-12-19T17:57:13.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 0x5643e33a8100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x5643e36005a0 tx=0x5643e3602fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3b7dea40a181389 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562a87be2c00 0x562a8781f600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d211cc9c00 0x55d211a6fb80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555a87903800 0x555a876acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(8 100000001fc.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x557315e1efc0 con 0x55731543c000 2023-12-19T17:57:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba14ed700 1 -- 172.21.15.45:0/538656731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643e3331080 con 0x5643e3301800 2023-12-19T17:57:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5573153ffc00 0x557315434b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 10.c 10:30604137:::100000001fc.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c800 con 0x5573153ffc00 2023-12-19T17:57:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba14ed700 1 -- 172.21.15.45:0/538656731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643e40f8a80 con 0x5643e3301800 2023-12-19T17:57:13.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba14ed700 1 -- 172.21.15.45:0/538656731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643e3331080 con 0x5643e3301800 2023-12-19T17:57:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211cc9c00 2023-12-19T17:57:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d211d1f400 0x55d211a6f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55e4ecd08000 0x55e4ec945b80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a87a64b40 con 0x562a87be2c00 2023-12-19T17:57:13.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5573153ffc00 0x557315434b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1f800 con 0x55d211d1f400 2023-12-19T17:57:13.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3400 con 0x562a87be2c00 2023-12-19T17:57:13.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd08000 2023-12-19T17:57:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 -- 172.21.15.45:0/538656731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 msgr2=0x5643e33a8100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 0x5643e33a8100 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x5643e36005a0 tx=0x5643e3602fc0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d211d1f400 0x55d211a6f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55e4ecd08800 0x55e4ec945600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 -- 172.21.15.45:0/538656731 shutdown_connections 2023-12-19T17:57:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 --2- 172.21.15.45:0/538656731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555a87903800 0x555a876acc00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f2ba753a840 1 -- 172.21.15.45:0/538656731 >> 172.21.15.45:0/538656731 conn(0x5643e40e6c00 msgr2=0x5643e33e4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08c00 con 0x55e4ecd08800 2023-12-19T17:57:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.896+0000 7f1ead46a700 1 -- 172.21.15.45:0/3290806850 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x562785c5e840 con 0x562785ef4c00 2023-12-19T17:57:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1ead46a700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562785f68800 0x562785ca9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55e4ecd08800 0x55e4ec945600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x555a8848ed80 con 0x555a87903800 2023-12-19T17:57:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a87a64b40 con 0x562a87be2c00 2023-12-19T17:57:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555a87a5e800 0x555a876ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5ec00 con 0x555a87a5e800 2023-12-19T17:57:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d7f84840 20 datascan.forall_objects: OSD matched oid 10000000206.00000000 2023-12-19T17:57:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d7f84840 10 datascan.operator(): handling object 10000000206.0 2023-12-19T17:57:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1ead46a700 1 -- 172.21.15.45:0/3290806850 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x562785c3aa80 con 0x562785ef4c00 2023-12-19T17:57:13.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:5 9.0 9:012cdbc7:::10000000206.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be2000 con 0x562a87be2c00 2023-12-19T17:57:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 -- 172.21.15.45:0/538656731 shutdown_connections 2023-12-19T17:57:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 -- 172.21.15.45:0/538656731 wait complete. 2023-12-19T17:57:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bed625700 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5573153ffc00 0x557315434b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555a87a5e800 0x555a876ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(5 10000000206.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x562a87a64b40 con 0x562a87be2c00 2023-12-19T17:57:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562785ef5400 0x562785ca8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d211d1f400 0x55d211a6f600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562a87be3000 0x562a87bfc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:6 10.0 10:012cdbc7:::10000000206.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3800 con 0x562a87be3000 2023-12-19T17:57:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785ef5800 con 0x562785ef5400 2023-12-19T17:57:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(9 100000001fc.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:13.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fc 2023-12-19T17:57:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/7 2023-12-19T17:57:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=7 2023-12-19T17:57:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543cc00 con 0x5573153ffc00 2023-12-19T17:57:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562785f68800 0x562785ca9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55e4ecd08800 0x55e4ec945600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562785ef5400 0x562785ca8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562a87be3000 0x562a87bfc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 Processor -- start 2023-12-19T17:57:13.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(10 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2023-12-19T17:57:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/7, will insert to root 2023-12-19T17:57:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:11 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543d000 con 0x5573153ffc00 2023-12-19T17:57:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562785f68800 0x562785ca9700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x5627869e48a0 tx=0x562785ce1440 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211d1f400 2023-12-19T17:57:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 -- start start 2023-12-19T17:57:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555a87a5e800 0x555a876ad180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562785ef5400 0x562785ca8100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 9.36 9:6db6db6d::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1fc00 con 0x55d211d1f400 2023-12-19T17:57:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562a87be3000 0x562a87bfc580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e4ed690fc0 con 0x55e4ecd08800 2023-12-19T17:57:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x562786a7eb40 con 0x562785ef5400 2023-12-19T17:57:13.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55e4ecd09000 0x55e4ecd20000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:4 9.12 9:49249249::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09400 con 0x55e4ecd09000 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=101b] v68'23 uv23 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211d1f400 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b14ada840 20 datascan.forall_objects: OSD matched oid 100000001f9.00000000 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b14ada840 10 datascan.operator(): handling object 100000001f9.0 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:5 9.36 9:6ee5e2c4:::100000001f9.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e36000 con 0x55d211d1f400 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562785ef5c00 0x562785ca7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f68c00 con 0x562785ef5c00 2023-12-19T17:57:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(11 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T17:57:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:12 8.10 8:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543d400 con 0x5573153ffc00 2023-12-19T17:57:13.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562785ef5c00 0x562785ca7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e3380140 con 0x5643e40e7000 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643e3380000 con 0x5643e40e7400 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.900+0000 7f2ba753a840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643e3381040 con 0x5643e3301800 2023-12-19T17:57:13.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55e4ecd09000 0x55e4ecd20000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(6 10000000206.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d7f84840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: inode: 0x0x10000000206 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/17 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d7f84840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=17 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562a87be3c00 0x562a87bfcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04000 con 0x562a87be3c00 2023-12-19T17:57:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(5 100000001f9.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv22 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211d1f400 2023-12-19T17:57:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d211e36400 0x55d211e3c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:6 10.16 10:6ee5e2c4:::100000001f9.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e36800 con 0x55d211e36400 2023-12-19T17:57:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555a8848eb40 con 0x555a87a5e800 2023-12-19T17:57:13.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562785ef5c00 0x562785ca7b80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:4 9.9 9:92492492::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f000 con 0x555a87903800 2023-12-19T17:57:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43426/0 (socket says 172.21.15.45:43426) 2023-12-19T17:57:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 learned_addr learned my addr 172.21.15.45:0/51911171 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:13.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562a87be3c00 0x562a87bfcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848ed80 con 0x555a87903800 2023-12-19T17:57:13.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x562786a7ed80 con 0x562785ef5c00 2023-12-19T17:57:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562785f69000 0x562785ca7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f69400 con 0x562785f69000 2023-12-19T17:57:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d211e36400 0x55d211e3c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba45ef2700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x555a87903400 0x555a87a64580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba45ef2700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 9.29 9:94000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5e400 con 0x555a87903400 2023-12-19T17:57:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301800 msgr2=0x5643e33a8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301800 0x5643e33a8100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7400 msgr2=0x5643e33a8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e7400 0x5643e33a8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643e33229c0 con 0x5643e40e7000 2023-12-19T17:57:13.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55e4ecd09000 0x55e4ecd20000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562785f69000 0x562785ca7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 0x5643e33a8680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x5643e3601860 tx=0x5643e40e0060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2b9fcea700 1 -- 172.21.15.45:0/51911171 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643e3330f20 con 0x5643e40e7000 2023-12-19T17:57:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2b9fcea700 1 -- 172.21.15.45:0/51911171 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643e40f9500 con 0x5643e40e7000 2023-12-19T17:57:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2b9fcea700 1 -- 172.21.15.45:0/51911171 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643e3331080 con 0x5643e40e7000 2023-12-19T17:57:13.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fa1d6f41700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562a87be3c00 0x562a87bfcb00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643e33231e0 con 0x5643e40e7000 2023-12-19T17:57:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643e3323860 con 0x5643e40e7000 2023-12-19T17:57:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f2ba753a840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba49efa700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x555a87903400 0x555a87a64580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd09000 2023-12-19T17:57:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562785f69000 0x562785ca7600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f79ca0aa700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:5 9.32 9:4c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecbe7c00 con 0x55e4ecbe7800 2023-12-19T17:57:13.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d211e36400 0x55d211e3c580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7fba49efa700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x555a87903400 0x555a87a64580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b12a95700 1 -- 172.21.15.45:0/1496362593 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(6 100000001f9.00000000 [getxattr (30) out=30b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x55d2127a6b40 con 0x55d211e36400 2023-12-19T17:57:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f9 2023-12-19T17:57:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/4 2023-12-19T17:57:13.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=4 2023-12-19T17:57:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d211e36c00 0x55d211e3cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37000 con 0x55d211e36c00 2023-12-19T17:57:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecbe7800 2023-12-19T17:57:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562786a7efc0 con 0x562785f69000 2023-12-19T17:57:13.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f79c98a9700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:6 9.a 9:50000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09400 con 0x55e4ecd09000 2023-12-19T17:57:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562785f69800 0x562786072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:4 9.2d 9:b6db6db6::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f69c00 con 0x562785f69800 2023-12-19T17:57:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.904+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d211e36c00 0x55d211e3cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:13.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562785f69800 0x562786072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba456f1700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x555a87a5ec00 0x555a87a64b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba456f1700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 9.19 9:98000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94000 con 0x555a87a5ec00 2023-12-19T17:57:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd09000 2023-12-19T17:57:14.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(12 10000000000.00000000 [create,omap-set-header] v68'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bef66a840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-12-19T17:57:14.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:13 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153fec00 con 0x5573153ffc00 2023-12-19T17:57:14.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79ca0aa700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55e4ecd09800 0x55e4ecd22680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79ca0aa700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.2a 9:54000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09c00 con 0x55e4ecd09800 2023-12-19T17:57:14.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x555a87a5ec00 0x555a87a64b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2b9fcea700 1 -- 172.21.15.45:0/51911171 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5643e335eb00 con 0x5643e40e7000 2023-12-19T17:57:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(7 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562785f69800 0x562786072000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/17, will insert to root 2023-12-19T17:57:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04400 con 0x562a87be3c00 2023-12-19T17:57:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b13a97700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d211e36c00 0x55d211e3cb00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55e4ecd09800 0x55e4ecd22680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4aefc700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x555a87a5ec00 0x555a87a64b00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2b9fcea700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643e3752000 0x5643e33a9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2b9fcea700 1 -- 172.21.15.45:0/51911171 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5643e333aa80 con 0x5643e40e7000 2023-12-19T17:57:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(13 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bef66a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=7 frag=*, r=0 2023-12-19T17:57:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bef66a840 20 datascan.read_dentry: 7_head not found in result 2023-12-19T17:57:14.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bef66a840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fc at 0x0x10000000000/7 with size=6291456 bytes 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(7 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/4, will insert to root 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37400 con 0x55d211e36c00 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:14 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153fe400 con 0x5573153ffc00 2023-12-19T17:57:14.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba753a840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:14.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 68 out=101b] v68'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x555a8848ed80 con 0x555a87a5ec00 2023-12-19T17:57:14.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba753a840 4 datascan.main: data pool 'cephfs_data' has ID 9 2023-12-19T17:57:14.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba753a840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T17:57:14.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643e40e7800 0x5643e33a9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 8.14 8:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e40e7c00 con 0x5643e40e7800 2023-12-19T17:57:14.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643e3752000 0x5643e33a9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(8 10000000000.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-12-19T17:57:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04800 con 0x562a87be3c00 2023-12-19T17:57:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79cf0b4700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55e4ecd09800 0x55e4ecd22680 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7eb40 con 0x562785f69800 2023-12-19T17:57:14.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 20 datascan.forall_objects: OSD matched oid 10000000200.00000000 2023-12-19T17:57:14.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 10 datascan.operator(): handling object 10000000200.0 2023-12-19T17:57:14.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(8 10000000000.00000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-12-19T17:57:14.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 9.19 9:992a6246:::10000000200.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f400 con 0x555a87a5ec00 2023-12-19T17:57:14.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eaec6d700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 9.1d 9:b8000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607a000 con 0x562785ef5c00 2023-12-19T17:57:14.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37800 con 0x55d211e36c00 2023-12-19T17:57:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(7 10000000200.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x555a8848ed80 con 0x555a87a5ec00 2023-12-19T17:57:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:8 10.19 10:992a6246:::10000000200.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f800 con 0x555a87a5e800 2023-12-19T17:57:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 68 out=101b] v68'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd09800 2023-12-19T17:57:14.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643e40e7800 0x5643e33a9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79d00f7840 20 datascan.forall_objects: OSD matched oid 1000000020a.00000000 2023-12-19T17:57:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79d00f7840 10 datascan.operator(): handling object 1000000020a.0 2023-12-19T17:57:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:8 9.2a 9:55a6cd83:::1000000020a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd30000 con 0x55e4ecd09800 2023-12-19T17:57:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643e3752000 0x5643e33a9700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5643e3600660 tx=0x5643e3602d20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 68 out=49b] v66'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7ed80 con 0x562785ef5c00 2023-12-19T17:57:14.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eae46c700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562785f68c00 0x562786074680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eae46c700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:6 9.3d 9:bc000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607e000 con 0x562785f68c00 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(8 10000000200.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x555a8848eb40 con 0x555a87a5e800 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: inode: 0x0x10000000200 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/11 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=11 2023-12-19T17:57:14.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5fc00 con 0x555a87903400 2023-12-19T17:57:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562785f68c00 0x562786074680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.908+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(8 1000000020a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd09800 2023-12-19T17:57:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643e40e7800 0x5643e33a9180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55e4ecd30400 0x55e4ecd20b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 10.a 10:55a6cd83:::1000000020a.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd30800 con 0x55e4ecd30400 2023-12-19T17:57:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb3c77700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562785f68c00 0x562786074680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55e4ecd30400 0x55e4ecd20b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv100 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e40e7800 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643e3752400 0x5643e3764000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 8.1f 8:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3752800 con 0x5643e3752400 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(14 10000000000.00000000 [omap-set-vals] v68'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x100000001fc 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-12-19T17:57:14.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:15 8.1f 8:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153ff800 con 0x5573152a9800 2023-12-19T17:57:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643e3752400 0x5643e3764000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 68 out=81b] v68'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(9 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d7f84840 20 datascan.read_dentry: oid=10000000000.00000000 dname=17 frag=*, r=0 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d7f84840 20 datascan.read_dentry: 17_head not found in result 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000206 at 0x0x10000000000/17 with size=6291456 bytes 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04c00 con 0x562a87be3c00 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 20 datascan.forall_objects: OSD matched oid 10000000205.00000000 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 10 datascan.operator(): handling object 10000000205.0 2023-12-19T17:57:14.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 9.3d 9:bfcd3380:::10000000205.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607e800 con 0x562785f68c00 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(15 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:16 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573152a9400 con 0x5573152a9800 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(9 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f9b14ada840 20 datascan.read_dentry: oid=10000000000.00000000 dname=4 frag=*, r=0 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f9b14ada840 20 datascan.read_dentry: 4_head not found in result 2023-12-19T17:57:14.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f9b14ada840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f9 at 0x0x10000000000/4 with size=6291456 bytes 2023-12-19T17:57:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79ce8b3700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55e4ecd30400 0x55e4ecd20b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37c00 con 0x55d211e36c00 2023-12-19T17:57:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(9 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fba4bf3f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fba4bf3f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fba4bf3f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/11, will insert to root 2023-12-19T17:57:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94800 con 0x555a87903400 2023-12-19T17:57:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643e3752400 0x5643e3764000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(16 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T17:57:14.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:17 8.1f 8:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c800 con 0x5573152a9800 2023-12-19T17:57:14.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(7 10000000205.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:8 10.1d 10:bfcd3380:::10000000205.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607ec00 con 0x562785ef5400 2023-12-19T17:57:14.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e3752400 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(9 1000000020a.00000000 [getxattr (30) out=30b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x55e4ed690fc0 con 0x55e4ecd30400 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020a 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/21 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=21 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643e3752c00 0x5643e3764580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:3 9.0 9:00000000::::head [pgnls-filter start_epoch 68 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753000 con 0x5643e3752c00 2023-12-19T17:57:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55e4ecd30c00 0x55e4ecd21080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31000 con 0x55e4ecd30c00 2023-12-19T17:57:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643e3752c00 0x5643e3764580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(8 10000000205.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562786a7eb40 con 0x562785ef5400 2023-12-19T17:57:14.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: inode: 0x0x10000000205 2023-12-19T17:57:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/16 2023-12-19T17:57:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=16 2023-12-19T17:57:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f000 con 0x562785f68c00 2023-12-19T17:57:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55e4ecd30c00 0x55e4ecd21080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643e3752c00 0x5643e3764580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(10 10000000000.00000000 [omap-set-vals] v68'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d7f84840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000206 2023-12-19T17:57:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:11 9.20 9:04000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05000 con 0x562a87be2400 2023-12-19T17:57:14.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.912+0000 7f79ce0b2700 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55e4ecd30c00 0x55e4ecd21080 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3752c00 2023-12-19T17:57:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 68 out=81b] v68'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be2400 2023-12-19T17:57:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 20 datascan.forall_objects: OSD matched oid 1000000020b.00000000 2023-12-19T17:57:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 10 datascan.operator(): handling object 1000000020b.0 2023-12-19T17:57:14.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 9.20 9:05552577:::1000000020b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05400 con 0x562a87be2400 2023-12-19T17:57:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643e3753400 0x5643e3764b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:4 9.1b 9:db6db6db::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753800 con 0x5643e3753400 2023-12-19T17:57:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643e3753400 0x5643e3764b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(12 1000000020b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be2400 2023-12-19T17:57:14.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 10.0 10:05552577:::1000000020b.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05800 con 0x562a87be3000 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643e3753400 0x5643e3764b00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(13 1000000020b.00000000 [getxattr (30) out=30b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020b 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/22 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=22 2023-12-19T17:57:14.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:14 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05c00 con 0x562a87be3c00 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3753400 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba14ed700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643e40e7c00 0x5643e3765b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba14ed700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:5 9.3b 9:dc000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753800 con 0x5643e40e7c00 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643e40e7c00 0x5643e3765b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643e40e7c00 0x5643e3765b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 68 out=81b] v68'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e40e7c00 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba753a840 20 datascan.forall_objects: OSD matched oid 100000001fe.00000000 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba753a840 10 datascan.operator(): handling object 100000001fe.0 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.916+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:6 9.3b 9:deccbd37:::100000001fe.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3752800 con 0x5643e40e7c00 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(6 100000001fe.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e40e7c00 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 10.1b 10:deccbd37:::100000001fe.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753800 con 0x5643e3753400 2023-12-19T17:57:14.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(7 100000001fe.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3753400 2023-12-19T17:57:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fe 2023-12-19T17:57:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/9 2023-12-19T17:57:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=9 2023-12-19T17:57:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(10 10000000000.00000000 [omap-set-vals] v68'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643e3301400 0x5643e3765600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782000 con 0x5643e3301400 2023-12-19T17:57:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x100000001f9 2023-12-19T17:57:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:11 9.36 9:6fe38dc2::::head [pgnls-filter start_epoch 68 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37000 con 0x55d211d1f400 2023-12-19T17:57:14.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(10 10000000000.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:11 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94c00 con 0x555a87903400 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643e3301400 0x5643e3765600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(9 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 68 out=81b] v68'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211d1f400 2023-12-19T17:57:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/16, will insert to root 2023-12-19T17:57:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f400 con 0x562785f68c00 2023-12-19T17:57:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2023-12-19T17:57:14.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 10 datascan.operator(): handling object 100000001f7.0 2023-12-19T17:57:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:12 9.36 9:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37400 con 0x55d211d1f400 2023-12-19T17:57:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(17 1.00000000 [create,omap-set-header] v68'11 uv11 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(10 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bef66a840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2023-12-19T17:57:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:18 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543cc00 con 0x5573152a9800 2023-12-19T17:57:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/21, will insert to root 2023-12-19T17:57:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:11 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31400 con 0x55e4ecd30c00 2023-12-19T17:57:14.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(14 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/22, will insert to root 2023-12-19T17:57:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04400 con 0x562a87be3c00 2023-12-19T17:57:14.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba5cf6700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643e3301400 0x5643e3765600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(11 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=11 frag=*, r=0 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 20 datascan.read_dentry: 11_head not found in result 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000200 at 0x0x10000000000/11 with size=6291456 bytes 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:12 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95000 con 0x555a87903400 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(18 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bef66a840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bef66a840 20 datascan.read_dentry: subdir_head not found in result 2023-12-19T17:57:14.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bef66a840 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2023-12-19T17:57:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:19 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543d000 con 0x5573152a9800 2023-12-19T17:57:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(12 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv23 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211d1f400 2023-12-19T17:57:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 10.16 10:6fe38dc2:::100000001f7.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e36000 con 0x55d211e36400 2023-12-19T17:57:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(10 10000000000.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T17:57:14.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:11 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f800 con 0x562785f68c00 2023-12-19T17:57:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(11 10000000000.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T17:57:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:12 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31800 con 0x55e4ecd30c00 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04800 con 0x562a87be3c00 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(8 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/9, will insert to root 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:9 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782400 con 0x5643e3301400 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b12a95700 1 -- 172.21.15.45:0/1496362593 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(13 100000001f7.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x55d2127a6b40 con 0x55d211e36400 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/2 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=2 2023-12-19T17:57:14.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.920+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:14 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1f000 con 0x55d211e36c00 2023-12-19T17:57:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(19 1.00000000 [omap-set-vals] v68'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-12-19T17:57:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:20 9.2c 9:34000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543d800 con 0x55731543c000 2023-12-19T17:57:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(12 10000000000.00000000 [omap-set-vals] v68'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x10000000200 2023-12-19T17:57:14.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:13 9.19 9:997b7129::::head [pgnls-filter start_epoch 68 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95400 con 0x555a87a5ec00 2023-12-19T17:57:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x557315e1efc0 con 0x55731543c000 2023-12-19T17:57:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 20 datascan.forall_objects: OSD matched oid 10000000209.00000000 2023-12-19T17:57:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 10 datascan.operator(): handling object 10000000209.0 2023-12-19T17:57:14.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:21 9.2c 9:37389ade:::10000000209.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543dc00 con 0x55731543c000 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(11 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f1eb4cba840 20 datascan.read_dentry: oid=10000000000.00000000 dname=16 frag=*, r=0 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f1eb4cba840 20 datascan.read_dentry: 16_head not found in result 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000205 at 0x0x10000000000/16 with size=6291456 bytes 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:12 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607fc00 con 0x562785f68c00 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(12 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f79d00f7840 20 datascan.read_dentry: oid=10000000000.00000000 dname=21 frag=*, r=0 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f79d00f7840 20 datascan.read_dentry: 21_head not found in result 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f79d00f7840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020a at 0x0x10000000000/21 with size=6291456 bytes 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:13 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31000 con 0x55e4ecd30c00 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(16 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fa1d7f84840 20 datascan.read_dentry: oid=10000000000.00000000 dname=22 frag=*, r=0 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fa1d7f84840 20 datascan.read_dentry: 22_head not found in result 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020b at 0x0x10000000000/22 with size=6291456 bytes 2023-12-19T17:57:14.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04c00 con 0x562a87be3c00 2023-12-19T17:57:14.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(21 10000000209.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x557315e1efc0 con 0x55731543c000 2023-12-19T17:57:14.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(9 10000000000.00000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f2ba753a840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-12-19T17:57:14.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f2ba753a840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782800 con 0x5643e3301400 2023-12-19T17:57:14.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(13 [pgnls-filter start_epoch 68 out=81b] v68'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555a8848ed80 con 0x555a87a5ec00 2023-12-19T17:57:14.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 10.c 10:37389ade:::10000000209.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c800 con 0x5573153ffc00 2023-12-19T17:57:14.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(14 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f9b14ada840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f9b14ada840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f9b14ada840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/2, will insert to root 2023-12-19T17:57:14.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1e800 con 0x55d211e36c00 2023-12-19T17:57:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 20 datascan.forall_objects: OSD matched oid 100000001f8.00000000 2023-12-19T17:57:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 10 datascan.operator(): handling object 100000001f8.0 2023-12-19T17:57:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 9.19 9:997b7129:::100000001f8.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95800 con 0x555a87a5ec00 2023-12-19T17:57:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(22 10000000209.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 10 datascan.inject_with_backtrace: inode: 0x0x10000000209 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/20 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=20 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:23 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573152a9400 con 0x5573153ffc00 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(14 100000001f8.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x555a8848ed80 con 0x555a87a5ec00 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:15 10.19 10:997b7129:::100000001f8.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95c00 con 0x555a87a5e800 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(15 100000001f8.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x555a8848eb40 con 0x555a87a5e800 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f8 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/3 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=3 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.924+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94000 con 0x555a87903400 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(12 10000000000.00000000 [omap-set-vals] v68'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eb4cba840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000205 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:13 9.3 9:c0000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607e000 con 0x562785f68c00 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(13 10000000000.00000000 [omap-set-vals] v68'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79d00f7840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x1000000020a 2023-12-19T17:57:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 9.2a 9:57fe7535::::head [pgnls-filter start_epoch 68 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd30000 con 0x55e4ecd09800 2023-12-19T17:57:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(17 10000000000.00000000 [omap-set-vals] v68'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7fa1d7f84840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x1000000020b 2023-12-19T17:57:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(13 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eae46c700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56278607e400 0x562786074c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:18 9.10 9:08000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04000 con 0x562a87ac3c00 2023-12-19T17:57:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eae46c700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 9.23 9:c4000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f400 con 0x56278607e400 2023-12-19T17:57:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(10 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f2ba753a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=9 frag=*, r=0 2023-12-19T17:57:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f2ba753a840 20 datascan.read_dentry: 9_head not found in result 2023-12-19T17:57:14.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f2ba753a840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fe at 0x0x10000000000/9 with size=6291456 bytes 2023-12-19T17:57:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 68 out=81b] v68'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd09800 2023-12-19T17:57:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:11 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782c00 con 0x5643e3301400 2023-12-19T17:57:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79d00f7840 20 datascan.forall_objects: OSD matched oid 100000001f6.00000000 2023-12-19T17:57:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79d00f7840 10 datascan.operator(): handling object 100000001f6.0 2023-12-19T17:57:14.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(15 10000000000.00000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56278607e400 0x562786074c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.928+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:15 9.2a 9:57fe7535:::100000001f6.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31c00 con 0x55e4ecd09800 2023-12-19T17:57:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-12-19T17:57:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1f800 con 0x55d211e36c00 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(23 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/20, will insert to root 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153ff800 con 0x5573153ffc00 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(16 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/3, will insert to root 2023-12-19T17:57:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95400 con 0x555a87903400 2023-12-19T17:57:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(18 [pgnls-filter start_epoch 68 out=81b] v68'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a87a64b40 con 0x562a87ac3c00 2023-12-19T17:57:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 20 datascan.forall_objects: OSD matched oid 100000001fd.00000000 2023-12-19T17:57:14.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 10 datascan.operator(): handling object 100000001fd.0 2023-12-19T17:57:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(15 100000001f6.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd09800 2023-12-19T17:57:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:16 10.a 10:57fe7535:::100000001f6.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09400 con 0x55e4ecd30400 2023-12-19T17:57:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb3476700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56278607e400 0x562786074c00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:19 9.10 9:08b99fea:::100000001fd.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be2800 con 0x562a87ac3c00 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(16 100000001f6.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x55e4ed690fc0 con 0x55e4ecd30400 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f6 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/1 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=1 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08400 con 0x55e4ecd30c00 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(14 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7efc0 con 0x56278607e400 2023-12-19T17:57:14.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(19 100000001fd.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562a87a64b40 con 0x562a87ac3c00 2023-12-19T17:57:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eaec6d700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 9.13 9:c8000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607e000 con 0x562785f68c00 2023-12-19T17:57:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:20 10.10 10:08b99fea:::100000001fd.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04000 con 0x562a87ac3c00 2023-12-19T17:57:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(20 100000001fd.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562a87a64b40 con 0x562a87ac3c00 2023-12-19T17:57:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fd 2023-12-19T17:57:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/8 2023-12-19T17:57:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=8 2023-12-19T17:57:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:21 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05000 con 0x562a87be3c00 2023-12-19T17:57:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(15 [pgnls-filter start_epoch 68 out=81b] v68'19 uv19 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb4cba840 20 datascan.forall_objects: OSD matched oid 100000001fb.00000000 2023-12-19T17:57:14.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb4cba840 10 datascan.operator(): handling object 100000001fb.0 2023-12-19T17:57:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(11 10000000000.00000000 [omap-set-vals] v68'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f2ba753a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x100000001fe 2023-12-19T17:57:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 9.13 9:ca8fdbba:::100000001fb.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607e800 con 0x562785f68c00 2023-12-19T17:57:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643e3783000 0x5643e3766100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:12 9.7 9:e0000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783400 con 0x5643e3783000 2023-12-19T17:57:14.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(16 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 20 datascan.read_dentry: oid=10000000000.00000000 dname=2 frag=*, r=0 2023-12-19T17:57:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 20 datascan.read_dentry: 2_head not found in result 2023-12-19T17:57:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000000/2 with size=6291456 bytes 2023-12-19T17:57:14.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1fc00 con 0x55d211e36c00 2023-12-19T17:57:14.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(16 100000001fb.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv19 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643e3783000 0x5643e3766100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(24 10000000000.00000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:17 10.13 10:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f000 con 0x562785f69000 2023-12-19T17:57:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-12-19T17:57:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:25 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543d400 con 0x5573153ffc00 2023-12-19T17:57:14.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(17 10000000000.00000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(17 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/1, will insert to root 2023-12-19T17:57:14.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09c00 con 0x55e4ecd30c00 2023-12-19T17:57:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-12-19T17:57:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94800 con 0x555a87903400 2023-12-19T17:57:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(21 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/8, will insert to root 2023-12-19T17:57:14.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05400 con 0x562a87be3c00 2023-12-19T17:57:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.932+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(17 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562786a7efc0 con 0x562785f69000 2023-12-19T17:57:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fb 2023-12-19T17:57:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/6 2023-12-19T17:57:14.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=6 2023-12-19T17:57:14.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607ec00 con 0x562785f68c00 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba54f5700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643e3783000 0x5643e3766100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(12 [pgnls-filter start_epoch 68 out=101b] v68'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3783000 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba753a840 20 datascan.forall_objects: OSD matched oid 10000000207.00000000 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba753a840 10 datascan.operator(): handling object 10000000207.0 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:13 9.7 9:e15a914f:::10000000207.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783800 con 0x5643e3783000 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(13 10000000207.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3783000 2023-12-19T17:57:14.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643e3783c00 0x5643e3766c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(17 10000000000.00000000 [omap-set-vals] v68'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b14ada840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x100000001f7 2023-12-19T17:57:14.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:14 10.7 10:e15a914f:::10000000207.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783400 con 0x5643e3783c00 2023-12-19T17:57:14.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 9.e 9:70000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37800 con 0x55d211e36c00 2023-12-19T17:57:14.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(25 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f7bef66a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=20 frag=*, r=0 2023-12-19T17:57:14.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f7bef66a840 20 datascan.read_dentry: 20_head not found in result 2023-12-19T17:57:14.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f7bef66a840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000209 at 0x0x10000000000/20 with size=6291456 bytes 2023-12-19T17:57:14.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:26 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c800 con 0x5573153ffc00 2023-12-19T17:57:14.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(18 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643e3783c00 0x5643e3766c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fba4bf3f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=3 frag=*, r=0 2023-12-19T17:57:14.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fba4bf3f840 20 datascan.read_dentry: 3_head not found in result 2023-12-19T17:57:14.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f8 at 0x0x10000000000/3 with size=6291456 bytes 2023-12-19T17:57:14.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94c00 con 0x555a87903400 2023-12-19T17:57:14.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(18 [pgnls-filter start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(18 10000000000.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f79d00f7840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-12-19T17:57:14.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f79d00f7840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b0e28c700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 9.2e 9:74000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4c000 con 0x55d211e36c00 2023-12-19T17:57:14.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecbe7c00 con 0x55e4ecd30c00 2023-12-19T17:57:14.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(22 10000000000.00000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-12-19T17:57:14.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:23 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05c00 con 0x562a87be3c00 2023-12-19T17:57:14.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(18 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/6, will insert to root 2023-12-19T17:57:14.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f69c00 con 0x562785f68c00 2023-12-19T17:57:14.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(19 [pgnls-filter start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:20 9.1e 9:78000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4c400 con 0x55d211cc9c00 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.936+0000 7f2ba64f7700 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643e3783c00 0x5643e3766c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(14 10000000207.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e3783c00 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 10 datascan.inject_with_backtrace: inode: 0x0x10000000207 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/18 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=18 2023-12-19T17:57:14.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:15 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783800 con 0x5643e3301400 2023-12-19T17:57:14.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 68 out=81b] v68'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211cc9c00 2023-12-19T17:57:14.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 20 datascan.forall_objects: OSD matched oid 1000000020c.00000000 2023-12-19T17:57:14.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 10 datascan.operator(): handling object 1000000020c.0 2023-12-19T17:57:14.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 9.1e 9:789b801b:::1000000020c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e37c00 con 0x55d211cc9c00 2023-12-19T17:57:14.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(21 1000000020c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211cc9c00 2023-12-19T17:57:14.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:22 10.1e 10:789b801b:::1000000020c.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e36800 con 0x55d211cc9c00 2023-12-19T17:57:14.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(26 10000000000.00000000 [omap-set-vals] v68'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7bef66a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000209 2023-12-19T17:57:14.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 9.1c 9:38000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5573153fec00 con 0x5573152a9800 2023-12-19T17:57:14.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(22 1000000020c.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211cc9c00 2023-12-19T17:57:14.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020c 2023-12-19T17:57:14.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/23 2023-12-19T17:57:14.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=23 2023-12-19T17:57:14.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:23 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e36000 con 0x55d211e36c00 2023-12-19T17:57:14.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(19 10000000000.00000000 [omap-set-vals] v68'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4bf3f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x100000001f8 2023-12-19T17:57:14.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:20 9.39 9:9c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f400 con 0x555a87903000 2023-12-19T17:57:14.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1ed80 con 0x5573152a9800 2023-12-19T17:57:14.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7be8e1c700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:28 9.3c 9:3c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c400 con 0x5573153ff400 2023-12-19T17:57:14.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(19 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f79d00f7840 20 datascan.read_dentry: oid=10000000000.00000000 dname=1 frag=*, r=0 2023-12-19T17:57:14.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f79d00f7840 20 datascan.read_dentry: 1_head not found in result 2023-12-19T17:57:14.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f79d00f7840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f6 at 0x0x10000000000/1 with size=6291456 bytes 2023-12-19T17:57:14.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:20 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08400 con 0x55e4ecd30c00 2023-12-19T17:57:14.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(23 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fa1d7f84840 20 datascan.read_dentry: oid=10000000000.00000000 dname=8 frag=*, r=0 2023-12-19T17:57:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fa1d7f84840 20 datascan.read_dentry: 8_head not found in result 2023-12-19T17:57:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fd at 0x0x10000000000/8 with size=6291456 bytes 2023-12-19T17:57:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04400 con 0x562a87be3c00 2023-12-19T17:57:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848eb40 con 0x555a87903000 2023-12-19T17:57:14.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba45ef2700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 9.5 9:a0000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f000 con 0x555a87903800 2023-12-19T17:57:14.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(19 10000000000.00000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f1eb4cba840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-12-19T17:57:14.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f1eb4cba840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:20 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785ef5800 con 0x562785f68c00 2023-12-19T17:57:14.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(28 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1ed80 con 0x5573153ff400 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7be961d700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:29 9.2 9:40000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543cc00 con 0x55731543c000 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(15 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/18, will insert to root 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782400 con 0x5643e3301400 2023-12-19T17:57:14.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(23 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/23, will insert to root 2023-12-19T17:57:14.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211cc9800 con 0x55d211e36c00 2023-12-19T17:57:14.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7bede26700 1 -- 172.21.15.45:0/1039258945 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(29 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1efc0 con 0x55731543c000 2023-12-19T17:57:14.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(21 [pgnls-filter start_epoch 68 out=81b] v68'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555a8848ed80 con 0x555a87903800 2023-12-19T17:57:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7f7be8e1c700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 9.22 9:44000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543c400 con 0x5573153ffc00 2023-12-19T17:57:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4bf3f840 20 datascan.forall_objects: OSD matched oid 10000000204.00000000 2023-12-19T17:57:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4bf3f840 10 datascan.operator(): handling object 10000000204.0 2023-12-19T17:57:14.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.940+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:22 9.5 9:a0beda95:::10000000204.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5e400 con 0x555a87903800 2023-12-19T17:57:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(30 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1eb40 con 0x5573153ffc00 2023-12-19T17:57:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7be961d700 1 -- 172.21.15.45:0/1039258945 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:31 9.12 9:48000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55731543d000 con 0x5573153ff400 2023-12-19T17:57:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(22 10000000204.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x555a8848ed80 con 0x555a87903800 2023-12-19T17:57:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555a87a5fc00 0x555a87a65b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:23 10.5 10:a0beda95:::10000000204.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95c00 con 0x555a87a5fc00 2023-12-19T17:57:14.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(20 10000000000.00000000 [omap-set-vals] v68'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555a87a5fc00 0x555a87a65b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79d00f7840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x100000001f6 2023-12-19T17:57:14.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:21 9.1a 9:58000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08c00 con 0x55e4ecd09800 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bee627700 1 -- 172.21.15.45:0/1039258945 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(31 [pgnls-filter start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x557315e1ed80 con 0x5573153ff400 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5573152a9800 msgr2=0x557315053b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5573152a9800 0x557315053b80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5573153fe800 msgr2=0x557315053600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5573153fe800 0x557315053600 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5573153ff000 msgr2=0x557315434000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5573153ff000 0x557315434000 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55731543c000 msgr2=0x557315436c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55731543c000 0x557315436c00 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 reap_dead start 2023-12-19T17:57:14.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5573152a9000 msgr2=0x557315054100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5573152a9000 0x557315054100 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5573153ff400 msgr2=0x557315436680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5573153ff400 0x557315436680 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5573153ffc00 msgr2=0x557315434b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5573153ffc00 0x557315434b00 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bed625700 1 -- 172.21.15.45:0/1039258945 reap_dead start 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5573153fe000 msgr2=0x557315055700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5573153fe000 0x557315055700 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x5573150be870 tx=0x5573152b7c20 comp rx=0 tx=0).stop 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 msgr2=0x557315054c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315054c00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5573152b54d0 tx=0x5573152b6c00 comp rx=0 tx=0).stop 2023-12-19T17:57:14.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(24 10000000000.00000000 [omap-set-vals] v68'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d7f84840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x100000001fd 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 9.30 9:0c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3400 con 0x562a87be2400 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 shutdown_connections 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5573153fe000 0x557315055700 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/1039258945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5573152a8800 0x557315054c00 secure :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5573152b54d0 tx=0x5573152b6c00 comp rx=0 tx=0).stop 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 >> 172.21.15.45:0/1039258945 conn(0x557314facc00 msgr2=0x55731508f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd09800 2023-12-19T17:57:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4a6fb700 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555a87a5fc00 0x555a87a65b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(20 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f1eb4cba840 20 datascan.read_dentry: oid=10000000000.00000000 dname=6 frag=*, r=0 2023-12-19T17:57:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f1eb4cba840 20 datascan.read_dentry: 6_head not found in result 2023-12-19T17:57:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fb at 0x0x10000000000/6 with size=6291456 bytes 2023-12-19T17:57:14.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:21 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607e000 con 0x562785f68c00 2023-12-19T17:57:14.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79c98a9700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:22 9.3a 9:5c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd2e000 con 0x55e4ecd08000 2023-12-19T17:57:14.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(16 10000000000.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 shutdown_connections 2023-12-19T17:57:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(24 10000000000.00000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f9b14ada840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-12-19T17:57:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f9b14ada840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/1039258945 wait complete. 2023-12-19T17:57:14.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:25 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1f000 con 0x55d211e36c00 2023-12-19T17:57:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f2ba753a840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-12-19T17:57:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f2ba753a840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:17 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782800 con 0x5643e3301400 2023-12-19T17:57:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(25 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be2400 2023-12-19T17:57:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(23 10000000204.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x555a8848eb40 con 0x555a87a5fc00 2023-12-19T17:57:14.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: inode: 0x0x10000000204 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/15 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=15 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95000 con 0x555a87903400 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d1736700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562a87c04800 0x562a87bfc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d1736700 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 9.8 9:10000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04c00 con 0x562a87c04800 2023-12-19T17:57:14.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79cf0b4700 1 -- 172.21.15.45:0/4169426698 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(22 [pgnls-filter start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690d80 con 0x55e4ecd08000 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79ca0aa700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:23 9.6 9:60000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08c00 con 0x55e4ecd09000 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562a87c04800 0x562a87bfc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 msgr2=0x557315052580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f7bef66a840 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 0x557315052580 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x5573150bf320 tx=0x55731508d440 comp rx=0 tx=0).stop 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 shutdown_connections 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x557314fad000 0x557315053080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x557314fad400 0x557315052b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 --2- 172.21.15.45:0/3147280198 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557314fad800 0x557315052580 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 >> 172.21.15.45:0/3147280198 conn(0x557314fadc00 msgr2=0x55731508f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.944+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd09000 2023-12-19T17:57:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79c98a9700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:24 9.26 9:64000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd2e400 con 0x55e4ecd09000 2023-12-19T17:57:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 shutdown_connections 2023-12-19T17:57:14.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f7bef66a840 1 -- 172.21.15.45:0/3147280198 wait complete. 2023-12-19T17:57:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d6740700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562a87c04800 0x562a87bfc000 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(21 10000000000.00000000 [omap-set-vals] v68'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb4cba840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x100000001fb 2023-12-19T17:57:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56278607e800 0x562786073080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:22 9.33 9:cc000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607ec00 con 0x56278607e800 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 68 out=81b] v68'19 uv19 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd09000 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 20 datascan.forall_objects: OSD matched oid 100000001ff.00000000 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 10 datascan.operator(): handling object 100000001ff.0 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(25 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 20 datascan.read_dentry: oid=10000000000.00000000 dname=23 frag=*, r=0 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 20 datascan.read_dentry: 23_head not found in result 2023-12-19T17:57:14.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020c at 0x0x10000000000/23 with size=6291456 bytes 2023-12-19T17:57:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:26 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211d1e800 con 0x55d211e36c00 2023-12-19T17:57:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:25 9.26 9:658f2455:::100000001ff.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09400 con 0x55e4ecd09000 2023-12-19T17:57:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(17 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(26 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a87a64b40 con 0x562a87c04800 2023-12-19T17:57:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f2ba753a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=18 frag=*, r=0 2023-12-19T17:57:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f2ba753a840 20 datascan.read_dentry: 18_head not found in result 2023-12-19T17:57:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f2ba753a840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000207 at 0x0x10000000000/18 with size=6291456 bytes 2023-12-19T17:57:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d1f37700 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:27 9.28 9:14000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05400 con 0x562a87be3000 2023-12-19T17:57:14.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(24 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/15, will insert to root 2023-12-19T17:57:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:25 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94000 con 0x555a87903400 2023-12-19T17:57:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782c00 con 0x5643e3301400 2023-12-19T17:57:14.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56278607e800 0x562786073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(25 100000001ff.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv19 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd09000 2023-12-19T17:57:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:26 10.6 10:658f2455:::100000001ff.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31400 con 0x55e4ecd09000 2023-12-19T17:57:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(27 [pgnls-filter start_epoch 68 out=101b] v68'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 20 datascan.forall_objects: OSD matched oid 10000000202.00000000 2023-12-19T17:57:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 10 datascan.operator(): handling object 10000000202.0 2023-12-19T17:57:14.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb2c75700 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56278607e800 0x562786073080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:28 9.28 9:15246602:::10000000202.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be2000 con 0x562a87be3000 2023-12-19T17:57:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(26 100000001ff.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd09000 2023-12-19T17:57:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 10 datascan.inject_with_backtrace: inode: 0x0x100000001ff 2023-12-19T17:57:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/10 2023-12-19T17:57:14.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=10 2023-12-19T17:57:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:27 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31800 con 0x55e4ecd30c00 2023-12-19T17:57:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(22 [pgnls-filter start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7eb40 con 0x56278607e800 2023-12-19T17:57:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eaec6d700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:23 9.b 9:d0000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562786090000 con 0x562785ef5c00 2023-12-19T17:57:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(28 10000000202.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:14.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 10.8 10:15246602:::10000000202.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05800 con 0x562a87be2400 2023-12-19T17:57:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(26 10000000000.00000000 [omap-set-vals] v68'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x1000000020c 2023-12-19T17:57:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d211e37c00 0x55d211e3db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 9.3e 9:7c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e36800 con 0x55d211e37c00 2023-12-19T17:57:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7ed80 con 0x562785ef5c00 2023-12-19T17:57:14.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(25 10000000000.00000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f1eae46c700 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 9.2b 9:d4000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f800 con 0x562785f68c00 2023-12-19T17:57:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-12-19T17:57:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:26 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95400 con 0x555a87903400 2023-12-19T17:57:14.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d211e37c00 0x55d211e3db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(29 10000000202.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be2400 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: inode: 0x0x10000000202 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/13 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.948+0000 7fa1d7f84840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=13 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05400 con 0x562a87be3c00 2023-12-19T17:57:14.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(24 [pgnls-filter start_epoch 68 out=81b] v68'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 20 datascan.forall_objects: OSD matched oid 10000000203.00000000 2023-12-19T17:57:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 10 datascan.operator(): handling object 10000000203.0 2023-12-19T17:57:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b13296700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d211e37c00 0x55d211e3db80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:25 9.2b 9:d4a58307:::10000000203.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f400 con 0x562785f68c00 2023-12-19T17:57:14.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(25 10000000203.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(27 [pgnls-filter start_epoch 68 out=49b] v66'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211e37c00 2023-12-19T17:57:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 10.b 10:d4a58307:::10000000203.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x56278607f000 con 0x56278607e800 2023-12-19T17:57:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:28 9.1 9:80000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4c000 con 0x55d211e37c00 2023-12-19T17:57:14.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(28 [pgnls-filter start_epoch 68 out=49b] v66'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6fc0 con 0x55d211e37c00 2023-12-19T17:57:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b0e28c700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d211e4c800 0x55d211e3c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(26 10000000203.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562786a7eb40 con 0x56278607e800 2023-12-19T17:57:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b0e28c700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:29 9.21 9:84000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4cc00 con 0x55d211e4c800 2023-12-19T17:57:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: inode: 0x0x10000000203 2023-12-19T17:57:14.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/14 2023-12-19T17:57:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=14 2023-12-19T17:57:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:27 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f69c00 con 0x562785f68c00 2023-12-19T17:57:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d211e4c800 0x55d211e3c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(18 10000000000.00000000 [omap-set-vals] v68'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba753a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000207 2023-12-19T17:57:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:19 9.7 9:e2e07930::::head [pgnls-filter start_epoch 68 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782000 con 0x5643e3783000 2023-12-19T17:57:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(27 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/10, will insert to root 2023-12-19T17:57:14.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:28 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31000 con 0x55e4ecd30c00 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(26 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fba4bf3f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=15 frag=*, r=0 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fba4bf3f840 20 datascan.read_dentry: 15_head not found in result 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000204 at 0x0x10000000000/15 with size=6291456 bytes 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:27 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94800 con 0x555a87903400 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b12a95700 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d211e4c800 0x55d211e3c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 68 out=81b] v68'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3783000 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(30 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fa1d7f84840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fa1d7f84840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fa1d7f84840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/13, will insert to root 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:31 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05c00 con 0x562a87be3c00 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba753a840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba753a840 10 datascan.operator(): handling object 10000000001.0 2023-12-19T17:57:14.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:20 9.7 9:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753800 con 0x5643e3783000 2023-12-19T17:57:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(27 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/14, will insert to root 2023-12-19T17:57:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:28 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f68400 con 0x562785f68c00 2023-12-19T17:57:14.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(28 10000000000.00000000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-12-19T17:57:14.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:29 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd30800 con 0x55e4ecd30c00 2023-12-19T17:57:14.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b12a95700 1 -- 172.21.15.45:0/1496362593 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(29 [pgnls-filter start_epoch 68 out=49b] v66'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6b40 con 0x55d211e4c800 2023-12-19T17:57:14.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 9.11 9:88000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4c400 con 0x55d211e36c00 2023-12-19T17:57:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(20 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3783000 2023-12-19T17:57:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.952+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:21 10.7 10:e2e07930:::10000000001.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753000 con 0x5643e3783c00 2023-12-19T17:57:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(30 [pgnls-filter start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211e36c00 2023-12-19T17:57:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b0e28c700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:31 9.31 9:8c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4d000 con 0x55d211cc9400 2023-12-19T17:57:14.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(21 10000000001.00000000 [getxattr (30) out=30b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e3783c00 2023-12-19T17:57:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-12-19T17:57:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/0 2023-12-19T17:57:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=0 2023-12-19T17:57:14.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783800 con 0x5643e3301400 2023-12-19T17:57:14.132 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '1', '--worker_m', '7'] in time 0:00:00.370909, result: 2023-12-19T17:57:14.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b12a95700 1 -- 172.21.15.45:0/1496362593 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(31 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6b40 con 0x55d211cc9400 2023-12-19T17:57:14.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b0ea8d700 1 -- 172.21.15.45:0/1496362593 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 9.9 9:90000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55d211e4dc00 con 0x55d211cc9c00 2023-12-19T17:57:14.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(27 10000000000.00000000 [omap-set-vals] v68'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4bf3f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000204 2023-12-19T17:57:14.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:28 9.25 9:a4000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94c00 con 0x555a87903800 2023-12-19T17:57:14.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(31 10000000000.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-12-19T17:57:14.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:32 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3800 con 0x562a87be3c00 2023-12-19T17:57:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(28 10000000000.00000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-12-19T17:57:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:29 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785f69400 con 0x562785f68c00 2023-12-19T17:57:14.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b13a97700 1 -- 172.21.15.45:0/1496362593 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(32 [pgnls-filter start_epoch 68 out=49b] v66'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55d2127a6d80 con 0x55d211cc9c00 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(29 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f79d00f7840 20 datascan.read_dentry: oid=10000000000.00000000 dname=10 frag=*, r=0 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f79d00f7840 20 datascan.read_dentry: 10_head not found in result 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f79d00f7840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001ff at 0x0x10000000000/10 with size=6291456 bytes 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d211cc9c00 msgr2=0x55d211a6fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55d211cc9c00 0x55d211a6fb80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d211d1f400 msgr2=0x55d211a6f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55d211d1f400 0x55d211a6f600 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd09c00 con 0x55e4ecd30c00 2023-12-19T17:57:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(28 [pgnls-filter start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848ed80 con 0x555a87903800 2023-12-19T17:57:14.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d211e4c800 msgr2=0x55d211e3c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55d211e4c800 0x55d211e3c000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d211e37c00 msgr2=0x55d211e3db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55d211e37c00 0x55d211e3db80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d211cc9400 msgr2=0x55d211a70100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55d211cc9400 0x55d211a70100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d211e36400 msgr2=0x55d211e3c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55d211e36400 0x55d211e3c580 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d211e36c00 msgr2=0x55d211e3cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55d211e36c00 0x55d211e3cb00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 reap_dead start 2023-12-19T17:57:14.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 reap_dead start 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(22 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(32 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d211d1ec00 msgr2=0x55d211a71700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b13296700 1 -- 172.21.15.45:0/1496362593 reap_dead start 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d211d1ec00 0x55d211a71700 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x55d211adb380 tx=0x55d21283fec0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 msgr2=0x55d211a71180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 0x55d211a71180 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x55d21283d590 tx=0x55d2127aee40 comp rx=0 tx=0).stop 2023-12-19T17:57:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba45ef2700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:29 9.15 9:a8000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95800 con 0x555a87903400 2023-12-19T17:57:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/0, will insert to root 2023-12-19T17:57:14.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:23 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782400 con 0x5643e3301400 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 20 datascan.read_dentry: oid=10000000000.00000000 dname=13 frag=*, r=0 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 20 datascan.read_dentry: 13_head not found in result 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000202 at 0x0x10000000000/13 with size=6291456 bytes 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87ac3400 con 0x562a87be3c00 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(29 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 shutdown_connections 2023-12-19T17:57:14.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55d211d1ec00 0x55d211a71700 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/1496362593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d211cc8800 0x55d211a71180 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 >> 172.21.15.45:0/1496362593 conn(0x55d2119c8c00 msgr2=0x55d211aab800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 20 datascan.read_dentry: oid=10000000000.00000000 dname=14 frag=*, r=0 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 20 datascan.read_dentry: 14_head not found in result 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000203 at 0x0x10000000000/14 with size=6291456 bytes 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x562785ef5800 con 0x562785f68c00 2023-12-19T17:57:14.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 shutdown_connections 2023-12-19T17:57:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/1496362593 wait complete. 2023-12-19T17:57:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(29 [pgnls-filter start_epoch 68 out=81b] v68'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4bf3f840 20 datascan.forall_objects: OSD matched oid 1000000020d.00000000 2023-12-19T17:57:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4bf3f840 10 datascan.operator(): handling object 1000000020d.0 2023-12-19T17:57:14.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 9.15 9:a8e69ea8:::1000000020d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f800 con 0x555a87903400 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d2119c9400 msgr2=0x55d211a6eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d2119c9400 0x55d211a6eb00 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x55d211ada9f0 tx=0x55d211aa9440 comp rx=0 tx=0).stop 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 shutdown_connections 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d2119c9000 0x55d211a6f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55d2119c9400 0x55d211a6eb00 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 --2- 172.21.15.45:0/4019061113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55d2119c9800 0x55d211a6e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 >> 172.21.15.45:0/4019061113 conn(0x55d2119c9c00 msgr2=0x55d211aab000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 shutdown_connections 2023-12-19T17:57:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(30 1000000020d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7f9b14ada840 1 -- 172.21.15.45:0/4019061113 wait complete. 2023-12-19T17:57:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.956+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:31 10.15 10:a8e69ea8:::1000000020d.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f400 con 0x555a87a5ec00 2023-12-19T17:57:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(30 10000000000.00000000 [omap-set-vals] v68'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecd30c00 2023-12-19T17:57:14.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x100000001ff 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:31 9.16 9:68000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd08400 con 0x55e4ecbe7800 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fba4aefc700 1 -- 172.21.15.45:0/2138239300 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(31 1000000020d.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x555a8848ed80 con 0x555a87a5ec00 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fba4bf3f840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020d 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/24 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fba4bf3f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=24 2023-12-19T17:57:14.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:32 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95000 con 0x555a87903400 2023-12-19T17:57:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(23 10000000000.00000000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f2ba753a840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-12-19T17:57:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f2ba753a840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782800 con 0x5643e3301400 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce0b2700 1 -- 172.21.15.45:0/4169426698 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(31 [pgnls-filter start_epoch 68 out=49b] v66'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55e4ed690b40 con 0x55e4ecbe7800 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79c98a9700 1 -- 172.21.15.45:0/4169426698 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:32 9.36 9:6c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x55e4ecd31400 con 0x55e4ecd08800 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(32 [pgnls-filter start_epoch 68 out=101b] v68'23 uv23 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55e4ed690fc0 con 0x55e4ecd08800 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55e4ecd08000 msgr2=0x55e4ec945b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55e4ecd08000 0x55e4ec945b80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55e4ecd08800 msgr2=0x55e4ec945600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55e4ecd08800 0x55e4ec945600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55e4ecd09800 msgr2=0x55e4ecd22680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55e4ecd09800 0x55e4ecd22680 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55e4ecbe7800 msgr2=0x55e4ec946100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55e4ecbe7800 0x55e4ec946100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55e4ecd09000 msgr2=0x55e4ecd20000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55e4ecd09000 0x55e4ecd20000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55e4ecd30400 msgr2=0x55e4ecd20b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55e4ecd30400 0x55e4ecd20b00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55e4ecd30c00 msgr2=0x55e4ecd21080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55e4ecd30c00 0x55e4ecd21080 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 reap_dead start 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 reap_dead start 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 reap_dead start 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79ce8b3700 1 -- 172.21.15.45:0/4169426698 reap_dead start 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55e4ecbe7400 msgr2=0x55e4ec947700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55e4ecbe7400 0x55e4ec947700 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x55e4ecc4ed80 tx=0x55e4ed60e180 comp rx=0 tx=0).stop 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6800 msgr2=0x55e4ec946c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6800 0x55e4ec946c00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x55e4ed7256e0 tx=0x55e4ecb9cde0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 shutdown_connections 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55e4ecbe7400 0x55e4ec947700 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/4169426698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ecbe6800 0x55e4ec946c00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 >> 172.21.15.45:0/4169426698 conn(0x55e4ecbe6000 msgr2=0x55e4ec993800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 shutdown_connections 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/4169426698 wait complete. 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 msgr2=0x55e4ec945080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 0x55e4ec945080 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x55e4eca05500 tx=0x55e4ed60e000 comp rx=0 tx=0).stop 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 shutdown_connections 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55e4ec89f800 0x55e4ec945080 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e4ec89f400 0x55e4ec944b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 --2- 172.21.15.45:0/2192491825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55e4ec89f000 0x55e4ec944580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 >> 172.21.15.45:0/2192491825 conn(0x55e4ec89ec00 msgr2=0x55e4ec993000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(33 10000000000.00000000 [omap-set-vals] v68'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d7f84840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x10000000202 2023-12-19T17:57:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:34 9.28 9:177a762d::::head [pgnls-filter start_epoch 68 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3400 con 0x562a87be3000 2023-12-19T17:57:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 shutdown_connections 2023-12-19T17:57:14.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7f79d00f7840 1 -- 172.21.15.45:0/2192491825 wait complete. 2023-12-19T17:57:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(34 [pgnls-filter start_epoch 68 out=81b] v68'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d7f84840 20 datascan.forall_objects: OSD matched oid 10000000201.00000000 2023-12-19T17:57:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d7f84840 10 datascan.operator(): handling object 10000000201.0 2023-12-19T17:57:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.960+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:35 9.28 9:177a762d:::10000000201.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87be3800 con 0x562a87be3000 2023-12-19T17:57:14.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(35 10000000201.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:36 10.8 10:177a762d:::10000000201.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04400 con 0x562a87be2400 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(36 10000000201.00000000 [getxattr (30) out=30b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be2400 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: inode: 0x0x10000000201 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/12 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=12 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:37 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05800 con 0x562a87be3c00 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb3c77700 1 -- 172.21.15.45:0/3290806850 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(30 10000000000.00000000 [omap-set-vals] v68'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562786a7ed80 con 0x562785f68c00 2023-12-19T17:57:14.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x10000000203 2023-12-19T17:57:14.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:31 9.1b 9:d8000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562786090000 con 0x56278607e400 2023-12-19T17:57:14.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(32 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/24, will insert to root 2023-12-19T17:57:14.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94000 con 0x555a87903400 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(24 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f2ba753a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=0 frag=*, r=0 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f2ba753a840 20 datascan.read_dentry: 0_head not found in result 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f2ba753a840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/0 with size=6291456 bytes 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:25 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782c00 con 0x5643e3301400 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(37 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/12, will insert to root 2023-12-19T17:57:14.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:38 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05400 con 0x562a87be3c00 2023-12-19T17:57:14.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(33 10000000000.00000000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-12-19T17:57:14.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:34 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95400 con 0x555a87903400 2023-12-19T17:57:14.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb3476700 1 -- 172.21.15.45:0/3290806850 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(31 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562786a7efc0 con 0x56278607e400 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562785ef5c00 msgr2=0x562785ca7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562785ef5c00 0x562785ca7b80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562785f69000 msgr2=0x562785ca7600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562785f69000 0x562785ca7600 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562785f69800 msgr2=0x562786072000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562785f69800 0x562786072000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56278607e400 msgr2=0x562786074c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x56278607e400 0x562786074c00 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 reap_dead start 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562785ef5400 msgr2=0x562785ca8100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562785ef5400 0x562785ca8100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56278607e800 msgr2=0x562786073080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56278607e800 0x562786073080 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562785f68c00 msgr2=0x562786074680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562785f68c00 0x562786074680 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb2c75700 1 -- 172.21.15.45:0/3290806850 reap_dead start 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562785f68800 msgr2=0x562785ca9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562785f68800 0x562785ca9700 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x5627869e48a0 tx=0x562785ce1440 comp rx=0 tx=0).stop 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef4c00 msgr2=0x562785ca8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef4c00 0x562785ca8c00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x5627869e53b0 tx=0x5627869eafc0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 shutdown_connections 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562785f68800 0x562785ca9700 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/3290806850 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785ef4c00 0x562785ca8c00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 >> 172.21.15.45:0/3290806850 conn(0x562785c00c00 msgr2=0x562785ce3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 shutdown_connections 2023-12-19T17:57:14.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.964+0000 7f1eb4cba840 1 -- 172.21.15.45:0/3290806850 wait complete. 2023-12-19T17:57:14.160 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '3', '--worker_m', '7'] in time 0:00:00.398531, result: 2023-12-19T17:57:14.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(25 10000000000.00000000 [omap-set-vals] v68'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-12-19T17:57:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785c01800 msgr2=0x562785ca6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785c01800 0x562785ca6580 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x562785d13320 tx=0x5627869ead80 comp rx=0 tx=0).stop 2023-12-19T17:57:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:26 9.27 9:e4000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3794000 con 0x5643e40e7c00 2023-12-19T17:57:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 shutdown_connections 2023-12-19T17:57:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562785c01000 0x562785ca7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562785c01400 0x562785ca6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 --2- 172.21.15.45:0/274005588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562785c01800 0x562785ca6580 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 >> 172.21.15.45:0/274005588 conn(0x562785c01c00 msgr2=0x562785ce3000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(38 10000000000.00000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-12-19T17:57:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:39 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05c00 con 0x562a87be3c00 2023-12-19T17:57:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(34 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4bf3f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=24 frag=*, r=0 2023-12-19T17:57:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4bf3f840 20 datascan.read_dentry: 24_head not found in result 2023-12-19T17:57:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4bf3f840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020d at 0x0x10000000000/24 with size=6291456 bytes 2023-12-19T17:57:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:35 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94800 con 0x555a87903400 2023-12-19T17:57:14.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(39 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 20 datascan.read_dentry: oid=10000000000.00000000 dname=12 frag=*, r=0 2023-12-19T17:57:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 20 datascan.read_dentry: 12_head not found in result 2023-12-19T17:57:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000201 at 0x0x10000000000/12 with size=6291456 bytes 2023-12-19T17:57:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:40 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c1c000 con 0x562a87be3c00 2023-12-19T17:57:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 shutdown_connections 2023-12-19T17:57:14.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f1eb4cba840 1 -- 172.21.15.45:0/274005588 wait complete. 2023-12-19T17:57:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(26 [pgnls-filter start_epoch 68 out=81b] v68'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e40e7c00 2023-12-19T17:57:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 20 datascan.forall_objects: OSD matched oid 10000000208.00000000 2023-12-19T17:57:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 10 datascan.operator(): handling object 10000000208.0 2023-12-19T17:57:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:27 9.27 9:e5993619:::10000000208.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3794400 con 0x5643e40e7c00 2023-12-19T17:57:14.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(27 10000000208.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (98) out=98b,getxattr,getxattr] v0'0 uv6 ondisk = 0) v8 ==== 416+0+144 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e40e7c00 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:28 10.7 10:e5993619:::10000000208.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3794800 con 0x5643e3783c00 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(28 10000000208.00000000 [getxattr (30) out=30b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e3783c00 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 10 datascan.inject_with_backtrace: inode: 0x0x10000000208 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/19 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=19 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:29 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3794c00 con 0x5643e3301400 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(35 10000000000.00000000 [omap-set-vals] v68'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4bf3f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x1000000020d 2023-12-19T17:57:14.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:36 9.35 9:ac000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a95800 con 0x555a87a5e800 2023-12-19T17:57:14.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848eb40 con 0x555a87a5e800 2023-12-19T17:57:14.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.968+0000 7fba45ef2700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:37 9.d 9:b0000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a5f000 con 0x555a87903400 2023-12-19T17:57:14.168 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '2', '--worker_m', '7'] in time 0:00:00.406566, result: 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba49efa700 1 -- 172.21.15.45:0/2138239300 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(37 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848efc0 con 0x555a87903400 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba456f1700 1 -- 172.21.15.45:0/2138239300 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:38 9.2d 9:b4000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x555a87a94400 con 0x555a87a5fc00 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(38 [pgnls-filter start_epoch 68 out=49b] v66'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x555a8848eb40 con 0x555a87a5fc00 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555a87903800 msgr2=0x555a876acc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555a87903800 0x555a876acc00 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555a87a5e800 msgr2=0x555a876ad180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555a87a5e800 0x555a876ad180 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555a87a5fc00 msgr2=0x555a87a65b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555a87a5fc00 0x555a87a65b80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x555a87a5ec00 msgr2=0x555a87a64b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x555a87a5ec00 0x555a87a64b00 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555a87903000 msgr2=0x555a876ac680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555a87903000 0x555a876ac680 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x555a87903400 msgr2=0x555a87a64580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x555a87903400 0x555a87a64580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 reap_dead start 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 reap_dead start 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 reap_dead start 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4a6fb700 1 -- 172.21.15.45:0/2138239300 reap_dead start 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555a87a5e000 msgr2=0x555a87a64000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555a87a5e000 0x555a87a64000 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x555a878fc8a0 tx=0x555a884014a0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902c00 msgr2=0x555a876ac100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902c00 0x555a876ac100 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x555a878fd590 tx=0x555a883fed80 comp rx=0 tx=0).stop 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d6f41700 1 -- 172.21.15.45:0/3190738841 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(40 10000000000.00000000 [omap-set-vals] v68'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562a87a64d80 con 0x562a87be3c00 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d7f84840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x10000000201 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 shutdown_connections 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555a87a5e000 0x555a87a64000 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/2138239300 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87902c00 0x555a876ac100 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 >> 172.21.15.45:0/2138239300 conn(0x555a87604c00 msgr2=0x555a876e7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 9.18 9:18000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c1c400 con 0x562a87be3000 2023-12-19T17:57:14.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 shutdown_connections 2023-12-19T17:57:14.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(29 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/19, will insert to root 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3795000 con 0x5643e3301400 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/2138239300 wait complete. 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(30 10000000000.00000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-12-19T17:57:14.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:31 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3795400 con 0x5643e3301400 2023-12-19T17:57:14.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(41 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87be3000 2023-12-19T17:57:14.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d1736700 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:42 9.38 9:1c000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05000 con 0x562a87c04800 2023-12-19T17:57:14.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87605400 msgr2=0x555a876ab600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87605400 0x555a876ab600 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x555a877173e0 tx=0x555a883fee40 comp rx=0 tx=0).stop 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 shutdown_connections 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555a87605000 0x555a876ab080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555a87605400 0x555a876ab600 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 --2- 172.21.15.45:0/1317426896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555a87605800 0x555a876abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 >> 172.21.15.45:0/1317426896 conn(0x555a87605c00 msgr2=0x555a876e7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(31 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=19 frag=*, r=0 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 20 datascan.read_dentry: 19_head not found in result 2023-12-19T17:57:14.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000208 at 0x0x10000000000/19 with size=6291456 bytes 2023-12-19T17:57:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:32 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3795800 con 0x5643e3301400 2023-12-19T17:57:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 shutdown_connections 2023-12-19T17:57:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(42 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a87a64b40 con 0x562a87c04800 2023-12-19T17:57:14.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fba4bf3f840 1 -- 172.21.15.45:0/1317426896 wait complete. 2023-12-19T17:57:14.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.972+0000 7fa1d1f37700 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:43 9.4 9:20000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c04000 con 0x562a87be2c00 2023-12-19T17:57:14.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(43 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a87a64b40 con 0x562a87be2c00 2023-12-19T17:57:14.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d1736700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562a87c04c00 0x562a87bfdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d1736700 1 -- 172.21.15.45:0/3190738841 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:44 9.24 9:24000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x562a87c05000 con 0x562a87c04c00 2023-12-19T17:57:14.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562a87c04c00 0x562a87bfdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.178 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '5', '--worker_m', '7'] in time 0:00:00.415798, result: 2023-12-19T17:57:14.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(32 10000000000.00000000 [omap-set-vals] v68'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba753a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000208 2023-12-19T17:57:14.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 9.17 9:e8000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3795c00 con 0x5643e3301400 2023-12-19T17:57:14.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d5f3f700 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562a87c04c00 0x562a87bfdb80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(33 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d5f3f700 1 -- 172.21.15.45:0/3190738841 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(44 [pgnls-filter start_epoch 68 out=49b] v66'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562a87a64fc0 con 0x562a87c04c00 2023-12-19T17:57:14.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562a87be2400 msgr2=0x562a8781fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562a87be2400 0x562a8781fb80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562a87be2c00 msgr2=0x562a8781f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba0cec700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:34 9.37 9:ec000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783800 con 0x5643e40e7800 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562a87be2c00 0x562a8781f600 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562a87c04c00 msgr2=0x562a87bfdb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562a87c04c00 0x562a87bfdb80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562a87c04800 msgr2=0x562a87bfc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562a87c04800 0x562a87bfc000 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562a87ac3c00 msgr2=0x562a87820100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562a87ac3c00 0x562a87820100 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562a87be3000 msgr2=0x562a87bfc580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562a87be3000 0x562a87bfc580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562a87be3c00 msgr2=0x562a87bfcb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562a87be3c00 0x562a87bfcb00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 reap_dead start 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 reap_dead start 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 reap_dead start 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d6740700 1 -- 172.21.15.45:0/3190738841 reap_dead start 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562a87ac3800 msgr2=0x562a87821700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562a87ac3800 0x562a87821700 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x562a878deb70 tx=0x562a88568000 comp rx=0 tx=0).stop 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 msgr2=0x562a87820680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820680 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x562a87a7cbd0 tx=0x562a87a74c00 comp rx=0 tx=0).stop 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 shutdown_connections 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562a87ac3800 0x562a87821700 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/3190738841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87ac2c00 0x562a87820680 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 >> 172.21.15.45:0/3190738841 conn(0x562a87ac2000 msgr2=0x562a8788d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(34 [pgnls-filter start_epoch 68 out=49b] v66'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e40e7800 2023-12-19T17:57:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 shutdown_connections 2023-12-19T17:57:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/3190738841 wait complete. 2023-12-19T17:57:14.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba14ed700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:35 9.f 9:f0000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753c00 con 0x5643e3783000 2023-12-19T17:57:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 msgr2=0x562a8781eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 0x562a8781eb00 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x562a878df5f0 tx=0x562a88568480 comp rx=0 tx=0).stop 2023-12-19T17:57:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(35 [pgnls-filter start_epoch 68 out=49b] v66'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3783000 2023-12-19T17:57:14.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7f2ba0cec700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:36 9.2f 9:f4000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782000 con 0x5643e3753400 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 shutdown_connections 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562a87779800 0x562a8781f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562a87779400 0x562a8781eb00 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 --2- 172.21.15.45:0/1065391932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562a87779000 0x562a8781e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 >> 172.21.15.45:0/1065391932 conn(0x562a87778c00 msgr2=0x562a8788d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 shutdown_connections 2023-12-19T17:57:14.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.976+0000 7fa1d7f84840 1 -- 172.21.15.45:0/1065391932 wait complete. 2023-12-19T17:57:14.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba54f5700 1 -- 172.21.15.45:0/51911171 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(36 [pgnls-filter start_epoch 68 out=49b] v66'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643e40ecb40 con 0x5643e3753400 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba14ed700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:37 9.1f 9:f8000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3782400 con 0x5643e3752c00 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(37 [pgnls-filter start_epoch 68 out=49b] v66'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3752c00 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba0cec700 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:38 9.3f 9:fc000000::::head [pgnls-filter start_epoch 68 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3783800 con 0x5643e40e7c00 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(38 [pgnls-filter start_epoch 68 out=81b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e40e7c00 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 20 datascan.forall_objects: OSD matched oid 100000001fa.00000000 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 10 datascan.operator(): handling object 100000001fa.0 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:39 9.3f 9:feb1c803:::100000001fa.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3794c00 con 0x5643e40e7c00 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba64f7700 1 -- 172.21.15.45:0/51911171 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(39 100000001fa.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (97) out=97b,getxattr,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+143 (crc 0 0 0) 0x5643e40ecd80 con 0x5643e40e7c00 2023-12-19T17:57:14.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:40 10.1f 10:feb1c803:::100000001fa.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3794000 con 0x5643e3301400 2023-12-19T17:57:14.188 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '4', '--worker_m', '7'] in time 0:00:00.426062, result: 2023-12-19T17:57:14.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(40 100000001fa.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 20 datascan.operator(): loaded layout from xattr: pi: 10 os: 4194304 sc: 1 su: 4194304 2023-12-19T17:57:14.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fa 2023-12-19T17:57:14.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/5 2023-12-19T17:57:14.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=5 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:41 8.10 8:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753800 con 0x5643e3301400 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(41 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/5, will insert to root 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.980+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:42 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753c00 con 0x5643e3301400 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(42 10000000000.00000000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:43 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3752800 con 0x5643e3301400 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 21 ==== osd_op_reply(43 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 20 datascan.read_dentry: oid=10000000000.00000000 dname=5 frag=*, r=0 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 20 datascan.read_dentry: 5_head not found in result 2023-12-19T17:57:14.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fa at 0x0x10000000000/5 with size=6291456 bytes 2023-12-19T17:57:14.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:44 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5643e3753000 con 0x5643e3301400 2023-12-19T17:57:14.191 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '0', '--worker_m', '7'] in time 0:00:00.431057, result: 2023-12-19T17:57:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 <== osd.7 v2:172.21.15.73:6800/36538 22 ==== osd_op_reply(44 10000000000.00000000 [omap-set-vals] v68'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5643e40ecfc0 con 0x5643e3301400 2023-12-19T17:57:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x100000001fa 2023-12-19T17:57:14.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643e3752400 msgr2=0x5643e3764000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643e3752400 0x5643e3764000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643e3752c00 msgr2=0x5643e3764580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643e3752c00 0x5643e3764580 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643e40e7c00 msgr2=0x5643e3765b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643e40e7c00 0x5643e3765b80 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643e3753400 msgr2=0x5643e3764b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643e3753400 0x5643e3764b00 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643e40e7800 msgr2=0x5643e33a9180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.984+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643e40e7800 0x5643e33a9180 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643e3783000 msgr2=0x5643e3766100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643e3783000 0x5643e3766100 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643e3783c00 msgr2=0x5643e3766c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643e3783c00 0x5643e3766c00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643e3301400 msgr2=0x5643e3765600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643e3301400 0x5643e3765600 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 reap_dead start 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 reap_dead start 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba5cf6700 1 -- 172.21.15.45:0/51911171 reap_dead start 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643e3752000 msgr2=0x5643e33a9700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643e3752000 0x5643e33a9700 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5643e3600660 tx=0x5643e3602d20 comp rx=0 tx=0).stop 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 msgr2=0x5643e33a8680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 0x5643e33a8680 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x5643e3601860 tx=0x5643e40e0060 comp rx=0 tx=0).stop 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 shutdown_connections 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643e3752000 0x5643e33a9700 secure :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0x5643e3600660 tx=0x5643e3602d20 comp rx=0 tx=0).stop 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/51911171 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e7000 0x5643e33a8680 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 >> 172.21.15.45:0/51911171 conn(0x5643e40e6c00 msgr2=0x5643e33e4000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 shutdown_connections 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/51911171 wait complete. 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 msgr2=0x5643e33a6b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 0x5643e33a6b00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x5643e3413320 tx=0x5643e40e0000 comp rx=0 tx=0).stop 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 shutdown_connections 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643e40e6400 0x5643e33a6b00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643e40e6800 0x5643e33a7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 --2- 172.21.15.45:0/1199157949 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643e3301c00 0x5643e33a7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 >> 172.21.15.45:0/1199157949 conn(0x5643e3300c00 msgr2=0x5643e33e3800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 shutdown_connections 2023-12-19T17:57:14.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:13.988+0000 7f2ba753a840 1 -- 172.21.15.45:0/1199157949 wait complete. 2023-12-19T17:57:14.196 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--worker_n', '6', '--worker_m', '7'] in time 0:00:00.433437, result: 2023-12-19T17:57:14.196 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-12-19T17:57:14.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 -- start start 2023-12-19T17:57:14.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 Processor -- start 2023-12-19T17:57:14.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2571800 0x5586e2616580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 0x5586e2616b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2571000 0x5586e2617080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0a00 con 0x5586e2571400 2023-12-19T17:57:14.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0780 con 0x5586e2571000 2023-12-19T17:57:14.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb110fa840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0640 con 0x5586e2571800 2023-12-19T17:57:14.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb0f0b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 0x5586e2616b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb0f0b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 0x5586e2616b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43434/0 (socket says 172.21.15.45:43434) 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/573195088 learned_addr learned my addr 172.21.15.45:0/573195088 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb100b7700 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2571000 0x5586e2617080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.256+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2571800 0x5586e2616580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2571800 msgr2=0x5586e2616580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2571800 0x5586e2616580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2571000 msgr2=0x5586e2617080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2571000 0x5586e2617080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/573195088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586e2592b60 con 0x5586e2571400 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 0x5586e2616b00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x5586e267f2f0 tx=0x5586e33f2d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32f48be7de7478e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0d0b1700 1 -- 172.21.15.45:0/573195088 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5586e25a1600 con 0x5586e2571400 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0d0b1700 1 -- 172.21.15.45:0/573195088 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586e25bc480 con 0x5586e2571400 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0d0b1700 1 -- 172.21.15.45:0/573195088 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5586e25a11e0 con 0x5586e2571400 2023-12-19T17:57:14.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586e2592340 con 0x5586e2571400 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5586e2592000 con 0x5586e2571400 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 4 waiting for MDS map... 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0d0b1700 1 -- 172.21.15.45:0/573195088 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5586e25aac40 con 0x5586e2571400 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb0d0b1700 1 -- 172.21.15.45:0/573195088 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 42) v1 ==== 3126+0+0 (secure 0 0 0) 0x5586e2864300 con 0x5586e2571400 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 4 Got MDS map 42 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 4 datascan.main: Using metadata pool output 2023-12-19T17:57:14.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 4 datascan.main: connecting to RADOS... 2023-12-19T17:57:14.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 1 Processor -- start 2023-12-19T17:57:14.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.260+0000 7fcb110fa840 1 -- start start 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2617600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860800 0x5586e2617b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 0x5586e2618100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb110fa840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e25a7e00 con 0x5586e2860c00 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb110fa840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0780 con 0x5586e2860800 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb110fa840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0500 con 0x5586e2860400 2023-12-19T17:57:14.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 0x5586e2618100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 0x5586e2618100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43438/0 (socket says 172.21.15.45:43438) 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb100b7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2617600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/157290094 learned_addr learned my addr 172.21.15.45:0/157290094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860800 0x5586e2617b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 msgr2=0x5586e2617600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2617600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860800 msgr2=0x5586e2617b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860800 0x5586e2617b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/157290094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586e2592ea0 con 0x5586e2860c00 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb100b7700 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2617600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:14.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 0x5586e2618100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x5586e28765a0 tx=0x5586e2647260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d919eced05bf32b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0b0ad700 1 -- 172.21.15.45:0/157290094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5586e25a0f20 con 0x5586e2860c00 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0b0ad700 1 -- 172.21.15.45:0/157290094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586e2666900 con 0x5586e2860c00 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.264+0000 7fcb0b0ad700 1 -- 172.21.15.45:0/157290094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5586e25a1600 con 0x5586e2860c00 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- 172.21.15.45:0/157290094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 msgr2=0x5586e2618100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 0x5586e2618100 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x5586e28765a0 tx=0x5586e2647260 comp rx=0 tx=0).stop 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- 172.21.15.45:0/157290094 shutdown_connections 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860c00 0x5586e2618100 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860800 0x5586e2617b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- 172.21.15.45:0/157290094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2617600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- 172.21.15.45:0/157290094 >> 172.21.15.45:0/157290094 conn(0x5586e2570c00 msgr2=0x5586e263f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- 172.21.15.45:0/157290094 shutdown_connections 2023-12-19T17:57:14.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- 172.21.15.45:0/157290094 wait complete. 2023-12-19T17:57:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 Processor -- start 2023-12-19T17:57:14.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- start start 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2619180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860800 0x5586e2618c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860c00 0x5586e2618680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f03c0 con 0x5586e2860800 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0280 con 0x5586e2860c00 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb110fa840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586e25f0140 con 0x5586e2860400 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb0f8b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860800 0x5586e2618c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb0f0b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860c00 0x5586e2618680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb0f8b6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860800 0x5586e2618c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43448/0 (socket says 172.21.15.45:43448) 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 learned_addr learned my addr 172.21.15.45:0/1334285557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:14.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.268+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2619180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 msgr2=0x5586e2619180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2860400 0x5586e2619180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860c00 msgr2=0x5586e2618680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860c00 0x5586e2618680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586e2592b60 con 0x5586e2860800 2023-12-19T17:57:14.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2860c00 0x5586e2618680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:14.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860800 0x5586e2618c00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x5586e2877470 tx=0x5586e2878c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb098aa700 1 -- 172.21.15.45:0/1334285557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5586e25a1080 con 0x5586e2860800 2023-12-19T17:57:14.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb098aa700 1 -- 172.21.15.45:0/1334285557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586e2666300 con 0x5586e2860800 2023-12-19T17:57:14.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb098aa700 1 -- 172.21.15.45:0/1334285557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5586e25a0f20 con 0x5586e2860800 2023-12-19T17:57:14.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5586e2592340 con 0x5586e2860800 2023-12-19T17:57:14.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586e2593520 con 0x5586e2860800 2023-12-19T17:57:14.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.272+0000 7fcb110fa840 4 datascan.init: resolving metadata pool 8 2023-12-19T17:57:14.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb098aa700 1 -- 172.21.15.45:0/1334285557 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5586e25ce840 con 0x5586e2860800 2023-12-19T17:57:14.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb098aa700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5586e28da800 0x5586e2619700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb098aa700 1 -- 172.21.15.45:0/1334285557 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x5586e25aaa80 con 0x5586e2860800 2023-12-19T17:57:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb110fa840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T17:57:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb110fa840 4 datascan.main: resolving metadata pool 8 2023-12-19T17:57:14.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5586e2861000 0x5586e2618100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 8.0 8:00000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861400 con 0x5586e2861000 2023-12-19T17:57:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5586e28da800 0x5586e2619700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5586e2861000 0x5586e2618100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5586e2861000 0x5586e2618100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.276+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5586e28da800 0x5586e2619700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5586e267e8a0 tx=0x5586e29c8000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5586e2861400 0x5586e29ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:2 8.10 8:08000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28da400 con 0x5586e2861400 2023-12-19T17:57:14.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5586e2861400 0x5586e29ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5586e2861400 0x5586e29ce000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 68 out=81b] v68'41 uv41 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5586e28da400 0x5586e29ce580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:3 8.8 8:10000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28dac00 con 0x5586e28da400 2023-12-19T17:57:14.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.280+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5586e28da400 0x5586e29ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5586e28da400 0x5586e29ce580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(3 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5586e28dac00 0x5586e29ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:4 8.18 8:18000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db000 con 0x5586e28dac00 2023-12-19T17:57:14.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5586e28dac00 0x5586e29ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5586e28dac00 0x5586e29ceb00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(4 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.284+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:5 8.4 8:20000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db000 con 0x5586e28da400 2023-12-19T17:57:14.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(5 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:6 8.14 8:28000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db000 con 0x5586e28dac00 2023-12-19T17:57:14.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(6 [pgnls start_epoch 68 out=125b] v68'100 uv100 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5586e28db000 0x5586e29cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 8.c 8:30000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db800 con 0x5586e28db000 2023-12-19T17:57:14.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5586e28db000 0x5586e29cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb100b7700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5586e28db000 0x5586e29cf080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(7 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.288+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:8 8.1c 8:38000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db800 con 0x5586e28da400 2023-12-19T17:57:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(8 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 8.2 8:40000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db800 con 0x5586e28dac00 2023-12-19T17:57:14.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(9 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5586e28db800 0x5586e29cf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:10 8.12 8:48000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28dbc00 con 0x5586e28db800 2023-12-19T17:57:14.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5586e28db800 0x5586e29cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5586e28db800 0x5586e29cf600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(10 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28db800 2023-12-19T17:57:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5586e28dbc00 0x5586e29cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.292+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:11 8.a 8:50000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28dbc00 2023-12-19T17:57:14.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.296+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5586e28dbc00 0x5586e29cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.296+0000 7fcb0f0b5700 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5586e28dbc00 0x5586e29cfb80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.296+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(11 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.296+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 8.1a 8:58000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db000 2023-12-19T17:57:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.296+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(12 [pgnls start_epoch 68 out=49b] v68'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.296+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 8.6 8:60000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db000 2023-12-19T17:57:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(13 [pgnls start_epoch 68 out=49b] v67'22 uv22 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 8.16 8:68000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861000 2023-12-19T17:57:14.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(14 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:15 8.e 8:70000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db000 2023-12-19T17:57:14.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(15 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:16 8.1e 8:78000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861000 2023-12-19T17:57:14.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(16 [pgnls start_epoch 68 out=49b] v68'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:17 8.1 8:80000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28dbc00 2023-12-19T17:57:14.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(17 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.300+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:18 8.11 8:88000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28da400 2023-12-19T17:57:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(18 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:19 8.9 8:90000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db800 2023-12-19T17:57:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(19 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28db800 2023-12-19T17:57:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:20 8.19 8:98000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28da400 2023-12-19T17:57:14.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(20 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:21 8.5 8:a0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db800 2023-12-19T17:57:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(21 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28db800 2023-12-19T17:57:14.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.304+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 8.15 8:a8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(22 [pgnls start_epoch 68 out=73b] v67'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:23 8.d 8:b0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28da400 2023-12-19T17:57:14.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(23 [pgnls start_epoch 68 out=74b] v68'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:24 8.1d 8:b8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db000 2023-12-19T17:57:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(24 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:25 8.3 8:c0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28dbc00 2023-12-19T17:57:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(25 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 8.13 8:c8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861000 2023-12-19T17:57:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(26 [pgnls start_epoch 68 out=98b] v68'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.308+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 8.b 8:d0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861000 2023-12-19T17:57:14.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(27 [pgnls start_epoch 68 out=76b] v68'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:28 8.1b 8:d8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28dac00 2023-12-19T17:57:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(28 [pgnls start_epoch 68 out=49b] v68'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:29 8.7 8:e0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28dbc00 2023-12-19T17:57:14.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(29 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 8.17 8:e8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(30 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.312+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:31 8.f 8:f0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861000 2023-12-19T17:57:14.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(31 [pgnls start_epoch 68 out=73b] v68'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 8.1f 8:f8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e28db000 2023-12-19T17:57:14.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(32 [pgnls start_epoch 68 out=101b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-12-19T17:57:14.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:33 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861800 con 0x5586e2861400 2023-12-19T17:57:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=12470b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+12470 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T17:57:14.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.316+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:34 8.13 8:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00000 con 0x5586e2861000 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T17:57:14.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-12-19T17:57:14.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:35 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00400 con 0x5586e28db000 2023-12-19T17:57:14.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=508b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:36 8.0 8:00000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861000 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(36 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.320+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:37 8.10 8:08000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(37 [pgnls start_epoch 68 out=81b] v68'41 uv41 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:38 8.8 8:10000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28da400 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(38 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:39 8.18 8:18000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dac00 2023-12-19T17:57:14.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(39 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:40 8.4 8:20000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28da400 2023-12-19T17:57:14.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(40 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.324+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:41 8.14 8:28000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dac00 2023-12-19T17:57:14.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(41 [pgnls start_epoch 68 out=125b] v68'100 uv100 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:42 8.c 8:30000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(42 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:43 8.1c 8:38000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28da400 2023-12-19T17:57:14.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(43 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:44 8.2 8:40000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dac00 2023-12-19T17:57:14.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(44 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.328+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:45 8.12 8:48000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db800 2023-12-19T17:57:14.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(45 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28db800 2023-12-19T17:57:14.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:46 8.a 8:50000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dbc00 2023-12-19T17:57:14.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(46 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:47 8.1a 8:58000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(47 [pgnls start_epoch 68 out=49b] v68'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 8.6 8:60000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(48 [pgnls start_epoch 68 out=49b] v67'22 uv22 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:49 8.16 8:68000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861000 2023-12-19T17:57:14.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(49 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.332+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:50 8.e 8:70000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(50 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:51 8.1e 8:78000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861000 2023-12-19T17:57:14.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(51 [pgnls start_epoch 68 out=49b] v68'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:52 8.1 8:80000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dbc00 2023-12-19T17:57:14.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(52 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:53 8.11 8:88000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28da400 2023-12-19T17:57:14.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(53 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.336+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:54 8.9 8:90000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db800 2023-12-19T17:57:14.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(54 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28db800 2023-12-19T17:57:14.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:55 8.19 8:98000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28da400 2023-12-19T17:57:14.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(55 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:56 8.5 8:a0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db800 2023-12-19T17:57:14.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(56 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28db800 2023-12-19T17:57:14.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:57 8.15 8:a8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(57 [pgnls start_epoch 68 out=73b] v67'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.340+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:58 8.d 8:b0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28da400 2023-12-19T17:57:14.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(58 [pgnls start_epoch 68 out=74b] v68'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:59 8.1d 8:b8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(59 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:60 8.3 8:c0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dbc00 2023-12-19T17:57:14.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(60 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:61 8.13 8:c8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861000 2023-12-19T17:57:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(61 [pgnls start_epoch 68 out=98b] v68'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:62 8.b 8:d0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861000 2023-12-19T17:57:14.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(62 [pgnls start_epoch 68 out=76b] v68'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.344+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:63 8.1b 8:d8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dac00 2023-12-19T17:57:14.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.348+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(63 [pgnls start_epoch 68 out=49b] v68'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dac00 2023-12-19T17:57:14.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.348+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:64 8.7 8:e0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28dbc00 2023-12-19T17:57:14.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.348+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(64 [pgnls start_epoch 68 out=49b] v67'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e28dbc00 2023-12-19T17:57:14.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.348+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:65 8.17 8:e8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.348+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(65 [pgnls start_epoch 68 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.348+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:66 8.f 8:f0000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861000 2023-12-19T17:57:14.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(66 [pgnls start_epoch 68 out=73b] v68'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:67 8.1f 8:f8000000::::head [pgnls start_epoch 68 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(67 [pgnls start_epoch 68 out=101b] v68'12 uv12 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-12-19T17:57:14.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:68 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=12470b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+12470 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001ff for future processing to fix dnfirst 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000200 for future processing to fix dnfirst 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000201 for future processing to fix dnfirst 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000202 for future processing to fix dnfirst 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000203 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000204 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000205 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000206 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000207 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000208 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001f6 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000209 for future processing to fix dnfirst 2023-12-19T17:57:14.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x1000000020a for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x1000000020b for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x1000000020c for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x1000000020d for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001f8 for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001f9 for future processing to fix dnfirst 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001fa for future processing to fix dnfirst 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001fb for future processing to fix dnfirst 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001fc for future processing to fix dnfirst 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001fd for future processing to fix dnfirst 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 20 datascan.scan_links: adding 0x100000001fe for future processing to fix dnfirst 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-12-19T17:57:14.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:69 8.13 8:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01000 con 0x5586e2861000 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-12-19T17:57:14.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.352+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:70 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e28db000 2023-12-19T17:57:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=508b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 20 datascan.scan_links: injected ino detected 2023-12-19T17:57:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2023-12-19T17:57:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-12-19T17:57:14.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 10 datascan.scan_links: processing 26 injected_inos 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000000 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:71 8.1f 8:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01800 con 0x5586e28db000 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.356+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:72 8.1f 8:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e28db000 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v68'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e28db000 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:0 2023-12-19T17:57:14.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:73 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=0 frag=*, r=0 2023-12-19T17:57:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.360+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:74 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e2861400 2023-12-19T17:57:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v68'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-12-19T17:57:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001f6 2023-12-19T17:57:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:1 2023-12-19T17:57:14.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:75 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01800 con 0x5586e2861400 2023-12-19T17:57:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(75 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=1 frag=*, r=0 2023-12-19T17:57:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.364+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:76 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00400 con 0x5586e2861400 2023-12-19T17:57:14.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(76 10000000000.00000000 [omap-set-vals] v68'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x100000001f6 2023-12-19T17:57:14.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001f7 2023-12-19T17:57:14.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:2 2023-12-19T17:57:14.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:77 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01c00 con 0x5586e2861400 2023-12-19T17:57:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(77 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=2 frag=*, r=0 2023-12-19T17:57:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.368+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:78 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861800 con 0x5586e2861400 2023-12-19T17:57:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(78 10000000000.00000000 [omap-set-vals] v68'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x100000001f7 2023-12-19T17:57:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001f8 2023-12-19T17:57:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:3 2023-12-19T17:57:14.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:79 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(79 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=3 frag=*, r=0 2023-12-19T17:57:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:80 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.372+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(80 10000000000.00000000 [omap-set-vals] v68'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x100000001f8 2023-12-19T17:57:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001f9 2023-12-19T17:57:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:4 2023-12-19T17:57:14.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:81 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=4 frag=*, r=0 2023-12-19T17:57:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:82 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e2861400 2023-12-19T17:57:14.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(82 10000000000.00000000 [omap-set-vals] v68'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x100000001f9 2023-12-19T17:57:14.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001fa 2023-12-19T17:57:14.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:5 2023-12-19T17:57:14.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.376+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:83 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01800 con 0x5586e2861400 2023-12-19T17:57:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(83 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=5 frag=*, r=0 2023-12-19T17:57:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:84 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00400 con 0x5586e2861400 2023-12-19T17:57:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(84 10000000000.00000000 [omap-set-vals] v68'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x100000001fa 2023-12-19T17:57:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001fb 2023-12-19T17:57:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:6 2023-12-19T17:57:14.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:85 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01c00 con 0x5586e2861400 2023-12-19T17:57:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 21 ==== osd_op_reply(85 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=6 frag=*, r=0 2023-12-19T17:57:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.380+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:86 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 22 ==== osd_op_reply(86 10000000000.00000000 [omap-set-vals] v68'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x100000001fb 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001fc 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:7 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:87 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 23 ==== osd_op_reply(87 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=7 frag=*, r=0 2023-12-19T17:57:14.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.384+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:88 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e2861400 2023-12-19T17:57:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 24 ==== osd_op_reply(88 10000000000.00000000 [omap-set-vals] v68'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x100000001fc 2023-12-19T17:57:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001fd 2023-12-19T17:57:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:8 2023-12-19T17:57:14.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:89 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 25 ==== osd_op_reply(89 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=8 frag=*, r=0 2023-12-19T17:57:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.388+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:90 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861800 con 0x5586e2861400 2023-12-19T17:57:14.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 26 ==== osd_op_reply(90 10000000000.00000000 [omap-set-vals] v68'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x100000001fd 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001fe 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:9 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:91 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 27 ==== osd_op_reply(91 10000000000.00000000 [omap-get-vals-by-keys out=502b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=9 frag=*, r=0 2023-12-19T17:57:14.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.392+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:92 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01800 con 0x5586e2861400 2023-12-19T17:57:14.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 28 ==== osd_op_reply(92 10000000000.00000000 [omap-set-vals] v68'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x100000001fe 2023-12-19T17:57:14.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x100000001ff 2023-12-19T17:57:14.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:10 2023-12-19T17:57:14.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:93 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00400 con 0x5586e2861400 2023-12-19T17:57:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 29 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=10 frag=*, r=0 2023-12-19T17:57:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:94 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01c00 con 0x5586e2861400 2023-12-19T17:57:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 30 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v68'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x100000001ff 2023-12-19T17:57:14.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000200 2023-12-19T17:57:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:11 2023-12-19T17:57:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.396+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:95 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 31 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=11 frag=*, r=0 2023-12-19T17:57:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:96 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 32 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v68'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x10000000200 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000201 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:12 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:97 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e2861400 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.400+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 33 ==== osd_op_reply(97 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=12 frag=*, r=0 2023-12-19T17:57:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:98 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01800 con 0x5586e2861400 2023-12-19T17:57:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 34 ==== osd_op_reply(98 10000000000.00000000 [omap-set-vals] v68'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x10000000201 2023-12-19T17:57:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000202 2023-12-19T17:57:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:13 2023-12-19T17:57:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:99 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00400 con 0x5586e2861400 2023-12-19T17:57:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 35 ==== osd_op_reply(99 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=13 frag=*, r=0 2023-12-19T17:57:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.404+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:100 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01c00 con 0x5586e2861400 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 36 ==== osd_op_reply(100 10000000000.00000000 [omap-set-vals] v68'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x10000000202 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000203 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:14 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:101 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 37 ==== osd_op_reply(101 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=14 frag=*, r=0 2023-12-19T17:57:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.408+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:102 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 38 ==== osd_op_reply(102 10000000000.00000000 [omap-set-vals] v68'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x10000000203 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000204 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:15 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:103 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e2861400 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 39 ==== osd_op_reply(103 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=15 frag=*, r=0 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.412+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:104 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 40 ==== osd_op_reply(104 10000000000.00000000 [omap-set-vals] v68'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000204 2023-12-19T17:57:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000205 2023-12-19T17:57:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:16 2023-12-19T17:57:14.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:105 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861800 con 0x5586e2861400 2023-12-19T17:57:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 41 ==== osd_op_reply(105 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=16 frag=*, r=0 2023-12-19T17:57:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:106 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a14000 con 0x5586e2861400 2023-12-19T17:57:14.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.416+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 42 ==== osd_op_reply(106 10000000000.00000000 [omap-set-vals] v68'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000205 2023-12-19T17:57:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000206 2023-12-19T17:57:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:17 2023-12-19T17:57:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:107 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a14400 con 0x5586e2861400 2023-12-19T17:57:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 43 ==== osd_op_reply(107 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=17 frag=*, r=0 2023-12-19T17:57:14.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:108 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a14800 con 0x5586e2861400 2023-12-19T17:57:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 44 ==== osd_op_reply(108 10000000000.00000000 [omap-set-vals] v68'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000206 2023-12-19T17:57:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000207 2023-12-19T17:57:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:18 2023-12-19T17:57:14.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.420+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:109 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a14c00 con 0x5586e2861400 2023-12-19T17:57:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 45 ==== osd_op_reply(109 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=18 frag=*, r=0 2023-12-19T17:57:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:110 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a15000 con 0x5586e2861400 2023-12-19T17:57:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 46 ==== osd_op_reply(110 10000000000.00000000 [omap-set-vals] v68'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000207 2023-12-19T17:57:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000208 2023-12-19T17:57:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:19 2023-12-19T17:57:14.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:111 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a15400 con 0x5586e2861400 2023-12-19T17:57:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 47 ==== osd_op_reply(111 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=19 frag=*, r=0 2023-12-19T17:57:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.424+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:112 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a15800 con 0x5586e2861400 2023-12-19T17:57:14.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 48 ==== osd_op_reply(112 10000000000.00000000 [omap-set-vals] v68'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000208 2023-12-19T17:57:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x10000000209 2023-12-19T17:57:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:20 2023-12-19T17:57:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:113 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a15c00 con 0x5586e2861400 2023-12-19T17:57:14.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 49 ==== osd_op_reply(113 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=20 frag=*, r=0 2023-12-19T17:57:14.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.428+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:114 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a14000 con 0x5586e2861400 2023-12-19T17:57:14.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 50 ==== osd_op_reply(114 10000000000.00000000 [omap-set-vals] v68'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000209 2023-12-19T17:57:14.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x1000000020a 2023-12-19T17:57:14.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:21 2023-12-19T17:57:14.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:115 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861800 con 0x5586e2861400 2023-12-19T17:57:14.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 51 ==== osd_op_reply(115 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=21 frag=*, r=0 2023-12-19T17:57:14.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.432+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:116 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861400 2023-12-19T17:57:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 52 ==== osd_op_reply(116 10000000000.00000000 [omap-set-vals] v68'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x1000000020a 2023-12-19T17:57:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x1000000020b 2023-12-19T17:57:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:22 2023-12-19T17:57:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:117 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01800 con 0x5586e2861400 2023-12-19T17:57:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 53 ==== osd_op_reply(117 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=22 frag=*, r=0 2023-12-19T17:57:14.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.436+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:118 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00400 con 0x5586e2861400 2023-12-19T17:57:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 54 ==== osd_op_reply(118 10000000000.00000000 [omap-set-vals] v68'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x1000000020b 2023-12-19T17:57:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x1000000020c 2023-12-19T17:57:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:23 2023-12-19T17:57:14.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:119 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01c00 con 0x5586e2861400 2023-12-19T17:57:14.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 55 ==== osd_op_reply(119 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=23 frag=*, r=0 2023-12-19T17:57:14.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:120 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00800 con 0x5586e2861400 2023-12-19T17:57:14.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 56 ==== osd_op_reply(120 10000000000.00000000 [omap-set-vals] v68'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x1000000020c 2023-12-19T17:57:14.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 10 datascan.scan_links: handling injected_ino 0x1000000020d 2023-12-19T17:57:14.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:24 2023-12-19T17:57:14.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.440+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:121 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a00c00 con 0x5586e2861400 2023-12-19T17:57:14.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 57 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb110fa840 20 datascan.read_dentry: oid=10000000000.00000000 dname=24 frag=*, r=0 2023-12-19T17:57:14.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb110fa840 20 datascan.scan_links: first is now 2 2023-12-19T17:57:14.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:122 8.10 8:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a01400 con 0x5586e2861400 2023-12-19T17:57:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb100b7700 1 -- 172.21.15.45:0/1334285557 <== osd.7 v2:172.21.15.73:6800/36538 58 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v68'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5586e33f0d80 con 0x5586e2861400 2023-12-19T17:57:14.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb110fa840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x1000000020d 2023-12-19T17:57:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb110fa840 10 datascan.scan_links: updating inotable 2023-12-19T17:57:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:123 8.13 8:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e28db400 con 0x5586e2861000 2023-12-19T17:57:14.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.444+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(123 mds0_inotable [read 0~34 out=34b] v0'0 uv6 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.448+0000 7fcb110fa840 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2023-12-19T17:57:14.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.448+0000 7fcb110fa840 10 mds.0.inotable: skip_inos now [0x1000000020e~0xfffffffdf2] 2023-12-19T17:57:14.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.448+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:124 8.13 8:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2861800 con 0x5586e2861000 2023-12-19T17:57:14.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.448+0000 7fcb0f0b5700 1 -- 172.21.15.45:0/1334285557 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(124 mds0_inotable [writefull 0~34] v68'8 uv8 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5586e33f0b40 con 0x5586e2861000 2023-12-19T17:57:14.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 10 datascan.scan_links: updating snaptable 2023-12-19T17:57:14.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:125 8.d 8:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e68) v8 -- 0x5586e2a14000 con 0x5586e28da400 2023-12-19T17:57:14.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 <== osd.5 v2:172.21.15.73:6824/36539 13 ==== osd_op_reply(125 mds_snaptable [read 0~70 out=70b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5586e33f0fc0 con 0x5586e28da400 2023-12-19T17:57:14.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5586e28db000 msgr2=0x5586e29cf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5586e28db000 0x5586e29cf080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5586e28dbc00 msgr2=0x5586e29cfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5586e28dbc00 0x5586e29cfb80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5586e2861000 msgr2=0x5586e2618100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5586e2861000 0x5586e2618100 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5586e28dac00 msgr2=0x5586e29ceb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5586e28dac00 0x5586e29ceb00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 reap_dead start 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5586e28da400 msgr2=0x5586e29ce580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5586e28da400 0x5586e29ce580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5586e28db800 msgr2=0x5586e29cf600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5586e28db800 0x5586e29cf600 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5586e2861400 msgr2=0x5586e29ce000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5586e2861400 0x5586e29ce000 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5586e28da800 msgr2=0x5586e2619700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5586e28da800 0x5586e2619700 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x5586e267e8a0 tx=0x5586e29c8000 comp rx=0 tx=0).stop 2023-12-19T17:57:14.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860800 msgr2=0x5586e2618c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/1334285557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2860800 0x5586e2618c00 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x5586e2877470 tx=0x5586e2878c60 comp rx=0 tx=0).stop 2023-12-19T17:57:14.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 reap_dead start 2023-12-19T17:57:14.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb0f8b6700 1 -- 172.21.15.45:0/1334285557 reap_dead start 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 shutdown_connections 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 >> 172.21.15.45:0/1334285557 conn(0x5586e2570c00 msgr2=0x5586e263f800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 shutdown_connections 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/1334285557 wait complete. 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 msgr2=0x5586e2616b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 0x5586e2616b00 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x5586e267f2f0 tx=0x5586e33f2d20 comp rx=0 tx=0).stop 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 shutdown_connections 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5586e2571000 0x5586e2617080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5586e2571400 0x5586e2616b00 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 --2- 172.21.15.45:0/573195088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5586e2571800 0x5586e2616580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.452+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 >> 172.21.15.45:0/573195088 conn(0x5586e2571c00 msgr2=0x5586e263f000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.456+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 shutdown_connections 2023-12-19T17:57:14.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.456+0000 7fcb110fa840 1 -- 172.21.15.45:0/573195088 wait complete. 2023-12-19T17:57:14.467 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.270791, result: 2023-12-19T17:57:14.467 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-12-19T17:57:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.648+0000 7fa705742700 1 Processor -- start 2023-12-19T17:57:14.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.648+0000 7fa705742700 1 -- start start 2023-12-19T17:57:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa705742700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa70015cf50 0x7fa7000cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa705742700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7000b85d0 0x7fa7000cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa705742700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa70006f4a0 con 0x7fa7000701d0 2023-12-19T17:57:14.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa705742700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70015d330 con 0x7fa7000b85d0 2023-12-19T17:57:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa705742700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7000b8a90 con 0x7fa70015cf50 2023-12-19T17:57:14.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7000b85d0 0x7fa7000cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa7000b85d0 0x7fa7000cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43458/0 (socket says 172.21.15.45:43458) 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 -- 172.21.15.45:0/141713787 learned_addr learned my addr 172.21.15.45:0/141713787 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6feffd700 1 --2- 172.21.15.45:0/141713787 >> v2:172.21.15.73:3300/0 conn(0x7fa70015cf50 0x7fa7000cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 -- 172.21.15.45:0/141713787 >> v2:172.21.15.73:3300/0 conn(0x7fa70015cf50 msgr2=0x7fa7000cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 --2- 172.21.15.45:0/141713787 >> v2:172.21.15.73:3300/0 conn(0x7fa70015cf50 0x7fa7000cd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 -- 172.21.15.45:0/141713787 >> v1:172.21.15.73:6789/0 conn(0x7fa7000701d0 legacy=0x7fa700160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 -- 172.21.15.45:0/141713787 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70006f6f0 con 0x7fa7000b85d0 2023-12-19T17:57:14.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6f67fc700 1 --2- 172.21.15.45:0/141713787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7000cdec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa700071d70 tx=0x7fa6e8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3602aa56f9f07cd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6fe7fc700 1 -- 172.21.15.45:0/141713787 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800b8a0 con 0x7fa7000b85d0 2023-12-19T17:57:14.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6fe7fc700 1 -- 172.21.15.45:0/141713787 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e800ba00 con 0x7fa7000b85d0 2023-12-19T17:57:14.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.652+0000 7fa6fe7fc700 1 -- 172.21.15.45:0/141713787 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e800bd90 con 0x7fa7000b85d0 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 -- 172.21.15.45:0/141713787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 msgr2=0x7fa7000cdec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 --2- 172.21.15.45:0/141713787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7000cdec0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa700071d70 tx=0x7fa6e8009bf0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 -- 172.21.15.45:0/141713787 shutdown_connections 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 --2- 172.21.15.45:0/141713787 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7000cdec0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 --2- 172.21.15.45:0/141713787 >> v2:172.21.15.73:3300/0 conn(0x7fa70015cf50 0x7fa7000cd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 -- 172.21.15.45:0/141713787 >> 172.21.15.45:0/141713787 conn(0x7fa7000b4730 msgr2=0x7fa7000b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 -- 172.21.15.45:0/141713787 shutdown_connections 2023-12-19T17:57:14.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.656+0000 7fa705742700 1 -- 172.21.15.45:0/141713787 wait complete. 2023-12-19T17:57:14.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 Processor -- start 2023-12-19T17:57:14.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 -- start start 2023-12-19T17:57:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7000701d0 0x7fa70015b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7001f6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa70015cf50 0x7fa70006a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70015e9f0 con 0x7fa7000b85d0 2023-12-19T17:57:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7001f7500 con 0x7fa70015cf50 2023-12-19T17:57:14.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa705742700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7001f6f40 con 0x7fa7000701d0 2023-12-19T17:57:14.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7001f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7001f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43462/0 (socket says 172.21.15.45:43462) 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 -- 172.21.15.45:0/1852728910 learned_addr learned my addr 172.21.15.45:0/1852728910 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6feffd700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7000701d0 0x7fa70015b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6ff7fe700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa70015cf50 0x7fa70006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 -- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7000701d0 msgr2=0x7fa70015b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7000701d0 0x7fa70015b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 -- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa70015cf50 msgr2=0x7fa70006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa70015cf50 0x7fa70006a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6f67fc700 1 -- 172.21.15.45:0/1852728910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e8009570 con 0x7fa7000b85d0 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.660+0000 7fa6ff7fe700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa70015cf50 0x7fa70006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:14.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa6f67fc700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7001f6560 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa7000d2c10 tx=0x7fa6e8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80036c0 con 0x7fa7000b85d0 2023-12-19T17:57:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e801f070 con 0x7fa7000b85d0 2023-12-19T17:57:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7001f7220 con 0x7fa7000b85d0 2023-12-19T17:57:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e8003a80 con 0x7fa7000b85d0 2023-12-19T17:57:14.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa70015b950 con 0x7fa7000b85d0 2023-12-19T17:57:14.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.664+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7000cef70 con 0x7fa7000b85d0 2023-12-19T17:57:14.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.668+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa6e8021030 con 0x7fa7000b85d0 2023-12-19T17:57:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.668+0000 7fa6f7fff700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6e0065ad0 0x7fa6e0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:14.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.668+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fa6e8084b50 con 0x7fa7000b85d0 2023-12-19T17:57:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.668+0000 7fa6feffd700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6e0065ad0 0x7fa6e0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:14.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.668+0000 7fa6feffd700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6e0065ad0 0x7fa6e0067f90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0007a60 tx=0x7fa6f0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:14.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.676+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa6e8052180 con 0x7fa7000b85d0 2023-12-19T17:57:14.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:14.912+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fa700067760 con 0x7fa7000b85d0 2023-12-19T17:57:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.540+0000 7fa6f7fff700 1 -- 172.21.15.45:0/1852728910 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 3:0 v43) v1 ==== 101+0+0 (secure 0 0 0) 0x7fa6e80557a0 con 0x7fa7000b85d0 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6e0065ad0 msgr2=0x7fa6e0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6e0065ad0 0x7fa6e0067f90 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0007a60 tx=0x7fa6f0008040 comp rx=0 tx=0).stop 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 msgr2=0x7fa7001f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7001f6560 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa7000d2c10 tx=0x7fa6e8004770 comp rx=0 tx=0).stop 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 shutdown_connections 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6e0065ad0 0x7fa6e0067f90 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa70015cf50 0x7fa70006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7000b85d0 0x7fa7001f6560 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 --2- 172.21.15.45:0/1852728910 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7000701d0 0x7fa70015b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 >> 172.21.15.45:0/1852728910 conn(0x7fa7000b4730 msgr2=0x7fa7000b6740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 shutdown_connections 2023-12-19T17:57:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.544+0000 7fa705742700 1 -- 172.21.15.45:0/1852728910 wait complete. 2023-12-19T17:57:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:repaired: restoring rank 3:0 2023-12-19T17:57:15.560 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T17:57:15.556+0000 7f80e5e54700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:57:15.578 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T17:57:15.578 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T17:57:15.578 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T17:57:15.578 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:57:15.579 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T17:57:15.579 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T17:57:15.579 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T17:57:15.579 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:57:15.579 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T17:57:15.579 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T17:57:15.579 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T17:57:15.579 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:57:15.580 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T17:57:15.580 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T17:57:15.580 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T17:57:15.580 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:57:15.599 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T17:57:15.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T17:57:15.601 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T17:57:15.601 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T17:57:15.602 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T17:57:15.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T17:57:15.604 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T17:57:15.604 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T17:57:15.649 INFO:tasks.ceph.mds.a:Started 2023-12-19T17:57:15.650 DEBUG:teuthology.parallel:result is None 2023-12-19T17:57:15.650 INFO:tasks.ceph.mds.b:Started 2023-12-19T17:57:15.651 DEBUG:teuthology.parallel:result is None 2023-12-19T17:57:15.654 INFO:tasks.ceph.mds.d:Started 2023-12-19T17:57:15.654 DEBUG:teuthology.parallel:result is None 2023-12-19T17:57:15.655 INFO:tasks.ceph.mds.c:Started 2023-12-19T17:57:15.655 DEBUG:teuthology.parallel:result is None 2023-12-19T17:57:15.656 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:15.772 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:57:15.775 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:57:15.777 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:57:15.778 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T17:57:15.784 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:57:15.780+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:57:15.832 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:15.828+0000 7f06fa5c0700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T17:57:15.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.828+0000 7f26dd95d700 1 Processor -- start 2023-12-19T17:57:15.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.828+0000 7f26dd95d700 1 -- start start 2023-12-19T17:57:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d806ea90 0x7f26d80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26d80b88b0 0x7f26d80b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26d80b6250 0x7f26d80b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80d1820 con 0x7f26d80b6250 2023-12-19T17:57:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d80d1b00 con 0x7f26d80b88b0 2023-12-19T17:57:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80d1de0 con 0x7f26d806ea90 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26d80b6250 0x7f26d80b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26d7fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f26d80b88b0 0x7f26d80b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dc95b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d806ea90 0x7f26d80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f26d80b6250 0x7f26d80b66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43520/0 (socket says 172.21.15.45:43520) 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 -- 172.21.15.45:0/836177507 learned_addr learned my addr 172.21.15.45:0/836177507 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 -- 172.21.15.45:0/836177507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d806ea90 msgr2=0x7f26d80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 --2- 172.21.15.45:0/836177507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d806ea90 0x7f26d80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 -- 172.21.15.45:0/836177507 >> v2:172.21.15.73:3300/0 conn(0x7f26d80b88b0 msgr2=0x7f26d80b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 --2- 172.21.15.45:0/836177507 >> v2:172.21.15.73:3300/0 conn(0x7f26d80b88b0 0x7f26d80b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 -- 172.21.15.45:0/836177507 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d80d20c0 con 0x7f26d80b6250 2023-12-19T17:57:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26d7fff700 1 --2- 172.21.15.45:0/836177507 >> v2:172.21.15.73:3300/0 conn(0x7f26d80b88b0 0x7f26d80b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:15.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd15c700 1 --2- 172.21.15.45:0/836177507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d80b6250 0x7f26d80b66e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f26d8070650 tx=0x7f26d000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e947dbe5344f809e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:15.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26d77fe700 1 -- 172.21.15.45:0/836177507 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000e070 con 0x7f26d80b6250 2023-12-19T17:57:15.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26d77fe700 1 -- 172.21.15.45:0/836177507 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000b910 con 0x7f26d80b6250 2023-12-19T17:57:15.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26d77fe700 1 -- 172.21.15.45:0/836177507 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d000bcc0 con 0x7f26d80b6250 2023-12-19T17:57:15.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 -- 172.21.15.45:0/836177507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d80b6250 msgr2=0x7f26d80b66e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:15.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- 172.21.15.45:0/836177507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d80b6250 0x7f26d80b66e0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f26d8070650 tx=0x7f26d000b330 comp rx=0 tx=0).stop 2023-12-19T17:57:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 -- 172.21.15.45:0/836177507 shutdown_connections 2023-12-19T17:57:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- 172.21.15.45:0/836177507 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d80b6250 0x7f26d80b66e0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- 172.21.15.45:0/836177507 >> v2:172.21.15.73:3300/0 conn(0x7f26d80b88b0 0x7f26d80b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 --2- 172.21.15.45:0/836177507 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d806ea90 0x7f26d80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.832+0000 7f26dd95d700 1 -- 172.21.15.45:0/836177507 >> 172.21.15.45:0/836177507 conn(0x7f26d80b46d0 msgr2=0x7f26d80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.836+0000 7f26dd95d700 1 -- 172.21.15.45:0/836177507 shutdown_connections 2023-12-19T17:57:15.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.836+0000 7f26dd95d700 1 -- 172.21.15.45:0/836177507 wait complete. 2023-12-19T17:57:15.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.836+0000 7f26dd95d700 1 Processor -- start 2023-12-19T17:57:15.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.836+0000 7f26dd95d700 1 -- start start 2023-12-19T17:57:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 0x7f26d81562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d80b6250 0x7f26d8159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d80b88b0 0x7f26d81f6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80cafd0 con 0x7f26d806ea90 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d81581c0 con 0x7f26d80b88b0 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d81f6d70 con 0x7f26d80b6250 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 0x7f26d81562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 0x7f26d81562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43530/0 (socket says 172.21.15.45:43530) 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 -- 172.21.15.45:0/118847596 learned_addr learned my addr 172.21.15.45:0/118847596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd15c700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d80b88b0 0x7f26d81f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26d7fff700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d80b6250 0x7f26d8159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 -- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d80b6250 msgr2=0x7f26d8159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d80b6250 0x7f26d8159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 -- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d80b88b0 msgr2=0x7f26d81f6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d80b88b0 0x7f26d81f6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 -- 172.21.15.45:0/118847596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d0009b30 con 0x7f26d806ea90 2023-12-19T17:57:15.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dc95b700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 0x7f26d81562b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f26c800e870 tx=0x7f26c800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8009540 con 0x7f26d806ea90 2023-12-19T17:57:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c8013680 con 0x7f26d806ea90 2023-12-19T17:57:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d815d330 con 0x7f26d806ea90 2023-12-19T17:57:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8013a10 con 0x7f26d806ea90 2023-12-19T17:57:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.840+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d81f7330 con 0x7f26d806ea90 2023-12-19T17:57:15.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.844+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d8067760 con 0x7f26d806ea90 2023-12-19T17:57:15.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.844+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f26c8013b90 con 0x7f26d806ea90 2023-12-19T17:57:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.844+0000 7f26d57fa700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26c4065ad0 0x7f26c4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:15.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.844+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f26c80833f0 con 0x7f26d806ea90 2023-12-19T17:57:15.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.848+0000 7f26d7fff700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26c4065ad0 0x7f26c4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:15.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.848+0000 7f26d7fff700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26c4065ad0 0x7f26c4067f90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f26d80b7420 tx=0x7f26cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:15.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:15.852+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f26c8050940 con 0x7f26d806ea90 2023-12-19T17:57:16.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.060+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f26d80b7170 con 0x7f26d806ea90 2023-12-19T17:57:16.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.060+0000 7f26d57fa700 1 -- 172.21.15.45:0/118847596 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+4716 (secure 0 0 0) 0x7f26c805a070 con 0x7f26d806ea90 2023-12-19T17:57:16.066 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:16.066 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":46,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6175,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/3765002172","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":3765002172},{"type":"v1","addr":"172.21.15.73:6833","nonce":3765002172}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6187,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1273563393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1273563393},{"type":"v1","addr":"172.21.15.73:6835","nonce":1273563393}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":32},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45}],"filesystems":[{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:15.798587+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:replay","state_seq":1,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26c4065ad0 msgr2=0x7f26c4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26c4065ad0 0x7f26c4067f90 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f26d80b7420 tx=0x7f26cc008040 comp rx=0 tx=0).stop 2023-12-19T17:57:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 msgr2=0x7f26d81562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 0x7f26d81562b0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f26c800e870 tx=0x7f26c800eb80 comp rx=0 tx=0).stop 2023-12-19T17:57:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 shutdown_connections 2023-12-19T17:57:16.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f26c4065ad0 0x7f26c4067f90 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26d80b88b0 0x7f26d81f6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f26d80b6250 0x7f26d8159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 --2- 172.21.15.45:0/118847596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f26d806ea90 0x7f26d81562b0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 >> 172.21.15.45:0/118847596 conn(0x7f26d80b46d0 msgr2=0x7f26d80b7ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 shutdown_connections 2023-12-19T17:57:16.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:16.064+0000 7f26dd95d700 1 -- 172.21.15.45:0/118847596 wait complete. 2023-12-19T17:57:16.071 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 46 2023-12-19T17:57:16.496 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 46, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:57:09.426263+0000', 'modified': '2023-12-19T17:57:15.798587+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 56057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_56057': {'gid': 56057, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/2159224632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 2159224632}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 2159224632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9, 10], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:57:16.496 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_56057:up:replay 2023-12-19T17:57:17.497 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7660d700 1 Processor -- start 2023-12-19T17:57:17.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7660d700 1 -- start start 2023-12-19T17:57:17.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7660d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe700afe30 0x7fbe7015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7660d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7006f0a0 con 0x7fbe7015ae20 2023-12-19T17:57:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7660d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7006ea90 con 0x7fbe7006cad0 2023-12-19T17:57:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7660d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe700c3f60 con 0x7fbe700afe30 2023-12-19T17:57:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7560b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbe7015ae20 0x7fbe700c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53648/0 (socket says 172.21.15.45:53648) 2023-12-19T17:57:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.676+0000 7fbe7560b700 1 -- 172.21.15.45:0/1156973185 learned_addr learned my addr 172.21.15.45:0/1156973185 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:17.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe75e0c700 1 --2- 172.21.15.45:0/1156973185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe700afe30 0x7fbe7015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:17.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 748378966 0 0) 0x7fbe7006f0a0 con 0x7fbe7015ae20 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe5c0035d0 con 0x7fbe7015ae20 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601594137 0 0) 0x7fbe7006ea90 con 0x7fbe7006cad0 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe7006f0a0 con 0x7fbe7006cad0 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe75e0c700 1 -- 172.21.15.45:0/1156973185 >> v1:172.21.15.73:6789/0 conn(0x7fbe7006cad0 legacy=0x7fbe700af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3822498658 0 0) 0x7fbe5c0035d0 con 0x7fbe7015ae20 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe75e0c700 1 -- 172.21.15.45:0/1156973185 >> v1:172.21.15.45:6789/0 conn(0x7fbe7015ae20 legacy=0x7fbe700c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe75e0c700 1 -- 172.21.15.45:0/1156973185 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe700c4240 con 0x7fbe700afe30 2023-12-19T17:57:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe75e0c700 1 --2- 172.21.15.45:0/1156973185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe700afe30 0x7fbe7015be40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009dc0 tx=0x7fbe6800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c4617baea68e1e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6800e070 con 0x7fbe700afe30 2023-12-19T17:57:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe68003a40 con 0x7fbe700afe30 2023-12-19T17:57:17.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe67fff700 1 -- 172.21.15.45:0/1156973185 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c001670 con 0x7fbe700afe30 2023-12-19T17:57:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe7660d700 1 -- 172.21.15.45:0/1156973185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe700afe30 msgr2=0x7fbe7015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe7660d700 1 --2- 172.21.15.45:0/1156973185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe700afe30 0x7fbe7015be40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe68009dc0 tx=0x7fbe6800b330 comp rx=0 tx=0).stop 2023-12-19T17:57:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe7660d700 1 -- 172.21.15.45:0/1156973185 shutdown_connections 2023-12-19T17:57:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe7660d700 1 --2- 172.21.15.45:0/1156973185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe700afe30 0x7fbe7015be40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.680+0000 7fbe7660d700 1 -- 172.21.15.45:0/1156973185 >> 172.21.15.45:0/1156973185 conn(0x7fbe700cb900 msgr2=0x7fbe700b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.684+0000 7fbe7660d700 1 -- 172.21.15.45:0/1156973185 shutdown_connections 2023-12-19T17:57:17.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.684+0000 7fbe7660d700 1 -- 172.21.15.45:0/1156973185 wait complete. 2023-12-19T17:57:17.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.684+0000 7fbe7660d700 1 Processor -- start 2023-12-19T17:57:17.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.684+0000 7fbe7660d700 1 -- start start 2023-12-19T17:57:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 0x7fbe7014c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe700afe30 0x7fbe701f22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe7015ae20 0x7fbe701f2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:17.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe701f2d60 con 0x7fbe7006cad0 2023-12-19T17:57:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7014d900 con 0x7fbe700afe30 2023-12-19T17:57:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7014ccf0 con 0x7fbe7015ae20 2023-12-19T17:57:17.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 0x7fbe7014c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 0x7fbe7014c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43542/0 (socket says 172.21.15.45:43542) 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 -- 172.21.15.45:0/3531460139 learned_addr learned my addr 172.21.15.45:0/3531460139 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe75e0c700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe7015ae20 0x7fbe701f2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe74e0a700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe700afe30 0x7fbe701f22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 -- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe7015ae20 msgr2=0x7fbe701f2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe7015ae20 0x7fbe701f2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 -- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe700afe30 msgr2=0x7fbe701f22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe700afe30 0x7fbe701f22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 -- 172.21.15.45:0/3531460139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe68009a70 con 0x7fbe7006cad0 2023-12-19T17:57:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7560b700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 0x7fbe7014c710 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c6b0 tx=0x7fbe6c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c004ca0 con 0x7fbe7006cad0 2023-12-19T17:57:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe6c004e20 con 0x7fbe7006cad0 2023-12-19T17:57:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7014cfd0 con 0x7fbe7006cad0 2023-12-19T17:57:17.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe6c007310 con 0x7fbe7006cad0 2023-12-19T17:57:17.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.688+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7014d590 con 0x7fbe7006cad0 2023-12-19T17:57:17.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.692+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe70067760 con 0x7fbe7006cad0 2023-12-19T17:57:17.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.692+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe6c007470 con 0x7fbe7006cad0 2023-12-19T17:57:17.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.696+0000 7fbe65ffb700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbe54065ad0 0x7fbe54067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.696+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbe6c083240 con 0x7fbe7006cad0 2023-12-19T17:57:17.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.696+0000 7fbe74e0a700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbe54065ad0 0x7fbe54067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:17.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.696+0000 7fbe74e0a700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbe54065ad0 0x7fbe54067f90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbe70152f40 tx=0x7fbe60009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:17.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.700+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbe6c050780 con 0x7fbe7006cad0 2023-12-19T17:57:17.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.924+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe7006e310 con 0x7fbe7006cad0 2023-12-19T17:57:17.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe65ffb700 1 -- 172.21.15.45:0/3531460139 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fbe6c007720 con 0x7fbe7006cad0 2023-12-19T17:57:17.932 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:17.932 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":48,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:17.811355+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:17.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbe54065ad0 msgr2=0x7fbe54067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbe54065ad0 0x7fbe54067f90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fbe70152f40 tx=0x7fbe60009040 comp rx=0 tx=0).stop 2023-12-19T17:57:17.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 msgr2=0x7fbe7014c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:17.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 0x7fbe7014c710 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c00c6b0 tx=0x7fbe6c00c9c0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 shutdown_connections 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbe54065ad0 0x7fbe54067f90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe7015ae20 0x7fbe701f2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe700afe30 0x7fbe701f22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 --2- 172.21.15.45:0/3531460139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe7006cad0 0x7fbe7014c710 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 >> 172.21.15.45:0/3531460139 conn(0x7fbe700cb900 msgr2=0x7fbe700ce080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 shutdown_connections 2023-12-19T17:57:17.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:17.928+0000 7fbe7660d700 1 -- 172.21.15.45:0/3531460139 wait complete. 2023-12-19T17:57:17.937 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 48 2023-12-19T17:57:18.360 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:57:09.426263+0000', 'modified': '2023-12-19T17:57:17.811355+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 56057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_56057': {'gid': 56057, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.45:6837/2159224632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 2159224632}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 2159224632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9, 10], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:57:18.360 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_56057:up:rejoin 2023-12-19T17:57:19.360 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:19.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.547+0000 7f1f2d135700 1 Processor -- start 2023-12-19T17:57:19.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.547+0000 7f1f2d135700 1 -- start start 2023-12-19T17:57:19.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2d135700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f281611c0 0x7f1f280c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:19.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2d135700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f280af720 0x7f1f280afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:19.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2d135700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f280c3f90 con 0x7f1f281615a0 2023-12-19T17:57:19.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2d135700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f280b00f0 con 0x7f1f280af720 2023-12-19T17:57:19.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2d135700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f28070340 con 0x7f1f281611c0 2023-12-19T17:57:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f280af720 0x7f1f280afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f280af720 0x7f1f280afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46582/0 (socket says 172.21.15.45:46582) 2023-12-19T17:57:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 -- 172.21.15.45:0/3015395417 learned_addr learned my addr 172.21.15.45:0/3015395417 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f27fff700 1 --2- 172.21.15.45:0/3015395417 >> v2:172.21.15.73:3300/0 conn(0x7f1f281611c0 0x7f1f280c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 -- 172.21.15.45:0/3015395417 >> v2:172.21.15.73:3300/0 conn(0x7f1f281611c0 msgr2=0x7f1f280c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 --2- 172.21.15.45:0/3015395417 >> v2:172.21.15.73:3300/0 conn(0x7f1f281611c0 0x7f1f280c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 -- 172.21.15.45:0/3015395417 >> v1:172.21.15.73:6789/0 conn(0x7f1f281615a0 legacy=0x7f1f2806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:19.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 -- 172.21.15.45:0/3015395417 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f280c4270 con 0x7f1f280af720 2023-12-19T17:57:19.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f277fe700 1 -- 172.21.15.45:0/3015395417 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919755331 0 0) 0x7f1f280c3f90 con 0x7f1f281615a0 2023-12-19T17:57:19.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f2c934700 1 --2- 172.21.15.45:0/3015395417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f280af720 0x7f1f280afbb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1f28072080 tx=0x7f1f20009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18db183dccbd1712 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:19.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f277fe700 1 -- 172.21.15.45:0/3015395417 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20011830 con 0x7f1f280af720 2023-12-19T17:57:19.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f277fe700 1 -- 172.21.15.45:0/3015395417 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20011990 con 0x7f1f280af720 2023-12-19T17:57:19.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.551+0000 7f1f277fe700 1 -- 172.21.15.45:0/3015395417 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f20011d20 con 0x7f1f280af720 2023-12-19T17:57:19.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 -- 172.21.15.45:0/3015395417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f280af720 msgr2=0x7f1f280afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:19.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 --2- 172.21.15.45:0/3015395417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f280af720 0x7f1f280afbb0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1f28072080 tx=0x7f1f20009bf0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 -- 172.21.15.45:0/3015395417 shutdown_connections 2023-12-19T17:57:19.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 --2- 172.21.15.45:0/3015395417 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f280af720 0x7f1f280afbb0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 --2- 172.21.15.45:0/3015395417 >> v2:172.21.15.73:3300/0 conn(0x7f1f281611c0 0x7f1f280c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 -- 172.21.15.45:0/3015395417 >> 172.21.15.45:0/3015395417 conn(0x7f1f280cb900 msgr2=0x7f1f280b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:19.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 -- 172.21.15.45:0/3015395417 shutdown_connections 2023-12-19T17:57:19.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.555+0000 7f1f2d135700 1 -- 172.21.15.45:0/3015395417 wait complete. 2023-12-19T17:57:19.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 Processor -- start 2023-12-19T17:57:19.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 -- start start 2023-12-19T17:57:19.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f280af720 0x7f1f28150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:19.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 0x7f1f280c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:19.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f281615a0 0x7f1f280c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:19.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28161a60 con 0x7f1f281611c0 2023-12-19T17:57:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28162880 con 0x7f1f281615a0 2023-12-19T17:57:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.559+0000 7f1f2d135700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f28151250 con 0x7f1f280af720 2023-12-19T17:57:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 0x7f1f280c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f27fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f280af720 0x7f1f28150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 0x7f1f280c7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46592/0 (socket says 172.21.15.45:46592) 2023-12-19T17:57:19.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f2c934700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f281615a0 0x7f1f280c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 -- 172.21.15.45:0/2879551391 learned_addr learned my addr 172.21.15.45:0/2879551391 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 -- 172.21.15.45:0/2879551391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f280af720 msgr2=0x7f1f28150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:19.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f280af720 0x7f1f28150d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 -- 172.21.15.45:0/2879551391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f281615a0 msgr2=0x7f1f280c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f281615a0 0x7f1f280c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 -- 172.21.15.45:0/2879551391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20009570 con 0x7f1f281611c0 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f1f7fe700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 0x7f1f280c7650 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c540 tx=0x7f1f1000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f100054e0 con 0x7f1f281611c0 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f100036a0 con 0x7f1f281611c0 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f28161c70 con 0x7f1f281611c0 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f10003a50 con 0x7f1f281611c0 2023-12-19T17:57:19.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.563+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f28162230 con 0x7f1f281611c0 2023-12-19T17:57:19.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.567+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f2806e760 con 0x7f1f281611c0 2023-12-19T17:57:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.567+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f10003bb0 con 0x7f1f281611c0 2023-12-19T17:57:19.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.567+0000 7f1f257fa700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f08065ad0 0x7f1f08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:19.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.567+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f1f10082a40 con 0x7f1f281611c0 2023-12-19T17:57:19.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.567+0000 7f1f27fff700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f08065ad0 0x7f1f08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:19.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.571+0000 7f1f27fff700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f08065ad0 0x7f1f08067f90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1f280af6c0 tx=0x7f1f1800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.575+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f1004ff00 con 0x7f1f281611c0 2023-12-19T17:57:19.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.787+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f28067760 con 0x7f1f281611c0 2023-12-19T17:57:19.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.787+0000 7f1f257fa700 1 -- 172.21.15.45:0/2879551391 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f1f10003e60 con 0x7f1f281611c0 2023-12-19T17:57:19.795 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:19.795 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:18.814594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.791+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f08065ad0 msgr2=0x7f1f08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.791+0000 7f1f2d135700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f08065ad0 0x7f1f08067f90 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1f280af6c0 tx=0x7f1f1800b040 comp rx=0 tx=0).stop 2023-12-19T17:57:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.791+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 msgr2=0x7f1f280c7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:19.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.791+0000 7f1f2d135700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 0x7f1f280c7650 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000c540 tx=0x7f1f1000c850 comp rx=0 tx=0).stop 2023-12-19T17:57:19.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 shutdown_connections 2023-12-19T17:57:19.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f08065ad0 0x7f1f08067f90 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f281615a0 0x7f1f280c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f281611c0 0x7f1f280c7650 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 --2- 172.21.15.45:0/2879551391 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f280af720 0x7f1f28150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:19.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 >> 172.21.15.45:0/2879551391 conn(0x7f1f280cb900 msgr2=0x7f1f2806f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:19.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 shutdown_connections 2023-12-19T17:57:19.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:19.795+0000 7f1f2d135700 1 -- 172.21.15.45:0/2879551391 wait complete. 2023-12-19T17:57:19.802 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-19T17:57:20.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:57:09.426263+0000', 'modified': '2023-12-19T17:57:18.814594+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 69, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 56057}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_56057': {'gid': 56057, 'name': 'a', 'rank': 0, 'incarnation': 46, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.45:6837/2159224632', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 2159224632}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 2159224632}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9, 10], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:57:20.225 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:57:20.225 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-19T17:57:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.411+0000 7fd672c5d700 1 Processor -- start 2023-12-19T17:57:20.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.411+0000 7fd672c5d700 1 -- start start 2023-12-19T17:57:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.411+0000 7fd672c5d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd66c15ae20 0x7fd66c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd672c5d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c06f0a0 con 0x7fd66c0af720 2023-12-19T17:57:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd672c5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd66c06ea90 con 0x7fd66c06cad0 2023-12-19T17:57:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd672c5d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd66c0c3f60 con 0x7fd66c15ae20 2023-12-19T17:57:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd67245c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd66c0af720 0x7fd66c06f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58638/0 (socket says 172.21.15.45:58638) 2023-12-19T17:57:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd67245c700 1 -- 172.21.15.45:0/3268118092 learned_addr learned my addr 172.21.15.45:0/3268118092 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:20.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd671c5b700 1 --2- 172.21.15.45:0/3268118092 >> v2:172.21.15.73:3300/0 conn(0x7fd66c15ae20 0x7fd66c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd670c59700 1 -- 172.21.15.45:0/3268118092 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1445227636 0 0) 0x7fd66c06f0a0 con 0x7fd66c0af720 2023-12-19T17:57:20.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd670c59700 1 -- 172.21.15.45:0/3268118092 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6580035d0 con 0x7fd66c0af720 2023-12-19T17:57:20.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd671c5b700 1 -- 172.21.15.45:0/3268118092 >> v1:172.21.15.73:6789/0 conn(0x7fd66c06cad0 legacy=0x7fd66c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd671c5b700 1 -- 172.21.15.45:0/3268118092 >> v1:172.21.15.45:6789/0 conn(0x7fd66c0af720 legacy=0x7fd66c06f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd671c5b700 1 -- 172.21.15.45:0/3268118092 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66c0c4240 con 0x7fd66c15ae20 2023-12-19T17:57:20.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd671c5b700 1 --2- 172.21.15.45:0/3268118092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c15ae20 0x7fd66c15be40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd668009850 tx=0x7fd668009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2951fbc9e58bd413 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd670c59700 1 -- 172.21.15.45:0/3268118092 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668011830 con 0x7fd66c15ae20 2023-12-19T17:57:20.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd670c59700 1 -- 172.21.15.45:0/3268118092 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd668011990 con 0x7fd66c15ae20 2023-12-19T17:57:20.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.415+0000 7fd670c59700 1 -- 172.21.15.45:0/3268118092 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668011d40 con 0x7fd66c15ae20 2023-12-19T17:57:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 -- 172.21.15.45:0/3268118092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c15ae20 msgr2=0x7fd66c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 --2- 172.21.15.45:0/3268118092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c15ae20 0x7fd66c15be40 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd668009850 tx=0x7fd668009b60 comp rx=0 tx=0).stop 2023-12-19T17:57:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 -- 172.21.15.45:0/3268118092 shutdown_connections 2023-12-19T17:57:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 --2- 172.21.15.45:0/3268118092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c15ae20 0x7fd66c15be40 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 -- 172.21.15.45:0/3268118092 >> 172.21.15.45:0/3268118092 conn(0x7fd66c0cb900 msgr2=0x7fd66c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 -- 172.21.15.45:0/3268118092 shutdown_connections 2023-12-19T17:57:20.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 -- 172.21.15.45:0/3268118092 wait complete. 2023-12-19T17:57:20.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 Processor -- start 2023-12-19T17:57:20.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.419+0000 7fd672c5d700 1 -- start start 2023-12-19T17:57:20.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 0x7fd66c15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd66c0af720 0x7fd66c1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66c15ae20 0x7fd66c154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0c8020 con 0x7fd66c15ae20 2023-12-19T17:57:20.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0c5930 con 0x7fd66c06cad0 2023-12-19T17:57:20.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd66c0c5c10 con 0x7fd66c0af720 2023-12-19T17:57:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66c15ae20 0x7fd66c154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 0x7fd66c15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 0x7fd66c15b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:54312/0 (socket says 172.21.15.45:54312) 2023-12-19T17:57:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66c15ae20 0x7fd66c154710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46594/0 (socket says 172.21.15.45:46594) 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 -- 172.21.15.45:0/461636113 learned_addr learned my addr 172.21.15.45:0/461636113 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd67145a700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd66c0af720 0x7fd66c1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 -- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd66c0af720 msgr2=0x7fd66c1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd66c0af720 0x7fd66c1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 -- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66c15ae20 msgr2=0x7fd66c154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66c15ae20 0x7fd66c154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 -- 172.21.15.45:0/461636113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6680094b0 con 0x7fd66c06cad0 2023-12-19T17:57:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd671c5b700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 0x7fd66c15b510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd668014040 tx=0x7fd668004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd6627fc700 1 -- 172.21.15.45:0/461636113 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668019980 con 0x7fd66c06cad0 2023-12-19T17:57:20.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd6627fc700 1 -- 172.21.15.45:0/461636113 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd66801e070 con 0x7fd66c06cad0 2023-12-19T17:57:20.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd6627fc700 1 -- 172.21.15.45:0/461636113 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668019d20 con 0x7fd66c06cad0 2023-12-19T17:57:20.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66c0c82c0 con 0x7fd66c06cad0 2023-12-19T17:57:20.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.423+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd66c0b3e30 con 0x7fd66c06cad0 2023-12-19T17:57:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.427+0000 7fd6627fc700 1 -- 172.21.15.45:0/461636113 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd66802d450 con 0x7fd66c06cad0 2023-12-19T17:57:20.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.431+0000 7fd6627fc700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd650065ad0 0x7fd650067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.431+0000 7fd6627fc700 1 -- 172.21.15.45:0/461636113 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd668084520 con 0x7fd66c06cad0 2023-12-19T17:57:20.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.431+0000 7fd67145a700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd650065ad0 0x7fd650067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.431+0000 7fd67145a700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd650065ad0 0x7fd650067f90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd66c154f20 tx=0x7fd65c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 Processor -- start 2023-12-19T17:57:20.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 -- start start 2023-12-19T17:57:20.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a3de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a88290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a3b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x29af5b0 con 0x2a887d0 2023-12-19T17:57:20.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x29acd40 con 0x2a87eb0 2023-12-19T17:57:20.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x29a8630 con 0x2a66430 2023-12-19T17:57:20.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a3b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a3b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46596/0 (socket says 172.21.15.45:46596) 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 -- 172.21.15.45:0/515861558 learned_addr learned my addr 172.21.15.45:0/515861558 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67145a700 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a88290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd671c5b700 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a3de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 -- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 msgr2=0x2a88290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a88290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 -- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 msgr2=0x2a3de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a3de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 -- 172.21.15.45:0/515861558 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x281b960 con 0x2a887d0 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd671c5b700 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd67245c700 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a3b8c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd6640021e0 tx=0x7fd664007040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8570db7d56013 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd64f7fe700 1 -- 172.21.15.45:0/515861558 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664007980 con 0x2a887d0 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd64f7fe700 1 -- 172.21.15.45:0/515861558 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664007ae0 con 0x2a887d0 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.435+0000 7fd64f7fe700 1 -- 172.21.15.45:0/515861558 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6640135f0 con 0x2a887d0 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 -- 172.21.15.45:0/515861558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 msgr2=0x2a3b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a3b8c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fd6640021e0 tx=0x7fd664007040 comp rx=0 tx=0).stop 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 -- 172.21.15.45:0/515861558 shutdown_connections 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a3b8c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a88290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 --2- 172.21.15.45:0/515861558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a3de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 -- 172.21.15.45:0/515861558 >> 172.21.15.45:0/515861558 conn(0x27d04d0 msgr2=0x2a41d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 -- 172.21.15.45:0/515861558 shutdown_connections 2023-12-19T17:57:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 -- 172.21.15.45:0/515861558 wait complete. 2023-12-19T17:57:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 -- start start 2023-12-19T17:57:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.439+0000 7fd67714d740 1 Processor -- start 2023-12-19T17:57:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a65ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a418d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2965c80 con 0x2a887d0 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x296bb00 con 0x2a87eb0 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2854aa0 con 0x2a66430 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 10 client.0 _ll_register_callbacks cb 0x29a1f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46604/0 (socket says 172.21.15.45:46604) 2023-12-19T17:57:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 -- 172.21.15.45:0/348208698 learned_addr learned my addr 172.21.15.45:0/348208698 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67145a700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd671c5b700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a65ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 -- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 msgr2=0x2a65ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a65ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 -- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 msgr2=0x2a418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 -- 172.21.15.45:0/348208698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6580035d0 con 0x2a887d0 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67245c700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4bc60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd664002230 tx=0x7fd664001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f770b10fb1322e93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd64cff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd64cff9700 1 -- 172.21.15.45:0/348208698 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664007980 con 0x2a887d0 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd64cff9700 1 -- 172.21.15.45:0/348208698 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd66401c450 con 0x2a887d0 2023-12-19T17:57:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29a16b0 con 0x2a887d0 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd64cff9700 1 -- 172.21.15.45:0/348208698 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd664029ea0 con 0x2a887d0 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 10 client.6936 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x296e770 con 0x2a887d0 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd64cff9700 1 -- 172.21.15.45:0/348208698 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x29a16b0 con 0x2a887d0 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd64cff9700 1 -- 172.21.15.45:0/348208698 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd664012070 con 0x2a887d0 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 10 client.6936 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:20.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.443+0000 7fd67714d740 10 client.6936 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 20 client.6936 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2a92170 0x2a92550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 4 client.6936 mds_command: new command op to 56057 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2963a00 con 0x2a92170 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd671c5b700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2a92170 0x2a92550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd671c5b700 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2a92170 0x2a92550 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed71c12bd8bf206a server_cookie=716bf9f08a1e0d9b in_seq=0 out_seq=0 2023-12-19T17:57:20.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd64cff9700 10 client.6936 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd64cff9700 1 -- 172.21.15.45:0/348208698 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x2963a00 con 0x2a92170 2023-12-19T17:57:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd64cff9700 10 client.6936 handle_command_reply: tid=0 2023-12-19T17:57:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 client.6936 shutdown 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 msgr2=0x2a4bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4bc60 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fd664002230 tx=0x7fd664001250 comp rx=0 tx=0).stop 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 shutdown_connections 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2a92170 0x2a92550 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4bc60 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 --2- 172.21.15.45:0/348208698 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a65ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 >> 172.21.15.45:0/348208698 conn(0x27d04d0 msgr2=0x2a68bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd64cff9700 0 client.6936 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 shutdown_connections 2023-12-19T17:57:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.447+0000 7fd67714d740 1 -- 172.21.15.45:0/348208698 wait complete. 2023-12-19T17:57:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.451+0000 7fd67714d740 20 client.6936 trim_cache size 0 max 16384 2023-12-19T17:57:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.467+0000 7fd67714d740 1 Processor -- start 2023-12-19T17:57:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.467+0000 7fd67714d740 1 -- start start 2023-12-19T17:57:20.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.467+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a66430 0x2a68a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a87eb0 0x2a4a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2933480 con 0x2a887d0 2023-12-19T17:57:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x29726b0 con 0x2a66430 2023-12-19T17:57:20.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x29a8ee0 con 0x2a87eb0 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46606/0 (socket says 172.21.15.45:46606) 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 -- 172.21.15.45:0/4149351550 learned_addr learned my addr 172.21.15.45:0/4149351550 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67145a700 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a87eb0 0x2a4a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd671c5b700 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a66430 0x2a68a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 -- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a87eb0 msgr2=0x2a4a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a87eb0 0x2a4a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 -- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a66430 msgr2=0x2a68a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a66430 0x2a68a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 -- 172.21.15.45:0/4149351550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29549a0 con 0x2a887d0 2023-12-19T17:57:20.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67145a700 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a87eb0 0x2a4a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67245c700 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4ae00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd6640021e0 tx=0x7fd664021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f6ebe52017fda server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd64ffff700 1 -- 172.21.15.45:0/4149351550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664007980 con 0x2a887d0 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd64ffff700 1 -- 172.21.15.45:0/4149351550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664023070 con 0x2a887d0 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd64ffff700 1 -- 172.21.15.45:0/4149351550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd66401c690 con 0x2a887d0 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- 172.21.15.45:0/4149351550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 msgr2=0x2a4ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4ae00 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd6640021e0 tx=0x7fd664021070 comp rx=0 tx=0).stop 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- 172.21.15.45:0/4149351550 shutdown_connections 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2a4ae00 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a87eb0 0x2a4a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 --2- 172.21.15.45:0/4149351550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a66430 0x2a68a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- 172.21.15.45:0/4149351550 >> 172.21.15.45:0/4149351550 conn(0x27d04d0 msgr2=0x2a6a370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- 172.21.15.45:0/4149351550 shutdown_connections 2023-12-19T17:57:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.471+0000 7fd67714d740 1 -- 172.21.15.45:0/4149351550 wait complete. 2023-12-19T17:57:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 -- start start 2023-12-19T17:57:20.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 Processor -- start 2023-12-19T17:57:20.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a9bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a9aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2add700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a91e30 con 0x2a887d0 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a41050 con 0x2a87eb0 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2adf5d0 con 0x2a66430 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67714d740 10 client.0 _ll_register_callbacks cb 0x28e1e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2add700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2add700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46622/0 (socket says 172.21.15.45:46622) 2023-12-19T17:57:20.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 -- 172.21.15.45:0/3754929638 learned_addr learned my addr 172.21.15.45:0/3754929638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd671c5b700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a9bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67145a700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a9aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 -- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 msgr2=0x2a9bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a9bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 -- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 msgr2=0x2a9aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a9aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 -- 172.21.15.45:0/3754929638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x296e770 con 0x2a887d0 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd67245c700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2add700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd664001d00 tx=0x7fd664001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c99af27890e88f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd64cff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.475+0000 7fd64cff9700 1 -- 172.21.15.45:0/3754929638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd664001310 con 0x2a887d0 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 1 -- 172.21.15.45:0/3754929638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd664039040 con 0x2a887d0 2023-12-19T17:57:20.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd664007ae0 con 0x2a887d0 2023-12-19T17:57:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 1 -- 172.21.15.45:0/3754929638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd66401c660 con 0x2a887d0 2023-12-19T17:57:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 10 client.6942 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x2948c70 con 0x2a887d0 2023-12-19T17:57:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 1 -- 172.21.15.45:0/3754929638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd664007ae0 con 0x2a887d0 2023-12-19T17:57:20.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 1 -- 172.21.15.45:0/3754929638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fd66401c7c0 con 0x2a887d0 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 10 client.6942 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 10 client.6942 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 20 client.6942 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2ade230 0x2ae84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 4 client.6942 mds_command: new command op to 56057 tid=0[{"prefix": "status"}] 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2827460 con 0x2ade230 2023-12-19T17:57:20.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd671c5b700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2ade230 0x2ae84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 10 client.6942 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd671c5b700 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2ade230 0x2ae84a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=489af1cc4687a0b server_cookie=d2dedff4010a0152 in_seq=0 out_seq=0 2023-12-19T17:57:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 1 -- 172.21.15.45:0/3754929638 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x2827460 con 0x2ade230 2023-12-19T17:57:20.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 10 client.6942 handle_command_reply: tid=0 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 client.6942 shutdown 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 msgr2=0x2add700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2add700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd664001d00 tx=0x7fd664001a10 comp rx=0 tx=0).stop 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 shutdown_connections 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2ade230 0x2ae84a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a887d0 0x2add700 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a87eb0 0x2a9aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 --2- 172.21.15.45:0/3754929638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a66430 0x2a9bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd64cff9700 0 client.6942 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 >> 172.21.15.45:0/3754929638 conn(0x27d04d0 msgr2=0x2a68a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 shutdown_connections 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.479+0000 7fd67714d740 1 -- 172.21.15.45:0/3754929638 wait complete. 2023-12-19T17:57:20.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd67714d740 20 client.6942 trim_cache size 0 max 16384 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 56057, 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.6768181880000004, 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 49, 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 72, 2023-12-19T17:57:20.489 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 72, 2023-12-19T17:57:20.490 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 4.706336758 2023-12-19T17:57:20.490 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd650065ad0 msgr2=0x7fd650067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd650065ad0 0x7fd650067f90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd66c154f20 tx=0x7fd65c009040 comp rx=0 tx=0).stop 2023-12-19T17:57:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 msgr2=0x7fd66c15b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 0x7fd66c15b510 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fd668014040 tx=0x7fd668004770 comp rx=0 tx=0).stop 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 shutdown_connections 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd650065ad0 0x7fd650067f90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd66c15ae20 0x7fd66c154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd66c0af720 0x7fd66c1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 --2- 172.21.15.45:0/461636113 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd66c06cad0 0x7fd66c15b510 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 >> 172.21.15.45:0/461636113 conn(0x7fd66c0cb900 msgr2=0x7fd66c159a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 shutdown_connections 2023-12-19T17:57:20.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.483+0000 7fd672c5d700 1 -- 172.21.15.45:0/461636113 wait complete. 2023-12-19T17:57:20.513 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:57:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.695+0000 7fd32ef70700 1 Processor -- start 2023-12-19T17:57:20.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.695+0000 7fd32ef70700 1 -- start start 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32ef70700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd3281611c0 0x7fd3280c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32ef70700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3281615a0 0x7fd32806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32ef70700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32806dc80 con 0x7fd3280af720 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32ef70700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd328070340 con 0x7fd3281615a0 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32ef70700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3280c3f90 con 0x7fd3281611c0 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3281615a0 0x7fd32806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32e76f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd3280af720 0x7fd328164f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58644/0 (socket says 172.21.15.45:58644) 2023-12-19T17:57:20.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3281615a0 0x7fd32806d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46624/0 (socket says 172.21.15.45:46624) 2023-12-19T17:57:20.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 -- 172.21.15.45:0/404134242 learned_addr learned my addr 172.21.15.45:0/404134242 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32df6e700 1 --2- 172.21.15.45:0/404134242 >> v2:172.21.15.73:3300/0 conn(0x7fd3281611c0 0x7fd3280c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 -- 172.21.15.45:0/404134242 >> v2:172.21.15.73:3300/0 conn(0x7fd3281611c0 msgr2=0x7fd3280c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 --2- 172.21.15.45:0/404134242 >> v2:172.21.15.73:3300/0 conn(0x7fd3281611c0 0x7fd3280c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 -- 172.21.15.45:0/404134242 >> v1:172.21.15.45:6789/0 conn(0x7fd3280af720 legacy=0x7fd328164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 -- 172.21.15.45:0/404134242 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3280c4270 con 0x7fd3281615a0 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.699+0000 7fd32d76d700 1 --2- 172.21.15.45:0/404134242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281615a0 0x7fd32806d740 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd328072080 tx=0x7fd318009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec2b54edf1001b2f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32cf6c700 1 -- 172.21.15.45:0/404134242 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800b8a0 con 0x7fd3281615a0 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32cf6c700 1 -- 172.21.15.45:0/404134242 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31800ba00 con 0x7fd3281615a0 2023-12-19T17:57:20.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32cf6c700 1 -- 172.21.15.45:0/404134242 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31800bd90 con 0x7fd3281615a0 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 -- 172.21.15.45:0/404134242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281615a0 msgr2=0x7fd32806d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 --2- 172.21.15.45:0/404134242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281615a0 0x7fd32806d740 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fd328072080 tx=0x7fd318009bf0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 -- 172.21.15.45:0/404134242 shutdown_connections 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 --2- 172.21.15.45:0/404134242 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281615a0 0x7fd32806d740 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 --2- 172.21.15.45:0/404134242 >> v2:172.21.15.73:3300/0 conn(0x7fd3281611c0 0x7fd3280c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 -- 172.21.15.45:0/404134242 >> 172.21.15.45:0/404134242 conn(0x7fd3280cb900 msgr2=0x7fd3280b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 -- 172.21.15.45:0/404134242 shutdown_connections 2023-12-19T17:57:20.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 -- 172.21.15.45:0/404134242 wait complete. 2023-12-19T17:57:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 Processor -- start 2023-12-19T17:57:20.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.703+0000 7fd32ef70700 1 -- start start 2023-12-19T17:57:20.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3280af720 0x7fd3281f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 0x7fd3280c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3281615a0 0x7fd3280b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c8460 con 0x7fd3281611c0 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c7850 con 0x7fd3280af720 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3280c7b30 con 0x7fd3281615a0 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 0x7fd3280c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 0x7fd3280c6e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46632/0 (socket says 172.21.15.45:46632) 2023-12-19T17:57:20.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 -- 172.21.15.45:0/3992378074 learned_addr learned my addr 172.21.15.45:0/3992378074 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32df6e700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3280af720 0x7fd3281f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32e76f700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3281615a0 0x7fd3280b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 -- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3281615a0 msgr2=0x7fd3280b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3281615a0 0x7fd3280b2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 -- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3280af720 msgr2=0x7fd3281f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3280af720 0x7fd3281f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 -- 172.21.15.45:0/3992378074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd318009570 con 0x7fd3281611c0 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32d76d700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 0x7fd3280c6e20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3180038c0 con 0x7fd3281611c0 2023-12-19T17:57:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd318003a20 con 0x7fd3281611c0 2023-12-19T17:57:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3280c7e10 con 0x7fd3281611c0 2023-12-19T17:57:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd318003db0 con 0x7fd3281611c0 2023-12-19T17:57:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.707+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd328162610 con 0x7fd3281611c0 2023-12-19T17:57:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.711+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32806e760 con 0x7fd3281611c0 2023-12-19T17:57:20.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.711+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd318011420 con 0x7fd3281611c0 2023-12-19T17:57:20.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.715+0000 7fd31e7fc700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd30c065ad0 0x7fd30c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:20.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.715+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd318020030 con 0x7fd3281611c0 2023-12-19T17:57:20.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.715+0000 7fd32df6e700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd30c065ad0 0x7fd30c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:20.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.715+0000 7fd32df6e700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd30c065ad0 0x7fd30c067f90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd324009950 tx=0x7fd324008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:20.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.719+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd3180520d0 con 0x7fd3281611c0 2023-12-19T17:57:20.821 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:20.815+0000 7f06fddc7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:57:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.931+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd328067760 con 0x7fd3281611c0 2023-12-19T17:57:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.931+0000 7fd31e7fc700 1 -- 172.21.15.45:0/3992378074 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fd3180556f0 con 0x7fd3281611c0 2023-12-19T17:57:20.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:57:20.940 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:18.814594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd30c065ad0 msgr2=0x7fd30c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd30c065ad0 0x7fd30c067f90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd324009950 tx=0x7fd324008040 comp rx=0 tx=0).stop 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 msgr2=0x7fd3280c6e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 0x7fd3280c6e20 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd318000c00 tx=0x7fd318004770 comp rx=0 tx=0).stop 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 shutdown_connections 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd30c065ad0 0x7fd30c067f90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3281615a0 0x7fd3280b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3281611c0 0x7fd3280c6e20 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 --2- 172.21.15.45:0/3992378074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3280af720 0x7fd3281f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:20.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 >> 172.21.15.45:0/3992378074 conn(0x7fd3280cb900 msgr2=0x7fd32806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:20.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 shutdown_connections 2023-12-19T17:57:20.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:20.935+0000 7fd32ef70700 1 -- 172.21.15.45:0/3992378074 wait complete. 2023-12-19T17:57:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-19T17:57:20.968 INFO:tasks.cephfs.test_data_scan:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 3, "epoch": 49, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 3, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-12-19T17:57:09.426263+0000", "damaged": [], "data_pools": [ 9, 10 ], "enabled": true, "epoch": 49, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_56057": { "addr": "172.21.15.45:6837/2159224632", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6835", "nonce": 2159224632, "type": "v2" }, { "addr": "172.21.15.45:6837", "nonce": 2159224632, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 56057, "incarnation": 46, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 69, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 8, "modified": "2023-12-19T17:57:18.814594+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 56057 } } } ], "standbys": [ { "addr": "172.21.15.73:6835/75258698", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6833", "nonce": 75258698, "type": "v2" }, { "addr": "172.21.15.73:6835", "nonce": 75258698, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 47, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6760, "incarnation": 0, "join_fscid": -1, "name": "b", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.45:6836/2851116291", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6834", "nonce": 2851116291, "type": "v2" }, { "addr": "172.21.15.45:6836", "nonce": 2851116291, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 45, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 6897, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.73:6834/1739040049", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6832", "nonce": 1739040049, "type": "v2" }, { "addr": "172.21.15.73:6834", "nonce": 1739040049, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 47, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 56060, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-12-19T17:57:20.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:57:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.143+0000 7fd1c359e700 1 Processor -- start 2023-12-19T17:57:21.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.143+0000 7fd1c359e700 1 -- start start 2023-12-19T17:57:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd1c40afe30 0x7fd1c415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c406f0a0 con 0x7fd1c415ae20 2023-12-19T17:57:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c406ea90 con 0x7fd1c406cad0 2023-12-19T17:57:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c40c3f60 con 0x7fd1c40afe30 2023-12-19T17:57:21.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd1c415ae20 0x7fd1c40c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58648/0 (socket says 172.21.15.45:58648) 2023-12-19T17:57:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c259c700 1 -- 172.21.15.45:0/2318321687 learned_addr learned my addr 172.21.15.45:0/2318321687 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c2d9d700 1 --2- 172.21.15.45:0/2318321687 >> v2:172.21.15.73:3300/0 conn(0x7fd1c40afe30 0x7fd1c415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c1d9b700 1 -- 172.21.15.45:0/2318321687 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2063664586 0 0) 0x7fd1c406f0a0 con 0x7fd1c415ae20 2023-12-19T17:57:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c1d9b700 1 -- 172.21.15.45:0/2318321687 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1b00035d0 con 0x7fd1c415ae20 2023-12-19T17:57:21.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c2d9d700 1 -- 172.21.15.45:0/2318321687 >> v1:172.21.15.73:6789/0 conn(0x7fd1c406cad0 legacy=0x7fd1c40af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c2d9d700 1 -- 172.21.15.45:0/2318321687 >> v1:172.21.15.45:6789/0 conn(0x7fd1c415ae20 legacy=0x7fd1c40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.147+0000 7fd1c2d9d700 1 -- 172.21.15.45:0/2318321687 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40c4240 con 0x7fd1c40afe30 2023-12-19T17:57:21.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c2d9d700 1 --2- 172.21.15.45:0/2318321687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c415be40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009d90 tx=0x7fd1bc00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8218280bf7a344b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c1d9b700 1 -- 172.21.15.45:0/2318321687 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc00e070 con 0x7fd1c40afe30 2023-12-19T17:57:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c1d9b700 1 -- 172.21.15.45:0/2318321687 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc00bb20 con 0x7fd1c40afe30 2023-12-19T17:57:21.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c1d9b700 1 -- 172.21.15.45:0/2318321687 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc012430 con 0x7fd1c40afe30 2023-12-19T17:57:21.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 -- 172.21.15.45:0/2318321687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 msgr2=0x7fd1c415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 --2- 172.21.15.45:0/2318321687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c415be40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009d90 tx=0x7fd1bc00b330 comp rx=0 tx=0).stop 2023-12-19T17:57:21.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 -- 172.21.15.45:0/2318321687 shutdown_connections 2023-12-19T17:57:21.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 --2- 172.21.15.45:0/2318321687 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c415be40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 -- 172.21.15.45:0/2318321687 >> 172.21.15.45:0/2318321687 conn(0x7fd1c40cb900 msgr2=0x7fd1c40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 -- 172.21.15.45:0/2318321687 shutdown_connections 2023-12-19T17:57:21.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.151+0000 7fd1c359e700 1 -- 172.21.15.45:0/2318321687 wait complete. 2023-12-19T17:57:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 Processor -- start 2023-12-19T17:57:21.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 -- start start 2023-12-19T17:57:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 0x7fd1c40c8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1c415ae20 0x7fd1c40cc930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40c8740 con 0x7fd1c406cad0 2023-12-19T17:57:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40c5890 con 0x7fd1c40afe30 2023-12-19T17:57:21.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c4153db0 con 0x7fd1c415ae20 2023-12-19T17:57:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 0x7fd1c40c8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 0x7fd1c40c8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46634/0 (socket says 172.21.15.45:46634) 2023-12-19T17:57:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 -- 172.21.15.45:0/3487945307 learned_addr learned my addr 172.21.15.45:0/3487945307 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:21.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1b9d9b700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c2d9d700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1c415ae20 0x7fd1c40cc930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 -- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1c415ae20 msgr2=0x7fd1c40cc930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1c415ae20 0x7fd1c40cc930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 -- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 msgr2=0x7fd1c4156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c4156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1c259c700 1 -- 172.21.15.45:0/3487945307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009a70 con 0x7fd1c406cad0 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.155+0000 7fd1b9d9b700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:57:21.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1c259c700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 0x7fd1c40c8200 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c4d0 tx=0x7fd1b400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4005d90 con 0x7fd1c406cad0 2023-12-19T17:57:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b40070d0 con 0x7fd1c406cad0 2023-12-19T17:57:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c41551f0 con 0x7fd1c406cad0 2023-12-19T17:57:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b4007480 con 0x7fd1c406cad0 2023-12-19T17:57:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4153ad0 con 0x7fd1c406cad0 2023-12-19T17:57:21.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.159+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c4067760 con 0x7fd1c406cad0 2023-12-19T17:57:21.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.163+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1b40075e0 con 0x7fd1c406cad0 2023-12-19T17:57:21.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.163+0000 7fd1bb7fe700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1a4065ad0 0x7fd1a4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.163+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd1b40829b0 con 0x7fd1c406cad0 2023-12-19T17:57:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.163+0000 7fd1b9d9b700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1a4065ad0 0x7fd1a4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:21.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.163+0000 7fd1b9d9b700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1a4065ad0 0x7fd1a4067f90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4165800 tx=0x7fd1ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:21.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.171+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd1b404fef0 con 0x7fd1c406cad0 2023-12-19T17:57:21.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.387+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1c413b670 con 0x7fd1c406cad0 2023-12-19T17:57:21.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.387+0000 7fd1bb7fe700 1 -- 172.21.15.45:0/3487945307 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+91 (secure 0 0 0) 0x7fd1b4053510 con 0x7fd1c406cad0 2023-12-19T17:57:21.395 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_extra ] 2023-12-19T17:57:21.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1a4065ad0 msgr2=0x7fd1a4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1a4065ad0 0x7fd1a4067f90 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4165800 tx=0x7fd1ac009040 comp rx=0 tx=0).stop 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 msgr2=0x7fd1c40c8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 0x7fd1c40c8200 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400c4d0 tx=0x7fd1b400c7e0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 shutdown_connections 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1a4065ad0 0x7fd1a4067f90 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd1c415ae20 0x7fd1c40cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1c40afe30 0x7fd1c4156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 --2- 172.21.15.45:0/3487945307 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd1c406cad0 0x7fd1c40c8200 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 >> 172.21.15.45:0/3487945307 conn(0x7fd1c40cb900 msgr2=0x7fd1c415a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 shutdown_connections 2023-12-19T17:57:21.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:21.391+0000 7fd1c359e700 1 -- 172.21.15.45:0/3487945307 wait complete. 2023-12-19T17:57:21.420 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:57:21.421 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:57:21.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:21.422 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:57:21.442 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:57:21.443 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 42024sec preferred_lft 42024sec 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:57:21.445 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T17:57:21.446 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:57:21.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:21.447 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:57:21.532 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:57:21.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:21.535 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:57:21.603 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:57:21.603 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:57:21.603 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:57:21.603 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:57:21.603 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:57:21.603 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:57:21.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:21.604 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:57:21.604 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:57:21.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:57:21.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:57:21.604 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:57:21.605 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:57:21.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:21.747 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:57:21.765 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:57:21.765 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T17:57:21.766 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:57:21.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:21.767 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:57:21.850 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T17:57:21.850 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:57:21.850 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:21.910 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:57:21.911 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:57:21.911 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:21.972 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:57:22.056 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:57:22.056 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:57:22.140 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:57:22.144 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:57:22.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:22.145 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:57:22.211 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:57:22.211 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T17:57:22.261 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:57:22.291 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:57:22.291 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:57:22.372 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:57:22.375 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:57:22.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:22.377 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:57:22.401 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T17:57:22.395+0000 7f59b779a640 -1 init, newargv = 0x561c5fae6110 newargc=15 2023-12-19T17:57:22.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[51032]: starting ceph client 2023-12-19T17:57:22.413 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[51032]: starting fuse 2023-12-19T17:57:22.418 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:57:22.418 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T17:57:22.419 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:57:22.420 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:57:22.421 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:57:22.421 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:57:22.421 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:57:22.421 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:57:22.421 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T17:57:22.421 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:57:22.591 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.51032.asok 2023-12-19T17:57:22.773 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51032.asok 2023-12-19T17:57:22.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:22.774 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51032.asok status 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "51032", 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:57:22.983 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 6963, 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 6963 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:57:22.984 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1252212933 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:57:22.985 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1252212933 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.6963 192.168.0.1:0/1252212933", 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1252212933", 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 49, 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 72, 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:57:22.986 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:22.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:22.998 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:57:22.998 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:23.019 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:57:23.019 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:23.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:57:23.020 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:57:23.106 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2023-12-19T17:57:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.343+0000 7f0318e7e700 1 Processor -- start 2023-12-19T17:57:23.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.347+0000 7f0318e7e700 1 -- start start 2023-12-19T17:57:23.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.347+0000 7f0318e7e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f031415d150 0x7f03140d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.347+0000 7f0318e7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03140b8630 0x7f03140d2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.347+0000 7f0318e7e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03140705c0 con 0x7f0314070ab0 2023-12-19T17:57:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f031415d150 0x7f03140d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03140d12c0 con 0x7f031415d150 2023-12-19T17:57:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03140d15a0 con 0x7f03140b8630 2023-12-19T17:57:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f031415d150 0x7f03140d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46650/0 (socket says 172.21.15.45:46650) 2023-12-19T17:57:23.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 -- 172.21.15.45:0/2910623287 learned_addr learned my addr 172.21.15.45:0/2910623287 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0313fff700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03140b8630 0x7f03140d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 -- 172.21.15.45:0/2910623287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03140b8630 msgr2=0x7f03140d2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03140b8630 0x7f03140d2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 -- 172.21.15.45:0/2910623287 >> v1:172.21.15.73:6789/0 conn(0x7f0314070ab0 legacy=0x7f0314070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 -- 172.21.15.45:0/2910623287 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03140d1880 con 0x7f031415d150 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0313fff700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03140b8630 0x7f03140d2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:23.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0312ffd700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f031415d150 0x7f03140d0bc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0308009910 tx=0x7f0308009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8656db874936f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f03127fc700 1 -- 172.21.15.45:0/2910623287 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308004230 con 0x7f031415d150 2023-12-19T17:57:23.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f03127fc700 1 -- 172.21.15.45:0/2910623287 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0308004390 con 0x7f031415d150 2023-12-19T17:57:23.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f03127fc700 1 -- 172.21.15.45:0/2910623287 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308009e60 con 0x7f031415d150 2023-12-19T17:57:23.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- 172.21.15.45:0/2910623287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f031415d150 msgr2=0x7f03140d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f031415d150 0x7f03140d0bc0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f0308009910 tx=0x7f0308009c20 comp rx=0 tx=0).stop 2023-12-19T17:57:23.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- 172.21.15.45:0/2910623287 shutdown_connections 2023-12-19T17:57:23.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03140b8630 0x7f03140d2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 --2- 172.21.15.45:0/2910623287 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f031415d150 0x7f03140d0bc0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- 172.21.15.45:0/2910623287 >> 172.21.15.45:0/2910623287 conn(0x7f03140d2cc0 msgr2=0x7f03140d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- 172.21.15.45:0/2910623287 shutdown_connections 2023-12-19T17:57:23.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.351+0000 7f0318e7e700 1 -- 172.21.15.45:0/2910623287 wait complete. 2023-12-19T17:57:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.355+0000 7f0318e7e700 1 Processor -- start 2023-12-19T17:57:23.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.355+0000 7f0318e7e700 1 -- start start 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0318e7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0314070ab0 0x7f031414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0318e7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 0x7f03140b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0318e7e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031415d150 0x7f03140b7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0318e7e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03141603d0 con 0x7f03140b8630 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0318e7e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031415f330 con 0x7f031415d150 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0318e7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f031415f610 con 0x7f0314070ab0 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 0x7f03140b7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f03137fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0314070ab0 0x7f031414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 0x7f03140b7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46664/0 (socket says 172.21.15.45:46664) 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 -- 172.21.15.45:0/4259592138 learned_addr learned my addr 172.21.15.45:0/4259592138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0313fff700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031415d150 0x7f03140b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 -- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0314070ab0 msgr2=0x7f031414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0314070ab0 0x7f031414a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 -- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031415d150 msgr2=0x7f03140b7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031415d150 0x7f03140b7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 -- 172.21.15.45:0/4259592138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0308009570 con 0x7f03140b8630 2023-12-19T17:57:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f0312ffd700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 0x7f03140b7330 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0308004000 tx=0x7f0308004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f02fbfff700 1 -- 172.21.15.45:0/4259592138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308004500 con 0x7f03140b8630 2023-12-19T17:57:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f02fbfff700 1 -- 172.21.15.45:0/4259592138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030800bde0 con 0x7f03140b8630 2023-12-19T17:57:23.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.359+0000 7f02fbfff700 1 -- 172.21.15.45:0/4259592138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03080038e0 con 0x7f03140b8630 2023-12-19T17:57:23.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.363+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031415f8f0 con 0x7f03140b8630 2023-12-19T17:57:23.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.363+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f031415feb0 con 0x7f03140b8630 2023-12-19T17:57:23.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.367+0000 7f02fbfff700 1 -- 172.21.15.45:0/4259592138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0308003a40 con 0x7f03140b8630 2023-12-19T17:57:23.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.367+0000 7f02fbfff700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0300065ad0 0x7f0300067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.367+0000 7f02fbfff700 1 -- 172.21.15.45:0/4259592138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0308084750 con 0x7f03140b8630 2023-12-19T17:57:23.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.367+0000 7f03137fe700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0300065ad0 0x7f0300067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.367+0000 7f03137fe700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0300065ad0 0x7f0300067f90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0314157f80 tx=0x7f0304007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 Processor -- start 2023-12-19T17:57:23.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 -- start start 2023-12-19T17:57:23.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9c6a0 0x2b9ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2b9cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 0x2b9d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2afccf0 con 0x2b9d500 2023-12-19T17:57:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2afa480 con 0x2bb3e40 2023-12-19T17:57:23.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2af5d70 con 0x2b9c6a0 2023-12-19T17:57:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 0x2b9d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 0x2b9d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46668/0 (socket says 172.21.15.45:46668) 2023-12-19T17:57:23.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 -- 172.21.15.45:0/3305873553 learned_addr learned my addr 172.21.15.45:0/3305873553 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0312ffd700 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2b9cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f03137fe700 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9c6a0 0x2b9ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 -- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9c6a0 msgr2=0x2b9ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9c6a0 0x2b9ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 -- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 msgr2=0x2b9cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2b9cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 -- 172.21.15.45:0/3305873553 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29e8ee0 con 0x2b9d500 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0312ffd700 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2b9cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:23.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f0313fff700 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 0x2b9d8e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f030c00d530 tx=0x7f030c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0edc3d00ff170ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f02f97fa700 1 -- 172.21.15.45:0/3305873553 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c012070 con 0x2b9d500 2023-12-19T17:57:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f02f97fa700 1 -- 172.21.15.45:0/3305873553 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c00a650 con 0x2b9d500 2023-12-19T17:57:23.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.371+0000 7f02f97fa700 1 -- 172.21.15.45:0/3305873553 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030c00a9e0 con 0x2b9d500 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- 172.21.15.45:0/3305873553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 msgr2=0x2b9d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 0x2b9d8e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f030c00d530 tx=0x7f030c007f90 comp rx=0 tx=0).stop 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- 172.21.15.45:0/3305873553 shutdown_connections 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9d500 0x2b9d8e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2b9cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- 172.21.15.45:0/3305873553 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9c6a0 0x2b9ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- 172.21.15.45:0/3305873553 >> 172.21.15.45:0/3305873553 conn(0x291d780 msgr2=0x2bb6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- 172.21.15.45:0/3305873553 shutdown_connections 2023-12-19T17:57:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- 172.21.15.45:0/3305873553 wait complete. 2023-12-19T17:57:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- start start 2023-12-19T17:57:23.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 Processor -- start 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b8e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2b9bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bdbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab8e70 con 0x2b9c6a0 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2ab8b10 con 0x2b9d500 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a8b360 con 0x2bb3e40 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.375+0000 7f031d370740 10 client.0 _ll_register_callbacks cb 0x2aef6b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:23.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b8e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b8e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46674/0 (socket says 172.21.15.45:46674) 2023-12-19T17:57:23.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 -- 172.21.15.45:0/3949105854 learned_addr learned my addr 172.21.15.45:0/3949105854 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f0312ffd700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2b9bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f0313fff700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bdbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 -- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 msgr2=0x2bdbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bdbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 -- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 msgr2=0x2b9bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2b9bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 -- 172.21.15.45:0/3949105854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c007d70 con 0x2b9c6a0 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f03137fe700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b8e140 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f03040144f0 tx=0x7f03040037a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc5d163f154dbb43 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f02f27fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f02f27fc700 1 -- 172.21.15.45:0/3949105854 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304014c80 con 0x2b9c6a0 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f02f27fc700 1 -- 172.21.15.45:0/3949105854 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0304014de0 con 0x2b9c6a0 2023-12-19T17:57:23.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2abf810 con 0x2b9c6a0 2023-12-19T17:57:23.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f02f27fc700 1 -- 172.21.15.45:0/3949105854 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0304021420 con 0x2b9c6a0 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 10 client.6975 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x2abbb50 con 0x2b9c6a0 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f02f27fc700 1 -- 172.21.15.45:0/3949105854 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2abf810 con 0x2b9c6a0 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f02f27fc700 1 -- 172.21.15.45:0/3949105854 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f030402a400 con 0x2b9c6a0 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 10 client.6975 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 10 client.6975 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 20 client.6975 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2bcfdd0 0x2b8d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 4 client.6975 mds_command: new command op to 56057 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.379+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2ab2980 con 0x2bcfdd0 2023-12-19T17:57:23.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f0312ffd700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2bcfdd0 0x2b8d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f0312ffd700 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2bcfdd0 0x2b8d250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a21a3bd4c835bc64 server_cookie=c442edae7afc59bf in_seq=0 out_seq=0 2023-12-19T17:57:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f02f27fc700 10 client.6975 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f02f27fc700 1 -- 172.21.15.45:0/3949105854 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x2ab2980 con 0x2bcfdd0 2023-12-19T17:57:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f02f27fc700 10 client.6975 handle_command_reply: tid=0 2023-12-19T17:57:23.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 client.6975 shutdown 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 msgr2=0x2b8e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b8e140 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f03040144f0 tx=0x7f03040037a0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 shutdown_connections 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2bcfdd0 0x2b8d250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bdbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2b9bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 --2- 172.21.15.45:0/3949105854 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b8e140 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f02f27fc700 0 client.6975 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 >> 172.21.15.45:0/3949105854 conn(0x291d780 msgr2=0x2bd0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 shutdown_connections 2023-12-19T17:57:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 1 -- 172.21.15.45:0/3949105854 wait complete. 2023-12-19T17:57:23.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.383+0000 7f031d370740 20 client.6975 trim_cache size 0 max 16384 2023-12-19T17:57:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 Processor -- start 2023-12-19T17:57:23.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 -- start start 2023-12-19T17:57:23.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b9dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9d500 0x2b9e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2bdb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b8f380 con 0x2b9c6a0 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2b34c30 con 0x2bb3e40 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2af3580 con 0x2b9d500 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b9dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b9dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46680/0 (socket says 172.21.15.45:46680) 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 -- 172.21.15.45:0/3994066222 learned_addr learned my addr 172.21.15.45:0/3994066222 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f0312ffd700 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9d500 0x2b9e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f0313fff700 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2bdb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 -- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9d500 msgr2=0x2b9e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9d500 0x2b9e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 -- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 msgr2=0x2bdb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2bdb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 -- 172.21.15.45:0/3994066222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2aa1d80 con 0x2b9c6a0 2023-12-19T17:57:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.407+0000 7f03137fe700 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b9dff0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0304003790 tx=0x7f0304020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8252eb421b3dfe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f02f9ffb700 1 -- 172.21.15.45:0/3994066222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0304003ab0 con 0x2b9c6a0 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f02f9ffb700 1 -- 172.21.15.45:0/3994066222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030402a400 con 0x2b9c6a0 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f02f9ffb700 1 -- 172.21.15.45:0/3994066222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030402a570 con 0x2b9c6a0 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- 172.21.15.45:0/3994066222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 msgr2=0x2b9dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b9dff0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f0304003790 tx=0x7f0304020000 comp rx=0 tx=0).stop 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- 172.21.15.45:0/3994066222 shutdown_connections 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2bb3e40 0x2bdb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2b9d500 0x2b9e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- 172.21.15.45:0/3994066222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2b9dff0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- 172.21.15.45:0/3994066222 >> 172.21.15.45:0/3994066222 conn(0x291d780 msgr2=0x2b9d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- 172.21.15.45:0/3994066222 shutdown_connections 2023-12-19T17:57:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- 172.21.15.45:0/3994066222 wait complete. 2023-12-19T17:57:23.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- start start 2023-12-19T17:57:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 Processor -- start 2023-12-19T17:57:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2bcebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2bcf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bea770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2af4c00 con 0x2b9c6a0 2023-12-19T17:57:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2afdf80 con 0x2b9d500 2023-12-19T17:57:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2ac6980 con 0x2bb3e40 2023-12-19T17:57:23.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.411+0000 7f031d370740 10 client.0 _ll_register_callbacks cb 0x2abcf00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:23.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2bcebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2bcebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46692/0 (socket says 172.21.15.45:46692) 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 -- 172.21.15.45:0/2643446223 learned_addr learned my addr 172.21.15.45:0/2643446223 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f0313fff700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f0312ffd700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2bcf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 -- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 msgr2=0x2bea770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bea770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 -- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 msgr2=0x2bcf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2bcf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 -- 172.21.15.45:0/2643446223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x2abbb50 con 0x2b9c6a0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f03137fe700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2bcebf0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f030402a840 tx=0x7f0304014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fede549f71b94fb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f02f27fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f02f27fc700 1 -- 172.21.15.45:0/2643446223 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030402acd0 con 0x2b9c6a0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f02f27fc700 1 -- 172.21.15.45:0/2643446223 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0304003ab0 con 0x2b9c6a0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f030c00a650 con 0x2b9c6a0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f02f27fc700 1 -- 172.21.15.45:0/2643446223 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0304021420 con 0x2b9c6a0 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 10 client.6981 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:23.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x2968c10 con 0x2b9c6a0 2023-12-19T17:57:23.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f02f27fc700 1 -- 172.21.15.45:0/2643446223 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030c00a650 con 0x2b9c6a0 2023-12-19T17:57:23.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f02f27fc700 1 -- 172.21.15.45:0/2643446223 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f030403b070 con 0x2b9c6a0 2023-12-19T17:57:23.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 10 client.6981 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:23.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 10 client.6981 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 20 client.6981 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2c3eab0 0x2beacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 4 client.6981 mds_command: new command op to 56057 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x2974710 con 0x2c3eab0 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.415+0000 7f0312ffd700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2c3eab0 0x2beacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0312ffd700 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2c3eab0 0x2beacb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fab1f9c80a475f19 server_cookie=e40c6a1ec5e8045f in_seq=0 out_seq=0 2023-12-19T17:57:23.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f02f27fc700 10 client.6981 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f02f27fc700 1 -- 172.21.15.45:0/2643446223 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x2974710 con 0x2c3eab0 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f02f27fc700 10 client.6981 handle_command_reply: tid=0 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 client.6981 shutdown 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 msgr2=0x2bcebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2bcebf0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f030402a840 tx=0x7f0304014000 comp rx=0 tx=0).stop 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 shutdown_connections 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2c3eab0 0x2beacb0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2bb3e40 0x2bea770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2b9d500 0x2bcf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 --2- 172.21.15.45:0/2643446223 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2b9c6a0 0x2bcebf0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 >> 172.21.15.45:0/2643446223 conn(0x291d780 msgr2=0x2b9e170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f02f27fc700 0 client.6981 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 shutdown_connections 2023-12-19T17:57:23.427 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f06fa5c0700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T17:57:23.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 1 -- 172.21.15.45:0/2643446223 wait complete. 2023-12-19T17:57:23.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f031d370740 20 client.6981 trim_cache size 0 max 16384 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "1dc768cc-a260-41ea-a391-f4768f89cf92", 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0300065ad0 msgr2=0x7f0300067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0318e7e700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0300065ad0 0x7f0300067f90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0314157f80 tx=0x7f0304007ee0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 msgr2=0x7f03140b7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0318e7e700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 0x7f03140b7330 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f0308004000 tx=0x7f0308004770 comp rx=0 tx=0).stop 2023-12-19T17:57:23.429 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55f68010a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 shutdown_connections 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.419+0000 7f0318e7e700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0300065ad0 0x7f0300067f90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f0318e7e700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f031415d150 0x7f03140b7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f0318e7e700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03140b8630 0x7f03140b7330 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f0318e7e700 1 --2- 172.21.15.45:0/4259592138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0314070ab0 0x7f031414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 >> 172.21.15.45:0/4259592138 conn(0x7f03140d2cc0 msgr2=0x7f031415c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 shutdown_connections 2023-12-19T17:57:23.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f0318e7e700 1 -- 172.21.15.45:0/4259592138 wait complete. 2023-12-19T17:57:23.430 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.423+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [2,head] /subdir/3 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680228100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f8:[<0x10000000000/3 v40>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f8:[<0x10000000000/3 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.432 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fd [2,head] /subdir/8 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680226580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fd:[<0x10000000000/8 v82>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fd:[<0x10000000000/8 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.432 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [2,head] /subdir/21 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680240000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020a:[<0x10000000000/21 v184>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020a:[<0x10000000000/21 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.433 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [2,head] /subdir/19 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680241080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000208:[<0x10000000000/19 v168>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000208:[<0x10000000000/19 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.433 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000204 [2,head] /subdir/15 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680242680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000204:[<0x10000000000/15 v136>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000204:[<0x10000000000/15 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.433 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fe [2,head] /subdir/9 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680226000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fe:[<0x10000000000/9 v88>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fe:[<0x10000000000/9 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.434 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000201 [2,head] /subdir/12 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680243700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000201:[<0x10000000000/12 v112>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000201:[<0x10000000000/12 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.434 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [2,head] /subdir/20 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680240580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000209:[<0x10000000000/20 v176>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000209:[<0x10000000000/20 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.434 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ff [2,head] /subdir/10 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680248580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001ff:[<0x10000000000/10 v96>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001ff:[<0x10000000000/10 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.434 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f7 [2,head] /subdir/2 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680228680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f7:[<0x10000000000/2 v34>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f7:[<0x10000000000/2 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.435 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f9 [2,head] /subdir/4 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680227b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f9:[<0x10000000000/4 v50>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f9:[<0x10000000000/4 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000200 [2,head] /subdir/11 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680248000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000200:[<0x10000000000/11 v104>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000200:[<0x10000000000/11 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f6 [2,head] /subdir/1 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680240b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f6:[<0x10000000000/1 v24>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f6:[<0x10000000000/1 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [2,head] /subdir/24 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680228c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020d:[<0x10000000000/24 v200>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020d:[<0x10000000000/24 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [2,head] /subdir/16 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680242100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000205:[<0x10000000000/16 v144>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000205:[<0x10000000000/16 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/0 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680248b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000001:[<0x10000000000/0 v16>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000001:[<0x10000000000/0 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [2,head] /subdir/22 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680229700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020b:[<0x10000000000/22 v192>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020b:[<0x10000000000/22 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.436 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000203 [2,head] /subdir/14 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680242c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000203:[<0x10000000000/14 v128>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000203:[<0x10000000000/14 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.437 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fa [2,head] /subdir/5 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680227600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fa:[<0x10000000000/5 v56>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fa:[<0x10000000000/5 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.437 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [2,head] /subdir/18 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680241600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000207:[<0x10000000000/18 v160>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000207:[<0x10000000000/18 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.437 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000202 [2,head] /subdir/13 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680243180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000202:[<0x10000000000/13 v120>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000202:[<0x10000000000/13 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.437 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [2,head] /subdir/23 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680229180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020c:[<0x10000000000/23 v198>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020c:[<0x10000000000/23 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.437 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fc [2,head] /subdir/7 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680226b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fc:[<0x10000000000/7 v72>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fc:[<0x10000000000/7 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.437 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v5 ap=5 snaprealm=0x55f68015cb40 DIRTYPARENT f(v1 1=0+1) n(v0 rc2023-12-19T17:57:23.101313+0000 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={6963=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55f680109600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-19T17:57:23.101313+0000 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:57:23.438 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [2,head] /subdir/17 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680241b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000206:[<0x10000000000/17 v154>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000206:[<0x10000000000/17 v1>,<0x1/subdir v7>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.438 INFO:tasks.ceph.mds.a.smithi045.stderr:2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fb [2,head] /subdir/6 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680227080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fb:[<0x10000000000/6 v64>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fb:[<0x10000000000/6 v1>,<0x1/subdir v7>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:57:23.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-12-19T17:57:23.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.635+0000 7f09971e1700 1 Processor -- start 2023-12-19T17:57:23.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.635+0000 7f09971e1700 1 -- start start 2023-12-19T17:57:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09971e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09971e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f09900cdfd0 0x7f09900b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09971e1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f099015d300 con 0x7f09900b8580 2023-12-19T17:57:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09971e1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900d1550 con 0x7f09900cdfd0 2023-12-19T17:57:23.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09971e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09900d1830 con 0x7f099015cf20 2023-12-19T17:57:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09959de700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f09900b8580 0x7f09900cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:58652/0 (socket says 172.21.15.45:58652) 2023-12-19T17:57:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09959de700 1 -- 172.21.15.45:0/1312399472 learned_addr learned my addr 172.21.15.45:0/1312399472 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:57:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09969e0700 1 --2- 172.21.15.45:0/1312399472 >> v2:172.21.15.45:3300/0 conn(0x7f09900cdfd0 0x7f09900b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09961df700 1 --2- 172.21.15.45:0/1312399472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09969e0700 1 -- 172.21.15.45:0/1312399472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 msgr2=0x7f09900d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09969e0700 1 --2- 172.21.15.45:0/1312399472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09969e0700 1 -- 172.21.15.45:0/1312399472 >> v1:172.21.15.45:6789/0 conn(0x7f09900b8580 legacy=0x7f09900cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09969e0700 1 -- 172.21.15.45:0/1312399472 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900d1b10 con 0x7f09900cdfd0 2023-12-19T17:57:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09969e0700 1 --2- 172.21.15.45:0/1312399472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f09900b5d20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0988009d90 tx=0x7f098800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40b3953099423a7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09951dd700 1 -- 172.21.15.45:0/1312399472 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098800e070 con 0x7f09900cdfd0 2023-12-19T17:57:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09951dd700 1 -- 172.21.15.45:0/1312399472 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098800bbd0 con 0x7f09900cdfd0 2023-12-19T17:57:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.639+0000 7f09951dd700 1 -- 172.21.15.45:0/1312399472 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988012430 con 0x7f09900cdfd0 2023-12-19T17:57:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 -- 172.21.15.45:0/1312399472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 msgr2=0x7f09900b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 --2- 172.21.15.45:0/1312399472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f09900b5d20 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f0988009d90 tx=0x7f098800b330 comp rx=0 tx=0).stop 2023-12-19T17:57:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 -- 172.21.15.45:0/1312399472 shutdown_connections 2023-12-19T17:57:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 --2- 172.21.15.45:0/1312399472 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f09900b5d20 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 --2- 172.21.15.45:0/1312399472 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 -- 172.21.15.45:0/1312399472 >> 172.21.15.45:0/1312399472 conn(0x7f09900b4670 msgr2=0x7f09900b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 -- 172.21.15.45:0/1312399472 shutdown_connections 2023-12-19T17:57:23.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.643+0000 7f09971e1700 1 -- 172.21.15.45:0/1312399472 wait complete. 2023-12-19T17:57:23.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 Processor -- start 2023-12-19T17:57:23.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 -- start start 2023-12-19T17:57:23.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900b8580 0x7f09900ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f099015ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900aad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900caf20 con 0x7f09900cdfd0 2023-12-19T17:57:23.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900cb200 con 0x7f09900b8580 2023-12-19T17:57:23.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09971e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09900cb4e0 con 0x7f099015cf20 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f099015ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f099015ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46710/0 (socket says 172.21.15.45:46710) 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 -- 172.21.15.45:0/1288306011 learned_addr learned my addr 172.21.15.45:0/1288306011 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09961df700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900b8580 0x7f09900ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09969e0700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900aad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 -- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 msgr2=0x7f09900aad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900aad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 -- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900b8580 msgr2=0x7f09900ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900b8580 0x7f09900ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 -- 172.21.15.45:0/1288306011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0988009a70 con 0x7f09900cdfd0 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09961df700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900b8580 0x7f09900ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09969e0700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.647+0000 7f09959de700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f099015ae00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f098000c480 tx=0x7f098000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.651+0000 7f0986ffd700 1 -- 172.21.15.45:0/1288306011 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980005d90 con 0x7f09900cdfd0 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.651+0000 7f0986ffd700 1 -- 172.21.15.45:0/1288306011 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09800070d0 con 0x7f09900cdfd0 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.651+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09900cb7c0 con 0x7f09900cdfd0 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.651+0000 7f0986ffd700 1 -- 172.21.15.45:0/1288306011 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0980007460 con 0x7f09900cdfd0 2023-12-19T17:57:23.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.651+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09900caba0 con 0x7f09900cdfd0 2023-12-19T17:57:23.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.651+0000 7f0986ffd700 1 -- 172.21.15.45:0/1288306011 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09800075c0 con 0x7f09900cdfd0 2023-12-19T17:57:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.655+0000 7f0986ffd700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0974065ad0 0x7f0974067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.655+0000 7f0986ffd700 1 -- 172.21.15.45:0/1288306011 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0980082ad0 con 0x7f09900cdfd0 2023-12-19T17:57:23.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.655+0000 7f09961df700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0974065ad0 0x7f0974067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.655+0000 7f09961df700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0974065ad0 0x7f0974067f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f098c007a70 tx=0x7f098c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 Processor -- start 2023-12-19T17:57:23.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 -- start start 2023-12-19T17:57:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12d15c0 0x12fb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fb290 0x12d19a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 0x12d25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f71f0 con 0x12fe560 2023-12-19T17:57:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x11f1890 con 0x12fb290 2023-12-19T17:57:23.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1244640 con 0x12d15c0 2023-12-19T17:57:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 0x12d25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 0x12d25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46722/0 (socket says 172.21.15.45:46722) 2023-12-19T17:57:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 -- 172.21.15.45:0/3489745494 learned_addr learned my addr 172.21.15.45:0/3489745494 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09961df700 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12d15c0 0x12fb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09959de700 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fb290 0x12d19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 -- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12d15c0 msgr2=0x12fb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12d15c0 0x12fb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 -- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fb290 msgr2=0x12d19a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.659+0000 7f09969e0700 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fb290 0x12d19a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f09969e0700 1 -- 172.21.15.45:0/3489745494 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12626e0 con 0x12fe560 2023-12-19T17:57:23.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f09969e0700 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 0x12d25d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0988013000 tx=0x7f0988010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cb350166dd1ff47 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f0973fff700 1 -- 172.21.15.45:0/3489745494 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988003ac0 con 0x12fe560 2023-12-19T17:57:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f0973fff700 1 -- 172.21.15.45:0/3489745494 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988003c20 con 0x12fe560 2023-12-19T17:57:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f0973fff700 1 -- 172.21.15.45:0/3489745494 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09880125e0 con 0x12fe560 2023-12-19T17:57:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 -- 172.21.15.45:0/3489745494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 msgr2=0x12d25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 0x12d25d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0988013000 tx=0x7f0988010000 comp rx=0 tx=0).stop 2023-12-19T17:57:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 -- 172.21.15.45:0/3489745494 shutdown_connections 2023-12-19T17:57:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fe560 0x12d25d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fb290 0x12d19a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3489745494 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12d15c0 0x12fb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 -- 172.21.15.45:0/3489745494 >> 172.21.15.45:0/3489745494 conn(0x10655b0 msgr2=0x12fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 -- 172.21.15.45:0/3489745494 shutdown_connections 2023-12-19T17:57:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.663+0000 7f099b6d8740 1 -- 172.21.15.45:0/3489745494 wait complete. 2023-12-19T17:57:23.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 -- start start 2023-12-19T17:57:23.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 Processor -- start 2023-12-19T17:57:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12d15c0 0x12e8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12fa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fad40 0x12e6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x123f960 con 0x12fad40 2023-12-19T17:57:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x123d6c0 con 0x12d15c0 2023-12-19T17:57:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x11fae30 con 0x12fe560 2023-12-19T17:57:23.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f099b6d8740 10 client.0 _ll_register_callbacks cb 0x128de80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f09969e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fad40 0x12e6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f09961df700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12d15c0 0x12e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f09961df700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12d15c0 0x12e8310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:54462/0 (socket says 172.21.15.45:54462) 2023-12-19T17:57:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f09969e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fad40 0x12e6f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46724/0 (socket says 172.21.15.45:46724) 2023-12-19T17:57:23.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f09961df700 1 -- 172.21.15.45:0/2326365040 learned_addr learned my addr 172.21.15.45:0/2326365040 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.667+0000 7f09959de700 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12fa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09959de700 1 -- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12d15c0 msgr2=0x12e8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09959de700 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12d15c0 0x12e8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09959de700 1 -- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fad40 msgr2=0x12e6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09959de700 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fad40 0x12e6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09959de700 1 -- 172.21.15.45:0/2326365040 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09900d1b10 con 0x12fe560 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09959de700 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12fa800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0980080be0 tx=0x7f09800542a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5dbc3dc46c3df18 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2023-12-19T17:57:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 1 -- 172.21.15.45:0/2326365040 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098006b370 con 0x12fe560 2023-12-19T17:57:23.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 1 -- 172.21.15.45:0/2326365040 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0980057b90 con 0x12fe560 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1236740 con 0x12fe560 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 1 -- 172.21.15.45:0/2326365040 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098005bd40 con 0x12fe560 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 10 client.56132 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x10b0a40 con 0x12fe560 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 1 -- 172.21.15.45:0/2326365040 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1236740 con 0x12fe560 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 1 -- 172.21.15.45:0/2326365040 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f098005b8b0 con 0x12fe560 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 10 client.56132 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 10 client.56132 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 20 client.56132 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:23.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x132e190 0x1330580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 4 client.56132 mds_command: new command op to 56057 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:57:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11fa150 con 0x132e190 2023-12-19T17:57:23.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09961df700 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x132e190 0x1330580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09961df700 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x132e190 0x1330580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c27fa08d88102966 server_cookie=b2db1060ccb723b1 in_seq=0 out_seq=0 2023-12-19T17:57:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.671+0000 7f09717fa700 10 client.56132 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f09717fa700 1 -- 172.21.15.45:0/2326365040 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x11fa150 con 0x132e190 2023-12-19T17:57:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f09717fa700 10 client.56132 handle_command_reply: tid=0 2023-12-19T17:57:23.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 client.56132 shutdown 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 msgr2=0x12fa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12fa800 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0980080be0 tx=0x7f09800542a0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 shutdown_connections 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x132e190 0x1330580 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12fad40 0x12e6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12fa800 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2326365040 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12d15c0 0x12e8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 >> 172.21.15.45:0/2326365040 conn(0x10655b0 msgr2=0x131c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f09717fa700 0 client.56132 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 shutdown_connections 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 1 -- 172.21.15.45:0/2326365040 wait complete. 2023-12-19T17:57:23.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.675+0000 7f099b6d8740 20 client.56132 trim_cache size 0 max 16384 2023-12-19T17:57:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.695+0000 7f099b6d8740 1 Processor -- start 2023-12-19T17:57:23.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.695+0000 7f099b6d8740 1 -- start start 2023-12-19T17:57:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x12d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fad40 0x12cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x10e9b80 con 0x12d15c0 2023-12-19T17:57:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1239030 con 0x12fad40 2023-12-19T17:57:23.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x12425e0 con 0x12fe560 2023-12-19T17:57:23.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x12d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x12d0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46734/0 (socket says 172.21.15.45:46734) 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 -- 172.21.15.45:0/2846801818 learned_addr learned my addr 172.21.15.45:0/2846801818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09969e0700 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09959de700 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fad40 0x12cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 -- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 msgr2=0x12d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 -- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fad40 msgr2=0x12cfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fad40 0x12cfb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 -- 172.21.15.45:0/2846801818 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12037e0 con 0x12d15c0 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09959de700 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fad40 0x12cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:23.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f09961df700 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x12d0f30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f098c00f4c0 tx=0x7f098c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567788fe29a9345c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f0984bff700 1 -- 172.21.15.45:0/2846801818 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c028070 con 0x12d15c0 2023-12-19T17:57:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f0984bff700 1 -- 172.21.15.45:0/2846801818 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098c029250 con 0x12d15c0 2023-12-19T17:57:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f0984bff700 1 -- 172.21.15.45:0/2846801818 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c029b80 con 0x12d15c0 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 -- 172.21.15.45:0/2846801818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 msgr2=0x12d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.699+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x12d0f30 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f098c00f4c0 tx=0x7f098c015000 comp rx=0 tx=0).stop 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 -- 172.21.15.45:0/2846801818 shutdown_connections 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fe560 0x12d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fad40 0x12cfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 --2- 172.21.15.45:0/2846801818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x12d0f30 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 -- 172.21.15.45:0/2846801818 >> 172.21.15.45:0/2846801818 conn(0x10655b0 msgr2=0x1325ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 -- 172.21.15.45:0/2846801818 shutdown_connections 2023-12-19T17:57:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 -- 172.21.15.45:0/2846801818 wait complete. 2023-12-19T17:57:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 -- start start 2023-12-19T17:57:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.703+0000 7f099b6d8740 1 Processor -- start 2023-12-19T17:57:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x131b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fad40 0x1319640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fe560 0x1319b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x12078e0 con 0x12d15c0 2023-12-19T17:57:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dbb70 con 0x12fe560 2023-12-19T17:57:23.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x131c160 con 0x12fad40 2023-12-19T17:57:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 10 client.0 _ll_register_callbacks cb 0x7f098800b3a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x131b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x131b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46750/0 (socket says 172.21.15.45:46750) 2023-12-19T17:57:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 -- 172.21.15.45:0/3443785961 learned_addr learned my addr 172.21.15.45:0/3443785961 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09969e0700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fe560 0x1319b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09959de700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fad40 0x1319640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 -- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fad40 msgr2=0x1319640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fad40 0x1319640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 -- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fe560 msgr2=0x1319b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fe560 0x1319b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 -- 172.21.15.45:0/3443785961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098c00e040 con 0x12d15c0 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09961df700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x131b8b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f098c010010 tx=0x7f098c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeff3cbc31de8309 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09717fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09717fa700 1 -- 172.21.15.45:0/3443785961 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098c036070 con 0x12d15c0 2023-12-19T17:57:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09717fa700 1 -- 172.21.15.45:0/3443785961 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f098c029b90 con 0x12d15c0 2023-12-19T17:57:23.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0988003c20 con 0x12d15c0 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09717fa700 1 -- 172.21.15.45:0/3443785961 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f098c029d50 con 0x12d15c0 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 10 client.7002 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x11e9a10 con 0x12d15c0 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09717fa700 1 -- 172.21.15.45:0/3443785961 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0988003c20 con 0x12d15c0 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f09717fa700 1 -- 172.21.15.45:0/3443785961 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f098c039020 con 0x12d15c0 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 10 client.7002 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 10 client.7002 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 20 client.7002 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.707+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x1317c20 0x1318000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 4 client.7002 mds_command: new command op to 56057 tid=0[{"prefix": "scrub status"}] 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x10bc540 con 0x1317c20 2023-12-19T17:57:23.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f09959de700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x1317c20 0x1318000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f09717fa700 10 client.7002 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f09959de700 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x1317c20 0x1318000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=289b95da5aa88bf7 server_cookie=aa0cb49ba81a8311 in_seq=0 out_seq=0 2023-12-19T17:57:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f09717fa700 1 -- 172.21.15.45:0/3443785961 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x10bc540 con 0x1317c20 2023-12-19T17:57:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f09717fa700 10 client.7002 handle_command_reply: tid=0 2023-12-19T17:57:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 client.7002 shutdown 2023-12-19T17:57:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 msgr2=0x131b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x131b8b0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f098c010010 tx=0x7f098c012000 comp rx=0 tx=0).stop 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 shutdown_connections 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x1317c20 0x1318000 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x12fe560 0x1319b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12fad40 0x1319640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 --2- 172.21.15.45:0/3443785961 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12d15c0 0x131b8b0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f09717fa700 0 client.7002 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 >> 172.21.15.45:0/3443785961 conn(0x10655b0 msgr2=0x12e7940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 shutdown_connections 2023-12-19T17:57:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 1 -- 172.21.15.45:0/3443785961 wait complete. 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.711+0000 7f099b6d8740 20 client.7002 trim_cache size 0 max 16384 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: "1dc768cc-a260-41ea-a391-f4768f89cf92": { 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "1dc768cc-a260-41ea-a391-f4768f89cf92", 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,repair" 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:57:23.720 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:57:23.721 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:23.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0974065ad0 msgr2=0x7f0974067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0974065ad0 0x7f0974067f90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f098c007a70 tx=0x7f098c008040 comp rx=0 tx=0).stop 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 msgr2=0x7f099015ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f099015ae00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f098000c480 tx=0x7f098000c840 comp rx=0 tx=0).stop 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 shutdown_connections 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0974065ad0 0x7f0974067f90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f099015cf20 0x7f09900aad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f09900cdfd0 0x7f099015ae00 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 --2- 172.21.15.45:0/1288306011 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09900b8580 0x7f09900ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 >> 172.21.15.45:0/1288306011 conn(0x7f09900b4670 msgr2=0x7f09900b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 shutdown_connections 2023-12-19T17:57:23.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:23.715+0000 7f09971e1700 1 -- 172.21.15.45:0/1288306011 wait complete. 2023-12-19T17:57:23.744 INFO:tasks.cephfs.filesystem:scrub status for tag:1dc768cc-a260-41ea-a391-f4768f89cf92 - {'path': '/', 'tag': '1dc768cc-a260-41ea-a391-f4768f89cf92', 'options': 'recursive,repair'} 2023-12-19T17:57:30.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:57:30.882 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:57:53.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.3:0 scrub status 2023-12-19T17:57:53.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 Processor -- start 2023-12-19T17:57:53.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 -- start start 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc40071ae0 0x7fbc400cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fbc400cb840 0x7fbc400b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400b1b80 con 0x7fbc401443e0 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc401447c0 con 0x7fbc40071ae0 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400b1830 con 0x7fbc400cb840 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc35d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc40071ae0 0x7fbc400cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc35d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbc40071ae0 0x7fbc400cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59680/0 (socket says 172.21.15.45:59680) 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc35d9b700 1 -- 172.21.15.45:0/4135341749 learned_addr learned my addr 172.21.15.45:0/4135341749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:53.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/4135341749 >> v2:172.21.15.73:3300/0 conn(0x7fbc400cb840 0x7fbc400b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc35d9b700 1 -- 172.21.15.45:0/4135341749 >> v2:172.21.15.73:3300/0 conn(0x7fbc400cb840 msgr2=0x7fbc400b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.931+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/4135341749 >> v2:172.21.15.73:3300/0 conn(0x7fbc400cb840 0x7fbc400b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc35d9b700 1 -- 172.21.15.45:0/4135341749 >> v1:172.21.15.73:6789/0 conn(0x7fbc401443e0 legacy=0x7fbc400713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc35d9b700 1 -- 172.21.15.45:0/4135341749 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400cc070 con 0x7fbc40071ae0 2023-12-19T17:57:53.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/4135341749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40071ae0 0x7fbc400cb300 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbc40070540 tx=0x7fbc28009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58386d14e022a829 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:53.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3dd9b700 1 -- 172.21.15.45:0/4135341749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011830 con 0x7fbc40071ae0 2023-12-19T17:57:53.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3dd9b700 1 -- 172.21.15.45:0/4135341749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28011990 con 0x7fbc40071ae0 2023-12-19T17:57:53.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3dd9b700 1 -- 172.21.15.45:0/4135341749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011d20 con 0x7fbc40071ae0 2023-12-19T17:57:53.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 -- 172.21.15.45:0/4135341749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40071ae0 msgr2=0x7fbc400cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/4135341749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40071ae0 0x7fbc400cb300 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fbc40070540 tx=0x7fbc28009bf0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 -- 172.21.15.45:0/4135341749 shutdown_connections 2023-12-19T17:57:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/4135341749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40071ae0 0x7fbc400cb300 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/4135341749 >> v2:172.21.15.73:3300/0 conn(0x7fbc400cb840 0x7fbc400b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 -- 172.21.15.45:0/4135341749 >> 172.21.15.45:0/4135341749 conn(0x7fbc400cf5a0 msgr2=0x7fbc40070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 -- 172.21.15.45:0/4135341749 shutdown_connections 2023-12-19T17:57:53.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.935+0000 7fbc3f59e700 1 -- 172.21.15.45:0/4135341749 wait complete. 2023-12-19T17:57:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 Processor -- start 2023-12-19T17:57:53.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 -- start start 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc400cb840 0x7fbc4015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc401443e0 0x7fbc400ace90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40142720 0x7fbc400aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400a84f0 con 0x7fbc40142720 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc40132af0 con 0x7fbc401443e0 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400a8740 con 0x7fbc400cb840 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3e59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc400cb840 0x7fbc4015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40142720 0x7fbc400aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.939+0000 7fbc3e59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc400cb840 0x7fbc4015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:42782/0 (socket says 172.21.15.45:42782) 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3e59c700 1 -- 172.21.15.45:0/3328668534 learned_addr learned my addr 172.21.15.45:0/3328668534 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:53.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc401443e0 0x7fbc400ace90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc400cb840 msgr2=0x7fbc4015a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc400cb840 0x7fbc4015a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc401443e0 msgr2=0x7fbc400ace90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc401443e0 0x7fbc400ace90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/3328668534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc28009570 con 0x7fbc40142720 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40142720 0x7fbc400aae20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800efc0 tx=0x7fbc3800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc377fe700 1 -- 172.21.15.45:0/3328668534 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800cc90 con 0x7fbc40142720 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc377fe700 1 -- 172.21.15.45:0/3328668534 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3800f040 con 0x7fbc40142720 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc400a8a20 con 0x7fbc40142720 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc377fe700 1 -- 172.21.15.45:0/3328668534 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380146c0 con 0x7fbc40142720 2023-12-19T17:57:53.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.943+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400a8fe0 con 0x7fbc40142720 2023-12-19T17:57:53.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.947+0000 7fbc377fe700 1 -- 172.21.15.45:0/3328668534 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbc38014820 con 0x7fbc40142720 2023-12-19T17:57:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.947+0000 7fbc377fe700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc20065ad0 0x7fbc20067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.947+0000 7fbc377fe700 1 -- 172.21.15.45:0/3328668534 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbc38006e40 con 0x7fbc40142720 2023-12-19T17:57:53.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.947+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc20065ad0 0x7fbc20067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.951+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc20065ad0 0x7fbc20067f90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbc30007fd0 tx=0x7fbc30009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:53.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.951+0000 7fbc47ae9740 1 Processor -- start 2023-12-19T17:57:53.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.951+0000 7fbc47ae9740 1 -- start start 2023-12-19T17:57:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x219d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21a0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x21737b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x20991f0 con 0x21733d0 2023-12-19T17:57:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2093890 con 0x2174f60 2023-12-19T17:57:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x20e6640 con 0x219d0d0 2023-12-19T17:57:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x21737b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x21737b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59690/0 (socket says 172.21.15.45:59690) 2023-12-19T17:57:53.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/2621492607 learned_addr learned my addr 172.21.15.45:0/2621492607 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 msgr2=0x219d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x219d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x219d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 msgr2=0x21a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 -- 172.21.15.45:0/2621492607 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21046e0 con 0x21733d0 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x219d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:57:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x21737b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbc380518c0 tx=0x7fbc38009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2206b91549ad51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc1ffff700 1 -- 172.21.15.45:0/2621492607 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380591f0 con 0x21733d0 2023-12-19T17:57:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc1ffff700 1 -- 172.21.15.45:0/2621492607 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3805d3a0 con 0x21733d0 2023-12-19T17:57:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc1ffff700 1 -- 172.21.15.45:0/2621492607 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3800ce10 con 0x21733d0 2023-12-19T17:57:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- 172.21.15.45:0/2621492607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 msgr2=0x21737b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x21737b0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbc380518c0 tx=0x7fbc38009f30 comp rx=0 tx=0).stop 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- 172.21.15.45:0/2621492607 shutdown_connections 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x21737b0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/2621492607 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x219d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- 172.21.15.45:0/2621492607 >> 172.21.15.45:0/2621492607 conn(0x1f075b0 msgr2=0x219fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- 172.21.15.45:0/2621492607 shutdown_connections 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.955+0000 7fbc47ae9740 1 -- 172.21.15.45:0/2621492607 wait complete. 2023-12-19T17:57:53.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 -- start start 2023-12-19T17:57:53.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 Processor -- start 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x218a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21bb330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x218ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e1960 con 0x21733d0 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x20df6c0 con 0x2174f60 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x209ce30 con 0x219d0d0 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc47ae9740 10 client.0 _ll_register_callbacks cb 0x212fe80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc3e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x218a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc3e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x218a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59694/0 (socket says 172.21.15.45:59694) 2023-12-19T17:57:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.959+0000 7fbc3e59c700 1 -- 172.21.15.45:0/3505711382 learned_addr learned my addr 172.21.15.45:0/3505711382 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x218ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21bb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3e59c700 1 -- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 msgr2=0x218ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x218ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3e59c700 1 -- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 msgr2=0x21bb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21bb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3e59c700 1 -- 172.21.15.45:0/3505711382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400a8fe0 con 0x21733d0 2023-12-19T17:57:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x218a6b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbc30014500 tx=0x7fbc300010d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3401f4040c415d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:53.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3505711382 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc30014d30 con 0x21733d0 2023-12-19T17:57:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3505711382 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbc30020420 con 0x21733d0 2023-12-19T17:57:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x20d8740 con 0x21733d0 2023-12-19T17:57:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3505711382 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc30014e90 con 0x21733d0 2023-12-19T17:57:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 10 client.7014 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:53.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x1f52a40 con 0x21733d0 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3505711382 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x20d8740 con 0x21733d0 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3505711382 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbc30020630 con 0x21733d0 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 10 client.7014 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 10 client.7014 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 20 client.7014 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2188c90 0x21890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 4 client.7014 mds_command: new command op to 56057 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x209c150 con 0x2188c90 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.963+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2188c90 0x21890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2188c90 0x21890a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ed5e1415c19094f server_cookie=1ca25076d618866c in_seq=0 out_seq=0 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc1d7fa700 10 client.7014 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3505711382 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x209c150 con 0x2188c90 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc1d7fa700 10 client.7014 handle_command_reply: tid=0 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 client.7014 shutdown 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 msgr2=0x218a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x218a6b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbc30014500 tx=0x7fbc300010d0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 shutdown_connections 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x2188c90 0x21890a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x218ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2174f60 0x21bb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3505711382 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21733d0 0x218a6b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc1d7fa700 0 client.7014 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 >> 172.21.15.45:0/3505711382 conn(0x1f075b0 msgr2=0x21747e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 shutdown_connections 2023-12-19T17:57:53.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3505711382 wait complete. 2023-12-19T17:57:53.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.967+0000 7fbc47ae9740 20 client.7014 trim_cache size 0 max 16384 2023-12-19T17:57:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 Processor -- start 2023-12-19T17:57:53.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 -- start start 2023-12-19T17:57:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21733d0 0x21d3f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21873f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x219d0d0 0x2187930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1f8bb80 con 0x2174f60 2023-12-19T17:57:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x20e8520 con 0x219d0d0 2023-12-19T17:57:53.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.987+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x20e2620 con 0x21733d0 2023-12-19T17:57:53.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21873f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21873f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59710/0 (socket says 172.21.15.45:59710) 2023-12-19T17:57:53.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 -- 172.21.15.45:0/521147187 learned_addr learned my addr 172.21.15.45:0/521147187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:53.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x219d0d0 0x2187930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21733d0 0x21d3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 -- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21733d0 msgr2=0x21d3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21733d0 0x21d3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 -- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x219d0d0 msgr2=0x2187930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x219d0d0 0x2187930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 -- 172.21.15.45:0/521147187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x20a57e0 con 0x2174f60 2023-12-19T17:57:53.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21873f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc28010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374455207150f8e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc34d99700 1 -- 172.21.15.45:0/521147187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28011b00 con 0x2174f60 2023-12-19T17:57:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc34d99700 1 -- 172.21.15.45:0/521147187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc28022040 con 0x2174f60 2023-12-19T17:57:53.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc34d99700 1 -- 172.21.15.45:0/521147187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28004040 con 0x2174f60 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 -- 172.21.15.45:0/521147187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 msgr2=0x21873f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21873f0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbc28000c00 tx=0x7fbc28010000 comp rx=0 tx=0).stop 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 -- 172.21.15.45:0/521147187 shutdown_connections 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x219d0d0 0x2187930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21873f0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/521147187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21733d0 0x21d3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 -- 172.21.15.45:0/521147187 >> 172.21.15.45:0/521147187 conn(0x1f075b0 msgr2=0x219fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 -- 172.21.15.45:0/521147187 shutdown_connections 2023-12-19T17:57:53.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 -- 172.21.15.45:0/521147187 wait complete. 2023-12-19T17:57:54.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.991+0000 7fbc47ae9740 1 -- start start 2023-12-19T17:57:54.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 Processor -- start 2023-12-19T17:57:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21733d0 0x221fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:54.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x21d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x21dbce0 con 0x2174f60 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x20dced0 con 0x21733d0 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x20a98e0 con 0x219d0d0 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 10 client.0 _ll_register_callbacks cb 0x209ffc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21d3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:59724/0 (socket says 172.21.15.45:59724) 2023-12-19T17:57:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 -- 172.21.15.45:0/3090823745 learned_addr learned my addr 172.21.15.45:0/3090823745 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21733d0 0x221fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x21d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 -- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 msgr2=0x21d35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x21d35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 -- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21733d0 msgr2=0x221fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21733d0 0x221fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 -- 172.21.15.45:0/3090823745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc400cc070 con 0x2174f60 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc3ed9d700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x21d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:57:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc35d9b700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21d3060 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbc28013000 tx=0x7fbc280047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d992fe3d1c9a65f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:57:54.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc1d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3090823745 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28004240 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc3805d3a0 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.995+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3090823745 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbc280043a0 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3090823745 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc280045a0 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 10 client.7020 fetch_fsmap learned FSMap version 49 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x208ba10 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3090823745 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3805d3a0 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3090823745 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 49) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbc28027790 con 0x2174f60 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 10 client.7020 fetch_fsmap finished waiting for FSMap version 49 2023-12-19T17:57:54.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 10 client.7020 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.a 2023-12-19T17:57:54.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 20 client.7020 populate_metadata read hostname 'smithi045' 2023-12-19T17:57:54.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x21d6af0 0x21d6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:57:54.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 4 client.7020 mds_command: new command op to 56057 tid=0[{"prefix": "scrub status"}] 2023-12-19T17:57:54.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 --> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1f5e540 con 0x21d6af0 2023-12-19T17:57:54.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x21d6af0 0x21d6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc3e59c700 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x21d6af0 0x21d6f00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a1febf902fc5614 server_cookie=4613231c0c80c892 in_seq=0 out_seq=0 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 10 client.7020 ms_handle_connect on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 1 -- 172.21.15.45:0/3090823745 <== mds.0 v2:172.21.15.45:6835/2159224632 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1f5e540 con 0x21d6af0 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 10 client.7020 handle_command_reply: tid=0 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 client.7020 shutdown 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 msgr2=0x21d3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21d3060 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fbc28013000 tx=0x7fbc280047e0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 shutdown_connections 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:6835/2159224632,v1:172.21.15.45:6837/2159224632] conn(0x21d6af0 0x21d6f00 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x219d0d0 0x21d35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2174f60 0x21d3060 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 --2- 172.21.15.45:0/3090823745 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21733d0 0x221fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc1d7fa700 0 client.7020 ms_handle_reset on v2:172.21.15.45:6835/2159224632 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 >> 172.21.15.45:0/3090823745 conn(0x1f075b0 msgr2=0x2178010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 shutdown_connections 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 1 -- 172.21.15.45:0/3090823745 wait complete. 2023-12-19T17:57:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:53.999+0000 7fbc47ae9740 20 client.7020 trim_cache size 0 max 16384 2023-12-19T17:57:54.009 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:57:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2023-12-19T17:57:54.009 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2023-12-19T17:57:54.009 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc20065ad0 msgr2=0x7fbc20067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc20065ad0 0x7fbc20067f90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fbc30007fd0 tx=0x7fbc30009040 comp rx=0 tx=0).stop 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40142720 msgr2=0x7fbc400aae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40142720 0x7fbc400aae20 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbc3800efc0 tx=0x7fbc3800c3a0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 shutdown_connections 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbc20065ad0 0x7fbc20067f90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbc40142720 0x7fbc400aae20 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc401443e0 0x7fbc400ace90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 --2- 172.21.15.45:0/3328668534 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbc400cb840 0x7fbc4015a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 >> 172.21.15.45:0/3328668534 conn(0x7fbc40071ae0 msgr2=0x7fbc4015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 shutdown_connections 2023-12-19T17:57:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:57:54.003+0000 7fbc3f59e700 1 -- 172.21.15.45:0/3328668534 wait complete. 2023-12-19T17:57:54.030 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-19T17:57:54.030 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/0 2023-12-19T17:57:54.030 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:57:54.030 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/0" 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:57:54.031 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:57:57.939 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/1 2023-12-19T17:57:57.939 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:57:57.939 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:57:57.939 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/1" 2023-12-19T17:57:57.939 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:57:57.939 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:57:57.940 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:00.976 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:58:00.985 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:58:01.293 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/2 2023-12-19T17:58:01.293 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:01.293 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:01.293 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/2" 2023-12-19T17:58:01.293 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:01.293 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:01.294 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:04.601 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/3 2023-12-19T17:58:04.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:04.601 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:04.601 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/3" 2023-12-19T17:58:04.601 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:04.602 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:08.148 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/4 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/4" 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:08.149 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:08.150 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:08.150 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:11.495 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/5 2023-12-19T17:58:11.495 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:11.495 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:11.495 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/5" 2023-12-19T17:58:11.495 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:11.495 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:11.496 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:14.842 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/6 2023-12-19T17:58:14.842 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:14.842 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:14.842 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/6" 2023-12-19T17:58:14.842 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:14.843 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:18.179 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/7 2023-12-19T17:58:18.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:18.179 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:18.179 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/7" 2023-12-19T17:58:18.179 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:18.180 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:21.720 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/8 2023-12-19T17:58:21.720 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:21.720 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:21.720 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/8" 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:21.721 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:25.073 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/9 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/9" 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:25.074 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:28.430 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/10 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/10" 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:28.431 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:28.432 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:28.432 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:28.432 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:28.432 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:31.060 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:58:31.068 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:58:31.981 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/11 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/11" 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:31.981 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:31.982 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:35.303 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/12 2023-12-19T17:58:35.304 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:35.304 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:35.304 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/12" 2023-12-19T17:58:35.304 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:35.304 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:35.305 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:38.649 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/13 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/13" 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:38.650 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:38.651 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:38.651 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:41.995 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/14 2023-12-19T17:58:41.995 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:41.995 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:41.995 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/14" 2023-12-19T17:58:41.995 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:41.995 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:41.996 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:45.342 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/15 2023-12-19T17:58:45.342 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:45.342 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:45.342 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/15" 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:45.343 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:45.344 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:45.344 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:45.344 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:45.344 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:48.690 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/16 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/16" 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:48.691 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:48.692 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:48.692 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:48.692 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:48.692 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:48.692 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:48.692 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:52.038 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/17 2023-12-19T17:58:52.038 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/17" 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:52.039 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:55.389 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/18 2023-12-19T17:58:55.389 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/18" 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:55.390 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:55.391 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:55.391 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:55.391 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:55.391 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:58:58.741 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/19 2023-12-19T17:58:58.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:58:58.741 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/19" 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:58:58.742 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:01.157 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:59:01.163 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:59:02.088 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/20 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/20" 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:59:02.089 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:59:02.090 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:59:02.090 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:59:02.090 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:59:02.090 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:05.593 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/21 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/21" 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:59:05.593 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:59:05.594 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:08.949 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/22 2023-12-19T17:59:08.949 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:08.949 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:59:08.949 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/22" 2023-12-19T17:59:08.949 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:59:08.949 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:59:08.950 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:12.306 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/23 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/23" 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:59:12.306 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:59:12.307 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:59:12.307 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:59:12.307 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:59:12.307 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:15.658 INFO:tasks.cephfs.mount:Validating 6291456 bytes from subdir/24 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/subdir/24" 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 6291456: 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 6291456 2023-12-19T17:59:15.658 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T17:59:15.659 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T17:59:15.659 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T17:59:15.659 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T17:59:15.659 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T17:59:15.659 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:19.007 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T17:59:19.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:59:19.095 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:59:19.142 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T17:59:19.143 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:19.143 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:19.165 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:19.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.385+0000 7f2b5adce700 1 Processor -- start 2023-12-19T17:59:19.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.385+0000 7f2b5adce700 1 -- start start 2023-12-19T17:59:19.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.385+0000 7f2b5adce700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b5415cf50 0x7f2b540cd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.385+0000 7f2b5adce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540701d0 0x7f2b540cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.385+0000 7f2b5adce700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5406f4a0 con 0x7f2b540b85d0 2023-12-19T17:59:19.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5415d330 con 0x7f2b5415cf50 2023-12-19T17:59:19.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540b8a90 con 0x7f2b540701d0 2023-12-19T17:59:19.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b5415cf50 0x7f2b540cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2b5415cf50 0x7f2b540cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37344/0 (socket says 172.21.15.45:37344) 2023-12-19T17:59:19.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 -- 172.21.15.45:0/2726305084 learned_addr learned my addr 172.21.15.45:0/2726305084 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:19.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5a5cd700 1 --2- 172.21.15.45:0/2726305084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540701d0 0x7f2b540cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 -- 172.21.15.45:0/2726305084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540701d0 msgr2=0x7f2b540cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:19.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 --2- 172.21.15.45:0/2726305084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540701d0 0x7f2b540cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 -- 172.21.15.45:0/2726305084 >> v1:172.21.15.73:6789/0 conn(0x7f2b540b85d0 legacy=0x7f2b54160a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:19.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 -- 172.21.15.45:0/2726305084 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5406f6f0 con 0x7f2b5415cf50 2023-12-19T17:59:19.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b59dcc700 1 --2- 172.21.15.45:0/2726305084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b540cd980 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009910 tx=0x7f2b50009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a84be6697f3ce0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:19.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b58dca700 1 -- 172.21.15.45:0/2726305084 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50004230 con 0x7f2b5415cf50 2023-12-19T17:59:19.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b58dca700 1 -- 172.21.15.45:0/2726305084 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50004390 con 0x7f2b5415cf50 2023-12-19T17:59:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b58dca700 1 -- 172.21.15.45:0/2726305084 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50009e60 con 0x7f2b5415cf50 2023-12-19T17:59:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- 172.21.15.45:0/2726305084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 msgr2=0x7f2b540cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 --2- 172.21.15.45:0/2726305084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b540cd980 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009910 tx=0x7f2b50009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- 172.21.15.45:0/2726305084 shutdown_connections 2023-12-19T17:59:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 --2- 172.21.15.45:0/2726305084 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540701d0 0x7f2b540cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 --2- 172.21.15.45:0/2726305084 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b540cd980 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- 172.21.15.45:0/2726305084 >> 172.21.15.45:0/2726305084 conn(0x7f2b540b4730 msgr2=0x7f2b540b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:19.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- 172.21.15.45:0/2726305084 shutdown_connections 2023-12-19T17:59:19.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.389+0000 7f2b5adce700 1 -- 172.21.15.45:0/2726305084 wait complete. 2023-12-19T17:59:19.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 Processor -- start 2023-12-19T17:59:19.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 -- start start 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b540701d0 0x7f2b54154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540b85d0 0x7f2b540c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b54153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540ca560 con 0x7f2b5415cf50 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540ca840 con 0x7f2b540701d0 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5adce700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b540cab20 con 0x7f2b540b85d0 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5a5cd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b54153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b59dcc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b540701d0 0x7f2b54154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5a5cd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b54153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37354/0 (socket says 172.21.15.45:37354) 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b5a5cd700 1 -- 172.21.15.45:0/184938257 learned_addr learned my addr 172.21.15.45:0/184938257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:19.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.393+0000 7f2b595cb700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540b85d0 0x7f2b540c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b59dcc700 1 -- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540b85d0 msgr2=0x7f2b540c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b59dcc700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540b85d0 0x7f2b540c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b59dcc700 1 -- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 msgr2=0x7f2b54153c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b59dcc700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b54153c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b59dcc700 1 -- 172.21.15.45:0/184938257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009570 con 0x7f2b540701d0 2023-12-19T17:59:19.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b59dcc700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b540701d0 0x7f2b54154650 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2b50015000 tx=0x7f2b50004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b5000be60 con 0x7f2b540701d0 2023-12-19T17:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500036c0 con 0x7f2b540701d0 2023-12-19T17:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b540cae00 con 0x7f2b540701d0 2023-12-19T17:59:19.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50003a70 con 0x7f2b540701d0 2023-12-19T17:59:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b540ca250 con 0x7f2b540701d0 2023-12-19T17:59:19.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.397+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b540cef70 con 0x7f2b540701d0 2023-12-19T17:59:19.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.401+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2b50003bd0 con 0x7f2b540701d0 2023-12-19T17:59:19.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.401+0000 7f2b4a7fc700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2b38065ad0 0x7f2b38067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.401+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f2b50084600 con 0x7f2b540701d0 2023-12-19T17:59:19.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.401+0000 7f2b595cb700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2b38065ad0 0x7f2b38067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.405+0000 7f2b595cb700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2b38065ad0 0x7f2b38067f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b540ce650 tx=0x7f2b44007ee0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:19.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.409+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2b50051bd0 con 0x7f2b540701d0 2023-12-19T17:59:19.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.589+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b540cb320 con 0x7f2b540701d0 2023-12-19T17:59:19.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.593+0000 7f2b4a7fc700 1 -- 172.21.15.45:0/184938257 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f2b540cb320 con 0x7f2b540701d0 2023-12-19T17:59:19.598 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:19.599 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:57:15.816595+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6836/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6837/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6837/4130274339":"2023-12-20T17:57:08.416683+0000","172.21.15.45:6836/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6836/4130274339":"2023-12-20T17:57:08.416683+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2b38065ad0 msgr2=0x7f2b38067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2b38065ad0 0x7f2b38067f90 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2b540ce650 tx=0x7f2b44007ee0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b540701d0 msgr2=0x7f2b54154650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b540701d0 0x7f2b54154650 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2b50015000 tx=0x7f2b50004770 comp rx=0 tx=0).stop 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 shutdown_connections 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2b38065ad0 0x7f2b38067f90 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2b5415cf50 0x7f2b54153c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2b540b85d0 0x7f2b540c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 --2- 172.21.15.45:0/184938257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2b540701d0 0x7f2b54154650 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 >> 172.21.15.45:0/184938257 conn(0x7f2b540b4730 msgr2=0x7f2b540d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:19.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 shutdown_connections 2023-12-19T17:59:19.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.597+0000 7f2b5adce700 1 -- 172.21.15.45:0/184938257 wait complete. 2023-12-19T17:59:19.627 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:55:16.332981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:55:17.225656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:55:27.316408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:59:19.628 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:59:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.809+0000 7f5fcf59e700 1 Processor -- start 2023-12-19T17:59:19.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.809+0000 7f5fcf59e700 1 -- start start 2023-12-19T17:59:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fcf59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5fd00713d0 0x7f5fd0071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fcf59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00b2a40 con 0x7f5fd00ccd70 2023-12-19T17:59:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fcf59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd00b2c90 con 0x7f5fd0159a40 2023-12-19T17:59:19.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fcf59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd00ccb50 con 0x7f5fd00713d0 2023-12-19T17:59:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fcdd9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5fd00713d0 0x7f5fd0071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fced9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5fd00ccd70 0x7f5fd00cd200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33218/0 (socket says 172.21.15.45:33218) 2023-12-19T17:59:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.813+0000 7f5fced9d700 1 -- 172.21.15.45:0/3948664081 learned_addr learned my addr 172.21.15.45:0/3948664081 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:19.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/3948664081 >> v1:172.21.15.73:6789/0 conn(0x7f5fd0159a40 legacy=0x7f5fd00ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/3948664081 >> v1:172.21.15.45:6789/0 conn(0x7f5fd00ccd70 legacy=0x7f5fd00cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/3948664081 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd00b2f70 con 0x7f5fd00713d0 2023-12-19T17:59:19.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcdd9b700 1 --2- 172.21.15.45:0/3948664081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00713d0 0x7f5fd0071860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009850 tx=0x7f5fc4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a06204af84bddaef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcd59a700 1 -- 172.21.15.45:0/3948664081 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400f8a0 con 0x7f5fd00713d0 2023-12-19T17:59:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcd59a700 1 -- 172.21.15.45:0/3948664081 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc400fa00 con 0x7f5fd00713d0 2023-12-19T17:59:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcd59a700 1 -- 172.21.15.45:0/3948664081 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc400fd90 con 0x7f5fd00713d0 2023-12-19T17:59:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 -- 172.21.15.45:0/3948664081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00713d0 msgr2=0x7f5fd0071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/3948664081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00713d0 0x7f5fd0071860 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009850 tx=0x7f5fc4009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 -- 172.21.15.45:0/3948664081 shutdown_connections 2023-12-19T17:59:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/3948664081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00713d0 0x7f5fd0071860 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 -- 172.21.15.45:0/3948664081 >> 172.21.15.45:0/3948664081 conn(0x7f5fd00cf5a0 msgr2=0x7f5fd0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 -- 172.21.15.45:0/3948664081 shutdown_connections 2023-12-19T17:59:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.817+0000 7f5fcf59e700 1 -- 172.21.15.45:0/3948664081 wait complete. 2023-12-19T17:59:19.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 Processor -- start 2023-12-19T17:59:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 -- start start 2023-12-19T17:59:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00ccd70 0x7f5fd0154ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 0x7f5fd00ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fd0157780 0x7f5fd0152590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd0157360 con 0x7f5fd0159a40 2023-12-19T17:59:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01566e0 con 0x7f5fd00ccd70 2023-12-19T17:59:19.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcf59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd01569c0 con 0x7f5fd0157780 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 0x7f5fd00ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 0x7f5fd00ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37358/0 (socket says 172.21.15.45:37358) 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/303951610 learned_addr learned my addr 172.21.15.45:0/303951610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fd0157780 msgr2=0x7f5fd0152590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fced9d700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fd0157780 0x7f5fd0152590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fce59c700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00ccd70 0x7f5fd0154ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fd0157780 0x7f5fd0152590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00ccd70 msgr2=0x7f5fd0154ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00ccd70 0x7f5fd0154ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:19.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 -- 172.21.15.45:0/303951610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40094b0 con 0x7f5fd0159a40 2023-12-19T17:59:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fce59c700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00ccd70 0x7f5fd0154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:59:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.821+0000 7f5fcdd9b700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 0x7f5fd00ad230 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00720e0 tx=0x7f5fc4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4003ad0 con 0x7f5fd0159a40 2023-12-19T17:59:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc4003c30 con 0x7f5fd0159a40 2023-12-19T17:59:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd0156ca0 con 0x7f5fd0159a40 2023-12-19T17:59:19.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40045d0 con 0x7f5fd0159a40 2023-12-19T17:59:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd0155000 con 0x7f5fd0159a40 2023-12-19T17:59:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd01574a0 con 0x7f5fd0159a40 2023-12-19T17:59:19.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.825+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5fc4019400 con 0x7f5fd0159a40 2023-12-19T17:59:19.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.829+0000 7f5fbeffd700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5fb0065ad0 0x7f5fb0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.829+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f5fc4084a30 con 0x7f5fd0159a40 2023-12-19T17:59:19.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.829+0000 7f5fce59c700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5fb0065ad0 0x7f5fb0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.829+0000 7f5fce59c700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5fb0065ad0 0x7f5fb0067f90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0000fb0 tx=0x7f5fc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:19.833+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5fd01574a0 con 0x7f5fd0159a40 2023-12-19T17:59:20.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.009+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fd01574a0 con 0x7f5fd0159a40 2023-12-19T17:59:20.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fbeffd700 1 -- 172.21.15.45:0/303951610 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fd01574a0 con 0x7f5fd0159a40 2023-12-19T17:59:20.017 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5fb0065ad0 msgr2=0x7f5fb0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5fb0065ad0 0x7f5fb0067f90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0000fb0 tx=0x7f5fc0009040 comp rx=0 tx=0).stop 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 msgr2=0x7f5fd00ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 0x7f5fd00ad230 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00720e0 tx=0x7f5fc4004770 comp rx=0 tx=0).stop 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 shutdown_connections 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5fb0065ad0 0x7f5fb0067f90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5fd0157780 0x7f5fd0152590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5fd0159a40 0x7f5fd00ad230 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 --2- 172.21.15.45:0/303951610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5fd00ccd70 0x7f5fd0154ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 >> 172.21.15.45:0/303951610 conn(0x7f5fd00713d0 msgr2=0x7f5fd0070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 shutdown_connections 2023-12-19T17:59:20.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.013+0000 7f5fcf59e700 1 -- 172.21.15.45:0/303951610 wait complete. 2023-12-19T17:59:20.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:59:20.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 Processor -- start 2023-12-19T17:59:20.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 -- start start 2023-12-19T17:59:20.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77b40cc690 0x7f77b415b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77b40cb8d0 0x7f77b406d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b406ea90 con 0x7f77b40ce350 2023-12-19T17:59:20.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b415c340 con 0x7f77b40cc690 2023-12-19T17:59:20.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.221+0000 7f77b8e19700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b415baa0 con 0x7f77b40cb8d0 2023-12-19T17:59:20.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77b40cc690 0x7f77b415b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b2d9d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f77b40cb8d0 0x7f77b406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f77b40cc690 0x7f77b415b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37372/0 (socket says 172.21.15.45:37372) 2023-12-19T17:59:20.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 -- 172.21.15.45:0/4266532196 learned_addr learned my addr 172.21.15.45:0/4266532196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:20.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 -- 172.21.15.45:0/4266532196 >> v2:172.21.15.73:3300/0 conn(0x7f77b40cb8d0 msgr2=0x7f77b406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:20.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 --2- 172.21.15.45:0/4266532196 >> v2:172.21.15.73:3300/0 conn(0x7f77b40cb8d0 0x7f77b406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 -- 172.21.15.45:0/4266532196 >> v1:172.21.15.73:6789/0 conn(0x7f77b40ce350 legacy=0x7f77b40cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 -- 172.21.15.45:0/4266532196 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b415bd80 con 0x7f77b40cc690 2023-12-19T17:59:20.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b259c700 1 --2- 172.21.15.45:0/4266532196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40cc690 0x7f77b415b410 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f77b40b3f00 tx=0x7f77a4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07449a4234f8b4e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:20.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b159a700 1 -- 172.21.15.45:0/4266532196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011830 con 0x7f77b40cc690 2023-12-19T17:59:20.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b159a700 1 -- 172.21.15.45:0/4266532196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a4011990 con 0x7f77b40cc690 2023-12-19T17:59:20.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b159a700 1 -- 172.21.15.45:0/4266532196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a4011d20 con 0x7f77b40cc690 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b8e19700 1 -- 172.21.15.45:0/4266532196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40cc690 msgr2=0x7f77b415b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b8e19700 1 --2- 172.21.15.45:0/4266532196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40cc690 0x7f77b415b410 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f77b40b3f00 tx=0x7f77a4009bf0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b8e19700 1 -- 172.21.15.45:0/4266532196 shutdown_connections 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b8e19700 1 --2- 172.21.15.45:0/4266532196 >> v2:172.21.15.73:3300/0 conn(0x7f77b40cb8d0 0x7f77b406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b8e19700 1 --2- 172.21.15.45:0/4266532196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40cc690 0x7f77b415b410 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.225+0000 7f77b8e19700 1 -- 172.21.15.45:0/4266532196 >> 172.21.15.45:0/4266532196 conn(0x7f77b4071990 msgr2=0x7f77b40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.229+0000 7f77b8e19700 1 -- 172.21.15.45:0/4266532196 shutdown_connections 2023-12-19T17:59:20.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.229+0000 7f77b8e19700 1 -- 172.21.15.45:0/4266532196 wait complete. 2023-12-19T17:59:20.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 Processor -- start 2023-12-19T17:59:20.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 -- start start 2023-12-19T17:59:20.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77b40cb8d0 0x7f77b40b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b40cc690 0x7f77b414a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 0x7f77b41f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b41fa680 con 0x7f77b40ce350 2023-12-19T17:59:20.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40b2060 con 0x7f77b40cc690 2023-12-19T17:59:20.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b8e19700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b40b2340 con 0x7f77b40cb8d0 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 0x7f77b41f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 0x7f77b41f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37378/0 (socket says 172.21.15.45:37378) 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 -- 172.21.15.45:0/3273575765 learned_addr learned my addr 172.21.15.45:0/3273575765 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b259c700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77b40cb8d0 0x7f77b40b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b1d9b700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b40cc690 0x7f77b414a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 -- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77b40cb8d0 msgr2=0x7f77b40b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77b40cb8d0 0x7f77b40b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 -- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b40cc690 msgr2=0x7f77b414a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b40cc690 0x7f77b414a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.233+0000 7f77b2d9d700 1 -- 172.21.15.45:0/3273575765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a4009570 con 0x7f77b40ce350 2023-12-19T17:59:20.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77b2d9d700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 0x7f77b41f6ef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00efc0 tx=0x7f77ac00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:20.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac009ea0 con 0x7f77b40ce350 2023-12-19T17:59:20.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77ac00f040 con 0x7f77b40ce350 2023-12-19T17:59:20.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77ac00ced0 con 0x7f77b40ce350 2023-12-19T17:59:20.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b40b2620 con 0x7f77b40ce350 2023-12-19T17:59:20.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b40b3910 con 0x7f77b40ce350 2023-12-19T17:59:20.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.237+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b41fa7c0 con 0x7f77b40ce350 2023-12-19T17:59:20.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.241+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f77ac014480 con 0x7f77b40ce350 2023-12-19T17:59:20.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.241+0000 7f77a2ffd700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7794065ad0 0x7f7794067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.241+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f77ac083d90 con 0x7f77b40ce350 2023-12-19T17:59:20.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.241+0000 7f77b259c700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7794065ad0 0x7f7794067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.241+0000 7f77b259c700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7794065ad0 0x7f7794067f90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000c00 tx=0x7f77a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:20.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.249+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f77b41fa7c0 con 0x7f77b40ce350 2023-12-19T17:59:20.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.425+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77b41fa7c0 con 0x7f77b40ce350 2023-12-19T17:59:20.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.425+0000 7f77a2ffd700 1 -- 172.21.15.45:0/3273575765 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f77b41fa7c0 con 0x7f77b40ce350 2023-12-19T17:59:20.431 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7794065ad0 msgr2=0x7f7794067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7794065ad0 0x7f7794067f90 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f77a4000c00 tx=0x7f77a4008030 comp rx=0 tx=0).stop 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 msgr2=0x7f77b41f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 0x7f77b41f6ef0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f77ac00efc0 tx=0x7f77ac00c3a0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 shutdown_connections 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7794065ad0 0x7f7794067f90 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f77b40ce350 0x7f77b41f6ef0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f77b40cc690 0x7f77b414a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 --2- 172.21.15.45:0/3273575765 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f77b40cb8d0 0x7f77b40b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 >> 172.21.15.45:0/3273575765 conn(0x7f77b4071990 msgr2=0x7f77b40af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 shutdown_connections 2023-12-19T17:59:20.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.429+0000 7f77b8e19700 1 -- 172.21.15.45:0/3273575765 wait complete. 2023-12-19T17:59:20.458 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:59:20.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd87e700 1 Processor -- start 2023-12-19T17:59:20.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd87e700 1 -- start start 2023-12-19T17:59:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd87e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f80d2690 0x7f13f80cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd87e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f80d2200 con 0x7f13f80d0e30 2023-12-19T17:59:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd87e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13f80d1920 con 0x7f13f815d220 2023-12-19T17:59:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd87e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f80d2aa0 con 0x7f13f80d2690 2023-12-19T17:59:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fc87c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f13f80d0e30 0x7f13f80d1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33226/0 (socket says 172.21.15.45:33226) 2023-12-19T17:59:20.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fc87c700 1 -- 172.21.15.45:0/96395951 learned_addr learned my addr 172.21.15.45:0/96395951 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:20.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.641+0000 7f13fd07d700 1 --2- 172.21.15.45:0/96395951 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f80d2690 0x7f13f80cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1615948673 0 0) 0x7f13f80d2200 con 0x7f13f80d0e30 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e00035d0 con 0x7f13f80d0e30 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1774532336 0 0) 0x7f13f80d1920 con 0x7f13f815d220 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13f80d2200 con 0x7f13f815d220 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd07d700 1 -- 172.21.15.45:0/96395951 >> v1:172.21.15.73:6789/0 conn(0x7f13f815d220 legacy=0x7f13f806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd07d700 1 -- 172.21.15.45:0/96395951 >> v1:172.21.15.45:6789/0 conn(0x7f13f80d0e30 legacy=0x7f13f80d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd07d700 1 -- 172.21.15.45:0/96395951 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8070210 con 0x7f13f80d2690 2023-12-19T17:59:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd07d700 1 --2- 172.21.15.45:0/96395951 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f80d2690 0x7f13f80cd4b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009dc0 tx=0x7f13f000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5b3ffd5a1f4fbc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000e070 con 0x7f13f80d2690 2023-12-19T17:59:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f000bae0 con 0x7f13f80d2690 2023-12-19T17:59:20.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13ef7fe700 1 -- 172.21.15.45:0/96395951 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f000be90 con 0x7f13f80d2690 2023-12-19T17:59:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd87e700 1 -- 172.21.15.45:0/96395951 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f80d2690 msgr2=0x7f13f80cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd87e700 1 --2- 172.21.15.45:0/96395951 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f80d2690 0x7f13f80cd4b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009dc0 tx=0x7f13f000b330 comp rx=0 tx=0).stop 2023-12-19T17:59:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd87e700 1 -- 172.21.15.45:0/96395951 shutdown_connections 2023-12-19T17:59:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd87e700 1 --2- 172.21.15.45:0/96395951 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f80d2690 0x7f13f80cd4b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd87e700 1 -- 172.21.15.45:0/96395951 >> 172.21.15.45:0/96395951 conn(0x7f13f80b46d0 msgr2=0x7f13f80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.645+0000 7f13fd87e700 1 -- 172.21.15.45:0/96395951 shutdown_connections 2023-12-19T17:59:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.649+0000 7f13fd87e700 1 -- 172.21.15.45:0/96395951 wait complete. 2023-12-19T17:59:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.649+0000 7f13fd87e700 1 Processor -- start 2023-12-19T17:59:20.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.649+0000 7f13fd87e700 1 -- start start 2023-12-19T17:59:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd87e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 0x7f13f81f2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd87e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13f80d2690 0x7f13f815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd87e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f815d220 0x7f13f815beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd87e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81f5d40 con 0x7f13f80d0e30 2023-12-19T17:59:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd87e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81f6020 con 0x7f13f80d2690 2023-12-19T17:59:20.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd87e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13f81f6300 con 0x7f13f815d220 2023-12-19T17:59:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 0x7f13f81f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 0x7f13f81f2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37380/0 (socket says 172.21.15.45:37380) 2023-12-19T17:59:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 -- 172.21.15.45:0/1539925513 learned_addr learned my addr 172.21.15.45:0/1539925513 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fd07d700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f815d220 0x7f13f815beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13effff700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13f80d2690 0x7f13f815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 -- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f815d220 msgr2=0x7f13f815beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f815d220 0x7f13f815beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 -- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13f80d2690 msgr2=0x7f13f815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13f80d2690 0x7f13f815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 -- 172.21.15.45:0/1539925513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f0009a70 con 0x7f13f80d0e30 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.653+0000 7f13fc87c700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 0x7f13f81f2020 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c700 tx=0x7f13f400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.657+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4005d90 con 0x7f13f80d0e30 2023-12-19T17:59:20.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.657+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f40070d0 con 0x7f13f80d0e30 2023-12-19T17:59:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.657+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13f81f65e0 con 0x7f13f80d0e30 2023-12-19T17:59:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.657+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f4007480 con 0x7f13f80d0e30 2023-12-19T17:59:20.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.657+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13f81f2560 con 0x7f13f80d0e30 2023-12-19T17:59:20.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.657+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13f8072a90 con 0x7f13f80d0e30 2023-12-19T17:59:20.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.661+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f13f40075e0 con 0x7f13f80d0e30 2023-12-19T17:59:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.661+0000 7f13ed7fa700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f13e4065ad0 0x7f13e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.661+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f13f4082940 con 0x7f13f80d0e30 2023-12-19T17:59:20.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.661+0000 7f13effff700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f13e4065ad0 0x7f13e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:20.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.661+0000 7f13effff700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f13e4065ad0 0x7f13e4067f90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000f60 tx=0x7f13e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:20.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.669+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f13f404ff10 con 0x7f13f80d0e30 2023-12-19T17:59:20.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.845+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f13f804ed30 con 0x7f13f80d0e30 2023-12-19T17:59:20.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13ed7fa700 1 -- 172.21.15.45:0/1539925513 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f13f4017020 con 0x7f13f80d0e30 2023-12-19T17:59:20.852 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:59:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f13e4065ad0 msgr2=0x7f13e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f13e4065ad0 0x7f13e4067f90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f13e8000f60 tx=0x7f13e8009040 comp rx=0 tx=0).stop 2023-12-19T17:59:20.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 msgr2=0x7f13f81f2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 0x7f13f81f2020 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c700 tx=0x7f13f400ca10 comp rx=0 tx=0).stop 2023-12-19T17:59:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 shutdown_connections 2023-12-19T17:59:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f13e4065ad0 0x7f13e4067f90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13f815d220 0x7f13f815beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13f80d2690 0x7f13f815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 --2- 172.21.15.45:0/1539925513 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13f80d0e30 0x7f13f81f2020 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 >> 172.21.15.45:0/1539925513 conn(0x7f13f80b46d0 msgr2=0x7f13f80b6670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 shutdown_connections 2023-12-19T17:59:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:20.849+0000 7f13fd87e700 1 -- 172.21.15.45:0/1539925513 wait complete. 2023-12-19T17:59:20.877 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:59:21.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.053+0000 7f172a24c700 1 Processor -- start 2023-12-19T17:59:21.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.053+0000 7f172a24c700 1 -- start start 2023-12-19T17:59:21.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172a24c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f172415cf20 0x7f17240d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172a24c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17240b8580 0x7f17240cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172a24c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f17240d25f0 0x7f17240cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172a24c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f172415d300 con 0x7f172415cf20 2023-12-19T17:59:21.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172a24c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17240d1550 con 0x7f17240d25f0 2023-12-19T17:59:21.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172a24c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17240d1830 con 0x7f17240b8580 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172924a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f172415cf20 0x7f17240d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172924a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f172415cf20 0x7f17240d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37394/0 (socket says 172.21.15.45:37394) 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172924a700 1 -- 172.21.15.45:0/2511716069 learned_addr learned my addr 172.21.15.45:0/2511716069 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f1728a49700 1 --2- 172.21.15.45:0/2511716069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17240b8580 0x7f17240cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f1729a4b700 1 --2- 172.21.15.45:0/2511716069 >> v2:172.21.15.73:3300/0 conn(0x7f17240d25f0 0x7f17240cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172924a700 1 -- 172.21.15.45:0/2511716069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17240b8580 msgr2=0x7f17240cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.057+0000 7f172924a700 1 --2- 172.21.15.45:0/2511716069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17240b8580 0x7f17240cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172924a700 1 -- 172.21.15.45:0/2511716069 >> v2:172.21.15.73:3300/0 conn(0x7f17240d25f0 msgr2=0x7f17240cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172924a700 1 --2- 172.21.15.45:0/2511716069 >> v2:172.21.15.73:3300/0 conn(0x7f17240d25f0 0x7f17240cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172924a700 1 -- 172.21.15.45:0/2511716069 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17240d1b10 con 0x7f172415cf20 2023-12-19T17:59:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f1729a4b700 1 --2- 172.21.15.45:0/2511716069 >> v2:172.21.15.73:3300/0 conn(0x7f17240d25f0 0x7f17240cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172924a700 1 --2- 172.21.15.45:0/2511716069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172415cf20 0x7f17240d0c50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1724071c00 tx=0x7f1720009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c5a7dc4e09bce5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f171bfff700 1 -- 172.21.15.45:0/2511716069 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000b8a0 con 0x7f172415cf20 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f171bfff700 1 -- 172.21.15.45:0/2511716069 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f172000ba00 con 0x7f172415cf20 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f171bfff700 1 -- 172.21.15.45:0/2511716069 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f172000bd90 con 0x7f172415cf20 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 -- 172.21.15.45:0/2511716069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172415cf20 msgr2=0x7f17240d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 --2- 172.21.15.45:0/2511716069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172415cf20 0x7f17240d0c50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f1724071c00 tx=0x7f1720009bf0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 -- 172.21.15.45:0/2511716069 shutdown_connections 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 --2- 172.21.15.45:0/2511716069 >> v2:172.21.15.73:3300/0 conn(0x7f17240d25f0 0x7f17240cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 --2- 172.21.15.45:0/2511716069 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17240b8580 0x7f17240cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 --2- 172.21.15.45:0/2511716069 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f172415cf20 0x7f17240d0c50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 -- 172.21.15.45:0/2511716069 >> 172.21.15.45:0/2511716069 conn(0x7f17240b4670 msgr2=0x7f17240b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 -- 172.21.15.45:0/2511716069 shutdown_connections 2023-12-19T17:59:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.061+0000 7f172a24c700 1 -- 172.21.15.45:0/2511716069 wait complete. 2023-12-19T17:59:21.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 Processor -- start 2023-12-19T17:59:21.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 -- start start 2023-12-19T17:59:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17240b8580 0x7f172406bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 0x7f172406a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f172415cf20 0x7f172414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172415d670 con 0x7f17240d25f0 2023-12-19T17:59:21.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172406b670 con 0x7f17240b8580 2023-12-19T17:59:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172a24c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1724151790 con 0x7f172415cf20 2023-12-19T17:59:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 0x7f172406a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 0x7f172406a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37402/0 (socket says 172.21.15.45:37402) 2023-12-19T17:59:21.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 -- 172.21.15.45:0/2673847945 learned_addr learned my addr 172.21.15.45:0/2673847945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:21.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1729a4b700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f172415cf20 0x7f172414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172924a700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17240b8580 0x7f172406bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 -- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f172415cf20 msgr2=0x7f172414e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f172415cf20 0x7f172414e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 -- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17240b8580 msgr2=0x7f172406bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17240b8580 0x7f172406bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 -- 172.21.15.45:0/2673847945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1720009570 con 0x7f17240d25f0 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1729a4b700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f172415cf20 0x7f172414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f172924a700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17240b8580 0x7f172406bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.065+0000 7f1728a49700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 0x7f172406a010 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f171400d7d0 tx=0x7f171400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17140125f0 con 0x7f17240d25f0 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1714012750 con 0x7f17240d25f0 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724151a70 con 0x7f17240d25f0 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1714012ae0 con 0x7f17240d25f0 2023-12-19T17:59:21.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1724152030 con 0x7f17240d25f0 2023-12-19T17:59:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1714012c40 con 0x7f17240d25f0 2023-12-19T17:59:21.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.069+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172415d7b0 con 0x7f17240d25f0 2023-12-19T17:59:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.073+0000 7f1719ffb700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1708065b00 0x7f1708067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.073+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f1714083760 con 0x7f17240d25f0 2023-12-19T17:59:21.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.073+0000 7f172924a700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1708065b00 0x7f1708067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.073+0000 7f172924a700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1708065b00 0x7f1708067fc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f1720008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:21.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.077+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f172415d7b0 con 0x7f17240d25f0 2023-12-19T17:59:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.257+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f172415d7b0 con 0x7f17240d25f0 2023-12-19T17:59:21.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.257+0000 7f1719ffb700 1 -- 172.21.15.45:0/2673847945 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v72) v1 ==== 106+0+11 (secure 0 0 0) 0x7f172415d7b0 con 0x7f17240d25f0 2023-12-19T17:59:21.262 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1708065b00 msgr2=0x7f1708067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1708065b00 0x7f1708067fc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f1720000c00 tx=0x7f1720008030 comp rx=0 tx=0).stop 2023-12-19T17:59:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 msgr2=0x7f172406a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 0x7f172406a010 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f171400d7d0 tx=0x7f171400db90 comp rx=0 tx=0).stop 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 shutdown_connections 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1708065b00 0x7f1708067fc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f172415cf20 0x7f172414e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17240d25f0 0x7f172406a010 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 --2- 172.21.15.45:0/2673847945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17240b8580 0x7f172406bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 >> 172.21.15.45:0/2673847945 conn(0x7f17240b4670 msgr2=0x7f17240b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 shutdown_connections 2023-12-19T17:59:21.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.261+0000 7f172a24c700 1 -- 172.21.15.45:0/2673847945 wait complete. 2023-12-19T17:59:21.286 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:59:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 Processor -- start 2023-12-19T17:59:21.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 -- start start 2023-12-19T17:59:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdfec06cad0 0x7fdfec15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfec06f0a0 con 0x7fdfec15ae20 2023-12-19T17:59:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfec0b0110 con 0x7fdfec06cad0 2023-12-19T17:59:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff19b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec06ea90 con 0x7fdfec0af720 2023-12-19T17:59:21.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff09b3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdfec15ae20 0x7fdfec0c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33230/0 (socket says 172.21.15.45:33230) 2023-12-19T17:59:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff09b3700 1 -- 172.21.15.45:0/824783773 learned_addr learned my addr 172.21.15.45:0/824783773 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff11b4700 1 --2- 172.21.15.45:0/824783773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdfe3fff700 1 --2- 172.21.15.45:0/824783773 >> v2:172.21.15.73:3300/0 conn(0x7fdfec06cad0 0x7fdfec15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdfe37fe700 1 -- 172.21.15.45:0/824783773 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645786869 0 0) 0x7fdfec06f0a0 con 0x7fdfec15ae20 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdfe37fe700 1 -- 172.21.15.45:0/824783773 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfd40035d0 con 0x7fdfec15ae20 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff11b4700 1 -- 172.21.15.45:0/824783773 >> v2:172.21.15.73:3300/0 conn(0x7fdfec06cad0 msgr2=0x7fdfec15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff11b4700 1 --2- 172.21.15.45:0/824783773 >> v2:172.21.15.73:3300/0 conn(0x7fdfec06cad0 0x7fdfec15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff11b4700 1 -- 172.21.15.45:0/824783773 >> v1:172.21.15.45:6789/0 conn(0x7fdfec15ae20 legacy=0x7fdfec0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.465+0000 7fdff11b4700 1 -- 172.21.15.45:0/824783773 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfec0c3f60 con 0x7fdfec0af720 2023-12-19T17:59:21.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff11b4700 1 --2- 172.21.15.45:0/824783773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec0afbd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009d90 tx=0x7fdfe400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b902b0b7db41438 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdfe37fe700 1 -- 172.21.15.45:0/824783773 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe400e070 con 0x7fdfec0af720 2023-12-19T17:59:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdfe37fe700 1 -- 172.21.15.45:0/824783773 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe400bb20 con 0x7fdfec0af720 2023-12-19T17:59:21.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdfe37fe700 1 -- 172.21.15.45:0/824783773 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4012430 con 0x7fdfec0af720 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 -- 172.21.15.45:0/824783773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 msgr2=0x7fdfec0afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 --2- 172.21.15.45:0/824783773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec0afbd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009d90 tx=0x7fdfe400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 -- 172.21.15.45:0/824783773 shutdown_connections 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 --2- 172.21.15.45:0/824783773 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec0afbd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 --2- 172.21.15.45:0/824783773 >> v2:172.21.15.73:3300/0 conn(0x7fdfec06cad0 0x7fdfec15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 -- 172.21.15.45:0/824783773 >> 172.21.15.45:0/824783773 conn(0x7fdfec0cb900 msgr2=0x7fdfec0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:21.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 -- 172.21.15.45:0/824783773 shutdown_connections 2023-12-19T17:59:21.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.469+0000 7fdff19b5700 1 -- 172.21.15.45:0/824783773 wait complete. 2023-12-19T17:59:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.473+0000 7fdff19b5700 1 Processor -- start 2023-12-19T17:59:21.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.473+0000 7fdff19b5700 1 -- start start 2023-12-19T17:59:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfec06cad0 0x7fdfec1f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 0x7fdfec0b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0b1bb0 con 0x7fdfec15ae20 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec155cc0 con 0x7fdfec06cad0 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfec0b3050 con 0x7fdfec0af720 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 0x7fdfec0b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 0x7fdfec0b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37416/0 (socket says 172.21.15.45:37416) 2023-12-19T17:59:21.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 -- 172.21.15.45:0/2206946403 learned_addr learned my addr 172.21.15.45:0/2206946403 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff09b3700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfec06cad0 0x7fdfec1f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdfe3fff700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 -- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 msgr2=0x7fdfec155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 -- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfec06cad0 msgr2=0x7fdfec1f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfec06cad0 0x7fdfec1f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 -- 172.21.15.45:0/2206946403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe4009a70 con 0x7fdfec15ae20 2023-12-19T17:59:21.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff11b4700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 0x7fdfec0b2b10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4014040 tx=0x7fdfe4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe4012430 con 0x7fdfec15ae20 2023-12-19T17:59:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfe4020070 con 0x7fdfec15ae20 2023-12-19T17:59:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfec0b3320 con 0x7fdfec15ae20 2023-12-19T17:59:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe40098f0 con 0x7fdfec15ae20 2023-12-19T17:59:21.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.477+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfec0b14f0 con 0x7fdfec15ae20 2023-12-19T17:59:21.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.481+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfec067760 con 0x7fdfec15ae20 2023-12-19T17:59:21.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.481+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdfe4004040 con 0x7fdfec15ae20 2023-12-19T17:59:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.481+0000 7fdfe17fa700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfd8065ad0 0x7fdfd8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.481+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fdfe4022070 con 0x7fdfec15ae20 2023-12-19T17:59:21.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.481+0000 7fdff09b3700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfd8065ad0 0x7fdfd8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:21.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.485+0000 7fdff09b3700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfd8065ad0 0x7fdfd8067f90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8007fd0 tx=0x7fdfe8007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:21.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.489+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdfe4056100 con 0x7fdfec15ae20 2023-12-19T17:59:21.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.681+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdfec06d7d0 con 0x7fdfec15ae20 2023-12-19T17:59:21.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.681+0000 7fdfe17fa700 1 -- 172.21.15.45:0/2206946403 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v72) v1 ==== 80+0+364 (secure 0 0 0) 0x7fdfe402c180 con 0x7fdfec15ae20 2023-12-19T17:59:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6837/642740092 2023-12-20T17:57:15.782855+0000 2023-12-19T17:59:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6836/642740092 2023-12-20T17:57:15.782855+0000 2023-12-19T17:59:21.685 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6837/2368378550 2023-12-20T17:57:09.499680+0000 2023-12-19T17:59:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6837/4130274339 2023-12-20T17:57:08.416683+0000 2023-12-19T17:59:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6836/2368378550 2023-12-20T17:57:09.499680+0000 2023-12-19T17:59:21.686 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6836/4130274339 2023-12-20T17:57:08.416683+0000 2023-12-19T17:59:21.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.681+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfd8065ad0 msgr2=0x7fdfd8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.681+0000 7fdff19b5700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfd8065ad0 0x7fdfd8067f90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdfe8007fd0 tx=0x7fdfe8007de0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.681+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 msgr2=0x7fdfec0b2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.681+0000 7fdff19b5700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 0x7fdfec0b2b10 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4014040 tx=0x7fdfe4004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 shutdown_connections 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdfd8065ad0 0x7fdfd8067f90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdfec15ae20 0x7fdfec0b2b10 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdfec0af720 0x7fdfec155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 --2- 172.21.15.45:0/2206946403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdfec06cad0 0x7fdfec1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 >> 172.21.15.45:0/2206946403 conn(0x7fdfec0cb900 msgr2=0x7fdfec15b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 shutdown_connections 2023-12-19T17:59:21.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:21.685+0000 7fdff19b5700 1 -- 172.21.15.45:0/2206946403 wait complete. 2023-12-19T17:59:21.691 INFO:teuthology.orchestra.run.smithi045.stderr:listed 6 entries 2023-12-19T17:59:21.710 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:59:21.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:21.710 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:21.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[51032]: fuse finished with error 0 and tester_r 0 2023-12-19T17:59:21.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:59:21.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:21.790 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T17:59:21.961 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:59:21.962 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:21.982 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:59:21.982 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:59:21.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:21.982 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T17:59:22.043 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T17:59:22.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:59:22.045 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:22.045 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:22.064 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T17:59:22.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T17:59:22.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:22.064 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T17:59:22.126 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T17:59:22.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:59:22.128 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:59:22.128 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:22.149 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:59:22.149 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T17:59:22.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:22.149 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T17:59:22.211 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T17:59:22.212 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T17:59:22.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.397+0000 7f046e0e4700 1 Processor -- start 2023-12-19T17:59:22.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.397+0000 7f046e0e4700 1 -- start start 2023-12-19T17:59:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046e0e4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 0x7f046806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046e0e4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f046806f3b0 0x7f046806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046e0e4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04680d1820 con 0x7f046806ea90 2023-12-19T17:59:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046e0e4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04680d1630 con 0x7f046806f3b0 2023-12-19T17:59:22.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046e0e4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04680d1b00 con 0x7f04680b88b0 2023-12-19T17:59:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046d0e2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f046806ea90 0x7f04680d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33244/0 (socket says 172.21.15.45:33244) 2023-12-19T17:59:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046d0e2700 1 -- 172.21.15.45:0/1742390916 learned_addr learned my addr 172.21.15.45:0/1742390916 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046d8e3700 1 --2- 172.21.15.45:0/1742390916 >> v2:172.21.15.73:3300/0 conn(0x7f046806f3b0 0x7f046806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 0x7f046806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 648783136 0 0) 0x7f04680d1820 con 0x7f046806ea90 2023-12-19T17:59:22.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04540035d0 con 0x7f046806ea90 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2880126940 0 0) 0x7f04540035d0 con 0x7f046806ea90 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 msgr2=0x7f046806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 0x7f046806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 >> v2:172.21.15.73:3300/0 conn(0x7f046806f3b0 msgr2=0x7f046806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 --2- 172.21.15.45:0/1742390916 >> v2:172.21.15.73:3300/0 conn(0x7f046806f3b0 0x7f046806f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04680d1de0 con 0x7f046806ea90 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f0464001670 con 0x7f046806ea90 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 >> v1:172.21.15.45:6789/0 conn(0x7f046806ea90 legacy=0x7f04680d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454003a20 0x7f0454003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0454004870 0x7f0454004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 0x7f0454005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04680d1b00 con 0x7f0454004870 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f045400ba30 con 0x7f0454003a20 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f045400bbc0 con 0x7f04680b88b0 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0454004870 0x7f0454004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046d8e3700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 0x7f0454005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046d0e2700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454003a20 0x7f0454003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 -- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 msgr2=0x7f0454005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04680b88b0 0x7f0454005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 -- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454003a20 msgr2=0x7f0454003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454003a20 0x7f0454003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 -- 172.21.15.45:0/1742390916 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04540035d0 con 0x7f0454004870 2023-12-19T17:59:22.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.401+0000 7f046c8e1700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0454004870 0x7f0454004cf0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0458009ba0 tx=0x7f04540058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda6bd0c24f3e16f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800e6c0 con 0x7f0454004870 2023-12-19T17:59:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045800e820 con 0x7f0454004870 2023-12-19T17:59:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f045ffff700 1 -- 172.21.15.45:0/1742390916 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f045800eb90 con 0x7f0454004870 2023-12-19T17:59:22.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046e0e4700 1 -- 172.21.15.45:0/1742390916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0454004870 msgr2=0x7f0454004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046e0e4700 1 --2- 172.21.15.45:0/1742390916 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0454004870 0x7f0454004cf0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f0458009ba0 tx=0x7f04540058a0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046d8e3700 1 -- 172.21.15.45:0/1742390916 reap_dead start 2023-12-19T17:59:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046e0e4700 1 -- 172.21.15.45:0/1742390916 shutdown_connections 2023-12-19T17:59:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046e0e4700 1 -- 172.21.15.45:0/1742390916 >> 172.21.15.45:0/1742390916 conn(0x7f04680b46d0 msgr2=0x7f04680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046e0e4700 1 -- 172.21.15.45:0/1742390916 shutdown_connections 2023-12-19T17:59:22.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.405+0000 7f046e0e4700 1 -- 172.21.15.45:0/1742390916 wait complete. 2023-12-19T17:59:22.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 Processor -- start 2023-12-19T17:59:22.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 -- start start 2023-12-19T17:59:22.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454004870 0x7f046806fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0468158c20 0x7f04681590a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 0x7f04680c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04681f5c00 con 0x7f04680c8940 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04681f5ee0 con 0x7f0454004870 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046e0e4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04681f61c0 con 0x7f0468158c20 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 0x7f04680c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 0x7f04680c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37434/0 (socket says 172.21.15.45:37434) 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 -- 172.21.15.45:0/2543998946 learned_addr learned my addr 172.21.15.45:0/2543998946 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046c8e1700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0468158c20 0x7f04681590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d0e2700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454004870 0x7f046806fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 -- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0468158c20 msgr2=0x7f04681590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0468158c20 0x7f04681590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 -- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454004870 msgr2=0x7f046806fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454004870 0x7f046806fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 -- 172.21.15.45:0/2543998946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04681f64a0 con 0x7f04680c8940 2023-12-19T17:59:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.409+0000 7f046d8e3700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 0x7f04680c8da0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f04680b5ac0 tx=0x7f04600114b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.413+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046000e070 con 0x7f04680c8940 2023-12-19T17:59:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.413+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0460003d10 con 0x7f04680c8940 2023-12-19T17:59:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.413+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04681f6780 con 0x7f04680c8940 2023-12-19T17:59:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.413+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0460011960 con 0x7f04680c8940 2023-12-19T17:59:22.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.413+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04681595e0 con 0x7f04680c8940 2023-12-19T17:59:22.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.413+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046815ad20 con 0x7f04680c8940 2023-12-19T17:59:22.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.417+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0460011ac0 con 0x7f04680c8940 2023-12-19T17:59:22.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.417+0000 7f045dffb700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f044c065b00 0x7f044c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.417+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f04600838d0 con 0x7f04680c8940 2023-12-19T17:59:22.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.417+0000 7f046d0e2700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f044c065b00 0x7f044c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.417+0000 7f046d0e2700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f044c065b00 0x7f044c067fc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0464001eb0 tx=0x7f0464007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:22.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.421+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0460050e10 con 0x7f04680c8940 2023-12-19T17:59:22.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.633+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f04681f6970 con 0x7f04680c8940 2023-12-19T17:59:22.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.633+0000 7f045dffb700 1 -- 172.21.15.45:0/2543998946 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f0460054430 con 0x7f04680c8940 2023-12-19T17:59:22.639 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:22.639 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:18.814594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f044c065b00 msgr2=0x7f044c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f044c065b00 0x7f044c067fc0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0464001eb0 tx=0x7f0464007040 comp rx=0 tx=0).stop 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 msgr2=0x7f04680c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 0x7f04680c8da0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f04680b5ac0 tx=0x7f04600114b0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 shutdown_connections 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f044c065b00 0x7f044c067fc0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04680c8940 0x7f04680c8da0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0468158c20 0x7f04681590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 --2- 172.21.15.45:0/2543998946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0454004870 0x7f046806fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 >> 172.21.15.45:0/2543998946 conn(0x7f04680b46d0 msgr2=0x7f046815c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 shutdown_connections 2023-12-19T17:59:22.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.641+0000 7f046e0e4700 1 -- 172.21.15.45:0/2543998946 wait complete. 2023-12-19T17:59:22.647 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-19T17:59:22.671 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:22.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 Processor -- start 2023-12-19T17:59:22.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 -- start start 2023-12-19T17:59:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f316415ade0 0x7f31640b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b6540 0x7f31640b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31640b3fc0 0x7f31640b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316415b1c0 con 0x7f316415ade0 2023-12-19T17:59:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31640b69a0 con 0x7f31640b3fc0 2023-12-19T17:59:22.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316b28c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31640cfc90 con 0x7f31640b6540 2023-12-19T17:59:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f316a28a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f316415ade0 0x7f31640b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.857+0000 7f3169a89700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b6540 0x7f31640b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f31640b3fc0 0x7f31640b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316a28a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f316415ade0 0x7f31640b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37450/0 (socket says 172.21.15.45:37450) 2023-12-19T17:59:22.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316a28a700 1 -- 172.21.15.45:0/1397377892 learned_addr learned my addr 172.21.15.45:0/1397377892 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 -- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b6540 msgr2=0x7f31640b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 --2- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b6540 0x7f31640b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 -- 172.21.15.45:0/1397377892 >> v2:172.21.15.45:3300/0 conn(0x7f316415ade0 msgr2=0x7f31640b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 --2- 172.21.15.45:0/1397377892 >> v2:172.21.15.45:3300/0 conn(0x7f316415ade0 0x7f31640b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 -- 172.21.15.45:0/1397377892 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31640cff70 con 0x7f31640b3fc0 2023-12-19T17:59:22.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316aa8b700 1 --2- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31640b3fc0 0x7f31640b4450 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31640caf20 tx=0x7f315c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de42dc94763734e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f3169288700 1 -- 172.21.15.45:0/1397377892 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c00e070 con 0x7f31640b3fc0 2023-12-19T17:59:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f3169288700 1 -- 172.21.15.45:0/1397377892 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315c00bb20 con 0x7f31640b3fc0 2023-12-19T17:59:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f3169288700 1 -- 172.21.15.45:0/1397377892 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315c012430 con 0x7f31640b3fc0 2023-12-19T17:59:22.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 -- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31640b3fc0 msgr2=0x7f31640b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 --2- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31640b3fc0 0x7f31640b4450 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31640caf20 tx=0x7f315c00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 -- 172.21.15.45:0/1397377892 shutdown_connections 2023-12-19T17:59:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 --2- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31640b3fc0 0x7f31640b4450 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 --2- 172.21.15.45:0/1397377892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b6540 0x7f31640b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 --2- 172.21.15.45:0/1397377892 >> v2:172.21.15.45:3300/0 conn(0x7f316415ade0 0x7f31640b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 -- 172.21.15.45:0/1397377892 >> 172.21.15.45:0/1397377892 conn(0x7f31640b2540 msgr2=0x7f31640b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 -- 172.21.15.45:0/1397377892 shutdown_connections 2023-12-19T17:59:22.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.861+0000 7f316b28c700 1 -- 172.21.15.45:0/1397377892 wait complete. 2023-12-19T17:59:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 Processor -- start 2023-12-19T17:59:22.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 -- start start 2023-12-19T17:59:22.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b3fc0 0x7f31640b57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 0x7f3164140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316415ade0 0x7f31640b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164157660 con 0x7f31640b6540 2023-12-19T17:59:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3164141080 con 0x7f316415ade0 2023-12-19T17:59:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316b28c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3164156a50 con 0x7f31640b3fc0 2023-12-19T17:59:22.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f3169a89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 0x7f3164140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316a28a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b3fc0 0x7f31640b57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316aa8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316415ade0 0x7f31640b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f3169a89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 0x7f3164140b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37454/0 (socket says 172.21.15.45:37454) 2023-12-19T17:59:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316aa8b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316415ade0 0x7f31640b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:60232/0 (socket says 172.21.15.45:60232) 2023-12-19T17:59:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f316a28a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b3fc0 0x7f31640b57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38022/0 (socket says 172.21.15.45:38022) 2023-12-19T17:59:22.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.865+0000 7f3169a89700 1 -- 172.21.15.45:0/4249433163 learned_addr learned my addr 172.21.15.45:0/4249433163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f3169a89700 1 -- 172.21.15.45:0/4249433163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b3fc0 msgr2=0x7f31640b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f3169a89700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b3fc0 0x7f31640b57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f3169a89700 1 -- 172.21.15.45:0/4249433163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316415ade0 msgr2=0x7f31640b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f3169a89700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316415ade0 0x7f31640b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f3169a89700 1 -- 172.21.15.45:0/4249433163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315c009a70 con 0x7f31640b6540 2023-12-19T17:59:22.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f3169a89700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 0x7f3164140b40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f315400ebe0 tx=0x7f315400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154009740 con 0x7f31640b6540 2023-12-19T17:59:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f315400c850 con 0x7f31640b6540 2023-12-19T17:59:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f315400cbe0 con 0x7f31640b6540 2023-12-19T17:59:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3164156d30 con 0x7f31640b6540 2023-12-19T17:59:22.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31641572f0 con 0x7f31640b6540 2023-12-19T17:59:22.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.869+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3164067760 con 0x7f31640b6540 2023-12-19T17:59:22.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.873+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f315400cd40 con 0x7f31640b6540 2023-12-19T17:59:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.873+0000 7f315affd700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3148065ad0 0x7f3148067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.873+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f3154083680 con 0x7f31640b6540 2023-12-19T17:59:22.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.873+0000 7f316a28a700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3148065ad0 0x7f3148067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:22.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.873+0000 7f316a28a700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3148065ad0 0x7f3148067f90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3160009ad0 tx=0x7f31600092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:22.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:22.881+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3154050bc0 con 0x7f31640b6540 2023-12-19T17:59:23.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.061+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31641577a0 con 0x7f31640b6540 2023-12-19T17:59:23.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.065+0000 7f315affd700 1 -- 172.21.15.45:0/4249433163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f31641577a0 con 0x7f31640b6540 2023-12-19T17:59:23.071 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:23.071 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:57:15.816595+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6836/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6837/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6837/4130274339":"2023-12-20T17:57:08.416683+0000","172.21.15.45:6836/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6836/4130274339":"2023-12-20T17:57:08.416683+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3148065ad0 msgr2=0x7f3148067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3148065ad0 0x7f3148067f90 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3160009ad0 tx=0x7f31600092e0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 msgr2=0x7f3164140b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 0x7f3164140b40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f315400ebe0 tx=0x7f315400eef0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 shutdown_connections 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3148065ad0 0x7f3148067f90 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f316415ade0 0x7f31640b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31640b6540 0x7f3164140b40 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 --2- 172.21.15.45:0/4249433163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31640b3fc0 0x7f31640b57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 >> 172.21.15.45:0/4249433163 conn(0x7f31640b2540 msgr2=0x7f31640cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 shutdown_connections 2023-12-19T17:59:23.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.069+0000 7f316b28c700 1 -- 172.21.15.45:0/4249433163 wait complete. 2023-12-19T17:59:23.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:55:16.332981+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:55:17.225656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:55:27.316408+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:59:23.095 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:59:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.277+0000 7f2c2d87e700 1 Processor -- start 2023-12-19T17:59:23.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.277+0000 7f2c2d87e700 1 -- start start 2023-12-19T17:59:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d87e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c280d0e30 0x7f2c280d2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d87e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c2815d220 0x7f2c280cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d87e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c280d2200 con 0x7f2c280d1210 2023-12-19T17:59:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d87e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c28070210 con 0x7f2c280d0e30 2023-12-19T17:59:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d87e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280d1bb0 con 0x7f2c2815d220 2023-12-19T17:59:23.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d07d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2c280d1210 0x7f2c280b5e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33260/0 (socket says 172.21.15.45:33260) 2023-12-19T17:59:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2d07d700 1 -- 172.21.15.45:0/3909134918 learned_addr learned my addr 172.21.15.45:0/3909134918 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c2c87c700 1 --2- 172.21.15.45:0/3909134918 >> v2:172.21.15.45:3300/0 conn(0x7f2c280d0e30 0x7f2c280d2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.281+0000 7f2c27fff700 1 --2- 172.21.15.45:0/3909134918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c2815d220 0x7f2c280cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c27fff700 1 -- 172.21.15.45:0/3909134918 >> v2:172.21.15.45:3300/0 conn(0x7f2c280d0e30 msgr2=0x7f2c280d2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c27fff700 1 --2- 172.21.15.45:0/3909134918 >> v2:172.21.15.45:3300/0 conn(0x7f2c280d0e30 0x7f2c280d2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c27fff700 1 -- 172.21.15.45:0/3909134918 >> v1:172.21.15.45:6789/0 conn(0x7f2c280d1210 legacy=0x7f2c280b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c27fff700 1 -- 172.21.15.45:0/3909134918 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c280d1e90 con 0x7f2c2815d220 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2c87c700 1 --2- 172.21.15.45:0/3909134918 >> v2:172.21.15.45:3300/0 conn(0x7f2c280d0e30 0x7f2c280d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c277fe700 1 -- 172.21.15.45:0/3909134918 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617381668 0 0) 0x7f2c280d2200 con 0x7f2c280d1210 2023-12-19T17:59:23.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c27fff700 1 --2- 172.21.15.45:0/3909134918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c2815d220 0x7f2c280cd4b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009850 tx=0x7f2c14009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e365618a9c3bccec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c277fe700 1 -- 172.21.15.45:0/3909134918 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14011830 con 0x7f2c2815d220 2023-12-19T17:59:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c277fe700 1 -- 172.21.15.45:0/3909134918 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c14011990 con 0x7f2c2815d220 2023-12-19T17:59:23.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c277fe700 1 -- 172.21.15.45:0/3909134918 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14011d40 con 0x7f2c2815d220 2023-12-19T17:59:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 -- 172.21.15.45:0/3909134918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c2815d220 msgr2=0x7f2c280cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/3909134918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c2815d220 0x7f2c280cd4b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2c14009850 tx=0x7f2c14009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 -- 172.21.15.45:0/3909134918 shutdown_connections 2023-12-19T17:59:23.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/3909134918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c2815d220 0x7f2c280cd4b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/3909134918 >> v2:172.21.15.45:3300/0 conn(0x7f2c280d0e30 0x7f2c280d2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 -- 172.21.15.45:0/3909134918 >> 172.21.15.45:0/3909134918 conn(0x7f2c280b46d0 msgr2=0x7f2c280b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 -- 172.21.15.45:0/3909134918 shutdown_connections 2023-12-19T17:59:23.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.285+0000 7f2c2d87e700 1 -- 172.21.15.45:0/3909134918 wait complete. 2023-12-19T17:59:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 Processor -- start 2023-12-19T17:59:23.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 -- start start 2023-12-19T17:59:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c280d0e30 0x7f2c2815f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 0x7f2c2815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c2815d220 0x7f2c2806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c280b7e20 con 0x7f2c280d1210 2023-12-19T17:59:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2815d630 con 0x7f2c2815d220 2023-12-19T17:59:23.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.289+0000 7f2c2d87e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2814f290 con 0x7f2c280d0e30 2023-12-19T17:59:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 0x7f2c2815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 0x7f2c2815fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37476/0 (socket says 172.21.15.45:37476) 2023-12-19T17:59:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 -- 172.21.15.45:0/4096510286 learned_addr learned my addr 172.21.15.45:0/4096510286 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c2c87c700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c280d0e30 0x7f2c2815f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c2d07d700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c2815d220 0x7f2c2806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 -- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c280d0e30 msgr2=0x7f2c2815f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c280d0e30 0x7f2c2815f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 -- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c2815d220 msgr2=0x7f2c2806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c2815d220 0x7f2c2806ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 -- 172.21.15.45:0/4096510286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c0094b0 con 0x7f2c280d1210 2023-12-19T17:59:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c27fff700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 0x7f2c2815fec0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2c140090b0 tx=0x7f2c14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:23.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1401a990 con 0x7f2c280d1210 2023-12-19T17:59:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1401f070 con 0x7f2c280d1210 2023-12-19T17:59:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1401ad30 con 0x7f2c280d1210 2023-12-19T17:59:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c140094b0 con 0x7f2c280d1210 2023-12-19T17:59:23.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c280d1980 con 0x7f2c280d1210 2023-12-19T17:59:23.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.293+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c28072a90 con 0x7f2c280d1210 2023-12-19T17:59:23.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.297+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c1401b430 con 0x7f2c280d1210 2023-12-19T17:59:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.297+0000 7f2c257fa700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c0c065b50 0x7f2c0c068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.297+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f2c14084500 con 0x7f2c280d1210 2023-12-19T17:59:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.297+0000 7f2c2c87c700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c0c065b50 0x7f2c0c068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.301+0000 7f2c2c87c700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c0c065b50 0x7f2c0c068010 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009ce0 tx=0x7f2c1c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:23.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.305+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2c14051b50 con 0x7f2c280d1210 2023-12-19T17:59:23.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.481+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c280b7f60 con 0x7f2c280d1210 2023-12-19T17:59:23.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.481+0000 7f2c257fa700 1 -- 172.21.15.45:0/4096510286 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c14015020 con 0x7f2c280d1210 2023-12-19T17:59:23.486 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:59:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c0c065b50 msgr2=0x7f2c0c068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c0c065b50 0x7f2c0c068010 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c009ce0 tx=0x7f2c1c009240 comp rx=0 tx=0).stop 2023-12-19T17:59:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 msgr2=0x7f2c2815fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 0x7f2c2815fec0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f2c140090b0 tx=0x7f2c14004770 comp rx=0 tx=0).stop 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 shutdown_connections 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c0c065b50 0x7f2c0c068010 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c2815d220 0x7f2c2806ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c280d1210 0x7f2c2815fec0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 --2- 172.21.15.45:0/4096510286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c280d0e30 0x7f2c2815f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 >> 172.21.15.45:0/4096510286 conn(0x7f2c280b46d0 msgr2=0x7f2c2815b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 shutdown_connections 2023-12-19T17:59:23.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.485+0000 7f2c2d87e700 1 -- 172.21.15.45:0/4096510286 wait complete. 2023-12-19T17:59:23.513 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:59:23.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.689+0000 7f0146ae4700 1 Processor -- start 2023-12-19T17:59:23.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.689+0000 7f0146ae4700 1 -- start start 2023-12-19T17:59:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0146ae4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f01401621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0146ae4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f014015b920 0x7f01400713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0146ae4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0140071910 0x7f0140164d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0146ae4700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01400b2830 con 0x7f014015b920 2023-12-19T17:59:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0146ae4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0140071da0 con 0x7f0140071910 2023-12-19T17:59:23.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0146ae4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140162700 con 0x7f014015b540 2023-12-19T17:59:23.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f014015b920 0x7f01400713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f014015b920 0x7f01400713d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37478/0 (socket says 172.21.15.45:37478) 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 -- 172.21.15.45:0/1873773519 learned_addr learned my addr 172.21.15.45:0/1873773519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0145ae2700 1 --2- 172.21.15.45:0/1873773519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f01401621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01462e3700 1 --2- 172.21.15.45:0/1873773519 >> v2:172.21.15.73:3300/0 conn(0x7f0140071910 0x7f0140164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 -- 172.21.15.45:0/1873773519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 msgr2=0x7f01401621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 --2- 172.21.15.45:0/1873773519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f01401621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 -- 172.21.15.45:0/1873773519 >> v2:172.21.15.73:3300/0 conn(0x7f0140071910 msgr2=0x7f0140164d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 --2- 172.21.15.45:0/1873773519 >> v2:172.21.15.73:3300/0 conn(0x7f0140071910 0x7f0140164d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 -- 172.21.15.45:0/1873773519 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400b1bb0 con 0x7f014015b920 2023-12-19T17:59:23.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01462e3700 1 --2- 172.21.15.45:0/1873773519 >> v2:172.21.15.73:3300/0 conn(0x7f0140071910 0x7f0140164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:59:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f01452e1700 1 --2- 172.21.15.45:0/1873773519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015b920 0x7f01400713d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f01400b2730 tx=0x7f0130009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c004800a4ed57657 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0144ae0700 1 -- 172.21.15.45:0/1873773519 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013000ba20 con 0x7f014015b920 2023-12-19T17:59:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0144ae0700 1 -- 172.21.15.45:0/1873773519 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013000bb80 con 0x7f014015b920 2023-12-19T17:59:23.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.693+0000 7f0144ae0700 1 -- 172.21.15.45:0/1873773519 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130009e60 con 0x7f014015b920 2023-12-19T17:59:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 -- 172.21.15.45:0/1873773519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015b920 msgr2=0x7f01400713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 --2- 172.21.15.45:0/1873773519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015b920 0x7f01400713d0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f01400b2730 tx=0x7f0130009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 -- 172.21.15.45:0/1873773519 shutdown_connections 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 --2- 172.21.15.45:0/1873773519 >> v2:172.21.15.73:3300/0 conn(0x7f0140071910 0x7f0140164d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 --2- 172.21.15.45:0/1873773519 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015b920 0x7f01400713d0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 --2- 172.21.15.45:0/1873773519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f01401621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 -- 172.21.15.45:0/1873773519 >> 172.21.15.45:0/1873773519 conn(0x7f01400cf5a0 msgr2=0x7f0140070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 -- 172.21.15.45:0/1873773519 shutdown_connections 2023-12-19T17:59:23.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.697+0000 7f0146ae4700 1 -- 172.21.15.45:0/1873773519 wait complete. 2023-12-19T17:59:23.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 Processor -- start 2023-12-19T17:59:23.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 -- start start 2023-12-19T17:59:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f014015e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014015b920 0x7f014015a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c460 0x7f014014b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0140157040 con 0x7f014015c460 2023-12-19T17:59:23.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014015d190 con 0x7f014015b920 2023-12-19T17:59:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0146ae4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014015c8f0 con 0x7f014015b540 2023-12-19T17:59:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f01462e3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c460 0x7f014014b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0145ae2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f014015e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.701+0000 7f0145ae2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f014015e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38074/0 (socket says 172.21.15.45:38074) 2023-12-19T17:59:23.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f0145ae2700 1 -- 172.21.15.45:0/2074558771 learned_addr learned my addr 172.21.15.45:0/2074558771 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01452e1700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014015b920 0x7f014015a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01462e3700 1 -- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 msgr2=0x7f014015e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01462e3700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f014015e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01462e3700 1 -- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014015b920 msgr2=0x7f014015a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01462e3700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014015b920 0x7f014015a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01462e3700 1 -- 172.21.15.45:0/2074558771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009570 con 0x7f014015c460 2023-12-19T17:59:23.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.705+0000 7f01462e3700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c460 0x7f014014b950 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f013800c820 tx=0x7f013800cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.709+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138005c90 con 0x7f014015c460 2023-12-19T17:59:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.709+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0138005df0 con 0x7f014015c460 2023-12-19T17:59:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.709+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014015cbd0 con 0x7f014015c460 2023-12-19T17:59:23.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.709+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0138011840 con 0x7f014015c460 2023-12-19T17:59:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.709+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014014e080 con 0x7f014015c460 2023-12-19T17:59:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.709+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014014dee0 con 0x7f014015c460 2023-12-19T17:59:23.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.713+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f01380119a0 con 0x7f014015c460 2023-12-19T17:59:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.713+0000 7f01367fc700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.713+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f01380835f0 con 0x7f014015c460 2023-12-19T17:59:23.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.713+0000 7f0145ae2700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:23.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.713+0000 7f0145ae2700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f013c009fd0 tx=0x7f013c0099c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:23.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.721+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f014014dee0 con 0x7f014015c460 2023-12-19T17:59:23.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.901+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f014014dee0 con 0x7f014015c460 2023-12-19T17:59:23.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.901+0000 7f01367fc700 1 -- 172.21.15.45:0/2074558771 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f014014dee0 con 0x7f014015c460 2023-12-19T17:59:23.907 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 msgr2=0x7f0124067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f013c009fd0 tx=0x7f013c0099c0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c460 msgr2=0x7f014014b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:23.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c460 0x7f014014b950 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f013800c820 tx=0x7f013800cb30 comp rx=0 tx=0).stop 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 shutdown_connections 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014015c460 0x7f014014b950 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f014015b920 0x7f014015a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 --2- 172.21.15.45:0/2074558771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015b540 0x7f014015e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 >> 172.21.15.45:0/2074558771 conn(0x7f0140071910 msgr2=0x7f014006de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:23.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 shutdown_connections 2023-12-19T17:59:23.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:23.905+0000 7f0146ae4700 1 -- 172.21.15.45:0/2074558771 wait complete. 2023-12-19T17:59:23.933 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:59:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.105+0000 7f5361ba7700 1 Processor -- start 2023-12-19T17:59:24.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f5361ba7700 1 -- start start 2023-12-19T17:59:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f5361ba7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f535c15b410 0x7f535c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f5361ba7700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c0ce890 con 0x7f535c0cb8d0 2023-12-19T17:59:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f5361ba7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f535c15b840 con 0x7f535c0cc690 2023-12-19T17:59:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f5361ba7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f535c06ea90 con 0x7f535c15b410 2023-12-19T17:59:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535affd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f535c0cb8d0 0x7f535c06d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33266/0 (socket says 172.21.15.45:33266) 2023-12-19T17:59:24.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535affd700 1 -- 172.21.15.45:0/2769387638 learned_addr learned my addr 172.21.15.45:0/2769387638 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535bfff700 1 --2- 172.21.15.45:0/2769387638 >> v2:172.21.15.73:3300/0 conn(0x7f535c15b410 0x7f535c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535a7fc700 1 -- 172.21.15.45:0/2769387638 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669208769 0 0) 0x7f5350001110 con 0x7f535c0cb8d0 2023-12-19T17:59:24.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535a7fc700 1 -- 172.21.15.45:0/2769387638 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53440035d0 con 0x7f535c0cb8d0 2023-12-19T17:59:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535bfff700 1 -- 172.21.15.45:0/2769387638 >> v1:172.21.15.73:6789/0 conn(0x7f535c0cc690 legacy=0x7f535c0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535bfff700 1 -- 172.21.15.45:0/2769387638 >> v1:172.21.15.45:6789/0 conn(0x7f535c0cb8d0 legacy=0x7f535c06d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.109+0000 7f535bfff700 1 -- 172.21.15.45:0/2769387638 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c15c340 con 0x7f535c15b410 2023-12-19T17:59:24.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f535bfff700 1 --2- 172.21.15.45:0/2769387638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c15b410 0x7f535c0ce350 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5354009d90 tx=0x7f535400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e81ec03cd55acb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f535a7fc700 1 -- 172.21.15.45:0/2769387638 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535400e070 con 0x7f535c15b410 2023-12-19T17:59:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f535a7fc700 1 -- 172.21.15.45:0/2769387638 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535400bb20 con 0x7f535c15b410 2023-12-19T17:59:24.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f535a7fc700 1 -- 172.21.15.45:0/2769387638 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354012430 con 0x7f535c15b410 2023-12-19T17:59:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 -- 172.21.15.45:0/2769387638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c15b410 msgr2=0x7f535c0ce350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 --2- 172.21.15.45:0/2769387638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c15b410 0x7f535c0ce350 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5354009d90 tx=0x7f535400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 -- 172.21.15.45:0/2769387638 shutdown_connections 2023-12-19T17:59:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 --2- 172.21.15.45:0/2769387638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c15b410 0x7f535c0ce350 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 -- 172.21.15.45:0/2769387638 >> 172.21.15.45:0/2769387638 conn(0x7f535c071990 msgr2=0x7f535c0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:24.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 -- 172.21.15.45:0/2769387638 shutdown_connections 2023-12-19T17:59:24.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.113+0000 7f5361ba7700 1 -- 172.21.15.45:0/2769387638 wait complete. 2023-12-19T17:59:24.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 Processor -- start 2023-12-19T17:59:24.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 -- start start 2023-12-19T17:59:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f535c0cb8d0 0x7f535c14f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c0cc690 0x7f535c15d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 0x7f535c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c15e000 con 0x7f535c15b410 2023-12-19T17:59:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f535c159120 con 0x7f535c0cc690 2023-12-19T17:59:24.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f5361ba7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f535c159400 con 0x7f535c0cb8d0 2023-12-19T17:59:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.117+0000 7f535bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 0x7f535c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f535c0cb8d0 0x7f535c14f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 0x7f535c1570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37498/0 (socket says 172.21.15.45:37498) 2023-12-19T17:59:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 -- 172.21.15.45:0/773594350 learned_addr learned my addr 172.21.15.45:0/773594350 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:24.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535affd700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c0cc690 0x7f535c15d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 -- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f535c0cb8d0 msgr2=0x7f535c14f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f535c0cb8d0 0x7f535c14f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 -- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c0cc690 msgr2=0x7f535c15d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c0cc690 0x7f535c15d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 -- 172.21.15.45:0/773594350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5354009a70 con 0x7f535c15b410 2023-12-19T17:59:24.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f535bfff700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 0x7f535c1570e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f535c06aac0 tx=0x7f5354004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354012430 con 0x7f535c15b410 2023-12-19T17:59:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5354020070 con 0x7f535c15b410 2023-12-19T17:59:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f535c1596e0 con 0x7f535c15b410 2023-12-19T17:59:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5354004280 con 0x7f535c15b410 2023-12-19T17:59:24.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f535c15dc30 con 0x7f535c15b410 2023-12-19T17:59:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.121+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f535c04ed30 con 0x7f535c15b410 2023-12-19T17:59:24.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.125+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f53540043e0 con 0x7f535c15b410 2023-12-19T17:59:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.125+0000 7f5343fff700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5348065ad0 0x7f5348067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.125+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f5354022070 con 0x7f535c15b410 2023-12-19T17:59:24.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.125+0000 7f535b7fe700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5348065ad0 0x7f5348067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.125+0000 7f535b7fe700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5348065ad0 0x7f5348067f90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f534c000f60 tx=0x7f534c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.133+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5354052760 con 0x7f535c15b410 2023-12-19T17:59:24.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.305+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f535c06d050 con 0x7f535c15b410 2023-12-19T17:59:24.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.305+0000 7f5343fff700 1 -- 172.21.15.45:0/773594350 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5354055d80 con 0x7f535c15b410 2023-12-19T17:59:24.310 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:59:24.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5348065ad0 msgr2=0x7f5348067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5348065ad0 0x7f5348067f90 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f534c000f60 tx=0x7f534c009040 comp rx=0 tx=0).stop 2023-12-19T17:59:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 msgr2=0x7f535c1570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 0x7f535c1570e0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f535c06aac0 tx=0x7f5354004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 shutdown_connections 2023-12-19T17:59:24.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5348065ad0 0x7f5348067f90 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f535c15b410 0x7f535c1570e0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f535c0cc690 0x7f535c15d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 --2- 172.21.15.45:0/773594350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f535c0cb8d0 0x7f535c14f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 >> 172.21.15.45:0/773594350 conn(0x7f535c071990 msgr2=0x7f535c0acac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 shutdown_connections 2023-12-19T17:59:24.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.309+0000 7f5361ba7700 1 -- 172.21.15.45:0/773594350 wait complete. 2023-12-19T17:59:24.335 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:59:24.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.509+0000 7f85b5f16700 1 Processor -- start 2023-12-19T17:59:24.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.509+0000 7f85b5f16700 1 -- start start 2023-12-19T17:59:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5f16700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5f16700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85b00d25f0 0x7f85b00cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5f16700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b015d300 con 0x7f85b015cf20 2023-12-19T17:59:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5f16700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85b00d1360 con 0x7f85b00d25f0 2023-12-19T17:59:24.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5f16700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b00d1550 con 0x7f85b00b8580 2023-12-19T17:59:24.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5715700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85b00d25f0 0x7f85b00cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b4f14700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f85b015cf20 0x7f85b00d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33276/0 (socket says 172.21.15.45:33276) 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b4f14700 1 -- 172.21.15.45:0/3872909934 learned_addr learned my addr 172.21.15.45:0/3872909934 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85affff700 1 --2- 172.21.15.45:0/3872909934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5715700 1 -- 172.21.15.45:0/3872909934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 msgr2=0x7f85b00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5715700 1 --2- 172.21.15.45:0/3872909934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b00cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5715700 1 -- 172.21.15.45:0/3872909934 >> v1:172.21.15.45:6789/0 conn(0x7f85b015cf20 legacy=0x7f85b00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85b5715700 1 -- 172.21.15.45:0/3872909934 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b00d1830 con 0x7f85b00d25f0 2023-12-19T17:59:24.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.513+0000 7f85af7fe700 1 -- 172.21.15.45:0/3872909934 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3159054602 0 0) 0x7f85b015d300 con 0x7f85b015cf20 2023-12-19T17:59:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5715700 1 --2- 172.21.15.45:0/3872909934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b00d25f0 0x7f85b00cde00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009d90 tx=0x7f85a800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1daac39af8c6d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85af7fe700 1 -- 172.21.15.45:0/3872909934 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a800e070 con 0x7f85b00d25f0 2023-12-19T17:59:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85af7fe700 1 -- 172.21.15.45:0/3872909934 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a800bb20 con 0x7f85b00d25f0 2023-12-19T17:59:24.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85af7fe700 1 -- 172.21.15.45:0/3872909934 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8012430 con 0x7f85b00d25f0 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 -- 172.21.15.45:0/3872909934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b00d25f0 msgr2=0x7f85b00cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 --2- 172.21.15.45:0/3872909934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b00d25f0 0x7f85b00cde00 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009d90 tx=0x7f85a800b330 comp rx=0 tx=0).stop 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 -- 172.21.15.45:0/3872909934 shutdown_connections 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 --2- 172.21.15.45:0/3872909934 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b00d25f0 0x7f85b00cde00 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 --2- 172.21.15.45:0/3872909934 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b00cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 -- 172.21.15.45:0/3872909934 >> 172.21.15.45:0/3872909934 conn(0x7f85b00b4670 msgr2=0x7f85b00b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 -- 172.21.15.45:0/3872909934 shutdown_connections 2023-12-19T17:59:24.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 -- 172.21.15.45:0/3872909934 wait complete. 2023-12-19T17:59:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.517+0000 7f85b5f16700 1 Processor -- start 2023-12-19T17:59:24.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 -- start start 2023-12-19T17:59:24.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b0153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b00d25f0 0x7f85b00b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 0x7f85b00b3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b006d9a0 con 0x7f85b015cf20 2023-12-19T17:59:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b01594d0 con 0x7f85b00d25f0 2023-12-19T17:59:24.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5f16700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b006cd90 con 0x7f85b00b8580 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 0x7f85b00b3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 0x7f85b00b3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37524/0 (socket says 172.21.15.45:37524) 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 -- 172.21.15.45:0/2578604578 learned_addr learned my addr 172.21.15.45:0/2578604578 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b4f14700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b0153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85affff700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b00d25f0 0x7f85b00b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 -- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 msgr2=0x7f85b0153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b0153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 -- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b00d25f0 msgr2=0x7f85b00b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b00d25f0 0x7f85b00b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 -- 172.21.15.45:0/2578604578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a8009a70 con 0x7f85b015cf20 2023-12-19T17:59:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.521+0000 7f85b5715700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 0x7f85b00b3910 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f85b008bc80 tx=0x7f85a8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8012430 con 0x7f85b015cf20 2023-12-19T17:59:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a8020070 con 0x7f85b015cf20 2023-12-19T17:59:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a8004280 con 0x7f85b015cf20 2023-12-19T17:59:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b006d070 con 0x7f85b015cf20 2023-12-19T17:59:24.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b006d630 con 0x7f85b015cf20 2023-12-19T17:59:24.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b006db50 con 0x7f85b015cf20 2023-12-19T17:59:24.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.525+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85a80043e0 con 0x7f85b015cf20 2023-12-19T17:59:24.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.529+0000 7f85ad7fa700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8594065ad0 0x7f8594067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.529+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f85a8022070 con 0x7f85b015cf20 2023-12-19T17:59:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.529+0000 7f85b4f14700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8594065ad0 0x7f8594067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.529+0000 7f85b4f14700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8594065ad0 0x7f8594067f90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f85a4001030 tx=0x7f85a4007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.537+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f85b006db50 con 0x7f85b015cf20 2023-12-19T17:59:24.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.713+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f85b004ed30 con 0x7f85b015cf20 2023-12-19T17:59:24.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.717+0000 7f85ad7fa700 1 -- 172.21.15.45:0/2578604578 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v72) v1 ==== 106+0+11 (secure 0 0 0) 0x7f85a802c020 con 0x7f85b015cf20 2023-12-19T17:59:24.724 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:24.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8594065ad0 msgr2=0x7f8594067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8594065ad0 0x7f8594067f90 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f85a4001030 tx=0x7f85a4007e00 comp rx=0 tx=0).stop 2023-12-19T17:59:24.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 msgr2=0x7f85b00b3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 0x7f85b00b3910 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f85b008bc80 tx=0x7f85a8004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 shutdown_connections 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8594065ad0 0x7f8594067f90 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85b015cf20 0x7f85b00b3910 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85b00d25f0 0x7f85b00b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 --2- 172.21.15.45:0/2578604578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f85b00b8580 0x7f85b0153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.721+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 >> 172.21.15.45:0/2578604578 conn(0x7f85b00b4670 msgr2=0x7f85b00b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.725+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 shutdown_connections 2023-12-19T17:59:24.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.725+0000 7f85b5f16700 1 -- 172.21.15.45:0/2578604578 wait complete. 2023-12-19T17:59:24.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:24.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.921+0000 7f4820f2e700 1 Processor -- start 2023-12-19T17:59:24.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.921+0000 7f4820f2e700 1 -- start start 2023-12-19T17:59:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.925+0000 7f4820f2e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f481c159a50 0x7f481c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.925+0000 7f4820f2e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f481c15e450 0x7f481c06fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.925+0000 7f4820f2e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f481c0c3c50 con 0x7f481c0af720 2023-12-19T17:59:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.925+0000 7f4820f2e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c070540 con 0x7f481c15e450 2023-12-19T17:59:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.925+0000 7f4820f2e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f481c06c760 con 0x7f481c159a50 2023-12-19T17:59:24.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4812ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f481c15e450 0x7f481c06fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f481c159a50 0x7f481c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481bfff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f481c0af720 0x7f481c06d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:37488/0 (socket says 172.21.15.45:37488) 2023-12-19T17:59:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481bfff700 1 -- 172.21.15.45:0/2851630845 learned_addr learned my addr 172.21.15.45:0/2851630845 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:24.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481affd700 1 -- 172.21.15.45:0/2851630845 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119789711 0 0) 0x7f481c0c3c50 con 0x7f481c0af720 2023-12-19T17:59:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4812ffd700 1 -- 172.21.15.45:0/2851630845 >> v2:172.21.15.73:3300/0 conn(0x7f481c159a50 msgr2=0x7f481c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4812ffd700 1 --2- 172.21.15.45:0/2851630845 >> v2:172.21.15.73:3300/0 conn(0x7f481c159a50 0x7f481c0c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4812ffd700 1 -- 172.21.15.45:0/2851630845 >> v1:172.21.15.73:6789/0 conn(0x7f481c0af720 legacy=0x7f481c06d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4812ffd700 1 -- 172.21.15.45:0/2851630845 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c06ca40 con 0x7f481c15e450 2023-12-19T17:59:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4812ffd700 1 --2- 172.21.15.45:0/2851630845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c15e450 0x7f481c06fba0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f481c0c5840 tx=0x7f4804009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f360e0326cbe71e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481affd700 1 -- 172.21.15.45:0/2851630845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011830 con 0x7f481c15e450 2023-12-19T17:59:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481affd700 1 -- 172.21.15.45:0/2851630845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4804011990 con 0x7f481c15e450 2023-12-19T17:59:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f481affd700 1 -- 172.21.15.45:0/2851630845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804011d20 con 0x7f481c15e450 2023-12-19T17:59:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4820f2e700 1 -- 172.21.15.45:0/2851630845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c15e450 msgr2=0x7f481c06fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4820f2e700 1 --2- 172.21.15.45:0/2851630845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c15e450 0x7f481c06fba0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f481c0c5840 tx=0x7f4804009b30 comp rx=0 tx=0).stop 2023-12-19T17:59:24.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4820f2e700 1 -- 172.21.15.45:0/2851630845 shutdown_connections 2023-12-19T17:59:24.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4820f2e700 1 --2- 172.21.15.45:0/2851630845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c15e450 0x7f481c06fba0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4820f2e700 1 --2- 172.21.15.45:0/2851630845 >> v2:172.21.15.73:3300/0 conn(0x7f481c159a50 0x7f481c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.929+0000 7f4820f2e700 1 -- 172.21.15.45:0/2851630845 >> 172.21.15.45:0/2851630845 conn(0x7f481c0cb900 msgr2=0x7f481c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:24.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.933+0000 7f4820f2e700 1 -- 172.21.15.45:0/2851630845 shutdown_connections 2023-12-19T17:59:24.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.933+0000 7f4820f2e700 1 -- 172.21.15.45:0/2851630845 wait complete. 2023-12-19T17:59:24.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.933+0000 7f4820f2e700 1 Processor -- start 2023-12-19T17:59:24.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.933+0000 7f4820f2e700 1 -- start start 2023-12-19T17:59:24.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 0x7f481c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f481c159a50 0x7f481c1f3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f481c15e450 0x7f481c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c0c71c0 con 0x7f481c0af720 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f481c1f4cb0 con 0x7f481c159a50 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481c1f46f0 con 0x7f481c15e450 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 0x7f481c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 0x7f481c148e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37552/0 (socket says 172.21.15.45:37552) 2023-12-19T17:59:24.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 -- 172.21.15.45:0/179186099 learned_addr learned my addr 172.21.15.45:0/179186099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4812ffd700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f481c159a50 0x7f481c1f3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481bfff700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f481c15e450 0x7f481c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 -- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f481c15e450 msgr2=0x7f481c06d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f481c15e450 0x7f481c06d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 -- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f481c159a50 msgr2=0x7f481c1f3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f481c159a50 0x7f481c1f3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 -- 172.21.15.45:0/179186099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48040094b0 con 0x7f481c0af720 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4812ffd700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f481c159a50 0x7f481c1f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481bfff700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f481c15e450 0x7f481c06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f481b7fe700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 0x7f481c148e20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f480c00ea00 tx=0x7f480c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c009720 con 0x7f481c0af720 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480c00c850 con 0x7f481c0af720 2023-12-19T17:59:24.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f481c1f49d0 con 0x7f481c0af720 2023-12-19T17:59:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f480c00cbc0 con 0x7f481c0af720 2023-12-19T17:59:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.937+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f481c15a1f0 con 0x7f481c0af720 2023-12-19T17:59:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.941+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f481c0cf9a0 con 0x7f481c0af720 2023-12-19T17:59:24.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.941+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f480c00cd20 con 0x7f481c0af720 2023-12-19T17:59:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.941+0000 7f4818ff9700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47fc065ad0 0x7f47fc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:24.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.941+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f480c083690 con 0x7f481c0af720 2023-12-19T17:59:24.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.945+0000 7f4812ffd700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47fc065ad0 0x7f47fc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:24.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.945+0000 7f4812ffd700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47fc065ad0 0x7f47fc067f90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f481c15e830 tx=0x7f4804008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:24.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:24.949+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f480c050c60 con 0x7f481c0af720 2023-12-19T17:59:25.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.161+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f481c067760 con 0x7f481c0af720 2023-12-19T17:59:25.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.161+0000 7f4818ff9700 1 -- 172.21.15.45:0/179186099 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f480c054280 con 0x7f481c0af720 2023-12-19T17:59:25.166 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:25.167 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:18.814594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:59:25.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47fc065ad0 msgr2=0x7f47fc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47fc065ad0 0x7f47fc067f90 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f481c15e830 tx=0x7f4804008030 comp rx=0 tx=0).stop 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 msgr2=0x7f481c148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 0x7f481c148e20 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f480c00ea00 tx=0x7f480c00edc0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 shutdown_connections 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f47fc065ad0 0x7f47fc067f90 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f481c15e450 0x7f481c06d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f481c159a50 0x7f481c1f3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 --2- 172.21.15.45:0/179186099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f481c0af720 0x7f481c148e20 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 >> 172.21.15.45:0/179186099 conn(0x7f481c0cb900 msgr2=0x7f481c06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:25.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 shutdown_connections 2023-12-19T17:59:25.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.165+0000 7f4820f2e700 1 -- 172.21.15.45:0/179186099 wait complete. 2023-12-19T17:59:25.172 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-19T17:59:25.192 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:25.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.361+0000 7f0b5092b700 1 Processor -- start 2023-12-19T17:59:25.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.361+0000 7f0b5092b700 1 -- start start 2023-12-19T17:59:25.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b5092b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b4c1611c0 0x7f0b4c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b5092b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c0af720 0x7f0b4c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b5092b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b4c0b00c0 con 0x7f0b4c1615a0 2023-12-19T17:59:25.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b5092b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b4c070340 con 0x7f0b4c1611c0 2023-12-19T17:59:25.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b5092b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0c3f90 con 0x7f0b4c0af720 2023-12-19T17:59:25.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b43fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0b4c1615a0 0x7f0b4c06d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33278/0 (socket says 172.21.15.45:33278) 2023-12-19T17:59:25.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b43fff700 1 -- 172.21.15.45:0/2602339892 learned_addr learned my addr 172.21.15.45:0/2602339892 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:25.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4ad9d700 1 --2- 172.21.15.45:0/2602339892 >> v2:172.21.15.45:3300/0 conn(0x7f0b4c1611c0 0x7f0b4c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4b59e700 1 --2- 172.21.15.45:0/2602339892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c0af720 0x7f0b4c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4a59c700 1 -- 172.21.15.45:0/2602339892 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090548266 0 0) 0x7f0b4c0b00c0 con 0x7f0b4c1615a0 2023-12-19T17:59:25.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4a59c700 1 -- 172.21.15.45:0/2602339892 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b380035d0 con 0x7f0b4c1615a0 2023-12-19T17:59:25.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4b59e700 1 -- 172.21.15.45:0/2602339892 >> v2:172.21.15.45:3300/0 conn(0x7f0b4c1611c0 msgr2=0x7f0b4c0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:25.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4a59c700 1 -- 172.21.15.45:0/2602339892 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1939122899 0 0) 0x7f0b380035d0 con 0x7f0b4c1615a0 2023-12-19T17:59:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4b59e700 1 --2- 172.21.15.45:0/2602339892 >> v2:172.21.15.45:3300/0 conn(0x7f0b4c1611c0 0x7f0b4c0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4b59e700 1 -- 172.21.15.45:0/2602339892 >> v1:172.21.15.45:6789/0 conn(0x7f0b4c1615a0 legacy=0x7f0b4c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4b59e700 1 -- 172.21.15.45:0/2602339892 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c0c4270 con 0x7f0b4c0af720 2023-12-19T17:59:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4ad9d700 1 --2- 172.21.15.45:0/2602339892 >> v2:172.21.15.45:3300/0 conn(0x7f0b4c1611c0 0x7f0b4c0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:25.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.365+0000 7f0b4b59e700 1 --2- 172.21.15.45:0/2602339892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c0af720 0x7f0b4c0afb80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009d90 tx=0x7f0b4400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f836906fabb2e11e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b4a59c700 1 -- 172.21.15.45:0/2602339892 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4400e070 con 0x7f0b4c0af720 2023-12-19T17:59:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b4a59c700 1 -- 172.21.15.45:0/2602339892 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b44003a40 con 0x7f0b4c0af720 2023-12-19T17:59:25.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b4a59c700 1 -- 172.21.15.45:0/2602339892 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34001670 con 0x7f0b4c0af720 2023-12-19T17:59:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 -- 172.21.15.45:0/2602339892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c0af720 msgr2=0x7f0b4c0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2602339892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c0af720 0x7f0b4c0afb80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0b44009d90 tx=0x7f0b4400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 -- 172.21.15.45:0/2602339892 shutdown_connections 2023-12-19T17:59:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2602339892 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c0af720 0x7f0b4c0afb80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2602339892 >> v2:172.21.15.45:3300/0 conn(0x7f0b4c1611c0 0x7f0b4c0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 -- 172.21.15.45:0/2602339892 >> 172.21.15.45:0/2602339892 conn(0x7f0b4c0cb900 msgr2=0x7f0b4c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 -- 172.21.15.45:0/2602339892 shutdown_connections 2023-12-19T17:59:25.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 -- 172.21.15.45:0/2602339892 wait complete. 2023-12-19T17:59:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.369+0000 7f0b5092b700 1 Processor -- start 2023-12-19T17:59:25.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 -- start start 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b4c0af720 0x7f0b4c0c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 0x7f0b4c162130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c1615a0 0x7f0b4c152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c0c6870 con 0x7f0b4c1611c0 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c162670 con 0x7f0b4c0af720 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b4c1628a0 con 0x7f0b4c1615a0 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 0x7f0b4c162130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 0x7f0b4c162130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37562/0 (socket says 172.21.15.45:37562) 2023-12-19T17:59:25.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 -- 172.21.15.45:0/2098464030 learned_addr learned my addr 172.21.15.45:0/2098464030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b4ad9d700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b4c0af720 0x7f0b4c0c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b4b59e700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c1615a0 0x7f0b4c152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 -- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c1615a0 msgr2=0x7f0b4c152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c1615a0 0x7f0b4c152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 -- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b4c0af720 msgr2=0x7f0b4c0c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b4c0af720 0x7f0b4c0c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 -- 172.21.15.45:0/2098464030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c0094b0 con 0x7f0b4c1611c0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b43fff700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 0x7f0b4c162130 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c7b0 tx=0x7f0b3400cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34004ca0 con 0x7f0b4c1611c0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b34004e00 con 0x7f0b4c1611c0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b34007310 con 0x7f0b4c1611c0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b44009a70 con 0x7f0b4c1611c0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.373+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b4c162e60 con 0x7f0b4c1611c0 2023-12-19T17:59:25.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.377+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b4c06e760 con 0x7f0b4c1611c0 2023-12-19T17:59:25.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.377+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b34007470 con 0x7f0b4c1611c0 2023-12-19T17:59:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.381+0000 7f0b437fe700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b2c065ad0 0x7f0b2c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.381+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0b340831a0 con 0x7f0b4c1611c0 2023-12-19T17:59:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.381+0000 7f0b4ad9d700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b2c065ad0 0x7f0b2c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.381+0000 7f0b4ad9d700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b2c065ad0 0x7f0b2c067f90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0cdfa0 tx=0x7f0b3c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:25.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.385+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0b340506e0 con 0x7f0b4c1611c0 2023-12-19T17:59:25.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.561+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b4c067760 con 0x7f0b4c1611c0 2023-12-19T17:59:25.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.565+0000 7f0b437fe700 1 -- 172.21.15.45:0/2098464030 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f0b34053d00 con 0x7f0b4c1611c0 2023-12-19T17:59:25.571 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:25.571 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:57:15.816595+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6836/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6837/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6837/4130274339":"2023-12-20T17:57:08.416683+0000","172.21.15.45:6836/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6836/4130274339":"2023-12-20T17:57:08.416683+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:25.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b2c065ad0 msgr2=0x7f0b2c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b2c065ad0 0x7f0b2c067f90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c0cdfa0 tx=0x7f0b3c009240 comp rx=0 tx=0).stop 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 msgr2=0x7f0b4c162130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 0x7f0b4c162130 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0b3400c7b0 tx=0x7f0b3400cac0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 shutdown_connections 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b2c065ad0 0x7f0b2c067f90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b4c1615a0 0x7f0b4c152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b4c1611c0 0x7f0b4c162130 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 --2- 172.21.15.45:0/2098464030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b4c0af720 0x7f0b4c0c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 >> 172.21.15.45:0/2098464030 conn(0x7f0b4c0cb900 msgr2=0x7f0b4c15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 shutdown_connections 2023-12-19T17:59:25.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.569+0000 7f0b5092b700 1 -- 172.21.15.45:0/2098464030 wait complete. 2023-12-19T17:59:25.597 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T17:59:25.597 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e9a5d700 1 Processor -- start 2023-12-19T17:59:25.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e9a5d700 1 -- start start 2023-12-19T17:59:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e9a5d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51e415cec0 0x7f51e40cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e9a5d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e40aeeb0 con 0x7f51e41609b0 2023-12-19T17:59:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e9a5d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51e415d2a0 con 0x7f51e40ca6b0 2023-12-19T17:59:25.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e9a5d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e4161520 con 0x7f51e415cec0 2023-12-19T17:59:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e8a5b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f51e415cec0 0x7f51e40cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f51e41609b0 0x7f51e40c9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33284/0 (socket says 172.21.15.45:33284) 2023-12-19T17:59:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e3fff700 1 -- 172.21.15.45:0/2974227631 learned_addr learned my addr 172.21.15.45:0/2974227631 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e8a5b700 1 -- 172.21.15.45:0/2974227631 >> v1:172.21.15.73:6789/0 conn(0x7f51e40ca6b0 legacy=0x7f51e4070c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e8a5b700 1 -- 172.21.15.45:0/2974227631 >> v1:172.21.15.45:6789/0 conn(0x7f51e41609b0 legacy=0x7f51e40c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.777+0000 7f51e8a5b700 1 -- 172.21.15.45:0/2974227631 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e4070180 con 0x7f51e415cec0 2023-12-19T17:59:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e8a5b700 1 --2- 172.21.15.45:0/2974227631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415cec0 0x7f51e40cd520 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009850 tx=0x7f51d8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6613e56430242bdb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e37fe700 1 -- 172.21.15.45:0/2974227631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8011830 con 0x7f51e415cec0 2023-12-19T17:59:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e37fe700 1 -- 172.21.15.45:0/2974227631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d8011990 con 0x7f51e415cec0 2023-12-19T17:59:25.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e37fe700 1 -- 172.21.15.45:0/2974227631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d8011d20 con 0x7f51e415cec0 2023-12-19T17:59:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2974227631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415cec0 msgr2=0x7f51e40cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2974227631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415cec0 0x7f51e40cd520 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009850 tx=0x7f51d8009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2974227631 shutdown_connections 2023-12-19T17:59:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2974227631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e415cec0 0x7f51e40cd520 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2974227631 >> 172.21.15.45:0/2974227631 conn(0x7f51e40cf950 msgr2=0x7f51e40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2974227631 shutdown_connections 2023-12-19T17:59:25.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.781+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2974227631 wait complete. 2023-12-19T17:59:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 Processor -- start 2023-12-19T17:59:25.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 -- start start 2023-12-19T17:59:25.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e40ca6b0 0x7f51e4159810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51e415cec0 0x7f51e40ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 0x7f51e40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4159d50 con 0x7f51e41609b0 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40b3670 con 0x7f51e40ca6b0 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e9a5d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40acd10 con 0x7f51e415cec0 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 0x7f51e40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 0x7f51e40b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37578/0 (socket says 172.21.15.45:37578) 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 -- 172.21.15.45:0/2392056575 learned_addr learned my addr 172.21.15.45:0/2392056575 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e3fff700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51e415cec0 0x7f51e40ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e8a5b700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e40ca6b0 0x7f51e4159810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 -- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51e415cec0 msgr2=0x7f51e40ac2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51e415cec0 0x7f51e40ac2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 -- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e40ca6b0 msgr2=0x7f51e4159810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e40ca6b0 0x7f51e4159810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.785+0000 7f51e925c700 1 -- 172.21.15.45:0/2392056575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d80094b0 con 0x7f51e41609b0 2023-12-19T17:59:25.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e925c700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 0x7f51e40b4660 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00cc80 tx=0x7f51dc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc003c20 con 0x7f51e41609b0 2023-12-19T17:59:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc003d80 con 0x7f51e41609b0 2023-12-19T17:59:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e40b38a0 con 0x7f51e41609b0 2023-12-19T17:59:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00aaa0 con 0x7f51e41609b0 2023-12-19T17:59:25.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e40b3e60 con 0x7f51e41609b0 2023-12-19T17:59:25.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.789+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e406af10 con 0x7f51e41609b0 2023-12-19T17:59:25.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.793+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f51dc00ac00 con 0x7f51e41609b0 2023-12-19T17:59:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.793+0000 7f51e17fa700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51c8065ad0 0x7f51c8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.793+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f51dc083620 con 0x7f51e41609b0 2023-12-19T17:59:25.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.793+0000 7f51e8a5b700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51c8065ad0 0x7f51c8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:25.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.793+0000 7f51e8a5b700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51c8065ad0 0x7f51c8067f90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009fd0 tx=0x7f51d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:25.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:25.801+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f51dc050ad0 con 0x7f51e41609b0 2023-12-19T17:59:26.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.009+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51e4067760 con 0x7f51e41609b0 2023-12-19T17:59:26.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.009+0000 7f51e17fa700 1 -- 172.21.15.45:0/2392056575 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f51dc0540f0 con 0x7f51e41609b0 2023-12-19T17:59:26.015 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:26.015 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:18.814594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:59:26.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51c8065ad0 msgr2=0x7f51c8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51c8065ad0 0x7f51c8067f90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f51d8009fd0 tx=0x7f51d8008030 comp rx=0 tx=0).stop 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 msgr2=0x7f51e40b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 0x7f51e40b4660 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00cc80 tx=0x7f51dc00cf90 comp rx=0 tx=0).stop 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 shutdown_connections 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f51c8065ad0 0x7f51c8067f90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f51e41609b0 0x7f51e40b4660 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f51e415cec0 0x7f51e40ac2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 --2- 172.21.15.45:0/2392056575 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f51e40ca6b0 0x7f51e4159810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 >> 172.21.15.45:0/2392056575 conn(0x7f51e40cf950 msgr2=0x7f51e415a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 shutdown_connections 2023-12-19T17:59:26.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.013+0000 7f51e9a5d700 1 -- 172.21.15.45:0/2392056575 wait complete. 2023-12-19T17:59:26.020 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-19T17:59:26.041 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:26.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.221+0000 7f6c232fe700 1 Processor -- start 2023-12-19T17:59:26.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c232fe700 1 -- start start 2023-12-19T17:59:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c232fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 0x7f6c1c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c232fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c1c06cad0 0x7f6c1c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c232fe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c1c06f0a0 con 0x7f6c1c0af720 2023-12-19T17:59:26.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c232fe700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c1c06ea90 con 0x7f6c1c06cad0 2023-12-19T17:59:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c232fe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0c3f60 con 0x7f6c1c15ae20 2023-12-19T17:59:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c222fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 0x7f6c1c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c222fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 0x7f6c1c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38130/0 (socket says 172.21.15.45:38130) 2023-12-19T17:59:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c21afb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6c1c06cad0 0x7f6c1c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.225+0000 7f6c222fc700 1 -- 172.21.15.45:0/1913497170 learned_addr learned my addr 172.21.15.45:0/1913497170 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c222fc700 1 -- 172.21.15.45:0/1913497170 >> v2:172.21.15.73:3300/0 conn(0x7f6c1c06cad0 msgr2=0x7f6c1c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c222fc700 1 --2- 172.21.15.45:0/1913497170 >> v2:172.21.15.73:3300/0 conn(0x7f6c1c06cad0 0x7f6c1c0c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c222fc700 1 -- 172.21.15.45:0/1913497170 >> v1:172.21.15.73:6789/0 conn(0x7f6c1c0af720 legacy=0x7f6c1c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c222fc700 1 -- 172.21.15.45:0/1913497170 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c0c4240 con 0x7f6c1c15ae20 2023-12-19T17:59:26.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c222fc700 1 --2- 172.21.15.45:0/1913497170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 0x7f6c1c15be40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009910 tx=0x7f6c18009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c877574904331bd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c212fa700 1 -- 172.21.15.45:0/1913497170 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18011830 con 0x7f6c1c15ae20 2023-12-19T17:59:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c212fa700 1 -- 172.21.15.45:0/1913497170 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c18011990 con 0x7f6c1c15ae20 2023-12-19T17:59:26.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c212fa700 1 -- 172.21.15.45:0/1913497170 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c18011d40 con 0x7f6c1c15ae20 2023-12-19T17:59:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 -- 172.21.15.45:0/1913497170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 msgr2=0x7f6c1c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 --2- 172.21.15.45:0/1913497170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 0x7f6c1c15be40 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6c18009910 tx=0x7f6c18009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 -- 172.21.15.45:0/1913497170 shutdown_connections 2023-12-19T17:59:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 --2- 172.21.15.45:0/1913497170 >> v2:172.21.15.73:3300/0 conn(0x7f6c1c06cad0 0x7f6c1c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 --2- 172.21.15.45:0/1913497170 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c15ae20 0x7f6c1c15be40 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 -- 172.21.15.45:0/1913497170 >> 172.21.15.45:0/1913497170 conn(0x7f6c1c0cb900 msgr2=0x7f6c1c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 -- 172.21.15.45:0/1913497170 shutdown_connections 2023-12-19T17:59:26.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.229+0000 7f6c232fe700 1 -- 172.21.15.45:0/1913497170 wait complete. 2023-12-19T17:59:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 Processor -- start 2023-12-19T17:59:26.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 -- start start 2023-12-19T17:59:26.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c06cad0 0x7f6c1c0caab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 0x7f6c1c1f1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c1c15ae20 0x7f6c1c0b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c1f24d0 con 0x7f6c1c0af720 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0b2f20 con 0x7f6c1c15ae20 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c232fe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c1c0b3200 con 0x7f6c1c06cad0 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c21afb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 0x7f6c1c1f1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c222fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c06cad0 0x7f6c1c0caab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c21afb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 0x7f6c1c1f1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37586/0 (socket says 172.21.15.45:37586) 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c21afb700 1 -- 172.21.15.45:0/2841237779 learned_addr learned my addr 172.21.15.45:0/2841237779 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:26.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.233+0000 7f6c22afd700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c1c15ae20 0x7f6c1c0b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c21afb700 1 -- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c06cad0 msgr2=0x7f6c1c0caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c21afb700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c06cad0 0x7f6c1c0caab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c21afb700 1 -- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c1c15ae20 msgr2=0x7f6c1c0b3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c21afb700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c1c15ae20 0x7f6c1c0b3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c21afb700 1 -- 172.21.15.45:0/2841237779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c18009570 con 0x7f6c1c0af720 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c21afb700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 0x7f6c1c1f1f90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00e9a0 tx=0x7f6c0c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c009720 con 0x7f6c1c0af720 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c0c00c690 con 0x7f6c1c0af720 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c0c00ca40 con 0x7f6c1c0af720 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c1c0b34e0 con 0x7f6c1c0af720 2023-12-19T17:59:26.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c1c0b3aa0 con 0x7f6c1c0af720 2023-12-19T17:59:26.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.237+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c1c067760 con 0x7f6c1c0af720 2023-12-19T17:59:26.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.241+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6c0c00cba0 con 0x7f6c1c0af720 2023-12-19T17:59:26.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.241+0000 7f6c12ffd700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6c00065ad0 0x7f6c00067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.241+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f6c0c083570 con 0x7f6c1c0af720 2023-12-19T17:59:26.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.241+0000 7f6c222fc700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6c00065ad0 0x7f6c00067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.245+0000 7f6c222fc700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6c00065ad0 0x7f6c00067f90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6c18014040 tx=0x7f6c18008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:26.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.249+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6c0c050ab0 con 0x7f6c1c0af720 2023-12-19T17:59:26.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.461+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c1c155620 con 0x7f6c1c0af720 2023-12-19T17:59:26.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c12ffd700 1 -- 172.21.15.45:0/2841237779 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f6c0c0540d0 con 0x7f6c1c0af720 2023-12-19T17:59:26.469 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:26.469 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":49,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:57:09.426263+0000","modified":"2023-12-19T17:57:18.814594+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":69,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56057},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56057":{"gid":56057,"name":"a","rank":0,"incarnation":46,"state":"up:active","state_seq":4,"addr":"172.21.15.45:6837/2159224632","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2159224632},{"type":"v1","addr":"172.21.15.45:6837","nonce":2159224632}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9,10],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6c00065ad0 msgr2=0x7f6c00067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6c00065ad0 0x7f6c00067f90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f6c18014040 tx=0x7f6c18008030 comp rx=0 tx=0).stop 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 msgr2=0x7f6c1c1f1f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 0x7f6c1c1f1f90 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6c0c00e9a0 tx=0x7f6c0c00ecb0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 shutdown_connections 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6c00065ad0 0x7f6c00067f90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c1c15ae20 0x7f6c1c0b3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6c1c0af720 0x7f6c1c1f1f90 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 --2- 172.21.15.45:0/2841237779 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6c1c06cad0 0x7f6c1c0caab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.465+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 >> 172.21.15.45:0/2841237779 conn(0x7f6c1c0cb900 msgr2=0x7f6c1c0cdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:26.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.469+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 shutdown_connections 2023-12-19T17:59:26.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.469+0000 7f6c232fe700 1 -- 172.21.15.45:0/2841237779 wait complete. 2023-12-19T17:59:26.474 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 49 2023-12-19T17:59:26.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:26.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 Processor -- start 2023-12-19T17:59:26.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 -- start start 2023-12-19T17:59:26.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 0x7f93d00c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93d0164a70 0x7f93d00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d00cce30 0x7f93d00cd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00cdb80 con 0x7f93d00cce30 2023-12-19T17:59:26.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93d00cde60 con 0x7f93d0164a70 2023-12-19T17:59:26.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93d5c82700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00ce140 con 0x7f93d0164690 2023-12-19T17:59:26.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93cffff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f93d00cce30 0x7f93d00cd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 0x7f93d00c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93ceffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f93d0164a70 0x7f93d00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93cf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 0x7f93d00c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38144/0 (socket says 172.21.15.45:38144) 2023-12-19T17:59:26.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.673+0000 7f93cf7fe700 1 -- 172.21.15.45:0/756786993 learned_addr learned my addr 172.21.15.45:0/756786993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cf7fe700 1 -- 172.21.15.45:0/756786993 >> v2:172.21.15.73:3300/0 conn(0x7f93d0164a70 msgr2=0x7f93d00c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cf7fe700 1 --2- 172.21.15.45:0/756786993 >> v2:172.21.15.73:3300/0 conn(0x7f93d0164a70 0x7f93d00c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cf7fe700 1 -- 172.21.15.45:0/756786993 >> v2:172.21.15.45:3300/0 conn(0x7f93d00cce30 msgr2=0x7f93d00cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cf7fe700 1 --2- 172.21.15.45:0/756786993 >> v2:172.21.15.45:3300/0 conn(0x7f93d00cce30 0x7f93d00cd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cf7fe700 1 -- 172.21.15.45:0/756786993 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d00ce420 con 0x7f93d0164690 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cffff700 1 --2- 172.21.15.45:0/756786993 >> v2:172.21.15.45:3300/0 conn(0x7f93d00cce30 0x7f93d00cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:26.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93cf7fe700 1 --2- 172.21.15.45:0/756786993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 0x7f93d00c3e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f93d00b1590 tx=0x7f93c000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e02bd83f3c6aac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93ce7fc700 1 -- 172.21.15.45:0/756786993 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000e070 con 0x7f93d0164690 2023-12-19T17:59:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93ce7fc700 1 -- 172.21.15.45:0/756786993 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c000b910 con 0x7f93d0164690 2023-12-19T17:59:26.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93ce7fc700 1 -- 172.21.15.45:0/756786993 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c000bcc0 con 0x7f93d0164690 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 -- 172.21.15.45:0/756786993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 msgr2=0x7f93d00c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 --2- 172.21.15.45:0/756786993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 0x7f93d00c3e00 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f93d00b1590 tx=0x7f93c000b330 comp rx=0 tx=0).stop 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 -- 172.21.15.45:0/756786993 shutdown_connections 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 --2- 172.21.15.45:0/756786993 >> v2:172.21.15.45:3300/0 conn(0x7f93d00cce30 0x7f93d00cd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 --2- 172.21.15.45:0/756786993 >> v2:172.21.15.73:3300/0 conn(0x7f93d0164a70 0x7f93d00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 --2- 172.21.15.45:0/756786993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d0164690 0x7f93d00c3e00 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 -- 172.21.15.45:0/756786993 >> 172.21.15.45:0/756786993 conn(0x7f93d00cba40 msgr2=0x7f93d00ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 -- 172.21.15.45:0/756786993 shutdown_connections 2023-12-19T17:59:26.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.677+0000 7f93d5c82700 1 -- 172.21.15.45:0/756786993 wait complete. 2023-12-19T17:59:26.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.681+0000 7f93d5c82700 1 Processor -- start 2023-12-19T17:59:26.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.681+0000 7f93d5c82700 1 -- start start 2023-12-19T17:59:26.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d00cce30 0x7f93d00c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 0x7f93d00b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d0164a70 0x7f93d015d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00c7190 con 0x7f93d0164690 2023-12-19T17:59:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00c7470 con 0x7f93d0164a70 2023-12-19T17:59:26.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93d00c7750 con 0x7f93d00cce30 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 0x7f93d00b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 0x7f93d00b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37596/0 (socket says 172.21.15.45:37596) 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 -- 172.21.15.45:0/2459176783 learned_addr learned my addr 172.21.15.45:0/2459176783 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93cf7fe700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d00cce30 0x7f93d00c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93cffff700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d0164a70 0x7f93d015d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 -- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d00cce30 msgr2=0x7f93d00c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d00cce30 0x7f93d00c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 -- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d0164a70 msgr2=0x7f93d015d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d0164a70 0x7f93d015d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 -- 172.21.15.45:0/2459176783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c80094a0 con 0x7f93d0164690 2023-12-19T17:59:26.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93ceffd700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 0x7f93d00b3800 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e840 tx=0x7f93c400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:26.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40095a0 con 0x7f93d0164690 2023-12-19T17:59:26.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c4013680 con 0x7f93d0164690 2023-12-19T17:59:26.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93c0009b30 con 0x7f93d0164690 2023-12-19T17:59:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c40139f0 con 0x7f93d0164690 2023-12-19T17:59:26.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.685+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93d00c7d10 con 0x7f93d0164690 2023-12-19T17:59:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.689+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93d004ed30 con 0x7f93d0164690 2023-12-19T17:59:26.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.689+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f93c4013b50 con 0x7f93d0164690 2023-12-19T17:59:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.689+0000 7f93b7fff700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93bc065ad0 0x7f93bc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.693+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f93c4083440 con 0x7f93d0164690 2023-12-19T17:59:26.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.693+0000 7f93cf7fe700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93bc065ad0 0x7f93bc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:26.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.693+0000 7f93cf7fe700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93bc065ad0 0x7f93bc067f90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f93c000b370 tx=0x7f93c0009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:26.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.697+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f93c4050900 con 0x7f93d0164690 2023-12-19T17:59:26.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.881+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93d006c990 con 0x7f93d0164690 2023-12-19T17:59:26.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93b7fff700 1 -- 172.21.15.45:0/2459176783 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+18427 (secure 0 0 0) 0x7f93c4053f20 con 0x7f93d0164690 2023-12-19T17:59:26.889 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:26.889 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:57:15.816595+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:55:16.332981+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-19T17:55:17.225656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:55:27.316408+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6836/642740092":"2023-12-20T17:57:15.782855+0000","172.21.15.45:6837/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6837/4130274339":"2023-12-20T17:57:08.416683+0000","172.21.15.45:6836/2368378550":"2023-12-20T17:57:09.499680+0000","172.21.15.45:6836/4130274339":"2023-12-20T17:57:08.416683+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:26.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93bc065ad0 msgr2=0x7f93bc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93bc065ad0 0x7f93bc067f90 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f93c000b370 tx=0x7f93c0009000 comp rx=0 tx=0).stop 2023-12-19T17:59:26.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 msgr2=0x7f93d00b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:26.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 0x7f93d00b3800 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f93c400e840 tx=0x7f93c400eb50 comp rx=0 tx=0).stop 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 shutdown_connections 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93bc065ad0 0x7f93bc067f90 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f93d0164a70 0x7f93d015d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f93d0164690 0x7f93d00b3800 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 --2- 172.21.15.45:0/2459176783 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f93d00cce30 0x7f93d00c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.885+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 >> 172.21.15.45:0/2459176783 conn(0x7f93d00cba40 msgr2=0x7f93d00af460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.889+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 shutdown_connections 2023-12-19T17:59:26.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:26.889+0000 7f93d5c82700 1 -- 172.21.15.45:0/2459176783 wait complete. 2023-12-19T17:59:26.916 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T17:59:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.089+0000 7f35b21d5700 1 Processor -- start 2023-12-19T17:59:27.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.089+0000 7f35b21d5700 1 -- start start 2023-12-19T17:59:27.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b21d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac15cff0 0x7f35ac161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b21d5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f35ac06ddd0 0x7f35ac0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b21d5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35ac0ca520 0x7f35ac0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b21d5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac15d3d0 con 0x7f35ac0ca520 2023-12-19T17:59:27.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b21d5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0c9220 con 0x7f35ac06ddd0 2023-12-19T17:59:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b21d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0c9500 con 0x7f35ac15cff0 2023-12-19T17:59:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35ac0ca520 0x7f35ac0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f35ac0ca520 0x7f35ac0c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37600/0 (socket says 172.21.15.45:37600) 2023-12-19T17:59:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 -- 172.21.15.45:0/3405985671 learned_addr learned my addr 172.21.15.45:0/3405985671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b11d3700 1 --2- 172.21.15.45:0/3405985671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac15cff0 0x7f35ac161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b09d2700 1 --2- 172.21.15.45:0/3405985671 >> v2:172.21.15.73:3300/0 conn(0x7f35ac06ddd0 0x7f35ac0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 -- 172.21.15.45:0/3405985671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac15cff0 msgr2=0x7f35ac161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 --2- 172.21.15.45:0/3405985671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac15cff0 0x7f35ac161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 -- 172.21.15.45:0/3405985671 >> v2:172.21.15.73:3300/0 conn(0x7f35ac06ddd0 msgr2=0x7f35ac0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 --2- 172.21.15.45:0/3405985671 >> v2:172.21.15.73:3300/0 conn(0x7f35ac06ddd0 0x7f35ac0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 -- 172.21.15.45:0/3405985671 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0c97e0 con 0x7f35ac0ca520 2023-12-19T17:59:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35b19d4700 1 --2- 172.21.15.45:0/3405985671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac0ca520 0x7f35ac0c3920 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f35ac06ae40 tx=0x7f35a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac8acc5ae6f169d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.093+0000 7f35a3fff700 1 -- 172.21.15.45:0/3405985671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400e070 con 0x7f35ac0ca520 2023-12-19T17:59:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35a3fff700 1 -- 172.21.15.45:0/3405985671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a400b910 con 0x7f35ac0ca520 2023-12-19T17:59:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35a3fff700 1 -- 172.21.15.45:0/3405985671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a400bcc0 con 0x7f35ac0ca520 2023-12-19T17:59:27.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 -- 172.21.15.45:0/3405985671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac0ca520 msgr2=0x7f35ac0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 --2- 172.21.15.45:0/3405985671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac0ca520 0x7f35ac0c3920 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f35ac06ae40 tx=0x7f35a400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 -- 172.21.15.45:0/3405985671 shutdown_connections 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 --2- 172.21.15.45:0/3405985671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac0ca520 0x7f35ac0c3920 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 --2- 172.21.15.45:0/3405985671 >> v2:172.21.15.73:3300/0 conn(0x7f35ac06ddd0 0x7f35ac0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 --2- 172.21.15.45:0/3405985671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac15cff0 0x7f35ac161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 -- 172.21.15.45:0/3405985671 >> 172.21.15.45:0/3405985671 conn(0x7f35ac0cb900 msgr2=0x7f35ac0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:27.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 -- 172.21.15.45:0/3405985671 shutdown_connections 2023-12-19T17:59:27.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 -- 172.21.15.45:0/3405985671 wait complete. 2023-12-19T17:59:27.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.097+0000 7f35b21d5700 1 Processor -- start 2023-12-19T17:59:27.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 -- start start 2023-12-19T17:59:27.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 0x7f35ac0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac15cff0 0x7f35ac0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac1f1e20 0x7f35ac0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac153f10 con 0x7f35ac06ddd0 2023-12-19T17:59:27.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0c8720 con 0x7f35ac15cff0 2023-12-19T17:59:27.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac1535b0 con 0x7f35ac1f1e20 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 0x7f35ac0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 0x7f35ac0c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37610/0 (socket says 172.21.15.45:37610) 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 -- 172.21.15.45:0/2459646528 learned_addr learned my addr 172.21.15.45:0/2459646528 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b09d2700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac15cff0 0x7f35ac0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b19d4700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac1f1e20 0x7f35ac0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 -- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac1f1e20 msgr2=0x7f35ac0b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac1f1e20 0x7f35ac0b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 -- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac15cff0 msgr2=0x7f35ac0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac15cff0 0x7f35ac0c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 -- 172.21.15.45:0/2459646528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009b30 con 0x7f35ac06ddd0 2023-12-19T17:59:27.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b19d4700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac1f1e20 0x7f35ac0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:27.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b11d3700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 0x7f35ac0c5d60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f35a800e8a0 tx=0x7f35a800ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:27.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80095c0 con 0x7f35ac06ddd0 2023-12-19T17:59:27.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a8013680 con 0x7f35ac06ddd0 2023-12-19T17:59:27.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8013a10 con 0x7f35ac06ddd0 2023-12-19T17:59:27.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.101+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac1f2280 con 0x7f35ac06ddd0 2023-12-19T17:59:27.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.105+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac0c8440 con 0x7f35ac06ddd0 2023-12-19T17:59:27.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.105+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac154050 con 0x7f35ac06ddd0 2023-12-19T17:59:27.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.105+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f35a8013b70 con 0x7f35ac06ddd0 2023-12-19T17:59:27.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.109+0000 7f35a1ffb700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3590065ad0 0x7f3590067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.109+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f35a8083350 con 0x7f35ac06ddd0 2023-12-19T17:59:27.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.109+0000 7f35b09d2700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3590065ad0 0x7f3590067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.109+0000 7f35b09d2700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3590065ad0 0x7f3590067f90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f35ac151d10 tx=0x7f359c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:27.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.117+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f35ac154050 con 0x7f35ac06ddd0 2023-12-19T17:59:27.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.329+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f35ac154050 con 0x7f35ac06ddd0 2023-12-19T17:59:27.338 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T17:59:27.333+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T17:59:27.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.349+0000 7f35a1ffb700 1 -- 172.21.15.45:0/2459646528 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v50) v1 ==== 161+0+0 (secure 0 0 0) 0x7f35ac154050 con 0x7f35ac06ddd0 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3590065ad0 msgr2=0x7f3590067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3590065ad0 0x7f3590067f90 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f35ac151d10 tx=0x7f359c009240 comp rx=0 tx=0).stop 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 msgr2=0x7f35ac0c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 0x7f35ac0c5d60 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f35a800e8a0 tx=0x7f35a800ebb0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 shutdown_connections 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3590065ad0 0x7f3590067f90 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f35ac1f1e20 0x7f35ac0b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f35ac15cff0 0x7f35ac0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 --2- 172.21.15.45:0/2459646528 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f35ac06ddd0 0x7f35ac0c5d60 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 >> 172.21.15.45:0/2459646528 conn(0x7f35ac0cb900 msgr2=0x7f35ac15c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:27.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 shutdown_connections 2023-12-19T17:59:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.357+0000 7f35b21d5700 1 -- 172.21.15.45:0/2459646528 wait complete. 2023-12-19T17:59:27.362 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T17:59:27.373 INFO:tasks.ceph.mds.a.smithi045.stderr: -9667> 2023-12-19T17:57:20.815+0000 7f06fddc7700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:59:27.374 INFO:tasks.ceph.mds.a.smithi045.stderr: -9249> 2023-12-19T17:57:23.419+0000 7f06fa5c0700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T17:59:27.374 INFO:tasks.ceph.mds.a.smithi045.stderr: -9090> 2023-12-19T17:57:23.419+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55f68010a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:59:27.374 INFO:tasks.ceph.mds.a.smithi045.stderr: -8709> 2023-12-19T17:57:23.423+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [2,head] /subdir/3 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680228100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f8:[<0x10000000000/3 v40>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f8:[<0x10000000000/3 v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.377 INFO:tasks.ceph.mds.a.smithi045.stderr: -8500> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fd [2,head] /subdir/8 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680226580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fd:[<0x10000000000/8 v82>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fd:[<0x10000000000/8 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.377 INFO:tasks.ceph.mds.a.smithi045.stderr: -8476> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [2,head] /subdir/21 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680240000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020a:[<0x10000000000/21 v184>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020a:[<0x10000000000/21 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.377 INFO:tasks.ceph.mds.a.smithi045.stderr: -8453> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [2,head] /subdir/19 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680241080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000208:[<0x10000000000/19 v168>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000208:[<0x10000000000/19 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.377 INFO:tasks.ceph.mds.a.smithi045.stderr: -8429> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000204 [2,head] /subdir/15 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680242680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000204:[<0x10000000000/15 v136>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000204:[<0x10000000000/15 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8407> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fe [2,head] /subdir/9 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680226000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fe:[<0x10000000000/9 v88>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fe:[<0x10000000000/9 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8384> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000201 [2,head] /subdir/12 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680243700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000201:[<0x10000000000/12 v112>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000201:[<0x10000000000/12 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8361> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [2,head] /subdir/20 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680240580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000209:[<0x10000000000/20 v176>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000209:[<0x10000000000/20 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8337> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001ff [2,head] /subdir/10 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680248580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001ff:[<0x10000000000/10 v96>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001ff:[<0x10000000000/10 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8315> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f7 [2,head] /subdir/2 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680228680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f7:[<0x10000000000/2 v34>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f7:[<0x10000000000/2 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8292> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f9 [2,head] /subdir/4 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680227b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f9:[<0x10000000000/4 v50>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f9:[<0x10000000000/4 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8268> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000200 [2,head] /subdir/11 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680248000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000200:[<0x10000000000/11 v104>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000200:[<0x10000000000/11 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8245> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f6 [2,head] /subdir/1 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680240b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001f6:[<0x10000000000/1 v24>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001f6:[<0x10000000000/1 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8222> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [2,head] /subdir/24 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680228c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020d:[<0x10000000000/24 v200>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020d:[<0x10000000000/24 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8199> 2023-12-19T17:57:23.427+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000205 [2,head] /subdir/16 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680242100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000205:[<0x10000000000/16 v144>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000205:[<0x10000000000/16 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8175> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/0 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680248b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000001:[<0x10000000000/0 v16>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000001:[<0x10000000000/0 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8153> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [2,head] /subdir/22 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680229700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020b:[<0x10000000000/22 v192>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020b:[<0x10000000000/22 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8130> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000203 [2,head] /subdir/14 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680242c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000203:[<0x10000000000/14 v128>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000203:[<0x10000000000/14 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8107> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fa [2,head] /subdir/5 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680227600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fa:[<0x10000000000/5 v56>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fa:[<0x10000000000/5 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.378 INFO:tasks.ceph.mds.a.smithi045.stderr: -8084> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [2,head] /subdir/18 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680241600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000207:[<0x10000000000/18 v160>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000207:[<0x10000000000/18 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.379 INFO:tasks.ceph.mds.a.smithi045.stderr: -8061> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000202 [2,head] /subdir/13 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680243180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000202:[<0x10000000000/13 v120>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000202:[<0x10000000000/13 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.379 INFO:tasks.ceph.mds.a.smithi045.stderr: -8038> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [2,head] /subdir/23 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680229180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x1000000020c:[<0x10000000000/23 v198>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x1000000020c:[<0x10000000000/23 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.379 INFO:tasks.ceph.mds.a.smithi045.stderr: -8021> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fc [2,head] /subdir/7 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680226b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fc:[<0x10000000000/7 v72>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fc:[<0x10000000000/7 v1>,<0x1/subdir v4>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.379 INFO:tasks.ceph.mds.a.smithi045.stderr: -7924> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v5 ap=5 snaprealm=0x55f68015cb40 DIRTYPARENT f(v1 1=0+1) n(v0 rc2023-12-19T17:57:23.101313+0000 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={6963=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55f680109600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(8)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-19T17:57:23.101313+0000 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T17:59:27.379 INFO:tasks.ceph.mds.a.smithi045.stderr: -7706> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [2,head] /subdir/17 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680241b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x10000000206:[<0x10000000000/17 v154>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x10000000206:[<0x10000000000/17 v1>,<0x1/subdir v7>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.379 INFO:tasks.ceph.mds.a.smithi045.stderr: -7690> 2023-12-19T17:57:23.431+0000 7f06fa5c0700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fb [2,head] /subdir/6 auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55f680227080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(10)0x100000001fb:[<0x10000000000/6 v64>,<0x1/subdir v211>]//[9]","memoryvalue":"(10)0x100000001fb:[<0x10000000000/6 v1>,<0x1/subdir v7>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T17:59:27.381 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T17:59:27.436 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:59:27.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.557+0000 7f19e8870700 1 Processor -- start 2023-12-19T17:59:27.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.557+0000 7f19e8870700 1 -- start start 2023-12-19T17:59:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e8870700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f19e40b3a30 0x7f19e40acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e8870700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f19e40713d0 0x7f19e40717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e8870700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19e40b1f20 con 0x7f19e415cf00 2023-12-19T17:59:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e8870700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e4071d30 con 0x7f19e40713d0 2023-12-19T17:59:27.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e8870700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e40ad8b0 con 0x7f19e40b3a30 2023-12-19T17:59:27.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e2d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f19e415cf00 0x7f19e40b23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:33302/0 (socket says 172.21.15.45:33302) 2023-12-19T17:59:27.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e2d9d700 1 -- 172.21.15.45:0/2622228344 learned_addr learned my addr 172.21.15.45:0/2622228344 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:27.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e359e700 1 --2- 172.21.15.45:0/2622228344 >> v2:172.21.15.45:3300/0 conn(0x7f19e40713d0 0x7f19e40717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e259c700 1 --2- 172.21.15.45:0/2622228344 >> v2:172.21.15.73:3300/0 conn(0x7f19e40b3a30 0x7f19e40acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e359e700 1 -- 172.21.15.45:0/2622228344 >> v2:172.21.15.73:3300/0 conn(0x7f19e40b3a30 msgr2=0x7f19e40acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e359e700 1 --2- 172.21.15.45:0/2622228344 >> v2:172.21.15.73:3300/0 conn(0x7f19e40b3a30 0x7f19e40acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e359e700 1 -- 172.21.15.45:0/2622228344 >> v1:172.21.15.45:6789/0 conn(0x7f19e415cf00 legacy=0x7f19e40b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e1d9b700 1 -- 172.21.15.45:0/2622228344 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277505726 0 0) 0x7f19e40b1f20 con 0x7f19e415cf00 2023-12-19T17:59:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e359e700 1 -- 172.21.15.45:0/2622228344 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e40adb90 con 0x7f19e40713d0 2023-12-19T17:59:27.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e359e700 1 --2- 172.21.15.45:0/2622228344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40713d0 0x7f19e40717f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f19e40b15f0 tx=0x7f19dc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52325fd1899941f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e1d9b700 1 -- 172.21.15.45:0/2622228344 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00e070 con 0x7f19e40713d0 2023-12-19T17:59:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e1d9b700 1 -- 172.21.15.45:0/2622228344 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00bb20 con 0x7f19e40713d0 2023-12-19T17:59:27.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.561+0000 7f19e1d9b700 1 -- 172.21.15.45:0/2622228344 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc012430 con 0x7f19e40713d0 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 -- 172.21.15.45:0/2622228344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40713d0 msgr2=0x7f19e40717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 --2- 172.21.15.45:0/2622228344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40713d0 0x7f19e40717f0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f19e40b15f0 tx=0x7f19dc00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 -- 172.21.15.45:0/2622228344 shutdown_connections 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 --2- 172.21.15.45:0/2622228344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40713d0 0x7f19e40717f0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 --2- 172.21.15.45:0/2622228344 >> v2:172.21.15.73:3300/0 conn(0x7f19e40b3a30 0x7f19e40acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 -- 172.21.15.45:0/2622228344 >> 172.21.15.45:0/2622228344 conn(0x7f19e40cf5a0 msgr2=0x7f19e4070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 -- 172.21.15.45:0/2622228344 shutdown_connections 2023-12-19T17:59:27.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 -- 172.21.15.45:0/2622228344 wait complete. 2023-12-19T17:59:27.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 Processor -- start 2023-12-19T17:59:27.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.565+0000 7f19e8870700 1 -- start start 2023-12-19T17:59:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 0x7f19e4153670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19e415cf00 0x7f19e41f5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19e415b0c0 0x7f19e415f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e41f6400 con 0x7f19e40b3a30 2023-12-19T17:59:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4153c60 con 0x7f19e415b0c0 2023-12-19T17:59:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e4153f40 con 0x7f19e415cf00 2023-12-19T17:59:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 0x7f19e4153670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 0x7f19e4153670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37652/0 (socket says 172.21.15.45:37652) 2023-12-19T17:59:27.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 -- 172.21.15.45:0/1796000136 learned_addr learned my addr 172.21.15.45:0/1796000136 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e259c700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19e415cf00 0x7f19e41f5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e359e700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19e415b0c0 0x7f19e415f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 -- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19e415cf00 msgr2=0x7f19e41f5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19e415cf00 0x7f19e41f5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 -- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19e415b0c0 msgr2=0x7f19e415f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19e415b0c0 0x7f19e415f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 -- 172.21.15.45:0/1796000136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19dc009a70 con 0x7f19e40b3a30 2023-12-19T17:59:27.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e2d9d700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 0x7f19e4153670 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f19d40010e0 tx=0x7f19d400ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d40074e0 con 0x7f19e40b3a30 2023-12-19T17:59:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d4007640 con 0x7f19e40b3a30 2023-12-19T17:59:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e4154220 con 0x7f19e40b3a30 2023-12-19T17:59:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d4005a90 con 0x7f19e40b3a30 2023-12-19T17:59:27.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.569+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e41547e0 con 0x7f19e40b3a30 2023-12-19T17:59:27.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.573+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e4154a00 con 0x7f19e40b3a30 2023-12-19T17:59:27.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.573+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f19d4005bf0 con 0x7f19e40b3a30 2023-12-19T17:59:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.577+0000 7f19cb7fe700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19d0065b00 0x7f19d0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:27.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.577+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f19d4082a30 con 0x7f19e40b3a30 2023-12-19T17:59:27.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.577+0000 7f19e259c700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19d0065b00 0x7f19d0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:27.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.577+0000 7f19e259c700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19d0065b00 0x7f19d0067fc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f19e40ae8c0 tx=0x7f19d8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:27.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.581+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f19d404ff20 con 0x7f19e40b3a30 2023-12-19T17:59:27.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:27.797+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f19e404ed30 con 0x7f19e40b3a30 2023-12-19T17:59:28.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.357+0000 7f19cb7fe700 1 -- 172.21.15.45:0/1796000136 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v51) v1 ==== 104+0+0 (secure 0 0 0) 0x7f19d4007e60 con 0x7f19e40b3a30 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19d0065b00 msgr2=0x7f19d0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19d0065b00 0x7f19d0067fc0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f19e40ae8c0 tx=0x7f19d8009240 comp rx=0 tx=0).stop 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 msgr2=0x7f19e4153670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 0x7f19e4153670 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f19d40010e0 tx=0x7f19d400ca30 comp rx=0 tx=0).stop 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 shutdown_connections 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19d0065b00 0x7f19d0067fc0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19e415b0c0 0x7f19e415f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f19e415cf00 0x7f19e41f5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 --2- 172.21.15.45:0/1796000136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f19e40b3a30 0x7f19e4153670 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 >> 172.21.15.45:0/1796000136 conn(0x7f19e40713d0 msgr2=0x7f19e40af270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:28.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 shutdown_connections 2023-12-19T17:59:28.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.361+0000 7f19e8870700 1 -- 172.21.15.45:0/1796000136 wait complete. 2023-12-19T17:59:28.390 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T17:59:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.573+0000 7f1f3abfb700 1 Processor -- start 2023-12-19T17:59:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.577+0000 7f1f3abfb700 1 -- start start 2023-12-19T17:59:28.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.577+0000 7f1f3abfb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f340d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.577+0000 7f1f3abfb700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f340b8630 0x7f1f340d2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.577+0000 7f1f3abfb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f340705c0 con 0x7f1f3415d150 2023-12-19T17:59:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.577+0000 7f1f3abfb700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f340d12c0 con 0x7f1f340b8630 2023-12-19T17:59:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.577+0000 7f1f3abfb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340d15a0 con 0x7f1f34070ab0 2023-12-19T17:59:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f340d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f393f8700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1f3415d150 0x7f1f34070e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:37510/0 (socket says 172.21.15.45:37510) 2023-12-19T17:59:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f393f8700 1 -- 172.21.15.45:0/587341367 learned_addr learned my addr 172.21.15.45:0/587341367 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f340d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:38202/0 (socket says 172.21.15.45:38202) 2023-12-19T17:59:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f3a3fa700 1 --2- 172.21.15.45:0/587341367 >> v2:172.21.15.73:3300/0 conn(0x7f1f340b8630 0x7f1f340d2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:28.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f38bf7700 1 -- 172.21.15.45:0/587341367 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 30022453 0 0) 0x7f1f340705c0 con 0x7f1f3415d150 2023-12-19T17:59:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f38bf7700 1 -- 172.21.15.45:0/587341367 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f200035d0 con 0x7f1f3415d150 2023-12-19T17:59:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 -- 172.21.15.45:0/587341367 >> v2:172.21.15.73:3300/0 conn(0x7f1f340b8630 msgr2=0x7f1f340d2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 --2- 172.21.15.45:0/587341367 >> v2:172.21.15.73:3300/0 conn(0x7f1f340b8630 0x7f1f340d2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 -- 172.21.15.45:0/587341367 >> v1:172.21.15.73:6789/0 conn(0x7f1f3415d150 legacy=0x7f1f34070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 -- 172.21.15.45:0/587341367 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f340d1880 con 0x7f1f34070ab0 2023-12-19T17:59:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f39bf9700 1 --2- 172.21.15.45:0/587341367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f340d0bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009850 tx=0x7f1f30009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a723ac47117ada28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.581+0000 7f1f38bf7700 1 -- 172.21.15.45:0/587341367 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30011830 con 0x7f1f34070ab0 2023-12-19T17:59:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f38bf7700 1 -- 172.21.15.45:0/587341367 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f30011990 con 0x7f1f34070ab0 2023-12-19T17:59:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f38bf7700 1 -- 172.21.15.45:0/587341367 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f30011d40 con 0x7f1f34070ab0 2023-12-19T17:59:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 -- 172.21.15.45:0/587341367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 msgr2=0x7f1f340d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/587341367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f340d0bc0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009850 tx=0x7f1f30009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 -- 172.21.15.45:0/587341367 shutdown_connections 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/587341367 >> v2:172.21.15.73:3300/0 conn(0x7f1f340b8630 0x7f1f340d2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/587341367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f340d0bc0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 -- 172.21.15.45:0/587341367 >> 172.21.15.45:0/587341367 conn(0x7f1f340d2cc0 msgr2=0x7f1f340d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 -- 172.21.15.45:0/587341367 shutdown_connections 2023-12-19T17:59:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.585+0000 7f1f3abfb700 1 -- 172.21.15.45:0/587341367 wait complete. 2023-12-19T17:59:28.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 Processor -- start 2023-12-19T17:59:28.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 -- start start 2023-12-19T17:59:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f341f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f340b8630 0x7f1f340b63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 0x7f1f340b6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f340c9310 con 0x7f1f3415d150 2023-12-19T17:59:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f341558d0 con 0x7f1f340b8630 2023-12-19T17:59:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3abfb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f34155bb0 con 0x7f1f34070ab0 2023-12-19T17:59:28.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3a3fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 0x7f1f340b6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:28.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f39bf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f341f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:28.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f393f8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f340b8630 0x7f1f340b63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:28.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3a3fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 0x7f1f340b6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37654/0 (socket says 172.21.15.45:37654) 2023-12-19T17:59:28.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.589+0000 7f1f3a3fa700 1 -- 172.21.15.45:0/1205316004 learned_addr learned my addr 172.21.15.45:0/1205316004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3a3fa700 1 -- 172.21.15.45:0/1205316004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 msgr2=0x7f1f341f1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3a3fa700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f341f1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3a3fa700 1 -- 172.21.15.45:0/1205316004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f340b8630 msgr2=0x7f1f340b63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3a3fa700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f340b8630 0x7f1f340b63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3a3fa700 1 -- 172.21.15.45:0/1205316004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f300094b0 con 0x7f1f3415d150 2023-12-19T17:59:28.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3a3fa700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 0x7f1f340b6920 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00efc0 tx=0x7f1f2c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c009ea0 con 0x7f1f3415d150 2023-12-19T17:59:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f2c00f040 con 0x7f1f3415d150 2023-12-19T17:59:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f34155e90 con 0x7f1f3415d150 2023-12-19T17:59:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2c00ced0 con 0x7f1f3415d150 2023-12-19T17:59:28.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f34156450 con 0x7f1f3415d150 2023-12-19T17:59:28.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.593+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3404ed30 con 0x7f1f3415d150 2023-12-19T17:59:28.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.597+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f2c014480 con 0x7f1f3415d150 2023-12-19T17:59:28.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.601+0000 7f1f2a7fc700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f18065b00 0x7f1f18067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:28.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.601+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f1f2c083d70 con 0x7f1f3415d150 2023-12-19T17:59:28.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.601+0000 7f1f39bf9700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f18065b00 0x7f1f18067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:28.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.601+0000 7f1f39bf9700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f18065b00 0x7f1f18067fc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1f300090b0 tx=0x7f1f30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:28.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.605+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f2c0513b0 con 0x7f1f3415d150 2023-12-19T17:59:28.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:28.789+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1f340d1e10 con 0x7f1f3415d150 2023-12-19T17:59:29.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.761+0000 7f1f2a7fc700 1 -- 172.21.15.45:0/1205316004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1f2c018020 con 0x7f1f3415d150 2023-12-19T17:59:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f18065b00 msgr2=0x7f1f18067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f18065b00 0x7f1f18067fc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f1f300090b0 tx=0x7f1f30008030 comp rx=0 tx=0).stop 2023-12-19T17:59:29.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 msgr2=0x7f1f340b6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 0x7f1f340b6920 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f1f2c00efc0 tx=0x7f1f2c00c3a0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 shutdown_connections 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f18065b00 0x7f1f18067fc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f3415d150 0x7f1f340b6920 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f340b8630 0x7f1f340b63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 --2- 172.21.15.45:0/1205316004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f34070ab0 0x7f1f341f1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 >> 172.21.15.45:0/1205316004 conn(0x7f1f340d2cc0 msgr2=0x7f1f3415d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 shutdown_connections 2023-12-19T17:59:29.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.765+0000 7f1f3abfb700 1 -- 172.21.15.45:0/1205316004 wait complete. 2023-12-19T17:59:29.773 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-19T17:59:29.794 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T17:59:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.985+0000 7f0f6240a700 1 Processor -- start 2023-12-19T17:59:29.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.985+0000 7f0f6240a700 1 -- start start 2023-12-19T17:59:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f5c15cf40 0x7f0f5c0b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c161340 0x7f0f5c0d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5c06fe80 con 0x7f0f5c15d320 2023-12-19T17:59:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f5c070440 con 0x7f0f5c15cf40 2023-12-19T17:59:29.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c070160 con 0x7f0f5c161340 2023-12-19T17:59:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f5c15cf40 0x7f0f5c0b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0f5c15cf40 0x7f0f5c0b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44772/0 (socket says 172.21.15.45:44772) 2023-12-19T17:59:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 -- 172.21.15.45:0/1774308665 learned_addr learned my addr 172.21.15.45:0/1774308665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f609a7700 1 --2- 172.21.15.45:0/1774308665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c161340 0x7f0f5c0d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:29.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 -- 172.21.15.45:0/1774308665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c161340 msgr2=0x7f0f5c0d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 --2- 172.21.15.45:0/1774308665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c161340 0x7f0f5c0d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 -- 172.21.15.45:0/1774308665 >> v1:172.21.15.73:6789/0 conn(0x7f0f5c15d320 legacy=0x7f0f5c160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 -- 172.21.15.45:0/1774308665 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0d1030 con 0x7f0f5c15cf40 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5bfff700 1 --2- 172.21.15.45:0/1774308665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c15cf40 0x7f0f5c0b8770 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009910 tx=0x7f0f4c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f639e087caa44e04 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5affd700 1 -- 172.21.15.45:0/1774308665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c00ba60 con 0x7f0f5c15cf40 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5affd700 1 -- 172.21.15.45:0/1774308665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c00bbc0 con 0x7f0f5c15cf40 2023-12-19T17:59:29.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f5affd700 1 -- 172.21.15.45:0/1774308665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c009e60 con 0x7f0f5c15cf40 2023-12-19T17:59:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 -- 172.21.15.45:0/1774308665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c15cf40 msgr2=0x7f0f5c0b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.989+0000 7f0f6240a700 1 --2- 172.21.15.45:0/1774308665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c15cf40 0x7f0f5c0b8770 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009910 tx=0x7f0f4c009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- 172.21.15.45:0/1774308665 shutdown_connections 2023-12-19T17:59:29.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 --2- 172.21.15.45:0/1774308665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c161340 0x7f0f5c0d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 --2- 172.21.15.45:0/1774308665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c15cf40 0x7f0f5c0b8770 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- 172.21.15.45:0/1774308665 >> 172.21.15.45:0/1774308665 conn(0x7f0f5c0d2e50 msgr2=0x7f0f5c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- 172.21.15.45:0/1774308665 shutdown_connections 2023-12-19T17:59:29.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- 172.21.15.45:0/1774308665 wait complete. 2023-12-19T17:59:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 Processor -- start 2023-12-19T17:59:29.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- start start 2023-12-19T17:59:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c15cf40 0x7f0f5c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f5c15d320 0x7f0f5c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 0x7f0f5c0cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c9f20 con 0x7f0f5c161340 2023-12-19T17:59:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0ca200 con 0x7f0f5c15d320 2023-12-19T17:59:30.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.993+0000 7f0f6240a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0ca4e0 con 0x7f0f5c15cf40 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f609a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 0x7f0f5c0cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f609a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 0x7f0f5c0cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44774/0 (socket says 172.21.15.45:44774) 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f609a7700 1 -- 172.21.15.45:0/2580259641 learned_addr learned my addr 172.21.15.45:0/2580259641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f5c15d320 0x7f0f5c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5bfff700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c15cf40 0x7f0f5c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 -- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c15cf40 msgr2=0x7f0f5c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c15cf40 0x7f0f5c15a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 -- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 msgr2=0x7f0f5c0cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 0x7f0f5c0cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:30.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 -- 172.21.15.45:0/2580259641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f4c009570 con 0x7f0f5c15d320 2023-12-19T17:59:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f609a7700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 0x7f0f5c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f5b7fe700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f5c15d320 0x7f0f5c15feb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c480 tx=0x7f0f5000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:30.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500052d0 con 0x7f0f5c15d320 2023-12-19T17:59:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f50005430 con 0x7f0f5c15d320 2023-12-19T17:59:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c0ca7c0 con 0x7f0f5c15d320 2023-12-19T17:59:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500055a0 con 0x7f0f5c15d320 2023-12-19T17:59:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c0cad80 con 0x7f0f5c15d320 2023-12-19T17:59:30.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:29.997+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c04ed30 con 0x7f0f5c15d320 2023-12-19T17:59:30.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.001+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0f500038e0 con 0x7f0f5c15d320 2023-12-19T17:59:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.001+0000 7f0f58ff9700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f48065ad0 0x7f0f48067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.001+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6339+0+0 (secure 0 0 0) 0x7f0f50082790 con 0x7f0f5c15d320 2023-12-19T17:59:30.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.001+0000 7f0f5bfff700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f48065ad0 0x7f0f48067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:30.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.005+0000 7f0f5bfff700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f48065ad0 0x7f0f48067f90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c000c00 tx=0x7f0f4c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:30.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.009+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0f5004fee0 con 0x7f0f5c15d320 2023-12-19T17:59:30.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.197+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0f5c0d0a40 con 0x7f0f5c15d320 2023-12-19T17:59:30.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.773+0000 7f0f58ff9700 1 -- 172.21.15.45:0/2580259641 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0f50053500 con 0x7f0f5c15d320 2023-12-19T17:59:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f48065ad0 msgr2=0x7f0f48067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f48065ad0 0x7f0f48067f90 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c000c00 tx=0x7f0f4c008030 comp rx=0 tx=0).stop 2023-12-19T17:59:30.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f5c15d320 msgr2=0x7f0f5c15feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f5c15d320 0x7f0f5c15feb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c480 tx=0x7f0f5000c790 comp rx=0 tx=0).stop 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 shutdown_connections 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0f48065ad0 0x7f0f48067f90 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0f5c161340 0x7f0f5c0cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0f5c15d320 0x7f0f5c15feb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 --2- 172.21.15.45:0/2580259641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0f5c15cf40 0x7f0f5c15a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.777+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 >> 172.21.15.45:0/2580259641 conn(0x7f0f5c0d2e50 msgr2=0x7f0f5c0b3fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:30.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.781+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 shutdown_connections 2023-12-19T17:59:30.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.781+0000 7f0f6240a700 1 -- 172.21.15.45:0/2580259641 wait complete. 2023-12-19T17:59:30.786 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-19T17:59:30.809 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_extra cephfs_data_extra --yes-i-really-really-mean-it 2023-12-19T17:59:31.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 Processor -- start 2023-12-19T17:59:31.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 -- start start 2023-12-19T17:59:31.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faae815d320 0x7faae8160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7faae8161170 0x7faae80d1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faae81615a0 con 0x7faae815cf40 2023-12-19T17:59:31.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae8070440 con 0x7faae8161170 2023-12-19T17:59:31.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faaee65d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faae806fe80 con 0x7faae815d320 2023-12-19T17:59:31.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faae7fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faae815cf40 0x7faae80b8770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59488/0 (socket says 172.21.15.45:59488) 2023-12-19T17:59:31.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:30.997+0000 7faae7fff700 1 -- 172.21.15.45:0/1114118922 learned_addr learned my addr 172.21.15.45:0/1114118922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:31.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faaecbfa700 1 --2- 172.21.15.45:0/1114118922 >> v2:172.21.15.45:3300/0 conn(0x7faae8161170 0x7faae80d1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faadffff700 1 --2- 172.21.15.45:0/1114118922 >> v2:172.21.15.73:3300/0 conn(0x7faae815d320 0x7faae8160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3189841034 0 0) 0x7faae81615a0 con 0x7faae815cf40 2023-12-19T17:59:31.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faad40035d0 con 0x7faae815cf40 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2224810136 0 0) 0x7faad40035d0 con 0x7faae815cf40 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 >> v2:172.21.15.73:3300/0 conn(0x7faae815d320 msgr2=0x7faae8160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 --2- 172.21.15.45:0/1114118922 >> v2:172.21.15.73:3300/0 conn(0x7faae815d320 0x7faae8160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 >> v2:172.21.15.45:3300/0 conn(0x7faae8161170 msgr2=0x7faae80d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 --2- 172.21.15.45:0/1114118922 >> v2:172.21.15.45:3300/0 conn(0x7faae8161170 0x7faae80d1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae8070160 con 0x7faae815cf40 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7faad8001670 con 0x7faae815cf40 2023-12-19T17:59:31.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 >> v1:172.21.15.45:6789/0 conn(0x7faae815cf40 legacy=0x7faae80b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faad4003a70 0x7faad4003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4004870 0x7faad4004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad4005230 0x7faad400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae8070440 con 0x7faad4003a70 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae806fe80 con 0x7faad4004870 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faad400c020 con 0x7faad4005230 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faaecbfa700 1 --2- 172.21.15.45:0/1114118922 >> v2:172.21.15.45:3300/0 conn(0x7faae8161170 0x7faae80d1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:31.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faad4003a70 0x7faad4003e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faadffff700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4004870 0x7faad4004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faaecbfa700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad4005230 0x7faad400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 -- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad4005230 msgr2=0x7faad400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:31.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faad4005230 0x7faad400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 -- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4004870 msgr2=0x7faad4004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:31.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4004870 0x7faad4004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 -- 172.21.15.45:0/1114118922 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faad40035d0 con 0x7faad4003a70 2023-12-19T17:59:31.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faadffff700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4004870 0x7faad4004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:31.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faaecbfa700 1 -- 172.21.15.45:0/1114118922 reap_dead start 2023-12-19T17:59:31.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae7fff700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faad4003a70 0x7faad4003e90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7faad800c240 tx=0x7faad40058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa493f8dd4ea6de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:31.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8007b90 con 0x7faad4003a70 2023-12-19T17:59:31.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad800cdc0 con 0x7faad4003a70 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.001+0000 7faae77fe700 1 -- 172.21.15.45:0/1114118922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad8005bc0 con 0x7faad4003a70 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 -- 172.21.15.45:0/1114118922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faad4003a70 msgr2=0x7faad4003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faad4003a70 0x7faad4003e90 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7faad800c240 tx=0x7faad40058a0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 -- 172.21.15.45:0/1114118922 shutdown_connections 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 --2- 172.21.15.45:0/1114118922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faad4003a70 0x7faad4003e90 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 -- 172.21.15.45:0/1114118922 >> 172.21.15.45:0/1114118922 conn(0x7faae80d2e50 msgr2=0x7faae80d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:31.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 -- 172.21.15.45:0/1114118922 shutdown_connections 2023-12-19T17:59:31.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.005+0000 7faaee65d700 1 -- 172.21.15.45:0/1114118922 wait complete. 2023-12-19T17:59:31.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 Processor -- start 2023-12-19T17:59:31.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 -- start start 2023-12-19T17:59:31.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4003a70 0x7faae814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 0x7faae80c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae80cbfb0 0x7faae80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae80cb6a0 con 0x7faae80cbb30 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faae80caa90 con 0x7faad4003a70 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faae80cad70 con 0x7faae80cbfb0 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 0x7faae80c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 0x7faae80c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44804/0 (socket says 172.21.15.45:44804) 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 -- 172.21.15.45:0/119705867 learned_addr learned my addr 172.21.15.45:0/119705867 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faae7fff700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4003a70 0x7faae814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaecbfa700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae80cbfb0 0x7faae80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 -- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae80cbfb0 msgr2=0x7faae80ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae80cbfb0 0x7faae80ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 -- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4003a70 msgr2=0x7faae814f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4003a70 0x7faae814f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 -- 172.21.15.45:0/119705867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faae80cb050 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faadffff700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 0x7faae80c9f20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7faad0011500 tx=0x7faad00118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad00159f0 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faad0015b50 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faad00143e0 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.009+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faae80cb330 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.013+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faae814f8f0 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.013+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faae804ed30 con 0x7faae80cbb30 2023-12-19T17:59:31.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.013+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faad0014540 con 0x7faae80cbb30 2023-12-19T17:59:31.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.017+0000 7faae57fa700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faac8065ad0 0x7faac8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:31.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.017+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5925+0+0 (secure 0 0 0) 0x7faad00839a0 con 0x7faae80cbb30 2023-12-19T17:59:31.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.017+0000 7faae7fff700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faac8065ad0 0x7faac8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:31.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.017+0000 7faae7fff700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faac8065ad0 0x7faac8067f90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faad800c240 tx=0x7faad800a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:31.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.025+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faad0051280 con 0x7faae80cbb30 2023-12-19T17:59:31.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.201+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faae80d0a40 con 0x7faae80cbb30 2023-12-19T17:59:31.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:59:31.288 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T17:59:31.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.789+0000 7faae57fa700 1 -- 172.21.15.45:0/119705867 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_extra' removed v76) v1 ==== 187+0+0 (secure 0 0 0) 0x7faad00230e0 con 0x7faae80cbb30 2023-12-19T17:59:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faac8065ad0 msgr2=0x7faac8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faac8065ad0 0x7faac8067f90 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7faad800c240 tx=0x7faad800a000 comp rx=0 tx=0).stop 2023-12-19T17:59:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 msgr2=0x7faae80c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:31.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 0x7faae80c9f20 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7faad0011500 tx=0x7faad00118c0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 shutdown_connections 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faac8065ad0 0x7faac8067f90 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faae80cbfb0 0x7faae80ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faae80cbb30 0x7faae80c9f20 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 --2- 172.21.15.45:0/119705867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faad4003a70 0x7faae814f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 >> 172.21.15.45:0/119705867 conn(0x7faae80d2e50 msgr2=0x7faae806f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 shutdown_connections 2023-12-19T17:59:31.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:31.801+0000 7faaee65d700 1 -- 172.21.15.45:0/119705867 wait complete. 2023-12-19T17:59:31.811 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' removed 2023-12-19T17:59:31.832 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T17:59:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 Processor -- start 2023-12-19T17:59:32.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 -- start start 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7941443e0 0x7fc7940713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc794071910 0x7fc7940cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc794071d70 con 0x7fc7940cb840 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7940b1b80 con 0x7fc7941443e0 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7941447c0 con 0x7fc794071910 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc79259c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc7941443e0 0x7fc7940713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc792d9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fc7940cb840 0x7fc79415e740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56914/0 (socket says 172.21.15.45:56914) 2023-12-19T17:59:32.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc792d9d700 1 -- 172.21.15.45:0/2472181004 learned_addr learned my addr 172.21.15.45:0/2472181004 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:32.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.013+0000 7fc791d9b700 1 --2- 172.21.15.45:0/2472181004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc794071910 0x7fc7940cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc791d9b700 1 -- 172.21.15.45:0/2472181004 >> v2:172.21.15.45:3300/0 conn(0x7fc7941443e0 msgr2=0x7fc7940713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:32.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc791d9b700 1 --2- 172.21.15.45:0/2472181004 >> v2:172.21.15.45:3300/0 conn(0x7fc7941443e0 0x7fc7940713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc791d9b700 1 -- 172.21.15.45:0/2472181004 >> v1:172.21.15.73:6789/0 conn(0x7fc7940cb840 legacy=0x7fc79415e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc791d9b700 1 -- 172.21.15.45:0/2472181004 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7940b1830 con 0x7fc794071910 2023-12-19T17:59:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79159a700 1 -- 172.21.15.45:0/2472181004 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144088761 0 0) 0x7fc794071d70 con 0x7fc7940cb840 2023-12-19T17:59:32.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc791d9b700 1 --2- 172.21.15.45:0/2472181004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc794071910 0x7fc7940cb300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc788009850 tx=0x7fc788009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50fb3a12f757dc28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79159a700 1 -- 172.21.15.45:0/2472181004 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788011830 con 0x7fc794071910 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79159a700 1 -- 172.21.15.45:0/2472181004 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc788011990 con 0x7fc794071910 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79159a700 1 -- 172.21.15.45:0/2472181004 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc788011d40 con 0x7fc794071910 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 -- 172.21.15.45:0/2472181004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc794071910 msgr2=0x7fc7940cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 --2- 172.21.15.45:0/2472181004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc794071910 0x7fc7940cb300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc788009850 tx=0x7fc788009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 -- 172.21.15.45:0/2472181004 shutdown_connections 2023-12-19T17:59:32.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 --2- 172.21.15.45:0/2472181004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc794071910 0x7fc7940cb300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 --2- 172.21.15.45:0/2472181004 >> v2:172.21.15.45:3300/0 conn(0x7fc7941443e0 0x7fc7940713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 -- 172.21.15.45:0/2472181004 >> 172.21.15.45:0/2472181004 conn(0x7fc7940cf5a0 msgr2=0x7fc794070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:32.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 -- 172.21.15.45:0/2472181004 shutdown_connections 2023-12-19T17:59:32.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.017+0000 7fc79359e700 1 -- 172.21.15.45:0/2472181004 wait complete. 2023-12-19T17:59:32.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.021+0000 7fc79359e700 1 Processor -- start 2023-12-19T17:59:32.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.021+0000 7fc79359e700 1 -- start start 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 0x7fc7941386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7941443e0 0x7fc79415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc79413f540 0x7fc79413cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79415dc10 con 0x7fc7940cb840 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79415d650 con 0x7fc7941443e0 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79415d930 con 0x7fc79413f540 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 0x7fc7941386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 0x7fc7941386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44818/0 (socket says 172.21.15.45:44818) 2023-12-19T17:59:32.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 -- 172.21.15.45:0/3950666627 learned_addr learned my addr 172.21.15.45:0/3950666627 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc792d9d700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc79413f540 0x7fc79413cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc791d9b700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7941443e0 0x7fc79415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 -- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc79413f540 msgr2=0x7fc79413cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc79413f540 0x7fc79413cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 -- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7941443e0 msgr2=0x7fc79415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7941443e0 0x7fc79415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 -- 172.21.15.45:0/3950666627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7880094b0 con 0x7fc7940cb840 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc791d9b700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7941443e0 0x7fc79415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79259c700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 0x7fc7941386f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc78400e9b0 tx=0x7fc78400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc784009710 con 0x7fc7940cb840 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc78400c850 con 0x7fc7940cb840 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7940ae8c0 con 0x7fc7940cb840 2023-12-19T17:59:32.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc78400cbc0 con 0x7fc7940cb840 2023-12-19T17:59:32.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.025+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc794138c30 con 0x7fc7940cb840 2023-12-19T17:59:32.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.029+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc79404ed30 con 0x7fc7940cb840 2023-12-19T17:59:32.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.029+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc78400cd20 con 0x7fc7940cb840 2023-12-19T17:59:32.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.029+0000 7fc782ffd700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc774065ad0 0x7fc774067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.029+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fc7840835c0 con 0x7fc7940cb840 2023-12-19T17:59:32.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.033+0000 7fc791d9b700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc774065ad0 0x7fc774067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.033+0000 7fc791d9b700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc774065ad0 0x7fc774067f90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc7880090b0 tx=0x7fc78801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:32.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.037+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc784050fa0 con 0x7fc7940cb840 2023-12-19T17:59:32.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.217+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc7940b0ce0 con 0x7fc7940cb840 2023-12-19T17:59:32.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.229+0000 7fc782ffd700 1 -- 172.21.15.45:0/3950666627 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc7840545c0 con 0x7fc7940cb840 2023-12-19T17:59:32.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc774065ad0 msgr2=0x7fc774067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc774065ad0 0x7fc774067f90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc7880090b0 tx=0x7fc78801c040 comp rx=0 tx=0).stop 2023-12-19T17:59:32.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 msgr2=0x7fc7941386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 0x7fc7941386f0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fc78400e9b0 tx=0x7fc78400ed70 comp rx=0 tx=0).stop 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 shutdown_connections 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc774065ad0 0x7fc774067f90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc79413f540 0x7fc79413cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7941443e0 0x7fc79415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 --2- 172.21.15.45:0/3950666627 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc7940cb840 0x7fc7941386f0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 >> 172.21.15.45:0/3950666627 conn(0x7fc794071910 msgr2=0x7fc79406d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 shutdown_connections 2023-12-19T17:59:32.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.233+0000 7fc79359e700 1 -- 172.21.15.45:0/3950666627 wait complete. 2023-12-19T17:59:32.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_many_files_many_workers' 2023-12-19T17:59:32.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.441+0000 7fce4d4ae700 1 Processor -- start 2023-12-19T17:59:32.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.441+0000 7fce4d4ae700 1 -- start start 2023-12-19T17:59:32.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce4d4ae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480ce090 0x7fce480d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce4d4ae700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fce480b85d0 0x7fce480d1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce4d4ae700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce4806f4a0 con 0x7fce4815cf50 2023-12-19T17:59:32.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce4d4ae700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce4815d330 con 0x7fce480b85d0 2023-12-19T17:59:32.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce4d4ae700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce480b8a90 con 0x7fce480ce090 2023-12-19T17:59:32.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce46ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fce4815cf50 0x7fce480cd980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59498/0 (socket says 172.21.15.45:59498) 2023-12-19T17:59:32.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce46ffd700 1 -- 172.21.15.45:0/3679535142 learned_addr learned my addr 172.21.15.45:0/3679535142 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce477fe700 1 --2- 172.21.15.45:0/3679535142 >> v2:172.21.15.45:3300/0 conn(0x7fce480b85d0 0x7fce480d1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce467fc700 1 --2- 172.21.15.45:0/3679535142 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480ce090 0x7fce480d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce45ffb700 1 -- 172.21.15.45:0/3679535142 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070846023 0 0) 0x7fce4806f4a0 con 0x7fce4815cf50 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce45ffb700 1 -- 172.21.15.45:0/3679535142 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce300035d0 con 0x7fce4815cf50 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce477fe700 1 -- 172.21.15.45:0/3679535142 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480ce090 msgr2=0x7fce480d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce477fe700 1 --2- 172.21.15.45:0/3679535142 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480ce090 0x7fce480d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce477fe700 1 -- 172.21.15.45:0/3679535142 >> v1:172.21.15.45:6789/0 conn(0x7fce4815cf50 legacy=0x7fce480cd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce477fe700 1 -- 172.21.15.45:0/3679535142 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce4806f6f0 con 0x7fce480b85d0 2023-12-19T17:59:32.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce477fe700 1 --2- 172.21.15.45:0/3679535142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480b85d0 0x7fce480d1380 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fce40009d90 tx=0x7fce4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=407b0e161bc89d19 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:32.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce45ffb700 1 -- 172.21.15.45:0/3679535142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce4000e070 con 0x7fce480b85d0 2023-12-19T17:59:32.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce45ffb700 1 -- 172.21.15.45:0/3679535142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce4000bb20 con 0x7fce480b85d0 2023-12-19T17:59:32.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.445+0000 7fce45ffb700 1 -- 172.21.15.45:0/3679535142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce40012430 con 0x7fce480b85d0 2023-12-19T17:59:32.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 -- 172.21.15.45:0/3679535142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480b85d0 msgr2=0x7fce480d1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/3679535142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480b85d0 0x7fce480d1380 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fce40009d90 tx=0x7fce4000b330 comp rx=0 tx=0).stop 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 -- 172.21.15.45:0/3679535142 shutdown_connections 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/3679535142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480b85d0 0x7fce480d1380 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/3679535142 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480ce090 0x7fce480d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 -- 172.21.15.45:0/3679535142 >> 172.21.15.45:0/3679535142 conn(0x7fce480b4730 msgr2=0x7fce480b4b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 -- 172.21.15.45:0/3679535142 shutdown_connections 2023-12-19T17:59:32.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.449+0000 7fce4d4ae700 1 -- 172.21.15.45:0/3679535142 wait complete. 2023-12-19T17:59:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 Processor -- start 2023-12-19T17:59:32.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 -- start start 2023-12-19T17:59:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480b85d0 0x7fce481598b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 0x7fce480a9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815cf50 0x7fce480c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815e5f0 con 0x7fce480ce090 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce480aa670 con 0x7fce4815cf50 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce4d4ae700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce4815e030 con 0x7fce480b85d0 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 0x7fce480a9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce467fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 0x7fce480a9f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44828/0 (socket says 172.21.15.45:44828) 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.453+0000 7fce467fc700 1 -- 172.21.15.45:0/2645788700 learned_addr learned my addr 172.21.15.45:0/2645788700 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:32.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce46ffd700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480b85d0 0x7fce481598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce467fc700 1 -- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480b85d0 msgr2=0x7fce481598b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce467fc700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480b85d0 0x7fce481598b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce467fc700 1 -- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815cf50 msgr2=0x7fce480c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce467fc700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815cf50 0x7fce480c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce467fc700 1 -- 172.21.15.45:0/2645788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009a70 con 0x7fce480ce090 2023-12-19T17:59:32.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce467fc700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 0x7fce480a9f90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00ea00 tx=0x7fce3c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.457+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c009720 con 0x7fce480ce090 2023-12-19T17:59:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.461+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3c00c850 con 0x7fce480ce090 2023-12-19T17:59:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.461+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3c00cbc0 con 0x7fce480ce090 2023-12-19T17:59:32.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.461+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce4815e310 con 0x7fce480ce090 2023-12-19T17:59:32.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.461+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce48159e20 con 0x7fce480ce090 2023-12-19T17:59:32.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.461+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fce3c00cd20 con 0x7fce480ce090 2023-12-19T17:59:32.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.465+0000 7fce2f7fe700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce34065ba0 0x7fce34068060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:32.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.465+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fce3c083110 con 0x7fce480ce090 2023-12-19T17:59:32.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.465+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce480cef70 con 0x7fce480ce090 2023-12-19T17:59:32.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.465+0000 7fce46ffd700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce34065ba0 0x7fce34068060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:32.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.465+0000 7fce46ffd700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce34065ba0 0x7fce34068060 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fce380011e0 tx=0x7fce38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:32.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.473+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fce3c017080 con 0x7fce480ce090 2023-12-19T17:59:32.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.705+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_many_files_many_workers"]} v 0) v1 -- 0x7fce48067760 con 0x7fce480ce090 2023-12-19T17:59:32.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.797+0000 7fce2f7fe700 1 -- 172.21.15.45:0/2645788700 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_many_files_many_workers"]}]=0 v349) v1 ==== 172+0+0 (secure 0 0 0) 0x7fce3c021070 con 0x7fce480ce090 2023-12-19T17:59:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce34065ba0 msgr2=0x7fce34068060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce34065ba0 0x7fce34068060 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fce380011e0 tx=0x7fce38009040 comp rx=0 tx=0).stop 2023-12-19T17:59:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 msgr2=0x7fce480a9f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 0x7fce480a9f90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7fce3c00ea00 tx=0x7fce3c00edc0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 shutdown_connections 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fce34065ba0 0x7fce34068060 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fce4815cf50 0x7fce480c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fce480ce090 0x7fce480a9f90 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 --2- 172.21.15.45:0/2645788700 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fce480b85d0 0x7fce481598b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 >> 172.21.15.45:0/2645788700 conn(0x7fce480b4730 msgr2=0x7fce4815c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 shutdown_connections 2023-12-19T17:59:32.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:32.801+0000 7fce4d4ae700 1 -- 172.21.15.45:0/2645788700 wait complete. 2023-12-19T17:59:32.831 INFO:tasks.cephfs_test_runner:test_extra_data_pool_rebuild_many_files_many_workers (tasks.cephfs.test_data_scan.TestDataScan) ... ok 2023-12-19T17:59:32.832 INFO:tasks.cephfs_test_runner:Starting test: test_extra_data_pool_rebuild_simple (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T17:59:32.832 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_simple' 2023-12-19T17:59:33.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 Processor -- start 2023-12-19T17:59:33.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 -- start start 2023-12-19T17:59:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15ab50 0x7f111c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f111c15af30 0x7f111c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:33.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f111c06cbb0 con 0x7f111c06f4a0 2023-12-19T17:59:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f111c06fa10 con 0x7f111c15af30 2023-12-19T17:59:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.005+0000 7f1122c7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c06fcf0 con 0x7f111c15ab50 2023-12-19T17:59:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f111c15af30 0x7f111c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f111c15af30 0x7f111c0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44844/0 (socket says 172.21.15.45:44844) 2023-12-19T17:59:33.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 -- 172.21.15.45:0/24303474 learned_addr learned my addr 172.21.15.45:0/24303474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1120a17700 1 --2- 172.21.15.45:0/24303474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15ab50 0x7f111c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 -- 172.21.15.45:0/24303474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15ab50 msgr2=0x7f111c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 --2- 172.21.15.45:0/24303474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15ab50 0x7f111c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 -- 172.21.15.45:0/24303474 >> v1:172.21.15.73:6789/0 conn(0x7f111c06f4a0 legacy=0x7f111c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:33.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 -- 172.21.15.45:0/24303474 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f111c06ffd0 con 0x7f111c15af30 2023-12-19T17:59:33.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1113fff700 1 --2- 172.21.15.45:0/24303474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c15af30 0x7f111c0cd2b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f110c009910 tx=0x7f110c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28197c12a1dc0147 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:33.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f11137fe700 1 -- 172.21.15.45:0/24303474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c011830 con 0x7f111c15af30 2023-12-19T17:59:33.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f11137fe700 1 -- 172.21.15.45:0/24303474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f110c011990 con 0x7f111c15af30 2023-12-19T17:59:33.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f11137fe700 1 -- 172.21.15.45:0/24303474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c011d40 con 0x7f111c15af30 2023-12-19T17:59:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1122c7b700 1 -- 172.21.15.45:0/24303474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c15af30 msgr2=0x7f111c0cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:33.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1122c7b700 1 --2- 172.21.15.45:0/24303474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c15af30 0x7f111c0cd2b0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f110c009910 tx=0x7f110c009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1122c7b700 1 -- 172.21.15.45:0/24303474 shutdown_connections 2023-12-19T17:59:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1122c7b700 1 --2- 172.21.15.45:0/24303474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c15af30 0x7f111c0cd2b0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1122c7b700 1 --2- 172.21.15.45:0/24303474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15ab50 0x7f111c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.009+0000 7f1122c7b700 1 -- 172.21.15.45:0/24303474 >> 172.21.15.45:0/24303474 conn(0x7f111c0cba40 msgr2=0x7f111c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.013+0000 7f1122c7b700 1 -- 172.21.15.45:0/24303474 shutdown_connections 2023-12-19T17:59:33.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.013+0000 7f1122c7b700 1 -- 172.21.15.45:0/24303474 wait complete. 2023-12-19T17:59:33.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.013+0000 7f1122c7b700 1 Processor -- start 2023-12-19T17:59:33.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.013+0000 7f1122c7b700 1 -- start start 2023-12-19T17:59:33.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 0x7f111c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:33.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c15ab50 0x7f111c0c3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:33.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15af30 0x7f111c143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:33.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c0c3d50 con 0x7f111c06f4a0 2023-12-19T17:59:33.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f111c1f6d50 con 0x7f111c15ab50 2023-12-19T17:59:33.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111c1f64b0 con 0x7f111c15af30 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 0x7f111c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 0x7f111c1f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44860/0 (socket says 172.21.15.45:44860) 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 -- 172.21.15.45:0/83026647 learned_addr learned my addr 172.21.15.45:0/83026647 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1113fff700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c15ab50 0x7f111c0c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1121218700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15af30 0x7f111c143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 -- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15af30 msgr2=0x7f111c143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15af30 0x7f111c143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 -- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c15ab50 msgr2=0x7f111c0c3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c15ab50 0x7f111c0c3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 -- 172.21.15.45:0/83026647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009570 con 0x7f111c06f4a0 2023-12-19T17:59:33.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1113fff700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c15ab50 0x7f111c0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:33.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1120a17700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 0x7f111c1f5e20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f111800efc0 tx=0x7f111800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:33.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f111800cdc0 con 0x7f111c06f4a0 2023-12-19T17:59:33.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f111800f040 con 0x7f111c06f4a0 2023-12-19T17:59:33.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f111c1f6790 con 0x7f111c06f4a0 2023-12-19T17:59:33.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11180146a0 con 0x7f111c06f4a0 2023-12-19T17:59:33.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.017+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f111c0c6d00 con 0x7f111c06f4a0 2023-12-19T17:59:33.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.021+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f111c04ed30 con 0x7f111c06f4a0 2023-12-19T17:59:33.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.021+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1118014800 con 0x7f111c06f4a0 2023-12-19T17:59:33.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.025+0000 7f11117fa700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1108065ad0 0x7f1108067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:33.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.025+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f1118083970 con 0x7f111c06f4a0 2023-12-19T17:59:33.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.025+0000 7f1113fff700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1108065ad0 0x7f1108067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:33.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.025+0000 7f1113fff700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1108065ad0 0x7f1108067f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f111c15b330 tx=0x7f110c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:33.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.029+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1118051470 con 0x7f111c06f4a0 2023-12-19T17:59:33.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.265+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_simple"]} v 0) v1 -- 0x7f111c153c00 con 0x7f111c06f4a0 2023-12-19T17:59:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.801+0000 7f11117fa700 1 -- 172.21.15.45:0/83026647 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_simple"]}]=0 v350) v1 ==== 158+0+0 (secure 0 0 0) 0x7f1118054a90 con 0x7f111c06f4a0 2023-12-19T17:59:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1108065ad0 msgr2=0x7f1108067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:33.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1108065ad0 0x7f1108067f90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f111c15b330 tx=0x7f110c008030 comp rx=0 tx=0).stop 2023-12-19T17:59:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 msgr2=0x7f111c1f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 0x7f111c1f5e20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f111800efc0 tx=0x7f111800c3a0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 shutdown_connections 2023-12-19T17:59:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1108065ad0 0x7f1108067f90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f111c15af30 0x7f111c143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f111c15ab50 0x7f111c0c3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 --2- 172.21.15.45:0/83026647 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f111c06f4a0 0x7f111c1f5e20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 >> 172.21.15.45:0/83026647 conn(0x7f111c0cba40 msgr2=0x7f111c0c9d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 shutdown_connections 2023-12-19T17:59:33.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:33.805+0000 7f1122c7b700 1 -- 172.21.15.45:0/83026647 wait complete. 2023-12-19T17:59:33.839 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T17:59:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.017+0000 7fe80d408700 1 Processor -- start 2023-12-19T17:59:34.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.017+0000 7fe80d408700 1 -- start start 2023-12-19T17:59:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe80d408700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe80815d9a0 0x7fe8080cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe80d408700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8080ce510 con 0x7fe8080cc230 2023-12-19T17:59:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe80d408700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe808153eb0 con 0x7fe8080ce0e0 2023-12-19T17:59:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe80d408700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe80806fe90 con 0x7fe80815d9a0 2023-12-19T17:59:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe807fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8080cc230 0x7fe8080ca410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59508/0 (socket says 172.21.15.45:59508) 2023-12-19T17:59:34.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe807fff700 1 -- 172.21.15.45:0/1963994859 learned_addr learned my addr 172.21.15.45:0/1963994859 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe7fffff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe80815d9a0 0x7fe8080cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784959220 0 0) 0x7fe8080ce510 con 0x7fe8080cc230 2023-12-19T17:59:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f40034f0 con 0x7fe8080cc230 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1527847519 0 0) 0x7fe808153eb0 con 0x7fe8080ce0e0 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8080ce510 con 0x7fe8080ce0e0 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 18145639 0 0) 0x7fe7f40034f0 con 0x7fe8080cc230 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe80815d9a0 msgr2=0x7fe8080cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe80815d9a0 0x7fe8080cdba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 >> v1:172.21.15.73:6789/0 conn(0x7fe8080ce0e0 legacy=0x7fe808159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808070170 con 0x7fe8080cc230 2023-12-19T17:59:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fe7f8001690 con 0x7fe8080cc230 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 >> v1:172.21.15.45:6789/0 conn(0x7fe8080cc230 legacy=0x7fe8080ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f4003cd0 0x7fe7f4008900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40041b0 0x7fe7f400ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f400b500 0x7fe7f400d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe80806fe90 con 0x7fe7f40041b0 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f400e270 con 0x7fe7f400b500 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.021+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f400e430 con 0x7fe7f4003cd0 2023-12-19T17:59:34.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe7fffff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe80815d9a0 0x7fe8080cdba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f4003cd0 0x7fe7f4008900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe7fffff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40041b0 0x7fe7f400ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80cc07700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f400b500 0x7fe7f400d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 -- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f400b500 msgr2=0x7fe7f400d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7f400b500 0x7fe7f400d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 -- 172.21.15.45:0/1963994859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40041b0 msgr2=0x7fe7f400ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7f40041b0 0x7fe7f400ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 -- 172.21.15.45:0/1963994859 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f40034f0 con 0x7fe7f4003cd0 2023-12-19T17:59:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe807fff700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f4003cd0 0x7fe7f4008900 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ce6a0 tx=0x7fe7f40037a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34373c9bdbfc11f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f800cc90 con 0x7fe7f4003cd0 2023-12-19T17:59:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f800cdf0 con 0x7fe7f4003cd0 2023-12-19T17:59:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe8077fe700 1 -- 172.21.15.45:0/1963994859 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f8005bc0 con 0x7fe7f4003cd0 2023-12-19T17:59:34.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80d408700 1 -- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f4003cd0 msgr2=0x7fe7f4008900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80d408700 1 --2- 172.21.15.45:0/1963994859 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7f4003cd0 0x7fe7f4008900 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8080ce6a0 tx=0x7fe7f40037a0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80cc07700 1 -- 172.21.15.45:0/1963994859 reap_dead start 2023-12-19T17:59:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80d408700 1 -- 172.21.15.45:0/1963994859 shutdown_connections 2023-12-19T17:59:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80d408700 1 -- 172.21.15.45:0/1963994859 >> 172.21.15.45:0/1963994859 conn(0x7fe80806a750 msgr2=0x7fe8080b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80d408700 1 -- 172.21.15.45:0/1963994859 shutdown_connections 2023-12-19T17:59:34.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.025+0000 7fe80d408700 1 -- 172.21.15.45:0/1963994859 wait complete. 2023-12-19T17:59:34.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 Processor -- start 2023-12-19T17:59:34.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 -- start start 2023-12-19T17:59:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8080c7d50 0x7fe8080c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 0x7fe8080c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8080c8670 0x7fe808159f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080c6890 con 0x7fe8080c5820 2023-12-19T17:59:34.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080c39c0 con 0x7fe8080c7d50 2023-12-19T17:59:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe80d408700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8080c9080 con 0x7fe8080c8670 2023-12-19T17:59:34.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.029+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 0x7fe8080c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe80cc07700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8080c8670 0x7fe808159f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 0x7fe8080c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44876/0 (socket says 172.21.15.45:44876) 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 -- 172.21.15.45:0/4155051433 learned_addr learned my addr 172.21.15.45:0/4155051433 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe807fff700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8080c7d50 0x7fe8080c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 -- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8080c8670 msgr2=0x7fe808159f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8080c8670 0x7fe808159f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 -- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8080c7d50 msgr2=0x7fe8080c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8080c7d50 0x7fe8080c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 -- 172.21.15.45:0/4155051433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8080c3c10 con 0x7fe8080c5820 2023-12-19T17:59:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe7fffff700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 0x7fe8080c8130 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0011c00 tx=0x7fe7f0011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0006e80 con 0x7fe8080c5820 2023-12-19T17:59:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f000f980 con 0x7fe8080c5820 2023-12-19T17:59:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000fcf0 con 0x7fe8080c5820 2023-12-19T17:59:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8080c3ef0 con 0x7fe8080c5820 2023-12-19T17:59:34.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8080c44b0 con 0x7fe8080c5820 2023-12-19T17:59:34.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.033+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80806f9d0 con 0x7fe8080c5820 2023-12-19T17:59:34.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.037+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe7f0014440 con 0x7fe8080c5820 2023-12-19T17:59:34.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.037+0000 7fe8057fa700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7e8065b00 0x7fe7e8067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.037+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fe7f0083720 con 0x7fe8080c5820 2023-12-19T17:59:34.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.037+0000 7fe807fff700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7e8065b00 0x7fe7e8067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.041+0000 7fe807fff700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7e8065b00 0x7fe7e8067fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe80806e3d0 tx=0x7fe7f8006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:34.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.045+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe7f0051180 con 0x7fe8080c5820 2023-12-19T17:59:34.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.221+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe8080c46d0 con 0x7fe8080c5820 2023-12-19T17:59:34.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.233+0000 7fe8057fa700 1 -- 172.21.15.45:0/4155051433 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe7f00220c0 con 0x7fe8080c5820 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7e8065b00 msgr2=0x7fe7e8067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7e8065b00 0x7fe7e8067fc0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fe80806e3d0 tx=0x7fe7f8006040 comp rx=0 tx=0).stop 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 msgr2=0x7fe8080c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 0x7fe8080c8130 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0011c00 tx=0x7fe7f0011f10 comp rx=0 tx=0).stop 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 shutdown_connections 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7e8065b00 0x7fe7e8067fc0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8080c8670 0x7fe808159f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8080c5820 0x7fe8080c8130 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 --2- 172.21.15.45:0/4155051433 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8080c7d50 0x7fe8080c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 >> 172.21.15.45:0/4155051433 conn(0x7fe80806a750 msgr2=0x7fe8080afcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:34.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 shutdown_connections 2023-12-19T17:59:34.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.237+0000 7fe80d408700 1 -- 172.21.15.45:0/4155051433 wait complete. 2023-12-19T17:59:34.267 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T17:59:34.267 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:59:34.310 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T17:59:34.357 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T17:59:34.358 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:34.358 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:34.378 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T17:59:34.378 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:59:34.378 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:34.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:59:34.421 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:34.421 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:34.439 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T17:59:34.439 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T17:59:34.439 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:34.481 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T17:59:34.481 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T17:59:34.481 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:34.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 Processor -- start 2023-12-19T17:59:34.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 -- start start 2023-12-19T17:59:34.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415ab50 0x7fda640ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda6415af30 0x7fda640cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fda6406f4a0 0x7fda6415e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6406cbb0 con 0x7fda6415af30 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda6406fa10 con 0x7fda6406f4a0 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda69ccf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6406fcf0 con 0x7fda6415ab50 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda62ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda6415af30 0x7fda640cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda62ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda6415af30 0x7fda640cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44886/0 (socket says 172.21.15.45:44886) 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda62ffd700 1 -- 172.21.15.45:0/2554941702 learned_addr learned my addr 172.21.15.45:0/2554941702 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda63fff700 1 --2- 172.21.15.45:0/2554941702 >> v2:172.21.15.73:3300/0 conn(0x7fda6406f4a0 0x7fda6415e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.665+0000 7fda637fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415ab50 0x7fda640ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda63fff700 1 -- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415ab50 msgr2=0x7fda640ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda63fff700 1 --2- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415ab50 0x7fda640ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda63fff700 1 -- 172.21.15.45:0/2554941702 >> v2:172.21.15.45:3300/0 conn(0x7fda6415af30 msgr2=0x7fda640cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda63fff700 1 --2- 172.21.15.45:0/2554941702 >> v2:172.21.15.45:3300/0 conn(0x7fda6415af30 0x7fda640cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda63fff700 1 -- 172.21.15.45:0/2554941702 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6406ffd0 con 0x7fda6406f4a0 2023-12-19T17:59:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda63fff700 1 --2- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6406f4a0 0x7fda6415e8e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fda640cc4f0 tx=0x7fda5c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e8c3fa7f91eb5bb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda627fc700 1 -- 172.21.15.45:0/2554941702 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c00e070 con 0x7fda6406f4a0 2023-12-19T17:59:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda627fc700 1 -- 172.21.15.45:0/2554941702 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5c00bb20 con 0x7fda6406f4a0 2023-12-19T17:59:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda627fc700 1 -- 172.21.15.45:0/2554941702 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5c012430 con 0x7fda6406f4a0 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 -- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6406f4a0 msgr2=0x7fda6415e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 --2- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6406f4a0 0x7fda6415e8e0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fda640cc4f0 tx=0x7fda5c00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 -- 172.21.15.45:0/2554941702 shutdown_connections 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 --2- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6406f4a0 0x7fda6415e8e0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 --2- 172.21.15.45:0/2554941702 >> v2:172.21.15.45:3300/0 conn(0x7fda6415af30 0x7fda640cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 --2- 172.21.15.45:0/2554941702 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415ab50 0x7fda640ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 -- 172.21.15.45:0/2554941702 >> 172.21.15.45:0/2554941702 conn(0x7fda640cba40 msgr2=0x7fda640ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 -- 172.21.15.45:0/2554941702 shutdown_connections 2023-12-19T17:59:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.669+0000 7fda69ccf700 1 -- 172.21.15.45:0/2554941702 wait complete. 2023-12-19T17:59:34.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 Processor -- start 2023-12-19T17:59:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 -- start start 2023-12-19T17:59:34.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 0x7fda64151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6415ab50 0x7fda640c4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415af30 0x7fda640c4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c58f0 con 0x7fda6406f4a0 2023-12-19T17:59:34.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda640c5610 con 0x7fda6415ab50 2023-12-19T17:59:34.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda69ccf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda641530d0 con 0x7fda6415af30 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 0x7fda64151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.673+0000 7fda637fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 0x7fda64151e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44890/0 (socket says 172.21.15.45:44890) 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 -- 172.21.15.45:0/753255794 learned_addr learned my addr 172.21.15.45:0/753255794 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda62ffd700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6415ab50 0x7fda640c4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda63fff700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415af30 0x7fda640c4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 -- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415af30 msgr2=0x7fda640c4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415af30 0x7fda640c4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 -- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6415ab50 msgr2=0x7fda640c4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6415ab50 0x7fda640c4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 -- 172.21.15.45:0/753255794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda5c009a70 con 0x7fda6406f4a0 2023-12-19T17:59:34.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda637fe700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 0x7fda64151e50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fda5400ebe0 tx=0x7fda5400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54009740 con 0x7fda6406f4a0 2023-12-19T17:59:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda5400c850 con 0x7fda6406f4a0 2023-12-19T17:59:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400cbe0 con 0x7fda6406f4a0 2023-12-19T17:59:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda641533b0 con 0x7fda6406f4a0 2023-12-19T17:59:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda64152910 con 0x7fda6406f4a0 2023-12-19T17:59:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.677+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda64152f30 con 0x7fda6406f4a0 2023-12-19T17:59:34.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.681+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda5400cd40 con 0x7fda6406f4a0 2023-12-19T17:59:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.681+0000 7fda4bfff700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda50065ad0 0x7fda50067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.681+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fda54083180 con 0x7fda6406f4a0 2023-12-19T17:59:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.685+0000 7fda62ffd700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda50065ad0 0x7fda50067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.685+0000 7fda62ffd700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda50065ad0 0x7fda50067f90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fda641f5b50 tx=0x7fda580092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:34.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.689+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fda64152f30 con 0x7fda6406f4a0 2023-12-19T17:59:34.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.901+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda641538d0 con 0x7fda6406f4a0 2023-12-19T17:59:34.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.905+0000 7fda4bfff700 1 -- 172.21.15.45:0/753255794 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+3524 (secure 0 0 0) 0x7fda54017de0 con 0x7fda6406f4a0 2023-12-19T17:59:34.909 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:34.909 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":51,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6760,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/75258698","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":75258698},{"type":"v1","addr":"172.21.15.73:6835","nonce":75258698}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47},{"gid":6897,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2851116291","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2851116291},{"type":"v1","addr":"172.21.15.45:6836","nonce":2851116291}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":45},{"gid":7146,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4194562083","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":4194562083},{"type":"v1","addr":"172.21.15.45:6837","nonce":4194562083}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":51},{"gid":56060,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/1739040049","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1739040049},{"type":"v1","addr":"172.21.15.73:6834","nonce":1739040049}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[]} 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda50065ad0 msgr2=0x7fda50067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda50065ad0 0x7fda50067f90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fda641f5b50 tx=0x7fda580092e0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 msgr2=0x7fda64151e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 0x7fda64151e50 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7fda5400ebe0 tx=0x7fda5400eef0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 shutdown_connections 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda50065ad0 0x7fda50067f90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6415af30 0x7fda640c4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda6415ab50 0x7fda640c4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 --2- 172.21.15.45:0/753255794 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6406f4a0 0x7fda64151e50 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:34.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 >> 172.21.15.45:0/753255794 conn(0x7fda640cba40 msgr2=0x7fda640c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 shutdown_connections 2023-12-19T17:59:34.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:34.909+0000 7fda69ccf700 1 -- 172.21.15.45:0/753255794 wait complete. 2023-12-19T17:59:34.917 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 51 2023-12-19T17:59:34.936 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T17:59:34.936 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T17:59:34.936 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T17:59:34.936 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:59:34.937 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T17:59:34.937 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T17:59:34.937 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T17:59:34.937 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:59:34.937 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T17:59:34.937 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T17:59:34.938 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T17:59:34.938 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:59:34.938 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T17:59:34.938 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T17:59:34.938 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T17:59:34.938 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T17:59:34.955 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T17:59:34.955 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T17:59:34.956 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T17:59:34.956 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T17:59:34.957 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T17:59:34.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T17:59:34.965 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T17:59:34.965 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T17:59:35.007 INFO:tasks.ceph.mds.c:Started 2023-12-19T17:59:35.008 DEBUG:teuthology.parallel:result is None 2023-12-19T17:59:35.011 INFO:tasks.ceph.mds.a:Started 2023-12-19T17:59:35.011 DEBUG:teuthology.parallel:result is None 2023-12-19T17:59:35.013 INFO:tasks.ceph.mds.d:Started 2023-12-19T17:59:35.013 DEBUG:teuthology.parallel:result is None 2023-12-19T17:59:35.017 INFO:tasks.ceph.mds.b:Started 2023-12-19T17:59:35.018 DEBUG:teuthology.parallel:result is None 2023-12-19T17:59:35.018 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T17:59:35.122 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T17:59:35.127 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T17:59:35.129 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T17:59:35.147 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T17:59:35.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-19T17:59:35.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-19T17:59:35.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.189+0000 7f5adb59e700 1 Processor -- start 2023-12-19T17:59:35.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.189+0000 7f5adb59e700 1 -- start start 2023-12-19T17:59:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adb59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adb59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5adc06fe80 0x7f5adc0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adb59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5adc0d1820 con 0x7f5adc0b88b0 2023-12-19T17:59:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adb59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5adc0d1b00 con 0x7f5adc06fe80 2023-12-19T17:59:35.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adb59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0d1de0 con 0x7f5adc06ea90 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5adc06fe80 0x7f5adc0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5adc06fe80 0x7f5adc0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44930/0 (socket says 172.21.15.45:44930) 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 -- 172.21.15.45:0/3092602864 learned_addr learned my addr 172.21.15.45:0/3092602864 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5ada59c700 1 --2- 172.21.15.45:0/3092602864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 -- 172.21.15.45:0/3092602864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 msgr2=0x7f5adc0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 --2- 172.21.15.45:0/3092602864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 -- 172.21.15.45:0/3092602864 >> v1:172.21.15.73:6789/0 conn(0x7f5adc0b88b0 legacy=0x7f5adc0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 -- 172.21.15.45:0/3092602864 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5adc0d20c0 con 0x7f5adc06fe80 2023-12-19T17:59:35.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5ad959a700 1 -- 172.21.15.45:0/3092602864 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3931042723 0 0) 0x7f5adc0d1820 con 0x7f5adc0b88b0 2023-12-19T17:59:35.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5adad9d700 1 --2- 172.21.15.45:0/3092602864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc0b6420 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009e50 tx=0x7f5ad400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92916d75490f265a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:35.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.193+0000 7f5ad959a700 1 -- 172.21.15.45:0/3092602864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400e070 con 0x7f5adc06fe80 2023-12-19T17:59:35.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5ad959a700 1 -- 172.21.15.45:0/3092602864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad400b910 con 0x7f5adc06fe80 2023-12-19T17:59:35.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5ad959a700 1 -- 172.21.15.45:0/3092602864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400bcc0 con 0x7f5adc06fe80 2023-12-19T17:59:35.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 -- 172.21.15.45:0/3092602864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 msgr2=0x7f5adc0b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:35.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 --2- 172.21.15.45:0/3092602864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc0b6420 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4009e50 tx=0x7f5ad400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 -- 172.21.15.45:0/3092602864 shutdown_connections 2023-12-19T17:59:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 --2- 172.21.15.45:0/3092602864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc0b6420 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:35.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 --2- 172.21.15.45:0/3092602864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 -- 172.21.15.45:0/3092602864 >> 172.21.15.45:0/3092602864 conn(0x7f5adc0b46d0 msgr2=0x7f5adc0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 -- 172.21.15.45:0/3092602864 shutdown_connections 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 -- 172.21.15.45:0/3092602864 wait complete. 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.197+0000 7f5adb59e700 1 Processor -- start 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 -- start start 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc06d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:35.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5adc0b88b0 0x7f5adc15a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0ccb60 con 0x7f5adc06fe80 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc06de70 con 0x7f5adc0b88b0 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0cbda0 con 0x7f5adc06ea90 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc06d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc06d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44940/0 (socket says 172.21.15.45:44940) 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 -- 172.21.15.45:0/4215063477 learned_addr learned my addr 172.21.15.45:0/4215063477 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ada59c700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:35.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adad9d700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5adc0b88b0 0x7f5adc15a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 -- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 msgr2=0x7f5adc15acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc15acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 -- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5adc0b88b0 msgr2=0x7f5adc15a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5adc0b88b0 0x7f5adc15a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 -- 172.21.15.45:0/4215063477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009b30 con 0x7f5adc06fe80 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5ad9d9b700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc06d820 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00011e0 tx=0x7f5ad000cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:35.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad00054e0 con 0x7f5adc06fe80 2023-12-19T17:59:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad00036a0 con 0x7f5adc06fe80 2023-12-19T17:59:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc0cc080 con 0x7f5adc06fe80 2023-12-19T17:59:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0003a50 con 0x7f5adc06fe80 2023-12-19T17:59:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.201+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc0cc640 con 0x7f5adc06fe80 2023-12-19T17:59:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.205+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc067760 con 0x7f5adc06fe80 2023-12-19T17:59:35.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.205+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5ad0003bb0 con 0x7f5adc06fe80 2023-12-19T17:59:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.209+0000 7f5acaffd700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5abc065b00 0x7f5abc067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.209+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f5ad00825d0 con 0x7f5adc06fe80 2023-12-19T17:59:35.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.209+0000 7f5ada59c700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5abc065b00 0x7f5abc067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:35.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.209+0000 7f5ada59c700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5abc065b00 0x7f5abc067fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0c5ca0 tx=0x7f5acc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:35.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.213+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5ad0050030 con 0x7f5adc06fe80 2023-12-19T17:59:35.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:35.409+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f5adc15c840 con 0x7f5adc06fe80 2023-12-19T17:59:36.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.237+0000 7f5acaffd700 1 -- 172.21.15.45:0/4215063477 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v81) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ad0017080 con 0x7f5adc06fe80 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5abc065b00 msgr2=0x7f5abc067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5abc065b00 0x7f5abc067fc0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5adc0c5ca0 tx=0x7f5acc008040 comp rx=0 tx=0).stop 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 msgr2=0x7f5adc06d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc06d820 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5ad00011e0 tx=0x7f5ad000cae0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 shutdown_connections 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5abc065b00 0x7f5abc067fc0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5adc0b88b0 0x7f5adc15a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5adc06fe80 0x7f5adc06d820 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 --2- 172.21.15.45:0/4215063477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5adc06ea90 0x7f5adc15acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.241+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 >> 172.21.15.45:0/4215063477 conn(0x7f5adc0b46d0 msgr2=0x7f5adc0b7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:36.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.245+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 shutdown_connections 2023-12-19T17:59:36.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.245+0000 7f5adb59e700 1 -- 172.21.15.45:0/4215063477 wait complete. 2023-12-19T17:59:36.250 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-19T17:59:36.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T17:59:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.453+0000 7f7ec8a64700 1 Processor -- start 2023-12-19T17:59:36.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.453+0000 7f7ec8a64700 1 -- start start 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ec406f530 0x7f7ec40c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec40ca910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ec406fca0 con 0x7f7ec406d7a0 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ec4070d40 con 0x7f7ec406f530 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec406ff80 con 0x7f7ec40ca4e0 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f7ec406d7a0 0x7f7ec406db80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59520/0 (socket says 172.21.15.45:59520) 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec37fe700 1 -- 172.21.15.45:0/1359078068 learned_addr learned my addr 172.21.15.45:0/1359078068 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec2ffd700 1 --2- 172.21.15.45:0/1359078068 >> v2:172.21.15.45:3300/0 conn(0x7f7ec406f530 0x7f7ec40c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec3fff700 1 --2- 172.21.15.45:0/1359078068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec40ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec27fc700 1 -- 172.21.15.45:0/1359078068 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4277846069 0 0) 0x7f7ec406fca0 con 0x7f7ec406d7a0 2023-12-19T17:59:36.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec2ffd700 1 -- 172.21.15.45:0/1359078068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 msgr2=0x7f7ec40ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:36.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec2ffd700 1 --2- 172.21.15.45:0/1359078068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec40ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec2ffd700 1 -- 172.21.15.45:0/1359078068 >> v1:172.21.15.45:6789/0 conn(0x7f7ec406d7a0 legacy=0x7f7ec406db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec2ffd700 1 -- 172.21.15.45:0/1359078068 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ec4070260 con 0x7f7ec406f530 2023-12-19T17:59:36.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec2ffd700 1 --2- 172.21.15.45:0/1359078068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406f530 0x7f7ec40c9fa0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009850 tx=0x7f7eb8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d341856a98397978 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:36.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec27fc700 1 -- 172.21.15.45:0/1359078068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011830 con 0x7f7ec406f530 2023-12-19T17:59:36.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec27fc700 1 -- 172.21.15.45:0/1359078068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb8011990 con 0x7f7ec406f530 2023-12-19T17:59:36.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec27fc700 1 -- 172.21.15.45:0/1359078068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb8011d40 con 0x7f7ec406f530 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 -- 172.21.15.45:0/1359078068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406f530 msgr2=0x7f7ec40c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.457+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/1359078068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406f530 0x7f7ec40c9fa0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f7eb8009850 tx=0x7f7eb8009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 -- 172.21.15.45:0/1359078068 shutdown_connections 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/1359078068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec40ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/1359078068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406f530 0x7f7ec40c9fa0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 -- 172.21.15.45:0/1359078068 >> 172.21.15.45:0/1359078068 conn(0x7f7ec40cf950 msgr2=0x7f7ec40cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 -- 172.21.15.45:0/1359078068 shutdown_connections 2023-12-19T17:59:36.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 -- 172.21.15.45:0/1359078068 wait complete. 2023-12-19T17:59:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 Processor -- start 2023-12-19T17:59:36.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.461+0000 7f7ec8a64700 1 -- start start 2023-12-19T17:59:36.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 0x7f7ec41f2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ec406f530 0x7f7ec40c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec41f5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40c5ec0 con 0x7f7ec406d7a0 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec41f31c0 con 0x7f7ec406f530 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ec40c5240 con 0x7f7ec40ca4e0 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 0x7f7ec41f2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 0x7f7ec41f2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44964/0 (socket says 172.21.15.45:44964) 2023-12-19T17:59:36.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 -- 172.21.15.45:0/3658749410 learned_addr learned my addr 172.21.15.45:0/3658749410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec3fff700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec41f5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec2ffd700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ec406f530 0x7f7ec40c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 -- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 msgr2=0x7f7ec41f5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec41f5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 -- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ec406f530 msgr2=0x7f7ec40c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ec406f530 0x7f7ec40c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 -- 172.21.15.45:0/3658749410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb80094b0 con 0x7f7ec406d7a0 2023-12-19T17:59:36.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec37fe700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 0x7f7ec41f2c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400c550 tx=0x7f7eb400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4004ca0 con 0x7f7ec406d7a0 2023-12-19T17:59:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ec40c5520 con 0x7f7ec406d7a0 2023-12-19T17:59:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eb4004e00 con 0x7f7ec406d7a0 2023-12-19T17:59:36.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.465+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eb4007310 con 0x7f7ec406d7a0 2023-12-19T17:59:36.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.469+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ec40c5ae0 con 0x7f7ec406d7a0 2023-12-19T17:59:36.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.469+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ec40b5960 con 0x7f7ec406d7a0 2023-12-19T17:59:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.473+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7eb4007470 con 0x7f7ec406d7a0 2023-12-19T17:59:36.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.473+0000 7f7eabfff700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7eb0065ad0 0x7f7eb0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.473+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7eb4082b50 con 0x7f7ec406d7a0 2023-12-19T17:59:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.473+0000 7f7ec2ffd700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7eb0065ad0 0x7f7eb0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.473+0000 7f7ec2ffd700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7eb0065ad0 0x7f7eb0067f90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80090b0 tx=0x7f7eb8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:36.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.477+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7eb4050730 con 0x7f7ec406d7a0 2023-12-19T17:59:36.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.713+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7ec40c6000 con 0x7f7ec406d7a0 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.713+0000 7f7eabfff700 1 -- 172.21.15.45:0/3658749410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7eb4007720 con 0x7f7ec406d7a0 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A==", 2023-12-19T17:59:36.720 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg==", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.721 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA==", 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-19T17:59:36.722 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ==", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg==", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.723 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA==", 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w==", 2023-12-19T17:59:36.724 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ==", 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.725 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg==", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA==", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.726 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w==", 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-19T17:59:36.727 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA==", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA==", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.728 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A==", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ==", 2023-12-19T17:59:36.729 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ==", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T17:59:36.730 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl3IfBDBAAsKhx3aytTBDBVKorcbcCHw==", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA==", 2023-12-19T17:59:36.731 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q==", 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-19T17:59:36.732 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:59:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7eb0065ad0 msgr2=0x7f7eb0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7eb0065ad0 0x7f7eb0067f90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7eb80090b0 tx=0x7f7eb8008030 comp rx=0 tx=0).stop 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 msgr2=0x7f7ec41f2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 0x7f7ec41f2c80 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f7eb400c550 tx=0x7f7eb400c860 comp rx=0 tx=0).stop 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 shutdown_connections 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7eb0065ad0 0x7f7eb0067f90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ec40ca4e0 0x7f7ec41f5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ec406f530 0x7f7ec40c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 --2- 172.21.15.45:0/3658749410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ec406d7a0 0x7f7ec41f2c80 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 >> 172.21.15.45:0/3658749410 conn(0x7f7ec40cf950 msgr2=0x7f7ec40cfd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 shutdown_connections 2023-12-19T17:59:36.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.717+0000 7f7ec8a64700 1 -- 172.21.15.45:0/3658749410 wait complete. 2023-12-19T17:59:36.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:36.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.925+0000 7f473759e700 1 Processor -- start 2023-12-19T17:59:36.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.925+0000 7f473759e700 1 -- start start 2023-12-19T17:59:36.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47380d1820 con 0x7f47380b88b0 2023-12-19T17:59:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47380d1b00 con 0x7f473806fe80 2023-12-19T17:59:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47380d1de0 con 0x7f473806ea90 2023-12-19T17:59:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f472ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f47380b88b0 0x7f47380b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59528/0 (socket says 172.21.15.45:59528) 2023-12-19T17:59:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f472ffff700 1 -- 172.21.15.45:0/1625014642 learned_addr learned my addr 172.21.15.45:0/1625014642 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473659c700 1 --2- 172.21.15.45:0/1625014642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2708330584 0 0) 0x7f47380d1b00 con 0x7f473806fe80 2023-12-19T17:59:36.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47240035d0 con 0x7f473806fe80 2023-12-19T17:59:36.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2087479762 0 0) 0x7f47380d1820 con 0x7f47380b88b0 2023-12-19T17:59:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47380d1b00 con 0x7f47380b88b0 2023-12-19T17:59:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473659c700 1 -- 172.21.15.45:0/1625014642 >> v1:172.21.15.73:6789/0 conn(0x7f473806fe80 legacy=0x7f47380b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473659c700 1 -- 172.21.15.45:0/1625014642 >> v1:172.21.15.45:6789/0 conn(0x7f47380b88b0 legacy=0x7f47380b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473659c700 1 -- 172.21.15.45:0/1625014642 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380d20c0 con 0x7f473806ea90 2023-12-19T17:59:36.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f473659c700 1 --2- 172.21.15.45:0/1625014642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380d0f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4728009880 tx=0x7f4728009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cedf2d2800b3ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:36.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728011830 con 0x7f473806ea90 2023-12-19T17:59:36.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4728011990 con 0x7f473806ea90 2023-12-19T17:59:36.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.929+0000 7f4735d9b700 1 -- 172.21.15.45:0/1625014642 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728011d20 con 0x7f473806ea90 2023-12-19T17:59:36.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 -- 172.21.15.45:0/1625014642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 msgr2=0x7f47380d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 --2- 172.21.15.45:0/1625014642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380d0f20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4728009880 tx=0x7f4728009b90 comp rx=0 tx=0).stop 2023-12-19T17:59:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 -- 172.21.15.45:0/1625014642 shutdown_connections 2023-12-19T17:59:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 --2- 172.21.15.45:0/1625014642 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380d0f20 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 -- 172.21.15.45:0/1625014642 >> 172.21.15.45:0/1625014642 conn(0x7f47380b46d0 msgr2=0x7f47380b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 -- 172.21.15.45:0/1625014642 shutdown_connections 2023-12-19T17:59:36.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 -- 172.21.15.45:0/1625014642 wait complete. 2023-12-19T17:59:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 Processor -- start 2023-12-19T17:59:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.933+0000 7f473759e700 1 -- start start 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 0x7f47380b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47380b88b0 0x7f47380b6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47380cc280 con 0x7f473806fe80 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47380cb9e0 con 0x7f47380b88b0 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47380cbcc0 con 0x7f473806ea90 2023-12-19T17:59:36.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 0x7f47380b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 0x7f47380b67f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44966/0 (socket says 172.21.15.45:44966) 2023-12-19T17:59:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 -- 172.21.15.45:0/1350436363 learned_addr learned my addr 172.21.15.45:0/1350436363 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473659c700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f4736d9d700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47380b88b0 0x7f47380b6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 -- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 msgr2=0x7f47380cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 -- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47380b88b0 msgr2=0x7f47380b6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47380b88b0 0x7f47380b6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 -- 172.21.15.45:0/1350436363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47280094b0 con 0x7f473806fe80 2023-12-19T17:59:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473659c700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:36.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472ffff700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 0x7f47380b67f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f472000c700 tx=0x7f472000cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720005d90 con 0x7f473806fe80 2023-12-19T17:59:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47200070d0 con 0x7f473806fe80 2023-12-19T17:59:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47380cbfa0 con 0x7f473806fe80 2023-12-19T17:59:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4720007480 con 0x7f473806fe80 2023-12-19T17:59:36.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.937+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47380cb690 con 0x7f473806fe80 2023-12-19T17:59:36.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.941+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47380c9f90 con 0x7f473806fe80 2023-12-19T17:59:36.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.941+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f47200075e0 con 0x7f473806fe80 2023-12-19T17:59:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.945+0000 7f472effd700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4718065ad0 0x7f4718067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.945+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4720082500 con 0x7f473806fe80 2023-12-19T17:59:36.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.945+0000 7f473659c700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4718065ad0 0x7f4718067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:36.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.945+0000 7f473659c700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4718065ad0 0x7f4718067f90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f47280090b0 tx=0x7f472801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:36.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:36.949+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f47200500e0 con 0x7f473806fe80 2023-12-19T17:59:37.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.125+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4738067760 con 0x7f473806fe80 2023-12-19T17:59:37.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f472effd700 1 -- 172.21.15.45:0/1350436363 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+12547 (secure 0 0 0) 0x7f4720053700 con 0x7f473806fe80 2023-12-19T17:59:37.132 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:37.132 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":81,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:36.231254+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":10,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:37.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4718065ad0 msgr2=0x7f4718067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4718065ad0 0x7f4718067f90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f47280090b0 tx=0x7f472801c040 comp rx=0 tx=0).stop 2023-12-19T17:59:37.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 msgr2=0x7f47380b67f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 0x7f47380b67f0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f472000c700 tx=0x7f472000cac0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 shutdown_connections 2023-12-19T17:59:37.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4718065ad0 0x7f4718067f90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47380b88b0 0x7f47380b6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f473806fe80 0x7f47380b67f0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 --2- 172.21.15.45:0/1350436363 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f473806ea90 0x7f47380cb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 >> 172.21.15.45:0/1350436363 conn(0x7f47380b46d0 msgr2=0x7f47380b1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:37.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 shutdown_connections 2023-12-19T17:59:37.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.129+0000 7f473759e700 1 -- 172.21.15.45:0/1350436363 wait complete. 2023-12-19T17:59:37.158 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:59:37.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:59:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.333+0000 7fb77f1a7700 1 Processor -- start 2023-12-19T17:59:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.333+0000 7fb77f1a7700 1 -- start start 2023-12-19T17:59:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb77f1a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7780d0a50 0x7fb7780cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb77f1a7700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780d10e0 con 0x7fb7780cfd70 2023-12-19T17:59:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb77f1a7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7780d13c0 con 0x7fb77815d090 2023-12-19T17:59:37.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb77f1a7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7780b6040 con 0x7fb7780d0a50 2023-12-19T17:59:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb77d744700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb7780cfd70 0x7fb7780b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59534/0 (socket says 172.21.15.45:59534) 2023-12-19T17:59:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb77d744700 1 -- 172.21.15.45:0/2285502340 learned_addr learned my addr 172.21.15.45:0/2285502340 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb777fff700 1 --2- 172.21.15.45:0/2285502340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7780d0a50 0x7fb7780cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb777fff700 1 -- 172.21.15.45:0/2285502340 >> v1:172.21.15.73:6789/0 conn(0x7fb77815d090 legacy=0x7fb7780cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb777fff700 1 -- 172.21.15.45:0/2285502340 >> v1:172.21.15.45:6789/0 conn(0x7fb7780cfd70 legacy=0x7fb7780b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb777fff700 1 -- 172.21.15.45:0/2285502340 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7780d16a0 con 0x7fb7780d0a50 2023-12-19T17:59:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb777fff700 1 --2- 172.21.15.45:0/2285502340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7780d0a50 0x7fb7780cf830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb764009880 tx=0x7fb764009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6204fce3e2db310c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb7777fe700 1 -- 172.21.15.45:0/2285502340 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764011830 con 0x7fb7780d0a50 2023-12-19T17:59:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb7777fe700 1 -- 172.21.15.45:0/2285502340 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb764011990 con 0x7fb7780d0a50 2023-12-19T17:59:37.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.337+0000 7fb7777fe700 1 -- 172.21.15.45:0/2285502340 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764011d20 con 0x7fb7780d0a50 2023-12-19T17:59:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 -- 172.21.15.45:0/2285502340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7780d0a50 msgr2=0x7fb7780cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/2285502340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7780d0a50 0x7fb7780cf830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb764009880 tx=0x7fb764009b90 comp rx=0 tx=0).stop 2023-12-19T17:59:37.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 -- 172.21.15.45:0/2285502340 shutdown_connections 2023-12-19T17:59:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/2285502340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7780d0a50 0x7fb7780cf830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 -- 172.21.15.45:0/2285502340 >> 172.21.15.45:0/2285502340 conn(0x7fb7780b4b90 msgr2=0x7fb7780b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 -- 172.21.15.45:0/2285502340 shutdown_connections 2023-12-19T17:59:37.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 -- 172.21.15.45:0/2285502340 wait complete. 2023-12-19T17:59:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 Processor -- start 2023-12-19T17:59:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.341+0000 7fb77f1a7700 1 -- start start 2023-12-19T17:59:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 0x7fb778160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7780d0a50 0x7fb7780b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb77815d090 0x7fb77815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815fea0 con 0x7fb7780cfd70 2023-12-19T17:59:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815f290 con 0x7fb7780d0a50 2023-12-19T17:59:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb77815f570 con 0x7fb77815d090 2023-12-19T17:59:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 0x7fb778160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 0x7fb778160330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44982/0 (socket says 172.21.15.45:44982) 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb777fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7780d0a50 0x7fb7780b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 -- 172.21.15.45:0/3038104972 learned_addr learned my addr 172.21.15.45:0/3038104972 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77d744700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb77815d090 0x7fb77815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 -- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb77815d090 msgr2=0x7fb77815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb77815d090 0x7fb77815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 -- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7780d0a50 msgr2=0x7fb7780b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7780d0a50 0x7fb7780b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 -- 172.21.15.45:0/3038104972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7640094b0 con 0x7fb7780cfd70 2023-12-19T17:59:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77d744700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb77815d090 0x7fb77815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77cf43700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 0x7fb778160330 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c500 tx=0x7fb76c00c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0052d0 con 0x7fb7780cfd70 2023-12-19T17:59:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb76c005430 con 0x7fb7780cfd70 2023-12-19T17:59:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb77815f850 con 0x7fb7780cfd70 2023-12-19T17:59:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.345+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0055a0 con 0x7fb7780cfd70 2023-12-19T17:59:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.349+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7780b4250 con 0x7fb7780cfd70 2023-12-19T17:59:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.349+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7780b4440 con 0x7fb7780cfd70 2023-12-19T17:59:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.349+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb76c0038e0 con 0x7fb7780cfd70 2023-12-19T17:59:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.353+0000 7fb7757fa700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb75c065ad0 0x7fb75c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.353+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb76c082410 con 0x7fb7780cfd70 2023-12-19T17:59:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.353+0000 7fb777fff700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb75c065ad0 0x7fb75c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.353+0000 7fb777fff700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb75c065ad0 0x7fb75c067f90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb764000c00 tx=0x7fb764008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:37.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.357+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb76c04fe30 con 0x7fb7780cfd70 2023-12-19T17:59:37.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.537+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb77804ed30 con 0x7fb7780cfd70 2023-12-19T17:59:37.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.537+0000 7fb7757fa700 1 -- 172.21.15.45:0/3038104972 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb76c053450 con 0x7fb7780cfd70 2023-12-19T17:59:37.542 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:59:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb75c065ad0 msgr2=0x7fb75c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb75c065ad0 0x7fb75c067f90 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb764000c00 tx=0x7fb764008030 comp rx=0 tx=0).stop 2023-12-19T17:59:37.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 msgr2=0x7fb778160330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 0x7fb778160330 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00c500 tx=0x7fb76c00c810 comp rx=0 tx=0).stop 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 shutdown_connections 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb75c065ad0 0x7fb75c067f90 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb77815d090 0x7fb77815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7780d0a50 0x7fb7780b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 --2- 172.21.15.45:0/3038104972 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7780cfd70 0x7fb778160330 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 >> 172.21.15.45:0/3038104972 conn(0x7fb7780b4b90 msgr2=0x7fb7780b8790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 shutdown_connections 2023-12-19T17:59:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.541+0000 7fb77f1a7700 1 -- 172.21.15.45:0/3038104972 wait complete. 2023-12-19T17:59:37.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T17:59:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.737+0000 7f1f6685e700 1 Processor -- start 2023-12-19T17:59:37.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.737+0000 7f1f6685e700 1 -- start start 2023-12-19T17:59:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f6685e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6015ab50 0x7f1f600ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f6685e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1f6006e0a0 0x7f1f600cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f6685e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f6006cbb0 con 0x7f1f6015af30 2023-12-19T17:59:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f6685e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f6006fa10 con 0x7f1f6006e0a0 2023-12-19T17:59:37.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f6685e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6006fcf0 con 0x7f1f6015ab50 2023-12-19T17:59:37.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f577fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1f6015af30 0x7f1f6015e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:56956/0 (socket says 172.21.15.45:56956) 2023-12-19T17:59:37.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6015ab50 0x7f1f600ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f577fe700 1 -- 172.21.15.45:0/1699802772 learned_addr learned my addr 172.21.15.45:0/1699802772 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:37.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f64dfb700 1 --2- 172.21.15.45:0/1699802772 >> v2:172.21.15.45:3300/0 conn(0x7f1f6006e0a0 0x7f1f600cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5f7fe700 1 -- 172.21.15.45:0/1699802772 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471284361 0 0) 0x7f1f6006cbb0 con 0x7f1f6015af30 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5f7fe700 1 -- 172.21.15.45:0/1699802772 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f4c0035d0 con 0x7f1f6015af30 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5ffff700 1 -- 172.21.15.45:0/1699802772 >> v2:172.21.15.45:3300/0 conn(0x7f1f6006e0a0 msgr2=0x7f1f600cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5ffff700 1 --2- 172.21.15.45:0/1699802772 >> v2:172.21.15.45:3300/0 conn(0x7f1f6006e0a0 0x7f1f600cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5ffff700 1 -- 172.21.15.45:0/1699802772 >> v1:172.21.15.73:6789/0 conn(0x7f1f6015af30 legacy=0x7f1f6015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.741+0000 7f1f5ffff700 1 -- 172.21.15.45:0/1699802772 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f6006ffd0 con 0x7f1f6015ab50 2023-12-19T17:59:37.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f5ffff700 1 --2- 172.21.15.45:0/1699802772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6015ab50 0x7f1f600ccd70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009850 tx=0x7f1f50009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406b13b56a0a99fe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:37.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f5f7fe700 1 -- 172.21.15.45:0/1699802772 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50011830 con 0x7f1f6015ab50 2023-12-19T17:59:37.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f5f7fe700 1 -- 172.21.15.45:0/1699802772 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f50011990 con 0x7f1f6015ab50 2023-12-19T17:59:37.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f5f7fe700 1 -- 172.21.15.45:0/1699802772 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50011d40 con 0x7f1f6015ab50 2023-12-19T17:59:37.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 -- 172.21.15.45:0/1699802772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6015ab50 msgr2=0x7f1f600ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 --2- 172.21.15.45:0/1699802772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6015ab50 0x7f1f600ccd70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1f50009850 tx=0x7f1f50009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 -- 172.21.15.45:0/1699802772 shutdown_connections 2023-12-19T17:59:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 --2- 172.21.15.45:0/1699802772 >> v2:172.21.15.45:3300/0 conn(0x7f1f6006e0a0 0x7f1f600cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 --2- 172.21.15.45:0/1699802772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6015ab50 0x7f1f600ccd70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 -- 172.21.15.45:0/1699802772 >> 172.21.15.45:0/1699802772 conn(0x7f1f600cba40 msgr2=0x7f1f600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:37.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 -- 172.21.15.45:0/1699802772 shutdown_connections 2023-12-19T17:59:37.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.745+0000 7f1f6685e700 1 -- 172.21.15.45:0/1699802772 wait complete. 2023-12-19T17:59:37.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 Processor -- start 2023-12-19T17:59:37.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 -- start start 2023-12-19T17:59:37.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 0x7f1f600c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f6015ab50 0x7f1f601ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f6015af30 0x7f1f600ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600c7a00 con 0x7f1f6015af30 2023-12-19T17:59:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f600b41c0 con 0x7f1f6015ab50 2023-12-19T17:59:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f6685e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f601efeb0 con 0x7f1f6006e0a0 2023-12-19T17:59:37.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f64dfb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f6015af30 0x7f1f600ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 0x7f1f600c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f64dfb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f6015af30 0x7f1f600ca060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45002/0 (socket says 172.21.15.45:45002) 2023-12-19T17:59:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f5ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 0x7f1f600c74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:51518/0 (socket says 172.21.15.45:51518) 2023-12-19T17:59:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f64dfb700 1 -- 172.21.15.45:0/4278815618 learned_addr learned my addr 172.21.15.45:0/4278815618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:37.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.749+0000 7f1f577fe700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f6015ab50 0x7f1f601ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5ffff700 1 -- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f6015ab50 msgr2=0x7f1f601ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5ffff700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f6015ab50 0x7f1f601ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5ffff700 1 -- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f6015af30 msgr2=0x7f1f600ca060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5ffff700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f6015af30 0x7f1f600ca060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5ffff700 1 -- 172.21.15.45:0/4278815618 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f500094b0 con 0x7f1f6006e0a0 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5ffff700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 0x7f1f600c74c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f50016000 tx=0x7f1f50004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50004590 con 0x7f1f6006e0a0 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f500036c0 con 0x7f1f6006e0a0 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f60158380 con 0x7f1f6006e0a0 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f50003a70 con 0x7f1f6006e0a0 2023-12-19T17:59:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f60147a80 con 0x7f1f6006e0a0 2023-12-19T17:59:37.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.753+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6004ed30 con 0x7f1f6006e0a0 2023-12-19T17:59:37.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.757+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f50003bd0 con 0x7f1f6006e0a0 2023-12-19T17:59:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.757+0000 7f1f5d7fa700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f40065b20 0x7f1f40067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.757+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1f50021030 con 0x7f1f6006e0a0 2023-12-19T17:59:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.757+0000 7f1f577fe700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f40065b20 0x7f1f40067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.761+0000 7f1f577fe700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f40065b20 0x7f1f40067fe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1f60152050 tx=0x7f1f48007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.769+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f50052020 con 0x7f1f6006e0a0 2023-12-19T17:59:37.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.949+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1f6006c990 con 0x7f1f6006e0a0 2023-12-19T17:59:37.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.949+0000 7f1f5d7fa700 1 -- 172.21.15.45:0/4278815618 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1f50055640 con 0x7f1f6006e0a0 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:37.955 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f40065b20 msgr2=0x7f1f40067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f40065b20 0x7f1f40067fe0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1f60152050 tx=0x7f1f48007de0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 msgr2=0x7f1f600c74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 0x7f1f600c74c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1f50016000 tx=0x7f1f50004770 comp rx=0 tx=0).stop 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 shutdown_connections 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f40065b20 0x7f1f40067fe0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f6015af30 0x7f1f600ca060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f6015ab50 0x7f1f601ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 --2- 172.21.15.45:0/4278815618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f6006e0a0 0x7f1f600c74c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 >> 172.21.15.45:0/4278815618 conn(0x7f1f600cba40 msgr2=0x7f1f600ae630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:37.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 shutdown_connections 2023-12-19T17:59:37.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:37.953+0000 7f1f6685e700 1 -- 172.21.15.45:0/4278815618 wait complete. 2023-12-19T17:59:37.981 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T17:59:37.981 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T17:59:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.157+0000 7f99e6c8c700 1 Processor -- start 2023-12-19T17:59:38.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.157+0000 7f99e6c8c700 1 -- start start 2023-12-19T17:59:38.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e6c8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e015ccb0 0x7f99e00b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e6c8c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f99e0071160 0x7f99e00d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e6c8c700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99e00d15b0 con 0x7f99e015d090 2023-12-19T17:59:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e6c8c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e00d2b90 con 0x7f99e0071160 2023-12-19T17:59:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e6c8c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00d1890 con 0x7f99e015ccb0 2023-12-19T17:59:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e5489700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f99e015d090 0x7f99e0070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59550/0 (socket says 172.21.15.45:59550) 2023-12-19T17:59:38.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e5489700 1 -- 172.21.15.45:0/934662238 learned_addr learned my addr 172.21.15.45:0/934662238 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e648b700 1 --2- 172.21.15.45:0/934662238 >> v2:172.21.15.45:3300/0 conn(0x7f99e0071160 0x7f99e00d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e5c8a700 1 --2- 172.21.15.45:0/934662238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e015ccb0 0x7f99e00b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e648b700 1 -- 172.21.15.45:0/934662238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e015ccb0 msgr2=0x7f99e00b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e648b700 1 --2- 172.21.15.45:0/934662238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e015ccb0 0x7f99e00b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e648b700 1 -- 172.21.15.45:0/934662238 >> v1:172.21.15.45:6789/0 conn(0x7f99e015d090 legacy=0x7f99e0070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e648b700 1 -- 172.21.15.45:0/934662238 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e00d1b70 con 0x7f99e0071160 2023-12-19T17:59:38.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e648b700 1 --2- 172.21.15.45:0/934662238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e0071160 0x7f99e00d2650 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009d90 tx=0x7f99d800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f99c3cf31a5e0b10 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:38.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e4c88700 1 -- 172.21.15.45:0/934662238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d800e070 con 0x7f99e0071160 2023-12-19T17:59:38.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e4c88700 1 -- 172.21.15.45:0/934662238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d800bb20 con 0x7f99e0071160 2023-12-19T17:59:38.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.161+0000 7f99e4c88700 1 -- 172.21.15.45:0/934662238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8012430 con 0x7f99e0071160 2023-12-19T17:59:38.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 -- 172.21.15.45:0/934662238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e0071160 msgr2=0x7f99e00d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/934662238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e0071160 0x7f99e00d2650 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f99d8009d90 tx=0x7f99d800b330 comp rx=0 tx=0).stop 2023-12-19T17:59:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 -- 172.21.15.45:0/934662238 shutdown_connections 2023-12-19T17:59:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/934662238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e0071160 0x7f99e00d2650 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/934662238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e015ccb0 0x7f99e00b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 -- 172.21.15.45:0/934662238 >> 172.21.15.45:0/934662238 conn(0x7f99e00d2f50 msgr2=0x7f99e00d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 -- 172.21.15.45:0/934662238 shutdown_connections 2023-12-19T17:59:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.165+0000 7f99e6c8c700 1 -- 172.21.15.45:0/934662238 wait complete. 2023-12-19T17:59:38.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 Processor -- start 2023-12-19T17:59:38.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 -- start start 2023-12-19T17:59:38.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e0071160 0x7f99e00c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:38.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e015ccb0 0x7f99e0153ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:38.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 0x7f99e00cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e0154bb0 con 0x7f99e015d090 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c8bb0 con 0x7f99e015ccb0 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e6c8c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e00c7350 con 0x7f99e0071160 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e648b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 0x7f99e00cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e648b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 0x7f99e00cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:45012/0 (socket says 172.21.15.45:45012) 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e648b700 1 -- 172.21.15.45:0/4099645764 learned_addr learned my addr 172.21.15.45:0/4099645764 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:38.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e5c8a700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e0071160 0x7f99e00c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.169+0000 7f99e5489700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e015ccb0 0x7f99e0153ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e648b700 1 -- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e0071160 msgr2=0x7f99e00c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e648b700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e0071160 0x7f99e00c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e648b700 1 -- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e015ccb0 msgr2=0x7f99e0153ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e648b700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e015ccb0 0x7f99e0153ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e648b700 1 -- 172.21.15.45:0/4099645764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d8009a70 con 0x7f99e015d090 2023-12-19T17:59:38.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e648b700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 0x7f99e00cbf10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f99d8014040 tx=0x7f99d8004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8012430 con 0x7f99e015d090 2023-12-19T17:59:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99d8020070 con 0x7f99e015d090 2023-12-19T17:59:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99d8004280 con 0x7f99e015d090 2023-12-19T17:59:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99e00c8e00 con 0x7f99e015d090 2023-12-19T17:59:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e00c78d0 con 0x7f99e015d090 2023-12-19T17:59:38.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.173+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e0067c10 con 0x7f99e015d090 2023-12-19T17:59:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.177+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f99d80043e0 con 0x7f99e015d090 2023-12-19T17:59:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.177+0000 7f99d67fc700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f99c4065ad0 0x7f99c4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.177+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f99d8022070 con 0x7f99e015d090 2023-12-19T17:59:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.177+0000 7f99e5c8a700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f99c4065ad0 0x7f99c4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.177+0000 7f99e5c8a700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f99c4065ad0 0x7f99c4067f90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99e015c190 tx=0x7f99dc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.185+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f99d80527a0 con 0x7f99e015d090 2023-12-19T17:59:38.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.361+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f99e00c7af0 con 0x7f99e015d090 2023-12-19T17:59:38.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.833+0000 7f99d67fc700 1 -- 172.21.15.45:0/4099645764 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f99d8055dc0 con 0x7f99e015d090 2023-12-19T17:59:38.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f99c4065ad0 msgr2=0x7f99c4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:38.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f99c4065ad0 0x7f99c4067f90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f99e015c190 tx=0x7f99dc009240 comp rx=0 tx=0).stop 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 msgr2=0x7f99e00cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 0x7f99e00cbf10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f99d8014040 tx=0x7f99d8004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 shutdown_connections 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f99c4065ad0 0x7f99c4067f90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f99e015d090 0x7f99e00cbf10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99e015ccb0 0x7f99e0153ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 --2- 172.21.15.45:0/4099645764 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f99e0071160 0x7f99e00c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:38.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.837+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 >> 172.21.15.45:0/4099645764 conn(0x7f99e00d2f50 msgr2=0x7f99e00d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:38.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.841+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 shutdown_connections 2023-12-19T17:59:38.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:38.841+0000 7f99e6c8c700 1 -- 172.21.15.45:0/4099645764 wait complete. 2023-12-19T17:59:38.849 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-19T17:59:38.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T17:59:39.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.053+0000 7f1493369700 1 Processor -- start 2023-12-19T17:59:39.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.053+0000 7f1493369700 1 -- start start 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1493369700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c160b80 0x7f148c160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1493369700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f148c0d16d0 0x7f148c0d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1493369700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f148c0b5dd0 con 0x7f148c15d0b0 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1493369700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148c0d1240 con 0x7f148c0d16d0 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1493369700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c15d490 con 0x7f148c160b80 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f148c0d16d0 0x7f148c0d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f148c0d16d0 0x7f148c0d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:39890/0 (socket says 172.21.15.45:39890) 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 -- 172.21.15.45:0/2746096699 learned_addr learned my addr 172.21.15.45:0/2746096699 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1490904700 1 --2- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c160b80 0x7f148c160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 -- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c160b80 msgr2=0x7f148c160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 --2- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c160b80 0x7f148c160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 -- 172.21.15.45:0/2746096699 >> v1:172.21.15.73:6789/0 conn(0x7f148c15d0b0 legacy=0x7f148c0b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:39.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 -- 172.21.15.45:0/2746096699 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c161520 con 0x7f148c0d16d0 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1491906700 1 --2- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c0d16d0 0x7f148c0d1b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e50 tx=0x7f148400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15084f8a551b34c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1483fff700 1 -- 172.21.15.45:0/2746096699 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400e070 con 0x7f148c0d16d0 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1483fff700 1 -- 172.21.15.45:0/2746096699 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148400b910 con 0x7f148c0d16d0 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.057+0000 7f1483fff700 1 -- 172.21.15.45:0/2746096699 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148400bcc0 con 0x7f148c0d16d0 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 -- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c0d16d0 msgr2=0x7f148c0d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 --2- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c0d16d0 0x7f148c0d1b60 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1484009e50 tx=0x7f148400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 -- 172.21.15.45:0/2746096699 shutdown_connections 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 --2- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c160b80 0x7f148c160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 --2- 172.21.15.45:0/2746096699 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c0d16d0 0x7f148c0d1b60 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 -- 172.21.15.45:0/2746096699 >> 172.21.15.45:0/2746096699 conn(0x7f148c0d2e10 msgr2=0x7f148c0d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 -- 172.21.15.45:0/2746096699 shutdown_connections 2023-12-19T17:59:39.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.061+0000 7f1493369700 1 -- 172.21.15.45:0/2746096699 wait complete. 2023-12-19T17:59:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 Processor -- start 2023-12-19T17:59:39.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 -- start start 2023-12-19T17:59:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 0x7f148c15f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c15d0b0 0x7f148c0cbef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c160b80 0x7f148c0cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c1529a0 con 0x7f148c0d16d0 2023-12-19T17:59:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c152c80 con 0x7f148c160b80 2023-12-19T17:59:39.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1493369700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148c152f60 con 0x7f148c15d0b0 2023-12-19T17:59:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 0x7f148c15f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 0x7f148c15f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34820/0 (socket says 172.21.15.45:34820) 2023-12-19T17:59:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 -- 172.21.15.45:0/3254300026 learned_addr learned my addr 172.21.15.45:0/3254300026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491906700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c160b80 0x7f148c0cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:39.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1490904700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c15d0b0 0x7f148c0cbef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 -- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c15d0b0 msgr2=0x7f148c0cbef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c15d0b0 0x7f148c0cbef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 -- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c160b80 msgr2=0x7f148c0cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c160b80 0x7f148c0cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491105700 1 -- 172.21.15.45:0/3254300026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1484009b30 con 0x7f148c0d16d0 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.065+0000 7f1491906700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c160b80 0x7f148c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:39.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1491105700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 0x7f148c15f300 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f148800c500 tx=0x7f148800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880052d0 con 0x7f148c0d16d0 2023-12-19T17:59:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c153240 con 0x7f148c0d16d0 2023-12-19T17:59:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1488005430 con 0x7f148c0d16d0 2023-12-19T17:59:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14880055a0 con 0x7f148c0d16d0 2023-12-19T17:59:39.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c1525e0 con 0x7f148c0d16d0 2023-12-19T17:59:39.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.069+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c153760 con 0x7f148c0d16d0 2023-12-19T17:59:39.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.073+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f14880038e0 con 0x7f148c0d16d0 2023-12-19T17:59:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.073+0000 7f1481ffb700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1470065ad0 0x7f1470067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:39.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.073+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f1488082570 con 0x7f148c0d16d0 2023-12-19T17:59:39.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.073+0000 7f1490904700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1470065ad0 0x7f1470067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:39.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.073+0000 7f1490904700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1470065ad0 0x7f1470067f90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f148c1519f0 tx=0x7f147c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:39.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.081+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f148804feb0 con 0x7f148c0d16d0 2023-12-19T17:59:39.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.257+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f148c04ed30 con 0x7f148c0d16d0 2023-12-19T17:59:39.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.849+0000 7f1481ffb700 1 -- 172.21.15.45:0/3254300026 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7f14880534d0 con 0x7f148c0d16d0 2023-12-19T17:59:39.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.857+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1470065ad0 msgr2=0x7f1470067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:39.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.857+0000 7f1493369700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1470065ad0 0x7f1470067f90 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f148c1519f0 tx=0x7f147c009240 comp rx=0 tx=0).stop 2023-12-19T17:59:39.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.857+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 msgr2=0x7f148c15f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:39.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.857+0000 7f1493369700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 0x7f148c15f300 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f148800c500 tx=0x7f148800c810 comp rx=0 tx=0).stop 2023-12-19T17:59:39.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 shutdown_connections 2023-12-19T17:59:39.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1470065ad0 0x7f1470067f90 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f148c160b80 0x7f148c0cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f148c15d0b0 0x7f148c0cbef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 --2- 172.21.15.45:0/3254300026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f148c0d16d0 0x7f148c15f300 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:39.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 >> 172.21.15.45:0/3254300026 conn(0x7f148c0d2e10 msgr2=0x7f148c0c8f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:39.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 shutdown_connections 2023-12-19T17:59:39.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:39.865+0000 7f1493369700 1 -- 172.21.15.45:0/3254300026 wait complete. 2023-12-19T17:59:39.877 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-19T17:59:39.899 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T17:59:40.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.089+0000 7fd421eeb700 1 Processor -- start 2023-12-19T17:59:40.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.089+0000 7fd421eeb700 1 -- start start 2023-12-19T17:59:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd421eeb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd41c0b8580 0x7fd41c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd421eeb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c15d300 con 0x7fd41c0d25f0 2023-12-19T17:59:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd421eeb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd41c0d1550 con 0x7fd41c15cf20 2023-12-19T17:59:40.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd421eeb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd41c0d1360 con 0x7fd41c0b8580 2023-12-19T17:59:40.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd41bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd41c0b8580 0x7fd41c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd4216ea700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd41c0d25f0 0x7fd41c0b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46664/0 (socket says 172.21.15.45:46664) 2023-12-19T17:59:40.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd4216ea700 1 -- 172.21.15.45:0/2575992219 learned_addr learned my addr 172.21.15.45:0/2575992219 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:40.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd420ee9700 1 --1- 172.21.15.45:0/2575992219 >> v1:172.21.15.73:6789/0 conn(0x7fd41c15cf20 0x7fd41c0d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:52764/0 (socket says 172.21.15.45:52764) 2023-12-19T17:59:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd41bfff700 1 -- 172.21.15.45:0/2575992219 >> v1:172.21.15.73:6789/0 conn(0x7fd41c15cf20 legacy=0x7fd41c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd41bfff700 1 -- 172.21.15.45:0/2575992219 >> v1:172.21.15.45:6789/0 conn(0x7fd41c0d25f0 legacy=0x7fd41c0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd41bfff700 1 -- 172.21.15.45:0/2575992219 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd41c0d1830 con 0x7fd41c0b8580 2023-12-19T17:59:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd41bfff700 1 --2- 172.21.15.45:0/2575992219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c0cd8c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd408009850 tx=0x7fd408009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8936d96abc7e87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:40.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.093+0000 7fd41b7fe700 1 -- 172.21.15.45:0/2575992219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408011830 con 0x7fd41c0b8580 2023-12-19T17:59:40.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd41b7fe700 1 -- 172.21.15.45:0/2575992219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd408011990 con 0x7fd41c0b8580 2023-12-19T17:59:40.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd41b7fe700 1 -- 172.21.15.45:0/2575992219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd408011d20 con 0x7fd41c0b8580 2023-12-19T17:59:40.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 -- 172.21.15.45:0/2575992219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 msgr2=0x7fd41c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2575992219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c0cd8c0 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fd408009850 tx=0x7fd408009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 -- 172.21.15.45:0/2575992219 shutdown_connections 2023-12-19T17:59:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2575992219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c0cd8c0 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 -- 172.21.15.45:0/2575992219 >> 172.21.15.45:0/2575992219 conn(0x7fd41c0b4670 msgr2=0x7fd41c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 -- 172.21.15.45:0/2575992219 shutdown_connections 2023-12-19T17:59:40.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 -- 172.21.15.45:0/2575992219 wait complete. 2023-12-19T17:59:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 Processor -- start 2023-12-19T17:59:40.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.097+0000 7fd421eeb700 1 -- start start 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c1f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c0d25f0 0x7fd41c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15cf20 0x7fd41c149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c06fb20 con 0x7fd41c0b8580 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c1593b0 con 0x7fd41c15cf20 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd41c156ff0 con 0x7fd41c0d25f0 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c1f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c1f1bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34840/0 (socket says 172.21.15.45:34840) 2023-12-19T17:59:40.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 -- 172.21.15.45:0/2738715460 learned_addr learned my addr 172.21.15.45:0/2738715460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 -- 172.21.15.45:0/2738715460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c0d25f0 msgr2=0x7fd41c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c0d25f0 0x7fd41c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 -- 172.21.15.45:0/2738715460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15cf20 msgr2=0x7fd41c149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15cf20 0x7fd41c149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 -- 172.21.15.45:0/2738715460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4080094b0 con 0x7fd41c0b8580 2023-12-19T17:59:40.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd420ee9700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c1f1bf0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c4d0 tx=0x7fd41000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd410005cd0 con 0x7fd41c0b8580 2023-12-19T17:59:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd410005e30 con 0x7fd41c0b8580 2023-12-19T17:59:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd41c158a10 con 0x7fd41c0b8580 2023-12-19T17:59:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4100072d0 con 0x7fd41c0b8580 2023-12-19T17:59:40.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.101+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd41c158fd0 con 0x7fd41c0b8580 2023-12-19T17:59:40.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.105+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd41c04ed30 con 0x7fd41c0b8580 2023-12-19T17:59:40.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.105+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd410007430 con 0x7fd41c0b8580 2023-12-19T17:59:40.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.109+0000 7fd4197fa700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd400065b20 0x7fd400067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.109+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fd410082510 con 0x7fd41c0b8580 2023-12-19T17:59:40.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.109+0000 7fd41bfff700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd400065b20 0x7fd400067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.109+0000 7fd41bfff700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd400065b20 0x7fd400067fe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b1810 tx=0x7fd408010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:40.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.117+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd41004ff10 con 0x7fd41c0b8580 2023-12-19T17:59:40.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.341+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd41c159160 con 0x7fd41c0b8580 2023-12-19T17:59:40.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.357+0000 7fd4197fa700 1 -- 172.21.15.45:0/2738715460 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 11 and data pool 12 v53) v1 ==== 174+0+0 (secure 0 0 0) 0x7fd41c159160 con 0x7fd41c0b8580 2023-12-19T17:59:40.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd400065b20 msgr2=0x7fd400067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd400065b20 0x7fd400067fe0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd41c0b1810 tx=0x7fd408010000 comp rx=0 tx=0).stop 2023-12-19T17:59:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 msgr2=0x7fd41c1f1bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c1f1bf0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fd41000c4d0 tx=0x7fd41000c890 comp rx=0 tx=0).stop 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 shutdown_connections 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd400065b20 0x7fd400067fe0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd41c15cf20 0x7fd41c149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd41c0d25f0 0x7fd41c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 --2- 172.21.15.45:0/2738715460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd41c0b8580 0x7fd41c1f1bf0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.365+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 >> 172.21.15.45:0/2738715460 conn(0x7fd41c0b4670 msgr2=0x7fd41c0b3810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.369+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 shutdown_connections 2023-12-19T17:59:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.373+0000 7fd421eeb700 1 -- 172.21.15.45:0/2738715460 wait complete. 2023-12-19T17:59:40.396 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 11 and data pool 12 2023-12-19T17:59:40.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:40.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.593+0000 7f60ba035700 1 Processor -- start 2023-12-19T17:59:40.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.593+0000 7f60ba035700 1 -- start start 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60ba035700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b40cd480 0x7f60b406d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60ba035700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b406cbb0 con 0x7f60b415af30 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60ba035700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60b406fa10 con 0x7f60b415ab50 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60ba035700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b406fcf0 con 0x7f60b40cd480 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60b3fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f60b415af30 0x7f60b406d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46668/0 (socket says 172.21.15.45:46668) 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60b3fff700 1 -- 172.21.15.45:0/1887999045 learned_addr learned my addr 172.21.15.45:0/1887999045 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60aaffd700 1 --2- 172.21.15.45:0/1887999045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b40cd480 0x7f60b406d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2725972814 0 0) 0x7f60b406cbb0 con 0x7f60b415af30 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60a00035d0 con 0x7f60b415af30 2023-12-19T17:59:40.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062310229 0 0) 0x7f60b406fa10 con 0x7f60b415ab50 2023-12-19T17:59:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b406cbb0 con 0x7f60b415ab50 2023-12-19T17:59:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60aaffd700 1 -- 172.21.15.45:0/1887999045 >> v1:172.21.15.73:6789/0 conn(0x7f60b415ab50 legacy=0x7f60b40ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60aaffd700 1 -- 172.21.15.45:0/1887999045 >> v1:172.21.15.45:6789/0 conn(0x7f60b415af30 legacy=0x7f60b406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.597+0000 7f60aaffd700 1 -- 172.21.15.45:0/1887999045 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b406ffd0 con 0x7f60b40cd480 2023-12-19T17:59:40.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60aaffd700 1 --2- 172.21.15.45:0/1887999045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b40cd480 0x7f60b406d090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f609c009880 tx=0x7f609c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2cd8891244bc8680 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c011830 con 0x7f60b40cd480 2023-12-19T17:59:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f609c011990 con 0x7f60b40cd480 2023-12-19T17:59:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60b2ffd700 1 -- 172.21.15.45:0/1887999045 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f609c011d00 con 0x7f60b40cd480 2023-12-19T17:59:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 -- 172.21.15.45:0/1887999045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b40cd480 msgr2=0x7f60b406d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 --2- 172.21.15.45:0/1887999045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b40cd480 0x7f60b406d090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f609c009880 tx=0x7f609c009b90 comp rx=0 tx=0).stop 2023-12-19T17:59:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 -- 172.21.15.45:0/1887999045 shutdown_connections 2023-12-19T17:59:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 --2- 172.21.15.45:0/1887999045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b40cd480 0x7f60b406d090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 -- 172.21.15.45:0/1887999045 >> 172.21.15.45:0/1887999045 conn(0x7f60b40cba40 msgr2=0x7f60b40ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 -- 172.21.15.45:0/1887999045 shutdown_connections 2023-12-19T17:59:40.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.601+0000 7f60ba035700 1 -- 172.21.15.45:0/1887999045 wait complete. 2023-12-19T17:59:40.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.605+0000 7f60ba035700 1 Processor -- start 2023-12-19T17:59:40.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.605+0000 7f60ba035700 1 -- start start 2023-12-19T17:59:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40cd480 0x7f60b4158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b415ab50 0x7f60b41f3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 0x7f60b406cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4158be0 con 0x7f60b415af30 2023-12-19T17:59:40.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4159440 con 0x7f60b40cd480 2023-12-19T17:59:40.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b4157310 con 0x7f60b415ab50 2023-12-19T17:59:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 0x7f60b406cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 0x7f60b406cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34850/0 (socket says 172.21.15.45:34850) 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 -- 172.21.15.45:0/263422225 learned_addr learned my addr 172.21.15.45:0/263422225 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60aaffd700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b415ab50 0x7f60b41f3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b37fe700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40cd480 0x7f60b4158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 -- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b415ab50 msgr2=0x7f60b41f3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b415ab50 0x7f60b41f3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 -- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40cd480 msgr2=0x7f60b4158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40cd480 0x7f60b4158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 -- 172.21.15.45:0/263422225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c0094b0 con 0x7f60b415af30 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b37fe700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40cd480 0x7f60b4158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b3fff700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 0x7f60b406cf90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0014b0 tx=0x7f60ac00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac00a9a0 con 0x7f60b415af30 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60ac00ab00 con 0x7f60b415af30 2023-12-19T17:59:40.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b41575f0 con 0x7f60b415af30 2023-12-19T17:59:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60ac012400 con 0x7f60b415af30 2023-12-19T17:59:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.609+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b4157bb0 con 0x7f60b415af30 2023-12-19T17:59:40.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.613+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b404ed30 con 0x7f60b415af30 2023-12-19T17:59:40.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.613+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f60ac005d50 con 0x7f60b415af30 2023-12-19T17:59:40.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.617+0000 7f60b0ff9700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6094065ad0 0x7f6094067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:40.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.617+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f60ac082b90 con 0x7f60b415af30 2023-12-19T17:59:40.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.617+0000 7f60b37fe700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6094065ad0 0x7f6094067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:40.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.617+0000 7f60b37fe700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6094065ad0 0x7f6094067f90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f60a40017d0 tx=0x7f60a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:40.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.621+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f60ac050400 con 0x7f60b415af30 2023-12-19T17:59:40.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.805+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60b40b4ae0 con 0x7f60b415af30 2023-12-19T17:59:40.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.809+0000 7f60b0ff9700 1 -- 172.21.15.45:0/263422225 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f60ac017090 con 0x7f60b415af30 2023-12-19T17:59:40.815 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:40.815 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:40.347238+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:40.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6094065ad0 msgr2=0x7f6094067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6094065ad0 0x7f6094067f90 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f60a40017d0 tx=0x7f60a4009040 comp rx=0 tx=0).stop 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 msgr2=0x7f60b406cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 0x7f60b406cf90 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0014b0 tx=0x7f60ac00cd50 comp rx=0 tx=0).stop 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 shutdown_connections 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6094065ad0 0x7f6094067f90 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f60b415af30 0x7f60b406cf90 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f60b415ab50 0x7f60b41f3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 --2- 172.21.15.45:0/263422225 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f60b40cd480 0x7f60b4158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:40.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 >> 172.21.15.45:0/263422225 conn(0x7f60b40cba40 msgr2=0x7f60b41555d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:40.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 shutdown_connections 2023-12-19T17:59:40.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:40.813+0000 7f60ba035700 1 -- 172.21.15.45:0/263422225 wait complete. 2023-12-19T17:59:40.841 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.017+0000 7fe49bdf9700 1 Processor -- start 2023-12-19T17:59:41.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.017+0000 7fe49bdf9700 1 -- start start 2023-12-19T17:59:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49bdf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe4940adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49bdf9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49415e260 0x7fe49406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49bdf9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe49406efd0 0x7fe4940cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49bdf9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe49415af30 con 0x7fe49415e260 2023-12-19T17:59:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49bdf9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4940cd010 con 0x7fe49406efd0 2023-12-19T17:59:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49bdf9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940cd2f0 con 0x7fe49415ab50 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49415e260 0x7fe49406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe49415e260 0x7fe49406ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34864/0 (socket says 172.21.15.45:34864) 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 -- 172.21.15.45:0/3376605756 learned_addr learned my addr 172.21.15.45:0/3376605756 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499b95700 1 --2- 172.21.15.45:0/3376605756 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe4940adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe49a396700 1 --2- 172.21.15.45:0/3376605756 >> v2:172.21.15.73:3300/0 conn(0x7fe49406efd0 0x7fe4940cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 -- 172.21.15.45:0/3376605756 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 msgr2=0x7fe4940adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 --2- 172.21.15.45:0/3376605756 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe4940adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 -- 172.21.15.45:0/3376605756 >> v2:172.21.15.73:3300/0 conn(0x7fe49406efd0 msgr2=0x7fe4940cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 --2- 172.21.15.45:0/3376605756 >> v2:172.21.15.73:3300/0 conn(0x7fe49406efd0 0x7fe4940cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 -- 172.21.15.45:0/3376605756 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940cd5d0 con 0x7fe49415e260 2023-12-19T17:59:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe499394700 1 --2- 172.21.15.45:0/3376605756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe49406ea90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe494070580 tx=0x7fe484009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc0786e9b4398bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:41.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe498b93700 1 -- 172.21.15.45:0/3376605756 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484011830 con 0x7fe49415e260 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe498b93700 1 -- 172.21.15.45:0/3376605756 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe484011990 con 0x7fe49415e260 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.021+0000 7fe498b93700 1 -- 172.21.15.45:0/3376605756 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484011d20 con 0x7fe49415e260 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3376605756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 msgr2=0x7fe49406ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3376605756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe49406ea90 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fe494070580 tx=0x7fe484009bf0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3376605756 shutdown_connections 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3376605756 >> v2:172.21.15.73:3300/0 conn(0x7fe49406efd0 0x7fe4940cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3376605756 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe49406ea90 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3376605756 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe4940adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3376605756 >> 172.21.15.45:0/3376605756 conn(0x7fe4940cba40 msgr2=0x7fe4940ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3376605756 shutdown_connections 2023-12-19T17:59:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3376605756 wait complete. 2023-12-19T17:59:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 Processor -- start 2023-12-19T17:59:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.025+0000 7fe49bdf9700 1 -- start start 2023-12-19T17:59:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe49406efd0 0x7fe4940aca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe49415f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe494150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b3270 con 0x7fe49415e260 2023-12-19T17:59:41.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b3550 con 0x7fe49406efd0 2023-12-19T17:59:41.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b25f0 con 0x7fe49415ab50 2023-12-19T17:59:41.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe494150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe494150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34872/0 (socket says 172.21.15.45:34872) 2023-12-19T17:59:41.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 -- 172.21.15.45:0/3269088275 learned_addr learned my addr 172.21.15.45:0/3269088275 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:41.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe499b95700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe49406efd0 0x7fe4940aca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe499394700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe49415f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 -- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 msgr2=0x7fe49415f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe49415f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 -- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe49406efd0 msgr2=0x7fe4940aca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe49406efd0 0x7fe4940aca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 -- 172.21.15.45:0/3269088275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe484009570 con 0x7fe49415e260 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe499b95700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe49406efd0 0x7fe4940aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe499394700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe49415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49a396700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe494150eb0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009fd0 tx=0x7fe48c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c00ede0 con 0x7fe49415e260 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c014420 con 0x7fe49415e260 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4940b28d0 con 0x7fe49415e260 2023-12-19T17:59:41.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0147d0 con 0x7fe49415e260 2023-12-19T17:59:41.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.029+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4940b2e90 con 0x7fe49415e260 2023-12-19T17:59:41.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.033+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4940b33b0 con 0x7fe49415e260 2023-12-19T17:59:41.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.033+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe48c014930 con 0x7fe49415e260 2023-12-19T17:59:41.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.037+0000 7fe48a7fc700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe478065ad0 0x7fe478067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.037+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe48c006e40 con 0x7fe49415e260 2023-12-19T17:59:41.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.037+0000 7fe499b95700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe478065ad0 0x7fe478067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.037+0000 7fe499b95700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe478065ad0 0x7fe478067f90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe490009b20 tx=0x7fe490008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:41.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.041+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4940b33b0 con 0x7fe49415e260 2023-12-19T17:59:41.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.217+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4940b33b0 con 0x7fe49415e260 2023-12-19T17:59:41.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.221+0000 7fe48a7fc700 1 -- 172.21.15.45:0/3269088275 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+16274 (secure 0 0 0) 0x7fe4940b33b0 con 0x7fe49415e260 2023-12-19T17:59:41.227 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:41.227 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:40.347238+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe478065ad0 msgr2=0x7fe478067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe478065ad0 0x7fe478067f90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe490009b20 tx=0x7fe490008040 comp rx=0 tx=0).stop 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 msgr2=0x7fe494150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe494150eb0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009fd0 tx=0x7fe48c00e3c0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 shutdown_connections 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe478065ad0 0x7fe478067f90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe49415e260 0x7fe494150eb0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe49415ab50 0x7fe49415f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 --2- 172.21.15.45:0/3269088275 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe49406efd0 0x7fe4940aca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 >> 172.21.15.45:0/3269088275 conn(0x7fe4940cba40 msgr2=0x7fe49415e700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 shutdown_connections 2023-12-19T17:59:41.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.225+0000 7fe49bdf9700 1 -- 172.21.15.45:0/3269088275 wait complete. 2023-12-19T17:59:41.254 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T17:59:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 Processor -- start 2023-12-19T17:59:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 -- start start 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3fb81443e0 0x7f3fb80713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fb8071910 0x7f3fb80cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb8071d70 con 0x7f3fb80cb840 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb80b1b80 con 0x7f3fb8071910 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fbdd7d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb81447c0 con 0x7f3fb81443e0 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.425+0000 7f3fb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fb8071910 0x7f3fb80cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fb8071910 0x7f3fb80cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34884/0 (socket says 172.21.15.45:34884) 2023-12-19T17:59:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 -- 172.21.15.45:0/1378244788 learned_addr learned my addr 172.21.15.45:0/1378244788 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:41.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbcd7b700 1 --2- 172.21.15.45:0/1378244788 >> v2:172.21.15.73:3300/0 conn(0x7f3fb81443e0 0x7f3fb80713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 -- 172.21.15.45:0/1378244788 >> v2:172.21.15.73:3300/0 conn(0x7f3fb81443e0 msgr2=0x7f3fb80713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:41.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 --2- 172.21.15.45:0/1378244788 >> v2:172.21.15.73:3300/0 conn(0x7f3fb81443e0 0x7f3fb80713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 -- 172.21.15.45:0/1378244788 >> v1:172.21.15.45:6789/0 conn(0x7f3fb80cb840 legacy=0x7f3fb815e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 -- 172.21.15.45:0/1378244788 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb80b1830 con 0x7f3fb8071910 2023-12-19T17:59:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb7fff700 1 --2- 172.21.15.45:0/1378244788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb8071910 0x7f3fb80cb300 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3fb806ac80 tx=0x7f3fa4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af193e178814ba17 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb77fe700 1 -- 172.21.15.45:0/1378244788 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011830 con 0x7f3fb8071910 2023-12-19T17:59:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb77fe700 1 -- 172.21.15.45:0/1378244788 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fa4011990 con 0x7f3fb8071910 2023-12-19T17:59:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fb77fe700 1 -- 172.21.15.45:0/1378244788 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4011d20 con 0x7f3fb8071910 2023-12-19T17:59:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1378244788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb8071910 msgr2=0x7f3fb80cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1378244788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb8071910 0x7f3fb80cb300 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f3fb806ac80 tx=0x7f3fa4009bf0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1378244788 shutdown_connections 2023-12-19T17:59:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1378244788 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb8071910 0x7f3fb80cb300 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1378244788 >> v2:172.21.15.73:3300/0 conn(0x7f3fb81443e0 0x7f3fb80713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1378244788 >> 172.21.15.45:0/1378244788 conn(0x7f3fb80cf5a0 msgr2=0x7f3fb8070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1378244788 shutdown_connections 2023-12-19T17:59:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.429+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1378244788 wait complete. 2023-12-19T17:59:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 Processor -- start 2023-12-19T17:59:41.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 -- start start 2023-12-19T17:59:41.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb80cb840 0x7f3fb815c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb81443e0 0x7f3fb815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 0x7f3fb80ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb813d640 con 0x7f3fb815a8d0 2023-12-19T17:59:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb815c7b0 con 0x7f3fb80cb840 2023-12-19T17:59:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.433+0000 7f3fbdd7d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb813c9c0 con 0x7f3fb81443e0 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 0x7f3fb80ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 0x7f3fb80ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34894/0 (socket says 172.21.15.45:34894) 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 -- 172.21.15.45:0/1741884150 learned_addr learned my addr 172.21.15.45:0/1741884150 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbcd7b700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb80cb840 0x7f3fb815c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fb7fff700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb81443e0 0x7f3fb815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 -- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb81443e0 msgr2=0x7f3fb815dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb81443e0 0x7f3fb815dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 -- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb80cb840 msgr2=0x7f3fb815c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb80cb840 0x7f3fb815c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:41.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 -- 172.21.15.45:0/1741884150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fa4009570 con 0x7f3fb815a8d0 2023-12-19T17:59:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fb7fff700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb81443e0 0x7f3fb815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbd57c700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 0x7f3fb80ac8f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000cb90 tx=0x7f3fb000cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0003c70 con 0x7f3fb815a8d0 2023-12-19T17:59:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb0003df0 con 0x7f3fb815a8d0 2023-12-19T17:59:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000ab00 con 0x7f3fb815a8d0 2023-12-19T17:59:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb813cca0 con 0x7f3fb815a8d0 2023-12-19T17:59:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb813d260 con 0x7f3fb815a8d0 2023-12-19T17:59:41.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.437+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb813d780 con 0x7f3fb815a8d0 2023-12-19T17:59:41.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.441+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3fb000ac60 con 0x7f3fb815a8d0 2023-12-19T17:59:41.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.441+0000 7f3fb57fa700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3f9c065ad0 0x7f3f9c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.441+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3fb0083390 con 0x7f3fb815a8d0 2023-12-19T17:59:41.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.441+0000 7f3fbcd7b700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3f9c065ad0 0x7f3f9c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.441+0000 7f3fbcd7b700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3f9c065ad0 0x7f3f9c067f90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009b40 tx=0x7f3fac0091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:41.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.445+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3fb813d780 con 0x7f3fb815a8d0 2023-12-19T17:59:41.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:41.661+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3fb813d780 con 0x7f3fb815a8d0 2023-12-19T17:59:41.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-19T17:59:41.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-19T17:59:42.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.389+0000 7f3fb57fa700 1 -- 172.21.15.45:0/1741884150 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3fb813d780 con 0x7f3fb815a8d0 2023-12-19T17:59:42.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3f9c065ad0 msgr2=0x7f3f9c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:42.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3f9c065ad0 0x7f3f9c067f90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009b40 tx=0x7f3fac0091c0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 msgr2=0x7f3fb80ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:42.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 0x7f3fb80ac8f0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000cb90 tx=0x7f3fb000cea0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 shutdown_connections 2023-12-19T17:59:42.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3f9c065ad0 0x7f3f9c067f90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fb815a8d0 0x7f3fb80ac8f0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fb81443e0 0x7f3fb815dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 --2- 172.21.15.45:0/1741884150 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fb80cb840 0x7f3fb815c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 >> 172.21.15.45:0/1741884150 conn(0x7f3fb8071910 msgr2=0x7f3fb80b1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:42.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 shutdown_connections 2023-12-19T17:59:42.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.393+0000 7f3fbdd7d700 1 -- 172.21.15.45:0/1741884150 wait complete. 2023-12-19T17:59:42.421 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T17:59:42.421 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T17:59:42.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.609+0000 7f94fd034700 1 Processor -- start 2023-12-19T17:59:42.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.609+0000 7f94fd034700 1 -- start start 2023-12-19T17:59:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94fd034700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80cc690 0x7f94f815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94fd034700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94f80ce350 0x7f94f80cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94fd034700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f80cbb50 con 0x7f94f80cb700 2023-12-19T17:59:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94fd034700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f806ea90 con 0x7f94f80ce350 2023-12-19T17:59:42.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94fd034700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f815c340 con 0x7f94f80cc690 2023-12-19T17:59:42.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94f80ce350 0x7f94f80cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:42.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f94f80ce350 0x7f94f80cb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34906/0 (socket says 172.21.15.45:34906) 2023-12-19T17:59:42.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 -- 172.21.15.45:0/851745600 learned_addr learned my addr 172.21.15.45:0/851745600 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f6d9d700 1 --2- 172.21.15.45:0/851745600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80cc690 0x7f94f815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 -- 172.21.15.45:0/851745600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80cc690 msgr2=0x7f94f815b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 --2- 172.21.15.45:0/851745600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80cc690 0x7f94f815b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 -- 172.21.15.45:0/851745600 >> v1:172.21.15.73:6789/0 conn(0x7f94f80cb700 legacy=0x7f94f815e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 -- 172.21.15.45:0/851745600 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f815baa0 con 0x7f94f80ce350 2023-12-19T17:59:42.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f659c700 1 --2- 172.21.15.45:0/851745600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80ce350 0x7f94f80cb1c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009910 tx=0x7f94ec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6bf3c568f2b7354 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:42.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f5d9b700 1 -- 172.21.15.45:0/851745600 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec011830 con 0x7f94f80ce350 2023-12-19T17:59:42.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f5d9b700 1 -- 172.21.15.45:0/851745600 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec011990 con 0x7f94f80ce350 2023-12-19T17:59:42.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.613+0000 7f94f5d9b700 1 -- 172.21.15.45:0/851745600 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec011d40 con 0x7f94f80ce350 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 -- 172.21.15.45:0/851745600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80ce350 msgr2=0x7f94f80cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 --2- 172.21.15.45:0/851745600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80ce350 0x7f94f80cb1c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f94ec009910 tx=0x7f94ec009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 -- 172.21.15.45:0/851745600 shutdown_connections 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 --2- 172.21.15.45:0/851745600 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80ce350 0x7f94f80cb1c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 --2- 172.21.15.45:0/851745600 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80cc690 0x7f94f815b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 -- 172.21.15.45:0/851745600 >> 172.21.15.45:0/851745600 conn(0x7f94f8071990 msgr2=0x7f94f80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 -- 172.21.15.45:0/851745600 shutdown_connections 2023-12-19T17:59:42.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.617+0000 7f94fd034700 1 -- 172.21.15.45:0/851745600 wait complete. 2023-12-19T17:59:42.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 Processor -- start 2023-12-19T17:59:42.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 -- start start 2023-12-19T17:59:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f80cb700 0x7f94f80a8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 0x7f94f8146490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80ce350 0x7f94f80b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80a7970 con 0x7f94f80cc690 2023-12-19T17:59:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80a7c50 con 0x7f94f80cb700 2023-12-19T17:59:42.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94fd034700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f80a7f30 con 0x7f94f80ce350 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94f659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 0x7f94f8146490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94f659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 0x7f94f8146490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34916/0 (socket says 172.21.15.45:34916) 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94f659c700 1 -- 172.21.15.45:0/1633368712 learned_addr learned my addr 172.21.15.45:0/1633368712 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94f6d9d700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f80cb700 0x7f94f80a8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.621+0000 7f94f759e700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80ce350 0x7f94f80b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94f659c700 1 -- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80ce350 msgr2=0x7f94f80b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94f659c700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80ce350 0x7f94f80b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94f659c700 1 -- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f80cb700 msgr2=0x7f94f80a8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94f659c700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f80cb700 0x7f94f80a8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:42.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94f659c700 1 -- 172.21.15.45:0/1633368712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009570 con 0x7f94f80cc690 2023-12-19T17:59:42.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94f659c700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 0x7f94f8146490 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000c00 tx=0x7f94ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:42.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec004500 con 0x7f94f80cc690 2023-12-19T17:59:42.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0036c0 con 0x7f94f80cc690 2023-12-19T17:59:42.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f80a8210 con 0x7f94f80cc690 2023-12-19T17:59:42.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec003a70 con 0x7f94f80cc690 2023-12-19T17:59:42.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f81469d0 con 0x7f94f80cc690 2023-12-19T17:59:42.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.625+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94f815c040 con 0x7f94f80cc690 2023-12-19T17:59:42.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.629+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94ec003bd0 con 0x7f94f80cc690 2023-12-19T17:59:42.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.629+0000 7f94df7fe700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94e4065ad0 0x7f94e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:42.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.629+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94ec021030 con 0x7f94f80cc690 2023-12-19T17:59:42.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.629+0000 7f94f6d9d700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94e4065ad0 0x7f94e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:42.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.633+0000 7f94f6d9d700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94e4065ad0 0x7f94e4067f90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009bf0 tx=0x7f94e8009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:42.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.637+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f94f815c040 con 0x7f94f80cc690 2023-12-19T17:59:42.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:42.849+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f94f815c040 con 0x7f94f80cc690 2023-12-19T17:59:43.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.401+0000 7f94df7fe700 1 -- 172.21.15.45:0/1633368712 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) v1 ==== 122+0+0 (secure 0 0 0) 0x7f94f815c040 con 0x7f94f80cc690 2023-12-19T17:59:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94e4065ad0 msgr2=0x7f94e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94e4065ad0 0x7f94e4067f90 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f94e8009bf0 tx=0x7f94e8009240 comp rx=0 tx=0).stop 2023-12-19T17:59:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 msgr2=0x7f94f8146490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 0x7f94f8146490 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000c00 tx=0x7f94ec004770 comp rx=0 tx=0).stop 2023-12-19T17:59:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 shutdown_connections 2023-12-19T17:59:43.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94e4065ad0 0x7f94e4067f90 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f80ce350 0x7f94f80b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f80cc690 0x7f94f8146490 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 --2- 172.21.15.45:0/1633368712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f80cb700 0x7f94f80a8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 >> 172.21.15.45:0/1633368712 conn(0x7f94f8071990 msgr2=0x7f94f806fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 shutdown_connections 2023-12-19T17:59:43.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.405+0000 7f94fd034700 1 -- 172.21.15.45:0/1633368712 wait complete. 2023-12-19T17:59:43.436 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T17:59:43.436 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:43.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.609+0000 7f0919af5700 1 Processor -- start 2023-12-19T17:59:43.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.609+0000 7f0919af5700 1 -- start start 2023-12-19T17:59:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f0919af5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f09141659f0 0x7f0914167de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f0919af5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140d1820 con 0x7f091406ea90 2023-12-19T17:59:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f0919af5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09140d1b00 con 0x7f09140b88b0 2023-12-19T17:59:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f0919af5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09140d1630 con 0x7f09141659f0 2023-12-19T17:59:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f0918af3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f091406ea90 0x7f09140d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46686/0 (socket says 172.21.15.45:46686) 2023-12-19T17:59:43.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f0918af3700 1 -- 172.21.15.45:0/1668429468 learned_addr learned my addr 172.21.15.45:0/1668429468 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.613+0000 7f09192f4700 1 --2- 172.21.15.45:0/1668429468 >> v2:172.21.15.73:3300/0 conn(0x7f09141659f0 0x7f0914167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:43.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1438667702 0 0) 0x7f09140d1820 con 0x7f091406ea90 2023-12-19T17:59:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08fc0035d0 con 0x7f091406ea90 2023-12-19T17:59:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570063039 0 0) 0x7f09140d1b00 con 0x7f09140b88b0 2023-12-19T17:59:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09140d1820 con 0x7f09140b88b0 2023-12-19T17:59:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f09192f4700 1 -- 172.21.15.45:0/1668429468 >> v1:172.21.15.73:6789/0 conn(0x7f09140b88b0 legacy=0x7f091406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f09192f4700 1 -- 172.21.15.45:0/1668429468 >> v1:172.21.15.45:6789/0 conn(0x7f091406ea90 legacy=0x7f09140d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f09192f4700 1 -- 172.21.15.45:0/1668429468 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09140d1de0 con 0x7f09141659f0 2023-12-19T17:59:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f09192f4700 1 --2- 172.21.15.45:0/1668429468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09141659f0 0x7f0914167de0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f090c009d90 tx=0x7f090c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1317a96ea0c2c21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c00e070 con 0x7f09141659f0 2023-12-19T17:59:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f090c00bb20 con 0x7f09141659f0 2023-12-19T17:59:43.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f090b7fe700 1 -- 172.21.15.45:0/1668429468 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f090c012430 con 0x7f09141659f0 2023-12-19T17:59:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 -- 172.21.15.45:0/1668429468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09141659f0 msgr2=0x7f0914167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 --2- 172.21.15.45:0/1668429468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09141659f0 0x7f0914167de0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f090c009d90 tx=0x7f090c00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 -- 172.21.15.45:0/1668429468 shutdown_connections 2023-12-19T17:59:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 --2- 172.21.15.45:0/1668429468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09141659f0 0x7f0914167de0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 -- 172.21.15.45:0/1668429468 >> 172.21.15.45:0/1668429468 conn(0x7f09140b46d0 msgr2=0x7f09140b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 -- 172.21.15.45:0/1668429468 shutdown_connections 2023-12-19T17:59:43.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.617+0000 7f0919af5700 1 -- 172.21.15.45:0/1668429468 wait complete. 2023-12-19T17:59:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 Processor -- start 2023-12-19T17:59:43.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 -- start start 2023-12-19T17:59:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 0x7f09140c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09140b88b0 0x7f09140c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09141659f0 0x7f09140c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140c9cb0 con 0x7f091406ea90 2023-12-19T17:59:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09140c9f90 con 0x7f09140b88b0 2023-12-19T17:59:43.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0919af5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09140ca270 con 0x7f09141659f0 2023-12-19T17:59:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0918af3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 0x7f09140c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0918af3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 0x7f09140c8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34932/0 (socket says 172.21.15.45:34932) 2023-12-19T17:59:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f0918af3700 1 -- 172.21.15.45:0/368883273 learned_addr learned my addr 172.21.15.45:0/368883273 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f09192f4700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09141659f0 0x7f09140c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:43.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.621+0000 7f090bfff700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09140b88b0 0x7f09140c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0918af3700 1 -- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09141659f0 msgr2=0x7f09140c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0918af3700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09141659f0 0x7f09140c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0918af3700 1 -- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09140b88b0 msgr2=0x7f09140c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0918af3700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09140b88b0 0x7f09140c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0918af3700 1 -- 172.21.15.45:0/368883273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090c009a70 con 0x7f091406ea90 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f090bfff700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09140b88b0 0x7f09140c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0918af3700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 0x7f09140c8dc0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f091000c4d0 tx=0x7f091000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910005d90 con 0x7f091406ea90 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09100070d0 con 0x7f091406ea90 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910007460 con 0x7f091406ea90 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09140ca550 con 0x7f091406ea90 2023-12-19T17:59:43.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09140c9300 con 0x7f091406ea90 2023-12-19T17:59:43.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.625+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09140caa70 con 0x7f091406ea90 2023-12-19T17:59:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.629+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f09100075c0 con 0x7f091406ea90 2023-12-19T17:59:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.629+0000 7f09097fa700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0900065ad0 0x7f0900067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:43.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.629+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0910082880 con 0x7f091406ea90 2023-12-19T17:59:43.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.629+0000 7f090bfff700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0900065ad0 0x7f0900067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:43.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.629+0000 7f090bfff700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0900065ad0 0x7f0900067f90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f09140d1c60 tx=0x7f0904009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:43.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.637+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f091004ffe0 con 0x7f091406ea90 2023-12-19T17:59:43.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.853+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f09140c94c0 con 0x7f091406ea90 2023-12-19T17:59:43.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.853+0000 7f09097fa700 1 -- 172.21.15.45:0/368883273 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f0910053600 con 0x7f091406ea90 2023-12-19T17:59:43.858 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:43.858 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:59:40.348016+0000","modified":"2023-12-19T17:59:43.386570+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56312":{"gid":56312,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/2667696599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2667696599},{"type":"v1","addr":"172.21.15.73:6835","nonce":2667696599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T17:59:43.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0900065ad0 msgr2=0x7f0900067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0900065ad0 0x7f0900067f90 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f09140d1c60 tx=0x7f0904009040 comp rx=0 tx=0).stop 2023-12-19T17:59:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 msgr2=0x7f09140c8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 0x7f09140c8dc0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f091000c4d0 tx=0x7f091000c7e0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 shutdown_connections 2023-12-19T17:59:43.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0900065ad0 0x7f0900067f90 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f09141659f0 0x7f09140c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f09140b88b0 0x7f09140c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 --2- 172.21.15.45:0/368883273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f091406ea90 0x7f09140c8dc0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 >> 172.21.15.45:0/368883273 conn(0x7f09140b46d0 msgr2=0x7f091406f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 shutdown_connections 2023-12-19T17:59:43.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:43.857+0000 7f0919af5700 1 -- 172.21.15.45:0/368883273 wait complete. 2023-12-19T17:59:43.864 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 57 2023-12-19T17:59:43.884 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:44.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.061+0000 7fdb0c2d8700 1 Processor -- start 2023-12-19T17:59:44.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.061+0000 7fdb0c2d8700 1 -- start start 2023-12-19T17:59:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0c2d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415ab50 0x7fdb040adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0c2d8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fdb0415e260 0x7fdb0406ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0c2d8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0415af30 con 0x7fdb0406efd0 2023-12-19T17:59:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0c2d8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb040cd010 con 0x7fdb0415e260 2023-12-19T17:59:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0c2d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040cd2f0 con 0x7fdb0415ab50 2023-12-19T17:59:44.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0a875700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdb0406efd0 0x7fdb040cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46698/0 (socket says 172.21.15.45:46698) 2023-12-19T17:59:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0a875700 1 -- 172.21.15.45:0/4186572761 learned_addr learned my addr 172.21.15.45:0/4186572761 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb0a074700 1 --2- 172.21.15.45:0/4186572761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415ab50 0x7fdb040adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.065+0000 7fdb09873700 1 --2- 172.21.15.45:0/4186572761 >> v2:172.21.15.45:3300/0 conn(0x7fdb0415e260 0x7fdb0406ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09072700 1 -- 172.21.15.45:0/4186572761 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176514178 0 0) 0x7fdb0415af30 con 0x7fdb0406efd0 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09072700 1 -- 172.21.15.45:0/4186572761 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf00035d0 con 0x7fdb0406efd0 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09873700 1 -- 172.21.15.45:0/4186572761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415ab50 msgr2=0x7fdb040adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09873700 1 --2- 172.21.15.45:0/4186572761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415ab50 0x7fdb040adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09873700 1 -- 172.21.15.45:0/4186572761 >> v1:172.21.15.45:6789/0 conn(0x7fdb0406efd0 legacy=0x7fdb040cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09873700 1 -- 172.21.15.45:0/4186572761 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040cd5d0 con 0x7fdb0415e260 2023-12-19T17:59:44.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09873700 1 --2- 172.21.15.45:0/4186572761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0415e260 0x7fdb0406ea90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009850 tx=0x7fdaf4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3efe7ad26fe3b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09072700 1 -- 172.21.15.45:0/4186572761 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4011830 con 0x7fdb0415e260 2023-12-19T17:59:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09072700 1 -- 172.21.15.45:0/4186572761 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4011990 con 0x7fdb0415e260 2023-12-19T17:59:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb09072700 1 -- 172.21.15.45:0/4186572761 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4011d40 con 0x7fdb0415e260 2023-12-19T17:59:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/4186572761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0415e260 msgr2=0x7fdb0406ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/4186572761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0415e260 0x7fdb0406ea90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fdaf4009850 tx=0x7fdaf4009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/4186572761 shutdown_connections 2023-12-19T17:59:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/4186572761 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0415e260 0x7fdb0406ea90 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/4186572761 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415ab50 0x7fdb040adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/4186572761 >> 172.21.15.45:0/4186572761 conn(0x7fdb040cba40 msgr2=0x7fdb040ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/4186572761 shutdown_connections 2023-12-19T17:59:44.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.069+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/4186572761 wait complete. 2023-12-19T17:59:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 Processor -- start 2023-12-19T17:59:44.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 -- start start 2023-12-19T17:59:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 0x7fdb04142fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0415ab50 0x7fdb040af750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415e260 0x7fdb040afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041f6680 con 0x7fdb0406efd0 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04146810 con 0x7fdb0415ab50 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0c2d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb041f2160 con 0x7fdb0415e260 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0a074700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 0x7fdb04142fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0a074700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 0x7fdb04142fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34942/0 (socket says 172.21.15.45:34942) 2023-12-19T17:59:44.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.073+0000 7fdb0a074700 1 -- 172.21.15.45:0/1805754340 learned_addr learned my addr 172.21.15.45:0/1805754340 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb09873700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0415ab50 0x7fdb040af750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a875700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415e260 0x7fdb040afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a074700 1 -- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415e260 msgr2=0x7fdb040afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a074700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415e260 0x7fdb040afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a074700 1 -- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0415ab50 msgr2=0x7fdb040af750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a074700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0415ab50 0x7fdb040af750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a074700 1 -- 172.21.15.45:0/1805754340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40094b0 con 0x7fdb0406efd0 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a875700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415e260 0x7fdb040afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0a074700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 0x7fdb04142fb0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000e9d0 tx=0x7fdb0000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00009720 con 0x7fdb0406efd0 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000c850 con 0x7fdb0406efd0 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000cbc0 con 0x7fdb0406efd0 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb041434f0 con 0x7fdb0406efd0 2023-12-19T17:59:44.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb041f2650 con 0x7fdb0406efd0 2023-12-19T17:59:44.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.077+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0404ed30 con 0x7fdb0406efd0 2023-12-19T17:59:44.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.081+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdb0000cd20 con 0x7fdb0406efd0 2023-12-19T17:59:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.081+0000 7fdafaffd700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdae8065b20 0x7fdae8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.081+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb00083370 con 0x7fdb0406efd0 2023-12-19T17:59:44.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.081+0000 7fdb09873700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdae8065b20 0x7fdae8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.081+0000 7fdb09873700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdae8065b20 0x7fdae8067fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40090b0 tx=0x7fdaf4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:44.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.089+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdb00050c60 con 0x7fdb0406efd0 2023-12-19T17:59:44.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.269+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdb0406db10 con 0x7fdb0406efd0 2023-12-19T17:59:44.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.273+0000 7fdafaffd700 1 -- 172.21.15.45:0/1805754340 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16261 (secure 0 0 0) 0x7fdb00054280 con 0x7fdb0406efd0 2023-12-19T17:59:44.278 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:44.279 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":85,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:41.354167+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:44.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdae8065b20 msgr2=0x7fdae8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdae8065b20 0x7fdae8067fe0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdaf40090b0 tx=0x7fdaf4008030 comp rx=0 tx=0).stop 2023-12-19T17:59:44.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 msgr2=0x7fdb04142fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 0x7fdb04142fb0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fdb0000e9d0 tx=0x7fdb0000ed90 comp rx=0 tx=0).stop 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 shutdown_connections 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdae8065b20 0x7fdae8067fe0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdb0415e260 0x7fdb040afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb0415ab50 0x7fdb040af750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 --2- 172.21.15.45:0/1805754340 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdb0406efd0 0x7fdb04142fb0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 >> 172.21.15.45:0/1805754340 conn(0x7fdb040cba40 msgr2=0x7fdb0406e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 shutdown_connections 2023-12-19T17:59:44.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.277+0000 7fdb0c2d8700 1 -- 172.21.15.45:0/1805754340 wait complete. 2023-12-19T17:59:44.305 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T17:59:44.306 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:59:44.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.513+0000 7f7e854b1700 1 Processor -- start 2023-12-19T17:59:44.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.513+0000 7f7e854b1700 1 -- start start 2023-12-19T17:59:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e854b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e8006ea90 0x7f7e800d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e854b1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e800b88b0 0x7f7e800b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e854b1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e800b6df0 con 0x7f7e800b6250 2023-12-19T17:59:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e854b1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e800d1820 con 0x7f7e800b88b0 2023-12-19T17:59:44.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e854b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e800d1b00 con 0x7f7e8006ea90 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e84cb0700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7e800b6250 0x7f7e800b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:52798/0 (socket says 172.21.15.45:52798) 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e84cb0700 1 -- 172.21.15.45:0/894470898 learned_addr learned my addr 172.21.15.45:0/894470898 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e777fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7e800b88b0 0x7f7e800b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7ffff700 1 --2- 172.21.15.45:0/894470898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e8006ea90 0x7f7e800d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7f7fe700 1 -- 172.21.15.45:0/894470898 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1204373136 0 0) 0x7f7e800b6df0 con 0x7f7e800b6250 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7f7fe700 1 -- 172.21.15.45:0/894470898 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e6c0035d0 con 0x7f7e800b6250 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7ffff700 1 -- 172.21.15.45:0/894470898 >> v2:172.21.15.73:3300/0 conn(0x7f7e800b88b0 msgr2=0x7f7e800b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7ffff700 1 --2- 172.21.15.45:0/894470898 >> v2:172.21.15.73:3300/0 conn(0x7f7e800b88b0 0x7f7e800b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7ffff700 1 -- 172.21.15.45:0/894470898 >> v1:172.21.15.73:6789/0 conn(0x7f7e800b6250 legacy=0x7f7e800b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7ffff700 1 -- 172.21.15.45:0/894470898 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800d1de0 con 0x7f7e8006ea90 2023-12-19T17:59:44.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e777fe700 1 --2- 172.21.15.45:0/894470898 >> v2:172.21.15.73:3300/0 conn(0x7f7e800b88b0 0x7f7e800b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7ffff700 1 --2- 172.21.15.45:0/894470898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e8006ea90 0x7f7e800d0f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009850 tx=0x7f7e70009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=810458a1049e516c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7f7fe700 1 -- 172.21.15.45:0/894470898 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011830 con 0x7f7e8006ea90 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7f7fe700 1 -- 172.21.15.45:0/894470898 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e70011990 con 0x7f7e8006ea90 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.517+0000 7f7e7f7fe700 1 -- 172.21.15.45:0/894470898 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70011d40 con 0x7f7e8006ea90 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 -- 172.21.15.45:0/894470898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e8006ea90 msgr2=0x7f7e800d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 --2- 172.21.15.45:0/894470898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e8006ea90 0x7f7e800d0f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009850 tx=0x7f7e70009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 -- 172.21.15.45:0/894470898 shutdown_connections 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 --2- 172.21.15.45:0/894470898 >> v2:172.21.15.73:3300/0 conn(0x7f7e800b88b0 0x7f7e800b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 --2- 172.21.15.45:0/894470898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e8006ea90 0x7f7e800d0f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 -- 172.21.15.45:0/894470898 >> 172.21.15.45:0/894470898 conn(0x7f7e800b46d0 msgr2=0x7f7e800b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 -- 172.21.15.45:0/894470898 shutdown_connections 2023-12-19T17:59:44.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.521+0000 7f7e854b1700 1 -- 172.21.15.45:0/894470898 wait complete. 2023-12-19T17:59:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 Processor -- start 2023-12-19T17:59:44.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 -- start start 2023-12-19T17:59:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 0x7f7e80156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e800b6250 0x7f7e80070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e800b88b0 0x7f7e80070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80158b00 con 0x7f7e800b88b0 2023-12-19T17:59:44.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e80157ef0 con 0x7f7e8006ea90 2023-12-19T17:59:44.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e854b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e801581d0 con 0x7f7e800b6250 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e84cb0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e800b88b0 0x7f7e80070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 0x7f7e80156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 0x7f7e80156fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40014/0 (socket says 172.21.15.45:40014) 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 -- 172.21.15.45:0/2311634676 learned_addr learned my addr 172.21.15.45:0/2311634676 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e777fe700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e800b6250 0x7f7e80070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 -- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e800b6250 msgr2=0x7f7e80070a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e800b6250 0x7f7e80070a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 -- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e800b88b0 msgr2=0x7f7e80070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e800b88b0 0x7f7e80070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.525+0000 7f7e7ffff700 1 -- 172.21.15.45:0/2311634676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e680094b0 con 0x7f7e8006ea90 2023-12-19T17:59:44.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e7ffff700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 0x7f7e80156fc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e700090b0 tx=0x7f7e70004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e70004510 con 0x7f7e8006ea90 2023-12-19T17:59:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7001e070 con 0x7f7e8006ea90 2023-12-19T17:59:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e700094b0 con 0x7f7e8006ea90 2023-12-19T17:59:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e700038c0 con 0x7f7e8006ea90 2023-12-19T17:59:44.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e80158790 con 0x7f7e8006ea90 2023-12-19T17:59:44.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.529+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e80067760 con 0x7f7e8006ea90 2023-12-19T17:59:44.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.533+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7e70003a20 con 0x7f7e8006ea90 2023-12-19T17:59:44.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.533+0000 7f7e7d7fa700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7e60065b20 0x7f7e60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.533+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7e70020070 con 0x7f7e8006ea90 2023-12-19T17:59:44.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.533+0000 7f7e777fe700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7e60065b20 0x7f7e60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.533+0000 7f7e777fe700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7e60065b20 0x7f7e60067fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e800b40a0 tx=0x7f7e68009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:44.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.541+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7e70051ea0 con 0x7f7e8006ea90 2023-12-19T17:59:44.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.717+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7e8006cb60 con 0x7f7e60065b20 2023-12-19T17:59:44.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.729+0000 7f7e7d7fa700 1 -- 172.21.15.45:0/2311634676 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286475 (secure 0 0 0) 0x7f7e8006cb60 con 0x7f7e60065b20 2023-12-19T17:59:44.740 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:44.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7e60065b20 msgr2=0x7f7e60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7e60065b20 0x7f7e60067fe0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7e800b40a0 tx=0x7f7e68009240 comp rx=0 tx=0).stop 2023-12-19T17:59:44.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 msgr2=0x7f7e80156fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:44.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 0x7f7e80156fc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f7e700090b0 tx=0x7f7e70004770 comp rx=0 tx=0).stop 2023-12-19T17:59:44.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 shutdown_connections 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7e60065b20 0x7f7e60067fe0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7e800b88b0 0x7f7e80070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7e800b6250 0x7f7e80070a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 --2- 172.21.15.45:0/2311634676 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e8006ea90 0x7f7e80156fc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 >> 172.21.15.45:0/2311634676 conn(0x7f7e800b46d0 msgr2=0x7f7e800b2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 shutdown_connections 2023-12-19T17:59:44.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.737+0000 7f7e854b1700 1 -- 172.21.15.45:0/2311634676 wait complete. 2023-12-19T17:59:44.745 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:59:44.765 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2023-12-19T17:59:44.376970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257636,"kb_used_data":9252,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754717084,"statfs":{"total":773094113280,"available":772830294016,"internally_reserved":0,"allocated":9474048,"data_stored":5092841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541532"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396096+0000","last_change":"2023-12-19T17:59:40.388750+0000","last_active":"2023-12-19T17:59:40.396096+0000","last_peered":"2023-12-19T17:59:40.396096+0000","last_clean":"2023-12-19T17:59:40.396096+0000","last_became_active":"2023-12-19T17:59:40.388493+0000","last_became_peered":"2023-12-19T17:59:40.388493+0000","last_unstale":"2023-12-19T17:59:40.396096+0000","last_undegraded":"2023-12-19T17:59:40.396096+0000","last_fullsized":"2023-12-19T17:59:40.396096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:42.069671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.383068+0000","last_change":"2023-12-19T17:59:40.376012+0000","last_active":"2023-12-19T17:59:40.383068+0000","last_peered":"2023-12-19T17:59:40.383068+0000","last_clean":"2023-12-19T17:59:40.383068+0000","last_became_active":"2023-12-19T17:59:40.375679+0000","last_became_peered":"2023-12-19T17:59:40.375679+0000","last_unstale":"2023-12-19T17:59:40.383068+0000","last_undegraded":"2023-12-19T17:59:40.383068+0000","last_fullsized":"2023-12-19T17:59:40.383068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:19:44.227566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.395314+0000","last_change":"2023-12-19T17:59:40.393539+0000","last_active":"2023-12-19T17:59:40.395314+0000","last_peered":"2023-12-19T17:59:40.395314+0000","last_clean":"2023-12-19T17:59:40.395314+0000","last_became_active":"2023-12-19T17:59:40.393244+0000","last_became_peered":"2023-12-19T17:59:40.393244+0000","last_unstale":"2023-12-19T17:59:40.395314+0000","last_undegraded":"2023-12-19T17:59:40.395314+0000","last_fullsized":"2023-12-19T17:59:40.395314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:16.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396942+0000","last_change":"2023-12-19T17:59:40.388741+0000","last_active":"2023-12-19T17:59:40.396942+0000","last_peered":"2023-12-19T17:59:40.396942+0000","last_clean":"2023-12-19T17:59:40.396942+0000","last_became_active":"2023-12-19T17:59:40.388493+0000","last_became_peered":"2023-12-19T17:59:40.388493+0000","last_unstale":"2023-12-19T17:59:40.396942+0000","last_undegraded":"2023-12-19T17:59:40.396942+0000","last_fullsized":"2023-12-19T17:59:40.396942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:42.299574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.390312+0000","last_change":"2023-12-19T17:59:40.383947+0000","last_active":"2023-12-19T17:59:40.390312+0000","last_peered":"2023-12-19T17:59:40.390312+0000","last_clean":"2023-12-19T17:59:40.390312+0000","last_became_active":"2023-12-19T17:59:40.383683+0000","last_became_peered":"2023-12-19T17:59:40.383683+0000","last_unstale":"2023-12-19T17:59:40.390312+0000","last_undegraded":"2023-12-19T17:59:40.390312+0000","last_fullsized":"2023-12-19T17:59:40.390312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:32:14.527650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397504+0000","last_change":"2023-12-19T17:59:40.395462+0000","last_active":"2023-12-19T17:59:40.397504+0000","last_peered":"2023-12-19T17:59:40.397504+0000","last_clean":"2023-12-19T17:59:40.397504+0000","last_became_active":"2023-12-19T17:59:40.395214+0000","last_became_peered":"2023-12-19T17:59:40.395214+0000","last_unstale":"2023-12-19T17:59:40.397504+0000","last_undegraded":"2023-12-19T17:59:40.397504+0000","last_fullsized":"2023-12-19T17:59:40.397504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:50.823382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.405449+0000","last_change":"2023-12-19T17:59:40.399742+0000","last_active":"2023-12-19T17:59:40.405449+0000","last_peered":"2023-12-19T17:59:40.405449+0000","last_clean":"2023-12-19T17:59:40.405449+0000","last_became_active":"2023-12-19T17:59:40.399495+0000","last_became_peered":"2023-12-19T17:59:40.399495+0000","last_unstale":"2023-12-19T17:59:40.405449+0000","last_undegraded":"2023-12-19T17:59:40.405449+0000","last_fullsized":"2023-12-19T17:59:40.405449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:36.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392664+0000","last_change":"2023-12-19T17:59:40.384599+0000","last_active":"2023-12-19T17:59:40.392664+0000","last_peered":"2023-12-19T17:59:40.392664+0000","last_clean":"2023-12-19T17:59:40.392664+0000","last_became_active":"2023-12-19T17:59:40.384313+0000","last_became_peered":"2023-12-19T17:59:40.384313+0000","last_unstale":"2023-12-19T17:59:40.392664+0000","last_undegraded":"2023-12-19T17:59:40.392664+0000","last_fullsized":"2023-12-19T17:59:40.392664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:58.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397176+0000","last_change":"2023-12-19T17:59:40.390238+0000","last_active":"2023-12-19T17:59:40.397176+0000","last_peered":"2023-12-19T17:59:40.397176+0000","last_clean":"2023-12-19T17:59:40.397176+0000","last_became_active":"2023-12-19T17:59:40.388811+0000","last_became_peered":"2023-12-19T17:59:40.388811+0000","last_unstale":"2023-12-19T17:59:40.397176+0000","last_undegraded":"2023-12-19T17:59:40.397176+0000","last_fullsized":"2023-12-19T17:59:40.397176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:27.419842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397007+0000","last_change":"2023-12-19T17:59:40.391922+0000","last_active":"2023-12-19T17:59:40.397007+0000","last_peered":"2023-12-19T17:59:40.397007+0000","last_clean":"2023-12-19T17:59:40.397007+0000","last_became_active":"2023-12-19T17:59:40.391678+0000","last_became_peered":"2023-12-19T17:59:40.391678+0000","last_unstale":"2023-12-19T17:59:40.397007+0000","last_undegraded":"2023-12-19T17:59:40.397007+0000","last_fullsized":"2023-12-19T17:59:40.397007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:03:33.757704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394841+0000","last_change":"2023-12-19T17:59:40.391199+0000","last_active":"2023-12-19T17:59:40.394841+0000","last_peered":"2023-12-19T17:59:40.394841+0000","last_clean":"2023-12-19T17:59:40.394841+0000","last_became_active":"2023-12-19T17:59:40.389295+0000","last_became_peered":"2023-12-19T17:59:40.389295+0000","last_unstale":"2023-12-19T17:59:40.394841+0000","last_undegraded":"2023-12-19T17:59:40.394841+0000","last_fullsized":"2023-12-19T17:59:40.394841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:50.551334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.378712+0000","last_change":"2023-12-19T17:59:40.374616+0000","last_active":"2023-12-19T17:59:40.378712+0000","last_peered":"2023-12-19T17:59:40.378712+0000","last_clean":"2023-12-19T17:59:40.378712+0000","last_became_active":"2023-12-19T17:59:40.374313+0000","last_became_peered":"2023-12-19T17:59:40.374313+0000","last_unstale":"2023-12-19T17:59:40.378712+0000","last_undegraded":"2023-12-19T17:59:40.378712+0000","last_fullsized":"2023-12-19T17:59:40.378712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:04:02.610354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392717+0000","last_change":"2023-12-19T17:59:40.385488+0000","last_active":"2023-12-19T17:59:40.392717+0000","last_peered":"2023-12-19T17:59:40.392717+0000","last_clean":"2023-12-19T17:59:40.392717+0000","last_became_active":"2023-12-19T17:59:40.382871+0000","last_became_peered":"2023-12-19T17:59:40.382871+0000","last_unstale":"2023-12-19T17:59:40.392717+0000","last_undegraded":"2023-12-19T17:59:40.392717+0000","last_fullsized":"2023-12-19T17:59:40.392717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:51.449041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397521+0000","last_change":"2023-12-19T17:59:40.395902+0000","last_active":"2023-12-19T17:59:40.397521+0000","last_peered":"2023-12-19T17:59:40.397521+0000","last_clean":"2023-12-19T17:59:40.397521+0000","last_became_active":"2023-12-19T17:59:40.395598+0000","last_became_peered":"2023-12-19T17:59:40.395598+0000","last_unstale":"2023-12-19T17:59:40.397521+0000","last_undegraded":"2023-12-19T17:59:40.397521+0000","last_fullsized":"2023-12-19T17:59:40.397521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:01.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.387168+0000","last_change":"2023-12-19T17:59:40.378956+0000","last_active":"2023-12-19T17:59:40.387168+0000","last_peered":"2023-12-19T17:59:40.387168+0000","last_clean":"2023-12-19T17:59:40.387168+0000","last_became_active":"2023-12-19T17:59:40.378337+0000","last_became_peered":"2023-12-19T17:59:40.378337+0000","last_unstale":"2023-12-19T17:59:40.387168+0000","last_undegraded":"2023-12-19T17:59:40.387168+0000","last_fullsized":"2023-12-19T17:59:40.387168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:23:44.760420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.393221+0000","last_change":"2023-12-19T17:59:40.383953+0000","last_active":"2023-12-19T17:59:40.393221+0000","last_peered":"2023-12-19T17:59:40.393221+0000","last_clean":"2023-12-19T17:59:40.393221+0000","last_became_active":"2023-12-19T17:59:40.379412+0000","last_became_peered":"2023-12-19T17:59:40.379412+0000","last_unstale":"2023-12-19T17:59:40.393221+0000","last_undegraded":"2023-12-19T17:59:40.393221+0000","last_fullsized":"2023-12-19T17:59:40.393221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:11.813072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397631+0000","last_change":"2023-12-19T17:59:40.394217+0000","last_active":"2023-12-19T17:59:40.397631+0000","last_peered":"2023-12-19T17:59:40.397631+0000","last_clean":"2023-12-19T17:59:40.397631+0000","last_became_active":"2023-12-19T17:59:40.393958+0000","last_became_peered":"2023-12-19T17:59:40.393958+0000","last_unstale":"2023-12-19T17:59:40.397631+0000","last_undegraded":"2023-12-19T17:59:40.397631+0000","last_fullsized":"2023-12-19T17:59:40.397631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:05.556313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.398537+0000","last_change":"2023-12-19T17:59:40.395889+0000","last_active":"2023-12-19T17:59:40.398537+0000","last_peered":"2023-12-19T17:59:40.398537+0000","last_clean":"2023-12-19T17:59:40.398537+0000","last_became_active":"2023-12-19T17:59:40.395561+0000","last_became_peered":"2023-12-19T17:59:40.395561+0000","last_unstale":"2023-12-19T17:59:40.398537+0000","last_undegraded":"2023-12-19T17:59:40.398537+0000","last_fullsized":"2023-12-19T17:59:40.398537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:23.018554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392085+0000","last_change":"2023-12-19T17:59:40.386978+0000","last_active":"2023-12-19T17:59:40.392085+0000","last_peered":"2023-12-19T17:59:40.392085+0000","last_clean":"2023-12-19T17:59:40.392085+0000","last_became_active":"2023-12-19T17:59:40.386563+0000","last_became_peered":"2023-12-19T17:59:40.386563+0000","last_unstale":"2023-12-19T17:59:40.392085+0000","last_undegraded":"2023-12-19T17:59:40.392085+0000","last_fullsized":"2023-12-19T17:59:40.392085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:43:25.670298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388619+0000","last_change":"2023-12-19T17:59:40.376106+0000","last_active":"2023-12-19T17:59:40.388619+0000","last_peered":"2023-12-19T17:59:40.388619+0000","last_clean":"2023-12-19T17:59:40.388619+0000","last_became_active":"2023-12-19T17:59:40.375798+0000","last_became_peered":"2023-12-19T17:59:40.375798+0000","last_unstale":"2023-12-19T17:59:40.388619+0000","last_undegraded":"2023-12-19T17:59:40.388619+0000","last_fullsized":"2023-12-19T17:59:40.388619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:06.018981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.401343+0000","last_change":"2023-12-19T17:59:40.396065+0000","last_active":"2023-12-19T17:59:40.401343+0000","last_peered":"2023-12-19T17:59:40.401343+0000","last_clean":"2023-12-19T17:59:40.401343+0000","last_became_active":"2023-12-19T17:59:40.392467+0000","last_became_peered":"2023-12-19T17:59:40.392467+0000","last_unstale":"2023-12-19T17:59:40.401343+0000","last_undegraded":"2023-12-19T17:59:40.401343+0000","last_fullsized":"2023-12-19T17:59:40.401343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:23.018554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392759+0000","last_change":"2023-12-19T17:59:40.385959+0000","last_active":"2023-12-19T17:59:40.392759+0000","last_peered":"2023-12-19T17:59:40.392759+0000","last_clean":"2023-12-19T17:59:40.392759+0000","last_became_active":"2023-12-19T17:59:40.385692+0000","last_became_peered":"2023-12-19T17:59:40.385692+0000","last_unstale":"2023-12-19T17:59:40.392759+0000","last_undegraded":"2023-12-19T17:59:40.392759+0000","last_fullsized":"2023-12-19T17:59:40.392759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:23.160479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399311+0000","last_change":"2023-12-19T17:59:40.393605+0000","last_active":"2023-12-19T17:59:40.399311+0000","last_peered":"2023-12-19T17:59:40.399311+0000","last_clean":"2023-12-19T17:59:40.399311+0000","last_became_active":"2023-12-19T17:59:40.392598+0000","last_became_peered":"2023-12-19T17:59:40.392598+0000","last_unstale":"2023-12-19T17:59:40.399311+0000","last_undegraded":"2023-12-19T17:59:40.399311+0000","last_fullsized":"2023-12-19T17:59:40.399311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:35.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382925+0000","last_change":"2023-12-19T17:59:40.376507+0000","last_active":"2023-12-19T17:59:40.382925+0000","last_peered":"2023-12-19T17:59:40.382925+0000","last_clean":"2023-12-19T17:59:40.382925+0000","last_became_active":"2023-12-19T17:59:40.376218+0000","last_became_peered":"2023-12-19T17:59:40.376218+0000","last_unstale":"2023-12-19T17:59:40.382925+0000","last_undegraded":"2023-12-19T17:59:40.382925+0000","last_fullsized":"2023-12-19T17:59:40.382925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:49.882091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.381487+0000","last_change":"2023-12-19T17:59:40.371691+0000","last_active":"2023-12-19T17:59:40.381487+0000","last_peered":"2023-12-19T17:59:40.381487+0000","last_clean":"2023-12-19T17:59:40.381487+0000","last_became_active":"2023-12-19T17:59:40.371325+0000","last_became_peered":"2023-12-19T17:59:40.371325+0000","last_unstale":"2023-12-19T17:59:40.381487+0000","last_undegraded":"2023-12-19T17:59:40.381487+0000","last_fullsized":"2023-12-19T17:59:40.381487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:13.197183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389686+0000","last_change":"2023-12-19T17:59:40.383693+0000","last_active":"2023-12-19T17:59:40.389686+0000","last_peered":"2023-12-19T17:59:40.389686+0000","last_clean":"2023-12-19T17:59:40.389686+0000","last_became_active":"2023-12-19T17:59:40.383427+0000","last_became_peered":"2023-12-19T17:59:40.383427+0000","last_unstale":"2023-12-19T17:59:40.389686+0000","last_undegraded":"2023-12-19T17:59:40.389686+0000","last_fullsized":"2023-12-19T17:59:40.389686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:26.241603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.391463+0000","last_change":"2023-12-19T17:59:40.384517+0000","last_active":"2023-12-19T17:59:40.391463+0000","last_peered":"2023-12-19T17:59:40.391463+0000","last_clean":"2023-12-19T17:59:40.391463+0000","last_became_active":"2023-12-19T17:59:40.383180+0000","last_became_peered":"2023-12-19T17:59:40.383180+0000","last_unstale":"2023-12-19T17:59:40.391463+0000","last_undegraded":"2023-12-19T17:59:40.391463+0000","last_fullsized":"2023-12-19T17:59:40.391463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:13.776055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389459+0000","last_change":"2023-12-19T17:59:40.376753+0000","last_active":"2023-12-19T17:59:40.389459+0000","last_peered":"2023-12-19T17:59:40.389459+0000","last_clean":"2023-12-19T17:59:40.389459+0000","last_became_active":"2023-12-19T17:59:40.376508+0000","last_became_peered":"2023-12-19T17:59:40.376508+0000","last_unstale":"2023-12-19T17:59:40.389459+0000","last_undegraded":"2023-12-19T17:59:40.389459+0000","last_fullsized":"2023-12-19T17:59:40.389459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:26.166996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397024+0000","last_change":"2023-12-19T17:59:40.392744+0000","last_active":"2023-12-19T17:59:40.397024+0000","last_peered":"2023-12-19T17:59:40.397024+0000","last_clean":"2023-12-19T17:59:40.397024+0000","last_became_active":"2023-12-19T17:59:40.392433+0000","last_became_peered":"2023-12-19T17:59:40.392433+0000","last_unstale":"2023-12-19T17:59:40.397024+0000","last_undegraded":"2023-12-19T17:59:40.397024+0000","last_fullsized":"2023-12-19T17:59:40.397024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:48.841267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392821+0000","last_change":"2023-12-19T17:59:40.386911+0000","last_active":"2023-12-19T17:59:40.392821+0000","last_peered":"2023-12-19T17:59:40.392821+0000","last_clean":"2023-12-19T17:59:40.392821+0000","last_became_active":"2023-12-19T17:59:40.386547+0000","last_became_peered":"2023-12-19T17:59:40.386547+0000","last_unstale":"2023-12-19T17:59:40.392821+0000","last_undegraded":"2023-12-19T17:59:40.392821+0000","last_fullsized":"2023-12-19T17:59:40.392821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:03:33.757704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394599+0000","last_change":"2023-12-19T17:59:40.391918+0000","last_active":"2023-12-19T17:59:40.394599+0000","last_peered":"2023-12-19T17:59:40.394599+0000","last_clean":"2023-12-19T17:59:40.394599+0000","last_became_active":"2023-12-19T17:59:40.390890+0000","last_became_peered":"2023-12-19T17:59:40.390890+0000","last_unstale":"2023-12-19T17:59:40.394599+0000","last_undegraded":"2023-12-19T17:59:40.394599+0000","last_fullsized":"2023-12-19T17:59:40.394599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:40.135307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399074+0000","last_change":"2023-12-19T17:59:40.393117+0000","last_active":"2023-12-19T17:59:40.399074+0000","last_peered":"2023-12-19T17:59:40.399074+0000","last_clean":"2023-12-19T17:59:40.399074+0000","last_became_active":"2023-12-19T17:59:40.390135+0000","last_became_peered":"2023-12-19T17:59:40.390135+0000","last_unstale":"2023-12-19T17:59:40.399074+0000","last_undegraded":"2023-12-19T17:59:40.399074+0000","last_fullsized":"2023-12-19T17:59:40.399074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:42.299574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388719+0000","last_change":"2023-12-19T17:59:40.386680+0000","last_active":"2023-12-19T17:59:40.388719+0000","last_peered":"2023-12-19T17:59:40.388719+0000","last_clean":"2023-12-19T17:59:40.388719+0000","last_became_active":"2023-12-19T17:59:40.386409+0000","last_became_peered":"2023-12-19T17:59:40.386409+0000","last_unstale":"2023-12-19T17:59:40.388719+0000","last_undegraded":"2023-12-19T17:59:40.388719+0000","last_fullsized":"2023-12-19T17:59:40.388719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:45.624810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396509+0000","last_change":"2023-12-19T17:59:39.880813+0000","last_active":"2023-12-19T17:59:40.396509+0000","last_peered":"2023-12-19T17:59:40.396509+0000","last_clean":"2023-12-19T17:59:40.396509+0000","last_became_active":"2023-12-19T17:59:39.880560+0000","last_became_peered":"2023-12-19T17:59:39.880560+0000","last_unstale":"2023-12-19T17:59:40.396509+0000","last_undegraded":"2023-12-19T17:59:40.396509+0000","last_fullsized":"2023-12-19T17:59:40.396509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.693733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.387187+0000","last_change":"2023-12-19T17:59:40.379142+0000","last_active":"2023-12-19T17:59:40.387187+0000","last_peered":"2023-12-19T17:59:40.387187+0000","last_clean":"2023-12-19T17:59:40.387187+0000","last_became_active":"2023-12-19T17:59:40.378712+0000","last_became_peered":"2023-12-19T17:59:40.378712+0000","last_unstale":"2023-12-19T17:59:40.387187+0000","last_undegraded":"2023-12-19T17:59:40.387187+0000","last_fullsized":"2023-12-19T17:59:40.387187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:15.008268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394711+0000","last_change":"2023-12-19T17:59:39.882852+0000","last_active":"2023-12-19T17:59:40.394711+0000","last_peered":"2023-12-19T17:59:40.394711+0000","last_clean":"2023-12-19T17:59:40.394711+0000","last_became_active":"2023-12-19T17:59:39.882567+0000","last_became_peered":"2023-12-19T17:59:39.882567+0000","last_unstale":"2023-12-19T17:59:40.394711+0000","last_undegraded":"2023-12-19T17:59:40.394711+0000","last_fullsized":"2023-12-19T17:59:40.394711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:26.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399979+0000","last_change":"2023-12-19T17:59:40.396924+0000","last_active":"2023-12-19T17:59:40.399979+0000","last_peered":"2023-12-19T17:59:40.399979+0000","last_clean":"2023-12-19T17:59:40.399979+0000","last_became_active":"2023-12-19T17:59:40.395210+0000","last_became_peered":"2023-12-19T17:59:40.395210+0000","last_unstale":"2023-12-19T17:59:40.399979+0000","last_undegraded":"2023-12-19T17:59:40.399979+0000","last_fullsized":"2023-12-19T17:59:40.399979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:13.070675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396380+0000","last_change":"2023-12-19T17:59:39.879088+0000","last_active":"2023-12-19T17:59:40.396380+0000","last_peered":"2023-12-19T17:59:40.396380+0000","last_clean":"2023-12-19T17:59:40.396380+0000","last_became_active":"2023-12-19T17:59:39.878444+0000","last_became_peered":"2023-12-19T17:59:39.878444+0000","last_unstale":"2023-12-19T17:59:40.396380+0000","last_undegraded":"2023-12-19T17:59:40.396380+0000","last_fullsized":"2023-12-19T17:59:40.396380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:12.058751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.401361+0000","last_change":"2023-12-19T17:59:40.396311+0000","last_active":"2023-12-19T17:59:40.401361+0000","last_peered":"2023-12-19T17:59:40.401361+0000","last_clean":"2023-12-19T17:59:40.401361+0000","last_became_active":"2023-12-19T17:59:40.392770+0000","last_became_peered":"2023-12-19T17:59:40.392770+0000","last_unstale":"2023-12-19T17:59:40.401361+0000","last_undegraded":"2023-12-19T17:59:40.401361+0000","last_fullsized":"2023-12-19T17:59:40.401361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:16.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.400370+0000","last_change":"2023-12-19T17:59:39.879646+0000","last_active":"2023-12-19T17:59:40.400370+0000","last_peered":"2023-12-19T17:59:40.400370+0000","last_clean":"2023-12-19T17:59:40.400370+0000","last_became_active":"2023-12-19T17:59:39.879355+0000","last_became_peered":"2023-12-19T17:59:39.879355+0000","last_unstale":"2023-12-19T17:59:40.400370+0000","last_undegraded":"2023-12-19T17:59:40.400370+0000","last_fullsized":"2023-12-19T17:59:40.400370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:08.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382907+0000","last_change":"2023-12-19T17:59:40.377224+0000","last_active":"2023-12-19T17:59:40.382907+0000","last_peered":"2023-12-19T17:59:40.382907+0000","last_clean":"2023-12-19T17:59:40.382907+0000","last_became_active":"2023-12-19T17:59:40.375553+0000","last_became_peered":"2023-12-19T17:59:40.375553+0000","last_unstale":"2023-12-19T17:59:40.382907+0000","last_undegraded":"2023-12-19T17:59:40.382907+0000","last_fullsized":"2023-12-19T17:59:40.382907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:38:37.629764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392133+0000","last_change":"2023-12-19T17:59:39.879229+0000","last_active":"2023-12-19T17:59:40.392133+0000","last_peered":"2023-12-19T17:59:40.392133+0000","last_clean":"2023-12-19T17:59:40.392133+0000","last_became_active":"2023-12-19T17:59:39.878221+0000","last_became_peered":"2023-12-19T17:59:39.878221+0000","last_unstale":"2023-12-19T17:59:40.392133+0000","last_undegraded":"2023-12-19T17:59:40.392133+0000","last_fullsized":"2023-12-19T17:59:40.392133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:38.592069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394822+0000","last_change":"2023-12-19T17:59:40.390456+0000","last_active":"2023-12-19T17:59:40.394822+0000","last_peered":"2023-12-19T17:59:40.394822+0000","last_clean":"2023-12-19T17:59:40.394822+0000","last_became_active":"2023-12-19T17:59:40.388923+0000","last_became_peered":"2023-12-19T17:59:40.388923+0000","last_unstale":"2023-12-19T17:59:40.394822+0000","last_undegraded":"2023-12-19T17:59:40.394822+0000","last_fullsized":"2023-12-19T17:59:40.394822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:58.192927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389817+0000","last_change":"2023-12-19T17:59:39.873212+0000","last_active":"2023-12-19T17:59:40.389817+0000","last_peered":"2023-12-19T17:59:40.389817+0000","last_clean":"2023-12-19T17:59:40.389817+0000","last_became_active":"2023-12-19T17:59:39.872921+0000","last_became_peered":"2023-12-19T17:59:39.872921+0000","last_unstale":"2023-12-19T17:59:40.389817+0000","last_undegraded":"2023-12-19T17:59:40.389817+0000","last_fullsized":"2023-12-19T17:59:40.389817+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:26.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.400893+0000","last_change":"2023-12-19T17:59:40.393811+0000","last_active":"2023-12-19T17:59:40.400893+0000","last_peered":"2023-12-19T17:59:40.400893+0000","last_clean":"2023-12-19T17:59:40.400893+0000","last_became_active":"2023-12-19T17:59:40.393413+0000","last_became_peered":"2023-12-19T17:59:40.393413+0000","last_unstale":"2023-12-19T17:59:40.400893+0000","last_undegraded":"2023-12-19T17:59:40.400893+0000","last_fullsized":"2023-12-19T17:59:40.400893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.627372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.360196+0000","last_change":"2023-12-19T17:59:39.873914+0000","last_active":"2023-12-19T17:59:40.360196+0000","last_peered":"2023-12-19T17:59:40.360196+0000","last_clean":"2023-12-19T17:59:40.360196+0000","last_became_active":"2023-12-19T17:59:39.873610+0000","last_became_peered":"2023-12-19T17:59:39.873610+0000","last_unstale":"2023-12-19T17:59:40.360196+0000","last_undegraded":"2023-12-19T17:59:40.360196+0000","last_fullsized":"2023-12-19T17:59:40.360196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:35.581486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.408608+0000","last_change":"2023-12-19T17:59:40.400643+0000","last_active":"2023-12-19T17:59:40.408608+0000","last_peered":"2023-12-19T17:59:40.408608+0000","last_clean":"2023-12-19T17:59:40.408608+0000","last_became_active":"2023-12-19T17:59:40.400401+0000","last_became_peered":"2023-12-19T17:59:40.400401+0000","last_unstale":"2023-12-19T17:59:40.408608+0000","last_undegraded":"2023-12-19T17:59:40.408608+0000","last_fullsized":"2023-12-19T17:59:40.408608+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:45.624810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.372781+0000","last_change":"2023-12-19T17:59:39.872076+0000","last_active":"2023-12-19T17:59:40.372781+0000","last_peered":"2023-12-19T17:59:40.372781+0000","last_clean":"2023-12-19T17:59:40.372781+0000","last_became_active":"2023-12-19T17:59:39.871754+0000","last_became_peered":"2023-12-19T17:59:39.871754+0000","last_unstale":"2023-12-19T17:59:40.372781+0000","last_undegraded":"2023-12-19T17:59:40.372781+0000","last_fullsized":"2023-12-19T17:59:40.372781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:55.938725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382909+0000","last_change":"2023-12-19T17:59:40.375692+0000","last_active":"2023-12-19T17:59:40.382909+0000","last_peered":"2023-12-19T17:59:40.382909+0000","last_clean":"2023-12-19T17:59:40.382909+0000","last_became_active":"2023-12-19T17:59:40.375326+0000","last_became_peered":"2023-12-19T17:59:40.375326+0000","last_unstale":"2023-12-19T17:59:40.382909+0000","last_undegraded":"2023-12-19T17:59:40.382909+0000","last_fullsized":"2023-12-19T17:59:40.382909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.254157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.370102+0000","last_change":"2023-12-19T17:59:39.881890+0000","last_active":"2023-12-19T17:59:40.370102+0000","last_peered":"2023-12-19T17:59:40.370102+0000","last_clean":"2023-12-19T17:59:40.370102+0000","last_became_active":"2023-12-19T17:59:39.881387+0000","last_became_peered":"2023-12-19T17:59:39.881387+0000","last_unstale":"2023-12-19T17:59:40.370102+0000","last_undegraded":"2023-12-19T17:59:40.370102+0000","last_fullsized":"2023-12-19T17:59:40.370102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:34.741145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.398771+0000","last_change":"2023-12-19T17:59:40.394607+0000","last_active":"2023-12-19T17:59:40.398771+0000","last_peered":"2023-12-19T17:59:40.398771+0000","last_clean":"2023-12-19T17:59:40.398771+0000","last_became_active":"2023-12-19T17:59:40.393346+0000","last_became_peered":"2023-12-19T17:59:40.393346+0000","last_unstale":"2023-12-19T17:59:40.398771+0000","last_undegraded":"2023-12-19T17:59:40.398771+0000","last_fullsized":"2023-12-19T17:59:40.398771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:11.813072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.371630+0000","last_change":"2023-12-19T17:59:39.876418+0000","last_active":"2023-12-19T17:59:40.371630+0000","last_peered":"2023-12-19T17:59:40.371630+0000","last_clean":"2023-12-19T17:59:40.371630+0000","last_became_active":"2023-12-19T17:59:39.875782+0000","last_became_peered":"2023-12-19T17:59:39.875782+0000","last_unstale":"2023-12-19T17:59:40.371630+0000","last_undegraded":"2023-12-19T17:59:40.371630+0000","last_fullsized":"2023-12-19T17:59:40.371630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:18:32.065281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382944+0000","last_change":"2023-12-19T17:59:40.374994+0000","last_active":"2023-12-19T17:59:40.382944+0000","last_peered":"2023-12-19T17:59:40.382944+0000","last_clean":"2023-12-19T17:59:40.382944+0000","last_became_active":"2023-12-19T17:59:40.374706+0000","last_became_peered":"2023-12-19T17:59:40.374706+0000","last_unstale":"2023-12-19T17:59:40.382944+0000","last_undegraded":"2023-12-19T17:59:40.382944+0000","last_fullsized":"2023-12-19T17:59:40.382944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:05:59.640701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.393469+0000","last_change":"2023-12-19T17:59:39.878504+0000","last_active":"2023-12-19T17:59:40.393469+0000","last_peered":"2023-12-19T17:59:40.393469+0000","last_clean":"2023-12-19T17:59:40.393469+0000","last_became_active":"2023-12-19T17:59:39.878138+0000","last_became_peered":"2023-12-19T17:59:39.878138+0000","last_unstale":"2023-12-19T17:59:40.393469+0000","last_undegraded":"2023-12-19T17:59:40.393469+0000","last_fullsized":"2023-12-19T17:59:40.393469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:28.082682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.380862+0000","last_change":"2023-12-19T17:59:40.377985+0000","last_active":"2023-12-19T17:59:40.380862+0000","last_peered":"2023-12-19T17:59:40.380862+0000","last_clean":"2023-12-19T17:59:40.380862+0000","last_became_active":"2023-12-19T17:59:40.377739+0000","last_became_peered":"2023-12-19T17:59:40.377739+0000","last_unstale":"2023-12-19T17:59:40.380862+0000","last_undegraded":"2023-12-19T17:59:40.380862+0000","last_fullsized":"2023-12-19T17:59:40.380862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.627372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.408728+0000","last_change":"2023-12-19T17:59:39.876757+0000","last_active":"2023-12-19T17:59:40.408728+0000","last_peered":"2023-12-19T17:59:40.408728+0000","last_clean":"2023-12-19T17:59:40.408728+0000","last_became_active":"2023-12-19T17:59:39.876444+0000","last_became_peered":"2023-12-19T17:59:39.876444+0000","last_unstale":"2023-12-19T17:59:40.408728+0000","last_undegraded":"2023-12-19T17:59:40.408728+0000","last_fullsized":"2023-12-19T17:59:40.408728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:57.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.378694+0000","last_change":"2023-12-19T17:59:40.374624+0000","last_active":"2023-12-19T17:59:40.378694+0000","last_peered":"2023-12-19T17:59:40.378694+0000","last_clean":"2023-12-19T17:59:40.378694+0000","last_became_active":"2023-12-19T17:59:40.374387+0000","last_became_peered":"2023-12-19T17:59:40.374387+0000","last_unstale":"2023-12-19T17:59:40.378694+0000","last_undegraded":"2023-12-19T17:59:40.378694+0000","last_fullsized":"2023-12-19T17:59:40.378694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:49.698090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.393212+0000","last_change":"2023-12-19T17:59:39.872589+0000","last_active":"2023-12-19T17:59:40.393212+0000","last_peered":"2023-12-19T17:59:40.393212+0000","last_clean":"2023-12-19T17:59:40.393212+0000","last_became_active":"2023-12-19T17:59:39.872317+0000","last_became_peered":"2023-12-19T17:59:39.872317+0000","last_unstale":"2023-12-19T17:59:40.393212+0000","last_undegraded":"2023-12-19T17:59:40.393212+0000","last_fullsized":"2023-12-19T17:59:40.393212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:11.615448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397915+0000","last_change":"2023-12-19T17:59:40.391400+0000","last_active":"2023-12-19T17:59:40.397915+0000","last_peered":"2023-12-19T17:59:40.397915+0000","last_clean":"2023-12-19T17:59:40.397915+0000","last_became_active":"2023-12-19T17:59:40.390928+0000","last_became_peered":"2023-12-19T17:59:40.390928+0000","last_unstale":"2023-12-19T17:59:40.397915+0000","last_undegraded":"2023-12-19T17:59:40.397915+0000","last_fullsized":"2023-12-19T17:59:40.397915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:40.135307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369894+0000","last_change":"2023-12-19T17:59:39.879603+0000","last_active":"2023-12-19T17:59:40.369894+0000","last_peered":"2023-12-19T17:59:40.369894+0000","last_clean":"2023-12-19T17:59:40.369894+0000","last_became_active":"2023-12-19T17:59:39.879291+0000","last_became_peered":"2023-12-19T17:59:39.879291+0000","last_unstale":"2023-12-19T17:59:40.369894+0000","last_undegraded":"2023-12-19T17:59:40.369894+0000","last_fullsized":"2023-12-19T17:59:40.369894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:44.612886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.398423+0000","last_change":"2023-12-19T17:59:40.392361+0000","last_active":"2023-12-19T17:59:40.398423+0000","last_peered":"2023-12-19T17:59:40.398423+0000","last_clean":"2023-12-19T17:59:40.398423+0000","last_became_active":"2023-12-19T17:59:40.392102+0000","last_became_peered":"2023-12-19T17:59:40.392102+0000","last_unstale":"2023-12-19T17:59:40.398423+0000","last_undegraded":"2023-12-19T17:59:40.398423+0000","last_fullsized":"2023-12-19T17:59:40.398423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.627372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.372749+0000","last_change":"2023-12-19T17:59:39.877283+0000","last_active":"2023-12-19T17:59:40.372749+0000","last_peered":"2023-12-19T17:59:40.372749+0000","last_clean":"2023-12-19T17:59:40.372749+0000","last_became_active":"2023-12-19T17:59:39.876839+0000","last_became_peered":"2023-12-19T17:59:39.876839+0000","last_unstale":"2023-12-19T17:59:40.372749+0000","last_undegraded":"2023-12-19T17:59:40.372749+0000","last_fullsized":"2023-12-19T17:59:40.372749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:49.213154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397963+0000","last_change":"2023-12-19T17:59:40.391760+0000","last_active":"2023-12-19T17:59:40.397963+0000","last_peered":"2023-12-19T17:59:40.397963+0000","last_clean":"2023-12-19T17:59:40.397963+0000","last_became_active":"2023-12-19T17:59:40.391412+0000","last_became_peered":"2023-12-19T17:59:40.391412+0000","last_unstale":"2023-12-19T17:59:40.397963+0000","last_undegraded":"2023-12-19T17:59:40.397963+0000","last_fullsized":"2023-12-19T17:59:40.397963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:16.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397902+0000","last_change":"2023-12-19T17:59:39.871209+0000","last_active":"2023-12-19T17:59:40.397902+0000","last_peered":"2023-12-19T17:59:40.397902+0000","last_clean":"2023-12-19T17:59:40.397902+0000","last_became_active":"2023-12-19T17:59:39.869750+0000","last_became_peered":"2023-12-19T17:59:39.869750+0000","last_unstale":"2023-12-19T17:59:40.397902+0000","last_undegraded":"2023-12-19T17:59:40.397902+0000","last_fullsized":"2023-12-19T17:59:40.397902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:39.825161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392314+0000","last_change":"2023-12-19T17:59:40.387156+0000","last_active":"2023-12-19T17:59:40.392314+0000","last_peered":"2023-12-19T17:59:40.392314+0000","last_clean":"2023-12-19T17:59:40.392314+0000","last_became_active":"2023-12-19T17:59:40.386761+0000","last_became_peered":"2023-12-19T17:59:40.386761+0000","last_unstale":"2023-12-19T17:59:40.392314+0000","last_undegraded":"2023-12-19T17:59:40.392314+0000","last_fullsized":"2023-12-19T17:59:40.392314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:46:08.007213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.385044+0000","last_change":"2023-12-19T17:59:39.881930+0000","last_active":"2023-12-19T17:59:40.385044+0000","last_peered":"2023-12-19T17:59:40.385044+0000","last_clean":"2023-12-19T17:59:40.385044+0000","last_became_active":"2023-12-19T17:59:39.881631+0000","last_became_peered":"2023-12-19T17:59:39.881631+0000","last_unstale":"2023-12-19T17:59:40.385044+0000","last_undegraded":"2023-12-19T17:59:40.385044+0000","last_fullsized":"2023-12-19T17:59:40.385044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:15.668628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397623+0000","last_change":"2023-12-19T17:59:40.393372+0000","last_active":"2023-12-19T17:59:40.397623+0000","last_peered":"2023-12-19T17:59:40.397623+0000","last_clean":"2023-12-19T17:59:40.397623+0000","last_became_active":"2023-12-19T17:59:40.392005+0000","last_became_peered":"2023-12-19T17:59:40.392005+0000","last_unstale":"2023-12-19T17:59:40.397623+0000","last_undegraded":"2023-12-19T17:59:40.397623+0000","last_fullsized":"2023-12-19T17:59:40.397623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:09:44.755293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397248+0000","last_change":"2023-12-19T17:59:39.882585+0000","last_active":"2023-12-19T17:59:40.397248+0000","last_peered":"2023-12-19T17:59:40.397248+0000","last_clean":"2023-12-19T17:59:40.397248+0000","last_became_active":"2023-12-19T17:59:39.882306+0000","last_became_peered":"2023-12-19T17:59:39.882306+0000","last_unstale":"2023-12-19T17:59:40.397248+0000","last_undegraded":"2023-12-19T17:59:40.397248+0000","last_fullsized":"2023-12-19T17:59:40.397248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:08.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392776+0000","last_change":"2023-12-19T17:59:40.387601+0000","last_active":"2023-12-19T17:59:40.392776+0000","last_peered":"2023-12-19T17:59:40.392776+0000","last_clean":"2023-12-19T17:59:40.392776+0000","last_became_active":"2023-12-19T17:59:40.387279+0000","last_became_peered":"2023-12-19T17:59:40.387279+0000","last_unstale":"2023-12-19T17:59:40.392776+0000","last_undegraded":"2023-12-19T17:59:40.392776+0000","last_fullsized":"2023-12-19T17:59:40.392776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:12.793853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.395786+0000","last_change":"2023-12-19T17:59:39.872600+0000","last_active":"2023-12-19T17:59:40.395786+0000","last_peered":"2023-12-19T17:59:40.395786+0000","last_clean":"2023-12-19T17:59:40.395786+0000","last_became_active":"2023-12-19T17:59:39.871779+0000","last_became_peered":"2023-12-19T17:59:39.871779+0000","last_unstale":"2023-12-19T17:59:40.395786+0000","last_undegraded":"2023-12-19T17:59:40.395786+0000","last_fullsized":"2023-12-19T17:59:40.395786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:29.790572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382916+0000","last_change":"2023-12-19T17:59:40.375123+0000","last_active":"2023-12-19T17:59:40.382916+0000","last_peered":"2023-12-19T17:59:40.382916+0000","last_clean":"2023-12-19T17:59:40.382916+0000","last_became_active":"2023-12-19T17:59:40.374849+0000","last_became_peered":"2023-12-19T17:59:40.374849+0000","last_unstale":"2023-12-19T17:59:40.382916+0000","last_undegraded":"2023-12-19T17:59:40.382916+0000","last_fullsized":"2023-12-19T17:59:40.382916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:01.876476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.368898+0000","last_change":"2023-12-19T17:59:39.880070+0000","last_active":"2023-12-19T17:59:40.368898+0000","last_peered":"2023-12-19T17:59:40.368898+0000","last_clean":"2023-12-19T17:59:40.368898+0000","last_became_active":"2023-12-19T17:59:39.879774+0000","last_became_peered":"2023-12-19T17:59:39.879774+0000","last_unstale":"2023-12-19T17:59:40.368898+0000","last_undegraded":"2023-12-19T17:59:40.368898+0000","last_fullsized":"2023-12-19T17:59:40.368898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:05.007057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.390406+0000","last_change":"2023-12-19T17:59:40.383009+0000","last_active":"2023-12-19T17:59:40.390406+0000","last_peered":"2023-12-19T17:59:40.390406+0000","last_clean":"2023-12-19T17:59:40.390406+0000","last_became_active":"2023-12-19T17:59:40.380225+0000","last_became_peered":"2023-12-19T17:59:40.380225+0000","last_unstale":"2023-12-19T17:59:40.390406+0000","last_undegraded":"2023-12-19T17:59:40.390406+0000","last_fullsized":"2023-12-19T17:59:40.390406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:00.783109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.380640+0000","last_change":"2023-12-19T17:59:39.874158+0000","last_active":"2023-12-19T17:59:40.380640+0000","last_peered":"2023-12-19T17:59:40.380640+0000","last_clean":"2023-12-19T17:59:40.380640+0000","last_became_active":"2023-12-19T17:59:39.873862+0000","last_became_peered":"2023-12-19T17:59:39.873862+0000","last_unstale":"2023-12-19T17:59:40.380640+0000","last_undegraded":"2023-12-19T17:59:40.380640+0000","last_fullsized":"2023-12-19T17:59:40.380640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:57.181003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394440+0000","last_change":"2023-12-19T17:59:40.389589+0000","last_active":"2023-12-19T17:59:40.394440+0000","last_peered":"2023-12-19T17:59:40.394440+0000","last_clean":"2023-12-19T17:59:40.394440+0000","last_became_active":"2023-12-19T17:59:40.389204+0000","last_became_peered":"2023-12-19T17:59:40.389204+0000","last_unstale":"2023-12-19T17:59:40.394440+0000","last_undegraded":"2023-12-19T17:59:40.394440+0000","last_fullsized":"2023-12-19T17:59:40.394440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:41:42.214792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.368992+0000","last_change":"2023-12-19T17:59:39.876263+0000","last_active":"2023-12-19T17:59:40.368992+0000","last_peered":"2023-12-19T17:59:40.368992+0000","last_clean":"2023-12-19T17:59:40.368992+0000","last_became_active":"2023-12-19T17:59:39.875980+0000","last_became_peered":"2023-12-19T17:59:39.875980+0000","last_unstale":"2023-12-19T17:59:40.368992+0000","last_undegraded":"2023-12-19T17:59:40.368992+0000","last_fullsized":"2023-12-19T17:59:40.368992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:23:43.748496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397944+0000","last_change":"2023-12-19T17:59:40.389576+0000","last_active":"2023-12-19T17:59:40.397944+0000","last_peered":"2023-12-19T17:59:40.397944+0000","last_clean":"2023-12-19T17:59:40.397944+0000","last_became_active":"2023-12-19T17:59:40.389314+0000","last_became_peered":"2023-12-19T17:59:40.389314+0000","last_unstale":"2023-12-19T17:59:40.397944+0000","last_undegraded":"2023-12-19T17:59:40.397944+0000","last_fullsized":"2023-12-19T17:59:40.397944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:13.070675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.366759+0000","last_change":"2023-12-19T17:59:39.868934+0000","last_active":"2023-12-19T17:59:40.366759+0000","last_peered":"2023-12-19T17:59:40.366759+0000","last_clean":"2023-12-19T17:59:40.366759+0000","last_became_active":"2023-12-19T17:59:39.868625+0000","last_became_peered":"2023-12-19T17:59:39.868625+0000","last_unstale":"2023-12-19T17:59:40.366759+0000","last_undegraded":"2023-12-19T17:59:40.366759+0000","last_fullsized":"2023-12-19T17:59:40.366759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:47.829344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.405439+0000","last_change":"2023-12-19T17:59:40.398781+0000","last_active":"2023-12-19T17:59:40.405439+0000","last_peered":"2023-12-19T17:59:40.405439+0000","last_clean":"2023-12-19T17:59:40.405439+0000","last_became_active":"2023-12-19T17:59:40.397803+0000","last_became_peered":"2023-12-19T17:59:40.397803+0000","last_unstale":"2023-12-19T17:59:40.405439+0000","last_undegraded":"2023-12-19T17:59:40.405439+0000","last_fullsized":"2023-12-19T17:59:40.405439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:45.624810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382914+0000","last_change":"2023-12-19T17:59:39.878061+0000","last_active":"2023-12-19T17:59:40.382914+0000","last_peered":"2023-12-19T17:59:40.382914+0000","last_clean":"2023-12-19T17:59:40.382914+0000","last_became_active":"2023-12-19T17:59:39.877810+0000","last_became_peered":"2023-12-19T17:59:39.877810+0000","last_unstale":"2023-12-19T17:59:40.382914+0000","last_undegraded":"2023-12-19T17:59:40.382914+0000","last_fullsized":"2023-12-19T17:59:40.382914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:12.058751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397601+0000","last_change":"2023-12-19T17:59:40.389101+0000","last_active":"2023-12-19T17:59:40.397601+0000","last_peered":"2023-12-19T17:59:40.397601+0000","last_clean":"2023-12-19T17:59:40.397601+0000","last_became_active":"2023-12-19T17:59:40.388812+0000","last_became_peered":"2023-12-19T17:59:40.388812+0000","last_unstale":"2023-12-19T17:59:40.397601+0000","last_undegraded":"2023-12-19T17:59:40.397601+0000","last_fullsized":"2023-12-19T17:59:40.397601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:23.018554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.361277+0000","last_change":"2023-12-19T17:59:39.872819+0000","last_active":"2023-12-19T17:59:40.361277+0000","last_peered":"2023-12-19T17:59:40.361277+0000","last_clean":"2023-12-19T17:59:40.361277+0000","last_became_active":"2023-12-19T17:59:39.872559+0000","last_became_peered":"2023-12-19T17:59:39.872559+0000","last_unstale":"2023-12-19T17:59:40.361277+0000","last_undegraded":"2023-12-19T17:59:40.361277+0000","last_fullsized":"2023-12-19T17:59:40.361277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:25.229680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399708+0000","last_change":"2023-12-19T17:59:40.394157+0000","last_active":"2023-12-19T17:59:40.399708+0000","last_peered":"2023-12-19T17:59:40.399708+0000","last_clean":"2023-12-19T17:59:40.399708+0000","last_became_active":"2023-12-19T17:59:40.393846+0000","last_became_peered":"2023-12-19T17:59:40.393846+0000","last_unstale":"2023-12-19T17:59:40.399708+0000","last_undegraded":"2023-12-19T17:59:40.399708+0000","last_fullsized":"2023-12-19T17:59:40.399708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:18:33.077205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369739+0000","last_change":"2023-12-19T17:59:39.882949+0000","last_active":"2023-12-19T17:59:40.369739+0000","last_peered":"2023-12-19T17:59:40.369739+0000","last_clean":"2023-12-19T17:59:40.369739+0000","last_became_active":"2023-12-19T17:59:39.882437+0000","last_became_peered":"2023-12-19T17:59:39.882437+0000","last_unstale":"2023-12-19T17:59:40.369739+0000","last_undegraded":"2023-12-19T17:59:40.369739+0000","last_fullsized":"2023-12-19T17:59:40.369739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:22.006630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.390439+0000","last_change":"2023-12-19T17:59:40.383514+0000","last_active":"2023-12-19T17:59:40.390439+0000","last_peered":"2023-12-19T17:59:40.390439+0000","last_clean":"2023-12-19T17:59:40.390439+0000","last_became_active":"2023-12-19T17:59:40.382742+0000","last_became_peered":"2023-12-19T17:59:40.382742+0000","last_unstale":"2023-12-19T17:59:40.390439+0000","last_undegraded":"2023-12-19T17:59:40.390439+0000","last_fullsized":"2023-12-19T17:59:40.390439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:05:15.604488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369116+0000","last_change":"2023-12-19T17:59:39.883300+0000","last_active":"2023-12-19T17:59:40.369116+0000","last_peered":"2023-12-19T17:59:40.369116+0000","last_clean":"2023-12-19T17:59:40.369116+0000","last_became_active":"2023-12-19T17:59:39.881595+0000","last_became_peered":"2023-12-19T17:59:39.881595+0000","last_unstale":"2023-12-19T17:59:40.369116+0000","last_undegraded":"2023-12-19T17:59:40.369116+0000","last_fullsized":"2023-12-19T17:59:40.369116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:11.615448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397990+0000","last_change":"2023-12-19T17:59:40.389479+0000","last_active":"2023-12-19T17:59:40.397990+0000","last_peered":"2023-12-19T17:59:40.397990+0000","last_clean":"2023-12-19T17:59:40.397990+0000","last_became_active":"2023-12-19T17:59:40.389216+0000","last_became_peered":"2023-12-19T17:59:40.389216+0000","last_unstale":"2023-12-19T17:59:40.397990+0000","last_undegraded":"2023-12-19T17:59:40.397990+0000","last_fullsized":"2023-12-19T17:59:40.397990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:35.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.377679+0000","last_change":"2023-12-19T17:59:39.884357+0000","last_active":"2023-12-19T17:59:40.377679+0000","last_peered":"2023-12-19T17:59:40.377679+0000","last_clean":"2023-12-19T17:59:40.377679+0000","last_became_active":"2023-12-19T17:59:39.884077+0000","last_became_peered":"2023-12-19T17:59:39.884077+0000","last_unstale":"2023-12-19T17:59:40.377679+0000","last_undegraded":"2023-12-19T17:59:40.377679+0000","last_fullsized":"2023-12-19T17:59:40.377679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:38.592069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.408699+0000","last_change":"2023-12-19T17:59:40.401254+0000","last_active":"2023-12-19T17:59:40.408699+0000","last_peered":"2023-12-19T17:59:40.408699+0000","last_clean":"2023-12-19T17:59:40.408699+0000","last_became_active":"2023-12-19T17:59:40.400983+0000","last_became_peered":"2023-12-19T17:59:40.400983+0000","last_unstale":"2023-12-19T17:59:40.408699+0000","last_undegraded":"2023-12-19T17:59:40.408699+0000","last_fullsized":"2023-12-19T17:59:40.408699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:46.431718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.373009+0000","last_change":"2023-12-19T17:59:39.878021+0000","last_active":"2023-12-19T17:59:40.373009+0000","last_peered":"2023-12-19T17:59:40.373009+0000","last_clean":"2023-12-19T17:59:40.373009+0000","last_became_active":"2023-12-19T17:59:39.876868+0000","last_became_peered":"2023-12-19T17:59:39.876868+0000","last_unstale":"2023-12-19T17:59:40.373009+0000","last_undegraded":"2023-12-19T17:59:40.373009+0000","last_fullsized":"2023-12-19T17:59:40.373009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:08.573138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389110+0000","last_change":"2023-12-19T17:59:40.386955+0000","last_active":"2023-12-19T17:59:40.389110+0000","last_peered":"2023-12-19T17:59:40.389110+0000","last_clean":"2023-12-19T17:59:40.389110+0000","last_became_active":"2023-12-19T17:59:40.386532+0000","last_became_peered":"2023-12-19T17:59:40.386532+0000","last_unstale":"2023-12-19T17:59:40.389110+0000","last_undegraded":"2023-12-19T17:59:40.389110+0000","last_fullsized":"2023-12-19T17:59:40.389110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:35.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.377815+0000","last_change":"2023-12-19T17:59:39.880034+0000","last_active":"2023-12-19T17:59:40.377815+0000","last_peered":"2023-12-19T17:59:40.377815+0000","last_clean":"2023-12-19T17:59:40.377815+0000","last_became_active":"2023-12-19T17:59:39.879722+0000","last_became_peered":"2023-12-19T17:59:39.879722+0000","last_unstale":"2023-12-19T17:59:40.377815+0000","last_undegraded":"2023-12-19T17:59:40.377815+0000","last_fullsized":"2023-12-19T17:59:40.377815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:11.781929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388224+0000","last_change":"2023-12-19T17:59:40.381385+0000","last_active":"2023-12-19T17:59:40.388224+0000","last_peered":"2023-12-19T17:59:40.388224+0000","last_clean":"2023-12-19T17:59:40.388224+0000","last_became_active":"2023-12-19T17:59:40.381145+0000","last_became_peered":"2023-12-19T17:59:40.381145+0000","last_unstale":"2023-12-19T17:59:40.388224+0000","last_undegraded":"2023-12-19T17:59:40.388224+0000","last_fullsized":"2023-12-19T17:59:40.388224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:46.431718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.368753+0000","last_change":"2023-12-19T17:59:39.878172+0000","last_active":"2023-12-19T17:59:40.368753+0000","last_peered":"2023-12-19T17:59:40.368753+0000","last_clean":"2023-12-19T17:59:40.368753+0000","last_became_active":"2023-12-19T17:59:39.877668+0000","last_became_peered":"2023-12-19T17:59:39.877668+0000","last_unstale":"2023-12-19T17:59:40.368753+0000","last_undegraded":"2023-12-19T17:59:40.368753+0000","last_fullsized":"2023-12-19T17:59:40.368753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:50.437117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388027+0000","last_change":"2023-12-19T17:59:40.383456+0000","last_active":"2023-12-19T17:59:40.388027+0000","last_peered":"2023-12-19T17:59:40.388027+0000","last_clean":"2023-12-19T17:59:40.388027+0000","last_became_active":"2023-12-19T17:59:40.381498+0000","last_became_peered":"2023-12-19T17:59:40.381498+0000","last_unstale":"2023-12-19T17:59:40.388027+0000","last_undegraded":"2023-12-19T17:59:40.388027+0000","last_fullsized":"2023-12-19T17:59:40.388027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:03.573212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369682+0000","last_change":"2023-12-19T17:59:39.880767+0000","last_active":"2023-12-19T17:59:40.369682+0000","last_peered":"2023-12-19T17:59:40.369682+0000","last_clean":"2023-12-19T17:59:40.369682+0000","last_became_active":"2023-12-19T17:59:39.880304+0000","last_became_peered":"2023-12-19T17:59:39.880304+0000","last_unstale":"2023-12-19T17:59:40.369682+0000","last_undegraded":"2023-12-19T17:59:40.369682+0000","last_fullsized":"2023-12-19T17:59:40.369682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:38:36.617841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-19T17:59:39.864827+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:59:39.864827+0000","last_peered":"2023-12-19T17:59:39.864827+0000","last_clean":"2023-12-19T17:59:39.864827+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:59:39.864827+0000","last_undegraded":"2023-12-19T17:59:39.864827+0000","last_fullsized":"2023-12-19T17:59:39.864827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1626112,"data_stored":1078940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.115,"15min":1.0669999999999999},"min":{"1min":0.70099999999999996,"5min":0.56100000000000005,"15min":0.55000000000000004},"max":{"1min":1.46,"5min":1.577,"15min":1.8089999999999999},"last":1.603},{"interface":"front","average":{"1min":1.123,"5min":1.1499999999999999,"15min":1.131},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.61299999999999999},"max":{"1min":1.403,"5min":1.661,"15min":1.661},"last":1.51}]},{"osd":1,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.036,"15min":1.071},"min":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.607,"5min":1.607,"15min":1.7250000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.081,"15min":1.1259999999999999},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5569999999999999,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.0700000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.042,"15min":1.0569999999999999},"min":{"1min":0.754,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.514,"5min":1.514,"15min":2.069},"last":1.319},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.125,"15min":1.133},"min":{"1min":0.76700000000000002,"5min":0.72699999999999998,"15min":0.65300000000000002},"max":{"1min":1.3959999999999999,"5min":1.508,"15min":1.5660000000000001},"last":1.5449999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.133},"min":{"1min":0.67100000000000004,"5min":0.622,"15min":0.51600000000000001},"max":{"1min":1.5269999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2070000000000001,"15min":1.2150000000000001},"min":{"1min":0.89600000000000002,"5min":0.88900000000000001,"15min":0.64200000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.395}]},{"osd":4,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1299999999999999,"15min":1.204},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2929999999999999,"5min":1.712,"15min":1.8779999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2509999999999999,"15min":1.28},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4299999999999999,"5min":1.8120000000000001,"15min":2.1720000000000002},"last":1.857}]},{"osd":5,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1890000000000001,"15min":1.23},"min":{"1min":0.79700000000000004,"5min":0.77400000000000002,"15min":0.73099999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.97},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.2270000000000001,"15min":1.274},"min":{"1min":0.872,"5min":0.86099999999999999,"15min":0.63200000000000001},"max":{"1min":1.331,"5min":1.861,"15min":2.02},"last":1.4330000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.363,"15min":1.3859999999999999},"min":{"1min":1.016,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3799999999999999,"5min":1.9650000000000001,"15min":2.1429999999999998},"last":1.569},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.282,"15min":1.337},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.47,"5min":2.0049999999999999,"15min":2.2599999999999998},"last":1.6240000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":490114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.997,"15min":1.143},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.345,"5min":1.5149999999999999,"15min":4.5979999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.03,"15min":1.0860000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.357,"5min":1.5580000000000001,"15min":1.6819999999999999},"last":1.1739999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.085},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3799999999999999,"5min":1.494,"15min":2.2109999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0840000000000001,"15min":1.123},"min":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.583,"5min":1.583,"15min":1.621},"last":1.149}]},{"osd":2,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.117,"15min":1.3680000000000001},"min":{"1min":0.754,"5min":0.753,"15min":0.66800000000000004},"max":{"1min":1.5109999999999999,"5min":1.54,"15min":8.5470000000000006},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.109,"15min":1.244},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.429,"5min":1.778,"15min":4.6340000000000003},"last":1.0880000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1759999999999999,"15min":1.288},"min":{"1min":0.85699999999999998,"5min":0.76400000000000001,"15min":0.72099999999999997},"max":{"1min":1.486,"5min":1.6919999999999999,"15min":4.5380000000000003},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.155,"5min":1.1950000000000001,"15min":1.331},"min":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.512,"5min":1.911,"15min":4.508},"last":1.2190000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.139,"15min":1.1399999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.438},"max":{"1min":1.4650000000000001,"5min":1.6459999999999999,"15min":1.8360000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.93500000000000005,"5min":0.77600000000000002,"15min":0.70299999999999996},"max":{"1min":1.611,"5min":1.7769999999999999,"15min":1.899},"last":1.349}]},{"osd":5,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.238,"15min":1.264},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.5860000000000001,"5min":1.829,"15min":2.1400000000000001},"last":1.385},{"interface":"front","average":{"1min":1.23,"5min":1.26,"15min":1.268},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57299999999999995},"max":{"1min":1.657,"5min":1.768,"15min":1.9239999999999999},"last":1.208}]},{"osd":7,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.91100000000000003,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.625,"5min":1.845,"15min":1.845},"last":1.26},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.379,"15min":1.403},"min":{"1min":0.89600000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.651,"5min":1.9670000000000001,"15min":2.2440000000000002},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":488584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.998,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5469999999999999,"5min":1.613,"15min":1.613},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.99399999999999999,"15min":1.0549999999999999},"min":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2549999999999999,"5min":1.7849999999999999,"15min":2.9369999999999998},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0960000000000001},"min":{"1min":0.70799999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.413,"5min":1.589,"15min":1.778},"last":1.163},{"interface":"front","average":{"1min":1.091,"5min":1.1479999999999999,"15min":1.2},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.3759999999999999,"5min":1.825,"15min":2.0329999999999999},"last":1.1930000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.0409999999999999,"15min":1.1719999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":2.9929999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0700000000000001,"15min":1.159},"min":{"1min":0.78900000000000003,"5min":0.75700000000000001,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.671,"15min":1.671},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.153,"15min":1.2749999999999999},"min":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4159999999999999,"5min":1.649,"15min":2.2410000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.2070000000000001,"15min":1.3540000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.448,"5min":1.5580000000000001,"15min":3.0350000000000001},"last":1.4930000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.202,"15min":1.28},"min":{"1min":0.88200000000000001,"5min":0.76900000000000002,"15min":0.67100000000000004},"max":{"1min":1.589,"5min":1.851,"15min":2.0819999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2849999999999999,"15min":1.3859999999999999},"min":{"1min":0.78600000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.657,"5min":1.7370000000000001,"15min":3.2589999999999999},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.214,"15min":1.381},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":2.2909999999999999,"15min":3.3010000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.254,"15min":1.341},"min":{"1min":0.94399999999999995,"5min":0.91300000000000003,"15min":0.84799999999999998},"max":{"1min":1.5449999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":1.224}]},{"osd":7,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3149999999999999,"15min":1.4810000000000001},"min":{"1min":1.0589999999999999,"5min":0.96799999999999997,"15min":0.72299999999999998},"max":{"1min":1.7569999999999999,"5min":1.992,"15min":3.1099999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.331,"15min":1.5700000000000001},"min":{"1min":0.98099999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"max":{"1min":1.673,"5min":1.952,"15min":3.5680000000000001},"last":1.375}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":1048576,"data_stored":490218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0880000000000001,"15min":1.2190000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.518,"5min":2.7069999999999999,"15min":5.4420000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2849999999999999},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5309999999999999,"5min":4.5019999999999998,"15min":5.5049999999999999},"last":1.393}]},{"osd":1,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.2250000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5920000000000001,"5min":1.8180000000000001,"15min":4.6379999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.103,"15min":1.196},"min":{"1min":0.79500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.361,"5min":3.137,"15min":3.254},"last":1.1850000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1180000000000001,"15min":1.2649999999999999},"min":{"1min":0.69499999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.623,"5min":2.3090000000000002,"15min":4.593},"last":1.512},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1220000000000001,"15min":1.2350000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5389999999999999,"5min":1.978,"15min":2.3799999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.091,"15min":1.254},"min":{"1min":0.73899999999999999,"5min":0.71199999999999997,"15min":0.49199999999999999},"max":{"1min":1.7789999999999999,"5min":2.4750000000000001,"15min":5.4610000000000003},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2509999999999999,"15min":1.375},"min":{"1min":0.90100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5840000000000001,"5min":5.633,"15min":5.633},"last":1.458}]},{"osd":5,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2110000000000001,"15min":1.2190000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.6559999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.875},{"interface":"front","average":{"1min":1.113,"5min":1.1830000000000001,"15min":1.1659999999999999},"min":{"1min":0.81299999999999994,"5min":0.71199999999999997,"15min":0.63800000000000001},"max":{"1min":1.4650000000000001,"5min":2.1190000000000002,"15min":2.157},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2629999999999999,"15min":1.2569999999999999},"min":{"1min":0.81100000000000005,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.579,"5min":2.915,"15min":2.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4039999999999999,"15min":1.415},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.835,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.28}]},{"osd":7,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.91800000000000004,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.875,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.373},"min":{"1min":1.0589999999999999,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":1.3460000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":489132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82699999999999996,"15min":0.90300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.37},"max":{"1min":1.508,"5min":1.6599999999999999,"15min":1.825},"last":0.628},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.80500000000000005,"15min":0.94699999999999995},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.72899999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.85899999999999999,"15min":0.91100000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.167,"5min":1.46,"15min":1.54},"last":1.107},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0029999999999999,"15min":1.044},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3120000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.038,"15min":1.1020000000000001},"min":{"1min":0.71399999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.679,"5min":1.679,"15min":2.177},"last":1},{"interface":"front","average":{"1min":1.173,"5min":1.1299999999999999,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.64900000000000002,"15min":0.58899999999999997},"max":{"1min":1.49,"5min":1.629,"15min":1.8520000000000001},"last":1.3640000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1279999999999999,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.492,"5min":1.8109999999999999,"15min":2.234},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.3100000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":2.4350000000000001},"last":1.4450000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3080000000000001,"15min":1.395},"min":{"1min":0.92300000000000004,"5min":0.88100000000000001,"15min":0.80200000000000005},"max":{"1min":2.052,"5min":2.052,"15min":2.5419999999999998},"last":1.421},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.224,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":2.754},"last":1.206}]},{"osd":6,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3100000000000001,"15min":1.4019999999999999},"min":{"1min":0.96399999999999997,"5min":0.93899999999999995,"15min":0.78000000000000003},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6880000000000002},"last":1.286},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.4650000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.94699999999999995},"max":{"1min":2.274,"5min":2.274,"15min":2.6429999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2809999999999999,"15min":1.429},"min":{"1min":0.80900000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8580000000000001,"5min":2.0819999999999999,"15min":3.02},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4139999999999999,"15min":1.488},"min":{"1min":1.109,"5min":0.96299999999999997,"15min":0.83099999999999996},"max":{"1min":2.323,"5min":2.323,"15min":2.8170000000000002},"last":1.3839999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":489292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83799999999999997,"15min":1.2410000000000001},"min":{"1min":0.497,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4259999999999999,"5min":1.8069999999999999,"15min":13.32},"last":1.258},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.88400000000000001,"15min":1.357},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.383,"5min":1.734,"15min":13.206},"last":1.3100000000000001}]},{"osd":1,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.56599999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4490000000000001,"5min":1.841,"15min":1.841},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.90400000000000003,"15min":0.98299999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.121,"5min":1.492,"15min":1.948},"last":1.6759999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.877,"15min":0.94799999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.569,"5min":1.708,"15min":1.79},"last":1.417},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.198},"min":{"1min":0.63100000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.6040000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.76}]},{"osd":4,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2350000000000001,"15min":1.24},"min":{"1min":0.96899999999999997,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.5289999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.373},{"interface":"front","average":{"1min":1.113,"5min":1.177,"15min":1.272},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.5489999999999999,"5min":1.9139999999999999,"15min":2.024},"last":1.1259999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2749999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4450000000000001,"5min":1.849,"15min":4.0659999999999998},"last":1.512},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.304,"15min":1.444},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.7290000000000001,"5min":2.1230000000000002,"15min":3.7160000000000002},"last":1.6180000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2549999999999999,"15min":1.3879999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.593,"5min":2.0489999999999999,"15min":2.081},"last":1.468},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.26,"15min":1.339},"min":{"1min":0.91500000000000004,"5min":0.872,"15min":0.872},"max":{"1min":1.6140000000000001,"5min":1.972,"15min":2.1379999999999999},"last":1.5589999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3,"15min":1.4370000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.569,"5min":2.0169999999999999,"15min":2.363},"last":1.583},{"interface":"front","average":{"1min":1.24,"5min":1.3169999999999999,"15min":1.3879999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.728,"5min":2.0489999999999999,"15min":2.1629999999999998},"last":1.7130000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":1036288,"data_stored":488662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.94799999999999995},"min":{"1min":0.497,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1930000000000001,"5min":1.9159999999999999,"15min":1.931},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.74299999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0469999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80100000000000005,"15min":0.99099999999999999},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.2789999999999999,"5min":1.353,"15min":2.0590000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":1.135},"min":{"1min":0.65400000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.27,"5min":1.3899999999999999,"15min":3.4199999999999999},"last":1.01}]},{"osd":3,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.054,"15min":1.258},"min":{"1min":0.69899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.401,"5min":1.6160000000000001,"15min":3.4950000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97199999999999998,"15min":1.1799999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.55,"5min":1.6100000000000001,"15min":4.2030000000000003},"last":1.165}]},{"osd":4,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2609999999999999,"15min":1.4039999999999999},"min":{"1min":1.069,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6020000000000001,"5min":1.7050000000000001,"15min":4.3869999999999996},"last":1.397},{"interface":"front","average":{"1min":1.226,"5min":1.1830000000000001,"15min":1.375},"min":{"1min":0.95599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":2.6960000000000002},"last":1.365}]},{"osd":5,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.165,"15min":1.373},"min":{"1min":0.874,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":2.9249999999999998},"last":1.306},{"interface":"front","average":{"1min":1.258,"5min":1.2470000000000001,"15min":1.502},"min":{"1min":0.83299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6499999999999999,"5min":1.6679999999999999,"15min":3.8420000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.325,"15min":1.5469999999999999},"min":{"1min":1.107,"5min":0.95299999999999996,"15min":0.92600000000000005},"max":{"1min":1.6459999999999999,"5min":2.0529999999999999,"15min":4.5780000000000003},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3120000000000001,"15min":1.5620000000000001},"min":{"1min":0.97899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.73,"5min":2.0070000000000001,"15min":3.214},"last":1.1930000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3360000000000001,"15min":1.623},"min":{"1min":1.0580000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.619,"5min":1.7809999999999999,"15min":4.0910000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3300000000000001,"15min":1.542},"min":{"1min":0.88,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6819999999999999,"5min":1.8360000000000001,"15min":4.6390000000000002},"last":1.272}]}]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1617920,"data_stored":1077899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83799999999999997,"15min":1.0049999999999999},"min":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.107,"5min":1.4039999999999999,"15min":2.2250000000000001},"last":1.53},{"interface":"front","average":{"1min":0.877,"5min":0.92800000000000005,"15min":1.173},"min":{"1min":0.505,"5min":0.499,"15min":0.499},"max":{"1min":1.175,"5min":1.448,"15min":2.3599999999999999},"last":1.73}]},{"osd":2,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86499999999999999,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":1.2689999999999999,"5min":1.345,"15min":1.6839999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.875,"15min":0.97599999999999998},"min":{"1min":0.497,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.069,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.214}]},{"osd":3,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.876,"15min":1.0429999999999999},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.2869999999999999,"5min":1.5700000000000001,"15min":3.4399999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.093,"15min":1.258},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.363,"5min":1.724,"15min":2.5369999999999999},"last":1.7889999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2410000000000001,"15min":1.3660000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3620000000000001,"5min":1.6739999999999999,"15min":1.78},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.204,"15min":1.3919999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.472,"5min":1.944,"15min":2.7799999999999998},"last":1.6160000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1339999999999999,"15min":1.2949999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4119999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2110000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.536,"5min":1.784,"15min":2.0030000000000001},"last":1.879}]},{"osd":6,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.27,"15min":1.4350000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.659,"5min":2.04,"15min":2.1000000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2789999999999999,"15min":1.45},"min":{"1min":0.93500000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.615,"5min":1.984,"15min":2.3889999999999998},"last":1.446}]},{"osd":7,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2949999999999999,"15min":1.613},"min":{"1min":0.96799999999999997,"5min":0.95299999999999996,"15min":0.84299999999999997},"max":{"1min":1.6830000000000001,"5min":1.8600000000000001,"15min":4.9400000000000004},"last":1.585},{"interface":"front","average":{"1min":1.21,"5min":1.27,"15min":1.573},"min":{"1min":0.97099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.48,"5min":2.1339999999999999,"15min":4.8250000000000002},"last":1.696}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:59:44.771 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T17:59:44.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.989+0000 7fcf91698700 1 Processor -- start 2023-12-19T17:59:44.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.989+0000 7fcf91698700 1 -- start start 2023-12-19T17:59:44.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf91698700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcf8c1591b0 0x7fcf8c06ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf91698700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 0x7fcf8c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf91698700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c0c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf91698700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c0cadb0 con 0x7fcf8c159590 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf91698700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8c0c4ae0 con 0x7fcf8c1591b0 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf91698700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c0ca7f0 con 0x7fcf8c0c4120 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf837fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 0x7fcf8c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf837fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 0x7fcf8c0c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34964/0 (socket says 172.21.15.45:34964) 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf837fe700 1 -- 172.21.15.45:0/2414030328 learned_addr learned my addr 172.21.15.45:0/2414030328 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2414030328 >> v2:172.21.15.73:3300/0 conn(0x7fcf8c1591b0 0x7fcf8c06ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf90e97700 1 --2- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c0c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 -- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 msgr2=0x7fcf8c0c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c0c45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 -- 172.21.15.45:0/2414030328 >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 msgr2=0x7fcf8c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2414030328 >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 0x7fcf8c0c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 -- 172.21.15.45:0/2414030328 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c0caad0 con 0x7fcf8c1591b0 2023-12-19T17:59:45.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf837fe700 1 --2- 172.21.15.45:0/2414030328 >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 0x7fcf8c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:45.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.993+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c06ea90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c06ae40 tx=0x7fcf7c009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f007c5bc5c726656 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf8b7fe700 1 -- 172.21.15.45:0/2414030328 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c011830 con 0x7fcf8c1591b0 2023-12-19T17:59:45.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf8b7fe700 1 -- 172.21.15.45:0/2414030328 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c011990 con 0x7fcf8c1591b0 2023-12-19T17:59:45.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf8b7fe700 1 -- 172.21.15.45:0/2414030328 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c011d20 con 0x7fcf8c1591b0 2023-12-19T17:59:45.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 -- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 msgr2=0x7fcf8c06ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 --2- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c06ea90 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c06ae40 tx=0x7fcf7c009b30 comp rx=0 tx=0).stop 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 -- 172.21.15.45:0/2414030328 shutdown_connections 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 --2- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c0c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 --2- 172.21.15.45:0/2414030328 >> v2:172.21.15.45:3300/0 conn(0x7fcf8c159590 0x7fcf8c0c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 --2- 172.21.15.45:0/2414030328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c06ea90 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 -- 172.21.15.45:0/2414030328 >> 172.21.15.45:0/2414030328 conn(0x7fcf8c0cb900 msgr2=0x7fcf8c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 -- 172.21.15.45:0/2414030328 shutdown_connections 2023-12-19T17:59:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:44.997+0000 7fcf91698700 1 -- 172.21.15.45:0/2414030328 wait complete. 2023-12-19T17:59:45.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 Processor -- start 2023-12-19T17:59:45.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 -- start start 2023-12-19T17:59:45.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 0x7fcf8c15bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c14a570 con 0x7fcf8c071aa0 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c14a850 con 0x7fcf8c1591b0 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf91698700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c14ab30 con 0x7fcf8c0c4120 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 0x7fcf8c15bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 0x7fcf8c15bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34976/0 (socket says 172.21.15.45:34976) 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 -- 172.21.15.45:0/2573860580 learned_addr learned my addr 172.21.15.45:0/2573860580 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf837fe700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 -- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 msgr2=0x7fcf8c14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 -- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 msgr2=0x7fcf8c071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf90e97700 1 -- 172.21.15.45:0/2573860580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf74009570 con 0x7fcf8c071aa0 2023-12-19T17:59:45.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.001+0000 7fcf837fe700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf90e97700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 0x7fcf8c15bb50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcf84007e40 tx=0x7fcf8400e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8400ede0 con 0x7fcf8c071aa0 2023-12-19T17:59:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf84014420 con 0x7fcf8c071aa0 2023-12-19T17:59:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf840147d0 con 0x7fcf8c071aa0 2023-12-19T17:59:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c0094b0 con 0x7fcf8c071aa0 2023-12-19T17:59:45.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf8c14b0f0 con 0x7fcf8c071aa0 2023-12-19T17:59:45.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.005+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8c14b310 con 0x7fcf8c071aa0 2023-12-19T17:59:45.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.009+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcf84014930 con 0x7fcf8c071aa0 2023-12-19T17:59:45.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.009+0000 7fcf897fa700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf6c065ad0 0x7fcf6c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.009+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf84083b80 con 0x7fcf8c071aa0 2023-12-19T17:59:45.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.009+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf6c065ad0 0x7fcf6c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.009+0000 7fcf8bfff700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf6c065ad0 0x7fcf6c067f90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c000c00 tx=0x7fcf7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.017+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcf840512d0 con 0x7fcf8c071aa0 2023-12-19T17:59:45.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.189+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcf8c14a9c0 con 0x7fcf6c065ad0 2023-12-19T17:59:45.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.205+0000 7fcf897fa700 1 -- 172.21.15.45:0/2573860580 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286475 (secure 0 0 0) 0x7fcf8c14a9c0 con 0x7fcf6c065ad0 2023-12-19T17:59:45.214 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf6c065ad0 msgr2=0x7fcf6c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf6c065ad0 0x7fcf6c067f90 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c000c00 tx=0x7fcf7c008030 comp rx=0 tx=0).stop 2023-12-19T17:59:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 msgr2=0x7fcf8c15bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 0x7fcf8c15bb50 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fcf84007e40 tx=0x7fcf8400e3c0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 shutdown_connections 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcf6c065ad0 0x7fcf6c067f90 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcf8c071aa0 0x7fcf8c15bb50 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcf8c1591b0 0x7fcf8c071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 --2- 172.21.15.45:0/2573860580 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcf8c0c4120 0x7fcf8c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 >> 172.21.15.45:0/2573860580 conn(0x7fcf8c0cb900 msgr2=0x7fcf8c0b34b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 shutdown_connections 2023-12-19T17:59:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.213+0000 7fcf91698700 1 -- 172.21.15.45:0/2573860580 wait complete. 2023-12-19T17:59:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T17:59:45.241 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2023-12-19T17:59:44.376970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":257636,"kb_used_data":9252,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754717084,"statfs":{"total":773094113280,"available":772830294016,"internally_reserved":0,"allocated":9474048,"data_stored":5092841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.541532"},"pg_stats":[{"pgid":"12.3f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396096+0000","last_change":"2023-12-19T17:59:40.388750+0000","last_active":"2023-12-19T17:59:40.396096+0000","last_peered":"2023-12-19T17:59:40.396096+0000","last_clean":"2023-12-19T17:59:40.396096+0000","last_became_active":"2023-12-19T17:59:40.388493+0000","last_became_peered":"2023-12-19T17:59:40.388493+0000","last_unstale":"2023-12-19T17:59:40.396096+0000","last_undegraded":"2023-12-19T17:59:40.396096+0000","last_fullsized":"2023-12-19T17:59:40.396096+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:15:42.069671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.383068+0000","last_change":"2023-12-19T17:59:40.376012+0000","last_active":"2023-12-19T17:59:40.383068+0000","last_peered":"2023-12-19T17:59:40.383068+0000","last_clean":"2023-12-19T17:59:40.383068+0000","last_became_active":"2023-12-19T17:59:40.375679+0000","last_became_peered":"2023-12-19T17:59:40.375679+0000","last_unstale":"2023-12-19T17:59:40.383068+0000","last_undegraded":"2023-12-19T17:59:40.383068+0000","last_fullsized":"2023-12-19T17:59:40.383068+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:19:44.227566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.3d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.395314+0000","last_change":"2023-12-19T17:59:40.393539+0000","last_active":"2023-12-19T17:59:40.395314+0000","last_peered":"2023-12-19T17:59:40.395314+0000","last_clean":"2023-12-19T17:59:40.395314+0000","last_became_active":"2023-12-19T17:59:40.393244+0000","last_became_peered":"2023-12-19T17:59:40.393244+0000","last_unstale":"2023-12-19T17:59:40.395314+0000","last_undegraded":"2023-12-19T17:59:40.395314+0000","last_fullsized":"2023-12-19T17:59:40.395314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:16.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.3c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396942+0000","last_change":"2023-12-19T17:59:40.388741+0000","last_active":"2023-12-19T17:59:40.396942+0000","last_peered":"2023-12-19T17:59:40.396942+0000","last_clean":"2023-12-19T17:59:40.396942+0000","last_became_active":"2023-12-19T17:59:40.388493+0000","last_became_peered":"2023-12-19T17:59:40.388493+0000","last_unstale":"2023-12-19T17:59:40.396942+0000","last_undegraded":"2023-12-19T17:59:40.396942+0000","last_fullsized":"2023-12-19T17:59:40.396942+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:42.299574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.390312+0000","last_change":"2023-12-19T17:59:40.383947+0000","last_active":"2023-12-19T17:59:40.390312+0000","last_peered":"2023-12-19T17:59:40.390312+0000","last_clean":"2023-12-19T17:59:40.390312+0000","last_became_active":"2023-12-19T17:59:40.383683+0000","last_became_peered":"2023-12-19T17:59:40.383683+0000","last_unstale":"2023-12-19T17:59:40.390312+0000","last_undegraded":"2023-12-19T17:59:40.390312+0000","last_fullsized":"2023-12-19T17:59:40.390312+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:32:14.527650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.3a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397504+0000","last_change":"2023-12-19T17:59:40.395462+0000","last_active":"2023-12-19T17:59:40.397504+0000","last_peered":"2023-12-19T17:59:40.397504+0000","last_clean":"2023-12-19T17:59:40.397504+0000","last_became_active":"2023-12-19T17:59:40.395214+0000","last_became_peered":"2023-12-19T17:59:40.395214+0000","last_unstale":"2023-12-19T17:59:40.397504+0000","last_undegraded":"2023-12-19T17:59:40.397504+0000","last_fullsized":"2023-12-19T17:59:40.397504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:28:50.823382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.39","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.405449+0000","last_change":"2023-12-19T17:59:40.399742+0000","last_active":"2023-12-19T17:59:40.405449+0000","last_peered":"2023-12-19T17:59:40.405449+0000","last_clean":"2023-12-19T17:59:40.405449+0000","last_became_active":"2023-12-19T17:59:40.399495+0000","last_became_peered":"2023-12-19T17:59:40.399495+0000","last_unstale":"2023-12-19T17:59:40.405449+0000","last_undegraded":"2023-12-19T17:59:40.405449+0000","last_fullsized":"2023-12-19T17:59:40.405449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:36.593410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.38","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392664+0000","last_change":"2023-12-19T17:59:40.384599+0000","last_active":"2023-12-19T17:59:40.392664+0000","last_peered":"2023-12-19T17:59:40.392664+0000","last_clean":"2023-12-19T17:59:40.392664+0000","last_became_active":"2023-12-19T17:59:40.384313+0000","last_became_peered":"2023-12-19T17:59:40.384313+0000","last_unstale":"2023-12-19T17:59:40.392664+0000","last_undegraded":"2023-12-19T17:59:40.392664+0000","last_fullsized":"2023-12-19T17:59:40.392664+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:58.487747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.37","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397176+0000","last_change":"2023-12-19T17:59:40.390238+0000","last_active":"2023-12-19T17:59:40.397176+0000","last_peered":"2023-12-19T17:59:40.397176+0000","last_clean":"2023-12-19T17:59:40.397176+0000","last_became_active":"2023-12-19T17:59:40.388811+0000","last_became_peered":"2023-12-19T17:59:40.388811+0000","last_unstale":"2023-12-19T17:59:40.397176+0000","last_undegraded":"2023-12-19T17:59:40.397176+0000","last_fullsized":"2023-12-19T17:59:40.397176+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:27.419842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.36","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397007+0000","last_change":"2023-12-19T17:59:40.391922+0000","last_active":"2023-12-19T17:59:40.397007+0000","last_peered":"2023-12-19T17:59:40.397007+0000","last_clean":"2023-12-19T17:59:40.397007+0000","last_became_active":"2023-12-19T17:59:40.391678+0000","last_became_peered":"2023-12-19T17:59:40.391678+0000","last_unstale":"2023-12-19T17:59:40.397007+0000","last_undegraded":"2023-12-19T17:59:40.397007+0000","last_fullsized":"2023-12-19T17:59:40.397007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:03:33.757704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.35","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394841+0000","last_change":"2023-12-19T17:59:40.391199+0000","last_active":"2023-12-19T17:59:40.394841+0000","last_peered":"2023-12-19T17:59:40.394841+0000","last_clean":"2023-12-19T17:59:40.394841+0000","last_became_active":"2023-12-19T17:59:40.389295+0000","last_became_peered":"2023-12-19T17:59:40.389295+0000","last_unstale":"2023-12-19T17:59:40.394841+0000","last_undegraded":"2023-12-19T17:59:40.394841+0000","last_fullsized":"2023-12-19T17:59:40.394841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:50.551334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.34","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.378712+0000","last_change":"2023-12-19T17:59:40.374616+0000","last_active":"2023-12-19T17:59:40.378712+0000","last_peered":"2023-12-19T17:59:40.378712+0000","last_clean":"2023-12-19T17:59:40.378712+0000","last_became_active":"2023-12-19T17:59:40.374313+0000","last_became_peered":"2023-12-19T17:59:40.374313+0000","last_unstale":"2023-12-19T17:59:40.378712+0000","last_undegraded":"2023-12-19T17:59:40.378712+0000","last_fullsized":"2023-12-19T17:59:40.378712+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:04:02.610354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.33","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392717+0000","last_change":"2023-12-19T17:59:40.385488+0000","last_active":"2023-12-19T17:59:40.392717+0000","last_peered":"2023-12-19T17:59:40.392717+0000","last_clean":"2023-12-19T17:59:40.392717+0000","last_became_active":"2023-12-19T17:59:40.382871+0000","last_became_peered":"2023-12-19T17:59:40.382871+0000","last_unstale":"2023-12-19T17:59:40.392717+0000","last_undegraded":"2023-12-19T17:59:40.392717+0000","last_fullsized":"2023-12-19T17:59:40.392717+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:51.449041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.32","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397521+0000","last_change":"2023-12-19T17:59:40.395902+0000","last_active":"2023-12-19T17:59:40.397521+0000","last_peered":"2023-12-19T17:59:40.397521+0000","last_clean":"2023-12-19T17:59:40.397521+0000","last_became_active":"2023-12-19T17:59:40.395598+0000","last_became_peered":"2023-12-19T17:59:40.395598+0000","last_unstale":"2023-12-19T17:59:40.397521+0000","last_undegraded":"2023-12-19T17:59:40.397521+0000","last_fullsized":"2023-12-19T17:59:40.397521+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:50:01.931002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.31","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.387168+0000","last_change":"2023-12-19T17:59:40.378956+0000","last_active":"2023-12-19T17:59:40.387168+0000","last_peered":"2023-12-19T17:59:40.387168+0000","last_clean":"2023-12-19T17:59:40.387168+0000","last_became_active":"2023-12-19T17:59:40.378337+0000","last_became_peered":"2023-12-19T17:59:40.378337+0000","last_unstale":"2023-12-19T17:59:40.387168+0000","last_undegraded":"2023-12-19T17:59:40.387168+0000","last_fullsized":"2023-12-19T17:59:40.387168+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:23:44.760420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.30","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.393221+0000","last_change":"2023-12-19T17:59:40.383953+0000","last_active":"2023-12-19T17:59:40.393221+0000","last_peered":"2023-12-19T17:59:40.393221+0000","last_clean":"2023-12-19T17:59:40.393221+0000","last_became_active":"2023-12-19T17:59:40.379412+0000","last_became_peered":"2023-12-19T17:59:40.379412+0000","last_unstale":"2023-12-19T17:59:40.393221+0000","last_undegraded":"2023-12-19T17:59:40.393221+0000","last_fullsized":"2023-12-19T17:59:40.393221+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:11.813072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.2f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397631+0000","last_change":"2023-12-19T17:59:40.394217+0000","last_active":"2023-12-19T17:59:40.397631+0000","last_peered":"2023-12-19T17:59:40.397631+0000","last_clean":"2023-12-19T17:59:40.397631+0000","last_became_active":"2023-12-19T17:59:40.393958+0000","last_became_peered":"2023-12-19T17:59:40.393958+0000","last_unstale":"2023-12-19T17:59:40.397631+0000","last_undegraded":"2023-12-19T17:59:40.397631+0000","last_fullsized":"2023-12-19T17:59:40.397631+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:05.556313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.398537+0000","last_change":"2023-12-19T17:59:40.395889+0000","last_active":"2023-12-19T17:59:40.398537+0000","last_peered":"2023-12-19T17:59:40.398537+0000","last_clean":"2023-12-19T17:59:40.398537+0000","last_became_active":"2023-12-19T17:59:40.395561+0000","last_became_peered":"2023-12-19T17:59:40.395561+0000","last_unstale":"2023-12-19T17:59:40.398537+0000","last_undegraded":"2023-12-19T17:59:40.398537+0000","last_fullsized":"2023-12-19T17:59:40.398537+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:23.018554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.2d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392085+0000","last_change":"2023-12-19T17:59:40.386978+0000","last_active":"2023-12-19T17:59:40.392085+0000","last_peered":"2023-12-19T17:59:40.392085+0000","last_clean":"2023-12-19T17:59:40.392085+0000","last_became_active":"2023-12-19T17:59:40.386563+0000","last_became_peered":"2023-12-19T17:59:40.386563+0000","last_unstale":"2023-12-19T17:59:40.392085+0000","last_undegraded":"2023-12-19T17:59:40.392085+0000","last_fullsized":"2023-12-19T17:59:40.392085+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:43:25.670298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.2c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388619+0000","last_change":"2023-12-19T17:59:40.376106+0000","last_active":"2023-12-19T17:59:40.388619+0000","last_peered":"2023-12-19T17:59:40.388619+0000","last_clean":"2023-12-19T17:59:40.388619+0000","last_became_active":"2023-12-19T17:59:40.375798+0000","last_became_peered":"2023-12-19T17:59:40.375798+0000","last_unstale":"2023-12-19T17:59:40.388619+0000","last_undegraded":"2023-12-19T17:59:40.388619+0000","last_fullsized":"2023-12-19T17:59:40.388619+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:06.018981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.2b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.401343+0000","last_change":"2023-12-19T17:59:40.396065+0000","last_active":"2023-12-19T17:59:40.401343+0000","last_peered":"2023-12-19T17:59:40.401343+0000","last_clean":"2023-12-19T17:59:40.401343+0000","last_became_active":"2023-12-19T17:59:40.392467+0000","last_became_peered":"2023-12-19T17:59:40.392467+0000","last_unstale":"2023-12-19T17:59:40.401343+0000","last_undegraded":"2023-12-19T17:59:40.401343+0000","last_fullsized":"2023-12-19T17:59:40.401343+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:23.018554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.2a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392759+0000","last_change":"2023-12-19T17:59:40.385959+0000","last_active":"2023-12-19T17:59:40.392759+0000","last_peered":"2023-12-19T17:59:40.392759+0000","last_clean":"2023-12-19T17:59:40.392759+0000","last_became_active":"2023-12-19T17:59:40.385692+0000","last_became_peered":"2023-12-19T17:59:40.385692+0000","last_unstale":"2023-12-19T17:59:40.392759+0000","last_undegraded":"2023-12-19T17:59:40.392759+0000","last_fullsized":"2023-12-19T17:59:40.392759+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:20:23.160479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.29","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399311+0000","last_change":"2023-12-19T17:59:40.393605+0000","last_active":"2023-12-19T17:59:40.399311+0000","last_peered":"2023-12-19T17:59:40.399311+0000","last_clean":"2023-12-19T17:59:40.399311+0000","last_became_active":"2023-12-19T17:59:40.392598+0000","last_became_peered":"2023-12-19T17:59:40.392598+0000","last_unstale":"2023-12-19T17:59:40.399311+0000","last_undegraded":"2023-12-19T17:59:40.399311+0000","last_fullsized":"2023-12-19T17:59:40.399311+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:35.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.28","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382925+0000","last_change":"2023-12-19T17:59:40.376507+0000","last_active":"2023-12-19T17:59:40.382925+0000","last_peered":"2023-12-19T17:59:40.382925+0000","last_clean":"2023-12-19T17:59:40.382925+0000","last_became_active":"2023-12-19T17:59:40.376218+0000","last_became_peered":"2023-12-19T17:59:40.376218+0000","last_unstale":"2023-12-19T17:59:40.382925+0000","last_undegraded":"2023-12-19T17:59:40.382925+0000","last_fullsized":"2023-12-19T17:59:40.382925+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:25:49.882091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.27","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.381487+0000","last_change":"2023-12-19T17:59:40.371691+0000","last_active":"2023-12-19T17:59:40.381487+0000","last_peered":"2023-12-19T17:59:40.381487+0000","last_clean":"2023-12-19T17:59:40.381487+0000","last_became_active":"2023-12-19T17:59:40.371325+0000","last_became_peered":"2023-12-19T17:59:40.371325+0000","last_unstale":"2023-12-19T17:59:40.381487+0000","last_undegraded":"2023-12-19T17:59:40.381487+0000","last_fullsized":"2023-12-19T17:59:40.381487+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:13.197183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.26","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389686+0000","last_change":"2023-12-19T17:59:40.383693+0000","last_active":"2023-12-19T17:59:40.389686+0000","last_peered":"2023-12-19T17:59:40.389686+0000","last_clean":"2023-12-19T17:59:40.389686+0000","last_became_active":"2023-12-19T17:59:40.383427+0000","last_became_peered":"2023-12-19T17:59:40.383427+0000","last_unstale":"2023-12-19T17:59:40.389686+0000","last_undegraded":"2023-12-19T17:59:40.389686+0000","last_fullsized":"2023-12-19T17:59:40.389686+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:26.241603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.25","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.391463+0000","last_change":"2023-12-19T17:59:40.384517+0000","last_active":"2023-12-19T17:59:40.391463+0000","last_peered":"2023-12-19T17:59:40.391463+0000","last_clean":"2023-12-19T17:59:40.391463+0000","last_became_active":"2023-12-19T17:59:40.383180+0000","last_became_peered":"2023-12-19T17:59:40.383180+0000","last_unstale":"2023-12-19T17:59:40.391463+0000","last_undegraded":"2023-12-19T17:59:40.391463+0000","last_fullsized":"2023-12-19T17:59:40.391463+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:45:13.776055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.24","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389459+0000","last_change":"2023-12-19T17:59:40.376753+0000","last_active":"2023-12-19T17:59:40.389459+0000","last_peered":"2023-12-19T17:59:40.389459+0000","last_clean":"2023-12-19T17:59:40.389459+0000","last_became_active":"2023-12-19T17:59:40.376508+0000","last_became_peered":"2023-12-19T17:59:40.376508+0000","last_unstale":"2023-12-19T17:59:40.389459+0000","last_undegraded":"2023-12-19T17:59:40.389459+0000","last_fullsized":"2023-12-19T17:59:40.389459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:11:26.166996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.23","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397024+0000","last_change":"2023-12-19T17:59:40.392744+0000","last_active":"2023-12-19T17:59:40.397024+0000","last_peered":"2023-12-19T17:59:40.397024+0000","last_clean":"2023-12-19T17:59:40.397024+0000","last_became_active":"2023-12-19T17:59:40.392433+0000","last_became_peered":"2023-12-19T17:59:40.392433+0000","last_unstale":"2023-12-19T17:59:40.397024+0000","last_undegraded":"2023-12-19T17:59:40.397024+0000","last_fullsized":"2023-12-19T17:59:40.397024+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:48.841267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.22","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392821+0000","last_change":"2023-12-19T17:59:40.386911+0000","last_active":"2023-12-19T17:59:40.392821+0000","last_peered":"2023-12-19T17:59:40.392821+0000","last_clean":"2023-12-19T17:59:40.392821+0000","last_became_active":"2023-12-19T17:59:40.386547+0000","last_became_peered":"2023-12-19T17:59:40.386547+0000","last_unstale":"2023-12-19T17:59:40.392821+0000","last_undegraded":"2023-12-19T17:59:40.392821+0000","last_fullsized":"2023-12-19T17:59:40.392821+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:03:33.757704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.21","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394599+0000","last_change":"2023-12-19T17:59:40.391918+0000","last_active":"2023-12-19T17:59:40.394599+0000","last_peered":"2023-12-19T17:59:40.394599+0000","last_clean":"2023-12-19T17:59:40.394599+0000","last_became_active":"2023-12-19T17:59:40.390890+0000","last_became_peered":"2023-12-19T17:59:40.390890+0000","last_unstale":"2023-12-19T17:59:40.394599+0000","last_undegraded":"2023-12-19T17:59:40.394599+0000","last_fullsized":"2023-12-19T17:59:40.394599+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:40.135307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.20","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399074+0000","last_change":"2023-12-19T17:59:40.393117+0000","last_active":"2023-12-19T17:59:40.399074+0000","last_peered":"2023-12-19T17:59:40.399074+0000","last_clean":"2023-12-19T17:59:40.399074+0000","last_became_active":"2023-12-19T17:59:40.390135+0000","last_became_peered":"2023-12-19T17:59:40.390135+0000","last_unstale":"2023-12-19T17:59:40.399074+0000","last_undegraded":"2023-12-19T17:59:40.399074+0000","last_fullsized":"2023-12-19T17:59:40.399074+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:55:42.299574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388719+0000","last_change":"2023-12-19T17:59:40.386680+0000","last_active":"2023-12-19T17:59:40.388719+0000","last_peered":"2023-12-19T17:59:40.388719+0000","last_clean":"2023-12-19T17:59:40.388719+0000","last_became_active":"2023-12-19T17:59:40.386409+0000","last_became_peered":"2023-12-19T17:59:40.386409+0000","last_unstale":"2023-12-19T17:59:40.388719+0000","last_undegraded":"2023-12-19T17:59:40.388719+0000","last_fullsized":"2023-12-19T17:59:40.388719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:45.624810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1f","version":"84'4","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396509+0000","last_change":"2023-12-19T17:59:39.880813+0000","last_active":"2023-12-19T17:59:40.396509+0000","last_peered":"2023-12-19T17:59:40.396509+0000","last_clean":"2023-12-19T17:59:40.396509+0000","last_became_active":"2023-12-19T17:59:39.880560+0000","last_became_peered":"2023-12-19T17:59:39.880560+0000","last_unstale":"2023-12-19T17:59:40.396509+0000","last_undegraded":"2023-12-19T17:59:40.396509+0000","last_fullsized":"2023-12-19T17:59:40.396509+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:48.693733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.387187+0000","last_change":"2023-12-19T17:59:40.379142+0000","last_active":"2023-12-19T17:59:40.387187+0000","last_peered":"2023-12-19T17:59:40.387187+0000","last_clean":"2023-12-19T17:59:40.387187+0000","last_became_active":"2023-12-19T17:59:40.378712+0000","last_became_peered":"2023-12-19T17:59:40.378712+0000","last_unstale":"2023-12-19T17:59:40.387187+0000","last_undegraded":"2023-12-19T17:59:40.387187+0000","last_fullsized":"2023-12-19T17:59:40.387187+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:38:15.008268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1e","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394711+0000","last_change":"2023-12-19T17:59:39.882852+0000","last_active":"2023-12-19T17:59:40.394711+0000","last_peered":"2023-12-19T17:59:40.394711+0000","last_clean":"2023-12-19T17:59:40.394711+0000","last_became_active":"2023-12-19T17:59:39.882567+0000","last_became_peered":"2023-12-19T17:59:39.882567+0000","last_unstale":"2023-12-19T17:59:40.394711+0000","last_undegraded":"2023-12-19T17:59:40.394711+0000","last_fullsized":"2023-12-19T17:59:40.394711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:26.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399979+0000","last_change":"2023-12-19T17:59:40.396924+0000","last_active":"2023-12-19T17:59:40.399979+0000","last_peered":"2023-12-19T17:59:40.399979+0000","last_clean":"2023-12-19T17:59:40.399979+0000","last_became_active":"2023-12-19T17:59:40.395210+0000","last_became_peered":"2023-12-19T17:59:40.395210+0000","last_unstale":"2023-12-19T17:59:40.399979+0000","last_undegraded":"2023-12-19T17:59:40.399979+0000","last_fullsized":"2023-12-19T17:59:40.399979+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:13.070675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.396380+0000","last_change":"2023-12-19T17:59:39.879088+0000","last_active":"2023-12-19T17:59:40.396380+0000","last_peered":"2023-12-19T17:59:40.396380+0000","last_clean":"2023-12-19T17:59:40.396380+0000","last_became_active":"2023-12-19T17:59:39.878444+0000","last_became_peered":"2023-12-19T17:59:39.878444+0000","last_unstale":"2023-12-19T17:59:40.396380+0000","last_undegraded":"2023-12-19T17:59:40.396380+0000","last_fullsized":"2023-12-19T17:59:40.396380+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:12.058751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.401361+0000","last_change":"2023-12-19T17:59:40.396311+0000","last_active":"2023-12-19T17:59:40.401361+0000","last_peered":"2023-12-19T17:59:40.401361+0000","last_clean":"2023-12-19T17:59:40.401361+0000","last_became_active":"2023-12-19T17:59:40.392770+0000","last_became_peered":"2023-12-19T17:59:40.392770+0000","last_unstale":"2023-12-19T17:59:40.401361+0000","last_undegraded":"2023-12-19T17:59:40.401361+0000","last_fullsized":"2023-12-19T17:59:40.401361+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:16.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1c","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.400370+0000","last_change":"2023-12-19T17:59:39.879646+0000","last_active":"2023-12-19T17:59:40.400370+0000","last_peered":"2023-12-19T17:59:40.400370+0000","last_clean":"2023-12-19T17:59:40.400370+0000","last_became_active":"2023-12-19T17:59:39.879355+0000","last_became_peered":"2023-12-19T17:59:39.879355+0000","last_unstale":"2023-12-19T17:59:40.400370+0000","last_undegraded":"2023-12-19T17:59:40.400370+0000","last_fullsized":"2023-12-19T17:59:40.400370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:08.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382907+0000","last_change":"2023-12-19T17:59:40.377224+0000","last_active":"2023-12-19T17:59:40.382907+0000","last_peered":"2023-12-19T17:59:40.382907+0000","last_clean":"2023-12-19T17:59:40.382907+0000","last_became_active":"2023-12-19T17:59:40.375553+0000","last_became_peered":"2023-12-19T17:59:40.375553+0000","last_unstale":"2023-12-19T17:59:40.382907+0000","last_undegraded":"2023-12-19T17:59:40.382907+0000","last_fullsized":"2023-12-19T17:59:40.382907+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:38:37.629764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1b","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392133+0000","last_change":"2023-12-19T17:59:39.879229+0000","last_active":"2023-12-19T17:59:40.392133+0000","last_peered":"2023-12-19T17:59:40.392133+0000","last_clean":"2023-12-19T17:59:40.392133+0000","last_became_active":"2023-12-19T17:59:39.878221+0000","last_became_peered":"2023-12-19T17:59:39.878221+0000","last_unstale":"2023-12-19T17:59:40.392133+0000","last_undegraded":"2023-12-19T17:59:40.392133+0000","last_fullsized":"2023-12-19T17:59:40.392133+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:38.592069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394822+0000","last_change":"2023-12-19T17:59:40.390456+0000","last_active":"2023-12-19T17:59:40.394822+0000","last_peered":"2023-12-19T17:59:40.394822+0000","last_clean":"2023-12-19T17:59:40.394822+0000","last_became_active":"2023-12-19T17:59:40.388923+0000","last_became_peered":"2023-12-19T17:59:40.388923+0000","last_unstale":"2023-12-19T17:59:40.394822+0000","last_undegraded":"2023-12-19T17:59:40.394822+0000","last_fullsized":"2023-12-19T17:59:40.394822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:58.192927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389817+0000","last_change":"2023-12-19T17:59:39.873212+0000","last_active":"2023-12-19T17:59:40.389817+0000","last_peered":"2023-12-19T17:59:40.389817+0000","last_clean":"2023-12-19T17:59:40.389817+0000","last_became_active":"2023-12-19T17:59:39.872921+0000","last_became_peered":"2023-12-19T17:59:39.872921+0000","last_unstale":"2023-12-19T17:59:40.389817+0000","last_undegraded":"2023-12-19T17:59:40.389817+0000","last_fullsized":"2023-12-19T17:59:40.389817+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:57:26.407918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.400893+0000","last_change":"2023-12-19T17:59:40.393811+0000","last_active":"2023-12-19T17:59:40.400893+0000","last_peered":"2023-12-19T17:59:40.400893+0000","last_clean":"2023-12-19T17:59:40.400893+0000","last_became_active":"2023-12-19T17:59:40.393413+0000","last_became_peered":"2023-12-19T17:59:40.393413+0000","last_unstale":"2023-12-19T17:59:40.400893+0000","last_undegraded":"2023-12-19T17:59:40.400893+0000","last_fullsized":"2023-12-19T17:59:40.400893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.627372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.360196+0000","last_change":"2023-12-19T17:59:39.873914+0000","last_active":"2023-12-19T17:59:40.360196+0000","last_peered":"2023-12-19T17:59:40.360196+0000","last_clean":"2023-12-19T17:59:40.360196+0000","last_became_active":"2023-12-19T17:59:39.873610+0000","last_became_peered":"2023-12-19T17:59:39.873610+0000","last_unstale":"2023-12-19T17:59:40.360196+0000","last_undegraded":"2023-12-19T17:59:40.360196+0000","last_fullsized":"2023-12-19T17:59:40.360196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:43:35.581486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.408608+0000","last_change":"2023-12-19T17:59:40.400643+0000","last_active":"2023-12-19T17:59:40.408608+0000","last_peered":"2023-12-19T17:59:40.408608+0000","last_clean":"2023-12-19T17:59:40.408608+0000","last_became_active":"2023-12-19T17:59:40.400401+0000","last_became_peered":"2023-12-19T17:59:40.400401+0000","last_unstale":"2023-12-19T17:59:40.408608+0000","last_undegraded":"2023-12-19T17:59:40.408608+0000","last_fullsized":"2023-12-19T17:59:40.408608+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:45.624810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.372781+0000","last_change":"2023-12-19T17:59:39.872076+0000","last_active":"2023-12-19T17:59:40.372781+0000","last_peered":"2023-12-19T17:59:40.372781+0000","last_clean":"2023-12-19T17:59:40.372781+0000","last_became_active":"2023-12-19T17:59:39.871754+0000","last_became_peered":"2023-12-19T17:59:39.871754+0000","last_unstale":"2023-12-19T17:59:40.372781+0000","last_undegraded":"2023-12-19T17:59:40.372781+0000","last_fullsized":"2023-12-19T17:59:40.372781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:24:55.938725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382909+0000","last_change":"2023-12-19T17:59:40.375692+0000","last_active":"2023-12-19T17:59:40.382909+0000","last_peered":"2023-12-19T17:59:40.382909+0000","last_clean":"2023-12-19T17:59:40.382909+0000","last_became_active":"2023-12-19T17:59:40.375326+0000","last_became_peered":"2023-12-19T17:59:40.375326+0000","last_unstale":"2023-12-19T17:59:40.382909+0000","last_undegraded":"2023-12-19T17:59:40.382909+0000","last_fullsized":"2023-12-19T17:59:40.382909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:32:59.254157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.370102+0000","last_change":"2023-12-19T17:59:39.881890+0000","last_active":"2023-12-19T17:59:40.370102+0000","last_peered":"2023-12-19T17:59:40.370102+0000","last_clean":"2023-12-19T17:59:40.370102+0000","last_became_active":"2023-12-19T17:59:39.881387+0000","last_became_peered":"2023-12-19T17:59:39.881387+0000","last_unstale":"2023-12-19T17:59:40.370102+0000","last_undegraded":"2023-12-19T17:59:40.370102+0000","last_fullsized":"2023-12-19T17:59:40.370102+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:34.741145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.398771+0000","last_change":"2023-12-19T17:59:40.394607+0000","last_active":"2023-12-19T17:59:40.398771+0000","last_peered":"2023-12-19T17:59:40.398771+0000","last_clean":"2023-12-19T17:59:40.398771+0000","last_became_active":"2023-12-19T17:59:40.393346+0000","last_became_peered":"2023-12-19T17:59:40.393346+0000","last_unstale":"2023-12-19T17:59:40.398771+0000","last_undegraded":"2023-12-19T17:59:40.398771+0000","last_fullsized":"2023-12-19T17:59:40.398771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:35:11.813072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.371630+0000","last_change":"2023-12-19T17:59:39.876418+0000","last_active":"2023-12-19T17:59:40.371630+0000","last_peered":"2023-12-19T17:59:40.371630+0000","last_clean":"2023-12-19T17:59:40.371630+0000","last_became_active":"2023-12-19T17:59:39.875782+0000","last_became_peered":"2023-12-19T17:59:39.875782+0000","last_unstale":"2023-12-19T17:59:40.371630+0000","last_undegraded":"2023-12-19T17:59:40.371630+0000","last_fullsized":"2023-12-19T17:59:40.371630+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:18:32.065281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382944+0000","last_change":"2023-12-19T17:59:40.374994+0000","last_active":"2023-12-19T17:59:40.382944+0000","last_peered":"2023-12-19T17:59:40.382944+0000","last_clean":"2023-12-19T17:59:40.382944+0000","last_became_active":"2023-12-19T17:59:40.374706+0000","last_became_peered":"2023-12-19T17:59:40.374706+0000","last_unstale":"2023-12-19T17:59:40.382944+0000","last_undegraded":"2023-12-19T17:59:40.382944+0000","last_fullsized":"2023-12-19T17:59:40.382944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:05:59.640701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"84'3","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.393469+0000","last_change":"2023-12-19T17:59:39.878504+0000","last_active":"2023-12-19T17:59:40.393469+0000","last_peered":"2023-12-19T17:59:40.393469+0000","last_clean":"2023-12-19T17:59:40.393469+0000","last_became_active":"2023-12-19T17:59:39.878138+0000","last_became_peered":"2023-12-19T17:59:39.878138+0000","last_unstale":"2023-12-19T17:59:40.393469+0000","last_undegraded":"2023-12-19T17:59:40.393469+0000","last_fullsized":"2023-12-19T17:59:40.393469+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:16:28.082682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.380862+0000","last_change":"2023-12-19T17:59:40.377985+0000","last_active":"2023-12-19T17:59:40.380862+0000","last_peered":"2023-12-19T17:59:40.380862+0000","last_clean":"2023-12-19T17:59:40.380862+0000","last_became_active":"2023-12-19T17:59:40.377739+0000","last_became_peered":"2023-12-19T17:59:40.377739+0000","last_unstale":"2023-12-19T17:59:40.380862+0000","last_undegraded":"2023-12-19T17:59:40.380862+0000","last_fullsized":"2023-12-19T17:59:40.380862+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.627372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.14","version":"84'6","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.408728+0000","last_change":"2023-12-19T17:59:39.876757+0000","last_active":"2023-12-19T17:59:40.408728+0000","last_peered":"2023-12-19T17:59:40.408728+0000","last_clean":"2023-12-19T17:59:40.408728+0000","last_became_active":"2023-12-19T17:59:39.876444+0000","last_became_peered":"2023-12-19T17:59:39.876444+0000","last_unstale":"2023-12-19T17:59:40.408728+0000","last_undegraded":"2023-12-19T17:59:40.408728+0000","last_fullsized":"2023-12-19T17:59:40.408728+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:35:57.475823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.378694+0000","last_change":"2023-12-19T17:59:40.374624+0000","last_active":"2023-12-19T17:59:40.378694+0000","last_peered":"2023-12-19T17:59:40.378694+0000","last_clean":"2023-12-19T17:59:40.378694+0000","last_became_active":"2023-12-19T17:59:40.374387+0000","last_became_peered":"2023-12-19T17:59:40.374387+0000","last_unstale":"2023-12-19T17:59:40.378694+0000","last_undegraded":"2023-12-19T17:59:40.378694+0000","last_fullsized":"2023-12-19T17:59:40.378694+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:33:49.698090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.393212+0000","last_change":"2023-12-19T17:59:39.872589+0000","last_active":"2023-12-19T17:59:40.393212+0000","last_peered":"2023-12-19T17:59:40.393212+0000","last_clean":"2023-12-19T17:59:40.393212+0000","last_became_active":"2023-12-19T17:59:39.872317+0000","last_became_peered":"2023-12-19T17:59:39.872317+0000","last_unstale":"2023-12-19T17:59:40.393212+0000","last_undegraded":"2023-12-19T17:59:40.393212+0000","last_fullsized":"2023-12-19T17:59:40.393212+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:11.615448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397915+0000","last_change":"2023-12-19T17:59:40.391400+0000","last_active":"2023-12-19T17:59:40.397915+0000","last_peered":"2023-12-19T17:59:40.397915+0000","last_clean":"2023-12-19T17:59:40.397915+0000","last_became_active":"2023-12-19T17:59:40.390928+0000","last_became_peered":"2023-12-19T17:59:40.390928+0000","last_unstale":"2023-12-19T17:59:40.397915+0000","last_undegraded":"2023-12-19T17:59:40.397915+0000","last_fullsized":"2023-12-19T17:59:40.397915+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:51:40.135307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369894+0000","last_change":"2023-12-19T17:59:39.879603+0000","last_active":"2023-12-19T17:59:40.369894+0000","last_peered":"2023-12-19T17:59:40.369894+0000","last_clean":"2023-12-19T17:59:40.369894+0000","last_became_active":"2023-12-19T17:59:39.879291+0000","last_became_peered":"2023-12-19T17:59:39.879291+0000","last_unstale":"2023-12-19T17:59:40.369894+0000","last_undegraded":"2023-12-19T17:59:40.369894+0000","last_fullsized":"2023-12-19T17:59:40.369894+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:44.612886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.398423+0000","last_change":"2023-12-19T17:59:40.392361+0000","last_active":"2023-12-19T17:59:40.398423+0000","last_peered":"2023-12-19T17:59:40.398423+0000","last_clean":"2023-12-19T17:59:40.398423+0000","last_became_active":"2023-12-19T17:59:40.392102+0000","last_became_peered":"2023-12-19T17:59:40.392102+0000","last_unstale":"2023-12-19T17:59:40.398423+0000","last_undegraded":"2023-12-19T17:59:40.398423+0000","last_fullsized":"2023-12-19T17:59:40.398423+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:12.627372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.372749+0000","last_change":"2023-12-19T17:59:39.877283+0000","last_active":"2023-12-19T17:59:40.372749+0000","last_peered":"2023-12-19T17:59:40.372749+0000","last_clean":"2023-12-19T17:59:40.372749+0000","last_became_active":"2023-12-19T17:59:39.876839+0000","last_became_peered":"2023-12-19T17:59:39.876839+0000","last_unstale":"2023-12-19T17:59:40.372749+0000","last_undegraded":"2023-12-19T17:59:40.372749+0000","last_fullsized":"2023-12-19T17:59:40.372749+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:29:49.213154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397963+0000","last_change":"2023-12-19T17:59:40.391760+0000","last_active":"2023-12-19T17:59:40.397963+0000","last_peered":"2023-12-19T17:59:40.397963+0000","last_clean":"2023-12-19T17:59:40.397963+0000","last_became_active":"2023-12-19T17:59:40.391412+0000","last_became_peered":"2023-12-19T17:59:40.391412+0000","last_unstale":"2023-12-19T17:59:40.397963+0000","last_undegraded":"2023-12-19T17:59:40.397963+0000","last_fullsized":"2023-12-19T17:59:40.397963+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:16.680552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"84'8","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397902+0000","last_change":"2023-12-19T17:59:39.871209+0000","last_active":"2023-12-19T17:59:40.397902+0000","last_peered":"2023-12-19T17:59:40.397902+0000","last_clean":"2023-12-19T17:59:40.397902+0000","last_became_active":"2023-12-19T17:59:39.869750+0000","last_became_peered":"2023-12-19T17:59:39.869750+0000","last_unstale":"2023-12-19T17:59:40.397902+0000","last_undegraded":"2023-12-19T17:59:40.397902+0000","last_fullsized":"2023-12-19T17:59:40.397902+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:21:39.825161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392314+0000","last_change":"2023-12-19T17:59:40.387156+0000","last_active":"2023-12-19T17:59:40.392314+0000","last_peered":"2023-12-19T17:59:40.392314+0000","last_clean":"2023-12-19T17:59:40.392314+0000","last_became_active":"2023-12-19T17:59:40.386761+0000","last_became_peered":"2023-12-19T17:59:40.386761+0000","last_unstale":"2023-12-19T17:59:40.392314+0000","last_undegraded":"2023-12-19T17:59:40.392314+0000","last_fullsized":"2023-12-19T17:59:40.392314+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:46:08.007213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.f","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.385044+0000","last_change":"2023-12-19T17:59:39.881930+0000","last_active":"2023-12-19T17:59:40.385044+0000","last_peered":"2023-12-19T17:59:40.385044+0000","last_clean":"2023-12-19T17:59:40.385044+0000","last_became_active":"2023-12-19T17:59:39.881631+0000","last_became_peered":"2023-12-19T17:59:39.881631+0000","last_unstale":"2023-12-19T17:59:40.385044+0000","last_undegraded":"2023-12-19T17:59:40.385044+0000","last_fullsized":"2023-12-19T17:59:40.385044+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:14:15.668628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397623+0000","last_change":"2023-12-19T17:59:40.393372+0000","last_active":"2023-12-19T17:59:40.397623+0000","last_peered":"2023-12-19T17:59:40.397623+0000","last_clean":"2023-12-19T17:59:40.397623+0000","last_became_active":"2023-12-19T17:59:40.392005+0000","last_became_peered":"2023-12-19T17:59:40.392005+0000","last_unstale":"2023-12-19T17:59:40.397623+0000","last_undegraded":"2023-12-19T17:59:40.397623+0000","last_fullsized":"2023-12-19T17:59:40.397623+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:09:44.755293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.e","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397248+0000","last_change":"2023-12-19T17:59:39.882585+0000","last_active":"2023-12-19T17:59:40.397248+0000","last_peered":"2023-12-19T17:59:40.397248+0000","last_clean":"2023-12-19T17:59:40.397248+0000","last_became_active":"2023-12-19T17:59:39.882306+0000","last_became_peered":"2023-12-19T17:59:39.882306+0000","last_unstale":"2023-12-19T17:59:40.397248+0000","last_undegraded":"2023-12-19T17:59:40.397248+0000","last_fullsized":"2023-12-19T17:59:40.397248+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:49:08.637480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.392776+0000","last_change":"2023-12-19T17:59:40.387601+0000","last_active":"2023-12-19T17:59:40.392776+0000","last_peered":"2023-12-19T17:59:40.392776+0000","last_clean":"2023-12-19T17:59:40.392776+0000","last_became_active":"2023-12-19T17:59:40.387279+0000","last_became_peered":"2023-12-19T17:59:40.387279+0000","last_unstale":"2023-12-19T17:59:40.392776+0000","last_undegraded":"2023-12-19T17:59:40.392776+0000","last_fullsized":"2023-12-19T17:59:40.392776+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:12.793853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.d","version":"84'1","reported_seq":11,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.395786+0000","last_change":"2023-12-19T17:59:39.872600+0000","last_active":"2023-12-19T17:59:40.395786+0000","last_peered":"2023-12-19T17:59:40.395786+0000","last_clean":"2023-12-19T17:59:40.395786+0000","last_became_active":"2023-12-19T17:59:39.871779+0000","last_became_peered":"2023-12-19T17:59:39.871779+0000","last_unstale":"2023-12-19T17:59:40.395786+0000","last_undegraded":"2023-12-19T17:59:40.395786+0000","last_fullsized":"2023-12-19T17:59:40.395786+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:15:29.790572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382916+0000","last_change":"2023-12-19T17:59:40.375123+0000","last_active":"2023-12-19T17:59:40.382916+0000","last_peered":"2023-12-19T17:59:40.382916+0000","last_clean":"2023-12-19T17:59:40.382916+0000","last_became_active":"2023-12-19T17:59:40.374849+0000","last_became_peered":"2023-12-19T17:59:40.374849+0000","last_unstale":"2023-12-19T17:59:40.382916+0000","last_undegraded":"2023-12-19T17:59:40.382916+0000","last_fullsized":"2023-12-19T17:59:40.382916+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:22:01.876476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.368898+0000","last_change":"2023-12-19T17:59:39.880070+0000","last_active":"2023-12-19T17:59:40.368898+0000","last_peered":"2023-12-19T17:59:40.368898+0000","last_clean":"2023-12-19T17:59:40.368898+0000","last_became_active":"2023-12-19T17:59:39.879774+0000","last_became_peered":"2023-12-19T17:59:39.879774+0000","last_unstale":"2023-12-19T17:59:40.368898+0000","last_undegraded":"2023-12-19T17:59:40.368898+0000","last_fullsized":"2023-12-19T17:59:40.368898+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:05.007057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.390406+0000","last_change":"2023-12-19T17:59:40.383009+0000","last_active":"2023-12-19T17:59:40.390406+0000","last_peered":"2023-12-19T17:59:40.390406+0000","last_clean":"2023-12-19T17:59:40.390406+0000","last_became_active":"2023-12-19T17:59:40.380225+0000","last_became_peered":"2023-12-19T17:59:40.380225+0000","last_unstale":"2023-12-19T17:59:40.390406+0000","last_undegraded":"2023-12-19T17:59:40.390406+0000","last_fullsized":"2023-12-19T17:59:40.390406+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:24:00.783109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.b","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.380640+0000","last_change":"2023-12-19T17:59:39.874158+0000","last_active":"2023-12-19T17:59:40.380640+0000","last_peered":"2023-12-19T17:59:40.380640+0000","last_clean":"2023-12-19T17:59:40.380640+0000","last_became_active":"2023-12-19T17:59:39.873862+0000","last_became_peered":"2023-12-19T17:59:39.873862+0000","last_unstale":"2023-12-19T17:59:40.380640+0000","last_undegraded":"2023-12-19T17:59:40.380640+0000","last_fullsized":"2023-12-19T17:59:40.380640+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:04:57.181003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.394440+0000","last_change":"2023-12-19T17:59:40.389589+0000","last_active":"2023-12-19T17:59:40.394440+0000","last_peered":"2023-12-19T17:59:40.394440+0000","last_clean":"2023-12-19T17:59:40.394440+0000","last_became_active":"2023-12-19T17:59:40.389204+0000","last_became_peered":"2023-12-19T17:59:40.389204+0000","last_unstale":"2023-12-19T17:59:40.394440+0000","last_undegraded":"2023-12-19T17:59:40.394440+0000","last_fullsized":"2023-12-19T17:59:40.394440+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:41:42.214792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.368992+0000","last_change":"2023-12-19T17:59:39.876263+0000","last_active":"2023-12-19T17:59:40.368992+0000","last_peered":"2023-12-19T17:59:40.368992+0000","last_clean":"2023-12-19T17:59:40.368992+0000","last_became_active":"2023-12-19T17:59:39.875980+0000","last_became_peered":"2023-12-19T17:59:39.875980+0000","last_unstale":"2023-12-19T17:59:40.368992+0000","last_undegraded":"2023-12-19T17:59:40.368992+0000","last_fullsized":"2023-12-19T17:59:40.368992+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:23:43.748496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397944+0000","last_change":"2023-12-19T17:59:40.389576+0000","last_active":"2023-12-19T17:59:40.397944+0000","last_peered":"2023-12-19T17:59:40.397944+0000","last_clean":"2023-12-19T17:59:40.397944+0000","last_became_active":"2023-12-19T17:59:40.389314+0000","last_became_peered":"2023-12-19T17:59:40.389314+0000","last_unstale":"2023-12-19T17:59:40.397944+0000","last_undegraded":"2023-12-19T17:59:40.397944+0000","last_fullsized":"2023-12-19T17:59:40.397944+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:13.070675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.366759+0000","last_change":"2023-12-19T17:59:39.868934+0000","last_active":"2023-12-19T17:59:40.366759+0000","last_peered":"2023-12-19T17:59:40.366759+0000","last_clean":"2023-12-19T17:59:40.366759+0000","last_became_active":"2023-12-19T17:59:39.868625+0000","last_became_peered":"2023-12-19T17:59:39.868625+0000","last_unstale":"2023-12-19T17:59:40.366759+0000","last_undegraded":"2023-12-19T17:59:40.366759+0000","last_fullsized":"2023-12-19T17:59:40.366759+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:47.829344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.405439+0000","last_change":"2023-12-19T17:59:40.398781+0000","last_active":"2023-12-19T17:59:40.405439+0000","last_peered":"2023-12-19T17:59:40.405439+0000","last_clean":"2023-12-19T17:59:40.405439+0000","last_became_active":"2023-12-19T17:59:40.397803+0000","last_became_peered":"2023-12-19T17:59:40.397803+0000","last_unstale":"2023-12-19T17:59:40.405439+0000","last_undegraded":"2023-12-19T17:59:40.405439+0000","last_fullsized":"2023-12-19T17:59:40.405439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:27:45.624810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.7","version":"84'2","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.382914+0000","last_change":"2023-12-19T17:59:39.878061+0000","last_active":"2023-12-19T17:59:40.382914+0000","last_peered":"2023-12-19T17:59:40.382914+0000","last_clean":"2023-12-19T17:59:40.382914+0000","last_became_active":"2023-12-19T17:59:39.877810+0000","last_became_peered":"2023-12-19T17:59:39.877810+0000","last_unstale":"2023-12-19T17:59:40.382914+0000","last_undegraded":"2023-12-19T17:59:40.382914+0000","last_fullsized":"2023-12-19T17:59:40.382914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:50:12.058751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397601+0000","last_change":"2023-12-19T17:59:40.389101+0000","last_active":"2023-12-19T17:59:40.397601+0000","last_peered":"2023-12-19T17:59:40.397601+0000","last_clean":"2023-12-19T17:59:40.397601+0000","last_became_active":"2023-12-19T17:59:40.388812+0000","last_became_peered":"2023-12-19T17:59:40.388812+0000","last_unstale":"2023-12-19T17:59:40.397601+0000","last_undegraded":"2023-12-19T17:59:40.397601+0000","last_fullsized":"2023-12-19T17:59:40.397601+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:23.018554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.361277+0000","last_change":"2023-12-19T17:59:39.872819+0000","last_active":"2023-12-19T17:59:40.361277+0000","last_peered":"2023-12-19T17:59:40.361277+0000","last_clean":"2023-12-19T17:59:40.361277+0000","last_became_active":"2023-12-19T17:59:39.872559+0000","last_became_peered":"2023-12-19T17:59:39.872559+0000","last_unstale":"2023-12-19T17:59:40.361277+0000","last_undegraded":"2023-12-19T17:59:40.361277+0000","last_fullsized":"2023-12-19T17:59:40.361277+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:25.229680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.399708+0000","last_change":"2023-12-19T17:59:40.394157+0000","last_active":"2023-12-19T17:59:40.399708+0000","last_peered":"2023-12-19T17:59:40.399708+0000","last_clean":"2023-12-19T17:59:40.399708+0000","last_became_active":"2023-12-19T17:59:40.393846+0000","last_became_peered":"2023-12-19T17:59:40.393846+0000","last_unstale":"2023-12-19T17:59:40.399708+0000","last_undegraded":"2023-12-19T17:59:40.399708+0000","last_fullsized":"2023-12-19T17:59:40.399708+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:18:33.077205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369739+0000","last_change":"2023-12-19T17:59:39.882949+0000","last_active":"2023-12-19T17:59:40.369739+0000","last_peered":"2023-12-19T17:59:40.369739+0000","last_clean":"2023-12-19T17:59:40.369739+0000","last_became_active":"2023-12-19T17:59:39.882437+0000","last_became_peered":"2023-12-19T17:59:39.882437+0000","last_unstale":"2023-12-19T17:59:40.369739+0000","last_undegraded":"2023-12-19T17:59:40.369739+0000","last_fullsized":"2023-12-19T17:59:40.369739+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:26:22.006630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.390439+0000","last_change":"2023-12-19T17:59:40.383514+0000","last_active":"2023-12-19T17:59:40.390439+0000","last_peered":"2023-12-19T17:59:40.390439+0000","last_clean":"2023-12-19T17:59:40.390439+0000","last_became_active":"2023-12-19T17:59:40.382742+0000","last_became_peered":"2023-12-19T17:59:40.382742+0000","last_unstale":"2023-12-19T17:59:40.390439+0000","last_undegraded":"2023-12-19T17:59:40.390439+0000","last_fullsized":"2023-12-19T17:59:40.390439+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:05:15.604488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369116+0000","last_change":"2023-12-19T17:59:39.883300+0000","last_active":"2023-12-19T17:59:40.369116+0000","last_peered":"2023-12-19T17:59:40.369116+0000","last_clean":"2023-12-19T17:59:40.369116+0000","last_became_active":"2023-12-19T17:59:39.881595+0000","last_became_peered":"2023-12-19T17:59:39.881595+0000","last_unstale":"2023-12-19T17:59:40.369116+0000","last_undegraded":"2023-12-19T17:59:40.369116+0000","last_fullsized":"2023-12-19T17:59:40.369116+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:11.615448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.397990+0000","last_change":"2023-12-19T17:59:40.389479+0000","last_active":"2023-12-19T17:59:40.397990+0000","last_peered":"2023-12-19T17:59:40.397990+0000","last_clean":"2023-12-19T17:59:40.397990+0000","last_became_active":"2023-12-19T17:59:40.389216+0000","last_became_peered":"2023-12-19T17:59:40.389216+0000","last_unstale":"2023-12-19T17:59:40.397990+0000","last_undegraded":"2023-12-19T17:59:40.397990+0000","last_fullsized":"2023-12-19T17:59:40.397990+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:35.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.377679+0000","last_change":"2023-12-19T17:59:39.884357+0000","last_active":"2023-12-19T17:59:40.377679+0000","last_peered":"2023-12-19T17:59:40.377679+0000","last_clean":"2023-12-19T17:59:40.377679+0000","last_became_active":"2023-12-19T17:59:39.884077+0000","last_became_peered":"2023-12-19T17:59:39.884077+0000","last_unstale":"2023-12-19T17:59:40.377679+0000","last_undegraded":"2023-12-19T17:59:40.377679+0000","last_fullsized":"2023-12-19T17:59:40.377679+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:19:38.592069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.408699+0000","last_change":"2023-12-19T17:59:40.401254+0000","last_active":"2023-12-19T17:59:40.408699+0000","last_peered":"2023-12-19T17:59:40.408699+0000","last_clean":"2023-12-19T17:59:40.408699+0000","last_became_active":"2023-12-19T17:59:40.400983+0000","last_became_peered":"2023-12-19T17:59:40.400983+0000","last_unstale":"2023-12-19T17:59:40.408699+0000","last_undegraded":"2023-12-19T17:59:40.408699+0000","last_fullsized":"2023-12-19T17:59:40.408699+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:46.431718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.373009+0000","last_change":"2023-12-19T17:59:39.878021+0000","last_active":"2023-12-19T17:59:40.373009+0000","last_peered":"2023-12-19T17:59:40.373009+0000","last_clean":"2023-12-19T17:59:40.373009+0000","last_became_active":"2023-12-19T17:59:39.876868+0000","last_became_peered":"2023-12-19T17:59:39.876868+0000","last_unstale":"2023-12-19T17:59:40.373009+0000","last_undegraded":"2023-12-19T17:59:40.373009+0000","last_fullsized":"2023-12-19T17:59:40.373009+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:26:08.573138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.389110+0000","last_change":"2023-12-19T17:59:40.386955+0000","last_active":"2023-12-19T17:59:40.389110+0000","last_peered":"2023-12-19T17:59:40.389110+0000","last_clean":"2023-12-19T17:59:40.389110+0000","last_became_active":"2023-12-19T17:59:40.386532+0000","last_became_peered":"2023-12-19T17:59:40.386532+0000","last_unstale":"2023-12-19T17:59:40.389110+0000","last_undegraded":"2023-12-19T17:59:40.389110+0000","last_fullsized":"2023-12-19T17:59:40.389110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:27:35.753069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.377815+0000","last_change":"2023-12-19T17:59:39.880034+0000","last_active":"2023-12-19T17:59:40.377815+0000","last_peered":"2023-12-19T17:59:40.377815+0000","last_clean":"2023-12-19T17:59:40.377815+0000","last_became_active":"2023-12-19T17:59:39.879722+0000","last_became_peered":"2023-12-19T17:59:39.879722+0000","last_unstale":"2023-12-19T17:59:40.377815+0000","last_undegraded":"2023-12-19T17:59:40.377815+0000","last_fullsized":"2023-12-19T17:59:40.377815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:07:11.781929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388224+0000","last_change":"2023-12-19T17:59:40.381385+0000","last_active":"2023-12-19T17:59:40.388224+0000","last_peered":"2023-12-19T17:59:40.388224+0000","last_clean":"2023-12-19T17:59:40.388224+0000","last_became_active":"2023-12-19T17:59:40.381145+0000","last_became_peered":"2023-12-19T17:59:40.381145+0000","last_unstale":"2023-12-19T17:59:40.388224+0000","last_undegraded":"2023-12-19T17:59:40.388224+0000","last_fullsized":"2023-12-19T17:59:40.388224+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:40:46.431718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.368753+0000","last_change":"2023-12-19T17:59:39.878172+0000","last_active":"2023-12-19T17:59:40.368753+0000","last_peered":"2023-12-19T17:59:40.368753+0000","last_clean":"2023-12-19T17:59:40.368753+0000","last_became_active":"2023-12-19T17:59:39.877668+0000","last_became_peered":"2023-12-19T17:59:39.877668+0000","last_unstale":"2023-12-19T17:59:40.368753+0000","last_undegraded":"2023-12-19T17:59:40.368753+0000","last_fullsized":"2023-12-19T17:59:40.368753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T17:59:50.437117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.388027+0000","last_change":"2023-12-19T17:59:40.383456+0000","last_active":"2023-12-19T17:59:40.388027+0000","last_peered":"2023-12-19T17:59:40.388027+0000","last_clean":"2023-12-19T17:59:40.388027+0000","last_became_active":"2023-12-19T17:59:40.381498+0000","last_became_peered":"2023-12-19T17:59:40.381498+0000","last_unstale":"2023-12-19T17:59:40.388027+0000","last_undegraded":"2023-12-19T17:59:40.388027+0000","last_fullsized":"2023-12-19T17:59:40.388027+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:39.833896+0000","last_clean_scrub_stamp":"2023-12-19T17:59:39.833896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:03.573212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-19T17:59:40.369682+0000","last_change":"2023-12-19T17:59:39.880767+0000","last_active":"2023-12-19T17:59:40.369682+0000","last_peered":"2023-12-19T17:59:40.369682+0000","last_clean":"2023-12-19T17:59:40.369682+0000","last_became_active":"2023-12-19T17:59:39.880304+0000","last_became_peered":"2023-12-19T17:59:39.880304+0000","last_unstale":"2023-12-19T17:59:40.369682+0000","last_undegraded":"2023-12-19T17:59:40.369682+0000","last_fullsized":"2023-12-19T17:59:40.369682+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:59:38.821972+0000","last_clean_scrub_stamp":"2023-12-19T17:59:38.821972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:38:36.617841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":232,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-19T17:59:39.864827+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T17:59:39.864827+0000","last_peered":"2023-12-19T17:59:39.864827+0000","last_clean":"2023-12-19T17:59:39.864827+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T17:59:39.864827+0000","last_undegraded":"2023-12-19T17:59:39.864827+0000","last_fullsized":"2023-12-19T17:59:39.864827+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":12,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":11,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32636,"kb_used_data":1588,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339204,"statfs":{"total":96636764160,"available":96603344896,"internally_reserved":0,"allocated":1626112,"data_stored":1078940,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.125,"5min":1.115,"15min":1.0669999999999999},"min":{"1min":0.70099999999999996,"5min":0.56100000000000005,"15min":0.55000000000000004},"max":{"1min":1.46,"5min":1.577,"15min":1.8089999999999999},"last":1.603},{"interface":"front","average":{"1min":1.123,"5min":1.1499999999999999,"15min":1.131},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.61299999999999999},"max":{"1min":1.403,"5min":1.661,"15min":1.661},"last":1.51}]},{"osd":1,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.036,"15min":1.071},"min":{"1min":0.61699999999999999,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.607,"5min":1.607,"15min":1.7250000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.98999999999999999,"5min":1.081,"15min":1.1259999999999999},"min":{"1min":0.60899999999999999,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5569999999999999,"5min":3.7000000000000002,"15min":3.7000000000000002},"last":1.0700000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.042,"15min":1.0569999999999999},"min":{"1min":0.754,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.514,"5min":1.514,"15min":2.069},"last":1.319},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.125,"15min":1.133},"min":{"1min":0.76700000000000002,"5min":0.72699999999999998,"15min":0.65300000000000002},"max":{"1min":1.3959999999999999,"5min":1.508,"15min":1.5660000000000001},"last":1.5449999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.1279999999999999,"15min":1.133},"min":{"1min":0.67100000000000004,"5min":0.622,"15min":0.51600000000000001},"max":{"1min":1.5269999999999999,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.2070000000000001,"15min":1.2150000000000001},"min":{"1min":0.89600000000000002,"5min":0.88900000000000001,"15min":0.64200000000000002},"max":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"last":1.395}]},{"osd":4,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.1299999999999999,"15min":1.204},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.2929999999999999,"5min":1.712,"15min":1.8779999999999999},"last":1.236},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.2509999999999999,"15min":1.28},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4299999999999999,"5min":1.8120000000000001,"15min":2.1720000000000002},"last":1.857}]},{"osd":5,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1890000000000001,"15min":1.23},"min":{"1min":0.79700000000000004,"5min":0.77400000000000002,"15min":0.73099999999999998},"max":{"1min":1.756,"5min":1.756,"15min":1.97},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.2270000000000001,"15min":1.274},"min":{"1min":0.872,"5min":0.86099999999999999,"15min":0.63200000000000001},"max":{"1min":1.331,"5min":1.861,"15min":2.02},"last":1.4330000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:58:43 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.363,"15min":1.3859999999999999},"min":{"1min":1.016,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.3799999999999999,"5min":1.9650000000000001,"15min":2.1429999999999998},"last":1.569},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.282,"15min":1.337},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.47,"5min":2.0049999999999999,"15min":2.2599999999999998},"last":1.6240000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574950,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":490114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.997,"15min":1.143},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.345,"5min":1.5149999999999999,"15min":4.5979999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":1.03,"15min":1.0860000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.357,"5min":1.5580000000000001,"15min":1.6819999999999999},"last":1.1739999999999999}]},{"osd":1,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.085},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3799999999999999,"5min":1.494,"15min":2.2109999999999999},"last":1.1200000000000001},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0840000000000001,"15min":1.123},"min":{"1min":0.63800000000000001,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.583,"5min":1.583,"15min":1.621},"last":1.149}]},{"osd":2,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0680000000000001,"5min":1.117,"15min":1.3680000000000001},"min":{"1min":0.754,"5min":0.753,"15min":0.66800000000000004},"max":{"1min":1.5109999999999999,"5min":1.54,"15min":8.5470000000000006},"last":1.2869999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.109,"15min":1.244},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.429,"5min":1.778,"15min":4.6340000000000003},"last":1.0880000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.1759999999999999,"15min":1.288},"min":{"1min":0.85699999999999998,"5min":0.76400000000000001,"15min":0.72099999999999997},"max":{"1min":1.486,"5min":1.6919999999999999,"15min":4.5380000000000003},"last":0.95599999999999996},{"interface":"front","average":{"1min":1.155,"5min":1.1950000000000001,"15min":1.331},"min":{"1min":0.76700000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.512,"5min":1.911,"15min":4.508},"last":1.2190000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.139,"15min":1.1399999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.438},"max":{"1min":1.4650000000000001,"5min":1.6459999999999999,"15min":1.8360000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.238,"15min":1.2549999999999999},"min":{"1min":0.93500000000000005,"5min":0.77600000000000002,"15min":0.70299999999999996},"max":{"1min":1.611,"5min":1.7769999999999999,"15min":1.899},"last":1.349}]},{"osd":5,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.238,"15min":1.264},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.5860000000000001,"5min":1.829,"15min":2.1400000000000001},"last":1.385},{"interface":"front","average":{"1min":1.23,"5min":1.26,"15min":1.268},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.57299999999999995},"max":{"1min":1.657,"5min":1.768,"15min":1.9239999999999999},"last":1.208}]},{"osd":7,"last update":"Tue Dec 19 17:59:41 2023","interfaces":[{"interface":"back","average":{"1min":1.335,"5min":1.3460000000000001,"15min":1.3520000000000001},"min":{"1min":0.91100000000000003,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.625,"5min":1.845,"15min":1.845},"last":1.26},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.379,"15min":1.403},"min":{"1min":0.89600000000000002,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.651,"5min":1.9670000000000001,"15min":2.2440000000000002},"last":1.4399999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574950,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":488584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.998,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5469999999999999,"5min":1.613,"15min":1.613},"last":0.94799999999999995},{"interface":"front","average":{"1min":0.93500000000000005,"5min":0.99399999999999999,"15min":1.0549999999999999},"min":{"1min":0.66200000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.2549999999999999,"5min":1.7849999999999999,"15min":2.9369999999999998},"last":0.80400000000000005}]},{"osd":1,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.091,"5min":1.0920000000000001,"15min":1.0960000000000001},"min":{"1min":0.70799999999999996,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.413,"5min":1.589,"15min":1.778},"last":1.163},{"interface":"front","average":{"1min":1.091,"5min":1.1479999999999999,"15min":1.2},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.3759999999999999,"5min":1.825,"15min":2.0329999999999999},"last":1.1930000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.0409999999999999,"15min":1.1719999999999999},"min":{"1min":0.629,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":2.9929999999999999},"last":1.1339999999999999},{"interface":"front","average":{"1min":1.044,"5min":1.0700000000000001,"15min":1.159},"min":{"1min":0.78900000000000003,"5min":0.75700000000000001,"15min":0.52500000000000002},"max":{"1min":1.49,"5min":1.671,"15min":1.671},"last":0.76300000000000001}]},{"osd":3,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":1.153,"15min":1.2749999999999999},"min":{"1min":0.65900000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.4159999999999999,"5min":1.649,"15min":2.2410000000000001},"last":1.5389999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.2070000000000001,"15min":1.3540000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.448,"5min":1.5580000000000001,"15min":3.0350000000000001},"last":1.4930000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.202,"15min":1.28},"min":{"1min":0.88200000000000001,"5min":0.76900000000000002,"15min":0.67100000000000004},"max":{"1min":1.589,"5min":1.851,"15min":2.0819999999999999},"last":1.0049999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.2849999999999999,"15min":1.3859999999999999},"min":{"1min":0.78600000000000003,"5min":0.745,"15min":0.745},"max":{"1min":1.657,"5min":1.7370000000000001,"15min":3.2589999999999999},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2130000000000001,"5min":1.214,"15min":1.381},"min":{"1min":0.94199999999999995,"5min":0.78600000000000003,"15min":0.60499999999999998},"max":{"1min":1.589,"5min":2.2909999999999999,"15min":3.3010000000000002},"last":1.2589999999999999},{"interface":"front","average":{"1min":1.252,"5min":1.254,"15min":1.341},"min":{"1min":0.94399999999999995,"5min":0.91300000000000003,"15min":0.84799999999999998},"max":{"1min":1.5449999999999999,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":1.224}]},{"osd":7,"last update":"Tue Dec 19 17:58:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.3149999999999999,"15min":1.4810000000000001},"min":{"1min":1.0589999999999999,"5min":0.96799999999999997,"15min":0.72299999999999998},"max":{"1min":1.7569999999999999,"5min":1.992,"15min":3.1099999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.331,"15min":1.5700000000000001},"min":{"1min":0.98099999999999998,"5min":0.84799999999999998,"15min":0.82499999999999996},"max":{"1min":1.673,"5min":1.952,"15min":3.5680000000000001},"last":1.375}]}]},{"osd":4,"up_from":13,"seq":55834574950,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":1024,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":1048576,"data_stored":490218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0409999999999999,"5min":1.0880000000000001,"15min":1.2190000000000001},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.518,"5min":2.7069999999999999,"15min":5.4420000000000002},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.129,"5min":1.1699999999999999,"15min":1.2849999999999999},"min":{"1min":0.67600000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5309999999999999,"5min":4.5019999999999998,"15min":5.5049999999999999},"last":1.393}]},{"osd":1,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0980000000000001,"15min":1.2250000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.5920000000000001,"5min":1.8180000000000001,"15min":4.6379999999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.0229999999999999,"5min":1.103,"15min":1.196},"min":{"1min":0.79500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.361,"5min":3.137,"15min":3.254},"last":1.1850000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.1180000000000001,"15min":1.2649999999999999},"min":{"1min":0.69499999999999995,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.623,"5min":2.3090000000000002,"15min":4.593},"last":1.512},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1220000000000001,"15min":1.2350000000000001},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5389999999999999,"5min":1.978,"15min":2.3799999999999999},"last":1.0029999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0669999999999999,"5min":1.091,"15min":1.254},"min":{"1min":0.73899999999999999,"5min":0.71199999999999997,"15min":0.49199999999999999},"max":{"1min":1.7789999999999999,"5min":2.4750000000000001,"15min":5.4610000000000003},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.2509999999999999,"15min":1.375},"min":{"1min":0.90100000000000002,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5840000000000001,"5min":5.633,"15min":5.633},"last":1.458}]},{"osd":5,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2110000000000001,"15min":1.2190000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.6559999999999999,"5min":2.5649999999999999,"15min":2.5649999999999999},"last":0.875},{"interface":"front","average":{"1min":1.113,"5min":1.1830000000000001,"15min":1.1659999999999999},"min":{"1min":0.81299999999999994,"5min":0.71199999999999997,"15min":0.63800000000000001},"max":{"1min":1.4650000000000001,"5min":2.1190000000000002,"15min":2.157},"last":0.83699999999999997}]},{"osd":6,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2629999999999999,"15min":1.2569999999999999},"min":{"1min":0.81100000000000005,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.579,"5min":2.915,"15min":2.915},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.4039999999999999,"15min":1.415},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.835,"5min":2.5299999999999998,"15min":2.5299999999999998},"last":1.28}]},{"osd":7,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.3129999999999999,"15min":1.319},"min":{"1min":0.91800000000000004,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.875,"5min":2.4340000000000002,"15min":2.4340000000000002},"last":0.91800000000000004},{"interface":"front","average":{"1min":1.3740000000000001,"5min":1.4119999999999999,"15min":1.373},"min":{"1min":1.0589999999999999,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":5.6859999999999999,"15min":5.6859999999999999},"last":1.3460000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574951,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":1008,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":1032192,"data_stored":489132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.82699999999999996,"15min":0.90300000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.37},"max":{"1min":1.508,"5min":1.6599999999999999,"15min":1.825},"last":0.628},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.80500000000000005,"15min":0.94699999999999995},"min":{"1min":0.45900000000000002,"5min":0.435,"15min":0.435},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.72899999999999998}]},{"osd":1,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.85899999999999999,"15min":0.91100000000000003},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.167,"5min":1.46,"15min":1.54},"last":1.107},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0029999999999999,"15min":1.044},"min":{"1min":0.59399999999999997,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.3120000000000001}]},{"osd":2,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.024,"5min":1.038,"15min":1.1020000000000001},"min":{"1min":0.71399999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.679,"5min":1.679,"15min":2.177},"last":1},{"interface":"front","average":{"1min":1.173,"5min":1.1299999999999999,"15min":1.226},"min":{"1min":0.75600000000000001,"5min":0.64900000000000002,"15min":0.58899999999999997},"max":{"1min":1.49,"5min":1.629,"15min":1.8520000000000001},"last":1.3640000000000001}]},{"osd":4,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.1279999999999999,"15min":1.2310000000000001},"min":{"1min":0.69299999999999995,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":1.492,"5min":1.8109999999999999,"15min":2.234},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2390000000000001,"15min":1.3100000000000001},"min":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.8089999999999999,"5min":1.8089999999999999,"15min":2.4350000000000001},"last":1.4450000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3080000000000001,"15min":1.395},"min":{"1min":0.92300000000000004,"5min":0.88100000000000001,"15min":0.80200000000000005},"max":{"1min":2.052,"5min":2.052,"15min":2.5419999999999998},"last":1.421},{"interface":"front","average":{"1min":1.2789999999999999,"5min":1.224,"15min":1.347},"min":{"1min":0.85399999999999998,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":1.7030000000000001,"5min":1.7030000000000001,"15min":2.754},"last":1.206}]},{"osd":6,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.3100000000000001,"15min":1.4019999999999999},"min":{"1min":0.96399999999999997,"5min":0.93899999999999995,"15min":0.78000000000000003},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":2.6880000000000002},"last":1.286},{"interface":"front","average":{"1min":1.3979999999999999,"5min":1.393,"15min":1.4650000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.94699999999999995},"max":{"1min":2.274,"5min":2.274,"15min":2.6429999999999998},"last":1.2370000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:59:39 2023","interfaces":[{"interface":"back","average":{"1min":1.284,"5min":1.2809999999999999,"15min":1.429},"min":{"1min":0.80900000000000005,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.8580000000000001,"5min":2.0819999999999999,"15min":3.02},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4139999999999999,"15min":1.488},"min":{"1min":1.109,"5min":0.96299999999999997,"15min":0.83099999999999996},"max":{"1min":2.323,"5min":2.323,"15min":2.8170000000000002},"last":1.3839999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574950,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":1016,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":1040384,"data_stored":489292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.83799999999999997,"15min":1.2410000000000001},"min":{"1min":0.497,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.4259999999999999,"5min":1.8069999999999999,"15min":13.32},"last":1.258},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.88400000000000001,"15min":1.357},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.383,"5min":1.734,"15min":13.206},"last":1.3100000000000001}]},{"osd":1,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.88600000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.56599999999999995,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.4490000000000001,"5min":1.841,"15min":1.841},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.90400000000000003,"15min":0.98299999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.121,"5min":1.492,"15min":1.948},"last":1.6759999999999999}]},{"osd":3,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.877,"15min":0.94799999999999995},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.569,"5min":1.708,"15min":1.79},"last":1.417},{"interface":"front","average":{"1min":1.0549999999999999,"5min":1.1020000000000001,"15min":1.198},"min":{"1min":0.63100000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.6040000000000001,"5min":1.9350000000000001,"15min":1.9350000000000001},"last":1.76}]},{"osd":4,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2350000000000001,"15min":1.24},"min":{"1min":0.96899999999999997,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.5289999999999999,"5min":2.0550000000000002,"15min":2.0550000000000002},"last":1.373},{"interface":"front","average":{"1min":1.113,"5min":1.177,"15min":1.272},"min":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.5489999999999999,"5min":1.9139999999999999,"15min":2.024},"last":1.1259999999999999}]},{"osd":5,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1910000000000001,"15min":1.2749999999999999},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.4450000000000001,"5min":1.849,"15min":4.0659999999999998},"last":1.512},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.304,"15min":1.444},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.7290000000000001,"5min":2.1230000000000002,"15min":3.7160000000000002},"last":1.6180000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.2549999999999999,"15min":1.3879999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.593,"5min":2.0489999999999999,"15min":2.081},"last":1.468},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.26,"15min":1.339},"min":{"1min":0.91500000000000004,"5min":0.872,"15min":0.872},"max":{"1min":1.6140000000000001,"5min":1.972,"15min":2.1379999999999999},"last":1.5589999999999999}]},{"osd":7,"last update":"Tue Dec 19 17:59:35 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.3,"15min":1.4370000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.569,"5min":2.0169999999999999,"15min":2.363},"last":1.583},{"interface":"front","average":{"1min":1.24,"5min":1.3169999999999999,"15min":1.3879999999999999},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.728,"5min":2.0489999999999999,"15min":2.1629999999999998},"last":1.7130000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":1036288,"data_stored":488662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.81799999999999995,"5min":0.80700000000000005,"15min":0.94799999999999995},"min":{"1min":0.497,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.1930000000000001,"5min":1.9159999999999999,"15min":1.931},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.92700000000000005,"15min":1.016},"min":{"1min":0.74299999999999999,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1919999999999999,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":1.0469999999999999}]},{"osd":2,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.80100000000000005,"15min":0.99099999999999999},"min":{"1min":0.48499999999999999,"5min":0.434,"15min":0.434},"max":{"1min":1.2789999999999999,"5min":1.353,"15min":2.0590000000000002},"last":0.94199999999999995},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.92900000000000005,"15min":1.135},"min":{"1min":0.65400000000000003,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.27,"5min":1.3899999999999999,"15min":3.4199999999999999},"last":1.01}]},{"osd":3,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":1.054,"15min":1.258},"min":{"1min":0.69899999999999995,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.401,"5min":1.6160000000000001,"15min":3.4950000000000001},"last":1.3300000000000001},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.97199999999999998,"15min":1.1799999999999999},"min":{"1min":0.64600000000000002,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.55,"5min":1.6100000000000001,"15min":4.2030000000000003},"last":1.165}]},{"osd":4,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.302,"5min":1.2609999999999999,"15min":1.4039999999999999},"min":{"1min":1.069,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.6020000000000001,"5min":1.7050000000000001,"15min":4.3869999999999996},"last":1.397},{"interface":"front","average":{"1min":1.226,"5min":1.1830000000000001,"15min":1.375},"min":{"1min":0.95599999999999996,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":2.6960000000000002},"last":1.365}]},{"osd":5,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.165,"15min":1.373},"min":{"1min":0.874,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":2.9249999999999998},"last":1.306},{"interface":"front","average":{"1min":1.258,"5min":1.2470000000000001,"15min":1.502},"min":{"1min":0.83299999999999996,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.6499999999999999,"5min":1.6679999999999999,"15min":3.8420000000000001},"last":1.2450000000000001}]},{"osd":6,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.325,"15min":1.5469999999999999},"min":{"1min":1.107,"5min":0.95299999999999996,"15min":0.92600000000000005},"max":{"1min":1.6459999999999999,"5min":2.0529999999999999,"15min":4.5780000000000003},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.3149999999999999,"5min":1.3120000000000001,"15min":1.5620000000000001},"min":{"1min":0.97899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.73,"5min":2.0070000000000001,"15min":3.214},"last":1.1930000000000001}]},{"osd":7,"last update":"Tue Dec 19 17:58:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3420000000000001,"5min":1.3360000000000001,"15min":1.623},"min":{"1min":1.0580000000000001,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.619,"5min":1.7809999999999999,"15min":4.0910000000000002},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3300000000000001,"15min":1.542},"min":{"1min":0.88,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6819999999999999,"5min":1.8360000000000001,"15min":4.6390000000000002},"last":1.272}]}]},{"osd":0,"up_from":13,"seq":55834574950,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1617920,"data_stored":1077899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.83799999999999997,"15min":1.0049999999999999},"min":{"1min":0.49199999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.107,"5min":1.4039999999999999,"15min":2.2250000000000001},"last":1.53},{"interface":"front","average":{"1min":0.877,"5min":0.92800000000000005,"15min":1.173},"min":{"1min":0.505,"5min":0.499,"15min":0.499},"max":{"1min":1.175,"5min":1.448,"15min":2.3599999999999999},"last":1.73}]},{"osd":2,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.86499999999999999,"15min":0.99299999999999999},"min":{"1min":0.54600000000000004,"5min":0.53400000000000003,"15min":0.47499999999999998},"max":{"1min":1.2689999999999999,"5min":1.345,"15min":1.6839999999999999},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.875,"15min":0.97599999999999998},"min":{"1min":0.497,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.069,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.214}]},{"osd":3,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.876,"15min":1.0429999999999999},"min":{"1min":0.55800000000000005,"5min":0.502,"15min":0.502},"max":{"1min":1.2869999999999999,"5min":1.5700000000000001,"15min":3.4399999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":1.0009999999999999,"5min":1.093,"15min":1.258},"min":{"1min":0.56299999999999994,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.363,"5min":1.724,"15min":2.5369999999999999},"last":1.7889999999999999}]},{"osd":4,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.2410000000000001,"15min":1.3660000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.3620000000000001,"5min":1.6739999999999999,"15min":1.78},"last":1.9159999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.204,"15min":1.3919999999999999},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.472,"5min":1.944,"15min":2.7799999999999998},"last":1.6160000000000001}]},{"osd":5,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1339999999999999,"15min":1.2949999999999999},"min":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.4119999999999999,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.4870000000000001},{"interface":"front","average":{"1min":1.1919999999999999,"5min":1.2110000000000001,"15min":1.3220000000000001},"min":{"1min":0.89500000000000002,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":1.536,"5min":1.784,"15min":2.0030000000000001},"last":1.879}]},{"osd":6,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.27,"15min":1.4350000000000001},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.659,"5min":2.04,"15min":2.1000000000000001},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.2250000000000001,"5min":1.2789999999999999,"15min":1.45},"min":{"1min":0.93500000000000005,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.615,"5min":1.984,"15min":2.3889999999999998},"last":1.446}]},{"osd":7,"last update":"Tue Dec 19 17:58:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2949999999999999,"15min":1.613},"min":{"1min":0.96799999999999997,"5min":0.95299999999999996,"15min":0.84299999999999997},"max":{"1min":1.6830000000000001,"5min":1.8600000000000001,"15min":4.9400000000000004},"last":1.585},{"interface":"front","average":{"1min":1.21,"5min":1.27,"15min":1.573},"min":{"1min":0.97099999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.48,"5min":2.1339999999999999,"15min":4.8250000000000002},"last":1.696}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1668,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T17:59:45.246 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T17:59:45.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T17:59:45.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.477+0000 7f3eae958700 1 Processor -- start 2023-12-19T17:59:45.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.477+0000 7f3eae958700 1 -- start start 2023-12-19T17:59:45.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae958700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ea8070ab0 0x7f3ea80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae958700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3ea80d2620 0x7f3ea80b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae958700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ea80d2190 con 0x7f3ea80b2040 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae958700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea80ce350 con 0x7f3ea8070ab0 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae958700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea80d2a70 con 0x7f3ea80d2620 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ea8070ab0 0x7f3ea80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3ea8070ab0 0x7f3ea80cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34990/0 (socket says 172.21.15.45:34990) 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 -- 172.21.15.45:0/522881184 learned_addr learned my addr 172.21.15.45:0/522881184 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:45.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae157700 1 --2- 172.21.15.45:0/522881184 >> v2:172.21.15.73:3300/0 conn(0x7f3ea80d2620 0x7f3ea80b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 -- 172.21.15.45:0/522881184 >> v2:172.21.15.73:3300/0 conn(0x7f3ea80d2620 msgr2=0x7f3ea80b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:45.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 --2- 172.21.15.45:0/522881184 >> v2:172.21.15.73:3300/0 conn(0x7f3ea80d2620 0x7f3ea80b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 -- 172.21.15.45:0/522881184 >> v1:172.21.15.73:6789/0 conn(0x7f3ea80b2040 legacy=0x7f3ea8070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3ead956700 1 -- 172.21.15.45:0/522881184 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea80ce070 con 0x7f3ea8070ab0 2023-12-19T17:59:45.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.481+0000 7f3eae157700 1 --2- 172.21.15.45:0/522881184 >> v2:172.21.15.73:3300/0 conn(0x7f3ea80d2620 0x7f3ea80b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:45.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3ead956700 1 --2- 172.21.15.45:0/522881184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cd500 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80c65b0 tx=0x7f3ea4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd88cbad69c80bf8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eac954700 1 -- 172.21.15.45:0/522881184 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400b8a0 con 0x7f3ea8070ab0 2023-12-19T17:59:45.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eac954700 1 -- 172.21.15.45:0/522881184 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea400ba00 con 0x7f3ea8070ab0 2023-12-19T17:59:45.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eac954700 1 -- 172.21.15.45:0/522881184 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea400bd90 con 0x7f3ea8070ab0 2023-12-19T17:59:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 -- 172.21.15.45:0/522881184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea8070ab0 msgr2=0x7f3ea80cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 --2- 172.21.15.45:0/522881184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cd500 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f3ea80c65b0 tx=0x7f3ea4009bf0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 -- 172.21.15.45:0/522881184 shutdown_connections 2023-12-19T17:59:45.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 --2- 172.21.15.45:0/522881184 >> v2:172.21.15.73:3300/0 conn(0x7f3ea80d2620 0x7f3ea80b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 --2- 172.21.15.45:0/522881184 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cd500 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 -- 172.21.15.45:0/522881184 >> 172.21.15.45:0/522881184 conn(0x7f3ea80d2ca0 msgr2=0x7f3ea80d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:45.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 -- 172.21.15.45:0/522881184 shutdown_connections 2023-12-19T17:59:45.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.485+0000 7f3eae958700 1 -- 172.21.15.45:0/522881184 wait complete. 2023-12-19T17:59:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.489+0000 7f3eae958700 1 Processor -- start 2023-12-19T17:59:45.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.489+0000 7f3eae958700 1 -- start start 2023-12-19T17:59:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ea80b2040 0x7f3ea815b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 0x7f3ea815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80cb5f0 con 0x7f3ea80d2620 2023-12-19T17:59:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80cb8d0 con 0x7f3ea8070ab0 2023-12-19T17:59:45.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea80cbbb0 con 0x7f3ea80b2040 2023-12-19T17:59:45.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 0x7f3ea815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 0x7f3ea815e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35004/0 (socket says 172.21.15.45:35004) 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 -- 172.21.15.45:0/3759030821 learned_addr learned my addr 172.21.15.45:0/3759030821 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3ead956700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3ead155700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ea80b2040 0x7f3ea815b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 -- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ea80b2040 msgr2=0x7f3ea815b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ea80b2040 0x7f3ea815b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 -- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea8070ab0 msgr2=0x7f3ea80cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 -- 172.21.15.45:0/3759030821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009570 con 0x7f3ea80d2620 2023-12-19T17:59:45.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae157700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 0x7f3ea815e7d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009fa0 tx=0x7f3ea000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea000de60 con 0x7f3ea80d2620 2023-12-19T17:59:45.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea000f040 con 0x7f3ea80d2620 2023-12-19T17:59:45.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea80cbe90 con 0x7f3ea80d2620 2023-12-19T17:59:45.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea0003ca0 con 0x7f3ea80d2620 2023-12-19T17:59:45.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.493+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea80cc450 con 0x7f3ea80d2620 2023-12-19T17:59:45.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.497+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea80cc670 con 0x7f3ea80d2620 2023-12-19T17:59:45.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.497+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3ea0004030 con 0x7f3ea80d2620 2023-12-19T17:59:45.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.501+0000 7f3e9e7fc700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3e8c065ad0 0x7f3e8c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.501+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3ea00833b0 con 0x7f3ea80d2620 2023-12-19T17:59:45.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.501+0000 7f3ead956700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3e8c065ad0 0x7f3e8c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.501+0000 7f3ead956700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3e8c065ad0 0x7f3e8c067f90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.509+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3ea0050c20 con 0x7f3ea80d2620 2023-12-19T17:59:45.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.745+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3ea8067760 con 0x7f3ea80d2620 2023-12-19T17:59:45.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.757+0000 7f3e9e7fc700 1 -- 172.21.15.45:0/3759030821 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3ea0054240 con 0x7f3ea80d2620 2023-12-19T17:59:45.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3e8c065ad0 msgr2=0x7f3e8c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3e8c065ad0 0x7f3e8c067f90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3ea4000c00 tx=0x7f3ea4008030 comp rx=0 tx=0).stop 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 msgr2=0x7f3ea815e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 0x7f3ea815e7d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f3ea0009fa0 tx=0x7f3ea000d3b0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 shutdown_connections 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3e8c065ad0 0x7f3e8c067f90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3ea80d2620 0x7f3ea815e7d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3ea80b2040 0x7f3ea815b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 --2- 172.21.15.45:0/3759030821 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3ea8070ab0 0x7f3ea80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 >> 172.21.15.45:0/3759030821 conn(0x7f3ea80d2ca0 msgr2=0x7f3ea80b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 shutdown_connections 2023-12-19T17:59:45.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.761+0000 7f3eae958700 1 -- 172.21.15.45:0/3759030821 wait complete. 2023-12-19T17:59:45.767 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-19T17:59:45.788 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:45.823 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T17:59:45.818+0000 7fd783803700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T17:59:45.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.969+0000 7fa442017700 1 Processor -- start 2023-12-19T17:59:45.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.969+0000 7fa442017700 1 -- start start 2023-12-19T17:59:45.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa442017700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa43c15ab50 0x7fa43c0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa442017700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa43c15af30 0x7fa43c0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa442017700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa442017700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c06cbb0 con 0x7fa43c15af30 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa442017700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa43c06fa10 con 0x7fa43c15ab50 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa442017700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c06fcf0 con 0x7fa43c06f4a0 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa43affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa43c15af30 0x7fa43c0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa43b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa43c15ab50 0x7fa43c0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa43bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa43affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa43c15af30 0x7fa43c0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35020/0 (socket says 172.21.15.45:35020) 2023-12-19T17:59:45.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa43b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa43c15ab50 0x7fa43c0ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40058/0 (socket says 172.21.15.45:40058) 2023-12-19T17:59:45.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.973+0000 7fa43affd700 1 -- 172.21.15.45:0/755663810 learned_addr learned my addr 172.21.15.45:0/755663810 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:45.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43affd700 1 -- 172.21.15.45:0/755663810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 msgr2=0x7fa43c15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:45.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43affd700 1 --2- 172.21.15.45:0/755663810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c15e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43affd700 1 -- 172.21.15.45:0/755663810 >> v2:172.21.15.73:3300/0 conn(0x7fa43c15ab50 msgr2=0x7fa43c0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:45.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43affd700 1 --2- 172.21.15.45:0/755663810 >> v2:172.21.15.73:3300/0 conn(0x7fa43c15ab50 0x7fa43c0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43affd700 1 -- 172.21.15.45:0/755663810 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa43c06ffd0 con 0x7fa43c15af30 2023-12-19T17:59:45.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43affd700 1 --2- 172.21.15.45:0/755663810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c0cd2b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa43c070630 tx=0x7fa430009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbde8cf3307826c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43a7fc700 1 -- 172.21.15.45:0/755663810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011830 con 0x7fa43c15af30 2023-12-19T17:59:45.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43a7fc700 1 -- 172.21.15.45:0/755663810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa430011990 con 0x7fa43c15af30 2023-12-19T17:59:45.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa43a7fc700 1 -- 172.21.15.45:0/755663810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa430011d20 con 0x7fa43c15af30 2023-12-19T17:59:45.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 -- 172.21.15.45:0/755663810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 msgr2=0x7fa43c0cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 --2- 172.21.15.45:0/755663810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c0cd2b0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa43c070630 tx=0x7fa430009bf0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 -- 172.21.15.45:0/755663810 shutdown_connections 2023-12-19T17:59:45.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 --2- 172.21.15.45:0/755663810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c15e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 --2- 172.21.15.45:0/755663810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c0cd2b0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 --2- 172.21.15.45:0/755663810 >> v2:172.21.15.73:3300/0 conn(0x7fa43c15ab50 0x7fa43c0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 -- 172.21.15.45:0/755663810 >> 172.21.15.45:0/755663810 conn(0x7fa43c0cba40 msgr2=0x7fa43c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:45.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 -- 172.21.15.45:0/755663810 shutdown_connections 2023-12-19T17:59:45.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.977+0000 7fa442017700 1 -- 172.21.15.45:0/755663810 wait complete. 2023-12-19T17:59:45.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.981+0000 7fa442017700 1 Processor -- start 2023-12-19T17:59:45.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.981+0000 7fa442017700 1 -- start start 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa43c15ab50 0x7fa43c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c150ef0 con 0x7fa43c15af30 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0ac350 con 0x7fa43c15ab50 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa43c0c4b60 con 0x7fa43c06f4a0 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:35162/0 (socket says 172.21.15.45:35162) 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43b7fe700 1 -- 172.21.15.45:0/2163188219 learned_addr learned my addr 172.21.15.45:0/2163188219 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:45.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43affd700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa43c15ab50 0x7fa43c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 -- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 msgr2=0x7fa43c151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 -- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa43c15ab50 msgr2=0x7fa43c0acdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa43c15ab50 0x7fa43c0acdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 -- 172.21.15.45:0/2163188219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa430009570 con 0x7fa43c15af30 2023-12-19T17:59:45.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa43bfff700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c1509b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa43400eba0 tx=0x7fa43400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa434009a80 con 0x7fa43c15af30 2023-12-19T17:59:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa43400f040 con 0x7fa43c15af30 2023-12-19T17:59:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa43400cc40 con 0x7fa43c15af30 2023-12-19T17:59:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa43c0ac5f0 con 0x7fa43c15af30 2023-12-19T17:59:45.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.985+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa43c0c4e40 con 0x7fa43c15af30 2023-12-19T17:59:45.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.989+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa43c0acb10 con 0x7fa43c15af30 2023-12-19T17:59:45.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.989+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa434014480 con 0x7fa43c15af30 2023-12-19T17:59:45.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.989+0000 7fa423fff700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa428065ad0 0x7fa428067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:45.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.989+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa434006e40 con 0x7fa43c15af30 2023-12-19T17:59:45.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.989+0000 7fa43b7fe700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa428065ad0 0x7fa428067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:45.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.993+0000 7fa43b7fe700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa428065ad0 0x7fa428067f90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0c3f60 tx=0x7fa42c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:45.997+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa43c0acb10 con 0x7fa43c15af30 2023-12-19T17:59:46.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.209+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa43c0acb10 con 0x7fa43c15af30 2023-12-19T17:59:46.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.209+0000 7fa423fff700 1 -- 172.21.15.45:0/2163188219 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4714 (secure 0 0 0) 0x7fa43c0acb10 con 0x7fa43c15af30 2023-12-19T17:59:46.215 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:46.215 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":57,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:59:40.348016+0000","modified":"2023-12-19T17:59:43.386570+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56312":{"gid":56312,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/2667696599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2667696599},{"type":"v1","addr":"172.21.15.73:6835","nonce":2667696599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T17:59:46.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa428065ad0 msgr2=0x7fa428067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa428065ad0 0x7fa428067f90 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fa43c0c3f60 tx=0x7fa42c009240 comp rx=0 tx=0).stop 2023-12-19T17:59:46.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 msgr2=0x7fa43c1509b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c1509b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fa43400eba0 tx=0x7fa43400eeb0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 shutdown_connections 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa428065ad0 0x7fa428067f90 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa43c15af30 0x7fa43c1509b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa43c15ab50 0x7fa43c0acdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 --2- 172.21.15.45:0/2163188219 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa43c06f4a0 0x7fa43c151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 >> 172.21.15.45:0/2163188219 conn(0x7fa43c0cba40 msgr2=0x7fa43c0c9770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 shutdown_connections 2023-12-19T17:59:46.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.213+0000 7fa442017700 1 -- 172.21.15.45:0/2163188219 wait complete. 2023-12-19T17:59:46.221 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 57 2023-12-19T17:59:46.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T17:59:40.348016+0000', 'modified': '2023-12-19T17:59:43.386570+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 56312}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_56312': {'gid': 56312, 'name': 'b', 'rank': 0, 'incarnation': 53, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6835/2667696599', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 2667696599}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 2667696599}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T17:59:46.647 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T17:59:46.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T17:59:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.833+0000 7f8581f45700 1 Processor -- start 2023-12-19T17:59:46.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.833+0000 7f8581f45700 1 -- start start 2023-12-19T17:59:46.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f8581f45700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f857c06cad0 0x7f857c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f8581f45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c0af720 0x7f857c0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f8581f45700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857c06f0a0 con 0x7f857c15ae20 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f8581f45700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f857c0b0110 con 0x7f857c06cad0 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f8581f45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c06ea90 con 0x7f857c0af720 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f857c06cad0 0x7f857c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f857c06cad0 0x7f857c15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40072/0 (socket says 172.21.15.45:40072) 2023-12-19T17:59:46.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 -- 172.21.15.45:0/2954710807 learned_addr learned my addr 172.21.15.45:0/2954710807 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f8581744700 1 --2- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c0af720 0x7f857c0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 -- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c0af720 msgr2=0x7f857c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 --2- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c0af720 0x7f857c0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 -- 172.21.15.45:0/2954710807 >> v1:172.21.15.73:6789/0 conn(0x7f857c15ae20 legacy=0x7f857c0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 -- 172.21.15.45:0/2954710807 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f857c0c3f60 con 0x7f857c06cad0 2023-12-19T17:59:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857bfff700 1 --2- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c06cad0 0x7f857c15be40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8568009910 tx=0x7f8568009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6aba368823e6ddc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857b7fe700 1 -- 172.21.15.45:0/2954710807 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011830 con 0x7f857c06cad0 2023-12-19T17:59:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857b7fe700 1 -- 172.21.15.45:0/2954710807 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568011990 con 0x7f857c06cad0 2023-12-19T17:59:46.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.837+0000 7f857b7fe700 1 -- 172.21.15.45:0/2954710807 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568011d40 con 0x7f857c06cad0 2023-12-19T17:59:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 -- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c06cad0 msgr2=0x7f857c15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 --2- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c06cad0 0x7f857c15be40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8568009910 tx=0x7f8568009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 -- 172.21.15.45:0/2954710807 shutdown_connections 2023-12-19T17:59:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 --2- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c0af720 0x7f857c0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 --2- 172.21.15.45:0/2954710807 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c06cad0 0x7f857c15be40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 -- 172.21.15.45:0/2954710807 >> 172.21.15.45:0/2954710807 conn(0x7f857c0cb900 msgr2=0x7f857c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 -- 172.21.15.45:0/2954710807 shutdown_connections 2023-12-19T17:59:46.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.841+0000 7f8581f45700 1 -- 172.21.15.45:0/2954710807 wait complete. 2023-12-19T17:59:46.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 Processor -- start 2023-12-19T17:59:46.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 -- start start 2023-12-19T17:59:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 0x7f857c0c7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c0af720 0x7f857c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c15ae20 0x7f857c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0c8e10 con 0x7f857c15ae20 2023-12-19T17:59:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0c90f0 con 0x7f857c0af720 2023-12-19T17:59:46.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581f45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f857c0b3990 con 0x7f857c06cad0 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8580f43700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 0x7f857c0c7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8581744700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c15ae20 0x7f857c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8580f43700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 0x7f857c0c7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:35176/0 (socket says 172.21.15.45:35176) 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f8580f43700 1 -- 172.21.15.45:0/10142772 learned_addr learned my addr 172.21.15.45:0/10142772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.845+0000 7f857bfff700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c0af720 0x7f857c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8580f43700 1 -- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c0af720 msgr2=0x7f857c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8580f43700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c0af720 0x7f857c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8580f43700 1 -- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c15ae20 msgr2=0x7f857c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8580f43700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c15ae20 0x7f857c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8580f43700 1 -- 172.21.15.45:0/10142772 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009570 con 0x7f857c06cad0 2023-12-19T17:59:46.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8580f43700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 0x7f857c0c7190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f857000c440 tx=0x7f857000c750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f85797fa700 1 -- 172.21.15.45:0/10142772 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700052d0 con 0x7f857c06cad0 2023-12-19T17:59:46.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f85797fa700 1 -- 172.21.15.45:0/10142772 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570005430 con 0x7f857c06cad0 2023-12-19T17:59:46.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f85797fa700 1 -- 172.21.15.45:0/10142772 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700055a0 con 0x7f857c06cad0 2023-12-19T17:59:46.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f857c0c7770 con 0x7f857c06cad0 2023-12-19T17:59:46.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.849+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0c7d30 con 0x7f857c06cad0 2023-12-19T17:59:46.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.853+0000 7f85797fa700 1 -- 172.21.15.45:0/10142772 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f85700036a0 con 0x7f857c06cad0 2023-12-19T17:59:46.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.853+0000 7f8586432740 1 Processor -- start 2023-12-19T17:59:46.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.853+0000 7f8586432740 1 -- start start 2023-12-19T17:59:46.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.853+0000 7f85797fa700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8560065ad0 0x7f8560067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.853+0000 7f85797fa700 1 -- 172.21.15.45:0/10142772 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f85700824b0 con 0x7f857c06cad0 2023-12-19T17:59:46.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1301290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8581744700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8560065ad0 0x7f8560067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x12285b0 con 0x12df430 2023-12-19T17:59:46.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1225d40 con 0x1300eb0 2023-12-19T17:59:46.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1221630 con 0x13017d0 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f857bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1301290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40094/0 (socket says 172.21.15.45:40094) 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 -- 172.21.15.45:0/818561257 learned_addr learned my addr 172.21.15.45:0/818561257 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f857bfff700 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1301290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35054/0 (socket says 172.21.15.45:35054) 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8581744700 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 -- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 msgr2=0x12b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 -- 172.21.15.45:0/818561257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 msgr2=0x1301290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1301290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 -- 172.21.15.45:0/818561257 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1094960 con 0x1300eb0 2023-12-19T17:59:46.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8581744700 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:46.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8581744700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8560065ad0 0x7f8560067f90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8574013750 tx=0x7f8574013b10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8580f43700 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b6e10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8570080740 tx=0x7f857000a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0bdcadaf5ae1ae9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f85667fc700 1 -- 172.21.15.45:0/818561257 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570057780 con 0x1300eb0 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f85667fc700 1 -- 172.21.15.45:0/818561257 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857005b930 con 0x1300eb0 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f85667fc700 1 -- 172.21.15.45:0/818561257 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000ce10 con 0x1300eb0 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 msgr2=0x12b6e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b6e10 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f8570080740 tx=0x7f857000a000 comp rx=0 tx=0).stop 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- 172.21.15.45:0/818561257 shutdown_connections 2023-12-19T17:59:46.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1301290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 --2- 172.21.15.45:0/818561257 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b6e10 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- 172.21.15.45:0/818561257 >> 172.21.15.45:0/818561257 conn(0x10494d0 msgr2=0x12bad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- 172.21.15.45:0/818561257 shutdown_connections 2023-12-19T17:59:46.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.857+0000 7f8586432740 1 -- 172.21.15.45:0/818561257 wait complete. 2023-12-19T17:59:46.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 -- start start 2023-12-19T17:59:46.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 Processor -- start 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12df430 0x12bab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 0x12ffc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x13017d0 0x12c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x11dec80 con 0x1300eb0 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x11e4b00 con 0x13017d0 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x10cdaa0 con 0x12df430 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f8586432740 10 client.0 _ll_register_callbacks cb 0x121af70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f857bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 0x12ffc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.861+0000 7f857bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 0x12ffc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35068/0 (socket says 172.21.15.45:35068) 2023-12-19T17:59:46.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 -- 172.21.15.45:0/43374570 learned_addr learned my addr 172.21.15.45:0/43374570 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:46.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8580f43700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12df430 0x12bab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8581744700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x13017d0 0x12c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 -- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12df430 msgr2=0x12bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12df430 0x12bab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 -- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x13017d0 msgr2=0x12c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x13017d0 0x12c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 -- 172.21.15.45:0/43374570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f857c0c7d30 con 0x1300eb0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f857bfff700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 0x12ffc20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8568011d30 tx=0x7f85680047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61dd3382fb4e997f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f855b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f855b7fe700 1 -- 172.21.15.45:0/43374570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856802a070 con 0x1300eb0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f855b7fe700 1 -- 172.21.15.45:0/43374570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f85680117d0 con 0x1300eb0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x121a6b0 con 0x1300eb0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f855b7fe700 1 -- 172.21.15.45:0/43374570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8568020040 con 0x1300eb0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 10 client.7350 fetch_fsmap learned FSMap version 57 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x11e7770 con 0x1300eb0 2023-12-19T17:59:46.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f855b7fe700 1 -- 172.21.15.45:0/43374570 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x121a6b0 con 0x1300eb0 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f855b7fe700 1 -- 172.21.15.45:0/43374570 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f856802d020 con 0x1300eb0 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 10 client.7350 fetch_fsmap finished waiting for FSMap version 57 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 10 client.7350 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 20 client.7350 populate_metadata read hostname 'smithi045' 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x12c7ea0 0x12c8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 4 client.7350 mds_command: new command op to 56312 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 --> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x11dca00 con 0x12c7ea0 2023-12-19T17:59:46.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.865+0000 7f8580f43700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x12c7ea0 0x12c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8580f43700 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x12c7ea0 0x12c8280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6dd62da0596d95e server_cookie=e351120d31af9a10 in_seq=0 out_seq=0 2023-12-19T17:59:46.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f855b7fe700 10 client.7350 ms_handle_connect on v2:172.21.15.73:6834/2667696599 2023-12-19T17:59:46.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f855b7fe700 1 -- 172.21.15.45:0/43374570 <== mds.0 v2:172.21.15.73:6834/2667696599 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x11dca00 con 0x12c7ea0 2023-12-19T17:59:46.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f855b7fe700 10 client.7350 handle_command_reply: tid=0 2023-12-19T17:59:46.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 client.7350 shutdown 2023-12-19T17:59:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 msgr2=0x12ffc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 0x12ffc20 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8568011d30 tx=0x7f85680047e0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 shutdown_connections 2023-12-19T17:59:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x12c7ea0 0x12c8280 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x13017d0 0x12c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1300eb0 0x12ffc20 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 --2- 172.21.15.45:0/43374570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x12df430 0x12bab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 >> 172.21.15.45:0/43374570 conn(0x10494d0 msgr2=0x12e1bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f855b7fe700 0 client.7350 ms_handle_reset on v2:172.21.15.73:6834/2667696599 2023-12-19T17:59:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 shutdown_connections 2023-12-19T17:59:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 1 -- 172.21.15.45:0/43374570 wait complete. 2023-12-19T17:59:46.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.869+0000 7f8586432740 20 client.7350 trim_cache size 0 max 16384 2023-12-19T17:59:46.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.893+0000 7f8586432740 1 Processor -- start 2023-12-19T17:59:46.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.893+0000 7f8586432740 1 -- start start 2023-12-19T17:59:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8586432740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1309550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b7e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b8370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8586432740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x12b9930 con 0x12df430 2023-12-19T17:59:46.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x121ea30 con 0x1300eb0 2023-12-19T17:59:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x121ee40 con 0x13017d0 2023-12-19T17:59:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1309550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1309550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35070/0 (socket says 172.21.15.45:35070) 2023-12-19T17:59:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 -- 172.21.15.45:0/2971833474 learned_addr learned my addr 172.21.15.45:0/2971833474 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8581744700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f857bfff700 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 -- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 msgr2=0x12b8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 -- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 msgr2=0x12b7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 -- 172.21.15.45:0/2971833474 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12bae70 con 0x12df430 2023-12-19T17:59:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8580f43700 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1309550 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f857000c410 tx=0x7f8570055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff39cb2659e5b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8566ffd700 1 -- 172.21.15.45:0/2971833474 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570057800 con 0x12df430 2023-12-19T17:59:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8566ffd700 1 -- 172.21.15.45:0/2971833474 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8570080040 con 0x12df430 2023-12-19T17:59:46.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.897+0000 7f8566ffd700 1 -- 172.21.15.45:0/2971833474 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857000ce10 con 0x12df430 2023-12-19T17:59:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 -- 172.21.15.45:0/2971833474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 msgr2=0x1309550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1309550 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f857000c410 tx=0x7f8570055000 comp rx=0 tx=0).stop 2023-12-19T17:59:46.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 -- 172.21.15.45:0/2971833474 shutdown_connections 2023-12-19T17:59:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x13017d0 0x12b8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x12b7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 --2- 172.21.15.45:0/2971833474 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x12df430 0x1309550 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 -- 172.21.15.45:0/2971833474 >> 172.21.15.45:0/2971833474 conn(0x10494d0 msgr2=0x12dd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 -- 172.21.15.45:0/2971833474 shutdown_connections 2023-12-19T17:59:46.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 -- 172.21.15.45:0/2971833474 wait complete. 2023-12-19T17:59:46.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 -- start start 2023-12-19T17:59:46.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.901+0000 7f8586432740 1 Processor -- start 2023-12-19T17:59:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x135e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 0x12fe4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1306b70 0x12fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x11ef670 con 0x13017d0 2023-12-19T17:59:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x11ac480 con 0x1300eb0 2023-12-19T17:59:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x11c93d0 con 0x1306b70 2023-12-19T17:59:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8586432740 10 client.0 _ll_register_callbacks cb 0x115ae10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T17:59:46.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 0x12fe4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 0x12fe4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35074/0 (socket says 172.21.15.45:35074) 2023-12-19T17:59:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 -- 172.21.15.45:0/2931184045 learned_addr learned my addr 172.21.15.45:0/2931184045 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8580f43700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x135e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8581744700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1306b70 0x12fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 -- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1306b70 msgr2=0x12fe9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1306b70 0x12fe9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 -- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 msgr2=0x135e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x135e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 -- 172.21.15.45:0/2931184045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1094960 con 0x13017d0 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f8580f43700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x135e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f857bfff700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 0x12fe4b0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8568004860 tx=0x7f8568011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526ecfaa884da1f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:46.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.905+0000 7f855b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T17:59:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 1 -- 172.21.15.45:0/2931184045 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856802a070 con 0x13017d0 2023-12-19T17:59:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f857005b930 con 0x13017d0 2023-12-19T17:59:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 1 -- 172.21.15.45:0/2931184045 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8568000e40 con 0x13017d0 2023-12-19T17:59:46.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 1 -- 172.21.15.45:0/2931184045 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8568020040 con 0x13017d0 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 10 client.7356 fetch_fsmap learned FSMap version 57 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x11cd9a0 con 0x13017d0 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 1 -- 172.21.15.45:0/2931184045 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857005b930 con 0x13017d0 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 1 -- 172.21.15.45:0/2931184045 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8568009c90 con 0x13017d0 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 10 client.7356 fetch_fsmap finished waiting for FSMap version 57 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 10 client.7356 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 20 client.7356 populate_metadata read hostname 'smithi045' 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x13057d0 0x1305bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 4 client.7356 mds_command: new command op to 56312 tid=0[{"prefix": "status"}] 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 --> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] -- command(tid 0: {"prefix": "status"}) v1 -- 0x10a0460 con 0x13057d0 2023-12-19T17:59:46.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8580f43700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x13057d0 0x1305bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8580f43700 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x13057d0 0x1305bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35cd85f138f406cc server_cookie=187bae4c5df1e261 in_seq=0 out_seq=0 2023-12-19T17:59:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 10 client.7356 ms_handle_connect on v2:172.21.15.73:6834/2667696599 2023-12-19T17:59:46.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 1 -- 172.21.15.45:0/2931184045 <== mds.0 v2:172.21.15.73:6834/2667696599 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x10a0460 con 0x13057d0 2023-12-19T17:59:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f855b7fe700 10 client.7356 handle_command_reply: tid=0 2023-12-19T17:59:46.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.909+0000 7f8586432740 1 client.7356 shutdown 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 msgr2=0x12fe4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 0x12fe4b0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f8568004860 tx=0x7f8568011000 comp rx=0 tx=0).stop 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 shutdown_connections 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:6834/2667696599,v1:172.21.15.73:6835/2667696599] conn(0x13057d0 0x1305bb0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1306b70 0x12fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x13017d0 0x12fe4b0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 --2- 172.21.15.45:0/2931184045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1300eb0 0x135e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 >> 172.21.15.45:0/2931184045 conn(0x10494d0 msgr2=0x12dd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f855b7fe700 0 client.7356 ms_handle_reset on v2:172.21.15.73:6834/2667696599 2023-12-19T17:59:46.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 shutdown_connections 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 1 -- 172.21.15.45:0/2931184045 wait complete. 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8586432740 20 client.7356 trim_cache size 0 max 16384 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 56312, 2023-12-19T17:59:46.918 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.5579467530000004, 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 57, 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 85, 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 85, 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 11.764045741 2023-12-19T17:59:46.919 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8560065ad0 msgr2=0x7f8560067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8560065ad0 0x7f8560067f90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f8574013750 tx=0x7f8574013b10 comp rx=0 tx=0).stop 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 msgr2=0x7f857c0c7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 0x7f857c0c7190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f857000c440 tx=0x7f857000c750 comp rx=0 tx=0).stop 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 shutdown_connections 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8560065ad0 0x7f8560067f90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f857c15ae20 0x7f857c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f857c0af720 0x7f857c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 --2- 172.21.15.45:0/10142772 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f857c06cad0 0x7f857c0c7190 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 >> 172.21.15.45:0/10142772 conn(0x7f857c0cb900 msgr2=0x7f857c0cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 shutdown_connections 2023-12-19T17:59:46.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:46.913+0000 7f8581f45700 1 -- 172.21.15.45:0/10142772 wait complete. 2023-12-19T17:59:46.944 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T17:59:47.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.117+0000 7fb415351700 1 Processor -- start 2023-12-19T17:59:47.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.117+0000 7fb415351700 1 -- start start 2023-12-19T17:59:47.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb415351700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb41006ea90 0x7fb4100d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb415351700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb41006fe80 0x7fb4100b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb415351700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4100d1820 con 0x7fb4100b88b0 2023-12-19T17:59:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb415351700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4100d1b00 con 0x7fb41006fe80 2023-12-19T17:59:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb415351700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100d1de0 con 0x7fb41006ea90 2023-12-19T17:59:47.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb40f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb4100b88b0 0x7fb4100b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46706/0 (socket says 172.21.15.45:46706) 2023-12-19T17:59:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb40f7fe700 1 -- 172.21.15.45:0/1604674495 learned_addr learned my addr 172.21.15.45:0/1604674495 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb414b50700 1 --2- 172.21.15.45:0/1604674495 >> v2:172.21.15.73:3300/0 conn(0x7fb41006fe80 0x7fb4100b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.121+0000 7fb40ffff700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb41006ea90 0x7fb4100d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:47.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb40effd700 1 -- 172.21.15.45:0/1604674495 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755282438 0 0) 0x7fb4100d1820 con 0x7fb4100b88b0 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb40effd700 1 -- 172.21.15.45:0/1604674495 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3f80035d0 con 0x7fb4100b88b0 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb414b50700 1 -- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb41006ea90 msgr2=0x7fb4100d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb414b50700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb41006ea90 0x7fb4100d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb414b50700 1 -- 172.21.15.45:0/1604674495 >> v1:172.21.15.45:6789/0 conn(0x7fb4100b88b0 legacy=0x7fb4100b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb414b50700 1 -- 172.21.15.45:0/1604674495 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4100d20c0 con 0x7fb41006fe80 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb40ffff700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb41006ea90 0x7fb4100d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:47.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb414b50700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006fe80 0x7fb4100b6420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb408009d90 tx=0x7fb40800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9725e1cd138192d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb40effd700 1 -- 172.21.15.45:0/1604674495 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40800e070 con 0x7fb41006fe80 2023-12-19T17:59:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb40effd700 1 -- 172.21.15.45:0/1604674495 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40800bb20 con 0x7fb41006fe80 2023-12-19T17:59:47.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb40effd700 1 -- 172.21.15.45:0/1604674495 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb408012430 con 0x7fb41006fe80 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 -- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006fe80 msgr2=0x7fb4100b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006fe80 0x7fb4100b6420 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb408009d90 tx=0x7fb40800b330 comp rx=0 tx=0).stop 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 -- 172.21.15.45:0/1604674495 shutdown_connections 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006fe80 0x7fb4100b6420 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 --2- 172.21.15.45:0/1604674495 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb41006ea90 0x7fb4100d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 -- 172.21.15.45:0/1604674495 >> 172.21.15.45:0/1604674495 conn(0x7fb4100b46d0 msgr2=0x7fb4100b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 -- 172.21.15.45:0/1604674495 shutdown_connections 2023-12-19T17:59:47.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.125+0000 7fb415351700 1 -- 172.21.15.45:0/1604674495 wait complete. 2023-12-19T17:59:47.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.129+0000 7fb415351700 1 Processor -- start 2023-12-19T17:59:47.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.129+0000 7fb415351700 1 -- start start 2023-12-19T17:59:47.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006ea90 0x7fb410159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:47.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 0x7fb4100c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:47.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4100b88b0 0x7fb410070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100c6dd0 con 0x7fb41006fe80 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4100ccbe0 con 0x7fb41006ea90 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41015a1e0 con 0x7fb4100b88b0 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 0x7fb4100c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 0x7fb4100c71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:35084/0 (socket says 172.21.15.45:35084) 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 -- 172.21.15.45:0/1172120784 learned_addr learned my addr 172.21.15.45:0/1172120784 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40ffff700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006ea90 0x7fb410159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:47.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb414b50700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4100b88b0 0x7fb410070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 -- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4100b88b0 msgr2=0x7fb410070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4100b88b0 0x7fb410070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 -- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006ea90 msgr2=0x7fb410159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006ea90 0x7fb410159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 -- 172.21.15.45:0/1172120784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009a70 con 0x7fb41006fe80 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40f7fe700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 0x7fb4100c71f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb40400c700 tx=0x7fb40400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404005d90 con 0x7fb41006fe80 2023-12-19T17:59:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4040070d0 con 0x7fb41006fe80 2023-12-19T17:59:47.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4101e6f70 con 0x7fb41006fe80 2023-12-19T17:59:47.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb404007480 con 0x7fb41006fe80 2023-12-19T17:59:47.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.133+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4100c6710 con 0x7fb41006fe80 2023-12-19T17:59:47.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.137+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4100c6f10 con 0x7fb41006fe80 2023-12-19T17:59:47.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.137+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb4040075e0 con 0x7fb41006fe80 2023-12-19T17:59:47.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.141+0000 7fb40cff9700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3fc065ad0 0x7fb3fc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:47.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.141+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb4040827f0 con 0x7fb41006fe80 2023-12-19T17:59:47.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.141+0000 7fb40ffff700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3fc065ad0 0x7fb3fc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:47.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.141+0000 7fb40ffff700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3fc065ad0 0x7fb3fc067f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c960 tx=0x7fb400008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:47.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.149+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb4100c6f10 con 0x7fb41006fe80 2023-12-19T17:59:47.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.365+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4100c6f10 con 0x7fb41006fe80 2023-12-19T17:59:47.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb40cff9700 1 -- 172.21.15.45:0/1172120784 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb4100c6f10 con 0x7fb41006fe80 2023-12-19T17:59:47.373 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3fc065ad0 msgr2=0x7fb3fc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3fc065ad0 0x7fb3fc067f90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fb40000c960 tx=0x7fb400008040 comp rx=0 tx=0).stop 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 msgr2=0x7fb4100c71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 0x7fb4100c71f0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb40400c700 tx=0x7fb40400ca10 comp rx=0 tx=0).stop 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 shutdown_connections 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3fc065ad0 0x7fb3fc067f90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4100b88b0 0x7fb410070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb41006fe80 0x7fb4100c71f0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 --2- 172.21.15.45:0/1172120784 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb41006ea90 0x7fb410159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:47.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 >> 172.21.15.45:0/1172120784 conn(0x7fb4100b46d0 msgr2=0x7fb4100b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:47.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 shutdown_connections 2023-12-19T17:59:47.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:47.369+0000 7fb415351700 1 -- 172.21.15.45:0/1172120784 wait complete. 2023-12-19T17:59:47.398 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T17:59:47.398 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T17:59:47.398 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T17:59:47.398 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T17:59:47.398 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:47.399 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T17:59:47.399 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T17:59:47.399 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T17:59:47.399 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:59:47.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:47.399 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:59:47.415 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41878sec preferred_lft 41878sec 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T17:59:47.416 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.417 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T17:59:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T17:59:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T17:59:47.418 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T17:59:47.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:47.419 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T17:59:47.498 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T17:59:47.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:47.501 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T17:59:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T17:59:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T17:59:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T17:59:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T17:59:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T17:59:47.564 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T17:59:47.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:47.566 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T17:59:47.566 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T17:59:47.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T17:59:47.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T17:59:47.566 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T17:59:47.566 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T17:59:47.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:47.704 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T17:59:47.722 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T17:59:47.722 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T17:59:47.723 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:59:47.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:47.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T17:59:47.800 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T17:59:47.800 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:59:47.800 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:47.866 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T17:59:47.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T17:59:47.867 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:47.926 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:59:48.008 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:59:48.008 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:59:48.087 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:59:48.090 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:59:48.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:48.091 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:59:48.154 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T17:59:48.155 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T17:59:48.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T17:59:48.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T17:59:48.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T17:59:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T17:59:48.316 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T17:59:48.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:48.316 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T17:59:48.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T17:59:48.349+0000 7f20db4b6640 -1 init, newargv = 0x55d8ec5756a0 newargc=15 2023-12-19T17:59:48.354 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[52765]: starting ceph client 2023-12-19T17:59:48.367 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T17:59:48.368 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[52765]: starting fuse 2023-12-19T17:59:48.368 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T17:59:48.368 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:48.368 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T17:59:48.368 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T17:59:48.369 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T17:59:48.370 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:48.542 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.52765.asok 2023-12-19T17:59:48.728 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52765.asok 2023-12-19T17:59:48.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:48.729 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52765.asok status 2023-12-19T17:59:48.943 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:59:48.943 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T17:59:48.943 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T17:59:48.943 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T17:59:48.943 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T17:59:48.943 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "52765", 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7368, 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 7368 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:59:48.944 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1796700627 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1796700627 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.7368 192.168.0.1:0/1796700627", 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1796700627", 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 57, 2023-12-19T17:59:48.945 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 85, 2023-12-19T17:59:48.946 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T17:59:48.946 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T17:59:48.946 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T17:59:48.946 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:59:48.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:48.959 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T17:59:48.959 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:48.980 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T17:59:48.980 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:48.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:48.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:49.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_extra --pg_num_min 64 2023-12-19T17:59:49.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.285+0000 7fad05c9b700 1 Processor -- start 2023-12-19T17:59:49.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.285+0000 7fad05c9b700 1 -- start start 2023-12-19T17:59:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7fad05c9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000c9950 0x7fad000c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7fad05c9b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0006fcd0 con 0x7fad000b26f0 2023-12-19T17:59:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7fad05c9b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0006ffb0 con 0x7fad000c9570 2023-12-19T17:59:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7fad05c9b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad00070290 con 0x7fad000c9950 2023-12-19T17:59:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fad000b26f0 0x7fad000b2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36640/0 (socket says 172.21.15.45:36640) 2023-12-19T17:59:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfffff700 1 -- 172.21.15.45:0/656367055 learned_addr learned my addr 172.21.15.45:0/656367055 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facf7fff700 1 --2- 172.21.15.45:0/656367055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000c9950 0x7fad000c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4100229783 0 0) 0x7fad0006fcd0 con 0x7fad000b26f0 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facec0035d0 con 0x7fad000b26f0 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244856673 0 0) 0x7fad0006ffb0 con 0x7fad000c9570 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0006fcd0 con 0x7fad000c9570 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facf7fff700 1 -- 172.21.15.45:0/656367055 >> v1:172.21.15.73:6789/0 conn(0x7fad000c9570 legacy=0x7fad0006f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facf7fff700 1 -- 172.21.15.45:0/656367055 >> v1:172.21.15.45:6789/0 conn(0x7fad000b26f0 legacy=0x7fad000b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facf7fff700 1 -- 172.21.15.45:0/656367055 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad000b21d0 con 0x7fad000c9950 2023-12-19T17:59:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facf7fff700 1 --2- 172.21.15.45:0/656367055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000c9950 0x7fad000c9fc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7face8009880 tx=0x7face8009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60cff36de5af11b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8011830 con 0x7fad000c9950 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face8011990 con 0x7fad000c9950 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.289+0000 7facfeffd700 1 -- 172.21.15.45:0/656367055 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8011d20 con 0x7fad000c9950 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 -- 172.21.15.45:0/656367055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000c9950 msgr2=0x7fad000c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 --2- 172.21.15.45:0/656367055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000c9950 0x7fad000c9fc0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7face8009880 tx=0x7face8009b90 comp rx=0 tx=0).stop 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 -- 172.21.15.45:0/656367055 shutdown_connections 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 --2- 172.21.15.45:0/656367055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000c9950 0x7fad000c9fc0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 -- 172.21.15.45:0/656367055 >> 172.21.15.45:0/656367055 conn(0x7fad000cf0d0 msgr2=0x7fad000cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 -- 172.21.15.45:0/656367055 shutdown_connections 2023-12-19T17:59:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 -- 172.21.15.45:0/656367055 wait complete. 2023-12-19T17:59:49.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 Processor -- start 2023-12-19T17:59:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.293+0000 7fad05c9b700 1 -- start start 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000b26f0 0x7fad000c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 0x7fad0006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad000c9950 0x7fad0006efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad001594a0 con 0x7fad000c9570 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad00158b70 con 0x7fad000c9950 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad00158e50 con 0x7fad000b26f0 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 0x7fad0006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 0x7fad0006ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37080/0 (socket says 172.21.15.45:37080) 2023-12-19T17:59:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 -- 172.21.15.45:0/2825819570 learned_addr learned my addr 172.21.15.45:0/2825819570 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facfffff700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad000c9950 0x7fad0006efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facff7fe700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000b26f0 0x7fad000c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 -- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000b26f0 msgr2=0x7fad000c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000b26f0 0x7fad000c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 -- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad000c9950 msgr2=0x7fad0006efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad000c9950 0x7fad0006efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 -- 172.21.15.45:0/2825819570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face80094b0 con 0x7fad000c9570 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facff7fe700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000b26f0 0x7fad000c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facf7fff700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 0x7fad0006ea90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7face8009bd0 tx=0x7face8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8004510 con 0x7fad000c9570 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7face801e070 con 0x7fad000c9570 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad00159130 con 0x7fad000c9570 2023-12-19T17:59:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7face8003900 con 0x7fad000c9570 2023-12-19T17:59:49.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.297+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad00159930 con 0x7fad000c9570 2023-12-19T17:59:49.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.301+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0004ed30 con 0x7fad000c9570 2023-12-19T17:59:49.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.301+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7face8003a60 con 0x7fad000c9570 2023-12-19T17:59:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.301+0000 7facfcff9700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7face0065ad0 0x7face0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.305+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6029+0+0 (secure 0 0 0) 0x7face8083ff0 con 0x7fad000c9570 2023-12-19T17:59:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.305+0000 7facff7fe700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7face0065ad0 0x7face0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.305+0000 7facff7fe700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7face0065ad0 0x7face0067f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7facf00017d0 tx=0x7facf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.309+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7face80b50a0 con 0x7fad000c9570 2023-12-19T17:59:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.489+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64} v 0) v1 -- 0x7fad00159b80 con 0x7fad000c9570 2023-12-19T17:59:49.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.617+0000 7facfcff9700 1 -- 172.21.15.45:0/2825819570 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64}]=0 pool 'cephfs_data_extra' created v86) v1 ==== 142+0+0 (secure 0 0 0) 0x7face80200b0 con 0x7fad000c9570 2023-12-19T17:59:49.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7face0065ad0 msgr2=0x7face0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7face0065ad0 0x7face0067f90 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7facf00017d0 tx=0x7facf0009040 comp rx=0 tx=0).stop 2023-12-19T17:59:49.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 msgr2=0x7fad0006ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 0x7fad0006ea90 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7face8009bd0 tx=0x7face8004770 comp rx=0 tx=0).stop 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 shutdown_connections 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7face0065ad0 0x7face0067f90 secure :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7facf00017d0 tx=0x7facf0009040 comp rx=0 tx=0).stop 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fad000c9950 0x7fad0006efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fad000c9570 0x7fad0006ea90 secure :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7face8009bd0 tx=0x7face8004770 comp rx=0 tx=0).stop 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 --2- 172.21.15.45:0/2825819570 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fad000b26f0 0x7fad000c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.625+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 >> 172.21.15.45:0/2825819570 conn(0x7fad000cf0d0 msgr2=0x7fad00153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.629+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 shutdown_connections 2023-12-19T17:59:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.629+0000 7fad05c9b700 1 -- 172.21.15.45:0/2825819570 wait complete. 2023-12-19T17:59:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' created 2023-12-19T17:59:49.654 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_extra 2023-12-19T17:59:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.837+0000 7f132a28c700 1 Processor -- start 2023-12-19T17:59:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.837+0000 7f132a28c700 1 -- start start 2023-12-19T17:59:49.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f132a28c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132415b540 0x7f13241621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f132a28c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1324071ae0 0x7f13240af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f132a28c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1324162700 con 0x7f132415b920 2023-12-19T17:59:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f132a28c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13240b2830 con 0x7f1324071ae0 2023-12-19T17:59:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f132a28c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13240b1bb0 con 0x7f132415b540 2023-12-19T17:59:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1324071ae0 0x7f13240af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1324071ae0 0x7f13240af8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37096/0 (socket says 172.21.15.45:37096) 2023-12-19T17:59:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 -- 172.21.15.45:0/3687581496 learned_addr learned my addr 172.21.15.45:0/3687581496 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f132928a700 1 --2- 172.21.15.45:0/3687581496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132415b540 0x7f13241621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1328a89700 1 --1- 172.21.15.45:0/3687581496 >> v1:172.21.15.73:6789/0 conn(0x7f132415b920 0x7f13240713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34458/0 (socket says 172.21.15.45:34458) 2023-12-19T17:59:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f131bfff700 1 -- 172.21.15.45:0/3687581496 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2628497589 0 0) 0x7f1324162700 con 0x7f132415b920 2023-12-19T17:59:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f131bfff700 1 -- 172.21.15.45:0/3687581496 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13100035d0 con 0x7f132415b920 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 -- 172.21.15.45:0/3687581496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132415b540 msgr2=0x7f13241621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 --2- 172.21.15.45:0/3687581496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132415b540 0x7f13241621c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 -- 172.21.15.45:0/3687581496 >> v1:172.21.15.73:6789/0 conn(0x7f132415b920 legacy=0x7f13240713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.841+0000 7f1329a8b700 1 -- 172.21.15.45:0/3687581496 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13240b1e90 con 0x7f1324071ae0 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f1329a8b700 1 --2- 172.21.15.45:0/3687581496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1324071ae0 0x7f13240af8e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f131c009e50 tx=0x7f131c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dd078d3ec19222b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f131bfff700 1 -- 172.21.15.45:0/3687581496 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00e070 con 0x7f1324071ae0 2023-12-19T17:59:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f131bfff700 1 -- 172.21.15.45:0/3687581496 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f131c00b910 con 0x7f1324071ae0 2023-12-19T17:59:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f131bfff700 1 -- 172.21.15.45:0/3687581496 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f131c00bcc0 con 0x7f1324071ae0 2023-12-19T17:59:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 -- 172.21.15.45:0/3687581496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1324071ae0 msgr2=0x7f13240af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 --2- 172.21.15.45:0/3687581496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1324071ae0 0x7f13240af8e0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f131c009e50 tx=0x7f131c00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 -- 172.21.15.45:0/3687581496 shutdown_connections 2023-12-19T17:59:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 --2- 172.21.15.45:0/3687581496 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1324071ae0 0x7f13240af8e0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 --2- 172.21.15.45:0/3687581496 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132415b540 0x7f13241621c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 -- 172.21.15.45:0/3687581496 >> 172.21.15.45:0/3687581496 conn(0x7f13240cf5a0 msgr2=0x7f1324070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 -- 172.21.15.45:0/3687581496 shutdown_connections 2023-12-19T17:59:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.845+0000 7f132a28c700 1 -- 172.21.15.45:0/3687581496 wait complete. 2023-12-19T17:59:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 Processor -- start 2023-12-19T17:59:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 -- start start 2023-12-19T17:59:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132415b540 0x7f13240cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 0x7f1324160e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132414fc70 0x7f13240cd350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132415a2f0 con 0x7f132415b920 2023-12-19T17:59:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f132415a5d0 con 0x7f132415b540 2023-12-19T17:59:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132415a8b0 con 0x7f132414fc70 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 0x7f1324160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 0x7f1324160e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37106/0 (socket says 172.21.15.45:37106) 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 -- 172.21.15.45:0/3292718130 learned_addr learned my addr 172.21.15.45:0/3292718130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1329a8b700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132414fc70 0x7f13240cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132928a700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132415b540 0x7f13240cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 -- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132414fc70 msgr2=0x7f13240cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132414fc70 0x7f13240cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 -- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132415b540 msgr2=0x7f13240cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132415b540 0x7f13240cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 -- 172.21.15.45:0/3292718130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f131c009b30 con 0x7f132415b920 2023-12-19T17:59:49.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1328a89700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 0x7f1324160e50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f131400c700 tx=0x7f131400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:49.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1314005cd0 con 0x7f132415b920 2023-12-19T17:59:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1314005e30 con 0x7f132415b920 2023-12-19T17:59:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132415ab90 con 0x7f132415b920 2023-12-19T17:59:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.849+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13140072f0 con 0x7f132415b920 2023-12-19T17:59:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.853+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1324161390 con 0x7f132415b920 2023-12-19T17:59:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.853+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f132415adb0 con 0x7f132415b920 2023-12-19T17:59:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.853+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1314007450 con 0x7f132415b920 2023-12-19T17:59:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.857+0000 7f1319ffb700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1308065ad0 0x7f1308067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.857+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f1314082930 con 0x7f132415b920 2023-12-19T17:59:49.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.857+0000 7f132928a700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1308065ad0 0x7f1308067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:49.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.857+0000 7f132928a700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1308065ad0 0x7f1308067f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1320009be0 tx=0x7f13200091c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:49.865+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f131404ff90 con 0x7f132415b920 2023-12-19T17:59:50.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.093+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"} v 0) v1 -- 0x7f132404ed30 con 0x7f132415b920 2023-12-19T17:59:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.105+0000 7f1319ffb700 1 -- 172.21.15.45:0/3292718130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"}]=0 added data pool 13 to fsmap v58) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1314017020 con 0x7f132415b920 2023-12-19T17:59:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.117+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1308065ad0 msgr2=0x7f1308067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.117+0000 7f132a28c700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1308065ad0 0x7f1308067f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1320009be0 tx=0x7f13200091c0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.117+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 msgr2=0x7f1324160e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.117+0000 7f132a28c700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 0x7f1324160e50 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f131400c700 tx=0x7f131400ca10 comp rx=0 tx=0).stop 2023-12-19T17:59:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 shutdown_connections 2023-12-19T17:59:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1308065ad0 0x7f1308067f90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f132414fc70 0x7f13240cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f132415b920 0x7f1324160e50 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 --2- 172.21.15.45:0/3292718130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f132415b540 0x7f13240cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 >> 172.21.15.45:0/3292718130 conn(0x7f1324071ae0 msgr2=0x7f1324070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 shutdown_connections 2023-12-19T17:59:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.121+0000 7f132a28c700 1 -- 172.21.15.45:0/3292718130 wait complete. 2023-12-19T17:59:50.129 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 13 to fsmap 2023-12-19T17:59:50.148 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T17:59:50.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.321+0000 7f83f9fd9700 1 Processor -- start 2023-12-19T17:59:50.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f9fd9700 1 -- start start 2023-12-19T17:59:50.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f9fd9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f83f4164a70 0x7f83f40cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f9fd9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83f40c4510 0x7f83f40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f9fd9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83f40cd8b0 con 0x7f83f4164690 2023-12-19T17:59:50.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f9fd9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40cdb80 con 0x7f83f40c4510 2023-12-19T17:59:50.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f9fd9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83f40cde60 con 0x7f83f4164a70 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83f40c4510 0x7f83f40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f83f40c4510 0x7f83f40cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37114/0 (socket says 172.21.15.45:37114) 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 -- 172.21.15.45:0/659320703 learned_addr learned my addr 172.21.15.45:0/659320703 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f2ffd700 1 --2- 172.21.15.45:0/659320703 >> v2:172.21.15.73:3300/0 conn(0x7f83f4164a70 0x7f83f40cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 -- 172.21.15.45:0/659320703 >> v2:172.21.15.73:3300/0 conn(0x7f83f4164a70 msgr2=0x7f83f40cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 --2- 172.21.15.45:0/659320703 >> v2:172.21.15.73:3300/0 conn(0x7f83f4164a70 0x7f83f40cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 -- 172.21.15.45:0/659320703 >> v1:172.21.15.73:6789/0 conn(0x7f83f4164690 legacy=0x7f83f40c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.325+0000 7f83f3fff700 1 -- 172.21.15.45:0/659320703 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f40ce140 con 0x7f83f40c4510 2023-12-19T17:59:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f3fff700 1 --2- 172.21.15.45:0/659320703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f40cd370 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f83f40b4b60 tx=0x7f83ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca6d333c64f25ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f27fc700 1 -- 172.21.15.45:0/659320703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00e070 con 0x7f83f40c4510 2023-12-19T17:59:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f27fc700 1 -- 172.21.15.45:0/659320703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83ec00b9c0 con 0x7f83f40c4510 2023-12-19T17:59:50.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f27fc700 1 -- 172.21.15.45:0/659320703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83ec00bd70 con 0x7f83f40c4510 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 -- 172.21.15.45:0/659320703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 msgr2=0x7f83f40cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/659320703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f40cd370 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f83f40b4b60 tx=0x7f83ec00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 -- 172.21.15.45:0/659320703 shutdown_connections 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/659320703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f40cd370 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/659320703 >> v2:172.21.15.73:3300/0 conn(0x7f83f4164a70 0x7f83f40cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 -- 172.21.15.45:0/659320703 >> 172.21.15.45:0/659320703 conn(0x7f83f40cba40 msgr2=0x7f83f40ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 -- 172.21.15.45:0/659320703 shutdown_connections 2023-12-19T17:59:50.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.329+0000 7f83f9fd9700 1 -- 172.21.15.45:0/659320703 wait complete. 2023-12-19T17:59:50.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 Processor -- start 2023-12-19T17:59:50.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 -- start start 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f4156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83f4164690 0x7f83f40b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83f4164a70 0x7f83f4157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f4157280 con 0x7f83f40c4510 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40c7560 con 0x7f83f4164a70 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f40c7840 con 0x7f83f4164690 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f4156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f4156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37124/0 (socket says 172.21.15.45:37124) 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 -- 172.21.15.45:0/901348100 learned_addr learned my addr 172.21.15.45:0/901348100 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f2ffd700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83f4164690 0x7f83f40b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f3fff700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83f4164a70 0x7f83f4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 -- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83f4164690 msgr2=0x7f83f40b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83f4164690 0x7f83f40b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 -- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83f4164a70 msgr2=0x7f83f4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83f4164a70 0x7f83f4157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 -- 172.21.15.45:0/901348100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec009b30 con 0x7f83f40c4510 2023-12-19T17:59:50.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f37fe700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f4156c10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c500 tx=0x7f83e400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40052d0 con 0x7f83f40c4510 2023-12-19T17:59:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e4005430 con 0x7f83f40c4510 2023-12-19T17:59:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83e40055a0 con 0x7f83f40c4510 2023-12-19T17:59:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f40c7b20 con 0x7f83f40c4510 2023-12-19T17:59:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.333+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f4157b50 con 0x7f83f40c4510 2023-12-19T17:59:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.337+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f404ed30 con 0x7f83f40c4510 2023-12-19T17:59:50.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.337+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f83e40036a0 con 0x7f83f40c4510 2023-12-19T17:59:50.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.337+0000 7f83dbfff700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83e0065ad0 0x7f83e0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.341+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f83e4082780 con 0x7f83f40c4510 2023-12-19T17:59:50.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.341+0000 7f83f2ffd700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83e0065ad0 0x7f83e0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.341+0000 7f83f2ffd700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83e0065ad0 0x7f83e0067f90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f83f40b2100 tx=0x7f83e8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.345+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f83e404fe50 con 0x7f83f40c4510 2023-12-19T17:59:50.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.557+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83f40adfc0 con 0x7f83f40c4510 2023-12-19T17:59:50.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.557+0000 7f83dbfff700 1 -- 172.21.15.45:0/901348100 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f83e4053470 con 0x7f83f40c4510 2023-12-19T17:59:50.564 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:50.564 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:59:40.348016+0000","modified":"2023-12-19T17:59:50.097817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56312":{"gid":56312,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/2667696599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2667696599},{"type":"v1","addr":"172.21.15.73:6835","nonce":2667696599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T17:59:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83e0065ad0 msgr2=0x7f83e0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83e0065ad0 0x7f83e0067f90 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f83f40b2100 tx=0x7f83e8008040 comp rx=0 tx=0).stop 2023-12-19T17:59:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 msgr2=0x7f83f4156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f4156c10 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c500 tx=0x7f83e400c8c0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 shutdown_connections 2023-12-19T17:59:50.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f83e0065ad0 0x7f83e0067f90 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f83f4164a70 0x7f83f4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f83f4164690 0x7f83f40b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 --2- 172.21.15.45:0/901348100 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f83f40c4510 0x7f83f4156c10 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 >> 172.21.15.45:0/901348100 conn(0x7f83f40cba40 msgr2=0x7f83f40ce950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 shutdown_connections 2023-12-19T17:59:50.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.561+0000 7f83f9fd9700 1 -- 172.21.15.45:0/901348100 wait complete. 2023-12-19T17:59:50.569 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-12-19T17:59:50.590 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:50.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.765+0000 7fd51c482700 1 Processor -- start 2023-12-19T17:59:50.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.765+0000 7fd51c482700 1 -- start start 2023-12-19T17:59:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51c482700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd51415ab50 0x7fd5140ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51c482700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 0x7fd5140cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51c482700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51406cbb0 con 0x7fd51415af30 2023-12-19T17:59:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51c482700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51406fa10 con 0x7fd51415ab50 2023-12-19T17:59:50.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51c482700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51406fcf0 con 0x7fd51406e0a0 2023-12-19T17:59:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 0x7fd5140cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 0x7fd5140cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:60478/0 (socket says 172.21.15.45:60478) 2023-12-19T17:59:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 -- 172.21.15.45:0/30285723 learned_addr learned my addr 172.21.15.45:0/30285723 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:50.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51a21e700 1 --2- 172.21.15.45:0/30285723 >> v2:172.21.15.73:3300/0 conn(0x7fd51415ab50 0x7fd5140ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 -- 172.21.15.45:0/30285723 >> v2:172.21.15.73:3300/0 conn(0x7fd51415ab50 msgr2=0x7fd5140ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 --2- 172.21.15.45:0/30285723 >> v2:172.21.15.73:3300/0 conn(0x7fd51415ab50 0x7fd5140ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 -- 172.21.15.45:0/30285723 >> v1:172.21.15.73:6789/0 conn(0x7fd51415af30 legacy=0x7fd51415e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 -- 172.21.15.45:0/30285723 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51406ffd0 con 0x7fd51406e0a0 2023-12-19T17:59:50.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.769+0000 7fd51aa1f700 1 --2- 172.21.15.45:0/30285723 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 0x7fd5140cd2b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96f179b5b317b6fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:50.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51921c700 1 -- 172.21.15.45:0/30285723 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00e070 con 0x7fd51406e0a0 2023-12-19T17:59:50.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51921c700 1 -- 172.21.15.45:0/30285723 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00b910 con 0x7fd51406e0a0 2023-12-19T17:59:50.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51921c700 1 -- 172.21.15.45:0/30285723 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00bcc0 con 0x7fd51406e0a0 2023-12-19T17:59:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 -- 172.21.15.45:0/30285723 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 msgr2=0x7fd5140cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 --2- 172.21.15.45:0/30285723 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 0x7fd5140cd2b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009e50 tx=0x7fd50c00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 -- 172.21.15.45:0/30285723 shutdown_connections 2023-12-19T17:59:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 --2- 172.21.15.45:0/30285723 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51406e0a0 0x7fd5140cd2b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 --2- 172.21.15.45:0/30285723 >> v2:172.21.15.73:3300/0 conn(0x7fd51415ab50 0x7fd5140ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 -- 172.21.15.45:0/30285723 >> 172.21.15.45:0/30285723 conn(0x7fd5140cba40 msgr2=0x7fd5140ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 -- 172.21.15.45:0/30285723 shutdown_connections 2023-12-19T17:59:50.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.773+0000 7fd51c482700 1 -- 172.21.15.45:0/30285723 wait complete. 2023-12-19T17:59:50.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 Processor -- start 2023-12-19T17:59:50.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 -- start start 2023-12-19T17:59:50.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51406e0a0 0x7fd5140b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 0x7fd514158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51415af30 0x7fd514158680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51413f020 con 0x7fd51415ab50 2023-12-19T17:59:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514158d90 con 0x7fd51406e0a0 2023-12-19T17:59:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.777+0000 7fd51c482700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd514159070 con 0x7fd51415af30 2023-12-19T17:59:50.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 0x7fd514158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 0x7fd514158140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37128/0 (socket says 172.21.15.45:37128) 2023-12-19T17:59:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 -- 172.21.15.45:0/669808759 learned_addr learned my addr 172.21.15.45:0/669808759 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd51aa1f700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51415af30 0x7fd514158680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd51a21e700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51406e0a0 0x7fd5140b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 -- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51415af30 msgr2=0x7fd514158680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51415af30 0x7fd514158680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 -- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51406e0a0 msgr2=0x7fd5140b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51406e0a0 0x7fd5140b1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 -- 172.21.15.45:0/669808759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50c009b30 con 0x7fd51415ab50 2023-12-19T17:59:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd519a1d700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 0x7fd514158140 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c4d0 tx=0x7fd50400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:50.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040052d0 con 0x7fd51415ab50 2023-12-19T17:59:50.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504005430 con 0x7fd51415ab50 2023-12-19T17:59:50.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd514159350 con 0x7fd51415ab50 2023-12-19T17:59:50.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5040055a0 con 0x7fd51415ab50 2023-12-19T17:59:50.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.781+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd514159910 con 0x7fd51415ab50 2023-12-19T17:59:50.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.785+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51404ed30 con 0x7fd51415ab50 2023-12-19T17:59:50.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.785+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5040038c0 con 0x7fd51415ab50 2023-12-19T17:59:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.785+0000 7fd50affd700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd4f8065ad0 0x7fd4f8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.785+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fd5040827c0 con 0x7fd51415ab50 2023-12-19T17:59:50.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.789+0000 7fd51a21e700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd4f8065ad0 0x7fd4f8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:50.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.789+0000 7fd51a21e700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd4f8065ad0 0x7fd4f8067f90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd5141f1af0 tx=0x7fd510009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.793+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd50404fe00 con 0x7fd51415ab50 2023-12-19T17:59:50.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.977+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd51406c990 con 0x7fd51415ab50 2023-12-19T17:59:50.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.981+0000 7fd50affd700 1 -- 172.21.15.45:0/669808759 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+18059 (secure 0 0 0) 0x7fd504053420 con 0x7fd51415ab50 2023-12-19T17:59:50.985 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:50.986 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":87,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:50.097131+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd4f8065ad0 msgr2=0x7fd4f8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd4f8065ad0 0x7fd4f8067f90 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fd5141f1af0 tx=0x7fd510009240 comp rx=0 tx=0).stop 2023-12-19T17:59:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 msgr2=0x7fd514158140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 0x7fd514158140 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c4d0 tx=0x7fd50400c7e0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 shutdown_connections 2023-12-19T17:59:50.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd4f8065ad0 0x7fd4f8067f90 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd51415af30 0x7fd514158680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd51415ab50 0x7fd514158140 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 --2- 172.21.15.45:0/669808759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd51406e0a0 0x7fd5140b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 >> 172.21.15.45:0/669808759 conn(0x7fd5140cba40 msgr2=0x7fd514156c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 shutdown_connections 2023-12-19T17:59:50.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:50.985+0000 7fd51c482700 1 -- 172.21.15.45:0/669808759 wait complete. 2023-12-19T17:59:51.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:51.016 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout.pool -v cephfs_data_extra .) 2023-12-19T17:59:51.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:51.048 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-12-19T17:59:51.125 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:51.126 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:51.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:51.186 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=subdir/sixmegs bs=1M conv=fdatasync count=6 seek=0) 2023-12-19T17:59:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:6+0 records in 2023-12-19T17:59:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:6+0 records out 2023-12-19T17:59:51.390 INFO:teuthology.orchestra.run.smithi045.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.13457 s, 46.8 MB/s 2023-12-19T17:59:51.393 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T17:59:51.393 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T17:59:51.393 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-12-19T17:59:51.393 DEBUG:teuthology.orchestra.run.smithi045:> import json 2023-12-19T17:59:51.393 DEBUG:teuthology.orchestra.run.smithi045:> import sys 2023-12-19T17:59:51.393 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> sys.exit(e.errno) 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> print(json.dumps( 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> dict([(a, getattr(s, a)) for a in attrs]), 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> indent=2)) 2023-12-19T17:59:51.394 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T17:59:51.499 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T17:59:51.499 INFO:teuthology.orchestra.run.smithi045.stdout: "st_mode": 33204, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_ino": 1099511627777, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_dev": 49, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_nlink": 1, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_uid": 1000, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_gid": 1267, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_size": 6291456, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_atime": 1703008791.250309, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_mtime": 1703008791.3498077, 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout: "st_ctime": 1703008791.3498077 2023-12-19T17:59:51.500 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T17:59:51.680 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:51.680 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:51.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.973+0000 7f955d41e700 1 Processor -- start 2023-12-19T17:59:51.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.973+0000 7f955d41e700 1 -- start start 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.973+0000 7f955d41e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95580adad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.973+0000 7f955d41e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95580cddd0 0x7f95580ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.973+0000 7f955d41e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f955815af30 con 0x7f955815e260 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f955d41e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95580cd010 con 0x7f95580cddd0 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f955d41e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95580cd2f0 con 0x7f955815ab50 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95577fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f95580cddd0 0x7f95580ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:51.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f9556ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95580adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:51.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f954ffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f955815e260 0x7f955806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36652/0 (socket says 172.21.15.45:36652) 2023-12-19T17:59:51.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f954ffff700 1 -- 172.21.15.45:0/969373185 learned_addr learned my addr 172.21.15.45:0/969373185 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95567fc700 1 -- 172.21.15.45:0/969373185 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4185069923 0 0) 0x7f955815af30 con 0x7f955815e260 2023-12-19T17:59:51.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95567fc700 1 -- 172.21.15.45:0/969373185 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95440035d0 con 0x7f955815e260 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95577fe700 1 -- 172.21.15.45:0/969373185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 msgr2=0x7f95580adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95577fe700 1 --2- 172.21.15.45:0/969373185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95580adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95577fe700 1 -- 172.21.15.45:0/969373185 >> v1:172.21.15.45:6789/0 conn(0x7f955815e260 legacy=0x7f955806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95577fe700 1 -- 172.21.15.45:0/969373185 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95580cd5d0 con 0x7f95580cddd0 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f9556ffd700 1 --2- 172.21.15.45:0/969373185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95580adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95577fe700 1 --2- 172.21.15.45:0/969373185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580ce220 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9550009d90 tx=0x7f955000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b9f1f69091699d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95567fc700 1 -- 172.21.15.45:0/969373185 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955000e070 con 0x7f95580cddd0 2023-12-19T17:59:51.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95567fc700 1 -- 172.21.15.45:0/969373185 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955000bb20 con 0x7f95580cddd0 2023-12-19T17:59:51.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f95567fc700 1 -- 172.21.15.45:0/969373185 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550012430 con 0x7f95580cddd0 2023-12-19T17:59:51.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f955d41e700 1 -- 172.21.15.45:0/969373185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 msgr2=0x7f95580ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:51.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.977+0000 7f955d41e700 1 --2- 172.21.15.45:0/969373185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580ce220 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9550009d90 tx=0x7f955000b330 comp rx=0 tx=0).stop 2023-12-19T17:59:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 -- 172.21.15.45:0/969373185 shutdown_connections 2023-12-19T17:59:51.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 --2- 172.21.15.45:0/969373185 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580ce220 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 --2- 172.21.15.45:0/969373185 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95580adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 -- 172.21.15.45:0/969373185 >> 172.21.15.45:0/969373185 conn(0x7f95580cba40 msgr2=0x7f95580ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 -- 172.21.15.45:0/969373185 shutdown_connections 2023-12-19T17:59:51.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 -- 172.21.15.45:0/969373185 wait complete. 2023-12-19T17:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 Processor -- start 2023-12-19T17:59:51.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.981+0000 7f955d41e700 1 -- start start 2023-12-19T17:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580aff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:51.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95581589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955815e260 0x7f95581f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580ac2b0 con 0x7f95580cddd0 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580ad900 con 0x7f955815e260 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95580ac4c0 con 0x7f955815ab50 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580aff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580aff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37152/0 (socket says 172.21.15.45:37152) 2023-12-19T17:59:51.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 -- 172.21.15.45:0/2101747941 learned_addr learned my addr 172.21.15.45:0/2101747941 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f95577fe700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955815e260 0x7f95581f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f954ffff700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95581589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 -- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 msgr2=0x7f95581589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95581589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 -- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955815e260 msgr2=0x7f95581f6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955815e260 0x7f95581f6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 -- 172.21.15.45:0/2101747941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95480094b0 con 0x7f95580cddd0 2023-12-19T17:59:51.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f9556ffd700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580aff60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f954800ebe0 tx=0x7f9548009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954800c8b0 con 0x7f95580cddd0 2023-12-19T17:59:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f954800ca10 con 0x7f95580cddd0 2023-12-19T17:59:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f954800cda0 con 0x7f95580cddd0 2023-12-19T17:59:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9550009a70 con 0x7f95580cddd0 2023-12-19T17:59:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.985+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95580aca80 con 0x7f95580cddd0 2023-12-19T17:59:51.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.989+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f955815d750 con 0x7f95580cddd0 2023-12-19T17:59:51.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.989+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9548013470 con 0x7f95580cddd0 2023-12-19T17:59:51.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.993+0000 7f954f7fe700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9538065ad0 0x7f9538067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:51.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.993+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f9548083630 con 0x7f95580cddd0 2023-12-19T17:59:51.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.993+0000 7f954ffff700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9538065ad0 0x7f9538067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:51.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.993+0000 7f954ffff700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9538065ad0 0x7f9538067f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9558160410 tx=0x7f9540009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:51.997+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9548050c70 con 0x7f95580cddd0 2023-12-19T17:59:52.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.176+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f955806f170 con 0x7f95580cddd0 2023-12-19T17:59:52.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.180+0000 7f954f7fe700 1 -- 172.21.15.45:0/2101747941 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18046 (secure 0 0 0) 0x7f9548054290 con 0x7f95580cddd0 2023-12-19T17:59:52.187 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:52.187 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:51.103044+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:52.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9538065ad0 msgr2=0x7f9538067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9538065ad0 0x7f9538067f90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9558160410 tx=0x7f9540009040 comp rx=0 tx=0).stop 2023-12-19T17:59:52.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 msgr2=0x7f95580aff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580aff60 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f954800ebe0 tx=0x7f9548009e30 comp rx=0 tx=0).stop 2023-12-19T17:59:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 shutdown_connections 2023-12-19T17:59:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9538065ad0 0x7f9538067f90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f955815e260 0x7f95581f6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f955815ab50 0x7f95581589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 --2- 172.21.15.45:0/2101747941 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95580cddd0 0x7f95580aff60 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.184+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 >> 172.21.15.45:0/2101747941 conn(0x7f95580cba40 msgr2=0x7f955806cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:52.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.188+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 shutdown_connections 2023-12-19T17:59:52.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.188+0000 7f955d41e700 1 -- 172.21.15.45:0/2101747941 wait complete. 2023-12-19T17:59:52.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:59:38.443332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:59:39.328753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:59:49.559908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:59:52.215 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:59:52.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.392+0000 7f4e70fef700 1 Processor -- start 2023-12-19T17:59:52.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.392+0000 7f4e70fef700 1 -- start start 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e70fef700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e6c15cf20 0x7f4e6c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e70fef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0b8580 0x7f4e6c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e70fef700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c15d300 con 0x7f4e6c0d25f0 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e70fef700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c0d1550 con 0x7f4e6c15cf20 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e70fef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0d1830 con 0x7f4e6c0b8580 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e6c15cf20 0x7f4e6c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4e6c15cf20 0x7f4e6c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37168/0 (socket says 172.21.15.45:37168) 2023-12-19T17:59:52.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/3213408007 learned_addr learned my addr 172.21.15.45:0/3213408007 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:52.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6affd700 1 --2- 172.21.15.45:0/3213408007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0b8580 0x7f4e6c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6a7fc700 1 -- 172.21.15.45:0/3213408007 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 433702954 0 0) 0x7f4e6c15d300 con 0x7f4e6c0d25f0 2023-12-19T17:59:52.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/3213408007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0b8580 msgr2=0x7f4e6c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 --2- 172.21.15.45:0/3213408007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0b8580 0x7f4e6c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/3213408007 >> v1:172.21.15.73:6789/0 conn(0x7f4e6c0d25f0 legacy=0x7f4e6c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.396+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/3213408007 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0d1b10 con 0x7f4e6c15cf20 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e6b7fe700 1 --2- 172.21.15.45:0/3213408007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c0d0c50 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009910 tx=0x7f4e5c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c5900c51d51db1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e6a7fc700 1 -- 172.21.15.45:0/3213408007 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011830 con 0x7f4e6c15cf20 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e6a7fc700 1 -- 172.21.15.45:0/3213408007 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c011990 con 0x7f4e6c15cf20 2023-12-19T17:59:52.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e6a7fc700 1 -- 172.21.15.45:0/3213408007 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c011d40 con 0x7f4e6c15cf20 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 -- 172.21.15.45:0/3213408007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 msgr2=0x7f4e6c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 --2- 172.21.15.45:0/3213408007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c0d0c50 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c009910 tx=0x7f4e5c009c20 comp rx=0 tx=0).stop 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 -- 172.21.15.45:0/3213408007 shutdown_connections 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 --2- 172.21.15.45:0/3213408007 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0b8580 0x7f4e6c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 --2- 172.21.15.45:0/3213408007 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c0d0c50 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 -- 172.21.15.45:0/3213408007 >> 172.21.15.45:0/3213408007 conn(0x7f4e6c0b4670 msgr2=0x7f4e6c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 -- 172.21.15.45:0/3213408007 shutdown_connections 2023-12-19T17:59:52.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.400+0000 7f4e70fef700 1 -- 172.21.15.45:0/3213408007 wait complete. 2023-12-19T17:59:52.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.404+0000 7f4e70fef700 1 Processor -- start 2023-12-19T17:59:52.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.404+0000 7f4e70fef700 1 -- start start 2023-12-19T17:59:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 0x7f4e6c14f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0d25f0 0x7f4e6c1f3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c15fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c150420 con 0x7f4e6c15cf20 2023-12-19T17:59:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c1f3550 con 0x7f4e6c0b8580 2023-12-19T17:59:52.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c14fb80 con 0x7f4e6c0d25f0 2023-12-19T17:59:52.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c15fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 0x7f4e6c14f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0d25f0 0x7f4e6c1f3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 0x7f4e6c14f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:45900/0 (socket says 172.21.15.45:45900) 2023-12-19T17:59:52.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/4165479743 learned_addr learned my addr 172.21.15.45:0/4165479743 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:52.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0d25f0 msgr2=0x7f4e6c1f3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0d25f0 0x7f4e6c1f3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 msgr2=0x7f4e6c15fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c15fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 -- 172.21.15.45:0/4165479743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c009570 con 0x7f4e6c0b8580 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6affd700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0d25f0 0x7f4e6c1f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6bfff700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e6b7fe700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 0x7f4e6c14f4e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c08bc80 tx=0x7f4e5c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c004300 con 0x7f4e6c0b8580 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c01f070 con 0x7f4e6c0b8580 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c0036c0 con 0x7f4e6c0b8580 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.408+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c14fe60 con 0x7f4e6c0b8580 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.412+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c1f5d30 con 0x7f4e6c0b8580 2023-12-19T17:59:52.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.412+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c1f5f20 con 0x7f4e6c0b8580 2023-12-19T17:59:52.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.416+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4e5c021030 con 0x7f4e6c0b8580 2023-12-19T17:59:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.416+0000 7f4e53fff700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e58065ad0 0x7f4e58067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.416+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f4e5c084c70 con 0x7f4e6c0b8580 2023-12-19T17:59:52.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.416+0000 7f4e6affd700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e58065ad0 0x7f4e58067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.416+0000 7f4e6affd700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e58065ad0 0x7f4e58067f90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c150660 tx=0x7f4e60009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.424+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4e5c0523c0 con 0x7f4e6c0b8580 2023-12-19T17:59:52.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.604+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e6c04ed30 con 0x7f4e6c0b8580 2023-12-19T17:59:52.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.604+0000 7f4e53fff700 1 -- 172.21.15.45:0/4165479743 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e5c0559e0 con 0x7f4e6c0b8580 2023-12-19T17:59:52.611 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:59:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.608+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e58065ad0 msgr2=0x7f4e58067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.608+0000 7f4e70fef700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e58065ad0 0x7f4e58067f90 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c150660 tx=0x7f4e60009240 comp rx=0 tx=0).stop 2023-12-19T17:59:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.608+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 msgr2=0x7f4e6c14f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.608+0000 7f4e70fef700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 0x7f4e6c14f4e0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c08bc80 tx=0x7f4e5c004770 comp rx=0 tx=0).stop 2023-12-19T17:59:52.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 shutdown_connections 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e58065ad0 0x7f4e58067f90 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e6c15cf20 0x7f4e6c15fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e6c0d25f0 0x7f4e6c1f3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 --2- 172.21.15.45:0/4165479743 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e6c0b8580 0x7f4e6c14f4e0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 >> 172.21.15.45:0/4165479743 conn(0x7f4e6c0b4670 msgr2=0x7f4e6c151f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 shutdown_connections 2023-12-19T17:59:52.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.612+0000 7f4e70fef700 1 -- 172.21.15.45:0/4165479743 wait complete. 2023-12-19T17:59:52.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:59:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.812+0000 7f635b32e700 1 Processor -- start 2023-12-19T17:59:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.812+0000 7f635b32e700 1 -- start start 2023-12-19T17:59:52.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635b32e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6354071ae0 0x7f63540cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635b32e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f63540b2010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635b32e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63540b1b80 con 0x7f63541443e0 2023-12-19T17:59:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635b32e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63541447c0 con 0x7f6354071ae0 2023-12-19T17:59:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635b32e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63540b1830 con 0x7f63540cb840 2023-12-19T17:59:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f6359b2b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6354071ae0 0x7f63540cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635a32c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63541443e0 0x7f63540713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36654/0 (socket says 172.21.15.45:36654) 2023-12-19T17:59:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635a32c700 1 -- 172.21.15.45:0/1521631515 learned_addr learned my addr 172.21.15.45:0/1521631515 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635ab2d700 1 --2- 172.21.15.45:0/1521631515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f63540b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f6359b2b700 1 -- 172.21.15.45:0/1521631515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 msgr2=0x7f63540b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:52.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f6359b2b700 1 --2- 172.21.15.45:0/1521631515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f63540b2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f6359b2b700 1 -- 172.21.15.45:0/1521631515 >> v1:172.21.15.45:6789/0 conn(0x7f63541443e0 legacy=0x7f63540713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f6359b2b700 1 -- 172.21.15.45:0/1521631515 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63540cc070 con 0x7f6354071ae0 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635932a700 1 -- 172.21.15.45:0/1521631515 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458452153 0 0) 0x7f63540b1b80 con 0x7f63541443e0 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f6359b2b700 1 --2- 172.21.15.45:0/1521631515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6354071ae0 0x7f63540cb300 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6344009850 tx=0x7f6344009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2854fe3326a64069 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635932a700 1 -- 172.21.15.45:0/1521631515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344011830 con 0x7f6354071ae0 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635932a700 1 -- 172.21.15.45:0/1521631515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344011990 con 0x7f6354071ae0 2023-12-19T17:59:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.816+0000 7f635932a700 1 -- 172.21.15.45:0/1521631515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344011d20 con 0x7f6354071ae0 2023-12-19T17:59:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 -- 172.21.15.45:0/1521631515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6354071ae0 msgr2=0x7f63540cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 --2- 172.21.15.45:0/1521631515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6354071ae0 0x7f63540cb300 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f6344009850 tx=0x7f6344009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 -- 172.21.15.45:0/1521631515 shutdown_connections 2023-12-19T17:59:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 --2- 172.21.15.45:0/1521631515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f63540b2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 --2- 172.21.15.45:0/1521631515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6354071ae0 0x7f63540cb300 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 -- 172.21.15.45:0/1521631515 >> 172.21.15.45:0/1521631515 conn(0x7f63540cf5a0 msgr2=0x7f6354070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 -- 172.21.15.45:0/1521631515 shutdown_connections 2023-12-19T17:59:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 -- 172.21.15.45:0/1521631515 wait complete. 2023-12-19T17:59:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.820+0000 7f635b32e700 1 Processor -- start 2023-12-19T17:59:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 -- start start 2023-12-19T17:59:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f635415cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 0x7f63540b3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f635415b210 0x7f63540b35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635415b710 con 0x7f63541443e0 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635415b9f0 con 0x7f635415b210 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635415bcd0 con 0x7f63540cb840 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 0x7f63540b3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 0x7f63540b3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37192/0 (socket says 172.21.15.45:37192) 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 -- 172.21.15.45:0/1379717211 learned_addr learned my addr 172.21.15.45:0/1379717211 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635a32c700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f635415cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635ab2d700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f635415b210 0x7f63540b35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 -- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 msgr2=0x7f635415cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f635415cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 -- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f635415b210 msgr2=0x7f63540b35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f635415b210 0x7f63540b35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 -- 172.21.15.45:0/1379717211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440094b0 con 0x7f63541443e0 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f6359b2b700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 0x7f63540b3060 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6344000c00 tx=0x7f6344004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63440036c0 con 0x7f63541443e0 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6344003820 con 0x7f63541443e0 2023-12-19T17:59:52.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344003bd0 con 0x7f63541443e0 2023-12-19T17:59:52.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.824+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635415bfb0 con 0x7f63541443e0 2023-12-19T17:59:52.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.828+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635415d0a0 con 0x7f63541443e0 2023-12-19T17:59:52.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.828+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635415c4d0 con 0x7f63541443e0 2023-12-19T17:59:52.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.828+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6344003d30 con 0x7f63541443e0 2023-12-19T17:59:52.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.832+0000 7f634affd700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6338065ad0 0x7f6338067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:52.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.832+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f6344021030 con 0x7f63541443e0 2023-12-19T17:59:52.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.832+0000 7f635a32c700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6338065ad0 0x7f6338067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:52.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.832+0000 7f635a32c700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6338065ad0 0x7f6338067f90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6350004920 tx=0x7f6350009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:52.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:52.836+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f635415c4d0 con 0x7f63541443e0 2023-12-19T17:59:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.016+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f635415c4d0 con 0x7f63541443e0 2023-12-19T17:59:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.016+0000 7f634affd700 1 -- 172.21.15.45:0/1379717211 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f634402b020 con 0x7f63541443e0 2023-12-19T17:59:53.022 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6338065ad0 msgr2=0x7f6338067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6338065ad0 0x7f6338067f90 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f6350004920 tx=0x7f6350009190 comp rx=0 tx=0).stop 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 msgr2=0x7f63540b3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 0x7f63540b3060 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f6344000c00 tx=0x7f6344004770 comp rx=0 tx=0).stop 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 shutdown_connections 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6338065ad0 0x7f6338067f90 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f635415b210 0x7f63540b35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63541443e0 0x7f63540b3060 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 --2- 172.21.15.45:0/1379717211 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63540cb840 0x7f635415cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 >> 172.21.15.45:0/1379717211 conn(0x7f6354071ae0 msgr2=0x7f6354143610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 shutdown_connections 2023-12-19T17:59:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.020+0000 7f635b32e700 1 -- 172.21.15.45:0/1379717211 wait complete. 2023-12-19T17:59:53.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:59:53.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.232+0000 7f78e7551700 1 Processor -- start 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.232+0000 7f78e7551700 1 -- start start 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e7551700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78e015b920 0x7f78e00713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e7551700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e00b1bb0 con 0x7f78e015b540 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e7551700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78e00b1e90 con 0x7f78e0071910 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e7551700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78e00b2830 con 0x7f78e015b920 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e5d4e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f78e015b920 0x7f78e00713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e654f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f78e015b540 0x7f78e01621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36658/0 (socket says 172.21.15.45:36658) 2023-12-19T17:59:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e654f700 1 -- 172.21.15.45:0/1245296229 learned_addr learned my addr 172.21.15.45:0/1245296229 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e554d700 1 -- 172.21.15.45:0/1245296229 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574551395 0 0) 0x7f78e00b1bb0 con 0x7f78e015b540 2023-12-19T17:59:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e554d700 1 -- 172.21.15.45:0/1245296229 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78cc0035d0 con 0x7f78e015b540 2023-12-19T17:59:53.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e554d700 1 -- 172.21.15.45:0/1245296229 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4228138241 0 0) 0x7f78e00b1e90 con 0x7f78e0071910 2023-12-19T17:59:53.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e5d4e700 1 -- 172.21.15.45:0/1245296229 >> v1:172.21.15.73:6789/0 conn(0x7f78e0071910 legacy=0x7f78e00af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e5d4e700 1 -- 172.21.15.45:0/1245296229 >> v1:172.21.15.45:6789/0 conn(0x7f78e015b540 legacy=0x7f78e01621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e5d4e700 1 -- 172.21.15.45:0/1245296229 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e00b2170 con 0x7f78e015b920 2023-12-19T17:59:53.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e5d4e700 1 --2- 172.21.15.45:0/1245296229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015b920 0x7f78e00713d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009850 tx=0x7f78d0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d46893e8ea04f7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e554d700 1 -- 172.21.15.45:0/1245296229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011830 con 0x7f78e015b920 2023-12-19T17:59:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e554d700 1 -- 172.21.15.45:0/1245296229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d0011990 con 0x7f78e015b920 2023-12-19T17:59:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.236+0000 7f78e554d700 1 -- 172.21.15.45:0/1245296229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d0011d40 con 0x7f78e015b920 2023-12-19T17:59:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 -- 172.21.15.45:0/1245296229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015b920 msgr2=0x7f78e00713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 --2- 172.21.15.45:0/1245296229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015b920 0x7f78e00713d0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f78d0009850 tx=0x7f78d0009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 -- 172.21.15.45:0/1245296229 shutdown_connections 2023-12-19T17:59:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 --2- 172.21.15.45:0/1245296229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015b920 0x7f78e00713d0 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 -- 172.21.15.45:0/1245296229 >> 172.21.15.45:0/1245296229 conn(0x7f78e00cf5a0 msgr2=0x7f78e0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 -- 172.21.15.45:0/1245296229 shutdown_connections 2023-12-19T17:59:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.240+0000 7f78e7551700 1 -- 172.21.15.45:0/1245296229 wait complete. 2023-12-19T17:59:53.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 Processor -- start 2023-12-19T17:59:53.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 -- start start 2023-12-19T17:59:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78e015b540 0x7f78e013f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e015b920 0x7f78e01fa220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 0x7f78e0157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01fa760 con 0x7f78e015be00 2023-12-19T17:59:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01fa990 con 0x7f78e015b920 2023-12-19T17:59:53.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e7551700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78e01fac70 con 0x7f78e015b540 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.244+0000 7f78e6d50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 0x7f78e0157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 0x7f78e0157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37210/0 (socket says 172.21.15.45:37210) 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 -- 172.21.15.45:0/989952565 learned_addr learned my addr 172.21.15.45:0/989952565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e654f700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78e015b540 0x7f78e013f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e5d4e700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e015b920 0x7f78e01fa220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 -- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78e015b540 msgr2=0x7f78e013f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78e015b540 0x7f78e013f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 -- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e015b920 msgr2=0x7f78e01fa220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e015b920 0x7f78e01fa220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 -- 172.21.15.45:0/989952565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d00094b0 con 0x7f78e015be00 2023-12-19T17:59:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e6d50700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 0x7f78e0157e50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f78d800cc10 tx=0x7f78d8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d8003ea0 con 0x7f78e015be00 2023-12-19T17:59:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78d800a770 con 0x7f78e015be00 2023-12-19T17:59:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e01faf50 con 0x7f78e015be00 2023-12-19T17:59:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78d800ab00 con 0x7f78e015be00 2023-12-19T17:59:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e0158390 con 0x7f78e015be00 2023-12-19T17:59:53.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.248+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e00cccc0 con 0x7f78e015be00 2023-12-19T17:59:53.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.252+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f78d800ac60 con 0x7f78e015be00 2023-12-19T17:59:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.252+0000 7f78d6ffd700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78c4065ad0 0x7f78c4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.252+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f78d8082f20 con 0x7f78e015be00 2023-12-19T17:59:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.252+0000 7f78e654f700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78c4065ad0 0x7f78c4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.252+0000 7f78e654f700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78c4065ad0 0x7f78c4067f90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f78dc005930 tx=0x7f78dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.260+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f78e00cccc0 con 0x7f78e015be00 2023-12-19T17:59:53.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.436+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78e00cccc0 con 0x7f78e015be00 2023-12-19T17:59:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78d6ffd700 1 -- 172.21.15.45:0/989952565 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7f78e00cccc0 con 0x7f78e015be00 2023-12-19T17:59:53.444 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78c4065ad0 msgr2=0x7f78c4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78c4065ad0 0x7f78c4067f90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f78dc005930 tx=0x7f78dc009040 comp rx=0 tx=0).stop 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 msgr2=0x7f78e0157e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 0x7f78e0157e50 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f78d800cc10 tx=0x7f78d8002210 comp rx=0 tx=0).stop 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 shutdown_connections 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f78c4065ad0 0x7f78c4067f90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f78e015be00 0x7f78e0157e50 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78e015b920 0x7f78e01fa220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 --2- 172.21.15.45:0/989952565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f78e015b540 0x7f78e013f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.440+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 >> 172.21.15.45:0/989952565 conn(0x7f78e0071910 msgr2=0x7f78e006ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:53.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.444+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 shutdown_connections 2023-12-19T17:59:53.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.444+0000 7f78e7551700 1 -- 172.21.15.45:0/989952565 wait complete. 2023-12-19T17:59:53.470 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:59:53.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.656+0000 7f9b4ffe6700 1 Processor -- start 2023-12-19T17:59:53.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.656+0000 7f9b4ffe6700 1 -- start start 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b4806dd70 0x7f9b481619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b480b2490 0x7f9b4806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b480b1d20 con 0x7f9b481626c0 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4806ec50 con 0x7f9b480b2490 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b480b2c00 con 0x7f9b4806dd70 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b480b2490 0x7f9b4806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b480b2490 0x7f9b4806f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37216/0 (socket says 172.21.15.45:37216) 2023-12-19T17:59:53.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 -- 172.21.15.45:0/2446531471 learned_addr learned my addr 172.21.15.45:0/2446531471 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:53.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4d581700 1 --2- 172.21.15.45:0/2446531471 >> v2:172.21.15.73:3300/0 conn(0x7f9b4806dd70 0x7f9b481619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 -- 172.21.15.45:0/2446531471 >> v2:172.21.15.73:3300/0 conn(0x7f9b4806dd70 msgr2=0x7f9b481619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:53.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 --2- 172.21.15.45:0/2446531471 >> v2:172.21.15.73:3300/0 conn(0x7f9b4806dd70 0x7f9b481619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 -- 172.21.15.45:0/2446531471 >> v1:172.21.15.73:6789/0 conn(0x7f9b481626c0 legacy=0x7f9b4806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:53.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 -- 172.21.15.45:0/2446531471 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b480b2ee0 con 0x7f9b480b2490 2023-12-19T17:59:53.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4e583700 1 --2- 172.21.15.45:0/2446531471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b480b2490 0x7f9b4806f0e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009e50 tx=0x7f9b4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2993e600b39ec23 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:53.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4cd80700 1 -- 172.21.15.45:0/2446531471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4000e070 con 0x7f9b480b2490 2023-12-19T17:59:53.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4cd80700 1 -- 172.21.15.45:0/2446531471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b40003a40 con 0x7f9b480b2490 2023-12-19T17:59:53.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4cd80700 1 -- 172.21.15.45:0/2446531471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40003df0 con 0x7f9b480b2490 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/2446531471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b480b2490 msgr2=0x7f9b4806f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/2446531471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b480b2490 0x7f9b4806f0e0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009e50 tx=0x7f9b4000b330 comp rx=0 tx=0).stop 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/2446531471 shutdown_connections 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/2446531471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b480b2490 0x7f9b4806f0e0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/2446531471 >> v2:172.21.15.73:3300/0 conn(0x7f9b4806dd70 0x7f9b481619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.660+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/2446531471 >> 172.21.15.45:0/2446531471 conn(0x7f9b48071990 msgr2=0x7f9b480b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.664+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/2446531471 shutdown_connections 2023-12-19T17:59:53.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.664+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/2446531471 wait complete. 2023-12-19T17:59:53.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.664+0000 7f9b4ffe6700 1 Processor -- start 2023-12-19T17:59:53.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.664+0000 7f9b4ffe6700 1 -- start start 2023-12-19T17:59:53.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4ffe6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4806dd70 0x7f9b4814ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4ffe6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b480b2490 0x7f9b48159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4ffe6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 0x7f9b4815a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4ffe6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b48161180 con 0x7f9b481626c0 2023-12-19T17:59:53.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4ffe6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b481600e0 con 0x7f9b480b2490 2023-12-19T17:59:53.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4ffe6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b481603c0 con 0x7f9b4806dd70 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 0x7f9b4815a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4dd82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4806dd70 0x7f9b4814ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 0x7f9b4815a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37230/0 (socket says 172.21.15.45:37230) 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 -- 172.21.15.45:0/1412758543 learned_addr learned my addr 172.21.15.45:0/1412758543 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4d581700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b480b2490 0x7f9b48159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 -- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4806dd70 msgr2=0x7f9b4814ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4806dd70 0x7f9b4814ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 -- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b480b2490 msgr2=0x7f9b48159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b480b2490 0x7f9b48159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 -- 172.21.15.45:0/1412758543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b40009b30 con 0x7f9b481626c0 2023-12-19T17:59:53.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.668+0000 7f9b4e583700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 0x7f9b4815a060 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b0e50 tx=0x7f9b40004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004440 con 0x7f9b481626c0 2023-12-19T17:59:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b400045c0 con 0x7f9b481626c0 2023-12-19T17:59:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b40004970 con 0x7f9b481626c0 2023-12-19T17:59:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b481606a0 con 0x7f9b481626c0 2023-12-19T17:59:53.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b48160c60 con 0x7f9b481626c0 2023-12-19T17:59:53.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4804ed30 con 0x7f9b481626c0 2023-12-19T17:59:53.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.672+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b40012430 con 0x7f9b481626c0 2023-12-19T17:59:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.676+0000 7f9b3e7fc700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.676+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f9b40084830 con 0x7f9b481626c0 2023-12-19T17:59:53.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.676+0000 7f9b4dd82700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:53.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.676+0000 7f9b4dd82700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009980 tx=0x7f9b440090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:53.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.684+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b40055910 con 0x7f9b481626c0 2023-12-19T17:59:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.864+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f9b4806cef0 con 0x7f9b481626c0 2023-12-19T17:59:53.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.864+0000 7f9b3e7fc700 1 -- 172.21.15.45:0/1412758543 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v88) v1 ==== 106+0+11 (secure 0 0 0) 0x7f9b400554a0 con 0x7f9b481626c0 2023-12-19T17:59:53.870 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 msgr2=0x7f9b2c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f9b44009980 tx=0x7f9b440090e0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 msgr2=0x7f9b4815a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:53.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 0x7f9b4815a060 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f9b480b0e50 tx=0x7f9b40004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 shutdown_connections 2023-12-19T17:59:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b481626c0 0x7f9b4815a060 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b480b2490 0x7f9b48159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 --2- 172.21.15.45:0/1412758543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4806dd70 0x7f9b4814ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 >> 172.21.15.45:0/1412758543 conn(0x7f9b48071990 msgr2=0x7f9b480cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 shutdown_connections 2023-12-19T17:59:53.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:53.868+0000 7f9b4ffe6700 1 -- 172.21.15.45:0/1412758543 wait complete. 2023-12-19T17:59:53.896 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:59:54.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.072+0000 7f0695170700 1 Processor -- start 2023-12-19T17:59:54.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.072+0000 7f0695170700 1 -- start start 2023-12-19T17:59:54.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f0695170700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f069015e450 0x7f069006fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f0695170700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069006c760 con 0x7f06900af720 2023-12-19T17:59:54.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f0695170700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069006ca40 con 0x7f0690159a50 2023-12-19T17:59:54.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f0695170700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0690070540 con 0x7f069015e450 2023-12-19T17:59:54.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f069015e450 0x7f069006fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f069496f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f06900af720 0x7f069006d520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36670/0 (socket says 172.21.15.45:36670) 2023-12-19T17:59:54.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f069496f700 1 -- 172.21.15.45:0/858817163 learned_addr learned my addr 172.21.15.45:0/858817163 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068effd700 1 -- 172.21.15.45:0/858817163 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251922684 0 0) 0x7f069006c760 con 0x7f06900af720 2023-12-19T17:59:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068effd700 1 -- 172.21.15.45:0/858817163 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06780035d0 con 0x7f06900af720 2023-12-19T17:59:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068f7fe700 1 -- 172.21.15.45:0/858817163 >> v1:172.21.15.73:6789/0 conn(0x7f0690159a50 legacy=0x7f06900c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068f7fe700 1 -- 172.21.15.45:0/858817163 >> v1:172.21.15.45:6789/0 conn(0x7f06900af720 legacy=0x7f069006d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068f7fe700 1 -- 172.21.15.45:0/858817163 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069006cd20 con 0x7f069015e450 2023-12-19T17:59:54.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.076+0000 7f068f7fe700 1 --2- 172.21.15.45:0/858817163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f069015e450 0x7f069006fba0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0684009850 tx=0x7f0684009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e059e7f4dd7845 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f068effd700 1 -- 172.21.15.45:0/858817163 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011830 con 0x7f069015e450 2023-12-19T17:59:54.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f068effd700 1 -- 172.21.15.45:0/858817163 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0684011990 con 0x7f069015e450 2023-12-19T17:59:54.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f068effd700 1 -- 172.21.15.45:0/858817163 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0684011d40 con 0x7f069015e450 2023-12-19T17:59:54.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 -- 172.21.15.45:0/858817163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f069015e450 msgr2=0x7f069006fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 --2- 172.21.15.45:0/858817163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f069015e450 0x7f069006fba0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0684009850 tx=0x7f0684009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:54.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 -- 172.21.15.45:0/858817163 shutdown_connections 2023-12-19T17:59:54.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 --2- 172.21.15.45:0/858817163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f069015e450 0x7f069006fba0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 -- 172.21.15.45:0/858817163 >> 172.21.15.45:0/858817163 conn(0x7f06900cb900 msgr2=0x7f06900b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:54.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 -- 172.21.15.45:0/858817163 shutdown_connections 2023-12-19T17:59:54.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.080+0000 7f0695170700 1 -- 172.21.15.45:0/858817163 wait complete. 2023-12-19T17:59:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.084+0000 7f0695170700 1 Processor -- start 2023-12-19T17:59:54.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.084+0000 7f0695170700 1 -- start start 2023-12-19T17:59:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06900af720 0x7f06900c6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0690159a50 0x7f06900c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 0x7f06901f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06900c5e10 con 0x7f069015e450 2023-12-19T17:59:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06901f2d20 con 0x7f06900af720 2023-12-19T17:59:54.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06901f3000 con 0x7f0690159a50 2023-12-19T17:59:54.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 0x7f06901f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f068ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06900af720 0x7f06900c6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 0x7f06901f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37242/0 (socket says 172.21.15.45:37242) 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 -- 172.21.15.45:0/1811576037 learned_addr learned my addr 172.21.15.45:0/1811576037 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f068f7fe700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0690159a50 0x7f06900c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 -- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0690159a50 msgr2=0x7f06900c4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0690159a50 0x7f06900c4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 -- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06900af720 msgr2=0x7f06900c6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06900af720 0x7f06900c6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 -- 172.21.15.45:0/1811576037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06840094b0 con 0x7f069015e450 2023-12-19T17:59:54.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f068f7fe700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0690159a50 0x7f06900c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:54.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f069496f700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 0x7f06901f22d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f068800cb40 tx=0x7f068800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800a7b0 con 0x7f069015e450 2023-12-19T17:59:54.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068800a910 con 0x7f069015e450 2023-12-19T17:59:54.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068800ac80 con 0x7f069015e450 2023-12-19T17:59:54.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06900c5a30 con 0x7f069015e450 2023-12-19T17:59:54.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.088+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06900c6950 con 0x7f069015e450 2023-12-19T17:59:54.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.092+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06900c5f50 con 0x7f069015e450 2023-12-19T17:59:54.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.092+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f068801b3b0 con 0x7f069015e450 2023-12-19T17:59:54.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.096+0000 7f068cff9700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f067c065ad0 0x7f067c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.096+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f0688082c10 con 0x7f069015e450 2023-12-19T17:59:54.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.096+0000 7f068ffff700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f067c065ad0 0x7f067c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.096+0000 7f068ffff700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f067c065ad0 0x7f067c067f90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0680000f60 tx=0x7f0680009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.100+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f06900c5f50 con 0x7f069015e450 2023-12-19T17:59:54.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.292+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f06900c6950 con 0x7f069015e450 2023-12-19T17:59:54.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f068cff9700 1 -- 172.21.15.45:0/1811576037 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) v1 ==== 80+0+0 (secure 0 0 0) 0x7f06900c6950 con 0x7f069015e450 2023-12-19T17:59:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f067c065ad0 msgr2=0x7f067c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f067c065ad0 0x7f067c067f90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0680000f60 tx=0x7f0680009040 comp rx=0 tx=0).stop 2023-12-19T17:59:54.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 msgr2=0x7f06901f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 0x7f06901f22d0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f068800cb40 tx=0x7f068800cb70 comp rx=0 tx=0).stop 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 shutdown_connections 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f067c065ad0 0x7f067c067f90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f069015e450 0x7f06901f22d0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0690159a50 0x7f06900c4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 --2- 172.21.15.45:0/1811576037 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06900af720 0x7f06900c6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 >> 172.21.15.45:0/1811576037 conn(0x7f06900cb900 msgr2=0x7f0690156780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 shutdown_connections 2023-12-19T17:59:54.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.296+0000 7f0695170700 1 -- 172.21.15.45:0/1811576037 wait complete. 2023-12-19T17:59:54.306 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:59:54.325 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T17:59:54.325 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T17:59:54.343 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T17:59:54.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.556+0000 7f70a3d46700 1 Processor -- start 2023-12-19T17:59:54.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.556+0000 7f70a3d46700 1 -- start start 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a3d46700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f709c164690 0x7f709c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a3d46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0cdb80 con 0x7f709c0cd540 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a3d46700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c0cde60 con 0x7f709c164a70 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a3d46700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0cd970 con 0x7f709c164690 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a22e3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f709c0cd540 0x7f709c06ee00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36672/0 (socket says 172.21.15.45:36672) 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a22e3700 1 -- 172.21.15.45:0/1704561940 learned_addr learned my addr 172.21.15.45:0/1704561940 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:54.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a1ae2700 1 --2- 172.21.15.45:0/1704561940 >> v2:172.21.15.73:3300/0 conn(0x7f709c164690 0x7f709c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682223033 0 0) 0x7f709c0cdb80 con 0x7f709c0cd540 2023-12-19T17:59:54.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70880035d0 con 0x7f709c0cd540 2023-12-19T17:59:54.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1814495897 0 0) 0x7f709c0cde60 con 0x7f709c164a70 2023-12-19T17:59:54.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f709c0cdb80 con 0x7f709c164a70 2023-12-19T17:59:54.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a1ae2700 1 -- 172.21.15.45:0/1704561940 >> v1:172.21.15.73:6789/0 conn(0x7f709c164a70 legacy=0x7f709c0cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a1ae2700 1 -- 172.21.15.45:0/1704561940 >> v1:172.21.15.45:6789/0 conn(0x7f709c0cd540 legacy=0x7f709c06ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a1ae2700 1 -- 172.21.15.45:0/1704561940 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c0ce140 con 0x7f709c164690 2023-12-19T17:59:54.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.560+0000 7f70a1ae2700 1 --2- 172.21.15.45:0/1704561940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164690 0x7f709c0c3e00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f709c0cdab0 tx=0x7f709800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e83316b7c36837db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098016070 con 0x7f709c164690 2023-12-19T17:59:54.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f709800bb20 con 0x7f709c164690 2023-12-19T17:59:54.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a0ae0700 1 -- 172.21.15.45:0/1704561940 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709800e070 con 0x7f709c164690 2023-12-19T17:59:54.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 -- 172.21.15.45:0/1704561940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164690 msgr2=0x7f709c0c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 --2- 172.21.15.45:0/1704561940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164690 0x7f709c0c3e00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f709c0cdab0 tx=0x7f709800b330 comp rx=0 tx=0).stop 2023-12-19T17:59:54.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 -- 172.21.15.45:0/1704561940 shutdown_connections 2023-12-19T17:59:54.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 --2- 172.21.15.45:0/1704561940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164690 0x7f709c0c3e00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 -- 172.21.15.45:0/1704561940 >> 172.21.15.45:0/1704561940 conn(0x7f709c0cba40 msgr2=0x7f709c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:54.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 -- 172.21.15.45:0/1704561940 shutdown_connections 2023-12-19T17:59:54.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.564+0000 7f70a3d46700 1 -- 172.21.15.45:0/1704561940 wait complete. 2023-12-19T17:59:54.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 Processor -- start 2023-12-19T17:59:54.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 -- start start 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 0x7f709c1618f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f709c164690 0x7f709c160220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164a70 0x7f709c160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c15f440 con 0x7f709c0cd540 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1633a0 con 0x7f709c164a70 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a3d46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1635d0 con 0x7f709c164690 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 0x7f709c1618f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 0x7f709c1618f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37258/0 (socket says 172.21.15.45:37258) 2023-12-19T17:59:54.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 -- 172.21.15.45:0/2307778268 learned_addr learned my addr 172.21.15.45:0/2307778268 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a22e3700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164a70 0x7f709c160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a12e1700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f709c164690 0x7f709c160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 -- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f709c164690 msgr2=0x7f709c160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f709c164690 0x7f709c160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 -- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164a70 msgr2=0x7f709c160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164a70 0x7f709c160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a1ae2700 1 -- 172.21.15.45:0/2307778268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7098009a70 con 0x7f709c0cd540 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.568+0000 7f70a12e1700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f709c164690 0x7f709c160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70a1ae2700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 0x7f709c1618f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7098000f80 tx=0x7f7098004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7098016040 con 0x7f709c0cd540 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70980098f0 con 0x7f709c0cd540 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f709801b680 con 0x7f709c0cd540 2023-12-19T17:59:54.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c1638b0 con 0x7f709c0cd540 2023-12-19T17:59:54.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c152920 con 0x7f709c0cd540 2023-12-19T17:59:54.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.572+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c04ed30 con 0x7f709c0cd540 2023-12-19T17:59:54.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.576+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f709801b7e0 con 0x7f709c0cd540 2023-12-19T17:59:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.576+0000 7f70927fc700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7080065ad0 0x7f7080067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.576+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f7098084ab0 con 0x7f709c0cd540 2023-12-19T17:59:54.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.576+0000 7f70a12e1700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7080065ad0 0x7f7080067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.576+0000 7f70a12e1700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7080065ad0 0x7f7080067f90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f709c155750 tx=0x7f708c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.584+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7098052220 con 0x7f709c0cd540 2023-12-19T17:59:54.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.768+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f709c06c990 con 0x7f709c0cd540 2023-12-19T17:59:54.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.772+0000 7f70927fc700 1 -- 172.21.15.45:0/2307778268 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+18046 (secure 0 0 0) 0x7f7098055840 con 0x7f709c0cd540 2023-12-19T17:59:54.779 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T17:59:54.779 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T17:59:51.103044+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7080065ad0 msgr2=0x7f7080067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7080065ad0 0x7f7080067f90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f709c155750 tx=0x7f708c009040 comp rx=0 tx=0).stop 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 msgr2=0x7f709c1618f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 0x7f709c1618f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7098000f80 tx=0x7f7098004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 shutdown_connections 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7080065ad0 0x7f7080067f90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f709c164a70 0x7f709c160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f709c164690 0x7f709c160220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 --2- 172.21.15.45:0/2307778268 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f709c0cd540 0x7f709c1618f0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 >> 172.21.15.45:0/2307778268 conn(0x7f709c0cba40 msgr2=0x7f709c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 shutdown_connections 2023-12-19T17:59:54.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.776+0000 7f70a3d46700 1 -- 172.21.15.45:0/2307778268 wait complete. 2023-12-19T17:59:54.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:59:38.443332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:59:39.328753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:59:49.559908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T17:59:54.806 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T17:59:54.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.980+0000 7ff7d4ee4700 1 Processor -- start 2023-12-19T17:59:54.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.980+0000 7ff7d4ee4700 1 -- start start 2023-12-19T17:59:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7d4ee4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 0x7ff7d00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7d4ee4700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d015d300 con 0x7ff7d00cdfd0 2023-12-19T17:59:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7d4ee4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d00d1550 con 0x7ff7d00b8580 2023-12-19T17:59:54.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7d4ee4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00d1830 con 0x7ff7d015cf20 2023-12-19T17:59:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7cffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff7d00cdfd0 0x7ff7d00b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36684/0 (socket says 172.21.15.45:36684) 2023-12-19T17:59:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7cffff700 1 -- 172.21.15.45:0/202542810 learned_addr learned my addr 172.21.15.45:0/202542810 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:54.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.984+0000 7ff7cf7fe700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 0x7ff7d00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536402464 0 0) 0x7ff7d015d300 con 0x7ff7d00cdfd0 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7b80035d0 con 0x7ff7d00cdfd0 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3111789766 0 0) 0x7ff7d00d1550 con 0x7ff7d00b8580 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7d015d300 con 0x7ff7d00b8580 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3432860666 0 0) 0x7ff7b80035d0 con 0x7ff7d00cdfd0 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 msgr2=0x7ff7d00d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 0x7ff7d00d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 >> v1:172.21.15.73:6789/0 conn(0x7ff7d00b8580 legacy=0x7ff7d00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00d1b10 con 0x7ff7d00cdfd0 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7ff7c80019f0 con 0x7ff7d00cdfd0 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 >> v1:172.21.15.45:6789/0 conn(0x7ff7d00cdfd0 legacy=0x7ff7d00b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 0x7ff7b8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004140 0x7ff7b8004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b8004db0 0x7ff7b8005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00d1830 con 0x7ff7b8004db0 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b800bb10 con 0x7ff7b8004140 2023-12-19T17:59:54.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b800bcd0 con 0x7ff7d015cf20 2023-12-19T17:59:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b8004db0 0x7ff7b8005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cf7fe700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 0x7ff7b8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ceffd700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004140 0x7ff7b8004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 -- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 msgr2=0x7ff7b8003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d015cf20 0x7ff7b8003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 -- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004140 msgr2=0x7ff7b8004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004140 0x7ff7b8004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 -- 172.21.15.45:0/202542810 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b80035d0 con 0x7ff7b8004db0 2023-12-19T17:59:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7cffff700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b8004db0 0x7ff7b8005230 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00cd520 tx=0x7ff7b80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30fd38653d0ef364 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c80072d0 con 0x7ff7b8004db0 2023-12-19T17:59:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c8007430 con 0x7ff7b8004db0 2023-12-19T17:59:54.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7ce7fc700 1 -- 172.21.15.45:0/202542810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c80077e0 con 0x7ff7b8004db0 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/202542810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b8004db0 msgr2=0x7ff7b8005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.988+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/202542810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7b8004db0 0x7ff7b8005230 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00cd520 tx=0x7ff7b80058a0 comp rx=0 tx=0).stop 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7cffff700 1 -- 172.21.15.45:0/202542810 reap_dead start 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/202542810 shutdown_connections 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/202542810 >> 172.21.15.45:0/202542810 conn(0x7ff7d00b4670 msgr2=0x7ff7d00b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/202542810 shutdown_connections 2023-12-19T17:59:54.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/202542810 wait complete. 2023-12-19T17:59:54.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7d4ee4700 1 Processor -- start 2023-12-19T17:59:54.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.992+0000 7ff7d4ee4700 1 -- start start 2023-12-19T17:59:55.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004db0 0x7ff7d01f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d01531a0 0x7ff7d01f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 0x7ff7d01f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d00c8eb0 con 0x7ff7d01486d0 2023-12-19T17:59:55.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d0154c30 con 0x7ff7b8004db0 2023-12-19T17:59:55.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d0154f10 con 0x7ff7d01531a0 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 0x7ff7d01f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 0x7ff7d01f6930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37290/0 (socket says 172.21.15.45:37290) 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 -- 172.21.15.45:0/827786691 learned_addr learned my addr 172.21.15.45:0/827786691 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cf7fe700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004db0 0x7ff7d01f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7ceffd700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d01531a0 0x7ff7d01f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 -- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d01531a0 msgr2=0x7ff7d01f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d01531a0 0x7ff7d01f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 -- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004db0 msgr2=0x7ff7d01f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004db0 0x7ff7d01f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 -- 172.21.15.45:0/827786691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d01551f0 con 0x7ff7d01486d0 2023-12-19T17:59:55.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7cffff700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 0x7ff7d01f6930 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f80 tx=0x7ff7c8001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c80077a0 con 0x7ff7d01486d0 2023-12-19T17:59:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c8007920 con 0x7ff7d01486d0 2023-12-19T17:59:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d01554d0 con 0x7ff7d01486d0 2023-12-19T17:59:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:54.996+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c80019c0 con 0x7ff7d01486d0 2023-12-19T17:59:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.000+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d0155cd0 con 0x7ff7d01486d0 2023-12-19T17:59:55.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.000+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d01559f0 con 0x7ff7d01486d0 2023-12-19T17:59:55.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.000+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7c801a070 con 0x7ff7d01486d0 2023-12-19T17:59:55.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.004+0000 7ff7b7fff700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7bc065ad0 0x7ff7bc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.004+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7ff7c8084980 con 0x7ff7d01486d0 2023-12-19T17:59:55.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.004+0000 7ff7cf7fe700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7bc065ad0 0x7ff7bc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.004+0000 7ff7cf7fe700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7bc065ad0 0x7ff7bc067f90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009b70 tx=0x7ff7c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.008+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff7d01559f0 con 0x7ff7d01486d0 2023-12-19T17:59:55.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.188+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7d01559f0 con 0x7ff7d01486d0 2023-12-19T17:59:55.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.188+0000 7ff7b7fff700 1 -- 172.21.15.45:0/827786691 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7d01559f0 con 0x7ff7d01486d0 2023-12-19T17:59:55.194 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7bc065ad0 msgr2=0x7ff7bc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7bc065ad0 0x7ff7bc067f90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff7c0009b70 tx=0x7ff7c0008040 comp rx=0 tx=0).stop 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 msgr2=0x7ff7d01f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 0x7ff7d01f6930 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f80 tx=0x7ff7c8001d00 comp rx=0 tx=0).stop 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 shutdown_connections 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7bc065ad0 0x7ff7bc067f90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7d01486d0 0x7ff7d01f6930 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7d01531a0 0x7ff7d01f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 --2- 172.21.15.45:0/827786691 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7b8004db0 0x7ff7d01f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 >> 172.21.15.45:0/827786691 conn(0x7ff7d00b4670 msgr2=0x7ff7d00d09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:55.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 shutdown_connections 2023-12-19T17:59:55.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.192+0000 7ff7d4ee4700 1 -- 172.21.15.45:0/827786691 wait complete. 2023-12-19T17:59:55.217 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T17:59:55.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 Processor -- start 2023-12-19T17:59:55.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 -- start start 2023-12-19T17:59:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa5415cf20 0x7ffa540d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa540cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa540d25f0 0x7ffa540cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa5415d300 con 0x7ffa540d25f0 2023-12-19T17:59:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa540d1550 con 0x7ffa5415cf20 2023-12-19T17:59:55.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.396+0000 7ffa5359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540d1830 con 0x7ffa540b8580 2023-12-19T17:59:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa540d25f0 0x7ffa540cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffa540d25f0 0x7ffa540cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37304/0 (socket says 172.21.15.45:37304) 2023-12-19T17:59:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 -- 172.21.15.45:0/1913147483 learned_addr learned my addr 172.21.15.45:0/1913147483 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5259c700 1 --2- 172.21.15.45:0/1913147483 >> v2:172.21.15.73:3300/0 conn(0x7ffa5415cf20 0x7ffa540d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa51d9b700 1 --2- 172.21.15.45:0/1913147483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa540cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 -- 172.21.15.45:0/1913147483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 msgr2=0x7ffa540cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:55.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 --2- 172.21.15.45:0/1913147483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa540cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 -- 172.21.15.45:0/1913147483 >> v2:172.21.15.73:3300/0 conn(0x7ffa5415cf20 msgr2=0x7ffa540d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:55.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 --2- 172.21.15.45:0/1913147483 >> v2:172.21.15.73:3300/0 conn(0x7ffa5415cf20 0x7ffa540d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 -- 172.21.15.45:0/1913147483 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa540d1b10 con 0x7ffa540d25f0 2023-12-19T17:59:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa52d9d700 1 --2- 172.21.15.45:0/1913147483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa540d25f0 0x7ffa540cde00 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ffa5408bc50 tx=0x7ffa4c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcda9456f11e0dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5159a700 1 -- 172.21.15.45:0/1913147483 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00e070 con 0x7ffa540d25f0 2023-12-19T17:59:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5159a700 1 -- 172.21.15.45:0/1913147483 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c00b910 con 0x7ffa540d25f0 2023-12-19T17:59:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5159a700 1 -- 172.21.15.45:0/1913147483 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c00bcc0 con 0x7ffa540d25f0 2023-12-19T17:59:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 -- 172.21.15.45:0/1913147483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa540d25f0 msgr2=0x7ffa540cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 --2- 172.21.15.45:0/1913147483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa540d25f0 0x7ffa540cde00 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7ffa5408bc50 tx=0x7ffa4c00b330 comp rx=0 tx=0).stop 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 -- 172.21.15.45:0/1913147483 shutdown_connections 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 --2- 172.21.15.45:0/1913147483 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa540d25f0 0x7ffa540cde00 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 --2- 172.21.15.45:0/1913147483 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa540cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 --2- 172.21.15.45:0/1913147483 >> v2:172.21.15.73:3300/0 conn(0x7ffa5415cf20 0x7ffa540d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.400+0000 7ffa5359e700 1 -- 172.21.15.45:0/1913147483 >> 172.21.15.45:0/1913147483 conn(0x7ffa540b4670 msgr2=0x7ffa540b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.404+0000 7ffa5359e700 1 -- 172.21.15.45:0/1913147483 shutdown_connections 2023-12-19T17:59:55.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.404+0000 7ffa5359e700 1 -- 172.21.15.45:0/1913147483 wait complete. 2023-12-19T17:59:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.404+0000 7ffa5359e700 1 Processor -- start 2023-12-19T17:59:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.404+0000 7ffa5359e700 1 -- start start 2023-12-19T17:59:55.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa541f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa540d25f0 0x7ffa540ab4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 0x7ffa540ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540a99c0 con 0x7ffa5415cf20 2023-12-19T17:59:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540a9ca0 con 0x7ffa540d25f0 2023-12-19T17:59:55.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa540a9f80 con 0x7ffa540b8580 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 0x7ffa540ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 0x7ffa540ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37308/0 (socket says 172.21.15.45:37308) 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 -- 172.21.15.45:0/3911026543 learned_addr learned my addr 172.21.15.45:0/3911026543 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5259c700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa541f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa51d9b700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa540d25f0 0x7ffa540ab4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 -- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 msgr2=0x7ffa541f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa541f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 -- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa540d25f0 msgr2=0x7ffa540ab4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa540d25f0 0x7ffa540ab4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 -- 172.21.15.45:0/3911026543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa4c009b30 con 0x7ffa5415cf20 2023-12-19T17:59:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5259c700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa541f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa52d9d700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 0x7ffa540ab9f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ffa5408bc80 tx=0x7ffa4c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c0099b0 con 0x7ffa5415cf20 2023-12-19T17:59:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa4c004250 con 0x7ffa5415cf20 2023-12-19T17:59:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa4c004600 con 0x7ffa5415cf20 2023-12-19T17:59:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa540aa260 con 0x7ffa5415cf20 2023-12-19T17:59:55.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.408+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa541f24f0 con 0x7ffa5415cf20 2023-12-19T17:59:55.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.412+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa5404ed30 con 0x7ffa5415cf20 2023-12-19T17:59:55.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.412+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa4c004760 con 0x7ffa5415cf20 2023-12-19T17:59:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.416+0000 7ffa42ffd700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa34065ad0 0x7ffa34067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.416+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7ffa4c084900 con 0x7ffa5415cf20 2023-12-19T17:59:55.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.416+0000 7ffa5259c700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa34065ad0 0x7ffa34067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.416+0000 7ffa5259c700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa34065ad0 0x7ffa34067f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009bc0 tx=0x7ffa44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.420+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffa4c051f50 con 0x7ffa5415cf20 2023-12-19T17:59:55.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.596+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ffa540b5350 con 0x7ffa5415cf20 2023-12-19T17:59:55.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.596+0000 7ffa42ffd700 1 -- 172.21.15.45:0/3911026543 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7ffa4c055570 con 0x7ffa5415cf20 2023-12-19T17:59:55.602 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa34065ad0 msgr2=0x7ffa34067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa34065ad0 0x7ffa34067f90 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ffa44009bc0 tx=0x7ffa44008040 comp rx=0 tx=0).stop 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 msgr2=0x7ffa540ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 0x7ffa540ab9f0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7ffa5408bc80 tx=0x7ffa4c004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 shutdown_connections 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa34065ad0 0x7ffa34067f90 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa5415cf20 0x7ffa540ab9f0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa540d25f0 0x7ffa540ab4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 --2- 172.21.15.45:0/3911026543 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa540b8580 0x7ffa541f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 >> 172.21.15.45:0/3911026543 conn(0x7ffa540b4670 msgr2=0x7ffa540b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:55.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 shutdown_connections 2023-12-19T17:59:55.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.600+0000 7ffa5359e700 1 -- 172.21.15.45:0/3911026543 wait complete. 2023-12-19T17:59:55.631 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T17:59:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.812+0000 7fafc19f9700 1 Processor -- start 2023-12-19T17:59:55.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.812+0000 7fafc19f9700 1 -- start start 2023-12-19T17:59:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafc19f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafbc15cf20 0x7fafbc0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafc19f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc0b8580 0x7fafbc0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafc19f9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc15d300 con 0x7fafbc0d25f0 2023-12-19T17:59:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafc19f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc0d1550 con 0x7fafbc15cf20 2023-12-19T17:59:55.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafc19f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0d1830 con 0x7fafbc0b8580 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbaffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fafbc15cf20 0x7fafbc0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbb7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fafbc0d25f0 0x7fafbc06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36688/0 (socket says 172.21.15.45:36688) 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbb7fe700 1 -- 172.21.15.45:0/2220053547 learned_addr learned my addr 172.21.15.45:0/2220053547 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafba7fc700 1 --2- 172.21.15.45:0/2220053547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc0b8580 0x7fafbc0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbaffd700 1 -- 172.21.15.45:0/2220053547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc0b8580 msgr2=0x7fafbc0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbaffd700 1 --2- 172.21.15.45:0/2220053547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc0b8580 0x7fafbc0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbaffd700 1 -- 172.21.15.45:0/2220053547 >> v1:172.21.15.45:6789/0 conn(0x7fafbc0d25f0 legacy=0x7fafbc06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbaffd700 1 -- 172.21.15.45:0/2220053547 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0d1b10 con 0x7fafbc15cf20 2023-12-19T17:59:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafbaffd700 1 --2- 172.21.15.45:0/2220053547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc15cf20 0x7fafbc0d0c50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fafac009850 tx=0x7fafac009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e982d2cd71ccfb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.816+0000 7fafb9ffb700 1 -- 172.21.15.45:0/2220053547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011830 con 0x7fafbc15cf20 2023-12-19T17:59:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafb9ffb700 1 -- 172.21.15.45:0/2220053547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac011990 con 0x7fafbc15cf20 2023-12-19T17:59:55.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafb9ffb700 1 -- 172.21.15.45:0/2220053547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac011d20 con 0x7fafbc15cf20 2023-12-19T17:59:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 -- 172.21.15.45:0/2220053547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc15cf20 msgr2=0x7fafbc0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 --2- 172.21.15.45:0/2220053547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc15cf20 0x7fafbc0d0c50 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fafac009850 tx=0x7fafac009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 -- 172.21.15.45:0/2220053547 shutdown_connections 2023-12-19T17:59:55.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 --2- 172.21.15.45:0/2220053547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc0b8580 0x7fafbc0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 --2- 172.21.15.45:0/2220053547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc15cf20 0x7fafbc0d0c50 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 -- 172.21.15.45:0/2220053547 >> 172.21.15.45:0/2220053547 conn(0x7fafbc0b4670 msgr2=0x7fafbc0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 -- 172.21.15.45:0/2220053547 shutdown_connections 2023-12-19T17:59:55.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.820+0000 7fafc19f9700 1 -- 172.21.15.45:0/2220053547 wait complete. 2023-12-19T17:59:55.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 Processor -- start 2023-12-19T17:59:55.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 -- start start 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 0x7fafbc153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafbc0d25f0 0x7fafbc0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc15cf20 0x7fafbc0cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc151e70 con 0x7fafbc0b8580 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0cb190 con 0x7fafbc0d25f0 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafc19f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0caeb0 con 0x7fafbc15cf20 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 0x7fafbc153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 0x7fafbc153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37322/0 (socket says 172.21.15.45:37322) 2023-12-19T17:59:55.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 -- 172.21.15.45:0/343491520 learned_addr learned my addr 172.21.15.45:0/343491520 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbb7fe700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc15cf20 0x7fafbc0cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafba7fc700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafbc0d25f0 0x7fafbc0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 -- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc15cf20 msgr2=0x7fafbc0cbb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc15cf20 0x7fafbc0cbb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 -- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafbc0d25f0 msgr2=0x7fafbc0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafbc0d25f0 0x7fafbc0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:55.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.824+0000 7fafbaffd700 1 -- 172.21.15.45:0/343491520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafac0094b0 con 0x7fafbc0b8580 2023-12-19T17:59:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafbaffd700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 0x7fafbc153fa0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fafac000c00 tx=0x7fafac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac004550 con 0x7fafbc0b8580 2023-12-19T17:59:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafac01f070 con 0x7fafbc0b8580 2023-12-19T17:59:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc15d600 con 0x7fafbc0b8580 2023-12-19T17:59:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafac003900 con 0x7fafbc0b8580 2023-12-19T17:59:55.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc15dbc0 con 0x7fafbc0b8580 2023-12-19T17:59:55.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.828+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc04ed30 con 0x7fafbc0b8580 2023-12-19T17:59:55.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.832+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fafac003a60 con 0x7fafbc0b8580 2023-12-19T17:59:55.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.832+0000 7fafa3fff700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fafa8065b20 0x7fafa8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:55.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.832+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fafac021070 con 0x7fafbc0b8580 2023-12-19T17:59:55.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.832+0000 7fafba7fc700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fafa8065b20 0x7fafa8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:55.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.832+0000 7fafba7fc700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fafa8065b20 0x7fafa8067fe0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0ccff0 tx=0x7fafb0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:55.840+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fafac0523a0 con 0x7fafbc0b8580 2023-12-19T17:59:56.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.016+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafbc15c530 con 0x7fafbc0b8580 2023-12-19T17:59:56.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.016+0000 7fafa3fff700 1 -- 172.21.15.45:0/343491520 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafac0559c0 con 0x7fafbc0b8580 2023-12-19T17:59:56.023 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fafa8065b20 msgr2=0x7fafa8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fafa8065b20 0x7fafa8067fe0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fafbc0ccff0 tx=0x7fafb0008040 comp rx=0 tx=0).stop 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 msgr2=0x7fafbc153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 0x7fafbc153fa0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fafac000c00 tx=0x7fafac004770 comp rx=0 tx=0).stop 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 shutdown_connections 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fafa8065b20 0x7fafa8067fe0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fafbc15cf20 0x7fafbc0cbb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fafbc0d25f0 0x7fafbc0ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 --2- 172.21.15.45:0/343491520 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fafbc0b8580 0x7fafbc153fa0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 >> 172.21.15.45:0/343491520 conn(0x7fafbc0b4670 msgr2=0x7fafbc0b2170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:56.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 shutdown_connections 2023-12-19T17:59:56.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.020+0000 7fafc19f9700 1 -- 172.21.15.45:0/343491520 wait complete. 2023-12-19T17:59:56.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T17:59:56.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.228+0000 7fcee9a6a700 1 Processor -- start 2023-12-19T17:59:56.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.228+0000 7fcee9a6a700 1 -- start start 2023-12-19T17:59:56.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee9a6a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 0x7fcee406ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee9a6a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcee406d690 0x7fcee40b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee9a6a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 0x7fcee415dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee9a6a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40cddd0 con 0x7fcee415d840 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee9a6a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40cceb0 con 0x7fcee406d690 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee9a6a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40704c0 con 0x7fcee406fba0 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 0x7fcee415dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 0x7fcee406ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 0x7fcee406ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:60630/0 (socket says 172.21.15.45:60630) 2023-12-19T17:59:56.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 0x7fcee415dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37330/0 (socket says 172.21.15.45:37330) 2023-12-19T17:59:56.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 -- 172.21.15.45:0/2676726212 learned_addr learned my addr 172.21.15.45:0/2676726212 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:56.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee2ffd700 1 --2- 172.21.15.45:0/2676726212 >> v2:172.21.15.73:3300/0 conn(0x7fcee406d690 0x7fcee40b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 -- 172.21.15.45:0/2676726212 >> v2:172.21.15.73:3300/0 conn(0x7fcee406d690 msgr2=0x7fcee40b3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:56.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 --2- 172.21.15.45:0/2676726212 >> v2:172.21.15.73:3300/0 conn(0x7fcee406d690 0x7fcee40b3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 -- 172.21.15.45:0/2676726212 >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 msgr2=0x7fcee415dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 --2- 172.21.15.45:0/2676726212 >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 0x7fcee415dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 -- 172.21.15.45:0/2676726212 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee40cd150 con 0x7fcee406fba0 2023-12-19T17:59:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee3fff700 1 --2- 172.21.15.45:0/2676726212 >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 0x7fcee415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T17:59:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee37fe700 1 --2- 172.21.15.45:0/2676726212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 0x7fcee406ff80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcee406ad30 tx=0x7fced400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a37ff4efbd5f8da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:56.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee27fc700 1 -- 172.21.15.45:0/2676726212 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400e070 con 0x7fcee406fba0 2023-12-19T17:59:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee27fc700 1 -- 172.21.15.45:0/2676726212 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400b910 con 0x7fcee406fba0 2023-12-19T17:59:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.232+0000 7fcee27fc700 1 -- 172.21.15.45:0/2676726212 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400bcc0 con 0x7fcee406fba0 2023-12-19T17:59:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 -- 172.21.15.45:0/2676726212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 msgr2=0x7fcee406ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/2676726212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 0x7fcee406ff80 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fcee406ad30 tx=0x7fced400b330 comp rx=0 tx=0).stop 2023-12-19T17:59:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 -- 172.21.15.45:0/2676726212 shutdown_connections 2023-12-19T17:59:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/2676726212 >> v2:172.21.15.45:3300/0 conn(0x7fcee415d840 0x7fcee415dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/2676726212 >> v2:172.21.15.73:3300/0 conn(0x7fcee406d690 0x7fcee40b3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/2676726212 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee406fba0 0x7fcee406ff80 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 -- 172.21.15.45:0/2676726212 >> 172.21.15.45:0/2676726212 conn(0x7fcee4071990 msgr2=0x7fcee40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 -- 172.21.15.45:0/2676726212 shutdown_connections 2023-12-19T17:59:56.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.236+0000 7fcee9a6a700 1 -- 172.21.15.45:0/2676726212 wait complete. 2023-12-19T17:59:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 Processor -- start 2023-12-19T17:59:56.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 -- start start 2023-12-19T17:59:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 0x7fcee41572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee406fba0 0x7fcee40b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee415d840 0x7fcee40b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4163e20 con 0x7fcee406d690 2023-12-19T17:59:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee413e290 con 0x7fcee406fba0 2023-12-19T17:59:56.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee9a6a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4163000 con 0x7fcee415d840 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 0x7fcee41572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 0x7fcee41572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37332/0 (socket says 172.21.15.45:37332) 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 -- 172.21.15.45:0/3295297066 learned_addr learned my addr 172.21.15.45:0/3295297066 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee2ffd700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee406fba0 0x7fcee40b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee3fff700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee415d840 0x7fcee40b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 -- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee415d840 msgr2=0x7fcee40b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee415d840 0x7fcee40b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 -- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee406fba0 msgr2=0x7fcee40b1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee406fba0 0x7fcee40b1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 -- 172.21.15.45:0/3295297066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0094b0 con 0x7fcee406d690 2023-12-19T17:59:56.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcee37fe700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 0x7fcee41572f0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fced400b370 tx=0x7fced4004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.240+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400ce80 con 0x7fcee406d690 2023-12-19T17:59:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.244+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced4004250 con 0x7fcee406d690 2023-12-19T17:59:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.244+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced40045e0 con 0x7fcee406d690 2023-12-19T17:59:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.244+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fced4009b30 con 0x7fcee406d690 2023-12-19T17:59:56.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.244+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee413dc40 con 0x7fcee406d690 2023-12-19T17:59:56.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.244+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee404ed30 con 0x7fcee406d690 2023-12-19T17:59:56.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.244+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fced4004740 con 0x7fcee406d690 2023-12-19T17:59:56.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.248+0000 7fcedbfff700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcec4065ad0 0x7fcec4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.248+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fced4084730 con 0x7fcee406d690 2023-12-19T17:59:56.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.248+0000 7fcee2ffd700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcec4065ad0 0x7fcec4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.248+0000 7fcee2ffd700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcec4065ad0 0x7fcec4067f90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcee4164f00 tx=0x7fcecc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:56.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.252+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fced4051eb0 con 0x7fcee406d690 2023-12-19T17:59:56.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.440+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7fcee413f590 con 0x7fcee406d690 2023-12-19T17:59:56.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.440+0000 7fcedbfff700 1 -- 172.21.15.45:0/3295297066 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v88) v1 ==== 106+0+11 (secure 0 0 0) 0x7fced4020020 con 0x7fcee406d690 2023-12-19T17:59:56.447 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T17:59:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcec4065ad0 msgr2=0x7fcec4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcec4065ad0 0x7fcec4067f90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fcee4164f00 tx=0x7fcecc009240 comp rx=0 tx=0).stop 2023-12-19T17:59:56.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 msgr2=0x7fcee41572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 0x7fcee41572f0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fced400b370 tx=0x7fced4004af0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 shutdown_connections 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcec4065ad0 0x7fcec4067f90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcee415d840 0x7fcee40b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcee406fba0 0x7fcee40b1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 --2- 172.21.15.45:0/3295297066 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcee406d690 0x7fcee41572f0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 >> 172.21.15.45:0/3295297066 conn(0x7fcee4071990 msgr2=0x7fcee4065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 shutdown_connections 2023-12-19T17:59:56.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.444+0000 7fcee9a6a700 1 -- 172.21.15.45:0/3295297066 wait complete. 2023-12-19T17:59:56.476 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T17:59:56.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.652+0000 7fa3e4c7e700 1 Processor -- start 2023-12-19T17:59:56.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.652+0000 7fa3e4c7e700 1 -- start start 2023-12-19T17:59:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3e4c7e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3e006cad0 0x7fa3e015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3e4c7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e00af720 0x7fa3e00afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3e4c7e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e006f0a0 con 0x7fa3e015ae20 2023-12-19T17:59:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3e4c7e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e00b0110 con 0x7fa3e006cad0 2023-12-19T17:59:56.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3e4c7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e006ea90 con 0x7fa3e00af720 2023-12-19T17:59:56.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3deffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa3e006cad0 0x7fa3e015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3df7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa3e015ae20 0x7fa3e00c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:36692/0 (socket says 172.21.15.45:36692) 2023-12-19T17:59:56.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3df7fe700 1 -- 172.21.15.45:0/2296828845 learned_addr learned my addr 172.21.15.45:0/2296828845 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T17:59:56.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3dffff700 1 --2- 172.21.15.45:0/2296828845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e00af720 0x7fa3e00afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3deffd700 1 -- 172.21.15.45:0/2296828845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e00af720 msgr2=0x7fa3e00afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T17:59:56.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3deffd700 1 --2- 172.21.15.45:0/2296828845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e00af720 0x7fa3e00afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3deffd700 1 -- 172.21.15.45:0/2296828845 >> v1:172.21.15.45:6789/0 conn(0x7fa3e015ae20 legacy=0x7fa3e00c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3deffd700 1 -- 172.21.15.45:0/2296828845 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e00c3f60 con 0x7fa3e006cad0 2023-12-19T17:59:56.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.656+0000 7fa3de7fc700 1 -- 172.21.15.45:0/2296828845 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1755554031 0 0) 0x7fa3e006f0a0 con 0x7fa3e015ae20 2023-12-19T17:59:56.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3deffd700 1 --2- 172.21.15.45:0/2296828845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e006cad0 0x7fa3e015be40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009850 tx=0x7fa3d4009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff63f0d4f72474ac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:56.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3de7fc700 1 -- 172.21.15.45:0/2296828845 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4011830 con 0x7fa3e006cad0 2023-12-19T17:59:56.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3de7fc700 1 -- 172.21.15.45:0/2296828845 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4011990 con 0x7fa3e006cad0 2023-12-19T17:59:56.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3de7fc700 1 -- 172.21.15.45:0/2296828845 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4011d40 con 0x7fa3e006cad0 2023-12-19T17:59:56.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/2296828845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e006cad0 msgr2=0x7fa3e015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/2296828845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e006cad0 0x7fa3e015be40 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009850 tx=0x7fa3d4009b60 comp rx=0 tx=0).stop 2023-12-19T17:59:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/2296828845 shutdown_connections 2023-12-19T17:59:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/2296828845 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e00af720 0x7fa3e00afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/2296828845 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e006cad0 0x7fa3e015be40 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/2296828845 >> 172.21.15.45:0/2296828845 conn(0x7fa3e00cb900 msgr2=0x7fa3e00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:56.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/2296828845 shutdown_connections 2023-12-19T17:59:56.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.660+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/2296828845 wait complete. 2023-12-19T17:59:56.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.664+0000 7fa3e4c7e700 1 Processor -- start 2023-12-19T17:59:56.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.664+0000 7fa3e4c7e700 1 -- start start 2023-12-19T17:59:56.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.664+0000 7fa3e4c7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e006cad0 0x7fa3e01f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.664+0000 7fa3e4c7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 0x7fa3e01509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e015ae20 0x7fa3e0150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e015c130 con 0x7fa3e00af720 2023-12-19T17:59:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e01500e0 con 0x7fa3e015ae20 2023-12-19T17:59:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e014de20 con 0x7fa3e006cad0 2023-12-19T17:59:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 0x7fa3e01509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 0x7fa3e01509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:37354/0 (socket says 172.21.15.45:37354) 2023-12-19T17:59:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 -- 172.21.15.45:0/351830357 learned_addr learned my addr 172.21.15.45:0/351830357 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T17:59:56.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3df7fe700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e006cad0 0x7fa3e01f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3dffff700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e015ae20 0x7fa3e0150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 -- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e006cad0 msgr2=0x7fa3e01f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e006cad0 0x7fa3e01f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 -- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e015ae20 msgr2=0x7fa3e0150ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e015ae20 0x7fa3e0150ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 -- 172.21.15.45:0/351830357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40094b0 con 0x7fa3e00af720 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3df7fe700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e006cad0 0x7fa3e01f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3deffd700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 0x7fa3e01509a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40090b0 tx=0x7fa3d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d401aac0 con 0x7fa3e00af720 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d401f070 con 0x7fa3e00af720 2023-12-19T17:59:56.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e015b4b0 con 0x7fa3e00af720 2023-12-19T17:59:56.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d401ae60 con 0x7fa3e00af720 2023-12-19T17:59:56.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e015ba70 con 0x7fa3e00af720 2023-12-19T17:59:56.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.668+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e006f510 con 0x7fa3e00af720 2023-12-19T17:59:56.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.672+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa3d401b430 con 0x7fa3e00af720 2023-12-19T17:59:56.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.676+0000 7fa3c7fff700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa3cc065ad0 0x7fa3cc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T17:59:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.676+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fa3d4084d60 con 0x7fa3e00af720 2023-12-19T17:59:56.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.676+0000 7fa3df7fe700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa3cc065ad0 0x7fa3cc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T17:59:56.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.676+0000 7fa3df7fe700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa3cc065ad0 0x7fa3cc067f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00012e0 tx=0x7fa3d0001980 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T17:59:56.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.680+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa3d40523a0 con 0x7fa3e00af720 2023-12-19T17:59:56.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.872+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3e015c270 con 0x7fa3e00af720 2023-12-19T17:59:56.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.872+0000 7fa3c7fff700 1 -- 172.21.15.45:0/351830357 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v88) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa3e015c270 con 0x7fa3e00af720 2023-12-19T17:59:56.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa3cc065ad0 msgr2=0x7fa3cc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa3cc065ad0 0x7fa3cc067f90 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00012e0 tx=0x7fa3d0001980 comp rx=0 tx=0).stop 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 msgr2=0x7fa3e01509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 0x7fa3e01509a0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40090b0 tx=0x7fa3d4004770 comp rx=0 tx=0).stop 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 shutdown_connections 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa3cc065ad0 0x7fa3cc067f90 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3e015ae20 0x7fa3e0150ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa3e00af720 0x7fa3e01509a0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 --2- 172.21.15.45:0/351830357 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3e006cad0 0x7fa3e01f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 >> 172.21.15.45:0/351830357 conn(0x7fa3e00cb900 msgr2=0x7fa3e006f970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 shutdown_connections 2023-12-19T17:59:56.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T17:59:56.876+0000 7fa3e4c7e700 1 -- 172.21.15.45:0/351830357 wait complete. 2023-12-19T17:59:56.886 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T17:59:56.908 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T17:59:56.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T17:59:56.908 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T17:59:56.941 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[52765]: fuse finished with error 0 and tester_r 0 2023-12-19T17:59:56.947 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:00:01.385 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:00:01.390 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:00:03.049 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:00:03.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:03.049 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:00:03.073 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.300+0000 7fba1eefe700 1 Processor -- start 2023-12-19T18:00:03.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.300+0000 7fba1eefe700 1 -- start start 2023-12-19T18:00:03.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1eefe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1eefe700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180d1820 con 0x7fba180b88b0 2023-12-19T18:00:03.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1eefe700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180d1b00 con 0x7fba1806fe80 2023-12-19T18:00:03.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1eefe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180d1de0 con 0x7fba1806ea90 2023-12-19T18:00:03.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1d6fb700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba180b88b0 0x7fba180b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51300/0 (socket says 172.21.15.45:51300) 2023-12-19T18:00:03.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1d6fb700 1 -- 172.21.15.45:0/1990001120 learned_addr learned my addr 172.21.15.45:0/1990001120 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:03.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1defc700 1 --2- 172.21.15.45:0/1990001120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 382033378 0 0) 0x7fba180d1820 con 0x7fba180b88b0 2023-12-19T18:00:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba040035d0 con 0x7fba180b88b0 2023-12-19T18:00:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757234220 0 0) 0x7fba180d1b00 con 0x7fba1806fe80 2023-12-19T18:00:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba180d1820 con 0x7fba1806fe80 2023-12-19T18:00:03.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1defc700 1 -- 172.21.15.45:0/1990001120 >> v1:172.21.15.73:6789/0 conn(0x7fba1806fe80 legacy=0x7fba180b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1defc700 1 -- 172.21.15.45:0/1990001120 >> v1:172.21.15.45:6789/0 conn(0x7fba180b88b0 legacy=0x7fba180b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.304+0000 7fba1defc700 1 -- 172.21.15.45:0/1990001120 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180d20c0 con 0x7fba1806ea90 2023-12-19T18:00:03.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1defc700 1 --2- 172.21.15.45:0/1990001120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180d0f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba14009880 tx=0x7fba14009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cb3ac5b1d24bf2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14011830 con 0x7fba1806ea90 2023-12-19T18:00:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba14011990 con 0x7fba1806ea90 2023-12-19T18:00:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1cefa700 1 -- 172.21.15.45:0/1990001120 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba14011d20 con 0x7fba1806ea90 2023-12-19T18:00:03.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 -- 172.21.15.45:0/1990001120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 msgr2=0x7fba180d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 --2- 172.21.15.45:0/1990001120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180d0f20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fba14009880 tx=0x7fba14009b90 comp rx=0 tx=0).stop 2023-12-19T18:00:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 -- 172.21.15.45:0/1990001120 shutdown_connections 2023-12-19T18:00:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 --2- 172.21.15.45:0/1990001120 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180d0f20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 -- 172.21.15.45:0/1990001120 >> 172.21.15.45:0/1990001120 conn(0x7fba180b46d0 msgr2=0x7fba180b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 -- 172.21.15.45:0/1990001120 shutdown_connections 2023-12-19T18:00:03.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.308+0000 7fba1eefe700 1 -- 172.21.15.45:0/1990001120 wait complete. 2023-12-19T18:00:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 Processor -- start 2023-12-19T18:00:03.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 -- start start 2023-12-19T18:00:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1806fe80 0x7fba180c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba180b88b0 0x7fba18148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180c7900 con 0x7fba180b88b0 2023-12-19T18:00:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180c6cf0 con 0x7fba1806fe80 2023-12-19T18:00:03.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1eefe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180c6fd0 con 0x7fba1806ea90 2023-12-19T18:00:03.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1e6fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba180b88b0 0x7fba18148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1defc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1e6fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba180b88b0 0x7fba18148f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41570/0 (socket says 172.21.15.45:41570) 2023-12-19T18:00:03.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1e6fd700 1 -- 172.21.15.45:0/4058795125 learned_addr learned my addr 172.21.15.45:0/4058795125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.312+0000 7fba1d6fb700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1806fe80 0x7fba180c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1defc700 1 -- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1806fe80 msgr2=0x7fba180c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1defc700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1806fe80 0x7fba180c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1defc700 1 -- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba180b88b0 msgr2=0x7fba18148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1defc700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba180b88b0 0x7fba18148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1defc700 1 -- 172.21.15.45:0/4058795125 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba140094b0 con 0x7fba1806ea90 2023-12-19T18:00:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1defc700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180c6710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba14015000 tx=0x7fba14004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1401a8c0 con 0x7fba1806ea90 2023-12-19T18:00:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1401e070 con 0x7fba1806ea90 2023-12-19T18:00:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1401ac80 con 0x7fba1806ea90 2023-12-19T18:00:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba180c72b0 con 0x7fba1806ea90 2023-12-19T18:00:03.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba18149490 con 0x7fba1806ea90 2023-12-19T18:00:03.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.316+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba18067760 con 0x7fba1806ea90 2023-12-19T18:00:03.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.320+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba14024400 con 0x7fba1806ea90 2023-12-19T18:00:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.320+0000 7fba0e7fc700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9fc065b20 0x7fb9fc067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.320+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fba14084260 con 0x7fba1806ea90 2023-12-19T18:00:03.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.320+0000 7fba1d6fb700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9fc065b20 0x7fb9fc067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.324+0000 7fba1d6fb700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9fc065b20 0x7fb9fc067fe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba18071ce0 tx=0x7fba08007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:03.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.328+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba14051a60 con 0x7fba1806ea90 2023-12-19T18:00:03.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.540+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba180b6240 con 0x7fba1806ea90 2023-12-19T18:00:03.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.540+0000 7fba0e7fc700 1 -- 172.21.15.45:0/4058795125 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fba14020090 con 0x7fba1806ea90 2023-12-19T18:00:03.547 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:03.547 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":58,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T17:59:40.348016+0000","modified":"2023-12-19T17:59:50.097817+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56312},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56312":{"gid":56312,"name":"b","rank":0,"incarnation":53,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6835/2667696599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":2667696599},{"type":"v1","addr":"172.21.15.73:6835","nonce":2667696599}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9fc065b20 msgr2=0x7fb9fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9fc065b20 0x7fb9fc067fe0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fba18071ce0 tx=0x7fba08007e00 comp rx=0 tx=0).stop 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 msgr2=0x7fba180c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180c6710 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba14015000 tx=0x7fba14004770 comp rx=0 tx=0).stop 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 shutdown_connections 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9fc065b20 0x7fb9fc067fe0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba180b88b0 0x7fba18148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba1806fe80 0x7fba180c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 --2- 172.21.15.45:0/4058795125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba1806ea90 0x7fba180c6710 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 >> 172.21.15.45:0/4058795125 conn(0x7fba180b46d0 msgr2=0x7fba180b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 shutdown_connections 2023-12-19T18:00:03.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.544+0000 7fba1eefe700 1 -- 172.21.15.45:0/4058795125 wait complete. 2023-12-19T18:00:03.554 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 58 2023-12-19T18:00:03.576 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-12-19T18:00:03.780 INFO:teuthology.orchestra.run.smithi073.stdout:{"message":"","return_code":0} 2023-12-19T18:00:03.781 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-12-19T18:00:03.781 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:00:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.968+0000 7f59f9bfc700 1 Processor -- start 2023-12-19T18:00:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f9bfc700 1 -- start start 2023-12-19T18:00:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f9bfc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59f40b88b0 0x7f59f406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f9bfc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f59f406f3b0 0x7f59f406f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f9bfc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f40d1820 con 0x7f59f406ea90 2023-12-19T18:00:03.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f9bfc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40d1630 con 0x7f59f40b88b0 2023-12-19T18:00:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f9bfc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f40d1b00 con 0x7f59f406f3b0 2023-12-19T18:00:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.972+0000 7f59f3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59f40b88b0 0x7f59f406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f59f40b88b0 0x7f59f406ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41584/0 (socket says 172.21.15.45:41584) 2023-12-19T18:00:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 -- 172.21.15.45:0/3090931467 learned_addr learned my addr 172.21.15.45:0/3090931467 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f93fb700 1 --2- 172.21.15.45:0/3090931467 >> v2:172.21.15.73:3300/0 conn(0x7f59f406f3b0 0x7f59f406f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 -- 172.21.15.45:0/3090931467 >> v2:172.21.15.73:3300/0 conn(0x7f59f406f3b0 msgr2=0x7f59f406f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 --2- 172.21.15.45:0/3090931467 >> v2:172.21.15.73:3300/0 conn(0x7f59f406f3b0 0x7f59f406f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 -- 172.21.15.45:0/3090931467 >> v1:172.21.15.73:6789/0 conn(0x7f59f406ea90 legacy=0x7f59f40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 -- 172.21.15.45:0/3090931467 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f40d1de0 con 0x7f59f40b88b0 2023-12-19T18:00:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f3fff700 1 --2- 172.21.15.45:0/3090931467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f40b88b0 0x7f59f406ee70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f59f408bc60 tx=0x7f59e0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1459ff45f220aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f37fe700 1 -- 172.21.15.45:0/3090931467 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0011830 con 0x7f59f40b88b0 2023-12-19T18:00:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f37fe700 1 -- 172.21.15.45:0/3090931467 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0011990 con 0x7f59f40b88b0 2023-12-19T18:00:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f37fe700 1 -- 172.21.15.45:0/3090931467 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0011d20 con 0x7f59f40b88b0 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3090931467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f40b88b0 msgr2=0x7f59f406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3090931467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f40b88b0 0x7f59f406ee70 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f59f408bc60 tx=0x7f59e0009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3090931467 shutdown_connections 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3090931467 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f40b88b0 0x7f59f406ee70 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3090931467 >> v2:172.21.15.73:3300/0 conn(0x7f59f406f3b0 0x7f59f406f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.976+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3090931467 >> 172.21.15.45:0/3090931467 conn(0x7f59f40b46d0 msgr2=0x7f59f40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.980+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3090931467 shutdown_connections 2023-12-19T18:00:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.980+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3090931467 wait complete. 2023-12-19T18:00:03.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 Processor -- start 2023-12-19T18:00:03.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 -- start start 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59f406ea90 0x7f59f41f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 0x7f59f41f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59f40b88b0 0x7f59f40cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f41f34e0 con 0x7f59f406f3b0 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f415a9a0 con 0x7f59f406ea90 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f9bfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f415d270 con 0x7f59f40b88b0 2023-12-19T18:00:03.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 0x7f59f41f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 0x7f59f41f2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41586/0 (socket says 172.21.15.45:41586) 2023-12-19T18:00:03.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 -- 172.21.15.45:0/3112237443 learned_addr learned my addr 172.21.15.45:0/3112237443 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f8bfa700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59f406ea90 0x7f59f41f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f93fb700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59f40b88b0 0x7f59f40cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 -- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59f40b88b0 msgr2=0x7f59f40cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59f40b88b0 0x7f59f40cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 -- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59f406ea90 msgr2=0x7f59f41f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59f406ea90 0x7f59f41f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 -- 172.21.15.45:0/3112237443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009570 con 0x7f59f406f3b0 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f8bfa700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59f406ea90 0x7f59f41f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.984+0000 7f59f3fff700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 0x7f59f41f2fa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f59f4072a40 tx=0x7f59e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.988+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0004520 con 0x7f59f406f3b0 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.988+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e001f070 con 0x7f59f406f3b0 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.988+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0003900 con 0x7f59f406f3b0 2023-12-19T18:00:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.988+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f40cc290 con 0x7f59f406f3b0 2023-12-19T18:00:03.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.988+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f41f6340 con 0x7f59f406f3b0 2023-12-19T18:00:03.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.988+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f4067760 con 0x7f59f406f3b0 2023-12-19T18:00:03.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.992+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f59e0003a60 con 0x7f59f406f3b0 2023-12-19T18:00:03.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.992+0000 7f59f17fa700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59d8065ad0 0x7f59d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:03.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.992+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f59e0021070 con 0x7f59f406f3b0 2023-12-19T18:00:03.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.992+0000 7f59f8bfa700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59d8065ad0 0x7f59d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:03.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:03.992+0000 7f59f8bfa700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59d8065ad0 0x7f59d8067f90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f59f40c64f0 tx=0x7f59e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.000+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f59e00520f0 con 0x7f59f406f3b0 2023-12-19T18:00:04.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.216+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f59f415d3b0 con 0x7f59f406f3b0 2023-12-19T18:00:04.225 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:00:04.220+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:00:04.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.236+0000 7f59f17fa700 1 -- 172.21.15.45:0/3112237443 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v59) v1 ==== 161+0+0 (secure 0 0 0) 0x7f59e0015090 con 0x7f59f406f3b0 2023-12-19T18:00:04.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59d8065ad0 msgr2=0x7f59d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59d8065ad0 0x7f59d8067f90 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f59f40c64f0 tx=0x7f59e8009040 comp rx=0 tx=0).stop 2023-12-19T18:00:04.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 msgr2=0x7f59f41f2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 0x7f59f41f2fa0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f59f4072a40 tx=0x7f59e0004770 comp rx=0 tx=0).stop 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 shutdown_connections 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f59d8065ad0 0x7f59d8067f90 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f59f40b88b0 0x7f59f40cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59f406f3b0 0x7f59f41f2fa0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 --2- 172.21.15.45:0/3112237443 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59f406ea90 0x7f59f41f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 >> 172.21.15.45:0/3112237443 conn(0x7f59f40b46d0 msgr2=0x7f59f40c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 shutdown_connections 2023-12-19T18:00:04.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.240+0000 7f59f9bfc700 1 -- 172.21.15.45:0/3112237443 wait complete. 2023-12-19T18:00:04.246 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:00:04.253 INFO:tasks.ceph.mds.b.smithi073.stderr: -3348> 2023-12-19T17:59:45.818+0000 7fd783803700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:00:04.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:00:04.275 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:00:04.312 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.347 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.348 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:00:04.349 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T18:00:04.350 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T18:00:04.351 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T18:00:04.352 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:00:04.353 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T18:00:04.354 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.355 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.356 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T18:00:04.357 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T18:00:04.358 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T18:00:04.359 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T18:00:04.360 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:00:04.361 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T18:00:04.362 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:00:04.363 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:00:04.364 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:00:04.365 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T18:00:04.366 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T18:00:04.367 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.368 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.375 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:00:04.382 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T18:00:04.449 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.450 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T18:00:04.451 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T18:00:04.452 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:00:04.453 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T18:00:04.454 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:00:04.455 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T18:00:04.456 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:00:04.457 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.458 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T18:00:04.459 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.460 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.498 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T18:00:04.498 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T18:00:04.498 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:00:04.498 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:00:04.499 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.500 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:00:04.501 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.502 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:00:04.503 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T18:00:04.504 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:00:04.505 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:00:04.506 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:00:04.507 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T18:00:04.508 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:00:04.509 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:00:04.520 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T18:00:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.584+0000 7f055d32b140 1 Processor -- start 2023-12-19T18:00:04.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.584+0000 7f055d32b140 1 -- start start 2023-12-19T18:00:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681cec8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce387d0 0x55681cec8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce28ca0 0x55681ce39d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681cd88ce0 con 0x55681ce28ca0 2023-12-19T18:00:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681cd45250 con 0x55681ce387d0 2023-12-19T18:00:04.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55681cd44ef0 con 0x55681ce288c0 2023-12-19T18:00:04.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681cec8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055b661700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce28ca0 0x55681ce39d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681cec8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:55554/0 (socket says 172.21.15.45:55554) 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 -- 172.21.15.45:0/2028102837 learned_addr learned my addr 172.21.15.45:0/2028102837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055a65f700 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce387d0 0x55681cec8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 -- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce387d0 msgr2=0x55681cec8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce387d0 0x55681cec8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 -- 172.21.15.45:0/2028102837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce28ca0 msgr2=0x55681ce39d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce28ca0 0x55681ce39d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 -- 172.21.15.45:0/2028102837 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55681cd268b0 con 0x55681ce288c0 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055b661700 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce28ca0 0x55681ce39d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055ae60700 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681cec8120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f054c001a30 tx=0x7f054c006340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=473473d06c6e7b68 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055965d700 1 -- 172.21.15.45:0/2028102837 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c006e70 con 0x55681ce288c0 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055965d700 1 -- 172.21.15.45:0/2028102837 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0063b0 con 0x55681ce288c0 2023-12-19T18:00:04.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055965d700 1 -- 172.21.15.45:0/2028102837 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c003750 con 0x55681ce288c0 2023-12-19T18:00:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 msgr2=0x55681cec8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681cec8120 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f054c001a30 tx=0x7f054c006340 comp rx=0 tx=0).stop 2023-12-19T18:00:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- 172.21.15.45:0/2028102837 shutdown_connections 2023-12-19T18:00:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce28ca0 0x55681ce39d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce387d0 0x55681cec8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 --2- 172.21.15.45:0/2028102837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681cec8120 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- 172.21.15.45:0/2028102837 >> 172.21.15.45:0/2028102837 conn(0x55681cdfab80 msgr2=0x55681ce24ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- 172.21.15.45:0/2028102837 shutdown_connections 2023-12-19T18:00:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.588+0000 7f055d32b140 1 -- 172.21.15.45:0/2028102837 wait complete. 2023-12-19T18:00:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 Processor -- start 2023-12-19T18:00:04.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 -- start start 2023-12-19T18:00:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681ceb6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce28ca0 0x55681ce3f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 0x55681ce246d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681cd1b240 con 0x55681ce387d0 2023-12-19T18:00:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55681ce3fdb0 con 0x55681ce28ca0 2023-12-19T18:00:04.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055d32b140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55681ce3fb10 con 0x55681ce288c0 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055b661700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 0x55681ce246d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055b661700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 0x55681ce246d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41608/0 (socket says 172.21.15.45:41608) 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 learned_addr learned my addr 172.21.15.45:0/2854499678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681ceb6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.592+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce28ca0 0x55681ce3f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 msgr2=0x55681ceb6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55681ce288c0 0x55681ceb6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce28ca0 msgr2=0x55681ce3f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55681ce28ca0 0x55681ce3f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055400a040 con 0x55681ce387d0 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 0x55681ce246d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x55681ce233a0 tx=0x7f0554010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f0543fff700 1 -- 172.21.15.45:0/2854499678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554018030 con 0x55681ce387d0 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f0543fff700 1 -- 172.21.15.45:0/2854499678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554008040 con 0x55681ce387d0 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55681cd33470 con 0x55681ce387d0 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f0543fff700 1 -- 172.21.15.45:0/2854499678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400e850 con 0x55681ce387d0 2023-12-19T18:00:04.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.596+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55681cd26310 con 0x55681ce387d0 2023-12-19T18:00:04.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f0543fff700 1 -- 172.21.15.45:0/2854499678 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f055401b070 con 0x55681ce387d0 2023-12-19T18:00:04.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f0543fff700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0548064430 0x7f05480668f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f0543fff700 1 -- 172.21.15.45:0/2854499678 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f0554019070 con 0x55681ce387d0 2023-12-19T18:00:04.606 INFO:teuthology.orchestra.run.smithi045.stdout:Warning: using slow linear search 2023-12-19T18:00:04.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0548064430 0x7f05480668f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55681ceb8530 0x55681cf6fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:1 11.0 11:00000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681ceb8530 2023-12-19T18:00:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55681ceb8530 0x55681cf6fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0548064430 0x7f05480668f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f054c002250 tx=0x7f054c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.600+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55681ceb8530 0x55681cf6fa00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.608+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(1 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x55681ceb8530 2023-12-19T18:00:04.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.608+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f0544002860 0x7f055001d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.608+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 11.10 11:08000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0544002860 2023-12-19T18:00:04.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.608+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f0544002860 0x7f055001d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.608+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f0544002860 0x7f055001d910 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.612+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 [pgnls start_epoch 89 out=177b] v88'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.612+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7f054c0123f0 0x7f054c012850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.612+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:3 11.8 11:10000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0123f0 2023-12-19T18:00:04.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.612+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7f054c0123f0 0x7f054c012850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7f054c0123f0 0x7f054c012850 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(3 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0123f0 2023-12-19T18:00:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f0550013890 0x7f055002b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:4 11.18 11:18000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0550013890 2023-12-19T18:00:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f0550013890 0x7f055002b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f0550013890 0x7f055002b3f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(4 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55681cdfbbe0 0x7f0554053680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 11.4 11:20000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681cdfbbe0 2023-12-19T18:00:04.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.616+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55681cdfbbe0 0x7f0554053680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.620+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55681cdfbbe0 0x7f0554053680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.620+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(5 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.620+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f054c0253e0 0x7f054c025800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.620+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:6 11.14 11:28000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0253e0 2023-12-19T18:00:04.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.620+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f054c0253e0 0x7f054c025800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.620+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f054c0253e0 0x7f054c025800 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.628+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(6 [pgnls start_epoch 89 out=149b] v88'21 uv21 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.628+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:7 11.c 11:30000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681ceb8530 2023-12-19T18:00:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.628+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(7 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x55681ceb8530 2023-12-19T18:00:04.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.628+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:8 11.1c 11:38000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0253e0 2023-12-19T18:00:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(8 [pgnls start_epoch 89 out=73b] v84'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:9 11.2 11:40000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0550013890 2023-12-19T18:00:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(9 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 11.12 11:48000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681cdfbbe0 2023-12-19T18:00:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(10 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:11 11.a 11:50000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0123f0 2023-12-19T18:00:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(11 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0123f0 2023-12-19T18:00:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055a65f700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f055003c900 0x7f0550008400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:12 11.1a 11:58000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f055003c900 2023-12-19T18:00:04.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.632+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f055003c900 0x7f0550008400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.636+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f055003c900 0x7f0550008400 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(12 [pgnls start_epoch 89 out=49b] v84'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 11.6 11:60000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0544002860 2023-12-19T18:00:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(13 [pgnls start_epoch 89 out=77b] v88'4 uv4 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 11.16 11:68000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f055003c900 2023-12-19T18:00:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(14 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055b661700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55681ce40490 0x7f0554057860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.640+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 11.e 11:70000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681ce40490 2023-12-19T18:00:04.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.644+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55681ce40490 0x7f0554057860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.644+0000 7f055ae60700 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55681ce40490 0x7f0554057860 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.648+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(15 [pgnls start_epoch 89 out=73b] v84'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f054c018020 con 0x55681ce40490 2023-12-19T18:00:04.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.648+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 11.1e 11:78000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681cdfbbe0 2023-12-19T18:00:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(16 [pgnls start_epoch 89 out=49b] v84'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:17 11.1 11:80000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0253e0 2023-12-19T18:00:04.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(17 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:18 11.11 11:88000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0550013890 2023-12-19T18:00:04.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(18 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:19 11.9 11:90000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0123f0 2023-12-19T18:00:04.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(19 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0123f0 2023-12-19T18:00:04.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.652+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:20 11.19 11:98000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0544002860 2023-12-19T18:00:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(20 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:21 11.5 11:a0000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681cdfbbe0 2023-12-19T18:00:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(21 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:22 11.15 11:a8000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0550013890 2023-12-19T18:00:04.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(22 [pgnls start_epoch 89 out=97b] v84'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:23 11.d 11:b0000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f0550013890 2023-12-19T18:00:04.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(23 [pgnls start_epoch 89 out=74b] v84'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.656+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 11.1d 11:b8000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x55681cdfbbe0 2023-12-19T18:00:04.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(24 [pgnls start_epoch 89 out=73b] v84'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 11.3 11:c0000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0253e0 2023-12-19T18:00:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(25 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:26 11.13 11:c8000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f055003c900 2023-12-19T18:00:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(26 [pgnls start_epoch 89 out=98b] v88'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 11.b 11:d0000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x55681cf6ff40 con 0x7f054c0123f0 2023-12-19T18:00:04.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(27 [pgnls start_epoch 89 out=76b] v88'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0123f0 2023-12-19T18:00:04.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.660+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:28 11.1b 11:d8000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x7f0550049060 con 0x55681ce40490 2023-12-19T18:00:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(28 [pgnls start_epoch 89 out=49b] v84'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x55681ce40490 2023-12-19T18:00:04.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 11.7 11:e0000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x7f0550049060 con 0x7f055003c900 2023-12-19T18:00:04.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(29 [pgnls start_epoch 89 out=73b] v84'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 11.17 11:e8000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x7f0550049060 con 0x55681cdfbbe0 2023-12-19T18:00:04.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(30 [pgnls start_epoch 89 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:31 11.f 11:f0000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x7f0550049060 con 0x55681cdfbbe0 2023-12-19T18:00:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(31 [pgnls start_epoch 89 out=73b] v84'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.664+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:32 11.1f 11:f8000000:%01:::head [pgnls start_epoch 89 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e89) v8 -- 0x7f0550049060 con 0x7f0550013890 2023-12-19T18:00:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(32 [pgnls start_epoch 89 out=101b] v88'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:33 11.10 11:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681ce24c10 con 0x7f0544002860 2023-12-19T18:00:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:34 11.10 11:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681ceb7ff0 con 0x7f0544002860 2023-12-19T18:00:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:35 11.10 11:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf707e0 con 0x7f0544002860 2023-12-19T18:00:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:36 11.10 11:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf71080 con 0x7f0544002860 2023-12-19T18:00:04.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:37 11.10 11:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf71920 con 0x7f0544002860 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:38 11.14 11:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf721c0 con 0x7f054c0253e0 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:39 11.14 11:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf72a60 con 0x7f054c0253e0 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:40 11.14 11:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf73300 con 0x7f054c0253e0 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 11.14 11:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf73ba0 con 0x7f054c0253e0 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:42 11.1c 11:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf74440 con 0x7f054c0253e0 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:43 11.6 11:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf74ce0 con 0x7f0544002860 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:44 11.e 11:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf755c0 con 0x55681ce40490 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:45 11.15 11:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf76120 con 0x7f0550013890 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:46 11.15 11:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf73ba0 con 0x7f0550013890 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:47 11.d 11:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf74ce0 con 0x7f0550013890 2023-12-19T18:00:04.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.668+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:48 11.1d 11:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf77480 con 0x55681cdfbbe0 2023-12-19T18:00:04.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(38 1.00000000.inode [delete] v89'22 uv22 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:49 11.13 11:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf77480 con 0x7f055003c900 2023-12-19T18:00:04.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(45 604.00000000 [delete] v89'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:50 11.13 11:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf77830 con 0x7f055003c900 2023-12-19T18:00:04.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(44 608.00000000 [delete] v89'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x55681ce40490 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(46 500.00000000 [delete] v89'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:51 11.b 11:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf77be0 con 0x7f054c0123f0 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:52 11.7 11:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf77f90 con 0x7f055003c900 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(39 200.00000000 [delete] v89'23 uv23 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(33 601.00000000 [delete] v89'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(40 200.00000001 [delete] v89'24 uv24 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:53 11.f 11:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf72e10 con 0x55681cdfbbe0 2023-12-19T18:00:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:54 11.1f 11:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf77be0 con 0x7f0550013890 2023-12-19T18:00:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:55 11.1f 11:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e89) v8 -- 0x55681cf784c0 con 0x7f0550013890 2023-12-19T18:00:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.672+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(48 605.00000000 [delete] v89'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v89'5 uv5 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(42 607.00000000 [delete] v89'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(47 mds_snaptable [delete] v89'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(34 602.00000000 [delete] v89'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(35 10000000000.00000000 [delete] v89'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(36 600.00000000 [delete] v89'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(41 606.00000000 [delete] v89'25 uv25 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0253e0 2023-12-19T18:00:04.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(37 603.00000000 [delete] v89'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x7f0544002860 2023-12-19T18:00:04.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(49 mds0_inotable [delete] v89'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(50 100.00000000 [delete] v89'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055a65f700 1 -- 172.21.15.45:0/2854499678 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(51 mds0_sessionmap [delete] v89'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7f0550026040 con 0x7f054c0123f0 2023-12-19T18:00:04.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(52 609.00000000 [delete] v89'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f055003c900 2023-12-19T18:00:04.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055ae60700 1 -- 172.21.15.45:0/2854499678 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(53 400.00000000 [delete] v89'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7f054c018020 con 0x55681cdfbbe0 2023-12-19T18:00:04.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(54 100.00000000.inode [delete] v89'7 uv7 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(55 1.00000000 [delete] v89'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7f0554051090 con 0x7f0550013890 2023-12-19T18:00:04.684 INFO:teuthology.orchestra.run.smithi045.stdout:Removed 23 objects 2023-12-19T18:00:04.684 INFO:teuthology.orchestra.run.smithi045.stdout:successfully purged pool cephfs_metadata 2023-12-19T18:00:04.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f0544002860 msgr2=0x7f055001d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7f0544002860 0x7f055001d910 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55681ceb8530 msgr2=0x55681cf6fa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55681ceb8530 0x55681cf6fa00 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f0550013890 msgr2=0x7f055002b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f0550013890 0x7f055002b3f0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7f054c0123f0 msgr2=0x7f054c012850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7f054c0123f0 0x7f054c012850 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55681ce40490 msgr2=0x7f0554057860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55681ce40490 0x7f0554057860 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f055003c900 msgr2=0x7f0550008400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f055003c900 0x7f0550008400 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 reap_dead start 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f054c0253e0 msgr2=0x7f054c025800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f054c0253e0 0x7f054c025800 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55681cdfbbe0 msgr2=0x7f0554053680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55681cdfbbe0 0x7f0554053680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.676+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 reap_dead start 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055b661700 1 -- 172.21.15.45:0/2854499678 reap_dead start 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0548064430 msgr2=0x7f05480668f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0548064430 0x7f05480668f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f054c002250 tx=0x7f054c008030 comp rx=0 tx=0).stop 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 msgr2=0x55681ce246d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 0x55681ce246d0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x55681ce233a0 tx=0x7f0554010ee0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 shutdown_connections 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0548064430 0x7f05480668f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 --2- 172.21.15.45:0/2854499678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55681ce387d0 0x55681ce246d0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 >> 172.21.15.45:0/2854499678 conn(0x55681cdfab80 msgr2=0x55681cec7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 shutdown_connections 2023-12-19T18:00:04.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.680+0000 7f055d32b140 1 -- 172.21.15.45:0/2854499678 wait complete. 2023-12-19T18:00:04.690 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2023-12-19T18:00:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9416964700 1 Processor -- start 2023-12-19T18:00:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9416964700 1 -- start start 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9416964700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f941015b920 0x7f94100713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9416964700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94100b1bb0 con 0x7f941015b540 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9416964700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94100b1e90 con 0x7f9410071910 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9416964700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94100b2830 con 0x7f941015b920 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9415161700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f941015b920 0x7f94100713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9415962700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f941015b540 0x7f94101621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51332/0 (socket says 172.21.15.45:51332) 2023-12-19T18:00:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9415962700 1 -- 172.21.15.45:0/1315460610 learned_addr learned my addr 172.21.15.45:0/1315460610 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9415161700 1 -- 172.21.15.45:0/1315460610 >> v1:172.21.15.73:6789/0 conn(0x7f9410071910 legacy=0x7f94100af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9415161700 1 -- 172.21.15.45:0/1315460610 >> v1:172.21.15.45:6789/0 conn(0x7f941015b540 legacy=0x7f94101621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.868+0000 7f9415161700 1 -- 172.21.15.45:0/1315460610 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94100b2170 con 0x7f941015b920 2023-12-19T18:00:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9415161700 1 --2- 172.21.15.45:0/1315460610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b920 0x7f94100713d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9400009850 tx=0x7f9400009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ab23d36ece4be2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9414960700 1 -- 172.21.15.45:0/1315460610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011830 con 0x7f941015b920 2023-12-19T18:00:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9414960700 1 -- 172.21.15.45:0/1315460610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9400011990 con 0x7f941015b920 2023-12-19T18:00:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9414960700 1 -- 172.21.15.45:0/1315460610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9400011d20 con 0x7f941015b920 2023-12-19T18:00:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 -- 172.21.15.45:0/1315460610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b920 msgr2=0x7f94100713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 --2- 172.21.15.45:0/1315460610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b920 0x7f94100713d0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f9400009850 tx=0x7f9400009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 -- 172.21.15.45:0/1315460610 shutdown_connections 2023-12-19T18:00:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 --2- 172.21.15.45:0/1315460610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b920 0x7f94100713d0 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 -- 172.21.15.45:0/1315460610 >> 172.21.15.45:0/1315460610 conn(0x7f94100cf5a0 msgr2=0x7f9410070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 -- 172.21.15.45:0/1315460610 shutdown_connections 2023-12-19T18:00:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.872+0000 7f9416964700 1 -- 172.21.15.45:0/1315460610 wait complete. 2023-12-19T18:00:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 Processor -- start 2023-12-19T18:00:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 -- start start 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 0x7f9410150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941015b920 0x7f941015cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9410152250 0x7f94101526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941015d0a0 con 0x7f941015b540 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94100cbb30 con 0x7f941015b920 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94100cbe10 con 0x7f9410152250 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 0x7f9410150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 0x7f9410150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41626/0 (socket says 172.21.15.45:41626) 2023-12-19T18:00:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 -- 172.21.15.45:0/1021022046 learned_addr learned my addr 172.21.15.45:0/1021022046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415161700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941015b920 0x7f941015cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416163700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9410152250 0x7f94101526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 -- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9410152250 msgr2=0x7f94101526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9410152250 0x7f94101526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 -- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941015b920 msgr2=0x7f941015cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941015b920 0x7f941015cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 -- 172.21.15.45:0/1021022046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94000094b0 con 0x7f941015b540 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9415962700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 0x7f9410150dc0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f940c00c700 tx=0x7f940c00cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0074e0 con 0x7f941015b540 2023-12-19T18:00:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c007640 con 0x7f941015b540 2023-12-19T18:00:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94100cc0f0 con 0x7f941015b540 2023-12-19T18:00:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c005a90 con 0x7f941015b540 2023-12-19T18:00:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.876+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94100cc6b0 con 0x7f941015b540 2023-12-19T18:00:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.880+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941004ed30 con 0x7f941015b540 2023-12-19T18:00:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.880+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f940c005bf0 con 0x7f941015b540 2023-12-19T18:00:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.884+0000 7f94067fc700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93f4065ad0 0x7f93f4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:04.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.884+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f940c082a50 con 0x7f941015b540 2023-12-19T18:00:04.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.884+0000 7f9415161700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93f4065ad0 0x7f93f4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:04.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.884+0000 7f9415161700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93f4065ad0 0x7f93f4067f90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f94000097a0 tx=0x7f9400008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:04.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:04.892+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f940c050050 con 0x7f941015b540 2023-12-19T18:00:05.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.112+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f94100b2f00 con 0x7f941015b540 2023-12-19T18:00:05.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.248+0000 7f94067fc700 1 -- 172.21.15.45:0/1021022046 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v60) v1 ==== 107+0+0 (secure 0 0 0) 0x7f940c0170b0 con 0x7f941015b540 2023-12-19T18:00:05.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93f4065ad0 msgr2=0x7f93f4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93f4065ad0 0x7f93f4067f90 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f94000097a0 tx=0x7f9400008030 comp rx=0 tx=0).stop 2023-12-19T18:00:05.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 msgr2=0x7f9410150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 0x7f9410150dc0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f940c00c700 tx=0x7f940c00cac0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 shutdown_connections 2023-12-19T18:00:05.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f93f4065ad0 0x7f93f4067f90 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9410152250 0x7f94101526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f941015b920 0x7f941015cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 --2- 172.21.15.45:0/1021022046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f941015b540 0x7f9410150dc0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 >> 172.21.15.45:0/1021022046 conn(0x7f9410071910 msgr2=0x7f941015f380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 shutdown_connections 2023-12-19T18:00:05.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.252+0000 7f9416964700 1 -- 172.21.15.45:0/1021022046 wait complete. 2023-12-19T18:00:05.266 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:05.265+0000 7fa5e05e4700 -1 mds.0.snaptable: load_2 could not read table: -2 2023-12-19T18:00:05.266 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:05.265+0000 7fa5e05e4700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2023-12-19T18:00:05.269 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:00:05.264+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:00:05.269 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:00:05.264+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-12-19T18:00:05.283 INFO:tasks.ceph.mds.b.smithi073.stderr: -34> 2023-12-19T18:00:05.265+0000 7fa5e05e4700 -1 mds.0.snaptable: load_2 could not read table: -2 2023-12-19T18:00:05.283 INFO:tasks.ceph.mds.b.smithi073.stderr: -30> 2023-12-19T18:00:05.265+0000 7fa5e05e4700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2023-12-19T18:00:05.285 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-12-19T18:00:05.334 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:00:05.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.468+0000 7f96a8f64700 1 Processor -- start 2023-12-19T18:00:05.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.468+0000 7f96a8f64700 1 -- start start 2023-12-19T18:00:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a8f64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f96a40b8580 0x7f96a40cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:05.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a8f64700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a415d300 con 0x7f96a415cf20 2023-12-19T18:00:05.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a8f64700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96a40d1550 con 0x7f96a40d25f0 2023-12-19T18:00:05.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a8f64700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96a40d1360 con 0x7f96a40b8580 2023-12-19T18:00:05.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a37fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f96a415cf20 0x7f96a40d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51342/0 (socket says 172.21.15.45:51342) 2023-12-19T18:00:05.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a37fe700 1 -- 172.21.15.45:0/1033452374 learned_addr learned my addr 172.21.15.45:0/1033452374 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:05.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a2ffd700 1 --2- 172.21.15.45:0/1033452374 >> v2:172.21.15.73:3300/0 conn(0x7f96a40b8580 0x7f96a40cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a27fc700 1 -- 172.21.15.45:0/1033452374 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130897094 0 0) 0x7f96a415d300 con 0x7f96a415cf20 2023-12-19T18:00:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a27fc700 1 -- 172.21.15.45:0/1033452374 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f968c0035d0 con 0x7f96a415cf20 2023-12-19T18:00:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a2ffd700 1 -- 172.21.15.45:0/1033452374 >> v1:172.21.15.73:6789/0 conn(0x7f96a40d25f0 legacy=0x7f96a40b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a2ffd700 1 -- 172.21.15.45:0/1033452374 >> v1:172.21.15.45:6789/0 conn(0x7f96a415cf20 legacy=0x7f96a40d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a2ffd700 1 -- 172.21.15.45:0/1033452374 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a40d1830 con 0x7f96a40b8580 2023-12-19T18:00:05.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a2ffd700 1 --2- 172.21.15.45:0/1033452374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a40cd8c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9698009850 tx=0x7f9698009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33d305ef7709fe30 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:05.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.472+0000 7f96a27fc700 1 -- 172.21.15.45:0/1033452374 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011830 con 0x7f96a40b8580 2023-12-19T18:00:05.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a27fc700 1 -- 172.21.15.45:0/1033452374 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9698011990 con 0x7f96a40b8580 2023-12-19T18:00:05.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a27fc700 1 -- 172.21.15.45:0/1033452374 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9698011d00 con 0x7f96a40b8580 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 -- 172.21.15.45:0/1033452374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 msgr2=0x7f96a40cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 --2- 172.21.15.45:0/1033452374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a40cd8c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9698009850 tx=0x7f9698009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 -- 172.21.15.45:0/1033452374 shutdown_connections 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 --2- 172.21.15.45:0/1033452374 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a40cd8c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 -- 172.21.15.45:0/1033452374 >> 172.21.15.45:0/1033452374 conn(0x7f96a40b4670 msgr2=0x7f96a40b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 -- 172.21.15.45:0/1033452374 shutdown_connections 2023-12-19T18:00:05.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.476+0000 7f96a8f64700 1 -- 172.21.15.45:0/1033452374 wait complete. 2023-12-19T18:00:05.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 Processor -- start 2023-12-19T18:00:05.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 -- start start 2023-12-19T18:00:05.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a41f4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:05.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 0x7f96a40a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:05.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96a415cf20 0x7f96a41f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:05.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40cccc0 con 0x7f96a40d25f0 2023-12-19T18:00:05.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b7160 con 0x7f96a40b8580 2023-12-19T18:00:05.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a8f64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96a40b7440 con 0x7f96a415cf20 2023-12-19T18:00:05.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 0x7f96a40a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:05.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 0x7f96a40a95e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41640/0 (socket says 172.21.15.45:41640) 2023-12-19T18:00:05.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.480+0000 7f96a2ffd700 1 -- 172.21.15.45:0/2073085207 learned_addr learned my addr 172.21.15.45:0/2073085207 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:05.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a37fe700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a41f4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:05.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a3fff700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96a415cf20 0x7f96a41f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:05.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a2ffd700 1 -- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96a415cf20 msgr2=0x7f96a41f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a2ffd700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96a415cf20 0x7f96a41f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a2ffd700 1 -- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 msgr2=0x7f96a41f4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a2ffd700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a41f4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a2ffd700 1 -- 172.21.15.45:0/2073085207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96980094b0 con 0x7f96a40d25f0 2023-12-19T18:00:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a37fe700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a41f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a2ffd700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 0x7f96a40a95e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f96980090b0 tx=0x7f9698004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969801a7e0 con 0x7f96a40d25f0 2023-12-19T18:00:05.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969801a940 con 0x7f96a40d25f0 2023-12-19T18:00:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96a40b7720 con 0x7f96a40d25f0 2023-12-19T18:00:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969801acf0 con 0x7f96a40d25f0 2023-12-19T18:00:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96a40b7ce0 con 0x7f96a40d25f0 2023-12-19T18:00:05.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.484+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96a404ed30 con 0x7f96a40d25f0 2023-12-19T18:00:05.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.488+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9698022070 con 0x7f96a40d25f0 2023-12-19T18:00:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.488+0000 7f968bfff700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9690065b50 0x7f9690068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.488+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f96980843a0 con 0x7f96a40d25f0 2023-12-19T18:00:05.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.492+0000 7f96a37fe700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9690065b50 0x7f9690068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:05.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.492+0000 7f96a37fe700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9690065b50 0x7f9690068010 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9694007fd0 tx=0x7f9694007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:05.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.496+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9698051a50 con 0x7f96a40d25f0 2023-12-19T18:00:05.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:05.716+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f96a406fe50 con 0x7f96a40d25f0 2023-12-19T18:00:06.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.280+0000 7f968bfff700 1 -- 172.21.15.45:0/2073085207 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v63) v1 ==== 162+0+0 (secure 0 0 0) 0x7f96980150b0 con 0x7f96a40d25f0 2023-12-19T18:00:06.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9690065b50 msgr2=0x7f9690068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9690065b50 0x7f9690068010 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f9694007fd0 tx=0x7f9694007de0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 msgr2=0x7f96a40a95e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 0x7f96a40a95e0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f96980090b0 tx=0x7f9698004770 comp rx=0 tx=0).stop 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 shutdown_connections 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9690065b50 0x7f9690068010 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f96a415cf20 0x7f96a41f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f96a40d25f0 0x7f96a40a95e0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 --2- 172.21.15.45:0/2073085207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f96a40b8580 0x7f96a41f4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 >> 172.21.15.45:0/2073085207 conn(0x7f96a40b4670 msgr2=0x7f96a4070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 shutdown_connections 2023-12-19T18:00:06.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.288+0000 7f96a8f64700 1 -- 172.21.15.45:0/2073085207 wait complete. 2023-12-19T18:00:06.296 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-12-19T18:00:06.320 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:06.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.508+0000 7f821d85d700 1 Processor -- start 2023-12-19T18:00:06.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 -- start start 2023-12-19T18:00:06.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f821815ae20 0x7f821815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f821806cad0 0x7f82180c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82180af720 0x7f82180afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82180b0110 con 0x7f821815ae20 2023-12-19T18:00:06.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821806f0a0 con 0x7f821806cad0 2023-12-19T18:00:06.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d85d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821806ea90 con 0x7f82180af720 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f821815ae20 0x7f821815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f821815ae20 0x7f821815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41642/0 (socket says 172.21.15.45:41642) 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 -- 172.21.15.45:0/3451367631 learned_addr learned my addr 172.21.15.45:0/3451367631 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821d05c700 1 --2- 172.21.15.45:0/3451367631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82180af720 0x7f82180afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f8217fff700 1 --2- 172.21.15.45:0/3451367631 >> v2:172.21.15.73:3300/0 conn(0x7f821806cad0 0x7f82180c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 -- 172.21.15.45:0/3451367631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82180af720 msgr2=0x7f82180afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 --2- 172.21.15.45:0/3451367631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82180af720 0x7f82180afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 -- 172.21.15.45:0/3451367631 >> v2:172.21.15.73:3300/0 conn(0x7f821806cad0 msgr2=0x7f82180c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 --2- 172.21.15.45:0/3451367631 >> v2:172.21.15.73:3300/0 conn(0x7f821806cad0 0x7f82180c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.512+0000 7f821c85b700 1 -- 172.21.15.45:0/3451367631 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82180c3f60 con 0x7f821815ae20 2023-12-19T18:00:06.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821c85b700 1 --2- 172.21.15.45:0/3451367631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821815ae20 0x7f821815be40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f821806ac40 tx=0x7f820c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b8457de8d70b85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:06.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f82177fe700 1 -- 172.21.15.45:0/3451367631 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011830 con 0x7f821815ae20 2023-12-19T18:00:06.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f82177fe700 1 -- 172.21.15.45:0/3451367631 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820c011990 con 0x7f821815ae20 2023-12-19T18:00:06.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f82177fe700 1 -- 172.21.15.45:0/3451367631 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820c011d20 con 0x7f821815ae20 2023-12-19T18:00:06.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 -- 172.21.15.45:0/3451367631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821815ae20 msgr2=0x7f821815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 --2- 172.21.15.45:0/3451367631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821815ae20 0x7f821815be40 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f821806ac40 tx=0x7f820c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 -- 172.21.15.45:0/3451367631 shutdown_connections 2023-12-19T18:00:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 --2- 172.21.15.45:0/3451367631 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82180af720 0x7f82180afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 --2- 172.21.15.45:0/3451367631 >> v2:172.21.15.73:3300/0 conn(0x7f821806cad0 0x7f82180c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 --2- 172.21.15.45:0/3451367631 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f821815ae20 0x7f821815be40 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 -- 172.21.15.45:0/3451367631 >> 172.21.15.45:0/3451367631 conn(0x7f82180cb900 msgr2=0x7f82180b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 -- 172.21.15.45:0/3451367631 shutdown_connections 2023-12-19T18:00:06.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.516+0000 7f821d85d700 1 -- 172.21.15.45:0/3451367631 wait complete. 2023-12-19T18:00:06.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 Processor -- start 2023-12-19T18:00:06.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 -- start start 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821806cad0 0x7f821815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 0x7f82180af0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f821815ae20 0x7f82180c7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c6080 con 0x7f82180af720 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c75f0 con 0x7f821806cad0 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d85d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82180c8280 con 0x7f821815ae20 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 0x7f82180af0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 0x7f82180af0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41644/0 (socket says 172.21.15.45:41644) 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 -- 172.21.15.45:0/2579586231 learned_addr learned my addr 172.21.15.45:0/2579586231 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821c85b700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821806cad0 0x7f821815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821d05c700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f821815ae20 0x7f82180c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 -- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f821815ae20 msgr2=0x7f82180c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f821815ae20 0x7f82180c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 -- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821806cad0 msgr2=0x7f821815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821806cad0 0x7f821815a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f8217fff700 1 -- 172.21.15.45:0/2579586231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f820c009570 con 0x7f82180af720 2023-12-19T18:00:06.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.520+0000 7f821c85b700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821806cad0 0x7f821815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:06.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f8217fff700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 0x7f82180af0a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f820400e940 tx=0x7f820400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:06.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82040096a0 con 0x7f82180af720 2023-12-19T18:00:06.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f820400c850 con 0x7f82180af720 2023-12-19T18:00:06.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f820400cc00 con 0x7f82180af720 2023-12-19T18:00:06.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82180c7fa0 con 0x7f82180af720 2023-12-19T18:00:06.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82180c5ca0 con 0x7f82180af720 2023-12-19T18:00:06.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82180c61c0 con 0x7f82180af720 2023-12-19T18:00:06.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.524+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f820400cd60 con 0x7f82180af720 2023-12-19T18:00:06.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.528+0000 7f82157fa700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81fc065b00 0x7f81fc067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.528+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f8204083520 con 0x7f82180af720 2023-12-19T18:00:06.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.528+0000 7f821c85b700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81fc065b00 0x7f81fc067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.528+0000 7f821c85b700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81fc065b00 0x7f81fc067fc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f820c009860 tx=0x7f820c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:06.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.532+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f82180c61c0 con 0x7f82180af720 2023-12-19T18:00:06.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.752+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82180c61c0 con 0x7f82180af720 2023-12-19T18:00:06.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f82157fa700 1 -- 172.21.15.45:0/2579586231 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f82180c61c0 con 0x7f82180af720 2023-12-19T18:00:06.761 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:06.761 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3302507960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3302507960},{"type":"v1","addr":"172.21.15.73:6835","nonce":3302507960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:06.276427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:06.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81fc065b00 msgr2=0x7f81fc067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81fc065b00 0x7f81fc067fc0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f820c009860 tx=0x7f820c008030 comp rx=0 tx=0).stop 2023-12-19T18:00:06.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 msgr2=0x7f82180af0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 0x7f82180af0a0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f820400e940 tx=0x7f820400ed00 comp rx=0 tx=0).stop 2023-12-19T18:00:06.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 shutdown_connections 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f81fc065b00 0x7f81fc067fc0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f821815ae20 0x7f82180c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82180af720 0x7f82180af0a0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 --2- 172.21.15.45:0/2579586231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821806cad0 0x7f821815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 >> 172.21.15.45:0/2579586231 conn(0x7f82180cb900 msgr2=0x7f82180cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 shutdown_connections 2023-12-19T18:00:06.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.756+0000 7f821d85d700 1 -- 172.21.15.45:0/2579586231 wait complete. 2023-12-19T18:00:06.765 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 63 2023-12-19T18:00:06.784 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T18:00:06.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:06.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.932+0000 7f592bc0a700 1 Processor -- start 2023-12-19T18:00:06.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.932+0000 7f592bc0a700 1 -- start start 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f592bc0a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f592415d040 0x7f59240cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f592bc0a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f592406f4a0 0x7f59240d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f592bc0a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59240b6060 con 0x7f592415d420 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f592bc0a700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592406f930 con 0x7f592415d040 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f592bc0a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f592406fc10 con 0x7f592406f4a0 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f592415d040 0x7f59240cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f592415d040 0x7f59240cdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41650/0 (socket says 172.21.15.45:41650) 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 -- 172.21.15.45:0/3756327910 learned_addr learned my addr 172.21.15.45:0/3756327910 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:06.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59291a5700 1 --2- 172.21.15.45:0/3756327910 >> v2:172.21.15.73:3300/0 conn(0x7f592406f4a0 0x7f59240d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 -- 172.21.15.45:0/3756327910 >> v2:172.21.15.73:3300/0 conn(0x7f592406f4a0 msgr2=0x7f59240d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 --2- 172.21.15.45:0/3756327910 >> v2:172.21.15.73:3300/0 conn(0x7f592406f4a0 0x7f59240d21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 -- 172.21.15.45:0/3756327910 >> v1:172.21.15.73:6789/0 conn(0x7f592415d420 legacy=0x7f59240d0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 -- 172.21.15.45:0/3756327910 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592406fef0 con 0x7f592415d040 2023-12-19T18:00:06.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59299a6700 1 --2- 172.21.15.45:0/3756327910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f592415d040 0x7f59240cdf20 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5924071a50 tx=0x7f5920009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c891abdb85105e2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.936+0000 7f59289a4700 1 -- 172.21.15.45:0/3756327910 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011830 con 0x7f592415d040 2023-12-19T18:00:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f59289a4700 1 -- 172.21.15.45:0/3756327910 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920011990 con 0x7f592415d040 2023-12-19T18:00:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f59289a4700 1 -- 172.21.15.45:0/3756327910 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920011d20 con 0x7f592415d040 2023-12-19T18:00:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 -- 172.21.15.45:0/3756327910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f592415d040 msgr2=0x7f59240cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 --2- 172.21.15.45:0/3756327910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f592415d040 0x7f59240cdf20 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f5924071a50 tx=0x7f5920009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 -- 172.21.15.45:0/3756327910 shutdown_connections 2023-12-19T18:00:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 --2- 172.21.15.45:0/3756327910 >> v2:172.21.15.73:3300/0 conn(0x7f592406f4a0 0x7f59240d21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 --2- 172.21.15.45:0/3756327910 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f592415d040 0x7f59240cdf20 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 -- 172.21.15.45:0/3756327910 >> 172.21.15.45:0/3756327910 conn(0x7f59240d2e50 msgr2=0x7f59240d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:06.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 -- 172.21.15.45:0/3756327910 shutdown_connections 2023-12-19T18:00:06.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 -- 172.21.15.45:0/3756327910 wait complete. 2023-12-19T18:00:06.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 Processor -- start 2023-12-19T18:00:06.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.940+0000 7f592bc0a700 1 -- start start 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592415d040 0x7f59240d2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f592415d420 0x7f59241f5280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 0x7f59241f57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59241f5d00 con 0x7f59241f3a80 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592415e800 con 0x7f592415d040 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f592415e520 con 0x7f592415d420 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 0x7f59241f57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 0x7f59241f57c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41658/0 (socket says 172.21.15.45:41658) 2023-12-19T18:00:06.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 -- 172.21.15.45:0/631056266 learned_addr learned my addr 172.21.15.45:0/631056266 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:06.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f59299a6700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592415d040 0x7f59240d2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f59291a5700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f592415d420 0x7f59241f5280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 -- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f592415d420 msgr2=0x7f59241f5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f592415d420 0x7f59241f5280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 -- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592415d040 msgr2=0x7f59240d2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592415d040 0x7f59240d2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 -- 172.21.15.45:0/631056266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5920009570 con 0x7f59241f3a80 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f59299a6700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592415d040 0x7f59240d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592a1a7700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 0x7f59241f57c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f591c00cbf0 tx=0x7f591c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:06.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c003c20 con 0x7f59241f3a80 2023-12-19T18:00:06.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591c003d80 con 0x7f59241f3a80 2023-12-19T18:00:06.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591c00ac20 con 0x7f59241f3a80 2023-12-19T18:00:06.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f592415eb50 con 0x7f59241f3a80 2023-12-19T18:00:06.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.944+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f592415f110 con 0x7f59241f3a80 2023-12-19T18:00:06.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.948+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f592404ed30 con 0x7f59241f3a80 2023-12-19T18:00:06.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.948+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f591c0050d0 con 0x7f59241f3a80 2023-12-19T18:00:06.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.948+0000 7f591a7fc700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5908065ad0 0x7f5908067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:06.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.948+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f591c083620 con 0x7f59241f3a80 2023-12-19T18:00:06.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.948+0000 7f59299a6700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5908065ad0 0x7f5908067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:06.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.952+0000 7f59299a6700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5908065ad0 0x7f5908067f90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5920000c00 tx=0x7f5920008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:06.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:06.956+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f591c050bc0 con 0x7f59241f3a80 2023-12-19T18:00:07.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.168+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59240c6700 con 0x7f59241f3a80 2023-12-19T18:00:07.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.168+0000 7f591a7fc700 1 -- 172.21.15.45:0/631056266 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4706 (secure 0 0 0) 0x7f591c0541e0 con 0x7f59241f3a80 2023-12-19T18:00:07.174 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:07.174 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3302507960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3302507960},{"type":"v1","addr":"172.21.15.73:6835","nonce":3302507960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:06.276427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.168+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5908065ad0 msgr2=0x7f5908067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.168+0000 7f592bc0a700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5908065ad0 0x7f5908067f90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f5920000c00 tx=0x7f5920008030 comp rx=0 tx=0).stop 2023-12-19T18:00:07.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.168+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 msgr2=0x7f59241f57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.168+0000 7f592bc0a700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 0x7f59241f57c0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f591c00cbf0 tx=0x7f591c00a060 comp rx=0 tx=0).stop 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 shutdown_connections 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5908065ad0 0x7f5908067f90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f59241f3a80 0x7f59241f57c0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f592415d420 0x7f59241f5280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 --2- 172.21.15.45:0/631056266 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f592415d040 0x7f59240d2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 >> 172.21.15.45:0/631056266 conn(0x7f59240d2e50 msgr2=0x7f5924154400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 shutdown_connections 2023-12-19T18:00:07.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.172+0000 7f592bc0a700 1 -- 172.21.15.45:0/631056266 wait complete. 2023-12-19T18:00:07.179 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 63 2023-12-19T18:00:07.199 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:07.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.372+0000 7fe678c64700 1 Processor -- start 2023-12-19T18:00:07.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.372+0000 7fe678c64700 1 -- start start 2023-12-19T18:00:07.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe678c64700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe67406cad0 0x7fe67415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe678c64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe6740af720 0x7fe6740afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe678c64700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe67406f0a0 con 0x7fe67415ae20 2023-12-19T18:00:07.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe678c64700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6740b00d0 con 0x7fe67406cad0 2023-12-19T18:00:07.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe678c64700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67406ea90 con 0x7fe6740af720 2023-12-19T18:00:07.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe6737fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe67415ae20 0x7fe6740c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51352/0 (socket says 172.21.15.45:51352) 2023-12-19T18:00:07.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe6737fe700 1 -- 172.21.15.45:0/2953805188 learned_addr learned my addr 172.21.15.45:0/2953805188 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:07.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe66affd700 1 --2- 172.21.15.45:0/2953805188 >> v2:172.21.15.45:3300/0 conn(0x7fe67406cad0 0x7fe67415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe673fff700 1 --2- 172.21.15.45:0/2953805188 >> v2:172.21.15.73:3300/0 conn(0x7fe6740af720 0x7fe6740afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe672ffd700 1 -- 172.21.15.45:0/2953805188 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3688230117 0 0) 0x7fe67406f0a0 con 0x7fe67415ae20 2023-12-19T18:00:07.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe66affd700 1 -- 172.21.15.45:0/2953805188 >> v2:172.21.15.73:3300/0 conn(0x7fe6740af720 msgr2=0x7fe6740afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:07.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe66affd700 1 --2- 172.21.15.45:0/2953805188 >> v2:172.21.15.73:3300/0 conn(0x7fe6740af720 0x7fe6740afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe66affd700 1 -- 172.21.15.45:0/2953805188 >> v1:172.21.15.45:6789/0 conn(0x7fe67415ae20 legacy=0x7fe6740c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe66affd700 1 -- 172.21.15.45:0/2953805188 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740c3f60 con 0x7fe67406cad0 2023-12-19T18:00:07.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.376+0000 7fe66affd700 1 --2- 172.21.15.45:0/2953805188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67406cad0 0x7fe67415be40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe6740cc270 tx=0x7fe65c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ee843b929cc9603 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:07.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe672ffd700 1 -- 172.21.15.45:0/2953805188 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011830 con 0x7fe67406cad0 2023-12-19T18:00:07.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe672ffd700 1 -- 172.21.15.45:0/2953805188 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65c011990 con 0x7fe67406cad0 2023-12-19T18:00:07.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe672ffd700 1 -- 172.21.15.45:0/2953805188 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65c011d20 con 0x7fe67406cad0 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 -- 172.21.15.45:0/2953805188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67406cad0 msgr2=0x7fe67415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 --2- 172.21.15.45:0/2953805188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67406cad0 0x7fe67415be40 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe6740cc270 tx=0x7fe65c009b30 comp rx=0 tx=0).stop 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 -- 172.21.15.45:0/2953805188 shutdown_connections 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 --2- 172.21.15.45:0/2953805188 >> v2:172.21.15.73:3300/0 conn(0x7fe6740af720 0x7fe6740afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 --2- 172.21.15.45:0/2953805188 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67406cad0 0x7fe67415be40 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 -- 172.21.15.45:0/2953805188 >> 172.21.15.45:0/2953805188 conn(0x7fe6740cb900 msgr2=0x7fe6740b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 -- 172.21.15.45:0/2953805188 shutdown_connections 2023-12-19T18:00:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.380+0000 7fe678c64700 1 -- 172.21.15.45:0/2953805188 wait complete. 2023-12-19T18:00:07.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 Processor -- start 2023-12-19T18:00:07.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 -- start start 2023-12-19T18:00:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67406cad0 0x7fe6740b2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6740af720 0x7fe67415dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 0x7fe6740c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741f2780 con 0x7fe67415ae20 2023-12-19T18:00:07.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741f35a0 con 0x7fe67406cad0 2023-12-19T18:00:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe678c64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6741f2990 con 0x7fe6740af720 2023-12-19T18:00:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe673fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 0x7fe6740c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe673fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 0x7fe6740c7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41688/0 (socket says 172.21.15.45:41688) 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe673fff700 1 -- 172.21.15.45:0/957822515 learned_addr learned my addr 172.21.15.45:0/957822515 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe6737fe700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67406cad0 0x7fe6740b2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.384+0000 7fe66affd700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6740af720 0x7fe67415dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe673fff700 1 -- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6740af720 msgr2=0x7fe67415dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe673fff700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6740af720 0x7fe67415dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe673fff700 1 -- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67406cad0 msgr2=0x7fe6740b2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe673fff700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67406cad0 0x7fe6740b2230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe673fff700 1 -- 172.21.15.45:0/957822515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe65c0094b0 con 0x7fe67415ae20 2023-12-19T18:00:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe673fff700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 0x7fe6740c7b10 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00efc0 tx=0x7fe66c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c009ea0 con 0x7fe67415ae20 2023-12-19T18:00:07.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00f040 con 0x7fe67415ae20 2023-12-19T18:00:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c014480 con 0x7fe67415ae20 2023-12-19T18:00:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6741f2c70 con 0x7fe67415ae20 2023-12-19T18:00:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe67415e220 con 0x7fe67415ae20 2023-12-19T18:00:07.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.388+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe67406f510 con 0x7fe67415ae20 2023-12-19T18:00:07.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.392+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe66c0145e0 con 0x7fe67415ae20 2023-12-19T18:00:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.392+0000 7fe670ff9700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe654065ad0 0x7fe654067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.392+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fe66c083d40 con 0x7fe67415ae20 2023-12-19T18:00:07.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.392+0000 7fe6737fe700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe654065ad0 0x7fe654067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.396+0000 7fe6737fe700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe654065ad0 0x7fe654067f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe664000f60 tx=0x7fe664007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:07.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.400+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe67406f510 con 0x7fe67415ae20 2023-12-19T18:00:07.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.616+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe67406f510 con 0x7fe67415ae20 2023-12-19T18:00:07.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.616+0000 7fe670ff9700 1 -- 172.21.15.45:0/957822515 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4706 (secure 0 0 0) 0x7fe67406f510 con 0x7fe67415ae20 2023-12-19T18:00:07.623 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:07.623 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3302507960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3302507960},{"type":"v1","addr":"172.21.15.73:6835","nonce":3302507960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:06.276427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe654065ad0 msgr2=0x7fe654067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe654065ad0 0x7fe654067f90 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fe664000f60 tx=0x7fe664007e90 comp rx=0 tx=0).stop 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 msgr2=0x7fe6740c7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 0x7fe6740c7b10 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00efc0 tx=0x7fe66c00c3a0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 shutdown_connections 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe654065ad0 0x7fe654067f90 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe67415ae20 0x7fe6740c7b10 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe6740af720 0x7fe67415dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 --2- 172.21.15.45:0/957822515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe67406cad0 0x7fe6740b2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 >> 172.21.15.45:0/957822515 conn(0x7fe6740cb900 msgr2=0x7fe674155b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:07.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 shutdown_connections 2023-12-19T18:00:07.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.620+0000 7fe678c64700 1 -- 172.21.15.45:0/957822515 wait complete. 2023-12-19T18:00:07.629 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 63 2023-12-19T18:00:07.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.824+0000 7ff8038e0700 1 Processor -- start 2023-12-19T18:00:07.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff8038e0700 1 -- start start 2023-12-19T18:00:07.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff8038e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff7fc15ab50 0x7ff7fc0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff8038e0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc15f700 con 0x7ff7fc15af30 2023-12-19T18:00:07.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff8038e0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7fc06cbb0 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff8038e0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7fc06fa10 con 0x7ff7fc15ab50 2023-12-19T18:00:07.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff800e7b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ff7fc15af30 0x7ff7fc15e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51364/0 (socket says 172.21.15.45:51364) 2023-12-19T18:00:07.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff800e7b700 1 -- 172.21.15.45:0/2930193996 learned_addr learned my addr 172.21.15.45:0/2930193996 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:07.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff80167c700 1 --2- 172.21.15.45:0/2930193996 >> v2:172.21.15.45:3300/0 conn(0x7ff7fc15ab50 0x7ff7fc0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516090008 0 0) 0x7ff7fc15f700 con 0x7ff7fc15af30 2023-12-19T18:00:07.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.828+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7e80035d0 con 0x7ff7fc15af30 2023-12-19T18:00:07.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3567937041 0 0) 0x7ff7fc06cbb0 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7fc15f700 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 923559315 0 0) 0x7ff7e80035d0 con 0x7ff7fc15af30 2023-12-19T18:00:07.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff80167c700 1 -- 172.21.15.45:0/2930193996 >> v1:172.21.15.73:6789/0 conn(0x7ff7fc06e0a0 legacy=0x7ff7fc15eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff80167c700 1 -- 172.21.15.45:0/2930193996 >> v1:172.21.15.45:6789/0 conn(0x7ff7fc15af30 legacy=0x7ff7fc15e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff80167c700 1 -- 172.21.15.45:0/2930193996 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7fc06fcf0 con 0x7ff7fc15ab50 2023-12-19T18:00:07.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff80167c700 1 --2- 172.21.15.45:0/2930193996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc15ab50 0x7ff7fc0ccd70 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009850 tx=0x7ff7f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3250c4f8e02511e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec001670 con 0x7ff7fc15ab50 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f8004030 con 0x7ff7fc15ab50 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff7f3fff700 1 -- 172.21.15.45:0/2930193996 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f80043c0 con 0x7ff7fc15ab50 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 -- 172.21.15.45:0/2930193996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc15ab50 msgr2=0x7ff7fc0ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 --2- 172.21.15.45:0/2930193996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc15ab50 0x7ff7fc0ccd70 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7ff7f8009850 tx=0x7ff7f8009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 -- 172.21.15.45:0/2930193996 shutdown_connections 2023-12-19T18:00:07.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 --2- 172.21.15.45:0/2930193996 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc15ab50 0x7ff7fc0ccd70 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 -- 172.21.15.45:0/2930193996 >> 172.21.15.45:0/2930193996 conn(0x7ff7fc0cba40 msgr2=0x7ff7fc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:07.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 -- 172.21.15.45:0/2930193996 shutdown_connections 2023-12-19T18:00:07.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.832+0000 7ff8038e0700 1 -- 172.21.15.45:0/2930193996 wait complete. 2023-12-19T18:00:07.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 Processor -- start 2023-12-19T18:00:07.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 -- start start 2023-12-19T18:00:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 0x7ff7fc151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc15ab50 0x7ff7fc0c5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc15af30 0x7ff7fc0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc0aba60 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1529c0 con 0x7ff7fc15af30 2023-12-19T18:00:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff8038e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc152120 con 0x7ff7fc15ab50 2023-12-19T18:00:07.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff80167c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 0x7ff7fc151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff80167c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 0x7ff7fc151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41712/0 (socket says 172.21.15.45:41712) 2023-12-19T18:00:07.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.836+0000 7ff80167c700 1 -- 172.21.15.45:0/1572694867 learned_addr learned my addr 172.21.15.45:0/1572694867 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff800e7b700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc15ab50 0x7ff7fc0c5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff801e7d700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc15af30 0x7ff7fc0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff80167c700 1 -- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc15ab50 msgr2=0x7ff7fc0c5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff80167c700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc15ab50 0x7ff7fc0c5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff80167c700 1 -- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc15af30 msgr2=0x7ff7fc0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff80167c700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc15af30 0x7ff7fc0c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff80167c700 1 -- 172.21.15.45:0/1572694867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f80094b0 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff800e7b700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc15ab50 0x7ff7fc0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff801e7d700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc15af30 0x7ff7fc0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff80167c700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 0x7ff7fc151070 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0b1660 tx=0x7ff7f8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8011830 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f801f070 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc152400 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8011bd0 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc0ad2d0 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.840+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7fc04ed30 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.844+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff7f8011d30 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.844+0000 7ff7f1ffb700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7e0065b00 0x7ff7e0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.844+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7ff7f8021070 con 0x7ff7fc06e0a0 2023-12-19T18:00:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.844+0000 7ff800e7b700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7e0065b00 0x7ff7e0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:07.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.848+0000 7ff800e7b700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7e0065b00 0x7ff7e0067fc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc15a110 tx=0x7ff7ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:07.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:07.852+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff7f80521f0 con 0x7ff7fc06e0a0 2023-12-19T18:00:08.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.064+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff7fc06c990 con 0x7ff7fc06e0a0 2023-12-19T18:00:08.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.064+0000 7ff7f1ffb700 1 -- 172.21.15.45:0/1572694867 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4706 (secure 0 0 0) 0x7ff7f802b020 con 0x7ff7fc06e0a0 2023-12-19T18:00:08.071 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:08.071 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3302507960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3302507960},{"type":"v1","addr":"172.21.15.73:6835","nonce":3302507960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:06.276427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7e0065b00 msgr2=0x7ff7e0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7e0065b00 0x7ff7e0067fc0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc15a110 tx=0x7ff7ec009040 comp rx=0 tx=0).stop 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 msgr2=0x7ff7fc151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 0x7ff7fc151070 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc0b1660 tx=0x7ff7f8004770 comp rx=0 tx=0).stop 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 shutdown_connections 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff7e0065b00 0x7ff7e0067fc0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7fc15af30 0x7ff7fc0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff7fc15ab50 0x7ff7fc0c5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 --2- 172.21.15.45:0/1572694867 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff7fc06e0a0 0x7ff7fc151070 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 >> 172.21.15.45:0/1572694867 conn(0x7ff7fc0cba40 msgr2=0x7ff7fc155380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 shutdown_connections 2023-12-19T18:00:08.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.068+0000 7ff8038e0700 1 -- 172.21.15.45:0/1572694867 wait complete. 2023-12-19T18:00:08.076 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 63 2023-12-19T18:00:08.096 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:08.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.268+0000 7fec4759e700 1 Processor -- start 2023-12-19T18:00:08.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.268+0000 7fec4759e700 1 -- start start 2023-12-19T18:00:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fec480b88b0 0x7fec4806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fec4806f3b0 0x7fec4806f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec480d1820 con 0x7fec4806ea90 2023-12-19T18:00:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec480d1630 con 0x7fec4806f3b0 2023-12-19T18:00:08.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec480d1b00 con 0x7fec480b88b0 2023-12-19T18:00:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fec4806ea90 0x7fec480d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51366/0 (socket says 172.21.15.45:51366) 2023-12-19T18:00:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4659c700 1 -- 172.21.15.45:0/86794430 learned_addr learned my addr 172.21.15.45:0/86794430 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec46d9d700 1 --2- 172.21.15.45:0/86794430 >> v2:172.21.15.45:3300/0 conn(0x7fec4806f3b0 0x7fec4806f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec45d9b700 1 --2- 172.21.15.45:0/86794430 >> v2:172.21.15.73:3300/0 conn(0x7fec480b88b0 0x7fec4806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec46d9d700 1 -- 172.21.15.45:0/86794430 >> v2:172.21.15.73:3300/0 conn(0x7fec480b88b0 msgr2=0x7fec4806ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec46d9d700 1 --2- 172.21.15.45:0/86794430 >> v2:172.21.15.73:3300/0 conn(0x7fec480b88b0 0x7fec4806ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4559a700 1 -- 172.21.15.45:0/86794430 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880979583 0 0) 0x7fec480d1820 con 0x7fec4806ea90 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec46d9d700 1 -- 172.21.15.45:0/86794430 >> v1:172.21.15.45:6789/0 conn(0x7fec4806ea90 legacy=0x7fec480d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec46d9d700 1 -- 172.21.15.45:0/86794430 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec480d1de0 con 0x7fec4806f3b0 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec46d9d700 1 --2- 172.21.15.45:0/86794430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806f3b0 0x7fec4806f820 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fec480b2610 tx=0x7fec4000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151bf7f369f79e31 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4559a700 1 -- 172.21.15.45:0/86794430 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4000e070 con 0x7fec4806f3b0 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4559a700 1 -- 172.21.15.45:0/86794430 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4000bb20 con 0x7fec4806f3b0 2023-12-19T18:00:08.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.272+0000 7fec4559a700 1 -- 172.21.15.45:0/86794430 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec40012430 con 0x7fec4806f3b0 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 -- 172.21.15.45:0/86794430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806f3b0 msgr2=0x7fec4806f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 --2- 172.21.15.45:0/86794430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806f3b0 0x7fec4806f820 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fec480b2610 tx=0x7fec4000b330 comp rx=0 tx=0).stop 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 -- 172.21.15.45:0/86794430 shutdown_connections 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 --2- 172.21.15.45:0/86794430 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806f3b0 0x7fec4806f820 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 --2- 172.21.15.45:0/86794430 >> v2:172.21.15.73:3300/0 conn(0x7fec480b88b0 0x7fec4806ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 -- 172.21.15.45:0/86794430 >> 172.21.15.45:0/86794430 conn(0x7fec480b46d0 msgr2=0x7fec480b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 -- 172.21.15.45:0/86794430 shutdown_connections 2023-12-19T18:00:08.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 -- 172.21.15.45:0/86794430 wait complete. 2023-12-19T18:00:08.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 Processor -- start 2023-12-19T18:00:08.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.276+0000 7fec4759e700 1 -- start start 2023-12-19T18:00:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 0x7fec4806a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4806f3b0 0x7fec4815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec480b88b0 0x7fec480b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4806a550 con 0x7fec4806ea90 2023-12-19T18:00:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4806a780 con 0x7fec4806f3b0 2023-12-19T18:00:08.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4806aa60 con 0x7fec480b88b0 2023-12-19T18:00:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 0x7fec4806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 0x7fec4806a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41730/0 (socket says 172.21.15.45:41730) 2023-12-19T18:00:08.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 -- 172.21.15.45:0/3578587684 learned_addr learned my addr 172.21.15.45:0/3578587684 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec45d9b700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4806f3b0 0x7fec4815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec46d9d700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec480b88b0 0x7fec480b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 -- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec480b88b0 msgr2=0x7fec480b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec480b88b0 0x7fec480b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 -- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4806f3b0 msgr2=0x7fec4815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4806f3b0 0x7fec4815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 -- 172.21.15.45:0/3578587684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40009a70 con 0x7fec4806ea90 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec46d9d700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec480b88b0 0x7fec480b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4659c700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 0x7fec4806a010 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c4e0 tx=0x7fec3800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38004ca0 con 0x7fec4806ea90 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec38004e20 con 0x7fec4806ea90 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4806ad40 con 0x7fec4806ea90 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38007310 con 0x7fec4806ea90 2023-12-19T18:00:08.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.280+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4806b300 con 0x7fec4806ea90 2023-12-19T18:00:08.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.284+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec48071bb0 con 0x7fec4806ea90 2023-12-19T18:00:08.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.284+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fec38007470 con 0x7fec4806ea90 2023-12-19T18:00:08.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.288+0000 7fec36ffd700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec28065ad0 0x7fec28067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.288+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fec38083250 con 0x7fec4806ea90 2023-12-19T18:00:08.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.288+0000 7fec45d9b700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec28065ad0 0x7fec28067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.288+0000 7fec45d9b700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec28065ad0 0x7fec28067f90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fec480d2a40 tx=0x7fec3c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.292+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fec380507f0 con 0x7fec4806ea90 2023-12-19T18:00:08.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.504+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec48067760 con 0x7fec4806ea90 2023-12-19T18:00:08.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.504+0000 7fec36ffd700 1 -- 172.21.15.45:0/3578587684 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4706 (secure 0 0 0) 0x7fec38007720 con 0x7fec4806ea90 2023-12-19T18:00:08.512 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:08.512 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":63,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7045,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4066989108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4066989108},{"type":"v1","addr":"172.21.15.45:6837","nonce":4066989108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7215,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1954255677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1954255677},{"type":"v1","addr":"172.21.15.45:6835","nonce":1954255677}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7333,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/3302507960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":3302507960},{"type":"v1","addr":"172.21.15.73:6835","nonce":3302507960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":63}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:06.276427+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec28065ad0 msgr2=0x7fec28067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec28065ad0 0x7fec28067f90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fec480d2a40 tx=0x7fec3c009240 comp rx=0 tx=0).stop 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 msgr2=0x7fec4806a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 0x7fec4806a010 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fec3800c4e0 tx=0x7fec3800c7f0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 shutdown_connections 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec28065ad0 0x7fec28067f90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fec480b88b0 0x7fec480b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fec4806f3b0 0x7fec4815a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 --2- 172.21.15.45:0/3578587684 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fec4806ea90 0x7fec4806a010 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 >> 172.21.15.45:0/3578587684 conn(0x7fec480b46d0 msgr2=0x7fec480c8720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 shutdown_connections 2023-12-19T18:00:08.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.508+0000 7fec4759e700 1 -- 172.21.15.45:0/3578587684 wait complete. 2023-12-19T18:00:08.518 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 63 2023-12-19T18:00:08.540 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset session 2023-12-19T18:00:08.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.600+0000 7f5919066380 1 -- start start 2023-12-19T18:00:08.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.600+0000 7f5919066380 1 Processor -- start 2023-12-19T18:00:08.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.600+0000 7f5919066380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556188deb800 0x556188e90580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 0x556188e90b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x556188deb000 0x556188e91080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188e6aa00 con 0x556188deb800 2023-12-19T18:00:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188e6a780 con 0x556188deb400 2023-12-19T18:00:08.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x556188e6a640 con 0x556188deb000 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5917820700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556188deb800 0x556188e90580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 0x556188e90b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 0x556188e90b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:43408/0 (socket says 172.21.15.45:43408) 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 -- 172.21.15.45:0/3621725411 learned_addr learned my addr 172.21.15.45:0/3621725411 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5918021700 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x556188deb000 0x556188e91080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 -- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x556188deb000 msgr2=0x556188e91080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x556188deb000 0x556188e91080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 -- 172.21.15.45:0/3621725411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556188deb800 msgr2=0x556188e90580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556188deb800 0x556188e90580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 -- 172.21.15.45:0/3621725411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556188e0cb60 con 0x556188deb400 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5917820700 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556188deb800 0x556188e90580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:08.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591701f700 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 0x556188e90b00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x556188f4abd0 tx=0x556189bc2c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb567ae967e7d159 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591501b700 1 -- 172.21.15.45:0/3621725411 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556188e1b080 con 0x556188deb400 2023-12-19T18:00:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591501b700 1 -- 172.21.15.45:0/3621725411 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556189bd6300 con 0x556188deb400 2023-12-19T18:00:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556188e0d1e0 con 0x556188deb400 2023-12-19T18:00:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x556188e0cb60 con 0x556188deb400 2023-12-19T18:00:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 4 waiting for MDS map... 2023-12-19T18:00:08.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591501b700 1 -- 172.21.15.45:0/3621725411 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556188e1b600 con 0x556188deb400 2023-12-19T18:00:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591501b700 1 -- 172.21.15.45:0/3621725411 <== mon.1 v2:172.21.15.73:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x556188e24c40 con 0x556188deb400 2023-12-19T18:00:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f591501b700 1 -- 172.21.15.45:0/3621725411 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x556188e2cf00 con 0x556188deb400 2023-12-19T18:00:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 4 Got MDS map 63 2023-12-19T18:00:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 10 main: main 2023-12-19T18:00:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.604+0000 7f5919066380 4 main: connecting to RADOS... 2023-12-19T18:00:08.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 Processor -- start 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- start start 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 0x556188e91600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890de800 0x556188e91b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890dec00 0x556188e92100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188e21e00 con 0x5561890de400 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188e6aa00 con 0x5561890de800 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x556188e6a780 con 0x5561890dec00 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 0x556188e91600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 0x556188e91600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41752/0 (socket says 172.21.15.45:41752) 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 -- 172.21.15.45:0/3846909616 learned_addr learned my addr 172.21.15.45:0/3846909616 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5917820700 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890de800 0x556188e91b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f591701f700 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890dec00 0x556188e92100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 -- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890dec00 msgr2=0x556188e92100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890dec00 0x556188e92100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 -- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890de800 msgr2=0x556188e91b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890de800 0x556188e91b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 -- 172.21.15.45:0/3846909616 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556188e0c340 con 0x5561890de400 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5918021700 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 0x556188e91600 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x5561891340c0 tx=0x5561890e6c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01dc0aec238a26 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5913017700 1 -- 172.21.15.45:0/3846909616 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556188e1b080 con 0x5561890de400 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5913017700 1 -- 172.21.15.45:0/3846909616 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556189bd7200 con 0x5561890de400 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5913017700 1 -- 172.21.15.45:0/3846909616 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556188e1b600 con 0x5561890de400 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- 172.21.15.45:0/3846909616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 msgr2=0x556188e91600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 0x556188e91600 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x5561891340c0 tx=0x5561890e6c00 comp rx=0 tx=0).stop 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- 172.21.15.45:0/3846909616 shutdown_connections 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890dec00 0x556188e92100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890de800 0x556188e91b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 --2- 172.21.15.45:0/3846909616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de400 0x556188e91600 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- 172.21.15.45:0/3846909616 >> 172.21.15.45:0/3846909616 conn(0x556188deac00 msgr2=0x556188eb9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- 172.21.15.45:0/3846909616 shutdown_connections 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.608+0000 7f5919066380 1 -- 172.21.15.45:0/3846909616 wait complete. 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 Processor -- start 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 -- start start 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890de400 0x556188e93180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de800 0x556188e92c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890dec00 0x556188e92680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188e6a500 con 0x5561890de800 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x556188e6a3c0 con 0x5561890dec00 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x556188e6a280 con 0x5561890de400 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de800 0x556188e92c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de800 0x556188e92c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41762/0 (socket says 172.21.15.45:41762) 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 -- 172.21.15.45:0/1210352485 learned_addr learned my addr 172.21.15.45:0/1210352485 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f591701f700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890dec00 0x556188e92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5918021700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890de400 0x556188e93180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 -- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890de400 msgr2=0x556188e93180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890de400 0x556188e93180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 -- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890dec00 msgr2=0x556188e92680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5561890dec00 0x556188e92680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 -- 172.21.15.45:0/1210352485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556188e0c000 con 0x5561890de800 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5918021700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5561890de400 0x556188e93180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:08.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5917820700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de800 0x556188e92c00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x556189134e40 tx=0x5561890e6d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5911814700 1 -- 172.21.15.45:0/1210352485 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556188e1b080 con 0x5561890de800 2023-12-19T18:00:08.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5911814700 1 -- 172.21.15.45:0/1210352485 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556188e36180 con 0x5561890de800 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5911814700 1 -- 172.21.15.45:0/1210352485 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x556188e1b600 con 0x5561890de800 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.612+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556188e0cea0 con 0x5561890de800 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.616+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556188e0d520 con 0x5561890de800 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.616+0000 7f5919066380 4 main: resolving pool 11 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.616+0000 7f5911814700 1 -- 172.21.15.45:0/1210352485 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x556188e68840 con 0x5561890de800 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.616+0000 7f5911814700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5561890dc800 0x556188e93700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.616+0000 7f5911814700 1 -- 172.21.15.45:0/1210352485 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x556188e24a80 con 0x5561890de800 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5919066380 4 main: creating IoCtx.. 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5919066380 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5561890df000 0x556188e92100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5918021700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5561890dc800 0x556188e93700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 11.b 11:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5561890df400 con 0x5561890df000 2023-12-19T18:00:08.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f591701f700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5561890df000 0x556188e92100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5918021700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5561890dc800 0x556188e93700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x5561891340c0 tx=0x556188ec1140 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f591701f700 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5561890df000 0x556188e92100 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f591701f700 1 -- 172.21.15.45:0/1210352485 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v90'5 uv5 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x556189c5eb40 con 0x5561890df000 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:08.628 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5561890df000 msgr2=0x556188e92100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5919066380 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5561890df000 0x556188e92100 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.620+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5561890dc800 msgr2=0x556188e93700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5561890dc800 0x556188e93700 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x5561891340c0 tx=0x556188ec1140 comp rx=0 tx=0).stop 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de800 msgr2=0x556188e92c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 --2- 172.21.15.45:0/1210352485 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5561890de800 0x556188e92c00 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x556189134e40 tx=0x5561890e6d20 comp rx=0 tx=0).stop 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5917820700 1 -- 172.21.15.45:0/1210352485 reap_dead start 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 shutdown_connections 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 >> 172.21.15.45:0/1210352485 conn(0x556188deac00 msgr2=0x556188eb9800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 shutdown_connections 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/1210352485 wait complete. 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 msgr2=0x556188e90b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 0x556188e90b00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x556188f4abd0 tx=0x556189bc2c60 comp rx=0 tx=0).stop 2023-12-19T18:00:08.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 shutdown_connections 2023-12-19T18:00:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x556188deb000 0x556188e91080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556188deb400 0x556188e90b00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 --2- 172.21.15.45:0/3621725411 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x556188deb800 0x556188e90580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 >> 172.21.15.45:0/3621725411 conn(0x556188debc00 msgr2=0x556188eb9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 shutdown_connections 2023-12-19T18:00:08.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.624+0000 7f5919066380 1 -- 172.21.15.45:0/3621725411 wait complete. 2023-12-19T18:00:08.637 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'session'] in time 0:00:00.096869, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T18:00:08.637 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset snap 2023-12-19T18:00:08.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 -- start start 2023-12-19T18:00:08.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 Processor -- start 2023-12-19T18:00:08.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a2f3800 0x558d3a398580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a2f3400 0x558d3a398b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a2f3000 0x558d3a399080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d3a329e00 con 0x558d3a2f3400 2023-12-19T18:00:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372a00 con 0x558d3a2f3800 2023-12-19T18:00:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.696+0000 7feeba873380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372640 con 0x558d3a2f3000 2023-12-19T18:00:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb882c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a2f3400 0x558d3a398b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb902d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a2f3800 0x558d3a398580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a2f3000 0x558d3a399080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb902d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a2f3800 0x558d3a398580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:43436/0 (socket says 172.21.15.45:43436) 2023-12-19T18:00:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb902d700 1 -- 172.21.15.45:0/3758529806 learned_addr learned my addr 172.21.15.45:0/3758529806 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 -- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a2f3800 msgr2=0x558d3a398580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a2f3800 0x558d3a398580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 -- 172.21.15.45:0/3758529806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a2f3400 msgr2=0x558d3a398b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a2f3400 0x558d3a398b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 -- 172.21.15.45:0/3758529806 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d3a314b60 con 0x558d3a2f3000 2023-12-19T18:00:08.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb982e700 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a2f3000 0x558d3a399080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x558d3a454c00 tx=0x558d3b176e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f94f812540155735 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb6828700 1 -- 172.21.15.45:0/3758529806 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d3a323600 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb6828700 1 -- 172.21.15.45:0/3758529806 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d3b0d4900 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb6828700 1 -- 172.21.15.45:0/3758529806 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d3a3231e0 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d3a314340 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558d3a314000 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeba873380 4 waiting for MDS map... 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb6828700 1 -- 172.21.15.45:0/3758529806 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x558d3a32cc40 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeb6828700 1 -- 172.21.15.45:0/3758529806 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x558d3a5ee000 con 0x558d3a2f3000 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeba873380 4 Got MDS map 63 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeba873380 10 main: main 2023-12-19T18:00:08.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.700+0000 7feeba873380 4 main: connecting to RADOS... 2023-12-19T18:00:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 Processor -- start 2023-12-19T18:00:08.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 -- start start 2023-12-19T18:00:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a399600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 0x558d3a399b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6c00 0x558d3a39a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372500 con 0x558d3a5f6800 2023-12-19T18:00:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d3a3723c0 con 0x558d3a5f6c00 2023-12-19T18:00:08.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeba873380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372a00 con 0x558d3a5f6400 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 0x558d3a399b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 0x558d3a399b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41786/0 (socket says 172.21.15.45:41786) 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 -- 172.21.15.45:0/4193134869 learned_addr learned my addr 172.21.15.45:0/4193134869 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb882c700 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a399600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb882c700 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6c00 0x558d3a39a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 -- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 msgr2=0x558d3a399600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a399600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 -- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6c00 msgr2=0x558d3a39a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6c00 0x558d3a39a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 -- 172.21.15.45:0/4193134869 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d3a314ea0 con 0x558d3a5f6800 2023-12-19T18:00:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb882c700 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6c00 0x558d3a39a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:08.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb902d700 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 0x558d3a399b80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x558d3a4522a0 tx=0x558d3b0d0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a2921819c099211 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb4824700 1 -- 172.21.15.45:0/4193134869 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d3a323600 con 0x558d3a5f6800 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb4824700 1 -- 172.21.15.45:0/4193134869 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d3b0d4d80 con 0x558d3a5f6800 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.704+0000 7feeb4824700 1 -- 172.21.15.45:0/4193134869 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d3a3231e0 con 0x558d3a5f6800 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- 172.21.15.45:0/4193134869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 msgr2=0x558d3a399b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 0x558d3a399b80 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x558d3a4522a0 tx=0x558d3b0d0c00 comp rx=0 tx=0).stop 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- 172.21.15.45:0/4193134869 shutdown_connections 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6c00 0x558d3a39a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6800 0x558d3a399b80 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- 172.21.15.45:0/4193134869 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a399600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- 172.21.15.45:0/4193134869 >> 172.21.15.45:0/4193134869 conn(0x558d3a2f2c00 msgr2=0x558d3a3af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- 172.21.15.45:0/4193134869 shutdown_connections 2023-12-19T18:00:08.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- 172.21.15.45:0/4193134869 wait complete. 2023-12-19T18:00:08.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 Processor -- start 2023-12-19T18:00:08.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- start start 2023-12-19T18:00:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a39b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6800 0x558d3a39ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6c00 0x558d3a39a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372280 con 0x558d3a5f6c00 2023-12-19T18:00:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372140 con 0x558d3a5f6800 2023-12-19T18:00:08.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeba873380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x558d3a372000 con 0x558d3a5f6400 2023-12-19T18:00:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeb882c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6c00 0x558d3a39a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeb882c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6c00 0x558d3a39a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:41792/0 (socket says 172.21.15.45:41792) 2023-12-19T18:00:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeb882c700 1 -- 172.21.15.45:0/1306289166 learned_addr learned my addr 172.21.15.45:0/1306289166 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeb902d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6800 0x558d3a39ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.708+0000 7feeb882c700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a39b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb882c700 1 -- 172.21.15.45:0/1306289166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 msgr2=0x558d3a39b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb882c700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a5f6400 0x558d3a39b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb882c700 1 -- 172.21.15.45:0/1306289166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6800 msgr2=0x558d3a39ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb882c700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a5f6800 0x558d3a39ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb882c700 1 -- 172.21.15.45:0/1306289166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d3a314b60 con 0x558d3a5f6c00 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb882c700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6c00 0x558d3a39a680 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x558d3a452f60 tx=0x558d3a3c9260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb3021700 1 -- 172.21.15.45:0/1306289166 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d3a323080 con 0x558d3a5f6c00 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb3021700 1 -- 172.21.15.45:0/1306289166 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558d3a33e180 con 0x558d3a5f6c00 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeb3021700 1 -- 172.21.15.45:0/1306289166 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558d3a323600 con 0x558d3a5f6c00 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558d3a314340 con 0x558d3a5f6c00 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d3a314000 con 0x558d3a5f6c00 2023-12-19T18:00:08.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.712+0000 7feeba873380 4 main: resolving pool 11 2023-12-19T18:00:08.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb3021700 1 -- 172.21.15.45:0/1306289166 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x558d3a370840 con 0x558d3a5f6c00 2023-12-19T18:00:08.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb3021700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558d3a752000 0x558d3a39b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb3021700 1 -- 172.21.15.45:0/1306289166 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x558d3a32ca80 con 0x558d3a5f6c00 2023-12-19T18:00:08.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb902d700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558d3a752000 0x558d3a39b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeba873380 4 main: creating IoCtx.. 2023-12-19T18:00:08.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeba873380 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558d3a5f7000 0x558d3a39a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 11.d 11:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558d3a5f7400 con 0x558d3a5f7000 2023-12-19T18:00:08.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb882c700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558d3a5f7000 0x558d3a39a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb902d700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558d3a752000 0x558d3a39b700 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x558d3a4522a0 tx=0x558d3b176de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.716+0000 7feeb882c700 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558d3a5f7000 0x558d3a39a100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeb882c700 1 -- 172.21.15.45:0/1306289166 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v90'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x558d3b174b40 con 0x558d3a5f7000 2023-12-19T18:00:08.726 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T18:00:08.727 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:08.727 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558d3a5f7000 msgr2=0x558d3a39a100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x558d3a5f7000 0x558d3a39a100 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558d3a752000 msgr2=0x558d3a39b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x558d3a752000 0x558d3a39b700 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x558d3a4522a0 tx=0x558d3b176de0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6c00 msgr2=0x558d3a39a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 --2- 172.21.15.45:0/1306289166 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a5f6c00 0x558d3a39a680 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x558d3a452f60 tx=0x558d3a3c9260 comp rx=0 tx=0).stop 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeb902d700 1 -- 172.21.15.45:0/1306289166 reap_dead start 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 shutdown_connections 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 >> 172.21.15.45:0/1306289166 conn(0x558d3a2f2c00 msgr2=0x558d3a3af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 shutdown_connections 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/1306289166 wait complete. 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a2f3000 msgr2=0x558d3a399080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.720+0000 7feeba873380 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a2f3000 0x558d3a399080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x558d3a454c00 tx=0x558d3b176e40 comp rx=0 tx=0).stop 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 shutdown_connections 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x558d3a2f3000 0x558d3a399080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x558d3a2f3400 0x558d3a398b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 --2- 172.21.15.45:0/3758529806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x558d3a2f3800 0x558d3a398580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 >> 172.21.15.45:0/3758529806 conn(0x558d3a2f3c00 msgr2=0x558d3a3af000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 shutdown_connections 2023-12-19T18:00:08.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.724+0000 7feeba873380 1 -- 172.21.15.45:0/3758529806 wait complete. 2023-12-19T18:00:08.736 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'snap'] in time 0:00:00.099062, result: { "result": 0 } 2023-12-19T18:00:08.736 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset inode 2023-12-19T18:00:08.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.796+0000 7f27e117c380 1 -- start start 2023-12-19T18:00:08.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.796+0000 7f27e117c380 1 Processor -- start 2023-12-19T18:00:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 0x559c957f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c9574b400 0x559c957f0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c9574b000 0x559c957f1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c95781e00 con 0x559c9574b800 2023-12-19T18:00:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c957caa00 con 0x559c9574b400 2023-12-19T18:00:08.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c957ca640 con 0x559c9574b000 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 0x559c957f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 0x559c957f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34496/0 (socket says 172.21.15.45:34496) 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 -- 172.21.15.45:0/3490382834 learned_addr learned my addr 172.21.15.45:0/3490382834 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df135700 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c9574b400 0x559c957f0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e0137700 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c9574b000 0x559c957f1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 -- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c9574b000 msgr2=0x559c957f1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c9574b000 0x559c957f1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 -- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c9574b400 msgr2=0x559c957f0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c9574b400 0x559c957f0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 -- 172.21.15.45:0/3490382834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c9576cb60 con 0x559c9574b800 2023-12-19T18:00:08.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27df936700 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 0x559c957f0580 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x559c958aaba0 tx=0x559c965c0e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1394bd19c5c34d41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27dd131700 1 -- 172.21.15.45:0/3490382834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559c9577b600 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27dd131700 1 -- 172.21.15.45:0/3490382834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c95796900 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27dd131700 1 -- 172.21.15.45:0/3490382834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559c9577b1e0 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c9576c340 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559c9576c000 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 4 waiting for MDS map... 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27dd131700 1 -- 172.21.15.45:0/3490382834 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x559c95784c40 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27dd131700 1 -- 172.21.15.45:0/3490382834 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x559c95a44000 con 0x559c9574b800 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 4 Got MDS map 63 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 10 main: main 2023-12-19T18:00:08.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.800+0000 7f27e117c380 4 main: connecting to RADOS... 2023-12-19T18:00:08.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 Processor -- start 2023-12-19T18:00:08.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 -- start start 2023-12-19T18:00:08.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a400 0x559c957f1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3a800 0x559c957f1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 0x559c957f2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c957ca500 con 0x559c95a3ac00 2023-12-19T18:00:08.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c957ca3c0 con 0x559c95a3a800 2023-12-19T18:00:08.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e117c380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c957caa00 con 0x559c95a3a400 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 0x559c957f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df936700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3a800 0x559c957f1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 0x559c957f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34498/0 (socket says 172.21.15.45:34498) 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27e0137700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a400 0x559c957f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df936700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3a800 0x559c957f1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40798/0 (socket says 172.21.15.45:40798) 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 -- 172.21.15.45:0/1672670766 learned_addr learned my addr 172.21.15.45:0/1672670766 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 -- 172.21.15.45:0/1672670766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a400 msgr2=0x559c957f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a400 0x559c957f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 -- 172.21.15.45:0/1672670766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3a800 msgr2=0x559c957f1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3a800 0x559c957f1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 -- 172.21.15.45:0/1672670766 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c9576cea0 con 0x559c95a3ac00 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27df135700 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 0x559c957f2100 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x559c95a920f0 tx=0x559c95a4cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484e37ab6d1a2ad7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27db12d700 1 -- 172.21.15.45:0/1672670766 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559c9577b600 con 0x559c95a3ac00 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27db12d700 1 -- 172.21.15.45:0/1672670766 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c95796900 con 0x559c95a3ac00 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.804+0000 7f27db12d700 1 -- 172.21.15.45:0/1672670766 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559c9577b1e0 con 0x559c95a3ac00 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- 172.21.15.45:0/1672670766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 msgr2=0x559c957f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 0x559c957f2100 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x559c95a920f0 tx=0x559c95a4cc00 comp rx=0 tx=0).stop 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- 172.21.15.45:0/1672670766 shutdown_connections 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3ac00 0x559c957f2100 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3a800 0x559c957f1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- 172.21.15.45:0/1672670766 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a400 0x559c957f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- 172.21.15.45:0/1672670766 >> 172.21.15.45:0/1672670766 conn(0x559c9574ac00 msgr2=0x559c95819800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- 172.21.15.45:0/1672670766 shutdown_connections 2023-12-19T18:00:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- 172.21.15.45:0/1672670766 wait complete. 2023-12-19T18:00:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 Processor -- start 2023-12-19T18:00:08.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- start start 2023-12-19T18:00:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3a400 0x559c957f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a800 0x559c957f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3ac00 0x559c957f2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c957ca280 con 0x559c95a3a400 2023-12-19T18:00:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559c957ca140 con 0x559c95a3ac00 2023-12-19T18:00:08.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e117c380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559c957ca000 con 0x559c95a3a800 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e0137700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3a400 0x559c957f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e0137700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3a400 0x559c957f3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34510/0 (socket says 172.21.15.45:34510) 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27e0137700 1 -- 172.21.15.45:0/1724057992 learned_addr learned my addr 172.21.15.45:0/1724057992 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27df135700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3ac00 0x559c957f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.808+0000 7f27df936700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a800 0x559c957f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e0137700 1 -- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a800 msgr2=0x559c957f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e0137700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a800 0x559c957f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e0137700 1 -- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3ac00 msgr2=0x559c957f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e0137700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c95a3ac00 0x559c957f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e0137700 1 -- 172.21.15.45:0/1724057992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559c9576cb60 con 0x559c95a3a400 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27df936700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c95a3a800 0x559c957f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e0137700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3a400 0x559c957f3180 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x559c95a92de0 tx=0x559c95821320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27d992a700 1 -- 172.21.15.45:0/1724057992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559c9577b080 con 0x559c95a3a400 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27d992a700 1 -- 172.21.15.45:0/1724057992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559c95796180 con 0x559c95a3a400 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27d992a700 1 -- 172.21.15.45:0/1724057992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559c9577b600 con 0x559c95a3a400 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559c9576c340 con 0x559c95a3a400 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559c9576c000 con 0x559c95a3a400 2023-12-19T18:00:08.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27e117c380 4 main: resolving pool 11 2023-12-19T18:00:08.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.812+0000 7f27d992a700 1 -- 172.21.15.45:0/1724057992 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x559c957c8840 con 0x559c95a3a400 2023-12-19T18:00:08.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27d992a700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559c95b98000 0x559c957f3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27d992a700 1 -- 172.21.15.45:0/1724057992 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x559c95784a80 con 0x559c95a3a400 2023-12-19T18:00:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27e117c380 4 main: creating IoCtx.. 2023-12-19T18:00:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27df936700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559c95b98000 0x559c957f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27e117c380 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559c95a3b000 0x559c957f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:1 11.13 11:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x559c95a3b400 con 0x559c95a3b000 2023-12-19T18:00:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27df135700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559c95a3b000 0x559c957f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27df936700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559c95b98000 0x559c957f3700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x559c958aaed0 tx=0x559c965c0c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.816+0000 7f27df135700 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559c95a3b000 0x559c957f2100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27df135700 1 -- 172.21.15.45:0/1724057992 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v90'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x559c965beb40 con 0x559c95a3b000 2023-12-19T18:00:08.828 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T18:00:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T18:00:08.828 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T18:00:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:00:08.829 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:08.829 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559c95a3b000 msgr2=0x559c957f2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x559c95a3b000 0x559c957f2100 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559c95b98000 msgr2=0x559c957f3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559c95b98000 0x559c957f3700 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x559c958aaed0 tx=0x559c965c0c60 comp rx=0 tx=0).stop 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3a400 msgr2=0x559c957f3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/1724057992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c95a3a400 0x559c957f3180 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x559c95a92de0 tx=0x559c95821320 comp rx=0 tx=0).stop 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27df135700 1 -- 172.21.15.45:0/1724057992 reap_dead start 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 shutdown_connections 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 >> 172.21.15.45:0/1724057992 conn(0x559c9574ac00 msgr2=0x559c95819800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 shutdown_connections 2023-12-19T18:00:08.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/1724057992 wait complete. 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 msgr2=0x559c957f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 0x559c957f0580 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x559c958aaba0 tx=0x559c965c0e40 comp rx=0 tx=0).stop 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 shutdown_connections 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559c9574b000 0x559c957f1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559c9574b400 0x559c957f0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 --2- 172.21.15.45:0/3490382834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559c9574b800 0x559c957f0580 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.820+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 >> 172.21.15.45:0/3490382834 conn(0x559c9574bc00 msgr2=0x559c95819000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.824+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 shutdown_connections 2023-12-19T18:00:08.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.824+0000 7f27e117c380 1 -- 172.21.15.45:0/3490382834 wait complete. 2023-12-19T18:00:08.835 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'inode'] in time 0:00:00.099233, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T18:00:08.836 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2023-12-19T18:00:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 -- start start 2023-12-19T18:00:08.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 Processor -- start 2023-12-19T18:00:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 0x5600389bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x560038917400 0x5600389bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560038917000 0x5600389bd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560038996a00 con 0x560038917800 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560038996780 con 0x560038917000 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x560038996640 con 0x560038917400 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 0x5600389bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 0x5600389bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34516/0 (socket says 172.21.15.45:34516) 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/4099803588 learned_addr learned my addr 172.21.15.45:0/4099803588 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/4099803588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x560038917400 msgr2=0x5600389bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x560038917400 0x5600389bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/4099803588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560038917000 msgr2=0x5600389bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560038917000 0x5600389bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/4099803588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560038938b60 con 0x560038917800 2023-12-19T18:00:08.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 0x5600389bc580 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x560038a76de0 tx=0x5600396fec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2172a251d43345aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.896+0000 7f9d5aab6700 1 -- 172.21.15.45:0/4099803588 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560038947600 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5aab6700 1 -- 172.21.15.45:0/4099803588 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560038962480 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5aab6700 1 -- 172.21.15.45:0/4099803588 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600389471e0 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560038938340 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560038938000 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 4 waiting for MDS map... 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5aab6700 1 -- 172.21.15.45:0/4099803588 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x560038950c40 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5aab6700 1 -- 172.21.15.45:0/4099803588 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x560038c08300 con 0x560038917800 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 4 Got MDS map 63 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 10 main: JournalTool::main 2023-12-19T18:00:08.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 4 main: JournalTool: connecting to RADOS... 2023-12-19T18:00:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 1 Processor -- start 2023-12-19T18:00:08.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.900+0000 7f9d5eb01380 1 -- start start 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979e400 0x5600389bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e800 0x5600389bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 0x5600389be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003894de00 con 0x56003979ec00 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560038996780 con 0x56003979e400 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x560038996500 con 0x56003979e800 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 0x5600389be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 0x5600389be100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34526/0 (socket says 172.21.15.45:34526) 2023-12-19T18:00:08.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 -- 172.21.15.45:0/1679092864 learned_addr learned my addr 172.21.15.45:0/1679092864 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979e400 0x5600389bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e800 0x5600389bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 -- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e800 msgr2=0x5600389bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e800 0x5600389bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 -- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979e400 msgr2=0x5600389bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979e400 0x5600389bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 -- 172.21.15.45:0/1679092864 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560038938ea0 con 0x56003979ec00 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e800 0x5600389bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979e400 0x5600389bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5caba700 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 0x5600389be100 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x560038c68090 tx=0x5600389ed5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5ff8b6c60550b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d58ab2700 1 -- 172.21.15.45:0/1679092864 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560038947080 con 0x56003979ec00 2023-12-19T18:00:08.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d58ab2700 1 -- 172.21.15.45:0/1679092864 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600396f2780 con 0x56003979ec00 2023-12-19T18:00:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d58ab2700 1 -- 172.21.15.45:0/1679092864 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560038947600 con 0x56003979ec00 2023-12-19T18:00:08.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- 172.21.15.45:0/1679092864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 msgr2=0x5600389be100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 0x5600389be100 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x560038c68090 tx=0x5600389ed5c0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- 172.21.15.45:0/1679092864 shutdown_connections 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979ec00 0x5600389be100 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e800 0x5600389bdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/1679092864 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979e400 0x5600389bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- 172.21.15.45:0/1679092864 >> 172.21.15.45:0/1679092864 conn(0x560038916c00 msgr2=0x5600389e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- 172.21.15.45:0/1679092864 shutdown_connections 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.904+0000 7f9d5eb01380 1 -- 172.21.15.45:0/1679092864 wait complete. 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 Processor -- start 2023-12-19T18:00:08.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 -- start start 2023-12-19T18:00:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e400 0x5600389bf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 0x5600389bec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979ec00 0x5600389be680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600389963c0 con 0x56003979e800 2023-12-19T18:00:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560038996280 con 0x56003979ec00 2023-12-19T18:00:08.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x560038996140 con 0x56003979e400 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 0x5600389bec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 0x5600389bec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34530/0 (socket says 172.21.15.45:34530) 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/2644164718 learned_addr learned my addr 172.21.15.45:0/2644164718 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e400 0x5600389bf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5caba700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979ec00 0x5600389be680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e400 msgr2=0x5600389bf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e400 0x5600389bf180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979ec00 msgr2=0x5600389be680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979ec00 0x5600389be680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/2644164718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600389391e0 con 0x56003979e800 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 0x5600389bec00 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x560038c693e0 tx=0x5600389ed260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d572af700 1 -- 172.21.15.45:0/2644164718 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560038946f20 con 0x56003979e800 2023-12-19T18:00:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d572af700 1 -- 172.21.15.45:0/2644164718 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5600396f2c00 con 0x56003979e800 2023-12-19T18:00:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d572af700 1 -- 172.21.15.45:0/2644164718 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560038947080 con 0x56003979e800 2023-12-19T18:00:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560038938ea0 con 0x56003979e800 2023-12-19T18:00:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560038938b60 con 0x56003979e800 2023-12-19T18:00:08.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.908+0000 7f9d5eb01380 4 main: JournalTool: resolving pool 11 2023-12-19T18:00:08.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.912+0000 7f9d572af700 1 -- 172.21.15.45:0/2644164718 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x560038994840 con 0x56003979e800 2023-12-19T18:00:08.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.912+0000 7f9d572af700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x560038d52000 0x5600389bf700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.912+0000 7f9d572af700 1 -- 172.21.15.45:0/2644164718 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x560038950a80 con 0x56003979e800 2023-12-19T18:00:08.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.912+0000 7f9d5eb01380 4 main: JournalTool: creating IoCtx.. 2023-12-19T18:00:08.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.912+0000 7f9d5eb01380 4 main: Executing for rank 0 2023-12-19T18:00:08.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x560038d52000 0x5600389bf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 -- start start 2023-12-19T18:00:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 Processor -- start 2023-12-19T18:00:08.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x560038d52000 0x5600389bf700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x560038a762a0 tx=0x560038d5f800 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979f400 0x5600389be100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979f800 0x5600389bdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 0x5600389bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x560038996a00 con 0x560038d52400 2023-12-19T18:00:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x560038996140 con 0x56003979f400 2023-12-19T18:00:08.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5eb01380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x560038996280 con 0x56003979f800 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5caba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 0x5600389bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5caba700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 0x5600389bd600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34532/0 (socket says 172.21.15.45:34532) 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5caba700 1 -- 172.21.15.45:0/3465749371 learned_addr learned my addr 172.21.15.45:0/3465749371 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979f800 0x5600389bdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.916+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979f400 0x5600389be100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5caba700 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979f800 msgr2=0x5600389bdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5caba700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979f800 0x5600389bdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5caba700 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979f400 msgr2=0x5600389be100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5caba700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979f400 0x5600389be100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5caba700 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560038ca0b60 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5caba700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 0x5600389bd600 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x560038c68300 tx=0x5600396fe000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ba80bfb9cb6dfdf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d542a9700 1 -- 172.21.15.45:0/3465749371 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5600389471e0 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d542a9700 1 -- 172.21.15.45:0/3465749371 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560038962900 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560038ca09c0 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560038ca0820 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5eb01380 4 waiting for MDS map... 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d542a9700 1 -- 172.21.15.45:0/3465749371 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560038946dc0 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d542a9700 1 -- 172.21.15.45:0/3465749371 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x560038950700 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d542a9700 1 -- 172.21.15.45:0/3465749371 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x560038958f00 con 0x560038d52400 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5eb01380 4 Got MDS map 63 2023-12-19T18:00:08.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x560038d52800 0x560038de4000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:1 11.f 11:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038d52c00 con 0x560038d52800 2023-12-19T18:00:08.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x560038d52800 0x560038de4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.920+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x560038d52800 0x560038de4000 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=24e0790b06d4474e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.924+0000 7f9d5dabc700 1 -- 172.21.15.45:0/3465749371 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v90'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790b40 con 0x560038d52800 2023-12-19T18:00:08.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.924+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x560038d53000 0x560038de4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.924+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:2 11.14 11:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038d53400 con 0x560038d53000 2023-12-19T18:00:08.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.924+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x560038d53000 0x560038de4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x560038d53000 0x560038de4580 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=76dc26b00371010a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/3465749371 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v90'26 uv26 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790d80 con 0x560038d53000 2023-12-19T18:00:08.935 INFO:teuthology.orchestra.run.smithi045.stdout:writing EResetJournal entry 2023-12-19T18:00:08.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:3 11.14 11:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038d53800 con 0x560038d53000 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x560038d53c00 0x560038de4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:4 11.1b 11:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038dc4400 con 0x560038d53c00 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x560038dc4800 0x560038de5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 11.b 11:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038dc4c00 con 0x560038dc4800 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x560038dc5000 0x560038de5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:6 11.1f 11:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038dc5400 con 0x560038dc5000 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x560038dc5800 0x560038de5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:7 11.1a 11:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038dc5c00 con 0x560038dc5800 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.928+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 11.1e 11:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038dfa000 con 0x560038d52800 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x560038d53c00 0x560038de4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x560038dc4800 0x560038de5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5caba700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x560038dc5000 0x560038de5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x560038dc5800 0x560038de5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5caba700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x560038dc5000 0x560038de5600 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=8d6b56e9ce833a3f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5d2bb700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x560038dc4800 0x560038de5080 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=5e05e792b3369089 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x560038d53c00 0x560038de4b00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=370bf0ad059cd4c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5dabc700 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x560038dc5800 0x560038de5b80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=a4cddd62fbce5ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/3465749371 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(3 200.00000001 [delete] v90'27 uv26 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790d80 con 0x560038d53000 2023-12-19T18:00:08.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.932+0000 7f9d5dabc700 1 -- 172.21.15.45:0/3465749371 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(8 200.00000006 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790b40 con 0x560038d52800 2023-12-19T18:00:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/3465749371 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(5 200.00000003 [delete] v90'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790d80 con 0x560038dc4800 2023-12-19T18:00:08.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5dabc700 1 -- 172.21.15.45:0/3465749371 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(4 200.00000002 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790b40 con 0x560038d53c00 2023-12-19T18:00:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d52aa6700 1 -- 172.21.15.45:0/3465749371 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 11.14 11:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x560038d52c00 con 0x560038d53000 2023-12-19T18:00:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5caba700 1 -- 172.21.15.45:0/3465749371 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(6 200.00000004 [delete] v90'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5600397918c0 con 0x560038dc5000 2023-12-19T18:00:08.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5dabc700 1 -- 172.21.15.45:0/3465749371 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(7 200.00000005 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790b40 con 0x560038dc5800 2023-12-19T18:00:08.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5d2bb700 1 -- 172.21.15.45:0/3465749371 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v90'28 uv28 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x560039790d80 con 0x560038d53000 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 4 Successfully wrote new journal pointer and header for rank 4:0 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x560038dc5000 msgr2=0x560038de5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x560038dc5000 0x560038de5600 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x560038dc4800 msgr2=0x560038de5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x560038dc4800 0x560038de5080 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x560038d53c00 msgr2=0x560038de4b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x560038d53c00 0x560038de4b00 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x560038dc5800 msgr2=0x560038de5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x560038dc5800 0x560038de5b80 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x560038d53000 msgr2=0x560038de4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x560038d53000 0x560038de4580 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5caba700 1 -- 172.21.15.45:0/3465749371 reap_dead start 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x560038d52800 msgr2=0x560038de4000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x560038d52800 0x560038de4000 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 msgr2=0x5600389bd600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 0x5600389bd600 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x560038c68300 tx=0x5600396fe000 comp rx=0 tx=0).stop 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 shutdown_connections 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038d52400 0x5600389bd600 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x560038d52800 0x560038de4000 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/3465749371 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x560038d53000 0x560038de4580 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 >> 172.21.15.45:0/3465749371 conn(0x56003979f000 msgr2=0x5600389e6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 shutdown_connections 2023-12-19T18:00:08.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.936+0000 7f9d5eb01380 1 -- 172.21.15.45:0/3465749371 wait complete. 2023-12-19T18:00:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x560038d52000 msgr2=0x5600389bf700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x560038d52000 0x5600389bf700 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x560038a762a0 tx=0x560038d5f800 comp rx=0 tx=0).stop 2023-12-19T18:00:08.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 msgr2=0x5600389bec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 0x5600389bec00 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x560038c693e0 tx=0x5600389ed260 comp rx=0 tx=0).stop 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 shutdown_connections 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x560038d52000 0x5600389bf700 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56003979ec00 0x5600389be680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56003979e800 0x5600389bec00 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/2644164718 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56003979e400 0x5600389bf180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 >> 172.21.15.45:0/2644164718 conn(0x560038916c00 msgr2=0x5600389e5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 shutdown_connections 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/2644164718 wait complete. 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 msgr2=0x5600389bc580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 0x5600389bc580 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x560038a76de0 tx=0x5600396fec60 comp rx=0 tx=0).stop 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 shutdown_connections 2023-12-19T18:00:08.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560038917000 0x5600389bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x560038917400 0x5600389bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 --2- 172.21.15.45:0/4099803588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x560038917800 0x5600389bc580 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 >> 172.21.15.45:0/4099803588 conn(0x560038917c00 msgr2=0x5600389e5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 shutdown_connections 2023-12-19T18:00:08.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:08.940+0000 7f9d5eb01380 1 -- 172.21.15.45:0/4099803588 wait complete. 2023-12-19T18:00:08.952 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.116198, result: writing EResetJournal entry 2023-12-19T18:00:08.952 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init 2023-12-19T18:00:09.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 -- start start 2023-12-19T18:00:09.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 Processor -- start 2023-12-19T18:00:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 0x5645ff556580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff4b1400 0x5645ff556b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff4b1800 0x5645ff557080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ff4e7e00 con 0x5645ff4b1000 2023-12-19T18:00:09.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530780 con 0x5645ff4b1800 2023-12-19T18:00:09.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b4390840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530640 con 0x5645ff4b1400 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b2b4c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 0x5645ff556580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b2b4c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 0x5645ff556580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34552/0 (socket says 172.21.15.45:34552) 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.020+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/1299351604 learned_addr learned my addr 172.21.15.45:0/1299351604 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b234b700 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff4b1400 0x5645ff556b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b334d700 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff4b1800 0x5645ff557080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff4b1400 msgr2=0x5645ff556b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff4b1400 0x5645ff556b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff4b1800 msgr2=0x5645ff557080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff4b1800 0x5645ff557080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/1299351604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ff4d2b60 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 0x5645ff556580 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x5645ff5b94d0 tx=0x56460029c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=affd7a5914e3aa70 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b0347700 1 -- 172.21.15.45:0/1299351604 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5645ff4e1600 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b0347700 1 -- 172.21.15.45:0/1299351604 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5645ff4fc480 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b0347700 1 -- 172.21.15.45:0/1299351604 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5645ff4e11e0 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645ff4d2340 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5645ff4d2000 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 4 waiting for MDS map... 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b0347700 1 -- 172.21.15.45:0/1299351604 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x5645ff4eac40 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b0347700 1 -- 172.21.15.45:0/1299351604 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x5645ff7b8000 con 0x5645ff4b1000 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 4 Got MDS map 63 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 4 datascan.main: Using metadata pool output 2023-12-19T18:00:09.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 4 datascan.main: connecting to RADOS... 2023-12-19T18:00:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 1 Processor -- start 2023-12-19T18:00:09.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.024+0000 7fd3b4390840 1 -- start start 2023-12-19T18:00:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4400 0x5645ff557600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 0x5645ff557b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4c00 0x5645ff558100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530500 con 0x5645ff7f4800 2023-12-19T18:00:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ff5303c0 con 0x5645ff7f4400 2023-12-19T18:00:09.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530780 con 0x5645ff7f4c00 2023-12-19T18:00:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 0x5645ff557b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 0x5645ff557b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34554/0 (socket says 172.21.15.45:34554) 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/4024046310 learned_addr learned my addr 172.21.15.45:0/4024046310 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b234b700 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4c00 0x5645ff558100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b334d700 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4400 0x5645ff557600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4c00 msgr2=0x5645ff558100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4c00 0x5645ff558100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4400 msgr2=0x5645ff557600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4400 0x5645ff557600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/4024046310 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ff4d2ea0 con 0x5645ff7f4800 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b234b700 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4c00 0x5645ff558100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 0x5645ff557b80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x5645ff7bc8a0 tx=0x56460029c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48f1aa1abfe80c94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3ae343700 1 -- 172.21.15.45:0/4024046310 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5645ff4e0f20 con 0x5645ff7f4800 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3ae343700 1 -- 172.21.15.45:0/4024046310 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646002a2d80 con 0x5645ff7f4800 2023-12-19T18:00:09.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3ae343700 1 -- 172.21.15.45:0/4024046310 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5645ff4e1600 con 0x5645ff7f4800 2023-12-19T18:00:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- 172.21.15.45:0/4024046310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 msgr2=0x5645ff557b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 0x5645ff557b80 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x5645ff7bc8a0 tx=0x56460029c2a0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- 172.21.15.45:0/4024046310 shutdown_connections 2023-12-19T18:00:09.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4c00 0x5645ff558100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4800 0x5645ff557b80 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 --2- 172.21.15.45:0/4024046310 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4400 0x5645ff557600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- 172.21.15.45:0/4024046310 >> 172.21.15.45:0/4024046310 conn(0x5645ff7f4000 msgr2=0x5645ff5a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.028+0000 7fd3b4390840 1 -- 172.21.15.45:0/4024046310 shutdown_connections 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 -- 172.21.15.45:0/4024046310 wait complete. 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 Processor -- start 2023-12-19T18:00:09.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 -- start start 2023-12-19T18:00:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4400 0x5645ff559180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4800 0x5645ff558c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 0x5645ff558680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530280 con 0x5645ff7f4c00 2023-12-19T18:00:09.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530140 con 0x5645ff7f4800 2023-12-19T18:00:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b4390840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645ff530000 con 0x5645ff7f4400 2023-12-19T18:00:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b234b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 0x5645ff558680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b234b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 0x5645ff558680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34562/0 (socket says 172.21.15.45:34562) 2023-12-19T18:00:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b234b700 1 -- 172.21.15.45:0/3281399454 learned_addr learned my addr 172.21.15.45:0/3281399454 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b334d700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4400 0x5645ff559180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.032+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4800 0x5645ff558c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b234b700 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4400 msgr2=0x5645ff559180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b234b700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff7f4400 0x5645ff559180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b234b700 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4800 msgr2=0x5645ff558c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b234b700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff7f4800 0x5645ff558c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b234b700 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645ff4d2b60 con 0x5645ff7f4c00 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b234b700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 0x5645ff558680 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x5645ff7bd620 tx=0x56460029c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3acb40700 1 -- 172.21.15.45:0/3281399454 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5645ff4e1080 con 0x5645ff7f4c00 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3acb40700 1 -- 172.21.15.45:0/3281399454 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5646002a2300 con 0x5645ff7f4c00 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5645ff4d2340 con 0x5645ff7f4c00 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3acb40700 1 -- 172.21.15.45:0/3281399454 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5645ff4e0f20 con 0x5645ff7f4c00 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645ff4d2000 con 0x5645ff7f4c00 2023-12-19T18:00:09.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.036+0000 7fd3b4390840 4 datascan.init: resolving metadata pool 11 2023-12-19T18:00:09.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3acb40700 1 -- 172.21.15.45:0/3281399454 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5645ff50e840 con 0x5645ff7f4c00 2023-12-19T18:00:09.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3acb40700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5645ff7f5400 0x5645ff559700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3acb40700 1 -- 172.21.15.45:0/3281399454 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x5645ff4eaa80 con 0x5645ff7f4c00 2023-12-19T18:00:09.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b4390840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:00:09.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5645ff7f5800 0x5645ff558100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b334d700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5645ff7f5400 0x5645ff559700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:1 11.14 11:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5645ff7f5c00 con 0x5645ff7f5800 2023-12-19T18:00:09.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5645ff7f5800 0x5645ff558100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b334d700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5645ff7f5400 0x5645ff559700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x5645ff5b8930 tx=0x5645ff918000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.040+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5645ff7f5800 0x5645ff558100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.044+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/3281399454 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 160+0+0 (crc 0 0 0) 0x564600334b40 con 0x5645ff7f5800 2023-12-19T18:00:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.044+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:2 11.14 11:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5645ff91e000 con 0x5645ff7f5800 2023-12-19T18:00:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.044+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/3281399454 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v90'29 uv29 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x564600334b40 con 0x5645ff7f5800 2023-12-19T18:00:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.044+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5645ff91e400 0x5645ff557b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.044+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:3 11.1f 11:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5645ff91e800 con 0x5645ff91e400 2023-12-19T18:00:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.048+0000 7fd3b334d700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5645ff91e400 0x5645ff557b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.048+0000 7fd3b334d700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5645ff91e400 0x5645ff557b80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.048+0000 7fd3b334d700 1 -- 172.21.15.45:0/3281399454 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 162+0+0 (crc 0 0 0) 0x564600335200 con 0x5645ff91e400 2023-12-19T18:00:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.048+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:4 11.1f 11:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5645ff91ec00 con 0x5645ff91e400 2023-12-19T18:00:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b334d700 1 -- 172.21.15.45:0/3281399454 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v90'10 uv10 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x564600335200 con 0x5645ff91e400 2023-12-19T18:00:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5645ff91f000 0x5645ff557600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:5 11.13 11:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5645ff91f400 con 0x5645ff91f000 2023-12-19T18:00:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5645ff91f000 0x5645ff557600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b2b4c700 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5645ff91f000 0x5645ff557600 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/3281399454 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x564600334b40 con 0x5645ff91f000 2023-12-19T18:00:09.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b4390840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:00:09.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.052+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:6 11.13 11:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5645ff91e000 con 0x5645ff91f000 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b2b4c700 1 -- 172.21.15.45:0/3281399454 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v90'7 uv7 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x564600334b40 con 0x5645ff91f000 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5645ff91e400 msgr2=0x5645ff557b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5645ff91e400 0x5645ff557b80 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5645ff91f000 msgr2=0x5645ff557600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5645ff91f000 0x5645ff557600 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5645ff7f5800 msgr2=0x5645ff558100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5645ff7f5800 0x5645ff558100 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b234b700 1 -- 172.21.15.45:0/3281399454 reap_dead start 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5645ff7f5400 msgr2=0x5645ff559700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5645ff7f5400 0x5645ff559700 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x5645ff5b8930 tx=0x5645ff918000 comp rx=0 tx=0).stop 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 msgr2=0x5645ff558680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 0x5645ff558680 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x5645ff7bd620 tx=0x56460029c000 comp rx=0 tx=0).stop 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 shutdown_connections 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5645ff7f5400 0x5645ff559700 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/3281399454 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff7f4c00 0x5645ff558680 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 >> 172.21.15.45:0/3281399454 conn(0x5645ff7f4000 msgr2=0x5645ff5a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 shutdown_connections 2023-12-19T18:00:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/3281399454 wait complete. 2023-12-19T18:00:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 msgr2=0x5645ff556580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 0x5645ff556580 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x5645ff5b94d0 tx=0x56460029c480 comp rx=0 tx=0).stop 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 shutdown_connections 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5645ff4b1800 0x5645ff557080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5645ff4b1400 0x5645ff556b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 --2- 172.21.15.45:0/1299351604 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5645ff4b1000 0x5645ff556580 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 >> 172.21.15.45:0/1299351604 conn(0x5645ff4b0c00 msgr2=0x5645ff5a1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.056+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 shutdown_connections 2023-12-19T18:00:09.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.060+0000 7fd3b4390840 1 -- 172.21.15.45:0/1299351604 wait complete. 2023-12-19T18:00:09.073 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init'] in time 0:00:00.121372, result: 2023-12-19T18:00:09.074 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents 2023-12-19T18:00:09.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 -- start start 2023-12-19T18:00:09.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 Processor -- start 2023-12-19T18:00:09.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 0x563ec9503b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec945d400 0x563ec9503600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec945d000 0x563ec9503080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dca00 con 0x563ec945d800 2023-12-19T18:00:09.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc640 con 0x563ec945d400 2023-12-19T18:00:09.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe246603840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc500 con 0x563ec945d000 2023-12-19T18:00:09.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 0x563ec9503b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 0x563ec9503b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34578/0 (socket says 172.21.15.45:34578) 2023-12-19T18:00:09.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 -- 172.21.15.45:0/3121043249 learned_addr learned my addr 172.21.15.45:0/3121043249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe2455c0700 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec945d000 0x563ec9503080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe2445be700 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec945d400 0x563ec9503600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 -- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec945d000 msgr2=0x563ec9503080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec945d000 0x563ec9503080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 -- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec945d400 msgr2=0x563ec9503600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec945d400 0x563ec9503600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe244dbf700 1 -- 172.21.15.45:0/3121043249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ec947eb60 con 0x563ec945d800 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.132+0000 7fe2455c0700 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec945d000 0x563ec9503080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:09.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe244dbf700 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 0x563ec9503b80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x563ec956b410 tx=0x563eca252d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a5ce02e4596ec0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe2425ba700 1 -- 172.21.15.45:0/3121043249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563ec948d600 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe2425ba700 1 -- 172.21.15.45:0/3121043249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563eca254000 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe2425ba700 1 -- 172.21.15.45:0/3121043249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563ec948d1e0 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ec947e340 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x563ec947e000 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 4 waiting for MDS map... 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe2425ba700 1 -- 172.21.15.45:0/3121043249 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x563ec9496c40 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe2425ba700 1 -- 172.21.15.45:0/3121043249 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x563eca256000 con 0x563ec945d800 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 4 Got MDS map 63 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 4 datascan.main: Using metadata pool output 2023-12-19T18:00:09.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 4 datascan.main: connecting to RADOS... 2023-12-19T18:00:09.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 Processor -- start 2023-12-19T18:00:09.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 -- start start 2023-12-19T18:00:09.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ec9493e00 con 0x563ec9751000 2023-12-19T18:00:09.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc640 con 0x563ec9750800 2023-12-19T18:00:09.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe246603840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc3c0 con 0x563ec9750c00 2023-12-19T18:00:09.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.136+0000 7fe2445be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2445be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34594/0 (socket says 172.21.15.45:34594) 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2445be700 1 -- 172.21.15.45:0/2601990803 learned_addr learned my addr 172.21.15.45:0/2601990803 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe244dbf700 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 -- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 msgr2=0x563ec9502580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 -- 172.21.15.45:0/2601990803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 msgr2=0x563ec9504100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 -- 172.21.15.45:0/2601990803 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ec947eea0 con 0x563ec9750800 2023-12-19T18:00:09.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2445be700 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:09.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2455c0700 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x563ec974e7b0 tx=0x563ec9760c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2000f06abb4ca269 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2405b6700 1 -- 172.21.15.45:0/2601990803 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563ec948d600 con 0x563ec9750800 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2405b6700 1 -- 172.21.15.45:0/2601990803 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563eca254d80 con 0x563ec9750800 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe2405b6700 1 -- 172.21.15.45:0/2601990803 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563ec948d1e0 con 0x563ec9750800 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 -- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 msgr2=0x563ec9502b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x563ec974e7b0 tx=0x563ec9760c00 comp rx=0 tx=0).stop 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 -- 172.21.15.45:0/2601990803 shutdown_connections 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 --2- 172.21.15.45:0/2601990803 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 -- 172.21.15.45:0/2601990803 >> 172.21.15.45:0/2601990803 conn(0x563ec945cc00 msgr2=0x563ec952b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 -- 172.21.15.45:0/2601990803 shutdown_connections 2023-12-19T18:00:09.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 -- 172.21.15.45:0/2601990803 wait complete. 2023-12-19T18:00:09.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 Processor -- start 2023-12-19T18:00:09.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.140+0000 7fe246603840 1 -- start start 2023-12-19T18:00:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc280 con 0x563ec9751000 2023-12-19T18:00:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc140 con 0x563ec9750800 2023-12-19T18:00:09.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x563ec94dc000 con 0x563ec9750c00 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2445be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2445be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34596/0 (socket says 172.21.15.45:34596) 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 learned_addr learned my addr 172.21.15.45:0/4256450818 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 msgr2=0x563ec9502580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec9750c00 0x563ec9502580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 msgr2=0x563ec9504100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ec947eb60 con 0x563ec9750800 2023-12-19T18:00:09.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec9751000 0x563ec9504100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:09.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x563ec974e9f0 tx=0x563eca252000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe23edb3700 1 -- 172.21.15.45:0/4256450818 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563ec948cdc0 con 0x563ec9750800 2023-12-19T18:00:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe23edb3700 1 -- 172.21.15.45:0/4256450818 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563eca254a80 con 0x563ec9750800 2023-12-19T18:00:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe23edb3700 1 -- 172.21.15.45:0/4256450818 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x563ec948d600 con 0x563ec9750800 2023-12-19T18:00:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563ec947e340 con 0x563ec9750800 2023-12-19T18:00:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563ec947f520 con 0x563ec9750800 2023-12-19T18:00:09.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.144+0000 7fe246603840 4 datascan.init: resolving metadata pool 11 2023-12-19T18:00:09.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe23edb3700 1 -- 172.21.15.45:0/4256450818 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x563ec94ba840 con 0x563ec9750800 2023-12-19T18:00:09.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe23edb3700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563ec97cc400 0x563ec98b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe23edb3700 1 -- 172.21.15.45:0/4256450818 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x563ec9496a80 con 0x563ec9750800 2023-12-19T18:00:09.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:00:09.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 4 datascan.main: data pool 'cephfs_data' has ID 12 2023-12-19T18:00:09.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T18:00:09.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 4 datascan.main: data pool 'cephfs_data_extra' has ID 13 2023-12-19T18:00:09.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T18:00:09.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563ec9751400 0x563ec9504680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563ec97cc400 0x563ec98b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.148+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751800 con 0x563ec9751400 2023-12-19T18:00:09.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563ec9751400 0x563ec9504680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563ec97cc400 0x563ec98b0000 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x563ec956b740 tx=0x563ec95333e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563ec9751400 0x563ec9504680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe23fdb5700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563ec97cc800 0x563ec98b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:2 12.20 12:04000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ccc00 con 0x563ec97cc800 2023-12-19T18:00:09.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563ec97cc800 0x563ec98b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.152+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563ec97cc800 0x563ec98b0580 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(2 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe2405b6700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563ec97cd400 0x563ec98b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 12.10 12:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec97cd400 2023-12-19T18:00:09.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563ec97cd400 0x563ec98b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563ec97cd400 0x563ec98b0b00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.156+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:4 12.30 12:0c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd000 con 0x563ec97cc800 2023-12-19T18:00:09.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(4 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2405b6700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563ec97cdc00 0x563ec98b1080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:5 12.8 12:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce800 con 0x563ec97cdc00 2023-12-19T18:00:09.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563ec97cdc00 0x563ec98b1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563ec97cdc00 0x563ec98b1080 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(5 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:6 12.28 12:14000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cf400 con 0x563ec97cd400 2023-12-19T18:00:09.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(6 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2405b6700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563ec97cec00 0x563ec98b1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:7 12.18 12:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cf000 con 0x563ec97cec00 2023-12-19T18:00:09.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.160+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563ec97cec00 0x563ec98b1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563ec97cec00 0x563ec98b1600 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(7 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe23fdb5700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563ec97cf800 0x563ec98b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:8 12.38 12:1c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cfc00 con 0x563ec97cf800 2023-12-19T18:00:09.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563ec97cf800 0x563ec98b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe244dbf700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563ec97cf800 0x563ec98b1b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(8 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe2405b6700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563ec97cf400 0x563ec98b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 12.4 12:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec97cf400 2023-12-19T18:00:09.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.164+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563ec97cf400 0x563ec98b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe2445be700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563ec97cf400 0x563ec98b2680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(9 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:10 12.24 12:24000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce800 con 0x563ec97cf800 2023-12-19T18:00:09.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(10 [pgnls start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe2405b6700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563ec97ccc00 0x563ec98b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:11 12.14 12:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd000 con 0x563ec97ccc00 2023-12-19T18:00:09.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563ec97ccc00 0x563ec98b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.168+0000 7fe2455c0700 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563ec97ccc00 0x563ec98b2c00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(11 [pgnls start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:12 12.34 12:2c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cfc00 con 0x563ec97ccc00 2023-12-19T18:00:09.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(12 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 12.c 12:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce400 con 0x563ec97cd400 2023-12-19T18:00:09.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(13 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:14 12.2c 12:34000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec97cf800 2023-12-19T18:00:09.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(14 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:15 12.1c 12:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cf000 con 0x563ec97cd400 2023-12-19T18:00:09.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(15 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.172+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:16 12.3c 12:3c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751800 con 0x563ec97ccc00 2023-12-19T18:00:09.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(16 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:17 12.2 12:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce800 con 0x563ec9751400 2023-12-19T18:00:09.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(17 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:18 12.22 12:44000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0000 con 0x563ec97cc800 2023-12-19T18:00:09.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(18 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:19 12.12 12:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce400 con 0x563ec97cdc00 2023-12-19T18:00:09.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(19 [pgnls start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.176+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:20 12.32 12:4c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0400 con 0x563ec97cdc00 2023-12-19T18:00:09.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(20 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:21 12.a 12:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cf000 con 0x563ec97cf800 2023-12-19T18:00:09.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(21 [pgnls start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:22 12.2a 12:54000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0800 con 0x563ec97cf800 2023-12-19T18:00:09.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(22 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:23 12.1a 12:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec9751400 2023-12-19T18:00:09.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(23 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.180+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:24 12.3a 12:5c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0c00 con 0x563ec97cdc00 2023-12-19T18:00:09.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(24 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:25 12.6 12:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0400 con 0x563ec97cec00 2023-12-19T18:00:09.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(25 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:26 12.26 12:64000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1000 con 0x563ec97ccc00 2023-12-19T18:00:09.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(26 [pgnls start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:27 12.16 12:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1400 con 0x563ec97cf400 2023-12-19T18:00:09.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(27 [pgnls start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.184+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:28 12.36 12:6c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0000 con 0x563ec97ccc00 2023-12-19T18:00:09.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(28 [pgnls start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 12.e 12:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1800 con 0x563ec97cd400 2023-12-19T18:00:09.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(29 [pgnls start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:30 12.2e 12:74000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0400 con 0x563ec97cec00 2023-12-19T18:00:09.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(30 [pgnls start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:31 12.1e 12:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1c00 con 0x563ec9751400 2023-12-19T18:00:09.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(31 [pgnls start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.188+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 12.3e 12:7c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751800 con 0x563ec97cd400 2023-12-19T18:00:09.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(32 [pgnls start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:33 12.1 12:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec97cf400 2023-12-19T18:00:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(33 [pgnls start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:34 12.21 12:84000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cfc00 con 0x563ec97cec00 2023-12-19T18:00:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(34 [pgnls start_epoch 90 out=49b] v88'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:35 12.11 12:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce800 con 0x563ec97ccc00 2023-12-19T18:00:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.192+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(35 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:36 12.31 12:8c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd000 con 0x563ec97cd400 2023-12-19T18:00:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(36 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:37 12.9 12:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce400 con 0x563ec97cf800 2023-12-19T18:00:09.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(37 [pgnls start_epoch 90 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:38 12.29 12:94000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd000 con 0x563ec9751400 2023-12-19T18:00:09.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(38 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:39 12.19 12:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec97cd400 2023-12-19T18:00:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(39 [pgnls start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.196+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:40 12.39 12:9c000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751800 con 0x563ec97cf400 2023-12-19T18:00:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.200+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(40 [pgnls start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.200+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 12.5 12:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd000 con 0x563ec97cf400 2023-12-19T18:00:09.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.200+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(41 [pgnls start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.200+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:42 12.25 12:a4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0800 con 0x563ec97cc800 2023-12-19T18:00:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.200+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(42 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.200+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:43 12.15 12:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0c00 con 0x563ec97cf400 2023-12-19T18:00:09.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(43 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:44 12.35 12:ac000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1800 con 0x563ec97cd400 2023-12-19T18:00:09.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(44 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:45 12.d 12:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1400 con 0x563ec97cc800 2023-12-19T18:00:09.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(45 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:46 12.2d 12:b4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cf000 con 0x563ec97cdc00 2023-12-19T18:00:09.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(46 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.204+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:47 12.1d 12:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1c00 con 0x563ec97cd400 2023-12-19T18:00:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(47 [pgnls start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:48 12.3d 12:bc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1000 con 0x563ec97cec00 2023-12-19T18:00:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(48 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:49 12.3 12:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6000 con 0x563ec97cd400 2023-12-19T18:00:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(49 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:50 12.23 12:c4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0000 con 0x563ec97cd400 2023-12-19T18:00:09.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(50 [pgnls start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:51 12.13 12:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6400 con 0x563ec97cec00 2023-12-19T18:00:09.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(51 [pgnls start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.208+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:52 12.33 12:cc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0400 con 0x563ec97cf800 2023-12-19T18:00:09.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(52 [pgnls start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:53 12.b 12:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6800 con 0x563ec97cdc00 2023-12-19T18:00:09.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(53 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:54 12.2b 12:d4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0800 con 0x563ec9751400 2023-12-19T18:00:09.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(54 [pgnls start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:55 12.1b 12:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6c00 con 0x563ec9751400 2023-12-19T18:00:09.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(55 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.212+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:56 12.3b 12:dc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cfc00 con 0x563ec97cf800 2023-12-19T18:00:09.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(56 [pgnls start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:57 12.7 12:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7000 con 0x563ec97cec00 2023-12-19T18:00:09.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(57 [pgnls start_epoch 90 out=81b] v88'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:58 12.7 12:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751c00 con 0x563ec97cec00 2023-12-19T18:00:09.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe246603840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T18:00:09.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.216+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:59 12.7 12:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6800 con 0x563ec97cec00 2023-12-19T18:00:09.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.220+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(59 10000000001.00000000 [call] v90'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.220+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:60 12.27 12:e4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6000 con 0x563ec97cd400 2023-12-19T18:00:09.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.220+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(60 [pgnls start_epoch 90 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.220+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:61 12.17 12:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7400 con 0x563ec97cf400 2023-12-19T18:00:09.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.220+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(61 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.220+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:62 12.37 12:ec000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce800 con 0x563ec9751400 2023-12-19T18:00:09.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(62 [pgnls start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:63 12.f 12:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7800 con 0x563ec97cf400 2023-12-19T18:00:09.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(63 [pgnls start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:64 12.2f 12:f4000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0c00 con 0x563ec97cf800 2023-12-19T18:00:09.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(64 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:65 12.1f 12:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7c00 con 0x563ec97cf400 2023-12-19T18:00:09.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(65 [pgnls start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.224+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:66 12.3f 12:fc000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0800 con 0x563ec97cc800 2023-12-19T18:00:09.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(66 [pgnls start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:67 13.0 13:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd000 con 0x563ec97cc800 2023-12-19T18:00:09.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(67 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:68 13.10 13:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1800 con 0x563ec97cec00 2023-12-19T18:00:09.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(68 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:69 13.8 13:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1400 con 0x563ec97cf800 2023-12-19T18:00:09.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(69 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.228+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:70 13.18 13:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1c00 con 0x563ec97cc800 2023-12-19T18:00:09.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(70 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:71 13.4 13:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1000 con 0x563ec97cf400 2023-12-19T18:00:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(71 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:72 13.14 13:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0000 con 0x563ec97cd400 2023-12-19T18:00:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(72 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:73 13.c 13:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0800 con 0x563ec97cec00 2023-12-19T18:00:09.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(73 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.232+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9902000 con 0x563ec97cf400 2023-12-19T18:00:09.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(74 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:75 13.2 13:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6400 con 0x563ec97ccc00 2023-12-19T18:00:09.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(75 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:76 13.12 13:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9902400 con 0x563ec97cd400 2023-12-19T18:00:09.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(76 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:77 13.a 13:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7000 con 0x563ec97cf800 2023-12-19T18:00:09.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(77 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cf800 2023-12-19T18:00:09.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.236+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:78 13.1a 13:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9902800 con 0x563ec97cec00 2023-12-19T18:00:09.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(78 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:79 13.6 13:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6800 con 0x563ec9751400 2023-12-19T18:00:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(79 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:80 13.16 13:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9902c00 con 0x563ec97cdc00 2023-12-19T18:00:09.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(80 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:81 13.e 13:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751c00 con 0x563ec97cc800 2023-12-19T18:00:09.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(81 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.240+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:82 13.1e 13:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9903000 con 0x563ec9751400 2023-12-19T18:00:09.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(82 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:83 13.1 13:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0400 con 0x563ec97cf400 2023-12-19T18:00:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(83 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:84 13.11 13:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9903400 con 0x563ec97cec00 2023-12-19T18:00:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(84 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:85 13.9 13:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0c00 con 0x563ec97ccc00 2023-12-19T18:00:09.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(85 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.244+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:86 13.19 13:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9903800 con 0x563ec97cdc00 2023-12-19T18:00:09.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(86 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cdc00 2023-12-19T18:00:09.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:87 13.5 13:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1400 con 0x563ec9751400 2023-12-19T18:00:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(87 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:88 13.15 13:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9903c00 con 0x563ec9751400 2023-12-19T18:00:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(88 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:89 13.d 13:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0000 con 0x563ec9751400 2023-12-19T18:00:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(89 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.248+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:90 13.1d 13:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0400 con 0x563ec97cc800 2023-12-19T18:00:09.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(90 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:91 13.3 13:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6000 con 0x563ec97cd400 2023-12-19T18:00:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe244dbf700 1 -- 172.21.15.45:0/4256450818 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(91 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4fc0 con 0x563ec97cd400 2023-12-19T18:00:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:92 13.13 13:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f1400 con 0x563ec97cc800 2023-12-19T18:00:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(92 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:93 13.b 13:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f6c00 con 0x563ec97ccc00 2023-12-19T18:00:09.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(93 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.252+0000 7fe23fdb5700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:94 13.1b 13:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f0000 con 0x563ec9751400 2023-12-19T18:00:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(94 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec9751400 2023-12-19T18:00:09.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:95 13.7 13:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7400 con 0x563ec97cc800 2023-12-19T18:00:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(95 [pgnls start_epoch 90 out=81b] v88'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:96 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cd800 con 0x563ec97cc800 2023-12-19T18:00:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(96 10000000001.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cc800 2023-12-19T18:00:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe246603840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T18:00:09.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.256+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:97 12.7 12:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97cf000 con 0x563ec97cec00 2023-12-19T18:00:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.260+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(97 10000000001.00000000 [call,setxattr (8)] v90'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.260+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:98 13.17 13:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec97ce400 con 0x563ec97ccc00 2023-12-19T18:00:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.260+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(98 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97ccc00 2023-12-19T18:00:09.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.260+0000 7fe2405b6700 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:99 13.f 13:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec98f7800 con 0x563ec97cf400 2023-12-19T18:00:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.264+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(99 [pgnls start_epoch 90 out=81b] v88'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.264+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:100 13.f 13:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9751800 con 0x563ec97cf400 2023-12-19T18:00:09.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.264+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(100 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.264+0000 7fe246603840 10 datascan.operator(): handling object 1099511627777.1 2023-12-19T18:00:09.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.264+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:101 12.7 12:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9904000 con 0x563ec97cec00 2023-12-19T18:00:09.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe2455c0700 1 -- 172.21.15.45:0/4256450818 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(101 10000000001.00000000 [call,setxattr (8)] v90'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x563eca1d4d80 con 0x563ec97cec00 2023-12-19T18:00:09.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:102 13.1f 13:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x563ec9904400 con 0x563ec97cf400 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(102 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x563eca1d4b40 con 0x563ec97cf400 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563ec97cd400 msgr2=0x563ec98b0b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x563ec97cd400 0x563ec98b0b00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563ec97cec00 msgr2=0x563ec98b1600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x563ec97cec00 0x563ec98b1600 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563ec97cf800 msgr2=0x563ec98b1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x563ec97cf800 0x563ec98b1b80 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563ec97cdc00 msgr2=0x563ec98b1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x563ec97cdc00 0x563ec98b1080 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563ec9751400 msgr2=0x563ec9504680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x563ec9751400 0x563ec9504680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563ec97ccc00 msgr2=0x563ec98b2c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x563ec97ccc00 0x563ec98b2c00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563ec97cf400 msgr2=0x563ec98b2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 reap_dead start 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x563ec97cf400 0x563ec98b2680 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 reap_dead start 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563ec97cc800 msgr2=0x563ec98b0580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x563ec97cc800 0x563ec98b0580 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 reap_dead start 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe2445be700 1 -- 172.21.15.45:0/4256450818 reap_dead start 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563ec97cc400 msgr2=0x563ec98b0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563ec97cc400 0x563ec98b0000 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x563ec956b740 tx=0x563ec95333e0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 msgr2=0x563ec9502b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x563ec974e9f0 tx=0x563eca252000 comp rx=0 tx=0).stop 2023-12-19T18:00:09.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 shutdown_connections 2023-12-19T18:00:09.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x563ec97cc400 0x563ec98b0000 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 --2- 172.21.15.45:0/4256450818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec9750800 0x563ec9502b00 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 >> 172.21.15.45:0/4256450818 conn(0x563ec945cc00 msgr2=0x563ec952b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 shutdown_connections 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.268+0000 7fe246603840 1 -- 172.21.15.45:0/4256450818 wait complete. 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 msgr2=0x563ec9503b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 0x563ec9503b80 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x563ec956b410 tx=0x563eca252d80 comp rx=0 tx=0).stop 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 shutdown_connections 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x563ec945d000 0x563ec9503080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563ec945d400 0x563ec9503600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 --2- 172.21.15.45:0/3121043249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x563ec945d800 0x563ec9503b80 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 >> 172.21.15.45:0/3121043249 conn(0x563ec945dc00 msgr2=0x563ec952b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 shutdown_connections 2023-12-19T18:00:09.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.272+0000 7fe246603840 1 -- 172.21.15.45:0/3121043249 wait complete. 2023-12-19T18:00:09.285 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents'] in time 0:00:00.211743, result: 2023-12-19T18:00:09.286 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes 2023-12-19T18:00:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 -- start start 2023-12-19T18:00:09.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 Processor -- start 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628978ab000 0x562897950580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 0x562897951080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5628978abc00 0x562897951600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289792aa00 con 0x5628978ab800 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289792a640 con 0x5628978ab000 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec19f00840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56289792a500 con 0x5628978abc00 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 0x562897951080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 0x562897951080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34618/0 (socket says 172.21.15.45:34618) 2023-12-19T18:00:09.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 -- 172.21.15.45:0/2992371826 learned_addr learned my addr 172.21.15.45:0/2992371826 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec18ebd700 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5628978abc00 0x562897951600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec186bc700 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628978ab000 0x562897950580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 -- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5628978abc00 msgr2=0x562897951600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5628978abc00 0x562897951600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 -- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628978ab000 msgr2=0x562897950580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628978ab000 0x562897950580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 -- 172.21.15.45:0/2992371826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628978ccb60 con 0x5628978ab800 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.348+0000 7fec17ebb700 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 0x562897951080 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x5628979b92c0 tx=0x5628979815c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e1dc59850d429c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec15eb7700 1 -- 172.21.15.45:0/2992371826 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5628978db080 con 0x5628978ab800 2023-12-19T18:00:09.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec15eb7700 1 -- 172.21.15.45:0/2992371826 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628978f6180 con 0x5628978ab800 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec15eb7700 1 -- 172.21.15.45:0/2992371826 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5628978db600 con 0x5628978ab800 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628978cd1e0 con 0x5628978ab800 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5628978ccb60 con 0x5628978ab800 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 4 waiting for MDS map... 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec15eb7700 1 -- 172.21.15.45:0/2992371826 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x5628978e4c40 con 0x5628978ab800 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec15eb7700 1 -- 172.21.15.45:0/2992371826 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x5628978ecf00 con 0x5628978ab800 2023-12-19T18:00:09.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 4 Got MDS map 63 2023-12-19T18:00:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 4 datascan.main: Using metadata pool output 2023-12-19T18:00:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 4 datascan.main: connecting to RADOS... 2023-12-19T18:00:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 Processor -- start 2023-12-19T18:00:09.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 -- start start 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 0x562897952680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628978e1e00 con 0x562897beac00 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289792a500 con 0x562897bea400 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.352+0000 7fec19f00840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56289792a640 con 0x562897bea800 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 0x562897952680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 0x562897952680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34620/0 (socket says 172.21.15.45:34620) 2023-12-19T18:00:09.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 -- 172.21.15.45:0/908026210 learned_addr learned my addr 172.21.15.45:0/908026210 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec18ebd700 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec186bc700 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 -- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 msgr2=0x562897952100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 -- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 msgr2=0x562897951b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 -- 172.21.15.45:0/908026210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628978cc340 con 0x562897beac00 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec17ebb700 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 0x562897952680 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x5628979b9920 tx=0x5628979812c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3933ecd89b363fb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec13eb3700 1 -- 172.21.15.45:0/908026210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5628978db1e0 con 0x562897beac00 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec13eb3700 1 -- 172.21.15.45:0/908026210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562898692300 con 0x562897beac00 2023-12-19T18:00:09.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec13eb3700 1 -- 172.21.15.45:0/908026210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5628978daf20 con 0x562897beac00 2023-12-19T18:00:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 -- 172.21.15.45:0/908026210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 msgr2=0x562897952680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 0x562897952680 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x5628979b9920 tx=0x5628979812c0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 -- 172.21.15.45:0/908026210 shutdown_connections 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beac00 0x562897952680 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 --2- 172.21.15.45:0/908026210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 -- 172.21.15.45:0/908026210 >> 172.21.15.45:0/908026210 conn(0x562897bea000 msgr2=0x562897979800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 -- 172.21.15.45:0/908026210 shutdown_connections 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 -- 172.21.15.45:0/908026210 wait complete. 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 Processor -- start 2023-12-19T18:00:09.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.356+0000 7fec19f00840 1 -- start start 2023-12-19T18:00:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 0x562897952c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289792a3c0 con 0x562897beb000 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56289792a280 con 0x562897bea400 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56289792a140 con 0x562897bea800 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 0x562897952c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 0x562897952c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34626/0 (socket says 172.21.15.45:34626) 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 learned_addr learned my addr 172.21.15.45:0/1439182486 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 msgr2=0x562897952100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x562897bea800 0x562897952100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 msgr2=0x562897951b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562897bea400 0x562897951b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628978cd1e0 con 0x562897beb000 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 0x562897952c00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x562898698a50 tx=0x56289869cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec126b0700 1 -- 172.21.15.45:0/1439182486 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5628978db1e0 con 0x562897beb000 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec126b0700 1 -- 172.21.15.45:0/1439182486 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562898692000 con 0x562897beb000 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5628978ccb60 con 0x562897beb000 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec126b0700 1 -- 172.21.15.45:0/1439182486 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5628978daf20 con 0x562897beb000 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628978cc340 con 0x562897beb000 2023-12-19T18:00:09.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.360+0000 7fec19f00840 4 datascan.init: resolving metadata pool 11 2023-12-19T18:00:09.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec126b0700 1 -- 172.21.15.45:0/1439182486 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x562897908840 con 0x562897beb000 2023-12-19T18:00:09.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec126b0700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562897d00000 0x562897950b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec126b0700 1 -- 172.21.15.45:0/1439182486 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x5628978e4a80 con 0x562897beb000 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec19f00840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec19f00840 4 datascan.main: data pool 'cephfs_data' has ID 12 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec19f00840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562897d00000 0x562897950b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562897beb400 0x562897953180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.364+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:1 11.14 11:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897beb800 con 0x562897beb400 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562897d00000 0x562897950b00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x5628979b86f0 tx=0x56289869dc20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562897beb400 0x562897953180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562897beb400 0x562897953180 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv29 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562897bebc00 0x562897952680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:2 11.1f 11:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00400 con 0x562897bebc00 2023-12-19T18:00:09.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562897bebc00 0x562897952680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562897bebc00 0x562897952680 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562897d00800 0x562897953700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.368+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:3 12.0 12:00000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d00800 2023-12-19T18:00:09.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.372+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562897d00800 0x562897953700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.372+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562897d00800 0x562897953700 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.372+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.372+0000 7fec136b2700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562897beb800 0x562897d22000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.372+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:4 12.20 12:04000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897beb800 2023-12-19T18:00:09.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.372+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562897beb800 0x562897d22000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562897beb800 0x562897d22000 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec13eb3700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562897d30000 0x562897d22580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 12.10 12:08000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897d30000 2023-12-19T18:00:09.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562897d30000 0x562897d22580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562897d30000 0x562897d22580 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.376+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:6 12.30 12:0c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d01c00 con 0x562897beb800 2023-12-19T18:00:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec13eb3700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562897d30800 0x562897d22b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 12.8 12:10000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d30800 2023-12-19T18:00:09.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562897d30800 0x562897d22b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec186bc700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562897d30800 0x562897d22b00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:8 12.28 12:14000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897d30000 2023-12-19T18:00:09.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec13eb3700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562897d01c00 0x562897d23080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.380+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:9 12.18 12:18000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00400 con 0x562897d01c00 2023-12-19T18:00:09.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.384+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562897d01c00 0x562897d23080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.384+0000 7fec17ebb700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562897d01c00 0x562897d23080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.384+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.384+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:10 12.38 12:1c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30c00 con 0x562897bebc00 2023-12-19T18:00:09.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.384+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.384+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:11 12.4 12:20000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897beb400 2023-12-19T18:00:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:12 12.24 12:24000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31000 con 0x562897bebc00 2023-12-19T18:00:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec13eb3700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562897d31800 0x562897d23600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:13 12.14 12:28000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31c00 con 0x562897d31800 2023-12-19T18:00:09.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562897d31800 0x562897d23600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec18ebd700 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562897d31800 0x562897d23600 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.388+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 12.34 12:2c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897d31800 2023-12-19T18:00:09.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(14 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:15 12.c 12:30000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897d30000 2023-12-19T18:00:09.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(15 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:16 12.2c 12:34000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30c00 con 0x562897bebc00 2023-12-19T18:00:09.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(16 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:17 12.1c 12:38000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e400 con 0x562897d30000 2023-12-19T18:00:09.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(17 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:18 12.3c 12:3c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31000 con 0x562897d31800 2023-12-19T18:00:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(18 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.392+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:19 12.2 12:40000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e800 con 0x562897d00800 2023-12-19T18:00:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:20 12.22 12:44000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897beb800 2023-12-19T18:00:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(20 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:21 12.12 12:48000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3ec00 con 0x562897d30800 2023-12-19T18:00:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:22 12.32 12:4c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31c00 con 0x562897d30800 2023-12-19T18:00:09.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(22 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.396+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:23 12.a 12:50000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897bebc00 2023-12-19T18:00:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(23 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:24 12.2a 12:54000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897bebc00 2023-12-19T18:00:09.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:25 12.1a 12:58000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e800 con 0x562897d00800 2023-12-19T18:00:09.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(25 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 12.3a 12:5c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30c00 con 0x562897d30800 2023-12-19T18:00:09.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:27 12.6 12:60000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897d01c00 2023-12-19T18:00:09.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.400+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:28 12.26 12:64000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d31800 2023-12-19T18:00:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.404+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(28 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.404+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:29 12.16 12:68000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f400 con 0x562897beb400 2023-12-19T18:00:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.404+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(29 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.404+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:30 12.36 12:6c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e400 con 0x562897d31800 2023-12-19T18:00:09.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.404+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(30 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.404+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:31 12.e 12:70000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f800 con 0x562897d30000 2023-12-19T18:00:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(31 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:32 12.2e 12:74000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897d01c00 2023-12-19T18:00:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(32 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:33 12.1e 12:78000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3fc00 con 0x562897d00800 2023-12-19T18:00:09.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(33 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:34 12.3e 12:7c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897d30000 2023-12-19T18:00:09.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(34 [pgnls-filter start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.408+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:35 12.1 12:80000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31000 con 0x562897beb400 2023-12-19T18:00:09.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(35 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:36 12.21 12:84000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3ec00 con 0x562897d01c00 2023-12-19T18:00:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 90 out=49b] v88'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:37 12.11 12:88000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897d31800 2023-12-19T18:00:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:38 12.31 12:8c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d30000 2023-12-19T18:00:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(38 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.412+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:39 12.9 12:90000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897bebc00 2023-12-19T18:00:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(39 [pgnls-filter start_epoch 90 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:40 12.29 12:94000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00400 con 0x562897d00800 2023-12-19T18:00:09.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(40 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:41 12.19 12:98000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31c00 con 0x562897d30000 2023-12-19T18:00:09.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(41 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:42 12.39 12:9c000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897beb400 2023-12-19T18:00:09.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(42 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.416+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:43 12.5 12:a0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30c00 con 0x562897beb400 2023-12-19T18:00:09.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(43 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:44 12.25 12:a4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897beb800 2023-12-19T18:00:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(44 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:45 12.15 12:a8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e800 con 0x562897beb400 2023-12-19T18:00:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:46 12.35 12:ac000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d30000 2023-12-19T18:00:09.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(46 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.420+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:47 12.d 12:b0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31000 con 0x562897beb800 2023-12-19T18:00:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.424+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(47 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.424+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:48 12.2d 12:b4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e400 con 0x562897d30800 2023-12-19T18:00:09.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.424+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(48 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.424+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:49 12.1d 12:b8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897d30000 2023-12-19T18:00:09.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.424+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(49 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.424+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:50 12.3d 12:bc000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f800 con 0x562897d01c00 2023-12-19T18:00:09.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(50 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:51 12.3 12:c0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00400 con 0x562897d30000 2023-12-19T18:00:09.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(51 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:52 12.23 12:c4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897d30000 2023-12-19T18:00:09.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(52 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:53 12.13 12:c8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f400 con 0x562897d01c00 2023-12-19T18:00:09.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(53 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:54 12.33 12:cc000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897bebc00 2023-12-19T18:00:09.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.428+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:55 12.b 12:d0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3fc00 con 0x562897d30800 2023-12-19T18:00:09.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:56 12.2b 12:d4000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31000 con 0x562897d00800 2023-12-19T18:00:09.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(56 [pgnls-filter start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:57 12.1b 12:d8000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48000 con 0x562897d00800 2023-12-19T18:00:09.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(57 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:58 12.3b 12:dc000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897bebc00 2023-12-19T18:00:09.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.432+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(58 [pgnls-filter start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:59 12.7 12:e0000000::::head [pgnls-filter start_epoch 90 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48400 con 0x562897d01c00 2023-12-19T18:00:09.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(59 [pgnls-filter start_epoch 90 out=81b] v90'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:60 12.0 12:00000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d01000 con 0x562897d00800 2023-12-19T18:00:09.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(60 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:61 12.20 12:04000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48800 con 0x562897beb800 2023-12-19T18:00:09.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(61 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.436+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:62 12.10 12:08000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3ec00 con 0x562897d30000 2023-12-19T18:00:09.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(62 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:63 12.30 12:0c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48c00 con 0x562897beb800 2023-12-19T18:00:09.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:64 12.8 12:10000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f800 con 0x562897d30800 2023-12-19T18:00:09.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(64 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:65 12.28 12:14000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49000 con 0x562897d30000 2023-12-19T18:00:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(65 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.440+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:66 12.18 12:18000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f400 con 0x562897d01c00 2023-12-19T18:00:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.444+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(66 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.444+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:67 12.38 12:1c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49400 con 0x562897bebc00 2023-12-19T18:00:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.444+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(67 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.444+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:68 12.4 12:20000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897beb400 2023-12-19T18:00:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.444+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.444+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:69 12.24 12:24000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49800 con 0x562897bebc00 2023-12-19T18:00:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(69 [pgnls-filter start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:70 12.14 12:28000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897d31800 2023-12-19T18:00:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(70 [pgnls-filter start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:71 12.34 12:2c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49c00 con 0x562897d31800 2023-12-19T18:00:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(71 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:72 12.c 12:30000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e800 con 0x562897d30000 2023-12-19T18:00:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(72 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:73 12.2c 12:34000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48400 con 0x562897bebc00 2023-12-19T18:00:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.448+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:74 12.1c 12:38000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e400 con 0x562897d30000 2023-12-19T18:00:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.452+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(74 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.452+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:75 12.3c 12:3c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48800 con 0x562897d31800 2023-12-19T18:00:09.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.452+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(75 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.452+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:76 12.2 12:40000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3fc00 con 0x562897d00800 2023-12-19T18:00:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.452+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(76 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.452+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:77 12.22 12:44000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48c00 con 0x562897beb800 2023-12-19T18:00:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(77 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:78 12.12 12:48000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d30800 2023-12-19T18:00:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(78 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:79 12.32 12:4c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48000 con 0x562897d30800 2023-12-19T18:00:09.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(79 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:80 12.a 12:50000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00400 con 0x562897bebc00 2023-12-19T18:00:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 13 ==== osd_op_reply(80 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:81 12.2a 12:54000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31c00 con 0x562897bebc00 2023-12-19T18:00:09.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 14 ==== osd_op_reply(81 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.456+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:82 12.1a 12:58000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49000 con 0x562897d00800 2023-12-19T18:00:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(82 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:83 12.3a 12:5c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30400 con 0x562897d30800 2023-12-19T18:00:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(83 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:84 12.6 12:60000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49400 con 0x562897d01c00 2023-12-19T18:00:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(84 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:85 12.26 12:64000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897d31800 2023-12-19T18:00:09.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(85 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.460+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:86 12.16 12:68000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49800 con 0x562897beb400 2023-12-19T18:00:09.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(86 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:87 12.36 12:6c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30c00 con 0x562897d31800 2023-12-19T18:00:09.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(87 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:88 12.e 12:70000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49c00 con 0x562897d30000 2023-12-19T18:00:09.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(88 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:89 12.2e 12:74000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31000 con 0x562897d01c00 2023-12-19T18:00:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(89 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.464+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:90 12.1e 12:78000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48400 con 0x562897d00800 2023-12-19T18:00:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(90 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:91 12.3e 12:7c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48000 con 0x562897d30000 2023-12-19T18:00:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 18 ==== osd_op_reply(91 [pgnls-filter start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:92 12.1 12:80000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3ec00 con 0x562897beb400 2023-12-19T18:00:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(92 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:93 12.21 12:84000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49000 con 0x562897d01c00 2023-12-19T18:00:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(93 [pgnls-filter start_epoch 90 out=49b] v88'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.468+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:94 12.11 12:88000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897d31800 2023-12-19T18:00:09.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(94 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d31800 2023-12-19T18:00:09.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:95 12.31 12:8c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d01000 con 0x562897d30000 2023-12-19T18:00:09.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 19 ==== osd_op_reply(95 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:96 12.9 12:90000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e800 con 0x562897bebc00 2023-12-19T18:00:09.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 15 ==== osd_op_reply(96 [pgnls-filter start_epoch 90 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:97 12.29 12:94000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00c00 con 0x562897d00800 2023-12-19T18:00:09.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(97 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:98 12.19 12:98000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e400 con 0x562897d30000 2023-12-19T18:00:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.472+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 20 ==== osd_op_reply(98 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:99 12.39 12:9c000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f800 con 0x562897beb400 2023-12-19T18:00:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(99 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:100 12.5 12:a0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897beb400 2023-12-19T18:00:09.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(100 [pgnls-filter start_epoch 90 out=49b] v88'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:101 12.25 12:a4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897beb800 2023-12-19T18:00:09.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(101 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.476+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:102 12.15 12:a8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48800 con 0x562897beb400 2023-12-19T18:00:09.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(102 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:103 12.35 12:ac000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3fc00 con 0x562897d30000 2023-12-19T18:00:09.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 21 ==== osd_op_reply(103 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:104 12.d 12:b0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49c00 con 0x562897beb800 2023-12-19T18:00:09.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(104 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:105 12.2d 12:b4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3ec00 con 0x562897d30800 2023-12-19T18:00:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(105 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.480+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:106 12.1d 12:b8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48000 con 0x562897d30000 2023-12-19T18:00:09.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 22 ==== osd_op_reply(106 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:107 12.3d 12:bc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f800 con 0x562897d01c00 2023-12-19T18:00:09.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(107 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:108 12.3 12:c0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31c00 con 0x562897d30000 2023-12-19T18:00:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 23 ==== osd_op_reply(108 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:109 12.23 12:c4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f000 con 0x562897d30000 2023-12-19T18:00:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 24 ==== osd_op_reply(109 [pgnls-filter start_epoch 90 out=49b] v88'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:110 12.13 12:c8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d31400 con 0x562897d01c00 2023-12-19T18:00:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(110 [pgnls-filter start_epoch 90 out=49b] v88'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.484+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:111 12.33 12:cc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49800 con 0x562897bebc00 2023-12-19T18:00:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 16 ==== osd_op_reply(111 [pgnls-filter start_epoch 90 out=49b] v88'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:112 12.b 12:d0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d30c00 con 0x562897d30800 2023-12-19T18:00:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(112 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d30800 2023-12-19T18:00:09.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:113 12.2b 12:d4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48400 con 0x562897d00800 2023-12-19T18:00:09.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(113 [pgnls-filter start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:114 12.1b 12:d8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d00400 con 0x562897d00800 2023-12-19T18:00:09.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(114 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.488+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:115 12.3b 12:dc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48800 con 0x562897bebc00 2023-12-19T18:00:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 17 ==== osd_op_reply(115 [pgnls-filter start_epoch 90 out=49b] v88'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:116 12.7 12:e0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3f400 con 0x562897d01c00 2023-12-19T18:00:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(116 [pgnls-filter start_epoch 90 out=81b] v90'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-12-19T18:00:09.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 10 datascan.operator(): handling object 10000000001.0 2023-12-19T18:00:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:117 12.7 12:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d01400 con 0x562897d01c00 2023-12-19T18:00:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (103) out=103b,getxattr,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+149 (crc 0 0 0) 0x562898690fc0 con 0x562897d01c00 2023-12-19T18:00:09.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:118 13.7 13:e2e07930:::10000000001.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d01800 con 0x562897beb800 2023-12-19T18:00:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(118 10000000001.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 20 datascan.operator(): loaded layout from xattr: pi: 13 os: 4194304 sc: 1 su: 4194304 2023-12-19T18:00:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-12-19T18:00:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/sixmegs 2023-12-19T18:00:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=sixmegs 2023-12-19T18:00:09.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:119 11.10 11:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5e000 con 0x562897d30000 2023-12-19T18:00:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 25 ==== osd_op_reply(119 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2023-12-19T18:00:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/sixmegs, will insert to root 2023-12-19T18:00:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.492+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:120 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5e400 con 0x562897d30000 2023-12-19T18:00:09.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.496+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 26 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.496+0000 7fec19f00840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:00:09.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.496+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:121 11.10 11:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5e800 con 0x562897d30000 2023-12-19T18:00:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 27 ==== osd_op_reply(121 10000000000.00000000 [create,omap-set-header] v90'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec19f00840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-12-19T18:00:09.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:122 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5ec00 con 0x562897d30000 2023-12-19T18:00:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 28 ==== osd_op_reply(122 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec19f00840 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2023-12-19T18:00:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec19f00840 20 datascan.read_dentry: sixmegs_head not found in result 2023-12-19T18:00:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec19f00840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/sixmegs with size=6291456 bytes 2023-12-19T18:00:09.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.500+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:123 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5f000 con 0x562897d30000 2023-12-19T18:00:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 29 ==== osd_op_reply(123 10000000000.00000000 [omap-set-vals] v90'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2023-12-19T18:00:09.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-12-19T18:00:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-12-19T18:00:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:124 11.1f 11:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5f400 con 0x562897bebc00 2023-12-19T18:00:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 18 ==== osd_op_reply(124 1.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 4 datascan.get_frag_of: Unexpected error on '1.00000000': (2) No such file or directory 2023-12-19T18:00:09.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-12-19T18:00:09.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:125 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5f800 con 0x562897bebc00 2023-12-19T18:00:09.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 19 ==== osd_op_reply(125 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:00:09.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:126 11.1f 11:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48000 con 0x562897bebc00 2023-12-19T18:00:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 20 ==== osd_op_reply(126 1.00000000 [create,omap-set-header] v90'11 uv11 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2023-12-19T18:00:09.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.504+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:127 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49800 con 0x562897bebc00 2023-12-19T18:00:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 21 ==== osd_op_reply(127 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec19f00840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:00:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec19f00840 20 datascan.read_dentry: subdir_head not found in result 2023-12-19T18:00:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec19f00840 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:subdir 2023-12-19T18:00:09.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:128 11.1f 11:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e800 con 0x562897bebc00 2023-12-19T18:00:09.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 22 ==== osd_op_reply(128 1.00000000 [omap-set-vals] v90'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec19f00840 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-12-19T18:00:09.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:129 12.27 12:e4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e400 con 0x562897d30000 2023-12-19T18:00:09.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.0 v2:172.21.15.45:6808/36279 30 ==== osd_op_reply(129 [pgnls-filter start_epoch 90 out=49b] v88'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897d30000 2023-12-19T18:00:09.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.508+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:130 12.17 12:e8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d3e000 con 0x562897beb400 2023-12-19T18:00:09.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(130 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:131 12.37 12:ec000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d48c00 con 0x562897d00800 2023-12-19T18:00:09.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(131 [pgnls-filter start_epoch 90 out=49b] v88'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897d00800 2023-12-19T18:00:09.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:132 12.f 12:f0000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5e000 con 0x562897beb400 2023-12-19T18:00:09.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(132 [pgnls-filter start_epoch 90 out=49b] v88'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:133 12.2f 12:f4000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49400 con 0x562897bebc00 2023-12-19T18:00:09.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec18ebd700 1 -- 172.21.15.45:0/1439182486 <== osd.2 v2:172.21.15.45:6824/36285 23 ==== osd_op_reply(133 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690d80 con 0x562897bebc00 2023-12-19T18:00:09.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.512+0000 7fec136b2700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:134 12.1f 12:f8000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d5fc00 con 0x562897beb400 2023-12-19T18:00:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 <== osd.6 v2:172.21.15.73:6816/36537 16 ==== osd_op_reply(134 [pgnls-filter start_epoch 90 out=49b] v88'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690b40 con 0x562897beb400 2023-12-19T18:00:09.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec13eb3700 1 -- 172.21.15.45:0/1439182486 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:135 12.3f 12:fc000000::::head [pgnls-filter start_epoch 90 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x562897d49000 con 0x562897beb800 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec17ebb700 1 -- 172.21.15.45:0/1439182486 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(135 [pgnls-filter start_epoch 90 out=49b] v88'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x562898690fc0 con 0x562897beb800 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562897d30000 msgr2=0x562897d22580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x562897d30000 0x562897d22580 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562897d01c00 msgr2=0x562897d23080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x562897d01c00 0x562897d23080 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562897bebc00 msgr2=0x562897952680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x562897bebc00 0x562897952680 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562897d30800 msgr2=0x562897d22b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x562897d30800 0x562897d22b00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562897d00800 msgr2=0x562897953700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x562897d00800 0x562897953700 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 reap_dead start 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec186bc700 1 -- 172.21.15.45:0/1439182486 reap_dead start 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562897d31800 msgr2=0x562897d23600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x562897d31800 0x562897d23600 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562897beb400 msgr2=0x562897953180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x562897beb400 0x562897953180 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562897beb800 msgr2=0x562897d22000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x562897beb800 0x562897d22000 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562897d00000 msgr2=0x562897950b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562897d00000 0x562897950b00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x5628979b86f0 tx=0x56289869dc20 comp rx=0 tx=0).stop 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 msgr2=0x562897952c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 0x562897952c00 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x562898698a50 tx=0x56289869cc00 comp rx=0 tx=0).stop 2023-12-19T18:00:09.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 shutdown_connections 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x562897d00000 0x562897950b00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 --2- 172.21.15.45:0/1439182486 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x562897beb000 0x562897952c00 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 >> 172.21.15.45:0/1439182486 conn(0x562897bea000 msgr2=0x562897979800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 shutdown_connections 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.516+0000 7fec19f00840 1 -- 172.21.15.45:0/1439182486 wait complete. 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 msgr2=0x562897951080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 0x562897951080 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x5628979b92c0 tx=0x5628979815c0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 shutdown_connections 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5628978abc00 0x562897951600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5628978ab800 0x562897951080 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 --2- 172.21.15.45:0/2992371826 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628978ab000 0x562897950580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 >> 172.21.15.45:0/2992371826 conn(0x5628978aac00 msgr2=0x562897979000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 shutdown_connections 2023-12-19T18:00:09.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.520+0000 7fec19f00840 1 -- 172.21.15.45:0/2992371826 wait complete. 2023-12-19T18:00:09.534 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes'] in time 0:00:00.248502, result: 2023-12-19T18:00:09.534 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-12-19T18:00:09.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 -- start start 2023-12-19T18:00:09.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 Processor -- start 2023-12-19T18:00:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c4f43800 0x5643c4fe9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c4f43400 0x5643c4fe9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 0x5643c4fe9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2a00 con 0x5643c4f43000 2023-12-19T18:00:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2780 con 0x5643c4f43400 2023-12-19T18:00:09.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf1141840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2640 con 0x5643c4f43800 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.592+0000 7f9cf00fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 0x5643c4fe9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 0x5643c4fe9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34642/0 (socket says 172.21.15.45:34642) 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1580008008 learned_addr learned my addr 172.21.15.45:0/1580008008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c4f43800 0x5643c4fe9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c4f43400 0x5643c4fe9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c4f43800 msgr2=0x5643c4fe9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c4f43800 0x5643c4fe9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c4f43400 msgr2=0x5643c4fe9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c4f43400 0x5643c4fe9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1580008008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c4f64b60 con 0x5643c4f43000 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 0x5643c4fe9080 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x5643c5051380 tx=0x5643c5d3cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4a379ac3e86e5c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9ced0f8700 1 -- 172.21.15.45:0/1580008008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643c4f73600 con 0x5643c4f43000 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9ced0f8700 1 -- 172.21.15.45:0/1580008008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643c5238000 con 0x5643c4f43000 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9ced0f8700 1 -- 172.21.15.45:0/1580008008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643c4f731e0 con 0x5643c4f43000 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643c4f64340 con 0x5643c4f43000 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5643c4f64000 con 0x5643c4f43000 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 4 waiting for MDS map... 2023-12-19T18:00:09.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9ced0f8700 1 -- 172.21.15.45:0/1580008008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x5643c4f7cc40 con 0x5643c4f43000 2023-12-19T18:00:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9ced0f8700 1 -- 172.21.15.45:0/1580008008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 63) v1 ==== 3126+0+0 (secure 0 0 0) 0x5643c5240000 con 0x5643c4f43000 2023-12-19T18:00:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 4 Got MDS map 63 2023-12-19T18:00:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 4 datascan.main: Using metadata pool output 2023-12-19T18:00:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 4 datascan.main: connecting to RADOS... 2023-12-19T18:00:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.596+0000 7f9cf1141840 1 Processor -- start 2023-12-19T18:00:09.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 -- start start 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 0x5643c4fe8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2500 con 0x5643c5236400 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2780 con 0x5643c5236c00 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc23c0 con 0x5643c5236800 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 0x5643c4fe8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 0x5643c4fe8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34658/0 (socket says 172.21.15.45:34658) 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 -- 172.21.15.45:0/2957295710 learned_addr learned my addr 172.21.15.45:0/2957295710 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 -- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 msgr2=0x5643c4fe8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 -- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5236c00 msgr2=0x5643c4fea100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 -- 172.21.15.45:0/2957295710 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c4f64ea0 con 0x5643c5236400 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:09.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 0x5643c4fe8b00 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x5643c52448d0 tx=0x5643c5d3c120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5943e4bb8be61f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9ceb0f4700 1 -- 172.21.15.45:0/2957295710 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643c4f73080 con 0x5643c5236400 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9ceb0f4700 1 -- 172.21.15.45:0/2957295710 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643c5238480 con 0x5643c5236400 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9ceb0f4700 1 -- 172.21.15.45:0/2957295710 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643c4f73600 con 0x5643c5236400 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.600+0000 7f9cf1141840 1 -- 172.21.15.45:0/2957295710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 msgr2=0x5643c4fe8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 0x5643c4fe8b00 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x5643c52448d0 tx=0x5643c5d3c120 comp rx=0 tx=0).stop 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- 172.21.15.45:0/2957295710 shutdown_connections 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- 172.21.15.45:0/2957295710 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236400 0x5643c4fe8b00 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- 172.21.15.45:0/2957295710 >> 172.21.15.45:0/2957295710 conn(0x5643c4f42c00 msgr2=0x5643c5011800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- 172.21.15.45:0/2957295710 shutdown_connections 2023-12-19T18:00:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- 172.21.15.45:0/2957295710 wait complete. 2023-12-19T18:00:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 Processor -- start 2023-12-19T18:00:09.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- start start 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5237000 0x5643c4fea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2280 con 0x5643c5236c00 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2140 con 0x5643c5237000 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cf1141840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643c4fc2000 con 0x5643c5236800 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef8fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef8fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236c00 0x5643c4fea100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34672/0 (socket says 172.21.15.45:34672) 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 learned_addr learned my addr 172.21.15.45:0/1628046566 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5237000 0x5643c4fea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 msgr2=0x5643c4fe8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.604+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c5236800 0x5643c4fe8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5237000 msgr2=0x5643c4fea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c5237000 0x5643c4fea680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643c4f651e0 con 0x5643c5236c00 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236c00 0x5643c4fea100 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x5643c52456e0 tx=0x5643c524ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9ce98f1700 1 -- 172.21.15.45:0/1628046566 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643c4f73080 con 0x5643c5236c00 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9ce98f1700 1 -- 172.21.15.45:0/1628046566 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643c4f8e480 con 0x5643c5236c00 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5643c4f64ea0 con 0x5643c5236c00 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9ce98f1700 1 -- 172.21.15.45:0/1628046566 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5643c4f73600 con 0x5643c5236c00 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5643c4f64b60 con 0x5643c5236c00 2023-12-19T18:00:09.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9cf1141840 4 datascan.init: resolving metadata pool 11 2023-12-19T18:00:09.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.608+0000 7f9ce98f1700 1 -- 172.21.15.45:0/1628046566 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5643c4fa0840 con 0x5643c5236c00 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9ce98f1700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643c5392000 0x5643c5394000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9ce98f1700 1 -- 172.21.15.45:0/1628046566 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x5643c4f7ca80 con 0x5643c5236c00 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cf1141840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cf1141840 4 datascan.main: resolving metadata pool 11 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643c5237400 0x5643c4feac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:1 11.0 11:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5237800 con 0x5643c5237400 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643c5392000 0x5643c5394000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643c5237400 0x5643c4feac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643c5392000 0x5643c5394000 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x5643c52453e0 tx=0x5643c524fec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643c5237400 0x5643c4feac00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(1 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5237400 2023-12-19T18:00:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643c5236400 0x5643c4fe8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.612+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 11.10 11:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5237800 con 0x5643c5236400 2023-12-19T18:00:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643c5236400 0x5643c4fe8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643c5236400 0x5643c4fe8b00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 [pgnls start_epoch 90 out=81b] v90'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643c5237800 0x5643c5394580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:3 11.8 11:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392400 con 0x5643c5237800 2023-12-19T18:00:09.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643c5237800 0x5643c5394580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643c5237800 0x5643c5394580 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(3 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643c5392400 0x5643c5394b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:4 11.18 11:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392c00 con 0x5643c5392400 2023-12-19T18:00:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.616+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643c5392400 0x5643c5394b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643c5392400 0x5643c5394b00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(4 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643c5392c00 0x5643c5395080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:5 11.4 11:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393400 con 0x5643c5392c00 2023-12-19T18:00:09.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643c5392c00 0x5643c5395080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643c5392c00 0x5643c5395080 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.620+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(5 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643c5393400 0x5643c5395600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:6 11.14 11:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392800 con 0x5643c5393400 2023-12-19T18:00:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643c5393400 0x5643c5395600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643c5393400 0x5643c5395600 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(6 [pgnls start_epoch 90 out=125b] v90'29 uv29 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:7 11.c 11:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392800 con 0x5643c5237400 2023-12-19T18:00:09.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(7 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5237400 2023-12-19T18:00:09.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.624+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:8 11.1c 11:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392800 con 0x5643c5393400 2023-12-19T18:00:09.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(8 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:9 11.2 11:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392800 con 0x5643c5392400 2023-12-19T18:00:09.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(9 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:10 11.12 11:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392800 con 0x5643c5392c00 2023-12-19T18:00:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(10 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:11 11.a 11:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5392800 con 0x5643c5237800 2023-12-19T18:00:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(11 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef8fd700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643c5392800 0x5643c5396100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.628+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:12 11.1a 11:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393000 con 0x5643c5392800 2023-12-19T18:00:09.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.632+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643c5392800 0x5643c5396100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.632+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643c5392800 0x5643c5396100 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.632+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(12 [pgnls start_epoch 90 out=49b] v90'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.632+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 11.6 11:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393000 con 0x5643c5236400 2023-12-19T18:00:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.632+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(13 [pgnls start_epoch 90 out=49b] v89'5 uv5 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.632+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 11.16 11:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393000 con 0x5643c5392800 2023-12-19T18:00:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(14 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cef0fc700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643c5393000 0x5643c5396c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 11.e 11:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5393000 2023-12-19T18:00:09.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643c5393000 0x5643c5396c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cf00fe700 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643c5393000 0x5643c5396c00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(15 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5393000 2023-12-19T18:00:09.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 11.1e 11:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392c00 2023-12-19T18:00:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(16 [pgnls start_epoch 90 out=49b] v90'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.636+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:17 11.1 11:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5393400 2023-12-19T18:00:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(17 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:18 11.11 11:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392400 2023-12-19T18:00:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(18 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:19 11.9 11:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5237800 2023-12-19T18:00:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(19 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:20 11.19 11:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5236400 2023-12-19T18:00:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(20 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.640+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:21 11.5 11:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392c00 2023-12-19T18:00:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(21 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:22 11.15 11:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392400 2023-12-19T18:00:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(22 [pgnls start_epoch 90 out=73b] v89'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:23 11.d 11:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392400 2023-12-19T18:00:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(23 [pgnls start_epoch 90 out=74b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 11.1d 11:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392c00 2023-12-19T18:00:09.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(24 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 11.3 11:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5393400 2023-12-19T18:00:09.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.644+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(25 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:26 11.13 11:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392800 2023-12-19T18:00:09.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(26 [pgnls start_epoch 90 out=98b] v90'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:27 11.b 11:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5237800 2023-12-19T18:00:09.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(27 [pgnls start_epoch 90 out=76b] v90'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:28 11.1b 11:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5393000 2023-12-19T18:00:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(28 [pgnls start_epoch 90 out=49b] v90'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5393000 2023-12-19T18:00:09.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.648+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 11.7 11:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392800 2023-12-19T18:00:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(29 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:30 11.17 11:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392c00 2023-12-19T18:00:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(30 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:31 11.f 11:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392c00 2023-12-19T18:00:09.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(31 [pgnls start_epoch 90 out=73b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:32 11.1f 11:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392400 2023-12-19T18:00:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(32 [pgnls start_epoch 90 out=101b] v90'12 uv12 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-12-19T18:00:09.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.652+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:33 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6000 con 0x5643c5236400 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+509 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 20 datascan.scan_links: injected ino detected 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T18:00:09.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-12-19T18:00:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T18:00:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-12-19T18:00:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:34 11.13 11:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392800 2023-12-19T18:00:09.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(34 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:35 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6800 con 0x5643c5392400 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(35 1.00000000 [omap-get-vals out=508b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 20 datascan.scan_links: injected ino detected 2023-12-19T18:00:09.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.656+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:36 11.0 11:00000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6c00 con 0x5643c5237400 2023-12-19T18:00:09.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(36 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5237400 2023-12-19T18:00:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:37 11.10 11:08000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5236400 2023-12-19T18:00:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(37 [pgnls start_epoch 90 out=81b] v90'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:38 11.8 11:10000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5237800 2023-12-19T18:00:09.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(38 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:39 11.18 11:18000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392400 2023-12-19T18:00:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(39 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.660+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:40 11.4 11:20000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(40 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 11.14 11:28000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5393400 2023-12-19T18:00:09.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(41 [pgnls start_epoch 90 out=125b] v90'29 uv29 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:42 11.c 11:30000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5237400 2023-12-19T18:00:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(42 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5237400 2023-12-19T18:00:09.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:43 11.1c 11:38000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5393400 2023-12-19T18:00:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(43 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:44 11.2 11:40000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392400 2023-12-19T18:00:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.664+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(44 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:45 11.12 11:48000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(45 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:46 11.a 11:50000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5237800 2023-12-19T18:00:09.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(46 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:47 11.1a 11:58000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392800 2023-12-19T18:00:09.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(47 [pgnls start_epoch 90 out=49b] v90'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 11.6 11:60000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5236400 2023-12-19T18:00:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(48 [pgnls start_epoch 90 out=49b] v89'5 uv5 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.668+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:49 11.16 11:68000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392800 2023-12-19T18:00:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(49 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:50 11.e 11:70000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5393000 2023-12-19T18:00:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(50 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5393000 2023-12-19T18:00:09.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:51 11.1e 11:78000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(51 [pgnls start_epoch 90 out=49b] v90'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:52 11.1 11:80000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5393400 2023-12-19T18:00:09.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(52 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.672+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:53 11.11 11:88000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392400 2023-12-19T18:00:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(53 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:54 11.9 11:90000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5237800 2023-12-19T18:00:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(54 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:55 11.19 11:98000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5236400 2023-12-19T18:00:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(55 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:56 11.5 11:a0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(56 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.676+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:57 11.15 11:a8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392400 2023-12-19T18:00:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(57 [pgnls start_epoch 90 out=73b] v89'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:58 11.d 11:b0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392400 2023-12-19T18:00:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(58 [pgnls start_epoch 90 out=74b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:59 11.1d 11:b8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(59 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:60 11.3 11:c0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5393400 2023-12-19T18:00:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(60 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5393400 2023-12-19T18:00:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:61 11.13 11:c8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392800 2023-12-19T18:00:09.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(61 [pgnls start_epoch 90 out=98b] v90'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.680+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:62 11.b 11:d0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5237800 2023-12-19T18:00:09.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(62 [pgnls start_epoch 90 out=76b] v90'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5643c5d3afc0 con 0x5643c5237800 2023-12-19T18:00:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:63 11.1b 11:d8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5393000 2023-12-19T18:00:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(63 [pgnls start_epoch 90 out=49b] v90'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5393000 2023-12-19T18:00:09.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:64 11.7 11:e0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392800 2023-12-19T18:00:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(64 [pgnls start_epoch 90 out=49b] v89'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:65 11.17 11:e8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(65 [pgnls start_epoch 90 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:66 11.f 11:f0000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392c00 2023-12-19T18:00:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(66 [pgnls start_epoch 90 out=73b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5392c00 2023-12-19T18:00:09.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.684+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:67 11.1f 11:f8000000::::head [pgnls start_epoch 90 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5392400 2023-12-19T18:00:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 13 ==== osd_op_reply(67 [pgnls start_epoch 90 out=101b] v90'12 uv12 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-12-19T18:00:09.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:68 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c7000 con 0x5643c5236400 2023-12-19T18:00:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(68 10000000000.00000000 [omap-get-vals out=509b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+509 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 20 datascan.scan_links: injected ino detected 2023-12-19T18:00:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-12-19T18:00:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-12-19T18:00:09.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-12-19T18:00:09.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:69 11.13 11:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c7400 con 0x5643c5392800 2023-12-19T18:00:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(69 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-12-19T18:00:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T18:00:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-12-19T18:00:09.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:70 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c7800 con 0x5643c5392400 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 14 ==== osd_op_reply(70 1.00000000 [omap-get-vals out=508b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 20 datascan.scan_links: injected ino detected 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: processing 2 injected_inos 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 10 datascan.scan_links: handling injected_ino 0x10000000000 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:subdir 2023-12-19T18:00:09.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:71 11.1f 11:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6c00 con 0x5643c5392400 2023-12-19T18:00:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.688+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 15 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=507b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+507 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:00:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 20 datascan.scan_links: first is now 2 2023-12-19T18:00:09.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:72 11.1f 11:ff5b34d6:::1.00000000:head [omap-set-vals in=507b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6800 con 0x5643c5392400 2023-12-19T18:00:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 16 ==== osd_op_reply(72 1.00000000 [omap-set-vals] v90'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 20 datascan.inject_linkage: Injected dentry 0x0x1/subdir pointing to 0x0x10000000000 2023-12-19T18:00:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-12-19T18:00:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:sixmegs 2023-12-19T18:00:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:73 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c6400 con 0x5643c5236400 2023-12-19T18:00:09.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(73 10000000000.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+508 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 20 datascan.read_dentry: oid=10000000000.00000000 dname=sixmegs frag=*, r=0 2023-12-19T18:00:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 20 datascan.scan_links: first is now 2 2023-12-19T18:00:09.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.692+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:74 11.10 11:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c7400 con 0x5643c5236400 2023-12-19T18:00:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf00fe700 1 -- 172.21.15.45:0/1628046566 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(74 10000000000.00000000 [omap-set-vals] v90'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5643c5d3ad80 con 0x5643c5236400 2023-12-19T18:00:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf1141840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/sixmegs pointing to 0x0x10000000001 2023-12-19T18:00:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf1141840 10 datascan.scan_links: updating inotable 2023-12-19T18:00:09.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:75 11.13 11:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c7800 con 0x5643c5392800 2023-12-19T18:00:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(75 mds0_inotable [read 0~34 out=34b] v0'0 uv6 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf1141840 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2023-12-19T18:00:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf1141840 10 mds.0.inotable: skip_inos now [0x10000000002~0xfffffffffe] 2023-12-19T18:00:09.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.696+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:76 11.13 11:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c53c7c00 con 0x5643c5392800 2023-12-19T18:00:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.700+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(76 mds0_inotable [writefull 0~34] v90'8 uv8 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392800 2023-12-19T18:00:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.700+0000 7f9cf1141840 10 datascan.scan_links: updating snaptable 2023-12-19T18:00:09.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:77 11.d 11:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x5643c5393800 con 0x5643c5392400 2023-12-19T18:00:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cef0fc700 1 -- 172.21.15.45:0/1628046566 <== osd.2 v2:172.21.15.45:6824/36285 17 ==== osd_op_reply(77 mds_snaptable [read 0~70 out=70b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5643c5d3ab40 con 0x5643c5392400 2023-12-19T18:00:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643c5236400 msgr2=0x5643c4fe8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5643c5236400 0x5643c4fe8b00 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643c5237400 msgr2=0x5643c4feac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5643c5237400 0x5643c4feac00 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643c5392400 msgr2=0x5643c5394b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5643c5392400 0x5643c5394b00 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643c5237800 msgr2=0x5643c5394580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5643c5237800 0x5643c5394580 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643c5393000 msgr2=0x5643c5396c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 reap_dead start 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5643c5393000 0x5643c5396c00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 reap_dead start 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643c5392800 msgr2=0x5643c5396100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5643c5392800 0x5643c5396100 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643c5393400 msgr2=0x5643c5395600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5643c5393400 0x5643c5395600 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643c5392c00 msgr2=0x5643c5395080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5643c5392c00 0x5643c5395080 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643c5392000 msgr2=0x5643c5394000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5643c5392000 0x5643c5394000 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x5643c52453e0 tx=0x5643c524fec0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236c00 msgr2=0x5643c4fea100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1628046566 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c5236c00 0x5643c4fea100 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x5643c52456e0 tx=0x5643c524ec00 comp rx=0 tx=0).stop 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cef8fd700 1 -- 172.21.15.45:0/1628046566 reap_dead start 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 shutdown_connections 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 >> 172.21.15.45:0/1628046566 conn(0x5643c4f42c00 msgr2=0x5643c5011800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 shutdown_connections 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1628046566 wait complete. 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 msgr2=0x5643c4fe9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 0x5643c4fe9080 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x5643c5051380 tx=0x5643c5d3cd80 comp rx=0 tx=0).stop 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 shutdown_connections 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5643c4f43000 0x5643c4fe9080 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5643c4f43400 0x5643c4fe9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 --2- 172.21.15.45:0/1580008008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5643c4f43800 0x5643c4fe9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 >> 172.21.15.45:0/1580008008 conn(0x5643c4f43c00 msgr2=0x5643c5011000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 shutdown_connections 2023-12-19T18:00:09.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.704+0000 7f9cf1141840 1 -- 172.21.15.45:0/1580008008 wait complete. 2023-12-19T18:00:09.721 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.186387, result: 2023-12-19T18:00:09.721 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-12-19T18:00:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.900+0000 7fee0769b700 1 Processor -- start 2023-12-19T18:00:09.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.900+0000 7fee0769b700 1 -- start start 2023-12-19T18:00:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee0769b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee0015ab50 0x7fee000ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee0769b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fee0006e0a0 0x7fee000cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee0769b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0006cbb0 con 0x7fee0015af30 2023-12-19T18:00:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee0769b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0006fa10 con 0x7fee0015ab50 2023-12-19T18:00:09.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee0769b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee0006fcf0 con 0x7fee0006e0a0 2023-12-19T18:00:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee05437700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee0015ab50 0x7fee000ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee04c36700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fee0015af30 0x7fee0015e8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38898/0 (socket says 172.21.15.45:38898) 2023-12-19T18:00:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee04c36700 1 -- 172.21.15.45:0/3104530721 learned_addr learned my addr 172.21.15.45:0/3104530721 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.904+0000 7fee05c38700 1 --2- 172.21.15.45:0/3104530721 >> v2:172.21.15.73:3300/0 conn(0x7fee0006e0a0 0x7fee000cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee05437700 1 -- 172.21.15.45:0/3104530721 >> v2:172.21.15.73:3300/0 conn(0x7fee0006e0a0 msgr2=0x7fee000cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee05437700 1 --2- 172.21.15.45:0/3104530721 >> v2:172.21.15.73:3300/0 conn(0x7fee0006e0a0 0x7fee000cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fedf7fff700 1 -- 172.21.15.45:0/3104530721 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289481938 0 0) 0x7fee0006cbb0 con 0x7fee0015af30 2023-12-19T18:00:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee05437700 1 -- 172.21.15.45:0/3104530721 >> v1:172.21.15.45:6789/0 conn(0x7fee0015af30 legacy=0x7fee0015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee05437700 1 -- 172.21.15.45:0/3104530721 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0006ffd0 con 0x7fee0015ab50 2023-12-19T18:00:09.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee05437700 1 --2- 172.21.15.45:0/3104530721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ccd70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fee000cf250 tx=0x7fedfc009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fa3697b8437b66c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fedf7fff700 1 -- 172.21.15.45:0/3104530721 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc011830 con 0x7fee0015ab50 2023-12-19T18:00:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fedf7fff700 1 -- 172.21.15.45:0/3104530721 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc011990 con 0x7fee0015ab50 2023-12-19T18:00:09.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fedf7fff700 1 -- 172.21.15.45:0/3104530721 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc011d20 con 0x7fee0015ab50 2023-12-19T18:00:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 -- 172.21.15.45:0/3104530721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 msgr2=0x7fee000ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 --2- 172.21.15.45:0/3104530721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ccd70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fee000cf250 tx=0x7fedfc009b30 comp rx=0 tx=0).stop 2023-12-19T18:00:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 -- 172.21.15.45:0/3104530721 shutdown_connections 2023-12-19T18:00:09.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 --2- 172.21.15.45:0/3104530721 >> v2:172.21.15.73:3300/0 conn(0x7fee0006e0a0 0x7fee000cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 --2- 172.21.15.45:0/3104530721 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ccd70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 -- 172.21.15.45:0/3104530721 >> 172.21.15.45:0/3104530721 conn(0x7fee000cba40 msgr2=0x7fee000ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 -- 172.21.15.45:0/3104530721 shutdown_connections 2023-12-19T18:00:09.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.908+0000 7fee0769b700 1 -- 172.21.15.45:0/3104530721 wait complete. 2023-12-19T18:00:09.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.912+0000 7fee0769b700 1 Processor -- start 2023-12-19T18:00:09.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.912+0000 7fee0769b700 1 -- start start 2023-12-19T18:00:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0006e0a0 0x7fee000c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0015af30 0x7fee001546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c3d60 con 0x7fee0015ab50 2023-12-19T18:00:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c4040 con 0x7fee0006e0a0 2023-12-19T18:00:09.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee000c4320 con 0x7fee0015af30 2023-12-19T18:00:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ad2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34700/0 (socket says 172.21.15.45:34700) 2023-12-19T18:00:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 -- 172.21.15.45:0/845948062 learned_addr learned my addr 172.21.15.45:0/845948062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:09.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee05437700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0006e0a0 0x7fee000c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee05c38700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0015af30 0x7fee001546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 -- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0015af30 msgr2=0x7fee001546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0015af30 0x7fee001546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 -- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0006e0a0 msgr2=0x7fee000c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0006e0a0 0x7fee000c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 -- 172.21.15.45:0/845948062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0094b0 con 0x7fee0015ab50 2023-12-19T18:00:09.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee04c36700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ad2a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c4b0 tx=0x7fedf000c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf0004ca0 con 0x7fee0015ab50 2023-12-19T18:00:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf0004e00 con 0x7fee0015ab50 2023-12-19T18:00:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00072d0 con 0x7fee0015ab50 2023-12-19T18:00:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.916+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee000c4600 con 0x7fee0015ab50 2023-12-19T18:00:09.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.920+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee00154c30 con 0x7fee0015ab50 2023-12-19T18:00:09.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.920+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee000c4b20 con 0x7fee0015ab50 2023-12-19T18:00:09.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.920+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fedf0007430 con 0x7fee0015ab50 2023-12-19T18:00:09.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.924+0000 7fedf5ffb700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fede4065ad0 0x7fede4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.924+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fedf0083100 con 0x7fee0015ab50 2023-12-19T18:00:09.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.924+0000 7fee05437700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fede4065ad0 0x7fede4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:09.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.924+0000 7fee05437700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fede4065ad0 0x7fede4067f90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0090b0 tx=0x7fedfc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:09.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:09.932+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fee000c4b20 con 0x7fee0015ab50 2023-12-19T18:00:10.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.168+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fee000c4b20 con 0x7fee0015ab50 2023-12-19T18:00:10.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.688+0000 7fedf5ffb700 1 -- 172.21.15.45:0/845948062 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 4:0 v64) v1 ==== 101+0+0 (secure 0 0 0) 0x7fee000c4b20 con 0x7fee0015ab50 2023-12-19T18:00:10.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fede4065ad0 msgr2=0x7fede4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:10.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fede4065ad0 0x7fede4067f90 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0090b0 tx=0x7fedfc008030 comp rx=0 tx=0).stop 2023-12-19T18:00:10.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 msgr2=0x7fee000ad2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:10.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ad2a0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7fedf000c4b0 tx=0x7fedf000c7c0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 shutdown_connections 2023-12-19T18:00:10.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fede4065ad0 0x7fede4067f90 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0015af30 0x7fee001546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0015ab50 0x7fee000ad2a0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 --2- 172.21.15.45:0/845948062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0006e0a0 0x7fee000c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 >> 172.21.15.45:0/845948062 conn(0x7fee000cba40 msgr2=0x7fee000c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:10.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 shutdown_connections 2023-12-19T18:00:10.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.692+0000 7fee0769b700 1 -- 172.21.15.45:0/845948062 wait complete. 2023-12-19T18:00:10.702 INFO:teuthology.orchestra.run.smithi045.stderr:repaired: restoring rank 4:0 2023-12-19T18:00:10.705 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:10.705+0000 7f1716fae700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T18:00:10.727 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T18:00:10.727 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T18:00:10.727 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T18:00:10.727 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:00:10.727 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T18:00:10.727 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T18:00:10.727 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T18:00:10.728 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:00:10.728 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T18:00:10.728 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T18:00:10.728 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T18:00:10.728 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:00:10.728 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T18:00:10.728 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T18:00:10.728 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T18:00:10.729 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:00:10.749 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T18:00:10.749 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T18:00:10.750 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T18:00:10.750 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T18:00:10.751 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T18:00:10.751 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T18:00:10.752 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T18:00:10.752 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T18:00:10.798 INFO:tasks.ceph.mds.a:Started 2023-12-19T18:00:10.799 DEBUG:teuthology.parallel:result is None 2023-12-19T18:00:10.799 INFO:tasks.ceph.mds.b:Started 2023-12-19T18:00:10.799 DEBUG:teuthology.parallel:result is None 2023-12-19T18:00:10.802 INFO:tasks.ceph.mds.d:Started 2023-12-19T18:00:10.803 DEBUG:teuthology.parallel:result is None 2023-12-19T18:00:10.804 INFO:tasks.ceph.mds.c:Started 2023-12-19T18:00:10.804 DEBUG:teuthology.parallel:result is None 2023-12-19T18:00:10.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:10.920 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T18:00:10.920 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T18:00:10.925 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T18:00:10.926 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:00:10.940 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:00:10.932+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:00:10.971 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:10.969+0000 7f446f675700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T18:00:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 Processor -- start 2023-12-19T18:00:10.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 -- start start 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd83415e450 0x7fd83406fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd8340af720 0x7fd8340afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8340b00c0 con 0x7fd834159a50 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd834070540 con 0x7fd8340af720 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8396e0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83406c760 con 0x7fd83415e450 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd8340af720 0x7fd8340afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd8340af720 0x7fd8340afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34734/0 (socket says 172.21.15.45:34734) 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 -- 172.21.15.45:0/1777628813 learned_addr learned my addr 172.21.15.45:0/1777628813 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:10.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8337fe700 1 --2- 172.21.15.45:0/1777628813 >> v2:172.21.15.73:3300/0 conn(0x7fd83415e450 0x7fd83406fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 -- 172.21.15.45:0/1777628813 >> v2:172.21.15.73:3300/0 conn(0x7fd83415e450 msgr2=0x7fd83406fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 --2- 172.21.15.45:0/1777628813 >> v2:172.21.15.73:3300/0 conn(0x7fd83415e450 0x7fd83406fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 -- 172.21.15.45:0/1777628813 >> v1:172.21.15.73:6789/0 conn(0x7fd834159a50 legacy=0x7fd8340c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:10.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 -- 172.21.15.45:0/1777628813 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83406ca40 con 0x7fd8340af720 2023-12-19T18:00:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd8337fe700 1 --2- 172.21.15.45:0/1777628813 >> v2:172.21.15.73:3300/0 conn(0x7fd83415e450 0x7fd83406fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.976+0000 7fd838edf700 1 --2- 172.21.15.45:0/1777628813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8340af720 0x7fd8340afb80 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd834071fc0 tx=0x7fd82c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f25b14deaa0de35 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd832ffd700 1 -- 172.21.15.45:0/1777628813 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00e070 con 0x7fd8340af720 2023-12-19T18:00:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd832ffd700 1 -- 172.21.15.45:0/1777628813 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c00b9c0 con 0x7fd8340af720 2023-12-19T18:00:10.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd832ffd700 1 -- 172.21.15.45:0/1777628813 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c00bd70 con 0x7fd8340af720 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 -- 172.21.15.45:0/1777628813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8340af720 msgr2=0x7fd8340afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1777628813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8340af720 0x7fd8340afb80 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fd834071fc0 tx=0x7fd82c00b330 comp rx=0 tx=0).stop 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 -- 172.21.15.45:0/1777628813 shutdown_connections 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1777628813 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd8340af720 0x7fd8340afb80 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1777628813 >> v2:172.21.15.73:3300/0 conn(0x7fd83415e450 0x7fd83406fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 -- 172.21.15.45:0/1777628813 >> 172.21.15.45:0/1777628813 conn(0x7fd8340cb900 msgr2=0x7fd8340b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 -- 172.21.15.45:0/1777628813 shutdown_connections 2023-12-19T18:00:10.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 -- 172.21.15.45:0/1777628813 wait complete. 2023-12-19T18:00:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.980+0000 7fd8396e0700 1 Processor -- start 2023-12-19T18:00:10.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 -- start start 2023-12-19T18:00:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd8340af720 0x7fd834151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd834159a50 0x7fd8340ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 0x7fd8340aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:10.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c5930 con 0x7fd83415e450 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c5bd0 con 0x7fd834159a50 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8396e0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8340c5eb0 con 0x7fd8340af720 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd833fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd8340af720 0x7fd834151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 0x7fd8340aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 0x7fd8340aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34750/0 (socket says 172.21.15.45:34750) 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd833fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd8340af720 0x7fd834151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:33780/0 (socket says 172.21.15.45:33780) 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 -- 172.21.15.45:0/1553110660 learned_addr learned my addr 172.21.15.45:0/1553110660 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd8337fe700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd834159a50 0x7fd8340ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:10.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 -- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd8340af720 msgr2=0x7fd834151f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd8340af720 0x7fd834151f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 -- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd834159a50 msgr2=0x7fd8340ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd834159a50 0x7fd8340ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:10.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 -- 172.21.15.45:0/1553110660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd82c009b30 con 0x7fd83415e450 2023-12-19T18:00:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.984+0000 7fd838edf700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 0x7fd8340aeea0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd83406aca0 tx=0x7fd82c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c004880 con 0x7fd83415e450 2023-12-19T18:00:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82c0099b0 con 0x7fd83415e450 2023-12-19T18:00:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8340c6190 con 0x7fd83415e450 2023-12-19T18:00:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82c01c680 con 0x7fd83415e450 2023-12-19T18:00:10.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8340c6990 con 0x7fd83415e450 2023-12-19T18:00:10.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8340c66b0 con 0x7fd83415e450 2023-12-19T18:00:10.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.988+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd82c01c7e0 con 0x7fd83415e450 2023-12-19T18:00:10.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.992+0000 7fd830ff9700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd820065ad0 0x7fd820067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:10.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.992+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd82c084ad0 con 0x7fd83415e450 2023-12-19T18:00:10.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.992+0000 7fd833fff700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd820065ad0 0x7fd820067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:10.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.992+0000 7fd833fff700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd820065ad0 0x7fd820067f90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd824000f60 tx=0x7fd824009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:11.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:10.996+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd8340c66b0 con 0x7fd83415e450 2023-12-19T18:00:11.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.204+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8340c66b0 con 0x7fd83415e450 2023-12-19T18:00:11.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.204+0000 7fd830ff9700 1 -- 172.21.15.45:0/1553110660 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4715 (secure 0 0 0) 0x7fd8340c66b0 con 0x7fd83415e450 2023-12-19T18:00:11.212 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:11.212 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":67,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7051,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1215291836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1215291836},{"type":"v1","addr":"172.21.15.73:6833","nonce":1215291836}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:10.950082+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:11.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd820065ad0 msgr2=0x7fd820067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:11.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd820065ad0 0x7fd820067f90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fd824000f60 tx=0x7fd824009040 comp rx=0 tx=0).stop 2023-12-19T18:00:11.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 msgr2=0x7fd8340aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:11.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 0x7fd8340aeea0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fd83406aca0 tx=0x7fd82c004af0 comp rx=0 tx=0).stop 2023-12-19T18:00:11.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 shutdown_connections 2023-12-19T18:00:11.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd820065ad0 0x7fd820067f90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd83415e450 0x7fd8340aeea0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd834159a50 0x7fd8340ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 --2- 172.21.15.45:0/1553110660 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd8340af720 0x7fd834151f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 >> 172.21.15.45:0/1553110660 conn(0x7fd8340cb900 msgr2=0x7fd8340c46e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 shutdown_connections 2023-12-19T18:00:11.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:11.208+0000 7fd8396e0700 1 -- 172.21.15.45:0/1553110660 wait complete. 2023-12-19T18:00:11.217 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 67 2023-12-19T18:00:11.639 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:00:05.116228+0000', 'modified': '2023-12-19T18:00:10.950082+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7707': {'gid': 7707, 'name': 'b', 'rank': 0, 'incarnation': 67, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.73:6835/3311981467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6833', 'nonce': 3311981467}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3311981467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12, 13], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:00:11.639 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7707:up:replay 2023-12-19T18:00:12.640 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:12.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 Processor -- start 2023-12-19T18:00:12.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 -- start start 2023-12-19T18:00:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6806ea90 0x7fda680d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda680b88b0 0x7fda680b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda680b6df0 con 0x7fda680b6250 2023-12-19T18:00:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda680d1820 con 0x7fda680b88b0 2023-12-19T18:00:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda6d4d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680d1b00 con 0x7fda6806ea90 2023-12-19T18:00:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.820+0000 7fda677fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda680b88b0 0x7fda680b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fda680b88b0 0x7fda680b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34762/0 (socket says 172.21.15.45:34762) 2023-12-19T18:00:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 -- 172.21.15.45:0/1122135195 learned_addr learned my addr 172.21.15.45:0/1122135195 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:12.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda67fff700 1 --2- 172.21.15.45:0/1122135195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6806ea90 0x7fda680d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 -- 172.21.15.45:0/1122135195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6806ea90 msgr2=0x7fda680d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 --2- 172.21.15.45:0/1122135195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6806ea90 0x7fda680d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 -- 172.21.15.45:0/1122135195 >> v1:172.21.15.45:6789/0 conn(0x7fda680b6250 legacy=0x7fda680b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:12.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 -- 172.21.15.45:0/1122135195 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda680d1de0 con 0x7fda680b88b0 2023-12-19T18:00:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda677fe700 1 --2- 172.21.15.45:0/1122135195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680b88b0 0x7fda680b5d10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fda58009910 tx=0x7fda58009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d48776fcc10f46a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda66ffd700 1 -- 172.21.15.45:0/1122135195 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58011830 con 0x7fda680b88b0 2023-12-19T18:00:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda66ffd700 1 -- 172.21.15.45:0/1122135195 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda58011990 con 0x7fda680b88b0 2023-12-19T18:00:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda66ffd700 1 -- 172.21.15.45:0/1122135195 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda58011d40 con 0x7fda680b88b0 2023-12-19T18:00:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 -- 172.21.15.45:0/1122135195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680b88b0 msgr2=0x7fda680b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/1122135195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680b88b0 0x7fda680b5d10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fda58009910 tx=0x7fda58009c20 comp rx=0 tx=0).stop 2023-12-19T18:00:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 -- 172.21.15.45:0/1122135195 shutdown_connections 2023-12-19T18:00:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/1122135195 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda680b88b0 0x7fda680b5d10 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/1122135195 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda6806ea90 0x7fda680d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 -- 172.21.15.45:0/1122135195 >> 172.21.15.45:0/1122135195 conn(0x7fda680b46d0 msgr2=0x7fda680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 -- 172.21.15.45:0/1122135195 shutdown_connections 2023-12-19T18:00:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.824+0000 7fda6d4d3700 1 -- 172.21.15.45:0/1122135195 wait complete. 2023-12-19T18:00:12.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 Processor -- start 2023-12-19T18:00:12.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 -- start start 2023-12-19T18:00:12.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 0x7fda680abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda680b6250 0x7fda680c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda680b88b0 0x7fda680c8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680caea0 con 0x7fda6806ea90 2023-12-19T18:00:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda680cb180 con 0x7fda680b6250 2023-12-19T18:00:12.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6d4d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda680cb460 con 0x7fda680b88b0 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 0x7fda680abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 0x7fda680abf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34770/0 (socket says 172.21.15.45:34770) 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 -- 172.21.15.45:0/2642009639 learned_addr learned my addr 172.21.15.45:0/2642009639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda6ccd2700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda680b88b0 0x7fda680c8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda677fe700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda680b6250 0x7fda680c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 -- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda680b88b0 msgr2=0x7fda680c8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda680b88b0 0x7fda680c8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 -- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda680b6250 msgr2=0x7fda680c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:12.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda680b6250 0x7fda680c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.828+0000 7fda67fff700 1 -- 172.21.15.45:0/2642009639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda58009570 con 0x7fda6806ea90 2023-12-19T18:00:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda67fff700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 0x7fda680abf30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fda6000efc0 tx=0x7fda6000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda6000cb50 con 0x7fda6806ea90 2023-12-19T18:00:12.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda6000f040 con 0x7fda6806ea90 2023-12-19T18:00:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda680cb740 con 0x7fda6806ea90 2023-12-19T18:00:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda60014480 con 0x7fda6806ea90 2023-12-19T18:00:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda680ac470 con 0x7fda6806ea90 2023-12-19T18:00:12.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.832+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda68067760 con 0x7fda6806ea90 2023-12-19T18:00:12.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.836+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fda600145e0 con 0x7fda6806ea90 2023-12-19T18:00:12.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.836+0000 7fda64ff9700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda48065b00 0x7fda48067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:12.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.836+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fda60083d30 con 0x7fda6806ea90 2023-12-19T18:00:12.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.836+0000 7fda677fe700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda48065b00 0x7fda48067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:12.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.836+0000 7fda677fe700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda48065b00 0x7fda48067fc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fda58000c00 tx=0x7fda58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:12.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:12.844+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fda60051320 con 0x7fda6806ea90 2023-12-19T18:00:13.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.056+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda680ab7b0 con 0x7fda6806ea90 2023-12-19T18:00:13.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda64ff9700 1 -- 172.21.15.45:0/2642009639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fda60018090 con 0x7fda6806ea90 2023-12-19T18:00:13.064 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:13.065 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":69,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:12.966908+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:13.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda48065b00 msgr2=0x7fda48067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda48065b00 0x7fda48067fc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fda58000c00 tx=0x7fda58008030 comp rx=0 tx=0).stop 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 msgr2=0x7fda680abf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 0x7fda680abf30 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fda6000efc0 tx=0x7fda6000c0c0 comp rx=0 tx=0).stop 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 shutdown_connections 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fda48065b00 0x7fda48067fc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fda680b88b0 0x7fda680c8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fda680b6250 0x7fda680c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 --2- 172.21.15.45:0/2642009639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fda6806ea90 0x7fda680abf30 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:13.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.060+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 >> 172.21.15.45:0/2642009639 conn(0x7fda680b46d0 msgr2=0x7fda680c5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:13.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.064+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 shutdown_connections 2023-12-19T18:00:13.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:13.064+0000 7fda6d4d3700 1 -- 172.21.15.45:0/2642009639 wait complete. 2023-12-19T18:00:13.071 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 69 2023-12-19T18:00:13.493 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 69, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:00:05.116228+0000', 'modified': '2023-12-19T18:00:12.966908+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7707': {'gid': 7707, 'name': 'b', 'rank': 0, 'incarnation': 67, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.73:6835/3311981467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6833', 'nonce': 3311981467}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3311981467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12, 13], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:00:13.493 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7707:up:rejoin 2023-12-19T18:00:14.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.672+0000 7f3b5dd51700 1 Processor -- start 2023-12-19T18:00:14.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.672+0000 7f3b5dd51700 1 -- start start 2023-12-19T18:00:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b5dd51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b580b88b0 0x7f3b5806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b5dd51700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580d1820 con 0x7f3b5806ea90 2023-12-19T18:00:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b5dd51700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b580d1b00 con 0x7f3b5806f3b0 2023-12-19T18:00:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b5dd51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580d1630 con 0x7f3b580b88b0 2023-12-19T18:00:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b5cd4f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b5806ea90 0x7f3b580d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38908/0 (socket says 172.21.15.45:38908) 2023-12-19T18:00:14.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b5cd4f700 1 -- 172.21.15.45:0/21050050 learned_addr learned my addr 172.21.15.45:0/21050050 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b57fff700 1 --2- 172.21.15.45:0/21050050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b580b88b0 0x7f3b5806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b577fe700 1 -- 172.21.15.45:0/21050050 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1619437733 0 0) 0x7f3b580d1820 con 0x7f3b5806ea90 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b577fe700 1 -- 172.21.15.45:0/21050050 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b480035d0 con 0x7f3b5806ea90 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b577fe700 1 -- 172.21.15.45:0/21050050 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4288625165 0 0) 0x7f3b580d1b00 con 0x7f3b5806f3b0 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b57fff700 1 -- 172.21.15.45:0/21050050 >> v1:172.21.15.73:6789/0 conn(0x7f3b5806f3b0 legacy=0x7f3b5806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b57fff700 1 -- 172.21.15.45:0/21050050 >> v1:172.21.15.45:6789/0 conn(0x7f3b5806ea90 legacy=0x7f3b580d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b57fff700 1 -- 172.21.15.45:0/21050050 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580d1de0 con 0x7f3b580b88b0 2023-12-19T18:00:14.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.676+0000 7f3b57fff700 1 --2- 172.21.15.45:0/21050050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b580b88b0 0x7f3b5806ee70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009880 tx=0x7f3b44009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8366904df77ff2e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b577fe700 1 -- 172.21.15.45:0/21050050 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011830 con 0x7f3b580b88b0 2023-12-19T18:00:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b577fe700 1 -- 172.21.15.45:0/21050050 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44011990 con 0x7f3b580b88b0 2023-12-19T18:00:14.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b577fe700 1 -- 172.21.15.45:0/21050050 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44011d20 con 0x7f3b580b88b0 2023-12-19T18:00:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 -- 172.21.15.45:0/21050050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b580b88b0 msgr2=0x7f3b5806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/21050050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b580b88b0 0x7f3b5806ee70 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3b44009880 tx=0x7f3b44009b90 comp rx=0 tx=0).stop 2023-12-19T18:00:14.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 -- 172.21.15.45:0/21050050 shutdown_connections 2023-12-19T18:00:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/21050050 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b580b88b0 0x7f3b5806ee70 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 -- 172.21.15.45:0/21050050 >> 172.21.15.45:0/21050050 conn(0x7f3b580b46d0 msgr2=0x7f3b580b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 -- 172.21.15.45:0/21050050 shutdown_connections 2023-12-19T18:00:14.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.680+0000 7f3b5dd51700 1 -- 172.21.15.45:0/21050050 wait complete. 2023-12-19T18:00:14.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 Processor -- start 2023-12-19T18:00:14.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 -- start start 2023-12-19T18:00:14.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b5806ea90 0x7f3b581f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:14.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 0x7f3b580c9030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b580b88b0 0x7f3b580cb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581f63e0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581f21a0 con 0x7f3b580b88b0 2023-12-19T18:00:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b5dd51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581f1e90 con 0x7f3b5806ea90 2023-12-19T18:00:14.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.684+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 0x7f3b580c9030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 0x7f3b580c9030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34780/0 (socket says 172.21.15.45:34780) 2023-12-19T18:00:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 -- 172.21.15.45:0/598803539 learned_addr learned my addr 172.21.15.45:0/598803539 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b5cd4f700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b5806ea90 0x7f3b581f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:14.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b5d550700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b580b88b0 0x7f3b580cb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 -- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b5806ea90 msgr2=0x7f3b581f5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b5806ea90 0x7f3b581f5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 -- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b580b88b0 msgr2=0x7f3b580cb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b580b88b0 0x7f3b580cb1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 -- 172.21.15.45:0/598803539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440094b0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b5d550700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b580b88b0 0x7f3b580cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b57fff700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 0x7f3b580c9030 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3b44013040 tx=0x7f3b44004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44019950 con 0x7f3b5806f3b0 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4401e070 con 0x7f3b5806f3b0 2023-12-19T18:00:14.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580c9570 con 0x7f3b5806f3b0 2023-12-19T18:00:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44019cd0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b581f5e20 con 0x7f3b5806f3b0 2023-12-19T18:00:14.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.688+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b581f22e0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.692+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b4402d450 con 0x7f3b5806f3b0 2023-12-19T18:00:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.692+0000 7f3b557fa700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b3c065ad0 0x7f3b3c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.692+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f3b44084540 con 0x7f3b5806f3b0 2023-12-19T18:00:14.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.692+0000 7f3b5cd4f700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b3c065ad0 0x7f3b3c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:14.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.696+0000 7f3b5cd4f700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b3c065ad0 0x7f3b3c067f90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c007fd0 tx=0x7f3b4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:14.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.700+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3b581f22e0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.912+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b581f22e0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.912+0000 7f3b557fa700 1 -- 172.21.15.45:0/598803539 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f3b581f22e0 con 0x7f3b5806f3b0 2023-12-19T18:00:14.920 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:14.920 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:13.982153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b3c065ad0 msgr2=0x7f3b3c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b3c065ad0 0x7f3b3c067f90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c007fd0 tx=0x7f3b4c009040 comp rx=0 tx=0).stop 2023-12-19T18:00:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 msgr2=0x7f3b580c9030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:14.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 0x7f3b580c9030 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f3b44013040 tx=0x7f3b44004770 comp rx=0 tx=0).stop 2023-12-19T18:00:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 shutdown_connections 2023-12-19T18:00:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b3c065ad0 0x7f3b3c067f90 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b580b88b0 0x7f3b580cb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b5806f3b0 0x7f3b580c9030 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 --2- 172.21.15.45:0/598803539 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b5806ea90 0x7f3b581f5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:14.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 >> 172.21.15.45:0/598803539 conn(0x7f3b580b46d0 msgr2=0x7f3b580715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:14.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 shutdown_connections 2023-12-19T18:00:14.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:14.916+0000 7f3b5dd51700 1 -- 172.21.15.45:0/598803539 wait complete. 2023-12-19T18:00:14.926 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 70 2023-12-19T18:00:15.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:00:05.116228+0000', 'modified': '2023-12-19T18:00:13.982153+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 92, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7707}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7707': {'gid': 7707, 'name': 'b', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6835/3311981467', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6833', 'nonce': 3311981467}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 3311981467}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [12, 13], 'metadata_pool': 11, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:00:15.350 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:00:15.350 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T18:00:15.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.528+0000 7f68dcb51700 1 Processor -- start 2023-12-19T18:00:15.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.528+0000 7f68dcb51700 1 -- start start 2023-12-19T18:00:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68dcb51700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f68d806ea90 0x7f68d80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68dcb51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806fe80 0x7f68d80b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68dcb51700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d80d1820 con 0x7f68d80b88b0 2023-12-19T18:00:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68dcb51700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d80d1b00 con 0x7f68d806ea90 2023-12-19T18:00:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68dcb51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d80d1de0 con 0x7f68d806fe80 2023-12-19T18:00:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68cffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68d80b88b0 0x7f68d80b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:38912/0 (socket says 172.21.15.45:38912) 2023-12-19T18:00:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68cffff700 1 -- 172.21.15.45:0/2699602347 learned_addr learned my addr 172.21.15.45:0/2699602347 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d77fe700 1 --2- 172.21.15.45:0/2699602347 >> v2:172.21.15.45:3300/0 conn(0x7f68d806ea90 0x7f68d80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d7fff700 1 --2- 172.21.15.45:0/2699602347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806fe80 0x7f68d80b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d6ffd700 1 -- 172.21.15.45:0/2699602347 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3594150364 0 0) 0x7f68d80d1820 con 0x7f68d80b88b0 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d6ffd700 1 -- 172.21.15.45:0/2699602347 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68c40035d0 con 0x7f68d80b88b0 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d77fe700 1 -- 172.21.15.45:0/2699602347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806fe80 msgr2=0x7f68d80b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d77fe700 1 --2- 172.21.15.45:0/2699602347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806fe80 0x7f68d80b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d77fe700 1 -- 172.21.15.45:0/2699602347 >> v1:172.21.15.45:6789/0 conn(0x7f68d80b88b0 legacy=0x7f68d80b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.532+0000 7f68d77fe700 1 -- 172.21.15.45:0/2699602347 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d80d20c0 con 0x7f68d806ea90 2023-12-19T18:00:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68d77fe700 1 --2- 172.21.15.45:0/2699602347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806ea90 0x7f68d80d0f20 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009850 tx=0x7f68c8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8251701dd7ebd23e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68d6ffd700 1 -- 172.21.15.45:0/2699602347 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8011830 con 0x7f68d806ea90 2023-12-19T18:00:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68d6ffd700 1 -- 172.21.15.45:0/2699602347 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c8011990 con 0x7f68d806ea90 2023-12-19T18:00:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68d6ffd700 1 -- 172.21.15.45:0/2699602347 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8011d40 con 0x7f68d806ea90 2023-12-19T18:00:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 -- 172.21.15.45:0/2699602347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806ea90 msgr2=0x7f68d80d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 --2- 172.21.15.45:0/2699602347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806ea90 0x7f68d80d0f20 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f68c8009850 tx=0x7f68c8009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 -- 172.21.15.45:0/2699602347 shutdown_connections 2023-12-19T18:00:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 --2- 172.21.15.45:0/2699602347 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806fe80 0x7f68d80b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 --2- 172.21.15.45:0/2699602347 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806ea90 0x7f68d80d0f20 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 -- 172.21.15.45:0/2699602347 >> 172.21.15.45:0/2699602347 conn(0x7f68d80b46d0 msgr2=0x7f68d80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 -- 172.21.15.45:0/2699602347 shutdown_connections 2023-12-19T18:00:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.536+0000 7f68dcb51700 1 -- 172.21.15.45:0/2699602347 wait complete. 2023-12-19T18:00:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 Processor -- start 2023-12-19T18:00:15.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 -- start start 2023-12-19T18:00:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806ea90 0x7f68d80ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 0x7f68d814c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d80b88b0 0x7f68d80c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814d0e0 con 0x7f68d806fe80 2023-12-19T18:00:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814d3c0 con 0x7f68d80b88b0 2023-12-19T18:00:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68dcb51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d814d6a0 con 0x7f68d806ea90 2023-12-19T18:00:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 0x7f68d814c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 0x7f68d814c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34794/0 (socket says 172.21.15.45:34794) 2023-12-19T18:00:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68cffff700 1 -- 172.21.15.45:0/1421974817 learned_addr learned my addr 172.21.15.45:0/1421974817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68d77fe700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806ea90 0x7f68d80ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.540+0000 7f68d7fff700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d80b88b0 0x7f68d80c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68cffff700 1 -- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806ea90 msgr2=0x7f68d80ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68cffff700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806ea90 0x7f68d80ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68cffff700 1 -- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d80b88b0 msgr2=0x7f68d80c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68cffff700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d80b88b0 0x7f68d80c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68cffff700 1 -- 172.21.15.45:0/1421974817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c80094b0 con 0x7f68d806fe80 2023-12-19T18:00:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68cffff700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 0x7f68d814c780 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c700 tx=0x7f68c000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68d4ff9700 1 -- 172.21.15.45:0/1421974817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0005d90 con 0x7f68d806fe80 2023-12-19T18:00:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68d4ff9700 1 -- 172.21.15.45:0/1421974817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c00070d0 con 0x7f68d806fe80 2023-12-19T18:00:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68d4ff9700 1 -- 172.21.15.45:0/1421974817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c0007480 con 0x7f68d806fe80 2023-12-19T18:00:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68d814d980 con 0x7f68d806fe80 2023-12-19T18:00:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.544+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d814ccc0 con 0x7f68d806fe80 2023-12-19T18:00:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.548+0000 7f68d4ff9700 1 -- 172.21.15.45:0/1421974817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f68c00075e0 con 0x7f68d806fe80 2023-12-19T18:00:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.548+0000 7f68d4ff9700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f68b8065ad0 0x7f68b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.548+0000 7f68d4ff9700 1 -- 172.21.15.45:0/1421974817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f68c00829e0 con 0x7f68d806fe80 2023-12-19T18:00:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.548+0000 7f68d77fe700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f68b8065ad0 0x7f68b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.548+0000 7f68d77fe700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f68b8065ad0 0x7f68b8067f90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f68c80090b0 tx=0x7f68c801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 Processor -- start 2023-12-19T18:00:15.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 -- start start 2023-12-19T18:00:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x20d8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2123290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x20d68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x204a5b0 con 0x21237d0 2023-12-19T18:00:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2047d40 con 0x2122eb0 2023-12-19T18:00:15.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2043630 con 0x2101430 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x20d68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x20d68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34802/0 (socket says 172.21.15.45:34802) 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 -- 172.21.15.45:0/3265430480 learned_addr learned my addr 172.21.15.45:0/3265430480 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68cffff700 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2123290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d77fe700 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x20d8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 -- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 msgr2=0x2123290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2123290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 -- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 msgr2=0x20d8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x20d8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 -- 172.21.15.45:0/3265430480 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1eb6960 con 0x21237d0 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68d7fff700 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x20d68c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f68d0011580 tx=0x7f68d0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65650db60567a2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68cd7fa700 1 -- 172.21.15.45:0/3265430480 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000e040 con 0x21237d0 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68cd7fa700 1 -- 172.21.15.45:0/3265430480 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000f040 con 0x21237d0 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.552+0000 7f68cd7fa700 1 -- 172.21.15.45:0/3265430480 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0015830 con 0x21237d0 2023-12-19T18:00:15.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 -- 172.21.15.45:0/3265430480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 msgr2=0x20d68c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x20d68c0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f68d0011580 tx=0x7f68d0009750 comp rx=0 tx=0).stop 2023-12-19T18:00:15.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 -- 172.21.15.45:0/3265430480 shutdown_connections 2023-12-19T18:00:15.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x20d68c0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2123290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 --2- 172.21.15.45:0/3265430480 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x20d8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 -- 172.21.15.45:0/3265430480 >> 172.21.15.45:0/3265430480 conn(0x1e6b4d0 msgr2=0x20dcd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 -- 172.21.15.45:0/3265430480 shutdown_connections 2023-12-19T18:00:15.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 -- 172.21.15.45:0/3265430480 wait complete. 2023-12-19T18:00:15.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 -- start start 2023-12-19T18:00:15.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.556+0000 7f68e1044740 1 Processor -- start 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 0x21046d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2122eb0 0x21217a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21237d0 0x2121ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2000c80 con 0x2101430 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2006b00 con 0x21237d0 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1eefaa0 con 0x2122eb0 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 10 client.0 _ll_register_callbacks cb 0x203cf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 0x21046d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 0x21046d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34810/0 (socket says 172.21.15.45:34810) 2023-12-19T18:00:15.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 -- 172.21.15.45:0/2936485246 learned_addr learned my addr 172.21.15.45:0/2936485246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68cffff700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2122eb0 0x21217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d7fff700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21237d0 0x2121ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 -- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2122eb0 msgr2=0x21217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2122eb0 0x21217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 -- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21237d0 msgr2=0x2121ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21237d0 0x2121ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 -- 172.21.15.45:0/2936485246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d0011230 con 0x2101430 2023-12-19T18:00:15.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d7fff700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21237d0 0x2121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:15.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68d77fe700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 0x21046d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f68d8072a40 tx=0x7f68c800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0be59dadf037abb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68b67fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:15.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68b67fc700 1 -- 172.21.15.45:0/2936485246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c8003cb0 con 0x2101430 2023-12-19T18:00:15.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68b67fc700 1 -- 172.21.15.45:0/2936485246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f68c801f070 con 0x2101430 2023-12-19T18:00:15.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x203c6b0 con 0x2101430 2023-12-19T18:00:15.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68b67fc700 1 -- 172.21.15.45:0/2936485246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68c8003e10 con 0x2101430 2023-12-19T18:00:15.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 10 client.7743 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:15.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.560+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x2009770 con 0x2101430 2023-12-19T18:00:15.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68b67fc700 1 -- 172.21.15.45:0/2936485246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x203c6b0 con 0x2101430 2023-12-19T18:00:15.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68b67fc700 1 -- 172.21.15.45:0/2936485246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f68c8038350 con 0x2101430 2023-12-19T18:00:15.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68e1044740 10 client.7743 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:15.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68e1044740 10 client.7743 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:00:15.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68e1044740 20 client.7743 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:15.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68e1044740 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20d9870 0x2136c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68e1044740 4 client.7743 mds_command: new command op to 7707 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:00:15.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1ffea00 con 0x20d9870 2023-12-19T18:00:15.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68cffff700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20d9870 0x2136c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68cffff700 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20d9870 0x2136c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=455b0d49a422106 server_cookie=5f7cc7ae74416c7c in_seq=0 out_seq=0 2023-12-19T18:00:15.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68b67fc700 10 client.7743 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:15.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68b67fc700 1 -- 172.21.15.45:0/2936485246 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1ffea00 con 0x20d9870 2023-12-19T18:00:15.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.564+0000 7f68b67fc700 10 client.7743 handle_command_reply: tid=0 2023-12-19T18:00:15.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 client.7743 shutdown 2023-12-19T18:00:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 msgr2=0x21046d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 0x21046d0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f68d8072a40 tx=0x7f68c800e000 comp rx=0 tx=0).stop 2023-12-19T18:00:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 shutdown_connections 2023-12-19T18:00:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20d9870 0x2136c00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x21237d0 0x2121ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2122eb0 0x21217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 --2- 172.21.15.45:0/2936485246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2101430 0x21046d0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 >> 172.21.15.45:0/2936485246 conn(0x1e6b4d0 msgr2=0x20ffe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68b67fc700 0 client.7743 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 shutdown_connections 2023-12-19T18:00:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 1 -- 172.21.15.45:0/2936485246 wait complete. 2023-12-19T18:00:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.568+0000 7f68e1044740 20 client.7743 trim_cache size 0 max 16384 2023-12-19T18:00:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.588+0000 7f68e1044740 1 Processor -- start 2023-12-19T18:00:15.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.588+0000 7f68e1044740 1 -- start start 2023-12-19T18:00:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2132f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x21334a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x21213f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2012ce0 con 0x21237d0 2023-12-19T18:00:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x20d1c50 con 0x2122eb0 2023-12-19T18:00:15.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2043ee0 con 0x2101430 2023-12-19T18:00:15.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x21213f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x21213f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34822/0 (socket says 172.21.15.45:34822) 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 -- 172.21.15.45:0/3964935351 learned_addr learned my addr 172.21.15.45:0/3964935351 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68cffff700 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x21334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d77fe700 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2132f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 -- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 msgr2=0x2132f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2132f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 -- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 msgr2=0x21334a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x21334a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 -- 172.21.15.45:0/3964935351 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1fef9a0 con 0x21237d0 2023-12-19T18:00:15.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68cffff700 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x21334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68d7fff700 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x21213f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f68d0019000 tx=0x7f68d0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337726ff5966bc72 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68cdffb700 1 -- 172.21.15.45:0/3964935351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d000e050 con 0x21237d0 2023-12-19T18:00:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68cdffb700 1 -- 172.21.15.45:0/3964935351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d0003c40 con 0x21237d0 2023-12-19T18:00:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68cdffb700 1 -- 172.21.15.45:0/3964935351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68d0009840 con 0x21237d0 2023-12-19T18:00:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 -- 172.21.15.45:0/3964935351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 msgr2=0x21213f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.592+0000 7f68e1044740 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x21213f0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f68d0019000 tx=0x7f68d0016000 comp rx=0 tx=0).stop 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- 172.21.15.45:0/3964935351 shutdown_connections 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x21237d0 0x21213f0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2122eb0 0x21334a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 --2- 172.21.15.45:0/3964935351 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2101430 0x2132f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- 172.21.15.45:0/3964935351 >> 172.21.15.45:0/3964935351 conn(0x1e6b4d0 msgr2=0x2132660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- 172.21.15.45:0/3964935351 shutdown_connections 2023-12-19T18:00:15.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- 172.21.15.45:0/3964935351 wait complete. 2023-12-19T18:00:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- start start 2023-12-19T18:00:15.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 Processor -- start 2023-12-19T18:00:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2101430 0x2188450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 0x2125b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21237d0 0x2126060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x20eb310 con 0x2122eb0 2023-12-19T18:00:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x213b2a0 con 0x2101430 2023-12-19T18:00:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x20eb070 con 0x21237d0 2023-12-19T18:00:15.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68e1044740 10 client.0 _ll_register_callbacks cb 0x1f7ce10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 0x2125b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68cffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 0x2125b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34828/0 (socket says 172.21.15.45:34828) 2023-12-19T18:00:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68cffff700 1 -- 172.21.15.45:0/135664306 learned_addr learned my addr 172.21.15.45:0/135664306 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.596+0000 7f68d77fe700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2101430 0x2188450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68d7fff700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21237d0 0x2126060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68cffff700 1 -- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21237d0 msgr2=0x2126060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68cffff700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21237d0 0x2126060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68cffff700 1 -- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2101430 msgr2=0x2188450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68cffff700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2101430 0x2188450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68cffff700 1 -- 172.21.15.45:0/135664306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1eb6960 con 0x2122eb0 2023-12-19T18:00:15.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68d7fff700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21237d0 0x2126060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68cffff700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 0x2125b20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f68c0056010 tx=0x7f68c000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d78827f0f9f125e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68b67fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68b67fc700 1 -- 172.21.15.45:0/135664306 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c006b1d0 con 0x2122eb0 2023-12-19T18:00:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68d000f040 con 0x2122eb0 2023-12-19T18:00:15.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68b67fc700 1 -- 172.21.15.45:0/135664306 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f68c0053be0 con 0x2122eb0 2023-12-19T18:00:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68b67fc700 1 -- 172.21.15.45:0/135664306 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68c0057a10 con 0x2122eb0 2023-12-19T18:00:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 10 client.7749 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:15.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1fe3c70 con 0x2122eb0 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68b67fc700 1 -- 172.21.15.45:0/135664306 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68d000f040 con 0x2122eb0 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68b67fc700 1 -- 172.21.15.45:0/135664306 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f68c00530d0 con 0x2122eb0 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 10 client.7749 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 10 client.7749 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 20 client.7749 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20dbdf0 0x20dc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 4 client.7749 mds_command: new command op to 7707 tid=0[{"prefix": "status"}] 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "status"}) v1 -- 0x1ec2460 con 0x20dbdf0 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.600+0000 7f68d77fe700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20dbdf0 0x20dc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68b67fc700 10 client.7749 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:15.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68d77fe700 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20dbdf0 0x20dc1d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a6ee26661f92ec server_cookie=fe41f5b0bfce6f1b in_seq=0 out_seq=0 2023-12-19T18:00:15.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68b67fc700 1 -- 172.21.15.45:0/135664306 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x1ec2460 con 0x20dbdf0 2023-12-19T18:00:15.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68b67fc700 10 client.7749 handle_command_reply: tid=0 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 client.7749 shutdown 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 msgr2=0x2125b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 0x2125b20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f68c0056010 tx=0x7f68c000cf90 comp rx=0 tx=0).stop 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 shutdown_connections 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x20dbdf0 0x20dc1d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x21237d0 0x2126060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2122eb0 0x2125b20 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68b67fc700 0 client.7749 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 --2- 172.21.15.45:0/135664306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2101430 0x2188450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 >> 172.21.15.45:0/135664306 conn(0x1e6b4d0 msgr2=0x20ea170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 shutdown_connections 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 1 -- 172.21.15.45:0/135664306 wait complete. 2023-12-19T18:00:15.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68e1044740 20 client.7749 trim_cache size 0 max 16384 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7707, 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.645069908, 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 70, 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 94, 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 94, 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 4.6783403440000004 2023-12-19T18:00:15.612 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:15.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f68b8065ad0 msgr2=0x7f68b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f68b8065ad0 0x7f68b8067f90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f68c80090b0 tx=0x7f68c801c040 comp rx=0 tx=0).stop 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 msgr2=0x7f68d814c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 0x7f68d814c780 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f68c000c700 tx=0x7f68c000ca10 comp rx=0 tx=0).stop 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 shutdown_connections 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f68b8065ad0 0x7f68b8067f90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f68d80b88b0 0x7f68d80c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68d806fe80 0x7f68d814c780 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 --2- 172.21.15.45:0/1421974817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68d806ea90 0x7f68d80ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 >> 172.21.15.45:0/1421974817 conn(0x7f68d80b46d0 msgr2=0x7f68d80b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 shutdown_connections 2023-12-19T18:00:15.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.604+0000 7f68dcb51700 1 -- 172.21.15.45:0/1421974817 wait complete. 2023-12-19T18:00:15.634 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:15.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.812+0000 7fc95409b700 1 Processor -- start 2023-12-19T18:00:15.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.816+0000 7fc95409b700 1 -- start start 2023-12-19T18:00:15.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.816+0000 7fc95409b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc94c164690 0x7fc94c0c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc94c164a70 0x7fc94c0c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc94c0cdb80 con 0x7fc94c0cce30 2023-12-19T18:00:15.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0cd970 con 0x7fc94c164a70 2023-12-19T18:00:15.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc94c0cde60 con 0x7fc94c164690 2023-12-19T18:00:15.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc94c164a70 0x7fc94c0c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc94c164a70 0x7fc94c0c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34838/0 (socket says 172.21.15.45:34838) 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 -- 172.21.15.45:0/2355318984 learned_addr learned my addr 172.21.15.45:0/2355318984 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951e37700 1 --2- 172.21.15.45:0/2355318984 >> v2:172.21.15.73:3300/0 conn(0x7fc94c164690 0x7fc94c0c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 -- 172.21.15.45:0/2355318984 >> v2:172.21.15.73:3300/0 conn(0x7fc94c164690 msgr2=0x7fc94c0c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 --2- 172.21.15.45:0/2355318984 >> v2:172.21.15.73:3300/0 conn(0x7fc94c164690 0x7fc94c0c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 -- 172.21.15.45:0/2355318984 >> v1:172.21.15.73:6789/0 conn(0x7fc94c0cce30 legacy=0x7fc94c0cd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 -- 172.21.15.45:0/2355318984 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc94c0ce140 con 0x7fc94c164a70 2023-12-19T18:00:15.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951e37700 1 --2- 172.21.15.45:0/2355318984 >> v2:172.21.15.73:3300/0 conn(0x7fc94c164690 0x7fc94c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc951636700 1 --2- 172.21.15.45:0/2355318984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c164a70 0x7fc94c0c4340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc94c070630 tx=0x7fc93c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b25c3128bbd0f4ff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc950e35700 1 -- 172.21.15.45:0/2355318984 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00b8a0 con 0x7fc94c164a70 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc950e35700 1 -- 172.21.15.45:0/2355318984 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c00ba00 con 0x7fc94c164a70 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc950e35700 1 -- 172.21.15.45:0/2355318984 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00bd90 con 0x7fc94c164a70 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 -- 172.21.15.45:0/2355318984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c164a70 msgr2=0x7fc94c0c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 --2- 172.21.15.45:0/2355318984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c164a70 0x7fc94c0c4340 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fc94c070630 tx=0x7fc93c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 -- 172.21.15.45:0/2355318984 shutdown_connections 2023-12-19T18:00:15.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 --2- 172.21.15.45:0/2355318984 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c164a70 0x7fc94c0c4340 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 --2- 172.21.15.45:0/2355318984 >> v2:172.21.15.73:3300/0 conn(0x7fc94c164690 0x7fc94c0c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.820+0000 7fc95409b700 1 -- 172.21.15.45:0/2355318984 >> 172.21.15.45:0/2355318984 conn(0x7fc94c0cba40 msgr2=0x7fc94c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 -- 172.21.15.45:0/2355318984 shutdown_connections 2023-12-19T18:00:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 -- 172.21.15.45:0/2355318984 wait complete. 2023-12-19T18:00:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 Processor -- start 2023-12-19T18:00:15.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 -- start start 2023-12-19T18:00:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 0x7fc94c163120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc94c164690 0x7fc94c161a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc94c164a70 0x7fc94c155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c162c90 con 0x7fc94c0cce30 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c162080 con 0x7fc94c164a70 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.824+0000 7fc95409b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94c162360 con 0x7fc94c164690 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 0x7fc94c163120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 0x7fc94c163120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34852/0 (socket says 172.21.15.45:34852) 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 -- 172.21.15.45:0/3195801533 learned_addr learned my addr 172.21.15.45:0/3195801533 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:15.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951636700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc94c164690 0x7fc94c161a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc952638700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc94c164a70 0x7fc94c155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 -- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc94c164690 msgr2=0x7fc94c161a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc94c164690 0x7fc94c161a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 -- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc94c164a70 msgr2=0x7fc94c155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc94c164a70 0x7fc94c155db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:15.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 -- 172.21.15.45:0/3195801533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009570 con 0x7fc94c0cce30 2023-12-19T18:00:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc952638700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc94c164a70 0x7fc94c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc951e37700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 0x7fc94c163120 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc948009fc0 tx=0x7fc94800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94800de40 con 0x7fc94c0cce30 2023-12-19T18:00:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94800f040 con 0x7fc94c0cce30 2023-12-19T18:00:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94c162640 con 0x7fc94c0cce30 2023-12-19T18:00:15.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc948003c60 con 0x7fc94c0cce30 2023-12-19T18:00:15.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.828+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94c1562f0 con 0x7fc94c0cce30 2023-12-19T18:00:15.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.832+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94c04ed30 con 0x7fc94c0cce30 2023-12-19T18:00:15.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.832+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc948004030 con 0x7fc94c0cce30 2023-12-19T18:00:15.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.832+0000 7fc9427fc700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc930065b50 0x7fc930068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.832+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fc9480833a0 con 0x7fc94c0cce30 2023-12-19T18:00:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.832+0000 7fc951636700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc930065b50 0x7fc930068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:15.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.836+0000 7fc951636700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc930065b50 0x7fc930068010 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c00 tx=0x7fc93c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:15.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:15.840+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc948050ba0 con 0x7fc94c0cce30 2023-12-19T18:00:16.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.052+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc94c06d160 con 0x7fc94c0cce30 2023-12-19T18:00:16.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.052+0000 7fc9427fc700 1 -- 172.21.15.45:0/3195801533 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fc9480541c0 con 0x7fc94c0cce30 2023-12-19T18:00:16.058 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:16.058 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:13.982153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc930065b50 msgr2=0x7fc930068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc930065b50 0x7fc930068010 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc93c000c00 tx=0x7fc93c008030 comp rx=0 tx=0).stop 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 msgr2=0x7fc94c163120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 0x7fc94c163120 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc948009fc0 tx=0x7fc94800d3b0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 shutdown_connections 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc930065b50 0x7fc930068010 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc94c164a70 0x7fc94c155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc94c164690 0x7fc94c161a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 --2- 172.21.15.45:0/3195801533 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc94c0cce30 0x7fc94c163120 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 >> 172.21.15.45:0/3195801533 conn(0x7fc94c0cba40 msgr2=0x7fc94c0c8fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 shutdown_connections 2023-12-19T18:00:16.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.056+0000 7fc95409b700 1 -- 172.21.15.45:0/3195801533 wait complete. 2023-12-19T18:00:16.062 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 70 2023-12-19T18:00:16.080 INFO:tasks.cephfs.test_data_scan:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 4, "epoch": 70, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 4, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-12-19T18:00:05.116228+0000", "damaged": [], "data_pools": [ 12, 13 ], "enabled": true, "epoch": 70, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_7707": { "addr": "172.21.15.73:6835/3311981467", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6833", "nonce": 3311981467, "type": "v2" }, { "addr": "172.21.15.73:6835", "nonce": 3311981467, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7707, "incarnation": 67, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 92, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 11, "modified": "2023-12-19T18:00:13.982153+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 7707 } } } ], "standbys": [ { "addr": "172.21.15.45:6837/2881617867", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6835", "nonce": 2881617867, "type": "v2" }, { "addr": "172.21.15.45:6837", "nonce": 2881617867, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 67, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7495, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.73:6834/13160268", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6832", "nonce": 13160268, "type": "v2" }, { "addr": "172.21.15.73:6834", "nonce": 13160268, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 68, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7498, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.45:6836/3881803392", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6834", "nonce": 3881803392, "type": "v2" }, { "addr": "172.21.15.45:6836", "nonce": 3881803392, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 66, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 7698, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-12-19T18:00:16.080 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:00:16.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.248+0000 7f335b59e700 1 Processor -- start 2023-12-19T18:00:16.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.248+0000 7f335b59e700 1 -- start start 2023-12-19T18:00:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f335c161530 0x7f335c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 0x7f335c0c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f335c06e310 con 0x7f335c15cff0 2023-12-19T18:00:16.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f335c15d3d0 con 0x7f335c161530 2023-12-19T18:00:16.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0c42f0 con 0x7f335c0c3920 2023-12-19T18:00:16.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335ad9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 0x7f335c0c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:16.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f3351d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f335c161530 0x7f335c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335a59c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f335c15cff0 0x7f335c0c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:58560/0 (socket says 172.21.15.45:58560) 2023-12-19T18:00:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335ad9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 0x7f335c0c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:33888/0 (socket says 172.21.15.45:33888) 2023-12-19T18:00:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.252+0000 7f335a59c700 1 -- 172.21.15.45:0/342966477 learned_addr learned my addr 172.21.15.45:0/342966477 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335ad9d700 1 -- 172.21.15.45:0/342966477 >> v2:172.21.15.73:3300/0 conn(0x7f335c161530 msgr2=0x7f335c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335ad9d700 1 --2- 172.21.15.45:0/342966477 >> v2:172.21.15.73:3300/0 conn(0x7f335c161530 0x7f335c06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f3359d9b700 1 -- 172.21.15.45:0/342966477 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2626912149 0 0) 0x7f335c06e310 con 0x7f335c15cff0 2023-12-19T18:00:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335ad9d700 1 -- 172.21.15.45:0/342966477 >> v1:172.21.15.73:6789/0 conn(0x7f335c15cff0 legacy=0x7f335c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335ad9d700 1 -- 172.21.15.45:0/342966477 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c161990 con 0x7f335c0c3920 2023-12-19T18:00:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f3351d9b700 1 --2- 172.21.15.45:0/342966477 >> v2:172.21.15.73:3300/0 conn(0x7f335c161530 0x7f335c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:16.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335ad9d700 1 --2- 172.21.15.45:0/342966477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 0x7f335c0c3db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36dcb9b2ced50251 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f3359d9b700 1 -- 172.21.15.45:0/342966477 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335400e070 con 0x7f335c0c3920 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f3359d9b700 1 -- 172.21.15.45:0/342966477 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335400bb20 con 0x7f335c0c3920 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f3359d9b700 1 -- 172.21.15.45:0/342966477 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354012430 con 0x7f335c0c3920 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 -- 172.21.15.45:0/342966477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 msgr2=0x7f335c0c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 --2- 172.21.15.45:0/342966477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 0x7f335c0c3db0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3354009d90 tx=0x7f335400b330 comp rx=0 tx=0).stop 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 -- 172.21.15.45:0/342966477 shutdown_connections 2023-12-19T18:00:16.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 --2- 172.21.15.45:0/342966477 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c0c3920 0x7f335c0c3db0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 --2- 172.21.15.45:0/342966477 >> v2:172.21.15.73:3300/0 conn(0x7f335c161530 0x7f335c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 -- 172.21.15.45:0/342966477 >> 172.21.15.45:0/342966477 conn(0x7f335c0cb900 msgr2=0x7f335c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 -- 172.21.15.45:0/342966477 shutdown_connections 2023-12-19T18:00:16.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.256+0000 7f335b59e700 1 -- 172.21.15.45:0/342966477 wait complete. 2023-12-19T18:00:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 Processor -- start 2023-12-19T18:00:16.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 -- start start 2023-12-19T18:00:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335c0c3920 0x7f335c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:16.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c15cff0 0x7f335c15a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 0x7f335c0cc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b3e30 con 0x7f335c161530 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0c6860 con 0x7f335c0c3920 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.260+0000 7f335b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f335c0b3870 con 0x7f335c15cff0 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 0x7f335c0cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335a59c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335c0c3920 0x7f335c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 0x7f335c0cc870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34866/0 (socket says 172.21.15.45:34866) 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 -- 172.21.15.45:0/1463229087 learned_addr learned my addr 172.21.15.45:0/1463229087 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:16.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f3351d9b700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c15cff0 0x7f335c15a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 -- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c15cff0 msgr2=0x7f335c15a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c15cff0 0x7f335c15a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 -- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335c0c3920 msgr2=0x7f335c15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335c0c3920 0x7f335c15a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 -- 172.21.15.45:0/1463229087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440094b0 con 0x7f335c161530 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335a59c700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335c0c3920 0x7f335c15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:16.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335ad9d700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 0x7f335c0cc870 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3354014040 tx=0x7f3354004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354012430 con 0x7f335c161530 2023-12-19T18:00:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3354020070 con 0x7f335c161530 2023-12-19T18:00:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3354009a70 con 0x7f335c161530 2023-12-19T18:00:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3354004280 con 0x7f335c161530 2023-12-19T18:00:16.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.264+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f335c0c6de0 con 0x7f335c161530 2023-12-19T18:00:16.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.268+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335c0c6c40 con 0x7f335c161530 2023-12-19T18:00:16.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.268+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f33540043e0 con 0x7f335c161530 2023-12-19T18:00:16.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.272+0000 7f33537fe700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f333c065ad0 0x7f333c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:16.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.272+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f3354022070 con 0x7f335c161530 2023-12-19T18:00:16.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.272+0000 7f335a59c700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f333c065ad0 0x7f333c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:16.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.272+0000 7f335a59c700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f333c065ad0 0x7f333c067f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f334c007b30 tx=0x7f334c007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:16.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.276+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f335c0c6c40 con 0x7f335c161530 2023-12-19T18:00:16.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.496+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f335c0c6c40 con 0x7f335c161530 2023-12-19T18:00:16.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.496+0000 7f33537fe700 1 -- 172.21.15.45:0/1463229087 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+91 (secure 0 0 0) 0x7f335c0c6c40 con 0x7f335c161530 2023-12-19T18:00:16.501 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_extra ] 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f333c065ad0 msgr2=0x7f333c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f333c065ad0 0x7f333c067f90 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f334c007b30 tx=0x7f334c007a80 comp rx=0 tx=0).stop 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 msgr2=0x7f335c0cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 0x7f335c0cc870 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f3354014040 tx=0x7f3354004af0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 shutdown_connections 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f333c065ad0 0x7f333c067f90 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335c161530 0x7f335c0cc870 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335c15cff0 0x7f335c15a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 --2- 172.21.15.45:0/1463229087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335c0c3920 0x7f335c15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:16.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 >> 172.21.15.45:0/1463229087 conn(0x7f335c0cb900 msgr2=0x7f335c0cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:16.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 shutdown_connections 2023-12-19T18:00:16.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:16.500+0000 7f335b59e700 1 -- 172.21.15.45:0/1463229087 wait complete. 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:00:16.529 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:00:16.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:16.529 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T18:00:16.550 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:00:16.550 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T18:00:16.551 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41848sec preferred_lft 41848sec 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T18:00:16.552 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.553 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:00:16.553 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:00:16.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:16.554 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:00:16.634 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:00:16.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:16.637 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T18:00:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T18:00:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:00:16.705 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T18:00:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:00:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T18:00:16.706 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:00:16.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:16.706 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T18:00:16.707 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T18:00:16.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T18:00:16.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T18:00:16.707 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T18:00:16.707 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T18:00:16.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:16.844 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:00:16.862 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:00:16.862 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:00:16.863 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:00:16.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:16.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T18:00:16.943 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T18:00:16.944 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:00:16.944 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:17.007 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:00:17.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:00:17.008 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:17.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:00:17.145 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:00:17.146 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:00:17.220 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:00:17.224 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:00:17.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:17.225 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:00:17.285 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T18:00:17.285 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T18:00:17.335 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:00:17.377 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:00:17.377 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:00:17.455 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:00:17.457 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:00:17.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:17.457 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:00:17.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T18:00:17.488+0000 7f24ec5bb640 -1 init, newargv = 0x5619a9f55560 newargc=15 2023-12-19T18:00:17.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[54060]: starting ceph client 2023-12-19T18:00:17.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[54060]: starting fuse 2023-12-19T18:00:17.511 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:00:17.511 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T18:00:17.511 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:00:17.511 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T18:00:17.511 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T18:00:17.512 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T18:00:17.513 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:00:17.679 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.54060.asok 2023-12-19T18:00:17.859 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54060.asok 2023-12-19T18:00:17.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:17.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54060.asok status 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "54060", 2023-12-19T18:00:18.063 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 7764, 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 7764 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3322288004 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:00:18.064 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 3322288004 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.7764 192.168.0.1:0/3322288004", 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/3322288004", 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 70, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 94, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T18:00:18.065 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:18.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:18.078 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T18:00:18.078 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:18.097 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T18:00:18.098 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:18.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:18.098 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:18.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive 2023-12-19T18:00:18.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 Processor -- start 2023-12-19T18:00:18.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 -- start start 2023-12-19T18:00:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415ccb0 0x7f08040b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f080415d090 0x7f08040d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08040d15b0 con 0x7f08040d0e40 2023-12-19T18:00:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08040d2b90 con 0x7f080415d090 2023-12-19T18:00:18.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.400+0000 7f0808951700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08040d1890 con 0x7f080415ccb0 2023-12-19T18:00:18.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f080415d090 0x7f08040d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f08037fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415ccb0 0x7f08040b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f080415d090 0x7f08040d2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34874/0 (socket says 172.21.15.45:34874) 2023-12-19T18:00:18.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 -- 172.21.15.45:0/4072094367 learned_addr learned my addr 172.21.15.45:0/4072094367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 -- 172.21.15.45:0/4072094367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415ccb0 msgr2=0x7f08040b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 --2- 172.21.15.45:0/4072094367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415ccb0 0x7f08040b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 -- 172.21.15.45:0/4072094367 >> v1:172.21.15.73:6789/0 conn(0x7f08040d0e40 legacy=0x7f0804070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 -- 172.21.15.45:0/4072094367 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08040d1b70 con 0x7f080415d090 2023-12-19T18:00:18.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0802ffd700 1 --2- 172.21.15.45:0/4072094367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080415d090 0x7f08040d2650 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009910 tx=0x7f07f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a8a0d30d0bd474 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f08027fc700 1 -- 172.21.15.45:0/4072094367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8011830 con 0x7f080415d090 2023-12-19T18:00:18.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f08027fc700 1 -- 172.21.15.45:0/4072094367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f8011990 con 0x7f080415d090 2023-12-19T18:00:18.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f08027fc700 1 -- 172.21.15.45:0/4072094367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f8011d40 con 0x7f080415d090 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0808951700 1 -- 172.21.15.45:0/4072094367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080415d090 msgr2=0x7f08040d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.404+0000 7f0808951700 1 --2- 172.21.15.45:0/4072094367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080415d090 0x7f08040d2650 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009910 tx=0x7f07f8009c20 comp rx=0 tx=0).stop 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- 172.21.15.45:0/4072094367 shutdown_connections 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 --2- 172.21.15.45:0/4072094367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f080415d090 0x7f08040d2650 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 --2- 172.21.15.45:0/4072094367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415ccb0 0x7f08040b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- 172.21.15.45:0/4072094367 >> 172.21.15.45:0/4072094367 conn(0x7f08040d2f50 msgr2=0x7f08040d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- 172.21.15.45:0/4072094367 shutdown_connections 2023-12-19T18:00:18.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- 172.21.15.45:0/4072094367 wait complete. 2023-12-19T18:00:18.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 Processor -- start 2023-12-19T18:00:18.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- start start 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 0x7f08041f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080415ccb0 0x7f0804154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415d090 0x7f0804154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0804149d50 con 0x7f08040d0e40 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f080414a8d0 con 0x7f080415ccb0 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f0808951700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0804149fa0 con 0x7f080415d090 2023-12-19T18:00:18.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.408+0000 7f08037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 0x7f08041f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 0x7f08041f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34876/0 (socket says 172.21.15.45:34876) 2023-12-19T18:00:18.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 -- 172.21.15.45:0/206007516 learned_addr learned my addr 172.21.15.45:0/206007516 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f0802ffd700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080415ccb0 0x7f0804154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f0803fff700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415d090 0x7f0804154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 -- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415d090 msgr2=0x7f0804154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415d090 0x7f0804154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 -- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080415ccb0 msgr2=0x7f0804154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080415ccb0 0x7f0804154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 -- 172.21.15.45:0/206007516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07f8009570 con 0x7f08040d0e40 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f0802ffd700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080415ccb0 0x7f0804154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:18.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f08037fe700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 0x7f08041f1f10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f07f400ea00 tx=0x7f07f400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f07ebfff700 1 -- 172.21.15.45:0/206007516 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4009720 con 0x7f08040d0e40 2023-12-19T18:00:18.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f07ebfff700 1 -- 172.21.15.45:0/206007516 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f400eea0 con 0x7f08040d0e40 2023-12-19T18:00:18.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f080414a280 con 0x7f08040d0e40 2023-12-19T18:00:18.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f07ebfff700 1 -- 172.21.15.45:0/206007516 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400ca50 con 0x7f08040d0e40 2023-12-19T18:00:18.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.412+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08041f2450 con 0x7f08040d0e40 2023-12-19T18:00:18.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.416+0000 7f07ebfff700 1 -- 172.21.15.45:0/206007516 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f07f400cbb0 con 0x7f08040d0e40 2023-12-19T18:00:18.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.416+0000 7f07ebfff700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f07f0065ad0 0x7f07f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.416+0000 7f07ebfff700 1 -- 172.21.15.45:0/206007516 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f07f4083510 con 0x7f08040d0e40 2023-12-19T18:00:18.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f0802ffd700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f07f0065ad0 0x7f07f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f0802ffd700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f07f0065ad0 0x7f07f0067f90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009c60 tx=0x7f07f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 Processor -- start 2023-12-19T18:00:18.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 -- start start 2023-12-19T18:00:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a016a0 0x1a01a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 0x1a01fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a028e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1961cf0 con 0x1a18e40 2023-12-19T18:00:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x195f480 con 0x1a016a0 2023-12-19T18:00:18.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x195ad70 con 0x1a02500 2023-12-19T18:00:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f0802ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 0x1a01fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f0802ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 0x1a01fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34886/0 (socket says 172.21.15.45:34886) 2023-12-19T18:00:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f0802ffd700 1 -- 172.21.15.45:0/3633618617 learned_addr learned my addr 172.21.15.45:0/3633618617 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.420+0000 7f08037fe700 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a016a0 0x1a01a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0803fff700 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a028e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0802ffd700 1 -- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 msgr2=0x1a028e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0802ffd700 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a028e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0802ffd700 1 -- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a016a0 msgr2=0x1a01a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0802ffd700 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a016a0 0x1a01a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0802ffd700 1 -- 172.21.15.45:0/3633618617 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x184dee0 con 0x1a18e40 2023-12-19T18:00:18.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f0802ffd700 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 0x1a01fc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009f70 tx=0x7f07f8010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53083c8db75f86d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f07e97fa700 1 -- 172.21.15.45:0/3633618617 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f802b070 con 0x1a18e40 2023-12-19T18:00:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f07e97fa700 1 -- 172.21.15.45:0/3633618617 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80036c0 con 0x1a18e40 2023-12-19T18:00:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f07e97fa700 1 -- 172.21.15.45:0/3633618617 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f801f070 con 0x1a18e40 2023-12-19T18:00:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 -- 172.21.15.45:0/3633618617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 msgr2=0x1a01fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 0x1a01fc0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009f70 tx=0x7f07f8010000 comp rx=0 tx=0).stop 2023-12-19T18:00:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 -- 172.21.15.45:0/3633618617 shutdown_connections 2023-12-19T18:00:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a028e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a18e40 0x1a01fc0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 --2- 172.21.15.45:0/3633618617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a016a0 0x1a01a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 -- 172.21.15.45:0/3633618617 >> 172.21.15.45:0/3633618617 conn(0x1782780 msgr2=0x1a1be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 -- 172.21.15.45:0/3633618617 shutdown_connections 2023-12-19T18:00:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.424+0000 7f080ce4a740 1 -- 172.21.15.45:0/3633618617 wait complete. 2023-12-19T18:00:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 -- start start 2023-12-19T18:00:18.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 Processor -- start 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x19f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a18e40 0x19f0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x191de70 con 0x1a016a0 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x191db10 con 0x1a18e40 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x18f0360 con 0x1a02500 2023-12-19T18:00:18.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 10 client.0 _ll_register_callbacks cb 0x19546b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34898/0 (socket says 172.21.15.45:34898) 2023-12-19T18:00:18.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 -- 172.21.15.45:0/2098659618 learned_addr learned my addr 172.21.15.45:0/2098659618 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f0803fff700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a18e40 0x19f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f0802ffd700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x19f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 -- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 msgr2=0x19f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x19f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 -- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a18e40 msgr2=0x19f0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a18e40 0x19f0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 -- 172.21.15.45:0/2098659618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08040d1b70 con 0x1a016a0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f08037fe700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a349d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f07f400e9d0 tx=0x7f07f40547a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85a8bc36fb18e18b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f07e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f07e27fc700 1 -- 172.21.15.45:0/2098659618 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f40585d0 con 0x1a016a0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f07e27fc700 1 -- 172.21.15.45:0/2098659618 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f07f405c780 con 0x1a016a0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.428+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1924810 con 0x1a016a0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f07e27fc700 1 -- 172.21.15.45:0/2098659618 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07f4081250 con 0x1a016a0 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 10 client.7776 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:18.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1920b50 con 0x1a016a0 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f07e27fc700 1 -- 172.21.15.45:0/2098659618 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1924810 con 0x1a016a0 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f07e27fc700 1 -- 172.21.15.45:0/2098659618 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f07f40721f0 con 0x1a016a0 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 10 client.7776 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 10 client.7776 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 20 client.7776 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a41e50 0x1a42260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 4 client.7776 mds_command: new command op to 7707 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:00:18.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1917980 con 0x1a41e50 2023-12-19T18:00:18.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f0802ffd700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a41e50 0x1a42260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f0802ffd700 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a41e50 0x1a42260 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644884f31900765a server_cookie=bc93a2348eb0d0f2 in_seq=0 out_seq=0 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.432+0000 7f07e27fc700 10 client.7776 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f07e27fc700 1 -- 172.21.15.45:0/2098659618 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1917980 con 0x1a41e50 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f07e27fc700 10 client.7776 handle_command_reply: tid=0 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 client.7776 shutdown 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 msgr2=0x1a349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a349d0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f07f400e9d0 tx=0x7f07f40547a0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 shutdown_connections 2023-12-19T18:00:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a41e50 0x1a42260 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a18e40 0x19f0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x19f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f07e27fc700 0 client.7776 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2098659618 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a349d0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 >> 172.21.15.45:0/2098659618 conn(0x1782780 msgr2=0x1a35fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 shutdown_connections 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 1 -- 172.21.15.45:0/2098659618 wait complete. 2023-12-19T18:00:18.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.436+0000 7f080ce4a740 20 client.7776 trim_cache size 0 max 16384 2023-12-19T18:00:18.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 Processor -- start 2023-12-19T18:00:18.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 -- start start 2023-12-19T18:00:18.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x19efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a03e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1958170 con 0x1a016a0 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1958580 con 0x1782780 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.456+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1962f80 con 0x1a02500 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x19efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x19efbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:41196/0 (socket says 172.21.15.45:41196) 2023-12-19T18:00:18.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 -- 172.21.15.45:0/2846241992 learned_addr learned my addr 172.21.15.45:0/2846241992 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f0803fff700 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a03e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f0802ffd700 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 -- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 msgr2=0x1a03e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a03e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 -- 172.21.15.45:0/2846241992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 msgr2=0x1a038f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a038f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 -- 172.21.15.45:0/2846241992 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1906d80 con 0x1782780 2023-12-19T18:00:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f08037fe700 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x19efbb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07f4012020 tx=0x7f07f401e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bff03bbf6b34eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f07e9ffb700 1 -- 172.21.15.45:0/2846241992 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f4081250 con 0x1782780 2023-12-19T18:00:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f07e9ffb700 1 -- 172.21.15.45:0/2846241992 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f4054a00 con 0x1782780 2023-12-19T18:00:18.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f07e9ffb700 1 -- 172.21.15.45:0/2846241992 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07f400e070 con 0x1782780 2023-12-19T18:00:18.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f080ce4a740 1 -- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 msgr2=0x19efbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.460+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x19efbb0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f07f4012020 tx=0x7f07f401e000 comp rx=0 tx=0).stop 2023-12-19T18:00:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- 172.21.15.45:0/2846241992 shutdown_connections 2023-12-19T18:00:18.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a02500 0x1a03e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a016a0 0x1a038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 --2- 172.21.15.45:0/2846241992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x19efbb0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- 172.21.15.45:0/2846241992 >> 172.21.15.45:0/2846241992 conn(0x19f3dc0 msgr2=0x1a3f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- 172.21.15.45:0/2846241992 shutdown_connections 2023-12-19T18:00:18.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- 172.21.15.45:0/2846241992 wait complete. 2023-12-19T18:00:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- start start 2023-12-19T18:00:18.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 Processor -- start 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x1a01020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a016a0 0x1a1c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 0x1a02ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x19566e0 con 0x1a02500 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a03e50 con 0x1782780 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a1c6e0 con 0x1a016a0 2023-12-19T18:00:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.464+0000 7f080ce4a740 10 client.0 _ll_register_callbacks cb 0x1921f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 0x1a02ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 0x1a02ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34918/0 (socket says 172.21.15.45:34918) 2023-12-19T18:00:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 -- 172.21.15.45:0/4078033964 learned_addr learned my addr 172.21.15.45:0/4078033964 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f08037fe700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x1a01020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0802ffd700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a016a0 0x1a1c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 -- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a016a0 msgr2=0x1a1c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a016a0 0x1a1c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 -- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 msgr2=0x1a01020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x1a01020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 -- 172.21.15.45:0/4078033964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1920b50 con 0x1a02500 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f0803fff700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 0x1a02ce0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f07fc016eb0 tx=0x7f07fc015690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97196e6830dbca3e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f07e27fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f07e27fc700 1 -- 172.21.15.45:0/4078033964 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07fc003a20 con 0x1a02500 2023-12-19T18:00:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f07e27fc700 1 -- 172.21.15.45:0/4078033964 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f07fc003b80 con 0x1a02500 2023-12-19T18:00:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f07f80036c0 con 0x1a02500 2023-12-19T18:00:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f07e27fc700 1 -- 172.21.15.45:0/4078033964 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f07fc003d40 con 0x1a02500 2023-12-19T18:00:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 10 client.7782 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x17cdc10 con 0x1a02500 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f07e27fc700 1 -- 172.21.15.45:0/4078033964 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07f80036c0 con 0x1a02500 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f07e27fc700 1 -- 172.21.15.45:0/4078033964 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f07fc012050 con 0x1a02500 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 10 client.7782 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 10 client.7782 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 20 client.7782 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a18e40 0x1a96d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 4 client.7782 mds_command: new command op to 7707 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x17d9710 con 0x1a18e40 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.468+0000 7f08037fe700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a18e40 0x1a96d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f08037fe700 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a18e40 0x1a96d40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e6f0ec2e0d2df1 server_cookie=614fccfcf6f8228c in_seq=0 out_seq=0 2023-12-19T18:00:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f07e27fc700 10 client.7782 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f07e27fc700 1 -- 172.21.15.45:0/4078033964 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x17d9710 con 0x1a18e40 2023-12-19T18:00:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f07e27fc700 10 client.7782 handle_command_reply: tid=0 2023-12-19T18:00:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 client.7782 shutdown 2023-12-19T18:00:18.478 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:18.477+0000 7f446f675700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 msgr2=0x1a02ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 0x1a02ce0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f07fc016eb0 tx=0x7f07fc015690 comp rx=0 tx=0).stop 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 shutdown_connections 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1a18e40 0x1a96d40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a02500 0x1a02ce0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a016a0 0x1a1c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 --2- 172.21.15.45:0/4078033964 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1782780 0x1a01020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 >> 172.21.15.45:0/4078033964 conn(0x19f3dc0 msgr2=0x1a3fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f07e27fc700 0 client.7782 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 shutdown_connections 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 1 -- 172.21.15.45:0/4078033964 wait complete. 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.472+0000 7f080ce4a740 20 client.7782 trim_cache size 0 max 16384 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "be7c37d3-1cb1-4346-a0c5-36ef86269af3", 2023-12-19T18:00:18.480 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2023-12-19T18:00:18.481 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f07f0065ad0 msgr2=0x7f07f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f07f0065ad0 0x7f07f0067f90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f07f8009c60 tx=0x7f07f8008030 comp rx=0 tx=0).stop 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 msgr2=0x7f08041f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 0x7f08041f1f10 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f07f400ea00 tx=0x7f07f400ed10 comp rx=0 tx=0).stop 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 shutdown_connections 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f07f0065ad0 0x7f07f0067f90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f080415d090 0x7f0804154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f080415ccb0 0x7f0804154770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 --2- 172.21.15.45:0/206007516 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f08040d0e40 0x7f08041f1f10 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 >> 172.21.15.45:0/206007516 conn(0x7f08040d2f50 msgr2=0x7f08040c68a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 shutdown_connections 2023-12-19T18:00:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.476+0000 7f0808951700 1 -- 172.21.15.45:0/206007516 wait complete. 2023-12-19T18:00:18.483 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:18.481+0000 7f446f675700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55cc418d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:00:18.483 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:18.481+0000 7f446f675700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cc41948680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/sixmegs v8>,<0x1/subdir v10>]//[12]","memoryvalue":"(13)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:00:18.488 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:00:18.489+0000 7f446f675700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v5 ap=5 snaprealm=0x55cc418f6d80 DIRTYPARENT f(v1 1=0+1) n(v0 rc2023-12-19T18:00:18.171175+0000 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={7764=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55cc418d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-19T18:00:18.171175+0000 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:00:18.505 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-12-19T18:00:18.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.696+0000 7ff4b759e700 1 Processor -- start 2023-12-19T18:00:18.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.696+0000 7ff4b759e700 1 -- start start 2023-12-19T18:00:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.696+0000 7ff4b759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff4b815cf20 0x7ff4b80d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4b80b8580 0x7ff4b80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4b815d300 con 0x7ff4b80d25f0 2023-12-19T18:00:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80d1550 con 0x7ff4b80b8580 2023-12-19T18:00:18.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4b80d1830 con 0x7ff4b815cf20 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4b80b8580 0x7ff4b80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff4b80b8580 0x7ff4b80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34926/0 (socket says 172.21.15.45:34926) 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/809196279 learned_addr learned my addr 172.21.15.45:0/809196279 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b659c700 1 --2- 172.21.15.45:0/809196279 >> v2:172.21.15.73:3300/0 conn(0x7ff4b815cf20 0x7ff4b80d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/809196279 >> v2:172.21.15.73:3300/0 conn(0x7ff4b815cf20 msgr2=0x7ff4b80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/809196279 >> v2:172.21.15.73:3300/0 conn(0x7ff4b815cf20 0x7ff4b80d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/809196279 >> v1:172.21.15.73:6789/0 conn(0x7ff4b80d25f0 legacy=0x7ff4b806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/809196279 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b80d1b10 con 0x7ff4b80b8580 2023-12-19T18:00:18.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/809196279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b80b8580 0x7ff4b80cd8c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff4b808bc50 tx=0x7ff4ac009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bdde6c3bb429d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b559a700 1 -- 172.21.15.45:0/809196279 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00b8a0 con 0x7ff4b80b8580 2023-12-19T18:00:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b559a700 1 -- 172.21.15.45:0/809196279 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac00ba00 con 0x7ff4b80b8580 2023-12-19T18:00:18.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b559a700 1 -- 172.21.15.45:0/809196279 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac00bd90 con 0x7ff4b80b8580 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- 172.21.15.45:0/809196279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b80b8580 msgr2=0x7ff4b80cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 --2- 172.21.15.45:0/809196279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b80b8580 0x7ff4b80cd8c0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7ff4b808bc50 tx=0x7ff4ac009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- 172.21.15.45:0/809196279 shutdown_connections 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 --2- 172.21.15.45:0/809196279 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b80b8580 0x7ff4b80cd8c0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 --2- 172.21.15.45:0/809196279 >> v2:172.21.15.73:3300/0 conn(0x7ff4b815cf20 0x7ff4b80d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- 172.21.15.45:0/809196279 >> 172.21.15.45:0/809196279 conn(0x7ff4b80b4670 msgr2=0x7ff4b80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- 172.21.15.45:0/809196279 shutdown_connections 2023-12-19T18:00:18.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.700+0000 7ff4b759e700 1 -- 172.21.15.45:0/809196279 wait complete. 2023-12-19T18:00:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.704+0000 7ff4b759e700 1 Processor -- start 2023-12-19T18:00:18.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.704+0000 7ff4b759e700 1 -- start start 2023-12-19T18:00:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 0x7ff4b815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80d25f0 0x7ff4b81fa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b815cf20 0x7ff4b815af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b81fada0 con 0x7ff4b815cf20 2023-12-19T18:00:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b806a1d0 con 0x7ff4b80d25f0 2023-12-19T18:00:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8160510 con 0x7ff4b80b8580 2023-12-19T18:00:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 0x7ff4b815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 0x7ff4b815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:33958/0 (socket says 172.21.15.45:33958) 2023-12-19T18:00:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b659c700 1 -- 172.21.15.45:0/1147491763 learned_addr learned my addr 172.21.15.45:0/1147491763 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b815cf20 0x7ff4b815af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80d25f0 0x7ff4b81fa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 msgr2=0x7ff4b815f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 0x7ff4b815f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b815cf20 msgr2=0x7ff4b815af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b815cf20 0x7ff4b815af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/1147491763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac009570 con 0x7ff4b80d25f0 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b659c700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 0x7ff4b815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:18.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.708+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b815cf20 0x7ff4b815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.712+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80d25f0 0x7ff4b81fa860 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac016000 tx=0x7ff4ac004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.712+0000 7ff4a6ffd700 1 -- 172.21.15.45:0/1147491763 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0038c0 con 0x7ff4b80d25f0 2023-12-19T18:00:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.712+0000 7ff4a6ffd700 1 -- 172.21.15.45:0/1147491763 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac01e070 con 0x7ff4b80d25f0 2023-12-19T18:00:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.712+0000 7ff4a6ffd700 1 -- 172.21.15.45:0/1147491763 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac003c60 con 0x7ff4b80d25f0 2023-12-19T18:00:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.712+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b815b4b0 con 0x7ff4b80d25f0 2023-12-19T18:00:18.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.712+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b815ff50 con 0x7ff4b80d25f0 2023-12-19T18:00:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.716+0000 7ff4a6ffd700 1 -- 172.21.15.45:0/1147491763 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff4ac01a420 con 0x7ff4b80d25f0 2023-12-19T18:00:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.716+0000 7ff4a6ffd700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff498065b20 0x7ff498067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.716+0000 7ff4a6ffd700 1 -- 172.21.15.45:0/1147491763 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7ff4ac020070 con 0x7ff4b80d25f0 2023-12-19T18:00:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.716+0000 7ff4b659c700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff498065b20 0x7ff498067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.716+0000 7ff4b659c700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff498065b20 0x7ff498067fe0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009ea0 tx=0x7ff4a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 Processor -- start 2023-12-19T18:00:18.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 -- start start 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c8a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 0x1c609a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1c615d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b861f0 con 0x1c8a290 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b80890 con 0x1c8d560 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bd3640 con 0x1c605c0 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 0x1c609a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 0x1c609a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34944/0 (socket says 172.21.15.45:34944) 2023-12-19T18:00:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/2914739489 learned_addr learned my addr 172.21.15.45:0/2914739489 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1c615d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b659c700 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c8a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 msgr2=0x1c8a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c8a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 msgr2=0x1c615d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1c615d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/2914739489 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1bf16e0 con 0x1c8a290 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.720+0000 7ff4b659c700 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c8a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 0x1c609a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac055ba0 tx=0x7ff4ac0559e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e70ffcd1f9287f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff497fff700 1 -- 172.21.15.45:0/2914739489 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0565a0 con 0x1c8a290 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff497fff700 1 -- 172.21.15.45:0/2914739489 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac07ce90 con 0x1c8a290 2023-12-19T18:00:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff497fff700 1 -- 172.21.15.45:0/2914739489 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac055ea0 con 0x1c8a290 2023-12-19T18:00:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2914739489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 msgr2=0x1c609a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 0x1c609a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac055ba0 tx=0x7ff4ac0559e0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2914739489 shutdown_connections 2023-12-19T18:00:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1c615d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8a290 0x1c609a0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2914739489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c8a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2914739489 >> 172.21.15.45:0/2914739489 conn(0x19f45b0 msgr2=0x1c8ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2914739489 shutdown_connections 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2914739489 wait complete. 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 -- start start 2023-12-19T18:00:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.724+0000 7ff4bfef8740 1 Processor -- start 2023-12-19T18:00:18.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c77310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c8d560 0x1c89800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1c75f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bce960 con 0x1c89d40 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1bcc6c0 con 0x1c605c0 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1b89e30 con 0x1c8d560 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 10 client.0 _ll_register_callbacks cb 0x1c1ce80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1c75f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1c75f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34946/0 (socket says 172.21.15.45:34946) 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/3603499515 learned_addr learned my addr 172.21.15.45:0/3603499515 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b659c700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c77310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c8d560 0x1c89800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c8d560 msgr2=0x1c89800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c8d560 0x1c89800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 msgr2=0x1c77310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c77310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/3603499515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b815ff50 con 0x1c89d40 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1c75f10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0003fd0 tx=0x7ff4b00058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15a10d77aaa7b9d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4957fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4957fa700 1 -- 172.21.15.45:0/3603499515 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00118f0 con 0x1c89d40 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4957fa700 1 -- 172.21.15.45:0/3603499515 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7ff4b0011a50 con 0x1c89d40 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1bc5740 con 0x1c89d40 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4957fa700 1 -- 172.21.15.45:0/3603499515 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4b0011c10 con 0x1c89d40 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 10 client.7794 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1a3fa40 con 0x1c89d40 2023-12-19T18:00:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.728+0000 7ff4957fa700 1 -- 172.21.15.45:0/3603499515 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1bc5740 con 0x1c89d40 2023-12-19T18:00:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4957fa700 1 -- 172.21.15.45:0/3603499515 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff4b001e3f0 con 0x1c89d40 2023-12-19T18:00:18.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 10 client.7794 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 10 client.7794 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 20 client.7794 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1cbd190 0x1cbf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 4 client.7794 mds_command: new command op to 7707 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1b89150 con 0x1cbd190 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4b659c700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1cbd190 0x1cbf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4957fa700 10 client.7794 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4b659c700 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1cbd190 0x1cbf580 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c89df9b554752b97 server_cookie=e309565767e700c in_seq=0 out_seq=0 2023-12-19T18:00:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4957fa700 1 -- 172.21.15.45:0/3603499515 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1b89150 con 0x1cbd190 2023-12-19T18:00:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4957fa700 10 client.7794 handle_command_reply: tid=0 2023-12-19T18:00:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.732+0000 7ff4bfef8740 1 client.7794 shutdown 2023-12-19T18:00:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 msgr2=0x1c75f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1c75f10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0003fd0 tx=0x7ff4b00058d0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 shutdown_connections 2023-12-19T18:00:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1cbd190 0x1cbf580 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1c75f10 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c8d560 0x1c89800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/3603499515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c77310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 >> 172.21.15.45:0/3603499515 conn(0x19f45b0 msgr2=0x1cab720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4957fa700 0 client.7794 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 shutdown_connections 2023-12-19T18:00:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 1 -- 172.21.15.45:0/3603499515 wait complete. 2023-12-19T18:00:18.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.736+0000 7ff4bfef8740 20 client.7794 trim_cache size 0 max 16384 2023-12-19T18:00:18.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.752+0000 7ff4bfef8740 1 Processor -- start 2023-12-19T18:00:18.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 -- start start 2023-12-19T18:00:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c92d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c89d40 0x1d039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 0x1d03f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a78b80 con 0x1c8d560 2023-12-19T18:00:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b6ab70 con 0x1c605c0 2023-12-19T18:00:18.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1bcf620 con 0x1c89d40 2023-12-19T18:00:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 0x1d03f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 0x1d03f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34954/0 (socket says 172.21.15.45:34954) 2023-12-19T18:00:18.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/2134506632 learned_addr learned my addr 172.21.15.45:0/2134506632 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c89d40 0x1d039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b659c700 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c92d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c89d40 msgr2=0x1d039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c89d40 0x1d039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 msgr2=0x1c92d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c92d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 -- 172.21.15.45:0/2134506632 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1b927e0 con 0x1c8d560 2023-12-19T18:00:18.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 0x1d03f30 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0000f80 tx=0x7ff4b000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e39ffa78a974fa2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4a4ff9700 1 -- 172.21.15.45:0/2134506632 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b001e9a0 con 0x1c8d560 2023-12-19T18:00:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4a4ff9700 1 -- 172.21.15.45:0/2134506632 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b00015a0 con 0x1c8d560 2023-12-19T18:00:18.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.756+0000 7ff4a4ff9700 1 -- 172.21.15.45:0/2134506632 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b00118f0 con 0x1c8d560 2023-12-19T18:00:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2134506632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 msgr2=0x1d03f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 0x1d03f30 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ff4b0000f80 tx=0x7ff4b000c000 comp rx=0 tx=0).stop 2023-12-19T18:00:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2134506632 shutdown_connections 2023-12-19T18:00:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c8d560 0x1d03f30 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c89d40 0x1d039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/2134506632 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c605c0 0x1c92d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2134506632 >> 172.21.15.45:0/2134506632 conn(0x19f45b0 msgr2=0x1c76ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2134506632 shutdown_connections 2023-12-19T18:00:18.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 -- 172.21.15.45:0/2134506632 wait complete. 2023-12-19T18:00:18.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 -- start start 2023-12-19T18:00:18.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.760+0000 7ff4bfef8740 1 Processor -- start 2023-12-19T18:00:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c61590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1d07f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1d08440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b87ab0 con 0x1c89d40 2023-12-19T18:00:18.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1c8e120 con 0x1c8d560 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1c61ef0 con 0x1c605c0 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 10 client.0 _ll_register_callbacks cb 0x7ff4ac006a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1d07f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1d07f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34956/0 (socket says 172.21.15.45:34956) 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/4252883187 learned_addr learned my addr 172.21.15.45:0/4252883187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b659c700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c61590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b6d9d700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1d08440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 msgr2=0x1c61590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c61590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 msgr2=0x1d08440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1d08440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 -- 172.21.15.45:0/4252883187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a3fa40 con 0x1c89d40 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4b5d9b700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1d07f00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac055ba0 tx=0x7ff4ac01c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b53653d72f1796 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4957fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:18.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4957fa700 1 -- 172.21.15.45:0/4252883187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac0565a0 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4957fa700 1 -- 172.21.15.45:0/4252883187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7ff4ac081050 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff4ac07ce90 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.764+0000 7ff4957fa700 1 -- 172.21.15.45:0/4252883187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4ac0521e0 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 10 client.7800 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x1b78a10 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4957fa700 1 -- 172.21.15.45:0/4252883187 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac07ce90 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4957fa700 1 -- 172.21.15.45:0/4252883187 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7ff4ac055390 con 0x1c89d40 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 10 client.7800 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 10 client.7800 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 20 client.7800 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1c90ad0 0x1c90ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 4 client.7800 mds_command: new command op to 7707 tid=0[{"prefix": "scrub status"}] 2023-12-19T18:00:18.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1a4b540 con 0x1c90ad0 2023-12-19T18:00:18.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4b659c700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1c90ad0 0x1c90ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:18.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4b659c700 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1c90ad0 0x1c90ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e05cca385650d476 server_cookie=8231f81d346ae079 in_seq=0 out_seq=0 2023-12-19T18:00:18.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4957fa700 10 client.7800 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4957fa700 1 -- 172.21.15.45:0/4252883187 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x1a4b540 con 0x1c90ad0 2023-12-19T18:00:18.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4957fa700 10 client.7800 handle_command_reply: tid=0 2023-12-19T18:00:18.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 client.7800 shutdown 2023-12-19T18:00:18.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 msgr2=0x1d07f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1d07f00 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac055ba0 tx=0x7ff4ac01c040 comp rx=0 tx=0).stop 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 shutdown_connections 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x1c90ad0 0x1c90ee0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1c8d560 0x1d08440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1c89d40 0x1d07f00 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4957fa700 0 client.7800 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 --2- 172.21.15.45:0/4252883187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1c605c0 0x1c61590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 >> 172.21.15.45:0/4252883187 conn(0x19f45b0 msgr2=0x1c92f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 shutdown_connections 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.768+0000 7ff4bfef8740 1 -- 172.21.15.45:0/4252883187 wait complete. 2023-12-19T18:00:18.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4bfef8740 20 client.7800 trim_cache size 0 max 16384 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: "be7c37d3-1cb1-4346-a0c5-36ef86269af3": { 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "be7c37d3-1cb1-4346-a0c5-36ef86269af3", 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,repair" 2023-12-19T18:00:18.778 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:00:18.779 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:00:18.779 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff498065b20 msgr2=0x7ff498067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff498065b20 0x7ff498067fe0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8009ea0 tx=0x7ff4a8008040 comp rx=0 tx=0).stop 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80d25f0 msgr2=0x7ff4b81fa860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80d25f0 0x7ff4b81fa860 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac016000 tx=0x7ff4ac004770 comp rx=0 tx=0).stop 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 shutdown_connections 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff498065b20 0x7ff498067fe0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff4b815cf20 0x7ff4b815af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff4b80d25f0 0x7ff4b81fa860 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 --2- 172.21.15.45:0/1147491763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff4b80b8580 0x7ff4b815f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:18.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 >> 172.21.15.45:0/1147491763 conn(0x7ff4b80b4670 msgr2=0x7ff4b8070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:18.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 shutdown_connections 2023-12-19T18:00:18.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:18.772+0000 7ff4b759e700 1 -- 172.21.15.45:0/1147491763 wait complete. 2023-12-19T18:00:18.801 INFO:tasks.cephfs.filesystem:scrub status for tag:be7c37d3-1cb1-4346-a0c5-36ef86269af3 - {'path': '/', 'tag': 'be7c37d3-1cb1-4346-a0c5-36ef86269af3', 'options': 'recursive,repair'} 2023-12-19T18:00:31.548 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:00:31.556 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:00:48.802 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4:0 scrub status 2023-12-19T18:00:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 Processor -- start 2023-12-19T18:00:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 -- start start 2023-12-19T18:00:48.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbef80cb8d0 0x7fbef815b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:48.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80ce350 0x7fbef806d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:48.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef806ea90 con 0x7fbef80cc690 2023-12-19T18:00:48.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef815c340 con 0x7fbef80cb8d0 2023-12-19T18:00:48.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbefc969700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef815baa0 con 0x7fbef80ce350 2023-12-19T18:00:48.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.987+0000 7fbef5d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbef80cb8d0 0x7fbef815b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:48.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbef80cb8d0 0x7fbef815b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57636/0 (socket says 172.21.15.45:57636) 2023-12-19T18:00:48.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 -- 172.21.15.45:0/3772225782 learned_addr learned my addr 172.21.15.45:0/3772225782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80ce350 0x7fbef806d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 -- 172.21.15.45:0/3772225782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80ce350 msgr2=0x7fbef806d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80ce350 0x7fbef806d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 -- 172.21.15.45:0/3772225782 >> v1:172.21.15.73:6789/0 conn(0x7fbef80cc690 legacy=0x7fbef80cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 -- 172.21.15.45:0/3772225782 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef815bd80 con 0x7fbef80cb8d0 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80ce350 0x7fbef806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef559a700 1 -- 172.21.15.45:0/3772225782 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 85464307 0 0) 0x7fbef806ea90 con 0x7fbef80cc690 2023-12-19T18:00:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80cb8d0 0x7fbef815b410 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009910 tx=0x7fbeec009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0dd3f27f748ce3c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef559a700 1 -- 172.21.15.45:0/3772225782 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec00ba60 con 0x7fbef80cb8d0 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef559a700 1 -- 172.21.15.45:0/3772225782 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeec00bbc0 con 0x7fbef80cb8d0 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbef559a700 1 -- 172.21.15.45:0/3772225782 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeec009e60 con 0x7fbef80cb8d0 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 -- 172.21.15.45:0/3772225782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80cb8d0 msgr2=0x7fbef815b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80cb8d0 0x7fbef815b410 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009910 tx=0x7fbeec009c20 comp rx=0 tx=0).stop 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 -- 172.21.15.45:0/3772225782 shutdown_connections 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80ce350 0x7fbef806d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 --2- 172.21.15.45:0/3772225782 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80cb8d0 0x7fbef815b410 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 -- 172.21.15.45:0/3772225782 >> 172.21.15.45:0/3772225782 conn(0x7fbef8071990 msgr2=0x7fbef80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 -- 172.21.15.45:0/3772225782 shutdown_connections 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.991+0000 7fbefc969700 1 -- 172.21.15.45:0/3772225782 wait complete. 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 Processor -- start 2023-12-19T18:00:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 -- start start 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef80cb8d0 0x7fbef8154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80cc690 0x7fbef80a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 0x7fbef815acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8155a60 con 0x7fbef80ce350 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8154550 con 0x7fbef80cb8d0 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbefc969700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef8155cb0 con 0x7fbef80cc690 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.995+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 0x7fbef815acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 0x7fbef815acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57646/0 (socket says 172.21.15.45:57646) 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 -- 172.21.15.45:0/89612429 learned_addr learned my addr 172.21.15.45:0/89612429 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80cc690 0x7fbef80a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef659c700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef80cb8d0 0x7fbef8154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 -- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80cc690 msgr2=0x7fbef80a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80cc690 0x7fbef80a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 -- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef80cb8d0 msgr2=0x7fbef8154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef80cb8d0 0x7fbef8154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 -- 172.21.15.45:0/89612429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeec009570 con 0x7fbef80ce350 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80cc690 0x7fbef80a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 0x7fbef815acf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbef0007df0 tx=0x7fbef000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbee6ffd700 1 -- 172.21.15.45:0/89612429 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef000ddd0 con 0x7fbef80ce350 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbee6ffd700 1 -- 172.21.15.45:0/89612429 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef000f040 con 0x7fbef80ce350 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbee6ffd700 1 -- 172.21.15.45:0/89612429 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0003c80 con 0x7fbef80ce350 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef8155f90 con 0x7fbef80ce350 2023-12-19T18:00:49.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:48.999+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8156550 con 0x7fbef80ce350 2023-12-19T18:00:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.003+0000 7fbee6ffd700 1 -- 172.21.15.45:0/89612429 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbef0004030 con 0x7fbef80ce350 2023-12-19T18:00:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.003+0000 7fbee6ffd700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbed8065ad0 0x7fbed8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.003+0000 7fbee6ffd700 1 -- 172.21.15.45:0/89612429 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbef0083740 con 0x7fbef80ce350 2023-12-19T18:00:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.003+0000 7fbef659c700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbed8065ad0 0x7fbed8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.003+0000 7fbef659c700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbed8065ad0 0x7fbed8067f90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbee8000f60 tx=0x7fbee8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 Processor -- start 2023-12-19T18:00:49.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 -- start start 2023-12-19T18:00:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29af5c0 0x29d90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29d96a0 0x29af9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x29fb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x28d51f0 con 0x29f23e0 2023-12-19T18:00:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x28cf890 con 0x29d96a0 2023-12-19T18:00:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.007+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2922640 con 0x29af5c0 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x29fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x29fb560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57662/0 (socket says 172.21.15.45:57662) 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 -- 172.21.15.45:0/3852383468 learned_addr learned my addr 172.21.15.45:0/3852383468 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef659c700 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29af5c0 0x29d90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29d96a0 0x29af9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 -- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29af5c0 msgr2=0x29d90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29af5c0 0x29d90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 -- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29d96a0 msgr2=0x29af9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29d96a0 0x29af9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 -- 172.21.15.45:0/3852383468 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29406e0 con 0x29f23e0 2023-12-19T18:00:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x29fb560 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbef0081830 tx=0x7fbef00551b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56ddab1b8aa3e826 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbed7fff700 1 -- 172.21.15.45:0/3852383468 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef005c9c0 con 0x29f23e0 2023-12-19T18:00:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbed7fff700 1 -- 172.21.15.45:0/3852383468 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0003de0 con 0x29f23e0 2023-12-19T18:00:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbed7fff700 1 -- 172.21.15.45:0/3852383468 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0054c40 con 0x29f23e0 2023-12-19T18:00:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 -- 172.21.15.45:0/3852383468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 msgr2=0x29fb560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x29fb560 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fbef0081830 tx=0x7fbef00551b0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 -- 172.21.15.45:0/3852383468 shutdown_connections 2023-12-19T18:00:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x29fb560 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29d96a0 0x29af9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/3852383468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29af5c0 0x29d90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 -- 172.21.15.45:0/3852383468 >> 172.21.15.45:0/3852383468 conn(0x27435b0 msgr2=0x29dbe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 -- 172.21.15.45:0/3852383468 shutdown_connections 2023-12-19T18:00:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.011+0000 7fbeffbfd740 1 -- 172.21.15.45:0/3852383468 wait complete. 2023-12-19T18:00:49.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 -- start start 2023-12-19T18:00:49.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 Processor -- start 2023-12-19T18:00:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29d8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x291d960 con 0x29af5c0 2023-12-19T18:00:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x291b6c0 con 0x29f23e0 2023-12-19T18:00:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d8e30 con 0x29d96a0 2023-12-19T18:00:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 10 client.0 _ll_register_callbacks cb 0x296be80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29d8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29d8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57670/0 (socket says 172.21.15.45:57670) 2023-12-19T18:00:49.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 -- 172.21.15.45:0/574929106 learned_addr learned my addr 172.21.15.45:0/574929106 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 -- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 msgr2=0x29b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 -- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 msgr2=0x29b3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 -- 172.21.15.45:0/574929106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef8156550 con 0x29af5c0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbef659c700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29d8420 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbee8003950 tx=0x7fbee8001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4db230ea248b37ef server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbed57fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbed57fa700 1 -- 172.21.15.45:0/574929106 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8005500 con 0x29af5c0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbed57fa700 1 -- 172.21.15.45:0/574929106 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbee800eab0 con 0x29af5c0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.015+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2914740 con 0x29af5c0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbed57fa700 1 -- 172.21.15.45:0/574929106 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbee800ec70 con 0x29af5c0 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 10 client.7812 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x278ea40 con 0x29af5c0 2023-12-19T18:00:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbed57fa700 1 -- 172.21.15.45:0/574929106 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2914740 con 0x29af5c0 2023-12-19T18:00:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbed57fa700 1 -- 172.21.15.45:0/574929106 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbee8020070 con 0x29af5c0 2023-12-19T18:00:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 10 client.7812 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 10 client.7812 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-19T18:00:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 20 client.7812 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x29deaa0 0x29dd080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 4 client.7812 mds_command: new command op to 7707 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:00:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x28d8150 con 0x29deaa0 2023-12-19T18:00:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x29deaa0 0x29dd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbed57fa700 10 client.7812 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.019+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x29deaa0 0x29dd080 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d7eaf99427a69065 server_cookie=e0acf6df7457320e in_seq=0 out_seq=0 2023-12-19T18:00:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbed57fa700 1 -- 172.21.15.45:0/574929106 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x28d8150 con 0x29deaa0 2023-12-19T18:00:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbed57fa700 10 client.7812 handle_command_reply: tid=0 2023-12-19T18:00:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 client.7812 shutdown 2023-12-19T18:00:49.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 msgr2=0x29d8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29d8420 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fbee8003950 tx=0x7fbee8001080 comp rx=0 tx=0).stop 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 shutdown_connections 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x29deaa0 0x29dd080 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/574929106 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29d8420 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 >> 172.21.15.45:0/574929106 conn(0x27435b0 msgr2=0x29adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbed57fa700 0 client.7812 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 shutdown_connections 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 1 -- 172.21.15.45:0/574929106 wait complete. 2023-12-19T18:00:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.023+0000 7fbeffbfd740 20 client.7812 trim_cache size 0 max 16384 2023-12-19T18:00:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 Processor -- start 2023-12-19T18:00:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 -- start start 2023-12-19T18:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29ae540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29aea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c7b80 con 0x29af5c0 2023-12-19T18:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x28e6c30 con 0x29f23e0 2023-12-19T18:00:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x291aed0 con 0x29d96a0 2023-12-19T18:00:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57684/0 (socket says 172.21.15.45:57684) 2023-12-19T18:00:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 -- 172.21.15.45:0/1116604836 learned_addr learned my addr 172.21.15.45:0/1116604836 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29aea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 -- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 msgr2=0x29aea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29aea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 -- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 msgr2=0x29b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.043+0000 7fbef659c700 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbef659c700 1 -- 172.21.15.45:0/1116604836 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28e17e0 con 0x29af5c0 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbef659c700 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29ae540 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007ed0 tx=0x7fbee801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5f95de895497b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbee4ff9700 1 -- 172.21.15.45:0/1116604836 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8005410 con 0x29af5c0 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbee4ff9700 1 -- 172.21.15.45:0/1116604836 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee8019070 con 0x29af5c0 2023-12-19T18:00:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbee4ff9700 1 -- 172.21.15.45:0/1116604836 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee800e900 con 0x29af5c0 2023-12-19T18:00:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 -- 172.21.15.45:0/1116604836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 msgr2=0x29ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29ae540 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fbee8007ed0 tx=0x7fbee801a000 comp rx=0 tx=0).stop 2023-12-19T18:00:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 -- 172.21.15.45:0/1116604836 shutdown_connections 2023-12-19T18:00:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29f23e0 0x29b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x29aea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/1116604836 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29af5c0 0x29ae540 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 -- 172.21.15.45:0/1116604836 >> 172.21.15.45:0/1116604836 conn(0x27435b0 msgr2=0x29d7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 -- 172.21.15.45:0/1116604836 shutdown_connections 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 -- 172.21.15.45:0/1116604836 wait complete. 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 -- start start 2023-12-19T18:00:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.047+0000 7fbeffbfd740 1 Processor -- start 2023-12-19T18:00:49.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29af5c0 0x2a0b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x2a107d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x2a574e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a0bcd0 con 0x29f23e0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x29e03a0 con 0x29af5c0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2a0b7a0 con 0x29d96a0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 10 client.0 _ll_register_callbacks cb 0x7fbef00547b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x2a574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x2a574e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57698/0 (socket says 172.21.15.45:57698) 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 -- 172.21.15.45:0/170735559 learned_addr learned my addr 172.21.15.45:0/170735559 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef659c700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29af5c0 0x2a0b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef5d9b700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x2a107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 -- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 msgr2=0x2a107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x2a107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 -- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29af5c0 msgr2=0x2a0b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29af5c0 0x2a0b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 -- 172.21.15.45:0/170735559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x278ea40 con 0x29f23e0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef6d9d700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x2a574e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbef00818e0 tx=0x7fbef0021070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709af25456cd05ad server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbed57fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbed57fa700 1 -- 172.21.15.45:0/170735559 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef0054e40 con 0x29f23e0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbed57fa700 1 -- 172.21.15.45:0/170735559 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbef005c9c0 con 0x29f23e0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbef0003de0 con 0x29f23e0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbed57fa700 1 -- 172.21.15.45:0/170735559 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbef00550e0 con 0x29f23e0 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 10 client.7818 fetch_fsmap learned FSMap version 70 2023-12-19T18:00:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x28c7a10 con 0x29f23e0 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbed57fa700 1 -- 172.21.15.45:0/170735559 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef0003de0 con 0x29f23e0 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbed57fa700 1 -- 172.21.15.45:0/170735559 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 70) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fbef005c530 con 0x29f23e0 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 10 client.7818 fetch_fsmap finished waiting for FSMap version 70 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 10 client.7818 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.b 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 20 client.7818 populate_metadata read hostname 'smithi045' 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x2a57a20 0x2a12630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 4 client.7818 mds_command: new command op to 7707 tid=0[{"prefix": "scrub status"}] 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 --> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x279a540 con 0x2a57a20 2023-12-19T18:00:49.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.051+0000 7fbef659c700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x2a57a20 0x2a12630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbef659c700 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x2a57a20 0x2a12630 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32f684d2e13d22d server_cookie=3aeb6cda00c1c4c0 in_seq=0 out_seq=0 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbed57fa700 10 client.7818 ms_handle_connect on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbed57fa700 1 -- 172.21.15.45:0/170735559 <== mds.0 v2:172.21.15.73:6833/3311981467 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x279a540 con 0x2a57a20 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbed57fa700 10 client.7818 handle_command_reply: tid=0 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 client.7818 shutdown 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 msgr2=0x2a574e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x2a574e0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fbef00818e0 tx=0x7fbef0021070 comp rx=0 tx=0).stop 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 shutdown_connections 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:6833/3311981467,v1:172.21.15.73:6835/3311981467] conn(0x2a57a20 0x2a12630 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x29f23e0 0x2a574e0 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x29d96a0 0x2a107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 --2- 172.21.15.45:0/170735559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x29af5c0 0x2a0b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 >> 172.21.15.45:0/170735559 conn(0x27435b0 msgr2=0x29dd080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbed57fa700 0 client.7818 ms_handle_reset on v2:172.21.15.73:6833/3311981467 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 shutdown_connections 2023-12-19T18:00:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 1 -- 172.21.15.45:0/170735559 wait complete. 2023-12-19T18:00:49.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbeffbfd740 20 client.7818 trim_cache size 0 max 16384 2023-12-19T18:00:49.064 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:49.064 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2023-12-19T18:00:49.064 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2023-12-19T18:00:49.064 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbed8065ad0 msgr2=0x7fbed8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbed8065ad0 0x7fbed8067f90 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbee8000f60 tx=0x7fbee8009040 comp rx=0 tx=0).stop 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 msgr2=0x7fbef815acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 0x7fbef815acf0 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fbef0007df0 tx=0x7fbef000d3b0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 shutdown_connections 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbed8065ad0 0x7fbed8067f90 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbef80ce350 0x7fbef815acf0 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbef80cc690 0x7fbef80a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 --2- 172.21.15.45:0/89612429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbef80cb8d0 0x7fbef8154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 >> 172.21.15.45:0/89612429 conn(0x7fbef8071990 msgr2=0x7fbef80cac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 shutdown_connections 2023-12-19T18:00:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.055+0000 7fbefc969700 1 -- 172.21.15.45:0/89612429 wait complete. 2023-12-19T18:00:49.088 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-19T18:00:49.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:49.089 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ls subdir) 2023-12-19T18:00:49.136 INFO:teuthology.orchestra.run.smithi045.stdout:sixmegs 2023-12-19T18:00:49.140 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:00:49.140 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:00:49.140 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-12-19T18:00:49.140 DEBUG:teuthology.orchestra.run.smithi045:> import json 2023-12-19T18:00:49.140 DEBUG:teuthology.orchestra.run.smithi045:> import sys 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> try: 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/sixmegs'"'"') 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> except OSError as e: 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> sys.exit(e.errno) 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> print(json.dumps( 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> dict([(a, getattr(s, a)) for a in attrs]), 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> indent=2)) 2023-12-19T18:00:49.141 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:00:49.304 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_mode": 33088, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_ino": 1099511627777, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_dev": 49, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_nlink": 1, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_uid": 0, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_gid": 0, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_size": 6291456, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_atime": 1703008803.0, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_mtime": 1703008803.0, 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout: "st_ctime": 1703008803.0 2023-12-19T18:00:49.305 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:00:49.494 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:00:49.494 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:00:49.582 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:00:49.627 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:00:49.628 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:00:49.628 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:00:49.647 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:00:49.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 Processor -- start 2023-12-19T18:00:49.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 -- start start 2023-12-19T18:00:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9bc15ab50 0x7fc9bc0ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc9bc15af30 0x7fc9bc0cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc06f4a0 0x7fc9bc15e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc06cbb0 con 0x7fc9bc15af30 2023-12-19T18:00:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9bc06fa10 con 0x7fc9bc15ab50 2023-12-19T18:00:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9c25d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc06fcf0 con 0x7fc9bc06f4a0 2023-12-19T18:00:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.867+0000 7fc9b37fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc9bc15af30 0x7fc9bc0cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc06f4a0 0x7fc9bc15e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9bbfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9bc15ab50 0x7fc9bc0ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9b37fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc9bc15af30 0x7fc9bc0cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57700/0 (socket says 172.21.15.45:57700) 2023-12-19T18:00:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9b37fe700 1 -- 172.21.15.45:0/3406699405 learned_addr learned my addr 172.21.15.45:0/3406699405 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 -- 172.21.15.45:0/3406699405 >> v2:172.21.15.73:3300/0 conn(0x7fc9bc15ab50 msgr2=0x7fc9bc0ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 --2- 172.21.15.45:0/3406699405 >> v2:172.21.15.73:3300/0 conn(0x7fc9bc15ab50 0x7fc9bc0ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 -- 172.21.15.45:0/3406699405 >> v2:172.21.15.45:3300/0 conn(0x7fc9bc15af30 msgr2=0x7fc9bc0cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 --2- 172.21.15.45:0/3406699405 >> v2:172.21.15.45:3300/0 conn(0x7fc9bc15af30 0x7fc9bc0cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 -- 172.21.15.45:0/3406699405 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc06ffd0 con 0x7fc9bc06f4a0 2023-12-19T18:00:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c0b6f700 1 --2- 172.21.15.45:0/3406699405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc06f4a0 0x7fc9bc15e8e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc070630 tx=0x7fc9b400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fb38756c8286f62 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9bb7fe700 1 -- 172.21.15.45:0/3406699405 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400e070 con 0x7fc9bc06f4a0 2023-12-19T18:00:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9bb7fe700 1 -- 172.21.15.45:0/3406699405 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b400bb20 con 0x7fc9bc06f4a0 2023-12-19T18:00:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9bb7fe700 1 -- 172.21.15.45:0/3406699405 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b4012430 con 0x7fc9bc06f4a0 2023-12-19T18:00:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3406699405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc06f4a0 msgr2=0x7fc9bc15e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3406699405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc06f4a0 0x7fc9bc15e8e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc070630 tx=0x7fc9b400b330 comp rx=0 tx=0).stop 2023-12-19T18:00:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3406699405 shutdown_connections 2023-12-19T18:00:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3406699405 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc06f4a0 0x7fc9bc15e8e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3406699405 >> v2:172.21.15.45:3300/0 conn(0x7fc9bc15af30 0x7fc9bc0cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3406699405 >> v2:172.21.15.73:3300/0 conn(0x7fc9bc15ab50 0x7fc9bc0ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3406699405 >> 172.21.15.45:0/3406699405 conn(0x7fc9bc0cba40 msgr2=0x7fc9bc0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.871+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3406699405 shutdown_connections 2023-12-19T18:00:49.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.875+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3406699405 wait complete. 2023-12-19T18:00:49.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.875+0000 7fc9c25d2700 1 Processor -- start 2023-12-19T18:00:49.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.875+0000 7fc9c25d2700 1 -- start start 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c25d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc06f4a0 0x7fc9bc1420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c25d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 0x7fc9bc1427c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c25d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc15af30 0x7fc9bc145220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c25d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b2d00 con 0x7fc9bc15ab50 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c25d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc159cb0 con 0x7fc9bc06f4a0 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c25d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc0b3580 con 0x7fc9bc15af30 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 0x7fc9bc1427c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 0x7fc9bc1427c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57714/0 (socket says 172.21.15.45:57714) 2023-12-19T18:00:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 -- 172.21.15.45:0/3251787817 learned_addr learned my addr 172.21.15.45:0/3251787817 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9c0b6f700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc15af30 0x7fc9bc145220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9bbfff700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc06f4a0 0x7fc9bc1420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 -- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc15af30 msgr2=0x7fc9bc145220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc15af30 0x7fc9bc145220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 -- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc06f4a0 msgr2=0x7fc9bc1420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc06f4a0 0x7fc9bc1420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 -- 172.21.15.45:0/3251787817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b4009a70 con 0x7fc9bc15ab50 2023-12-19T18:00:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.879+0000 7fc9b37fe700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 0x7fc9bc1427c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e8f0 tx=0x7fc9a400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4013680 con 0x7fc9bc15ab50 2023-12-19T18:00:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9a40137e0 con 0x7fc9bc15ab50 2023-12-19T18:00:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a4013b70 con 0x7fc9bc15ab50 2023-12-19T18:00:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc142d00 con 0x7fc9bc15ab50 2023-12-19T18:00:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc1599d0 con 0x7fc9bc15ab50 2023-12-19T18:00:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc04ed30 con 0x7fc9bc15ab50 2023-12-19T18:00:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.883+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc9a4013cd0 con 0x7fc9bc15ab50 2023-12-19T18:00:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.887+0000 7fc9b97fa700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc99c065ad0 0x7fc99c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.887+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fc9a4083420 con 0x7fc9bc15ab50 2023-12-19T18:00:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.887+0000 7fc9bbfff700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc99c065ad0 0x7fc99c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.887+0000 7fc9bbfff700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc99c065ad0 0x7fc99c067f90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009bf0 tx=0x7fc9ac009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:49.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:49.895+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc9a4050960 con 0x7fc9bc15ab50 2023-12-19T18:00:50.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.167+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9bc0b36c0 con 0x7fc9bc15ab50 2023-12-19T18:00:50.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.171+0000 7fc9b97fa700 1 -- 172.21.15.45:0/3251787817 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18435 (secure 0 0 0) 0x7fc9a4053f80 con 0x7fc9bc15ab50 2023-12-19T18:00:50.178 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:50.178 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":94,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:00:10.965536+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6835/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6834/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6834/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6835/2667696599":"2023-12-20T18:00:04.222190+0000","172.21.15.73:6834/2667696599":"2023-12-20T18:00:04.222190+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:00:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.171+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc99c065ad0 msgr2=0x7fc99c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.171+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc99c065ad0 0x7fc99c067f90 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009bf0 tx=0x7fc9ac009240 comp rx=0 tx=0).stop 2023-12-19T18:00:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.171+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 msgr2=0x7fc9bc1427c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.171+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 0x7fc9bc1427c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fc9a400e8f0 tx=0x7fc9a400ec00 comp rx=0 tx=0).stop 2023-12-19T18:00:50.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 shutdown_connections 2023-12-19T18:00:50.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc99c065ad0 0x7fc99c067f90 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9bc15af30 0x7fc9bc145220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9bc15ab50 0x7fc9bc1427c0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 --2- 172.21.15.45:0/3251787817 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc9bc06f4a0 0x7fc9bc1420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 >> 172.21.15.45:0/3251787817 conn(0x7fc9bc0cba40 msgr2=0x7fc9bc0acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:50.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 shutdown_connections 2023-12-19T18:00:50.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.175+0000 7fc9c25d2700 1 -- 172.21.15.45:0/3251787817 wait complete. 2023-12-19T18:00:50.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:59:38.443332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:59:39.328753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:59:49.559908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:00:50.206 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:00:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f688d8c6700 1 Processor -- start 2023-12-19T18:00:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f688d8c6700 1 -- start start 2023-12-19T18:00:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f688d8c6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6888071ae0 0x7f68880cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f688d8c6700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68880b1b80 con 0x7f68881443e0 2023-12-19T18:00:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f688d8c6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68881447c0 con 0x7f68880cb840 2023-12-19T18:00:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f688d8c6700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68880b1830 con 0x7f6888071ae0 2023-12-19T18:00:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f6886ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f68881443e0 0x7f68880713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41832/0 (socket says 172.21.15.45:41832) 2023-12-19T18:00:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f6886ffd700 1 -- 172.21.15.45:0/1795656355 learned_addr learned my addr 172.21.15.45:0/1795656355 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.383+0000 7f68867fc700 1 --2- 172.21.15.45:0/1795656355 >> v2:172.21.15.73:3300/0 conn(0x7f6888071ae0 0x7f68880cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f6885ffb700 1 -- 172.21.15.45:0/1795656355 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000884463 0 0) 0x7f68880b1b80 con 0x7f68881443e0 2023-12-19T18:00:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f6885ffb700 1 -- 172.21.15.45:0/1795656355 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f68700035d0 con 0x7f68881443e0 2023-12-19T18:00:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f6885ffb700 1 -- 172.21.15.45:0/1795656355 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879464172 0 0) 0x7f68881447c0 con 0x7f68880cb840 2023-12-19T18:00:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f68867fc700 1 -- 172.21.15.45:0/1795656355 >> v1:172.21.15.73:6789/0 conn(0x7f68880cb840 legacy=0x7f68880b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f68867fc700 1 -- 172.21.15.45:0/1795656355 >> v1:172.21.15.45:6789/0 conn(0x7f68881443e0 legacy=0x7f68880713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f68867fc700 1 -- 172.21.15.45:0/1795656355 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880cc070 con 0x7f6888071ae0 2023-12-19T18:00:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f68867fc700 1 --2- 172.21.15.45:0/1795656355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6888071ae0 0x7f68880cb300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f687c009850 tx=0x7f687c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4530a9b7e6eb431c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f6885ffb700 1 -- 172.21.15.45:0/1795656355 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c011830 con 0x7f6888071ae0 2023-12-19T18:00:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f6885ffb700 1 -- 172.21.15.45:0/1795656355 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687c011990 con 0x7f6888071ae0 2023-12-19T18:00:50.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f6885ffb700 1 -- 172.21.15.45:0/1795656355 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687c011d40 con 0x7f6888071ae0 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 -- 172.21.15.45:0/1795656355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6888071ae0 msgr2=0x7f68880cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 --2- 172.21.15.45:0/1795656355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6888071ae0 0x7f68880cb300 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f687c009850 tx=0x7f687c009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 -- 172.21.15.45:0/1795656355 shutdown_connections 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 --2- 172.21.15.45:0/1795656355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6888071ae0 0x7f68880cb300 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 -- 172.21.15.45:0/1795656355 >> 172.21.15.45:0/1795656355 conn(0x7f68880cf5a0 msgr2=0x7f6888070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 -- 172.21.15.45:0/1795656355 shutdown_connections 2023-12-19T18:00:50.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.387+0000 7f688d8c6700 1 -- 172.21.15.45:0/1795656355 wait complete. 2023-12-19T18:00:50.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 Processor -- start 2023-12-19T18:00:50.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 -- start start 2023-12-19T18:00:50.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 0x7f688813a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68881443e0 0x7f688813b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f688813a630 0x7f6888159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6888139c60 con 0x7f68880cb840 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688813ba90 con 0x7f688813a630 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.391+0000 7f688d8c6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688813bd70 con 0x7f68881443e0 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 0x7f688813a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 0x7f688813a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57726/0 (socket says 172.21.15.45:57726) 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 -- 172.21.15.45:0/2491345863 learned_addr learned my addr 172.21.15.45:0/2491345863 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f68867fc700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68881443e0 0x7f688813b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f68877fe700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f688813a630 0x7f6888159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 -- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68881443e0 msgr2=0x7f688813b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68881443e0 0x7f688813b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 -- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f688813a630 msgr2=0x7f6888159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f688813a630 0x7f6888159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 -- 172.21.15.45:0/2491345863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f687c0094b0 con 0x7f68880cb840 2023-12-19T18:00:50.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f6886ffd700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 0x7f688813a0f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f6878001260 tx=0x7f687800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68780074e0 con 0x7f68880cb840 2023-12-19T18:00:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688813c050 con 0x7f68880cb840 2023-12-19T18:00:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878007640 con 0x7f68880cb840 2023-12-19T18:00:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878005a50 con 0x7f68880cb840 2023-12-19T18:00:50.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.395+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688813b550 con 0x7f68880cb840 2023-12-19T18:00:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.399+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6888139a20 con 0x7f68880cb840 2023-12-19T18:00:50.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.399+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6878005bb0 con 0x7f68880cb840 2023-12-19T18:00:50.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.399+0000 7f686ffff700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6874065ad0 0x7f6874067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.403+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f6878082860 con 0x7f68880cb840 2023-12-19T18:00:50.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.403+0000 7f68867fc700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6874065ad0 0x7f6874067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.403+0000 7f68867fc700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6874065ad0 0x7f6874067f90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f687c0090b0 tx=0x7f687c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:50.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.407+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f687804fe70 con 0x7f68880cb840 2023-12-19T18:00:50.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f688804ed30 con 0x7f68880cb840 2023-12-19T18:00:50.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f686ffff700 1 -- 172.21.15.45:0/2491345863 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6878005e60 con 0x7f68880cb840 2023-12-19T18:00:50.589 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:00:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6874065ad0 msgr2=0x7f6874067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6874065ad0 0x7f6874067f90 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f687c0090b0 tx=0x7f687c008030 comp rx=0 tx=0).stop 2023-12-19T18:00:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 msgr2=0x7f688813a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 0x7f688813a0f0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f6878001260 tx=0x7f687800c7d0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 shutdown_connections 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6874065ad0 0x7f6874067f90 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f688813a630 0x7f6888159e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f68881443e0 0x7f688813b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 --2- 172.21.15.45:0/2491345863 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f68880cb840 0x7f688813a0f0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.583+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 >> 172.21.15.45:0/2491345863 conn(0x7f6888071ae0 msgr2=0x7f68880cab40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.587+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 shutdown_connections 2023-12-19T18:00:50.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.587+0000 7f688d8c6700 1 -- 172.21.15.45:0/2491345863 wait complete. 2023-12-19T18:00:50.613 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:00:50.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 Processor -- start 2023-12-19T18:00:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 -- start start 2023-12-19T18:00:50.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb8500cb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb85006b730 0x7fb8500704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8500cccc0 con 0x7fb8500cebd0 2023-12-19T18:00:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500cbe60 con 0x7fb85006b730 2023-12-19T18:00:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb854c71700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500cc0b0 con 0x7fb850071f30 2023-12-19T18:00:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb84ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb85006b730 0x7fb8500704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb84ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb85006b730 0x7fb8500704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57730/0 (socket says 172.21.15.45:57730) 2023-12-19T18:00:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb84ed9d700 1 -- 172.21.15.45:0/3507806715 learned_addr learned my addr 172.21.15.45:0/3507806715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.803+0000 7fb84e59c700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb8500cb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84ed9d700 1 -- 172.21.15.45:0/3507806715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 msgr2=0x7fb8500cb920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84ed9d700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb8500cb920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84ed9d700 1 -- 172.21.15.45:0/3507806715 >> v1:172.21.15.73:6789/0 conn(0x7fb8500cebd0 legacy=0x7fb85006b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84ed9d700 1 -- 172.21.15.45:0/3507806715 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500cc390 con 0x7fb85006b730 2023-12-19T18:00:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84e59c700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb8500cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84dd9b700 1 -- 172.21.15.45:0/3507806715 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 91568987 0 0) 0x7fb8500cccc0 con 0x7fb8500cebd0 2023-12-19T18:00:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84ed9d700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8500704c0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb848009e50 tx=0x7fb84800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=151effe9f7eb0ef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84dd9b700 1 -- 172.21.15.45:0/3507806715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800e070 con 0x7fb85006b730 2023-12-19T18:00:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84dd9b700 1 -- 172.21.15.45:0/3507806715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84800b910 con 0x7fb85006b730 2023-12-19T18:00:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb84dd9b700 1 -- 172.21.15.45:0/3507806715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84800bcc0 con 0x7fb85006b730 2023-12-19T18:00:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 -- 172.21.15.45:0/3507806715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 msgr2=0x7fb8500704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8500704c0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fb848009e50 tx=0x7fb84800b330 comp rx=0 tx=0).stop 2023-12-19T18:00:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 -- 172.21.15.45:0/3507806715 shutdown_connections 2023-12-19T18:00:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8500704c0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 --2- 172.21.15.45:0/3507806715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb8500cb920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 -- 172.21.15.45:0/3507806715 >> 172.21.15.45:0/3507806715 conn(0x7fb8500cd6e0 msgr2=0x7fb8500cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 -- 172.21.15.45:0/3507806715 shutdown_connections 2023-12-19T18:00:50.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.807+0000 7fb854c71700 1 -- 172.21.15.45:0/3507806715 wait complete. 2023-12-19T18:00:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.811+0000 7fb854c71700 1 Processor -- start 2023-12-19T18:00:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.811+0000 7fb854c71700 1 -- start start 2023-12-19T18:00:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8501f2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb850157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8500cebd0 0x7fb8500b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500b4750 con 0x7fb85006b730 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500b55f0 con 0x7fb8500cebd0 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500b49e0 con 0x7fb850071f30 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8501f2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8501f2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57738/0 (socket says 172.21.15.45:57738) 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 -- 172.21.15.45:0/2138444763 learned_addr learned my addr 172.21.15.45:0/2138444763 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb847fff700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb850157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84ed9d700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8500cebd0 0x7fb8500b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 -- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 msgr2=0x7fb850157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb850157ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 -- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8500cebd0 msgr2=0x7fb8500b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8500cebd0 0x7fb8500b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:50.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 -- 172.21.15.45:0/2138444763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8400094b0 con 0x7fb85006b730 2023-12-19T18:00:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb847fff700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb850157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84ed9d700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8500cebd0 0x7fb8500b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb84e59c700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8501f2ad0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fb84000ebe0 tx=0x7fb840009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:50.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000c910 con 0x7fb85006b730 2023-12-19T18:00:50.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84000ca70 con 0x7fb85006b730 2023-12-19T18:00:50.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84000ce00 con 0x7fb85006b730 2023-12-19T18:00:50.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb848009b30 con 0x7fb85006b730 2023-12-19T18:00:50.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.815+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8500b4fa0 con 0x7fb85006b730 2023-12-19T18:00:50.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.819+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8500d0620 con 0x7fb85006b730 2023-12-19T18:00:50.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.819+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb840013470 con 0x7fb85006b730 2023-12-19T18:00:50.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.823+0000 7fb846ffd700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb830065ad0 0x7fb830067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:50.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.823+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fb840083660 con 0x7fb85006b730 2023-12-19T18:00:50.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.823+0000 7fb847fff700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb830065ad0 0x7fb830067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:50.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.823+0000 7fb847fff700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb830065ad0 0x7fb830067f90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb8500c7590 tx=0x7fb838009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:50.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:50.827+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb840050cd0 con 0x7fb85006b730 2023-12-19T18:00:51.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.011+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb85004ed30 con 0x7fb85006b730 2023-12-19T18:00:51.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.011+0000 7fb846ffd700 1 -- 172.21.15.45:0/2138444763 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8400542f0 con 0x7fb85006b730 2023-12-19T18:00:51.017 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:00:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb830065ad0 msgr2=0x7fb830067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb830065ad0 0x7fb830067f90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fb8500c7590 tx=0x7fb838009040 comp rx=0 tx=0).stop 2023-12-19T18:00:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 msgr2=0x7fb8501f2ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8501f2ad0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fb84000ebe0 tx=0x7fb840009ed0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 shutdown_connections 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb830065ad0 0x7fb830067f90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb8500cebd0 0x7fb8500b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb850071f30 0x7fb850157ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 --2- 172.21.15.45:0/2138444763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb85006b730 0x7fb8501f2ad0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 >> 172.21.15.45:0/2138444763 conn(0x7fb8500cd6e0 msgr2=0x7fb85015d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 shutdown_connections 2023-12-19T18:00:51.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.015+0000 7fb854c71700 1 -- 172.21.15.45:0/2138444763 wait complete. 2023-12-19T18:00:51.046 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:00:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.227+0000 7f4b96c5e700 1 Processor -- start 2023-12-19T18:00:51.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.227+0000 7f4b96c5e700 1 -- start start 2023-12-19T18:00:51.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b96c5e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b9015d090 0x7f4b900d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b96c5e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b900cff40 0x7f4b900b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b96c5e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b900d10e0 con 0x7f4b900cdff0 2023-12-19T18:00:51.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b96c5e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900b6040 con 0x7f4b900cff40 2023-12-19T18:00:51.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b96c5e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b900d13c0 con 0x7f4b9015d090 2023-12-19T18:00:51.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b900cff40 0x7f4b900b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b949fa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4b9015d090 0x7f4b900d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4b900cff40 0x7f4b900b6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57744/0 (socket says 172.21.15.45:57744) 2023-12-19T18:00:51.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 -- 172.21.15.45:0/1783477678 learned_addr learned my addr 172.21.15.45:0/1783477678 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b8f7fe700 1 -- 172.21.15.45:0/1783477678 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281181518 0 0) 0x7f4b900d10e0 con 0x7f4b900cdff0 2023-12-19T18:00:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 -- 172.21.15.45:0/1783477678 >> v2:172.21.15.73:3300/0 conn(0x7f4b9015d090 msgr2=0x7f4b900d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 --2- 172.21.15.45:0/1783477678 >> v2:172.21.15.73:3300/0 conn(0x7f4b9015d090 0x7f4b900d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 -- 172.21.15.45:0/1783477678 >> v1:172.21.15.73:6789/0 conn(0x7f4b900cdff0 legacy=0x7f4b900cf830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.231+0000 7f4b951fb700 1 -- 172.21.15.45:0/1783477678 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b900d16a0 con 0x7f4b900cff40 2023-12-19T18:00:51.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b951fb700 1 --2- 172.21.15.45:0/1783477678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900cff40 0x7f4b900b6490 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4b900b6180 tx=0x7f4b8800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adbeca0edaa7f65 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:51.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b8f7fe700 1 -- 172.21.15.45:0/1783477678 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8800e070 con 0x7f4b900cff40 2023-12-19T18:00:51.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b8f7fe700 1 -- 172.21.15.45:0/1783477678 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b88003a40 con 0x7f4b900cff40 2023-12-19T18:00:51.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b8f7fe700 1 -- 172.21.15.45:0/1783477678 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88003df0 con 0x7f4b900cff40 2023-12-19T18:00:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 -- 172.21.15.45:0/1783477678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900cff40 msgr2=0x7f4b900b6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/1783477678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900cff40 0x7f4b900b6490 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f4b900b6180 tx=0x7f4b8800b330 comp rx=0 tx=0).stop 2023-12-19T18:00:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 -- 172.21.15.45:0/1783477678 shutdown_connections 2023-12-19T18:00:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/1783477678 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b900cff40 0x7f4b900b6490 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/1783477678 >> v2:172.21.15.73:3300/0 conn(0x7f4b9015d090 0x7f4b900d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 -- 172.21.15.45:0/1783477678 >> 172.21.15.45:0/1783477678 conn(0x7f4b900b4b90 msgr2=0x7f4b900b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 -- 172.21.15.45:0/1783477678 shutdown_connections 2023-12-19T18:00:51.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.235+0000 7f4b96c5e700 1 -- 172.21.15.45:0/1783477678 wait complete. 2023-12-19T18:00:51.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.239+0000 7f4b96c5e700 1 Processor -- start 2023-12-19T18:00:51.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.239+0000 7f4b96c5e700 1 -- start start 2023-12-19T18:00:51.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 0x7f4b900cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b900cff40 0x7f4b900b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 0x7f4b901522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900c7e80 con 0x7f4b9015d090 2023-12-19T18:00:51.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cb400 con 0x7f4b900cdff0 2023-12-19T18:00:51.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b900cb6e0 con 0x7f4b900cff40 2023-12-19T18:00:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 0x7f4b901522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b8ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b900cff40 0x7f4b900b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b949fa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 0x7f4b900cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b8ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b900cff40 0x7f4b900b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:43678/0 (socket says 172.21.15.45:43678) 2023-12-19T18:00:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 0x7f4b901522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57750/0 (socket says 172.21.15.45:57750) 2023-12-19T18:00:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b8ffff700 1 -- 172.21.15.45:0/432033297 learned_addr learned my addr 172.21.15.45:0/432033297 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:51.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b949fa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 0x7f4b900cad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40950/0 (socket says 172.21.15.45:40950) 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 -- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b900cff40 msgr2=0x7f4b900b6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b900cff40 0x7f4b900b6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 -- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 msgr2=0x7f4b900cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 0x7f4b900cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 -- 172.21.15.45:0/432033297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b88009b30 con 0x7f4b9015d090 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b949fa700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 0x7f4b900cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:51.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b951fb700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 0x7f4b901522a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4b88014000 tx=0x7f4b88004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b88004440 con 0x7f4b9015d090 2023-12-19T18:00:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b880092e0 con 0x7f4b9015d090 2023-12-19T18:00:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b900c7b10 con 0x7f4b9015d090 2023-12-19T18:00:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b880047c0 con 0x7f4b9015d090 2023-12-19T18:00:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.243+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b900cb9c0 con 0x7f4b9015d090 2023-12-19T18:00:51.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.247+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b900cf120 con 0x7f4b9015d090 2023-12-19T18:00:51.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.247+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b88012430 con 0x7f4b9015d090 2023-12-19T18:00:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.251+0000 7f4b8d7fa700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b74065ad0 0x7f4b74067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.251+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f4b880847d0 con 0x7f4b9015d090 2023-12-19T18:00:51.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.251+0000 7f4b949fa700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b74065ad0 0x7f4b74067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.251+0000 7f4b949fa700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b74065ad0 0x7f4b74067f90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4b901f5c80 tx=0x7f4b84009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.255+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4b88051d20 con 0x7f4b9015d090 2023-12-19T18:00:51.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.435+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4b9004ed30 con 0x7f4b9015d090 2023-12-19T18:00:51.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b8d7fa700 1 -- 172.21.15.45:0/432033297 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4b88055340 con 0x7f4b9015d090 2023-12-19T18:00:51.444 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:00:51.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b74065ad0 msgr2=0x7f4b74067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b74065ad0 0x7f4b74067f90 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4b901f5c80 tx=0x7f4b84009240 comp rx=0 tx=0).stop 2023-12-19T18:00:51.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 msgr2=0x7f4b901522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 0x7f4b901522a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f4b88014000 tx=0x7f4b88004af0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 shutdown_connections 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b74065ad0 0x7f4b74067f90 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9015d090 0x7f4b901522a0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b900cff40 0x7f4b900b6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 --2- 172.21.15.45:0/432033297 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b900cdff0 0x7f4b900cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 >> 172.21.15.45:0/432033297 conn(0x7f4b900b4b90 msgr2=0x7f4b900d1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 shutdown_connections 2023-12-19T18:00:51.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.439+0000 7f4b96c5e700 1 -- 172.21.15.45:0/432033297 wait complete. 2023-12-19T18:00:51.468 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T18:00:51.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.651+0000 7fa72cb70700 1 Processor -- start 2023-12-19T18:00:51.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.651+0000 7fa72cb70700 1 -- start start 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72cb70700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa72815d090 0x7fa7280d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72cb70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72cb70700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7280d01e0 con 0x7fa7280cfd70 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72cb70700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7280b6040 con 0x7fa72815d090 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72cb70700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280d10e0 con 0x7fa7280cdff0 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa72815d090 0x7fa7280d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa726d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa7280cfd70 0x7fa72806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41846/0 (socket says 172.21.15.45:41846) 2023-12-19T18:00:51.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa726d9d700 1 -- 172.21.15.45:0/3648779757 learned_addr learned my addr 172.21.15.45:0/3648779757 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:51.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa725d9b700 1 --2- 172.21.15.45:0/3648779757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72559a700 1 -- 172.21.15.45:0/3648779757 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763569407 0 0) 0x7fa720001490 con 0x7fa7280cfd70 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72559a700 1 -- 172.21.15.45:0/3648779757 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7100035d0 con 0x7fa7280cfd70 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa725d9b700 1 -- 172.21.15.45:0/3648779757 >> v2:172.21.15.45:3300/0 conn(0x7fa72815d090 msgr2=0x7fa7280d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa725d9b700 1 --2- 172.21.15.45:0/3648779757 >> v2:172.21.15.45:3300/0 conn(0x7fa72815d090 0x7fa7280d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa725d9b700 1 -- 172.21.15.45:0/3648779757 >> v1:172.21.15.45:6789/0 conn(0x7fa7280cfd70 legacy=0x7fa72806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa725d9b700 1 -- 172.21.15.45:0/3648779757 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7280d13c0 con 0x7fa7280cdff0 2023-12-19T18:00:51.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.655+0000 7fa72659c700 1 --2- 172.21.15.45:0/3648779757 >> v2:172.21.15.45:3300/0 conn(0x7fa72815d090 0x7fa7280d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa725d9b700 1 --2- 172.21.15.45:0/3648779757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280cf830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009850 tx=0x7fa71c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30f015c000883eff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72559a700 1 -- 172.21.15.45:0/3648779757 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c011830 con 0x7fa7280cdff0 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72559a700 1 -- 172.21.15.45:0/3648779757 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c011990 con 0x7fa7280cdff0 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72559a700 1 -- 172.21.15.45:0/3648779757 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c011d40 con 0x7fa7280cdff0 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 -- 172.21.15.45:0/3648779757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 msgr2=0x7fa7280cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 --2- 172.21.15.45:0/3648779757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280cf830 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa71c009850 tx=0x7fa71c009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 -- 172.21.15.45:0/3648779757 shutdown_connections 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 --2- 172.21.15.45:0/3648779757 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280cf830 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 --2- 172.21.15.45:0/3648779757 >> v2:172.21.15.45:3300/0 conn(0x7fa72815d090 0x7fa7280d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 -- 172.21.15.45:0/3648779757 >> 172.21.15.45:0/3648779757 conn(0x7fa7280b4b90 msgr2=0x7fa7280b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 -- 172.21.15.45:0/3648779757 shutdown_connections 2023-12-19T18:00:51.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.659+0000 7fa72cb70700 1 -- 172.21.15.45:0/3648779757 wait complete. 2023-12-19T18:00:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 Processor -- start 2023-12-19T18:00:51.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 -- start start 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 0x7fa7281f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa72815d090 0x7fa72815b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280c8170 con 0x7fa7280cfd70 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa72815e5f0 con 0x7fa72815d090 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7280c7e90 con 0x7fa7280cdff0 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 0x7fa7281f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 0x7fa7281f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57768/0 (socket says 172.21.15.45:57768) 2023-12-19T18:00:51.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 -- 172.21.15.45:0/1850824819 learned_addr learned my addr 172.21.15.45:0/1850824819 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:51.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72659c700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa726d9d700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa72815d090 0x7fa72815b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 -- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 msgr2=0x7fa7280c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 -- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa72815d090 msgr2=0x7fa72815b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa72815d090 0x7fa72815b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 -- 172.21.15.45:0/1850824819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7180094b0 con 0x7fa7280cfd70 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72659c700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa726d9d700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa72815d090 0x7fa72815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa725d9b700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 0x7fa7281f2430 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0090b0 tx=0x7fa71c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c004480 con 0x7fa7280cfd70 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c0094b0 con 0x7fa7280cfd70 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71c01f070 con 0x7fa7280cfd70 2023-12-19T18:00:51.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71c003900 con 0x7fa7280cfd70 2023-12-19T18:00:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.663+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa72815eb70 con 0x7fa7280cfd70 2023-12-19T18:00:51.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.667+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa72804ed30 con 0x7fa7280cfd70 2023-12-19T18:00:51.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.667+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa71c021030 con 0x7fa7280cfd70 2023-12-19T18:00:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.671+0000 7fa716ffd700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa708065ad0 0x7fa708067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.671+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fa71c084930 con 0x7fa7280cfd70 2023-12-19T18:00:51.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.671+0000 7fa72659c700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa708065ad0 0x7fa708067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:51.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.671+0000 7fa72659c700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa708065ad0 0x7fa708067f90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa718009d30 tx=0x7fa718008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:51.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.675+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa71c051fa0 con 0x7fa7280cfd70 2023-12-19T18:00:51.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.847+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7fa7280c8ea0 con 0x7fa7280cfd70 2023-12-19T18:00:51.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa716ffd700 1 -- 172.21.15.45:0/1850824819 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v94) v1 ==== 106+0+11 (secure 0 0 0) 0x7fa71c006ce0 con 0x7fa7280cfd70 2023-12-19T18:00:51.857 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:00:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa708065ad0 msgr2=0x7fa708067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa708065ad0 0x7fa708067f90 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa718009d30 tx=0x7fa718008040 comp rx=0 tx=0).stop 2023-12-19T18:00:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 msgr2=0x7fa7281f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 0x7fa7281f2430 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fa71c0090b0 tx=0x7fa71c004770 comp rx=0 tx=0).stop 2023-12-19T18:00:51.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 shutdown_connections 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa708065ad0 0x7fa708067f90 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa72815d090 0x7fa72815b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7280cfd70 0x7fa7281f2430 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 --2- 172.21.15.45:0/1850824819 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa7280cdff0 0x7fa7280c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 >> 172.21.15.45:0/1850824819 conn(0x7fa7280b4b90 msgr2=0x7fa7280cc830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 shutdown_connections 2023-12-19T18:00:51.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:51.851+0000 7fa72cb70700 1 -- 172.21.15.45:0/1850824819 wait complete. 2023-12-19T18:00:51.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:00:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 Processor -- start 2023-12-19T18:00:52.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 -- start start 2023-12-19T18:00:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30601611c0 0x7f30600c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30600af720 0x7f30600afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30600b00c0 con 0x7f30601615a0 2023-12-19T18:00:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3060070340 con 0x7f30601611c0 2023-12-19T18:00:52.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.051+0000 7f3065158700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30600c3f90 con 0x7f30600af720 2023-12-19T18:00:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f30601611c0 0x7f30600c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f30601615a0 0x7f306006d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41856/0 (socket says 172.21.15.45:41856) 2023-12-19T18:00:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305f7fe700 1 -- 172.21.15.45:0/3689595468 learned_addr learned my addr 172.21.15.45:0/3689595468 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:52.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f3064957700 1 --2- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30600af720 0x7f30600afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305ffff700 1 -- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30600af720 msgr2=0x7f30600afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305ffff700 1 --2- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30600af720 0x7f30600afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305ffff700 1 -- 172.21.15.45:0/3689595468 >> v1:172.21.15.45:6789/0 conn(0x7f30601615a0 legacy=0x7f306006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305ffff700 1 -- 172.21.15.45:0/3689595468 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30600c4270 con 0x7f30601611c0 2023-12-19T18:00:52.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305ffff700 1 --2- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601611c0 0x7f30600c3920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3050009850 tx=0x7f3050009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dca83035d94d0470 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305effd700 1 -- 172.21.15.45:0/3689595468 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011830 con 0x7f30601611c0 2023-12-19T18:00:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305effd700 1 -- 172.21.15.45:0/3689595468 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3050011990 con 0x7f30601611c0 2023-12-19T18:00:52.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f305effd700 1 -- 172.21.15.45:0/3689595468 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050011d40 con 0x7f30601611c0 2023-12-19T18:00:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f3065158700 1 -- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601611c0 msgr2=0x7f30600c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.055+0000 7f3065158700 1 --2- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601611c0 0x7f30600c3920 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3050009850 tx=0x7f3050009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.059+0000 7f3065158700 1 -- 172.21.15.45:0/3689595468 shutdown_connections 2023-12-19T18:00:52.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.059+0000 7f3065158700 1 --2- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30600af720 0x7f30600afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.059+0000 7f3065158700 1 --2- 172.21.15.45:0/3689595468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601611c0 0x7f30600c3920 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.059+0000 7f3065158700 1 -- 172.21.15.45:0/3689595468 >> 172.21.15.45:0/3689595468 conn(0x7f30600cb900 msgr2=0x7f30600b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:52.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.059+0000 7f3065158700 1 -- 172.21.15.45:0/3689595468 shutdown_connections 2023-12-19T18:00:52.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.059+0000 7f3065158700 1 -- 172.21.15.45:0/3689595468 wait complete. 2023-12-19T18:00:52.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 Processor -- start 2023-12-19T18:00:52.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 -- start start 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 0x7f306015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30601611c0 0x7f30601f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601615a0 0x7f3060160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30601f7b30 con 0x7f30600af720 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30601607d0 con 0x7f30601615a0 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3065158700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306015d560 con 0x7f30601611c0 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 0x7f306015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 0x7f306015cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57772/0 (socket says 172.21.15.45:57772) 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 -- 172.21.15.45:0/2267347314 learned_addr learned my addr 172.21.15.45:0/2267347314 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305f7fe700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30601611c0 0x7f30601f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f3064957700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601615a0 0x7f3060160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 -- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30601611c0 msgr2=0x7f30601f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30601611c0 0x7f30601f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 -- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601615a0 msgr2=0x7f3060160290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601615a0 0x7f3060160290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.063+0000 7f305ffff700 1 -- 172.21.15.45:0/2267347314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30500094b0 con 0x7f30600af720 2023-12-19T18:00:52.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f305ffff700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 0x7f306015cf80 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f30500090b0 tx=0x7f3050004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050004480 con 0x7f30600af720 2023-12-19T18:00:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305001f070 con 0x7f30600af720 2023-12-19T18:00:52.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f306015f7b0 con 0x7f30600af720 2023-12-19T18:00:52.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3050003900 con 0x7f30600af720 2023-12-19T18:00:52.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f306015fd70 con 0x7f30600af720 2023-12-19T18:00:52.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.067+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306006e760 con 0x7f30600af720 2023-12-19T18:00:52.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.071+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3050021030 con 0x7f30600af720 2023-12-19T18:00:52.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.071+0000 7f305cff9700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f304c065ad0 0x7f304c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.071+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f30500847c0 con 0x7f30600af720 2023-12-19T18:00:52.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.071+0000 7f305f7fe700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f304c065ad0 0x7f304c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.071+0000 7f305f7fe700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f304c065ad0 0x7f304c067f90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f30601f4760 tx=0x7f3054009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:52.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.079+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3050051f50 con 0x7f30600af720 2023-12-19T18:00:52.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.271+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3060067760 con 0x7f30600af720 2023-12-19T18:00:52.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.271+0000 7f305cff9700 1 -- 172.21.15.45:0/2267347314 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v94) v1 ==== 80+0+366 (secure 0 0 0) 0x7f3050055570 con 0x7f30600af720 2023-12-19T18:00:52.280 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6835/3302507960 2023-12-20T18:00:10.938718+0000 2023-12-19T18:00:52.280 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6835/1645920961 2023-12-20T18:00:05.266321+0000 2023-12-19T18:00:52.280 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6834/3302507960 2023-12-20T18:00:10.938718+0000 2023-12-19T18:00:52.280 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6834/1645920961 2023-12-20T18:00:05.266321+0000 2023-12-19T18:00:52.281 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6835/2667696599 2023-12-20T18:00:04.222190+0000 2023-12-19T18:00:52.281 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6834/2667696599 2023-12-20T18:00:04.222190+0000 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f304c065ad0 msgr2=0x7f304c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f304c065ad0 0x7f304c067f90 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f30601f4760 tx=0x7f3054009040 comp rx=0 tx=0).stop 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 msgr2=0x7f306015cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 0x7f306015cf80 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f30500090b0 tx=0x7f3050004770 comp rx=0 tx=0).stop 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 shutdown_connections 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f304c065ad0 0x7f304c067f90 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30601615a0 0x7f3060160290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30601611c0 0x7f30601f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 --2- 172.21.15.45:0/2267347314 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30600af720 0x7f306015cf80 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 >> 172.21.15.45:0/2267347314 conn(0x7f30600cb900 msgr2=0x7f30600cd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 shutdown_connections 2023-12-19T18:00:52.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.275+0000 7f3065158700 1 -- 172.21.15.45:0/2267347314 wait complete. 2023-12-19T18:00:52.286 INFO:teuthology.orchestra.run.smithi045.stderr:listed 6 entries 2023-12-19T18:00:52.305 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T18:00:52.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:52.305 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T18:00:52.337 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[54060]: fuse finished with error 0 and tester_r 0 2023-12-19T18:00:52.340 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:00:52.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:52.341 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:00:52.526 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:00:52.526 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:00:52.544 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:00:52.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:00:52.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:52.544 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T18:00:52.608 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T18:00:52.608 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:00:52.609 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:00:52.609 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:00:52.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:00:52.628 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:00:52.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:52.628 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T18:00:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T18:00:52.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:00:52.695 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:00:52.695 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:00:52.710 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:00:52.710 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:00:52.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:00:52.710 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T18:00:52.774 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T18:00:52.775 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:00:52.776 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.955+0000 7fea6b59e700 1 Processor -- start 2023-12-19T18:00:52.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.955+0000 7fea6b59e700 1 -- start start 2023-12-19T18:00:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea6c0b88b0 0x7fea6c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06f3b0 0x7fea6c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6c0d1820 con 0x7fea6c06ea90 2023-12-19T18:00:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6b59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea6c0d1630 con 0x7fea6c0b88b0 2023-12-19T18:00:52.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0d1b00 con 0x7fea6c06f3b0 2023-12-19T18:00:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea63fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fea6c0b88b0 0x7fea6c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fea6c06ea90 0x7fea6c0d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41866/0 (socket says 172.21.15.45:41866) 2023-12-19T18:00:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6a59c700 1 -- 172.21.15.45:0/1183715817 learned_addr learned my addr 172.21.15.45:0/1183715817 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:52.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6ad9d700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06f3b0 0x7fea6c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea63fff700 1 -- 172.21.15.45:0/1183715817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06f3b0 msgr2=0x7fea6c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea63fff700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06f3b0 0x7fea6c06f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea63fff700 1 -- 172.21.15.45:0/1183715817 >> v1:172.21.15.45:6789/0 conn(0x7fea6c06ea90 legacy=0x7fea6c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea63fff700 1 -- 172.21.15.45:0/1183715817 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6c0d1de0 con 0x7fea6c0b88b0 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea6ad9d700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06f3b0 0x7fea6c06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea69d9b700 1 -- 172.21.15.45:0/1183715817 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4106927618 0 0) 0x7fea6c0d1820 con 0x7fea6c06ea90 2023-12-19T18:00:52.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea63fff700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0b88b0 0x7fea6c06ee70 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fea54009850 tx=0x7fea54009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70edfe56edf3c63b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:52.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea69d9b700 1 -- 172.21.15.45:0/1183715817 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011830 con 0x7fea6c0b88b0 2023-12-19T18:00:52.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea69d9b700 1 -- 172.21.15.45:0/1183715817 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea54011990 con 0x7fea6c0b88b0 2023-12-19T18:00:52.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.959+0000 7fea69d9b700 1 -- 172.21.15.45:0/1183715817 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54011d20 con 0x7fea6c0b88b0 2023-12-19T18:00:52.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 -- 172.21.15.45:0/1183715817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0b88b0 msgr2=0x7fea6c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0b88b0 0x7fea6c06ee70 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7fea54009850 tx=0x7fea54009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:52.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 -- 172.21.15.45:0/1183715817 shutdown_connections 2023-12-19T18:00:52.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06f3b0 0x7fea6c06f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1183715817 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c0b88b0 0x7fea6c06ee70 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 -- 172.21.15.45:0/1183715817 >> 172.21.15.45:0/1183715817 conn(0x7fea6c0b46d0 msgr2=0x7fea6c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:52.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 -- 172.21.15.45:0/1183715817 shutdown_connections 2023-12-19T18:00:52.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 -- 172.21.15.45:0/1183715817 wait complete. 2023-12-19T18:00:52.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 Processor -- start 2023-12-19T18:00:52.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 -- start start 2023-12-19T18:00:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.963+0000 7fea6b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06ea90 0x7fea6c158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 0x7fea6c0cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0b88b0 0x7fea6c158140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0ccc70 con 0x7fea6c06f3b0 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c158680 con 0x7fea6c0b88b0 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6c0cb8a0 con 0x7fea6c06ea90 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 0x7fea6c0cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 0x7fea6c0cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57786/0 (socket says 172.21.15.45:57786) 2023-12-19T18:00:52.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 -- 172.21.15.45:0/1531515509 learned_addr learned my addr 172.21.15.45:0/1531515509 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6ad9d700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0b88b0 0x7fea6c158140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6a59c700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06ea90 0x7fea6c158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 -- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06ea90 msgr2=0x7fea6c158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06ea90 0x7fea6c158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 -- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0b88b0 msgr2=0x7fea6c158140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0b88b0 0x7fea6c158140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 -- 172.21.15.45:0/1531515509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea540094b0 con 0x7fea6c06f3b0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6a59c700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06ea90 0x7fea6c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6ad9d700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0b88b0 0x7fea6c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea63fff700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 0x7fea6c0cc730 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fea54000c00 tx=0x7fea54004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54004500 con 0x7fea6c06f3b0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea540036c0 con 0x7fea6c06f3b0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6c0cbb80 con 0x7fea6c06f3b0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54003a50 con 0x7fea6c06f3b0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6c0c8210 con 0x7fea6c06f3b0 2023-12-19T18:00:52.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.967+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6c067760 con 0x7fea6c06f3b0 2023-12-19T18:00:52.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.971+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fea54003bb0 con 0x7fea6c06f3b0 2023-12-19T18:00:52.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.971+0000 7fea62ffd700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea4c065ad0 0x7fea4c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.971+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fea54021030 con 0x7fea6c06f3b0 2023-12-19T18:00:52.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.971+0000 7fea6a59c700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea4c065ad0 0x7fea4c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:52.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.975+0000 7fea6a59c700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea4c065ad0 0x7fea4c067f90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000f60 tx=0x7fea5c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:52.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:52.979+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fea540523c0 con 0x7fea6c06f3b0 2023-12-19T18:00:53.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.195+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea6c0b2050 con 0x7fea6c06f3b0 2023-12-19T18:00:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea62ffd700 1 -- 172.21.15.45:0/1531515509 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fea54015090 con 0x7fea6c06f3b0 2023-12-19T18:00:53.205 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:53.205 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:13.982153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea4c065ad0 msgr2=0x7fea4c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea4c065ad0 0x7fea4c067f90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fea5c000f60 tx=0x7fea5c009040 comp rx=0 tx=0).stop 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 msgr2=0x7fea6c0cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 0x7fea6c0cc730 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fea54000c00 tx=0x7fea54004770 comp rx=0 tx=0).stop 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 shutdown_connections 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea4c065ad0 0x7fea4c067f90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fea6c0b88b0 0x7fea6c158140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fea6c06f3b0 0x7fea6c0cc730 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 --2- 172.21.15.45:0/1531515509 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fea6c06ea90 0x7fea6c158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 >> 172.21.15.45:0/1531515509 conn(0x7fea6c0b46d0 msgr2=0x7fea6c0cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 shutdown_connections 2023-12-19T18:00:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.199+0000 7fea6b59e700 1 -- 172.21.15.45:0/1531515509 wait complete. 2023-12-19T18:00:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 70 2023-12-19T18:00:53.229 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:00:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.403+0000 7f427b498700 1 Processor -- start 2023-12-19T18:00:53.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.403+0000 7f427b498700 1 -- start start 2023-12-19T18:00:53.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427b498700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f42740b88b0 0x7f427406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427b498700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f427406f3b0 0x7f427406f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427b498700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42740d1820 con 0x7f427406ea90 2023-12-19T18:00:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427b498700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42740d1630 con 0x7f427406f3b0 2023-12-19T18:00:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427b498700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42740d1b00 con 0x7f42740b88b0 2023-12-19T18:00:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427a496700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f427406ea90 0x7f42740d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41872/0 (socket says 172.21.15.45:41872) 2023-12-19T18:00:53.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427a496700 1 -- 172.21.15.45:0/139108810 learned_addr learned my addr 172.21.15.45:0/139108810 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427ac97700 1 --2- 172.21.15.45:0/139108810 >> v2:172.21.15.45:3300/0 conn(0x7f427406f3b0 0x7f427406f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f4279c95700 1 --2- 172.21.15.45:0/139108810 >> v2:172.21.15.73:3300/0 conn(0x7f42740b88b0 0x7f427406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427ac97700 1 -- 172.21.15.45:0/139108810 >> v2:172.21.15.73:3300/0 conn(0x7f42740b88b0 msgr2=0x7f427406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427ac97700 1 --2- 172.21.15.45:0/139108810 >> v2:172.21.15.73:3300/0 conn(0x7f42740b88b0 0x7f427406ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427ac97700 1 -- 172.21.15.45:0/139108810 >> v1:172.21.15.45:6789/0 conn(0x7f427406ea90 legacy=0x7f42740d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427ac97700 1 -- 172.21.15.45:0/139108810 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42740d1de0 con 0x7f427406f3b0 2023-12-19T18:00:53.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f4279494700 1 -- 172.21.15.45:0/139108810 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 552114344 0 0) 0x7f42740d1820 con 0x7f427406ea90 2023-12-19T18:00:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f427ac97700 1 --2- 172.21.15.45:0/139108810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406f3b0 0x7f427406f820 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f42740b2610 tx=0x7f426c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed2c41543451694 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f4279494700 1 -- 172.21.15.45:0/139108810 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c00e070 con 0x7f427406f3b0 2023-12-19T18:00:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f4279494700 1 -- 172.21.15.45:0/139108810 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f426c00bb20 con 0x7f427406f3b0 2023-12-19T18:00:53.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.407+0000 7f4279494700 1 -- 172.21.15.45:0/139108810 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426c012430 con 0x7f427406f3b0 2023-12-19T18:00:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 -- 172.21.15.45:0/139108810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406f3b0 msgr2=0x7f427406f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 --2- 172.21.15.45:0/139108810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406f3b0 0x7f427406f820 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f42740b2610 tx=0x7f426c00b330 comp rx=0 tx=0).stop 2023-12-19T18:00:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 -- 172.21.15.45:0/139108810 shutdown_connections 2023-12-19T18:00:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 --2- 172.21.15.45:0/139108810 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406f3b0 0x7f427406f820 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 --2- 172.21.15.45:0/139108810 >> v2:172.21.15.73:3300/0 conn(0x7f42740b88b0 0x7f427406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 -- 172.21.15.45:0/139108810 >> 172.21.15.45:0/139108810 conn(0x7f42740b46d0 msgr2=0x7f42740b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 -- 172.21.15.45:0/139108810 shutdown_connections 2023-12-19T18:00:53.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 -- 172.21.15.45:0/139108810 wait complete. 2023-12-19T18:00:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 Processor -- start 2023-12-19T18:00:53.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.411+0000 7f427b498700 1 -- start start 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 0x7f4274157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f427406f3b0 0x7f42740cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42740b88b0 0x7f42740cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740cbed0 con 0x7f427406ea90 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42740cb250 con 0x7f42740b88b0 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42740cb530 con 0x7f427406f3b0 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 0x7f4274157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 0x7f4274157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57808/0 (socket says 172.21.15.45:57808) 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 -- 172.21.15.45:0/1025252193 learned_addr learned my addr 172.21.15.45:0/1025252193 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:53.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f4279c95700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f427406f3b0 0x7f42740cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427ac97700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42740b88b0 0x7f42740cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 -- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f427406f3b0 msgr2=0x7f42740cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f427406f3b0 0x7f42740cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 -- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42740b88b0 msgr2=0x7f42740cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42740b88b0 0x7f42740cc830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 -- 172.21.15.45:0/1025252193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426c009a70 con 0x7f427406ea90 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f4279c95700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f427406f3b0 0x7f42740cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427a496700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 0x7f4274157910 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f427000c4e0 tx=0x7f427000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270004ca0 con 0x7f427406ea90 2023-12-19T18:00:53.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4270004e20 con 0x7f427406ea90 2023-12-19T18:00:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4270007310 con 0x7f427406ea90 2023-12-19T18:00:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42740cb810 con 0x7f427406ea90 2023-12-19T18:00:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.415+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4274157e50 con 0x7f427406ea90 2023-12-19T18:00:53.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.419+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42740cc010 con 0x7f427406ea90 2023-12-19T18:00:53.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.419+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4270007470 con 0x7f427406ea90 2023-12-19T18:00:53.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.419+0000 7f426affd700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4258065b50 0x7f4258068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.419+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f4270082fe0 con 0x7f427406ea90 2023-12-19T18:00:53.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.419+0000 7f4279c95700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4258065b50 0x7f4258068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.423+0000 7f4279c95700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4258065b50 0x7f4258068010 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f42741569d0 tx=0x7f4264008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.427+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4270050730 con 0x7f427406ea90 2023-12-19T18:00:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.607+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4274067760 con 0x7f427406ea90 2023-12-19T18:00:53.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.611+0000 7f426affd700 1 -- 172.21.15.45:0/1025252193 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18435 (secure 0 0 0) 0x7f4270007720 con 0x7f427406ea90 2023-12-19T18:00:53.618 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:53.618 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":94,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:00:10.965536+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6835/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6834/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6834/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6835/2667696599":"2023-12-20T18:00:04.222190+0000","172.21.15.73:6834/2667696599":"2023-12-20T18:00:04.222190+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4258065b50 msgr2=0x7f4258068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4258065b50 0x7f4258068010 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f42741569d0 tx=0x7f4264008040 comp rx=0 tx=0).stop 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 msgr2=0x7f4274157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 0x7f4274157910 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f427000c4e0 tx=0x7f427000c7f0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 shutdown_connections 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4258065b50 0x7f4258068010 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42740b88b0 0x7f42740cc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f427406f3b0 0x7f42740cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 --2- 172.21.15.45:0/1025252193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f427406ea90 0x7f4274157910 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 >> 172.21.15.45:0/1025252193 conn(0x7f42740b46d0 msgr2=0x7f427406f790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:53.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 shutdown_connections 2023-12-19T18:00:53.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.615+0000 7f427b498700 1 -- 172.21.15.45:0/1025252193 wait complete. 2023-12-19T18:00:53.648 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T17:59:38.443332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T17:59:39.328753+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T17:59:49.559908+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:00:53.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:00:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.831+0000 7f89b28aa700 1 Processor -- start 2023-12-19T18:00:53.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.831+0000 7f89b28aa700 1 -- start start 2023-12-19T18:00:53.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b28aa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac15cf20 0x7f89ac0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b28aa700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89ac0cdfd0 0x7f89ac0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b28aa700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89ac15d300 con 0x7f89ac0b8580 2023-12-19T18:00:53.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b28aa700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89ac0d1550 con 0x7f89ac0cdfd0 2023-12-19T18:00:53.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b28aa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac0d1830 con 0x7f89ac15cf20 2023-12-19T18:00:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b20a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89ac0cdfd0 0x7f89ac0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b10a7700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f89ac0b8580 0x7f89ac0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41874/0 (socket says 172.21.15.45:41874) 2023-12-19T18:00:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b10a7700 1 -- 172.21.15.45:0/1921568893 learned_addr learned my addr 172.21.15.45:0/1921568893 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b20a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f89ac0cdfd0 0x7f89ac0b5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57822/0 (socket says 172.21.15.45:57822) 2023-12-19T18:00:53.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b18a8700 1 --2- 172.21.15.45:0/1921568893 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac15cf20 0x7f89ac0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b20a9700 1 -- 172.21.15.45:0/1921568893 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac15cf20 msgr2=0x7f89ac0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b20a9700 1 --2- 172.21.15.45:0/1921568893 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac15cf20 0x7f89ac0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b20a9700 1 -- 172.21.15.45:0/1921568893 >> v1:172.21.15.45:6789/0 conn(0x7f89ac0b8580 legacy=0x7f89ac0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b20a9700 1 -- 172.21.15.45:0/1921568893 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ac0d1b10 con 0x7f89ac0cdfd0 2023-12-19T18:00:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.835+0000 7f89b08a6700 1 -- 172.21.15.45:0/1921568893 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2746055166 0 0) 0x7f89ac15d300 con 0x7f89ac0b8580 2023-12-19T18:00:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b20a9700 1 --2- 172.21.15.45:0/1921568893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0cdfd0 0x7f89ac0b5d20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009d90 tx=0x7f89a400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37353941b1b00f02 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b08a6700 1 -- 172.21.15.45:0/1921568893 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a400e070 con 0x7f89ac0cdfd0 2023-12-19T18:00:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b08a6700 1 -- 172.21.15.45:0/1921568893 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a400bb20 con 0x7f89ac0cdfd0 2023-12-19T18:00:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b08a6700 1 -- 172.21.15.45:0/1921568893 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4012430 con 0x7f89ac0cdfd0 2023-12-19T18:00:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 -- 172.21.15.45:0/1921568893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0cdfd0 msgr2=0x7f89ac0b5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1921568893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0cdfd0 0x7f89ac0b5d20 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009d90 tx=0x7f89a400b330 comp rx=0 tx=0).stop 2023-12-19T18:00:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 -- 172.21.15.45:0/1921568893 shutdown_connections 2023-12-19T18:00:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1921568893 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0cdfd0 0x7f89ac0b5d20 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1921568893 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac15cf20 0x7f89ac0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 -- 172.21.15.45:0/1921568893 >> 172.21.15.45:0/1921568893 conn(0x7f89ac0b4670 msgr2=0x7f89ac0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 -- 172.21.15.45:0/1921568893 shutdown_connections 2023-12-19T18:00:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.839+0000 7f89b28aa700 1 -- 172.21.15.45:0/1921568893 wait complete. 2023-12-19T18:00:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 Processor -- start 2023-12-19T18:00:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 -- start start 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 0x7f89ac1f1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac0cdfd0 0x7f89ac0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89ac15cf20 0x7f89ac1f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac159700 con 0x7f89ac0b8580 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac158af0 con 0x7f89ac15cf20 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89ac158dd0 con 0x7f89ac0cdfd0 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 0x7f89ac1f1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 0x7f89ac1f1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57828/0 (socket says 172.21.15.45:57828) 2023-12-19T18:00:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 -- 172.21.15.45:0/1351329076 learned_addr learned my addr 172.21.15.45:0/1351329076 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b10a7700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac0cdfd0 0x7f89ac0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b20a9700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89ac15cf20 0x7f89ac1f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 -- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac0cdfd0 msgr2=0x7f89ac0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac0cdfd0 0x7f89ac0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 -- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89ac15cf20 msgr2=0x7f89ac1f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89ac15cf20 0x7f89ac1f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 -- 172.21.15.45:0/1351329076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a4009a70 con 0x7f89ac0b8580 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b20a9700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89ac15cf20 0x7f89ac1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:53.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b18a8700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 0x7f89ac1f1c80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f89a800e840 tx=0x7f89a800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80095a0 con 0x7f89ac0b8580 2023-12-19T18:00:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a800c690 con 0x7f89ac0b8580 2023-12-19T18:00:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89ac1590b0 con 0x7f89ac0b8580 2023-12-19T18:00:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a800ca00 con 0x7f89ac0b8580 2023-12-19T18:00:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.843+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89ac1f21c0 con 0x7f89ac0b8580 2023-12-19T18:00:53.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.847+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89ac04ed30 con 0x7f89ac0b8580 2023-12-19T18:00:53.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.847+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f89a800cb60 con 0x7f89ac0b8580 2023-12-19T18:00:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.851+0000 7f89a27fc700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8990065ad0 0x7f8990067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:53.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.851+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f89a8083590 con 0x7f89ac0b8580 2023-12-19T18:00:53.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.851+0000 7f89b10a7700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8990065ad0 0x7f8990067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:53.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.851+0000 7f89b10a7700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8990065ad0 0x7f8990067f90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f89ac159950 tx=0x7f899c007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:53.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:53.855+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f89a8050ad0 con 0x7f89ac0b8580 2023-12-19T18:00:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.031+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f89ac0b5ce0 con 0x7f89ac0b8580 2023-12-19T18:00:54.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.031+0000 7f89a27fc700 1 -- 172.21.15.45:0/1351329076 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) v1 ==== 93+0+10 (secure 0 0 0) 0x7f89a80540f0 con 0x7f89ac0b8580 2023-12-19T18:00:54.040 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:00:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8990065ad0 msgr2=0x7f8990067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8990065ad0 0x7f8990067f90 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f89ac159950 tx=0x7f899c007c00 comp rx=0 tx=0).stop 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 msgr2=0x7f89ac1f1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 0x7f89ac1f1c80 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f89a800e840 tx=0x7f89a800ec00 comp rx=0 tx=0).stop 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 shutdown_connections 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8990065ad0 0x7f8990067f90 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f89ac15cf20 0x7f89ac1f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f89ac0cdfd0 0x7f89ac0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 --2- 172.21.15.45:0/1351329076 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f89ac0b8580 0x7f89ac1f1c80 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 >> 172.21.15.45:0/1351329076 conn(0x7f89ac0b4670 msgr2=0x7f89ac0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 shutdown_connections 2023-12-19T18:00:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.035+0000 7f89b28aa700 1 -- 172.21.15.45:0/1351329076 wait complete. 2023-12-19T18:00:54.064 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:00:54.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.243+0000 7f579e42f700 1 Processor -- start 2023-12-19T18:00:54.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579e42f700 1 -- start start 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579e42f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579e42f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980d2200 con 0x7f579815d220 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579e42f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57980d1920 con 0x7f57980d0e30 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579e42f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980d2aa0 con 0x7f57980d2690 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579cc2c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f579815d220 0x7f579806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41878/0 (socket says 172.21.15.45:41878) 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.247+0000 7f579cc2c700 1 -- 172.21.15.45:0/2205946963 learned_addr learned my addr 172.21.15.45:0/2205946963 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579dc2e700 1 --2- 172.21.15.45:0/2205946963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2191587556 0 0) 0x7f57980d2200 con 0x7f579815d220 2023-12-19T18:00:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57840035d0 con 0x7f579815d220 2023-12-19T18:00:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1112463602 0 0) 0x7f57980d1920 con 0x7f57980d0e30 2023-12-19T18:00:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57980d2200 con 0x7f57980d0e30 2023-12-19T18:00:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579dc2e700 1 -- 172.21.15.45:0/2205946963 >> v1:172.21.15.73:6789/0 conn(0x7f57980d0e30 legacy=0x7f57980d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579dc2e700 1 -- 172.21.15.45:0/2205946963 >> v1:172.21.15.45:6789/0 conn(0x7f579815d220 legacy=0x7f579806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579dc2e700 1 -- 172.21.15.45:0/2205946963 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5798070210 con 0x7f57980d2690 2023-12-19T18:00:54.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579dc2e700 1 --2- 172.21.15.45:0/2205946963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cd4b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5790009dc0 tx=0x7f579000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e5f72c94f546e018 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:54.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579000e070 con 0x7f57980d2690 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579000bb20 con 0x7f57980d2690 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f578ffff700 1 -- 172.21.15.45:0/2205946963 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790012430 con 0x7f57980d2690 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 -- 172.21.15.45:0/2205946963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 msgr2=0x7f57980cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 --2- 172.21.15.45:0/2205946963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cd4b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5790009dc0 tx=0x7f579000b330 comp rx=0 tx=0).stop 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 -- 172.21.15.45:0/2205946963 shutdown_connections 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 --2- 172.21.15.45:0/2205946963 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cd4b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 -- 172.21.15.45:0/2205946963 >> 172.21.15.45:0/2205946963 conn(0x7f57980b46d0 msgr2=0x7f57980b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:54.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 -- 172.21.15.45:0/2205946963 shutdown_connections 2023-12-19T18:00:54.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.251+0000 7f579e42f700 1 -- 172.21.15.45:0/2205946963 wait complete. 2023-12-19T18:00:54.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.255+0000 7f579e42f700 1 Processor -- start 2023-12-19T18:00:54.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.255+0000 7f579e42f700 1 -- start start 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.255+0000 7f579e42f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57980d0e30 0x7f5798151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 0x7f57980b7280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980caf10 con 0x7f579815d220 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57980cb1f0 con 0x7f57980d0e30 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57980cb4d0 con 0x7f57980d2690 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 0x7f57980b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 0x7f57980b7280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57834/0 (socket says 172.21.15.45:57834) 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 -- 172.21.15.45:0/1625587053 learned_addr learned my addr 172.21.15.45:0/1625587053 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579d42d700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57980d0e30 0x7f5798151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579cc2c700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 -- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 msgr2=0x7f57980cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 -- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57980d0e30 msgr2=0x7f5798151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57980d0e30 0x7f5798151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 -- 172.21.15.45:0/1625587053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5790009a70 con 0x7f579815d220 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579cc2c700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579dc2e700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 0x7f57980b7280 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f579000b370 tx=0x7f5790004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790004830 con 0x7f579815d220 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5790020070 con 0x7f579815d220 2023-12-19T18:00:54.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790004990 con 0x7f579815d220 2023-12-19T18:00:54.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57980cb7b0 con 0x7f579815d220 2023-12-19T18:00:54.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.259+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57980cc210 con 0x7f579815d220 2023-12-19T18:00:54.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.263+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5798072a90 con 0x7f579815d220 2023-12-19T18:00:54.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.263+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5790012430 con 0x7f579815d220 2023-12-19T18:00:54.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.267+0000 7f578dffb700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f577c065b00 0x7f577c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.267+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f5790022070 con 0x7f579815d220 2023-12-19T18:00:54.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.267+0000 7f579d42d700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f577c065b00 0x7f577c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.267+0000 7f579d42d700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f577c065b00 0x7f577c067fc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5794001850 tx=0x7f5794009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:54.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.271+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f57900526e0 con 0x7f579815d220 2023-12-19T18:00:54.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.455+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f57980cb050 con 0x7f579815d220 2023-12-19T18:00:54.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.455+0000 7f578dffb700 1 -- 172.21.15.45:0/1625587053 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) v1 ==== 104+0+11 (secure 0 0 0) 0x7f57980cb050 con 0x7f579815d220 2023-12-19T18:00:54.462 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f577c065b00 msgr2=0x7f577c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f577c065b00 0x7f577c067fc0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f5794001850 tx=0x7f5794009040 comp rx=0 tx=0).stop 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 msgr2=0x7f57980b7280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 0x7f57980b7280 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7f579000b370 tx=0x7f5790004af0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 shutdown_connections 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f577c065b00 0x7f577c067fc0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f579815d220 0x7f57980b7280 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f57980d2690 0x7f57980cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 --2- 172.21.15.45:0/1625587053 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57980d0e30 0x7f5798151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 >> 172.21.15.45:0/1625587053 conn(0x7f57980b46d0 msgr2=0x7f57980c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 shutdown_connections 2023-12-19T18:00:54.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.459+0000 7f579e42f700 1 -- 172.21.15.45:0/1625587053 wait complete. 2023-12-19T18:00:54.490 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:00:54.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.659+0000 7f50ad727700 1 Processor -- start 2023-12-19T18:00:54.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.659+0000 7f50ad727700 1 -- start start 2023-12-19T18:00:54.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50ad727700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50a815ccf0 0x7f50a80b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50ad727700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a80cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50ad727700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50a8160970 0x7f50a8160dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50ad727700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a8070370 con 0x7f50a8160970 2023-12-19T18:00:54.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50ad727700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50a806f4a0 con 0x7f50a815ccf0 2023-12-19T18:00:54.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50ad727700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a806f6f0 con 0x7f50a80cd940 2023-12-19T18:00:54.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a7fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f50a815ccf0 0x7f50a80b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50acf26700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f50a8160970 0x7f50a8160dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a80cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a80cdda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:43806/0 (socket says 172.21.15.45:43806) 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 -- 172.21.15.45:0/2682432782 learned_addr learned my addr 172.21.15.45:0/2682432782 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 -- 172.21.15.45:0/2682432782 >> v2:172.21.15.73:3300/0 conn(0x7f50a815ccf0 msgr2=0x7f50a80b8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 --2- 172.21.15.45:0/2682432782 >> v2:172.21.15.73:3300/0 conn(0x7f50a815ccf0 0x7f50a80b8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 -- 172.21.15.45:0/2682432782 >> v2:172.21.15.45:3300/0 conn(0x7f50a8160970 msgr2=0x7f50a8160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 --2- 172.21.15.45:0/2682432782 >> v2:172.21.15.45:3300/0 conn(0x7f50a8160970 0x7f50a8160dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 -- 172.21.15.45:0/2682432782 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a806f9d0 con 0x7f50a80cd940 2023-12-19T18:00:54.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.663+0000 7f50a77fe700 1 --2- 172.21.15.45:0/2682432782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a80cdda0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50a808b710 tx=0x7f509c009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25f2986a1c1ef6dd server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:54.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50a6ffd700 1 -- 172.21.15.45:0/2682432782 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c011830 con 0x7f50a80cd940 2023-12-19T18:00:54.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50a6ffd700 1 -- 172.21.15.45:0/2682432782 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509c011990 con 0x7f50a80cd940 2023-12-19T18:00:54.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50a6ffd700 1 -- 172.21.15.45:0/2682432782 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509c011d20 con 0x7f50a80cd940 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 -- 172.21.15.45:0/2682432782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 msgr2=0x7f50a80cdda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 --2- 172.21.15.45:0/2682432782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a80cdda0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f50a808b710 tx=0x7f509c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 -- 172.21.15.45:0/2682432782 shutdown_connections 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 --2- 172.21.15.45:0/2682432782 >> v2:172.21.15.45:3300/0 conn(0x7f50a8160970 0x7f50a8160dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 --2- 172.21.15.45:0/2682432782 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a80cdda0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 --2- 172.21.15.45:0/2682432782 >> v2:172.21.15.73:3300/0 conn(0x7f50a815ccf0 0x7f50a80b8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 -- 172.21.15.45:0/2682432782 >> 172.21.15.45:0/2682432782 conn(0x7f50a80b46f0 msgr2=0x7f50a80b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 -- 172.21.15.45:0/2682432782 shutdown_connections 2023-12-19T18:00:54.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 -- 172.21.15.45:0/2682432782 wait complete. 2023-12-19T18:00:54.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 Processor -- start 2023-12-19T18:00:54.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.667+0000 7f50ad727700 1 -- start start 2023-12-19T18:00:54.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a81452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50a815ccf0 0x7f50a8153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 0x7f50a81541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8154a00 con 0x7f50a8160970 2023-12-19T18:00:54.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8154730 con 0x7f50a815ccf0 2023-12-19T18:00:54.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50a8142a60 con 0x7f50a80cd940 2023-12-19T18:00:54.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 0x7f50a81541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 0x7f50a81541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57858/0 (socket says 172.21.15.45:57858) 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 -- 172.21.15.45:0/4195272749 learned_addr learned my addr 172.21.15.45:0/4195272749 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50a7fff700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a81452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50a77fe700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50a815ccf0 0x7f50a8153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 -- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 msgr2=0x7f50a81452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a81452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 -- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50a815ccf0 msgr2=0x7f50a8153cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50a815ccf0 0x7f50a8153cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 -- 172.21.15.45:0/4195272749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c009570 con 0x7f50a8160970 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50a77fe700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50a815ccf0 0x7f50a8153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:54.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50acf26700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 0x7f50a81541f0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f50a000efc0 tx=0x7f50a000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:54.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0009ba0 con 0x7f50a8160970 2023-12-19T18:00:54.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a000f040 con 0x7f50a8160970 2023-12-19T18:00:54.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a0014480 con 0x7f50a8160970 2023-12-19T18:00:54.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50a8142d40 con 0x7f50a8160970 2023-12-19T18:00:54.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.671+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50a8143300 con 0x7f50a8160970 2023-12-19T18:00:54.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.675+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50a81434f0 con 0x7f50a8160970 2023-12-19T18:00:54.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.675+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f50a00145e0 con 0x7f50a8160970 2023-12-19T18:00:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.679+0000 7f50a4ff9700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5094065ad0 0x7f5094067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:54.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.679+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f50a0083dd0 con 0x7f50a8160970 2023-12-19T18:00:54.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.679+0000 7f50a7fff700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5094065ad0 0x7f5094067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:54.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.679+0000 7f50a7fff700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5094065ad0 0x7f5094067f90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5098009b80 tx=0x7f5098008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:54.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.683+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f50a00513a0 con 0x7f50a8160970 2023-12-19T18:00:54.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.855+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f50a804ed30 con 0x7f50a8160970 2023-12-19T18:00:54.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50a4ff9700 1 -- 172.21.15.45:0/4195272749 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) v1 ==== 100+0+11 (secure 0 0 0) 0x7f50a00180a0 con 0x7f50a8160970 2023-12-19T18:00:54.864 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:00:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5094065ad0 msgr2=0x7f5094067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5094065ad0 0x7f5094067f90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5098009b80 tx=0x7f5098008040 comp rx=0 tx=0).stop 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 msgr2=0x7f50a81541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 0x7f50a81541f0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f50a000efc0 tx=0x7f50a000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 shutdown_connections 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5094065ad0 0x7f5094067f90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f50a8160970 0x7f50a81541f0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50a815ccf0 0x7f50a8153cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 --2- 172.21.15.45:0/4195272749 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f50a80cd940 0x7f50a81452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:54.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.859+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 >> 172.21.15.45:0/4195272749 conn(0x7f50a80b46f0 msgr2=0x7f50a815c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.863+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 shutdown_connections 2023-12-19T18:00:54.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:54.863+0000 7f50ad727700 1 -- 172.21.15.45:0/4195272749 wait complete. 2023-12-19T18:00:54.891 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T18:00:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.071+0000 7f151feb5700 1 Processor -- start 2023-12-19T18:00:55.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151feb5700 1 -- start start 2023-12-19T18:00:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151feb5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 0x7f15181619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151feb5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15180b1d20 con 0x7f15181626c0 2023-12-19T18:00:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151feb5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f151806ec50 con 0x7f15180b2490 2023-12-19T18:00:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151feb5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15180b2c00 con 0x7f151806dd70 2023-12-19T18:00:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151dc51700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f15181626c0 0x7f151806d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41880/0 (socket says 172.21.15.45:41880) 2023-12-19T18:00:55.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151dc51700 1 -- 172.21.15.45:0/181742440 learned_addr learned my addr 172.21.15.45:0/181742440 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151d450700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 0x7f15181619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2289377836 0 0) 0x7f15180b1d20 con 0x7f15181626c0 2023-12-19T18:00:55.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.075+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15040035d0 con 0x7f15181626c0 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1537701 0 0) 0x7f15040035d0 con 0x7f15181626c0 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 msgr2=0x7f15181619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 0x7f15181619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 >> v1:172.21.15.73:6789/0 conn(0x7f15180b2490 legacy=0x7f151806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15180b2ee0 con 0x7f15181626c0 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f1514001670 con 0x7f15181626c0 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 >> v1:172.21.15.45:6789/0 conn(0x7f15181626c0 legacy=0x7f151806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 0x7f1504003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f1504004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504004db0 0x7f1504005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180b2c00 con 0x7f1504004020 2023-12-19T18:00:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150400bc20 con 0x7f1504004db0 2023-12-19T18:00:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f150400bde0 con 0x7f151806dd70 2023-12-19T18:00:55.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f1504004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151dc51700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 0x7f1504003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151e452700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504004db0 0x7f1504005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 -- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 msgr2=0x7f1504003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f151806dd70 0x7f1504003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 -- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504004db0 msgr2=0x7f1504005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1504004db0 0x7f1504005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 -- 172.21.15.45:0/181742440 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15040035d0 con 0x7f1504004020 2023-12-19T18:00:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151d450700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f1504004870 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f1508009b70 tx=0x7f15040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77275603926570a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800e6c0 con 0x7f1504004020 2023-12-19T18:00:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150800e820 con 0x7f1504004020 2023-12-19T18:00:55.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.079+0000 7f151cc4f700 1 -- 172.21.15.45:0/181742440 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150800eb90 con 0x7f1504004020 2023-12-19T18:00:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151feb5700 1 -- 172.21.15.45:0/181742440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 msgr2=0x7f1504004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151feb5700 1 --2- 172.21.15.45:0/181742440 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f1504004870 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f1508009b70 tx=0x7f15040058a0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151e452700 1 -- 172.21.15.45:0/181742440 reap_dead start 2023-12-19T18:00:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151feb5700 1 -- 172.21.15.45:0/181742440 shutdown_connections 2023-12-19T18:00:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151feb5700 1 -- 172.21.15.45:0/181742440 >> 172.21.15.45:0/181742440 conn(0x7f1518071990 msgr2=0x7f15180b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:55.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151feb5700 1 -- 172.21.15.45:0/181742440 shutdown_connections 2023-12-19T18:00:55.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.083+0000 7f151feb5700 1 -- 172.21.15.45:0/181742440 wait complete. 2023-12-19T18:00:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 Processor -- start 2023-12-19T18:00:55.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 -- start start 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f15181f62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15180cc760 0x7f15180ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1518152d80 0x7f1518153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518153740 con 0x7f1504004020 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15180cd810 con 0x7f15180cc760 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1518140b10 con 0x7f1518152d80 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f15181f62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f15181f62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57874/0 (socket says 172.21.15.45:57874) 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 -- 172.21.15.45:0/3529334064 learned_addr learned my addr 172.21.15.45:0/3529334064 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:55.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151d450700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15180cc760 0x7f15180ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151e452700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1518152d80 0x7f1518153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 -- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1518152d80 msgr2=0x7f1518153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1518152d80 0x7f1518153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 -- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15180cc760 msgr2=0x7f15180ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15180cc760 0x7f15180ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 -- 172.21.15.45:0/3529334064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15181f67e0 con 0x7f1504004020 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151e452700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1518152d80 0x7f1518153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:55.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151d450700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15180cc760 0x7f15180ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151dc51700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f15181f62a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f15140072a0 tx=0x7f1514007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514007840 con 0x7f1504004020 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151400f870 con 0x7f1504004020 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15140014e0 con 0x7f1504004020 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.087+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15180cd250 con 0x7f1504004020 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.091+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15181407a0 con 0x7f1504004020 2023-12-19T18:00:55.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.091+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151804ed30 con 0x7f1504004020 2023-12-19T18:00:55.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.091+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f151400fc00 con 0x7f1504004020 2023-12-19T18:00:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.095+0000 7f150e7fc700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f14fc065ad0 0x7f14fc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.095+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f15140840b0 con 0x7f1504004020 2023-12-19T18:00:55.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.095+0000 7f151d450700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f14fc065ad0 0x7f14fc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.095+0000 7f151d450700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f14fc065ad0 0x7f14fc067f90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f15080090b0 tx=0x7f1508008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.099+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1514051700 con 0x7f1504004020 2023-12-19T18:00:55.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.275+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f151806cef0 con 0x7f1504004020 2023-12-19T18:00:55.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.279+0000 7f150e7fc700 1 -- 172.21.15.45:0/3529334064 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v94) v1 ==== 106+0+11 (secure 0 0 0) 0x7f1514054d20 con 0x7f1504004020 2023-12-19T18:00:55.285 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:00:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f14fc065ad0 msgr2=0x7f14fc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f14fc065ad0 0x7f14fc067f90 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f15080090b0 tx=0x7f1508008030 comp rx=0 tx=0).stop 2023-12-19T18:00:55.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 msgr2=0x7f15181f62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f15181f62a0 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f15140072a0 tx=0x7f1514007660 comp rx=0 tx=0).stop 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 shutdown_connections 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f14fc065ad0 0x7f14fc067f90 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1518152d80 0x7f1518153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f15180cc760 0x7f15180ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 --2- 172.21.15.45:0/3529334064 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1504004020 0x7f15181f62a0 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 >> 172.21.15.45:0/3529334064 conn(0x7f1518071990 msgr2=0x7f151806ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 shutdown_connections 2023-12-19T18:00:55.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.283+0000 7f151feb5700 1 -- 172.21.15.45:0/3529334064 wait complete. 2023-12-19T18:00:55.314 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:55.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd68599700 1 Processor -- start 2023-12-19T18:00:55.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd68599700 1 -- start start 2023-12-19T18:00:55.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd68599700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbd600cd480 0x7fbd6006d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd68599700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6006cbb0 con 0x7fbd6015ab50 2023-12-19T18:00:55.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd68599700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd6006fa10 con 0x7fbd6015af30 2023-12-19T18:00:55.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd68599700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd6006fcf0 con 0x7fbd600cd480 2023-12-19T18:00:55.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd66335700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbd6015ab50 0x7fbd600ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41890/0 (socket says 172.21.15.45:41890) 2023-12-19T18:00:55.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd66335700 1 -- 172.21.15.45:0/2423935142 learned_addr learned my addr 172.21.15.45:0/2423935142 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:55.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.487+0000 7fbd65b34700 1 --2- 172.21.15.45:0/2423935142 >> v2:172.21.15.45:3300/0 conn(0x7fbd600cd480 0x7fbd6006d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65333700 1 -- 172.21.15.45:0/2423935142 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114889102 0 0) 0x7fbd6006cbb0 con 0x7fbd6015ab50 2023-12-19T18:00:55.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65333700 1 -- 172.21.15.45:0/2423935142 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd4c0035d0 con 0x7fbd6015ab50 2023-12-19T18:00:55.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65b34700 1 -- 172.21.15.45:0/2423935142 >> v1:172.21.15.73:6789/0 conn(0x7fbd6015af30 legacy=0x7fbd6006d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65b34700 1 -- 172.21.15.45:0/2423935142 >> v1:172.21.15.45:6789/0 conn(0x7fbd6015ab50 legacy=0x7fbd600ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65333700 1 -- 172.21.15.45:0/2423935142 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241486651 0 0) 0x7fbd6006fa10 con 0x7fbd6015af30 2023-12-19T18:00:55.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65b34700 1 -- 172.21.15.45:0/2423935142 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd6006ffd0 con 0x7fbd600cd480 2023-12-19T18:00:55.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65b34700 1 --2- 172.21.15.45:0/2423935142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd6006d090 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009850 tx=0x7fbd50009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eac117ceab2736f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65333700 1 -- 172.21.15.45:0/2423935142 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50011830 con 0x7fbd600cd480 2023-12-19T18:00:55.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65333700 1 -- 172.21.15.45:0/2423935142 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd50011990 con 0x7fbd600cd480 2023-12-19T18:00:55.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd65333700 1 -- 172.21.15.45:0/2423935142 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50011d40 con 0x7fbd600cd480 2023-12-19T18:00:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 -- 172.21.15.45:0/2423935142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 msgr2=0x7fbd6006d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 --2- 172.21.15.45:0/2423935142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd6006d090 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009850 tx=0x7fbd50009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:55.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 -- 172.21.15.45:0/2423935142 shutdown_connections 2023-12-19T18:00:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 --2- 172.21.15.45:0/2423935142 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd6006d090 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 -- 172.21.15.45:0/2423935142 >> 172.21.15.45:0/2423935142 conn(0x7fbd600cba40 msgr2=0x7fbd600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 -- 172.21.15.45:0/2423935142 shutdown_connections 2023-12-19T18:00:55.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.491+0000 7fbd68599700 1 -- 172.21.15.45:0/2423935142 wait complete. 2023-12-19T18:00:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 Processor -- start 2023-12-19T18:00:55.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 -- start start 2023-12-19T18:00:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd600b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd6015ab50 0x7fbd601422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd6015af30 0x7fbd600b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b2e80 con 0x7fbd600cd480 2023-12-19T18:00:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b2200 con 0x7fbd6015af30 2023-12-19T18:00:55.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.495+0000 7fbd68599700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600b24e0 con 0x7fbd6015ab50 2023-12-19T18:00:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd600b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd600b32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57894/0 (socket says 172.21.15.45:57894) 2023-12-19T18:00:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 -- 172.21.15.45:0/3888819715 learned_addr learned my addr 172.21.15.45:0/3888819715 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd65b34700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd6015ab50 0x7fbd601422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66b36700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd6015af30 0x7fbd600b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 -- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd6015ab50 msgr2=0x7fbd601422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd6015ab50 0x7fbd601422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 -- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd6015af30 msgr2=0x7fbd600b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd6015af30 0x7fbd600b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 -- 172.21.15.45:0/3888819715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500094b0 con 0x7fbd600cd480 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd66335700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd600b32a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c4f0 tx=0x7fbd5c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c005d90 con 0x7fbd600cd480 2023-12-19T18:00:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0070d0 con 0x7fbd600cd480 2023-12-19T18:00:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd600b27c0 con 0x7fbd600cd480 2023-12-19T18:00:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c007440 con 0x7fbd600cd480 2023-12-19T18:00:55.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.499+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd60153b20 con 0x7fbd600cd480 2023-12-19T18:00:55.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.503+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd600b2fc0 con 0x7fbd600cd480 2023-12-19T18:00:55.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.503+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbd5c0075a0 con 0x7fbd600cd480 2023-12-19T18:00:55.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.503+0000 7fbd56ffd700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd44065ad0 0x7fbd44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.503+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbd5c0827f0 con 0x7fbd600cd480 2023-12-19T18:00:55.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.503+0000 7fbd65b34700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd44065ad0 0x7fbd44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.507+0000 7fbd65b34700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd44065ad0 0x7fbd44067f90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbd500090b0 tx=0x7fbd50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.511+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbd5c04fe70 con 0x7fbd600cd480 2023-12-19T18:00:55.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.723+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbd6004ed30 con 0x7fbd600cd480 2023-12-19T18:00:55.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.723+0000 7fbd56ffd700 1 -- 172.21.15.45:0/3888819715 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fbd5c053490 con 0x7fbd600cd480 2023-12-19T18:00:55.730 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:55.730 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:13.982153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.723+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd44065ad0 msgr2=0x7fbd44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.723+0000 7fbd68599700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd44065ad0 0x7fbd44067f90 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fbd500090b0 tx=0x7fbd50008030 comp rx=0 tx=0).stop 2023-12-19T18:00:55.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.723+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 msgr2=0x7fbd600b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.723+0000 7fbd68599700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd600b32a0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c00c4f0 tx=0x7fbd5c00c800 comp rx=0 tx=0).stop 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 shutdown_connections 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbd44065ad0 0x7fbd44067f90 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbd6015af30 0x7fbd600b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbd6015ab50 0x7fbd601422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 --2- 172.21.15.45:0/3888819715 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbd600cd480 0x7fbd600b32a0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 >> 172.21.15.45:0/3888819715 conn(0x7fbd600cba40 msgr2=0x7fbd600af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 shutdown_connections 2023-12-19T18:00:55.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.727+0000 7fbd68599700 1 -- 172.21.15.45:0/3888819715 wait complete. 2023-12-19T18:00:55.735 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 70 2023-12-19T18:00:55.757 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 Processor -- start 2023-12-19T18:00:55.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 -- start start 2023-12-19T18:00:55.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbe1406ea90 0x7fbe140d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe140b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe140d1820 con 0x7fbe140b88b0 2023-12-19T18:00:55.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe140d1b00 con 0x7fbe1406ea90 2023-12-19T18:00:55.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe192b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe140d1de0 con 0x7fbe1406fe80 2023-12-19T18:00:55.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe13fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbe1406ea90 0x7fbe140d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe0b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbe140b88b0 0x7fbe140b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41904/0 (socket says 172.21.15.45:41904) 2023-12-19T18:00:55.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe0b7fe700 1 -- 172.21.15.45:0/2295500935 learned_addr learned my addr 172.21.15.45:0/2295500935 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:55.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe18ab0700 1 --2- 172.21.15.45:0/2295500935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe140b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.939+0000 7fbe13fff700 1 -- 172.21.15.45:0/2295500935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 msgr2=0x7fbe140b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe13fff700 1 --2- 172.21.15.45:0/2295500935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe140b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe13fff700 1 -- 172.21.15.45:0/2295500935 >> v1:172.21.15.45:6789/0 conn(0x7fbe140b88b0 legacy=0x7fbe140b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe13fff700 1 -- 172.21.15.45:0/2295500935 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe140d20c0 con 0x7fbe1406ea90 2023-12-19T18:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe137fe700 1 -- 172.21.15.45:0/2295500935 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2756801135 0 0) 0x7fbe140d1820 con 0x7fbe140b88b0 2023-12-19T18:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe13fff700 1 --2- 172.21.15.45:0/2295500935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1406ea90 0x7fbe140d0f20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009850 tx=0x7fbe04009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e571cd350eeb2dcf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe137fe700 1 -- 172.21.15.45:0/2295500935 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04011830 con 0x7fbe1406ea90 2023-12-19T18:00:55.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe137fe700 1 -- 172.21.15.45:0/2295500935 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe04011990 con 0x7fbe1406ea90 2023-12-19T18:00:55.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe137fe700 1 -- 172.21.15.45:0/2295500935 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe04011d20 con 0x7fbe1406ea90 2023-12-19T18:00:55.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 -- 172.21.15.45:0/2295500935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1406ea90 msgr2=0x7fbe140d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2295500935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1406ea90 0x7fbe140d0f20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fbe04009850 tx=0x7fbe04009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:55.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 -- 172.21.15.45:0/2295500935 shutdown_connections 2023-12-19T18:00:55.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2295500935 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe140b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2295500935 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe1406ea90 0x7fbe140d0f20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 -- 172.21.15.45:0/2295500935 >> 172.21.15.45:0/2295500935 conn(0x7fbe140b46d0 msgr2=0x7fbe140b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:55.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 -- 172.21.15.45:0/2295500935 shutdown_connections 2023-12-19T18:00:55.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.943+0000 7fbe192b1700 1 -- 172.21.15.45:0/2295500935 wait complete. 2023-12-19T18:00:55.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 Processor -- start 2023-12-19T18:00:55.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 -- start start 2023-12-19T18:00:55.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1406ea90 0x7fbe140b7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe141f4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 0x7fbe140b6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe14145dc0 con 0x7fbe140b88b0 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe141483c0 con 0x7fbe1406ea90 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe192b1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe141486a0 con 0x7fbe1406fe80 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe18ab0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 0x7fbe140b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe18ab0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 0x7fbe140b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57918/0 (socket says 172.21.15.45:57918) 2023-12-19T18:00:55.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe18ab0700 1 -- 172.21.15.45:0/2267835273 learned_addr learned my addr 172.21.15.45:0/2267835273 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe13fff700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1406ea90 0x7fbe140b7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.947+0000 7fbe0b7fe700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe141f4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe18ab0700 1 -- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 msgr2=0x7fbe141f4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe18ab0700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe141f4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe18ab0700 1 -- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1406ea90 msgr2=0x7fbe140b7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:55.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe18ab0700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1406ea90 0x7fbe140b7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe18ab0700 1 -- 172.21.15.45:0/2267835273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe040094b0 con 0x7fbe140b88b0 2023-12-19T18:00:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe0b7fe700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe141f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe18ab0700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 0x7fbe140b6790 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007e60 tx=0x7fbe0c00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c00ede0 con 0x7fbe140b88b0 2023-12-19T18:00:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c014420 con 0x7fbe140b88b0 2023-12-19T18:00:55.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe14148980 con 0x7fbe140b88b0 2023-12-19T18:00:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0147d0 con 0x7fbe140b88b0 2023-12-19T18:00:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe141596b0 con 0x7fbe140b88b0 2023-12-19T18:00:55.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.951+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe14145fc0 con 0x7fbe140b88b0 2023-12-19T18:00:55.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.955+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbe0c014930 con 0x7fbe140b88b0 2023-12-19T18:00:55.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.955+0000 7fbe117fa700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbdf4065b00 0x7fbdf4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:55.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.955+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fbe0c083be0 con 0x7fbe140b88b0 2023-12-19T18:00:55.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.955+0000 7fbe13fff700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbdf4065b00 0x7fbdf4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:55.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.955+0000 7fbe13fff700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbdf4065b00 0x7fbdf4067fc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbe04014040 tx=0x7fbe04008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:55.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:55.959+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbe14145fc0 con 0x7fbe140b88b0 2023-12-19T18:00:56.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.139+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe14067760 con 0x7fbe140b88b0 2023-12-19T18:00:56.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.143+0000 7fbe117fa700 1 -- 172.21.15.45:0/2267835273 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18435 (secure 0 0 0) 0x7fbe0c07be60 con 0x7fbe140b88b0 2023-12-19T18:00:56.151 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:56.151 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":94,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:00:10.965536+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6835/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6834/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6834/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6835/2667696599":"2023-12-20T18:00:04.222190+0000","172.21.15.73:6834/2667696599":"2023-12-20T18:00:04.222190+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:00:56.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbdf4065b00 msgr2=0x7fbdf4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbdf4065b00 0x7fbdf4067fc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fbe04014040 tx=0x7fbe04008030 comp rx=0 tx=0).stop 2023-12-19T18:00:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 msgr2=0x7fbe140b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 0x7fbe140b6790 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c007e60 tx=0x7fbe0c00e3c0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 shutdown_connections 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbdf4065b00 0x7fbdf4067fc0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbe140b88b0 0x7fbe140b6790 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbe1406fe80 0x7fbe141f4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 --2- 172.21.15.45:0/2267835273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe1406ea90 0x7fbe140b7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 >> 172.21.15.45:0/2267835273 conn(0x7fbe140b46d0 msgr2=0x7fbe140b3280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 shutdown_connections 2023-12-19T18:00:56.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.147+0000 7fbe192b1700 1 -- 172.21.15.45:0/2267835273 wait complete. 2023-12-19T18:00:56.179 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T18:00:56.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:56.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.347+0000 7ff007335700 1 Processor -- start 2023-12-19T18:00:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff007335700 1 -- start start 2023-12-19T18:00:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff007335700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff000164690 0x7ff0000c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff007335700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff0000cd540 0x7ff0000c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff007335700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0000cdb80 con 0x7ff000164a70 2023-12-19T18:00:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff007335700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0000cd970 con 0x7ff000164690 2023-12-19T18:00:56.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff007335700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0000cde60 con 0x7ff0000cd540 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff000164690 0x7ff0000c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff000164690 0x7ff0000c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57928/0 (socket says 172.21.15.45:57928) 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 -- 172.21.15.45:0/93502008 learned_addr learned my addr 172.21.15.45:0/93502008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0058d2700 1 --2- 172.21.15.45:0/93502008 >> v2:172.21.15.73:3300/0 conn(0x7ff0000cd540 0x7ff0000c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 -- 172.21.15.45:0/93502008 >> v2:172.21.15.73:3300/0 conn(0x7ff0000cd540 msgr2=0x7ff0000c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 --2- 172.21.15.45:0/93502008 >> v2:172.21.15.73:3300/0 conn(0x7ff0000cd540 0x7ff0000c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 -- 172.21.15.45:0/93502008 >> v1:172.21.15.45:6789/0 conn(0x7ff000164a70 legacy=0x7ff0000cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.351+0000 7ff0050d1700 1 -- 172.21.15.45:0/93502008 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0000ce140 con 0x7ff000164690 2023-12-19T18:00:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff0050d1700 1 --2- 172.21.15.45:0/93502008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff000164690 0x7ff0000c3e00 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff0000cf250 tx=0x7feffc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbaaa92a93ef600 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7feff7fff700 1 -- 172.21.15.45:0/93502008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc00b8a0 con 0x7ff000164690 2023-12-19T18:00:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7feff7fff700 1 -- 172.21.15.45:0/93502008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc00ba00 con 0x7ff000164690 2023-12-19T18:00:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7feff7fff700 1 -- 172.21.15.45:0/93502008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc00bd90 con 0x7ff000164690 2023-12-19T18:00:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 -- 172.21.15.45:0/93502008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff000164690 msgr2=0x7ff0000c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 --2- 172.21.15.45:0/93502008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff000164690 0x7ff0000c3e00 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7ff0000cf250 tx=0x7feffc009bf0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 -- 172.21.15.45:0/93502008 shutdown_connections 2023-12-19T18:00:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 --2- 172.21.15.45:0/93502008 >> v2:172.21.15.73:3300/0 conn(0x7ff0000cd540 0x7ff0000c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 --2- 172.21.15.45:0/93502008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff000164690 0x7ff0000c3e00 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 -- 172.21.15.45:0/93502008 >> 172.21.15.45:0/93502008 conn(0x7ff0000cba40 msgr2=0x7ff0000ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 -- 172.21.15.45:0/93502008 shutdown_connections 2023-12-19T18:00:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.355+0000 7ff007335700 1 -- 172.21.15.45:0/93502008 wait complete. 2023-12-19T18:00:56.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 Processor -- start 2023-12-19T18:00:56.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 -- start start 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 0x7ff0000c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff000164690 0x7ff0000b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff000164a70 0x7ff0001608e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00014d650 con 0x7ff0000cd540 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00014df20 con 0x7ff000164a70 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff007335700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00014dc40 con 0x7ff000164690 2023-12-19T18:00:56.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 0x7ff0000c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 0x7ff0000c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57938/0 (socket says 172.21.15.45:57938) 2023-12-19T18:00:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 -- 172.21.15.45:0/2892855138 learned_addr learned my addr 172.21.15.45:0/2892855138 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0058d2700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff000164a70 0x7ff0001608e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0048d0700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff000164690 0x7ff0000b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 -- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff000164690 msgr2=0x7ff0000b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff000164690 0x7ff0000b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 -- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff000164a70 msgr2=0x7ff0001608e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff000164a70 0x7ff0001608e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.359+0000 7ff0050d1700 1 -- 172.21.15.45:0/2892855138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009570 con 0x7ff0000cd540 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7ff0050d1700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 0x7ff0000c8040 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff0000b1660 tx=0x7feffc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc0038c0 con 0x7ff0000cd540 2023-12-19T18:00:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feffc01f070 con 0x7ff0000cd540 2023-12-19T18:00:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0000c7560 con 0x7ff0000cd540 2023-12-19T18:00:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc003c60 con 0x7ff0000cd540 2023-12-19T18:00:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0000c7b20 con 0x7ff0000cd540 2023-12-19T18:00:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.363+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00004ed30 con 0x7ff0000cd540 2023-12-19T18:00:56.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.367+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feffc026480 con 0x7ff0000cd540 2023-12-19T18:00:56.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.367+0000 7feff5ffb700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe4065ad0 0x7fefe4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.367+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7feffc021070 con 0x7ff0000cd540 2023-12-19T18:00:56.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.367+0000 7ff0048d0700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe4065ad0 0x7fefe4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.371+0000 7ff0048d0700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe4065ad0 0x7fefe4067f90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff0000c7490 tx=0x7feff0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:56.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.375+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feffc0526c0 con 0x7ff0000cd540 2023-12-19T18:00:56.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.587+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff00006c990 con 0x7ff0000cd540 2023-12-19T18:00:56.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.587+0000 7feff5ffb700 1 -- 172.21.15.45:0/2892855138 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4709 (secure 0 0 0) 0x7feffc055ce0 con 0x7ff0000cd540 2023-12-19T18:00:56.594 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:56.594 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:13.982153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.587+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe4065ad0 msgr2=0x7fefe4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe4065ad0 0x7fefe4067f90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff0000c7490 tx=0x7feff0009040 comp rx=0 tx=0).stop 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 msgr2=0x7ff0000c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 0x7ff0000c8040 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7ff0000b1660 tx=0x7feffc004770 comp rx=0 tx=0).stop 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 shutdown_connections 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe4065ad0 0x7fefe4067f90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff000164a70 0x7ff0001608e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff000164690 0x7ff0000b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 --2- 172.21.15.45:0/2892855138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0000cd540 0x7ff0000c8040 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 >> 172.21.15.45:0/2892855138 conn(0x7ff0000cba40 msgr2=0x7ff0000c4700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 shutdown_connections 2023-12-19T18:00:56.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.591+0000 7ff007335700 1 -- 172.21.15.45:0/2892855138 wait complete. 2023-12-19T18:00:56.599 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 70 2023-12-19T18:00:56.618 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:00:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.803+0000 7fc08759e700 1 Processor -- start 2023-12-19T18:00:56.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.803+0000 7fc08759e700 1 -- start start 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc088159590 0x7fc08806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc0880c4120 0x7fc0880c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0880c3e20 con 0x7fc0881591b0 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0880cadb0 con 0x7fc0880c4120 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0880c4aa0 con 0x7fc088159590 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc0881591b0 0x7fc0880c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41930/0 (socket says 172.21.15.45:41930) 2023-12-19T18:00:56.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc08659c700 1 -- 172.21.15.45:0/1436265457 learned_addr learned my addr 172.21.15.45:0/1436265457 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:56.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc07ffff700 1 --2- 172.21.15.45:0/1436265457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc088159590 0x7fc08806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc086d9d700 1 --2- 172.21.15.45:0/1436265457 >> v2:172.21.15.73:3300/0 conn(0x7fc0880c4120 0x7fc0880c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc085d9b700 1 -- 172.21.15.45:0/1436265457 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3425988319 0 0) 0x7fc0880c3e20 con 0x7fc0881591b0 2023-12-19T18:00:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc085d9b700 1 -- 172.21.15.45:0/1436265457 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0740035d0 con 0x7fc0881591b0 2023-12-19T18:00:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc07ffff700 1 -- 172.21.15.45:0/1436265457 >> v2:172.21.15.73:3300/0 conn(0x7fc0880c4120 msgr2=0x7fc0880c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc07ffff700 1 --2- 172.21.15.45:0/1436265457 >> v2:172.21.15.73:3300/0 conn(0x7fc0880c4120 0x7fc0880c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc07ffff700 1 -- 172.21.15.45:0/1436265457 >> v1:172.21.15.45:6789/0 conn(0x7fc0881591b0 legacy=0x7fc0880c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc07ffff700 1 -- 172.21.15.45:0/1436265457 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0880ca7f0 con 0x7fc088159590 2023-12-19T18:00:56.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc07ffff700 1 --2- 172.21.15.45:0/1436265457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc088159590 0x7fc08806ea90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc070009850 tx=0x7fc070009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=168f3541cda683df server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc085d9b700 1 -- 172.21.15.45:0/1436265457 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070011830 con 0x7fc088159590 2023-12-19T18:00:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc085d9b700 1 -- 172.21.15.45:0/1436265457 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc070011990 con 0x7fc088159590 2023-12-19T18:00:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.807+0000 7fc085d9b700 1 -- 172.21.15.45:0/1436265457 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc070011d40 con 0x7fc088159590 2023-12-19T18:00:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 -- 172.21.15.45:0/1436265457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc088159590 msgr2=0x7fc08806ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 --2- 172.21.15.45:0/1436265457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc088159590 0x7fc08806ea90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc070009850 tx=0x7fc070009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 -- 172.21.15.45:0/1436265457 shutdown_connections 2023-12-19T18:00:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 --2- 172.21.15.45:0/1436265457 >> v2:172.21.15.73:3300/0 conn(0x7fc0880c4120 0x7fc0880c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 --2- 172.21.15.45:0/1436265457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc088159590 0x7fc08806ea90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 -- 172.21.15.45:0/1436265457 >> 172.21.15.45:0/1436265457 conn(0x7fc0880cb900 msgr2=0x7fc0880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 -- 172.21.15.45:0/1436265457 shutdown_connections 2023-12-19T18:00:56.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 -- 172.21.15.45:0/1436265457 wait complete. 2023-12-19T18:00:56.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 Processor -- start 2023-12-19T18:00:56.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.811+0000 7fc08759e700 1 -- start start 2023-12-19T18:00:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880c4120 0x7fc0881529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0881591b0 0x7fc088155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc0881462c0 0x7fc088154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088146d20 con 0x7fc0880c4120 2023-12-19T18:00:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc088146770 con 0x7fc0881591b0 2023-12-19T18:00:56.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0881f68d0 con 0x7fc0881462c0 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880c4120 0x7fc0881529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880c4120 0x7fc0881529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57946/0 (socket says 172.21.15.45:57946) 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08659c700 1 -- 172.21.15.45:0/3422302407 learned_addr learned my addr 172.21.15.45:0/3422302407 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc0881462c0 0x7fc088154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc07ffff700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0881591b0 0x7fc088155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 -- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0881591b0 msgr2=0x7fc088155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0881591b0 0x7fc088155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 -- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880c4120 msgr2=0x7fc0881529b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:56.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880c4120 0x7fc0881529b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:56.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 -- 172.21.15.45:0/3422302407 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0700094b0 con 0x7fc0881462c0 2023-12-19T18:00:56.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc086d9d700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc0881462c0 0x7fc088154600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc080009d90 tx=0x7fc08000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:56.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080009c00 con 0x7fc0881462c0 2023-12-19T18:00:56.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc08000f040 con 0x7fc0881462c0 2023-12-19T18:00:56.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc080014480 con 0x7fc0881462c0 2023-12-19T18:00:56.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc088157b00 con 0x7fc0881462c0 2023-12-19T18:00:56.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.815+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0881580c0 con 0x7fc0881462c0 2023-12-19T18:00:56.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.819+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08806d620 con 0x7fc0881462c0 2023-12-19T18:00:56.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.819+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc0800145e0 con 0x7fc0881462c0 2023-12-19T18:00:56.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.819+0000 7fc07effd700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc068065b00 0x7fc068067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:56.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.823+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fc080084070 con 0x7fc0881462c0 2023-12-19T18:00:56.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.823+0000 7fc08659c700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc068065b00 0x7fc068067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:56.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.823+0000 7fc08659c700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc068065b00 0x7fc068067fc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc0780011e0 tx=0x7fc078009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:56.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:56.831+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc0800b50a0 con 0x7fc0881462c0 2023-12-19T18:00:57.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.043+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc088067760 con 0x7fc0881462c0 2023-12-19T18:00:57.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc07effd700 1 -- 172.21.15.45:0/3422302407 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fc0800515b0 con 0x7fc0881462c0 2023-12-19T18:00:57.053 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:57.053 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":70,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:00:05.116228+0000","modified":"2023-12-19T18:00:13.982153+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":92,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7707},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7707":{"gid":7707,"name":"b","rank":0,"incarnation":67,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/3311981467","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":3311981467},{"type":"v1","addr":"172.21.15.73:6835","nonce":3311981467}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[12,13],"metadata_pool":11,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-19T18:00:57.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc068065b00 msgr2=0x7fc068067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc068065b00 0x7fc068067fc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fc0780011e0 tx=0x7fc078009040 comp rx=0 tx=0).stop 2023-12-19T18:00:57.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc0881462c0 msgr2=0x7fc088154600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc0881462c0 0x7fc088154600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fc080009d90 tx=0x7fc08000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 shutdown_connections 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc068065b00 0x7fc068067fc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc0881462c0 0x7fc088154600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0881591b0 0x7fc088155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 --2- 172.21.15.45:0/3422302407 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc0880c4120 0x7fc0881529b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 >> 172.21.15.45:0/3422302407 conn(0x7fc0880cb900 msgr2=0x7fc0880cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 shutdown_connections 2023-12-19T18:00:57.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.047+0000 7fc08759e700 1 -- 172.21.15.45:0/3422302407 wait complete. 2023-12-19T18:00:57.059 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 70 2023-12-19T18:00:57.079 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:00:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.247+0000 7f6f8b9f9700 1 Processor -- start 2023-12-19T18:00:57.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.247+0000 7f6f8b9f9700 1 -- start start 2023-12-19T18:00:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.247+0000 7f6f8b9f9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f8406f4a0 0x7f6f840d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.247+0000 7f6f8b9f9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f840b6060 con 0x7f6f8415d420 2023-12-19T18:00:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.247+0000 7f6f8b9f9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8406f930 con 0x7f6f8415d040 2023-12-19T18:00:57.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.247+0000 7f6f8b9f9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f8406fc10 con 0x7f6f8406f4a0 2023-12-19T18:00:57.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f89f96700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f8415d420 0x7f6f840b6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41934/0 (socket says 172.21.15.45:41934) 2023-12-19T18:00:57.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f89f96700 1 -- 172.21.15.45:0/4062610236 learned_addr learned my addr 172.21.15.45:0/4062610236 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:57.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f88f94700 1 --2- 172.21.15.45:0/4062610236 >> v2:172.21.15.45:3300/0 conn(0x7f6f8406f4a0 0x7f6f840d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f7bfff700 1 -- 172.21.15.45:0/4062610236 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 922387288 0 0) 0x7f6f840b6060 con 0x7f6f8415d420 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f7bfff700 1 -- 172.21.15.45:0/4062610236 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f700035d0 con 0x7f6f8415d420 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f88f94700 1 -- 172.21.15.45:0/4062610236 >> v1:172.21.15.73:6789/0 conn(0x7f6f8415d040 legacy=0x7f6f840cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f7bfff700 1 -- 172.21.15.45:0/4062610236 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334764989 0 0) 0x7f6f8406f930 con 0x7f6f8415d040 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f88f94700 1 -- 172.21.15.45:0/4062610236 >> v1:172.21.15.45:6789/0 conn(0x7f6f8415d420 legacy=0x7f6f840b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f88f94700 1 -- 172.21.15.45:0/4062610236 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8406fef0 con 0x7f6f8406f4a0 2023-12-19T18:00:57.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f88f94700 1 --2- 172.21.15.45:0/4062610236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8406f4a0 0x7f6f840d21a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009850 tx=0x7f6f74009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8088bef52176fd1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:57.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f7bfff700 1 -- 172.21.15.45:0/4062610236 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74011830 con 0x7f6f8406f4a0 2023-12-19T18:00:57.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f7bfff700 1 -- 172.21.15.45:0/4062610236 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f74011990 con 0x7f6f8406f4a0 2023-12-19T18:00:57.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f7bfff700 1 -- 172.21.15.45:0/4062610236 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f74011d00 con 0x7f6f8406f4a0 2023-12-19T18:00:57.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/4062610236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8406f4a0 msgr2=0x7f6f840d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/4062610236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8406f4a0 0x7f6f840d21a0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f6f74009850 tx=0x7f6f74009b60 comp rx=0 tx=0).stop 2023-12-19T18:00:57.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/4062610236 shutdown_connections 2023-12-19T18:00:57.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/4062610236 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8406f4a0 0x7f6f840d21a0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.251+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/4062610236 >> 172.21.15.45:0/4062610236 conn(0x7f6f840d2e50 msgr2=0x7f6f840d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:57.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.255+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/4062610236 shutdown_connections 2023-12-19T18:00:57.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.255+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/4062610236 wait complete. 2023-12-19T18:00:57.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.255+0000 7f6f8b9f9700 1 Processor -- start 2023-12-19T18:00:57.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 -- start start 2023-12-19T18:00:57.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 0x7f6f841516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f8415d420 0x7f6f840cc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f840ca710 0x7f6f840cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840caf60 con 0x7f6f8415d040 2023-12-19T18:00:57.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f840ccdf0 con 0x7f6f840ca710 2023-12-19T18:00:57.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f841563f0 con 0x7f6f8415d420 2023-12-19T18:00:57.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 0x7f6f841516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 0x7f6f841516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57960/0 (socket says 172.21.15.45:57960) 2023-12-19T18:00:57.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 -- 172.21.15.45:0/2696554878 learned_addr learned my addr 172.21.15.45:0/2696554878 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89f96700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f840ca710 0x7f6f840cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f88f94700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f8415d420 0x7f6f840cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 -- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f8415d420 msgr2=0x7f6f840cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f8415d420 0x7f6f840cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 -- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f840ca710 msgr2=0x7f6f840cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f840ca710 0x7f6f840cc8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 -- 172.21.15.45:0/2696554878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f740094b0 con 0x7f6f8415d040 2023-12-19T18:00:57.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f88f94700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f8415d420 0x7f6f840cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:57.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f89795700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 0x7f6f841516f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f6f800011e0 tx=0x7f6f8000ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:57.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f800054e0 con 0x7f6f8415d040 2023-12-19T18:00:57.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f840cac80 con 0x7f6f8415d040 2023-12-19T18:00:57.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.259+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f800036a0 con 0x7f6f8415d040 2023-12-19T18:00:57.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.263+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f80003a50 con 0x7f6f8415d040 2023-12-19T18:00:57.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.263+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f84156080 con 0x7f6f8415d040 2023-12-19T18:00:57.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.263+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f84156210 con 0x7f6f8415d040 2023-12-19T18:00:57.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.263+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f80003bb0 con 0x7f6f8415d040 2023-12-19T18:00:57.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.267+0000 7f6f79ffb700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f68065b00 0x7f6f68067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.267+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f6f80082a70 con 0x7f6f8415d040 2023-12-19T18:00:57.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.267+0000 7f6f88f94700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f68065b00 0x7f6f68067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.267+0000 7f6f88f94700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f68065b00 0x7f6f68067fc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6f740090b0 tx=0x7f6f74008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:57.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.271+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f8004ffd0 con 0x7f6f8415d040 2023-12-19T18:00:57.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.447+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f8404ed30 con 0x7f6f8415d040 2023-12-19T18:00:57.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.451+0000 7f6f79ffb700 1 -- 172.21.15.45:0/2696554878 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) v1 ==== 74+0+18435 (secure 0 0 0) 0x7f6f80003e60 con 0x7f6f8415d040 2023-12-19T18:00:57.459 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:00:57.459 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":94,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:00:10.965536+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_metadata","create_time":"2023-12-19T17:59:38.443332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_data","create_time":"2023-12-19T17:59:39.328753+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T17:59:49.559908+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6835/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6835/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6834/3302507960":"2023-12-20T18:00:10.938718+0000","172.21.15.73:6834/1645920961":"2023-12-20T18:00:05.266321+0000","172.21.15.73:6835/2667696599":"2023-12-20T18:00:04.222190+0000","172.21.15.73:6834/2667696599":"2023-12-20T18:00:04.222190+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f68065b00 msgr2=0x7f6f68067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f68065b00 0x7f6f68067fc0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6f740090b0 tx=0x7f6f74008030 comp rx=0 tx=0).stop 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 msgr2=0x7f6f841516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 0x7f6f841516f0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f6f800011e0 tx=0x7f6f8000ca30 comp rx=0 tx=0).stop 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 shutdown_connections 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f68065b00 0x7f6f68067fc0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f840ca710 0x7f6f840cc8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f8415d420 0x7f6f840cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 --2- 172.21.15.45:0/2696554878 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f8415d040 0x7f6f841516f0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 >> 172.21.15.45:0/2696554878 conn(0x7f6f840d2e50 msgr2=0x7f6f840b2e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:57.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.455+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 shutdown_connections 2023-12-19T18:00:57.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.459+0000 7f6f8b9f9700 1 -- 172.21.15.45:0/2696554878 wait complete. 2023-12-19T18:00:57.487 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:00:57.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 Processor -- start 2023-12-19T18:00:57.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 -- start start 2023-12-19T18:00:57.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31f81611c0 0x7f31f80c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f81615a0 0x7f31f806d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31f806dc80 con 0x7f31f80af720 2023-12-19T18:00:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31f8070340 con 0x7f31f81611c0 2023-12-19T18:00:57.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fe89f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f80c3f90 con 0x7f31f81615a0 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31f81611c0 0x7f31f80c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f31f81611c0 0x7f31f80c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57972/0 (socket says 172.21.15.45:57972) 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 -- 172.21.15.45:0/2374496072 learned_addr learned my addr 172.21.15.45:0/2374496072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd09c700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f81615a0 0x7f31f806d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 -- 172.21.15.45:0/2374496072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f81615a0 msgr2=0x7f31f806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f81615a0 0x7f31f806d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 -- 172.21.15.45:0/2374496072 >> v1:172.21.15.73:6789/0 conn(0x7f31f80af720 legacy=0x7f31f8164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd89d700 1 -- 172.21.15.45:0/2374496072 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f80c4270 con 0x7f31f81611c0 2023-12-19T18:00:57.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.659+0000 7f31fd09c700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f81615a0 0x7f31f806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:57.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fd89d700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80c3920 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009910 tx=0x7f31f4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207dc2fd3f2278c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:57.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fc89b700 1 -- 172.21.15.45:0/2374496072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f400ba60 con 0x7f31f81611c0 2023-12-19T18:00:57.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fc89b700 1 -- 172.21.15.45:0/2374496072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31f400bbc0 con 0x7f31f81611c0 2023-12-19T18:00:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fc89b700 1 -- 172.21.15.45:0/2374496072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f4009e60 con 0x7f31f81611c0 2023-12-19T18:00:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 -- 172.21.15.45:0/2374496072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 msgr2=0x7f31f80c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80c3920 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009910 tx=0x7f31f4009c20 comp rx=0 tx=0).stop 2023-12-19T18:00:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 -- 172.21.15.45:0/2374496072 shutdown_connections 2023-12-19T18:00:57.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f81615a0 0x7f31f806d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2374496072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80c3920 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 -- 172.21.15.45:0/2374496072 >> 172.21.15.45:0/2374496072 conn(0x7f31f80cb900 msgr2=0x7f31f80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 -- 172.21.15.45:0/2374496072 shutdown_connections 2023-12-19T18:00:57.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.663+0000 7f31fe89f700 1 -- 172.21.15.45:0/2374496072 wait complete. 2023-12-19T18:00:57.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.667+0000 7f31fe89f700 1 Processor -- start 2023-12-19T18:00:57.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.667+0000 7f31fe89f700 1 -- start start 2023-12-19T18:00:57.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f80af720 0x7f31f81569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80ccbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31f81615a0 0x7f31f80cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f81f7cd0 con 0x7f31f81611c0 2023-12-19T18:00:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31f81f7f20 con 0x7f31f81615a0 2023-12-19T18:00:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31f81f8200 con 0x7f31f80af720 2023-12-19T18:00:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80ccbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80ccbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57976/0 (socket says 172.21.15.45:57976) 2023-12-19T18:00:57.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 -- 172.21.15.45:0/2673968387 learned_addr learned my addr 172.21.15.45:0/2673968387 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:57.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd89d700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f80af720 0x7f31f81569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe09e700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31f81615a0 0x7f31f80cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 -- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f80af720 msgr2=0x7f31f81569b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f80af720 0x7f31f81569b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 -- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31f81615a0 msgr2=0x7f31f80cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31f81615a0 0x7f31f80cd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 -- 172.21.15.45:0/2673968387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f4009570 con 0x7f31f81611c0 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe09e700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31f81615a0 0x7f31f80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fd09c700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80ccbc0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f31e800e810 tx=0x7f31e800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e8004230 con 0x7f31f81611c0 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31e80043b0 con 0x7f31f81611c0 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31e80036c0 con 0x7f31f81611c0 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31f81f84e0 con 0x7f31f81611c0 2023-12-19T18:00:57.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.671+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31f81f6e30 con 0x7f31f81611c0 2023-12-19T18:00:57.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.675+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31f806e760 con 0x7f31f81611c0 2023-12-19T18:00:57.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.675+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f31e8003820 con 0x7f31f81611c0 2023-12-19T18:00:57.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.679+0000 7f31ee7fc700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31dc065ad0 0x7f31dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:57.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.679+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f31e8082fa0 con 0x7f31f81611c0 2023-12-19T18:00:57.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.679+0000 7f31fd89d700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31dc065ad0 0x7f31dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:57.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.679+0000 7f31fd89d700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31dc065ad0 0x7f31dc067f90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c60 tx=0x7f31f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:57.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.683+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f31e80504e0 con 0x7f31f81611c0 2023-12-19T18:00:57.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.899+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f31f8067760 con 0x7f31f81611c0 2023-12-19T18:00:57.908 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:00:57.899+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:00:57.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.915+0000 7f31ee7fc700 1 -- 172.21.15.45:0/2673968387 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f31e8053b00 con 0x7f31f81611c0 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31dc065ad0 msgr2=0x7f31dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31dc065ad0 0x7f31dc067f90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f31f4009c60 tx=0x7f31f4008030 comp rx=0 tx=0).stop 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 msgr2=0x7f31f80ccbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80ccbc0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f31e800e810 tx=0x7f31e800eb20 comp rx=0 tx=0).stop 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 shutdown_connections 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f31dc065ad0 0x7f31dc067f90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f31f81615a0 0x7f31f80cd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f31f81611c0 0x7f31f80ccbc0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 --2- 172.21.15.45:0/2673968387 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f31f80af720 0x7f31f81569b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:57.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 >> 172.21.15.45:0/2673968387 conn(0x7f31f80cb900 msgr2=0x7f31f80713c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:57.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 shutdown_connections 2023-12-19T18:00:57.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:57.919+0000 7f31fe89f700 1 -- 172.21.15.45:0/2673968387 wait complete. 2023-12-19T18:00:57.928 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:00:57.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -4506> 2023-12-19T18:00:10.969+0000 7f446f675700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T18:00:57.937 INFO:tasks.ceph.mds.b.smithi073.stderr: -2649> 2023-12-19T18:00:18.477+0000 7f446f675700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T18:00:57.937 INFO:tasks.ceph.mds.b.smithi073.stderr: -2479> 2023-12-19T18:00:18.481+0000 7f446f675700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /subdir/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55cc418d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x10000000000:[<0x1/subdir v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:00:57.937 INFO:tasks.ceph.mds.b.smithi073.stderr: -2425> 2023-12-19T18:00:18.481+0000 7f446f675700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /subdir/sixmegs auth v1 ap=1 DIRTYPARENT s=6291456 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cc41948680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/sixmegs v8>,<0x1/subdir v10>]//[12]","memoryvalue":"(13)0x10000000001:[<0x10000000000/sixmegs v1>,<0x1/subdir v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:00:57.938 INFO:tasks.ceph.mds.b.smithi073.stderr: -2131> 2023-12-19T18:00:18.489+0000 7f446f675700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v5 ap=5 snaprealm=0x55cc418f6d80 DIRTYPARENT f(v1 1=0+1) n(v0 rc2023-12-19T18:00:18.171175+0000 1=0+1)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={7764=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x55cc418d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(11)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=0+1)","ondisk_value.rstat":"n(v0 2=0+2)","memory_value.dirstat":"f(v1 1=0+1)","memory_value.rstat":"n(v0 rc2023-12-19T18:00:18.171175+0000 1=0+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:00:57.948 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T18:00:58.000 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:00:58.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.127+0000 7f4c24dfc700 1 Processor -- start 2023-12-19T18:00:58.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.127+0000 7f4c24dfc700 1 -- start start 2023-12-19T18:00:58.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c24dfc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c2015cf20 0x7f4c200d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:58.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c24dfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200b8580 0x7f4c200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:58.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c24dfc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2015d300 con 0x7f4c200d25f0 2023-12-19T18:00:58.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c24dfc700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c200d1550 con 0x7f4c2015cf20 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c24dfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200d1830 con 0x7f4c200b8580 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c2015cf20 0x7f4c200d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4c2015cf20 0x7f4c200d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:57992/0 (socket says 172.21.15.45:57992) 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2424365746 learned_addr learned my addr 172.21.15.45:0/2424365746 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2424365746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200b8580 msgr2=0x7f4c200cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1effd700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200b8580 0x7f4c200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200b8580 0x7f4c200cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2424365746 >> v1:172.21.15.73:6789/0 conn(0x7f4c200d25f0 legacy=0x7f4c2006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:58.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2424365746 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c200d1b10 con 0x7f4c2015cf20 2023-12-19T18:00:58.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1effd700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200b8580 0x7f4c200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:00:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1f7fe700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c200d0c50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009910 tx=0x7f4c10009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df6c22eeeb28ef9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/2424365746 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10004230 con 0x7f4c2015cf20 2023-12-19T18:00:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/2424365746 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10004390 con 0x7f4c2015cf20 2023-12-19T18:00:58.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.131+0000 7f4c1e7fc700 1 -- 172.21.15.45:0/2424365746 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10009e60 con 0x7f4c2015cf20 2023-12-19T18:00:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2424365746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 msgr2=0x7f4c200d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c200d0c50 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4c10009910 tx=0x7f4c10009c20 comp rx=0 tx=0).stop 2023-12-19T18:00:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2424365746 shutdown_connections 2023-12-19T18:00:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200b8580 0x7f4c200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2424365746 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c200d0c50 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2424365746 >> 172.21.15.45:0/2424365746 conn(0x7f4c200b4670 msgr2=0x7f4c200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2424365746 shutdown_connections 2023-12-19T18:00:58.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.135+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2424365746 wait complete. 2023-12-19T18:00:58.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 Processor -- start 2023-12-19T18:00:58.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 -- start start 2023-12-19T18:00:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c200b8580 0x7f4c20160080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200d25f0 0x7f4c2015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c20155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2015e3f0 con 0x7f4c2015cf20 2023-12-19T18:00:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2015e670 con 0x7f4c200b8580 2023-12-19T18:00:58.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c24dfc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c2015e950 con 0x7f4c200d25f0 2023-12-19T18:00:58.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200d25f0 0x7f4c2015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c20155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200d25f0 0x7f4c2015deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:43924/0 (socket says 172.21.15.45:43924) 2023-12-19T18:00:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1effd700 1 -- 172.21.15.45:0/2343549245 learned_addr learned my addr 172.21.15.45:0/2343549245 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1f7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c200b8580 0x7f4c20160080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:58.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200d25f0 msgr2=0x7f4c2015deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1f7fe700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200d25f0 0x7f4c2015deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 msgr2=0x7f4c20155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1f7fe700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c20155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.139+0000 7f4c1f7fe700 1 -- 172.21.15.45:0/2343549245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10009570 con 0x7f4c200b8580 2023-12-19T18:00:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c1ffff700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c20155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:58.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c1f7fe700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c200b8580 0x7f4c20160080 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c10015000 tx=0x7f4c10004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000be50 con 0x7f4c200b8580 2023-12-19T18:00:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1001f070 con 0x7f4c200b8580 2023-12-19T18:00:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c2015ec30 con 0x7f4c200b8580 2023-12-19T18:00:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10003900 con 0x7f4c200b8580 2023-12-19T18:00:58.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c20153540 con 0x7f4c200b8580 2023-12-19T18:00:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.143+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c2004ed30 con 0x7f4c200b8580 2023-12-19T18:00:58.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.147+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4c10021030 con 0x7f4c200b8580 2023-12-19T18:00:58.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.147+0000 7f4c07fff700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c0c065ad0 0x7f4c0c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:58.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.147+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f4c10084b40 con 0x7f4c200b8580 2023-12-19T18:00:58.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.151+0000 7f4c1effd700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c0c065ad0 0x7f4c0c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:58.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.151+0000 7f4c1effd700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c0c065ad0 0x7f4c0c067f90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400ac00 tx=0x7f4c14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:58.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.155+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4c10052040 con 0x7f4c200b8580 2023-12-19T18:00:58.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.375+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4c2004ed30 con 0x7f4c200b8580 2023-12-19T18:00:58.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.935+0000 7f4c07fff700 1 -- 172.21.15.45:0/2343549245 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4c10055660 con 0x7f4c200b8580 2023-12-19T18:00:58.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c0c065ad0 msgr2=0x7f4c0c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:58.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c0c065ad0 0x7f4c0c067f90 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400ac00 tx=0x7f4c14008040 comp rx=0 tx=0).stop 2023-12-19T18:00:58.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c200b8580 msgr2=0x7f4c20160080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c200b8580 0x7f4c20160080 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4c10015000 tx=0x7f4c10004770 comp rx=0 tx=0).stop 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 shutdown_connections 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4c0c065ad0 0x7f4c0c067f90 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4c2015cf20 0x7f4c20155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4c200d25f0 0x7f4c2015deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 --2- 172.21.15.45:0/2343549245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4c200b8580 0x7f4c20160080 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 >> 172.21.15.45:0/2343549245 conn(0x7f4c200b4670 msgr2=0x7f4c200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:58.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 shutdown_connections 2023-12-19T18:00:58.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:58.939+0000 7f4c24dfc700 1 -- 172.21.15.45:0/2343549245 wait complete. 2023-12-19T18:00:58.969 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T18:00:59.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.167+0000 7f6f1f57f700 1 Processor -- start 2023-12-19T18:00:59.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.171+0000 7f6f1f57f700 1 -- start start 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.171+0000 7f6f1f57f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6f18161340 0x7f6f18167f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1f57f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1806fe80 con 0x7f6f1815d320 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1f57f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f18070160 con 0x7f6f1815cf40 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1f57f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f18070440 con 0x7f6f18161340 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1cb1a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6f1815d320 0x7f6f18160c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57770/0 (socket says 172.21.15.45:57770) 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1cb1a700 1 -- 172.21.15.45:0/1512782952 learned_addr learned my addr 172.21.15.45:0/1512782952 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:00:59.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1db1c700 1 --2- 172.21.15.45:0/1512782952 >> v2:172.21.15.73:3300/0 conn(0x7f6f18161340 0x7f6f18167f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483378712 0 0) 0x7f6f1806fe80 con 0x7f6f1815d320 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f040035d0 con 0x7f6f1815d320 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585823249 0 0) 0x7f6f040035d0 con 0x7f6f1815d320 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 >> v2:172.21.15.73:3300/0 conn(0x7f6f18161340 msgr2=0x7f6f18167f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 --2- 172.21.15.45:0/1512782952 >> v2:172.21.15.73:3300/0 conn(0x7f6f18161340 0x7f6f18167f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 >> v1:172.21.15.73:6789/0 conn(0x7f6f1815cf40 legacy=0x7f6f180b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180d1030 con 0x7f6f1815d320 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f6f08001670 con 0x7f6f1815d320 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1db1c700 1 --2- 172.21.15.45:0/1512782952 >> v2:172.21.15.73:3300/0 conn(0x7f6f18161340 0x7f6f18167f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 >> v1:172.21.15.45:6789/0 conn(0x7f6f1815d320 legacy=0x7f6f18160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f04003a20 0x7f6f04003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f04004870 0x7f6f04004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04005230 0x7f6f0400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18070440 con 0x7f6f04003a20 2023-12-19T18:00:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0400c080 con 0x7f6f04004870 2023-12-19T18:00:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0400c240 con 0x7f6f04005230 2023-12-19T18:00:59.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f04003a20 0x7f6f04003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1cb1a700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f04004870 0x7f6f04004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1db1c700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04005230 0x7f6f0400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 -- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04005230 msgr2=0x7f6f0400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04005230 0x7f6f0400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 -- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f04004870 msgr2=0x7f6f04004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f04004870 0x7f6f04004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 -- 172.21.15.45:0/1512782952 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f040035d0 con 0x7f6f04003a20 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1db1c700 1 -- 172.21.15.45:0/1512782952 reap_dead start 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.175+0000 7f6f1d31b700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f04003a20 0x7f6f04003e00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6f140018f0 tx=0x7f6f040058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f2796d263a10a9c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f14001390 con 0x7f6f04003a20 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f140052d0 con 0x7f6f04003a20 2023-12-19T18:00:59.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f0ffff700 1 -- 172.21.15.45:0/1512782952 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f140036a0 con 0x7f6f04003a20 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1512782952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f04003a20 msgr2=0x7f6f04003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f04003a20 0x7f6f04003e00 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f6f140018f0 tx=0x7f6f040058a0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1512782952 shutdown_connections 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1512782952 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f04003a20 0x7f6f04003e00 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1512782952 >> 172.21.15.45:0/1512782952 conn(0x7f6f180d2e50 msgr2=0x7f6f180d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1512782952 shutdown_connections 2023-12-19T18:00:59.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.179+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1512782952 wait complete. 2023-12-19T18:00:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 Processor -- start 2023-12-19T18:00:59.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 -- start start 2023-12-19T18:00:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04003a20 0x7f6f180c6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 0x7f6f1814d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f180c8630 0x7f6f180c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c8ff0 con 0x7f6f180c7fe0 2023-12-19T18:00:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c8460 con 0x7f6f180c8630 2023-12-19T18:00:59.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1f57f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c6f40 con 0x7f6f04003a20 2023-12-19T18:00:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1cb1a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 0x7f6f1814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1d31b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04003a20 0x7f6f180c6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1d31b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04003a20 0x7f6f180c6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:57894/0 (socket says 172.21.15.45:57894) 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1cb1a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 0x7f6f1814d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49878/0 (socket says 172.21.15.45:49878) 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1d31b700 1 -- 172.21.15.45:0/1465711004 learned_addr learned my addr 172.21.15.45:0/1465711004 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.183+0000 7f6f1db1c700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f180c8630 0x7f6f180c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1cb1a700 1 -- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04003a20 msgr2=0x7f6f180c6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1cb1a700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04003a20 0x7f6f180c6960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1cb1a700 1 -- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f180c8630 msgr2=0x7f6f180c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1cb1a700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f180c8630 0x7f6f180c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1cb1a700 1 -- 172.21.15.45:0/1465711004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180c7220 con 0x7f6f180c7fe0 2023-12-19T18:00:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1cb1a700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 0x7f6f1814d160 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6f08001030 tx=0x7f6f08007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08012560 con 0x7f6f180c7fe0 2023-12-19T18:00:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f080126e0 con 0x7f6f180c7fe0 2023-12-19T18:00:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f180c7500 con 0x7f6f180c7fe0 2023-12-19T18:00:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08012a90 con 0x7f6f180c7fe0 2023-12-19T18:00:59.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f180c7ac0 con 0x7f6f180c7fe0 2023-12-19T18:00:59.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.187+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1804ed30 con 0x7f6f180c7fe0 2023-12-19T18:00:59.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.191+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f08012bf0 con 0x7f6f180c7fe0 2023-12-19T18:00:59.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.191+0000 7f6f0dffb700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6efc065ad0 0x7f6efc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:00:59.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.191+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(95..95 src has 1..95) v4 ==== 6777+0+0 (secure 0 0 0) 0x7f6f08083440 con 0x7f6f180c7fe0 2023-12-19T18:00:59.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.191+0000 7f6f1d31b700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6efc065ad0 0x7f6efc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:00:59.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.195+0000 7f6f1d31b700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6efc065ad0 0x7f6efc067f90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6f14015040 tx=0x7f6f14005000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:00:59.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.199+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f080509d0 con 0x7f6f180c7fe0 2023-12-19T18:00:59.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.379+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6f180d0a40 con 0x7f6f180c7fe0 2023-12-19T18:00:59.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.943+0000 7f6f0dffb700 1 -- 172.21.15.45:0/1465711004 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6f08053ff0 con 0x7f6f180c7fe0 2023-12-19T18:00:59.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6efc065ad0 msgr2=0x7f6efc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6efc065ad0 0x7f6efc067f90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6f14015040 tx=0x7f6f14005000 comp rx=0 tx=0).stop 2023-12-19T18:00:59.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 msgr2=0x7f6f1814d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:00:59.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 0x7f6f1814d160 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6f08001030 tx=0x7f6f08007340 comp rx=0 tx=0).stop 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 shutdown_connections 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6efc065ad0 0x7f6efc067f90 secure :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f6f14015040 tx=0x7f6f14005000 comp rx=0 tx=0).stop 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f180c8630 0x7f6f180c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f180c7fe0 0x7f6f1814d160 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 --2- 172.21.15.45:0/1465711004 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f04003a20 0x7f6f180c6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 >> 172.21.15.45:0/1465711004 conn(0x7f6f180d2e50 msgr2=0x7f6f180b6640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 shutdown_connections 2023-12-19T18:00:59.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:00:59.947+0000 7f6f1f57f700 1 -- 172.21.15.45:0/1465711004 wait complete. 2023-12-19T18:00:59.959 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-19T18:00:59.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T18:01:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.155+0000 7fd107241700 1 Processor -- start 2023-12-19T18:01:00.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.155+0000 7fd107241700 1 -- start start 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd10015ccb0 0x7fd1000b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd10015d090 0x7fd1000d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1000d15b0 con 0x7fd1000d0e40 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000d2b90 con 0x7fd10015ccb0 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1000d1890 con 0x7fd10015d090 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd10015ccb0 0x7fd1000b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd10015ccb0 0x7fd1000b8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49888/0 (socket says 172.21.15.45:49888) 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 -- 172.21.15.45:0/3729191163 learned_addr learned my addr 172.21.15.45:0/3729191163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd105a3e700 1 --2- 172.21.15.45:0/3729191163 >> v2:172.21.15.73:3300/0 conn(0x7fd10015d090 0x7fd1000d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 -- 172.21.15.45:0/3729191163 >> v2:172.21.15.73:3300/0 conn(0x7fd10015d090 msgr2=0x7fd1000d2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 --2- 172.21.15.45:0/3729191163 >> v2:172.21.15.73:3300/0 conn(0x7fd10015d090 0x7fd1000d2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 -- 172.21.15.45:0/3729191163 >> v1:172.21.15.73:6789/0 conn(0x7fd1000d0e40 legacy=0x7fd100070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 -- 172.21.15.45:0/3729191163 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1000d1b70 con 0x7fd10015ccb0 2023-12-19T18:01:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd105a3e700 1 --2- 172.21.15.45:0/3729191163 >> v2:172.21.15.73:3300/0 conn(0x7fd10015d090 0x7fd1000d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10623f700 1 --2- 172.21.15.45:0/3729191163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1000b8900 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd1000701b0 tx=0x7fd0fc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804244197c02c954 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:00.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10523d700 1 -- 172.21.15.45:0/3729191163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc004230 con 0x7fd10015ccb0 2023-12-19T18:01:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10523d700 1 -- 172.21.15.45:0/3729191163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0fc004390 con 0x7fd10015ccb0 2023-12-19T18:01:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd10523d700 1 -- 172.21.15.45:0/3729191163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc0036c0 con 0x7fd10015ccb0 2023-12-19T18:01:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 -- 172.21.15.45:0/3729191163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 msgr2=0x7fd1000b8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.159+0000 7fd107241700 1 --2- 172.21.15.45:0/3729191163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1000b8900 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fd1000701b0 tx=0x7fd0fc009bf0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.163+0000 7fd107241700 1 -- 172.21.15.45:0/3729191163 shutdown_connections 2023-12-19T18:01:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.163+0000 7fd107241700 1 --2- 172.21.15.45:0/3729191163 >> v2:172.21.15.73:3300/0 conn(0x7fd10015d090 0x7fd1000d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.163+0000 7fd107241700 1 --2- 172.21.15.45:0/3729191163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1000b8900 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.163+0000 7fd107241700 1 -- 172.21.15.45:0/3729191163 >> 172.21.15.45:0/3729191163 conn(0x7fd1000d2f50 msgr2=0x7fd1000d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.163+0000 7fd107241700 1 -- 172.21.15.45:0/3729191163 shutdown_connections 2023-12-19T18:01:00.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.163+0000 7fd107241700 1 -- 172.21.15.45:0/3729191163 wait complete. 2023-12-19T18:01:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 Processor -- start 2023-12-19T18:01:00.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 -- start start 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1000d0e40 0x7fd100156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1001f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd10015d090 0x7fd1000c8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd100156ac0 con 0x7fd10015ccb0 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1000cb500 con 0x7fd1000d0e40 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd107241700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd100154920 con 0x7fd10015d090 2023-12-19T18:01:00.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1001f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1001f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49900/0 (socket says 172.21.15.45:49900) 2023-12-19T18:01:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 -- 172.21.15.45:0/3724327276 learned_addr learned my addr 172.21.15.45:0/3724327276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd10623f700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1000d0e40 0x7fd100156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd106a40700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd10015d090 0x7fd1000c8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 -- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd10015d090 msgr2=0x7fd1000c8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:00.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd10015d090 0x7fd1000c8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 -- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1000d0e40 msgr2=0x7fd100156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:00.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1000d0e40 0x7fd100156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.167+0000 7fd105a3e700 1 -- 172.21.15.45:0/3724327276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc009570 con 0x7fd10015ccb0 2023-12-19T18:01:00.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd105a3e700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1001f50b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c7f0 tx=0x7fd0f000cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011800 con 0x7fd10015ccb0 2023-12-19T18:01:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0f0011960 con 0x7fd10015ccb0 2023-12-19T18:01:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd100154c00 con 0x7fd10015ccb0 2023-12-19T18:01:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0011cf0 con 0x7fd10015ccb0 2023-12-19T18:01:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1000cb750 con 0x7fd10015ccb0 2023-12-19T18:01:00.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.171+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd100067c10 con 0x7fd10015ccb0 2023-12-19T18:01:00.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.175+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd0f0024480 con 0x7fd10015ccb0 2023-12-19T18:01:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.175+0000 7fd0f6ffd700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd0e4065ad0 0x7fd0e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.175+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fd0f0083620 con 0x7fd10015ccb0 2023-12-19T18:01:00.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.175+0000 7fd10623f700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd0e4065ad0 0x7fd0e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:00.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.175+0000 7fd10623f700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd0e4065ad0 0x7fd0e4067f90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd1000701b0 tx=0x7fd0fc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:00.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.179+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd0f0050dd0 con 0x7fd10015ccb0 2023-12-19T18:01:00.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.359+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd10004ed30 con 0x7fd10015ccb0 2023-12-19T18:01:00.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.951+0000 7fd0f6ffd700 1 -- 172.21.15.45:0/3724327276 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd0f00543f0 con 0x7fd10015ccb0 2023-12-19T18:01:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd0e4065ad0 msgr2=0x7fd0e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd0e4065ad0 0x7fd0e4067f90 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd1000701b0 tx=0x7fd0fc008030 comp rx=0 tx=0).stop 2023-12-19T18:01:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 msgr2=0x7fd1001f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:00.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1001f50b0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fd0f000c7f0 tx=0x7fd0f000cb00 comp rx=0 tx=0).stop 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 shutdown_connections 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd0e4065ad0 0x7fd0e4067f90 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd10015d090 0x7fd1000c8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd10015ccb0 0x7fd1001f50b0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 --2- 172.21.15.45:0/3724327276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd1000d0e40 0x7fd100156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 >> 172.21.15.45:0/3724327276 conn(0x7fd1000d2f50 msgr2=0x7fd1000cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 shutdown_connections 2023-12-19T18:01:00.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:00.959+0000 7fd107241700 1 -- 172.21.15.45:0/3724327276 wait complete. 2023-12-19T18:01:00.969 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-19T18:01:00.994 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_extra cephfs_data_extra --yes-i-really-really-mean-it 2023-12-19T18:01:01.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.175+0000 7f2d370d8700 1 Processor -- start 2023-12-19T18:01:01.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.175+0000 7f2d370d8700 1 -- start start 2023-12-19T18:01:01.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d30143750 0x7f2d3006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d300b0af0 0x7f2d3006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d300b1430 con 0x7f2d30143b30 2023-12-19T18:01:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d300c38d0 con 0x7f2d30143750 2023-12-19T18:01:01.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d300b1150 con 0x7f2d300b0af0 2023-12-19T18:01:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d30143750 0x7f2d3006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d30143750 0x7f2d3006eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49916/0 (socket says 172.21.15.45:49916) 2023-12-19T18:01:01.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 -- 172.21.15.45:0/3188391203 learned_addr learned my addr 172.21.15.45:0/3188391203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d368d7700 1 --2- 172.21.15.45:0/3188391203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d300b0af0 0x7f2d3006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 -- 172.21.15.45:0/3188391203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d300b0af0 msgr2=0x7f2d3006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 --2- 172.21.15.45:0/3188391203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d300b0af0 0x7f2d3006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 -- 172.21.15.45:0/3188391203 >> v1:172.21.15.73:6789/0 conn(0x7f2d30143b30 legacy=0x7f2d300b03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 -- 172.21.15.45:0/3188391203 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d300c3b70 con 0x7f2d30143750 2023-12-19T18:01:01.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d360d6700 1 --2- 172.21.15.45:0/3188391203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d3006eeb0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009910 tx=0x7f2d2c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78569dc79bc875d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:01.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d350d4700 1 -- 172.21.15.45:0/3188391203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c00ba60 con 0x7f2d30143750 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d350d4700 1 -- 172.21.15.45:0/3188391203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d2c00bbc0 con 0x7f2d30143750 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d350d4700 1 -- 172.21.15.45:0/3188391203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c009e60 con 0x7f2d30143750 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 -- 172.21.15.45:0/3188391203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 msgr2=0x7f2d3006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.179+0000 7f2d370d8700 1 --2- 172.21.15.45:0/3188391203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d3006eeb0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c009910 tx=0x7f2d2c009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- 172.21.15.45:0/3188391203 shutdown_connections 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 --2- 172.21.15.45:0/3188391203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d300b0af0 0x7f2d3006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 --2- 172.21.15.45:0/3188391203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d3006eeb0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- 172.21.15.45:0/3188391203 >> 172.21.15.45:0/3188391203 conn(0x7f2d300cecd0 msgr2=0x7f2d300cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- 172.21.15.45:0/3188391203 shutdown_connections 2023-12-19T18:01:01.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- 172.21.15.45:0/3188391203 wait complete. 2023-12-19T18:01:01.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 Processor -- start 2023-12-19T18:01:01.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- start start 2023-12-19T18:01:01.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300b0af0 0x7f2d3013d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:01.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d300b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:01.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d3013bb10 0x7f2d300acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:01.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3013c0b0 con 0x7f2d30143750 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3013c390 con 0x7f2d300b0af0 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d370d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d3013c670 con 0x7f2d3013bb10 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d358d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d300b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d358d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d300b3040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49924/0 (socket says 172.21.15.45:49924) 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.183+0000 7f2d358d5700 1 -- 172.21.15.45:0/2061173342 learned_addr learned my addr 172.21.15.45:0/2061173342 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d368d7700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d3013bb10 0x7f2d300acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:01.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d360d6700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300b0af0 0x7f2d3013d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d358d5700 1 -- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d3013bb10 msgr2=0x7f2d300acb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d358d5700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d3013bb10 0x7f2d300acb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d358d5700 1 -- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300b0af0 msgr2=0x7f2d3013d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:01.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d358d5700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300b0af0 0x7f2d3013d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d358d5700 1 -- 172.21.15.45:0/2061173342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d2c009570 con 0x7f2d30143750 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d360d6700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300b0af0 0x7f2d3013d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d358d5700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d300b3040 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000c4d0 tx=0x7f2d2000c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200052d0 con 0x7f2d30143750 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d3013c950 con 0x7f2d30143750 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d20005430 con 0x7f2d30143750 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d200055a0 con 0x7f2d30143750 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d300b3580 con 0x7f2d30143750 2023-12-19T18:01:01.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.187+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d3004ed30 con 0x7f2d30143750 2023-12-19T18:01:01.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.191+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d200038c0 con 0x7f2d30143750 2023-12-19T18:01:01.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.191+0000 7f2d26ffd700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d14065ad0 0x7f2d14067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:01.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.191+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 5925+0+0 (secure 0 0 0) 0x7f2d20082720 con 0x7f2d30143750 2023-12-19T18:01:01.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.191+0000 7f2d360d6700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d14065ad0 0x7f2d14067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:01.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.195+0000 7f2d360d6700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d14065ad0 0x7f2d14067f90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c000c00 tx=0x7f2d2c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:01.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.199+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2d2004fee0 con 0x7f2d30143750 2023-12-19T18:01:01.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.383+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f2d300aede0 con 0x7f2d30143750 2023-12-19T18:01:01.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:01:01.688 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:01:01.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.959+0000 7f2d26ffd700 1 -- 172.21.15.45:0/2061173342 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_extra' removed v98) v1 ==== 187+0+0 (secure 0 0 0) 0x7f2d20053500 con 0x7f2d30143750 2023-12-19T18:01:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d14065ad0 msgr2=0x7f2d14067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:01.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d14065ad0 0x7f2d14067f90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c000c00 tx=0x7f2d2c008030 comp rx=0 tx=0).stop 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 msgr2=0x7f2d300b3040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d300b3040 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000c4d0 tx=0x7f2d2000c7e0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 shutdown_connections 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d14065ad0 0x7f2d14067f90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d3013bb10 0x7f2d300acb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d30143750 0x7f2d300b3040 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 --2- 172.21.15.45:0/2061173342 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d300b0af0 0x7f2d3013d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 >> 172.21.15.45:0/2061173342 conn(0x7f2d300cecd0 msgr2=0x7f2d300ca620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:01.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 shutdown_connections 2023-12-19T18:01:01.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:01.967+0000 7f2d370d8700 1 -- 172.21.15.45:0/2061173342 wait complete. 2023-12-19T18:01:01.976 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' removed 2023-12-19T18:01:01.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T18:01:02.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.171+0000 7feab08eb700 1 Processor -- start 2023-12-19T18:01:02.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.171+0000 7feab08eb700 1 -- start start 2023-12-19T18:01:02.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feab08eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b540 0x7feaac1621c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feab08eb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac162700 con 0x7feaac15b920 2023-12-19T18:01:02.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feab08eb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaac0b1bb0 con 0x7feaac071ae0 2023-12-19T18:01:02.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feab08eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac0b2830 con 0x7feaac15b540 2023-12-19T18:01:02.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaa2ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7feaac15b920 0x7feaac0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57774/0 (socket says 172.21.15.45:57774) 2023-12-19T18:01:02.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaa2ffd700 1 -- 172.21.15.45:0/3344513134 learned_addr learned my addr 172.21.15.45:0/3344513134 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:02.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaab7fe700 1 --2- 172.21.15.45:0/3344513134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b540 0x7feaac1621c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaab7fe700 1 -- 172.21.15.45:0/3344513134 >> v1:172.21.15.73:6789/0 conn(0x7feaac071ae0 legacy=0x7feaac0af8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaab7fe700 1 -- 172.21.15.45:0/3344513134 >> v1:172.21.15.45:6789/0 conn(0x7feaac15b920 legacy=0x7feaac0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaab7fe700 1 -- 172.21.15.45:0/3344513134 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaac0b1e90 con 0x7feaac15b540 2023-12-19T18:01:02.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.175+0000 7feaaaffd700 1 -- 172.21.15.45:0/3344513134 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1284197716 0 0) 0x7feaac162700 con 0x7feaac15b920 2023-12-19T18:01:02.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feaab7fe700 1 --2- 172.21.15.45:0/3344513134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b540 0x7feaac1621c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e10 tx=0x7fea9c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=83ff687eda4f4301 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feaaaffd700 1 -- 172.21.15.45:0/3344513134 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00e070 con 0x7feaac15b540 2023-12-19T18:01:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feaaaffd700 1 -- 172.21.15.45:0/3344513134 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea9c00b9c0 con 0x7feaac15b540 2023-12-19T18:01:02.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feaaaffd700 1 -- 172.21.15.45:0/3344513134 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea9c00bd70 con 0x7feaac15b540 2023-12-19T18:01:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 -- 172.21.15.45:0/3344513134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b540 msgr2=0x7feaac1621c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 --2- 172.21.15.45:0/3344513134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b540 0x7feaac1621c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009e10 tx=0x7fea9c00b330 comp rx=0 tx=0).stop 2023-12-19T18:01:02.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 -- 172.21.15.45:0/3344513134 shutdown_connections 2023-12-19T18:01:02.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 --2- 172.21.15.45:0/3344513134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b540 0x7feaac1621c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 -- 172.21.15.45:0/3344513134 >> 172.21.15.45:0/3344513134 conn(0x7feaac0cf5a0 msgr2=0x7feaac070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:02.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 -- 172.21.15.45:0/3344513134 shutdown_connections 2023-12-19T18:01:02.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.179+0000 7feab08eb700 1 -- 172.21.15.45:0/3344513134 wait complete. 2023-12-19T18:01:02.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.183+0000 7feab08eb700 1 Processor -- start 2023-12-19T18:01:02.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.183+0000 7feab08eb700 1 -- start start 2023-12-19T18:01:02.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac15b540 0x7feaac15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b920 0x7feaac1f7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 0x7feaac1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1f6f60 con 0x7feaac1653b0 2023-12-19T18:01:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaac1f7eb0 con 0x7feaac15b540 2023-12-19T18:01:02.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaac15c810 con 0x7feaac15b920 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 0x7feaac1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 0x7feaac1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49928/0 (socket says 172.21.15.45:49928) 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 -- 172.21.15.45:0/1862964637 learned_addr learned my addr 172.21.15.45:0/1862964637 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaa2ffd700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b920 0x7feaac1f7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaab7fe700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac15b540 0x7feaac15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 -- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b920 msgr2=0x7feaac1f7970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b920 0x7feaac1f7970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 -- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac15b540 msgr2=0x7feaac15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac15b540 0x7feaac15c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 -- 172.21.15.45:0/1862964637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9c009a70 con 0x7feaac1653b0 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaabfff700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 0x7feaac1548c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7feaa400c370 tx=0x7feaa400c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa40052d0 con 0x7feaac1653b0 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaac15caf0 con 0x7feaac1653b0 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa4005430 con 0x7feaac1653b0 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa4003930 con 0x7feaac1653b0 2023-12-19T18:01:02.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.187+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaac1f7170 con 0x7feaac1653b0 2023-12-19T18:01:02.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.191+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaac15d010 con 0x7feaac1653b0 2023-12-19T18:01:02.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.191+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feaa4003a90 con 0x7feaac1653b0 2023-12-19T18:01:02.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.195+0000 7feaa8ff9700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea8c065ad0 0x7fea8c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.195+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5521+0+0 (secure 0 0 0) 0x7feaa40823c0 con 0x7feaac1653b0 2023-12-19T18:01:02.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.195+0000 7feaab7fe700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea8c065ad0 0x7fea8c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.195+0000 7feaab7fe700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea8c065ad0 0x7fea8c067f90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fea9c014040 tx=0x7fea9c01e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:02.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.203+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feaac15d010 con 0x7feaac1653b0 2023-12-19T18:01:02.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.379+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7feaac15d010 con 0x7feaac1653b0 2023-12-19T18:01:02.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.387+0000 7feaa8ff9700 1 -- 172.21.15.45:0/1862964637 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7feaac15d010 con 0x7feaac1653b0 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea8c065ad0 msgr2=0x7fea8c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea8c065ad0 0x7fea8c067f90 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fea9c014040 tx=0x7fea9c01e040 comp rx=0 tx=0).stop 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 msgr2=0x7feaac1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 0x7feaac1548c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7feaa400c370 tx=0x7feaa400c680 comp rx=0 tx=0).stop 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 shutdown_connections 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fea8c065ad0 0x7fea8c067f90 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7feaac1653b0 0x7feaac1548c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7feaac15b920 0x7feaac1f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 --2- 172.21.15.45:0/1862964637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7feaac15b540 0x7feaac15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.391+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 >> 172.21.15.45:0/1862964637 conn(0x7feaac071ae0 msgr2=0x7feaac15f280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.395+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 shutdown_connections 2023-12-19T18:01:02.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.395+0000 7feab08eb700 1 -- 172.21.15.45:0/1862964637 wait complete. 2023-12-19T18:01:02.422 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_simple' 2023-12-19T18:01:02.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.599+0000 7f3b87345700 1 Processor -- start 2023-12-19T18:01:02.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b87345700 1 -- start start 2023-12-19T18:01:02.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b87345700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3b800afe30 0x7f3b8015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b87345700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8006f0a0 con 0x7f3b8006cad0 2023-12-19T18:01:02.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b87345700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b8006ea90 con 0x7f3b8015ae20 2023-12-19T18:01:02.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b87345700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b800c3f60 con 0x7f3b800afe30 2023-12-19T18:01:02.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b85b42700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3b8006cad0 0x7f3b800af720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57776/0 (socket says 172.21.15.45:57776) 2023-12-19T18:01:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.603+0000 7f3b85b42700 1 -- 172.21.15.45:0/1088388124 learned_addr learned my addr 172.21.15.45:0/1088388124 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b86b44700 1 --2- 172.21.15.45:0/1088388124 >> v2:172.21.15.73:3300/0 conn(0x7f3b800afe30 0x7f3b8015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b85341700 1 -- 172.21.15.45:0/1088388124 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2283372333 0 0) 0x7f3b8006f0a0 con 0x7f3b8006cad0 2023-12-19T18:01:02.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b85341700 1 -- 172.21.15.45:0/1088388124 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b6c0035d0 con 0x7f3b8006cad0 2023-12-19T18:01:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b85341700 1 -- 172.21.15.45:0/1088388124 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1826101126 0 0) 0x7f3b6c0035d0 con 0x7f3b8006cad0 2023-12-19T18:01:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b86b44700 1 -- 172.21.15.45:0/1088388124 >> v1:172.21.15.73:6789/0 conn(0x7f3b8015ae20 legacy=0x7f3b800c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b86b44700 1 -- 172.21.15.45:0/1088388124 >> v1:172.21.15.45:6789/0 conn(0x7f3b8006cad0 legacy=0x7f3b800af720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b86b44700 1 -- 172.21.15.45:0/1088388124 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b800c4240 con 0x7f3b800afe30 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b86b44700 1 --2- 172.21.15.45:0/1088388124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b800afe30 0x7f3b8015be40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009d90 tx=0x7f3b7800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=679fa57225d0db7d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b85341700 1 -- 172.21.15.45:0/1088388124 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800e070 con 0x7f3b800afe30 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b85341700 1 -- 172.21.15.45:0/1088388124 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b78003a40 con 0x7f3b800afe30 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b85341700 1 -- 172.21.15.45:0/1088388124 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b70001670 con 0x7f3b800afe30 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 -- 172.21.15.45:0/1088388124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b800afe30 msgr2=0x7f3b8015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 --2- 172.21.15.45:0/1088388124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b800afe30 0x7f3b8015be40 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009d90 tx=0x7f3b7800b330 comp rx=0 tx=0).stop 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 -- 172.21.15.45:0/1088388124 shutdown_connections 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 --2- 172.21.15.45:0/1088388124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b800afe30 0x7f3b8015be40 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 -- 172.21.15.45:0/1088388124 >> 172.21.15.45:0/1088388124 conn(0x7f3b800cb900 msgr2=0x7f3b800b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 -- 172.21.15.45:0/1088388124 shutdown_connections 2023-12-19T18:01:02.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.607+0000 7f3b87345700 1 -- 172.21.15.45:0/1088388124 wait complete. 2023-12-19T18:01:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 Processor -- start 2023-12-19T18:01:02.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 -- start start 2023-12-19T18:01:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b8006cad0 0x7f3b8014e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b800afe30 0x7f3b800ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 0x7f3b80154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c9c10 con 0x7f3b8015ae20 2023-12-19T18:01:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800ca570 con 0x7f3b8006cad0 2023-12-19T18:01:02.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b87345700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b800c8f90 con 0x7f3b800afe30 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b86b44700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 0x7f3b80154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b86b44700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 0x7f3b80154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49942/0 (socket says 172.21.15.45:49942) 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.611+0000 7f3b86b44700 1 -- 172.21.15.45:0/2760372449 learned_addr learned my addr 172.21.15.45:0/2760372449 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86343700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b8006cad0 0x7f3b8014e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b85b42700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b800afe30 0x7f3b800ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86b44700 1 -- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b800afe30 msgr2=0x7f3b800ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86b44700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b800afe30 0x7f3b800ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86b44700 1 -- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b8006cad0 msgr2=0x7f3b8014e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86b44700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b8006cad0 0x7f3b8014e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86b44700 1 -- 172.21.15.45:0/2760372449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009a70 con 0x7f3b8015ae20 2023-12-19T18:01:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b85b42700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b800afe30 0x7f3b800ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b86b44700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 0x7f3b80154670 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3b800cb1b0 tx=0x7f3b78004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:02.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b78004540 con 0x7f3b8015ae20 2023-12-19T18:01:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b780046a0 con 0x7f3b8015ae20 2023-12-19T18:01:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b800c9270 con 0x7f3b8015ae20 2023-12-19T18:01:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7801d470 con 0x7f3b8015ae20 2023-12-19T18:01:02.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.615+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b800c9830 con 0x7f3b8015ae20 2023-12-19T18:01:02.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.619+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b800c9d50 con 0x7f3b8015ae20 2023-12-19T18:01:02.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.619+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3b7801d5d0 con 0x7f3b8015ae20 2023-12-19T18:01:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.619+0000 7f3b76ffd700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b64065ad0 0x7f3b64067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.619+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f3b78084e30 con 0x7f3b8015ae20 2023-12-19T18:01:02.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.619+0000 7f3b86343700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b64065ad0 0x7f3b64067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:02.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.623+0000 7f3b86343700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b64065ad0 0x7f3b64067f90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000f60 tx=0x7f3b7c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:02.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.627+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3b800c9d50 con 0x7f3b8015ae20 2023-12-19T18:01:02.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.867+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_simple"]} v 0) v1 -- 0x7f3b800c9d50 con 0x7f3b8015ae20 2023-12-19T18:01:02.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.975+0000 7f3b76ffd700 1 -- 172.21.15.45:0/2760372449 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_rebuild_simple"]}]=0 v419) v1 ==== 155+0+0 (secure 0 0 0) 0x7f3b800c9d50 con 0x7f3b8015ae20 2023-12-19T18:01:02.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b64065ad0 msgr2=0x7f3b64067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b64065ad0 0x7f3b64067f90 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c000f60 tx=0x7f3b7c009040 comp rx=0 tx=0).stop 2023-12-19T18:01:02.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 msgr2=0x7f3b80154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 0x7f3b80154670 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f3b800cb1b0 tx=0x7f3b78004af0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 shutdown_connections 2023-12-19T18:01:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3b64065ad0 0x7f3b64067f90 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3b8015ae20 0x7f3b80154670 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3b800afe30 0x7f3b800ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 --2- 172.21.15.45:0/2760372449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3b8006cad0 0x7f3b8014e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 >> 172.21.15.45:0/2760372449 conn(0x7f3b800cb900 msgr2=0x7f3b8015b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 shutdown_connections 2023-12-19T18:01:02.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:02.979+0000 7f3b87345700 1 -- 172.21.15.45:0/2760372449 wait complete. 2023-12-19T18:01:03.010 INFO:tasks.cephfs_test_runner:test_extra_data_pool_rebuild_simple (tasks.cephfs.test_data_scan.TestDataScan) ... ok 2023-12-19T18:01:03.011 INFO:tasks.cephfs_test_runner:Starting test: test_extra_data_pool_stashed_layout (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T18:01:03.011 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_stashed_layout' 2023-12-19T18:01:03.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.187+0000 7f5a66fb3700 1 Processor -- start 2023-12-19T18:01:03.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.187+0000 7f5a66fb3700 1 -- start start 2023-12-19T18:01:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a66fb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a6006d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a66fb3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6006cbb0 con 0x7f5a6015ab50 2023-12-19T18:01:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a66fb3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a6006fa10 con 0x7f5a600cd480 2023-12-19T18:01:03.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a66fb3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6006fcf0 con 0x7f5a6015af30 2023-12-19T18:01:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a64d4f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5a6015ab50 0x7f5a600ccd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57778/0 (socket says 172.21.15.45:57778) 2023-12-19T18:01:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a64d4f700 1 -- 172.21.15.45:0/4270986659 learned_addr learned my addr 172.21.15.45:0/4270986659 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:03.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a65550700 1 --2- 172.21.15.45:0/4270986659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a6006d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a65550700 1 -- 172.21.15.45:0/4270986659 >> v1:172.21.15.73:6789/0 conn(0x7f5a600cd480 legacy=0x7f5a6006d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a65550700 1 -- 172.21.15.45:0/4270986659 >> v1:172.21.15.45:6789/0 conn(0x7f5a6015ab50 legacy=0x7f5a600ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a65550700 1 -- 172.21.15.45:0/4270986659 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6006ffd0 con 0x7f5a6015af30 2023-12-19T18:01:03.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.191+0000 7f5a5f7fe700 1 -- 172.21.15.45:0/4270986659 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196143009 0 0) 0x7f5a6006cbb0 con 0x7f5a6015ab50 2023-12-19T18:01:03.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a65550700 1 --2- 172.21.15.45:0/4270986659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a6006d7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009dc0 tx=0x7f5a5800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e765569fbeba831 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a5f7fe700 1 -- 172.21.15.45:0/4270986659 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800e070 con 0x7f5a6015af30 2023-12-19T18:01:03.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a5f7fe700 1 -- 172.21.15.45:0/4270986659 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5800bbd0 con 0x7f5a6015af30 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a5f7fe700 1 -- 172.21.15.45:0/4270986659 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58012430 con 0x7f5a6015af30 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 -- 172.21.15.45:0/4270986659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 msgr2=0x7f5a6006d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/4270986659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a6006d7a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5a58009dc0 tx=0x7f5a5800b330 comp rx=0 tx=0).stop 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 -- 172.21.15.45:0/4270986659 shutdown_connections 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/4270986659 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a6006d7a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 -- 172.21.15.45:0/4270986659 >> 172.21.15.45:0/4270986659 conn(0x7f5a600cba40 msgr2=0x7f5a600ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:03.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 -- 172.21.15.45:0/4270986659 shutdown_connections 2023-12-19T18:01:03.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.195+0000 7f5a66fb3700 1 -- 172.21.15.45:0/4270986659 wait complete. 2023-12-19T18:01:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 Processor -- start 2023-12-19T18:01:03.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 -- start start 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 0x7f5a600c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6015ab50 0x7f5a600acae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a601f6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600c5800 con 0x7f5a600cd480 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600aba40 con 0x7f5a6015ab50 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a66fb3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a600abd20 con 0x7f5a6015af30 2023-12-19T18:01:03.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a64d4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 0x7f5a600c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a64d4f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 0x7f5a600c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49950/0 (socket says 172.21.15.45:49950) 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.199+0000 7f5a64d4f700 1 -- 172.21.15.45:0/3311338667 learned_addr learned my addr 172.21.15.45:0/3311338667 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a65550700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a601f6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a5ffff700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6015ab50 0x7f5a600acae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a64d4f700 1 -- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 msgr2=0x7f5a601f6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a64d4f700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a601f6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a64d4f700 1 -- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6015ab50 msgr2=0x7f5a600acae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a64d4f700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6015ab50 0x7f5a600acae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a64d4f700 1 -- 172.21.15.45:0/3311338667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58009a70 con 0x7f5a600cd480 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a64d4f700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 0x7f5a600c52c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400c550 tx=0x7f5a5400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54004ca0 con 0x7f5a600cd480 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a600ac000 con 0x7f5a600cd480 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a54004e00 con 0x7f5a600cd480 2023-12-19T18:01:03.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a54007310 con 0x7f5a600cd480 2023-12-19T18:01:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a600ac5c0 con 0x7f5a600cd480 2023-12-19T18:01:03.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.203+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6004ed30 con 0x7f5a600cd480 2023-12-19T18:01:03.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.207+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a54007470 con 0x7f5a600cd480 2023-12-19T18:01:03.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.207+0000 7f5a5d7fa700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a44065ad0 0x7f5a44067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:03.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.207+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f5a54082db0 con 0x7f5a600cd480 2023-12-19T18:01:03.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.207+0000 7f5a5ffff700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a44065ad0 0x7f5a44067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:03.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.207+0000 7f5a5ffff700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a44065ad0 0x7f5a44067f90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5a601e7410 tx=0x7f5a4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:03.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.215+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5a540507a0 con 0x7f5a600cd480 2023-12-19T18:01:03.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.451+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_stashed_layout"]} v 0) v1 -- 0x7f5a6014eb40 con 0x7f5a600cd480 2023-12-19T18:01:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.979+0000 7f5a5d7fa700 1 -- 172.21.15.45:0/3311338667 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_stashed_layout"]}]=0 v420) v1 ==== 158+0+0 (secure 0 0 0) 0x7f5a54007720 con 0x7f5a600cd480 2023-12-19T18:01:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a44065ad0 msgr2=0x7f5a44067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a44065ad0 0x7f5a44067f90 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f5a601e7410 tx=0x7f5a4c009040 comp rx=0 tx=0).stop 2023-12-19T18:01:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 msgr2=0x7f5a600c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:03.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 0x7f5a600c52c0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400c550 tx=0x7f5a5400c860 comp rx=0 tx=0).stop 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 shutdown_connections 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a44065ad0 0x7f5a44067f90 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5a6015af30 0x7f5a601f6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.983+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5a6015ab50 0x7f5a600acae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.987+0000 7f5a66fb3700 1 --2- 172.21.15.45:0/3311338667 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5a600cd480 0x7f5a600c52c0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.987+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 >> 172.21.15.45:0/3311338667 conn(0x7f5a600cba40 msgr2=0x7f5a600ce9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.987+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 shutdown_connections 2023-12-19T18:01:03.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:03.987+0000 7f5a66fb3700 1 -- 172.21.15.45:0/3311338667 wait complete. 2023-12-19T18:01:04.017 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T18:01:04.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.211+0000 7f6464c34700 1 Processor -- start 2023-12-19T18:01:04.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.211+0000 7f6464c34700 1 -- start start 2023-12-19T18:01:04.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f6464c34700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f6464c34700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64600cdff0 0x7f64600cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f6464c34700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64600d01e0 con 0x7f64600cfd70 2023-12-19T18:01:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f6464c34700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64600b6040 con 0x7f64600cdff0 2023-12-19T18:01:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f6464c34700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64600d10e0 con 0x7f646015d090 2023-12-19T18:01:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645dd9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f64600cdff0 0x7f64600cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645ed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f64600cfd70 0x7f646006ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57790/0 (socket says 172.21.15.45:57790) 2023-12-19T18:01:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645ed9d700 1 -- 172.21.15.45:0/3909317874 learned_addr learned my addr 172.21.15.45:0/3909317874 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:04.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645e59c700 1 --2- 172.21.15.45:0/3909317874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645d59a700 1 -- 172.21.15.45:0/3909317874 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3774232475 0 0) 0x7f6458001490 con 0x7f64600cfd70 2023-12-19T18:01:04.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645d59a700 1 -- 172.21.15.45:0/3909317874 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64480035d0 con 0x7f64600cfd70 2023-12-19T18:01:04.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645dd9b700 1 -- 172.21.15.45:0/3909317874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 msgr2=0x7f64600d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:04.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645dd9b700 1 --2- 172.21.15.45:0/3909317874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645dd9b700 1 -- 172.21.15.45:0/3909317874 >> v1:172.21.15.45:6789/0 conn(0x7f64600cfd70 legacy=0x7f646006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.215+0000 7f645dd9b700 1 -- 172.21.15.45:0/3909317874 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64600d13c0 con 0x7f64600cdff0 2023-12-19T18:01:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f645dd9b700 1 --2- 172.21.15.45:0/3909317874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cdff0 0x7f64600cf830 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6454009850 tx=0x7f6454009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e23bad876f0ff837 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f645d59a700 1 -- 172.21.15.45:0/3909317874 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011830 con 0x7f64600cdff0 2023-12-19T18:01:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f645d59a700 1 -- 172.21.15.45:0/3909317874 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6454011990 con 0x7f64600cdff0 2023-12-19T18:01:04.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f645d59a700 1 -- 172.21.15.45:0/3909317874 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454011d00 con 0x7f64600cdff0 2023-12-19T18:01:04.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 -- 172.21.15.45:0/3909317874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cdff0 msgr2=0x7f64600cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 --2- 172.21.15.45:0/3909317874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cdff0 0x7f64600cf830 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f6454009850 tx=0x7f6454009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:04.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 -- 172.21.15.45:0/3909317874 shutdown_connections 2023-12-19T18:01:04.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 --2- 172.21.15.45:0/3909317874 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cdff0 0x7f64600cf830 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 --2- 172.21.15.45:0/3909317874 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 -- 172.21.15.45:0/3909317874 >> 172.21.15.45:0/3909317874 conn(0x7f64600b4b90 msgr2=0x7f64600b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:04.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 -- 172.21.15.45:0/3909317874 shutdown_connections 2023-12-19T18:01:04.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.219+0000 7f6464c34700 1 -- 172.21.15.45:0/3909317874 wait complete. 2023-12-19T18:01:04.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.223+0000 7f6464c34700 1 Processor -- start 2023-12-19T18:01:04.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.223+0000 7f6464c34700 1 -- start start 2023-12-19T18:01:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f6464c34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64600cdff0 0x7f646015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f6464c34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 0x7f64601f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f6464c34700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f6464c34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f646015e4c0 con 0x7f64600cfd70 2023-12-19T18:01:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f6464c34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64600ab200 con 0x7f64600cdff0 2023-12-19T18:01:04.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f6464c34700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f646015ef60 con 0x7f646015d090 2023-12-19T18:01:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 0x7f64601f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 0x7f64601f2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49970/0 (socket says 172.21.15.45:49970) 2023-12-19T18:01:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 -- 172.21.15.45:0/1506953130 learned_addr learned my addr 172.21.15.45:0/1506953130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645e59c700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64600cdff0 0x7f646015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645ed9d700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 -- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 msgr2=0x7f64600c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600c8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 -- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64600cdff0 msgr2=0x7f646015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64600cdff0 0x7f646015a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 -- 172.21.15.45:0/1506953130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64540094b0 con 0x7f64600cfd70 2023-12-19T18:01:04.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645e59c700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64600cdff0 0x7f646015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.227+0000 7f645dd9b700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 0x7f64601f2640 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f64540090b0 tx=0x7f6454004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.231+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454004590 con 0x7f64600cfd70 2023-12-19T18:01:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.231+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f645401f070 con 0x7f64600cfd70 2023-12-19T18:01:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.231+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6454003900 con 0x7f64600cfd70 2023-12-19T18:01:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.231+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f646015f240 con 0x7f64600cfd70 2023-12-19T18:01:04.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.231+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f646015f800 con 0x7f64600cfd70 2023-12-19T18:01:04.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.231+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f646004ed30 con 0x7f64600cfd70 2023-12-19T18:01:04.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.235+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6454003a60 con 0x7f64600cfd70 2023-12-19T18:01:04.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.235+0000 7f644effd700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6440065ad0 0x7f6440067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.235+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f6454021070 con 0x7f64600cfd70 2023-12-19T18:01:04.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.235+0000 7f645e59c700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6440065ad0 0x7f6440067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.235+0000 7f645e59c700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6440065ad0 0x7f6440067f90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f64600cac50 tx=0x7f6450009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:04.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.243+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6454052280 con 0x7f64600cfd70 2023-12-19T18:01:04.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.419+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f64600cc900 con 0x7f64600cfd70 2023-12-19T18:01:04.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.423+0000 7f644effd700 1 -- 172.21.15.45:0/1506953130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f64540150c0 con 0x7f64600cfd70 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6440065ad0 msgr2=0x7f6440067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6440065ad0 0x7f6440067f90 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f64600cac50 tx=0x7f6450009240 comp rx=0 tx=0).stop 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 msgr2=0x7f64601f2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 0x7f64601f2640 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f64540090b0 tx=0x7f6454004770 comp rx=0 tx=0).stop 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 shutdown_connections 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6440065ad0 0x7f6440067f90 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f646015d090 0x7f64600c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64600cfd70 0x7f64601f2640 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 --2- 172.21.15.45:0/1506953130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64600cdff0 0x7f646015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 >> 172.21.15.45:0/1506953130 conn(0x7f64600b4b90 msgr2=0x7f64600d3760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:04.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 shutdown_connections 2023-12-19T18:01:04.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.427+0000 7f6464c34700 1 -- 172.21.15.45:0/1506953130 wait complete. 2023-12-19T18:01:04.457 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:01:04.457 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:01:04.509 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:01:04.555 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:01:04.555 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:01:04.555 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:01:04.574 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:01:04.575 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:01:04.575 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:01:04.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:01:04.617 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:01:04.617 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:01:04.638 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:01:04.638 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:01:04.638 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:01:04.677 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:01:04.677 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T18:01:04.678 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:04.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.851+0000 7fd209951700 1 Processor -- start 2023-12-19T18:01:04.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.851+0000 7fd209951700 1 -- start start 2023-12-19T18:01:04.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209951700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2041615a0 0x7fd2040c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209951700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2040af720 0x7fd2040afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209951700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040c3f90 con 0x7fd2041611c0 2023-12-19T18:01:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209951700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2040b00f0 con 0x7fd2040af720 2023-12-19T18:01:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209951700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd204070340 con 0x7fd2041615a0 2023-12-19T18:01:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd20894f700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd2041611c0 0x7fd20406d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57806/0 (socket says 172.21.15.45:57806) 2023-12-19T18:01:04.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd20894f700 1 -- 172.21.15.45:0/3305077925 learned_addr learned my addr 172.21.15.45:0/3305077925 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209150700 1 --2- 172.21.15.45:0/3305077925 >> v2:172.21.15.45:3300/0 conn(0x7fd2040af720 0x7fd2040afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd1fbfff700 1 --2- 172.21.15.45:0/3305077925 >> v2:172.21.15.73:3300/0 conn(0x7fd2041615a0 0x7fd2040c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd1fb7fe700 1 -- 172.21.15.45:0/3305077925 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1762864416 0 0) 0x7fd2040c3f90 con 0x7fd2041611c0 2023-12-19T18:01:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd1fb7fe700 1 -- 172.21.15.45:0/3305077925 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1ec0035d0 con 0x7fd2041611c0 2023-12-19T18:01:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209150700 1 -- 172.21.15.45:0/3305077925 >> v2:172.21.15.73:3300/0 conn(0x7fd2041615a0 msgr2=0x7fd2040c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:04.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209150700 1 --2- 172.21.15.45:0/3305077925 >> v2:172.21.15.73:3300/0 conn(0x7fd2041615a0 0x7fd2040c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209150700 1 -- 172.21.15.45:0/3305077925 >> v1:172.21.15.45:6789/0 conn(0x7fd2041611c0 legacy=0x7fd20406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.855+0000 7fd209150700 1 -- 172.21.15.45:0/3305077925 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040c4270 con 0x7fd2040af720 2023-12-19T18:01:04.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209150700 1 --2- 172.21.15.45:0/3305077925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2040af720 0x7fd2040afbb0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd2040b1560 tx=0x7fd1fc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af362cb0de8a3f14 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd1fb7fe700 1 -- 172.21.15.45:0/3305077925 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00e070 con 0x7fd2040af720 2023-12-19T18:01:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd1fb7fe700 1 -- 172.21.15.45:0/3305077925 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc00bb20 con 0x7fd2040af720 2023-12-19T18:01:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd1fb7fe700 1 -- 172.21.15.45:0/3305077925 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc00be90 con 0x7fd2040af720 2023-12-19T18:01:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 -- 172.21.15.45:0/3305077925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2040af720 msgr2=0x7fd2040afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 --2- 172.21.15.45:0/3305077925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2040af720 0x7fd2040afbb0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fd2040b1560 tx=0x7fd1fc00b330 comp rx=0 tx=0).stop 2023-12-19T18:01:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 -- 172.21.15.45:0/3305077925 shutdown_connections 2023-12-19T18:01:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 --2- 172.21.15.45:0/3305077925 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2040af720 0x7fd2040afbb0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 --2- 172.21.15.45:0/3305077925 >> v2:172.21.15.73:3300/0 conn(0x7fd2041615a0 0x7fd2040c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 -- 172.21.15.45:0/3305077925 >> 172.21.15.45:0/3305077925 conn(0x7fd2040cb900 msgr2=0x7fd2040b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 -- 172.21.15.45:0/3305077925 shutdown_connections 2023-12-19T18:01:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 -- 172.21.15.45:0/3305077925 wait complete. 2023-12-19T18:01:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.859+0000 7fd209951700 1 Processor -- start 2023-12-19T18:01:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 -- start start 2023-12-19T18:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2040af720 0x7fd204152c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2041611c0 0x7fd2040c65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 0x7fd20415b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20415a810 con 0x7fd2041615a0 2023-12-19T18:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20415aaf0 con 0x7fd2040af720 2023-12-19T18:01:04.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20415add0 con 0x7fd2041611c0 2023-12-19T18:01:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 0x7fd20415b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 0x7fd20415b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:49992/0 (socket says 172.21.15.45:49992) 2023-12-19T18:01:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 -- 172.21.15.45:0/4054677234 learned_addr learned my addr 172.21.15.45:0/4054677234 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd1fbfff700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2041611c0 0x7fd2040c65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd20894f700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2040af720 0x7fd204152c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 -- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2041611c0 msgr2=0x7fd2040c65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2041611c0 0x7fd2040c65d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 -- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2040af720 msgr2=0x7fd204152c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2040af720 0x7fd204152c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 -- 172.21.15.45:0/4054677234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc009a70 con 0x7fd2041615a0 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd20894f700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2040af720 0x7fd204152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:04.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209150700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 0x7fd20415b8b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b370 tx=0x7fd1fc004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc003e50 con 0x7fd2041615a0 2023-12-19T18:01:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc020070 con 0x7fd2041615a0 2023-12-19T18:01:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0276c0 con 0x7fd2041615a0 2023-12-19T18:01:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.863+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20415b0b0 con 0x7fd2041615a0 2023-12-19T18:01:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.867+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd204153160 con 0x7fd2041615a0 2023-12-19T18:01:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.867+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd20406e760 con 0x7fd2041615a0 2023-12-19T18:01:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.867+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd1fc027820 con 0x7fd2041615a0 2023-12-19T18:01:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.871+0000 7fd1f97fa700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1f0065ad0 0x7fd1f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.871+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fd1fc022070 con 0x7fd2041615a0 2023-12-19T18:01:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.871+0000 7fd20894f700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1f0065ad0 0x7fd1f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.871+0000 7fd20894f700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1f0065ad0 0x7fd1f0067f90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd200005930 tx=0x7fd200009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:04.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:04.879+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd1fc052a80 con 0x7fd2041615a0 2023-12-19T18:01:05.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.099+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd20415b5d0 con 0x7fd2041615a0 2023-12-19T18:01:05.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.099+0000 7fd1f97fa700 1 -- 172.21.15.45:0/4054677234 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3520 (secure 0 0 0) 0x7fd20415b5d0 con 0x7fd2041615a0 2023-12-19T18:01:05.106 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:05.106 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7495,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2881617867","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2881617867},{"type":"v1","addr":"172.21.15.45:6837","nonce":2881617867}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":67},{"gid":7498,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/13160268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":13160268},{"type":"v1","addr":"172.21.15.73:6834","nonce":13160268}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":68},{"gid":7698,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/3881803392","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":3881803392},{"type":"v1","addr":"172.21.15.45:6836","nonce":3881803392}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7720,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/517207978","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":517207978},{"type":"v1","addr":"172.21.15.73:6835","nonce":517207978}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72}],"filesystems":[]} 2023-12-19T18:01:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1f0065ad0 msgr2=0x7fd1f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1f0065ad0 0x7fd1f0067f90 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd200005930 tx=0x7fd200009040 comp rx=0 tx=0).stop 2023-12-19T18:01:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 msgr2=0x7fd20415b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 0x7fd20415b8b0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00b370 tx=0x7fd1fc004af0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 shutdown_connections 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd1f0065ad0 0x7fd1f0067f90 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2041615a0 0x7fd20415b8b0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2041611c0 0x7fd2040c65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 --2- 172.21.15.45:0/4054677234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2040af720 0x7fd204152c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 >> 172.21.15.45:0/4054677234 conn(0x7fd2040cb900 msgr2=0x7fd2040b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 shutdown_connections 2023-12-19T18:01:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.103+0000 7fd209951700 1 -- 172.21.15.45:0/4054677234 wait complete. 2023-12-19T18:01:05.112 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 72 2023-12-19T18:01:05.134 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T18:01:05.134 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T18:01:05.134 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T18:01:05.134 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:05.135 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T18:01:05.135 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T18:01:05.135 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T18:01:05.135 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:05.135 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T18:01:05.135 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T18:01:05.135 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T18:01:05.135 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:05.136 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T18:01:05.136 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T18:01:05.136 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T18:01:05.136 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:05.155 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T18:01:05.156 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T18:01:05.157 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T18:01:05.158 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T18:01:05.158 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T18:01:05.158 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T18:01:05.160 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T18:01:05.160 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T18:01:05.206 INFO:tasks.ceph.mds.c:Started 2023-12-19T18:01:05.207 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:05.213 INFO:tasks.ceph.mds.a:Started 2023-12-19T18:01:05.213 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:05.213 INFO:tasks.ceph.mds.b:Started 2023-12-19T18:01:05.214 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:05.220 INFO:tasks.ceph.mds.d:Started 2023-12-19T18:01:05.220 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:05.221 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T18:01:05.331 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:01:05.331 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T18:01:05.332 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T18:01:05.339 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T18:01:05.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.391+0000 7f54aed2e700 1 Processor -- start 2023-12-19T18:01:05.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.391+0000 7f54aed2e700 1 -- start start 2023-12-19T18:01:05.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54aed2e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a815cff0 0x7f54a8161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54aed2e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a80ca6f0 con 0x7f54a80c3920 2023-12-19T18:01:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54aed2e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a80c9220 con 0x7f54a806ddd0 2023-12-19T18:01:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54aed2e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a815d3d0 con 0x7f54a815cff0 2023-12-19T18:01:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a815cff0 0x7f54a8161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:05.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54ae52d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f54a80c3920 0x7f54a806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57810/0 (socket says 172.21.15.45:57810) 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f54a815cff0 0x7f54a8161530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50016/0 (socket says 172.21.15.45:50016) 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54ad52b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f54a806ddd0 0x7f54a80c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:43944/0 (socket says 172.21.15.45:43944) 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 -- 172.21.15.45:0/3443613857 learned_addr learned my addr 172.21.15.45:0/3443613857 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54acd2a700 1 -- 172.21.15.45:0/3443613857 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1239634404 0 0) 0x7f54a80c9220 con 0x7f54a806ddd0 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 -- 172.21.15.45:0/3443613857 >> v1:172.21.15.73:6789/0 conn(0x7f54a806ddd0 legacy=0x7f54a80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 -- 172.21.15.45:0/3443613857 >> v1:172.21.15.45:6789/0 conn(0x7f54a80c3920 legacy=0x7f54a806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 -- 172.21.15.45:0/3443613857 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a80c9500 con 0x7f54a815cff0 2023-12-19T18:01:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54add2c700 1 --2- 172.21.15.45:0/3443613857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a8161530 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009910 tx=0x7f54a4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ebe6fc7d6410f98 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54acd2a700 1 -- 172.21.15.45:0/3443613857 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4004230 con 0x7f54a815cff0 2023-12-19T18:01:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54acd2a700 1 -- 172.21.15.45:0/3443613857 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a4004390 con 0x7f54a815cff0 2023-12-19T18:01:05.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.395+0000 7f54acd2a700 1 -- 172.21.15.45:0/3443613857 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a4009e60 con 0x7f54a815cff0 2023-12-19T18:01:05.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 -- 172.21.15.45:0/3443613857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 msgr2=0x7f54a8161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 --2- 172.21.15.45:0/3443613857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a8161530 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009910 tx=0x7f54a4009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 -- 172.21.15.45:0/3443613857 shutdown_connections 2023-12-19T18:01:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 --2- 172.21.15.45:0/3443613857 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a8161530 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 -- 172.21.15.45:0/3443613857 >> 172.21.15.45:0/3443613857 conn(0x7f54a80cb900 msgr2=0x7f54a80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:05.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 -- 172.21.15.45:0/3443613857 shutdown_connections 2023-12-19T18:01:05.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 -- 172.21.15.45:0/3443613857 wait complete. 2023-12-19T18:01:05.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 Processor -- start 2023-12-19T18:01:05.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.399+0000 7f54aed2e700 1 -- start start 2023-12-19T18:01:05.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54a806ddd0 0x7f54a81f2070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54a80c3920 0x7f54a8147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a80b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815e560 con 0x7f54a815cff0 2023-12-19T18:01:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a80b4700 con 0x7f54a80c3920 2023-12-19T18:01:05.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a815e7b0 con 0x7f54a806ddd0 2023-12-19T18:01:05.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a80b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:05.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a80b16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50028/0 (socket says 172.21.15.45:50028) 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 -- 172.21.15.45:0/4008282988 learned_addr learned my addr 172.21.15.45:0/4008282988 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ad52b700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54a80c3920 0x7f54a8147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54add2c700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54a806ddd0 0x7f54a81f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 -- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54a806ddd0 msgr2=0x7f54a81f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54a806ddd0 0x7f54a81f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 -- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54a80c3920 msgr2=0x7f54a8147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54a80c3920 0x7f54a8147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 -- 172.21.15.45:0/4008282988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a4009570 con 0x7f54a815cff0 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ad52b700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54a80c3920 0x7f54a8147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54add2c700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54a806ddd0 0x7f54a81f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54ae52d700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a80b16e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f54a0002000 tx=0x7f54a000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000ad40 con 0x7f54a815cff0 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a00070d0 con 0x7f54a815cff0 2023-12-19T18:01:05.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54a000aea0 con 0x7f54a815cff0 2023-12-19T18:01:05.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a815ea90 con 0x7f54a815cff0 2023-12-19T18:01:05.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a80b1c20 con 0x7f54a815cff0 2023-12-19T18:01:05.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.403+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a815efb0 con 0x7f54a815cff0 2023-12-19T18:01:05.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.407+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f54a0007480 con 0x7f54a815cff0 2023-12-19T18:01:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.407+0000 7f549e7fc700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f548c065ad0 0x7f548c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.407+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f54a0082cb0 con 0x7f54a815cff0 2023-12-19T18:01:05.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.407+0000 7f54add2c700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f548c065ad0 0x7f548c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:05.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.407+0000 7f54add2c700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f548c065ad0 0x7f548c067f90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009910 tx=0x7f54a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:05.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.415+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f54a815efb0 con 0x7f54a815cff0 2023-12-19T18:01:05.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:05.603+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f54a815efb0 con 0x7f54a815cff0 2023-12-19T18:01:06.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.379+0000 7f549e7fc700 1 -- 172.21.15.45:0/4008282988 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v103) v1 ==== 97+0+0 (secure 0 0 0) 0x7f54a815efb0 con 0x7f54a815cff0 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f548c065ad0 msgr2=0x7f548c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f548c065ad0 0x7f548c067f90 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f54a4009910 tx=0x7f54a4008030 comp rx=0 tx=0).stop 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 msgr2=0x7f54a80b16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a80b16e0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f54a0002000 tx=0x7f54a000a340 comp rx=0 tx=0).stop 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 shutdown_connections 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f548c065ad0 0x7f548c067f90 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f54a815cff0 0x7f54a80b16e0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f54a80c3920 0x7f54a8147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 --2- 172.21.15.45:0/4008282988 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f54a806ddd0 0x7f54a81f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 >> 172.21.15.45:0/4008282988 conn(0x7f54a80cb900 msgr2=0x7f54a8160750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 shutdown_connections 2023-12-19T18:01:06.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.387+0000 7f54aed2e700 1 -- 172.21.15.45:0/4008282988 wait complete. 2023-12-19T18:01:06.395 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-19T18:01:06.418 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T18:01:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.599+0000 7ffa2eb88700 1 Processor -- start 2023-12-19T18:01:06.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.599+0000 7ffa2eb88700 1 -- start start 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2eb88700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffa2815cff0 0x7ffa28161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2eb88700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa280ca6f0 con 0x7ffa2806ddd0 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2eb88700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa280c9220 con 0x7ffa280c3920 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2eb88700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa2815d3d0 con 0x7ffa2815cff0 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2d385700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffa2806ddd0 0x7ffa280c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57812/0 (socket says 172.21.15.45:57812) 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2d385700 1 -- 172.21.15.45:0/1113658825 learned_addr learned my addr 172.21.15.45:0/1113658825 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:06.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2db86700 1 --2- 172.21.15.45:0/1113658825 >> v2:172.21.15.73:3300/0 conn(0x7ffa2815cff0 0x7ffa28161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:06.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2cb84700 1 -- 172.21.15.45:0/1113658825 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946564244 0 0) 0x7ffa280ca6f0 con 0x7ffa2806ddd0 2023-12-19T18:01:06.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.603+0000 7ffa2cb84700 1 -- 172.21.15.45:0/1113658825 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa140035d0 con 0x7ffa2806ddd0 2023-12-19T18:01:06.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2db86700 1 -- 172.21.15.45:0/1113658825 >> v1:172.21.15.73:6789/0 conn(0x7ffa280c3920 legacy=0x7ffa2806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2db86700 1 -- 172.21.15.45:0/1113658825 >> v1:172.21.15.45:6789/0 conn(0x7ffa2806ddd0 legacy=0x7ffa280c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2db86700 1 -- 172.21.15.45:0/1113658825 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280c9500 con 0x7ffa2815cff0 2023-12-19T18:01:06.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2db86700 1 --2- 172.21.15.45:0/1113658825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa28161530 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009850 tx=0x7ffa24009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee39de2079689d64 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:06.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2cb84700 1 -- 172.21.15.45:0/1113658825 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24011830 con 0x7ffa2815cff0 2023-12-19T18:01:06.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2cb84700 1 -- 172.21.15.45:0/1113658825 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa24011990 con 0x7ffa2815cff0 2023-12-19T18:01:06.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2cb84700 1 -- 172.21.15.45:0/1113658825 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa24011d40 con 0x7ffa2815cff0 2023-12-19T18:01:06.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 -- 172.21.15.45:0/1113658825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 msgr2=0x7ffa28161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/1113658825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa28161530 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ffa24009850 tx=0x7ffa24009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:06.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 -- 172.21.15.45:0/1113658825 shutdown_connections 2023-12-19T18:01:06.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/1113658825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa28161530 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 -- 172.21.15.45:0/1113658825 >> 172.21.15.45:0/1113658825 conn(0x7ffa280cb900 msgr2=0x7ffa280b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:06.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 -- 172.21.15.45:0/1113658825 shutdown_connections 2023-12-19T18:01:06.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.607+0000 7ffa2eb88700 1 -- 172.21.15.45:0/1113658825 wait complete. 2023-12-19T18:01:06.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 Processor -- start 2023-12-19T18:01:06.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 -- start start 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa2806ddd0 0x7ffa281609c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 0x7ffa2815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa2815ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2815f3b0 con 0x7ffa280c3920 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2815f680 con 0x7ffa2815cff0 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2eb88700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280b1590 con 0x7ffa2806ddd0 2023-12-19T18:01:06.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 0x7ffa2815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 0x7ffa2815e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50036/0 (socket says 172.21.15.45:50036) 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 -- 172.21.15.45:0/2126502457 learned_addr learned my addr 172.21.15.45:0/2126502457 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2db86700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa2806ddd0 0x7ffa281609c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2e387700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa2815ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 -- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa2806ddd0 msgr2=0x7ffa281609c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa2806ddd0 0x7ffa281609c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 -- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 msgr2=0x7ffa2815ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa2815ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2d385700 1 -- 172.21.15.45:0/2126502457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa240094b0 con 0x7ffa280c3920 2023-12-19T18:01:06.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.611+0000 7ffa2e387700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa2815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:06.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa2d385700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 0x7ffa2815e930 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c4d0 tx=0x7ffa1800c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:06.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18005d90 con 0x7ffa280c3920 2023-12-19T18:01:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa180070d0 con 0x7ffa280c3920 2023-12-19T18:01:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa18007480 con 0x7ffa280c3920 2023-12-19T18:01:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280b1870 con 0x7ffa280c3920 2023-12-19T18:01:06.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa280b1e30 con 0x7ffa280c3920 2023-12-19T18:01:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa28067760 con 0x7ffa280c3920 2023-12-19T18:01:06.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.615+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa180075e0 con 0x7ffa280c3920 2023-12-19T18:01:06.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.619+0000 7ffa1e7fc700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa0c065b20 0x7ffa0c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:06.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.619+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ffa18082480 con 0x7ffa280c3920 2023-12-19T18:01:06.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.619+0000 7ffa2db86700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa0c065b20 0x7ffa0c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:06.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.619+0000 7ffa2db86700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa0c065b20 0x7ffa0c067fe0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffa240090b0 tx=0x7ffa24008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:06.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.623+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffa18050030 con 0x7ffa280c3920 2023-12-19T18:01:06.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.867+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ffa2815f7f0 con 0x7ffa280c3920 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.867+0000 7ffa1e7fc700 1 -- 172.21.15.45:0/2126502457 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ffa2815f7f0 con 0x7ffa280c3920 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A==", 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.876 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg==", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:01:06.877 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA==", 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.878 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ==", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg==", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.879 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA==", 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-19T18:01:06.880 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w==", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ==", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.881 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg==", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA==", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.882 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w==", 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.883 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA==", 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA==", 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.884 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A==", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.885 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ==", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ==", 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.886 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl3IfBDBAAsKhx3aytTBDBVKorcbcCHw==", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.887 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA==", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q==", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T18:01:06.888 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:01:06.889 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.889 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:06.889 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-19T18:01:06.889 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:06.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa0c065b20 msgr2=0x7ffa0c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa0c065b20 0x7ffa0c067fe0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7ffa240090b0 tx=0x7ffa24008030 comp rx=0 tx=0).stop 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 msgr2=0x7ffa2815e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 0x7ffa2815e930 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7ffa1800c4d0 tx=0x7ffa1800c7e0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 shutdown_connections 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa0c065b20 0x7ffa0c067fe0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa2815cff0 0x7ffa2815ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffa280c3920 0x7ffa2815e930 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 --2- 172.21.15.45:0/2126502457 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffa2806ddd0 0x7ffa281609c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 >> 172.21.15.45:0/2126502457 conn(0x7ffa280cb900 msgr2=0x7ffa280cdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 shutdown_connections 2023-12-19T18:01:06.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:06.871+0000 7ffa2eb88700 1 -- 172.21.15.45:0/2126502457 wait complete. 2023-12-19T18:01:06.902 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.075+0000 7f2cf4809700 1 Processor -- start 2023-12-19T18:01:07.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.075+0000 7f2cf4809700 1 -- start start 2023-12-19T18:01:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cf4809700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cf006cad0 0x7f2cf015be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cf4809700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cf00af720 0x7f2cf00afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cf4809700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf006f0a0 con 0x7f2cf015ae20 2023-12-19T18:01:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cf4809700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf00b00d0 con 0x7f2cf006cad0 2023-12-19T18:01:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cf4809700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf006ea90 con 0x7f2cf00af720 2023-12-19T18:01:07.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cee59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cf006cad0 0x7f2cf015be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2ceed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2cf015ae20 0x7f2cf00c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57820/0 (socket says 172.21.15.45:57820) 2023-12-19T18:01:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cee59c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2cf006cad0 0x7f2cf015be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50048/0 (socket says 172.21.15.45:50048) 2023-12-19T18:01:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2ceed9d700 1 -- 172.21.15.45:0/2037428192 learned_addr learned my addr 172.21.15.45:0/2037428192 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:07.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cef59e700 1 --2- 172.21.15.45:0/2037428192 >> v2:172.21.15.73:3300/0 conn(0x7f2cf00af720 0x7f2cf00afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cee59c700 1 -- 172.21.15.45:0/2037428192 >> v2:172.21.15.73:3300/0 conn(0x7f2cf00af720 msgr2=0x7f2cf00afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cee59c700 1 --2- 172.21.15.45:0/2037428192 >> v2:172.21.15.73:3300/0 conn(0x7f2cf00af720 0x7f2cf00afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cee59c700 1 -- 172.21.15.45:0/2037428192 >> v1:172.21.15.45:6789/0 conn(0x7f2cf015ae20 legacy=0x7f2cf00c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cee59c700 1 -- 172.21.15.45:0/2037428192 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf00c3f60 con 0x7f2cf006cad0 2023-12-19T18:01:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.079+0000 7f2cedd9b700 1 -- 172.21.15.45:0/2037428192 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1599949776 0 0) 0x7f2cf006f0a0 con 0x7f2cf015ae20 2023-12-19T18:01:07.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cee59c700 1 --2- 172.21.15.45:0/2037428192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf015be40 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00cc270 tx=0x7f2ce4009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87f3313f3e81d034 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cedd9b700 1 -- 172.21.15.45:0/2037428192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4011830 con 0x7f2cf006cad0 2023-12-19T18:01:07.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cedd9b700 1 -- 172.21.15.45:0/2037428192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce4011990 con 0x7f2cf006cad0 2023-12-19T18:01:07.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cedd9b700 1 -- 172.21.15.45:0/2037428192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce4011d20 con 0x7f2cf006cad0 2023-12-19T18:01:07.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 -- 172.21.15.45:0/2037428192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 msgr2=0x7f2cf015be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 --2- 172.21.15.45:0/2037428192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf015be40 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2cf00cc270 tx=0x7f2ce4009b30 comp rx=0 tx=0).stop 2023-12-19T18:01:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 -- 172.21.15.45:0/2037428192 shutdown_connections 2023-12-19T18:01:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 --2- 172.21.15.45:0/2037428192 >> v2:172.21.15.73:3300/0 conn(0x7f2cf00af720 0x7f2cf00afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 --2- 172.21.15.45:0/2037428192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf015be40 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 -- 172.21.15.45:0/2037428192 >> 172.21.15.45:0/2037428192 conn(0x7f2cf00cb900 msgr2=0x7f2cf00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 -- 172.21.15.45:0/2037428192 shutdown_connections 2023-12-19T18:01:07.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.083+0000 7f2cf4809700 1 -- 172.21.15.45:0/2037428192 wait complete. 2023-12-19T18:01:07.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 Processor -- start 2023-12-19T18:01:07.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 -- start start 2023-12-19T18:01:07.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf00c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cf00af720 0x7f2cf00c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cf015ae20 0x7f2cf006f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00b4010 con 0x7f2cf006cad0 2023-12-19T18:01:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf013d140 con 0x7f2cf015ae20 2023-12-19T18:01:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.087+0000 7f2cf4809700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf00c71f0 con 0x7f2cf00af720 2023-12-19T18:01:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf00c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf00c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50056/0 (socket says 172.21.15.45:50056) 2023-12-19T18:01:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cee59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cf00af720 0x7f2cf00c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 -- 172.21.15.45:0/1952815982 learned_addr learned my addr 172.21.15.45:0/1952815982 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cef59e700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cf015ae20 0x7f2cf006f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 -- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cf00af720 msgr2=0x7f2cf00c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cf00af720 0x7f2cf00c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 -- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cf015ae20 msgr2=0x7f2cf006f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cf015ae20 0x7f2cf006f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 -- 172.21.15.45:0/1952815982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40094b0 con 0x7f2cf006cad0 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cef59e700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cf015ae20 0x7f2cf006f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:07.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2ceed9d700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf00c5890 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000c4e0 tx=0x7f2ce000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0004ca0 con 0x7f2cf006cad0 2023-12-19T18:01:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0004e20 con 0x7f2cf006cad0 2023-12-19T18:01:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf00c5dd0 con 0x7f2cf006cad0 2023-12-19T18:01:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0007310 con 0x7f2cf006cad0 2023-12-19T18:01:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf0139d50 con 0x7f2cf006cad0 2023-12-19T18:01:07.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.091+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf006f510 con 0x7f2cf006cad0 2023-12-19T18:01:07.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.095+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ce0007470 con 0x7f2cf006cad0 2023-12-19T18:01:07.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.095+0000 7f2cd77fe700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2cdc065ad0 0x7f2cdc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.095+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2ce00829a0 con 0x7f2cf006cad0 2023-12-19T18:01:07.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.095+0000 7f2cee59c700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2cdc065ad0 0x7f2cdc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.095+0000 7f2cee59c700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2cdc065ad0 0x7f2cdc067f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2cf006cf10 tx=0x7f2ce4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.103+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2cf006f510 con 0x7f2cf006cad0 2023-12-19T18:01:07.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.291+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cf00c5dd0 con 0x7f2cf006cad0 2023-12-19T18:01:07.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.291+0000 7f2cd77fe700 1 -- 172.21.15.45:0/1952815982 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+12548 (secure 0 0 0) 0x7f2cf00c5dd0 con 0x7f2cf006cad0 2023-12-19T18:01:07.300 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:07.300 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":103,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:06.375750+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.295+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2cdc065ad0 msgr2=0x7f2cdc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.295+0000 7f2cf4809700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2cdc065ad0 0x7f2cdc067f90 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2cf006cf10 tx=0x7f2ce4008030 comp rx=0 tx=0).stop 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.295+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 msgr2=0x7f2cf00c5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.295+0000 7f2cf4809700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf00c5890 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000c4e0 tx=0x7f2ce000c7f0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 shutdown_connections 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2cdc065ad0 0x7f2cdc067f90 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2cf015ae20 0x7f2cf006f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cf00af720 0x7f2cf00c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 --2- 172.21.15.45:0/1952815982 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cf006cad0 0x7f2cf00c5890 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 >> 172.21.15.45:0/1952815982 conn(0x7f2cf00cb900 msgr2=0x7f2cf006dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 shutdown_connections 2023-12-19T18:01:07.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.299+0000 7f2cf4809700 1 -- 172.21.15.45:0/1952815982 wait complete. 2023-12-19T18:01:07.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:01:07.329 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:01:07.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f54f5700 1 Processor -- start 2023-12-19T18:01:07.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f54f5700 1 -- start start 2023-12-19T18:01:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f54f5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1f015cf20 0x7fc1f00d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f54f5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f015d300 con 0x7fc1f00cdfd0 2023-12-19T18:01:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f54f5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00d1550 con 0x7fc1f00b8580 2023-12-19T18:01:07.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f54f5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00d1830 con 0x7fc1f015cf20 2023-12-19T18:01:07.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f4cf4700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc1f00cdfd0 0x7fc1f00b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57822/0 (socket says 172.21.15.45:57822) 2023-12-19T18:01:07.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.527+0000 7fc1f4cf4700 1 -- 172.21.15.45:0/2223515991 learned_addr learned my addr 172.21.15.45:0/2223515991 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:07.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1effff700 1 --2- 172.21.15.45:0/2223515991 >> v2:172.21.15.73:3300/0 conn(0x7fc1f015cf20 0x7fc1f00d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1eeffd700 1 -- 172.21.15.45:0/2223515991 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232015702 0 0) 0x7fc1f015d300 con 0x7fc1f00cdfd0 2023-12-19T18:01:07.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1eeffd700 1 -- 172.21.15.45:0/2223515991 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d80035d0 con 0x7fc1f00cdfd0 2023-12-19T18:01:07.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1effff700 1 -- 172.21.15.45:0/2223515991 >> v1:172.21.15.73:6789/0 conn(0x7fc1f00b8580 legacy=0x7fc1f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1effff700 1 -- 172.21.15.45:0/2223515991 >> v1:172.21.15.45:6789/0 conn(0x7fc1f00cdfd0 legacy=0x7fc1f00b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1effff700 1 -- 172.21.15.45:0/2223515991 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00d1b10 con 0x7fc1f015cf20 2023-12-19T18:01:07.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1effff700 1 --2- 172.21.15.45:0/2223515991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f015cf20 0x7fc1f00d0c50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009850 tx=0x7fc1e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c604b923a829114 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1eeffd700 1 -- 172.21.15.45:0/2223515991 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0011830 con 0x7fc1f015cf20 2023-12-19T18:01:07.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1eeffd700 1 -- 172.21.15.45:0/2223515991 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e0011990 con 0x7fc1f015cf20 2023-12-19T18:01:07.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1eeffd700 1 -- 172.21.15.45:0/2223515991 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0011d40 con 0x7fc1f015cf20 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 -- 172.21.15.45:0/2223515991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f015cf20 msgr2=0x7fc1f00d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/2223515991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f015cf20 0x7fc1f00d0c50 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009850 tx=0x7fc1e0009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 -- 172.21.15.45:0/2223515991 shutdown_connections 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/2223515991 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f015cf20 0x7fc1f00d0c50 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 -- 172.21.15.45:0/2223515991 >> 172.21.15.45:0/2223515991 conn(0x7fc1f00b4670 msgr2=0x7fc1f00b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 -- 172.21.15.45:0/2223515991 shutdown_connections 2023-12-19T18:01:07.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.531+0000 7fc1f54f5700 1 -- 172.21.15.45:0/2223515991 wait complete. 2023-12-19T18:01:07.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.535+0000 7fc1f54f5700 1 Processor -- start 2023-12-19T18:01:07.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.535+0000 7fc1f54f5700 1 -- start start 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f00b8580 0x7fc1f00c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1f00cdfd0 0x7fc1f00b71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 0x7fc1f014d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00b7720 con 0x7fc1f015cf20 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00ca230 con 0x7fc1f00b8580 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00ca510 con 0x7fc1f00cdfd0 2023-12-19T18:01:07.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 0x7fc1f014d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 0x7fc1f014d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50072/0 (socket says 172.21.15.45:50072) 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 -- 172.21.15.45:0/540589651 learned_addr learned my addr 172.21.15.45:0/540589651 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1effff700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f00b8580 0x7fc1f00c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1ef7fe700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1f00cdfd0 0x7fc1f00b71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 -- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1f00cdfd0 msgr2=0x7fc1f00b71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1f00cdfd0 0x7fc1f00b71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 -- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f00b8580 msgr2=0x7fc1f00c9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f00b8580 0x7fc1f00c9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 -- 172.21.15.45:0/540589651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e00094b0 con 0x7fc1f015cf20 2023-12-19T18:01:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f4cf4700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 0x7fc1f014d6e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800cb30 tx=0x7fc1e800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007480 con 0x7fc1f015cf20 2023-12-19T18:01:07.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e80075e0 con 0x7fc1f015cf20 2023-12-19T18:01:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f00ca7f0 con 0x7fc1f015cf20 2023-12-19T18:01:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.539+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007950 con 0x7fc1f015cf20 2023-12-19T18:01:07.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.543+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f014dc20 con 0x7fc1f015cf20 2023-12-19T18:01:07.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.543+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f00cad10 con 0x7fc1f015cf20 2023-12-19T18:01:07.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.543+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc1e8012400 con 0x7fc1f015cf20 2023-12-19T18:01:07.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.547+0000 7fc1ecff9700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc1dc065ad0 0x7fc1dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.547+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc1e8082810 con 0x7fc1f015cf20 2023-12-19T18:01:07.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.547+0000 7fc1effff700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc1dc065ad0 0x7fc1dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.547+0000 7fc1effff700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc1dc065ad0 0x7fc1dc067f90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00090b0 tx=0x7fc1e001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.551+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc1e80503f0 con 0x7fc1f015cf20 2023-12-19T18:01:07.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.731+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1f004ed30 con 0x7fc1f015cf20 2023-12-19T18:01:07.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.731+0000 7fc1ecff9700 1 -- 172.21.15.45:0/540589651 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1e80170a0 con 0x7fc1f015cf20 2023-12-19T18:01:07.740 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:01:07.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc1dc065ad0 msgr2=0x7fc1dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc1dc065ad0 0x7fc1dc067f90 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc1e00090b0 tx=0x7fc1e001c040 comp rx=0 tx=0).stop 2023-12-19T18:01:07.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 msgr2=0x7fc1f014d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 0x7fc1f014d6e0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800cb30 tx=0x7fc1e800cb60 comp rx=0 tx=0).stop 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 shutdown_connections 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc1dc065ad0 0x7fc1dc067f90 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc1f015cf20 0x7fc1f014d6e0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1f00cdfd0 0x7fc1f00b71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 --2- 172.21.15.45:0/540589651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1f00b8580 0x7fc1f00c9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 >> 172.21.15.45:0/540589651 conn(0x7fc1f00b4670 msgr2=0x7fc1f00b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 shutdown_connections 2023-12-19T18:01:07.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.735+0000 7fc1f54f5700 1 -- 172.21.15.45:0/540589651 wait complete. 2023-12-19T18:01:07.765 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T18:01:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.935+0000 7f88dc742700 1 Processor -- start 2023-12-19T18:01:07.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.935+0000 7f88dc742700 1 -- start start 2023-12-19T18:01:07.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dc742700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88d415d040 0x7f88d40cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dc742700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88d406f4a0 0x7f88d40d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dc742700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d420 0x7f88d40d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dc742700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d40b6060 con 0x7f88d406f4a0 2023-12-19T18:01:07.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dc742700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d406f930 con 0x7f88d415d040 2023-12-19T18:01:07.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dc742700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d406fc10 con 0x7f88d415d420 2023-12-19T18:01:07.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88d406f4a0 0x7f88d40d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88d406f4a0 0x7f88d40d21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50074/0 (socket says 172.21.15.45:50074) 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 -- 172.21.15.45:0/4020570514 learned_addr learned my addr 172.21.15.45:0/4020570514 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88da4de700 1 --2- 172.21.15.45:0/4020570514 >> v2:172.21.15.73:3300/0 conn(0x7f88d415d040 0x7f88d40cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dacdf700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d420 0x7f88d40d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 -- 172.21.15.45:0/4020570514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d420 msgr2=0x7f88d40d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d420 0x7f88d40d26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 -- 172.21.15.45:0/4020570514 >> v2:172.21.15.73:3300/0 conn(0x7f88d415d040 msgr2=0x7f88d40cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 --2- 172.21.15.45:0/4020570514 >> v2:172.21.15.73:3300/0 conn(0x7f88d415d040 0x7f88d40cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 -- 172.21.15.45:0/4020570514 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d406fef0 con 0x7f88d406f4a0 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88dacdf700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d420 0x7f88d40d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:07.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88da4de700 1 --2- 172.21.15.45:0/4020570514 >> v2:172.21.15.73:3300/0 conn(0x7f88d415d040 0x7f88d40cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:07.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d9cdd700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d406f4a0 0x7f88d40d21a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f88d40679f0 tx=0x7f88c4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf67be496a91f41 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d94dc700 1 -- 172.21.15.45:0/4020570514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4011830 con 0x7f88d406f4a0 2023-12-19T18:01:07.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d94dc700 1 -- 172.21.15.45:0/4020570514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c4011990 con 0x7f88d406f4a0 2023-12-19T18:01:07.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.939+0000 7f88d94dc700 1 -- 172.21.15.45:0/4020570514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4011d20 con 0x7f88d406f4a0 2023-12-19T18:01:07.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 -- 172.21.15.45:0/4020570514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d406f4a0 msgr2=0x7f88d40d21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d406f4a0 0x7f88d40d21a0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f88d40679f0 tx=0x7f88c4009bf0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 -- 172.21.15.45:0/4020570514 shutdown_connections 2023-12-19T18:01:07.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d420 0x7f88d40d26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 --2- 172.21.15.45:0/4020570514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d406f4a0 0x7f88d40d21a0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 --2- 172.21.15.45:0/4020570514 >> v2:172.21.15.73:3300/0 conn(0x7f88d415d040 0x7f88d40cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 -- 172.21.15.45:0/4020570514 >> 172.21.15.45:0/4020570514 conn(0x7f88d40d2e50 msgr2=0x7f88d40d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 -- 172.21.15.45:0/4020570514 shutdown_connections 2023-12-19T18:01:07.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 -- 172.21.15.45:0/4020570514 wait complete. 2023-12-19T18:01:07.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 Processor -- start 2023-12-19T18:01:07.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.943+0000 7f88dc742700 1 -- start start 2023-12-19T18:01:07.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d040 0x7f88d414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 0x7f88d40cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d40cc2f0 0x7f88d40cc7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d40c9890 con 0x7f88d415d420 2023-12-19T18:01:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d414d5a0 con 0x7f88d40cc2f0 2023-12-19T18:01:07.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d40c8b10 con 0x7f88d415d040 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 0x7f88d40cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 0x7f88d40cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50090/0 (socket says 172.21.15.45:50090) 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 -- 172.21.15.45:0/2946356992 learned_addr learned my addr 172.21.15.45:0/2946356992 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88da4de700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d040 0x7f88d414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dacdf700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d40cc2f0 0x7f88d40cc7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 -- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d040 msgr2=0x7f88d414d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d040 0x7f88d414d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 -- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d40cc2f0 msgr2=0x7f88d40cc7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d40cc2f0 0x7f88d40cc7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 -- 172.21.15.45:0/2946356992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d00094b0 con 0x7f88d415d420 2023-12-19T18:01:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88d9cdd700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 0x7f88d40cbdb0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009f40 tx=0x7f88c4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4004240 con 0x7f88d415d420 2023-12-19T18:01:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c401f070 con 0x7f88d415d420 2023-12-19T18:01:07.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c4009570 con 0x7f88d415d420 2023-12-19T18:01:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c4004600 con 0x7f88d415d420 2023-12-19T18:01:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.947+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d40c8db0 con 0x7f88d415d420 2023-12-19T18:01:07.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.951+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d404ed30 con 0x7f88d415d420 2023-12-19T18:01:07.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.951+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88c4021030 con 0x7f88d415d420 2023-12-19T18:01:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.955+0000 7f88caffd700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88b8065ad0 0x7f88b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.955+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f88c4083f40 con 0x7f88d415d420 2023-12-19T18:01:07.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.955+0000 7f88da4de700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88b8065ad0 0x7f88b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:07.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.955+0000 7f88da4de700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88b8065ad0 0x7f88b8067f90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009d80 tx=0x7f88d0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:07.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:07.959+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88c4051bc0 con 0x7f88d415d420 2023-12-19T18:01:08.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.139+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f88d40b58e0 con 0x7f88d415d420 2023-12-19T18:01:08.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.139+0000 7f88caffd700 1 -- 172.21.15.45:0/2946356992 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v103) v1 ==== 84+0+65 (secure 0 0 0) 0x7f88c4015090 con 0x7f88d415d420 2023-12-19T18:01:08.147 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:08.147 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-19T18:01:08.147 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:01:08.147 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-19T18:01:08.148 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-19T18:01:08.148 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:08.148 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88b8065ad0 msgr2=0x7f88b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88b8065ad0 0x7f88b8067f90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f88d0009d80 tx=0x7f88d0009240 comp rx=0 tx=0).stop 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 msgr2=0x7f88d40cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 0x7f88d40cbdb0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f88c4009f40 tx=0x7f88c4004770 comp rx=0 tx=0).stop 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 shutdown_connections 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f88b8065ad0 0x7f88b8067f90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88d40cc2f0 0x7f88d40cc7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88d415d420 0x7f88d40cbdb0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 --2- 172.21.15.45:0/2946356992 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88d415d040 0x7f88d414d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 >> 172.21.15.45:0/2946356992 conn(0x7f88d40d2e50 msgr2=0x7f88d41580c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:08.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 shutdown_connections 2023-12-19T18:01:08.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.143+0000 7f88dc742700 1 -- 172.21.15.45:0/2946356992 wait complete. 2023-12-19T18:01:08.179 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T18:01:08.179 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T18:01:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 Processor -- start 2023-12-19T18:01:08.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 -- start start 2023-12-19T18:01:08.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff02c15cf40 0x7ff02c0b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15d320 0x7ff02c160c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02c06fe80 con 0x7ff02c161170 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02c070440 con 0x7ff02c15cf40 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.359+0000 7ff031819700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c1615e0 con 0x7ff02c15d320 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff02c15cf40 0x7ff02c0b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff023fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15d320 0x7ff02c160c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:08.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02b7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff02c161170 0x7ff02c06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:43960/0 (socket says 172.21.15.45:43960) 2023-12-19T18:01:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02b7fe700 1 -- 172.21.15.45:0/3143975110 learned_addr learned my addr 172.21.15.45:0/3143975110 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02affd700 1 -- 172.21.15.45:0/3143975110 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15d320 msgr2=0x7ff02c160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02a7fc700 1 -- 172.21.15.45:0/3143975110 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74631960 0 0) 0x7ff02c06fe80 con 0x7ff02c161170 2023-12-19T18:01:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02affd700 1 --2- 172.21.15.45:0/3143975110 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15d320 0x7ff02c160c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02affd700 1 -- 172.21.15.45:0/3143975110 >> v1:172.21.15.73:6789/0 conn(0x7ff02c161170 legacy=0x7ff02c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:08.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02affd700 1 -- 172.21.15.45:0/3143975110 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02c070160 con 0x7ff02c15cf40 2023-12-19T18:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02affd700 1 --2- 172.21.15.45:0/3143975110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15cf40 0x7ff02c0b8770 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009880 tx=0x7ff01c009b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e0a3dd0eca2323 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02a7fc700 1 -- 172.21.15.45:0/3143975110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c011830 con 0x7ff02c15cf40 2023-12-19T18:01:08.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02a7fc700 1 -- 172.21.15.45:0/3143975110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01c011990 con 0x7ff02c15cf40 2023-12-19T18:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff02a7fc700 1 -- 172.21.15.45:0/3143975110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01c011d20 con 0x7ff02c15cf40 2023-12-19T18:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 -- 172.21.15.45:0/3143975110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15cf40 msgr2=0x7ff02c0b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:08.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 --2- 172.21.15.45:0/3143975110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15cf40 0x7ff02c0b8770 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7ff01c009880 tx=0x7ff01c009b90 comp rx=0 tx=0).stop 2023-12-19T18:01:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 -- 172.21.15.45:0/3143975110 shutdown_connections 2023-12-19T18:01:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 --2- 172.21.15.45:0/3143975110 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15d320 0x7ff02c160c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 --2- 172.21.15.45:0/3143975110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15cf40 0x7ff02c0b8770 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 -- 172.21.15.45:0/3143975110 >> 172.21.15.45:0/3143975110 conn(0x7ff02c0d2e50 msgr2=0x7ff02c0d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 -- 172.21.15.45:0/3143975110 shutdown_connections 2023-12-19T18:01:08.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.363+0000 7ff031819700 1 -- 172.21.15.45:0/3143975110 wait complete. 2023-12-19T18:01:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.367+0000 7ff031819700 1 Processor -- start 2023-12-19T18:01:08.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.367+0000 7ff031819700 1 -- start start 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15cf40 0x7ff02c157bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 0x7ff02c0b62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff02c161170 0x7ff02c150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c1554f0 con 0x7ff02c15d320 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c1557d0 con 0x7ff02c161170 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02c155ab0 con 0x7ff02c15cf40 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 0x7ff02c0b62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 0x7ff02c0b62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:50102/0 (socket says 172.21.15.45:50102) 2023-12-19T18:01:08.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 -- 172.21.15.45:0/3549911791 learned_addr learned my addr 172.21.15.45:0/3549911791 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff02affd700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15cf40 0x7ff02c157bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:08.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff02b7fe700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff02c161170 0x7ff02c150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 -- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15cf40 msgr2=0x7ff02c157bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15cf40 0x7ff02c157bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 -- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff02c161170 msgr2=0x7ff02c150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff02c161170 0x7ff02c150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 -- 172.21.15.45:0/3549911791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0094b0 con 0x7ff02c15d320 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff02b7fe700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff02c161170 0x7ff02c150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff023fff700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 0x7ff02c0b62d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff01400e9a0 tx=0x7ff01400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014009720 con 0x7ff02c15d320 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400c850 con 0x7ff02c15d320 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400cc00 con 0x7ff02c15d320 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02c155d90 con 0x7ff02c15d320 2023-12-19T18:01:08.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.371+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02c15d9a0 con 0x7ff02c15d320 2023-12-19T18:01:08.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.375+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02c04ed30 con 0x7ff02c15d320 2023-12-19T18:01:08.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.375+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff014013470 con 0x7ff02c15d320 2023-12-19T18:01:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.375+0000 7ff028ff9700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff00c065b20 0x7ff00c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.379+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff0140830b0 con 0x7ff02c15d320 2023-12-19T18:01:08.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.379+0000 7ff02affd700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff00c065b20 0x7ff00c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:08.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.379+0000 7ff02affd700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff00c065b20 0x7ff00c067fe0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0090b0 tx=0x7ff01c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:08.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.383+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff014050c60 con 0x7ff02c15d320 2023-12-19T18:01:08.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:08.567+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff02c0d0a40 con 0x7ff02c15d320 2023-12-19T18:01:09.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.575+0000 7ff028ff9700 1 -- 172.21.15.45:0/3549911791 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v104) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff0140170b0 con 0x7ff02c15d320 2023-12-19T18:01:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff00c065b20 msgr2=0x7ff00c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff00c065b20 0x7ff00c067fe0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff01c0090b0 tx=0x7ff01c008030 comp rx=0 tx=0).stop 2023-12-19T18:01:09.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 msgr2=0x7ff02c0b62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 0x7ff02c0b62d0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7ff01400e9a0 tx=0x7ff01400ed60 comp rx=0 tx=0).stop 2023-12-19T18:01:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 shutdown_connections 2023-12-19T18:01:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff00c065b20 0x7ff00c067fe0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff02c161170 0x7ff02c150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff02c15d320 0x7ff02c0b62d0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 --2- 172.21.15.45:0/3549911791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff02c15cf40 0x7ff02c157bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 >> 172.21.15.45:0/3549911791 conn(0x7ff02c0d2e50 msgr2=0x7ff02c0b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 shutdown_connections 2023-12-19T18:01:09.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.587+0000 7ff031819700 1 -- 172.21.15.45:0/3549911791 wait complete. 2023-12-19T18:01:09.597 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-19T18:01:09.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T18:01:09.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.799+0000 7f242425e700 1 Processor -- start 2023-12-19T18:01:09.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.799+0000 7f242425e700 1 -- start start 2023-12-19T18:01:09.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f242425e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f241c1614b0 0x7f241c0adb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:09.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f242425e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c0b2dd0 0x7f241c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:09.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f242425e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f241c06ddb0 con 0x7f241c0ae100 2023-12-19T18:01:09.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f242425e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f241c161890 con 0x7f241c1614b0 2023-12-19T18:01:09.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f242425e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c06e090 con 0x7f241c0b2dd0 2023-12-19T18:01:09.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f24217f9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f241c0ae100 0x7f241c0b26c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57060/0 (socket says 172.21.15.45:57060) 2023-12-19T18:01:09.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f24217f9700 1 -- 172.21.15.45:0/1932625003 learned_addr learned my addr 172.21.15.45:0/1932625003 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:09.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.803+0000 7f2421ffa700 1 --2- 172.21.15.45:0/1932625003 >> v2:172.21.15.45:3300/0 conn(0x7f241c1614b0 0x7f241c0adb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f24227fb700 1 --2- 172.21.15.45:0/1932625003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c0b2dd0 0x7f241c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f2420ff8700 1 -- 172.21.15.45:0/1932625003 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461947662 0 0) 0x7f241c06ddb0 con 0x7f241c0ae100 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f2420ff8700 1 -- 172.21.15.45:0/1932625003 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24080035d0 con 0x7f241c0ae100 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f24227fb700 1 -- 172.21.15.45:0/1932625003 >> v2:172.21.15.45:3300/0 conn(0x7f241c1614b0 msgr2=0x7f241c0adb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f24227fb700 1 --2- 172.21.15.45:0/1932625003 >> v2:172.21.15.45:3300/0 conn(0x7f241c1614b0 0x7f241c0adb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f24227fb700 1 -- 172.21.15.45:0/1932625003 >> v1:172.21.15.45:6789/0 conn(0x7f241c0ae100 legacy=0x7f241c0b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f24227fb700 1 -- 172.21.15.45:0/1932625003 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c06e370 con 0x7f241c0b2dd0 2023-12-19T18:01:09.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f2421ffa700 1 --2- 172.21.15.45:0/1932625003 >> v2:172.21.15.45:3300/0 conn(0x7f241c1614b0 0x7f241c0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f24227fb700 1 --2- 172.21.15.45:0/1932625003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c0b2dd0 0x7f241c06f050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2414009d90 tx=0x7f241400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=528db1a15edc5876 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f2420ff8700 1 -- 172.21.15.45:0/1932625003 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400e070 con 0x7f241c0b2dd0 2023-12-19T18:01:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f2420ff8700 1 -- 172.21.15.45:0/1932625003 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241400bb20 con 0x7f241c0b2dd0 2023-12-19T18:01:09.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f2420ff8700 1 -- 172.21.15.45:0/1932625003 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241400be90 con 0x7f241c0b2dd0 2023-12-19T18:01:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 -- 172.21.15.45:0/1932625003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c0b2dd0 msgr2=0x7f241c06f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 --2- 172.21.15.45:0/1932625003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c0b2dd0 0x7f241c06f050 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2414009d90 tx=0x7f241400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 -- 172.21.15.45:0/1932625003 shutdown_connections 2023-12-19T18:01:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 --2- 172.21.15.45:0/1932625003 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c0b2dd0 0x7f241c06f050 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 --2- 172.21.15.45:0/1932625003 >> v2:172.21.15.45:3300/0 conn(0x7f241c1614b0 0x7f241c0adb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 -- 172.21.15.45:0/1932625003 >> 172.21.15.45:0/1932625003 conn(0x7f241c0718d0 msgr2=0x7f241c0b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 -- 172.21.15.45:0/1932625003 shutdown_connections 2023-12-19T18:01:09.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.807+0000 7f242425e700 1 -- 172.21.15.45:0/1932625003 wait complete. 2023-12-19T18:01:09.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 Processor -- start 2023-12-19T18:01:09.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 -- start start 2023-12-19T18:01:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f241c0ae100 0x7f241c150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 0x7f241c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c1614b0 0x7f241c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c1f6900 con 0x7f241c0b2dd0 2023-12-19T18:01:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f241c15f4b0 con 0x7f241c0ae100 2023-12-19T18:01:09.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.811+0000 7f242425e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f241c15f790 con 0x7f241c1614b0 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 0x7f241c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 0x7f241c157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46482/0 (socket says 172.21.15.45:46482) 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 -- 172.21.15.45:0/3784582404 learned_addr learned my addr 172.21.15.45:0/3784582404 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f2421ffa700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f241c0ae100 0x7f241c150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24227fb700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c1614b0 0x7f241c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 -- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c1614b0 msgr2=0x7f241c155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:09.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c1614b0 0x7f241c155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 -- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f241c0ae100 msgr2=0x7f241c150650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:09.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f241c0ae100 0x7f241c150650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:09.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 -- 172.21.15.45:0/3784582404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24180094b0 con 0x7f241c0b2dd0 2023-12-19T18:01:09.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24217f9700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 0x7f241c157530 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c4f0 tx=0x7f240c00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:09.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c005d90 con 0x7f241c0b2dd0 2023-12-19T18:01:09.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f240c0070d0 con 0x7f241c0b2dd0 2023-12-19T18:01:09.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f240c007440 con 0x7f241c0b2dd0 2023-12-19T18:01:09.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2414009a70 con 0x7f241c0b2dd0 2023-12-19T18:01:09.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f241c15fd50 con 0x7f241c0b2dd0 2023-12-19T18:01:09.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.815+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f241c04ed30 con 0x7f241c0b2dd0 2023-12-19T18:01:09.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.819+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f240c0075a0 con 0x7f241c0b2dd0 2023-12-19T18:01:09.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.819+0000 7f24127fc700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2400065b00 0x7f2400067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.819+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f240c082370 con 0x7f241c0b2dd0 2023-12-19T18:01:09.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.819+0000 7f2421ffa700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2400065b00 0x7f2400067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:09.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.819+0000 7f2421ffa700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2400065b00 0x7f2400067fc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f241c1f9eb0 tx=0x7f2418009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:09.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:09.827+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f240c04fe70 con 0x7f241c0b2dd0 2023-12-19T18:01:10.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.003+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f241c06cea0 con 0x7f241c0b2dd0 2023-12-19T18:01:10.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.591+0000 7f24127fc700 1 -- 172.21.15.45:0/3784582404 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v105) v1 ==== 170+0+0 (secure 0 0 0) 0x7f240c053490 con 0x7f241c0b2dd0 2023-12-19T18:01:10.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2400065b00 msgr2=0x7f2400067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:10.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2400065b00 0x7f2400067fc0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f241c1f9eb0 tx=0x7f2418009240 comp rx=0 tx=0).stop 2023-12-19T18:01:10.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 msgr2=0x7f241c157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:10.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 0x7f241c157530 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f240c00c4f0 tx=0x7f240c00c800 comp rx=0 tx=0).stop 2023-12-19T18:01:10.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 shutdown_connections 2023-12-19T18:01:10.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2400065b00 0x7f2400067fc0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f241c1614b0 0x7f241c155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f241c0b2dd0 0x7f241c157530 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 --2- 172.21.15.45:0/3784582404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f241c0ae100 0x7f241c150650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.603+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 >> 172.21.15.45:0/3784582404 conn(0x7f241c0718d0 msgr2=0x7f241c06fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:10.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.607+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 shutdown_connections 2023-12-19T18:01:10.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.607+0000 7f242425e700 1 -- 172.21.15.45:0/3784582404 wait complete. 2023-12-19T18:01:10.618 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-19T18:01:10.642 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T18:01:10.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.819+0000 7f5d9e40f700 1 Processor -- start 2023-12-19T18:01:10.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.819+0000 7f5d9e40f700 1 -- start start 2023-12-19T18:01:10.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9e40f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d9815cf20 0x7f5d980d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9e40f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9e40f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9815d300 con 0x7f5d980b8580 2023-12-19T18:01:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9e40f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d980d1550 con 0x7f5d9815cf20 2023-12-19T18:01:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9e40f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d980d1830 con 0x7f5d980cdfd0 2023-12-19T18:01:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9d40d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d9815cf20 0x7f5d980d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:10.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9cc0c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d980b8580 0x7f5d980cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57076/0 (socket says 172.21.15.45:57076) 2023-12-19T18:01:10.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9cc0c700 1 -- 172.21.15.45:0/899240138 learned_addr learned my addr 172.21.15.45:0/899240138 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:10.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9dc0e700 1 --2- 172.21.15.45:0/899240138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:10.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d8ffff700 1 -- 172.21.15.45:0/899240138 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 831081487 0 0) 0x7f5d9815d300 con 0x7f5d980b8580 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d8ffff700 1 -- 172.21.15.45:0/899240138 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d840035d0 con 0x7f5d980b8580 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9d40d700 1 -- 172.21.15.45:0/899240138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 msgr2=0x7f5d980b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9d40d700 1 --2- 172.21.15.45:0/899240138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9d40d700 1 -- 172.21.15.45:0/899240138 >> v1:172.21.15.45:6789/0 conn(0x7f5d980b8580 legacy=0x7f5d980cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9d40d700 1 -- 172.21.15.45:0/899240138 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d980d1b10 con 0x7f5d9815cf20 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.823+0000 7f5d9d40d700 1 --2- 172.21.15.45:0/899240138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980d0c50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009850 tx=0x7f5d94009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2810c7182c054a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d8ffff700 1 -- 172.21.15.45:0/899240138 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011830 con 0x7f5d9815cf20 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d8ffff700 1 -- 172.21.15.45:0/899240138 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d94011990 con 0x7f5d9815cf20 2023-12-19T18:01:10.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d8ffff700 1 -- 172.21.15.45:0/899240138 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94011d40 con 0x7f5d9815cf20 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 -- 172.21.15.45:0/899240138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 msgr2=0x7f5d980d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/899240138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980d0c50 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009850 tx=0x7f5d94009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 -- 172.21.15.45:0/899240138 shutdown_connections 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/899240138 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/899240138 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980d0c50 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 -- 172.21.15.45:0/899240138 >> 172.21.15.45:0/899240138 conn(0x7f5d980b4670 msgr2=0x7f5d980b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:10.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 -- 172.21.15.45:0/899240138 shutdown_connections 2023-12-19T18:01:10.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.827+0000 7f5d9e40f700 1 -- 172.21.15.45:0/899240138 wait complete. 2023-12-19T18:01:10.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 Processor -- start 2023-12-19T18:01:10.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 -- start start 2023-12-19T18:01:10.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b8580 0x7f5d981573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:10.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:10.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980b2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:10.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981f8190 con 0x7f5d9815cf20 2023-12-19T18:01:10.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d981fa2c0 con 0x7f5d980b8580 2023-12-19T18:01:10.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.831+0000 7f5d9e40f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d98157a10 con 0x7f5d980cdfd0 2023-12-19T18:01:10.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980b2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:10.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980b2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46490/0 (socket says 172.21.15.45:46490) 2023-12-19T18:01:10.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 -- 172.21.15.45:0/2205172237 learned_addr learned my addr 172.21.15.45:0/2205172237 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9cc0c700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9d40d700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b8580 0x7f5d981573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 -- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 msgr2=0x7f5d980b2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 -- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b8580 msgr2=0x7f5d981573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b8580 0x7f5d981573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:10.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 -- 172.21.15.45:0/2205172237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940094b0 con 0x7f5d9815cf20 2023-12-19T18:01:10.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9dc0e700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980b2fc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000ef90 tx=0x7f5d9000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:10.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9000cc90 con 0x7f5d9815cf20 2023-12-19T18:01:10.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9000f040 con 0x7f5d9815cf20 2023-12-19T18:01:10.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d98157cf0 con 0x7f5d9815cf20 2023-12-19T18:01:10.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90014480 con 0x7f5d9815cf20 2023-12-19T18:01:10.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.835+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d981582b0 con 0x7f5d9815cf20 2023-12-19T18:01:10.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.839+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d981f8340 con 0x7f5d9815cf20 2023-12-19T18:01:10.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.839+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5d900145e0 con 0x7f5d9815cf20 2023-12-19T18:01:10.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.839+0000 7f5d8dffb700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d7c065ad0 0x7f5d7c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:10.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.839+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f5d90083da0 con 0x7f5d9815cf20 2023-12-19T18:01:10.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.839+0000 7f5d9d40d700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d7c065ad0 0x7f5d7c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:10.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.843+0000 7f5d9d40d700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d7c065ad0 0x7f5d7c067f90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5d940090b0 tx=0x7f5d9401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:10.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:10.847+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5d981f8340 con 0x7f5d9815cf20 2023-12-19T18:01:11.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.067+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5d981f8340 con 0x7f5d9815cf20 2023-12-19T18:01:11.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.083+0000 7f5d8dffb700 1 -- 172.21.15.45:0/2205172237 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v74) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5d981f8340 con 0x7f5d9815cf20 2023-12-19T18:01:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.091+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d7c065ad0 msgr2=0x7f5d7c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.091+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d7c065ad0 0x7f5d7c067f90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f5d940090b0 tx=0x7f5d9401c040 comp rx=0 tx=0).stop 2023-12-19T18:01:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.091+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 msgr2=0x7f5d980b2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.091+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980b2fc0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f5d9000ef90 tx=0x7f5d9000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 shutdown_connections 2023-12-19T18:01:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d7c065ad0 0x7f5d7c067f90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d9815cf20 0x7f5d980b2fc0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d980cdfd0 0x7f5d980b2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 --2- 172.21.15.45:0/2205172237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d980b8580 0x7f5d981573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 >> 172.21.15.45:0/2205172237 conn(0x7f5d980b4670 msgr2=0x7f5d9815ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 shutdown_connections 2023-12-19T18:01:11.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.095+0000 7f5d9e40f700 1 -- 172.21.15.45:0/2205172237 wait complete. 2023-12-19T18:01:11.125 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 14 and data pool 15 2023-12-19T18:01:11.141 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:11.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.311+0000 7fe08f397700 1 Processor -- start 2023-12-19T18:01:11.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08f397700 1 -- start start 2023-12-19T18:01:11.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08f397700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe08815cff0 0x7fe088161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08f397700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0880c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08f397700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0880ca6f0 con 0x7fe08806ddd0 2023-12-19T18:01:11.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08f397700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08815d3d0 con 0x7fe08815cff0 2023-12-19T18:01:11.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08f397700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880c42f0 con 0x7fe0880c3920 2023-12-19T18:01:11.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08db94700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe08806ddd0 0x7fe0880c9fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57088/0 (socket says 172.21.15.45:57088) 2023-12-19T18:01:11.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08db94700 1 -- 172.21.15.45:0/1209834081 learned_addr learned my addr 172.21.15.45:0/1209834081 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:11.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08e395700 1 --2- 172.21.15.45:0/1209834081 >> v2:172.21.15.73:3300/0 conn(0x7fe08815cff0 0x7fe088161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.315+0000 7fe08eb96700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0880c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08d393700 1 -- 172.21.15.45:0/1209834081 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026444126 0 0) 0x7fe0880ca6f0 con 0x7fe08806ddd0 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08d393700 1 -- 172.21.15.45:0/1209834081 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0740035d0 con 0x7fe08806ddd0 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08e395700 1 -- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 msgr2=0x7fe0880c3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08e395700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0880c3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08e395700 1 -- 172.21.15.45:0/1209834081 >> v1:172.21.15.45:6789/0 conn(0x7fe08806ddd0 legacy=0x7fe0880c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08e395700 1 -- 172.21.15.45:0/1209834081 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0880c9220 con 0x7fe08815cff0 2023-12-19T18:01:11.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08eb96700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0880c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:11.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08e395700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08815cff0 0x7fe088161530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe084009850 tx=0x7fe084009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d34338de7795320 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:11.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08d393700 1 -- 172.21.15.45:0/1209834081 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011830 con 0x7fe08815cff0 2023-12-19T18:01:11.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08d393700 1 -- 172.21.15.45:0/1209834081 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe084011990 con 0x7fe08815cff0 2023-12-19T18:01:11.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08d393700 1 -- 172.21.15.45:0/1209834081 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe084011d40 con 0x7fe08815cff0 2023-12-19T18:01:11.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08f397700 1 -- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08815cff0 msgr2=0x7fe088161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08f397700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08815cff0 0x7fe088161530 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fe084009850 tx=0x7fe084009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:11.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08f397700 1 -- 172.21.15.45:0/1209834081 shutdown_connections 2023-12-19T18:01:11.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.319+0000 7fe08f397700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0880c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.323+0000 7fe08f397700 1 --2- 172.21.15.45:0/1209834081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08815cff0 0x7fe088161530 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.323+0000 7fe08f397700 1 -- 172.21.15.45:0/1209834081 >> 172.21.15.45:0/1209834081 conn(0x7fe0880cb900 msgr2=0x7fe0880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:11.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.323+0000 7fe08f397700 1 -- 172.21.15.45:0/1209834081 shutdown_connections 2023-12-19T18:01:11.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.323+0000 7fe08f397700 1 -- 172.21.15.45:0/1209834081 wait complete. 2023-12-19T18:01:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.323+0000 7fe08f397700 1 Processor -- start 2023-12-19T18:01:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.323+0000 7fe08f397700 1 -- start start 2023-12-19T18:01:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08806ddd0 0x7fe0881f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0881f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 0x7fe08806ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880c6620 con 0x7fe08815cff0 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880c59a0 con 0x7fe08806ddd0 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0880c5c80 con 0x7fe0880c3920 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 0x7fe08806ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 0x7fe08806ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46496/0 (socket says 172.21.15.45:46496) 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 -- 172.21.15.45:0/3862271504 learned_addr learned my addr 172.21.15.45:0/3862271504 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08db94700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0881f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08e395700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08806ddd0 0x7fe0881f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 -- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 msgr2=0x7fe0881f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0881f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 -- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08806ddd0 msgr2=0x7fe0881f2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08806ddd0 0x7fe0881f2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 -- 172.21.15.45:0/3862271504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080009a70 con 0x7fe08815cff0 2023-12-19T18:01:11.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08eb96700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 0x7fe08806ea90 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fe08000efc0 tx=0x7fe08000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:11.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08000cb40 con 0x7fe08815cff0 2023-12-19T18:01:11.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08000f040 con 0x7fe08815cff0 2023-12-19T18:01:11.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0840094b0 con 0x7fe08815cff0 2023-12-19T18:01:11.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe080003a40 con 0x7fe08815cff0 2023-12-19T18:01:11.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.327+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0880c6240 con 0x7fe08815cff0 2023-12-19T18:01:11.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.331+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0880b2a30 con 0x7fe08815cff0 2023-12-19T18:01:11.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.331+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe080014480 con 0x7fe08815cff0 2023-12-19T18:01:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.331+0000 7fe07effd700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe06c065ad0 0x7fe06c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.331+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe080083c30 con 0x7fe08815cff0 2023-12-19T18:01:11.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.335+0000 7fe08e395700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe06c065ad0 0x7fe06c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.335+0000 7fe08e395700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe06c065ad0 0x7fe06c067f90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe0840090b0 tx=0x7fe084008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:11.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.339+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe0800514a0 con 0x7fe08815cff0 2023-12-19T18:01:11.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.523+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0880c6760 con 0x7fe08815cff0 2023-12-19T18:01:11.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.527+0000 7fe07effd700 1 -- 172.21.15.45:0/3862271504 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16221 (secure 0 0 0) 0x7fe0880c6760 con 0x7fe08815cff0 2023-12-19T18:01:11.534 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:11.534 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":106,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:11.071872+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.527+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe06c065ad0 msgr2=0x7fe06c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.527+0000 7fe08f397700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe06c065ad0 0x7fe06c067f90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe0840090b0 tx=0x7fe084008030 comp rx=0 tx=0).stop 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.527+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 msgr2=0x7fe08806ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.527+0000 7fe08f397700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 0x7fe08806ea90 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fe08000efc0 tx=0x7fe08000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 shutdown_connections 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe06c065ad0 0x7fe06c067f90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe08815cff0 0x7fe08806ea90 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe0880c3920 0x7fe0881f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 --2- 172.21.15.45:0/3862271504 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe08806ddd0 0x7fe0881f2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 >> 172.21.15.45:0/3862271504 conn(0x7fe0880cb900 msgr2=0x7fe088160fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 shutdown_connections 2023-12-19T18:01:11.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.531+0000 7fe08f397700 1 -- 172.21.15.45:0/3862271504 wait complete. 2023-12-19T18:01:11.562 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.731+0000 7f533609f700 1 Processor -- start 2023-12-19T18:01:11.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.731+0000 7f533609f700 1 -- start start 2023-12-19T18:01:11.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533609f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f533006ea90 0x7f53300d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533609f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300d1820 con 0x7f53300b88b0 2023-12-19T18:01:11.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533609f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53300d1b00 con 0x7f533006fe80 2023-12-19T18:01:11.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533609f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53300d1de0 con 0x7f533006ea90 2023-12-19T18:01:11.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f533006ea90 0x7f53300d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f533006ea90 0x7f53300d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46506/0 (socket says 172.21.15.45:46506) 2023-12-19T18:01:11.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 -- 172.21.15.45:0/2836982860 learned_addr learned my addr 172.21.15.45:0/2836982860 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:11.741 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533489c700 1 --1- 172.21.15.45:0/2836982860 >> v1:172.21.15.45:6789/0 conn(0x7f53300b88b0 0x7f53300b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57102/0 (socket says 172.21.15.45:57102) 2023-12-19T18:01:11.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 -- 172.21.15.45:0/2836982860 >> v1:172.21.15.73:6789/0 conn(0x7f533006fe80 legacy=0x7f53300b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 -- 172.21.15.45:0/2836982860 >> v1:172.21.15.45:6789/0 conn(0x7f53300b88b0 legacy=0x7f53300b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 -- 172.21.15.45:0/2836982860 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53300d20c0 con 0x7f533006ea90 2023-12-19T18:01:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533509d700 1 --2- 172.21.15.45:0/2836982860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006ea90 0x7f53300d0f20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f532c009910 tx=0x7f532c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95669fe5b37f4f47 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f5327fff700 1 -- 172.21.15.45:0/2836982860 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c00ba60 con 0x7f533006ea90 2023-12-19T18:01:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f5327fff700 1 -- 172.21.15.45:0/2836982860 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532c00bbc0 con 0x7f533006ea90 2023-12-19T18:01:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f5327fff700 1 -- 172.21.15.45:0/2836982860 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532c009e60 con 0x7f533006ea90 2023-12-19T18:01:11.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533609f700 1 -- 172.21.15.45:0/2836982860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006ea90 msgr2=0x7f53300d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.735+0000 7f533609f700 1 --2- 172.21.15.45:0/2836982860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006ea90 0x7f53300d0f20 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f532c009910 tx=0x7f532c009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- 172.21.15.45:0/2836982860 shutdown_connections 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 --2- 172.21.15.45:0/2836982860 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006ea90 0x7f53300d0f20 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- 172.21.15.45:0/2836982860 >> 172.21.15.45:0/2836982860 conn(0x7f53300b46d0 msgr2=0x7f53300b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- 172.21.15.45:0/2836982860 shutdown_connections 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- 172.21.15.45:0/2836982860 wait complete. 2023-12-19T18:01:11.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 Processor -- start 2023-12-19T18:01:11.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- start start 2023-12-19T18:01:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f533006ea90 0x7f53300c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 0x7f533014b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53300b88b0 0x7f53301e2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300c8a00 con 0x7f533006fe80 2023-12-19T18:01:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53300c8ce0 con 0x7f53300b88b0 2023-12-19T18:01:11.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.739+0000 7f533609f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53300c8fc0 con 0x7f533006ea90 2023-12-19T18:01:11.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 0x7f533014b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 0x7f533014b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46516/0 (socket says 172.21.15.45:46516) 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 -- 172.21.15.45:0/1509357997 learned_addr learned my addr 172.21.15.45:0/1509357997 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533509d700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f533006ea90 0x7f53300c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533589e700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53300b88b0 0x7f53301e2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 -- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f533006ea90 msgr2=0x7f53300c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f533006ea90 0x7f53300c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 -- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53300b88b0 msgr2=0x7f53301e2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53300b88b0 0x7f53301e2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 -- 172.21.15.45:0/1509357997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c009570 con 0x7f533006fe80 2023-12-19T18:01:11.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533489c700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 0x7f533014b720 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f532000c700 tx=0x7f532000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:11.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5320005cd0 con 0x7f533006fe80 2023-12-19T18:01:11.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5320005e30 con 0x7f533006fe80 2023-12-19T18:01:11.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53200072d0 con 0x7f533006fe80 2023-12-19T18:01:11.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53300ca6f0 con 0x7f533006fe80 2023-12-19T18:01:11.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.743+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53300c86b0 con 0x7f533006fe80 2023-12-19T18:01:11.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.747+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53300cac10 con 0x7f533006fe80 2023-12-19T18:01:11.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.747+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5320007430 con 0x7f533006fe80 2023-12-19T18:01:11.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.747+0000 7f5325ffb700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5314065ad0 0x7f5314067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:11.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.751+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f53200825b0 con 0x7f533006fe80 2023-12-19T18:01:11.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.751+0000 7f533509d700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5314065ad0 0x7f5314067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:11.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.751+0000 7f533509d700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5314065ad0 0x7f5314067f90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f532c006f80 tx=0x7f532c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:11.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.755+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f53300cac10 con 0x7f533006fe80 2023-12-19T18:01:11.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.931+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53300cac10 con 0x7f533006fe80 2023-12-19T18:01:11.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.931+0000 7f5325ffb700 1 -- 172.21.15.45:0/1509357997 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) v1 ==== 74+0+16221 (secure 0 0 0) 0x7f53300cac10 con 0x7f533006fe80 2023-12-19T18:01:11.940 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:11.940 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":106,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:11.071872+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:11.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5314065ad0 msgr2=0x7f5314067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5314065ad0 0x7f5314067f90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f532c006f80 tx=0x7f532c008030 comp rx=0 tx=0).stop 2023-12-19T18:01:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 msgr2=0x7f533014b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 0x7f533014b720 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f532000c700 tx=0x7f532000ca10 comp rx=0 tx=0).stop 2023-12-19T18:01:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 shutdown_connections 2023-12-19T18:01:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5314065ad0 0x7f5314067f90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53300b88b0 0x7f53301e2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f533006fe80 0x7f533014b720 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 --2- 172.21.15.45:0/1509357997 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f533006ea90 0x7f53300c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 >> 172.21.15.45:0/1509357997 conn(0x7f53300b46d0 msgr2=0x7f53300b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 shutdown_connections 2023-12-19T18:01:11.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:11.935+0000 7f533609f700 1 -- 172.21.15.45:0/1509357997 wait complete. 2023-12-19T18:01:11.968 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T18:01:12.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 Processor -- start 2023-12-19T18:01:12.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 -- start start 2023-12-19T18:01:12.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f884c15b920 0x7f884c0713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:12.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f884c071910 0x7f884c0af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:12.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0b1bb0 con 0x7f884c15b540 2023-12-19T18:01:12.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c0b2830 con 0x7f884c071910 2023-12-19T18:01:12.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8851351700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c071d80 con 0x7f884c15b920 2023-12-19T18:01:12.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f884bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f884c15b540 0x7f884c1621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57116/0 (socket says 172.21.15.45:57116) 2023-12-19T18:01:12.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f884bfff700 1 -- 172.21.15.45:0/973409968 learned_addr learned my addr 172.21.15.45:0/973409968 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f8850b50700 1 --2- 172.21.15.45:0/973409968 >> v2:172.21.15.45:3300/0 conn(0x7f884c071910 0x7f884c0af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.155+0000 7f884b7fe700 1 --2- 172.21.15.45:0/973409968 >> v2:172.21.15.73:3300/0 conn(0x7f884c15b920 0x7f884c0713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f884affd700 1 -- 172.21.15.45:0/973409968 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349022973 0 0) 0x7f884c0b1bb0 con 0x7f884c15b540 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f884affd700 1 -- 172.21.15.45:0/973409968 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88340035d0 con 0x7f884c15b540 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8850b50700 1 -- 172.21.15.45:0/973409968 >> v2:172.21.15.73:3300/0 conn(0x7f884c15b920 msgr2=0x7f884c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8850b50700 1 --2- 172.21.15.45:0/973409968 >> v2:172.21.15.73:3300/0 conn(0x7f884c15b920 0x7f884c0713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8850b50700 1 -- 172.21.15.45:0/973409968 >> v1:172.21.15.45:6789/0 conn(0x7f884c15b540 legacy=0x7f884c1621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f884affd700 1 -- 172.21.15.45:0/973409968 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1749403199 0 0) 0x7f88340035d0 con 0x7f884c15b540 2023-12-19T18:01:12.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8850b50700 1 -- 172.21.15.45:0/973409968 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0b1e90 con 0x7f884c071910 2023-12-19T18:01:12.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8850b50700 1 --2- 172.21.15.45:0/973409968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c071910 0x7f884c0af8e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f884c0ce830 tx=0x7f884400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a95c67fd3df3dec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:12.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f884affd700 1 -- 172.21.15.45:0/973409968 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884400e070 con 0x7f884c071910 2023-12-19T18:01:12.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f884affd700 1 -- 172.21.15.45:0/973409968 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8844003a90 con 0x7f884c071910 2023-12-19T18:01:12.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f884affd700 1 -- 172.21.15.45:0/973409968 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0017f0 con 0x7f884c071910 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 -- 172.21.15.45:0/973409968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c071910 msgr2=0x7f884c0af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 --2- 172.21.15.45:0/973409968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c071910 0x7f884c0af8e0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f884c0ce830 tx=0x7f884400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 -- 172.21.15.45:0/973409968 shutdown_connections 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 --2- 172.21.15.45:0/973409968 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c071910 0x7f884c0af8e0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 --2- 172.21.15.45:0/973409968 >> v2:172.21.15.73:3300/0 conn(0x7f884c15b920 0x7f884c0713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 -- 172.21.15.45:0/973409968 >> 172.21.15.45:0/973409968 conn(0x7f884c0cf5a0 msgr2=0x7f884c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 -- 172.21.15.45:0/973409968 shutdown_connections 2023-12-19T18:01:12.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.159+0000 7f8851351700 1 -- 172.21.15.45:0/973409968 wait complete. 2023-12-19T18:01:12.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.163+0000 7f8851351700 1 Processor -- start 2023-12-19T18:01:12.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.163+0000 7f8851351700 1 -- start start 2023-12-19T18:01:12.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 0x7f884c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:12.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f884c15b920 0x7f884c0ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:12.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884c0cd030 0x7f884c15bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:12.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0cd4c0 con 0x7f884c15b540 2023-12-19T18:01:12.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1514c0 con 0x7f884c0cd030 2023-12-19T18:01:12.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c155e50 con 0x7f884c15b920 2023-12-19T18:01:12.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 0x7f884c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:12.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 0x7f884c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46546/0 (socket says 172.21.15.45:46546) 2023-12-19T18:01:12.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 -- 172.21.15.45:0/4171366220 learned_addr learned my addr 172.21.15.45:0/4171366220 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:12.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884b7fe700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f884c15b920 0x7f884c0ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8850b50700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884c0cd030 0x7f884c15bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 -- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f884c15b920 msgr2=0x7f884c0ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f884c15b920 0x7f884c0ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 -- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884c0cd030 msgr2=0x7f884c15bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884c0cd030 0x7f884c15bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 -- 172.21.15.45:0/4171366220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009a70 con 0x7f884c15b540 2023-12-19T18:01:12.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f884bfff700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 0x7f884c151db0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f883c00c750 tx=0x7f883c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c0074e0 con 0x7f884c15b540 2023-12-19T18:01:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f883c007640 con 0x7f884c15b540 2023-12-19T18:01:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c150940 con 0x7f884c15b540 2023-12-19T18:01:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f883c005a90 con 0x7f884c15b540 2023-12-19T18:01:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.167+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c150f00 con 0x7f884c15b540 2023-12-19T18:01:12.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.171+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f884c156050 con 0x7f884c15b540 2023-12-19T18:01:12.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.171+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f883c005bf0 con 0x7f884c15b540 2023-12-19T18:01:12.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.175+0000 7f8848ff9700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8838065ad0 0x7f8838067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:12.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.175+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f883c0829c0 con 0x7f884c15b540 2023-12-19T18:01:12.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.175+0000 7f884b7fe700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8838065ad0 0x7f8838067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:12.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.175+0000 7f884b7fe700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8838065ad0 0x7f8838067f90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f884c0cb7c0 tx=0x7f8840009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:12.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.183+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f884c156050 con 0x7f884c15b540 2023-12-19T18:01:12.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:12.395+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f884c156010 con 0x7f884c15b540 2023-12-19T18:01:13.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.111+0000 7f8848ff9700 1 -- 172.21.15.45:0/4171366220 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v77) v1 ==== 118+0+0 (secure 0 0 0) 0x7f883c017020 con 0x7f884c15b540 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8838065ad0 msgr2=0x7f8838067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8838065ad0 0x7f8838067f90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f884c0cb7c0 tx=0x7f8840009240 comp rx=0 tx=0).stop 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 msgr2=0x7f884c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 0x7f884c151db0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f883c00c750 tx=0x7f883c00ca60 comp rx=0 tx=0).stop 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 shutdown_connections 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8838065ad0 0x7f8838067f90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f884c0cd030 0x7f884c15bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f884c15b920 0x7f884c0ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 --2- 172.21.15.45:0/4171366220 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f884c15b540 0x7f884c151db0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 >> 172.21.15.45:0/4171366220 conn(0x7f884c071910 msgr2=0x7f884c070c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 shutdown_connections 2023-12-19T18:01:13.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.119+0000 7f8851351700 1 -- 172.21.15.45:0/4171366220 wait complete. 2023-12-19T18:01:13.151 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T18:01:13.151 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T18:01:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.331+0000 7f63f5999700 1 Processor -- start 2023-12-19T18:01:13.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.331+0000 7f63f5999700 1 -- start start 2023-12-19T18:01:13.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.331+0000 7f63f5999700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63f015aef0 0x7f63f00ac460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:13.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.331+0000 7f63f5999700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f63f00ac9a0 0x7f63f0071d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63f5999700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63f00cc4a0 con 0x7f63f00b2d90 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63f5999700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f00cbbb0 con 0x7f63f015aef0 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63f5999700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63f00ace40 con 0x7f63f00ac9a0 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63eeffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f63f015aef0 0x7f63f00ac460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63ef7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f63f00b2d90 0x7f63f00b0d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57118/0 (socket says 172.21.15.45:57118) 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63ef7fe700 1 -- 172.21.15.45:0/2083243189 learned_addr learned my addr 172.21.15.45:0/2083243189 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:13.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63ee7fc700 1 --2- 172.21.15.45:0/2083243189 >> v2:172.21.15.73:3300/0 conn(0x7f63f00ac9a0 0x7f63f0071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63eeffd700 1 -- 172.21.15.45:0/2083243189 >> v2:172.21.15.73:3300/0 conn(0x7f63f00ac9a0 msgr2=0x7f63f0071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63eeffd700 1 --2- 172.21.15.45:0/2083243189 >> v2:172.21.15.73:3300/0 conn(0x7f63f00ac9a0 0x7f63f0071d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63eeffd700 1 -- 172.21.15.45:0/2083243189 >> v1:172.21.15.45:6789/0 conn(0x7f63f00b2d90 legacy=0x7f63f00b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63edffb700 1 -- 172.21.15.45:0/2083243189 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196904361 0 0) 0x7f63f00cc4a0 con 0x7f63f00b2d90 2023-12-19T18:01:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63eeffd700 1 -- 172.21.15.45:0/2083243189 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f00cbe50 con 0x7f63f015aef0 2023-12-19T18:01:13.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63eeffd700 1 --2- 172.21.15.45:0/2083243189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f015aef0 0x7f63f00ac460 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f63f0071ad0 tx=0x7f63e0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6c27b01996a09b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63edffb700 1 -- 172.21.15.45:0/2083243189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011830 con 0x7f63f015aef0 2023-12-19T18:01:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63edffb700 1 -- 172.21.15.45:0/2083243189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0011990 con 0x7f63f015aef0 2023-12-19T18:01:13.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.335+0000 7f63edffb700 1 -- 172.21.15.45:0/2083243189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0011d20 con 0x7f63f015aef0 2023-12-19T18:01:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 -- 172.21.15.45:0/2083243189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f015aef0 msgr2=0x7f63f00ac460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:13.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 --2- 172.21.15.45:0/2083243189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f015aef0 0x7f63f00ac460 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f63f0071ad0 tx=0x7f63e0009b30 comp rx=0 tx=0).stop 2023-12-19T18:01:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 -- 172.21.15.45:0/2083243189 shutdown_connections 2023-12-19T18:01:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 --2- 172.21.15.45:0/2083243189 >> v2:172.21.15.73:3300/0 conn(0x7f63f00ac9a0 0x7f63f0071d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 --2- 172.21.15.45:0/2083243189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f015aef0 0x7f63f00ac460 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 -- 172.21.15.45:0/2083243189 >> 172.21.15.45:0/2083243189 conn(0x7f63f006a010 msgr2=0x7f63f006a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 -- 172.21.15.45:0/2083243189 shutdown_connections 2023-12-19T18:01:13.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 -- 172.21.15.45:0/2083243189 wait complete. 2023-12-19T18:01:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 Processor -- start 2023-12-19T18:01:13.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.339+0000 7f63f5999700 1 -- start start 2023-12-19T18:01:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 0x7f63f00c5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f00b2d90 0x7f63f00b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63f015aef0 0x7f63f01f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c5460 con 0x7f63f00ac9a0 2023-12-19T18:01:13.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c47e0 con 0x7f63f00b2d90 2023-12-19T18:01:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f00c4ac0 con 0x7f63f015aef0 2023-12-19T18:01:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 0x7f63f00c5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 0x7f63f00c5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46568/0 (socket says 172.21.15.45:46568) 2023-12-19T18:01:13.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 -- 172.21.15.45:0/1553264103 learned_addr learned my addr 172.21.15.45:0/1553264103 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63ee7fc700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f00b2d90 0x7f63f00b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63ef7fe700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63f015aef0 0x7f63f01f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 -- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63f015aef0 msgr2=0x7f63f01f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63f015aef0 0x7f63f01f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 -- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f00b2d90 msgr2=0x7f63f00b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f00b2d90 0x7f63f00b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 -- 172.21.15.45:0/1553264103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e00094b0 con 0x7f63f00ac9a0 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63ef7fe700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63f015aef0 0x7f63f01f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63eeffd700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 0x7f63f00c5880 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f63e0014040 tx=0x7f63e0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00038c0 con 0x7f63f00ac9a0 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e001e070 con 0x7f63f00ac9a0 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0003c80 con 0x7f63f00ac9a0 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63f00c4da0 con 0x7f63f00ac9a0 2023-12-19T18:01:13.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.343+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63f015dd30 con 0x7f63f00ac9a0 2023-12-19T18:01:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.347+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63f00c55a0 con 0x7f63f00ac9a0 2023-12-19T18:01:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.347+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f63e002d450 con 0x7f63f00ac9a0 2023-12-19T18:01:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.347+0000 7f63d7fff700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f63dc065ad0 0x7f63dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:13.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.347+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f63e00841f0 con 0x7f63f00ac9a0 2023-12-19T18:01:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.347+0000 7f63ee7fc700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f63dc065ad0 0x7f63dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:13.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.351+0000 7f63ee7fc700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f63dc065ad0 0x7f63dc067f90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f63f0149160 tx=0x7f63e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:13.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.355+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f63e0051a60 con 0x7f63f00ac9a0 2023-12-19T18:01:13.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:13.575+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f63f004ed30 con 0x7f63f00ac9a0 2023-12-19T18:01:14.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.575+0000 7f63d7fff700 1 -- 172.21.15.45:0/1553264103 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v78) v1 ==== 122+0+0 (secure 0 0 0) 0x7f63e0055080 con 0x7f63f00ac9a0 2023-12-19T18:01:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f63dc065ad0 msgr2=0x7f63dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f63dc065ad0 0x7f63dc067f90 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f63f0149160 tx=0x7f63e4008040 comp rx=0 tx=0).stop 2023-12-19T18:01:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 msgr2=0x7f63f00c5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:14.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 0x7f63f00c5880 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f63e0014040 tx=0x7f63e0004770 comp rx=0 tx=0).stop 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 shutdown_connections 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f63dc065ad0 0x7f63dc067f90 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f63f015aef0 0x7f63f01f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f63f00b2d90 0x7f63f00b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 --2- 172.21.15.45:0/1553264103 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f63f00ac9a0 0x7f63f00c5880 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 >> 172.21.15.45:0/1553264103 conn(0x7f63f006a010 msgr2=0x7f63f006fe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 shutdown_connections 2023-12-19T18:01:14.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.583+0000 7f63f5999700 1 -- 172.21.15.45:0/1553264103 wait complete. 2023-12-19T18:01:14.619 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T18:01:14.619 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:14.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.791+0000 7fd75759e700 1 Processor -- start 2023-12-19T18:01:14.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.791+0000 7fd75759e700 1 -- start start 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7581611c0 0x7fd7580c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7580af720 0x7fd7580afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75759e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7580b00c0 con 0x7fd7581615a0 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd758070340 con 0x7fd7581611c0 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7580c3f90 con 0x7fd7580af720 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7581611c0 0x7fd7580c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:14.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7581611c0 0x7fd7580c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46572/0 (socket says 172.21.15.45:46572) 2023-12-19T18:01:14.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 -- 172.21.15.45:0/2802699914 learned_addr learned my addr 172.21.15.45:0/2802699914 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:14.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd756d9d700 1 --2- 172.21.15.45:0/2802699914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7580af720 0x7fd7580afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:14.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 -- 172.21.15.45:0/2802699914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7580af720 msgr2=0x7fd7580afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:14.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 --2- 172.21.15.45:0/2802699914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7580af720 0x7fd7580afb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 -- 172.21.15.45:0/2802699914 >> v1:172.21.15.73:6789/0 conn(0x7fd7581615a0 legacy=0x7fd75806d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:14.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.795+0000 7fd75659c700 1 -- 172.21.15.45:0/2802699914 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7580c4270 con 0x7fd7581611c0 2023-12-19T18:01:14.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75659c700 1 --2- 172.21.15.45:0/2802699914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd7580c3920 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd748009910 tx=0x7fd748009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5299996879e82d08 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:14.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75559a700 1 -- 172.21.15.45:0/2802699914 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748004230 con 0x7fd7581611c0 2023-12-19T18:01:14.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75559a700 1 -- 172.21.15.45:0/2802699914 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd748004390 con 0x7fd7581611c0 2023-12-19T18:01:14.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75559a700 1 -- 172.21.15.45:0/2802699914 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd748009e60 con 0x7fd7581611c0 2023-12-19T18:01:14.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 -- 172.21.15.45:0/2802699914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 msgr2=0x7fd7580c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:14.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 --2- 172.21.15.45:0/2802699914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd7580c3920 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fd748009910 tx=0x7fd748009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:14.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 -- 172.21.15.45:0/2802699914 shutdown_connections 2023-12-19T18:01:14.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 --2- 172.21.15.45:0/2802699914 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7580af720 0x7fd7580afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 --2- 172.21.15.45:0/2802699914 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd7580c3920 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 -- 172.21.15.45:0/2802699914 >> 172.21.15.45:0/2802699914 conn(0x7fd7580cb900 msgr2=0x7fd7580b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:14.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 -- 172.21.15.45:0/2802699914 shutdown_connections 2023-12-19T18:01:14.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.799+0000 7fd75759e700 1 -- 172.21.15.45:0/2802699914 wait complete. 2023-12-19T18:01:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 Processor -- start 2023-12-19T18:01:14.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 -- start start 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7580af720 0x7fd7581f9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd758149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7581615a0 0x7fd7581f81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7581f97a0 con 0x7fd7581611c0 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7581f8b90 con 0x7fd7580af720 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7581f8e70 con 0x7fd7581615a0 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd755d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd758149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd755d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd758149dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46586/0 (socket says 172.21.15.45:46586) 2023-12-19T18:01:14.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd755d9b700 1 -- 172.21.15.45:0/2721175222 learned_addr learned my addr 172.21.15.45:0/2721175222 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.803+0000 7fd75659c700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7580af720 0x7fd7581f9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:14.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd756d9d700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7581615a0 0x7fd7581f81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd755d9b700 1 -- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7581615a0 msgr2=0x7fd7581f81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd755d9b700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7581615a0 0x7fd7581f81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd755d9b700 1 -- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7580af720 msgr2=0x7fd7581f9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:14.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd755d9b700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7580af720 0x7fd7581f9c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd755d9b700 1 -- 172.21.15.45:0/2721175222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748009570 con 0x7fd7581611c0 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd755d9b700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd758149dc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b450 tx=0x7fd74c00b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c004020 con 0x7fd7581611c0 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74c004180 con 0x7fd7581611c0 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7581f9150 con 0x7fd7581611c0 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74c004530 con 0x7fd7581611c0 2023-12-19T18:01:14.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd758156650 con 0x7fd7581611c0 2023-12-19T18:01:14.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.807+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd75806e760 con 0x7fd7581611c0 2023-12-19T18:01:14.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.811+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd74c0036a0 con 0x7fd7581611c0 2023-12-19T18:01:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.811+0000 7fd746ffd700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd738065ad0 0x7fd738067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.815+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd74c082f10 con 0x7fd7581611c0 2023-12-19T18:01:14.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.815+0000 7fd75659c700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd738065ad0 0x7fd738067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:14.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.815+0000 7fd75659c700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd738065ad0 0x7fd738067f90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd748009910 tx=0x7fd748008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:14.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:14.819+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd74c0506f0 con 0x7fd7581611c0 2023-12-19T18:01:15.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.027+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd75806ede0 con 0x7fd7581611c0 2023-12-19T18:01:15.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.031+0000 7fd746ffd700 1 -- 172.21.15.45:0/2721175222 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4711 (secure 0 0 0) 0x7fd74c053d10 con 0x7fd7581611c0 2023-12-19T18:01:15.037 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:15.037 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":78,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:11.072662+0000","modified":"2023-12-19T18:01:14.573187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56894":{"gid":56894,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6834/723317362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":723317362},{"type":"v1","addr":"172.21.15.73:6834","nonce":723317362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd738065ad0 msgr2=0x7fd738067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd738065ad0 0x7fd738067f90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd748009910 tx=0x7fd748008030 comp rx=0 tx=0).stop 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 msgr2=0x7fd758149dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd758149dc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fd74c00b450 tx=0x7fd74c00b810 comp rx=0 tx=0).stop 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 shutdown_connections 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd738065ad0 0x7fd738067f90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7581615a0 0x7fd7581f81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7581611c0 0x7fd758149dc0 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 --2- 172.21.15.45:0/2721175222 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7580af720 0x7fd7581f9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 >> 172.21.15.45:0/2721175222 conn(0x7fd7580cb900 msgr2=0x7fd75806f1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 shutdown_connections 2023-12-19T18:01:15.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.035+0000 7fd75759e700 1 -- 172.21.15.45:0/2721175222 wait complete. 2023-12-19T18:01:15.045 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 78 2023-12-19T18:01:15.066 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:15.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700f2eb700 1 Processor -- start 2023-12-19T18:01:15.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700f2eb700 1 -- start start 2023-12-19T18:01:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700f2eb700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f700806cad0 0x7f700815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700f2eb700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700806f0a0 con 0x7f700815ae20 2023-12-19T18:01:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700f2eb700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f700806ea90 con 0x7f70080af720 2023-12-19T18:01:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700f2eb700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70080c3f60 con 0x7f700806cad0 2023-12-19T18:01:15.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.227+0000 7f700dae8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f700806cad0 0x7f700815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700eaea700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f70080af720 0x7f700806f530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48038/0 (socket says 172.21.15.45:48038) 2023-12-19T18:01:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700eaea700 1 -- 172.21.15.45:0/1421586375 learned_addr learned my addr 172.21.15.45:0/1421586375 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700e2e9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f700815ae20 0x7f70080c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57134/0 (socket says 172.21.15.45:57134) 2023-12-19T18:01:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700dae8700 1 -- 172.21.15.45:0/1421586375 >> v1:172.21.15.73:6789/0 conn(0x7f70080af720 legacy=0x7f700806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700d2e7700 1 -- 172.21.15.45:0/1421586375 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2365444760 0 0) 0x7f700806ea90 con 0x7f70080af720 2023-12-19T18:01:15.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700dae8700 1 -- 172.21.15.45:0/1421586375 >> v1:172.21.15.45:6789/0 conn(0x7f700815ae20 legacy=0x7f70080c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700dae8700 1 -- 172.21.15.45:0/1421586375 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080c4240 con 0x7f700806cad0 2023-12-19T18:01:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700dae8700 1 --2- 172.21.15.45:0/1421586375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700806cad0 0x7f700815be40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009850 tx=0x7f6ff8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6e0d0d0a7dabc51 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700d2e7700 1 -- 172.21.15.45:0/1421586375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011830 con 0x7f700806cad0 2023-12-19T18:01:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700d2e7700 1 -- 172.21.15.45:0/1421586375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ff8011990 con 0x7f700806cad0 2023-12-19T18:01:15.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700d2e7700 1 -- 172.21.15.45:0/1421586375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ff8011d20 con 0x7f700806cad0 2023-12-19T18:01:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 -- 172.21.15.45:0/1421586375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700806cad0 msgr2=0x7f700815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1421586375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700806cad0 0x7f700815be40 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8009850 tx=0x7f6ff8009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 -- 172.21.15.45:0/1421586375 shutdown_connections 2023-12-19T18:01:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1421586375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700806cad0 0x7f700815be40 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 -- 172.21.15.45:0/1421586375 >> 172.21.15.45:0/1421586375 conn(0x7f70080cb900 msgr2=0x7f70080b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 -- 172.21.15.45:0/1421586375 shutdown_connections 2023-12-19T18:01:15.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.231+0000 7f700f2eb700 1 -- 172.21.15.45:0/1421586375 wait complete. 2023-12-19T18:01:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.235+0000 7f700f2eb700 1 Processor -- start 2023-12-19T18:01:15.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.235+0000 7f700f2eb700 1 -- start start 2023-12-19T18:01:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700f2eb700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700806cad0 0x7f70081f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700f2eb700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70080af720 0x7f700815e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700f2eb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 0x7f700815ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700f2eb700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080c9d00 con 0x7f700815ae20 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700f2eb700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70080c9fe0 con 0x7f700806cad0 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700f2eb700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080ca2c0 con 0x7f70080af720 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 0x7f700815ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 0x7f700815ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46610/0 (socket says 172.21.15.45:46610) 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 -- 172.21.15.45:0/1381107654 learned_addr learned my addr 172.21.15.45:0/1381107654 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700e2e9700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700806cad0 0x7f70081f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700dae8700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70080af720 0x7f700815e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 -- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70080af720 msgr2=0x7f700815e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70080af720 0x7f700815e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 -- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700806cad0 msgr2=0x7f70081f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700806cad0 0x7f70081f1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 -- 172.21.15.45:0/1381107654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ff80094b0 con 0x7f700815ae20 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f700eaea700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 0x7f700815ecf0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7000002230 tx=0x7f700000cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.239+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000aac0 con 0x7f700815ae20 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.243+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700000ac40 con 0x7f700815ae20 2023-12-19T18:01:15.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.243+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000070d0 con 0x7f700815ae20 2023-12-19T18:01:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.243+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70080c5930 con 0x7f700815ae20 2023-12-19T18:01:15.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.243+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70081f2440 con 0x7f700815ae20 2023-12-19T18:01:15.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.243+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70080c5e50 con 0x7f700815ae20 2023-12-19T18:01:15.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.243+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7000007250 con 0x7f700815ae20 2023-12-19T18:01:15.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.247+0000 7f6ffeffd700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6fec065ad0 0x7f6fec067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.247+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7000082d30 con 0x7f700815ae20 2023-12-19T18:01:15.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.247+0000 7f700e2e9700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6fec065ad0 0x7f6fec067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.247+0000 7f700e2e9700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6fec065ad0 0x7f6fec067f90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7004000f60 tx=0x7f7004007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:15.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.255+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f70080c5e50 con 0x7f700815ae20 2023-12-19T18:01:15.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.435+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70080c5e50 con 0x7f700815ae20 2023-12-19T18:01:15.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.439+0000 7f6ffeffd700 1 -- 172.21.15.45:0/1381107654 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v107) v1 ==== 74+0+16208 (secure 0 0 0) 0x7f70080c5e50 con 0x7f700815ae20 2023-12-19T18:01:15.446 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:15.446 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":107,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:12.077733+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":105,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:15.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6fec065ad0 msgr2=0x7f6fec067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6fec065ad0 0x7f6fec067f90 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f7004000f60 tx=0x7f7004007ef0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 msgr2=0x7f700815ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 0x7f700815ecf0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f7000002230 tx=0x7f700000cf50 comp rx=0 tx=0).stop 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 shutdown_connections 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6fec065ad0 0x7f6fec067f90 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f700815ae20 0x7f700815ecf0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70080af720 0x7f700815e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 --2- 172.21.15.45:0/1381107654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f700806cad0 0x7f70081f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 >> 172.21.15.45:0/1381107654 conn(0x7f70080cb900 msgr2=0x7f70080cdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 shutdown_connections 2023-12-19T18:01:15.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.443+0000 7f700f2eb700 1 -- 172.21.15.45:0/1381107654 wait complete. 2023-12-19T18:01:15.472 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T18:01:15.472 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:01:15.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.643+0000 7ff30337d700 1 Processor -- start 2023-12-19T18:01:15.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff30337d700 1 -- start start 2023-12-19T18:01:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff30337d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff30337d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2fc0af720 0x7ff2fc0afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff30337d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2fc06f0a0 con 0x7ff2fc15ae20 2023-12-19T18:01:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff30337d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2fc0b0110 con 0x7ff2fc0af720 2023-12-19T18:01:15.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff30337d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc06ea90 con 0x7ff2fc06cad0 2023-12-19T18:01:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.647+0000 7ff302b7c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff2fc0af720 0x7ff2fc0afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc15be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:39982/0 (socket says 172.21.15.45:39982) 2023-12-19T18:01:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 -- 172.21.15.45:0/1526134847 learned_addr learned my addr 172.21.15.45:0/1526134847 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:15.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff30237b700 1 --1- 172.21.15.45:0/1526134847 >> v1:172.21.15.73:6789/0 conn(0x7ff2fc15ae20 0x7ff2fc0c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48054/0 (socket says 172.21.15.45:48054) 2023-12-19T18:01:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 -- 172.21.15.45:0/1526134847 >> v2:172.21.15.45:3300/0 conn(0x7ff2fc0af720 msgr2=0x7ff2fc0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 --2- 172.21.15.45:0/1526134847 >> v2:172.21.15.45:3300/0 conn(0x7ff2fc0af720 0x7ff2fc0afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 -- 172.21.15.45:0/1526134847 >> v1:172.21.15.73:6789/0 conn(0x7ff2fc15ae20 legacy=0x7ff2fc0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 -- 172.21.15.45:0/1526134847 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0c3f60 con 0x7ff2fc06cad0 2023-12-19T18:01:15.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301b7a700 1 --2- 172.21.15.45:0/1526134847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc15be40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009910 tx=0x7ff2f0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928cbd2be17e9496 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301379700 1 -- 172.21.15.45:0/1526134847 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0011830 con 0x7ff2fc06cad0 2023-12-19T18:01:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301379700 1 -- 172.21.15.45:0/1526134847 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f0011990 con 0x7ff2fc06cad0 2023-12-19T18:01:15.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff301379700 1 -- 172.21.15.45:0/1526134847 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0011d40 con 0x7ff2fc06cad0 2023-12-19T18:01:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff30337d700 1 -- 172.21.15.45:0/1526134847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 msgr2=0x7ff2fc15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.651+0000 7ff30337d700 1 --2- 172.21.15.45:0/1526134847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc15be40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0009910 tx=0x7ff2f0009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 -- 172.21.15.45:0/1526134847 shutdown_connections 2023-12-19T18:01:15.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 --2- 172.21.15.45:0/1526134847 >> v2:172.21.15.45:3300/0 conn(0x7ff2fc0af720 0x7ff2fc0afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 --2- 172.21.15.45:0/1526134847 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc15be40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 -- 172.21.15.45:0/1526134847 >> 172.21.15.45:0/1526134847 conn(0x7ff2fc0cb900 msgr2=0x7ff2fc0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:15.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 -- 172.21.15.45:0/1526134847 shutdown_connections 2023-12-19T18:01:15.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 -- 172.21.15.45:0/1526134847 wait complete. 2023-12-19T18:01:15.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 Processor -- start 2023-12-19T18:01:15.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.655+0000 7ff30337d700 1 -- start start 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2fc0af720 0x7ff2fc15cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc15ae20 0x7ff2fc15d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc155900 con 0x7ff2fc15ae20 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0aca20 con 0x7ff2fc0af720 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0abe10 con 0x7ff2fc06cad0 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff302b7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc15ae20 0x7ff2fc15d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff302b7c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc15ae20 0x7ff2fc15d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46632/0 (socket says 172.21.15.45:46632) 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2fc0af720 0x7ff2fc15cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff302b7c700 1 -- 172.21.15.45:0/2581335965 learned_addr learned my addr 172.21.15.45:0/2581335965 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30237b700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 -- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 msgr2=0x7ff2fc1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 -- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc15ae20 msgr2=0x7ff2fc15d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc15ae20 0x7ff2fc15d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 -- 172.21.15.45:0/2581335965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0009570 con 0x7ff2fc0af720 2023-12-19T18:01:15.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff301b7a700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2fc0af720 0x7ff2fc15cd00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0016000 tx=0x7ff2f0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:15.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0004450 con 0x7ff2fc0af720 2023-12-19T18:01:15.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2f00045b0 con 0x7ff2fc0af720 2023-12-19T18:01:15.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc0ac0f0 con 0x7ff2fc0af720 2023-12-19T18:01:15.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2f0003900 con 0x7ff2fc0af720 2023-12-19T18:01:15.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.659+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc0ac6b0 con 0x7ff2fc0af720 2023-12-19T18:01:15.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.663+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc0ac840 con 0x7ff2fc0af720 2023-12-19T18:01:15.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.663+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff2f0003a60 con 0x7ff2fc0af720 2023-12-19T18:01:15.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.667+0000 7ff2faffd700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff2e8065ad0 0x7ff2e8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:15.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.667+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff2f00847c0 con 0x7ff2fc0af720 2023-12-19T18:01:15.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.667+0000 7ff30237b700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff2e8065ad0 0x7ff2e8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:15.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.667+0000 7ff30237b700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff2e8065ad0 0x7ff2e8067f90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec000f60 tx=0x7ff2ec007f30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:15.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.675+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff2f00520c0 con 0x7ff2fc0af720 2023-12-19T18:01:15.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.847+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2fc06ed30 con 0x7ff2e8065ad0 2023-12-19T18:01:15.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.859+0000 7ff2faffd700 1 -- 172.21.15.45:0/2581335965 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287101 (secure 0 0 0) 0x7ff2ec004b30 con 0x7ff2e8065ad0 2023-12-19T18:01:15.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff2e8065ad0 msgr2=0x7ff2e8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff2e8065ad0 0x7ff2e8067f90 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec000f60 tx=0x7ff2ec007f30 comp rx=0 tx=0).stop 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2fc0af720 msgr2=0x7ff2fc15cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2fc0af720 0x7ff2fc15cd00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff2f0016000 tx=0x7ff2f0004770 comp rx=0 tx=0).stop 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 shutdown_connections 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff2e8065ad0 0x7ff2e8067f90 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff2fc15ae20 0x7ff2fc15d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff2fc0af720 0x7ff2fc15cd00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 --2- 172.21.15.45:0/2581335965 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff2fc06cad0 0x7ff2fc1553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 >> 172.21.15.45:0/2581335965 conn(0x7ff2fc0cb900 msgr2=0x7ff2fc0c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 shutdown_connections 2023-12-19T18:01:15.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:15.867+0000 7ff30337d700 1 -- 172.21.15.45:0/2581335965 wait complete. 2023-12-19T18:01:15.876 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:01:15.897 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2023-12-19T18:01:14.409841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259792,"kb_used_data":11408,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714928,"statfs":{"total":773094113280,"available":772828086272,"internally_reserved":0,"allocated":11681792,"data_stored":6223220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.831033"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114911+0000","last_change":"2023-12-19T18:01:11.109190+0000","last_active":"2023-12-19T18:01:11.114911+0000","last_peered":"2023-12-19T18:01:11.114911+0000","last_clean":"2023-12-19T18:01:11.114911+0000","last_became_active":"2023-12-19T18:01:11.108885+0000","last_became_peered":"2023-12-19T18:01:11.108885+0000","last_unstale":"2023-12-19T18:01:11.114911+0000","last_undegraded":"2023-12-19T18:01:11.114911+0000","last_fullsized":"2023-12-19T18:01:11.114911+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:46.066897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.117237+0000","last_change":"2023-12-19T18:01:11.114231+0000","last_active":"2023-12-19T18:01:11.117237+0000","last_peered":"2023-12-19T18:01:11.117237+0000","last_clean":"2023-12-19T18:01:11.117237+0000","last_became_active":"2023-12-19T18:01:11.113877+0000","last_became_peered":"2023-12-19T18:01:11.113877+0000","last_unstale":"2023-12-19T18:01:11.117237+0000","last_undegraded":"2023-12-19T18:01:11.117237+0000","last_fullsized":"2023-12-19T18:01:11.117237+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:35:10.298213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115556+0000","last_change":"2023-12-19T18:01:11.111366+0000","last_active":"2023-12-19T18:01:11.115556+0000","last_peered":"2023-12-19T18:01:11.115556+0000","last_clean":"2023-12-19T18:01:11.115556+0000","last_became_active":"2023-12-19T18:01:11.111078+0000","last_became_peered":"2023-12-19T18:01:11.111078+0000","last_unstale":"2023-12-19T18:01:11.115556+0000","last_undegraded":"2023-12-19T18:01:11.115556+0000","last_fullsized":"2023-12-19T18:01:11.115556+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:44.170571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112785+0000","last_change":"2023-12-19T18:01:11.104789+0000","last_active":"2023-12-19T18:01:11.112785+0000","last_peered":"2023-12-19T18:01:11.112785+0000","last_clean":"2023-12-19T18:01:11.112785+0000","last_became_active":"2023-12-19T18:01:11.103704+0000","last_became_peered":"2023-12-19T18:01:11.103704+0000","last_unstale":"2023-12-19T18:01:11.112785+0000","last_undegraded":"2023-12-19T18:01:11.112785+0000","last_fullsized":"2023-12-19T18:01:11.112785+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:05:53.385657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132235+0000","last_change":"2023-12-19T18:01:11.127248+0000","last_active":"2023-12-19T18:01:11.132235+0000","last_peered":"2023-12-19T18:01:11.132235+0000","last_clean":"2023-12-19T18:01:11.132235+0000","last_became_active":"2023-12-19T18:01:11.126868+0000","last_became_peered":"2023-12-19T18:01:11.126868+0000","last_unstale":"2023-12-19T18:01:11.132235+0000","last_undegraded":"2023-12-19T18:01:11.132235+0000","last_fullsized":"2023-12-19T18:01:11.132235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:51:55.970478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.121268+0000","last_change":"2023-12-19T18:01:11.112795+0000","last_active":"2023-12-19T18:01:11.121268+0000","last_peered":"2023-12-19T18:01:11.121268+0000","last_clean":"2023-12-19T18:01:11.121268+0000","last_became_active":"2023-12-19T18:01:11.112510+0000","last_became_peered":"2023-12-19T18:01:11.112510+0000","last_unstale":"2023-12-19T18:01:11.121268+0000","last_undegraded":"2023-12-19T18:01:11.121268+0000","last_fullsized":"2023-12-19T18:01:11.121268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:04.056910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.121844+0000","last_change":"2023-12-19T18:01:11.112656+0000","last_active":"2023-12-19T18:01:11.121844+0000","last_peered":"2023-12-19T18:01:11.121844+0000","last_clean":"2023-12-19T18:01:11.121844+0000","last_became_active":"2023-12-19T18:01:11.112389+0000","last_became_peered":"2023-12-19T18:01:11.112389+0000","last_unstale":"2023-12-19T18:01:11.121844+0000","last_undegraded":"2023-12-19T18:01:11.121844+0000","last_fullsized":"2023-12-19T18:01:11.121844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:02.837660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.111316+0000","last_change":"2023-12-19T18:01:11.107524+0000","last_active":"2023-12-19T18:01:11.111316+0000","last_peered":"2023-12-19T18:01:11.111316+0000","last_clean":"2023-12-19T18:01:11.111316+0000","last_became_active":"2023-12-19T18:01:11.107257+0000","last_became_peered":"2023-12-19T18:01:11.107257+0000","last_unstale":"2023-12-19T18:01:11.111316+0000","last_undegraded":"2023-12-19T18:01:11.111316+0000","last_fullsized":"2023-12-19T18:01:11.111316+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:53.082346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122268+0000","last_change":"2023-12-19T18:01:11.117664+0000","last_active":"2023-12-19T18:01:11.122268+0000","last_peered":"2023-12-19T18:01:11.122268+0000","last_clean":"2023-12-19T18:01:11.122268+0000","last_became_active":"2023-12-19T18:01:11.117163+0000","last_became_peered":"2023-12-19T18:01:11.117163+0000","last_unstale":"2023-12-19T18:01:11.122268+0000","last_undegraded":"2023-12-19T18:01:11.122268+0000","last_fullsized":"2023-12-19T18:01:11.122268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:44.170571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132308+0000","last_change":"2023-12-19T18:01:11.127806+0000","last_active":"2023-12-19T18:01:11.132308+0000","last_peered":"2023-12-19T18:01:11.132308+0000","last_clean":"2023-12-19T18:01:11.132308+0000","last_became_active":"2023-12-19T18:01:11.126742+0000","last_became_peered":"2023-12-19T18:01:11.126742+0000","last_unstale":"2023-12-19T18:01:11.132308+0000","last_undegraded":"2023-12-19T18:01:11.132308+0000","last_fullsized":"2023-12-19T18:01:11.132308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:48.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123884+0000","last_change":"2023-12-19T18:01:11.115703+0000","last_active":"2023-12-19T18:01:11.123884+0000","last_peered":"2023-12-19T18:01:11.123884+0000","last_clean":"2023-12-19T18:01:11.123884+0000","last_became_active":"2023-12-19T18:01:11.114968+0000","last_became_peered":"2023-12-19T18:01:11.114968+0000","last_unstale":"2023-12-19T18:01:11.123884+0000","last_undegraded":"2023-12-19T18:01:11.123884+0000","last_fullsized":"2023-12-19T18:01:11.123884+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:09.283636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122083+0000","last_change":"2023-12-19T18:01:11.118077+0000","last_active":"2023-12-19T18:01:11.122083+0000","last_peered":"2023-12-19T18:01:11.122083+0000","last_clean":"2023-12-19T18:01:11.122083+0000","last_became_active":"2023-12-19T18:01:11.117471+0000","last_became_peered":"2023-12-19T18:01:11.117471+0000","last_unstale":"2023-12-19T18:01:11.122083+0000","last_undegraded":"2023-12-19T18:01:11.122083+0000","last_fullsized":"2023-12-19T18:01:11.122083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:51:24.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.116840+0000","last_change":"2023-12-19T18:01:11.114564+0000","last_active":"2023-12-19T18:01:11.116840+0000","last_peered":"2023-12-19T18:01:11.116840+0000","last_clean":"2023-12-19T18:01:11.116840+0000","last_became_active":"2023-12-19T18:01:11.114252+0000","last_became_peered":"2023-12-19T18:01:11.114252+0000","last_unstale":"2023-12-19T18:01:11.116840+0000","last_undegraded":"2023-12-19T18:01:11.116840+0000","last_fullsized":"2023-12-19T18:01:11.116840+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:12.084706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126429+0000","last_change":"2023-12-19T18:01:11.125304+0000","last_active":"2023-12-19T18:01:11.126429+0000","last_peered":"2023-12-19T18:01:11.126429+0000","last_clean":"2023-12-19T18:01:11.126429+0000","last_became_active":"2023-12-19T18:01:11.125009+0000","last_became_peered":"2023-12-19T18:01:11.125009+0000","last_unstale":"2023-12-19T18:01:11.126429+0000","last_undegraded":"2023-12-19T18:01:11.126429+0000","last_fullsized":"2023-12-19T18:01:11.126429+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:04.296617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.097603+0000","last_change":"2023-12-19T18:01:11.092933+0000","last_active":"2023-12-19T18:01:11.097603+0000","last_peered":"2023-12-19T18:01:11.097603+0000","last_clean":"2023-12-19T18:01:11.097603+0000","last_became_active":"2023-12-19T18:01:11.092595+0000","last_became_peered":"2023-12-19T18:01:11.092595+0000","last_unstale":"2023-12-19T18:01:11.097603+0000","last_undegraded":"2023-12-19T18:01:11.097603+0000","last_fullsized":"2023-12-19T18:01:11.097603+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:59.078109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113864+0000","last_change":"2023-12-19T18:01:11.105964+0000","last_active":"2023-12-19T18:01:11.113864+0000","last_peered":"2023-12-19T18:01:11.113864+0000","last_clean":"2023-12-19T18:01:11.113864+0000","last_became_active":"2023-12-19T18:01:11.105683+0000","last_became_peered":"2023-12-19T18:01:11.105683+0000","last_unstale":"2023-12-19T18:01:11.113864+0000","last_undegraded":"2023-12-19T18:01:11.113864+0000","last_fullsized":"2023-12-19T18:01:11.113864+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:04.672534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.120110+0000","last_change":"2023-12-19T18:01:11.117491+0000","last_active":"2023-12-19T18:01:11.120110+0000","last_peered":"2023-12-19T18:01:11.120110+0000","last_clean":"2023-12-19T18:01:11.120110+0000","last_became_active":"2023-12-19T18:01:11.111028+0000","last_became_peered":"2023-12-19T18:01:11.111028+0000","last_unstale":"2023-12-19T18:01:11.120110+0000","last_undegraded":"2023-12-19T18:01:11.120110+0000","last_fullsized":"2023-12-19T18:01:11.120110+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:19.670877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112772+0000","last_change":"2023-12-19T18:01:11.106155+0000","last_active":"2023-12-19T18:01:11.112772+0000","last_peered":"2023-12-19T18:01:11.112772+0000","last_clean":"2023-12-19T18:01:11.112772+0000","last_became_active":"2023-12-19T18:01:11.105850+0000","last_became_peered":"2023-12-19T18:01:11.105850+0000","last_unstale":"2023-12-19T18:01:11.112772+0000","last_undegraded":"2023-12-19T18:01:11.112772+0000","last_fullsized":"2023-12-19T18:01:11.112772+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:23.588524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114808+0000","last_change":"2023-12-19T18:01:11.109246+0000","last_active":"2023-12-19T18:01:11.114808+0000","last_peered":"2023-12-19T18:01:11.114808+0000","last_clean":"2023-12-19T18:01:11.114808+0000","last_became_active":"2023-12-19T18:01:11.109010+0000","last_became_peered":"2023-12-19T18:01:11.109010+0000","last_unstale":"2023-12-19T18:01:11.114808+0000","last_undegraded":"2023-12-19T18:01:11.114808+0000","last_fullsized":"2023-12-19T18:01:11.114808+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:14.251055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.119902+0000","last_change":"2023-12-19T18:01:11.114753+0000","last_active":"2023-12-19T18:01:11.119902+0000","last_peered":"2023-12-19T18:01:11.119902+0000","last_clean":"2023-12-19T18:01:11.119902+0000","last_became_active":"2023-12-19T18:01:11.114476+0000","last_became_peered":"2023-12-19T18:01:11.114476+0000","last_unstale":"2023-12-19T18:01:11.119902+0000","last_undegraded":"2023-12-19T18:01:11.119902+0000","last_fullsized":"2023-12-19T18:01:11.119902+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:04.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115871+0000","last_change":"2023-12-19T18:01:11.106135+0000","last_active":"2023-12-19T18:01:11.115871+0000","last_peered":"2023-12-19T18:01:11.115871+0000","last_clean":"2023-12-19T18:01:11.115871+0000","last_became_active":"2023-12-19T18:01:11.105810+0000","last_became_peered":"2023-12-19T18:01:11.105810+0000","last_unstale":"2023-12-19T18:01:11.115871+0000","last_undegraded":"2023-12-19T18:01:11.115871+0000","last_fullsized":"2023-12-19T18:01:11.115871+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:40.367670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.111295+0000","last_change":"2023-12-19T18:01:11.107334+0000","last_active":"2023-12-19T18:01:11.111295+0000","last_peered":"2023-12-19T18:01:11.111295+0000","last_clean":"2023-12-19T18:01:11.111295+0000","last_became_active":"2023-12-19T18:01:11.107065+0000","last_became_peered":"2023-12-19T18:01:11.107065+0000","last_unstale":"2023-12-19T18:01:11.111295+0000","last_undegraded":"2023-12-19T18:01:11.111295+0000","last_fullsized":"2023-12-19T18:01:11.111295+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:58.782064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114116+0000","last_change":"2023-12-19T18:01:11.108136+0000","last_active":"2023-12-19T18:01:11.114116+0000","last_peered":"2023-12-19T18:01:11.114116+0000","last_clean":"2023-12-19T18:01:11.114116+0000","last_became_active":"2023-12-19T18:01:11.107829+0000","last_became_peered":"2023-12-19T18:01:11.107829+0000","last_unstale":"2023-12-19T18:01:11.114116+0000","last_undegraded":"2023-12-19T18:01:11.114116+0000","last_fullsized":"2023-12-19T18:01:11.114116+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:03.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.106426+0000","last_change":"2023-12-19T18:01:11.096437+0000","last_active":"2023-12-19T18:01:11.106426+0000","last_peered":"2023-12-19T18:01:11.106426+0000","last_clean":"2023-12-19T18:01:11.106426+0000","last_became_active":"2023-12-19T18:01:11.096154+0000","last_became_peered":"2023-12-19T18:01:11.096154+0000","last_unstale":"2023-12-19T18:01:11.106426+0000","last_undegraded":"2023-12-19T18:01:11.106426+0000","last_fullsized":"2023-12-19T18:01:11.106426+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.377004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130834+0000","last_change":"2023-12-19T18:01:11.124951+0000","last_active":"2023-12-19T18:01:11.130834+0000","last_peered":"2023-12-19T18:01:11.130834+0000","last_clean":"2023-12-19T18:01:11.130834+0000","last_became_active":"2023-12-19T18:01:11.124666+0000","last_became_peered":"2023-12-19T18:01:11.124666+0000","last_unstale":"2023-12-19T18:01:11.130834+0000","last_undegraded":"2023-12-19T18:01:11.130834+0000","last_fullsized":"2023-12-19T18:01:11.130834+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:02.837660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.119741+0000","last_change":"2023-12-19T18:01:11.116999+0000","last_active":"2023-12-19T18:01:11.119741+0000","last_peered":"2023-12-19T18:01:11.119741+0000","last_clean":"2023-12-19T18:01:11.119741+0000","last_became_active":"2023-12-19T18:01:11.115883+0000","last_became_peered":"2023-12-19T18:01:11.115883+0000","last_unstale":"2023-12-19T18:01:11.119741+0000","last_undegraded":"2023-12-19T18:01:11.119741+0000","last_fullsized":"2023-12-19T18:01:11.119741+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:15.554471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115094+0000","last_change":"2023-12-19T18:01:11.110448+0000","last_active":"2023-12-19T18:01:11.115094+0000","last_peered":"2023-12-19T18:01:11.115094+0000","last_clean":"2023-12-19T18:01:11.115094+0000","last_became_active":"2023-12-19T18:01:11.109734+0000","last_became_peered":"2023-12-19T18:01:11.109734+0000","last_unstale":"2023-12-19T18:01:11.115094+0000","last_undegraded":"2023-12-19T18:01:11.115094+0000","last_fullsized":"2023-12-19T18:01:11.115094+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:39.493258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130718+0000","last_change":"2023-12-19T18:01:11.120371+0000","last_active":"2023-12-19T18:01:11.130718+0000","last_peered":"2023-12-19T18:01:11.130718+0000","last_clean":"2023-12-19T18:01:11.130718+0000","last_became_active":"2023-12-19T18:01:11.120055+0000","last_became_peered":"2023-12-19T18:01:11.120055+0000","last_unstale":"2023-12-19T18:01:11.130718+0000","last_undegraded":"2023-12-19T18:01:11.130718+0000","last_fullsized":"2023-12-19T18:01:11.130718+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:04.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.120162+0000","last_change":"2023-12-19T18:01:11.117401+0000","last_active":"2023-12-19T18:01:11.120162+0000","last_peered":"2023-12-19T18:01:11.120162+0000","last_clean":"2023-12-19T18:01:11.120162+0000","last_became_active":"2023-12-19T18:01:11.115523+0000","last_became_peered":"2023-12-19T18:01:11.115523+0000","last_unstale":"2023-12-19T18:01:11.120162+0000","last_undegraded":"2023-12-19T18:01:11.120162+0000","last_fullsized":"2023-12-19T18:01:11.120162+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:56:06.866017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113338+0000","last_change":"2023-12-19T18:01:11.106875+0000","last_active":"2023-12-19T18:01:11.113338+0000","last_peered":"2023-12-19T18:01:11.113338+0000","last_clean":"2023-12-19T18:01:11.113338+0000","last_became_active":"2023-12-19T18:01:11.104250+0000","last_became_peered":"2023-12-19T18:01:11.104250+0000","last_unstale":"2023-12-19T18:01:11.113338+0000","last_undegraded":"2023-12-19T18:01:11.113338+0000","last_fullsized":"2023-12-19T18:01:11.113338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:26.978959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123569+0000","last_change":"2023-12-19T18:01:11.119599+0000","last_active":"2023-12-19T18:01:11.123569+0000","last_peered":"2023-12-19T18:01:11.123569+0000","last_clean":"2023-12-19T18:01:11.123569+0000","last_became_active":"2023-12-19T18:01:11.119014+0000","last_became_peered":"2023-12-19T18:01:11.119014+0000","last_unstale":"2023-12-19T18:01:11.123569+0000","last_undegraded":"2023-12-19T18:01:11.123569+0000","last_fullsized":"2023-12-19T18:01:11.123569+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:02.909254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.107735+0000","last_change":"2023-12-19T18:01:11.100242+0000","last_active":"2023-12-19T18:01:11.107735+0000","last_peered":"2023-12-19T18:01:11.107735+0000","last_clean":"2023-12-19T18:01:11.107735+0000","last_became_active":"2023-12-19T18:01:11.099989+0000","last_became_peered":"2023-12-19T18:01:11.099989+0000","last_unstale":"2023-12-19T18:01:11.107735+0000","last_undegraded":"2023-12-19T18:01:11.107735+0000","last_fullsized":"2023-12-19T18:01:11.107735+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:58:31.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.124370+0000","last_change":"2023-12-19T18:01:11.122714+0000","last_active":"2023-12-19T18:01:11.124370+0000","last_peered":"2023-12-19T18:01:11.124370+0000","last_clean":"2023-12-19T18:01:11.124370+0000","last_became_active":"2023-12-19T18:01:11.122419+0000","last_became_peered":"2023-12-19T18:01:11.122419+0000","last_unstale":"2023-12-19T18:01:11.124370+0000","last_undegraded":"2023-12-19T18:01:11.124370+0000","last_fullsized":"2023-12-19T18:01:11.124370+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:02:41.594124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"106'4","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.127451+0000","last_change":"2023-12-19T18:01:10.623787+0000","last_active":"2023-12-19T18:01:11.127451+0000","last_peered":"2023-12-19T18:01:11.127451+0000","last_clean":"2023-12-19T18:01:11.127451+0000","last_became_active":"2023-12-19T18:01:10.623389+0000","last_became_peered":"2023-12-19T18:01:10.623389+0000","last_unstale":"2023-12-19T18:01:11.127451+0000","last_undegraded":"2023-12-19T18:01:11.127451+0000","last_fullsized":"2023-12-19T18:01:11.127451+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:53.059902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123566+0000","last_change":"2023-12-19T18:01:11.119435+0000","last_active":"2023-12-19T18:01:11.123566+0000","last_peered":"2023-12-19T18:01:11.123566+0000","last_clean":"2023-12-19T18:01:11.123566+0000","last_became_active":"2023-12-19T18:01:11.119150+0000","last_became_peered":"2023-12-19T18:01:11.119150+0000","last_unstale":"2023-12-19T18:01:11.123566+0000","last_undegraded":"2023-12-19T18:01:11.123566+0000","last_fullsized":"2023-12-19T18:01:11.123566+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:36.502533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112955+0000","last_change":"2023-12-19T18:01:10.629685+0000","last_active":"2023-12-19T18:01:11.112955+0000","last_peered":"2023-12-19T18:01:11.112955+0000","last_clean":"2023-12-19T18:01:11.112955+0000","last_became_active":"2023-12-19T18:01:10.629347+0000","last_became_peered":"2023-12-19T18:01:10.629347+0000","last_unstale":"2023-12-19T18:01:11.112955+0000","last_undegraded":"2023-12-19T18:01:11.112955+0000","last_fullsized":"2023-12-19T18:01:11.112955+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:58:30.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114861+0000","last_change":"2023-12-19T18:01:11.110078+0000","last_active":"2023-12-19T18:01:11.114861+0000","last_peered":"2023-12-19T18:01:11.114861+0000","last_clean":"2023-12-19T18:01:11.114861+0000","last_became_active":"2023-12-19T18:01:11.109804+0000","last_became_peered":"2023-12-19T18:01:11.109804+0000","last_unstale":"2023-12-19T18:01:11.114861+0000","last_undegraded":"2023-12-19T18:01:11.114861+0000","last_fullsized":"2023-12-19T18:01:11.114861+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:22.081110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114552+0000","last_change":"2023-12-19T18:01:10.621870+0000","last_active":"2023-12-19T18:01:11.114552+0000","last_peered":"2023-12-19T18:01:11.114552+0000","last_clean":"2023-12-19T18:01:11.114552+0000","last_became_active":"2023-12-19T18:01:10.618785+0000","last_became_peered":"2023-12-19T18:01:10.618785+0000","last_unstale":"2023-12-19T18:01:11.114552+0000","last_undegraded":"2023-12-19T18:01:11.114552+0000","last_fullsized":"2023-12-19T18:01:11.114552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:12.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126566+0000","last_change":"2023-12-19T18:01:11.123716+0000","last_active":"2023-12-19T18:01:11.126566+0000","last_peered":"2023-12-19T18:01:11.126566+0000","last_clean":"2023-12-19T18:01:11.126566+0000","last_became_active":"2023-12-19T18:01:11.123457+0000","last_became_peered":"2023-12-19T18:01:11.123457+0000","last_unstale":"2023-12-19T18:01:11.126566+0000","last_undegraded":"2023-12-19T18:01:11.126566+0000","last_fullsized":"2023-12-19T18:01:11.126566+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:46.066897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.118261+0000","last_change":"2023-12-19T18:01:10.622111+0000","last_active":"2023-12-19T18:01:11.118261+0000","last_peered":"2023-12-19T18:01:11.118261+0000","last_clean":"2023-12-19T18:01:11.118261+0000","last_became_active":"2023-12-19T18:01:10.620722+0000","last_became_peered":"2023-12-19T18:01:10.620722+0000","last_unstale":"2023-12-19T18:01:11.118261+0000","last_undegraded":"2023-12-19T18:01:11.118261+0000","last_fullsized":"2023-12-19T18:01:11.118261+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:12:11.840806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.131910+0000","last_change":"2023-12-19T18:01:11.122088+0000","last_active":"2023-12-19T18:01:11.131910+0000","last_peered":"2023-12-19T18:01:11.131910+0000","last_clean":"2023-12-19T18:01:11.131910+0000","last_became_active":"2023-12-19T18:01:11.121793+0000","last_became_peered":"2023-12-19T18:01:11.121793+0000","last_unstale":"2023-12-19T18:01:11.131910+0000","last_undegraded":"2023-12-19T18:01:11.131910+0000","last_fullsized":"2023-12-19T18:01:11.131910+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.311614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.102330+0000","last_change":"2023-12-19T18:01:10.623052+0000","last_active":"2023-12-19T18:01:11.102330+0000","last_peered":"2023-12-19T18:01:11.102330+0000","last_clean":"2023-12-19T18:01:11.102330+0000","last_became_active":"2023-12-19T18:01:10.622490+0000","last_became_peered":"2023-12-19T18:01:10.622490+0000","last_unstale":"2023-12-19T18:01:11.102330+0000","last_undegraded":"2023-12-19T18:01:11.102330+0000","last_fullsized":"2023-12-19T18:01:11.102330+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:39.361506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132243+0000","last_change":"2023-12-19T18:01:11.128582+0000","last_active":"2023-12-19T18:01:11.132243+0000","last_peered":"2023-12-19T18:01:11.132243+0000","last_clean":"2023-12-19T18:01:11.132243+0000","last_became_active":"2023-12-19T18:01:11.128272+0000","last_became_peered":"2023-12-19T18:01:11.128272+0000","last_unstale":"2023-12-19T18:01:11.132243+0000","last_undegraded":"2023-12-19T18:01:11.132243+0000","last_fullsized":"2023-12-19T18:01:11.132243+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:16:22.093440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.118467+0000","last_change":"2023-12-19T18:01:10.631784+0000","last_active":"2023-12-19T18:01:11.118467+0000","last_peered":"2023-12-19T18:01:11.118467+0000","last_clean":"2023-12-19T18:01:11.118467+0000","last_became_active":"2023-12-19T18:01:10.631402+0000","last_became_peered":"2023-12-19T18:01:10.631402+0000","last_unstale":"2023-12-19T18:01:11.118467+0000","last_undegraded":"2023-12-19T18:01:11.118467+0000","last_fullsized":"2023-12-19T18:01:11.118467+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:03.666370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.102354+0000","last_change":"2023-12-19T18:01:11.093772+0000","last_active":"2023-12-19T18:01:11.102354+0000","last_peered":"2023-12-19T18:01:11.102354+0000","last_clean":"2023-12-19T18:01:11.102354+0000","last_became_active":"2023-12-19T18:01:11.093450+0000","last_became_peered":"2023-12-19T18:01:11.093450+0000","last_unstale":"2023-12-19T18:01:11.102354+0000","last_undegraded":"2023-12-19T18:01:11.102354+0000","last_fullsized":"2023-12-19T18:01:11.102354+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:21.895699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.108334+0000","last_change":"2023-12-19T18:01:10.636168+0000","last_active":"2023-12-19T18:01:11.108334+0000","last_peered":"2023-12-19T18:01:11.108334+0000","last_clean":"2023-12-19T18:01:11.108334+0000","last_became_active":"2023-12-19T18:01:10.635909+0000","last_became_peered":"2023-12-19T18:01:10.635909+0000","last_unstale":"2023-12-19T18:01:11.108334+0000","last_undegraded":"2023-12-19T18:01:11.108334+0000","last_fullsized":"2023-12-19T18:01:11.108334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:17.745584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.124420+0000","last_change":"2023-12-19T18:01:11.120249+0000","last_active":"2023-12-19T18:01:11.124420+0000","last_peered":"2023-12-19T18:01:11.124420+0000","last_clean":"2023-12-19T18:01:11.124420+0000","last_became_active":"2023-12-19T18:01:11.119970+0000","last_became_peered":"2023-12-19T18:01:11.119970+0000","last_unstale":"2023-12-19T18:01:11.124420+0000","last_undegraded":"2023-12-19T18:01:11.124420+0000","last_fullsized":"2023-12-19T18:01:11.124420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.311614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.083311+0000","last_change":"2023-12-19T18:01:10.628264+0000","last_active":"2023-12-19T18:01:11.083311+0000","last_peered":"2023-12-19T18:01:11.083311+0000","last_clean":"2023-12-19T18:01:11.083311+0000","last_became_active":"2023-12-19T18:01:10.627914+0000","last_became_peered":"2023-12-19T18:01:10.627914+0000","last_unstale":"2023-12-19T18:01:11.083311+0000","last_undegraded":"2023-12-19T18:01:11.083311+0000","last_fullsized":"2023-12-19T18:01:11.083311+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:05:54.353577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.117222+0000","last_change":"2023-12-19T18:01:11.114159+0000","last_active":"2023-12-19T18:01:11.117222+0000","last_peered":"2023-12-19T18:01:11.117222+0000","last_clean":"2023-12-19T18:01:11.117222+0000","last_became_active":"2023-12-19T18:01:11.113553+0000","last_became_peered":"2023-12-19T18:01:11.113553+0000","last_unstale":"2023-12-19T18:01:11.117222+0000","last_undegraded":"2023-12-19T18:01:11.117222+0000","last_fullsized":"2023-12-19T18:01:11.117222+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:59.078109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.083920+0000","last_change":"2023-12-19T18:01:10.626428+0000","last_active":"2023-12-19T18:01:11.083920+0000","last_peered":"2023-12-19T18:01:11.083920+0000","last_clean":"2023-12-19T18:01:11.083920+0000","last_became_active":"2023-12-19T18:01:10.626136+0000","last_became_peered":"2023-12-19T18:01:10.626136+0000","last_unstale":"2023-12-19T18:01:11.083920+0000","last_undegraded":"2023-12-19T18:01:11.083920+0000","last_fullsized":"2023-12-19T18:01:11.083920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:02:40.587960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126494+0000","last_change":"2023-12-19T18:01:11.122162+0000","last_active":"2023-12-19T18:01:11.126494+0000","last_peered":"2023-12-19T18:01:11.126494+0000","last_clean":"2023-12-19T18:01:11.126494+0000","last_became_active":"2023-12-19T18:01:11.121871+0000","last_became_peered":"2023-12-19T18:01:11.121871+0000","last_unstale":"2023-12-19T18:01:11.126494+0000","last_undegraded":"2023-12-19T18:01:11.126494+0000","last_fullsized":"2023-12-19T18:01:11.126494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:51:55.970478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.089422+0000","last_change":"2023-12-19T18:01:10.633490+0000","last_active":"2023-12-19T18:01:11.089422+0000","last_peered":"2023-12-19T18:01:11.089422+0000","last_clean":"2023-12-19T18:01:11.089422+0000","last_became_active":"2023-12-19T18:01:10.632937+0000","last_became_peered":"2023-12-19T18:01:10.632937+0000","last_unstale":"2023-12-19T18:01:11.089422+0000","last_undegraded":"2023-12-19T18:01:11.089422+0000","last_fullsized":"2023-12-19T18:01:11.089422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:08.277472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130734+0000","last_change":"2023-12-19T18:01:11.123064+0000","last_active":"2023-12-19T18:01:11.130734+0000","last_peered":"2023-12-19T18:01:11.130734+0000","last_clean":"2023-12-19T18:01:11.130734+0000","last_became_active":"2023-12-19T18:01:11.122434+0000","last_became_peered":"2023-12-19T18:01:11.122434+0000","last_unstale":"2023-12-19T18:01:11.130734+0000","last_undegraded":"2023-12-19T18:01:11.130734+0000","last_fullsized":"2023-12-19T18:01:11.130734+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:33:49.688500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114398+0000","last_change":"2023-12-19T18:01:10.620651+0000","last_active":"2023-12-19T18:01:11.114398+0000","last_peered":"2023-12-19T18:01:11.114398+0000","last_clean":"2023-12-19T18:01:11.114398+0000","last_became_active":"2023-12-19T18:01:10.620248+0000","last_became_peered":"2023-12-19T18:01:10.620248+0000","last_unstale":"2023-12-19T18:01:11.114398+0000","last_undegraded":"2023-12-19T18:01:11.114398+0000","last_fullsized":"2023-12-19T18:01:11.114398+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:11.305450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.129245+0000","last_change":"2023-12-19T18:01:11.120011+0000","last_active":"2023-12-19T18:01:11.129245+0000","last_peered":"2023-12-19T18:01:11.129245+0000","last_clean":"2023-12-19T18:01:11.129245+0000","last_became_active":"2023-12-19T18:01:11.119500+0000","last_became_peered":"2023-12-19T18:01:11.119500+0000","last_unstale":"2023-12-19T18:01:11.129245+0000","last_undegraded":"2023-12-19T18:01:11.129245+0000","last_fullsized":"2023-12-19T18:01:11.129245+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:39.393835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"106'6","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132544+0000","last_change":"2023-12-19T18:01:10.630202+0000","last_active":"2023-12-19T18:01:11.132544+0000","last_peered":"2023-12-19T18:01:11.132544+0000","last_clean":"2023-12-19T18:01:11.132544+0000","last_became_active":"2023-12-19T18:01:10.629909+0000","last_became_peered":"2023-12-19T18:01:10.629909+0000","last_unstale":"2023-12-19T18:01:11.132544+0000","last_undegraded":"2023-12-19T18:01:11.132544+0000","last_fullsized":"2023-12-19T18:01:11.132544+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:02:40.587960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.105149+0000","last_change":"2023-12-19T18:01:11.100600+0000","last_active":"2023-12-19T18:01:11.105149+0000","last_peered":"2023-12-19T18:01:11.105149+0000","last_clean":"2023-12-19T18:01:11.105149+0000","last_became_active":"2023-12-19T18:01:11.100362+0000","last_became_peered":"2023-12-19T18:01:11.100362+0000","last_unstale":"2023-12-19T18:01:11.105149+0000","last_undegraded":"2023-12-19T18:01:11.105149+0000","last_fullsized":"2023-12-19T18:01:11.105149+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:50.934788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115969+0000","last_change":"2023-12-19T18:01:10.616613+0000","last_active":"2023-12-19T18:01:11.115969+0000","last_peered":"2023-12-19T18:01:11.115969+0000","last_clean":"2023-12-19T18:01:11.115969+0000","last_became_active":"2023-12-19T18:01:10.616024+0000","last_became_peered":"2023-12-19T18:01:10.616024+0000","last_unstale":"2023-12-19T18:01:11.115969+0000","last_undegraded":"2023-12-19T18:01:11.115969+0000","last_fullsized":"2023-12-19T18:01:11.115969+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:56.566301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.107472+0000","last_change":"2023-12-19T18:01:11.103843+0000","last_active":"2023-12-19T18:01:11.107472+0000","last_peered":"2023-12-19T18:01:11.107472+0000","last_clean":"2023-12-19T18:01:11.107472+0000","last_became_active":"2023-12-19T18:01:11.103572+0000","last_became_peered":"2023-12-19T18:01:11.103572+0000","last_unstale":"2023-12-19T18:01:11.107472+0000","last_undegraded":"2023-12-19T18:01:11.107472+0000","last_fullsized":"2023-12-19T18:01:11.107472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.311614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.097725+0000","last_change":"2023-12-19T18:01:10.626216+0000","last_active":"2023-12-19T18:01:11.097725+0000","last_peered":"2023-12-19T18:01:11.097725+0000","last_clean":"2023-12-19T18:01:11.097725+0000","last_became_active":"2023-12-19T18:01:10.625949+0000","last_became_peered":"2023-12-19T18:01:10.625949+0000","last_unstale":"2023-12-19T18:01:11.097725+0000","last_undegraded":"2023-12-19T18:01:11.097725+0000","last_fullsized":"2023-12-19T18:01:11.097725+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:51.197277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.120582+0000","last_change":"2023-12-19T18:01:11.115801+0000","last_active":"2023-12-19T18:01:11.120582+0000","last_peered":"2023-12-19T18:01:11.120582+0000","last_clean":"2023-12-19T18:01:11.120582+0000","last_became_active":"2023-12-19T18:01:11.115537+0000","last_became_peered":"2023-12-19T18:01:11.115537+0000","last_unstale":"2023-12-19T18:01:11.120582+0000","last_undegraded":"2023-12-19T18:01:11.120582+0000","last_fullsized":"2023-12-19T18:01:11.120582+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:23.187848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113982+0000","last_change":"2023-12-19T18:01:10.620015+0000","last_active":"2023-12-19T18:01:11.113982+0000","last_peered":"2023-12-19T18:01:11.113982+0000","last_clean":"2023-12-19T18:01:11.113982+0000","last_became_active":"2023-12-19T18:01:10.619742+0000","last_became_peered":"2023-12-19T18:01:10.619742+0000","last_unstale":"2023-12-19T18:01:11.113982+0000","last_undegraded":"2023-12-19T18:01:11.113982+0000","last_fullsized":"2023-12-19T18:01:11.113982+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:39.361506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122676+0000","last_change":"2023-12-19T18:01:11.111619+0000","last_active":"2023-12-19T18:01:11.122676+0000","last_peered":"2023-12-19T18:01:11.122676+0000","last_clean":"2023-12-19T18:01:11.122676+0000","last_became_active":"2023-12-19T18:01:11.110589+0000","last_became_peered":"2023-12-19T18:01:11.110589+0000","last_unstale":"2023-12-19T18:01:11.122676+0000","last_undegraded":"2023-12-19T18:01:11.122676+0000","last_fullsized":"2023-12-19T18:01:11.122676+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:14.041471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.118388+0000","last_change":"2023-12-19T18:01:10.620118+0000","last_active":"2023-12-19T18:01:11.118388+0000","last_peered":"2023-12-19T18:01:11.118388+0000","last_clean":"2023-12-19T18:01:11.118388+0000","last_became_active":"2023-12-19T18:01:10.619763+0000","last_became_peered":"2023-12-19T18:01:10.619763+0000","last_unstale":"2023-12-19T18:01:11.118388+0000","last_undegraded":"2023-12-19T18:01:11.118388+0000","last_fullsized":"2023-12-19T18:01:11.118388+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:03.290453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130580+0000","last_change":"2023-12-19T18:01:11.120167+0000","last_active":"2023-12-19T18:01:11.130580+0000","last_peered":"2023-12-19T18:01:11.130580+0000","last_clean":"2023-12-19T18:01:11.130580+0000","last_became_active":"2023-12-19T18:01:11.119828+0000","last_became_peered":"2023-12-19T18:01:11.119828+0000","last_unstale":"2023-12-19T18:01:11.130580+0000","last_undegraded":"2023-12-19T18:01:11.130580+0000","last_fullsized":"2023-12-19T18:01:11.130580+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:31.170039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.129306+0000","last_change":"2023-12-19T18:01:10.621231+0000","last_active":"2023-12-19T18:01:11.129306+0000","last_peered":"2023-12-19T18:01:11.129306+0000","last_clean":"2023-12-19T18:01:11.129306+0000","last_became_active":"2023-12-19T18:01:10.619942+0000","last_became_peered":"2023-12-19T18:01:10.619942+0000","last_unstale":"2023-12-19T18:01:11.129306+0000","last_undegraded":"2023-12-19T18:01:11.129306+0000","last_fullsized":"2023-12-19T18:01:11.129306+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:03.290453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132058+0000","last_change":"2023-12-19T18:01:11.127482+0000","last_active":"2023-12-19T18:01:11.132058+0000","last_peered":"2023-12-19T18:01:11.132058+0000","last_clean":"2023-12-19T18:01:11.132058+0000","last_became_active":"2023-12-19T18:01:11.127083+0000","last_became_peered":"2023-12-19T18:01:11.127083+0000","last_unstale":"2023-12-19T18:01:11.132058+0000","last_undegraded":"2023-12-19T18:01:11.132058+0000","last_fullsized":"2023-12-19T18:01:11.132058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:58:31.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.127355+0000","last_change":"2023-12-19T18:01:10.617221+0000","last_active":"2023-12-19T18:01:11.127355+0000","last_peered":"2023-12-19T18:01:11.127355+0000","last_clean":"2023-12-19T18:01:11.127355+0000","last_became_active":"2023-12-19T18:01:10.616730+0000","last_became_peered":"2023-12-19T18:01:10.616730+0000","last_unstale":"2023-12-19T18:01:11.127355+0000","last_undegraded":"2023-12-19T18:01:11.127355+0000","last_fullsized":"2023-12-19T18:01:11.127355+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:22.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123816+0000","last_change":"2023-12-19T18:01:11.114972+0000","last_active":"2023-12-19T18:01:11.123816+0000","last_peered":"2023-12-19T18:01:11.123816+0000","last_clean":"2023-12-19T18:01:11.123816+0000","last_became_active":"2023-12-19T18:01:11.114607+0000","last_became_peered":"2023-12-19T18:01:11.114607+0000","last_unstale":"2023-12-19T18:01:11.123816+0000","last_undegraded":"2023-12-19T18:01:11.123816+0000","last_fullsized":"2023-12-19T18:01:11.123816+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:10.953209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.098680+0000","last_change":"2023-12-19T18:01:10.622079+0000","last_active":"2023-12-19T18:01:11.098680+0000","last_peered":"2023-12-19T18:01:11.098680+0000","last_clean":"2023-12-19T18:01:11.098680+0000","last_became_active":"2023-12-19T18:01:10.620706+0000","last_became_peered":"2023-12-19T18:01:10.620706+0000","last_unstale":"2023-12-19T18:01:11.098680+0000","last_undegraded":"2023-12-19T18:01:11.098680+0000","last_fullsized":"2023-12-19T18:01:11.098680+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:57.361799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113356+0000","last_change":"2023-12-19T18:01:11.106966+0000","last_active":"2023-12-19T18:01:11.113356+0000","last_peered":"2023-12-19T18:01:11.113356+0000","last_clean":"2023-12-19T18:01:11.113356+0000","last_became_active":"2023-12-19T18:01:11.106725+0000","last_became_peered":"2023-12-19T18:01:11.106725+0000","last_unstale":"2023-12-19T18:01:11.113356+0000","last_undegraded":"2023-12-19T18:01:11.113356+0000","last_fullsized":"2023-12-19T18:01:11.113356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:49:25.917729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126448+0000","last_change":"2023-12-19T18:01:10.618714+0000","last_active":"2023-12-19T18:01:11.126448+0000","last_peered":"2023-12-19T18:01:11.126448+0000","last_clean":"2023-12-19T18:01:11.126448+0000","last_became_active":"2023-12-19T18:01:10.618411+0000","last_became_peered":"2023-12-19T18:01:10.618411+0000","last_unstale":"2023-12-19T18:01:11.126448+0000","last_undegraded":"2023-12-19T18:01:11.126448+0000","last_fullsized":"2023-12-19T18:01:11.126448+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:05.670478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126044+0000","last_change":"2023-12-19T18:01:11.116618+0000","last_active":"2023-12-19T18:01:11.126044+0000","last_peered":"2023-12-19T18:01:11.126044+0000","last_clean":"2023-12-19T18:01:11.126044+0000","last_became_active":"2023-12-19T18:01:11.116235+0000","last_became_peered":"2023-12-19T18:01:11.116235+0000","last_unstale":"2023-12-19T18:01:11.126044+0000","last_undegraded":"2023-12-19T18:01:11.126044+0000","last_fullsized":"2023-12-19T18:01:11.126044+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:05:55.359741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.100462+0000","last_change":"2023-12-19T18:01:10.631503+0000","last_active":"2023-12-19T18:01:11.100462+0000","last_peered":"2023-12-19T18:01:11.100462+0000","last_clean":"2023-12-19T18:01:11.100462+0000","last_became_active":"2023-12-19T18:01:10.631181+0000","last_became_peered":"2023-12-19T18:01:10.631181+0000","last_unstale":"2023-12-19T18:01:11.100462+0000","last_undegraded":"2023-12-19T18:01:11.100462+0000","last_fullsized":"2023-12-19T18:01:11.100462+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:49:24.911565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.104786+0000","last_change":"2023-12-19T18:01:11.100019+0000","last_active":"2023-12-19T18:01:11.104786+0000","last_peered":"2023-12-19T18:01:11.104786+0000","last_clean":"2023-12-19T18:01:11.104786+0000","last_became_active":"2023-12-19T18:01:11.099773+0000","last_became_peered":"2023-12-19T18:01:11.099773+0000","last_unstale":"2023-12-19T18:01:11.104786+0000","last_undegraded":"2023-12-19T18:01:11.104786+0000","last_fullsized":"2023-12-19T18:01:11.104786+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:29.551439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.101315+0000","last_change":"2023-12-19T18:01:10.629144+0000","last_active":"2023-12-19T18:01:11.101315+0000","last_peered":"2023-12-19T18:01:11.101315+0000","last_clean":"2023-12-19T18:01:11.101315+0000","last_became_active":"2023-12-19T18:01:10.628807+0000","last_became_peered":"2023-12-19T18:01:10.628807+0000","last_unstale":"2023-12-19T18:01:11.101315+0000","last_undegraded":"2023-12-19T18:01:11.101315+0000","last_fullsized":"2023-12-19T18:01:11.101315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:17.745584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130705+0000","last_change":"2023-12-19T18:01:11.119276+0000","last_active":"2023-12-19T18:01:11.130705+0000","last_peered":"2023-12-19T18:01:11.130705+0000","last_clean":"2023-12-19T18:01:11.130705+0000","last_became_active":"2023-12-19T18:01:11.118945+0000","last_became_peered":"2023-12-19T18:01:11.118945+0000","last_unstale":"2023-12-19T18:01:11.130705+0000","last_undegraded":"2023-12-19T18:01:11.130705+0000","last_fullsized":"2023-12-19T18:01:11.130705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:19:15.351193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.096599+0000","last_change":"2023-12-19T18:01:10.630643+0000","last_active":"2023-12-19T18:01:11.096599+0000","last_peered":"2023-12-19T18:01:11.096599+0000","last_clean":"2023-12-19T18:01:11.096599+0000","last_became_active":"2023-12-19T18:01:10.630033+0000","last_became_peered":"2023-12-19T18:01:10.630033+0000","last_unstale":"2023-12-19T18:01:11.096599+0000","last_undegraded":"2023-12-19T18:01:11.096599+0000","last_fullsized":"2023-12-19T18:01:11.096599+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:38.387672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.117204+0000","last_change":"2023-12-19T18:01:11.112590+0000","last_active":"2023-12-19T18:01:11.117204+0000","last_peered":"2023-12-19T18:01:11.117204+0000","last_clean":"2023-12-19T18:01:11.117204+0000","last_became_active":"2023-12-19T18:01:11.112301+0000","last_became_peered":"2023-12-19T18:01:11.112301+0000","last_unstale":"2023-12-19T18:01:11.117204+0000","last_undegraded":"2023-12-19T18:01:11.117204+0000","last_fullsized":"2023-12-19T18:01:11.117204+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:46.561985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.121484+0000","last_change":"2023-12-19T18:01:10.624225+0000","last_active":"2023-12-19T18:01:11.121484+0000","last_peered":"2023-12-19T18:01:11.121484+0000","last_clean":"2023-12-19T18:01:11.121484+0000","last_became_active":"2023-12-19T18:01:10.623813+0000","last_became_peered":"2023-12-19T18:01:10.623813+0000","last_unstale":"2023-12-19T18:01:11.121484+0000","last_undegraded":"2023-12-19T18:01:11.121484+0000","last_fullsized":"2023-12-19T18:01:11.121484+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:22.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112398+0000","last_change":"2023-12-19T18:01:11.108223+0000","last_active":"2023-12-19T18:01:11.112398+0000","last_peered":"2023-12-19T18:01:11.112398+0000","last_clean":"2023-12-19T18:01:11.112398+0000","last_became_active":"2023-12-19T18:01:11.107950+0000","last_became_peered":"2023-12-19T18:01:11.107950+0000","last_unstale":"2023-12-19T18:01:11.112398+0000","last_undegraded":"2023-12-19T18:01:11.112398+0000","last_fullsized":"2023-12-19T18:01:11.112398+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:49:13.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.098656+0000","last_change":"2023-12-19T18:01:10.620428+0000","last_active":"2023-12-19T18:01:11.098656+0000","last_peered":"2023-12-19T18:01:11.098656+0000","last_clean":"2023-12-19T18:01:11.098656+0000","last_became_active":"2023-12-19T18:01:10.620160+0000","last_became_peered":"2023-12-19T18:01:10.620160+0000","last_unstale":"2023-12-19T18:01:11.098656+0000","last_undegraded":"2023-12-19T18:01:11.098656+0000","last_fullsized":"2023-12-19T18:01:11.098656+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:08.277472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126702+0000","last_change":"2023-12-19T18:01:11.125637+0000","last_active":"2023-12-19T18:01:11.126702+0000","last_peered":"2023-12-19T18:01:11.126702+0000","last_clean":"2023-12-19T18:01:11.126702+0000","last_became_active":"2023-12-19T18:01:11.124625+0000","last_became_peered":"2023-12-19T18:01:11.124625+0000","last_unstale":"2023-12-19T18:01:11.126702+0000","last_undegraded":"2023-12-19T18:01:11.126702+0000","last_fullsized":"2023-12-19T18:01:11.126702+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:51:55.970478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.099858+0000","last_change":"2023-12-19T18:01:10.623609+0000","last_active":"2023-12-19T18:01:11.099858+0000","last_peered":"2023-12-19T18:01:11.099858+0000","last_clean":"2023-12-19T18:01:11.099858+0000","last_became_active":"2023-12-19T18:01:10.623343+0000","last_became_peered":"2023-12-19T18:01:10.623343+0000","last_unstale":"2023-12-19T18:01:11.099858+0000","last_undegraded":"2023-12-19T18:01:11.099858+0000","last_fullsized":"2023-12-19T18:01:11.099858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:07.370840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132312+0000","last_change":"2023-12-19T18:01:11.127865+0000","last_active":"2023-12-19T18:01:11.132312+0000","last_peered":"2023-12-19T18:01:11.132312+0000","last_clean":"2023-12-19T18:01:11.132312+0000","last_became_active":"2023-12-19T18:01:11.127558+0000","last_became_peered":"2023-12-19T18:01:11.127558+0000","last_unstale":"2023-12-19T18:01:11.132312+0000","last_undegraded":"2023-12-19T18:01:11.132312+0000","last_fullsized":"2023-12-19T18:01:11.132312+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:46.066897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.110617+0000","last_change":"2023-12-19T18:01:10.615274+0000","last_active":"2023-12-19T18:01:11.110617+0000","last_peered":"2023-12-19T18:01:11.110617+0000","last_clean":"2023-12-19T18:01:11.110617+0000","last_became_active":"2023-12-19T18:01:10.614802+0000","last_became_peered":"2023-12-19T18:01:10.614802+0000","last_unstale":"2023-12-19T18:01:11.110617+0000","last_undegraded":"2023-12-19T18:01:11.110617+0000","last_fullsized":"2023-12-19T18:01:11.110617+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:05:54.353577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123637+0000","last_change":"2023-12-19T18:01:11.117580+0000","last_active":"2023-12-19T18:01:11.123637+0000","last_peered":"2023-12-19T18:01:11.123637+0000","last_clean":"2023-12-19T18:01:11.123637+0000","last_became_active":"2023-12-19T18:01:11.117344+0000","last_became_peered":"2023-12-19T18:01:11.117344+0000","last_unstale":"2023-12-19T18:01:11.123637+0000","last_undegraded":"2023-12-19T18:01:11.123637+0000","last_fullsized":"2023-12-19T18:01:11.123637+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:18.751748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.098556+0000","last_change":"2023-12-19T18:01:10.612739+0000","last_active":"2023-12-19T18:01:11.098556+0000","last_peered":"2023-12-19T18:01:11.098556+0000","last_clean":"2023-12-19T18:01:11.098556+0000","last_became_active":"2023-12-19T18:01:10.612202+0000","last_became_peered":"2023-12-19T18:01:10.612202+0000","last_unstale":"2023-12-19T18:01:11.098556+0000","last_undegraded":"2023-12-19T18:01:11.098556+0000","last_fullsized":"2023-12-19T18:01:11.098556+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:09.947045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.131145+0000","last_change":"2023-12-19T18:01:11.129458+0000","last_active":"2023-12-19T18:01:11.131145+0000","last_peered":"2023-12-19T18:01:11.131145+0000","last_clean":"2023-12-19T18:01:11.131145+0000","last_became_active":"2023-12-19T18:01:11.129192+0000","last_became_peered":"2023-12-19T18:01:11.129192+0000","last_unstale":"2023-12-19T18:01:11.131145+0000","last_undegraded":"2023-12-19T18:01:11.131145+0000","last_fullsized":"2023-12-19T18:01:11.131145+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:49:13.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.107819+0000","last_change":"2023-12-19T18:01:10.631333+0000","last_active":"2023-12-19T18:01:11.107819+0000","last_peered":"2023-12-19T18:01:11.107819+0000","last_clean":"2023-12-19T18:01:11.107819+0000","last_became_active":"2023-12-19T18:01:10.631030+0000","last_became_peered":"2023-12-19T18:01:10.631030+0000","last_unstale":"2023-12-19T18:01:11.107819+0000","last_undegraded":"2023-12-19T18:01:11.107819+0000","last_fullsized":"2023-12-19T18:01:11.107819+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:28.545275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122875+0000","last_change":"2023-12-19T18:01:11.111229+0000","last_active":"2023-12-19T18:01:11.122875+0000","last_peered":"2023-12-19T18:01:11.122875+0000","last_clean":"2023-12-19T18:01:11.122875+0000","last_became_active":"2023-12-19T18:01:11.110975+0000","last_became_peered":"2023-12-19T18:01:11.110975+0000","last_unstale":"2023-12-19T18:01:11.122875+0000","last_undegraded":"2023-12-19T18:01:11.122875+0000","last_fullsized":"2023-12-19T18:01:11.122875+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:18:59.437060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.089917+0000","last_change":"2023-12-19T18:01:10.627584+0000","last_active":"2023-12-19T18:01:11.089917+0000","last_peered":"2023-12-19T18:01:11.089917+0000","last_clean":"2023-12-19T18:01:11.089917+0000","last_became_active":"2023-12-19T18:01:10.627284+0000","last_became_peered":"2023-12-19T18:01:10.627284+0000","last_unstale":"2023-12-19T18:01:11.089917+0000","last_undegraded":"2023-12-19T18:01:11.089917+0000","last_fullsized":"2023-12-19T18:01:11.089917+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:38.387672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130726+0000","last_change":"2023-12-19T18:01:11.119745+0000","last_active":"2023-12-19T18:01:11.130726+0000","last_peered":"2023-12-19T18:01:11.130726+0000","last_clean":"2023-12-19T18:01:11.130726+0000","last_became_active":"2023-12-19T18:01:11.119431+0000","last_became_peered":"2023-12-19T18:01:11.119431+0000","last_unstale":"2023-12-19T18:01:11.130726+0000","last_undegraded":"2023-12-19T18:01:11.130726+0000","last_fullsized":"2023-12-19T18:01:11.130726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:51:24.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.097559+0000","last_change":"2023-12-19T18:01:10.624018+0000","last_active":"2023-12-19T18:01:11.097559+0000","last_peered":"2023-12-19T18:01:11.097559+0000","last_clean":"2023-12-19T18:01:11.097559+0000","last_became_active":"2023-12-19T18:01:10.623723+0000","last_became_peered":"2023-12-19T18:01:10.623723+0000","last_unstale":"2023-12-19T18:01:11.097559+0000","last_undegraded":"2023-12-19T18:01:11.097559+0000","last_fullsized":"2023-12-19T18:01:11.097559+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:19.340604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122813+0000","last_change":"2023-12-19T18:01:11.112780+0000","last_active":"2023-12-19T18:01:11.122813+0000","last_peered":"2023-12-19T18:01:11.122813+0000","last_clean":"2023-12-19T18:01:11.122813+0000","last_became_active":"2023-12-19T18:01:11.108431+0000","last_became_peered":"2023-12-19T18:01:11.108431+0000","last_unstale":"2023-12-19T18:01:11.122813+0000","last_undegraded":"2023-12-19T18:01:11.122813+0000","last_fullsized":"2023-12-19T18:01:11.122813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:23.187848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.109489+0000","last_change":"2023-12-19T18:01:10.628814+0000","last_active":"2023-12-19T18:01:11.109489+0000","last_peered":"2023-12-19T18:01:11.109489+0000","last_clean":"2023-12-19T18:01:11.109489+0000","last_became_active":"2023-12-19T18:01:10.628533+0000","last_became_peered":"2023-12-19T18:01:10.628533+0000","last_unstale":"2023-12-19T18:01:11.109489+0000","last_undegraded":"2023-12-19T18:01:11.109489+0000","last_fullsized":"2023-12-19T18:01:11.109489+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:21:56.169254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":254,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-19T18:01:10.607888+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:01:10.607888+0000","last_peered":"2023-12-19T18:01:10.607888+0000","last_clean":"2023-12-19T18:01:10.607888+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:01:10.607888+0000","last_undegraded":"2023-12-19T18:01:10.607888+0000","last_fullsized":"2023-12-19T18:01:10.607888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1892352,"data_stored":1215872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.204,"15min":1.0980000000000001},"min":{"1min":0.70299999999999996,"5min":0.56100000000000005,"15min":0.55000000000000004},"max":{"1min":8.3209999999999997,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.7609999999999999,"5min":1.28,"15min":1.1719999999999999},"min":{"1min":0.75800000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.249000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.137,"15min":1.1000000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":12.625,"5min":12.625,"15min":12.625},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.70699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":13.337999999999999,"5min":13.337999999999999,"15min":13.337999999999999},"last":1.0609999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.1479999999999999,"15min":1.091},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":13.041,"5min":13.041,"15min":13.041},"last":1.3140000000000001},{"interface":"front","average":{"1min":3.4180000000000001,"5min":1.5780000000000001,"15min":1.2849999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":48.889000000000003,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.274}]},{"osd":3,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.2669999999999999,"15min":1.173},"min":{"1min":0.82399999999999995,"5min":0.622,"15min":0.51600000000000001},"max":{"1min":12.917,"5min":12.917,"15min":12.917},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.4119999999999999,"5min":1.675,"15min":1.365},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.64200000000000002},"max":{"1min":46.375,"5min":46.375,"15min":46.375},"last":1.0880000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":1.246,"15min":1.2250000000000001},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":13.137,"5min":13.137,"15min":13.137},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.369,"15min":1.3129999999999999},"min":{"1min":1.0229999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":13.109,"5min":13.109,"15min":13.109},"last":1.2270000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.2909999999999999,"15min":1.2490000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"max":{"1min":8.2690000000000001,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.778,"5min":1.329,"15min":1.298},"min":{"1min":0.85699999999999998,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":13.198,"5min":13.198,"15min":13.198},"last":1.212}]},{"osd":6,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.486,"15min":1.4199999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":13.442,"5min":13.442,"15min":13.442},"last":1.262},{"interface":"front","average":{"1min":1.8999999999999999,"5min":1.413,"15min":1.3680000000000001},"min":{"1min":0.98099999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.981,"5min":13.981,"15min":13.981},"last":1.375}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1318912,"data_stored":633251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0089999999999999,"15min":1.131},"min":{"1min":0.65100000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.399,"5min":1.5149999999999999,"15min":4.5979999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.018,"15min":1.0780000000000001},"min":{"1min":0.746,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3939999999999999,"5min":1.5580000000000001,"15min":1.6819999999999999},"last":1}]},{"osd":1,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.083,"15min":1.0880000000000001},"min":{"1min":0.71799999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.377},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0860000000000001,"15min":1.1220000000000001},"min":{"1min":0.86899999999999999,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.4370000000000001,"5min":1.583,"15min":1.621},"last":1.47}]},{"osd":2,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.127,"15min":1.339},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66800000000000004},"max":{"1min":1.3779999999999999,"5min":1.5129999999999999,"15min":8.5470000000000006},"last":1.103},{"interface":"front","average":{"1min":1.272,"5min":1.153,"15min":1.2390000000000001},"min":{"1min":1.042,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.778,"15min":4.6340000000000003},"last":1.3180000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1850000000000001,"15min":1.276},"min":{"1min":0.82899999999999996,"5min":0.76400000000000001,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.6180000000000001,"15min":4.5380000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.3180000000000001},"min":{"1min":0.82599999999999996,"5min":0.72399999999999998,"15min":0.65300000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":4.508},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1619999999999999,"15min":1.1439999999999999},"min":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.438},"max":{"1min":1.577,"5min":1.643,"15min":1.8360000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.84799999999999998,"5min":0.77600000000000002,"15min":0.70299999999999996},"max":{"1min":1.583,"5min":1.6779999999999999,"15min":1.899},"last":1.532}]},{"osd":5,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.262,"15min":1.264},"min":{"1min":0.90500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6120000000000001,"5min":1.643,"15min":2.1400000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2749999999999999,"15min":1.2709999999999999},"min":{"1min":0.77200000000000002,"5min":0.73699999999999999,"15min":0.57299999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3560000000000001,"15min":1.355},"min":{"1min":0.92700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.395,"15min":1.403},"min":{"1min":1.1279999999999999,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.728,"5min":1.8460000000000001,"15min":2.2440000000000002},"last":1.5669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1314816,"data_stored":632669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0049999999999999,"15min":0.999},"min":{"1min":0.86699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.53,"5min":1.5469999999999999,"15min":1.613},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.089,"5min":0.996,"15min":1.0549999999999999},"min":{"1min":0.82799999999999996,"5min":0.629,"15min":0.60599999999999998},"max":{"1min":1.54,"5min":1.54,"15min":2.9369999999999998},"last":1.3109999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.111,"15min":1.099},"min":{"1min":0.77100000000000002,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.47,"15min":1.778},"last":1.085},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.1839999999999999},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":2.0329999999999999},"last":1.1060000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.073,"15min":1.1559999999999999},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.522,"5min":1.891,"15min":2.9929999999999999},"last":1.256},{"interface":"front","average":{"1min":1.196,"5min":1.077,"15min":1.1479999999999999},"min":{"1min":0.88100000000000001,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.671},"last":0.88700000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.141,"15min":1.25},"min":{"1min":0.83399999999999996,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.605,"5min":1.605,"15min":2.2410000000000001},"last":1.022},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2050000000000001,"15min":1.329},"min":{"1min":0.76600000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7070000000000001,"5min":1.796,"15min":3.0350000000000001},"last":1.3560000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1779999999999999,"15min":1.26},"min":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.67100000000000004},"max":{"1min":1.464,"5min":1.589,"15min":2.0819999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.278,"15min":1.3620000000000001},"min":{"1min":0.85899999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.623,"5min":1.7070000000000001,"15min":3.2589999999999999},"last":1.196}]},{"osd":6,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.208,"15min":1.345},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.655,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2310000000000001,"15min":1.3180000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4910000000000001,"5min":1.5620000000000001,"15min":2.3239999999999998},"last":0.97999999999999998}]},{"osd":7,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3200000000000001,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.722,"5min":1.992,"15min":3.1099999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.341,"5min":1.333,"15min":1.5229999999999999},"min":{"1min":1.0229999999999999,"5min":0.84799999999999998,"15min":0.82499999999999996},"max":{"1min":1.6699999999999999,"5min":1.9750000000000001,"15min":3.5680000000000001},"last":1.413}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":634287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.085,"15min":1.206},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5189999999999999,"5min":1.8420000000000001,"15min":5.4420000000000002},"last":0.871},{"interface":"front","average":{"1min":1.262,"5min":1.167,"15min":1.276},"min":{"1min":0.98099999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":5.5049999999999999},"last":1.294}]},{"osd":1,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.115,"15min":1.2130000000000001},"min":{"1min":0.66600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.512,"5min":1.7,"15min":4.6379999999999999},"last":1.216},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0720000000000001,"15min":1.1850000000000001},"min":{"1min":0.81299999999999994,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5089999999999999,"5min":1.6659999999999999,"15min":3.254},"last":1.401}]},{"osd":2,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0840000000000001,"15min":1.2430000000000001},"min":{"1min":0.78100000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4359999999999999,"5min":1.647,"15min":4.593},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.127,"15min":1.2250000000000001},"min":{"1min":0.92500000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5,"5min":1.54,"15min":2.3799999999999999},"last":1.4730000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.0980000000000001,"15min":1.2410000000000001},"min":{"1min":0.82299999999999995,"5min":0.73899999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.163},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.181,"15min":1.3540000000000001},"min":{"1min":0.85299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.484,"5min":1.7250000000000001,"15min":5.633},"last":1.1359999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1799999999999999,"15min":1.21},"min":{"1min":0.77800000000000002,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.462,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1799999999999999,"15min":1.1659999999999999},"min":{"1min":0.85799999999999998,"5min":0.71199999999999997,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.244}]},{"osd":6,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2290000000000001,"15min":1.254},"min":{"1min":0.92100000000000004,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.55,"5min":1.899,"15min":2.915},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.401,"15min":1.4119999999999999},"min":{"1min":0.96599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.671,"5min":1.883,"15min":2.5299999999999998},"last":1.369}]},{"osd":7,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2929999999999999,"15min":1.3140000000000001},"min":{"1min":0.72799999999999998,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.6220000000000001,"5min":1.875,"15min":2.4340000000000002},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.339,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.6200000000000001,"5min":1.837,"15min":5.6859999999999999},"last":0.96799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":634185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82799999999999996,"15min":0.89100000000000001},"min":{"1min":0.5,"5min":0.495,"15min":0.37},"max":{"1min":1.409,"5min":1.6599999999999999,"15min":1.825},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.85399999999999998,"15min":0.94299999999999995},"min":{"1min":0.56299999999999994,"5min":0.435,"15min":0.435},"max":{"1min":1.4299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":1.6100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.873,"15min":0.91200000000000003},"min":{"1min":0.67000000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.3899999999999999,"5min":1.46,"15min":1.54},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.60499999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3260000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.5629999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.05,"15min":1.1000000000000001},"min":{"1min":0.79500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.474,"5min":1.679,"15min":2.177},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.145,"15min":1.218},"min":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.58899999999999997},"max":{"1min":1.641,"5min":1.641,"15min":1.8520000000000001},"last":1.405}]},{"osd":4,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.123,"15min":1.2210000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.65400000000000003},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.234},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2609999999999999,"15min":1.306},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.8089999999999999,"15min":2.4350000000000001},"last":1.6499999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3100000000000001,"15min":1.385},"min":{"1min":1.0129999999999999,"5min":0.88100000000000001,"15min":0.80200000000000005},"max":{"1min":1.6830000000000001,"5min":2.052,"15min":2.5419999999999998},"last":2.0699999999999998},{"interface":"front","average":{"1min":1.298,"5min":1.244,"15min":1.3380000000000001},"min":{"1min":0.96699999999999997,"5min":0.80500000000000005,"15min":0.74299999999999999},"max":{"1min":1.776,"5min":1.776,"15min":2.754},"last":1.468}]},{"osd":6,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.333,"15min":1.3959999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.78000000000000003},"max":{"1min":1.946,"5min":1.946,"15min":2.6880000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.379,"15min":1.4550000000000001},"min":{"1min":1.0629999999999999,"5min":0.995,"15min":0.94699999999999995},"max":{"1min":1.7390000000000001,"5min":2.274,"15min":2.6429999999999998},"last":1.6699999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.288,"15min":1.4179999999999999},"min":{"1min":0.872,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4159999999999999,"15min":1.4790000000000001},"min":{"1min":1.0549999999999999,"5min":0.96299999999999997,"15min":0.83099999999999996},"max":{"1min":1.548,"5min":2.323,"15min":2.8170000000000002},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1298432,"data_stored":625504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.86899999999999999,"15min":1.1970000000000001},"min":{"1min":0.64100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3500000000000001,"5min":1.8069999999999999,"15min":13.32},"last":3.9209999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.90100000000000002,"15min":1.3109999999999999},"min":{"1min":0.78400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.417,"5min":1.5449999999999999,"15min":13.206},"last":3.8149999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89500000000000002,"15min":0.90500000000000003},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2909999999999999,"5min":1.6259999999999999,"15min":1.841},"last":2.8090000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.93500000000000005,"15min":0.98599999999999999},"min":{"1min":0.72999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.948},"last":3.6579999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.879,"15min":0.94599999999999995},"min":{"1min":0.68999999999999995,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.6699999999999999,"5min":1.708,"15min":1.79},"last":3.2389999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0980000000000001,"15min":1.1930000000000001},"min":{"1min":0.63900000000000001,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.76,"5min":1.7709999999999999,"15min":1.9350000000000001},"last":2.75}]},{"osd":4,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2250000000000001,"15min":1.24},"min":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4570000000000001,"5min":1.6000000000000001,"15min":2.0550000000000002},"last":3.8359999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1899999999999999,"15min":1.268},"min":{"1min":1.0029999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.5069999999999999,"5min":1.774,"15min":2.024},"last":8.5990000000000002}]},{"osd":5,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.1859999999999999,"15min":1.2689999999999999},"min":{"1min":0.89700000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6619999999999999,"5min":1.849,"15min":4.0659999999999998},"last":5.2480000000000002},{"interface":"front","average":{"1min":1.321,"5min":1.3009999999999999,"15min":1.4279999999999999},"min":{"1min":1.0760000000000001,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":3.7160000000000002},"last":3.7999999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2709999999999999,"15min":1.3819999999999999},"min":{"1min":1.0009999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":2.081},"last":8.6340000000000003},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.254,"15min":1.335},"min":{"1min":0.97699999999999998,"5min":0.872,"15min":0.872},"max":{"1min":1.595,"5min":1.8240000000000001,"15min":2.1379999999999999},"last":5.4130000000000003}]},{"osd":7,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3100000000000001,"15min":1.4279999999999999},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7070000000000001,"5min":2.0169999999999999,"15min":2.363},"last":8.4809999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.3200000000000001,"15min":1.3859999999999999},"min":{"1min":1.0469999999999999,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7130000000000001,"5min":2.0489999999999999,"15min":2.1629999999999998},"last":5.375}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":632599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.81699999999999995,"15min":0.92800000000000005},"min":{"1min":0.65500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.931},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.90000000000000002,"15min":0.99399999999999999},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.9810000000000001},"last":0.90800000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79700000000000004,"15min":0.95399999999999996},"min":{"1min":0.60199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.131,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.94199999999999995,"15min":1.0960000000000001},"min":{"1min":0.59699999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.508,"5min":1.508,"15min":3.4199999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.216},"min":{"1min":0.71799999999999997,"5min":0.47299999999999998,"15min":0.46700000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":3.4950000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.94199999999999995,"15min":1.129},"min":{"1min":0.68400000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.325,"5min":1.55,"15min":4.2030000000000003},"last":1.145}]},{"osd":4,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.24,"15min":1.3700000000000001},"min":{"1min":0.94499999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4630000000000001,"5min":1.831,"15min":4.3869999999999996},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1890000000000001,"15min":1.3360000000000001},"min":{"1min":0.89200000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.681,"5min":1.681,"15min":2.6960000000000002},"last":1.1180000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.173,"15min":1.331},"min":{"1min":0.82999999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.252,"15min":1.4510000000000001},"min":{"1min":0.90100000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.782,"5min":1.782,"15min":3.8420000000000001},"last":1.397}]},{"osd":6,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3100000000000001,"15min":1.4950000000000001},"min":{"1min":1.006,"5min":0.93100000000000005,"15min":0.92600000000000005},"max":{"1min":1.617,"5min":2.0529999999999999,"15min":4.5780000000000003},"last":1.254},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.5089999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7969999999999999,"5min":2.0070000000000001,"15min":3.214},"last":1.22}]},{"osd":7,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3300000000000001,"15min":1.5629999999999999},"min":{"1min":0.99299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.875,"5min":1.875,"15min":4.0910000000000002},"last":1.292},{"interface":"front","average":{"1min":1.335,"5min":1.327,"15min":1.496},"min":{"1min":0.88,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.7210000000000001,"5min":1.8360000000000001,"15min":4.6390000000000002},"last":1.202}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1888256,"data_stored":1214853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85699999999999998,"15min":0.97699999999999998},"min":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92600000000000005,"15min":1.1220000000000001},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.73,"15min":2.3599999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.877,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.86499999999999999,"15min":0.95999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.81599999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.90600000000000003,"15min":1.022},"min":{"1min":0.64900000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.077},{"interface":"front","average":{"1min":1.228,"5min":1.1140000000000001,"15min":1.234},"min":{"1min":0.745,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.514,"5min":1.8,"15min":2.5369999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.22,"15min":1.3400000000000001},"min":{"1min":0.79700000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.641,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.361},"min":{"1min":0.71599999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5609999999999999,"5min":1.6160000000000001,"15min":2.7799999999999998},"last":1.2669999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1519999999999999,"15min":1.272},"min":{"1min":0.83099999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5289999999999999,"5min":1.659,"15min":2.0579999999999998},"last":1.147},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2410000000000001,"15min":1.3140000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.6499999999999999,"5min":1.879,"15min":2.0030000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.272,"15min":1.409},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7170000000000001,"5min":1.923,"15min":2.1000000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.238,"15min":1.4059999999999999},"min":{"1min":0.90600000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.55,"5min":1.95,"15min":2.3889999999999998},"last":1.234}]},{"osd":7,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.2889999999999999,"15min":1.5469999999999999},"min":{"1min":0.93000000000000005,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7050000000000001,"5min":1.8600000000000001,"15min":4.9400000000000004},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.272,"15min":1.512},"min":{"1min":0.871,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.722,"5min":1.722,"15min":4.8250000000000002},"last":1.2010000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:01:15.903 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:01:16.014 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:01:16.012+0000 7fccf6eb0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:01:16.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 Processor -- start 2023-12-19T18:01:16.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 -- start start 2023-12-19T18:01:16.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c4c1611c0 0x7f3c4c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c4c0af720 0x7f3c4c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0c3f90 con 0x7f3c4c1615a0 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b00f0 con 0x7f3c4c0af720 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c52da8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c4c070340 con 0x7f3c4c1611c0 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.115+0000 7f3c525a7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c4c0af720 0x7f3c4c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c515a5700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f3c4c1615a0 0x7f3c4c06d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48066/0 (socket says 172.21.15.45:48066) 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c51da6700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3c4c1611c0 0x7f3c4c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c515a5700 1 -- 172.21.15.45:0/2602927751 learned_addr learned my addr 172.21.15.45:0/2602927751 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:16.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c525a7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3c4c0af720 0x7f3c4c0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46646/0 (socket says 172.21.15.45:46646) 2023-12-19T18:01:16.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c51da6700 1 -- 172.21.15.45:0/2602927751 >> v2:172.21.15.45:3300/0 conn(0x7f3c4c0af720 msgr2=0x7f3c4c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:16.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c51da6700 1 --2- 172.21.15.45:0/2602927751 >> v2:172.21.15.45:3300/0 conn(0x7f3c4c0af720 0x7f3c4c0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c51da6700 1 -- 172.21.15.45:0/2602927751 >> v1:172.21.15.73:6789/0 conn(0x7f3c4c1615a0 legacy=0x7f3c4c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c51da6700 1 -- 172.21.15.45:0/2602927751 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0c4270 con 0x7f3c4c1611c0 2023-12-19T18:01:16.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c51da6700 1 --2- 172.21.15.45:0/2602927751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1611c0 0x7f3c4c0c3920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c072080 tx=0x7f3c4800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e924819e12e512f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:16.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c50da4700 1 -- 172.21.15.45:0/2602927751 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4800e070 con 0x7f3c4c1611c0 2023-12-19T18:01:16.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c50da4700 1 -- 172.21.15.45:0/2602927751 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4800bb20 con 0x7f3c4c1611c0 2023-12-19T18:01:16.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c50da4700 1 -- 172.21.15.45:0/2602927751 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48012430 con 0x7f3c4c1611c0 2023-12-19T18:01:16.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 -- 172.21.15.45:0/2602927751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1611c0 msgr2=0x7f3c4c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 --2- 172.21.15.45:0/2602927751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1611c0 0x7f3c4c0c3920 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c072080 tx=0x7f3c4800b330 comp rx=0 tx=0).stop 2023-12-19T18:01:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 -- 172.21.15.45:0/2602927751 shutdown_connections 2023-12-19T18:01:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 --2- 172.21.15.45:0/2602927751 >> v2:172.21.15.45:3300/0 conn(0x7f3c4c0af720 0x7f3c4c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 --2- 172.21.15.45:0/2602927751 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1611c0 0x7f3c4c0c3920 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 -- 172.21.15.45:0/2602927751 >> 172.21.15.45:0/2602927751 conn(0x7f3c4c0cb900 msgr2=0x7f3c4c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 -- 172.21.15.45:0/2602927751 shutdown_connections 2023-12-19T18:01:16.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.119+0000 7f3c52da8700 1 -- 172.21.15.45:0/2602927751 wait complete. 2023-12-19T18:01:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 Processor -- start 2023-12-19T18:01:16.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 -- start start 2023-12-19T18:01:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 0x7f3c4c1fa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1611c0 0x7f3c4c1f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1615a0 0x7f3c4c1530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c15d220 con 0x7f3c4c0af720 2023-12-19T18:01:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c1f7e70 con 0x7f3c4c1615a0 2023-12-19T18:01:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.123+0000 7f3c52da8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c153620 con 0x7f3c4c1611c0 2023-12-19T18:01:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 0x7f3c4c1fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 0x7f3c4c1fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46656/0 (socket says 172.21.15.45:46656) 2023-12-19T18:01:16.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 -- 172.21.15.45:0/1407699089 learned_addr learned my addr 172.21.15.45:0/1407699089 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c515a5700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1611c0 0x7f3c4c1f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c525a7700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1615a0 0x7f3c4c1530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 -- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1611c0 msgr2=0x7f3c4c1f7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1611c0 0x7f3c4c1f7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 -- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1615a0 msgr2=0x7f3c4c1530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1615a0 0x7f3c4c1530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 -- 172.21.15.45:0/1407699089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48009a70 con 0x7f3c4c0af720 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c525a7700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1615a0 0x7f3c4c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c515a5700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1611c0 0x7f3c4c1f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:16.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c51da6700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 0x7f3c4c1fa440 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800b680 tx=0x7f3c48004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48012430 con 0x7f3c4c0af720 2023-12-19T18:01:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c48020070 con 0x7f3c4c0af720 2023-12-19T18:01:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c1fb3a0 con 0x7f3c4c0af720 2023-12-19T18:01:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c480276c0 con 0x7f3c4c0af720 2023-12-19T18:01:16.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.127+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c1fade0 con 0x7f3c4c0af720 2023-12-19T18:01:16.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.131+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c06e760 con 0x7f3c4c0af720 2023-12-19T18:01:16.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.131+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c48027820 con 0x7f3c4c0af720 2023-12-19T18:01:16.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.131+0000 7f3c427fc700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c30065ad0 0x7f3c30067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.131+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3c48022070 con 0x7f3c4c0af720 2023-12-19T18:01:16.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.135+0000 7f3c515a5700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c30065ad0 0x7f3c30067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.135+0000 7f3c515a5700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c30065ad0 0x7f3c30067f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c15cb70 tx=0x7f3c3c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:16.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.139+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c48053010 con 0x7f3c4c0af720 2023-12-19T18:01:16.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.311+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3c4c06ee10 con 0x7f3c30065ad0 2023-12-19T18:01:16.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.331+0000 7f3c427fc700 1 -- 172.21.15.45:0/1407699089 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287101 (secure 0 0 0) 0x7f3c3c001c70 con 0x7f3c30065ad0 2023-12-19T18:01:16.339 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:16.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.335+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c30065ad0 msgr2=0x7f3c30067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.335+0000 7f3c52da8700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c30065ad0 0x7f3c30067f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c15cb70 tx=0x7f3c3c009040 comp rx=0 tx=0).stop 2023-12-19T18:01:16.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.335+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 msgr2=0x7f3c4c1fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.335+0000 7f3c52da8700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 0x7f3c4c1fa440 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3c4800b680 tx=0x7f3c48004af0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.335+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 shutdown_connections 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c30065ad0 0x7f3c30067f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c4c1615a0 0x7f3c4c1530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1611c0 0x7f3c4c1f7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 --2- 172.21.15.45:0/1407699089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0af720 0x7f3c4c1fa440 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 >> 172.21.15.45:0/1407699089 conn(0x7f3c4c0cb900 msgr2=0x7f3c4c0ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 shutdown_connections 2023-12-19T18:01:16.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.339+0000 7f3c52da8700 1 -- 172.21.15.45:0/1407699089 wait complete. 2023-12-19T18:01:16.346 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:01:16.371 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":394,"stamp":"2023-12-19T18:01:14.409841+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259792,"kb_used_data":11408,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754714928,"statfs":{"total":773094113280,"available":772828086272,"internally_reserved":0,"allocated":11681792,"data_stored":6223220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.831033"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114911+0000","last_change":"2023-12-19T18:01:11.109190+0000","last_active":"2023-12-19T18:01:11.114911+0000","last_peered":"2023-12-19T18:01:11.114911+0000","last_clean":"2023-12-19T18:01:11.114911+0000","last_became_active":"2023-12-19T18:01:11.108885+0000","last_became_peered":"2023-12-19T18:01:11.108885+0000","last_unstale":"2023-12-19T18:01:11.114911+0000","last_undegraded":"2023-12-19T18:01:11.114911+0000","last_fullsized":"2023-12-19T18:01:11.114911+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:46.066897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.117237+0000","last_change":"2023-12-19T18:01:11.114231+0000","last_active":"2023-12-19T18:01:11.117237+0000","last_peered":"2023-12-19T18:01:11.117237+0000","last_clean":"2023-12-19T18:01:11.117237+0000","last_became_active":"2023-12-19T18:01:11.113877+0000","last_became_peered":"2023-12-19T18:01:11.113877+0000","last_unstale":"2023-12-19T18:01:11.117237+0000","last_undegraded":"2023-12-19T18:01:11.117237+0000","last_fullsized":"2023-12-19T18:01:11.117237+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:35:10.298213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115556+0000","last_change":"2023-12-19T18:01:11.111366+0000","last_active":"2023-12-19T18:01:11.115556+0000","last_peered":"2023-12-19T18:01:11.115556+0000","last_clean":"2023-12-19T18:01:11.115556+0000","last_became_active":"2023-12-19T18:01:11.111078+0000","last_became_peered":"2023-12-19T18:01:11.111078+0000","last_unstale":"2023-12-19T18:01:11.115556+0000","last_undegraded":"2023-12-19T18:01:11.115556+0000","last_fullsized":"2023-12-19T18:01:11.115556+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:44.170571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112785+0000","last_change":"2023-12-19T18:01:11.104789+0000","last_active":"2023-12-19T18:01:11.112785+0000","last_peered":"2023-12-19T18:01:11.112785+0000","last_clean":"2023-12-19T18:01:11.112785+0000","last_became_active":"2023-12-19T18:01:11.103704+0000","last_became_peered":"2023-12-19T18:01:11.103704+0000","last_unstale":"2023-12-19T18:01:11.112785+0000","last_undegraded":"2023-12-19T18:01:11.112785+0000","last_fullsized":"2023-12-19T18:01:11.112785+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:05:53.385657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132235+0000","last_change":"2023-12-19T18:01:11.127248+0000","last_active":"2023-12-19T18:01:11.132235+0000","last_peered":"2023-12-19T18:01:11.132235+0000","last_clean":"2023-12-19T18:01:11.132235+0000","last_became_active":"2023-12-19T18:01:11.126868+0000","last_became_peered":"2023-12-19T18:01:11.126868+0000","last_unstale":"2023-12-19T18:01:11.132235+0000","last_undegraded":"2023-12-19T18:01:11.132235+0000","last_fullsized":"2023-12-19T18:01:11.132235+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:51:55.970478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.121268+0000","last_change":"2023-12-19T18:01:11.112795+0000","last_active":"2023-12-19T18:01:11.121268+0000","last_peered":"2023-12-19T18:01:11.121268+0000","last_clean":"2023-12-19T18:01:11.121268+0000","last_became_active":"2023-12-19T18:01:11.112510+0000","last_became_peered":"2023-12-19T18:01:11.112510+0000","last_unstale":"2023-12-19T18:01:11.121268+0000","last_undegraded":"2023-12-19T18:01:11.121268+0000","last_fullsized":"2023-12-19T18:01:11.121268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:35:04.056910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.121844+0000","last_change":"2023-12-19T18:01:11.112656+0000","last_active":"2023-12-19T18:01:11.121844+0000","last_peered":"2023-12-19T18:01:11.121844+0000","last_clean":"2023-12-19T18:01:11.121844+0000","last_became_active":"2023-12-19T18:01:11.112389+0000","last_became_peered":"2023-12-19T18:01:11.112389+0000","last_unstale":"2023-12-19T18:01:11.121844+0000","last_undegraded":"2023-12-19T18:01:11.121844+0000","last_fullsized":"2023-12-19T18:01:11.121844+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:02.837660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.111316+0000","last_change":"2023-12-19T18:01:11.107524+0000","last_active":"2023-12-19T18:01:11.111316+0000","last_peered":"2023-12-19T18:01:11.111316+0000","last_clean":"2023-12-19T18:01:11.111316+0000","last_became_active":"2023-12-19T18:01:11.107257+0000","last_became_peered":"2023-12-19T18:01:11.107257+0000","last_unstale":"2023-12-19T18:01:11.111316+0000","last_undegraded":"2023-12-19T18:01:11.111316+0000","last_fullsized":"2023-12-19T18:01:11.111316+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:53.082346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122268+0000","last_change":"2023-12-19T18:01:11.117664+0000","last_active":"2023-12-19T18:01:11.122268+0000","last_peered":"2023-12-19T18:01:11.122268+0000","last_clean":"2023-12-19T18:01:11.122268+0000","last_became_active":"2023-12-19T18:01:11.117163+0000","last_became_peered":"2023-12-19T18:01:11.117163+0000","last_unstale":"2023-12-19T18:01:11.122268+0000","last_undegraded":"2023-12-19T18:01:11.122268+0000","last_fullsized":"2023-12-19T18:01:11.122268+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:49:44.170571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132308+0000","last_change":"2023-12-19T18:01:11.127806+0000","last_active":"2023-12-19T18:01:11.132308+0000","last_peered":"2023-12-19T18:01:11.132308+0000","last_clean":"2023-12-19T18:01:11.132308+0000","last_became_active":"2023-12-19T18:01:11.126742+0000","last_became_peered":"2023-12-19T18:01:11.126742+0000","last_unstale":"2023-12-19T18:01:11.132308+0000","last_undegraded":"2023-12-19T18:01:11.132308+0000","last_fullsized":"2023-12-19T18:01:11.132308+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:41:48.105187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123884+0000","last_change":"2023-12-19T18:01:11.115703+0000","last_active":"2023-12-19T18:01:11.123884+0000","last_peered":"2023-12-19T18:01:11.123884+0000","last_clean":"2023-12-19T18:01:11.123884+0000","last_became_active":"2023-12-19T18:01:11.114968+0000","last_became_peered":"2023-12-19T18:01:11.114968+0000","last_unstale":"2023-12-19T18:01:11.123884+0000","last_undegraded":"2023-12-19T18:01:11.123884+0000","last_fullsized":"2023-12-19T18:01:11.123884+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:09.283636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122083+0000","last_change":"2023-12-19T18:01:11.118077+0000","last_active":"2023-12-19T18:01:11.122083+0000","last_peered":"2023-12-19T18:01:11.122083+0000","last_clean":"2023-12-19T18:01:11.122083+0000","last_became_active":"2023-12-19T18:01:11.117471+0000","last_became_peered":"2023-12-19T18:01:11.117471+0000","last_unstale":"2023-12-19T18:01:11.122083+0000","last_undegraded":"2023-12-19T18:01:11.122083+0000","last_fullsized":"2023-12-19T18:01:11.122083+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:51:24.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.116840+0000","last_change":"2023-12-19T18:01:11.114564+0000","last_active":"2023-12-19T18:01:11.116840+0000","last_peered":"2023-12-19T18:01:11.116840+0000","last_clean":"2023-12-19T18:01:11.116840+0000","last_became_active":"2023-12-19T18:01:11.114252+0000","last_became_peered":"2023-12-19T18:01:11.114252+0000","last_unstale":"2023-12-19T18:01:11.116840+0000","last_undegraded":"2023-12-19T18:01:11.116840+0000","last_fullsized":"2023-12-19T18:01:11.116840+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:12.084706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126429+0000","last_change":"2023-12-19T18:01:11.125304+0000","last_active":"2023-12-19T18:01:11.126429+0000","last_peered":"2023-12-19T18:01:11.126429+0000","last_clean":"2023-12-19T18:01:11.126429+0000","last_became_active":"2023-12-19T18:01:11.125009+0000","last_became_peered":"2023-12-19T18:01:11.125009+0000","last_unstale":"2023-12-19T18:01:11.126429+0000","last_undegraded":"2023-12-19T18:01:11.126429+0000","last_fullsized":"2023-12-19T18:01:11.126429+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:04.296617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.097603+0000","last_change":"2023-12-19T18:01:11.092933+0000","last_active":"2023-12-19T18:01:11.097603+0000","last_peered":"2023-12-19T18:01:11.097603+0000","last_clean":"2023-12-19T18:01:11.097603+0000","last_became_active":"2023-12-19T18:01:11.092595+0000","last_became_peered":"2023-12-19T18:01:11.092595+0000","last_unstale":"2023-12-19T18:01:11.097603+0000","last_undegraded":"2023-12-19T18:01:11.097603+0000","last_fullsized":"2023-12-19T18:01:11.097603+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:59.078109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113864+0000","last_change":"2023-12-19T18:01:11.105964+0000","last_active":"2023-12-19T18:01:11.113864+0000","last_peered":"2023-12-19T18:01:11.113864+0000","last_clean":"2023-12-19T18:01:11.113864+0000","last_became_active":"2023-12-19T18:01:11.105683+0000","last_became_peered":"2023-12-19T18:01:11.105683+0000","last_unstale":"2023-12-19T18:01:11.113864+0000","last_undegraded":"2023-12-19T18:01:11.113864+0000","last_fullsized":"2023-12-19T18:01:11.113864+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:04.672534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.120110+0000","last_change":"2023-12-19T18:01:11.117491+0000","last_active":"2023-12-19T18:01:11.120110+0000","last_peered":"2023-12-19T18:01:11.120110+0000","last_clean":"2023-12-19T18:01:11.120110+0000","last_became_active":"2023-12-19T18:01:11.111028+0000","last_became_peered":"2023-12-19T18:01:11.111028+0000","last_unstale":"2023-12-19T18:01:11.120110+0000","last_undegraded":"2023-12-19T18:01:11.120110+0000","last_fullsized":"2023-12-19T18:01:11.120110+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:47:19.670877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112772+0000","last_change":"2023-12-19T18:01:11.106155+0000","last_active":"2023-12-19T18:01:11.112772+0000","last_peered":"2023-12-19T18:01:11.112772+0000","last_clean":"2023-12-19T18:01:11.112772+0000","last_became_active":"2023-12-19T18:01:11.105850+0000","last_became_peered":"2023-12-19T18:01:11.105850+0000","last_unstale":"2023-12-19T18:01:11.112772+0000","last_undegraded":"2023-12-19T18:01:11.112772+0000","last_fullsized":"2023-12-19T18:01:11.112772+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:23.588524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114808+0000","last_change":"2023-12-19T18:01:11.109246+0000","last_active":"2023-12-19T18:01:11.114808+0000","last_peered":"2023-12-19T18:01:11.114808+0000","last_clean":"2023-12-19T18:01:11.114808+0000","last_became_active":"2023-12-19T18:01:11.109010+0000","last_became_peered":"2023-12-19T18:01:11.109010+0000","last_unstale":"2023-12-19T18:01:11.114808+0000","last_undegraded":"2023-12-19T18:01:11.114808+0000","last_fullsized":"2023-12-19T18:01:11.114808+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:14.251055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.119902+0000","last_change":"2023-12-19T18:01:11.114753+0000","last_active":"2023-12-19T18:01:11.119902+0000","last_peered":"2023-12-19T18:01:11.119902+0000","last_clean":"2023-12-19T18:01:11.119902+0000","last_became_active":"2023-12-19T18:01:11.114476+0000","last_became_peered":"2023-12-19T18:01:11.114476+0000","last_unstale":"2023-12-19T18:01:11.119902+0000","last_undegraded":"2023-12-19T18:01:11.119902+0000","last_fullsized":"2023-12-19T18:01:11.119902+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:04.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115871+0000","last_change":"2023-12-19T18:01:11.106135+0000","last_active":"2023-12-19T18:01:11.115871+0000","last_peered":"2023-12-19T18:01:11.115871+0000","last_clean":"2023-12-19T18:01:11.115871+0000","last_became_active":"2023-12-19T18:01:11.105810+0000","last_became_peered":"2023-12-19T18:01:11.105810+0000","last_unstale":"2023-12-19T18:01:11.115871+0000","last_undegraded":"2023-12-19T18:01:11.115871+0000","last_fullsized":"2023-12-19T18:01:11.115871+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:40.367670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.111295+0000","last_change":"2023-12-19T18:01:11.107334+0000","last_active":"2023-12-19T18:01:11.111295+0000","last_peered":"2023-12-19T18:01:11.111295+0000","last_clean":"2023-12-19T18:01:11.111295+0000","last_became_active":"2023-12-19T18:01:11.107065+0000","last_became_peered":"2023-12-19T18:01:11.107065+0000","last_unstale":"2023-12-19T18:01:11.111295+0000","last_undegraded":"2023-12-19T18:01:11.111295+0000","last_fullsized":"2023-12-19T18:01:11.111295+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:58.782064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114116+0000","last_change":"2023-12-19T18:01:11.108136+0000","last_active":"2023-12-19T18:01:11.114116+0000","last_peered":"2023-12-19T18:01:11.114116+0000","last_clean":"2023-12-19T18:01:11.114116+0000","last_became_active":"2023-12-19T18:01:11.107829+0000","last_became_peered":"2023-12-19T18:01:11.107829+0000","last_unstale":"2023-12-19T18:01:11.114116+0000","last_undegraded":"2023-12-19T18:01:11.114116+0000","last_fullsized":"2023-12-19T18:01:11.114116+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:03.900307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.106426+0000","last_change":"2023-12-19T18:01:11.096437+0000","last_active":"2023-12-19T18:01:11.106426+0000","last_peered":"2023-12-19T18:01:11.106426+0000","last_clean":"2023-12-19T18:01:11.106426+0000","last_became_active":"2023-12-19T18:01:11.096154+0000","last_became_peered":"2023-12-19T18:01:11.096154+0000","last_unstale":"2023-12-19T18:01:11.106426+0000","last_undegraded":"2023-12-19T18:01:11.106426+0000","last_fullsized":"2023-12-19T18:01:11.106426+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.377004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130834+0000","last_change":"2023-12-19T18:01:11.124951+0000","last_active":"2023-12-19T18:01:11.130834+0000","last_peered":"2023-12-19T18:01:11.130834+0000","last_clean":"2023-12-19T18:01:11.130834+0000","last_became_active":"2023-12-19T18:01:11.124666+0000","last_became_peered":"2023-12-19T18:01:11.124666+0000","last_unstale":"2023-12-19T18:01:11.130834+0000","last_undegraded":"2023-12-19T18:01:11.130834+0000","last_fullsized":"2023-12-19T18:01:11.130834+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:35:02.837660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.119741+0000","last_change":"2023-12-19T18:01:11.116999+0000","last_active":"2023-12-19T18:01:11.119741+0000","last_peered":"2023-12-19T18:01:11.119741+0000","last_clean":"2023-12-19T18:01:11.119741+0000","last_became_active":"2023-12-19T18:01:11.115883+0000","last_became_peered":"2023-12-19T18:01:11.115883+0000","last_unstale":"2023-12-19T18:01:11.119741+0000","last_undegraded":"2023-12-19T18:01:11.119741+0000","last_fullsized":"2023-12-19T18:01:11.119741+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:59:15.554471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115094+0000","last_change":"2023-12-19T18:01:11.110448+0000","last_active":"2023-12-19T18:01:11.115094+0000","last_peered":"2023-12-19T18:01:11.115094+0000","last_clean":"2023-12-19T18:01:11.115094+0000","last_became_active":"2023-12-19T18:01:11.109734+0000","last_became_peered":"2023-12-19T18:01:11.109734+0000","last_unstale":"2023-12-19T18:01:11.115094+0000","last_undegraded":"2023-12-19T18:01:11.115094+0000","last_fullsized":"2023-12-19T18:01:11.115094+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:44:39.493258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130718+0000","last_change":"2023-12-19T18:01:11.120371+0000","last_active":"2023-12-19T18:01:11.130718+0000","last_peered":"2023-12-19T18:01:11.130718+0000","last_clean":"2023-12-19T18:01:11.130718+0000","last_became_active":"2023-12-19T18:01:11.120055+0000","last_became_peered":"2023-12-19T18:01:11.120055+0000","last_unstale":"2023-12-19T18:01:11.130718+0000","last_undegraded":"2023-12-19T18:01:11.130718+0000","last_fullsized":"2023-12-19T18:01:11.130718+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:50:04.236044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.120162+0000","last_change":"2023-12-19T18:01:11.117401+0000","last_active":"2023-12-19T18:01:11.120162+0000","last_peered":"2023-12-19T18:01:11.120162+0000","last_clean":"2023-12-19T18:01:11.120162+0000","last_became_active":"2023-12-19T18:01:11.115523+0000","last_became_peered":"2023-12-19T18:01:11.115523+0000","last_unstale":"2023-12-19T18:01:11.120162+0000","last_undegraded":"2023-12-19T18:01:11.120162+0000","last_fullsized":"2023-12-19T18:01:11.120162+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:56:06.866017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113338+0000","last_change":"2023-12-19T18:01:11.106875+0000","last_active":"2023-12-19T18:01:11.113338+0000","last_peered":"2023-12-19T18:01:11.113338+0000","last_clean":"2023-12-19T18:01:11.113338+0000","last_became_active":"2023-12-19T18:01:11.104250+0000","last_became_peered":"2023-12-19T18:01:11.104250+0000","last_unstale":"2023-12-19T18:01:11.113338+0000","last_undegraded":"2023-12-19T18:01:11.113338+0000","last_fullsized":"2023-12-19T18:01:11.113338+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:02:26.978959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123569+0000","last_change":"2023-12-19T18:01:11.119599+0000","last_active":"2023-12-19T18:01:11.123569+0000","last_peered":"2023-12-19T18:01:11.123569+0000","last_clean":"2023-12-19T18:01:11.123569+0000","last_became_active":"2023-12-19T18:01:11.119014+0000","last_became_peered":"2023-12-19T18:01:11.119014+0000","last_unstale":"2023-12-19T18:01:11.123569+0000","last_undegraded":"2023-12-19T18:01:11.123569+0000","last_fullsized":"2023-12-19T18:01:11.123569+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:31:02.909254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.107735+0000","last_change":"2023-12-19T18:01:11.100242+0000","last_active":"2023-12-19T18:01:11.107735+0000","last_peered":"2023-12-19T18:01:11.107735+0000","last_clean":"2023-12-19T18:01:11.107735+0000","last_became_active":"2023-12-19T18:01:11.099989+0000","last_became_peered":"2023-12-19T18:01:11.099989+0000","last_unstale":"2023-12-19T18:01:11.107735+0000","last_undegraded":"2023-12-19T18:01:11.107735+0000","last_fullsized":"2023-12-19T18:01:11.107735+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:58:31.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.124370+0000","last_change":"2023-12-19T18:01:11.122714+0000","last_active":"2023-12-19T18:01:11.124370+0000","last_peered":"2023-12-19T18:01:11.124370+0000","last_clean":"2023-12-19T18:01:11.124370+0000","last_became_active":"2023-12-19T18:01:11.122419+0000","last_became_peered":"2023-12-19T18:01:11.122419+0000","last_unstale":"2023-12-19T18:01:11.124370+0000","last_undegraded":"2023-12-19T18:01:11.124370+0000","last_fullsized":"2023-12-19T18:01:11.124370+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:02:41.594124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"106'4","reported_seq":14,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.127451+0000","last_change":"2023-12-19T18:01:10.623787+0000","last_active":"2023-12-19T18:01:11.127451+0000","last_peered":"2023-12-19T18:01:11.127451+0000","last_clean":"2023-12-19T18:01:11.127451+0000","last_became_active":"2023-12-19T18:01:10.623389+0000","last_became_peered":"2023-12-19T18:01:10.623389+0000","last_unstale":"2023-12-19T18:01:11.127451+0000","last_undegraded":"2023-12-19T18:01:11.127451+0000","last_fullsized":"2023-12-19T18:01:11.127451+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:27:53.059902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123566+0000","last_change":"2023-12-19T18:01:11.119435+0000","last_active":"2023-12-19T18:01:11.123566+0000","last_peered":"2023-12-19T18:01:11.123566+0000","last_clean":"2023-12-19T18:01:11.123566+0000","last_became_active":"2023-12-19T18:01:11.119150+0000","last_became_peered":"2023-12-19T18:01:11.119150+0000","last_unstale":"2023-12-19T18:01:11.123566+0000","last_undegraded":"2023-12-19T18:01:11.123566+0000","last_fullsized":"2023-12-19T18:01:11.123566+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:19:36.502533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112955+0000","last_change":"2023-12-19T18:01:10.629685+0000","last_active":"2023-12-19T18:01:11.112955+0000","last_peered":"2023-12-19T18:01:11.112955+0000","last_clean":"2023-12-19T18:01:11.112955+0000","last_became_active":"2023-12-19T18:01:10.629347+0000","last_became_peered":"2023-12-19T18:01:10.629347+0000","last_unstale":"2023-12-19T18:01:11.112955+0000","last_undegraded":"2023-12-19T18:01:11.112955+0000","last_fullsized":"2023-12-19T18:01:11.112955+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:58:30.395868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114861+0000","last_change":"2023-12-19T18:01:11.110078+0000","last_active":"2023-12-19T18:01:11.114861+0000","last_peered":"2023-12-19T18:01:11.114861+0000","last_clean":"2023-12-19T18:01:11.114861+0000","last_became_active":"2023-12-19T18:01:11.109804+0000","last_became_peered":"2023-12-19T18:01:11.109804+0000","last_unstale":"2023-12-19T18:01:11.114861+0000","last_undegraded":"2023-12-19T18:01:11.114861+0000","last_fullsized":"2023-12-19T18:01:11.114861+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:45:22.081110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114552+0000","last_change":"2023-12-19T18:01:10.621870+0000","last_active":"2023-12-19T18:01:11.114552+0000","last_peered":"2023-12-19T18:01:11.114552+0000","last_clean":"2023-12-19T18:01:11.114552+0000","last_became_active":"2023-12-19T18:01:10.618785+0000","last_became_peered":"2023-12-19T18:01:10.618785+0000","last_unstale":"2023-12-19T18:01:11.114552+0000","last_undegraded":"2023-12-19T18:01:11.114552+0000","last_fullsized":"2023-12-19T18:01:11.114552+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:19:12.702236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126566+0000","last_change":"2023-12-19T18:01:11.123716+0000","last_active":"2023-12-19T18:01:11.126566+0000","last_peered":"2023-12-19T18:01:11.126566+0000","last_clean":"2023-12-19T18:01:11.126566+0000","last_became_active":"2023-12-19T18:01:11.123457+0000","last_became_peered":"2023-12-19T18:01:11.123457+0000","last_unstale":"2023-12-19T18:01:11.126566+0000","last_undegraded":"2023-12-19T18:01:11.126566+0000","last_fullsized":"2023-12-19T18:01:11.126566+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:46.066897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.118261+0000","last_change":"2023-12-19T18:01:10.622111+0000","last_active":"2023-12-19T18:01:11.118261+0000","last_peered":"2023-12-19T18:01:11.118261+0000","last_clean":"2023-12-19T18:01:11.118261+0000","last_became_active":"2023-12-19T18:01:10.620722+0000","last_became_peered":"2023-12-19T18:01:10.620722+0000","last_unstale":"2023-12-19T18:01:11.118261+0000","last_undegraded":"2023-12-19T18:01:11.118261+0000","last_fullsized":"2023-12-19T18:01:11.118261+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:12:11.840806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.131910+0000","last_change":"2023-12-19T18:01:11.122088+0000","last_active":"2023-12-19T18:01:11.131910+0000","last_peered":"2023-12-19T18:01:11.131910+0000","last_clean":"2023-12-19T18:01:11.131910+0000","last_became_active":"2023-12-19T18:01:11.121793+0000","last_became_peered":"2023-12-19T18:01:11.121793+0000","last_unstale":"2023-12-19T18:01:11.131910+0000","last_undegraded":"2023-12-19T18:01:11.131910+0000","last_fullsized":"2023-12-19T18:01:11.131910+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.311614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.102330+0000","last_change":"2023-12-19T18:01:10.623052+0000","last_active":"2023-12-19T18:01:11.102330+0000","last_peered":"2023-12-19T18:01:11.102330+0000","last_clean":"2023-12-19T18:01:11.102330+0000","last_became_active":"2023-12-19T18:01:10.622490+0000","last_became_peered":"2023-12-19T18:01:10.622490+0000","last_unstale":"2023-12-19T18:01:11.102330+0000","last_undegraded":"2023-12-19T18:01:11.102330+0000","last_fullsized":"2023-12-19T18:01:11.102330+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:39.361506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132243+0000","last_change":"2023-12-19T18:01:11.128582+0000","last_active":"2023-12-19T18:01:11.132243+0000","last_peered":"2023-12-19T18:01:11.132243+0000","last_clean":"2023-12-19T18:01:11.132243+0000","last_became_active":"2023-12-19T18:01:11.128272+0000","last_became_peered":"2023-12-19T18:01:11.128272+0000","last_unstale":"2023-12-19T18:01:11.132243+0000","last_undegraded":"2023-12-19T18:01:11.132243+0000","last_fullsized":"2023-12-19T18:01:11.132243+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:16:22.093440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.118467+0000","last_change":"2023-12-19T18:01:10.631784+0000","last_active":"2023-12-19T18:01:11.118467+0000","last_peered":"2023-12-19T18:01:11.118467+0000","last_clean":"2023-12-19T18:01:11.118467+0000","last_became_active":"2023-12-19T18:01:10.631402+0000","last_became_peered":"2023-12-19T18:01:10.631402+0000","last_unstale":"2023-12-19T18:01:11.118467+0000","last_undegraded":"2023-12-19T18:01:11.118467+0000","last_fullsized":"2023-12-19T18:01:11.118467+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:37:03.666370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.102354+0000","last_change":"2023-12-19T18:01:11.093772+0000","last_active":"2023-12-19T18:01:11.102354+0000","last_peered":"2023-12-19T18:01:11.102354+0000","last_clean":"2023-12-19T18:01:11.102354+0000","last_became_active":"2023-12-19T18:01:11.093450+0000","last_became_peered":"2023-12-19T18:01:11.093450+0000","last_unstale":"2023-12-19T18:01:11.102354+0000","last_undegraded":"2023-12-19T18:01:11.102354+0000","last_fullsized":"2023-12-19T18:01:11.102354+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:10:21.895699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.108334+0000","last_change":"2023-12-19T18:01:10.636168+0000","last_active":"2023-12-19T18:01:11.108334+0000","last_peered":"2023-12-19T18:01:11.108334+0000","last_clean":"2023-12-19T18:01:11.108334+0000","last_became_active":"2023-12-19T18:01:10.635909+0000","last_became_peered":"2023-12-19T18:01:10.635909+0000","last_unstale":"2023-12-19T18:01:11.108334+0000","last_undegraded":"2023-12-19T18:01:11.108334+0000","last_fullsized":"2023-12-19T18:01:11.108334+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:17.745584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.124420+0000","last_change":"2023-12-19T18:01:11.120249+0000","last_active":"2023-12-19T18:01:11.124420+0000","last_peered":"2023-12-19T18:01:11.124420+0000","last_clean":"2023-12-19T18:01:11.124420+0000","last_became_active":"2023-12-19T18:01:11.119970+0000","last_became_peered":"2023-12-19T18:01:11.119970+0000","last_unstale":"2023-12-19T18:01:11.124420+0000","last_undegraded":"2023-12-19T18:01:11.124420+0000","last_fullsized":"2023-12-19T18:01:11.124420+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.311614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.083311+0000","last_change":"2023-12-19T18:01:10.628264+0000","last_active":"2023-12-19T18:01:11.083311+0000","last_peered":"2023-12-19T18:01:11.083311+0000","last_clean":"2023-12-19T18:01:11.083311+0000","last_became_active":"2023-12-19T18:01:10.627914+0000","last_became_peered":"2023-12-19T18:01:10.627914+0000","last_unstale":"2023-12-19T18:01:11.083311+0000","last_undegraded":"2023-12-19T18:01:11.083311+0000","last_fullsized":"2023-12-19T18:01:11.083311+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:05:54.353577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.117222+0000","last_change":"2023-12-19T18:01:11.114159+0000","last_active":"2023-12-19T18:01:11.117222+0000","last_peered":"2023-12-19T18:01:11.117222+0000","last_clean":"2023-12-19T18:01:11.117222+0000","last_became_active":"2023-12-19T18:01:11.113553+0000","last_became_peered":"2023-12-19T18:01:11.113553+0000","last_unstale":"2023-12-19T18:01:11.117222+0000","last_undegraded":"2023-12-19T18:01:11.117222+0000","last_fullsized":"2023-12-19T18:01:11.117222+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:47:59.078109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.083920+0000","last_change":"2023-12-19T18:01:10.626428+0000","last_active":"2023-12-19T18:01:11.083920+0000","last_peered":"2023-12-19T18:01:11.083920+0000","last_clean":"2023-12-19T18:01:11.083920+0000","last_became_active":"2023-12-19T18:01:10.626136+0000","last_became_peered":"2023-12-19T18:01:10.626136+0000","last_unstale":"2023-12-19T18:01:11.083920+0000","last_undegraded":"2023-12-19T18:01:11.083920+0000","last_fullsized":"2023-12-19T18:01:11.083920+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:02:40.587960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126494+0000","last_change":"2023-12-19T18:01:11.122162+0000","last_active":"2023-12-19T18:01:11.126494+0000","last_peered":"2023-12-19T18:01:11.126494+0000","last_clean":"2023-12-19T18:01:11.126494+0000","last_became_active":"2023-12-19T18:01:11.121871+0000","last_became_peered":"2023-12-19T18:01:11.121871+0000","last_unstale":"2023-12-19T18:01:11.126494+0000","last_undegraded":"2023-12-19T18:01:11.126494+0000","last_fullsized":"2023-12-19T18:01:11.126494+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:51:55.970478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.089422+0000","last_change":"2023-12-19T18:01:10.633490+0000","last_active":"2023-12-19T18:01:11.089422+0000","last_peered":"2023-12-19T18:01:11.089422+0000","last_clean":"2023-12-19T18:01:11.089422+0000","last_became_active":"2023-12-19T18:01:10.632937+0000","last_became_peered":"2023-12-19T18:01:10.632937+0000","last_unstale":"2023-12-19T18:01:11.089422+0000","last_undegraded":"2023-12-19T18:01:11.089422+0000","last_fullsized":"2023-12-19T18:01:11.089422+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:08.277472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130734+0000","last_change":"2023-12-19T18:01:11.123064+0000","last_active":"2023-12-19T18:01:11.130734+0000","last_peered":"2023-12-19T18:01:11.130734+0000","last_clean":"2023-12-19T18:01:11.130734+0000","last_became_active":"2023-12-19T18:01:11.122434+0000","last_became_peered":"2023-12-19T18:01:11.122434+0000","last_unstale":"2023-12-19T18:01:11.130734+0000","last_undegraded":"2023-12-19T18:01:11.130734+0000","last_fullsized":"2023-12-19T18:01:11.130734+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:33:49.688500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"106'3","reported_seq":13,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.114398+0000","last_change":"2023-12-19T18:01:10.620651+0000","last_active":"2023-12-19T18:01:11.114398+0000","last_peered":"2023-12-19T18:01:11.114398+0000","last_clean":"2023-12-19T18:01:11.114398+0000","last_became_active":"2023-12-19T18:01:10.620248+0000","last_became_peered":"2023-12-19T18:01:10.620248+0000","last_unstale":"2023-12-19T18:01:11.114398+0000","last_undegraded":"2023-12-19T18:01:11.114398+0000","last_fullsized":"2023-12-19T18:01:11.114398+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:11.305450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.129245+0000","last_change":"2023-12-19T18:01:11.120011+0000","last_active":"2023-12-19T18:01:11.129245+0000","last_peered":"2023-12-19T18:01:11.129245+0000","last_clean":"2023-12-19T18:01:11.129245+0000","last_became_active":"2023-12-19T18:01:11.119500+0000","last_became_peered":"2023-12-19T18:01:11.119500+0000","last_unstale":"2023-12-19T18:01:11.129245+0000","last_undegraded":"2023-12-19T18:01:11.129245+0000","last_fullsized":"2023-12-19T18:01:11.129245+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:39.393835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"106'6","reported_seq":16,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132544+0000","last_change":"2023-12-19T18:01:10.630202+0000","last_active":"2023-12-19T18:01:11.132544+0000","last_peered":"2023-12-19T18:01:11.132544+0000","last_clean":"2023-12-19T18:01:11.132544+0000","last_became_active":"2023-12-19T18:01:10.629909+0000","last_became_peered":"2023-12-19T18:01:10.629909+0000","last_unstale":"2023-12-19T18:01:11.132544+0000","last_undegraded":"2023-12-19T18:01:11.132544+0000","last_fullsized":"2023-12-19T18:01:11.132544+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:02:40.587960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.105149+0000","last_change":"2023-12-19T18:01:11.100600+0000","last_active":"2023-12-19T18:01:11.105149+0000","last_peered":"2023-12-19T18:01:11.105149+0000","last_clean":"2023-12-19T18:01:11.105149+0000","last_became_active":"2023-12-19T18:01:11.100362+0000","last_became_peered":"2023-12-19T18:01:11.100362+0000","last_unstale":"2023-12-19T18:01:11.105149+0000","last_undegraded":"2023-12-19T18:01:11.105149+0000","last_fullsized":"2023-12-19T18:01:11.105149+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:17:50.934788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.115969+0000","last_change":"2023-12-19T18:01:10.616613+0000","last_active":"2023-12-19T18:01:11.115969+0000","last_peered":"2023-12-19T18:01:11.115969+0000","last_clean":"2023-12-19T18:01:11.115969+0000","last_became_active":"2023-12-19T18:01:10.616024+0000","last_became_peered":"2023-12-19T18:01:10.616024+0000","last_unstale":"2023-12-19T18:01:11.115969+0000","last_undegraded":"2023-12-19T18:01:11.115969+0000","last_fullsized":"2023-12-19T18:01:11.115969+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:56.566301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.107472+0000","last_change":"2023-12-19T18:01:11.103843+0000","last_active":"2023-12-19T18:01:11.107472+0000","last_peered":"2023-12-19T18:01:11.107472+0000","last_clean":"2023-12-19T18:01:11.107472+0000","last_became_active":"2023-12-19T18:01:11.103572+0000","last_became_peered":"2023-12-19T18:01:11.103572+0000","last_unstale":"2023-12-19T18:01:11.107472+0000","last_undegraded":"2023-12-19T18:01:11.107472+0000","last_fullsized":"2023-12-19T18:01:11.107472+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:07:12.311614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.097725+0000","last_change":"2023-12-19T18:01:10.626216+0000","last_active":"2023-12-19T18:01:11.097725+0000","last_peered":"2023-12-19T18:01:11.097725+0000","last_clean":"2023-12-19T18:01:11.097725+0000","last_became_active":"2023-12-19T18:01:10.625949+0000","last_became_peered":"2023-12-19T18:01:10.625949+0000","last_unstale":"2023-12-19T18:01:11.097725+0000","last_undegraded":"2023-12-19T18:01:11.097725+0000","last_fullsized":"2023-12-19T18:01:11.097725+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:51:51.197277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.120582+0000","last_change":"2023-12-19T18:01:11.115801+0000","last_active":"2023-12-19T18:01:11.120582+0000","last_peered":"2023-12-19T18:01:11.120582+0000","last_clean":"2023-12-19T18:01:11.120582+0000","last_became_active":"2023-12-19T18:01:11.115537+0000","last_became_peered":"2023-12-19T18:01:11.115537+0000","last_unstale":"2023-12-19T18:01:11.120582+0000","last_undegraded":"2023-12-19T18:01:11.120582+0000","last_fullsized":"2023-12-19T18:01:11.120582+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:23.187848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113982+0000","last_change":"2023-12-19T18:01:10.620015+0000","last_active":"2023-12-19T18:01:11.113982+0000","last_peered":"2023-12-19T18:01:11.113982+0000","last_clean":"2023-12-19T18:01:11.113982+0000","last_became_active":"2023-12-19T18:01:10.619742+0000","last_became_peered":"2023-12-19T18:01:10.619742+0000","last_unstale":"2023-12-19T18:01:11.113982+0000","last_undegraded":"2023-12-19T18:01:11.113982+0000","last_fullsized":"2023-12-19T18:01:11.113982+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:39:39.361506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122676+0000","last_change":"2023-12-19T18:01:11.111619+0000","last_active":"2023-12-19T18:01:11.122676+0000","last_peered":"2023-12-19T18:01:11.122676+0000","last_clean":"2023-12-19T18:01:11.122676+0000","last_became_active":"2023-12-19T18:01:11.110589+0000","last_became_peered":"2023-12-19T18:01:11.110589+0000","last_unstale":"2023-12-19T18:01:11.122676+0000","last_undegraded":"2023-12-19T18:01:11.122676+0000","last_fullsized":"2023-12-19T18:01:11.122676+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:59:14.041471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"106'8","reported_seq":18,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.118388+0000","last_change":"2023-12-19T18:01:10.620118+0000","last_active":"2023-12-19T18:01:11.118388+0000","last_peered":"2023-12-19T18:01:11.118388+0000","last_clean":"2023-12-19T18:01:11.118388+0000","last_became_active":"2023-12-19T18:01:10.619763+0000","last_became_peered":"2023-12-19T18:01:10.619763+0000","last_unstale":"2023-12-19T18:01:11.118388+0000","last_undegraded":"2023-12-19T18:01:11.118388+0000","last_fullsized":"2023-12-19T18:01:11.118388+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:03.290453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130580+0000","last_change":"2023-12-19T18:01:11.120167+0000","last_active":"2023-12-19T18:01:11.130580+0000","last_peered":"2023-12-19T18:01:11.130580+0000","last_clean":"2023-12-19T18:01:11.130580+0000","last_became_active":"2023-12-19T18:01:11.119828+0000","last_became_peered":"2023-12-19T18:01:11.119828+0000","last_unstale":"2023-12-19T18:01:11.130580+0000","last_undegraded":"2023-12-19T18:01:11.130580+0000","last_fullsized":"2023-12-19T18:01:11.130580+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:00:31.170039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.129306+0000","last_change":"2023-12-19T18:01:10.621231+0000","last_active":"2023-12-19T18:01:11.129306+0000","last_peered":"2023-12-19T18:01:11.129306+0000","last_clean":"2023-12-19T18:01:11.129306+0000","last_became_active":"2023-12-19T18:01:10.619942+0000","last_became_peered":"2023-12-19T18:01:10.619942+0000","last_unstale":"2023-12-19T18:01:11.129306+0000","last_undegraded":"2023-12-19T18:01:11.129306+0000","last_fullsized":"2023-12-19T18:01:11.129306+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:04:03.290453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132058+0000","last_change":"2023-12-19T18:01:11.127482+0000","last_active":"2023-12-19T18:01:11.132058+0000","last_peered":"2023-12-19T18:01:11.132058+0000","last_clean":"2023-12-19T18:01:11.132058+0000","last_became_active":"2023-12-19T18:01:11.127083+0000","last_became_peered":"2023-12-19T18:01:11.127083+0000","last_unstale":"2023-12-19T18:01:11.132058+0000","last_undegraded":"2023-12-19T18:01:11.132058+0000","last_fullsized":"2023-12-19T18:01:11.132058+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:58:31.402032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.127355+0000","last_change":"2023-12-19T18:01:10.617221+0000","last_active":"2023-12-19T18:01:11.127355+0000","last_peered":"2023-12-19T18:01:11.127355+0000","last_clean":"2023-12-19T18:01:11.127355+0000","last_became_active":"2023-12-19T18:01:10.616730+0000","last_became_peered":"2023-12-19T18:01:10.616730+0000","last_unstale":"2023-12-19T18:01:11.127355+0000","last_undegraded":"2023-12-19T18:01:11.127355+0000","last_fullsized":"2023-12-19T18:01:11.127355+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:22.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123816+0000","last_change":"2023-12-19T18:01:11.114972+0000","last_active":"2023-12-19T18:01:11.123816+0000","last_peered":"2023-12-19T18:01:11.123816+0000","last_clean":"2023-12-19T18:01:11.123816+0000","last_became_active":"2023-12-19T18:01:11.114607+0000","last_became_peered":"2023-12-19T18:01:11.114607+0000","last_unstale":"2023-12-19T18:01:11.123816+0000","last_undegraded":"2023-12-19T18:01:11.123816+0000","last_fullsized":"2023-12-19T18:01:11.123816+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:10.953209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.098680+0000","last_change":"2023-12-19T18:01:10.622079+0000","last_active":"2023-12-19T18:01:11.098680+0000","last_peered":"2023-12-19T18:01:11.098680+0000","last_clean":"2023-12-19T18:01:11.098680+0000","last_became_active":"2023-12-19T18:01:10.620706+0000","last_became_peered":"2023-12-19T18:01:10.620706+0000","last_unstale":"2023-12-19T18:01:11.098680+0000","last_undegraded":"2023-12-19T18:01:11.098680+0000","last_fullsized":"2023-12-19T18:01:11.098680+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:30:57.361799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.113356+0000","last_change":"2023-12-19T18:01:11.106966+0000","last_active":"2023-12-19T18:01:11.113356+0000","last_peered":"2023-12-19T18:01:11.113356+0000","last_clean":"2023-12-19T18:01:11.113356+0000","last_became_active":"2023-12-19T18:01:11.106725+0000","last_became_peered":"2023-12-19T18:01:11.106725+0000","last_unstale":"2023-12-19T18:01:11.113356+0000","last_undegraded":"2023-12-19T18:01:11.113356+0000","last_fullsized":"2023-12-19T18:01:11.113356+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:49:25.917729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126448+0000","last_change":"2023-12-19T18:01:10.618714+0000","last_active":"2023-12-19T18:01:11.126448+0000","last_peered":"2023-12-19T18:01:11.126448+0000","last_clean":"2023-12-19T18:01:11.126448+0000","last_became_active":"2023-12-19T18:01:10.618411+0000","last_became_peered":"2023-12-19T18:01:10.618411+0000","last_unstale":"2023-12-19T18:01:11.126448+0000","last_undegraded":"2023-12-19T18:01:11.126448+0000","last_fullsized":"2023-12-19T18:01:11.126448+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:40:05.670478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126044+0000","last_change":"2023-12-19T18:01:11.116618+0000","last_active":"2023-12-19T18:01:11.126044+0000","last_peered":"2023-12-19T18:01:11.126044+0000","last_clean":"2023-12-19T18:01:11.126044+0000","last_became_active":"2023-12-19T18:01:11.116235+0000","last_became_peered":"2023-12-19T18:01:11.116235+0000","last_unstale":"2023-12-19T18:01:11.126044+0000","last_undegraded":"2023-12-19T18:01:11.126044+0000","last_fullsized":"2023-12-19T18:01:11.126044+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:05:55.359741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.100462+0000","last_change":"2023-12-19T18:01:10.631503+0000","last_active":"2023-12-19T18:01:11.100462+0000","last_peered":"2023-12-19T18:01:11.100462+0000","last_clean":"2023-12-19T18:01:11.100462+0000","last_became_active":"2023-12-19T18:01:10.631181+0000","last_became_peered":"2023-12-19T18:01:10.631181+0000","last_unstale":"2023-12-19T18:01:11.100462+0000","last_undegraded":"2023-12-19T18:01:11.100462+0000","last_fullsized":"2023-12-19T18:01:11.100462+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:49:24.911565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.104786+0000","last_change":"2023-12-19T18:01:11.100019+0000","last_active":"2023-12-19T18:01:11.104786+0000","last_peered":"2023-12-19T18:01:11.104786+0000","last_clean":"2023-12-19T18:01:11.104786+0000","last_became_active":"2023-12-19T18:01:11.099773+0000","last_became_peered":"2023-12-19T18:01:11.099773+0000","last_unstale":"2023-12-19T18:01:11.104786+0000","last_undegraded":"2023-12-19T18:01:11.104786+0000","last_fullsized":"2023-12-19T18:01:11.104786+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:29.551439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.101315+0000","last_change":"2023-12-19T18:01:10.629144+0000","last_active":"2023-12-19T18:01:11.101315+0000","last_peered":"2023-12-19T18:01:11.101315+0000","last_clean":"2023-12-19T18:01:11.101315+0000","last_became_active":"2023-12-19T18:01:10.628807+0000","last_became_peered":"2023-12-19T18:01:10.628807+0000","last_unstale":"2023-12-19T18:01:11.101315+0000","last_undegraded":"2023-12-19T18:01:11.101315+0000","last_fullsized":"2023-12-19T18:01:11.101315+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:17.745584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130705+0000","last_change":"2023-12-19T18:01:11.119276+0000","last_active":"2023-12-19T18:01:11.130705+0000","last_peered":"2023-12-19T18:01:11.130705+0000","last_clean":"2023-12-19T18:01:11.130705+0000","last_became_active":"2023-12-19T18:01:11.118945+0000","last_became_peered":"2023-12-19T18:01:11.118945+0000","last_unstale":"2023-12-19T18:01:11.130705+0000","last_undegraded":"2023-12-19T18:01:11.130705+0000","last_fullsized":"2023-12-19T18:01:11.130705+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:19:15.351193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.096599+0000","last_change":"2023-12-19T18:01:10.630643+0000","last_active":"2023-12-19T18:01:11.096599+0000","last_peered":"2023-12-19T18:01:11.096599+0000","last_clean":"2023-12-19T18:01:11.096599+0000","last_became_active":"2023-12-19T18:01:10.630033+0000","last_became_peered":"2023-12-19T18:01:10.630033+0000","last_unstale":"2023-12-19T18:01:11.096599+0000","last_undegraded":"2023-12-19T18:01:11.096599+0000","last_fullsized":"2023-12-19T18:01:11.096599+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:38.387672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.117204+0000","last_change":"2023-12-19T18:01:11.112590+0000","last_active":"2023-12-19T18:01:11.117204+0000","last_peered":"2023-12-19T18:01:11.117204+0000","last_clean":"2023-12-19T18:01:11.117204+0000","last_became_active":"2023-12-19T18:01:11.112301+0000","last_became_peered":"2023-12-19T18:01:11.112301+0000","last_unstale":"2023-12-19T18:01:11.117204+0000","last_undegraded":"2023-12-19T18:01:11.117204+0000","last_fullsized":"2023-12-19T18:01:11.117204+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:13:46.561985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"106'2","reported_seq":12,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.121484+0000","last_change":"2023-12-19T18:01:10.624225+0000","last_active":"2023-12-19T18:01:11.121484+0000","last_peered":"2023-12-19T18:01:11.121484+0000","last_clean":"2023-12-19T18:01:11.121484+0000","last_became_active":"2023-12-19T18:01:10.623813+0000","last_became_peered":"2023-12-19T18:01:10.623813+0000","last_unstale":"2023-12-19T18:01:11.121484+0000","last_undegraded":"2023-12-19T18:01:11.121484+0000","last_fullsized":"2023-12-19T18:01:11.121484+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:22.181684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.112398+0000","last_change":"2023-12-19T18:01:11.108223+0000","last_active":"2023-12-19T18:01:11.112398+0000","last_peered":"2023-12-19T18:01:11.112398+0000","last_clean":"2023-12-19T18:01:11.112398+0000","last_became_active":"2023-12-19T18:01:11.107950+0000","last_became_peered":"2023-12-19T18:01:11.107950+0000","last_unstale":"2023-12-19T18:01:11.112398+0000","last_undegraded":"2023-12-19T18:01:11.112398+0000","last_fullsized":"2023-12-19T18:01:11.112398+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:49:13.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.098656+0000","last_change":"2023-12-19T18:01:10.620428+0000","last_active":"2023-12-19T18:01:11.098656+0000","last_peered":"2023-12-19T18:01:11.098656+0000","last_clean":"2023-12-19T18:01:11.098656+0000","last_became_active":"2023-12-19T18:01:10.620160+0000","last_became_peered":"2023-12-19T18:01:10.620160+0000","last_unstale":"2023-12-19T18:01:11.098656+0000","last_undegraded":"2023-12-19T18:01:11.098656+0000","last_fullsized":"2023-12-19T18:01:11.098656+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:23:08.277472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.126702+0000","last_change":"2023-12-19T18:01:11.125637+0000","last_active":"2023-12-19T18:01:11.126702+0000","last_peered":"2023-12-19T18:01:11.126702+0000","last_clean":"2023-12-19T18:01:11.126702+0000","last_became_active":"2023-12-19T18:01:11.124625+0000","last_became_peered":"2023-12-19T18:01:11.124625+0000","last_unstale":"2023-12-19T18:01:11.126702+0000","last_undegraded":"2023-12-19T18:01:11.126702+0000","last_fullsized":"2023-12-19T18:01:11.126702+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:51:55.970478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.099858+0000","last_change":"2023-12-19T18:01:10.623609+0000","last_active":"2023-12-19T18:01:11.099858+0000","last_peered":"2023-12-19T18:01:11.099858+0000","last_clean":"2023-12-19T18:01:11.099858+0000","last_became_active":"2023-12-19T18:01:10.623343+0000","last_became_peered":"2023-12-19T18:01:10.623343+0000","last_unstale":"2023-12-19T18:01:11.099858+0000","last_undegraded":"2023-12-19T18:01:11.099858+0000","last_fullsized":"2023-12-19T18:01:11.099858+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:07.370840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.132312+0000","last_change":"2023-12-19T18:01:11.127865+0000","last_active":"2023-12-19T18:01:11.132312+0000","last_peered":"2023-12-19T18:01:11.132312+0000","last_clean":"2023-12-19T18:01:11.132312+0000","last_became_active":"2023-12-19T18:01:11.127558+0000","last_became_peered":"2023-12-19T18:01:11.127558+0000","last_unstale":"2023-12-19T18:01:11.132312+0000","last_undegraded":"2023-12-19T18:01:11.132312+0000","last_fullsized":"2023-12-19T18:01:11.132312+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:00:46.066897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.110617+0000","last_change":"2023-12-19T18:01:10.615274+0000","last_active":"2023-12-19T18:01:11.110617+0000","last_peered":"2023-12-19T18:01:11.110617+0000","last_clean":"2023-12-19T18:01:11.110617+0000","last_became_active":"2023-12-19T18:01:10.614802+0000","last_became_peered":"2023-12-19T18:01:10.614802+0000","last_unstale":"2023-12-19T18:01:11.110617+0000","last_undegraded":"2023-12-19T18:01:11.110617+0000","last_fullsized":"2023-12-19T18:01:11.110617+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:05:54.353577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.123637+0000","last_change":"2023-12-19T18:01:11.117580+0000","last_active":"2023-12-19T18:01:11.123637+0000","last_peered":"2023-12-19T18:01:11.123637+0000","last_clean":"2023-12-19T18:01:11.123637+0000","last_became_active":"2023-12-19T18:01:11.117344+0000","last_became_peered":"2023-12-19T18:01:11.117344+0000","last_unstale":"2023-12-19T18:01:11.123637+0000","last_undegraded":"2023-12-19T18:01:11.123637+0000","last_fullsized":"2023-12-19T18:01:11.123637+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:18.751748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.098556+0000","last_change":"2023-12-19T18:01:10.612739+0000","last_active":"2023-12-19T18:01:11.098556+0000","last_peered":"2023-12-19T18:01:11.098556+0000","last_clean":"2023-12-19T18:01:11.098556+0000","last_became_active":"2023-12-19T18:01:10.612202+0000","last_became_peered":"2023-12-19T18:01:10.612202+0000","last_unstale":"2023-12-19T18:01:11.098556+0000","last_undegraded":"2023-12-19T18:01:11.098556+0000","last_fullsized":"2023-12-19T18:01:11.098556+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:34:09.947045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.131145+0000","last_change":"2023-12-19T18:01:11.129458+0000","last_active":"2023-12-19T18:01:11.131145+0000","last_peered":"2023-12-19T18:01:11.131145+0000","last_clean":"2023-12-19T18:01:11.131145+0000","last_became_active":"2023-12-19T18:01:11.129192+0000","last_became_peered":"2023-12-19T18:01:11.129192+0000","last_unstale":"2023-12-19T18:01:11.131145+0000","last_undegraded":"2023-12-19T18:01:11.131145+0000","last_fullsized":"2023-12-19T18:01:11.131145+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:49:13.028161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.107819+0000","last_change":"2023-12-19T18:01:10.631333+0000","last_active":"2023-12-19T18:01:11.107819+0000","last_peered":"2023-12-19T18:01:11.107819+0000","last_clean":"2023-12-19T18:01:11.107819+0000","last_became_active":"2023-12-19T18:01:10.631030+0000","last_became_peered":"2023-12-19T18:01:10.631030+0000","last_unstale":"2023-12-19T18:01:11.107819+0000","last_undegraded":"2023-12-19T18:01:11.107819+0000","last_fullsized":"2023-12-19T18:01:11.107819+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:46:28.545275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122875+0000","last_change":"2023-12-19T18:01:11.111229+0000","last_active":"2023-12-19T18:01:11.122875+0000","last_peered":"2023-12-19T18:01:11.122875+0000","last_clean":"2023-12-19T18:01:11.122875+0000","last_became_active":"2023-12-19T18:01:11.110975+0000","last_became_peered":"2023-12-19T18:01:11.110975+0000","last_unstale":"2023-12-19T18:01:11.122875+0000","last_undegraded":"2023-12-19T18:01:11.122875+0000","last_fullsized":"2023-12-19T18:01:11.122875+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:18:59.437060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.089917+0000","last_change":"2023-12-19T18:01:10.627584+0000","last_active":"2023-12-19T18:01:11.089917+0000","last_peered":"2023-12-19T18:01:11.089917+0000","last_clean":"2023-12-19T18:01:11.089917+0000","last_became_active":"2023-12-19T18:01:10.627284+0000","last_became_peered":"2023-12-19T18:01:10.627284+0000","last_unstale":"2023-12-19T18:01:11.089917+0000","last_undegraded":"2023-12-19T18:01:11.089917+0000","last_fullsized":"2023-12-19T18:01:11.089917+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:45:38.387672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.130726+0000","last_change":"2023-12-19T18:01:11.119745+0000","last_active":"2023-12-19T18:01:11.130726+0000","last_peered":"2023-12-19T18:01:11.130726+0000","last_clean":"2023-12-19T18:01:11.130726+0000","last_became_active":"2023-12-19T18:01:11.119431+0000","last_became_peered":"2023-12-19T18:01:11.119431+0000","last_unstale":"2023-12-19T18:01:11.130726+0000","last_undegraded":"2023-12-19T18:01:11.130726+0000","last_fullsized":"2023-12-19T18:01:11.130726+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:51:24.057652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.097559+0000","last_change":"2023-12-19T18:01:10.624018+0000","last_active":"2023-12-19T18:01:11.097559+0000","last_peered":"2023-12-19T18:01:11.097559+0000","last_clean":"2023-12-19T18:01:11.097559+0000","last_became_active":"2023-12-19T18:01:10.623723+0000","last_became_peered":"2023-12-19T18:01:10.623723+0000","last_unstale":"2023-12-19T18:01:11.097559+0000","last_undegraded":"2023-12-19T18:01:11.097559+0000","last_fullsized":"2023-12-19T18:01:11.097559+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:39:19.340604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.122813+0000","last_change":"2023-12-19T18:01:11.112780+0000","last_active":"2023-12-19T18:01:11.122813+0000","last_peered":"2023-12-19T18:01:11.122813+0000","last_clean":"2023-12-19T18:01:11.122813+0000","last_became_active":"2023-12-19T18:01:11.108431+0000","last_became_peered":"2023-12-19T18:01:11.108431+0000","last_unstale":"2023-12-19T18:01:11.122813+0000","last_undegraded":"2023-12-19T18:01:11.122813+0000","last_fullsized":"2023-12-19T18:01:11.122813+0000","mapping_epoch":105,"log_start":"0'0","ondisk_log_start":"0'0","created":105,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:10.577292+0000","last_clean_scrub_stamp":"2023-12-19T18:01:10.577292+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:13:23.187848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"106'1","reported_seq":11,"reported_epoch":106,"state":"active+clean","last_fresh":"2023-12-19T18:01:11.109489+0000","last_change":"2023-12-19T18:01:10.628814+0000","last_active":"2023-12-19T18:01:11.109489+0000","last_peered":"2023-12-19T18:01:11.109489+0000","last_clean":"2023-12-19T18:01:11.109489+0000","last_became_active":"2023-12-19T18:01:10.628533+0000","last_became_peered":"2023-12-19T18:01:10.628533+0000","last_unstale":"2023-12-19T18:01:11.109489+0000","last_undegraded":"2023-12-19T18:01:11.109489+0000","last_fullsized":"2023-12-19T18:01:11.109489+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":104,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:01:09.571128+0000","last_clean_scrub_stamp":"2023-12-19T18:01:09.571128+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:21:56.169254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":254,"reported_epoch":105,"state":"active+clean","last_fresh":"2023-12-19T18:01:10.607888+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:01:10.607888+0000","last_peered":"2023-12-19T18:01:10.607888+0000","last_clean":"2023-12-19T18:01:10.607888+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:01:10.607888+0000","last_undegraded":"2023-12-19T18:01:10.607888+0000","last_fullsized":"2023-12-19T18:01:10.607888+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32896,"kb_used_data":1848,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338944,"statfs":{"total":96636764160,"available":96603078656,"internally_reserved":0,"allocated":1892352,"data_stored":1215872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.204,"15min":1.0980000000000001},"min":{"1min":0.70299999999999996,"5min":0.56100000000000005,"15min":0.55000000000000004},"max":{"1min":8.3209999999999997,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.7609999999999999,"5min":1.28,"15min":1.1719999999999999},"min":{"1min":0.75800000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.249000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6000000000000001,"5min":1.137,"15min":1.1000000000000001},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":12.625,"5min":12.625,"15min":12.625},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.661,"5min":1.1890000000000001,"15min":1.1499999999999999},"min":{"1min":0.70699999999999996,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":13.337999999999999,"5min":13.337999999999999,"15min":13.337999999999999},"last":1.0609999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.1479999999999999,"15min":1.091},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":13.041,"5min":13.041,"15min":13.041},"last":1.3140000000000001},{"interface":"front","average":{"1min":3.4180000000000001,"5min":1.5780000000000001,"15min":1.2849999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":48.889000000000003,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.274}]},{"osd":3,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.712,"5min":1.2669999999999999,"15min":1.173},"min":{"1min":0.82399999999999995,"5min":0.622,"15min":0.51600000000000001},"max":{"1min":12.917,"5min":12.917,"15min":12.917},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.4119999999999999,"5min":1.675,"15min":1.365},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.64200000000000002},"max":{"1min":46.375,"5min":46.375,"15min":46.375},"last":1.0880000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.6890000000000001,"5min":1.246,"15min":1.2250000000000001},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":13.137,"5min":13.137,"15min":13.137},"last":1.1479999999999999},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.369,"15min":1.3129999999999999},"min":{"1min":1.0229999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":13.109,"5min":13.109,"15min":13.109},"last":1.2270000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5489999999999999,"5min":1.2909999999999999,"15min":1.2490000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"max":{"1min":8.2690000000000001,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.778,"5min":1.329,"15min":1.298},"min":{"1min":0.85699999999999998,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":13.198,"5min":13.198,"15min":13.198},"last":1.212}]},{"osd":6,"last update":"Tue Dec 19 18:00:48 2023","interfaces":[{"interface":"back","average":{"1min":1.9379999999999999,"5min":1.486,"15min":1.4199999999999999},"min":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":13.442,"5min":13.442,"15min":13.442},"last":1.262},{"interface":"front","average":{"1min":1.8999999999999999,"5min":1.413,"15min":1.3680000000000001},"min":{"1min":0.98099999999999998,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.981,"5min":13.981,"15min":13.981},"last":1.375}]}]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1318912,"data_stored":633251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.093,"5min":1.0089999999999999,"15min":1.131},"min":{"1min":0.65100000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.399,"5min":1.5149999999999999,"15min":4.5979999999999999},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.999,"5min":1.018,"15min":1.0780000000000001},"min":{"1min":0.746,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.3939999999999999,"5min":1.5580000000000001,"15min":1.6819999999999999},"last":1}]},{"osd":1,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.083,"15min":1.0880000000000001},"min":{"1min":0.71799999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.5469999999999999,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.377},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.0860000000000001,"15min":1.1220000000000001},"min":{"1min":0.86899999999999999,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.4370000000000001,"5min":1.583,"15min":1.621},"last":1.47}]},{"osd":2,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.127,"15min":1.339},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.66800000000000004},"max":{"1min":1.3779999999999999,"5min":1.5129999999999999,"15min":8.5470000000000006},"last":1.103},{"interface":"front","average":{"1min":1.272,"5min":1.153,"15min":1.2390000000000001},"min":{"1min":1.042,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.6220000000000001,"5min":1.778,"15min":4.6340000000000003},"last":1.3180000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.1850000000000001,"15min":1.276},"min":{"1min":0.82899999999999996,"5min":0.76400000000000001,"15min":0.72099999999999997},"max":{"1min":1.554,"5min":1.6180000000000001,"15min":4.5380000000000003},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.3180000000000001},"min":{"1min":0.82599999999999996,"5min":0.72399999999999998,"15min":0.65300000000000002},"max":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":4.508},"last":1.1839999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1619999999999999,"15min":1.1439999999999999},"min":{"1min":0.75900000000000001,"5min":0.73199999999999998,"15min":0.438},"max":{"1min":1.577,"5min":1.643,"15min":1.8360000000000001},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.2350000000000001,"5min":1.2450000000000001,"15min":1.2509999999999999},"min":{"1min":0.84799999999999998,"5min":0.77600000000000002,"15min":0.70299999999999996},"max":{"1min":1.583,"5min":1.6779999999999999,"15min":1.899},"last":1.532}]},{"osd":5,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.2989999999999999,"5min":1.262,"15min":1.264},"min":{"1min":0.90500000000000003,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.6120000000000001,"5min":1.643,"15min":2.1400000000000001},"last":0.86499999999999999},{"interface":"front","average":{"1min":1.329,"5min":1.2749999999999999,"15min":1.2709999999999999},"min":{"1min":0.77200000000000002,"5min":0.73699999999999999,"15min":0.57299999999999995},"max":{"1min":1.8320000000000001,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.1439999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:00:41 2023","interfaces":[{"interface":"back","average":{"1min":1.397,"5min":1.3560000000000001,"15min":1.355},"min":{"1min":0.92700000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.8680000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.429,"5min":1.395,"15min":1.403},"min":{"1min":1.1279999999999999,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.728,"5min":1.8460000000000001,"15min":2.2440000000000002},"last":1.5669999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1284,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1314816,"data_stored":632669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0049999999999999,"15min":0.999},"min":{"1min":0.86699999999999999,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.53,"5min":1.5469999999999999,"15min":1.613},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.089,"5min":0.996,"15min":1.0549999999999999},"min":{"1min":0.82799999999999996,"5min":0.629,"15min":0.60599999999999998},"max":{"1min":1.54,"5min":1.54,"15min":2.9369999999999998},"last":1.3109999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.111,"15min":1.099},"min":{"1min":0.77100000000000002,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.4319999999999999,"5min":1.47,"15min":1.778},"last":1.085},{"interface":"front","average":{"1min":1.167,"5min":1.1319999999999999,"15min":1.1839999999999999},"min":{"1min":0.752,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":2.0329999999999999},"last":1.1060000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.073,"15min":1.1559999999999999},"min":{"1min":0.70699999999999996,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.522,"5min":1.891,"15min":2.9929999999999999},"last":1.256},{"interface":"front","average":{"1min":1.196,"5min":1.077,"15min":1.1479999999999999},"min":{"1min":0.88100000000000001,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.671},"last":0.88700000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.141,"15min":1.25},"min":{"1min":0.83399999999999996,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.605,"5min":1.605,"15min":2.2410000000000001},"last":1.022},{"interface":"front","average":{"1min":1.3320000000000001,"5min":1.2050000000000001,"15min":1.329},"min":{"1min":0.76600000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.7070000000000001,"5min":1.796,"15min":3.0350000000000001},"last":1.3560000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.198,"5min":1.1779999999999999,"15min":1.26},"min":{"1min":0.78400000000000003,"5min":0.76900000000000002,"15min":0.67100000000000004},"max":{"1min":1.464,"5min":1.589,"15min":2.0819999999999999},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.278,"15min":1.3620000000000001},"min":{"1min":0.85899999999999999,"5min":0.745,"15min":0.745},"max":{"1min":1.623,"5min":1.7070000000000001,"15min":3.2589999999999999},"last":1.196}]},{"osd":6,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.208,"15min":1.345},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.655,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.1539999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.2310000000000001,"15min":1.3180000000000001},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.4910000000000001,"5min":1.5620000000000001,"15min":2.3239999999999998},"last":0.97999999999999998}]},{"osd":7,"last update":"Tue Dec 19 18:00:46 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3200000000000001,"15min":1.446},"min":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.722,"5min":1.992,"15min":3.1099999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.341,"5min":1.333,"15min":1.5229999999999999},"min":{"1min":1.0229999999999999,"5min":0.84799999999999998,"15min":0.82499999999999996},"max":{"1min":1.6699999999999999,"5min":1.9750000000000001,"15min":3.5680000000000001},"last":1.413}]}]},{"osd":4,"up_from":13,"seq":55834574968,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32348,"kb_used_data":1300,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339492,"statfs":{"total":96636764160,"available":96603639808,"internally_reserved":0,"allocated":1331200,"data_stored":634287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.085,"15min":1.206},"min":{"1min":0.68300000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.5189999999999999,"5min":1.8420000000000001,"15min":5.4420000000000002},"last":0.871},{"interface":"front","average":{"1min":1.262,"5min":1.167,"15min":1.276},"min":{"1min":0.98099999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.657,"5min":1.657,"15min":5.5049999999999999},"last":1.294}]},{"osd":1,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.115,"15min":1.2130000000000001},"min":{"1min":0.66600000000000004,"5min":0.443,"15min":0.443},"max":{"1min":1.512,"5min":1.7,"15min":4.6379999999999999},"last":1.216},{"interface":"front","average":{"1min":1.1020000000000001,"5min":1.0720000000000001,"15min":1.1850000000000001},"min":{"1min":0.81299999999999994,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5089999999999999,"5min":1.6659999999999999,"15min":3.254},"last":1.401}]},{"osd":2,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.0780000000000001,"5min":1.0840000000000001,"15min":1.2430000000000001},"min":{"1min":0.78100000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.4359999999999999,"5min":1.647,"15min":4.593},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.127,"15min":1.2250000000000001},"min":{"1min":0.92500000000000004,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5,"5min":1.54,"15min":2.3799999999999999},"last":1.4730000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.194,"5min":1.0980000000000001,"15min":1.2410000000000001},"min":{"1min":0.82299999999999995,"5min":0.73899999999999999,"15min":0.49199999999999999},"max":{"1min":1.4530000000000001,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.163},{"interface":"front","average":{"1min":1.1990000000000001,"5min":1.181,"15min":1.3540000000000001},"min":{"1min":0.85299999999999998,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.484,"5min":1.7250000000000001,"15min":5.633},"last":1.1359999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.1799999999999999,"15min":1.21},"min":{"1min":0.77800000000000002,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.462,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.177,"5min":1.1799999999999999,"15min":1.1659999999999999},"min":{"1min":0.85799999999999998,"5min":0.71199999999999997,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.244}]},{"osd":6,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2290000000000001,"15min":1.254},"min":{"1min":0.92100000000000004,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.55,"5min":1.899,"15min":2.915},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.401,"15min":1.4119999999999999},"min":{"1min":0.96599999999999997,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.671,"5min":1.883,"15min":2.5299999999999998},"last":1.369}]},{"osd":7,"last update":"Tue Dec 19 18:00:43 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.2929999999999999,"15min":1.3140000000000001},"min":{"1min":0.72799999999999998,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.6220000000000001,"5min":1.875,"15min":2.4340000000000002},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.339,"15min":1.369},"min":{"1min":0.88500000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.6200000000000001,"5min":1.837,"15min":5.6859999999999999},"last":0.96799999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32344,"kb_used_data":1296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339496,"statfs":{"total":96636764160,"available":96603643904,"internally_reserved":0,"allocated":1327104,"data_stored":634185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.82799999999999996,"15min":0.89100000000000001},"min":{"1min":0.5,"5min":0.495,"15min":0.37},"max":{"1min":1.409,"5min":1.6599999999999999,"15min":1.825},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.85399999999999998,"15min":0.94299999999999995},"min":{"1min":0.56299999999999994,"5min":0.435,"15min":0.435},"max":{"1min":1.4299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":1.6100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.873,"15min":0.91200000000000003},"min":{"1min":0.67000000000000004,"5min":0.442,"15min":0.442},"max":{"1min":1.3899999999999999,"5min":1.46,"15min":1.54},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.012,"15min":1.0389999999999999},"min":{"1min":0.60499999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.3260000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":1.5629999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.05,"15min":1.1000000000000001},"min":{"1min":0.79500000000000004,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.474,"5min":1.679,"15min":2.177},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.145,"15min":1.218},"min":{"1min":0.91600000000000004,"5min":0.64900000000000002,"15min":0.58899999999999997},"max":{"1min":1.641,"5min":1.641,"15min":1.8520000000000001},"last":1.405}]},{"osd":4,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.1679999999999999,"5min":1.123,"15min":1.2210000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.65400000000000003},"max":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":2.234},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.3009999999999999,"5min":1.2609999999999999,"15min":1.306},"min":{"1min":0.874,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.7350000000000001,"5min":1.8089999999999999,"15min":2.4350000000000001},"last":1.6499999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.325,"5min":1.3100000000000001,"15min":1.385},"min":{"1min":1.0129999999999999,"5min":0.88100000000000001,"15min":0.80200000000000005},"max":{"1min":1.6830000000000001,"5min":2.052,"15min":2.5419999999999998},"last":2.0699999999999998},{"interface":"front","average":{"1min":1.298,"5min":1.244,"15min":1.3380000000000001},"min":{"1min":0.96699999999999997,"5min":0.80500000000000005,"15min":0.74299999999999999},"max":{"1min":1.776,"5min":1.776,"15min":2.754},"last":1.468}]},{"osd":6,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.333,"15min":1.3959999999999999},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.78000000000000003},"max":{"1min":1.946,"5min":1.946,"15min":2.6880000000000002},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.389,"5min":1.379,"15min":1.4550000000000001},"min":{"1min":1.0629999999999999,"5min":0.995,"15min":0.94699999999999995},"max":{"1min":1.7390000000000001,"5min":2.274,"15min":2.6429999999999998},"last":1.6699999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:00:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3759999999999999,"5min":1.288,"15min":1.4179999999999999},"min":{"1min":0.872,"5min":0.77700000000000002,"15min":0.77700000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4159999999999999,"15min":1.4790000000000001},"min":{"1min":1.0549999999999999,"5min":0.96299999999999997,"15min":0.83099999999999996},"max":{"1min":1.548,"5min":2.323,"15min":2.8170000000000002},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574968,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32316,"kb_used_data":1268,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339524,"statfs":{"total":96636764160,"available":96603672576,"internally_reserved":0,"allocated":1298432,"data_stored":625504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.86899999999999999,"15min":1.1970000000000001},"min":{"1min":0.64100000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":1.3500000000000001,"5min":1.8069999999999999,"15min":13.32},"last":3.9209999999999998},{"interface":"front","average":{"1min":1.018,"5min":0.90100000000000002,"15min":1.3109999999999999},"min":{"1min":0.78400000000000003,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.417,"5min":1.5449999999999999,"15min":13.206},"last":3.8149999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.89500000000000002,"15min":0.90500000000000003},"min":{"1min":0.55500000000000005,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2909999999999999,"5min":1.6259999999999999,"15min":1.841},"last":2.8090000000000002},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.93500000000000005,"15min":0.98599999999999999},"min":{"1min":0.72999999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.948},"last":3.6579999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.879,"15min":0.94599999999999995},"min":{"1min":0.68999999999999995,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.6699999999999999,"5min":1.708,"15min":1.79},"last":3.2389999999999999},{"interface":"front","average":{"1min":1.1839999999999999,"5min":1.0980000000000001,"15min":1.1930000000000001},"min":{"1min":0.63900000000000001,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.76,"5min":1.7709999999999999,"15min":1.9350000000000001},"last":2.75}]},{"osd":4,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.252,"5min":1.2250000000000001,"15min":1.24},"min":{"1min":0.88400000000000001,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4570000000000001,"5min":1.6000000000000001,"15min":2.0550000000000002},"last":3.8359999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.1899999999999999,"15min":1.268},"min":{"1min":1.0029999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.5069999999999999,"5min":1.774,"15min":2.024},"last":8.5990000000000002}]},{"osd":5,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.1859999999999999,"15min":1.2689999999999999},"min":{"1min":0.89700000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.6619999999999999,"5min":1.849,"15min":4.0659999999999998},"last":5.2480000000000002},{"interface":"front","average":{"1min":1.321,"5min":1.3009999999999999,"15min":1.4279999999999999},"min":{"1min":1.0760000000000001,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":3.7160000000000002},"last":3.7999999999999998}]},{"osd":6,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.2709999999999999,"15min":1.3819999999999999},"min":{"1min":1.0009999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.72,"5min":1.72,"15min":2.081},"last":8.6340000000000003},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.254,"15min":1.335},"min":{"1min":0.97699999999999998,"5min":0.872,"15min":0.872},"max":{"1min":1.595,"5min":1.8240000000000001,"15min":2.1379999999999999},"last":5.4130000000000003}]},{"osd":7,"last update":"Tue Dec 19 18:00:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3979999999999999,"5min":1.3100000000000001,"15min":1.4279999999999999},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.7070000000000001,"5min":2.0169999999999999,"15min":2.363},"last":8.4809999999999999},{"interface":"front","average":{"1min":1.411,"5min":1.3200000000000001,"15min":1.3859999999999999},"min":{"1min":1.0469999999999999,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7130000000000001,"5min":2.0489999999999999,"15min":2.1629999999999998},"last":5.375}]}]},{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32328,"kb_used_data":1280,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339512,"statfs":{"total":96636764160,"available":96603660288,"internally_reserved":0,"allocated":1310720,"data_stored":632599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.81699999999999995,"15min":0.92800000000000005},"min":{"1min":0.65500000000000003,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.931},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.996,"5min":0.90000000000000002,"15min":0.99399999999999999},"min":{"1min":0.56299999999999994,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.9810000000000001},"last":0.90800000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.79700000000000004,"15min":0.95399999999999996},"min":{"1min":0.60199999999999998,"5min":0.434,"15min":0.434},"max":{"1min":1.131,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.0029999999999999,"5min":0.94199999999999995,"15min":1.0960000000000001},"min":{"1min":0.59699999999999998,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.508,"5min":1.508,"15min":3.4199999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.0389999999999999,"15min":1.216},"min":{"1min":0.71799999999999997,"5min":0.47299999999999998,"15min":0.46700000000000003},"max":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":3.4950000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.94199999999999995,"15min":1.129},"min":{"1min":0.68400000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.325,"5min":1.55,"15min":4.2030000000000003},"last":1.145}]},{"osd":4,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2749999999999999,"5min":1.24,"15min":1.3700000000000001},"min":{"1min":0.94499999999999995,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.4630000000000001,"5min":1.831,"15min":4.3869999999999996},"last":1.3320000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.1890000000000001,"15min":1.3360000000000001},"min":{"1min":0.89200000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.681,"5min":1.681,"15min":2.6960000000000002},"last":1.1180000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.22,"5min":1.173,"15min":1.331},"min":{"1min":0.82999999999999996,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.302,"5min":1.252,"15min":1.4510000000000001},"min":{"1min":0.90100000000000002,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.782,"5min":1.782,"15min":3.8420000000000001},"last":1.397}]},{"osd":6,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.3100000000000001,"15min":1.4950000000000001},"min":{"1min":1.006,"5min":0.93100000000000005,"15min":0.92600000000000005},"max":{"1min":1.617,"5min":2.0529999999999999,"15min":4.5780000000000003},"last":1.254},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.3149999999999999,"15min":1.5089999999999999},"min":{"1min":0.84499999999999997,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.7969999999999999,"5min":2.0070000000000001,"15min":3.214},"last":1.22}]},{"osd":7,"last update":"Tue Dec 19 18:00:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.3300000000000001,"15min":1.5629999999999999},"min":{"1min":0.99299999999999999,"5min":0.77000000000000002,"15min":0.77000000000000002},"max":{"1min":1.875,"5min":1.875,"15min":4.0910000000000002},"last":1.292},{"interface":"front","average":{"1min":1.335,"5min":1.327,"15min":1.496},"min":{"1min":0.88,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.7210000000000001,"5min":1.8360000000000001,"15min":4.6390000000000002},"last":1.202}]}]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32892,"kb_used_data":1844,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338948,"statfs":{"total":96636764160,"available":96603082752,"internally_reserved":0,"allocated":1888256,"data_stored":1214853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.85699999999999998,"15min":0.97699999999999998},"min":{"1min":0.52700000000000002,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.2070000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.99199999999999999,"5min":0.92600000000000005,"15min":1.1220000000000001},"min":{"1min":0.65700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.3340000000000001,"5min":1.73,"15min":2.3599999999999999},"last":1.0289999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.877,"15min":0.97099999999999997},"min":{"1min":0.60499999999999998,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0289999999999999,"5min":0.86499999999999999,"15min":0.95999999999999996},"min":{"1min":0.54400000000000004,"5min":0.48599999999999999,"15min":0.45300000000000001},"max":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.81599999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0720000000000001,"5min":0.90600000000000003,"15min":1.022},"min":{"1min":0.64900000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.077},{"interface":"front","average":{"1min":1.228,"5min":1.1140000000000001,"15min":1.234},"min":{"1min":0.745,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.514,"5min":1.8,"15min":2.5369999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2629999999999999,"5min":1.22,"15min":1.3400000000000001},"min":{"1min":0.79700000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.641,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2250000000000001,"15min":1.361},"min":{"1min":0.71599999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.5609999999999999,"5min":1.6160000000000001,"15min":2.7799999999999998},"last":1.2669999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.1519999999999999,"15min":1.272},"min":{"1min":0.83099999999999996,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.5289999999999999,"5min":1.659,"15min":2.0579999999999998},"last":1.147},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.2410000000000001,"15min":1.3140000000000001},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.6499999999999999,"5min":1.879,"15min":2.0030000000000001},"last":1.3660000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.272,"15min":1.409},"min":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"max":{"1min":1.7170000000000001,"5min":1.923,"15min":2.1000000000000001},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.238,"15min":1.4059999999999999},"min":{"1min":0.90600000000000003,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.55,"5min":1.95,"15min":2.3889999999999998},"last":1.234}]},{"osd":7,"last update":"Tue Dec 19 18:00:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3580000000000001,"5min":1.2889999999999999,"15min":1.5469999999999999},"min":{"1min":0.93000000000000005,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7050000000000001,"5min":1.8600000000000001,"15min":4.9400000000000004},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.272,"15min":1.512},"min":{"1min":0.871,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.722,"5min":1.722,"15min":4.8250000000000002},"last":1.2010000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:01:16.376 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T18:01:16.376 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T18:01:16.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.603+0000 7f9b4b59e700 1 Processor -- start 2023-12-19T18:01:16.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.603+0000 7f9b4b59e700 1 -- start start 2023-12-19T18:01:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4b59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9b4c070ab0 0x7f9b4c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9b4c0d2620 0x7f9b4c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b4c0d2190 con 0x7f9b4c0b2040 2023-12-19T18:01:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4b59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0ce350 con 0x7f9b4c0d2620 2023-12-19T18:01:16.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4b59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b4c0d2a70 con 0x7f9b4c070ab0 2023-12-19T18:01:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b49d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9b4c0b2040 0x7f9b4c070e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57142/0 (socket says 172.21.15.45:57142) 2023-12-19T18:01:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b49d9b700 1 -- 172.21.15.45:0/3304108524 learned_addr learned my addr 172.21.15.45:0/3304108524 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4ad9d700 1 --2- 172.21.15.45:0/3304108524 >> v2:172.21.15.45:3300/0 conn(0x7f9b4c0d2620 0x7f9b4c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4a59c700 1 --2- 172.21.15.45:0/3304108524 >> v2:172.21.15.73:3300/0 conn(0x7f9b4c070ab0 0x7f9b4c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4ad9d700 1 -- 172.21.15.45:0/3304108524 >> v2:172.21.15.73:3300/0 conn(0x7f9b4c070ab0 msgr2=0x7f9b4c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4ad9d700 1 --2- 172.21.15.45:0/3304108524 >> v2:172.21.15.73:3300/0 conn(0x7f9b4c070ab0 0x7f9b4c0cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4ad9d700 1 -- 172.21.15.45:0/3304108524 >> v1:172.21.15.45:6789/0 conn(0x7f9b4c0b2040 legacy=0x7f9b4c070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4ad9d700 1 -- 172.21.15.45:0/3304108524 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4c0ce070 con 0x7f9b4c0d2620 2023-12-19T18:01:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4ad9d700 1 --2- 172.21.15.45:0/3304108524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c0d2620 0x7f9b4c0b5e60 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0b5860 tx=0x7f9b4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38de2dcf21ab2a1d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:16.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4959a700 1 -- 172.21.15.45:0/3304108524 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400e070 con 0x7f9b4c0d2620 2023-12-19T18:01:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4959a700 1 -- 172.21.15.45:0/3304108524 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b4400bbd0 con 0x7f9b4c0d2620 2023-12-19T18:01:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.607+0000 7f9b4959a700 1 -- 172.21.15.45:0/3304108524 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b44012430 con 0x7f9b4c0d2620 2023-12-19T18:01:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3304108524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c0d2620 msgr2=0x7f9b4c0b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3304108524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c0d2620 0x7f9b4c0b5e60 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c0b5860 tx=0x7f9b4400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3304108524 shutdown_connections 2023-12-19T18:01:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3304108524 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c0d2620 0x7f9b4c0b5e60 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3304108524 >> v2:172.21.15.73:3300/0 conn(0x7f9b4c070ab0 0x7f9b4c0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3304108524 >> 172.21.15.45:0/3304108524 conn(0x7f9b4c0d2ca0 msgr2=0x7f9b4c0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3304108524 shutdown_connections 2023-12-19T18:01:16.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.611+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3304108524 wait complete. 2023-12-19T18:01:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 Processor -- start 2023-12-19T18:01:16.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 -- start start 2023-12-19T18:01:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 0x7f9b4c0c9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b4c0b2040 0x7f9b4c15fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4c0d2620 0x7f9b4c1f2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c160020 con 0x7f9b4c070ab0 2023-12-19T18:01:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0ca350 con 0x7f9b4c0b2040 2023-12-19T18:01:16.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b4c0ca630 con 0x7f9b4c0d2620 2023-12-19T18:01:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.615+0000 7f9b4a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 0x7f9b4c0c9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 0x7f9b4c0c9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46662/0 (socket says 172.21.15.45:46662) 2023-12-19T18:01:16.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 -- 172.21.15.45:0/3243335628 learned_addr learned my addr 172.21.15.45:0/3243335628 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b49d9b700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b4c0b2040 0x7f9b4c15fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4ad9d700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4c0d2620 0x7f9b4c1f2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 -- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4c0d2620 msgr2=0x7f9b4c1f2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4c0d2620 0x7f9b4c1f2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 -- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b4c0b2040 msgr2=0x7f9b4c15fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b4c0b2040 0x7f9b4c15fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 -- 172.21.15.45:0/3243335628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b44009a70 con 0x7f9b4c070ab0 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b49d9b700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b4c0b2040 0x7f9b4c15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:16.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4a59c700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 0x7f9b4c0c9d70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00d800 tx=0x7f9b3c00dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:16.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c0125f0 con 0x7f9b4c070ab0 2023-12-19T18:01:16.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b3c012750 con 0x7f9b4c070ab0 2023-12-19T18:01:16.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b3c012ac0 con 0x7f9b4c070ab0 2023-12-19T18:01:16.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b4c0ca910 con 0x7f9b4c070ab0 2023-12-19T18:01:16.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b4c1f2570 con 0x7f9b4c070ab0 2023-12-19T18:01:16.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.619+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b4c1f2790 con 0x7f9b4c070ab0 2023-12-19T18:01:16.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.623+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9b3c012c20 con 0x7f9b4c070ab0 2023-12-19T18:01:16.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.623+0000 7f9b3affd700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:16.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.627+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9b3c0835a0 con 0x7f9b4c070ab0 2023-12-19T18:01:16.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.627+0000 7f9b49d9b700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:16.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.627+0000 7f9b49d9b700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c15c0e0 tx=0x7f9b40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:16.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.631+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9b3c050eb0 con 0x7f9b4c070ab0 2023-12-19T18:01:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.871+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9b4c0d1b10 con 0x7f9b4c070ab0 2023-12-19T18:01:16.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.887+0000 7f9b3affd700 1 -- 172.21.15.45:0/3243335628 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9b3c012ed0 con 0x7f9b4c070ab0 2023-12-19T18:01:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 msgr2=0x7f9b2c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c15c0e0 tx=0x7f9b40009040 comp rx=0 tx=0).stop 2023-12-19T18:01:16.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 msgr2=0x7f9b4c0c9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 0x7f9b4c0c9d70 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f9b3c00d800 tx=0x7f9b3c00dbc0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 shutdown_connections 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9b2c065ad0 0x7f9b2c067f90 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9b4c0d2620 0x7f9b4c1f2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9b4c0b2040 0x7f9b4c15fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 --2- 172.21.15.45:0/3243335628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9b4c070ab0 0x7f9b4c0c9d70 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 >> 172.21.15.45:0/3243335628 conn(0x7f9b4c0d2ca0 msgr2=0x7f9b4c0b3d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 shutdown_connections 2023-12-19T18:01:16.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:16.891+0000 7f9b4b59e700 1 -- 172.21.15.45:0/3243335628 wait complete. 2023-12-19T18:01:16.899 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-19T18:01:16.920 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:17.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.095+0000 7f0aac964700 1 Processor -- start 2023-12-19T18:01:17.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.095+0000 7f0aac964700 1 -- start start 2023-12-19T18:01:17.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aac964700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0aa80b88b0 0x7f0aa806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aac964700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aac964700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa80d1820 con 0x7f0aa806ea90 2023-12-19T18:01:17.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aac964700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa80d1630 con 0x7f0aa80b88b0 2023-12-19T18:01:17.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aac964700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80d1b00 con 0x7f0aa806f3b0 2023-12-19T18:01:17.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aa77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0aa806ea90 0x7f0aa80d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57154/0 (socket says 172.21.15.45:57154) 2023-12-19T18:01:17.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aa77fe700 1 -- 172.21.15.45:0/2098297641 learned_addr learned my addr 172.21.15.45:0/2098297641 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:17.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aa6ffd700 1 --2- 172.21.15.45:0/2098297641 >> v2:172.21.15.73:3300/0 conn(0x7f0aa80b88b0 0x7f0aa806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aa7fff700 1 --2- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.099+0000 7f0aa67fc700 1 -- 172.21.15.45:0/2098297641 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963075795 0 0) 0x7f0aa80d1820 con 0x7f0aa806ea90 2023-12-19T18:01:17.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa67fc700 1 -- 172.21.15.45:0/2098297641 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a900035d0 con 0x7f0aa806ea90 2023-12-19T18:01:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa6ffd700 1 -- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 msgr2=0x7f0aa806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa6ffd700 1 --2- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa806f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa6ffd700 1 -- 172.21.15.45:0/2098297641 >> v1:172.21.15.45:6789/0 conn(0x7f0aa806ea90 legacy=0x7f0aa80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa6ffd700 1 -- 172.21.15.45:0/2098297641 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80d1de0 con 0x7f0aa80b88b0 2023-12-19T18:01:17.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa6ffd700 1 --2- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa80b88b0 0x7f0aa806ee70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009850 tx=0x7f0a9c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=539af60476b0c728 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa67fc700 1 -- 172.21.15.45:0/2098297641 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011830 con 0x7f0aa80b88b0 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa67fc700 1 -- 172.21.15.45:0/2098297641 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9c011990 con 0x7f0aa80b88b0 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aa67fc700 1 -- 172.21.15.45:0/2098297641 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9c011d40 con 0x7f0aa80b88b0 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 -- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa80b88b0 msgr2=0x7f0aa806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 --2- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa80b88b0 0x7f0aa806ee70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0a9c009850 tx=0x7f0a9c009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 -- 172.21.15.45:0/2098297641 shutdown_connections 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 --2- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa806f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 --2- 172.21.15.45:0/2098297641 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa80b88b0 0x7f0aa806ee70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 -- 172.21.15.45:0/2098297641 >> 172.21.15.45:0/2098297641 conn(0x7f0aa80b46d0 msgr2=0x7f0aa80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 -- 172.21.15.45:0/2098297641 shutdown_connections 2023-12-19T18:01:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.103+0000 7f0aac964700 1 -- 172.21.15.45:0/2098297641 wait complete. 2023-12-19T18:01:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.107+0000 7f0aac964700 1 Processor -- start 2023-12-19T18:01:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.107+0000 7f0aac964700 1 -- start start 2023-12-19T18:01:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa806ea90 0x7f0aa80cc780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa80ca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 0x7f0aa81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80ca5c0 con 0x7f0aa80b88b0 2023-12-19T18:01:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8156960 con 0x7f0aa806ea90 2023-12-19T18:01:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa80c9cb0 con 0x7f0aa806f3b0 2023-12-19T18:01:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 0x7f0aa81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 0x7f0aa81591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46666/0 (socket says 172.21.15.45:46666) 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 -- 172.21.15.45:0/3388025936 learned_addr learned my addr 172.21.15.45:0/3388025936 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa6ffd700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa80ca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa77fe700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa806ea90 0x7f0aa80cc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 -- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 msgr2=0x7f0aa80ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa80ca9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 -- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa806ea90 msgr2=0x7f0aa80cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa806ea90 0x7f0aa80cc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 -- 172.21.15.45:0/3388025936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c0094b0 con 0x7f0aa80b88b0 2023-12-19T18:01:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aa7fff700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 0x7f0aa81591e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009dd0 tx=0x7f0aa000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa0009c40 con 0x7f0aa80b88b0 2023-12-19T18:01:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa000f040 con 0x7f0aa80b88b0 2023-12-19T18:01:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa8159c80 con 0x7f0aa80b88b0 2023-12-19T18:01:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa000ce50 con 0x7f0aa80b88b0 2023-12-19T18:01:17.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.111+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa80ca1e0 con 0x7f0aa80b88b0 2023-12-19T18:01:17.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.115+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa80ca700 con 0x7f0aa80b88b0 2023-12-19T18:01:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.115+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0aa0014480 con 0x7f0aa80b88b0 2023-12-19T18:01:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.119+0000 7f0a8ffff700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a94065ad0 0x7f0a94067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.119+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0aa00839b0 con 0x7f0aa80b88b0 2023-12-19T18:01:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.119+0000 7f0aa77fe700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a94065ad0 0x7f0a94067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.119+0000 7f0aa77fe700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a94065ad0 0x7f0a94067f90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0a98007fd0 tx=0x7f0a98007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.123+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0aa80ca700 con 0x7f0aa80b88b0 2023-12-19T18:01:17.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.335+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0aa80ca700 con 0x7f0aa80b88b0 2023-12-19T18:01:17.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0a8ffff700 1 -- 172.21.15.45:0/3388025936 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 78 v78) v1 ==== 94+0+4711 (secure 0 0 0) 0x7f0aa80ca700 con 0x7f0aa80b88b0 2023-12-19T18:01:17.345 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:17.345 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":78,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":78,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:11.072662+0000","modified":"2023-12-19T18:01:14.573187+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56894":{"gid":56894,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6834/723317362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":723317362},{"type":"v1","addr":"172.21.15.73:6834","nonce":723317362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:17.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a94065ad0 msgr2=0x7f0a94067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a94065ad0 0x7f0a94067f90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f0a98007fd0 tx=0x7f0a98007de0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 msgr2=0x7f0aa81591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 0x7f0aa81591e0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f0aa0009dd0 tx=0x7f0aa000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 shutdown_connections 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a94065ad0 0x7f0a94067f90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0aa80b88b0 0x7f0aa81591e0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0aa806f3b0 0x7f0aa80ca9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 --2- 172.21.15.45:0/3388025936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0aa806ea90 0x7f0aa80cc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 >> 172.21.15.45:0/3388025936 conn(0x7f0aa80b46d0 msgr2=0x7f0aa80cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 shutdown_connections 2023-12-19T18:01:17.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.339+0000 7f0aac964700 1 -- 172.21.15.45:0/3388025936 wait complete. 2023-12-19T18:01:17.350 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 78 2023-12-19T18:01:17.774 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 78, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:01:11.072662+0000', 'modified': '2023-12-19T18:01:14.573187+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 56894}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_56894': {'gid': 56894, 'name': 'b', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.73:6834/723317362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 723317362}, {'type': 'v1', 'addr': '172.21.15.73:6834', 'nonce': 723317362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:01:17.775 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:01:17.775 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T18:01:17.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.947+0000 7f94fb4c4700 1 Processor -- start 2023-12-19T18:01:17.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fb4c4700 1 -- start start 2023-12-19T18:01:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fb4c4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fb4c4700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94f40af720 0x7f94f40afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fb4c4700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94f406f0a0 con 0x7f94f406cad0 2023-12-19T18:01:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fb4c4700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94f40b0110 con 0x7f94f40af720 2023-12-19T18:01:17.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fb4c4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f406ea90 con 0x7f94f415ae20 2023-12-19T18:01:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94facc3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f94f40af720 0x7f94f40afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f415be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:40030/0 (socket says 172.21.15.45:40030) 2023-12-19T18:01:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94f9cc1700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f94f406cad0 0x7f94f40c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:48070/0 (socket says 172.21.15.45:48070) 2023-12-19T18:01:17.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 -- 172.21.15.45:0/1625072144 learned_addr learned my addr 172.21.15.45:0/1625072144 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 -- 172.21.15.45:0/1625072144 >> v2:172.21.15.73:3300/0 conn(0x7f94f40af720 msgr2=0x7f94f40afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/1625072144 >> v2:172.21.15.73:3300/0 conn(0x7f94f40af720 0x7f94f40afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 -- 172.21.15.45:0/1625072144 >> v1:172.21.15.73:6789/0 conn(0x7f94f406cad0 legacy=0x7f94f40c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94fa4c2700 1 -- 172.21.15.45:0/1625072144 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f40c3f60 con 0x7f94f415ae20 2023-12-19T18:01:17.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.951+0000 7f94f94c0700 1 -- 172.21.15.45:0/1625072144 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3420024675 0 0) 0x7f94f406f0a0 con 0x7f94f406cad0 2023-12-19T18:01:17.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94facc3700 1 --2- 172.21.15.45:0/1625072144 >> v2:172.21.15.73:3300/0 conn(0x7f94f40af720 0x7f94f40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:17.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/1625072144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f415be40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009910 tx=0x7f94f0009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98410101c650b84c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94f94c0700 1 -- 172.21.15.45:0/1625072144 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011830 con 0x7f94f415ae20 2023-12-19T18:01:17.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94f94c0700 1 -- 172.21.15.45:0/1625072144 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f0011990 con 0x7f94f415ae20 2023-12-19T18:01:17.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94f94c0700 1 -- 172.21.15.45:0/1625072144 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0011d40 con 0x7f94f415ae20 2023-12-19T18:01:17.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 -- 172.21.15.45:0/1625072144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 msgr2=0x7f94f415be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/1625072144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f415be40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009910 tx=0x7f94f0009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:17.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 -- 172.21.15.45:0/1625072144 shutdown_connections 2023-12-19T18:01:17.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/1625072144 >> v2:172.21.15.73:3300/0 conn(0x7f94f40af720 0x7f94f40afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/1625072144 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f415be40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 -- 172.21.15.45:0/1625072144 >> 172.21.15.45:0/1625072144 conn(0x7f94f40cb900 msgr2=0x7f94f40b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:17.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 -- 172.21.15.45:0/1625072144 shutdown_connections 2023-12-19T18:01:17.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.955+0000 7f94fb4c4700 1 -- 172.21.15.45:0/1625072144 wait complete. 2023-12-19T18:01:17.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.959+0000 7f94fb4c4700 1 Processor -- start 2023-12-19T18:01:17.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.959+0000 7f94fb4c4700 1 -- start start 2023-12-19T18:01:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.959+0000 7f94fb4c4700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f406cad0 0x7f94f4149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 0x7f94f41f1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f406f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f4149f50 con 0x7f94f40af720 2023-12-19T18:01:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94f41f2520 con 0x7f94f406cad0 2023-12-19T18:01:17.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94f40c5fd0 con 0x7f94f415ae20 2023-12-19T18:01:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 0x7f94f41f1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 0x7f94f41f1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46680/0 (socket says 172.21.15.45:46680) 2023-12-19T18:01:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3485824669 learned_addr learned my addr 172.21.15.45:0/3485824669 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94facc3700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f406f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f406cad0 0x7f94f4149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 msgr2=0x7f94f406f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f406f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f406cad0 msgr2=0x7f94f4149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f406cad0 0x7f94f4149a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3485824669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009a70 con 0x7f94f40af720 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 0x7f94f41f1fe0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c750 tx=0x7f94e400ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94eaffd700 1 -- 172.21.15.45:0/3485824669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4004ca0 con 0x7f94f40af720 2023-12-19T18:01:17.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94eaffd700 1 -- 172.21.15.45:0/3485824669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4004e00 con 0x7f94f40af720 2023-12-19T18:01:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94f0009570 con 0x7f94f40af720 2023-12-19T18:01:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94eaffd700 1 -- 172.21.15.45:0/3485824669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4007310 con 0x7f94f40af720 2023-12-19T18:01:17.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.963+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f40c6590 con 0x7f94f40af720 2023-12-19T18:01:17.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.967+0000 7f94eaffd700 1 -- 172.21.15.45:0/3485824669 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f94e4007470 con 0x7f94f40af720 2023-12-19T18:01:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.971+0000 7f94eaffd700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94d8065ad0 0x7f94d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.971+0000 7f94eaffd700 1 -- 172.21.15.45:0/3485824669 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94e4082ef0 con 0x7f94f40af720 2023-12-19T18:01:17.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.971+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94d8065ad0 0x7f94d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.971+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94d8065ad0 0x7f94d8067f90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f94f0014040 tx=0x7f94f001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.971+0000 7f94ff9b2740 1 Processor -- start 2023-12-19T18:01:17.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.971+0000 7f94ff9b2740 1 -- start start 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4100 0x28d44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 0x28ac2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28ac800 0x29034b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x281d5b0 con 0x28d4a20 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x281ad40 con 0x28d4100 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2816630 con 0x28ac800 2023-12-19T18:01:17.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 0x28ac2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 0x28ac2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46694/0 (socket says 172.21.15.45:46694) 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 -- 172.21.15.45:0/958106237 learned_addr learned my addr 172.21.15.45:0/958106237 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94facc3700 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28ac800 0x29034b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4100 0x28d44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 -- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28ac800 msgr2=0x29034b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28ac800 0x29034b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 -- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4100 msgr2=0x28d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4100 0x28d44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 -- 172.21.15.45:0/958106237 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x2689960 con 0x28d4a20 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 0x28ac2c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f94e405bef0 tx=0x7f94e4054080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcdfd4ac62c6f28 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94d7fff700 1 -- 172.21.15.45:0/958106237 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e40720e0 con 0x28d4a20 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94d7fff700 1 -- 172.21.15.45:0/958106237 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4054440 con 0x28d4a20 2023-12-19T18:01:17.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94d7fff700 1 -- 172.21.15.45:0/958106237 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4058270 con 0x28d4a20 2023-12-19T18:01:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- 172.21.15.45:0/958106237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 msgr2=0x28ac2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 0x28ac2c0 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f94e405bef0 tx=0x7f94e4054080 comp rx=0 tx=0).stop 2023-12-19T18:01:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- 172.21.15.45:0/958106237 shutdown_connections 2023-12-19T18:01:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28ac800 0x29034b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28d4a20 0x28ac2c0 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/958106237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4100 0x28d44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- 172.21.15.45:0/958106237 >> 172.21.15.45:0/958106237 conn(0x263e4d0 msgr2=0x28afd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- 172.21.15.45:0/958106237 shutdown_connections 2023-12-19T18:01:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.975+0000 7f94ff9b2740 1 -- 172.21.15.45:0/958106237 wait complete. 2023-12-19T18:01:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 -- start start 2023-12-19T18:01:17.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 Processor -- start 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x28d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x28d6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4a20 0x28f09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d3c80 con 0x28ac800 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x27d9b00 con 0x28d4a20 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x26c2aa0 con 0x28d4100 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94ff9b2740 10 client.0 _ll_register_callbacks cb 0x280ff70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x28d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x28d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46700/0 (socket says 172.21.15.45:46700) 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94fa4c2700 1 -- 172.21.15.45:0/3029621130 learned_addr learned my addr 172.21.15.45:0/3029621130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x28d6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94facc3700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4a20 0x28f09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4a20 msgr2=0x28f09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4a20 0x28f09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3029621130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 msgr2=0x28d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x28d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 -- 172.21.15.45:0/3029621130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94f40c6590 con 0x28d4100 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x28d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x28d6820 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f94e40011e0 tx=0x7f94e400cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281a1ac3f33eb517 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.979+0000 7f94d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.73:3301/0 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94d57fa700 1 -- 172.21.15.45:0/3029621130 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e4053b30 con 0x28d4100 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94d57fa700 1 -- 172.21.15.45:0/3029621130 <== mon.2 v2:172.21.15.73:3301/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94e4072070 con 0x28d4100 2023-12-19T18:01:17.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x280f6b0 con 0x28d4100 2023-12-19T18:01:17.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94d57fa700 1 -- 172.21.15.45:0/3029621130 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94e405c420 con 0x28d4100 2023-12-19T18:01:17.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 10 client.56987 fetch_fsmap learned FSMap version 78 2023-12-19T18:01:17.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x27dc770 con 0x28d4100 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94d57fa700 1 -- 172.21.15.45:0/3029621130 <== mon.2 v2:172.21.15.73:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x280f6b0 con 0x28d4100 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94d57fa700 1 -- 172.21.15.45:0/3029621130 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f94e405bf90 con 0x28d4100 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 10 client.56987 fetch_fsmap finished waiting for FSMap version 78 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 10 client.56987 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 20 client.56987 populate_metadata read hostname 'smithi045' 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d5660 0x2912330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 4 client.56987 mds_command: new command op to 56894 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 --> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x27d1a00 con 0x28d5660 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d5660 0x2912330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:17.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d5660 0x2912330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8b740246afb05 server_cookie=5fb10d744311e9ee in_seq=0 out_seq=0 2023-12-19T18:01:17.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.983+0000 7f94d57fa700 10 client.56987 ms_handle_connect on v2:172.21.15.73:6832/723317362 2023-12-19T18:01:17.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94d57fa700 1 -- 172.21.15.45:0/3029621130 <== mds.0 v2:172.21.15.73:6832/723317362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x27d1a00 con 0x28d5660 2023-12-19T18:01:17.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94d57fa700 10 client.56987 handle_command_reply: tid=0 2023-12-19T18:01:17.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 client.56987 shutdown 2023-12-19T18:01:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 msgr2=0x28d6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x28d6820 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f94e40011e0 tx=0x7f94e400cf90 comp rx=0 tx=0).stop 2023-12-19T18:01:17.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 shutdown_connections 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d5660 0x2912330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28d4a20 0x28f09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94d57fa700 0 client.56987 ms_handle_reset on v2:172.21.15.73:6832/723317362 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x28d6820 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3029621130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x28d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 >> 172.21.15.45:0/3029621130 conn(0x263e4d0 msgr2=0x28afe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 shutdown_connections 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3029621130 wait complete. 2023-12-19T18:01:17.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:17.987+0000 7f94ff9b2740 20 client.56987 trim_cache size 0 max 16384 2023-12-19T18:01:18.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 Processor -- start 2023-12-19T18:01:18.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 -- start start 2023-12-19T18:01:18.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 0x28ab230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x2904040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x2904580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x27c5930 con 0x28ac800 2023-12-19T18:01:18.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2813e40 con 0x263e4d0 2023-12-19T18:01:18.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2811fa0 con 0x28d4100 2023-12-19T18:01:18.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94f9cc1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x2904040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 0x28ab230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94facc3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x2904580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 0x28ab230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:40930/0 (socket says 172.21.15.45:40930) 2023-12-19T18:01:18.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.011+0000 7f94fa4c2700 1 -- 172.21.15.45:0/3186986286 learned_addr learned my addr 172.21.15.45:0/3186986286 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:18.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94fa4c2700 1 -- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 msgr2=0x2904580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:18.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x2904580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94fa4c2700 1 -- 172.21.15.45:0/3186986286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 msgr2=0x2904040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:18.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x2904040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94fa4c2700 1 -- 172.21.15.45:0/3186986286 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x28f1990 con 0x263e4d0 2023-12-19T18:01:18.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x2904040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:18.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 0x28ab230 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009910 tx=0x7f94f0010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f0e8b124b60028a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:18.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94e8ff9700 1 -- 172.21.15.45:0/3186986286 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0032330 con 0x263e4d0 2023-12-19T18:01:18.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94e8ff9700 1 -- 172.21.15.45:0/3186986286 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f002b050 con 0x263e4d0 2023-12-19T18:01:18.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94e8ff9700 1 -- 172.21.15.45:0/3186986286 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0032a10 con 0x263e4d0 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 msgr2=0x28ab230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 0x28ab230 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f94f0009910 tx=0x7f94f0010000 comp rx=0 tx=0).stop 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3186986286 shutdown_connections 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x2904580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x28ac800 0x2904040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/3186986286 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x263e4d0 0x28ab230 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3186986286 >> 172.21.15.45:0/3186986286 conn(0x28f2460 msgr2=0x28d5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3186986286 shutdown_connections 2023-12-19T18:01:18.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 -- 172.21.15.45:0/3186986286 wait complete. 2023-12-19T18:01:18.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 -- start start 2023-12-19T18:01:18.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.015+0000 7f94ff9b2740 1 Processor -- start 2023-12-19T18:01:18.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 0x295baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28ac800 0x295c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x29131d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x27a1480 con 0x263e4d0 2023-12-19T18:01:18.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x26c2aa0 con 0x28ac800 2023-12-19T18:01:18.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x28d14d0 con 0x28d4100 2023-12-19T18:01:18.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 10 client.0 _ll_register_callbacks cb 0x274fe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:01:18.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 0x295baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 0x295baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46710/0 (socket says 172.21.15.45:46710) 2023-12-19T18:01:18.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 -- 172.21.15.45:0/948674576 learned_addr learned my addr 172.21.15.45:0/948674576 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:18.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28ac800 0x295c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94facc3700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x29131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 -- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 msgr2=0x29131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x29131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 -- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28ac800 msgr2=0x295c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28ac800 0x295c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 -- 172.21.15.45:0/948674576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x27dc770 con 0x263e4d0 2023-12-19T18:01:18.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94fa4c2700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 0x295baf0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f94f0013000 tx=0x7f94f00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3796873e18b88e3d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:18.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:01:18.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94d57fa700 1 -- 172.21.15.45:0/948674576 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f0005a40 con 0x263e4d0 2023-12-19T18:01:18.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94d57fa700 1 -- 172.21.15.45:0/948674576 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94f001f070 con 0x263e4d0 2023-12-19T18:01:18.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f94e4054440 con 0x263e4d0 2023-12-19T18:01:18.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94d57fa700 1 -- 172.21.15.45:0/948674576 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f94f0005ba0 con 0x263e4d0 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 10 client.8184 fetch_fsmap learned FSMap version 78 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=2+}) v3 -- 0x7f94f40c3f60 con 0x263e4d0 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.019+0000 7f94d57fa700 1 -- 172.21.15.45:0/948674576 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e4054440 con 0x263e4d0 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94d57fa700 1 -- 172.21.15.45:0/948674576 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 78) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f94f0005d00 con 0x263e4d0 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 10 client.8184 fetch_fsmap finished waiting for FSMap version 78 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 10 client.8184 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 20 client.8184 populate_metadata read hostname 'smithi045' 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d4a20 0x2910780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 4 client.8184 mds_command: new command op to 56894 tid=0[{"prefix": "status"}] 2023-12-19T18:01:18.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 --> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x2695460 con 0x28d4a20 2023-12-19T18:01:18.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d4a20 0x2910780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94f9cc1700 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d4a20 0x2910780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbfbe6e13df9f64b server_cookie=ea23a1ddea25267a in_seq=0 out_seq=0 2023-12-19T18:01:18.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94d57fa700 10 client.8184 ms_handle_connect on v2:172.21.15.73:6832/723317362 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94d57fa700 1 -- 172.21.15.45:0/948674576 <== mds.0 v2:172.21.15.73:6832/723317362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x2695460 con 0x28d4a20 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94d57fa700 10 client.8184 handle_command_reply: tid=0 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 client.8184 shutdown 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 msgr2=0x295baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 0x295baf0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f94f0013000 tx=0x7f94f00047e0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 shutdown_connections 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:6832/723317362,v1:172.21.15.73:6834/723317362] conn(0x28d4a20 0x2910780 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28d4100 0x29131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28ac800 0x295c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 --2- 172.21.15.45:0/948674576 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x263e4d0 0x295baf0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94d57fa700 0 client.8184 ms_handle_reset on v2:172.21.15.73:6832/723317362 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 >> 172.21.15.45:0/948674576 conn(0x28f2460 msgr2=0x28ef270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 shutdown_connections 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 1 -- 172.21.15.45:0/948674576 wait complete. 2023-12-19T18:01:18.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.023+0000 7f94ff9b2740 20 client.8184 trim_cache size 0 max 16384 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 56894, 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 6.946508702, 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 78, 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 107, 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 107, 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 12.694999020999999 2023-12-19T18:01:18.033 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:18.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94d8065ad0 msgr2=0x7f94d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94d8065ad0 0x7f94d8067f90 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f94f0014040 tx=0x7f94f001c040 comp rx=0 tx=0).stop 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 msgr2=0x7f94f41f1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 0x7f94f41f1fe0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f94e400c750 tx=0x7f94e400ca60 comp rx=0 tx=0).stop 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 shutdown_connections 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f94d8065ad0 0x7f94d8067f90 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f94f415ae20 0x7f94f406f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f94f40af720 0x7f94f41f1fe0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 --2- 172.21.15.45:0/3485824669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f94f406cad0 0x7f94f4149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 >> 172.21.15.45:0/3485824669 conn(0x7f94f40cb900 msgr2=0x7f94f415d700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 shutdown_connections 2023-12-19T18:01:18.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.027+0000 7f94fb4c4700 1 -- 172.21.15.45:0/3485824669 wait complete. 2023-12-19T18:01:18.058 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:01:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.231+0000 7f2466f37700 1 Processor -- start 2023-12-19T18:01:18.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.231+0000 7f2466f37700 1 -- start start 2023-12-19T18:01:18.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.231+0000 7f2466f37700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f24601611c0 0x7f24600c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2466f37700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c3f90 con 0x7f24601615a0 2023-12-19T18:01:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2466f37700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24600c4270 con 0x7f24600af720 2023-12-19T18:01:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2466f37700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246006eb30 con 0x7f24601611c0 2023-12-19T18:01:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465734700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f24601615a0 0x7f246006d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:57160/0 (socket says 172.21.15.45:57160) 2023-12-19T18:01:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465734700 1 -- 172.21.15.45:0/2033282711 learned_addr learned my addr 172.21.15.45:0/2033282711 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:18.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465f35700 1 --2- 172.21.15.45:0/2033282711 >> v2:172.21.15.73:3300/0 conn(0x7f24601611c0 0x7f24600c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2464f33700 1 -- 172.21.15.45:0/2033282711 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199227115 0 0) 0x7f24600c3f90 con 0x7f24601615a0 2023-12-19T18:01:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2464f33700 1 -- 172.21.15.45:0/2033282711 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f244c0035d0 con 0x7f24601615a0 2023-12-19T18:01:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465f35700 1 -- 172.21.15.45:0/2033282711 >> v1:172.21.15.73:6789/0 conn(0x7f24600af720 legacy=0x7f246006f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465f35700 1 -- 172.21.15.45:0/2033282711 >> v1:172.21.15.45:6789/0 conn(0x7f24601615a0 legacy=0x7f246006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465f35700 1 -- 172.21.15.45:0/2033282711 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246006ee10 con 0x7f24601611c0 2023-12-19T18:01:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2465f35700 1 --2- 172.21.15.45:0/2033282711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601611c0 0x7f24600c3920 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f245c009850 tx=0x7f245c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae3569a6b0837d83 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2464f33700 1 -- 172.21.15.45:0/2033282711 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c011830 con 0x7f24601611c0 2023-12-19T18:01:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2464f33700 1 -- 172.21.15.45:0/2033282711 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245c011990 con 0x7f24601611c0 2023-12-19T18:01:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.235+0000 7f2464f33700 1 -- 172.21.15.45:0/2033282711 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245c011d40 con 0x7f24601611c0 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 -- 172.21.15.45:0/2033282711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601611c0 msgr2=0x7f24600c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 --2- 172.21.15.45:0/2033282711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601611c0 0x7f24600c3920 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f245c009850 tx=0x7f245c009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 -- 172.21.15.45:0/2033282711 shutdown_connections 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 --2- 172.21.15.45:0/2033282711 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601611c0 0x7f24600c3920 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 -- 172.21.15.45:0/2033282711 >> 172.21.15.45:0/2033282711 conn(0x7f24600cb900 msgr2=0x7f24600b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 -- 172.21.15.45:0/2033282711 shutdown_connections 2023-12-19T18:01:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 -- 172.21.15.45:0/2033282711 wait complete. 2023-12-19T18:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.239+0000 7f2466f37700 1 Processor -- start 2023-12-19T18:01:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 -- start start 2023-12-19T18:01:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24600af720 0x7f246015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 0x7f24601f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601615a0 0x7f24600b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f246015ea10 con 0x7f24601611c0 2023-12-19T18:01:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24601f6ab0 con 0x7f24601615a0 2023-12-19T18:01:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f246015dde0 con 0x7f24600af720 2023-12-19T18:01:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 0x7f24601f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 0x7f24601f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46714/0 (socket says 172.21.15.45:46714) 2023-12-19T18:01:18.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 -- 172.21.15.45:0/3488943244 learned_addr learned my addr 172.21.15.45:0/3488943244 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465f35700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24600af720 0x7f246015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466736700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601615a0 0x7f24600b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 -- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24600af720 msgr2=0x7f246015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24600af720 0x7f246015e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 -- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601615a0 msgr2=0x7f24600b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601615a0 0x7f24600b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 -- 172.21.15.45:0/3488943244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0094b0 con 0x7f24601611c0 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466736700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601615a0 0x7f24600b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2465734700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 0x7f24601f6570 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2450005930 tx=0x7f245000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:18.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450005d90 con 0x7f24601611c0 2023-12-19T18:01:18.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24500070d0 con 0x7f24601611c0 2023-12-19T18:01:18.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f246015d020 con 0x7f24601611c0 2023-12-19T18:01:18.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.243+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2450007480 con 0x7f24601611c0 2023-12-19T18:01:18.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.247+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f246015d5e0 con 0x7f24601611c0 2023-12-19T18:01:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.247+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f246006e760 con 0x7f24601611c0 2023-12-19T18:01:18.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.247+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f24500075e0 con 0x7f24601611c0 2023-12-19T18:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.251+0000 7f24567fc700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2444065b20 0x7f2444067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.251+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2450082770 con 0x7f24601611c0 2023-12-19T18:01:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.251+0000 7f2465f35700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2444065b20 0x7f2444067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.251+0000 7f2465f35700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2444065b20 0x7f2444067fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f245c0090b0 tx=0x7f245c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:18.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.255+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f245004ffd0 con 0x7f24601611c0 2023-12-19T18:01:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.467+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2460067760 con 0x7f24601611c0 2023-12-19T18:01:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f24567fc700 1 -- 172.21.15.45:0/3488943244 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v78) v1 ==== 53+0+73 (secure 0 0 0) 0x7f24500535f0 con 0x7f24601611c0 2023-12-19T18:01:18.477 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:01:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2444065b20 msgr2=0x7f2444067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2444065b20 0x7f2444067fe0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f245c0090b0 tx=0x7f245c008030 comp rx=0 tx=0).stop 2023-12-19T18:01:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 msgr2=0x7f24601f6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 0x7f24601f6570 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f2450005930 tx=0x7f245000c7b0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 shutdown_connections 2023-12-19T18:01:18.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2444065b20 0x7f2444067fe0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f24601615a0 0x7f24600b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f24601611c0 0x7f24601f6570 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 --2- 172.21.15.45:0/3488943244 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f24600af720 0x7f246015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 >> 172.21.15.45:0/3488943244 conn(0x7f24600cb900 msgr2=0x7f24600afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 shutdown_connections 2023-12-19T18:01:18.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:18.471+0000 7f2466f37700 1 -- 172.21.15.45:0/3488943244 wait complete. 2023-12-19T18:01:18.500 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:01:18.501 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:01:18.501 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:18.504 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T18:01:18.518 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:01:18.518 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:01:18.518 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:01:18.518 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41786sec preferred_lft 41786sec 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T18:01:18.519 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:01:18.520 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:01:18.521 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T18:01:18.521 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.521 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:01:18.521 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:01:18.521 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T18:01:18.521 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:01:18.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:18.522 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:01:18.603 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:01:18.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:18.606 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T18:01:18.667 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T18:01:18.667 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:01:18.668 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T18:01:18.668 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:01:18.668 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T18:01:18.668 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:01:18.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:18.669 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T18:01:18.669 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T18:01:18.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T18:01:18.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T18:01:18.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T18:01:18.669 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T18:01:18.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:18.807 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:01:18.824 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:01:18.824 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:01:18.825 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:01:18.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:18.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T18:01:18.904 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T18:01:18.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:01:18.904 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:18.967 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:01:18.968 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:01:18.968 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:19.025 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:01:19.110 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:01:19.110 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:01:19.190 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:01:19.192 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:01:19.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:19.193 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:01:19.255 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T18:01:19.256 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T18:01:19.307 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:01:19.344 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:01:19.344 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:01:19.421 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:01:19.423 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:01:19.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:19.424 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:01:19.461 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T18:01:19.455+0000 7effb962d640 -1 init, newargv = 0x55c2c771a020 newargc=15 2023-12-19T18:01:19.461 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[55666]: starting ceph client 2023-12-19T18:01:19.473 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[55666]: starting fuse 2023-12-19T18:01:19.476 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:01:19.477 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T18:01:19.477 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:19.477 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T18:01:19.478 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T18:01:19.479 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:19.646 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.55666.asok 2023-12-19T18:01:19.829 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55666.asok 2023-12-19T18:01:19.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:19.829 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55666.asok status 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "55666", 2023-12-19T18:01:20.031 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 8196, 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 8196 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1304276109 2023-12-19T18:01:20.032 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1304276109 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.8196 192.168.0.1:0/1304276109", 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1304276109", 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 78, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 107, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T18:01:20.033 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T18:01:20.034 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:20.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:20.047 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T18:01:20.047 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:20.071 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T18:01:20.071 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:20.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:20.071 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:20.150 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_extra --pg_num_min 64 2023-12-19T18:01:20.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 Processor -- start 2023-12-19T18:01:20.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 -- start start 2023-12-19T18:01:20.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 0x7fe4c80ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe4c806cc20 0x7fe4c806fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c806d070 con 0x7fe4c815d390 2023-12-19T18:01:20.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c80cab30 con 0x7fe4c806cc20 2023-12-19T18:01:20.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4cddf9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8070360 con 0x7fe4c815cfb0 2023-12-19T18:01:20.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4c6ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe4c815d390 0x7fe4c806f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34316/0 (socket says 172.21.15.45:34316) 2023-12-19T18:01:20.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4c6ffd700 1 -- 172.21.15.45:0/1310520942 learned_addr learned my addr 172.21.15.45:0/1310520942 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:20.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/1310520942 >> v2:172.21.15.45:3300/0 conn(0x7fe4c806cc20 0x7fe4c806fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4c77fe700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 0x7fe4c80ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919572487 0 0) 0x7fe4c806d070 con 0x7fe4c815d390 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.375+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b00035d0 con 0x7fe4c815d390 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2507380020 0 0) 0x7fe4b00035d0 con 0x7fe4c815d390 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 msgr2=0x7fe4c80ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 0x7fe4c80ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 >> v2:172.21.15.45:3300/0 conn(0x7fe4c806cc20 msgr2=0x7fe4c806fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 --2- 172.21.15.45:0/1310520942 >> v2:172.21.15.45:3300/0 conn(0x7fe4c806cc20 0x7fe4c806fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80ca850 con 0x7fe4c815d390 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fe4bc001670 con 0x7fe4c815d390 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 >> v1:172.21.15.45:6789/0 conn(0x7fe4c815d390 legacy=0x7fe4c806f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0003a20 0x7fe4b0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 0x7fe4b0004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4b0004db0 0x7fe4b0005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8070360 con 0x7fe4b0004db0 2023-12-19T18:01:20.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b000ba30 con 0x7fe4b0003a20 2023-12-19T18:01:20.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4b000bb70 con 0x7fe4c815cfb0 2023-12-19T18:01:20.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4b0004db0 0x7fe4b0005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c6ffd700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 0x7fe4b0004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c77fe700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0003a20 0x7fe4b0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 -- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 msgr2=0x7fe4b0004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c815cfb0 0x7fe4b0004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 -- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0003a20 msgr2=0x7fe4b0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0003a20 0x7fe4b0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 -- 172.21.15.45:0/1310520942 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b00035d0 con 0x7fe4b0004db0 2023-12-19T18:01:20.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4b0004db0 0x7fe4b0005230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009fc0 tx=0x7fe4b00058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da9d3fffa93a814 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c000ec30 con 0x7fe4b0004db0 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c000f040 con 0x7fe4b0004db0 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c67fc700 1 -- 172.21.15.45:0/1310520942 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0014480 con 0x7fe4b0004db0 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4cddf9700 1 -- 172.21.15.45:0/1310520942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4b0004db0 msgr2=0x7fe4b0005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/1310520942 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4b0004db0 0x7fe4b0005230 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0009fc0 tx=0x7fe4b00058a0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.379+0000 7fe4c7fff700 1 -- 172.21.15.45:0/1310520942 reap_dead start 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.383+0000 7fe4cddf9700 1 -- 172.21.15.45:0/1310520942 shutdown_connections 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.383+0000 7fe4cddf9700 1 -- 172.21.15.45:0/1310520942 >> 172.21.15.45:0/1310520942 conn(0x7fe4c80cf0d0 msgr2=0x7fe4c80cb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.383+0000 7fe4cddf9700 1 -- 172.21.15.45:0/1310520942 shutdown_connections 2023-12-19T18:01:20.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.383+0000 7fe4cddf9700 1 -- 172.21.15.45:0/1310520942 wait complete. 2023-12-19T18:01:20.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.383+0000 7fe4cddf9700 1 Processor -- start 2023-12-19T18:01:20.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 -- start start 2023-12-19T18:01:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0004db0 0x7fe4c80c8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c80b39c0 0x7fe4c80b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 0x7fe4c8151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c8151a50 con 0x7fe4c81510b0 2023-12-19T18:01:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c5b70 con 0x7fe4b0004db0 2023-12-19T18:01:20.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c5e50 con 0x7fe4c80b39c0 2023-12-19T18:01:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 0x7fe4c8151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 0x7fe4c8151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54124/0 (socket says 172.21.15.45:54124) 2023-12-19T18:01:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 -- 172.21.15.45:0/3247985866 learned_addr learned my addr 172.21.15.45:0/3247985866 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c6ffd700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c80b39c0 0x7fe4c80b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c77fe700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0004db0 0x7fe4c80c8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 -- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c80b39c0 msgr2=0x7fe4c80b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c80b39c0 0x7fe4c80b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 -- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0004db0 msgr2=0x7fe4c80c8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0004db0 0x7fe4c80c8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 -- 172.21.15.45:0/3247985866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80c6130 con 0x7fe4c81510b0 2023-12-19T18:01:20.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4c7fff700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 0x7fe4c8151510 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0016000 tx=0x7fe4c0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0007000 con 0x7fe4c81510b0 2023-12-19T18:01:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4c00159d0 con 0x7fe4c81510b0 2023-12-19T18:01:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4c80c6410 con 0x7fe4c81510b0 2023-12-19T18:01:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.387+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0015dc0 con 0x7fe4c81510b0 2023-12-19T18:01:20.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.391+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80c69d0 con 0x7fe4c81510b0 2023-12-19T18:01:20.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.391+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c80c6bf0 con 0x7fe4c81510b0 2023-12-19T18:01:20.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.391+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe4c001d420 con 0x7fe4c81510b0 2023-12-19T18:01:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.395+0000 7fe4affff700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe4b4065b00 0x7fe4b4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.395+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe4c0084b50 con 0x7fe4c81510b0 2023-12-19T18:01:20.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.395+0000 7fe4c77fe700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe4b4065b00 0x7fe4b4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.395+0000 7fe4c77fe700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe4b4065b00 0x7fe4b4067fc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009b70 tx=0x7fe4b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:20.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.399+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe4c00524e0 con 0x7fe4c81510b0 2023-12-19T18:01:20.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.583+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64} v 0) v1 -- 0x7fe4c804ed30 con 0x7fe4c81510b0 2023-12-19T18:01:20.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.711+0000 7fe4affff700 1 -- 172.21.15.45:0/3247985866 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_extra", "pg_num_min": 64}]=0 pool 'cephfs_data_extra' created v108) v1 ==== 142+0+0 (secure 0 0 0) 0x7fe4c0055b00 con 0x7fe4c81510b0 2023-12-19T18:01:20.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe4b4065b00 msgr2=0x7fe4b4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe4b4065b00 0x7fe4b4067fc0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009b70 tx=0x7fe4b8008040 comp rx=0 tx=0).stop 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 msgr2=0x7fe4c8151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 0x7fe4c8151510 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0016000 tx=0x7fe4c0009750 comp rx=0 tx=0).stop 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 shutdown_connections 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe4b4065b00 0x7fe4b4067fc0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe4c81510b0 0x7fe4c8151510 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe4c80b39c0 0x7fe4c80b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 --2- 172.21.15.45:0/3247985866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe4b0004db0 0x7fe4c80c8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.715+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 >> 172.21.15.45:0/3247985866 conn(0x7fe4c80cf0d0 msgr2=0x7fe4c806f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:20.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.719+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 shutdown_connections 2023-12-19T18:01:20.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.719+0000 7fe4cddf9700 1 -- 172.21.15.45:0/3247985866 wait complete. 2023-12-19T18:01:20.732 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' created 2023-12-19T18:01:20.750 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_extra 2023-12-19T18:01:20.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.923+0000 7f8886fd2700 1 Processor -- start 2023-12-19T18:01:20.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.923+0000 7f8886fd2700 1 -- start start 2023-12-19T18:01:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.927+0000 7f8886fd2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f88801443e0 0x7f88800713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.927+0000 7f8886fd2700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8880071d70 con 0x7f8880071910 2023-12-19T18:01:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.927+0000 7f8886fd2700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88800cbe40 con 0x7f88800cba10 2023-12-19T18:01:20.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.927+0000 7f8886fd2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88800b1b80 con 0x7f88801443e0 2023-12-19T18:01:20.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f88857cf700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8880071910 0x7f88800cb300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34326/0 (socket says 172.21.15.45:34326) 2023-12-19T18:01:20.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f88857cf700 1 -- 172.21.15.45:0/3760668638 learned_addr learned my addr 172.21.15.45:0/3760668638 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:20.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8885fd0700 1 --2- 172.21.15.45:0/3760668638 >> v2:172.21.15.45:3300/0 conn(0x7f88801443e0 0x7f88800713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8885fd0700 1 -- 172.21.15.45:0/3760668638 >> v1:172.21.15.73:6789/0 conn(0x7f88800cba10 legacy=0x7f88800b2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8885fd0700 1 -- 172.21.15.45:0/3760668638 >> v1:172.21.15.45:6789/0 conn(0x7f8880071910 legacy=0x7f88800cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8884fce700 1 -- 172.21.15.45:0/3760668638 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1192104758 0 0) 0x7f88800cbe40 con 0x7f88800cba10 2023-12-19T18:01:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8885fd0700 1 -- 172.21.15.45:0/3760668638 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88801447c0 con 0x7f88801443e0 2023-12-19T18:01:20.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8885fd0700 1 --2- 172.21.15.45:0/3760668638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88801443e0 0x7f88800713d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f887c009840 tx=0x7f887c009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7919e2474047c3a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8884fce700 1 -- 172.21.15.45:0/3760668638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c004230 con 0x7f88801443e0 2023-12-19T18:01:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8884fce700 1 -- 172.21.15.45:0/3760668638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887c004390 con 0x7f88801443e0 2023-12-19T18:01:20.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8884fce700 1 -- 172.21.15.45:0/3760668638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887c0036c0 con 0x7f88801443e0 2023-12-19T18:01:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8886fd2700 1 -- 172.21.15.45:0/3760668638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88801443e0 msgr2=0x7f88800713d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8886fd2700 1 --2- 172.21.15.45:0/3760668638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88801443e0 0x7f88800713d0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f887c009840 tx=0x7f887c009b50 comp rx=0 tx=0).stop 2023-12-19T18:01:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8886fd2700 1 -- 172.21.15.45:0/3760668638 shutdown_connections 2023-12-19T18:01:20.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8886fd2700 1 --2- 172.21.15.45:0/3760668638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88801443e0 0x7f88800713d0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.931+0000 7f8886fd2700 1 -- 172.21.15.45:0/3760668638 >> 172.21.15.45:0/3760668638 conn(0x7f88800cf5a0 msgr2=0x7f8880070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.935+0000 7f8886fd2700 1 -- 172.21.15.45:0/3760668638 shutdown_connections 2023-12-19T18:01:20.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.935+0000 7f8886fd2700 1 -- 172.21.15.45:0/3760668638 wait complete. 2023-12-19T18:01:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.935+0000 7f8886fd2700 1 Processor -- start 2023-12-19T18:01:20.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.935+0000 7f8886fd2700 1 -- start start 2023-12-19T18:01:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88800cba10 0x7f888015d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88801443e0 0x7f88801f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 0x7f88800b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88800b3a50 con 0x7f88800b3060 2023-12-19T18:01:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888015db60 con 0x7f88800cba10 2023-12-19T18:01:20.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88801f6ad0 con 0x7f88801443e0 2023-12-19T18:01:20.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 0x7f88800b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 0x7f88800b3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54140/0 (socket says 172.21.15.45:54140) 2023-12-19T18:01:20.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 -- 172.21.15.45:0/4065705479 learned_addr learned my addr 172.21.15.45:0/4065705479 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:20.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8885fd0700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88800cba10 0x7f888015d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88857cf700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88801443e0 0x7f88801f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 -- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88801443e0 msgr2=0x7f88801f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88801443e0 0x7f88801f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 -- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88800cba10 msgr2=0x7f888015d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88800cba10 0x7f888015d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 -- 172.21.15.45:0/4065705479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887c009450 con 0x7f88800b3060 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88867d1700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 0x7f88800b3510 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f887800cbc0 tx=0x7f887800ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878003ea0 con 0x7f88800b3060 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f887800a650 con 0x7f88800b3060 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88801f5b70 con 0x7f88800b3060 2023-12-19T18:01:20.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800aa00 con 0x7f88800b3060 2023-12-19T18:01:20.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.939+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88801f6130 con 0x7f88800b3060 2023-12-19T18:01:20.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.943+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888013f900 con 0x7f88800b3060 2023-12-19T18:01:20.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.943+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f887800ab60 con 0x7f88800b3060 2023-12-19T18:01:20.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.947+0000 7f88767fc700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8864065ad0 0x7f8864067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:20.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.947+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 6401+0+0 (secure 0 0 0) 0x7f8878083370 con 0x7f88800b3060 2023-12-19T18:01:20.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.947+0000 7f8885fd0700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8864065ad0 0x7f8864067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:20.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.947+0000 7f8885fd0700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8864065ad0 0x7f8864067f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f887c009840 tx=0x7f887c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:20.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:20.955+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f888013f900 con 0x7f88800b3060 2023-12-19T18:01:21.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.171+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"} v 0) v1 -- 0x7f888013f900 con 0x7f88800b3060 2023-12-19T18:01:21.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.183+0000 7f88767fc700 1 -- 172.21.15.45:0/4065705479 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_extra"}]=0 added data pool 16 to fsmap v79) v1 ==== 141+0+0 (secure 0 0 0) 0x7f888013f900 con 0x7f88800b3060 2023-12-19T18:01:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8864065ad0 msgr2=0x7f8864067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8864065ad0 0x7f8864067f90 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f887c009840 tx=0x7f887c008030 comp rx=0 tx=0).stop 2023-12-19T18:01:21.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 msgr2=0x7f88800b3510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 0x7f88800b3510 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f887800cbc0 tx=0x7f887800ced0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 shutdown_connections 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8864065ad0 0x7f8864067f90 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88800b3060 0x7f88800b3510 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88801443e0 0x7f88801f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 --2- 172.21.15.45:0/4065705479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88800cba10 0x7f888015d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.191+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 >> 172.21.15.45:0/4065705479 conn(0x7f8880071910 msgr2=0x7f88800cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:21.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.199+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 shutdown_connections 2023-12-19T18:01:21.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.199+0000 7f8886fd2700 1 -- 172.21.15.45:0/4065705479 wait complete. 2023-12-19T18:01:21.208 INFO:teuthology.orchestra.run.smithi045.stderr:added data pool 16 to fsmap 2023-12-19T18:01:21.227 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:21.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a9342700 1 Processor -- start 2023-12-19T18:01:21.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a9342700 1 -- start start 2023-12-19T18:01:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a9342700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f84a41659f0 0x7f84a4167de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a9342700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a40d1820 con 0x7f84a406ea90 2023-12-19T18:01:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a9342700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a40d1b00 con 0x7f84a40b88b0 2023-12-19T18:01:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a9342700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a40d1630 con 0x7f84a41659f0 2023-12-19T18:01:21.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a2ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f84a406ea90 0x7f84a40d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34342/0 (socket says 172.21.15.45:34342) 2023-12-19T18:01:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.395+0000 7f84a2ffd700 1 -- 172.21.15.45:0/608741565 learned_addr learned my addr 172.21.15.45:0/608741565 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a37fe700 1 --2- 172.21.15.45:0/608741565 >> v2:172.21.15.45:3300/0 conn(0x7f84a41659f0 0x7f84a4167de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a1ffb700 1 -- 172.21.15.45:0/608741565 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3154163161 0 0) 0x7f84a40d1820 con 0x7f84a406ea90 2023-12-19T18:01:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a37fe700 1 -- 172.21.15.45:0/608741565 >> v1:172.21.15.73:6789/0 conn(0x7f84a40b88b0 legacy=0x7f84a406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a37fe700 1 -- 172.21.15.45:0/608741565 >> v1:172.21.15.45:6789/0 conn(0x7f84a406ea90 legacy=0x7f84a40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a37fe700 1 -- 172.21.15.45:0/608741565 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a40d1de0 con 0x7f84a41659f0 2023-12-19T18:01:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a37fe700 1 --2- 172.21.15.45:0/608741565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a41659f0 0x7f84a4167de0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f849c009d90 tx=0x7f849c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76267a8fd81d58 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a1ffb700 1 -- 172.21.15.45:0/608741565 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00e070 con 0x7f84a41659f0 2023-12-19T18:01:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a1ffb700 1 -- 172.21.15.45:0/608741565 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f849c00bad0 con 0x7f84a41659f0 2023-12-19T18:01:21.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a1ffb700 1 -- 172.21.15.45:0/608741565 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849c00be80 con 0x7f84a41659f0 2023-12-19T18:01:21.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 -- 172.21.15.45:0/608741565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a41659f0 msgr2=0x7f84a4167de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.407 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 --2- 172.21.15.45:0/608741565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a41659f0 0x7f84a4167de0 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f849c009d90 tx=0x7f849c00b330 comp rx=0 tx=0).stop 2023-12-19T18:01:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 -- 172.21.15.45:0/608741565 shutdown_connections 2023-12-19T18:01:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 --2- 172.21.15.45:0/608741565 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a41659f0 0x7f84a4167de0 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 -- 172.21.15.45:0/608741565 >> 172.21.15.45:0/608741565 conn(0x7f84a40b46d0 msgr2=0x7f84a40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 -- 172.21.15.45:0/608741565 shutdown_connections 2023-12-19T18:01:21.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.399+0000 7f84a9342700 1 -- 172.21.15.45:0/608741565 wait complete. 2023-12-19T18:01:21.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.403+0000 7f84a9342700 1 Processor -- start 2023-12-19T18:01:21.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.403+0000 7f84a9342700 1 -- start start 2023-12-19T18:01:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 0x7f84a40ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84a40b88b0 0x7f84a40cc3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84a41659f0 0x7f84a40c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c72e0 con 0x7f84a406ea90 2023-12-19T18:01:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c6710 con 0x7f84a40b88b0 2023-12-19T18:01:21.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a40c69b0 con 0x7f84a41659f0 2023-12-19T18:01:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 0x7f84a40ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 0x7f84a40ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54172/0 (socket says 172.21.15.45:54172) 2023-12-19T18:01:21.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 -- 172.21.15.45:0/3815776196 learned_addr learned my addr 172.21.15.45:0/3815776196 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a37fe700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84a41659f0 0x7f84a40c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a27fc700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84a40b88b0 0x7f84a40cc3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 -- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84a41659f0 msgr2=0x7f84a40c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84a41659f0 0x7f84a40c7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 -- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84a40b88b0 msgr2=0x7f84a40cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84a40b88b0 0x7f84a40cc3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 -- 172.21.15.45:0/3815776196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849c009a70 con 0x7f84a406ea90 2023-12-19T18:01:21.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a37fe700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84a41659f0 0x7f84a40c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a27fc700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84a40b88b0 0x7f84a40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a2ffd700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 0x7f84a40ca4a0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f849400c4e0 tx=0x7f849400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494004ca0 con 0x7f84a406ea90 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8494004e20 con 0x7f84a406ea90 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494007310 con 0x7f84a406ea90 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a40c6c90 con 0x7f84a406ea90 2023-12-19T18:01:21.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.407+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a40ca9e0 con 0x7f84a406ea90 2023-12-19T18:01:21.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.411+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a4067760 con 0x7f84a406ea90 2023-12-19T18:01:21.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.411+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8494007470 con 0x7f84a406ea90 2023-12-19T18:01:21.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.411+0000 7f848b7fe700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8490065ad0 0x7f8490067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.411+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f8494083260 con 0x7f84a406ea90 2023-12-19T18:01:21.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.411+0000 7f84a27fc700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8490065ad0 0x7f8490067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.415+0000 7f84a27fc700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8490065ad0 0x7f8490067f90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f84a40cd470 tx=0x7f8498009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:21.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.419+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f84940508a0 con 0x7f84a406ea90 2023-12-19T18:01:21.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.631+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84a40b7f30 con 0x7f84a406ea90 2023-12-19T18:01:21.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.635+0000 7f848b7fe700 1 -- 172.21.15.45:0/3815776196 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f8494007720 con 0x7f84a406ea90 2023-12-19T18:01:21.642 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:21.642 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":79,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:11.072662+0000","modified":"2023-12-19T18:01:21.176979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56894":{"gid":56894,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6834/723317362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":723317362},{"type":"v1","addr":"172.21.15.73:6834","nonce":723317362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.635+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8490065ad0 msgr2=0x7f8490067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.635+0000 7f84a9342700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8490065ad0 0x7f8490067f90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f84a40cd470 tx=0x7f8498009040 comp rx=0 tx=0).stop 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.635+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 msgr2=0x7f84a40ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.635+0000 7f84a9342700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 0x7f84a40ca4a0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f849400c4e0 tx=0x7f849400c8a0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 shutdown_connections 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8490065ad0 0x7f8490067f90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f84a41659f0 0x7f84a40c7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f84a40b88b0 0x7f84a40cc3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 --2- 172.21.15.45:0/3815776196 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f84a406ea90 0x7f84a40ca4a0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 >> 172.21.15.45:0/3815776196 conn(0x7f84a40b46d0 msgr2=0x7f84a40712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 shutdown_connections 2023-12-19T18:01:21.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.639+0000 7f84a9342700 1 -- 172.21.15.45:0/3815776196 wait complete. 2023-12-19T18:01:21.646 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 79 2023-12-19T18:01:21.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.835+0000 7fd6fe777700 1 Processor -- start 2023-12-19T18:01:21.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fe777700 1 -- start start 2023-12-19T18:01:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fe777700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd6f815cff0 0x7fd6f8161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fe777700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80ca6f0 con 0x7fd6f80c3920 2023-12-19T18:01:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fe777700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6f80c9220 con 0x7fd6f806ddd0 2023-12-19T18:01:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fe777700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6f815d3d0 con 0x7fd6f815cff0 2023-12-19T18:01:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fdf76700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd6f80c3920 0x7fd6f806ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:34346/0 (socket says 172.21.15.45:34346) 2023-12-19T18:01:21.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fdf76700 1 -- 172.21.15.45:0/481893010 learned_addr learned my addr 172.21.15.45:0/481893010 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fd775700 1 --2- 172.21.15.45:0/481893010 >> v2:172.21.15.45:3300/0 conn(0x7fd6f815cff0 0x7fd6f8161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217703009 0 0) 0x7fd6f80ca6f0 con 0x7fd6f80c3920 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6e40035d0 con 0x7fd6f80c3920 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1250867824 0 0) 0x7fd6f80c9220 con 0x7fd6f806ddd0 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6f80ca6f0 con 0x7fd6f806ddd0 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fd775700 1 -- 172.21.15.45:0/481893010 >> v1:172.21.15.73:6789/0 conn(0x7fd6f806ddd0 legacy=0x7fd6f80c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fd775700 1 -- 172.21.15.45:0/481893010 >> v1:172.21.15.45:6789/0 conn(0x7fd6f80c3920 legacy=0x7fd6f806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.839+0000 7fd6fd775700 1 -- 172.21.15.45:0/481893010 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f80c9500 con 0x7fd6f815cff0 2023-12-19T18:01:21.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fd775700 1 --2- 172.21.15.45:0/481893010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f815cff0 0x7fd6f8161530 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009d90 tx=0x7fd6f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e06aec3d95e9a2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400e070 con 0x7fd6f815cff0 2023-12-19T18:01:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f400bb20 con 0x7fd6f815cff0 2023-12-19T18:01:21.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6effff700 1 -- 172.21.15.45:0/481893010 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f400be90 con 0x7fd6f815cff0 2023-12-19T18:01:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 -- 172.21.15.45:0/481893010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f815cff0 msgr2=0x7fd6f8161530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 --2- 172.21.15.45:0/481893010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f815cff0 0x7fd6f8161530 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4009d90 tx=0x7fd6f400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 -- 172.21.15.45:0/481893010 shutdown_connections 2023-12-19T18:01:21.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 --2- 172.21.15.45:0/481893010 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f815cff0 0x7fd6f8161530 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 -- 172.21.15.45:0/481893010 >> 172.21.15.45:0/481893010 conn(0x7fd6f80cb900 msgr2=0x7fd6f80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 -- 172.21.15.45:0/481893010 shutdown_connections 2023-12-19T18:01:21.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.843+0000 7fd6fe777700 1 -- 172.21.15.45:0/481893010 wait complete. 2023-12-19T18:01:21.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 Processor -- start 2023-12-19T18:01:21.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 -- start start 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6f806ddd0 0x7fd6f80b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 0x7fd6f80af270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6f815cff0 0x7fd6f815f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80af7b0 con 0x7fd6f80c3920 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80b3cc0 con 0x7fd6f815cff0 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fe777700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f80b3700 con 0x7fd6f806ddd0 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fcf74700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 0x7fd6f80af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fcf74700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 0x7fd6f80af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:54190/0 (socket says 172.21.15.45:54190) 2023-12-19T18:01:21.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fcf74700 1 -- 172.21.15.45:0/706477130 learned_addr learned my addr 172.21.15.45:0/706477130 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.847+0000 7fd6fd775700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6f806ddd0 0x7fd6f80b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fdf76700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6f815cff0 0x7fd6f815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fcf74700 1 -- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6f806ddd0 msgr2=0x7fd6f80b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fcf74700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6f806ddd0 0x7fd6f80b3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fcf74700 1 -- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6f815cff0 msgr2=0x7fd6f815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fcf74700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6f815cff0 0x7fd6f815f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fcf74700 1 -- 172.21.15.45:0/706477130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f4009a70 con 0x7fd6f80c3920 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fcf74700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 0x7fd6f80af270 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c500 tx=0x7fd6e800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80052d0 con 0x7fd6f80c3920 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e8005450 con 0x7fd6f80c3920 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80038e0 con 0x7fd6f80c3920 2023-12-19T18:01:21.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f80b39e0 con 0x7fd6f80c3920 2023-12-19T18:01:21.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f80c5ca0 con 0x7fd6f80c3920 2023-12-19T18:01:21.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.851+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6f80c5ec0 con 0x7fd6f80c3920 2023-12-19T18:01:21.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.855+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd6e8003a40 con 0x7fd6f80c3920 2023-12-19T18:01:21.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.859+0000 7fd6edffb700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd6dc065ad0 0x7fd6dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:21.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.859+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fd6e8082850 con 0x7fd6f80c3920 2023-12-19T18:01:21.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.859+0000 7fd6fd775700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd6dc065ad0 0x7fd6dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:21.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.859+0000 7fd6fd775700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd6dc065ad0 0x7fd6dc067f90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4014040 tx=0x7fd6f4011000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:21.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:21.863+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd6e804ff20 con 0x7fd6f80c3920 2023-12-19T18:01:22.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.043+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6f8067760 con 0x7fd6f80c3920 2023-12-19T18:01:22.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.047+0000 7fd6edffb700 1 -- 172.21.15.45:0/706477130 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+18011 (secure 0 0 0) 0x7fd6e8053540 con 0x7fd6f80c3920 2023-12-19T18:01:22.055 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:22.055 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":109,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:21.176254+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"109","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd6dc065ad0 msgr2=0x7fd6dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd6dc065ad0 0x7fd6dc067f90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4014040 tx=0x7fd6f4011000 comp rx=0 tx=0).stop 2023-12-19T18:01:22.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 msgr2=0x7fd6f80af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 0x7fd6f80af270 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800c500 tx=0x7fd6e800c810 comp rx=0 tx=0).stop 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 shutdown_connections 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd6dc065ad0 0x7fd6dc067f90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6f815cff0 0x7fd6f815f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd6f80c3920 0x7fd6f80af270 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 --2- 172.21.15.45:0/706477130 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6f806ddd0 0x7fd6f80b3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 >> 172.21.15.45:0/706477130 conn(0x7fd6f80cb900 msgr2=0x7fd6f8160750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 shutdown_connections 2023-12-19T18:01:22.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:22.051+0000 7fd6fe777700 1 -- 172.21.15.45:0/706477130 wait complete. 2023-12-19T18:01:22.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:22.076 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir stripey) 2023-12-19T18:01:22.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:22.107 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.dir.layout -v 'stripe_unit=65536 stripe_count=4 object_size=262144 pool=cephfs_data_extra' ./stripey) 2023-12-19T18:01:22.182 INFO:tasks.cephfs.mount:Writing 1048576 bytes to stripey/flushed_file_0 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_0" 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 1048576): 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:22.183 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:22.909 INFO:tasks.cephfs.mount:Validating 1048576 bytes from stripey/flushed_file_0 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_0" 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1048576: 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1048576 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:22.910 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:22.911 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:22.911 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:22.911 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:22.911 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:23.663 INFO:tasks.cephfs.mount:Writing 524288 bytes to stripey/flushed_file_1 2023-12-19T18:01:23.663 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_1" 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 524288): 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:23.664 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:24.187 INFO:tasks.cephfs.mount:Validating 524288 bytes from stripey/flushed_file_1 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_1" 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 524288: 2023-12-19T18:01:24.187 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 524288 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:24.188 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:24.733 INFO:tasks.cephfs.mount:Writing 917504 bytes to stripey/flushed_file_2 2023-12-19T18:01:24.733 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_2" 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 917504): 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:24.734 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:25.470 INFO:tasks.cephfs.mount:Validating 917504 bytes from stripey/flushed_file_2 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_2" 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 917504: 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 917504 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:25.471 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:26.226 INFO:tasks.cephfs.mount:Writing 917503 bytes to stripey/flushed_file_3 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_3" 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 917503): 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:26.226 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:26.953 INFO:tasks.cephfs.mount:Validating 917503 bytes from stripey/flushed_file_3 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_3" 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 917503: 2023-12-19T18:01:26.953 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 917503 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:26.954 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:27.697 INFO:tasks.cephfs.mount:Writing 1441792 bytes to stripey/flushed_file_4 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_4" 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 1441792): 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:27.698 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:28.826 INFO:tasks.cephfs.mount:Validating 1441792 bytes from stripey/flushed_file_4 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_4" 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1441792: 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1441792 2023-12-19T18:01:28.826 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:28.827 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:28.827 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:28.827 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:28.827 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:28.827 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:29.781 INFO:tasks.cephfs.mount:Writing 1441793 bytes to stripey/flushed_file_5 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_5" 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 1441793): 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:29.782 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:30.914 INFO:tasks.cephfs.mount:Validating 1441793 bytes from stripey/flushed_file_5 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_5" 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1441793: 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1441793 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:30.915 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:30.916 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:30.916 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:30.916 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:30.916 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:31.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:01:31.759 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:01:31.865 INFO:tasks.cephfs.mount:Writing 1572864 bytes to stripey/flushed_file_6 2023-12-19T18:01:31.865 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:31.865 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:31.865 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_6" 2023-12-19T18:01:31.866 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:31.866 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 1572864): 2023-12-19T18:01:31.866 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:31.866 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:31.866 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:32.953 INFO:tasks.cephfs.mount:Validating 1572864 bytes from stripey/flushed_file_6 2023-12-19T18:01:32.953 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:32.953 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:32.953 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_6" 2023-12-19T18:01:32.953 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:32.953 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:32.953 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1572864: 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1572864 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:32.954 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:34.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:34.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.330+0000 7f5369276700 1 Processor -- start 2023-12-19T18:01:34.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.330+0000 7f5369276700 1 -- start start 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5369276700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53640af720 0x7f53640afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5369276700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53640702b0 con 0x7f536415e450 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5369276700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f536406c760 con 0x7f5364159a50 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5369276700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5364070540 con 0x7f53640af720 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f535b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f536415e450 0x7f536406fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40036/0 (socket says 172.21.15.45:40036) 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f535b7fe700 1 -- 172.21.15.45:0/360000521 learned_addr learned my addr 172.21.15.45:0/360000521 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:34.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5368a75700 1 --2- 172.21.15.45:0/360000521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53640af720 0x7f53640afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:34.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f53637fe700 1 -- 172.21.15.45:0/360000521 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2614979960 0 0) 0x7f536406c760 con 0x7f5364159a50 2023-12-19T18:01:34.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f53637fe700 1 -- 172.21.15.45:0/360000521 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53500035d0 con 0x7f5364159a50 2023-12-19T18:01:34.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5368a75700 1 -- 172.21.15.45:0/360000521 >> v1:172.21.15.73:6789/0 conn(0x7f5364159a50 legacy=0x7f53640c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5368a75700 1 -- 172.21.15.45:0/360000521 >> v1:172.21.15.45:6789/0 conn(0x7f536415e450 legacy=0x7f536406fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f53637fe700 1 -- 172.21.15.45:0/360000521 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330540977 0 0) 0x7f53640702b0 con 0x7f536415e450 2023-12-19T18:01:34.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5368a75700 1 -- 172.21.15.45:0/360000521 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f536406ca40 con 0x7f53640af720 2023-12-19T18:01:34.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f5368a75700 1 --2- 172.21.15.45:0/360000521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53640af720 0x7f53640afbd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f535c009dc0 tx=0x7f535c00b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3afe2ef91f84006f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:34.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f53637fe700 1 -- 172.21.15.45:0/360000521 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00e070 con 0x7f53640af720 2023-12-19T18:01:34.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f53637fe700 1 -- 172.21.15.45:0/360000521 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c00bb20 con 0x7f53640af720 2023-12-19T18:01:34.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.334+0000 7f53637fe700 1 -- 172.21.15.45:0/360000521 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c00bed0 con 0x7f53640af720 2023-12-19T18:01:34.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 -- 172.21.15.45:0/360000521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53640af720 msgr2=0x7f53640afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 --2- 172.21.15.45:0/360000521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53640af720 0x7f53640afbd0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f535c009dc0 tx=0x7f535c00b330 comp rx=0 tx=0).stop 2023-12-19T18:01:34.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 -- 172.21.15.45:0/360000521 shutdown_connections 2023-12-19T18:01:34.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 --2- 172.21.15.45:0/360000521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f53640af720 0x7f53640afbd0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 -- 172.21.15.45:0/360000521 >> 172.21.15.45:0/360000521 conn(0x7f53640cb900 msgr2=0x7f53640b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:34.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 -- 172.21.15.45:0/360000521 shutdown_connections 2023-12-19T18:01:34.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 -- 172.21.15.45:0/360000521 wait complete. 2023-12-19T18:01:34.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.338+0000 7f5369276700 1 Processor -- start 2023-12-19T18:01:34.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 -- start start 2023-12-19T18:01:34.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53640af720 0x7f5364157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:34.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5364159a50 0x7f53641562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 0x7f53641567e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640b0110 con 0x7f536415e450 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53641586c0 con 0x7f53640af720 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5369276700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5364149e70 con 0x7f5364159a50 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 0x7f53641567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 0x7f53641567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40044/0 (socket says 172.21.15.45:40044) 2023-12-19T18:01:34.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 -- 172.21.15.45:0/2829158742 learned_addr learned my addr 172.21.15.45:0/2829158742 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f535b7fe700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5364159a50 0x7f53641562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:34.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5363fff700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53640af720 0x7f5364157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 -- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5364159a50 msgr2=0x7f53641562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5364159a50 0x7f53641562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 -- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53640af720 msgr2=0x7f5364157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53640af720 0x7f5364157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 -- 172.21.15.45:0/2829158742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f535c009a70 con 0x7f536415e450 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5363fff700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53640af720 0x7f5364157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.342+0000 7f5368a75700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 0x7f53641567e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f535c009f30 tx=0x7f535c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c01b810 con 0x7f536415e450 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535c020070 con 0x7f536415e450 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535c01bb90 con 0x7f536415e450 2023-12-19T18:01:34.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5364157ab0 con 0x7f536415e450 2023-12-19T18:01:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5364158070 con 0x7f536415e450 2023-12-19T18:01:34.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5364067760 con 0x7f536415e450 2023-12-19T18:01:34.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.346+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f535c01bcf0 con 0x7f536415e450 2023-12-19T18:01:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.350+0000 7f53617fa700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5344065ad0 0x7f5344067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.350+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f535c022070 con 0x7f536415e450 2023-12-19T18:01:34.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.350+0000 7f5363fff700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5344065ad0 0x7f5344067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:34.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.350+0000 7f5363fff700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5344065ad0 0x7f5344067f90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5354007fd0 tx=0x7f5354009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:34.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.358+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f535c052ed0 con 0x7f536415e450 2023-12-19T18:01:34.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.578+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53640b0c40 con 0x7f536415e450 2023-12-19T18:01:34.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.578+0000 7f53617fa700 1 -- 172.21.15.45:0/2829158742 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) v1 ==== 94+0+4714 (secure 0 0 0) 0x7f535c0564f0 con 0x7f536415e450 2023-12-19T18:01:34.582 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:34.582 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":79,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":79,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:11.072662+0000","modified":"2023-12-19T18:01:21.176979+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":56894},"failed":[],"damaged":[],"stopped":[],"info":{"gid_56894":{"gid":56894,"name":"b","rank":0,"incarnation":74,"state":"up:active","state_seq":3,"addr":"172.21.15.73:6834/723317362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":723317362},{"type":"v1","addr":"172.21.15.73:6834","nonce":723317362}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:34.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5344065ad0 msgr2=0x7f5344067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5344065ad0 0x7f5344067f90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f5354007fd0 tx=0x7f5354009040 comp rx=0 tx=0).stop 2023-12-19T18:01:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 msgr2=0x7f53641567e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 0x7f53641567e0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f535c009f30 tx=0x7f535c004af0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 shutdown_connections 2023-12-19T18:01:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5344065ad0 0x7f5344067f90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f536415e450 0x7f53641567e0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5364159a50 0x7f53641562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 --2- 172.21.15.45:0/2829158742 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f53640af720 0x7f5364157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 >> 172.21.15.45:0/2829158742 conn(0x7f53640cb900 msgr2=0x7f53640b2e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 shutdown_connections 2023-12-19T18:01:34.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:34.582+0000 7f5369276700 1 -- 172.21.15.45:0/2829158742 wait complete. 2023-12-19T18:01:34.589 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 79 2023-12-19T18:01:34.608 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2023-12-19T18:01:34.824 INFO:teuthology.orchestra.run.smithi073.stdout:{"message":"","return_code":0} 2023-12-19T18:01:34.824 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-12-19T18:01:34.824 INFO:tasks.cephfs.mount:Writing 524288 bytes to stripey/unflushed_file 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/unflushed_file" 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'w'"'"') as f: 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> for i in range(0, 524288): 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> f.write(chr(val)) 2023-12-19T18:01:34.825 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:35.311 INFO:tasks.cephfs.mount:Validating 524288 bytes from stripey/unflushed_file 2023-12-19T18:01:35.311 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/unflushed_file" 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 524288: 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 524288 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:01:35.312 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:35.856 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:01:35.856 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:01:35.856 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-12-19T18:01:35.856 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:01:35.856 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/stripey/unflushed_file").st_ino) 2023-12-19T18:01:35.856 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:01:35.993 INFO:teuthology.orchestra.run.smithi045.stdout:1099511628284 2023-12-19T18:01:36.182 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:01:36.182 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:01:36.243 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:36.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.470+0000 7fc2fef89700 1 Processor -- start 2023-12-19T18:01:36.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.470+0000 7fc2fef89700 1 -- start start 2023-12-19T18:01:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fef89700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2f815ae20 0x7fc2f815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fef89700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2f80af720 0x7fc2f80afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fef89700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f806f0a0 con 0x7fc2f806cad0 2023-12-19T18:01:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fef89700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f80b00d0 con 0x7fc2f815ae20 2023-12-19T18:01:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fef89700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f806ea90 con 0x7fc2f80af720 2023-12-19T18:01:36.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2f815ae20 0x7fc2f815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2f815ae20 0x7fc2f815be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40060/0 (socket says 172.21.15.45:40060) 2023-12-19T18:01:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 -- 172.21.15.45:0/2468775238 learned_addr learned my addr 172.21.15.45:0/2468775238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fe788700 1 --2- 172.21.15.45:0/2468775238 >> v2:172.21.15.73:3300/0 conn(0x7fc2f80af720 0x7fc2f80afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fcf85700 1 -- 172.21.15.45:0/2468775238 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885953692 0 0) 0x7fc2f806f0a0 con 0x7fc2f806cad0 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fcf85700 1 -- 172.21.15.45:0/2468775238 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2e40035d0 con 0x7fc2f806cad0 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 -- 172.21.15.45:0/2468775238 >> v2:172.21.15.73:3300/0 conn(0x7fc2f80af720 msgr2=0x7fc2f80afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 --2- 172.21.15.45:0/2468775238 >> v2:172.21.15.73:3300/0 conn(0x7fc2f80af720 0x7fc2f80afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 -- 172.21.15.45:0/2468775238 >> v1:172.21.15.73:6789/0 conn(0x7fc2f806cad0 legacy=0x7fc2f80c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 -- 172.21.15.45:0/2468775238 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f80c3f60 con 0x7fc2f815ae20 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fdf87700 1 --2- 172.21.15.45:0/2468775238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f815ae20 0x7fc2f815be40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80cc270 tx=0x7fc2f4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd4bfbffd9ee4b7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fcf85700 1 -- 172.21.15.45:0/2468775238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4011830 con 0x7fc2f815ae20 2023-12-19T18:01:36.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fcf85700 1 -- 172.21.15.45:0/2468775238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f4011990 con 0x7fc2f815ae20 2023-12-19T18:01:36.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.474+0000 7fc2fcf85700 1 -- 172.21.15.45:0/2468775238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f4011d20 con 0x7fc2f815ae20 2023-12-19T18:01:36.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 -- 172.21.15.45:0/2468775238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f815ae20 msgr2=0x7fc2f815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2468775238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f815ae20 0x7fc2f815be40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fc2f80cc270 tx=0x7fc2f4009bf0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 -- 172.21.15.45:0/2468775238 shutdown_connections 2023-12-19T18:01:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2468775238 >> v2:172.21.15.73:3300/0 conn(0x7fc2f80af720 0x7fc2f80afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2468775238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f815ae20 0x7fc2f815be40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 -- 172.21.15.45:0/2468775238 >> 172.21.15.45:0/2468775238 conn(0x7fc2f80cb900 msgr2=0x7fc2f80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 -- 172.21.15.45:0/2468775238 shutdown_connections 2023-12-19T18:01:36.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.478+0000 7fc2fef89700 1 -- 172.21.15.45:0/2468775238 wait complete. 2023-12-19T18:01:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 Processor -- start 2023-12-19T18:01:36.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 -- start start 2023-12-19T18:01:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806cad0 0x7fc2f80c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 0x7fc2f80b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2f815ae20 0x7fc2f80b2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814e6a0 con 0x7fc2f80af720 2023-12-19T18:01:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814e980 con 0x7fc2f806cad0 2023-12-19T18:01:36.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fef89700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f814ec60 con 0x7fc2f815ae20 2023-12-19T18:01:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fd786700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 0x7fc2f80b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fd786700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 0x7fc2f80b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40076/0 (socket says 172.21.15.45:40076) 2023-12-19T18:01:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fd786700 1 -- 172.21.15.45:0/2295329260 learned_addr learned my addr 172.21.15.45:0/2295329260 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:36.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.482+0000 7fc2fdf87700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806cad0 0x7fc2f80c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fe788700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2f815ae20 0x7fc2f80b2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fd786700 1 -- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2f815ae20 msgr2=0x7fc2f80b2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fd786700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2f815ae20 0x7fc2f80b2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fd786700 1 -- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806cad0 msgr2=0x7fc2f80c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fd786700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806cad0 0x7fc2f80c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fd786700 1 -- 172.21.15.45:0/2295329260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f4009570 con 0x7fc2f80af720 2023-12-19T18:01:36.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fd786700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 0x7fc2f80b38b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c520 tx=0x7fc2e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:36.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80052d0 con 0x7fc2f80af720 2023-12-19T18:01:36.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e8005430 con 0x7fc2f80af720 2023-12-19T18:01:36.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80055a0 con 0x7fc2f80af720 2023-12-19T18:01:36.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f814ef40 con 0x7fc2f80af720 2023-12-19T18:01:36.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f80c8210 con 0x7fc2f80af720 2023-12-19T18:01:36.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.486+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f806f510 con 0x7fc2f80af720 2023-12-19T18:01:36.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.490+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2e80038e0 con 0x7fc2f80af720 2023-12-19T18:01:36.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.490+0000 7fc2ee7fc700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2dc065ad0 0x7fc2dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.490+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fc2e8082860 con 0x7fc2f80af720 2023-12-19T18:01:36.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.490+0000 7fc2fdf87700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2dc065ad0 0x7fc2dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.494+0000 7fc2fdf87700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2dc065ad0 0x7fc2dc067f90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4000c00 tx=0x7fc2f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:36.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.498+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc2f806f510 con 0x7fc2f80af720 2023-12-19T18:01:36.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.682+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2f806f510 con 0x7fc2f80af720 2023-12-19T18:01:36.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.686+0000 7fc2ee7fc700 1 -- 172.21.15.45:0/2295329260 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17998 (secure 0 0 0) 0x7fc2f806f510 con 0x7fc2f80af720 2023-12-19T18:01:36.689 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:36.690 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:22.181434+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2dc065ad0 msgr2=0x7fc2dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2dc065ad0 0x7fc2dc067f90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fc2f4000c00 tx=0x7fc2f4008030 comp rx=0 tx=0).stop 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 msgr2=0x7fc2f80b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 0x7fc2f80b38b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800c520 tx=0x7fc2e800c830 comp rx=0 tx=0).stop 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 shutdown_connections 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2dc065ad0 0x7fc2dc067f90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2f815ae20 0x7fc2f80b2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2f80af720 0x7fc2f80b38b0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 --2- 172.21.15.45:0/2295329260 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2f806cad0 0x7fc2f80c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 >> 172.21.15.45:0/2295329260 conn(0x7fc2f80cb900 msgr2=0x7fc2f80cc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 shutdown_connections 2023-12-19T18:01:36.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.690+0000 7fc2fef89700 1 -- 172.21.15.45:0/2295329260 wait complete. 2023-12-19T18:01:36.718 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:01:08.640298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:01:10.079199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T18:01:20.655255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:01:36.719 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:01:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.906+0000 7fa4a1291700 1 Processor -- start 2023-12-19T18:01:36.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.906+0000 7fa4a1291700 1 -- start start 2023-12-19T18:01:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa4a1291700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c15cf20 0x7fa49c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa4a1291700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 0x7fa49c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa4a1291700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa49c0d25f0 0x7fa49c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa4a1291700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c15d300 con 0x7fa49c0b8580 2023-12-19T18:01:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa4a1291700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa49c0d1550 con 0x7fa49c0d25f0 2023-12-19T18:01:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa4a1291700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c0d1830 con 0x7fa49c15cf20 2023-12-19T18:01:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49a7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 0x7fa49c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49a7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 0x7fa49c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40088/0 (socket says 172.21.15.45:40088) 2023-12-19T18:01:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49b7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa49c0d25f0 0x7fa49c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49a7fc700 1 -- 172.21.15.45:0/1517758565 learned_addr learned my addr 172.21.15.45:0/1517758565 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49affd700 1 --2- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c15cf20 0x7fa49c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49b7fe700 1 -- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c15cf20 msgr2=0x7fa49c0d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49b7fe700 1 --2- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c15cf20 0x7fa49c0d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49b7fe700 1 -- 172.21.15.45:0/1517758565 >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 msgr2=0x7fa49c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49b7fe700 1 --2- 172.21.15.45:0/1517758565 >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 0x7fa49c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49b7fe700 1 -- 172.21.15.45:0/1517758565 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c0d1b10 con 0x7fa49c0d25f0 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.910+0000 7fa49a7fc700 1 --2- 172.21.15.45:0/1517758565 >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 0x7fa49c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:36.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa49b7fe700 1 --2- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0cde00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa49c071c00 tx=0x7fa49400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79956fcc1d69bb93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa499ffb700 1 -- 172.21.15.45:0/1517758565 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa49400e070 con 0x7fa49c0d25f0 2023-12-19T18:01:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa499ffb700 1 -- 172.21.15.45:0/1517758565 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa49400bb20 con 0x7fa49c0d25f0 2023-12-19T18:01:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa499ffb700 1 -- 172.21.15.45:0/1517758565 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494012430 con 0x7fa49c0d25f0 2023-12-19T18:01:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 -- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 msgr2=0x7fa49c0cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 --2- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0cde00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa49c071c00 tx=0x7fa49400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 -- 172.21.15.45:0/1517758565 shutdown_connections 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 --2- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0cde00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 --2- 172.21.15.45:0/1517758565 >> v2:172.21.15.45:3300/0 conn(0x7fa49c0b8580 0x7fa49c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 --2- 172.21.15.45:0/1517758565 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c15cf20 0x7fa49c0d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 -- 172.21.15.45:0/1517758565 >> 172.21.15.45:0/1517758565 conn(0x7fa49c0b4670 msgr2=0x7fa49c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 -- 172.21.15.45:0/1517758565 shutdown_connections 2023-12-19T18:01:36.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.914+0000 7fa4a1291700 1 -- 172.21.15.45:0/1517758565 wait complete. 2023-12-19T18:01:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.918+0000 7fa4a1291700 1 Processor -- start 2023-12-19T18:01:36.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.918+0000 7fa4a1291700 1 -- start start 2023-12-19T18:01:36.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c0b8580 0x7fa49c1f1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 0x7fa49c14bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c0c9c50 con 0x7fa49c15cf20 2023-12-19T18:01:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c14c660 con 0x7fa49c0d25f0 2023-12-19T18:01:36.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa49c14c940 con 0x7fa49c0b8580 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 0x7fa49c14bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 0x7fa49c14bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40100/0 (socket says 172.21.15.45:40100) 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 -- 172.21.15.45:0/2645397129 learned_addr learned my addr 172.21.15.45:0/2645397129 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49a7fc700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49affd700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c0b8580 0x7fa49c1f1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 -- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c0b8580 msgr2=0x7fa49c1f1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c0b8580 0x7fa49c1f1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 -- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 msgr2=0x7fa49c0ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:36.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 -- 172.21.15.45:0/2645397129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa490009570 con 0x7fa49c15cf20 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49a7fc700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa49b7fe700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 0x7fa49c14bb80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa494014040 tx=0x7fa494004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa494004960 con 0x7fa49c15cf20 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa494020070 con 0x7fa49c15cf20 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa494009a70 con 0x7fa49c15cf20 2023-12-19T18:01:36.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4940276e0 con 0x7fa49c15cf20 2023-12-19T18:01:36.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.922+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa49c0ca180 con 0x7fa49c15cf20 2023-12-19T18:01:36.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.926+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa49c0ca370 con 0x7fa49c15cf20 2023-12-19T18:01:36.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.926+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa494012430 con 0x7fa49c15cf20 2023-12-19T18:01:36.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.926+0000 7fa4837fe700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa488065ad0 0x7fa488067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:36.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.926+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fa494022070 con 0x7fa49c15cf20 2023-12-19T18:01:36.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.930+0000 7fa49affd700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa488065ad0 0x7fa488067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:36.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.930+0000 7fa49affd700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa488065ad0 0x7fa488067f90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0098d0 tx=0x7fa48c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:36.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:36.934+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa494052c70 con 0x7fa49c15cf20 2023-12-19T18:01:37.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.114+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa49c04ed30 con 0x7fa49c15cf20 2023-12-19T18:01:37.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.114+0000 7fa4837fe700 1 -- 172.21.15.45:0/2645397129 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa494056290 con 0x7fa49c15cf20 2023-12-19T18:01:37.119 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa488065ad0 msgr2=0x7fa488067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa488065ad0 0x7fa488067f90 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa48c0098d0 tx=0x7fa48c008040 comp rx=0 tx=0).stop 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 msgr2=0x7fa49c14bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 0x7fa49c14bb80 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7fa494014040 tx=0x7fa494004af0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 shutdown_connections 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa488065ad0 0x7fa488067f90 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa49c15cf20 0x7fa49c14bb80 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa49c0d25f0 0x7fa49c0ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 --2- 172.21.15.45:0/2645397129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa49c0b8580 0x7fa49c1f1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 >> 172.21.15.45:0/2645397129 conn(0x7fa49c0b4670 msgr2=0x7fa49c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:37.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 shutdown_connections 2023-12-19T18:01:37.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.118+0000 7fa4a1291700 1 -- 172.21.15.45:0/2645397129 wait complete. 2023-12-19T18:01:37.147 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:01:37.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.330+0000 7f40ccbe6700 1 Processor -- start 2023-12-19T18:01:37.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.330+0000 7f40ccbe6700 1 -- start start 2023-12-19T18:01:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40ccbe6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c815d170 0x7f40c80ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40ccbe6700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40c80acd20 0x7f40c80ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40ccbe6700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40c8161710 con 0x7f40c80b19f0 2023-12-19T18:01:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40ccbe6700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40c81619f0 con 0x7f40c80acd20 2023-12-19T18:01:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40ccbe6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c80ac520 con 0x7f40c815d170 2023-12-19T18:01:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40c80acd20 0x7f40c80ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f40c80acd20 0x7f40c80ad1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40104/0 (socket says 172.21.15.45:40104) 2023-12-19T18:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 -- 172.21.15.45:0/1212359662 learned_addr learned my addr 172.21.15.45:0/1212359662 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c659c700 1 --2- 172.21.15.45:0/1212359662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c815d170 0x7f40c80ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 -- 172.21.15.45:0/1212359662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c815d170 msgr2=0x7f40c80ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 --2- 172.21.15.45:0/1212359662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c815d170 0x7f40c80ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 -- 172.21.15.45:0/1212359662 >> v1:172.21.15.73:6789/0 conn(0x7f40c80b19f0 legacy=0x7f40c806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 -- 172.21.15.45:0/1212359662 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c80ac800 con 0x7f40c80acd20 2023-12-19T18:01:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c6d9d700 1 --2- 172.21.15.45:0/1212359662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80acd20 0x7f40c80ad1b0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009e50 tx=0x7f40c000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fdcb2fb05912b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c559a700 1 -- 172.21.15.45:0/1212359662 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000e070 con 0x7f40c80acd20 2023-12-19T18:01:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c559a700 1 -- 172.21.15.45:0/1212359662 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c000b910 con 0x7f40c80acd20 2023-12-19T18:01:37.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.334+0000 7f40c559a700 1 -- 172.21.15.45:0/1212359662 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c000bcc0 con 0x7f40c80acd20 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1212359662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80acd20 msgr2=0x7f40c80ad1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1212359662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80acd20 0x7f40c80ad1b0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009e50 tx=0x7f40c000b330 comp rx=0 tx=0).stop 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1212359662 shutdown_connections 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1212359662 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80acd20 0x7f40c80ad1b0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1212359662 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c815d170 0x7f40c80ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1212359662 >> 172.21.15.45:0/1212359662 conn(0x7f40c8071990 msgr2=0x7f40c80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1212359662 shutdown_connections 2023-12-19T18:01:37.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.338+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1212359662 wait complete. 2023-12-19T18:01:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 Processor -- start 2023-12-19T18:01:37.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 -- start start 2023-12-19T18:01:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 0x7f40c8160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80b19f0 0x7f40c81427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c815d170 0x7f40c814eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8151b60 con 0x7f40c80b19f0 2023-12-19T18:01:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8161400 con 0x7f40c815d170 2023-12-19T18:01:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40ccbe6700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40c8150ac0 con 0x7f40c80acd20 2023-12-19T18:01:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40c5d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80b19f0 0x7f40c81427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40c659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 0x7f40c8160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40c6d9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c815d170 0x7f40c814eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40c659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 0x7f40c8160ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:35828/0 (socket says 172.21.15.45:35828) 2023-12-19T18:01:37.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.342+0000 7f40c659c700 1 -- 172.21.15.45:0/1000122562 learned_addr learned my addr 172.21.15.45:0/1000122562 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c659c700 1 -- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c815d170 msgr2=0x7f40c814eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c659c700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c815d170 0x7f40c814eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c659c700 1 -- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80b19f0 msgr2=0x7f40c81427e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c659c700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80b19f0 0x7f40c81427e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c659c700 1 -- 172.21.15.45:0/1000122562 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009b30 con 0x7f40c80acd20 2023-12-19T18:01:37.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c5d9b700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80b19f0 0x7f40c81427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40c659c700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 0x7f40c8160ec0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40b800e840 tx=0x7f40b800eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80095a0 con 0x7f40c80acd20 2023-12-19T18:01:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40b8013680 con 0x7f40c80acd20 2023-12-19T18:01:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40c8150da0 con 0x7f40c80acd20 2023-12-19T18:01:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40b80139f0 con 0x7f40c80acd20 2023-12-19T18:01:37.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40c8151360 con 0x7f40c80acd20 2023-12-19T18:01:37.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.346+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40c804ed30 con 0x7f40c80acd20 2023-12-19T18:01:37.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.350+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f40b8013b50 con 0x7f40c80acd20 2023-12-19T18:01:37.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.350+0000 7f40b6ffd700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f40a8065b20 0x7f40a8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.350+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f40b8083af0 con 0x7f40c80acd20 2023-12-19T18:01:37.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.350+0000 7f40c5d9b700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f40a8065b20 0x7f40a8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.354+0000 7f40c5d9b700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f40a8065b20 0x7f40a8067fe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f40c814e090 tx=0x7f40bc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:37.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.362+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f40b80511b0 con 0x7f40c80acd20 2023-12-19T18:01:37.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.542+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40c806cef0 con 0x7f40c80acd20 2023-12-19T18:01:37.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.542+0000 7f40b6ffd700 1 -- 172.21.15.45:0/1000122562 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f40b80547d0 con 0x7f40c80acd20 2023-12-19T18:01:37.546 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:01:37.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f40a8065b20 msgr2=0x7f40a8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f40a8065b20 0x7f40a8067fe0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f40c814e090 tx=0x7f40bc009040 comp rx=0 tx=0).stop 2023-12-19T18:01:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 msgr2=0x7f40c8160ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 0x7f40c8160ec0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f40b800e840 tx=0x7f40b800eb50 comp rx=0 tx=0).stop 2023-12-19T18:01:37.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 shutdown_connections 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f40a8065b20 0x7f40a8067fe0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40c815d170 0x7f40c814eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f40c80b19f0 0x7f40c81427e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 --2- 172.21.15.45:0/1000122562 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f40c80acd20 0x7f40c8160ec0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 >> 172.21.15.45:0/1000122562 conn(0x7f40c8071990 msgr2=0x7f40c815b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 shutdown_connections 2023-12-19T18:01:37.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.546+0000 7f40ccbe6700 1 -- 172.21.15.45:0/1000122562 wait complete. 2023-12-19T18:01:37.571 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:01:37.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 Processor -- start 2023-12-19T18:01:37.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 -- start start 2023-12-19T18:01:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f134815d0a0 0x7f13480d0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480b5f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13480d1960 con 0x7f13480d1470 2023-12-19T18:01:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13480d1c40 con 0x7f134815d0a0 2023-12-19T18:01:37.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.754+0000 7f134d043700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13480d1f20 con 0x7f13480b4fd0 2023-12-19T18:01:37.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1346d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f134815d0a0 0x7f13480d0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f13480d1470 0x7f13480b48c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40050/0 (socket says 172.21.15.45:40050) 2023-12-19T18:01:37.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134659c700 1 -- 172.21.15.45:0/1586534554 learned_addr learned my addr 172.21.15.45:0/1586534554 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:37.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134759e700 1 --2- 172.21.15.45:0/1586534554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480b5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1346d9d700 1 -- 172.21.15.45:0/1586534554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 msgr2=0x7f13480b5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:37.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1345d9b700 1 -- 172.21.15.45:0/1586534554 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572972922 0 0) 0x7f13480d1960 con 0x7f13480d1470 2023-12-19T18:01:37.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1346d9d700 1 --2- 172.21.15.45:0/1586534554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480b5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1346d9d700 1 -- 172.21.15.45:0/1586534554 >> v1:172.21.15.45:6789/0 conn(0x7f13480d1470 legacy=0x7f13480b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1346d9d700 1 -- 172.21.15.45:0/1586534554 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480d2200 con 0x7f134815d0a0 2023-12-19T18:01:37.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1346d9d700 1 --2- 172.21.15.45:0/1586534554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134815d0a0 0x7f13480d0f30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f1338009850 tx=0x7f1338009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5c5090efe9dba8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1345d9b700 1 -- 172.21.15.45:0/1586534554 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338011830 con 0x7f134815d0a0 2023-12-19T18:01:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1345d9b700 1 -- 172.21.15.45:0/1586534554 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1338011990 con 0x7f134815d0a0 2023-12-19T18:01:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f1345d9b700 1 -- 172.21.15.45:0/1586534554 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1338011d40 con 0x7f134815d0a0 2023-12-19T18:01:37.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 -- 172.21.15.45:0/1586534554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134815d0a0 msgr2=0x7f13480d0f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 --2- 172.21.15.45:0/1586534554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134815d0a0 0x7f13480d0f30 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f1338009850 tx=0x7f1338009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 -- 172.21.15.45:0/1586534554 shutdown_connections 2023-12-19T18:01:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 --2- 172.21.15.45:0/1586534554 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480b5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 --2- 172.21.15.45:0/1586534554 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f134815d0a0 0x7f13480d0f30 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 -- 172.21.15.45:0/1586534554 >> 172.21.15.45:0/1586534554 conn(0x7f13480cf8c0 msgr2=0x7f13480cfcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 -- 172.21.15.45:0/1586534554 shutdown_connections 2023-12-19T18:01:37.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.758+0000 7f134d043700 1 -- 172.21.15.45:0/1586534554 wait complete. 2023-12-19T18:01:37.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.762+0000 7f134d043700 1 Processor -- start 2023-12-19T18:01:37.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.762+0000 7f134d043700 1 -- start start 2023-12-19T18:01:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 0x7f13480ca0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f134815d0a0 0x7f1348149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f134815e130 con 0x7f13480d1470 2023-12-19T18:01:37.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13480ca5f0 con 0x7f134815d0a0 2023-12-19T18:01:37.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f134815d520 con 0x7f13480b4fd0 2023-12-19T18:01:37.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 0x7f13480ca0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 0x7f13480ca0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40140/0 (socket says 172.21.15.45:40140) 2023-12-19T18:01:37.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 -- 172.21.15.45:0/2824137305 learned_addr learned my addr 172.21.15.45:0/2824137305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f1346d9d700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134759e700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f134815d0a0 0x7f1348149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 -- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 msgr2=0x7f13480c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 -- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f134815d0a0 msgr2=0x7f1348149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f134815d0a0 0x7f1348149e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 -- 172.21.15.45:0/2824137305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13380094b0 con 0x7f13480d1470 2023-12-19T18:01:37.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134659c700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 0x7f13480ca0b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f133c00c750 tx=0x7f133c00ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c005d90 con 0x7f13480d1470 2023-12-19T18:01:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f133c0070d0 con 0x7f13480d1470 2023-12-19T18:01:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f133c007480 con 0x7f13480d1470 2023-12-19T18:01:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f134815d800 con 0x7f13480d1470 2023-12-19T18:01:37.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.766+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f134815ddc0 con 0x7f13480d1470 2023-12-19T18:01:37.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.770+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1348153e70 con 0x7f13480d1470 2023-12-19T18:01:37.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.770+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f133c0075e0 con 0x7f13480d1470 2023-12-19T18:01:37.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.774+0000 7f132f7fe700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1334065ad0 0x7f1334067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:37.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.774+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f133c0829c0 con 0x7f13480d1470 2023-12-19T18:01:37.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.774+0000 7f1346d9d700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1334065ad0 0x7f1334067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:37.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.774+0000 7f1346d9d700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1334065ad0 0x7f1334067f90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f13380090b0 tx=0x7f133801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:37.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.778+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f133c04ff70 con 0x7f13480d1470 2023-12-19T18:01:37.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.958+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f134804ed30 con 0x7f13480d1470 2023-12-19T18:01:37.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.962+0000 7f132f7fe700 1 -- 172.21.15.45:0/2824137305 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f133c0170a0 con 0x7f13480d1470 2023-12-19T18:01:37.965 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:01:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1334065ad0 msgr2=0x7f1334067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1334065ad0 0x7f1334067f90 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f13380090b0 tx=0x7f133801c040 comp rx=0 tx=0).stop 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 msgr2=0x7f13480ca0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 0x7f13480ca0b0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f133c00c750 tx=0x7f133c00ca60 comp rx=0 tx=0).stop 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 shutdown_connections 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1334065ad0 0x7f1334067f90 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f134815d0a0 0x7f1348149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f13480d1470 0x7f13480ca0b0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 --2- 172.21.15.45:0/2824137305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f13480b4fd0 0x7f13480c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 >> 172.21.15.45:0/2824137305 conn(0x7f13480cf8c0 msgr2=0x7f13480b7150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 shutdown_connections 2023-12-19T18:01:37.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:37.966+0000 7f134d043700 1 -- 172.21.15.45:0/2824137305 wait complete. 2023-12-19T18:01:37.993 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T18:01:38.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.162+0000 7efeb7a34700 1 Processor -- start 2023-12-19T18:01:38.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.162+0000 7efeb7a34700 1 -- start start 2023-12-19T18:01:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb7a34700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efeb01626c0 0x7efeb01619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb7a34700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb00b1d20 con 0x7efeb00b2490 2023-12-19T18:01:38.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb7a34700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efeb006ec50 con 0x7efeb006dd70 2023-12-19T18:01:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb7a34700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efeb00b2c00 con 0x7efeb01626c0 2023-12-19T18:01:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb4fcf700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efeb00b2490 0x7efeb006d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40056/0 (socket says 172.21.15.45:40056) 2023-12-19T18:01:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb57d0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efeb01626c0 0x7efeb01619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb4fcf700 1 -- 172.21.15.45:0/1115563799 learned_addr learned my addr 172.21.15.45:0/1115563799 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:38.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005283043 0 0) 0x7efeb00b1d20 con 0x7efeb00b2490 2023-12-19T18:01:38.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe9c0035d0 con 0x7efeb00b2490 2023-12-19T18:01:38.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424850984 0 0) 0x7efeb006ec50 con 0x7efeb006dd70 2023-12-19T18:01:38.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb00b1d20 con 0x7efeb006dd70 2023-12-19T18:01:38.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb57d0700 1 -- 172.21.15.45:0/1115563799 >> v1:172.21.15.73:6789/0 conn(0x7efeb006dd70 legacy=0x7efeb006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb57d0700 1 -- 172.21.15.45:0/1115563799 >> v1:172.21.15.45:6789/0 conn(0x7efeb00b2490 legacy=0x7efeb006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb57d0700 1 -- 172.21.15.45:0/1115563799 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb00b2ee0 con 0x7efeb01626c0 2023-12-19T18:01:38.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.166+0000 7efeb57d0700 1 --2- 172.21.15.45:0/1115563799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb01626c0 0x7efeb01619b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efeac009850 tx=0x7efeac009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deba7629cc619e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:38.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011830 con 0x7efeb01626c0 2023-12-19T18:01:38.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac011990 con 0x7efeb01626c0 2023-12-19T18:01:38.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efea7fff700 1 -- 172.21.15.45:0/1115563799 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac011d40 con 0x7efeb01626c0 2023-12-19T18:01:38.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 -- 172.21.15.45:0/1115563799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb01626c0 msgr2=0x7efeb01619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 --2- 172.21.15.45:0/1115563799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb01626c0 0x7efeb01619b0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7efeac009850 tx=0x7efeac009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:38.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 -- 172.21.15.45:0/1115563799 shutdown_connections 2023-12-19T18:01:38.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 --2- 172.21.15.45:0/1115563799 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb01626c0 0x7efeb01619b0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 -- 172.21.15.45:0/1115563799 >> 172.21.15.45:0/1115563799 conn(0x7efeb0071990 msgr2=0x7efeb00b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:38.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 -- 172.21.15.45:0/1115563799 shutdown_connections 2023-12-19T18:01:38.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.170+0000 7efeb7a34700 1 -- 172.21.15.45:0/1115563799 wait complete. 2023-12-19T18:01:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 Processor -- start 2023-12-19T18:01:38.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 -- start start 2023-12-19T18:01:38.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 0x7efeb014dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb00b2490 0x7efeb01609e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efeb01626c0 0x7efeb0160f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb01605c0 con 0x7efeb006dd70 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efeb014e1b0 con 0x7efeb00b2490 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb7a34700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efeb015f660 con 0x7efeb01626c0 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb57d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 0x7efeb014dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb57d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 0x7efeb014dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40154/0 (socket says 172.21.15.45:40154) 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb57d0700 1 -- 172.21.15.45:0/3233453939 learned_addr learned my addr 172.21.15.45:0/3233453939 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb4fcf700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb00b2490 0x7efeb01609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb5fd1700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efeb01626c0 0x7efeb0160f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb57d0700 1 -- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efeb01626c0 msgr2=0x7efeb0160f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.174+0000 7efeb57d0700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efeb01626c0 0x7efeb0160f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb57d0700 1 -- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb00b2490 msgr2=0x7efeb01609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb57d0700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb00b2490 0x7efeb01609e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb57d0700 1 -- 172.21.15.45:0/3233453939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeac0094b0 con 0x7efeb006dd70 2023-12-19T18:01:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb4fcf700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb00b2490 0x7efeb01609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb5fd1700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efeb01626c0 0x7efeb0160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:38.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb57d0700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 0x7efeb014dc70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7efeac0090b0 tx=0x7efeac004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac0199f0 con 0x7efeb006dd70 2023-12-19T18:01:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeac01e070 con 0x7efeb006dd70 2023-12-19T18:01:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac019db0 con 0x7efeb006dd70 2023-12-19T18:01:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efeb015f940 con 0x7efeb006dd70 2023-12-19T18:01:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efeb015ff00 con 0x7efeb006dd70 2023-12-19T18:01:38.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.178+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efeb0160830 con 0x7efeb006dd70 2023-12-19T18:01:38.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.182+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efeac02d450 con 0x7efeb006dd70 2023-12-19T18:01:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.182+0000 7efea5ffb700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe94065ad0 0x7efe94067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.182+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7efeac084400 con 0x7efeb006dd70 2023-12-19T18:01:38.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.182+0000 7efeb4fcf700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe94065ad0 0x7efe94067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.182+0000 7efeb4fcf700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe94065ad0 0x7efe94067f90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efeb00cb140 tx=0x7efea0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:38.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.190+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efeac051c30 con 0x7efeb006dd70 2023-12-19T18:01:38.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.378+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7efeb004ed30 con 0x7efeb006dd70 2023-12-19T18:01:38.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.378+0000 7efea5ffb700 1 -- 172.21.15.45:0/3233453939 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v110) v1 ==== 106+0+11 (secure 0 0 0) 0x7efeac055250 con 0x7efeb006dd70 2023-12-19T18:01:38.383 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:01:38.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe94065ad0 msgr2=0x7efe94067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe94065ad0 0x7efe94067f90 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efeb00cb140 tx=0x7efea0009040 comp rx=0 tx=0).stop 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 msgr2=0x7efeb014dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 0x7efeb014dc70 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7efeac0090b0 tx=0x7efeac004770 comp rx=0 tx=0).stop 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 shutdown_connections 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efe94065ad0 0x7efe94067f90 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efeb01626c0 0x7efeb0160f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efeb00b2490 0x7efeb01609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 --2- 172.21.15.45:0/3233453939 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efeb006dd70 0x7efeb014dc70 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 >> 172.21.15.45:0/3233453939 conn(0x7efeb0071990 msgr2=0x7efeb00cbd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 shutdown_connections 2023-12-19T18:01:38.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.382+0000 7efeb7a34700 1 -- 172.21.15.45:0/3233453939 wait complete. 2023-12-19T18:01:38.408 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:01:38.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9f4998700 1 Processor -- start 2023-12-19T18:01:38.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9f4998700 1 -- start start 2023-12-19T18:01:38.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9f4998700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd9f01609b0 0x7fd9f0160e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9f4998700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f00cdc30 con 0x7fd9f015cec0 2023-12-19T18:01:38.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9f4998700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f00aeeb0 con 0x7fd9f00c9fa0 2023-12-19T18:01:38.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9f4998700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f015d2a0 con 0x7fd9f01609b0 2023-12-19T18:01:38.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9eed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd9f015cec0 0x7fd9f00cd520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:40064/0 (socket says 172.21.15.45:40064) 2023-12-19T18:01:38.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9eed9d700 1 -- 172.21.15.45:0/1561450089 learned_addr learned my addr 172.21.15.45:0/1561450089 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:38.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936552213 0 0) 0x7fd9f00cdc30 con 0x7fd9f015cec0 2023-12-19T18:01:38.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9d80035d0 con 0x7fd9f015cec0 2023-12-19T18:01:38.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.594+0000 7fd9ee59c700 1 --2- 172.21.15.45:0/1561450089 >> v2:172.21.15.73:3300/0 conn(0x7fd9f01609b0 0x7fd9f0160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3782439759 0 0) 0x7fd9d80035d0 con 0x7fd9f015cec0 2023-12-19T18:01:38.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 >> v2:172.21.15.73:3300/0 conn(0x7fd9f01609b0 msgr2=0x7fd9f0160e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:38.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 --2- 172.21.15.45:0/1561450089 >> v2:172.21.15.73:3300/0 conn(0x7fd9f01609b0 0x7fd9f0160e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 >> v1:172.21.15.73:6789/0 conn(0x7fd9f00c9fa0 legacy=0x7fd9f00ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0161520 con 0x7fd9f015cec0 2023-12-19T18:01:38.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fd9e0001670 con 0x7fd9f015cec0 2023-12-19T18:01:38.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 >> v1:172.21.15.45:6789/0 conn(0x7fd9f015cec0 legacy=0x7fd9f00cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9d8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9d8004870 0x7fd9d8004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9d8005230 0x7fd9d800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f015d2a0 con 0x7fd9d8003a20 2023-12-19T18:01:38.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d800c180 con 0x7fd9d8005230 2023-12-19T18:01:38.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d800c340 con 0x7fd9d8004870 2023-12-19T18:01:38.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9d8003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9ee59c700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9d8004870 0x7fd9d8004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9ef59e700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9d8005230 0x7fd9d800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 -- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9d8004870 msgr2=0x7fd9d8004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9d8004870 0x7fd9d8004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 -- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9d8005230 msgr2=0x7fd9d800ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9d8005230 0x7fd9d800ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 -- 172.21.15.45:0/1561450089 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80035d0 con 0x7fd9d8003a20 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9ef59e700 1 -- 172.21.15.45:0/1561450089 reap_dead start 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9d8003e40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c320 tx=0x7fd9d80058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34522293a770321a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0007c30 con 0x7fd9d8003a20 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e000ce80 con 0x7fd9d8003a20 2023-12-19T18:01:38.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9edd9b700 1 -- 172.21.15.45:0/1561450089 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0005bc0 con 0x7fd9d8003a20 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9f4998700 1 -- 172.21.15.45:0/1561450089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 msgr2=0x7fd9d8003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.598+0000 7fd9f4998700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9d8003e40 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fd9e000c320 tx=0x7fd9d80058a0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.602+0000 7fd9f4998700 1 -- 172.21.15.45:0/1561450089 shutdown_connections 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.602+0000 7fd9f4998700 1 --2- 172.21.15.45:0/1561450089 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9d8003e40 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.602+0000 7fd9f4998700 1 -- 172.21.15.45:0/1561450089 >> 172.21.15.45:0/1561450089 conn(0x7fd9f00cf950 msgr2=0x7fd9f00cfd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.602+0000 7fd9f4998700 1 -- 172.21.15.45:0/1561450089 shutdown_connections 2023-12-19T18:01:38.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.602+0000 7fd9f4998700 1 -- 172.21.15.45:0/1561450089 wait complete. 2023-12-19T18:01:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.602+0000 7fd9f4998700 1 Processor -- start 2023-12-19T18:01:38.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 -- start start 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9f00ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f0150760 0x7fd9f00c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9f00c9b60 0x7fd9f00b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c8580 con 0x7fd9d8003a20 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c8860 con 0x7fd9f0150760 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c8b40 con 0x7fd9f00c9b60 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9f00ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9f00ae5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40172/0 (socket says 172.21.15.45:40172) 2023-12-19T18:01:38.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 -- 172.21.15.45:0/4178666856 learned_addr learned my addr 172.21.15.45:0/4178666856 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9ef59e700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9f00c9b60 0x7fd9f00b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9ee59c700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f0150760 0x7fd9f00c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 -- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9f00c9b60 msgr2=0x7fd9f00b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9f00c9b60 0x7fd9f00b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 -- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f0150760 msgr2=0x7fd9f00c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f0150760 0x7fd9f00c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 -- 172.21.15.45:0/4178666856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f00c8e20 con 0x7fd9d8003a20 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9ee59c700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f0150760 0x7fd9f00c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9eed9d700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9f00ae5c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800c150 tx=0x7fd9e0001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0001630 con 0x7fd9d8003a20 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9e00070d0 con 0x7fd9d8003a20 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e0007460 con 0x7fd9d8003a20 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f00c9100 con 0x7fd9d8003a20 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.606+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f00c8270 con 0x7fd9d8003a20 2023-12-19T18:01:38.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.610+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f00c89a0 con 0x7fd9d8003a20 2023-12-19T18:01:38.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.610+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd9e00075c0 con 0x7fd9d8003a20 2023-12-19T18:01:38.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.614+0000 7fd9d77fe700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9dc065ad0 0x7fd9dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:38.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.614+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fd9e0084600 con 0x7fd9d8003a20 2023-12-19T18:01:38.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.614+0000 7fd9ee59c700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9dc065ad0 0x7fd9dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:38.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.614+0000 7fd9ee59c700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9dc065ad0 0x7fd9dc067f90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00c9f70 tx=0x7fd9e4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:38.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.618+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd9f00c89a0 con 0x7fd9d8003a20 2023-12-19T18:01:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.810+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd9f00c89a0 con 0x7fd9d8003a20 2023-12-19T18:01:38.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.814+0000 7fd9d77fe700 1 -- 172.21.15.45:0/4178666856 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd9f00c89a0 con 0x7fd9d8003a20 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9dc065ad0 msgr2=0x7fd9dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9dc065ad0 0x7fd9dc067f90 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd9f00c9f70 tx=0x7fd9e4008040 comp rx=0 tx=0).stop 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 msgr2=0x7fd9f00ae5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9f00ae5c0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800c150 tx=0x7fd9e0001a00 comp rx=0 tx=0).stop 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 shutdown_connections 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd9dc065ad0 0x7fd9dc067f90 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd9f00c9b60 0x7fd9f00b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd9f0150760 0x7fd9f00c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 --2- 172.21.15.45:0/4178666856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd9d8003a20 0x7fd9f00ae5c0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 >> 172.21.15.45:0/4178666856 conn(0x7fd9f00cf950 msgr2=0x7fd9f015f480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 shutdown_connections 2023-12-19T18:01:38.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:38.818+0000 7fd9f4998700 1 -- 172.21.15.45:0/4178666856 wait complete. 2023-12-19T18:01:38.825 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T18:01:38.847 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:01:38.847 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:01:38.865 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:01:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.086+0000 7fee11199700 1 Processor -- start 2023-12-19T18:01:39.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.086+0000 7fee11199700 1 -- start start 2023-12-19T18:01:39.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee11199700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c0b2240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee11199700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c06fc40 con 0x7fee0c0d2190 2023-12-19T18:01:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee11199700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0c0d1db0 con 0x7fee0c0d1330 2023-12-19T18:01:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee11199700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0d2620 con 0x7fee0c15d1e0 2023-12-19T18:01:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee0a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fee0c0d2190 0x7fee0c0d0c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51380/0 (socket says 172.21.15.45:51380) 2023-12-19T18:01:39.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee0a59c700 1 -- 172.21.15.45:0/2817063350 learned_addr learned my addr 172.21.15.45:0/2817063350 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.090+0000 7fee0ad9d700 1 --2- 172.21.15.45:0/2817063350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c0b2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee09d9b700 1 -- 172.21.15.45:0/2817063350 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796826171 0 0) 0x7fee0c06fc40 con 0x7fee0c0d2190 2023-12-19T18:01:39.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee09d9b700 1 -- 172.21.15.45:0/2817063350 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf40035d0 con 0x7fee0c0d2190 2023-12-19T18:01:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee0ad9d700 1 -- 172.21.15.45:0/2817063350 >> v1:172.21.15.73:6789/0 conn(0x7fee0c0d1330 legacy=0x7fee0c0b6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee09d9b700 1 -- 172.21.15.45:0/2817063350 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1656806602 0 0) 0x7fee0c0d1db0 con 0x7fee0c0d1330 2023-12-19T18:01:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee0ad9d700 1 -- 172.21.15.45:0/2817063350 >> v1:172.21.15.45:6789/0 conn(0x7fee0c0d2190 legacy=0x7fee0c0d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee0ad9d700 1 -- 172.21.15.45:0/2817063350 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0c0d17f0 con 0x7fee0c15d1e0 2023-12-19T18:01:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee0ad9d700 1 --2- 172.21.15.45:0/2817063350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c0b2240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009880 tx=0x7fedfc009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d67135646b0f4901 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee09d9b700 1 -- 172.21.15.45:0/2817063350 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc011830 con 0x7fee0c15d1e0 2023-12-19T18:01:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee09d9b700 1 -- 172.21.15.45:0/2817063350 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc011990 con 0x7fee0c15d1e0 2023-12-19T18:01:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee09d9b700 1 -- 172.21.15.45:0/2817063350 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc011d00 con 0x7fee0c15d1e0 2023-12-19T18:01:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 -- 172.21.15.45:0/2817063350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 msgr2=0x7fee0c0b2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 --2- 172.21.15.45:0/2817063350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c0b2240 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fedfc009880 tx=0x7fedfc009b90 comp rx=0 tx=0).stop 2023-12-19T18:01:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 -- 172.21.15.45:0/2817063350 shutdown_connections 2023-12-19T18:01:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 --2- 172.21.15.45:0/2817063350 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c0b2240 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 -- 172.21.15.45:0/2817063350 >> 172.21.15.45:0/2817063350 conn(0x7fee0c0d2e40 msgr2=0x7fee0c0d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 -- 172.21.15.45:0/2817063350 shutdown_connections 2023-12-19T18:01:39.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.094+0000 7fee11199700 1 -- 172.21.15.45:0/2817063350 wait complete. 2023-12-19T18:01:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.098+0000 7fee11199700 1 Processor -- start 2023-12-19T18:01:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.098+0000 7fee11199700 1 -- start start 2023-12-19T18:01:39.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 0x7fee0c15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0c160590 0x7fee0c1f1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c0c9680 con 0x7fee0c0d1330 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c15e9c0 con 0x7fee0c160590 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee0c15eca0 con 0x7fee0c15d1e0 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 0x7fee0c15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 0x7fee0c15b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40536/0 (socket says 172.21.15.45:40536) 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 -- 172.21.15.45:0/3574521834 learned_addr learned my addr 172.21.15.45:0/3574521834 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0a59c700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0b59e700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0c160590 0x7fee0c1f1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 -- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 msgr2=0x7fee0c160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c160050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 -- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0c160590 msgr2=0x7fee0c1f1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0c160590 0x7fee0c1f1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 -- 172.21.15.45:0/3574521834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedfc0094b0 con 0x7fee0c0d1330 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0a59c700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee0ad9d700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 0x7fee0c15b260 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0090b0 tx=0x7fedfc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc0044d0 con 0x7fee0c0d1330 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedfc0036c0 con 0x7fee0c0d1330 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedfc003a70 con 0x7fee0c0d1330 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee0c15ef80 con 0x7fee0c0d1330 2023-12-19T18:01:39.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.102+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee0c15f540 con 0x7fee0c0d1330 2023-12-19T18:01:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.106+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee0c04ed30 con 0x7fee0c0d1330 2023-12-19T18:01:39.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.106+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fedfc003bd0 con 0x7fee0c0d1330 2023-12-19T18:01:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.110+0000 7fedf37fe700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fedf8065ad0 0x7fedf8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.110+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7fedfc084be0 con 0x7fee0c0d1330 2023-12-19T18:01:39.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.110+0000 7fee0a59c700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fedf8065ad0 0x7fedf8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.110+0000 7fee0a59c700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fedf8065ad0 0x7fedf8067f90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fee0c1f7170 tx=0x7fee00009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.114+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fedfc052470 con 0x7fee0c0d1330 2023-12-19T18:01:39.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.294+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee0c0cd250 con 0x7fee0c0d1330 2023-12-19T18:01:39.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.298+0000 7fedf37fe700 1 -- 172.21.15.45:0/3574521834 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+17998 (secure 0 0 0) 0x7fedfc055a90 con 0x7fee0c0d1330 2023-12-19T18:01:39.303 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:39.303 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":110,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:22.181434+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fedf8065ad0 msgr2=0x7fedf8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fedf8065ad0 0x7fedf8067f90 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fee0c1f7170 tx=0x7fee00009040 comp rx=0 tx=0).stop 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 msgr2=0x7fee0c15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 0x7fee0c15b260 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fedfc0090b0 tx=0x7fedfc004770 comp rx=0 tx=0).stop 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 shutdown_connections 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fedf8065ad0 0x7fedf8067f90 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee0c160590 0x7fee0c1f1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee0c15d1e0 0x7fee0c160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 --2- 172.21.15.45:0/3574521834 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee0c0d1330 0x7fee0c15b260 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 >> 172.21.15.45:0/3574521834 conn(0x7fee0c0d2e40 msgr2=0x7fee0c0c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 shutdown_connections 2023-12-19T18:01:39.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.302+0000 7fee11199700 1 -- 172.21.15.45:0/3574521834 wait complete. 2023-12-19T18:01:39.331 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:01:08.640298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:01:10.079199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T18:01:20.655255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:01:39.331 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:01:39.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.518+0000 7f741f59e700 1 Processor -- start 2023-12-19T18:01:39.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.518+0000 7f741f59e700 1 -- start start 2023-12-19T18:01:39.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74200b8580 0x7f74200cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74200d25f0 0x7f74200cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f742015d300 con 0x7f742015cf20 2023-12-19T18:01:39.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200d1360 con 0x7f74200d25f0 2023-12-19T18:01:39.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74200d1550 con 0x7f74200b8580 2023-12-19T18:01:39.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74200d25f0 0x7f74200cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741dd9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74200b8580 0x7f74200cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741e59c700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f742015cf20 0x7f74200d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:42364/0 (socket says 172.21.15.45:42364) 2023-12-19T18:01:39.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741e59c700 1 -- 172.21.15.45:0/2301035298 learned_addr learned my addr 172.21.15.45:0/2301035298 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:39.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741ed9d700 1 -- 172.21.15.45:0/2301035298 >> v2:172.21.15.73:3300/0 conn(0x7f74200b8580 msgr2=0x7f74200cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:39.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741d59a700 1 -- 172.21.15.45:0/2301035298 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4154348645 0 0) 0x7f742015d300 con 0x7f742015cf20 2023-12-19T18:01:39.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741ed9d700 1 --2- 172.21.15.45:0/2301035298 >> v2:172.21.15.73:3300/0 conn(0x7f74200b8580 0x7f74200cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741ed9d700 1 -- 172.21.15.45:0/2301035298 >> v1:172.21.15.73:6789/0 conn(0x7f742015cf20 legacy=0x7f74200d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.522+0000 7f741ed9d700 1 -- 172.21.15.45:0/2301035298 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74200d1830 con 0x7f74200d25f0 2023-12-19T18:01:39.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741ed9d700 1 --2- 172.21.15.45:0/2301035298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200cde00 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f74200ce9d0 tx=0x7f741800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ff465e3ece1ef6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741d59a700 1 -- 172.21.15.45:0/2301035298 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741800e070 con 0x7f74200d25f0 2023-12-19T18:01:39.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741d59a700 1 -- 172.21.15.45:0/2301035298 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741800bb20 con 0x7f74200d25f0 2023-12-19T18:01:39.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741d59a700 1 -- 172.21.15.45:0/2301035298 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418012430 con 0x7f74200d25f0 2023-12-19T18:01:39.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 -- 172.21.15.45:0/2301035298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 msgr2=0x7f74200cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 --2- 172.21.15.45:0/2301035298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200cde00 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f74200ce9d0 tx=0x7f741800b330 comp rx=0 tx=0).stop 2023-12-19T18:01:39.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 -- 172.21.15.45:0/2301035298 shutdown_connections 2023-12-19T18:01:39.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 --2- 172.21.15.45:0/2301035298 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200cde00 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 --2- 172.21.15.45:0/2301035298 >> v2:172.21.15.73:3300/0 conn(0x7f74200b8580 0x7f74200cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 -- 172.21.15.45:0/2301035298 >> 172.21.15.45:0/2301035298 conn(0x7f74200b4670 msgr2=0x7f74200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:39.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 -- 172.21.15.45:0/2301035298 shutdown_connections 2023-12-19T18:01:39.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.526+0000 7f741f59e700 1 -- 172.21.15.45:0/2301035298 wait complete. 2023-12-19T18:01:39.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 Processor -- start 2023-12-19T18:01:39.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 -- start start 2023-12-19T18:01:39.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74200b8580 0x7f74200a9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742015cf20 0x7f742015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200c9c50 con 0x7f74200d25f0 2023-12-19T18:01:39.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74200aacd0 con 0x7f742015cf20 2023-12-19T18:01:39.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74200c9f10 con 0x7f74200b8580 2023-12-19T18:01:39.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200aa2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40556/0 (socket says 172.21.15.45:40556) 2023-12-19T18:01:39.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.530+0000 7f741dd9b700 1 -- 172.21.15.45:0/1958159322 learned_addr learned my addr 172.21.15.45:0/1958159322 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:39.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741e59c700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74200b8580 0x7f74200a9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741ed9d700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742015cf20 0x7f742015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741dd9b700 1 -- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74200b8580 msgr2=0x7f74200a9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741dd9b700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74200b8580 0x7f74200a9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741dd9b700 1 -- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742015cf20 msgr2=0x7f742015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741dd9b700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742015cf20 0x7f742015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741dd9b700 1 -- 172.21.15.45:0/1958159322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7418009a70 con 0x7f74200d25f0 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741e59c700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74200b8580 0x7f74200a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:39.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741dd9b700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200aa2a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f741400e840 tx=0x7f741400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140095a0 con 0x7f74200d25f0 2023-12-19T18:01:39.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7414013680 con 0x7f74200d25f0 2023-12-19T18:01:39.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74140139f0 con 0x7f74200d25f0 2023-12-19T18:01:39.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74200ca1f0 con 0x7f74200d25f0 2023-12-19T18:01:39.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.534+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74200ca9f0 con 0x7f74200d25f0 2023-12-19T18:01:39.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.538+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74200cac10 con 0x7f74200d25f0 2023-12-19T18:01:39.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.538+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7414013b50 con 0x7f74200d25f0 2023-12-19T18:01:39.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.538+0000 7f740effd700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7400065ad0 0x7f7400067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.538+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f74140832a0 con 0x7f74200d25f0 2023-12-19T18:01:39.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.538+0000 7f741e59c700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7400065ad0 0x7f7400067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.542+0000 7f741e59c700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7400065ad0 0x7f7400067f90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7410000f60 tx=0x7f7410007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.546+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f74200cac10 con 0x7f74200d25f0 2023-12-19T18:01:39.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.722+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74200cac10 con 0x7f74200d25f0 2023-12-19T18:01:39.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f740effd700 1 -- 172.21.15.45:0/1958159322 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74200cac10 con 0x7f74200d25f0 2023-12-19T18:01:39.729 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7400065ad0 msgr2=0x7f7400067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7400065ad0 0x7f7400067f90 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7410000f60 tx=0x7f7410007e00 comp rx=0 tx=0).stop 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 msgr2=0x7f74200aa2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200aa2a0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f741400e840 tx=0x7f741400eb50 comp rx=0 tx=0).stop 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 shutdown_connections 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7400065ad0 0x7f7400067f90 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f742015cf20 0x7f742015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74200d25f0 0x7f74200aa2a0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 --2- 172.21.15.45:0/1958159322 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74200b8580 0x7f74200a9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 >> 172.21.15.45:0/1958159322 conn(0x7f74200b4670 msgr2=0x7f742015c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:39.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.726+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 shutdown_connections 2023-12-19T18:01:39.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.730+0000 7f741f59e700 1 -- 172.21.15.45:0/1958159322 wait complete. 2023-12-19T18:01:39.753 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:01:39.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.942+0000 7f300d45e700 1 Processor -- start 2023-12-19T18:01:39.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.946+0000 7f300d45e700 1 -- start start 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.946+0000 7f300d45e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f300815d1c0 0x7f30080d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.946+0000 7f300d45e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30080b4f60 0x7f30080b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.946+0000 7f300d45e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30080d17c0 con 0x7f30080d0e50 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.946+0000 7f300d45e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080d1aa0 con 0x7f30080b4f60 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.946+0000 7f300d45e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30080d1d80 con 0x7f300815d1c0 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30077fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f30080b4f60 0x7f30080b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30067fc700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f30080d0e50 0x7f30080b4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:42374/0 (socket says 172.21.15.45:42374) 2023-12-19T18:01:39.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30067fc700 1 -- 172.21.15.45:0/2535508081 learned_addr learned my addr 172.21.15.45:0/2535508081 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f3006ffd700 1 --2- 172.21.15.45:0/2535508081 >> v2:172.21.15.73:3300/0 conn(0x7f300815d1c0 0x7f30080d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f3005ffb700 1 -- 172.21.15.45:0/2535508081 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 867412462 0 0) 0x7f30080d17c0 con 0x7f30080d0e50 2023-12-19T18:01:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f3005ffb700 1 -- 172.21.15.45:0/2535508081 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff00035d0 con 0x7f30080d0e50 2023-12-19T18:01:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30077fe700 1 -- 172.21.15.45:0/2535508081 >> v2:172.21.15.73:3300/0 conn(0x7f300815d1c0 msgr2=0x7f30080d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30077fe700 1 --2- 172.21.15.45:0/2535508081 >> v2:172.21.15.73:3300/0 conn(0x7f300815d1c0 0x7f30080d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30077fe700 1 -- 172.21.15.45:0/2535508081 >> v1:172.21.15.73:6789/0 conn(0x7f30080d0e50 legacy=0x7f30080b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30077fe700 1 -- 172.21.15.45:0/2535508081 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30080d2060 con 0x7f30080b4f60 2023-12-19T18:01:39.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f30077fe700 1 --2- 172.21.15.45:0/2535508081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080b5f00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f30080cd620 tx=0x7f300000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85faf2ef24dcdb0f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f3005ffb700 1 -- 172.21.15.45:0/2535508081 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300000e070 con 0x7f30080b4f60 2023-12-19T18:01:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f3005ffb700 1 -- 172.21.15.45:0/2535508081 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300000bb20 con 0x7f30080b4f60 2023-12-19T18:01:39.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f3005ffb700 1 -- 172.21.15.45:0/2535508081 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000012430 con 0x7f30080b4f60 2023-12-19T18:01:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f300d45e700 1 -- 172.21.15.45:0/2535508081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 msgr2=0x7f30080b5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.950+0000 7f300d45e700 1 --2- 172.21.15.45:0/2535508081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080b5f00 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f30080cd620 tx=0x7f300000b330 comp rx=0 tx=0).stop 2023-12-19T18:01:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 -- 172.21.15.45:0/2535508081 shutdown_connections 2023-12-19T18:01:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 --2- 172.21.15.45:0/2535508081 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080b5f00 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 --2- 172.21.15.45:0/2535508081 >> v2:172.21.15.73:3300/0 conn(0x7f300815d1c0 0x7f30080d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 -- 172.21.15.45:0/2535508081 >> 172.21.15.45:0/2535508081 conn(0x7f30080cfa30 msgr2=0x7f30080cfe40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 -- 172.21.15.45:0/2535508081 shutdown_connections 2023-12-19T18:01:39.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 -- 172.21.15.45:0/2535508081 wait complete. 2023-12-19T18:01:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 Processor -- start 2023-12-19T18:01:39.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.954+0000 7f300d45e700 1 -- start start 2023-12-19T18:01:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30080d0e50 0x7f30081f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300815d1c0 0x7f30081f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30080c6940 con 0x7f30080b4f60 2023-12-19T18:01:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30080c6bb0 con 0x7f300815d1c0 2023-12-19T18:01:39.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30080c6e90 con 0x7f30080d0e50 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40580/0 (socket says 172.21.15.45:40580) 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 -- 172.21.15.45:0/1919079214 learned_addr learned my addr 172.21.15.45:0/1919079214 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f30067fc700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30080d0e50 0x7f30081f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f30077fe700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300815d1c0 0x7f30081f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 -- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30080d0e50 msgr2=0x7f30081f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30080d0e50 0x7f30081f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 -- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300815d1c0 msgr2=0x7f30081f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:39.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300815d1c0 0x7f30081f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 -- 172.21.15.45:0/1919079214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3000009a70 con 0x7f30080b4f60 2023-12-19T18:01:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f3006ffd700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080c8cc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800e840 tx=0x7f2ff800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80095a0 con 0x7f30080b4f60 2023-12-19T18:01:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff800c690 con 0x7f30080b4f60 2023-12-19T18:01:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30080c7170 con 0x7f30080b4f60 2023-12-19T18:01:39.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff800ca00 con 0x7f30080b4f60 2023-12-19T18:01:39.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.958+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30080c9510 con 0x7f30080b4f60 2023-12-19T18:01:39.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.962+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30080c7300 con 0x7f30080b4f60 2023-12-19T18:01:39.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.962+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2ff800cb60 con 0x7f30080b4f60 2023-12-19T18:01:39.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.962+0000 7f2fef7fe700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ff4065ad0 0x7f2ff4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:39.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.962+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f2ff80833e0 con 0x7f30080b4f60 2023-12-19T18:01:39.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.962+0000 7f30067fc700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ff4065ad0 0x7f2ff4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:39.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.966+0000 7f30067fc700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ff4065ad0 0x7f2ff4067f90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f30081f5650 tx=0x7f2ffc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:39.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:39.970+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2ff8050b50 con 0x7f30080b4f60 2023-12-19T18:01:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.150+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f300804ed30 con 0x7f30080b4f60 2023-12-19T18:01:40.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f2fef7fe700 1 -- 172.21.15.45:0/1919079214 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ff8054170 con 0x7f30080b4f60 2023-12-19T18:01:40.157 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:01:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ff4065ad0 msgr2=0x7f2ff4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ff4065ad0 0x7f2ff4067f90 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f30081f5650 tx=0x7f2ffc009040 comp rx=0 tx=0).stop 2023-12-19T18:01:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 msgr2=0x7f30080c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080c8cc0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f2ff800e840 tx=0x7f2ff800ec00 comp rx=0 tx=0).stop 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 shutdown_connections 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ff4065ad0 0x7f2ff4067f90 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f300815d1c0 0x7f30081f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f30080d0e50 0x7f30081f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 --2- 172.21.15.45:0/1919079214 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f30080b4f60 0x7f30080c8cc0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 >> 172.21.15.45:0/1919079214 conn(0x7f30080cfa30 msgr2=0x7f30080b7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 shutdown_connections 2023-12-19T18:01:40.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.154+0000 7f300d45e700 1 -- 172.21.15.45:0/1919079214 wait complete. 2023-12-19T18:01:40.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:01:40.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 Processor -- start 2023-12-19T18:01:40.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 -- start start 2023-12-19T18:01:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db015ccf0 0x7f3db00b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3db00cd940 0x7f3db00cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db006f4a0 con 0x7f3db0160970 2023-12-19T18:01:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db0070370 con 0x7f3db00cd940 2023-12-19T18:01:40.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3db4d82700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db006f6f0 con 0x7f3db015ccf0 2023-12-19T18:01:40.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3daf7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db015ccf0 0x7f3db00b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3daffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3db0160970 0x7f3db0160dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51394/0 (socket says 172.21.15.45:51394) 2023-12-19T18:01:40.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3daffff700 1 -- 172.21.15.45:0/2771662101 learned_addr learned my addr 172.21.15.45:0/2771662101 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:40.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.362+0000 7f3daeffd700 1 --2- 172.21.15.45:0/2771662101 >> v2:172.21.15.73:3300/0 conn(0x7f3db00cd940 0x7f3db00cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3daf7fe700 1 -- 172.21.15.45:0/2771662101 >> v2:172.21.15.73:3300/0 conn(0x7f3db00cd940 msgr2=0x7f3db00cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3daf7fe700 1 --2- 172.21.15.45:0/2771662101 >> v2:172.21.15.73:3300/0 conn(0x7f3db00cd940 0x7f3db00cdda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3daf7fe700 1 -- 172.21.15.45:0/2771662101 >> v1:172.21.15.45:6789/0 conn(0x7f3db0160970 legacy=0x7f3db0160dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3daf7fe700 1 -- 172.21.15.45:0/2771662101 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db006f9d0 con 0x7f3db015ccf0 2023-12-19T18:01:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3daf7fe700 1 --2- 172.21.15.45:0/2771662101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db015ccf0 0x7f3db00b8520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009850 tx=0x7f3da0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af895110022f5fdf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:40.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3dae7fc700 1 -- 172.21.15.45:0/2771662101 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0011830 con 0x7f3db015ccf0 2023-12-19T18:01:40.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3dae7fc700 1 -- 172.21.15.45:0/2771662101 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da0011990 con 0x7f3db015ccf0 2023-12-19T18:01:40.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3dae7fc700 1 -- 172.21.15.45:0/2771662101 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da0011d40 con 0x7f3db015ccf0 2023-12-19T18:01:40.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 -- 172.21.15.45:0/2771662101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db015ccf0 msgr2=0x7f3db00b8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 --2- 172.21.15.45:0/2771662101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db015ccf0 0x7f3db00b8520 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3da0009850 tx=0x7f3da0009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 -- 172.21.15.45:0/2771662101 shutdown_connections 2023-12-19T18:01:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 --2- 172.21.15.45:0/2771662101 >> v2:172.21.15.73:3300/0 conn(0x7f3db00cd940 0x7f3db00cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 --2- 172.21.15.45:0/2771662101 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db015ccf0 0x7f3db00b8520 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 -- 172.21.15.45:0/2771662101 >> 172.21.15.45:0/2771662101 conn(0x7f3db00b46f0 msgr2=0x7f3db00b4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 -- 172.21.15.45:0/2771662101 shutdown_connections 2023-12-19T18:01:40.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.366+0000 7f3db4d82700 1 -- 172.21.15.45:0/2771662101 wait complete. 2023-12-19T18:01:40.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.370+0000 7f3db4d82700 1 Processor -- start 2023-12-19T18:01:40.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.370+0000 7f3db4d82700 1 -- start start 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db00cd940 0x7f3db0157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 0x7f3db0157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db0160970 0x7f3db0157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00c9e30 con 0x7f3db015ccf0 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00ca110 con 0x7f3db00cd940 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db00ca3f0 con 0x7f3db0160970 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 0x7f3db0157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 0x7f3db0157590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40588/0 (socket says 172.21.15.45:40588) 2023-12-19T18:01:40.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 -- 172.21.15.45:0/1234914253 learned_addr learned my addr 172.21.15.45:0/1234914253 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:40.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daf7fe700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db00cd940 0x7f3db0157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daffff700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db0160970 0x7f3db0157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 -- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db0160970 msgr2=0x7f3db0157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db0160970 0x7f3db0157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 -- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db00cd940 msgr2=0x7f3db0157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db00cd940 0x7f3db0157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 -- 172.21.15.45:0/1234914253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00094b0 con 0x7f3db015ccf0 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3daeffd700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 0x7f3db0157590 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9d0 tx=0x7f3da400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da4009720 con 0x7f3db015ccf0 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400ee70 con 0x7f3db015ccf0 2023-12-19T18:01:40.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db00ca6d0 con 0x7f3db015ccf0 2023-12-19T18:01:40.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400ca50 con 0x7f3db015ccf0 2023-12-19T18:01:40.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.374+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db0158010 con 0x7f3db015ccf0 2023-12-19T18:01:40.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.378+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db004ed30 con 0x7f3db015ccf0 2023-12-19T18:01:40.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.378+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3da400cbb0 con 0x7f3db015ccf0 2023-12-19T18:01:40.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.382+0000 7f3d97fff700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3d9c065b00 0x7f3d9c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.382+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f3da4083460 con 0x7f3db015ccf0 2023-12-19T18:01:40.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.382+0000 7f3daf7fe700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3d9c065b00 0x7f3d9c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.382+0000 7f3daf7fe700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3d9c065b00 0x7f3d9c067fc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3da00090b0 tx=0x7f3da0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:40.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.386+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3da4050aa0 con 0x7f3db015ccf0 2023-12-19T18:01:40.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.566+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3db00d07f0 con 0x7f3db015ccf0 2023-12-19T18:01:40.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.566+0000 7f3d97fff700 1 -- 172.21.15.45:0/1234914253 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3da400ce60 con 0x7f3db015ccf0 2023-12-19T18:01:40.571 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:01:40.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3d9c065b00 msgr2=0x7f3d9c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3d9c065b00 0x7f3d9c067fc0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f3da00090b0 tx=0x7f3da0008030 comp rx=0 tx=0).stop 2023-12-19T18:01:40.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 msgr2=0x7f3db0157590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 0x7f3db0157590 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e9d0 tx=0x7f3da400ece0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 shutdown_connections 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3d9c065b00 0x7f3d9c067fc0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db0160970 0x7f3db0157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db015ccf0 0x7f3db0157590 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 --2- 172.21.15.45:0/1234914253 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db00cd940 0x7f3db0157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 >> 172.21.15.45:0/1234914253 conn(0x7f3db00b46f0 msgr2=0x7f3db015c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 shutdown_connections 2023-12-19T18:01:40.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.570+0000 7f3db4d82700 1 -- 172.21.15.45:0/1234914253 wait complete. 2023-12-19T18:01:40.598 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T18:01:40.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 Processor -- start 2023-12-19T18:01:40.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 -- start start 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f852015d090 0x7f85200d0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85200cdff0 0x7f85200cf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85200d01e0 con 0x7f85200cfd70 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85200b6040 con 0x7f85200cdff0 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f85255a7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85200d10e0 con 0x7f852015d090 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f851e7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85200cdff0 0x7f85200cf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f851e7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f85200cdff0 0x7f85200cf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40594/0 (socket says 172.21.15.45:40594) 2023-12-19T18:01:40.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f851e7fc700 1 -- 172.21.15.45:0/3701680385 learned_addr learned my addr 172.21.15.45:0/3701680385 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:40.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.782+0000 7f851effd700 1 --2- 172.21.15.45:0/3701680385 >> v2:172.21.15.73:3300/0 conn(0x7f852015d090 0x7f85200d0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851dffb700 1 -- 172.21.15.45:0/3701680385 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1944731891 0 0) 0x7f8518001490 con 0x7f85200cfd70 2023-12-19T18:01:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851dffb700 1 -- 172.21.15.45:0/3701680385 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85080035d0 con 0x7f85200cfd70 2023-12-19T18:01:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851e7fc700 1 -- 172.21.15.45:0/3701680385 >> v2:172.21.15.73:3300/0 conn(0x7f852015d090 msgr2=0x7f85200d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851e7fc700 1 --2- 172.21.15.45:0/3701680385 >> v2:172.21.15.73:3300/0 conn(0x7f852015d090 0x7f85200d0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851e7fc700 1 -- 172.21.15.45:0/3701680385 >> v1:172.21.15.73:6789/0 conn(0x7f85200cfd70 legacy=0x7f852006ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851e7fc700 1 -- 172.21.15.45:0/3701680385 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85200d13c0 con 0x7f85200cdff0 2023-12-19T18:01:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851e7fc700 1 --2- 172.21.15.45:0/3701680385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cdff0 0x7f85200cf830 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f85200d0750 tx=0x7f8514009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85868e36f3ad9568 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851dffb700 1 -- 172.21.15.45:0/3701680385 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514011830 con 0x7f85200cdff0 2023-12-19T18:01:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851dffb700 1 -- 172.21.15.45:0/3701680385 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8514011990 con 0x7f85200cdff0 2023-12-19T18:01:40.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f851dffb700 1 -- 172.21.15.45:0/3701680385 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514011d20 con 0x7f85200cdff0 2023-12-19T18:01:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 -- 172.21.15.45:0/3701680385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cdff0 msgr2=0x7f85200cf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 --2- 172.21.15.45:0/3701680385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cdff0 0x7f85200cf830 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f85200d0750 tx=0x7f8514009bf0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 -- 172.21.15.45:0/3701680385 shutdown_connections 2023-12-19T18:01:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 --2- 172.21.15.45:0/3701680385 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cdff0 0x7f85200cf830 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 --2- 172.21.15.45:0/3701680385 >> v2:172.21.15.73:3300/0 conn(0x7f852015d090 0x7f85200d0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 -- 172.21.15.45:0/3701680385 >> 172.21.15.45:0/3701680385 conn(0x7f85200b4b90 msgr2=0x7f85200b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:40.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 -- 172.21.15.45:0/3701680385 shutdown_connections 2023-12-19T18:01:40.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.786+0000 7f85255a7700 1 -- 172.21.15.45:0/3701680385 wait complete. 2023-12-19T18:01:40.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 Processor -- start 2023-12-19T18:01:40.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 -- start start 2023-12-19T18:01:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85200cdff0 0x7f852015d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 0x7f852015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f852015d090 0x7f852015fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852015e890 con 0x7f85200cfd70 2023-12-19T18:01:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85201519e0 con 0x7f85200cdff0 2023-12-19T18:01:40.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f85255a7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852015d9b0 con 0x7f852015d090 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f851e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 0x7f852015f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f851e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 0x7f852015f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40610/0 (socket says 172.21.15.45:40610) 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.790+0000 7f851e7fc700 1 -- 172.21.15.45:0/3659620689 learned_addr learned my addr 172.21.15.45:0/3659620689 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851effd700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85200cdff0 0x7f852015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851f7fe700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f852015d090 0x7f852015fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851e7fc700 1 -- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f852015d090 msgr2=0x7f852015fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851e7fc700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f852015d090 0x7f852015fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851e7fc700 1 -- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85200cdff0 msgr2=0x7f852015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851e7fc700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85200cdff0 0x7f852015d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851e7fc700 1 -- 172.21.15.45:0/3659620689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514009570 con 0x7f85200cfd70 2023-12-19T18:01:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851effd700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85200cdff0 0x7f852015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:40.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f851e7fc700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 0x7f852015f8d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f85200d0780 tx=0x7f8514004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85140044d0 con 0x7f85200cfd70 2023-12-19T18:01:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851401f070 con 0x7f85200cfd70 2023-12-19T18:01:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f852015dc10 con 0x7f85200cfd70 2023-12-19T18:01:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514003900 con 0x7f85200cfd70 2023-12-19T18:01:40.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f852015e1d0 con 0x7f85200cfd70 2023-12-19T18:01:40.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.794+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f852015e9d0 con 0x7f85200cfd70 2023-12-19T18:01:40.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.798+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8514003a60 con 0x7f85200cfd70 2023-12-19T18:01:40.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.798+0000 7f85077fe700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f850c065ad0 0x7f850c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.798+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f8514021070 con 0x7f85200cfd70 2023-12-19T18:01:40.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.798+0000 7f851effd700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f850c065ad0 0x7f850c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:40.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.802+0000 7f851effd700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f850c065ad0 0x7f850c067f90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8510009ba0 tx=0x7f8510008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:40.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.806+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f852015e9d0 con 0x7f85200cfd70 2023-12-19T18:01:40.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.986+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f852015e9d0 con 0x7f85200cfd70 2023-12-19T18:01:40.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.986+0000 7f85077fe700 1 -- 172.21.15.45:0/3659620689 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v110) v1 ==== 106+0+11 (secure 0 0 0) 0x7f852015e9d0 con 0x7f85200cfd70 2023-12-19T18:01:40.992 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f850c065ad0 msgr2=0x7f850c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f850c065ad0 0x7f850c067f90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8510009ba0 tx=0x7f8510008040 comp rx=0 tx=0).stop 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 msgr2=0x7f852015f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 0x7f852015f8d0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f85200d0780 tx=0x7f8514004770 comp rx=0 tx=0).stop 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 shutdown_connections 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f850c065ad0 0x7f850c067f90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f852015d090 0x7f852015fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f85200cfd70 0x7f852015f8d0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 --2- 172.21.15.45:0/3659620689 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f85200cdff0 0x7f852015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 >> 172.21.15.45:0/3659620689 conn(0x7f85200b4b90 msgr2=0x7f852006ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 shutdown_connections 2023-12-19T18:01:40.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:40.990+0000 7f85255a7700 1 -- 172.21.15.45:0/3659620689 wait complete. 2023-12-19T18:01:41.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:01:41.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.194+0000 7f9ae34b0700 1 Processor -- start 2023-12-19T18:01:41.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.194+0000 7f9ae34b0700 1 -- start start 2023-12-19T18:01:41.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae34b0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9adc06faa0 0x7f9adc0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:41.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae34b0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9adc06ff30 0x7f9adc0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:41.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae34b0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9adc0ce1b0 con 0x7f9adc1592b0 2023-12-19T18:01:41.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae34b0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc0ce490 con 0x7f9adc06ff30 2023-12-19T18:01:41.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae34b0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9adc1599c0 con 0x7f9adc06faa0 2023-12-19T18:01:41.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae24ae700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f9adc1592b0 0x7f9adc15a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51396/0 (socket says 172.21.15.45:51396) 2023-12-19T18:01:41.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae24ae700 1 -- 172.21.15.45:0/342060733 learned_addr learned my addr 172.21.15.45:0/342060733 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae1cad700 1 --2- 172.21.15.45:0/342060733 >> v2:172.21.15.73:3300/0 conn(0x7f9adc06faa0 0x7f9adc0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae2caf700 1 --2- 172.21.15.45:0/342060733 >> v2:172.21.15.45:3300/0 conn(0x7f9adc06ff30 0x7f9adc0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae14ac700 1 -- 172.21.15.45:0/342060733 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 21257607 0 0) 0x7f9adc0ce1b0 con 0x7f9adc1592b0 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae14ac700 1 -- 172.21.15.45:0/342060733 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ac80057e0 con 0x7f9adc1592b0 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae2caf700 1 -- 172.21.15.45:0/342060733 >> v2:172.21.15.73:3300/0 conn(0x7f9adc06faa0 msgr2=0x7f9adc0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae2caf700 1 --2- 172.21.15.45:0/342060733 >> v2:172.21.15.73:3300/0 conn(0x7f9adc06faa0 0x7f9adc0cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae2caf700 1 -- 172.21.15.45:0/342060733 >> v1:172.21.15.45:6789/0 conn(0x7f9adc1592b0 legacy=0x7f9adc15a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae14ac700 1 -- 172.21.15.45:0/342060733 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3409812052 0 0) 0x7f9ac80057e0 con 0x7f9adc1592b0 2023-12-19T18:01:41.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae2caf700 1 -- 172.21.15.45:0/342060733 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9adc159ca0 con 0x7f9adc06ff30 2023-12-19T18:01:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae1cad700 1 --2- 172.21.15.45:0/342060733 >> v2:172.21.15.73:3300/0 conn(0x7f9adc06faa0 0x7f9adc0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.198+0000 7f9ae2caf700 1 --2- 172.21.15.45:0/342060733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06ff30 0x7f9adc0ccc90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0ccbc0 tx=0x7f9ad400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c370a23d21977598 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae14ac700 1 -- 172.21.15.45:0/342060733 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400e070 con 0x7f9adc06ff30 2023-12-19T18:01:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae14ac700 1 -- 172.21.15.45:0/342060733 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad4003a40 con 0x7f9adc06ff30 2023-12-19T18:01:41.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae14ac700 1 -- 172.21.15.45:0/342060733 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8001670 con 0x7f9adc06ff30 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 -- 172.21.15.45:0/342060733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06ff30 msgr2=0x7f9adc0ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/342060733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06ff30 0x7f9adc0ccc90 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f9adc0ccbc0 tx=0x7f9ad400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 -- 172.21.15.45:0/342060733 shutdown_connections 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/342060733 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06ff30 0x7f9adc0ccc90 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/342060733 >> v2:172.21.15.73:3300/0 conn(0x7f9adc06faa0 0x7f9adc0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 -- 172.21.15.45:0/342060733 >> 172.21.15.45:0/342060733 conn(0x7f9adc0cbb40 msgr2=0x7f9adc0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:41.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 -- 172.21.15.45:0/342060733 shutdown_connections 2023-12-19T18:01:41.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.202+0000 7f9ae34b0700 1 -- 172.21.15.45:0/342060733 wait complete. 2023-12-19T18:01:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 Processor -- start 2023-12-19T18:01:41.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 -- start start 2023-12-19T18:01:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 0x7f9adc0ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9adc06ff30 0x7f9adc155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9adc1592b0 0x7f9adc0c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0c6190 con 0x7f9adc06faa0 2023-12-19T18:01:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0c6d10 con 0x7f9adc1592b0 2023-12-19T18:01:41.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae34b0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9adc0acf10 con 0x7f9adc06ff30 2023-12-19T18:01:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 0x7f9adc0ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 0x7f9adc0ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40632/0 (socket says 172.21.15.45:40632) 2023-12-19T18:01:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 -- 172.21.15.45:0/1697069844 learned_addr learned my addr 172.21.15.45:0/1697069844 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:41.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae2caf700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9adc1592b0 0x7f9adc0c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae1cad700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9adc06ff30 0x7f9adc155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 -- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9adc06ff30 msgr2=0x7f9adc155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9adc06ff30 0x7f9adc155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 -- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9adc1592b0 msgr2=0x7f9adc0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9adc1592b0 0x7f9adc0c4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae24ae700 1 -- 172.21.15.45:0/1697069844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0094b0 con 0x7f9adc06faa0 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae2caf700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9adc1592b0 0x7f9adc0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:41.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.206+0000 7f9ae1cad700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9adc06ff30 0x7f9adc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ae24ae700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 0x7f9adc0ac9d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800c780 tx=0x7f9ad800cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad8004ca0 con 0x7f9adc06faa0 2023-12-19T18:01:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ad8004e00 con 0x7f9adc06faa0 2023-12-19T18:01:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ad80072f0 con 0x7f9adc06faa0 2023-12-19T18:01:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad4009a70 con 0x7f9adc06faa0 2023-12-19T18:01:41.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9adc0c66c0 con 0x7f9adc06faa0 2023-12-19T18:01:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.210+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9adc0ce750 con 0x7f9adc06faa0 2023-12-19T18:01:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.214+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9ad8007450 con 0x7f9adc06faa0 2023-12-19T18:01:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.214+0000 7f9ad2ffd700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9ac0065b00 0x7f9ac0067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.214+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f9ad80826a0 con 0x7f9adc06faa0 2023-12-19T18:01:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.214+0000 7f9ae1cad700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9ac0065b00 0x7f9ac0067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.214+0000 7f9ae1cad700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9ac0065b00 0x7f9ac0067fc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9adc156950 tx=0x7f9acc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:41.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.222+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9adc0ce750 con 0x7f9adc06faa0 2023-12-19T18:01:41.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.410+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9adc0ce750 con 0x7f9adc06faa0 2023-12-19T18:01:41.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.410+0000 7f9ad2ffd700 1 -- 172.21.15.45:0/1697069844 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9adc0ce750 con 0x7f9adc06faa0 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9ac0065b00 msgr2=0x7f9ac0067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9ac0065b00 0x7f9ac0067fc0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9adc156950 tx=0x7f9acc008040 comp rx=0 tx=0).stop 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 msgr2=0x7f9adc0ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 0x7f9adc0ac9d0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f9ad800c780 tx=0x7f9ad800cb40 comp rx=0 tx=0).stop 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 shutdown_connections 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9ac0065b00 0x7f9ac0067fc0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9adc1592b0 0x7f9adc0c4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9adc06ff30 0x7f9adc155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 --2- 172.21.15.45:0/1697069844 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9adc06faa0 0x7f9adc0ac9d0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 >> 172.21.15.45:0/1697069844 conn(0x7f9adc0cbb40 msgr2=0x7f9adc158000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 shutdown_connections 2023-12-19T18:01:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:41.414+0000 7f9ae34b0700 1 -- 172.21.15.45:0/1697069844 wait complete. 2023-12-19T18:01:41.418 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T18:01:41.436 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T18:01:41.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:41.437 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T18:01:41.468 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[55666]: fuse finished with error 0 and tester_r 0 2023-12-19T18:01:41.477 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:47.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:01:47.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:01:47.578 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:01:47.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:01:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.826+0000 7f956e9fc700 1 Processor -- start 2023-12-19T18:01:47.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.826+0000 7f956e9fc700 1 -- start start 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e9fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f95680b88b0 0x7f956806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e9fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806f3b0 0x7f956806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e9fc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95680d1820 con 0x7f956806ea90 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e9fc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680d1630 con 0x7f95680b88b0 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e9fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95680d1b00 con 0x7f956806f3b0 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d9fa700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f956806ea90 0x7f95680d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51410/0 (socket says 172.21.15.45:51410) 2023-12-19T18:01:47.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d9fa700 1 -- 172.21.15.45:0/3195847248 learned_addr learned my addr 172.21.15.45:0/3195847248 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d1f9700 1 --2- 172.21.15.45:0/3195847248 >> v2:172.21.15.73:3300/0 conn(0x7f95680b88b0 0x7f956806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e1fb700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806f3b0 0x7f956806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956c9f8700 1 -- 172.21.15.45:0/3195847248 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2653805514 0 0) 0x7f95680d1820 con 0x7f956806ea90 2023-12-19T18:01:47.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956c9f8700 1 -- 172.21.15.45:0/3195847248 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95540035d0 con 0x7f956806ea90 2023-12-19T18:01:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d1f9700 1 -- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806f3b0 msgr2=0x7f956806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d1f9700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806f3b0 0x7f956806f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d1f9700 1 -- 172.21.15.45:0/3195847248 >> v1:172.21.15.45:6789/0 conn(0x7f956806ea90 legacy=0x7f95680d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956c9f8700 1 -- 172.21.15.45:0/3195847248 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3395562918 0 0) 0x7f95540035d0 con 0x7f956806ea90 2023-12-19T18:01:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956d1f9700 1 -- 172.21.15.45:0/3195847248 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95680d1de0 con 0x7f95680b88b0 2023-12-19T18:01:47.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.830+0000 7f956e1fb700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806f3b0 0x7f956806f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:47.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956d1f9700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95680b88b0 0x7f956806ee70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9558009850 tx=0x7f9558009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cdb780945ddfee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:47.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956c9f8700 1 -- 172.21.15.45:0/3195847248 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9564001670 con 0x7f95680b88b0 2023-12-19T18:01:47.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956c9f8700 1 -- 172.21.15.45:0/3195847248 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558004030 con 0x7f95680b88b0 2023-12-19T18:01:47.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956c9f8700 1 -- 172.21.15.45:0/3195847248 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580043e0 con 0x7f95680b88b0 2023-12-19T18:01:47.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 -- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95680b88b0 msgr2=0x7f956806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:47.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95680b88b0 0x7f956806ee70 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9558009850 tx=0x7f9558009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 -- 172.21.15.45:0/3195847248 shutdown_connections 2023-12-19T18:01:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806f3b0 0x7f956806f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 --2- 172.21.15.45:0/3195847248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95680b88b0 0x7f956806ee70 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 -- 172.21.15.45:0/3195847248 >> 172.21.15.45:0/3195847248 conn(0x7f95680b46d0 msgr2=0x7f95680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 -- 172.21.15.45:0/3195847248 shutdown_connections 2023-12-19T18:01:47.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.834+0000 7f956e9fc700 1 -- 172.21.15.45:0/3195847248 wait complete. 2023-12-19T18:01:47.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.838+0000 7f956e9fc700 1 Processor -- start 2023-12-19T18:01:47.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.838+0000 7f956e9fc700 1 -- start start 2023-12-19T18:01:47.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806ea90 0x7f95680c8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:47.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956806f3b0 0x7f956814b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:47.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 0x7f95680c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:47.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956814b5b0 con 0x7f95680b88b0 2023-12-19T18:01:47.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95680ca1f0 con 0x7f956806f3b0 2023-12-19T18:01:47.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9568157050 con 0x7f956806ea90 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 0x7f95680c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 0x7f95680c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40638/0 (socket says 172.21.15.45:40638) 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 -- 172.21.15.45:0/2051055281 learned_addr learned my addr 172.21.15.45:0/2051055281 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956d9fa700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806ea90 0x7f95680c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956d1f9700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956806f3b0 0x7f956814b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 -- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806ea90 msgr2=0x7f95680c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806ea90 0x7f95680c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 -- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956806f3b0 msgr2=0x7f956814b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956806f3b0 0x7f956814b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 -- 172.21.15.45:0/2051055281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9560009a70 con 0x7f95680b88b0 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956d1f9700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956806f3b0 0x7f956814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:47.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e1fb700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 0x7f95680c9cb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f956000efc0 tx=0x7f956000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f956000cb40 con 0x7f95680b88b0 2023-12-19T18:01:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f956000f040 con 0x7f95680b88b0 2023-12-19T18:01:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9560003a40 con 0x7f95680b88b0 2023-12-19T18:01:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95580094b0 con 0x7f95680b88b0 2023-12-19T18:01:47.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.842+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95680ca730 con 0x7f95680b88b0 2023-12-19T18:01:47.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.846+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9568067760 con 0x7f95680b88b0 2023-12-19T18:01:47.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.846+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9560014480 con 0x7f95680b88b0 2023-12-19T18:01:47.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.846+0000 7f955e7fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f954c065ad0 0x7f954c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:47.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.846+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 6433+0+0 (secure 0 0 0) 0x7f9560083d20 con 0x7f95680b88b0 2023-12-19T18:01:47.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.846+0000 7f956d9fa700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f954c065ad0 0x7f954c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:47.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.850+0000 7f956d9fa700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f954c065ad0 0x7f954c067f90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f956806e3f0 tx=0x7f9564007bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:47.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:47.854+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9560051490 con 0x7f95680b88b0 2023-12-19T18:01:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.070+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f95680d2370 con 0x7f95680b88b0 2023-12-19T18:01:48.078 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:01:48.074+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:01:48.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.094+0000 7f955e7fc700 1 -- 172.21.15.45:0/2051055281 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v80) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9560054ab0 con 0x7f95680b88b0 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f954c065ad0 msgr2=0x7f954c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f954c065ad0 0x7f954c067f90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f956806e3f0 tx=0x7f9564007bc0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 msgr2=0x7f95680c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 0x7f95680c9cb0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f956000efc0 tx=0x7f956000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 shutdown_connections 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f954c065ad0 0x7f954c067f90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f95680b88b0 0x7f95680c9cb0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f956806f3b0 0x7f956814b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 --2- 172.21.15.45:0/2051055281 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f956806ea90 0x7f95680c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 >> 172.21.15.45:0/2051055281 conn(0x7f95680b46d0 msgr2=0x7f95680b5cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 shutdown_connections 2023-12-19T18:01:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.098+0000 7f956e9fc700 1 -- 172.21.15.45:0/2051055281 wait complete. 2023-12-19T18:01:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:01:48.111 INFO:tasks.ceph.mds.b.smithi073.stderr: -9902> 2023-12-19T18:01:16.012+0000 7fccf6eb0700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:01:48.127 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:01:48.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:01:48.175 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T18:01:48.204 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T18:01:48.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T18:01:48.206 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:01:48.207 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.208 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T18:01:48.209 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:01:48.210 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.211 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T18:01:48.212 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T18:01:48.213 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.215 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T18:01:48.216 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:01:48.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T18:01:48.218 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:01:48.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T18:01:48.220 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T18:01:48.221 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:01:48.222 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:01:48.223 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.224 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T18:01:48.225 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T18:01:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:01:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.226 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.236 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:01:48.243 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T18:01:48.318 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T18:01:48.319 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.320 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.321 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T18:01:48.322 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:01:48.323 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.324 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.325 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T18:01:48.326 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T18:01:48.327 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T18:01:48.328 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:01:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.329 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.341 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T18:01:48.341 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:01:48.342 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:01:48.343 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T18:01:48.344 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T18:01:48.345 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.346 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:01:48.347 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.348 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T18:01:48.349 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:01:48.350 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:01:48.351 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:01:48.352 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:01:48.353 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T18:01:48.353 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T18:01:48.353 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.353 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T18:01:48.353 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.353 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.354 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T18:01:48.354 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T18:01:48.354 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T18:01:48.354 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T18:01:48.354 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T18:01:48.354 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T18:01:48.355 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T18:01:48.356 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T18:01:48.356 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T18:01:48.356 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:01:48.356 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:01:48.356 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:01:48.365 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph purge cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T18:01:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 Processor -- start 2023-12-19T18:01:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 -- start start 2023-12-19T18:01:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b7c6b0 0x55cb53aa5230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 0x55cb53aed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb539f5250 con 0x55cb53b80dd0 2023-12-19T18:01:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb539f4ef0 con 0x55cb53b7c6b0 2023-12-19T18:01:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa9b7d140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb539cb240 con 0x55cb53af2eb0 2023-12-19T18:01:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 0x55cb53aed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 0x55cb53aed250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40646/0 (socket says 172.21.15.45:40646) 2023-12-19T18:01:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa76b2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/607953068 learned_addr learned my addr 172.21.15.45:0/607953068 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:48.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b7c6b0 0x55cb53aa5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 msgr2=0x55cb53ae8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae8cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b7c6b0 msgr2=0x55cb53aa5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b7c6b0 0x55cb53aa5230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/607953068 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa000a1c0 con 0x55cb53b80dd0 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 0x55cb53aed250 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ab90 tx=0x7ffaa000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab0333a01273272 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa5eaf700 1 -- 172.21.15.45:0/607953068 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000e510 con 0x55cb53b80dd0 2023-12-19T18:01:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa5eaf700 1 -- 172.21.15.45:0/607953068 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaa000e670 con 0x55cb53b80dd0 2023-12-19T18:01:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.470+0000 7ffaa5eaf700 1 -- 172.21.15.45:0/607953068 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaa000ec20 con 0x55cb53b80dd0 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/607953068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 msgr2=0x55cb53aed250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 0x55cb53aed250 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7ffaa000ab90 tx=0x7ffaa000e000 comp rx=0 tx=0).stop 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/607953068 shutdown_connections 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b80dd0 0x55cb53aed250 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b7c6b0 0x55cb53aa5230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/607953068 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/607953068 >> 172.21.15.45:0/607953068 conn(0x55cb53ad5470 msgr2=0x55cb53b7f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/607953068 shutdown_connections 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/607953068 wait complete. 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 Processor -- start 2023-12-19T18:01:48.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- start start 2023-12-19T18:01:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b7c6b0 0x55cb53b7acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b80dd0 0x55cb53b7b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb53b527d0 con 0x55cb53b7c6b0 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb53b52a70 con 0x55cb53b80dd0 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa9b7d140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cb53b52d10 con 0x55cb53af2eb0 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.474+0000 7ffaa6eb1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b7c6b0 0x55cb53b7acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa6eb1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b7c6b0 0x55cb53b7acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40658/0 (socket says 172.21.15.45:40658) 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 learned_addr learned my addr 172.21.15.45:0/2774478044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b80dd0 0x55cb53b7b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b80dd0 msgr2=0x55cb53b7b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b80dd0 0x55cb53b7b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b7c6b0 msgr2=0x55cb53b7acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cb53b7c6b0 0x55cb53b7acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb539fd610 con 0x55cb53af2eb0 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cb53b80dd0 0x55cb53b7b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae9850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800ef60 tx=0x7ffa9800ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa4ead700 1 -- 172.21.15.45:0/2774478044 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9800cb90 con 0x55cb53af2eb0 2023-12-19T18:01:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa4ead700 1 -- 172.21.15.45:0/2774478044 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa98005070 con 0x55cb53af2eb0 2023-12-19T18:01:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa4ead700 1 -- 172.21.15.45:0/2774478044 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa98010400 con 0x55cb53af2eb0 2023-12-19T18:01:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cb539e3470 con 0x55cb53af2eb0 2023-12-19T18:01:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.478+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb539d68b0 con 0x55cb53af2eb0 2023-12-19T18:01:48.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.482+0000 7ffaa4ead700 1 -- 172.21.15.45:0/2774478044 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffa98010560 con 0x55cb53af2eb0 2023-12-19T18:01:48.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.482+0000 7ffaa4ead700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa94064400 0x7ffa940668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.482+0000 7ffaa4ead700 1 -- 172.21.15.45:0/2774478044 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6519+0+0 (secure 0 0 0) 0x7ffa98008070 con 0x55cb53af2eb0 2023-12-19T18:01:48.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.482+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa94064400 0x7ffa940668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.488 INFO:teuthology.orchestra.run.smithi045.stdout:Warning: using slow linear search 2023-12-19T18:01:48.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.482+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cb53ae9d90 0x55cb53b631a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.482+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 14.0 14:00000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x55cb53ae9d90 2023-12-19T18:01:48.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.486+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cb53ae9d90 0x55cb53b631a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.486+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa94064400 0x7ffa940668c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005630 tx=0x7ffa9c00c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.486+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cb53ae9d90 0x55cb53b631a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.490+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x55cb53ae9d90 2023-12-19T18:01:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.490+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7ffaa0010950 0x7ffaa0025420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.490+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 14.10 14:08000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa0010950 2023-12-19T18:01:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.490+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7ffaa0010950 0x7ffaa0025420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.490+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7ffaa0010950 0x7ffaa0025420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.494+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(2 [pgnls start_epoch 111 out=177b] v110'10 uv10 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x7ffa9800b050 con 0x7ffaa0010950 2023-12-19T18:01:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.494+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7ffa98053ac0 0x7ffa980527c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.494+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 14.8 14:10000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.498+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7ffa98053ac0 0x7ffa980527c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.498+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7ffa98053ac0 0x7ffa980527c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.502+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.502+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 14.18 14:18000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa0010950 2023-12-19T18:01:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.502+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(4 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9800b050 con 0x7ffaa0010950 2023-12-19T18:01:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.502+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7ffa98052d50 0x7ffa980541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.502+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:5 14.4 14:20000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98052d50 2023-12-19T18:01:48.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.502+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7ffa98052d50 0x7ffa980541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.506+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7ffa98052d50 0x7ffa980541f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.510+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(5 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa98052d50 2023-12-19T18:01:48.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.510+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7ffaa001b930 0x7ffaa0034410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.510+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:6 14.14 14:28000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa001b930 2023-12-19T18:01:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.510+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7ffaa001b930 0x7ffaa0034410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7ffaa001b930 0x7ffaa0034410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(6 [pgnls start_epoch 111 out=149b] v110'42 uv42 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x7ffa9800b050 con 0x7ffaa001b930 2023-12-19T18:01:48.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 14.c 14:30000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(7 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:8 14.1c 14:38000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(8 [pgnls start_epoch 111 out=73b] v106'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.514+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 14.2 14:40000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98052d50 2023-12-19T18:01:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(9 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa98052d50 2023-12-19T18:01:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:10 14.12 14:48000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x55cb53ae9d90 2023-12-19T18:01:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(10 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x55cb53ae9d90 2023-12-19T18:01:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7ffaa00333a0 0x7ffaa0033800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:11 14.a 14:50000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa00333a0 2023-12-19T18:01:48.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7ffaa00333a0 0x7ffaa0033800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.518+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7ffaa00333a0 0x7ffaa0033800 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(11 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffaa00333a0 2023-12-19T18:01:48.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 14.1a 14:58000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(12 [pgnls start_epoch 111 out=49b] v106'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 14.6 14:60000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(13 [pgnls start_epoch 111 out=77b] v110'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ffa9c016420 0x7ffa9c0168a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 14.16 14:68000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa9c016420 2023-12-19T18:01:48.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.522+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ffa9c016420 0x7ffa9c0168a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa7eb3700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ffa9c016420 0x7ffa9c0168a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(14 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa9c016420 2023-12-19T18:01:48.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 14.e 14:70000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa001b930 2023-12-19T18:01:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(15 [pgnls start_epoch 111 out=73b] v106'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7ffa9800b050 con 0x7ffaa001b930 2023-12-19T18:01:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7ffa9805b3b0 0x7ffa9807a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 14.1e 14:78000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa9805b3b0 2023-12-19T18:01:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.526+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7ffa9805b3b0 0x7ffa9807a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa76b2700 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7ffa9805b3b0 0x7ffa9807a850 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(16 [pgnls start_epoch 111 out=49b] v106'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98078040 con 0x7ffa9805b3b0 2023-12-19T18:01:48.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:17 14.1 14:80000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa9c016420 2023-12-19T18:01:48.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(17 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa9c016420 2023-12-19T18:01:48.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:18 14.11 14:88000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa001b930 2023-12-19T18:01:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(18 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98078040 con 0x7ffaa001b930 2023-12-19T18:01:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.530+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:19 14.9 14:90000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa00333a0 2023-12-19T18:01:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(19 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffaa00333a0 2023-12-19T18:01:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:20 14.19 14:98000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98052d50 2023-12-19T18:01:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(20 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa98052d50 2023-12-19T18:01:48.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 14.5 14:a0000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(21 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 14.15 14:a8000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa9805b3b0 2023-12-19T18:01:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(22 [pgnls start_epoch 111 out=97b] v106'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x7ffa98078040 con 0x7ffa9805b3b0 2023-12-19T18:01:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.534+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:23 14.d 14:b0000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98052d50 2023-12-19T18:01:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(23 [pgnls start_epoch 111 out=74b] v106'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa98052d50 2023-12-19T18:01:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:24 14.1d 14:b8000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(24 [pgnls start_epoch 111 out=73b] v106'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 14.3 14:c0000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(25 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:26 14.13 14:c8000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x55cb53ae9d90 2023-12-19T18:01:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(26 [pgnls start_epoch 111 out=98b] v110'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x7ffaa0017040 con 0x55cb53ae9d90 2023-12-19T18:01:48.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.538+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 14.b 14:d0000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(27 [pgnls start_epoch 111 out=76b] v110'3 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:28 14.1b 14:d8000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa0010950 2023-12-19T18:01:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(28 [pgnls start_epoch 111 out=49b] v106'1 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98078040 con 0x7ffaa0010950 2023-12-19T18:01:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 14.7 14:e0000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa00333a0 2023-12-19T18:01:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(29 [pgnls start_epoch 111 out=73b] v106'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffaa00333a0 2023-12-19T18:01:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:30 14.17 14:e8000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffaa0010950 2023-12-19T18:01:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(30 [pgnls start_epoch 111 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ffa98078040 con 0x7ffaa0010950 2023-12-19T18:01:48.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.542+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:31 14.f 14:f0000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa9805b3b0 2023-12-19T18:01:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(31 [pgnls start_epoch 111 out=73b] v106'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x7ffa98078040 con 0x7ffa9805b3b0 2023-12-19T18:01:48.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 14.1f 14:f8000000:%01:::head [pgnls start_epoch 111 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e111) v8 -- 0x55cb53b536f0 con 0x7ffa98053ac0 2023-12-19T18:01:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(32 [pgnls start_epoch 111 out=101b] v110'6 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:33 14.10 14:09401a81:::601.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c1c6a0 con 0x7ffaa0010950 2023-12-19T18:01:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:34 14.10 14:0bd6d154:::602.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c1cf70 con 0x7ffaa0010950 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:35 14.10 14:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c1fbb0 con 0x7ffaa0010950 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:36 14.10 14:0d82a743:::600.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c20450 con 0x7ffaa0010950 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:37 14.10 14:0d89b25e:::603.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c20cf0 con 0x7ffaa0010950 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:38 14.14 14:287034c4:::1.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c21590 con 0x7ffaa001b930 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:39 14.14 14:292cf221:::200.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c21e30 con 0x7ffaa001b930 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:40 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c226d0 con 0x7ffaa001b930 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:41 14.14 14:2f55791f:::606.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c22f70 con 0x7ffaa001b930 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:42 14.1c 14:3ed09add:::607.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c23810 con 0x7ffa98053ac0 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:43 14.6 14:654134d2:::mds0_openfiles.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c240b0 con 0x7ffa98053ac0 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:44 14.e 14:717a0223:::608.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c24950 con 0x7ffaa001b930 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:45 14.15 14:a93a17c2:::604.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c25330 con 0x7ffa9805b3b0 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:46 14.15 14:aa448500:::500.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c22f70 con 0x7ffa9805b3b0 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:47 14.d 14:b50e409b:::mds_snaptable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c26220 con 0x7ffa98052d50 2023-12-19T18:01:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.546+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 14.1d 14:b871830b:::605.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c25330 con 0x7ffa98053ac0 2023-12-19T18:01:48.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.550+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(48 605.00000000 [delete] v111'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.550+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(43 mds0_openfiles.0 [delete] v111'8 uv8 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.550+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(38 1.00000000.inode [delete] v111'43 uv43 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa001b930 2023-12-19T18:01:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.550+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:49 14.13 14:c91d4a1d:::mds0_inotable:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c22f70 con 0x55cb53ae9d90 2023-12-19T18:01:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.550+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:50 14.13 14:cd5a64a3:::100.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c265d0 con 0x55cb53ae9d90 2023-12-19T18:01:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.550+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:51 14.b 14:d0630e4c:::mds0_sessionmap:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c26fa0 con 0x7ffa98053ac0 2023-12-19T18:01:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(47 mds_snaptable [delete] v111'2 uv2 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa0017040 con 0x7ffa98052d50 2023-12-19T18:01:48.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(39 200.00000000 [delete] v111'44 uv44 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa001b930 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(44 608.00000000 [delete] v111'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa001b930 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(33 601.00000000 [delete] v111'11 uv11 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa0010950 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(34 602.00000000 [delete] v111'12 uv12 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa0010950 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(45 604.00000000 [delete] v111'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffa9805b3b0 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(42 607.00000000 [delete] v111'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:52 14.7 14:e0b41d06:::609.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c244e0 con 0x7ffaa00333a0 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:53 14.f 14:f1f69726:::400.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53b636e0 con 0x7ffa9805b3b0 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:54 14.1f 14:fe07bba1:::100.00000000.inode:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c1ca80 con 0x7ffa98053ac0 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:55 14.1f 14:ff5b34d6:::1.00000000:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_try+supports_pool_eio e111) v8 -- 0x55cb53c27350 con 0x7ffa98053ac0 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(40 200.00000001 [delete] v111'45 uv45 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa001b930 2023-12-19T18:01:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(41 606.00000000 [delete] v111'46 uv46 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa001b930 2023-12-19T18:01:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(46 500.00000000 [delete] v111'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffa9805b3b0 2023-12-19T18:01:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(35 10000000000.00000000 [delete] v111'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa0010950 2023-12-19T18:01:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(36 600.00000000 [delete] v111'14 uv14 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa0010950 2023-12-19T18:01:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(51 mds0_sessionmap [delete] v111'4 uv4 ondisk = 0) v8 ==== 159+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(37 603.00000000 [delete] v111'15 uv15 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffaa0010950 2023-12-19T18:01:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.554+0000 7ffaa76b2700 1 -- 172.21.15.45:0/2774478044 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(53 400.00000000 [delete] v111'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa98046040 con 0x7ffa9805b3b0 2023-12-19T18:01:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(54 100.00000000.inode [delete] v111'7 uv7 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(49 mds0_inotable [delete] v111'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7ffaa0017040 con 0x55cb53ae9d90 2023-12-19T18:01:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(55 1.00000000 [delete] v111'8 uv8 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffa98053ac0 2023-12-19T18:01:48.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(50 100.00000000 [delete] v111'5 uv5 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffaa0017040 con 0x55cb53ae9d90 2023-12-19T18:01:48.561 INFO:teuthology.orchestra.run.smithi045.stdout:Removed 23 objects 2023-12-19T18:01:48.561 INFO:teuthology.orchestra.run.smithi045.stdout:successfully purged pool cephfs_metadata 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa6eb1700 1 -- 172.21.15.45:0/2774478044 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(52 609.00000000 [delete] v111'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x7ffa9c021040 con 0x7ffaa00333a0 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7ffa98053ac0 msgr2=0x7ffa980527c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7ffa98053ac0 0x7ffa980527c0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7ffaa0010950 msgr2=0x7ffaa0025420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7ffaa0010950 0x7ffaa0025420 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cb53ae9d90 msgr2=0x55cb53b631a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cb53ae9d90 0x55cb53b631a0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ffa9c016420 msgr2=0x7ffa9c0168a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7ffa9c016420 0x7ffa9c0168a0 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7ffaa001b930 msgr2=0x7ffaa0034410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7ffaa001b930 0x7ffaa0034410 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7ffaa00333a0 msgr2=0x7ffaa0033800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7ffaa00333a0 0x7ffaa0033800 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 reap_dead start 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7ffa98052d50 msgr2=0x7ffa980541f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7ffa98052d50 0x7ffa980541f0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7ffa9805b3b0 msgr2=0x7ffa9807a850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7ffa9805b3b0 0x7ffa9807a850 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 reap_dead start 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 reap_dead start 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa7eb3700 1 -- 172.21.15.45:0/2774478044 reap_dead start 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa94064400 msgr2=0x7ffa940668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa94064400 0x7ffa940668c0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c005630 tx=0x7ffa9c00c040 comp rx=0 tx=0).stop 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 msgr2=0x55cb53ae9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae9850 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7ffa9800ef60 tx=0x7ffa9800ef90 comp rx=0 tx=0).stop 2023-12-19T18:01:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 shutdown_connections 2023-12-19T18:01:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffa94064400 0x7ffa940668c0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 --2- 172.21.15.45:0/2774478044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cb53af2eb0 0x55cb53ae9850 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 >> 172.21.15.45:0/2774478044 conn(0x55cb53ad5470 msgr2=0x55cb53aa5230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 shutdown_connections 2023-12-19T18:01:48.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.558+0000 7ffaa9b7d140 1 -- 172.21.15.45:0/2774478044 wait complete. 2023-12-19T18:01:48.567 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs reset cephfs --yes-i-really-mean-it 2023-12-19T18:01:48.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.746+0000 7f5d92c08700 1 Processor -- start 2023-12-19T18:01:48.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.746+0000 7f5d92c08700 1 -- start start 2023-12-19T18:01:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92c08700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92c08700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5d8c0cdfd0 0x7f5d8c0b5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92c08700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8c15d300 con 0x7f5d8c0b8580 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92c08700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d8c0d1550 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92c08700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c0d1830 con 0x7f5d8c15cf20 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91c06700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91405700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d8c0b8580 0x7f5d8c0cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:51426/0 (socket says 172.21.15.45:51426) 2023-12-19T18:01:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91405700 1 -- 172.21.15.45:0/30265034 learned_addr learned my addr 172.21.15.45:0/30265034 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92407700 1 --2- 172.21.15.45:0/30265034 >> v2:172.21.15.45:3300/0 conn(0x7f5d8c0cdfd0 0x7f5d8c0b5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91c06700 1 -- 172.21.15.45:0/30265034 >> v2:172.21.15.45:3300/0 conn(0x7f5d8c0cdfd0 msgr2=0x7f5d8c0b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91c06700 1 --2- 172.21.15.45:0/30265034 >> v2:172.21.15.45:3300/0 conn(0x7f5d8c0cdfd0 0x7f5d8c0b5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91c06700 1 -- 172.21.15.45:0/30265034 >> v1:172.21.15.45:6789/0 conn(0x7f5d8c0b8580 legacy=0x7f5d8c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91c06700 1 -- 172.21.15.45:0/30265034 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c0d1b10 con 0x7f5d8c15cf20 2023-12-19T18:01:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d92407700 1 --2- 172.21.15.45:0/30265034 >> v2:172.21.15.45:3300/0 conn(0x7f5d8c0cdfd0 0x7f5d8c0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:48.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.750+0000 7f5d91c06700 1 --2- 172.21.15.45:0/30265034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c0d0c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009850 tx=0x7f5d88009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb11e7d6bcd3dcd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d90c04700 1 -- 172.21.15.45:0/30265034 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88011830 con 0x7f5d8c15cf20 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d90c04700 1 -- 172.21.15.45:0/30265034 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d88011990 con 0x7f5d8c15cf20 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d90c04700 1 -- 172.21.15.45:0/30265034 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d88011d20 con 0x7f5d8c15cf20 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 -- 172.21.15.45:0/30265034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 msgr2=0x7f5d8c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 --2- 172.21.15.45:0/30265034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c0d0c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5d88009850 tx=0x7f5d88009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 -- 172.21.15.45:0/30265034 shutdown_connections 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 --2- 172.21.15.45:0/30265034 >> v2:172.21.15.45:3300/0 conn(0x7f5d8c0cdfd0 0x7f5d8c0b5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 --2- 172.21.15.45:0/30265034 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c0d0c50 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 -- 172.21.15.45:0/30265034 >> 172.21.15.45:0/30265034 conn(0x7f5d8c0b4670 msgr2=0x7f5d8c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 -- 172.21.15.45:0/30265034 shutdown_connections 2023-12-19T18:01:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 -- 172.21.15.45:0/30265034 wait complete. 2023-12-19T18:01:48.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.754+0000 7f5d92c08700 1 Processor -- start 2023-12-19T18:01:48.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 -- start start 2023-12-19T18:01:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d8c0b8580 0x7f5d8c06ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 0x7f5d8c1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c1f61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c1f3160 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c1f3440 con 0x7f5d8c0b8580 2023-12-19T18:01:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92c08700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c1f3a80 con 0x7f5d8c15cf20 2023-12-19T18:01:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 0x7f5d8c1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 0x7f5d8c1f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40680/0 (socket says 172.21.15.45:40680) 2023-12-19T18:01:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 -- 172.21.15.45:0/452604550 learned_addr learned my addr 172.21.15.45:0/452604550 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d92407700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c1f61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91c06700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d8c0b8580 0x7f5d8c06ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 -- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 msgr2=0x7f5d8c1f61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c1f61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 -- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d8c0b8580 msgr2=0x7f5d8c06ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d8c0b8580 0x7f5d8c06ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 -- 172.21.15.45:0/452604550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d880094b0 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d91405700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 0x7f5d8c1f5c60 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c520 tx=0x7f5d7c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.758+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c005d90 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.762+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0070d0 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.762+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c007440 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.762+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d8c1f3d60 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.762+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d8c070160 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.762+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d8c1f3f50 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.762+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5d7c0075a0 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.766+0000 7f5d827fc700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d70065ad0 0x7f5d70067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.766+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 6519+0+0 (secure 0 0 0) 0x7f5d7c0827d0 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.766+0000 7f5d91c06700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d70065ad0 0x7f5d70067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:48.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.766+0000 7f5d91c06700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d70065ad0 0x7f5d70067f90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5d88014040 tx=0x7f5d88008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.770+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5d7c04fe70 con 0x7f5d8c0cdfd0 2023-12-19T18:01:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:48.982+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5d8c0d20a0 con 0x7f5d8c0cdfd0 2023-12-19T18:01:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.106+0000 7f5d827fc700 1 -- 172.21.15.45:0/452604550 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs reset", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v81) v1 ==== 107+0+0 (secure 0 0 0) 0x7f5d7c053490 con 0x7f5d8c0cdfd0 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d70065ad0 msgr2=0x7f5d70067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d70065ad0 0x7f5d70067f90 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5d88014040 tx=0x7f5d88008030 comp rx=0 tx=0).stop 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 msgr2=0x7f5d8c1f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 0x7f5d8c1f5c60 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c00c520 tx=0x7f5d7c00c830 comp rx=0 tx=0).stop 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 shutdown_connections 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d70065ad0 0x7f5d70067f90 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d8c15cf20 0x7f5d8c1f61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d8c0cdfd0 0x7f5d8c1f5c60 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 --2- 172.21.15.45:0/452604550 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d8c0b8580 0x7f5d8c06ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 >> 172.21.15.45:0/452604550 conn(0x7f5d8c0b4670 msgr2=0x7f5d8c0b5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 shutdown_connections 2023-12-19T18:01:49.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.110+0000 7f5d92c08700 1 -- 172.21.15.45:0/452604550 wait complete. 2023-12-19T18:01:49.123 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:01:49.119+0000 7f660fb0c700 -1 mds.0.snaptable: load_2 could not read table: -2 2023-12-19T18:01:49.123 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:01:49.119+0000 7f660fb0c700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2023-12-19T18:01:49.125 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:01:49.122+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:01:49.125 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:01:49.122+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 mds daemon damaged (MDS_DAMAGE) 2023-12-19T18:01:49.138 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-12-19T18:01:49.148 INFO:tasks.ceph.mds.b.smithi073.stderr: -21> 2023-12-19T18:01:49.119+0000 7f660fb0c700 -1 mds.0.snaptable: load_2 could not read table: -2 2023-12-19T18:01:49.148 INFO:tasks.ceph.mds.b.smithi073.stderr: -20> 2023-12-19T18:01:49.119+0000 7f660fb0c700 -1 log_channel(cluster) log [ERR] : error reading table object 'mds_snaptable' -2 ((2) No such file or directory) 2023-12-19T18:01:49.197 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:01:49.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.318+0000 7f9c90e0f700 1 Processor -- start 2023-12-19T18:01:49.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 -- start start 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c8c15cf20 0x7f9c8c0d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f9c8c0d25f0 0x7f9c8c0cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c15d300 con 0x7f9c8c15cf20 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d1550 con 0x7f9c8c0d25f0 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c90e0f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0d1830 con 0x7f9c8c0b8580 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c8b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c8c15cf20 0x7f9c8c0d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c8b7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f9c8c15cf20 0x7f9c8c0d0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34090/0 (socket says 172.21.15.45:34090) 2023-12-19T18:01:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c8b7fe700 1 -- 172.21.15.45:0/2157148341 learned_addr learned my addr 172.21.15.45:0/2157148341 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.322+0000 7f9c8bfff700 1 --2- 172.21.15.45:0/2157148341 >> v2:172.21.15.73:3300/0 conn(0x7f9c8c0d25f0 0x7f9c8c0cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c82ffd700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8b7fe700 1 -- 172.21.15.45:0/2157148341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 msgr2=0x7f9c8c0cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8b7fe700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8b7fe700 1 -- 172.21.15.45:0/2157148341 >> v2:172.21.15.73:3300/0 conn(0x7f9c8c0d25f0 msgr2=0x7f9c8c0cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8b7fe700 1 --2- 172.21.15.45:0/2157148341 >> v2:172.21.15.73:3300/0 conn(0x7f9c8c0d25f0 0x7f9c8c0cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8b7fe700 1 -- 172.21.15.45:0/2157148341 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c8c0d1b10 con 0x7f9c8c15cf20 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c82ffd700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8bfff700 1 --2- 172.21.15.45:0/2157148341 >> v2:172.21.15.73:3300/0 conn(0x7f9c8c0d25f0 0x7f9c8c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:49.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8b7fe700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c0d0c50 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c071c00 tx=0x7f9c7c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0da711947072e69 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:49.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8affd700 1 -- 172.21.15.45:0/2157148341 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00e070 con 0x7f9c8c15cf20 2023-12-19T18:01:49.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8affd700 1 -- 172.21.15.45:0/2157148341 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7c00b9c0 con 0x7f9c8c15cf20 2023-12-19T18:01:49.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c8affd700 1 -- 172.21.15.45:0/2157148341 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7c00bd70 con 0x7f9c8c15cf20 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2157148341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 msgr2=0x7f9c8c0d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c0d0c50 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c071c00 tx=0x7f9c7c00b330 comp rx=0 tx=0).stop 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2157148341 shutdown_connections 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2157148341 >> v2:172.21.15.73:3300/0 conn(0x7f9c8c0d25f0 0x7f9c8c0cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2157148341 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c0d0c50 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2157148341 >> 172.21.15.45:0/2157148341 conn(0x7f9c8c0b4670 msgr2=0x7f9c8c0b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2157148341 shutdown_connections 2023-12-19T18:01:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.326+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2157148341 wait complete. 2023-12-19T18:01:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 Processor -- start 2023-12-19T18:01:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 -- start start 2023-12-19T18:01:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0d25f0 0x7f9c8c0b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c1f1fd0 con 0x7f9c8c15cf20 2023-12-19T18:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0aa8c0 con 0x7f9c8c0d25f0 2023-12-19T18:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.330+0000 7f9c90e0f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c8c0aaba0 con 0x7f9c8c0b8580 2023-12-19T18:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34100/0 (socket says 172.21.15.45:34100) 2023-12-19T18:01:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 -- 172.21.15.45:0/2055078376 learned_addr learned my addr 172.21.15.45:0/2055078376 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:49.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c82ffd700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0d25f0 0x7f9c8c0b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8b7fe700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 -- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 msgr2=0x7f9c8c0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 -- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0d25f0 msgr2=0x7f9c8c0b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0d25f0 0x7f9c8c0b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 -- 172.21.15.45:0/2055078376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c009b30 con 0x7f9c8c15cf20 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c8bfff700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c159780 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400e810 tx=0x7f9c8400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400c070 con 0x7f9c8c15cf20 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c84004020 con 0x7f9c8c15cf20 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8c15eb50 con 0x7f9c8c15cf20 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840043b0 con 0x7f9c8c15cf20 2023-12-19T18:01:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.334+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8c0aae80 con 0x7f9c8c15cf20 2023-12-19T18:01:49.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.338+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8c15f070 con 0x7f9c8c15cf20 2023-12-19T18:01:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.338+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9c840036c0 con 0x7f9c8c15cf20 2023-12-19T18:01:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.342+0000 7f9c88ff9700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9c6c065ad0 0x7f9c6c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.342+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f9c84082e10 con 0x7f9c8c15cf20 2023-12-19T18:01:49.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.342+0000 7f9c8b7fe700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9c6c065ad0 0x7f9c6c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:49.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.342+0000 7f9c8b7fe700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9c6c065ad0 0x7f9c6c067f90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b370 tx=0x7f9c7c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.350+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9c8c15f070 con 0x7f9c8c15cf20 2023-12-19T18:01:49.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:49.570+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f9c8c15f070 con 0x7f9c8c15cf20 2023-12-19T18:01:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.146+0000 7f9c88ff9700 1 -- 172.21.15.45:0/2055078376 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v84) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9c8c15f070 con 0x7f9c8c15cf20 2023-12-19T18:01:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9c6c065ad0 msgr2=0x7f9c6c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9c6c065ad0 0x7f9c6c067f90 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9c7c00b370 tx=0x7f9c7c009000 comp rx=0 tx=0).stop 2023-12-19T18:01:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 msgr2=0x7f9c8c159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c159780 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400e810 tx=0x7f9c8400eb20 comp rx=0 tx=0).stop 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 shutdown_connections 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9c6c065ad0 0x7f9c6c067f90 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9c8c15cf20 0x7f9c8c159780 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c8c0d25f0 0x7f9c8c0b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 --2- 172.21.15.45:0/2055078376 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9c8c0b8580 0x7f9c8c0a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 >> 172.21.15.45:0/2055078376 conn(0x7f9c8c0b4670 msgr2=0x7f9c8c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 shutdown_connections 2023-12-19T18:01:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.150+0000 7f9c90e0f700 1 -- 172.21.15.45:0/2055078376 wait complete. 2023-12-19T18:01:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-12-19T18:01:50.177 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:50.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.342+0000 7f4d3ac45700 1 Processor -- start 2023-12-19T18:01:50.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3ac45700 1 -- start start 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3ac45700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d341611c0 0x7f4d340c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3ac45700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4d341615a0 0x7f4d3406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3ac45700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d3406dc80 con 0x7f4d340af720 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3ac45700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d34070340 con 0x7f4d341611c0 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3ac45700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d340c3f90 con 0x7f4d341615a0 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d39c43700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4d341611c0 0x7f4d340c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3a444700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4d340af720 0x7f4d34164f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56380/0 (socket says 172.21.15.45:56380) 2023-12-19T18:01:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d3a444700 1 -- 172.21.15.45:0/710427530 learned_addr learned my addr 172.21.15.45:0/710427530 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.346+0000 7f4d39442700 1 --2- 172.21.15.45:0/710427530 >> v2:172.21.15.73:3300/0 conn(0x7f4d341615a0 0x7f4d3406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d39c43700 1 -- 172.21.15.45:0/710427530 >> v2:172.21.15.73:3300/0 conn(0x7f4d341615a0 msgr2=0x7f4d3406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:50.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d39c43700 1 --2- 172.21.15.45:0/710427530 >> v2:172.21.15.73:3300/0 conn(0x7f4d341615a0 0x7f4d3406d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d39c43700 1 -- 172.21.15.45:0/710427530 >> v1:172.21.15.45:6789/0 conn(0x7f4d340af720 legacy=0x7f4d34164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d39c43700 1 -- 172.21.15.45:0/710427530 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d340c4270 con 0x7f4d341611c0 2023-12-19T18:01:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d39442700 1 --2- 172.21.15.45:0/710427530 >> v2:172.21.15.73:3300/0 conn(0x7f4d341615a0 0x7f4d3406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d39c43700 1 --2- 172.21.15.45:0/710427530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341611c0 0x7f4d340c3920 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4d340b1140 tx=0x7f4d30009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ed5814a4ae13260 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:50.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d38c41700 1 -- 172.21.15.45:0/710427530 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30011830 con 0x7f4d341611c0 2023-12-19T18:01:50.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d38c41700 1 -- 172.21.15.45:0/710427530 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30011990 con 0x7f4d341611c0 2023-12-19T18:01:50.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d38c41700 1 -- 172.21.15.45:0/710427530 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30011d20 con 0x7f4d341611c0 2023-12-19T18:01:50.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 -- 172.21.15.45:0/710427530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341611c0 msgr2=0x7f4d340c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/710427530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341611c0 0x7f4d340c3920 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f4d340b1140 tx=0x7f4d30009b30 comp rx=0 tx=0).stop 2023-12-19T18:01:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 -- 172.21.15.45:0/710427530 shutdown_connections 2023-12-19T18:01:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/710427530 >> v2:172.21.15.73:3300/0 conn(0x7f4d341615a0 0x7f4d3406d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/710427530 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341611c0 0x7f4d340c3920 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 -- 172.21.15.45:0/710427530 >> 172.21.15.45:0/710427530 conn(0x7f4d340cb900 msgr2=0x7f4d340b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 -- 172.21.15.45:0/710427530 shutdown_connections 2023-12-19T18:01:50.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.350+0000 7f4d3ac45700 1 -- 172.21.15.45:0/710427530 wait complete. 2023-12-19T18:01:50.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 Processor -- start 2023-12-19T18:01:50.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 -- start start 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d340af720 0x7f4d340b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d341611c0 0x7f4d340c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 0x7f4d341f7750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d340b4200 con 0x7f4d341615a0 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415f2d0 con 0x7f4d341611c0 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3ac45700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3415eff0 con 0x7f4d340af720 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 0x7f4d341f7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 0x7f4d341f7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34122/0 (socket says 172.21.15.45:34122) 2023-12-19T18:01:50.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 -- 172.21.15.45:0/837976239 learned_addr learned my addr 172.21.15.45:0/837976239 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:50.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d39442700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d341611c0 0x7f4d340c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d39c43700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d340af720 0x7f4d340b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 -- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d340af720 msgr2=0x7f4d340b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d340af720 0x7f4d340b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 -- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d341611c0 msgr2=0x7f4d340c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d341611c0 0x7f4d340c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d3a444700 1 -- 172.21.15.45:0/837976239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d240094b0 con 0x7f4d341615a0 2023-12-19T18:01:50.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.354+0000 7f4d39c43700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d340af720 0x7f4d340b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d3a444700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 0x7f4d341f7750 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00cbc0 tx=0x7f4d2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00a7b0 con 0x7f4d341615a0 2023-12-19T18:01:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c00a910 con 0x7f4d341615a0 2023-12-19T18:01:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d300094b0 con 0x7f4d341615a0 2023-12-19T18:01:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00ac80 con 0x7f4d341615a0 2023-12-19T18:01:50.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d340b1710 con 0x7f4d341615a0 2023-12-19T18:01:50.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.358+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3406e760 con 0x7f4d341615a0 2023-12-19T18:01:50.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.362+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4d2c01b3b0 con 0x7f4d341615a0 2023-12-19T18:01:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.362+0000 7f4d2a7fc700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d18065ad0 0x7f4d18067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.362+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f4d2c082dc0 con 0x7f4d341615a0 2023-12-19T18:01:50.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.362+0000 7f4d39c43700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d18065ad0 0x7f4d18067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.362+0000 7f4d39c43700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d18065ad0 0x7f4d18067f90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4d30000c00 tx=0x7f4d30008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:50.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.370+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4d2c050410 con 0x7f4d341615a0 2023-12-19T18:01:50.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.594+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d34067760 con 0x7f4d341615a0 2023-12-19T18:01:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.594+0000 7f4d2a7fc700 1 -- 172.21.15.45:0/837976239 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f4d2c053a30 con 0x7f4d341615a0 2023-12-19T18:01:50.599 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:50.599 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":57101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/4041369678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":4041369678},{"type":"v1","addr":"172.21.15.73:6834","nonce":4041369678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:50.138422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d18065ad0 msgr2=0x7f4d18067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d18065ad0 0x7f4d18067f90 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f4d30000c00 tx=0x7f4d30008030 comp rx=0 tx=0).stop 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 msgr2=0x7f4d341f7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 0x7f4d341f7750 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00cbc0 tx=0x7f4d2c00cbf0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 shutdown_connections 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4d18065ad0 0x7f4d18067f90 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4d341615a0 0x7f4d341f7750 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4d341611c0 0x7f4d340c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 --2- 172.21.15.45:0/837976239 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4d340af720 0x7f4d340b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 >> 172.21.15.45:0/837976239 conn(0x7f4d340cb900 msgr2=0x7f4d34163a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 shutdown_connections 2023-12-19T18:01:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.598+0000 7f4d3ac45700 1 -- 172.21.15.45:0/837976239 wait complete. 2023-12-19T18:01:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 84 2023-12-19T18:01:50.624 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-19T18:01:50.624 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:50.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.794+0000 7fd555037700 1 Processor -- start 2023-12-19T18:01:50.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd555037700 1 -- start start 2023-12-19T18:01:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd555037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 0x7fd5500ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd555037700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd55006e0a0 0x7fd5500cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd555037700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd55006cbb0 con 0x7fd55015af30 2023-12-19T18:01:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd555037700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd55006fa10 con 0x7fd55006e0a0 2023-12-19T18:01:50.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd555037700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55006fcf0 con 0x7fd55015ab50 2023-12-19T18:01:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd54ed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 0x7fd5500ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd54ed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 0x7fd5500ccd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:60586/0 (socket says 172.21.15.45:60586) 2023-12-19T18:01:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd54ed9d700 1 -- 172.21.15.45:0/1523496929 learned_addr learned my addr 172.21.15.45:0/1523496929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:50.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd54f59e700 1 --2- 172.21.15.45:0/1523496929 >> v2:172.21.15.73:3300/0 conn(0x7fd55006e0a0 0x7fd5500cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd54ed9d700 1 -- 172.21.15.45:0/1523496929 >> v2:172.21.15.73:3300/0 conn(0x7fd55006e0a0 msgr2=0x7fd5500cd2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.798+0000 7fd54ed9d700 1 --2- 172.21.15.45:0/1523496929 >> v2:172.21.15.73:3300/0 conn(0x7fd55006e0a0 0x7fd5500cd2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54ed9d700 1 -- 172.21.15.45:0/1523496929 >> v1:172.21.15.73:6789/0 conn(0x7fd55015af30 legacy=0x7fd55015e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54ed9d700 1 -- 172.21.15.45:0/1523496929 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd55006ffd0 con 0x7fd55015ab50 2023-12-19T18:01:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54f59e700 1 --2- 172.21.15.45:0/1523496929 >> v2:172.21.15.73:3300/0 conn(0x7fd55006e0a0 0x7fd5500cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:50.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54ed9d700 1 --2- 172.21.15.45:0/1523496929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 0x7fd5500ccd70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd540009910 tx=0x7fd540009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d034ccc33414870 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54dd9b700 1 -- 172.21.15.45:0/1523496929 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000ba60 con 0x7fd55015ab50 2023-12-19T18:01:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54dd9b700 1 -- 172.21.15.45:0/1523496929 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000bbc0 con 0x7fd55015ab50 2023-12-19T18:01:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd54dd9b700 1 -- 172.21.15.45:0/1523496929 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540009e60 con 0x7fd55015ab50 2023-12-19T18:01:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 -- 172.21.15.45:0/1523496929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 msgr2=0x7fd5500ccd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 --2- 172.21.15.45:0/1523496929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 0x7fd5500ccd70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd540009910 tx=0x7fd540009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 -- 172.21.15.45:0/1523496929 shutdown_connections 2023-12-19T18:01:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 --2- 172.21.15.45:0/1523496929 >> v2:172.21.15.73:3300/0 conn(0x7fd55006e0a0 0x7fd5500cd2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 --2- 172.21.15.45:0/1523496929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015ab50 0x7fd5500ccd70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 -- 172.21.15.45:0/1523496929 >> 172.21.15.45:0/1523496929 conn(0x7fd5500cba40 msgr2=0x7fd5500ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 -- 172.21.15.45:0/1523496929 shutdown_connections 2023-12-19T18:01:50.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.802+0000 7fd555037700 1 -- 172.21.15.45:0/1523496929 wait complete. 2023-12-19T18:01:50.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 Processor -- start 2023-12-19T18:01:50.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 -- start start 2023-12-19T18:01:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd55006e0a0 0x7fd55014fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 0x7fd5500b2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015af30 0x7fd55014f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500c38a0 con 0x7fd55015ab50 2023-12-19T18:01:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500b2ba0 con 0x7fd55006e0a0 2023-12-19T18:01:50.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd555037700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5500b44d0 con 0x7fd55015af30 2023-12-19T18:01:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 0x7fd5500b2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 0x7fd5500b2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34130/0 (socket says 172.21.15.45:34130) 2023-12-19T18:01:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 -- 172.21.15.45:0/1360157506 learned_addr learned my addr 172.21.15.45:0/1360157506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:50.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54ed9d700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd55006e0a0 0x7fd55014fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54f59e700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015af30 0x7fd55014f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 -- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015af30 msgr2=0x7fd55014f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015af30 0x7fd55014f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 -- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd55006e0a0 msgr2=0x7fd55014fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd55006e0a0 0x7fd55014fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:50.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.806+0000 7fd54e59c700 1 -- 172.21.15.45:0/1360157506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd540009570 con 0x7fd55015ab50 2023-12-19T18:01:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd54e59c700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 0x7fd5500b2660 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c4d0 tx=0x7fd54400c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440052d0 con 0x7fd55015ab50 2023-12-19T18:01:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd544005430 con 0x7fd55015ab50 2023-12-19T18:01:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5440055a0 con 0x7fd55015ab50 2023-12-19T18:01:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5500c5410 con 0x7fd55015ab50 2023-12-19T18:01:50.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd55014f990 con 0x7fd55015ab50 2023-12-19T18:01:50.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.810+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5500c3a50 con 0x7fd55015ab50 2023-12-19T18:01:50.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.814+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd5440038c0 con 0x7fd55015ab50 2023-12-19T18:01:50.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.814+0000 7fd5377fe700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd53c065ad0 0x7fd53c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.814+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fd544082760 con 0x7fd55015ab50 2023-12-19T18:01:50.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.814+0000 7fd54ed9d700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd53c065ad0 0x7fd53c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:50.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.818+0000 7fd54ed9d700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd53c065ad0 0x7fd53c067f90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd540000c00 tx=0x7fd540008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:50.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:50.822+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd5500c3a50 con 0x7fd55015ab50 2023-12-19T18:01:51.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.038+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd5500c5250 con 0x7fd55015ab50 2023-12-19T18:01:51.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.038+0000 7fd5377fe700 1 -- 172.21.15.45:0/1360157506 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fd54404fda0 con 0x7fd55015ab50 2023-12-19T18:01:51.043 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:51.043 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":57101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/4041369678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":4041369678},{"type":"v1","addr":"172.21.15.73:6834","nonce":4041369678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:50.138422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:51.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd53c065ad0 msgr2=0x7fd53c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd53c065ad0 0x7fd53c067f90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd540000c00 tx=0x7fd540008030 comp rx=0 tx=0).stop 2023-12-19T18:01:51.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 msgr2=0x7fd5500b2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 0x7fd5500b2660 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fd54400c4d0 tx=0x7fd54400c7e0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 shutdown_connections 2023-12-19T18:01:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd53c065ad0 0x7fd53c067f90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd55015af30 0x7fd55014f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd55015ab50 0x7fd5500b2660 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 --2- 172.21.15.45:0/1360157506 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd55006e0a0 0x7fd55014fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 >> 172.21.15.45:0/1360157506 conn(0x7fd5500cba40 msgr2=0x7fd5500ca1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 shutdown_connections 2023-12-19T18:01:51.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.042+0000 7fd555037700 1 -- 172.21.15.45:0/1360157506 wait complete. 2023-12-19T18:01:51.050 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 84 2023-12-19T18:01:51.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:51.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.250+0000 7f00c9243700 1 Processor -- start 2023-12-19T18:01:51.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.250+0000 7f00c9243700 1 -- start start 2023-12-19T18:01:51.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c9243700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f00c415d030 0x7f00c40d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c9243700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40d17a0 con 0x7f00c40b8ab0 2023-12-19T18:01:51.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c9243700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c40d1a80 con 0x7f00c40ce290 2023-12-19T18:01:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c9243700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c40d1d60 con 0x7f00c415d030 2023-12-19T18:01:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c259c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f00c40b8ab0 0x7f00c40cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56386/0 (socket says 172.21.15.45:56386) 2023-12-19T18:01:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c259c700 1 -- 172.21.15.45:0/2837937111 learned_addr learned my addr 172.21.15.45:0/2837937111 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/2837937111 >> v2:172.21.15.73:3300/0 conn(0x7f00c415d030 0x7f00c40d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1614949453 0 0) 0x7f00c40d17a0 con 0x7f00c40b8ab0 2023-12-19T18:01:51.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00ac0035d0 con 0x7f00c40b8ab0 2023-12-19T18:01:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849881202 0 0) 0x7f00c40d1a80 con 0x7f00c40ce290 2023-12-19T18:01:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00c40d17a0 con 0x7f00c40ce290 2023-12-19T18:01:51.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2842239010 0 0) 0x7f00ac0035d0 con 0x7f00c40b8ab0 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 >> v2:172.21.15.73:3300/0 conn(0x7f00c415d030 msgr2=0x7f00c40d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 --2- 172.21.15.45:0/2837937111 >> v2:172.21.15.73:3300/0 conn(0x7f00c415d030 0x7f00c40d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 >> v1:172.21.15.73:6789/0 conn(0x7f00c40ce290 legacy=0x7f00c40b5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40d2040 con 0x7f00c40b8ab0 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f00b8001670 con 0x7f00c40b8ab0 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 >> v1:172.21.15.45:6789/0 conn(0x7f00c40b8ab0 legacy=0x7f00c40cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00ac003c00 0x7f00ac004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ac004870 0x7f00ac004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.254+0000 7f00c1d9b700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac005230 0x7f00ac00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c40d1d60 con 0x7f00ac005230 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac00c100 con 0x7f00ac004870 2023-12-19T18:01:51.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00ac00c2c0 con 0x7f00ac003c00 2023-12-19T18:01:51.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c359e700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac005230 0x7f00ac00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c259c700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ac004870 0x7f00ac004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00ac003c00 0x7f00ac004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 -- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ac004870 msgr2=0x7f00ac004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00ac004870 0x7f00ac004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 -- 172.21.15.45:0/2837937111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac005230 msgr2=0x7f00ac00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac005230 0x7f00ac00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 -- 172.21.15.45:0/2837937111 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ac0035d0 con 0x7f00ac003c00 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c359e700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac005230 0x7f00ac00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c359e700 1 -- 172.21.15.45:0/2837937111 reap_dead start 2023-12-19T18:01:51.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00ac003c00 0x7f00ac004000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009b70 tx=0x7f00ac0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=320653afb2a7b5d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:51.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400e6c0 con 0x7f00ac003c00 2023-12-19T18:01:51.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b400e820 con 0x7f00ac003c00 2023-12-19T18:01:51.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c1d9b700 1 -- 172.21.15.45:0/2837937111 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400eb90 con 0x7f00ac003c00 2023-12-19T18:01:51.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c9243700 1 -- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00ac003c00 msgr2=0x7f00ac004000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c9243700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00ac003c00 0x7f00ac004000 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009b70 tx=0x7f00ac0058a0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c9243700 1 -- 172.21.15.45:0/2837937111 shutdown_connections 2023-12-19T18:01:51.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c9243700 1 --2- 172.21.15.45:0/2837937111 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00ac003c00 0x7f00ac004000 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.258+0000 7f00c9243700 1 -- 172.21.15.45:0/2837937111 >> 172.21.15.45:0/2837937111 conn(0x7f00c40cf830 msgr2=0x7f00c40cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:51.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.262+0000 7f00c9243700 1 -- 172.21.15.45:0/2837937111 shutdown_connections 2023-12-19T18:01:51.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.262+0000 7f00c9243700 1 -- 172.21.15.45:0/2837937111 wait complete. 2023-12-19T18:01:51.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 Processor -- start 2023-12-19T18:01:51.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 -- start start 2023-12-19T18:01:51.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 0x7f00c415d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00c41f3410 0x7f00c40cb7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00c415f600 0x7f00c415fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415dad0 con 0x7f00ac003c00 2023-12-19T18:01:51.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415e8d0 con 0x7f00c415f600 2023-12-19T18:01:51.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c415ffa0 con 0x7f00c41f3410 2023-12-19T18:01:51.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 0x7f00c415d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 0x7f00c415d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34152/0 (socket says 172.21.15.45:34152) 2023-12-19T18:01:51.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 -- 172.21.15.45:0/3848971331 learned_addr learned my addr 172.21.15.45:0/3848971331 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c259c700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00c41f3410 0x7f00c40cb7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c359e700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00c415f600 0x7f00c415fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 -- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00c41f3410 msgr2=0x7f00c40cb7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00c41f3410 0x7f00c40cb7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 -- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00c415f600 msgr2=0x7f00c415fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00c415f600 0x7f00c415fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 -- 172.21.15.45:0/3848971331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c40cbd30 con 0x7f00ac003c00 2023-12-19T18:01:51.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c2d9d700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 0x7f00c415d590 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f00b40042f0 tx=0x7f00b40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:51.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b400e6c0 con 0x7f00ac003c00 2023-12-19T18:01:51.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b4003af0 con 0x7f00ac003c00 2023-12-19T18:01:51.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b4003ea0 con 0x7f00ac003c00 2023-12-19T18:01:51.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.266+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c415e5f0 con 0x7f00ac003c00 2023-12-19T18:01:51.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.270+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c415dcc0 con 0x7f00ac003c00 2023-12-19T18:01:51.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.270+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c404ed30 con 0x7f00ac003c00 2023-12-19T18:01:51.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.270+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f00b4013470 con 0x7f00ac003c00 2023-12-19T18:01:51.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.274+0000 7f00ab7fe700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00b0065ad0 0x7f00b0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.274+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f00b4084a00 con 0x7f00ac003c00 2023-12-19T18:01:51.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.274+0000 7f00c259c700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00b0065ad0 0x7f00b0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.274+0000 7f00c259c700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00b0065ad0 0x7f00b0067f90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f00b8001050 tx=0x7f00b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:51.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.282+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f00b4052150 con 0x7f00ac003c00 2023-12-19T18:01:51.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.494+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00c40cbd30 con 0x7f00ac003c00 2023-12-19T18:01:51.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.494+0000 7f00ab7fe700 1 -- 172.21.15.45:0/3848971331 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f00c40cbd30 con 0x7f00ac003c00 2023-12-19T18:01:51.498 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:51.498 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":57101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/4041369678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":4041369678},{"type":"v1","addr":"172.21.15.73:6834","nonce":4041369678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:50.138422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:51.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.494+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00b0065ad0 msgr2=0x7f00b0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.494+0000 7f00c9243700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00b0065ad0 0x7f00b0067f90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f00b8001050 tx=0x7f00b8009040 comp rx=0 tx=0).stop 2023-12-19T18:01:51.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.494+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 msgr2=0x7f00c415d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.494+0000 7f00c9243700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 0x7f00c415d590 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f00b40042f0 tx=0x7f00b40047e0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 shutdown_connections 2023-12-19T18:01:51.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00b0065ad0 0x7f00b0067f90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00c415f600 0x7f00c415fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00c41f3410 0x7f00c40cb7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 --2- 172.21.15.45:0/3848971331 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00ac003c00 0x7f00c415d590 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 >> 172.21.15.45:0/3848971331 conn(0x7f00c40cf830 msgr2=0x7f00c40b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:51.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 shutdown_connections 2023-12-19T18:01:51.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.498+0000 7f00c9243700 1 -- 172.21.15.45:0/3848971331 wait complete. 2023-12-19T18:01:51.503 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 84 2023-12-19T18:01:51.528 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:51.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 Processor -- start 2023-12-19T18:01:51.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 -- start start 2023-12-19T18:01:51.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0b5c06ea90 0x7f0b5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b5c06fe80 0x7f0b5c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b5c0d1820 con 0x7f0b5c0b88b0 2023-12-19T18:01:51.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0d1b00 con 0x7f0b5c06fe80 2023-12-19T18:01:51.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b6091d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5c0d1de0 con 0x7f0b5c06ea90 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b5b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b5c06fe80 0x7f0b5c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b5b59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0b5c06fe80 0x7f0b5c0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34156/0 (socket says 172.21.15.45:34156) 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.706+0000 7f0b5b59e700 1 -- 172.21.15.45:0/864914899 learned_addr learned my addr 172.21.15.45:0/864914899 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b5ad9d700 1 --2- 172.21.15.45:0/864914899 >> v2:172.21.15.73:3300/0 conn(0x7f0b5c06ea90 0x7f0b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b5b59e700 1 -- 172.21.15.45:0/864914899 >> v2:172.21.15.73:3300/0 conn(0x7f0b5c06ea90 msgr2=0x7f0b5c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b5b59e700 1 --2- 172.21.15.45:0/864914899 >> v2:172.21.15.73:3300/0 conn(0x7f0b5c06ea90 0x7f0b5c0d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b5b59e700 1 -- 172.21.15.45:0/864914899 >> v1:172.21.15.45:6789/0 conn(0x7f0b5c0b88b0 legacy=0x7f0b5c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b5b59e700 1 -- 172.21.15.45:0/864914899 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0d20c0 con 0x7f0b5c06fe80 2023-12-19T18:01:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b5b59e700 1 --2- 172.21.15.45:0/864914899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c0b6420 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0b57b0 tx=0x7f0b5400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636945fd1b406059 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b59d9b700 1 -- 172.21.15.45:0/864914899 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400e070 con 0x7f0b5c06fe80 2023-12-19T18:01:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b59d9b700 1 -- 172.21.15.45:0/864914899 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5400b9c0 con 0x7f0b5c06fe80 2023-12-19T18:01:51.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b59d9b700 1 -- 172.21.15.45:0/864914899 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5400bd70 con 0x7f0b5c06fe80 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 -- 172.21.15.45:0/864914899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 msgr2=0x7f0b5c0b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 --2- 172.21.15.45:0/864914899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c0b6420 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0b57b0 tx=0x7f0b5400b330 comp rx=0 tx=0).stop 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 -- 172.21.15.45:0/864914899 shutdown_connections 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 --2- 172.21.15.45:0/864914899 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c0b6420 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 --2- 172.21.15.45:0/864914899 >> v2:172.21.15.73:3300/0 conn(0x7f0b5c06ea90 0x7f0b5c0d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 -- 172.21.15.45:0/864914899 >> 172.21.15.45:0/864914899 conn(0x7f0b5c0b46d0 msgr2=0x7f0b5c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 -- 172.21.15.45:0/864914899 shutdown_connections 2023-12-19T18:01:51.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.710+0000 7f0b6091d700 1 -- 172.21.15.45:0/864914899 wait complete. 2023-12-19T18:01:51.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 Processor -- start 2023-12-19T18:01:51.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 -- start start 2023-12-19T18:01:51.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b5c06ea90 0x7f0b5c0cc590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0b88b0 0x7f0b5c0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c0cb860 con 0x7f0b5c06fe80 2023-12-19T18:01:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1e2f30 con 0x7f0b5c0b88b0 2023-12-19T18:01:51.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b6091d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5c1e3210 con 0x7f0b5c06ea90 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b5a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b5a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34160/0 (socket says 172.21.15.45:34160) 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.714+0000 7f0b5a59c700 1 -- 172.21.15.45:0/2377931055 learned_addr learned my addr 172.21.15.45:0/2377931055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5b59e700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0b88b0 0x7f0b5c0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5ad9d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b5c06ea90 0x7f0b5c0cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5a59c700 1 -- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b5c06ea90 msgr2=0x7f0b5c0cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5a59c700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b5c06ea90 0x7f0b5c0cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5a59c700 1 -- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0b88b0 msgr2=0x7f0b5c0c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5a59c700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0b88b0 0x7f0b5c0c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5a59c700 1 -- 172.21.15.45:0/2377931055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54009b30 con 0x7f0b5c06fe80 2023-12-19T18:01:51.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b5a59c700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c159150 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000c500 tx=0x7f0b5000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:51.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500052d0 con 0x7f0b5c06fe80 2023-12-19T18:01:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b50005430 con 0x7f0b5c06fe80 2023-12-19T18:01:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5c0cbb00 con 0x7f0b5c06fe80 2023-12-19T18:01:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b500055a0 con 0x7f0b5c06fe80 2023-12-19T18:01:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5c0cc300 con 0x7f0b5c06fe80 2023-12-19T18:01:51.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.718+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b5c1e33d0 con 0x7f0b5c06fe80 2023-12-19T18:01:51.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.722+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0b500038e0 con 0x7f0b5c06fe80 2023-12-19T18:01:51.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.726+0000 7f0b437fe700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b48065b00 0x7f0b48067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:51.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.726+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7f0b50082890 con 0x7f0b5c06fe80 2023-12-19T18:01:51.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.726+0000 7f0b5ad9d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b48065b00 0x7f0b48067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:51.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.726+0000 7f0b5ad9d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b48065b00 0x7f0b48067fc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007a60 tx=0x7f0b4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:51.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.730+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0b5004fe30 con 0x7f0b5c06fe80 2023-12-19T18:01:51.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.942+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b5c067760 con 0x7f0b5c06fe80 2023-12-19T18:01:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.946+0000 7f0b437fe700 1 -- 172.21.15.45:0/2377931055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4708 (secure 0 0 0) 0x7f0b50053450 con 0x7f0b5c06fe80 2023-12-19T18:01:51.950 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:51.950 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":57101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/4041369678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":4041369678},{"type":"v1","addr":"172.21.15.73:6834","nonce":4041369678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:50.138422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:51.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b48065b00 msgr2=0x7f0b48067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b48065b00 0x7f0b48067fc0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f0b4c007a60 tx=0x7f0b4c008040 comp rx=0 tx=0).stop 2023-12-19T18:01:51.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 msgr2=0x7f0b5c159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:51.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c159150 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000c500 tx=0x7f0b5000c810 comp rx=0 tx=0).stop 2023-12-19T18:01:51.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 shutdown_connections 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0b48065b00 0x7f0b48067fc0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0b5c0b88b0 0x7f0b5c0c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0b5c06fe80 0x7f0b5c159150 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 --2- 172.21.15.45:0/2377931055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0b5c06ea90 0x7f0b5c0cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 >> 172.21.15.45:0/2377931055 conn(0x7f0b5c0b46d0 msgr2=0x7f0b5c0b72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 shutdown_connections 2023-12-19T18:01:51.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:51.950+0000 7f0b6091d700 1 -- 172.21.15.45:0/2377931055 wait complete. 2023-12-19T18:01:51.957 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 84 2023-12-19T18:01:51.978 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:52.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.146+0000 7fba9250e700 1 Processor -- start 2023-12-19T18:01:52.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.146+0000 7fba9250e700 1 -- start start 2023-12-19T18:01:52.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba9250e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba8c1615a0 0x7fba8c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba9250e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c0c3f90 con 0x7fba8c0af720 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba9250e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba8c0c4270 con 0x7fba8c1611c0 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba9250e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba8c06eb30 con 0x7fba8c1615a0 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba8c1615a0 0x7fba8c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fba8c1615a0 0x7fba8c0c3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34162/0 (socket says 172.21.15.45:34162) 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba91d0d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fba8c0af720 0x7fba8c06f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56418/0 (socket says 172.21.15.45:56418) 2023-12-19T18:01:52.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 -- 172.21.15.45:0/206740525 learned_addr learned my addr 172.21.15.45:0/206740525 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 -- 172.21.15.45:0/206740525 >> v1:172.21.15.73:6789/0 conn(0x7fba8c1611c0 legacy=0x7fba8c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 -- 172.21.15.45:0/206740525 >> v1:172.21.15.45:6789/0 conn(0x7fba8c0af720 legacy=0x7fba8c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 -- 172.21.15.45:0/206740525 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba8c06ee10 con 0x7fba8c1615a0 2023-12-19T18:01:52.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba90d0b700 1 --2- 172.21.15.45:0/206740525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1615a0 0x7fba8c0c3920 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009910 tx=0x7fba7c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef3c51f30588832 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba83fff700 1 -- 172.21.15.45:0/206740525 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c00ba60 con 0x7fba8c1615a0 2023-12-19T18:01:52.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba83fff700 1 -- 172.21.15.45:0/206740525 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c00bbc0 con 0x7fba8c1615a0 2023-12-19T18:01:52.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.150+0000 7fba83fff700 1 -- 172.21.15.45:0/206740525 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c009e60 con 0x7fba8c1615a0 2023-12-19T18:01:52.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 -- 172.21.15.45:0/206740525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1615a0 msgr2=0x7fba8c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 --2- 172.21.15.45:0/206740525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1615a0 0x7fba8c0c3920 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fba7c009910 tx=0x7fba7c009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:52.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 -- 172.21.15.45:0/206740525 shutdown_connections 2023-12-19T18:01:52.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 --2- 172.21.15.45:0/206740525 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1615a0 0x7fba8c0c3920 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 -- 172.21.15.45:0/206740525 >> 172.21.15.45:0/206740525 conn(0x7fba8c0cb900 msgr2=0x7fba8c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 -- 172.21.15.45:0/206740525 shutdown_connections 2023-12-19T18:01:52.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.154+0000 7fba9250e700 1 -- 172.21.15.45:0/206740525 wait complete. 2023-12-19T18:01:52.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 Processor -- start 2023-12-19T18:01:52.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 -- start start 2023-12-19T18:01:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba8c0af720 0x7fba8c1faa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 0x7fba8c1f6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8c1615a0 0x7fba8c15f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1fafa0 con 0x7fba8c1611c0 2023-12-19T18:01:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c150ec0 con 0x7fba8c0af720 2023-12-19T18:01:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9250e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba8c1511a0 con 0x7fba8c1615a0 2023-12-19T18:01:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba90d0b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 0x7fba8c1f6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba90d0b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 0x7fba8c1f6180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34170/0 (socket says 172.21.15.45:34170) 2023-12-19T18:01:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba90d0b700 1 -- 172.21.15.45:0/1056958552 learned_addr learned my addr 172.21.15.45:0/1056958552 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba9150c700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba8c0af720 0x7fba8c1faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.158+0000 7fba91d0d700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8c1615a0 0x7fba8c15f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba90d0b700 1 -- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8c1615a0 msgr2=0x7fba8c15f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba90d0b700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8c1615a0 0x7fba8c15f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba90d0b700 1 -- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba8c0af720 msgr2=0x7fba8c1faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba90d0b700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba8c0af720 0x7fba8c1faa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba90d0b700 1 -- 172.21.15.45:0/1056958552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba7c009570 con 0x7fba8c1611c0 2023-12-19T18:01:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba90d0b700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 0x7fba8c1f6180 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0036c0 con 0x7fba8c1611c0 2023-12-19T18:01:52.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba8c151480 con 0x7fba8c1611c0 2023-12-19T18:01:52.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7c01e070 con 0x7fba8c1611c0 2023-12-19T18:01:52.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba7c003a60 con 0x7fba8c1611c0 2023-12-19T18:01:52.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.162+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba8c151a40 con 0x7fba8c1611c0 2023-12-19T18:01:52.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.166+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba8c06e760 con 0x7fba8c1611c0 2023-12-19T18:01:52.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.166+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fba7c003bc0 con 0x7fba8c1611c0 2023-12-19T18:01:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.170+0000 7fba81ffb700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba70065ad0 0x7fba70067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.170+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fba7c020070 con 0x7fba8c1611c0 2023-12-19T18:01:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.170+0000 7fba9150c700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba70065ad0 0x7fba70067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.170+0000 7fba9150c700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba70065ad0 0x7fba70067f90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fba88000f60 tx=0x7fba88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.174+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fba7c052010 con 0x7fba8c1611c0 2023-12-19T18:01:52.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.382+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fba8c151c30 con 0x7fba8c1611c0 2023-12-19T18:01:52.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.382+0000 7fba81ffb700 1 -- 172.21.15.45:0/1056958552 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4708 (secure 0 0 0) 0x7fba7c015090 con 0x7fba8c1611c0 2023-12-19T18:01:52.388 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:52.388 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":84,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7789,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1351755980","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6833","nonce":1351755980},{"type":"v1","addr":"172.21.15.73:6835","nonce":1351755980}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":7795,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/4254227619","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6836","nonce":4254227619},{"type":"v1","addr":"172.21.15.45:6837","nonce":4254227619}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":8028,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6835/1362905241","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1362905241},{"type":"v1","addr":"172.21.15.45:6835","nonce":1362905241}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":73},{"gid":57101,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6834/4041369678","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":4041369678},{"type":"v1","addr":"172.21.15.73:6834","nonce":4041369678}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":84}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:50.138422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":112,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[],"damaged":[0],"stopped":[],"info":{},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:52.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba70065ad0 msgr2=0x7fba70067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba70065ad0 0x7fba70067f90 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fba88000f60 tx=0x7fba88009040 comp rx=0 tx=0).stop 2023-12-19T18:01:52.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 msgr2=0x7fba8c1f6180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 0x7fba8c1f6180 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fba7c000c00 tx=0x7fba7c004770 comp rx=0 tx=0).stop 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 shutdown_connections 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fba70065ad0 0x7fba70067f90 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba8c1615a0 0x7fba8c15f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba8c1611c0 0x7fba8c1f6180 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 --2- 172.21.15.45:0/1056958552 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba8c0af720 0x7fba8c1faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 >> 172.21.15.45:0/1056958552 conn(0x7fba8c0cb900 msgr2=0x7fba8c06d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 shutdown_connections 2023-12-19T18:01:52.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.386+0000 7fba9250e700 1 -- 172.21.15.45:0/1056958552 wait complete. 2023-12-19T18:01:52.394 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 84 2023-12-19T18:01:52.414 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset session 2023-12-19T18:01:52.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 -- start start 2023-12-19T18:01:52.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 Processor -- start 2023-12-19T18:01:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f69f9800 0x55c2f6a9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f69f9400 0x55c2f6a9eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 0x55c2f6a9f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78a00 con 0x55c2f69f9000 2023-12-19T18:01:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78780 con 0x55c2f69f9400 2023-12-19T18:01:52.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f1d28380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78640 con 0x55c2f69f9800 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 0x55c2f6a9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f04e2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f69f9800 0x55c2f6a9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 0x55c2f6a9f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34188/0 (socket says 172.21.15.45:34188) 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 -- 172.21.15.45:0/3389603884 learned_addr learned my addr 172.21.15.45:0/3389603884 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75efce1700 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f69f9400 0x55c2f6a9eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 -- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f69f9800 msgr2=0x55c2f6a9e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f69f9800 0x55c2f6a9e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 -- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f69f9400 msgr2=0x55c2f6a9eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f69f9400 0x55c2f6a9eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.474+0000 7f75f0ce3700 1 -- 172.21.15.45:0/3389603884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2f6a1ab60 con 0x55c2f69f9000 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f0ce3700 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 0x55c2f6a9f080 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d6bd0 tx=0x55c2f77ecc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed0ef188abee7041 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75edcdd700 1 -- 172.21.15.45:0/3389603884 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2f6a29080 con 0x55c2f69f9000 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75edcdd700 1 -- 172.21.15.45:0/3389603884 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2f77f0300 con 0x55c2f69f9000 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75edcdd700 1 -- 172.21.15.45:0/3389603884 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2f6a29600 con 0x55c2f69f9000 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2f6a1b1e0 con 0x55c2f69f9000 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55c2f6a1ab60 con 0x55c2f69f9000 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 4 waiting for MDS map... 2023-12-19T18:01:52.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75edcdd700 1 -- 172.21.15.45:0/3389603884 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55c2f6a32c40 con 0x55c2f69f9000 2023-12-19T18:01:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75edcdd700 1 -- 172.21.15.45:0/3389603884 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x55c2f6a3af00 con 0x55c2f69f9000 2023-12-19T18:01:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 4 Got MDS map 84 2023-12-19T18:01:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 10 main: main 2023-12-19T18:01:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 4 main: connecting to RADOS... 2023-12-19T18:01:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 1 Processor -- start 2023-12-19T18:01:52.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.478+0000 7f75f1d28380 1 -- start start 2023-12-19T18:01:52.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 0x55c2f6a9f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a2fe00 con 0x55c2f7770400 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78780 con 0x55c2f7770800 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78a00 con 0x55c2f7770c00 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 0x55c2f6a9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 0x55c2f6a9f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34204/0 (socket says 172.21.15.45:34204) 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 -- 172.21.15.45:0/1275860364 learned_addr learned my addr 172.21.15.45:0/1275860364 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f04e2700 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 -- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 msgr2=0x55c2f6aa0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 -- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7770800 msgr2=0x55c2f6a9fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 -- 172.21.15.45:0/1275860364 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2f6a1a340 con 0x55c2f7770400 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75efce1700 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 0x55c2f6a9f600 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d2180 tx=0x55c2f77f4c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e0f7f7fbebad27e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75ebcd9700 1 -- 172.21.15.45:0/1275860364 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2f6a29080 con 0x55c2f7770400 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75ebcd9700 1 -- 172.21.15.45:0/1275860364 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2f77f0a80 con 0x55c2f7770400 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75ebcd9700 1 -- 172.21.15.45:0/1275860364 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2f6a29600 con 0x55c2f7770400 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- 172.21.15.45:0/1275860364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 msgr2=0x55c2f6a9f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 0x55c2f6a9f600 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d2180 tx=0x55c2f77f4c60 comp rx=0 tx=0).stop 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- 172.21.15.45:0/1275860364 shutdown_connections 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 --2- 172.21.15.45:0/1275860364 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770400 0x55c2f6a9f600 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- 172.21.15.45:0/1275860364 >> 172.21.15.45:0/1275860364 conn(0x55c2f69f8c00 msgr2=0x55c2f6ac7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- 172.21.15.45:0/1275860364 shutdown_connections 2023-12-19T18:01:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.482+0000 7f75f1d28380 1 -- 172.21.15.45:0/1275860364 wait complete. 2023-12-19T18:01:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 Processor -- start 2023-12-19T18:01:52.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 -- start start 2023-12-19T18:01:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7771000 0x55c2f6aa0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78500 con 0x55c2f7770800 2023-12-19T18:01:52.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a783c0 con 0x55c2f7771000 2023-12-19T18:01:52.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f1d28380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c2f6a78280 con 0x55c2f7770c00 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75efce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75efce1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34216/0 (socket says 172.21.15.45:34216) 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75efce1700 1 -- 172.21.15.45:0/548384044 learned_addr learned my addr 172.21.15.45:0/548384044 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75f04e2700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.486+0000 7f75efce1700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7771000 0x55c2f6aa0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f04e2700 1 -- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7771000 msgr2=0x55c2f6aa0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f04e2700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f7771000 0x55c2f6aa0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f04e2700 1 -- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770800 msgr2=0x55c2f6a9fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f04e2700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f04e2700 1 -- 172.21.15.45:0/548384044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c2f6a1a000 con 0x55c2f7770c00 2023-12-19T18:01:52.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75efce1700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f7770800 0x55c2f6a9fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:52.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f04e2700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d2e10 tx=0x55c2f77f4d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75ea4d6700 1 -- 172.21.15.45:0/548384044 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2f6a29080 con 0x55c2f7770c00 2023-12-19T18:01:52.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75ea4d6700 1 -- 172.21.15.45:0/548384044 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c2f6a44180 con 0x55c2f7770c00 2023-12-19T18:01:52.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c2f6a1aea0 con 0x55c2f7770c00 2023-12-19T18:01:52.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75ea4d6700 1 -- 172.21.15.45:0/548384044 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55c2f6a29600 con 0x55c2f7770c00 2023-12-19T18:01:52.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c2f6a1b520 con 0x55c2f7770c00 2023-12-19T18:01:52.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75f1d28380 4 main: resolving pool 14 2023-12-19T18:01:52.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.490+0000 7f75ea4d6700 1 -- 172.21.15.45:0/548384044 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55c2f6a76840 con 0x55c2f7770c00 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75ea4d6700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c2f6e48000 0x55c2f6aa1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75ea4d6700 1 -- 172.21.15.45:0/548384044 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55c2f6a32a80 con 0x55c2f7770c00 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75f1d28380 4 main: creating IoCtx.. 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75f1d28380 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c2f7771400 0x55c2f6aa0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:1 14.b 14:d0630e4c:::mds0_sessionmap:head [omap-clear,omap-set-header in=14b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55c2f7771800 con 0x55c2f7771400 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75efce1700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c2f6e48000 0x55c2f6aa1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75efce1700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c2f7771400 0x55c2f6aa0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75efce1700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c2f6e48000 0x55c2f6aa1700 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d2300 tx=0x55c2f6e56000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.494+0000 7f75efce1700 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c2f7771400 0x55c2f6aa0c00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75efce1700 1 -- 172.21.15.45:0/548384044 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(1 mds0_sessionmap [omap-clear,omap-set-header] v112'5 uv5 ondisk = 0) v8 ==== 201+0+0 (crc 0 0 0) 0x55c2f7882b40 con 0x55c2f7771400 2023-12-19T18:01:52.502 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:52.503 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T18:01:52.503 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T18:01:52.503 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T18:01:52.503 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:52.503 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:52.503 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:52.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c2f7771400 msgr2=0x55c2f6aa0c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55c2f7771400 0x55c2f6aa0c00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c2f6e48000 msgr2=0x55c2f6aa1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55c2f6e48000 0x55c2f6aa1700 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d2300 tx=0x55c2f6e56000 comp rx=0 tx=0).stop 2023-12-19T18:01:52.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 msgr2=0x55c2f6aa0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/548384044 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f7770c00 0x55c2f6aa0100 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d2e10 tx=0x55c2f77f4d20 comp rx=0 tx=0).stop 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f04e2700 1 -- 172.21.15.45:0/548384044 reap_dead start 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 shutdown_connections 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 >> 172.21.15.45:0/548384044 conn(0x55c2f69f8c00 msgr2=0x55c2f6ac7800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 shutdown_connections 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/548384044 wait complete. 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 msgr2=0x55c2f6a9f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 0x55c2f6a9f080 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x55c2f77d6bd0 tx=0x55c2f77ecc60 comp rx=0 tx=0).stop 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 shutdown_connections 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55c2f69f9000 0x55c2f6a9f080 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2f69f9400 0x55c2f6a9eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 --2- 172.21.15.45:0/3389603884 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55c2f69f9800 0x55c2f6a9e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 >> 172.21.15.45:0/3389603884 conn(0x55c2f69f9c00 msgr2=0x55c2f6ac7000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 shutdown_connections 2023-12-19T18:01:52.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.498+0000 7f75f1d28380 1 -- 172.21.15.45:0/3389603884 wait complete. 2023-12-19T18:01:52.512 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'session'] in time 0:00:00.098141, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T18:01:52.512 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset snap 2023-12-19T18:01:52.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.570+0000 7fa4a3fa6380 1 -- start start 2023-12-19T18:01:52.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.570+0000 7fa4a3fa6380 1 Processor -- start 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.570+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5ed9ff800 0x55a5edaa4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5ed9ff400 0x55a5edaa4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 0x55a5edaa5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda35e00 con 0x55a5ed9ff000 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7ea00 con 0x55a5ed9ff800 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e640 con 0x55a5ed9ff400 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 0x55a5edaa5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 0x55a5edaa5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34234/0 (socket says 172.21.15.45:34234) 2023-12-19T18:01:52.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 -- 172.21.15.45:0/4069879311 learned_addr learned my addr 172.21.15.45:0/4069879311 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5ed9ff400 0x55a5edaa4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2760700 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5ed9ff800 0x55a5edaa4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 -- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5ed9ff400 msgr2=0x55a5edaa4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5ed9ff400 0x55a5edaa4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 -- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5ed9ff800 msgr2=0x55a5edaa4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5ed9ff800 0x55a5edaa4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 -- 172.21.15.45:0/4069879311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5eda20b60 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a2f61700 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 0x55a5edaa5080 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x55a5edb5eba0 tx=0x55a5edad5380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83f0e5cae93b5eea server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa49ff5b700 1 -- 172.21.15.45:0/4069879311 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a5eda2f080 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa49ff5b700 1 -- 172.21.15.45:0/4069879311 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5ee7da300 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa49ff5b700 1 -- 172.21.15.45:0/4069879311 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a5eda2f600 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5eda211e0 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55a5eda20b60 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 4 waiting for MDS map... 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa49ff5b700 1 -- 172.21.15.45:0/4069879311 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55a5eda38c40 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa49ff5b700 1 -- 172.21.15.45:0/4069879311 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x55a5eda40f00 con 0x55a5ed9ff000 2023-12-19T18:01:52.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 4 Got MDS map 84 2023-12-19T18:01:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 10 main: main 2023-12-19T18:01:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.574+0000 7fa4a3fa6380 4 main: connecting to RADOS... 2023-12-19T18:01:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 Processor -- start 2023-12-19T18:01:52.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 -- start start 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfa400 0x55a5edaa5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 0x55a5edaa5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfac00 0x55a5edaa6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e500 con 0x55a5edcfa800 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e3c0 con 0x55a5edcfa400 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e640 con 0x55a5edcfac00 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 0x55a5edaa5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 0x55a5edaa5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34240/0 (socket says 172.21.15.45:34240) 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 -- 172.21.15.45:0/130209557 learned_addr learned my addr 172.21.15.45:0/130209557 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfa400 0x55a5edaa5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfac00 0x55a5edaa6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 -- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfac00 msgr2=0x55a5edaa6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfac00 0x55a5edaa6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 -- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfa400 msgr2=0x55a5edaa5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfa400 0x55a5edaa5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 -- 172.21.15.45:0/130209557 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5eda20340 con 0x55a5edcfa800 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfac00 0x55a5edaa6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa4a2760700 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 0x55a5edaa5b80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x55a5edd460f0 tx=0x55a5edcfcc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=660b72315abfc614 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa49df57700 1 -- 172.21.15.45:0/130209557 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a5eda2f080 con 0x55a5edcfa800 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa49df57700 1 -- 172.21.15.45:0/130209557 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5eda4a900 con 0x55a5edcfa800 2023-12-19T18:01:52.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.578+0000 7fa49df57700 1 -- 172.21.15.45:0/130209557 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a5eda2f600 con 0x55a5edcfa800 2023-12-19T18:01:52.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/130209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 msgr2=0x55a5edaa5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 0x55a5edaa5b80 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x55a5edd460f0 tx=0x55a5edcfcc00 comp rx=0 tx=0).stop 2023-12-19T18:01:52.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/130209557 shutdown_connections 2023-12-19T18:01:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfac00 0x55a5edaa6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa800 0x55a5edaa5b80 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/130209557 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfa400 0x55a5edaa5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/130209557 >> 172.21.15.45:0/130209557 conn(0x55a5ed9fec00 msgr2=0x55a5edabb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/130209557 shutdown_connections 2023-12-19T18:01:52.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/130209557 wait complete. 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 Processor -- start 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- start start 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa400 0x55a5edaa7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfa800 0x55a5edaa6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfac00 0x55a5edaa6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e280 con 0x55a5edcfa400 2023-12-19T18:01:52.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e140 con 0x55a5edcfac00 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a3fa6380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5eda7e000 con 0x55a5edcfa800 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa400 0x55a5edaa7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa400 0x55a5edaa7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34254/0 (socket says 172.21.15.45:34254) 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 -- 172.21.15.45:0/1104348238 learned_addr learned my addr 172.21.15.45:0/1104348238 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a2760700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfa800 0x55a5edaa6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfac00 0x55a5edaa6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 -- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfa800 msgr2=0x55a5edaa6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5edcfa800 0x55a5edaa6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 -- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfac00 msgr2=0x55a5edaa6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5edcfac00 0x55a5edaa6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.582+0000 7fa4a1f5f700 1 -- 172.21.15.45:0/1104348238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5eda20000 con 0x55a5edcfa400 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa400 0x55a5edaa7180 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x55a5edd46d80 tx=0x55a5edcfcd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa49c754700 1 -- 172.21.15.45:0/1104348238 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a5eda2f080 con 0x55a5edcfa400 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa49c754700 1 -- 172.21.15.45:0/1104348238 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5eda4a180 con 0x55a5edcfa400 2023-12-19T18:01:52.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa49c754700 1 -- 172.21.15.45:0/1104348238 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55a5eda2f600 con 0x55a5edcfa400 2023-12-19T18:01:52.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a5eda20ea0 con 0x55a5edcfa400 2023-12-19T18:01:52.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5eda21520 con 0x55a5edcfa400 2023-12-19T18:01:52.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa4a3fa6380 4 main: resolving pool 14 2023-12-19T18:01:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.586+0000 7fa49c754700 1 -- 172.21.15.45:0/1104348238 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55a5eda7c840 con 0x55a5edcfa400 2023-12-19T18:01:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa49c754700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a5ede4a000 0x55a5edaa7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa49c754700 1 -- 172.21.15.45:0/1104348238 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55a5eda38a80 con 0x55a5edcfa400 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a3fa6380 4 main: creating IoCtx.. 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a2760700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a5ede4a000 0x55a5edaa7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a5edcfb000 0x55a5edaa6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:1 14.d 14:b50e409b:::mds_snaptable:head [writefull 0~70 in=70b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55a5edcfb400 con 0x55a5edcfb000 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a2760700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a5ede4a000 0x55a5edaa7700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55a5edd460f0 tx=0x55a5ee872de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a5edcfb000 0x55a5edaa6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.590+0000 7fa4a1f5f700 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a5edcfb000 0x55a5edaa6100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a1f5f700 1 -- 172.21.15.45:0/1104348238 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(1 mds_snaptable [writefull 0~70] v112'3 uv3 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55a5ee870b40 con 0x55a5edcfb000 2023-12-19T18:01:52.599 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:52.600 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T18:01:52.600 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:52.600 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:52.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a5edcfb000 msgr2=0x55a5edaa6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55a5edcfb000 0x55a5edaa6100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a5ede4a000 msgr2=0x55a5edaa7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55a5ede4a000 0x55a5edaa7700 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x55a5edd460f0 tx=0x55a5ee872de0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa400 msgr2=0x55a5edaa7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/1104348238 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5edcfa400 0x55a5edaa7180 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x55a5edd46d80 tx=0x55a5edcfcd80 comp rx=0 tx=0).stop 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a2760700 1 -- 172.21.15.45:0/1104348238 reap_dead start 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 shutdown_connections 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 >> 172.21.15.45:0/1104348238 conn(0x55a5ed9fec00 msgr2=0x55a5edabb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 shutdown_connections 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.594+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/1104348238 wait complete. 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 msgr2=0x55a5edaa5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 0x55a5edaa5080 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x55a5edb5eba0 tx=0x55a5edad5380 comp rx=0 tx=0).stop 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 shutdown_connections 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55a5ed9ff000 0x55a5edaa5080 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55a5ed9ff400 0x55a5edaa4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 --2- 172.21.15.45:0/4069879311 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55a5ed9ff800 0x55a5edaa4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 >> 172.21.15.45:0/4069879311 conn(0x55a5ed9ffc00 msgr2=0x55a5edabb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 shutdown_connections 2023-12-19T18:01:52.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.598+0000 7fa4a3fa6380 1 -- 172.21.15.45:0/4069879311 wait complete. 2023-12-19T18:01:52.610 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'snap'] in time 0:00:00.097363, result: { "result": 0 } 2023-12-19T18:01:52.610 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 cephfs:0 reset inode 2023-12-19T18:01:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 -- start start 2023-12-19T18:01:52.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 Processor -- start 2023-12-19T18:01:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64b0f000 0x55af64bb4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64b0f400 0x55af64bb4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 0x55af64bb5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af64b45e00 con 0x55af64b0f800 2023-12-19T18:01:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e780 con 0x55af64b0f000 2023-12-19T18:01:52.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17eb53e380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e640 con 0x55af64b0f400 2023-12-19T18:01:52.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17ea4f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 0x55af64bb5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17ea4f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 0x55af64bb5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34280/0 (socket says 172.21.15.45:34280) 2023-12-19T18:01:52.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17ea4f9700 1 -- 172.21.15.45:0/3123507839 learned_addr learned my addr 172.21.15.45:0/3123507839 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64b0f000 0x55af64bb4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.670+0000 7f17e94f7700 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64b0f400 0x55af64bb4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17ea4f9700 1 -- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64b0f400 msgr2=0x55af64bb4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17ea4f9700 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64b0f400 0x55af64bb4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17ea4f9700 1 -- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64b0f000 msgr2=0x55af64bb4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17ea4f9700 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64b0f000 0x55af64bb4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17ea4f9700 1 -- 172.21.15.45:0/3123507839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af64b30b60 con 0x55af64b0f800 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17ea4f9700 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 0x55af64bb5080 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x55af6587c7b0 tx=0x55af658f4480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=676920e2b0391b4a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17e74f3700 1 -- 172.21.15.45:0/3123507839 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55af64b3f600 con 0x55af64b0f800 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17e74f3700 1 -- 172.21.15.45:0/3123507839 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af64b5a480 con 0x55af64b0f800 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17e74f3700 1 -- 172.21.15.45:0/3123507839 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55af64b3f1e0 con 0x55af64b0f800 2023-12-19T18:01:52.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af64b30340 con 0x55af64b0f800 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55af64b30000 con 0x55af64b0f800 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 4 waiting for MDS map... 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17e74f3700 1 -- 172.21.15.45:0/3123507839 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55af64b48c40 con 0x55af64b0f800 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17e74f3700 1 -- 172.21.15.45:0/3123507839 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x55af64df8300 con 0x55af64b0f800 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 4 Got MDS map 84 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 10 main: main 2023-12-19T18:01:52.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 4 main: connecting to RADOS... 2023-12-19T18:01:52.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 1 Processor -- start 2023-12-19T18:01:52.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.674+0000 7f17eb53e380 1 -- start start 2023-12-19T18:01:52.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50400 0x55af64bb5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50c00 0x55af64bb6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e500 con 0x55af64e50800 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e3c0 con 0x55af64e50400 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e780 con 0x55af64e50c00 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34288/0 (socket says 172.21.15.45:34288) 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 -- 172.21.15.45:0/196735837 learned_addr learned my addr 172.21.15.45:0/196735837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e94f7700 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50400 0x55af64bb5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e94f7700 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50c00 0x55af64bb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 -- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50c00 msgr2=0x55af64bb6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50c00 0x55af64bb6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 -- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50400 msgr2=0x55af64bb5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50400 0x55af64bb5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 -- 172.21.15.45:0/196735837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af64b30ea0 con 0x55af64e50800 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e94f7700 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50c00 0x55af64bb6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb5b80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x55af6587dce0 tx=0x55af64e00c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23cb5feb6adfa2f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e54ef700 1 -- 172.21.15.45:0/196735837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55af64b3f600 con 0x55af64e50800 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e54ef700 1 -- 172.21.15.45:0/196735837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af64b5a900 con 0x55af64e50800 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17e54ef700 1 -- 172.21.15.45:0/196735837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55af64b3f1e0 con 0x55af64e50800 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- 172.21.15.45:0/196735837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 msgr2=0x55af64bb5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb5b80 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x55af6587dce0 tx=0x55af64e00c00 comp rx=0 tx=0).stop 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- 172.21.15.45:0/196735837 shutdown_connections 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50c00 0x55af64bb6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb5b80 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 --2- 172.21.15.45:0/196735837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50400 0x55af64bb5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- 172.21.15.45:0/196735837 >> 172.21.15.45:0/196735837 conn(0x55af64e50000 msgr2=0x55af64bcb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- 172.21.15.45:0/196735837 shutdown_connections 2023-12-19T18:01:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.678+0000 7f17eb53e380 1 -- 172.21.15.45:0/196735837 wait complete. 2023-12-19T18:01:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 Processor -- start 2023-12-19T18:01:52.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 -- start start 2023-12-19T18:01:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50400 0x55af64bb7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50c00 0x55af64bb6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e280 con 0x55af64e50800 2023-12-19T18:01:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e140 con 0x55af64e50c00 2023-12-19T18:01:52.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af64b8e000 con 0x55af64e50400 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34292/0 (socket says 172.21.15.45:34292) 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50400 0x55af64bb7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 -- 172.21.15.45:0/4230677246 learned_addr learned my addr 172.21.15.45:0/4230677246 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50c00 0x55af64bb6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 -- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50400 msgr2=0x55af64bb7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50400 0x55af64bb7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 -- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50c00 msgr2=0x55af64bb6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64e50c00 0x55af64bb6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 -- 172.21.15.45:0/4230677246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af64b30b60 con 0x55af64e50800 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64e50400 0x55af64bb7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e9cf8700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb6c00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x55af6587ddd0 tx=0x55af658f4420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e3cec700 1 -- 172.21.15.45:0/4230677246 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55af64b3edc0 con 0x55af64e50800 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e3cec700 1 -- 172.21.15.45:0/4230677246 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af65900600 con 0x55af64e50800 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17e3cec700 1 -- 172.21.15.45:0/4230677246 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55af64b3f600 con 0x55af64e50800 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.682+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55af64b30340 con 0x55af64e50800 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.686+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af64b31520 con 0x55af64e50800 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.686+0000 7f17eb53e380 4 main: resolving pool 14 2023-12-19T18:01:52.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.686+0000 7f17e3cec700 1 -- 172.21.15.45:0/4230677246 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55af64b8c840 con 0x55af64e50800 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17e3cec700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55af64e51800 0x55af64bb7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17e3cec700 1 -- 172.21.15.45:0/4230677246 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55af64b48a80 con 0x55af64e50800 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17eb53e380 4 main: creating IoCtx.. 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17eb53e380 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55af64e51c00 0x55af64bb6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55af64e51800 0x55af64bb7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55af64f7a000 con 0x55af64e51c00 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55af64e51c00 0x55af64bb6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55af64e51800 0x55af64bb7700 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x55af658eaed0 tx=0x55af658f4180 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.690+0000 7f17e94f7700 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55af64e51c00 0x55af64bb6100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17e94f7700 1 -- 172.21.15.45:0/4230677246 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v112'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55af6598eb40 con 0x55af64e51c00 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout: "0": { 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout: "data": {}, 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout: "result": 0 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:52.698 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55af64e51c00 msgr2=0x55af64bb6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55af64e51c00 0x55af64bb6100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55af64e51800 msgr2=0x55af64bb7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55af64e51800 0x55af64bb7700 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x55af658eaed0 tx=0x55af658f4180 comp rx=0 tx=0).stop 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 msgr2=0x55af64bb6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/4230677246 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64e50800 0x55af64bb6c00 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x55af6587ddd0 tx=0x55af658f4420 comp rx=0 tx=0).stop 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17e9cf8700 1 -- 172.21.15.45:0/4230677246 reap_dead start 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 shutdown_connections 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 >> 172.21.15.45:0/4230677246 conn(0x55af64e50000 msgr2=0x55af64bcb800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 shutdown_connections 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/4230677246 wait complete. 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 msgr2=0x55af64bb5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 0x55af64bb5080 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x55af6587c7b0 tx=0x55af658f4480 comp rx=0 tx=0).stop 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 shutdown_connections 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55af64b0f800 0x55af64bb5080 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55af64b0f400 0x55af64bb4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 --2- 172.21.15.45:0/3123507839 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55af64b0f000 0x55af64bb4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 >> 172.21.15.45:0/3123507839 conn(0x55af64b0ec00 msgr2=0x55af64bcb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 shutdown_connections 2023-12-19T18:01:52.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.694+0000 7f17eb53e380 1 -- 172.21.15.45:0/3123507839 wait complete. 2023-12-19T18:01:52.707 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'cephfs:0', 'reset', 'inode'] in time 0:00:00.096847, result: { "0": { "data": {}, "result": 0 } } 2023-12-19T18:01:52.707 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2023-12-19T18:01:52.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 -- start start 2023-12-19T18:01:52.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 Processor -- start 2023-12-19T18:01:52.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f206d800 0x5640f2112580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 0x5640f2112b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f206d000 0x5640f2113080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20a3e00 con 0x5640f206d000 2023-12-19T18:01:52.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20eca00 con 0x5640f206d800 2023-12-19T18:01:52.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec640 con 0x5640f206d400 2023-12-19T18:01:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1814ff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f206d000 0x5640f2113080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa180cfe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f206d800 0x5640f2112580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 0x5640f2112b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa180cfe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f206d800 0x5640f2112580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:36608/0 (socket says 172.21.15.45:36608) 2023-12-19T18:01:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa180cfe700 1 -- 172.21.15.45:0/1404495190 learned_addr learned my addr 172.21.15.45:0/1404495190 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 0x5640f2112b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:60714/0 (socket says 172.21.15.45:60714) 2023-12-19T18:01:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 -- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f206d800 msgr2=0x5640f2112580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f206d800 0x5640f2112580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 -- 172.21.15.45:0/1404495190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f206d000 msgr2=0x5640f2113080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f206d000 0x5640f2113080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 -- 172.21.15.45:0/1404495190 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f208eb60 con 0x5640f206d400 2023-12-19T18:01:52.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1814ff700 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f206d000 0x5640f2113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa1804fd700 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 0x5640f2112b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5640f2e3cea0 tx=0x5640f2eeae40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb7baf7b1c900bc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa17e4f9700 1 -- 172.21.15.45:0/1404495190 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209d600 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa17e4f9700 1 -- 172.21.15.45:0/1404495190 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640f20b8180 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640f208e340 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5640f208e000 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa182544380 4 waiting for MDS map... 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.778+0000 7fa17e4f9700 1 -- 172.21.15.45:0/1404495190 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209d1e0 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa17e4f9700 1 -- 172.21.15.45:0/1404495190 <== mon.2 v2:172.21.15.73:3301/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x5640f20a6c40 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa17e4f9700 1 -- 172.21.15.45:0/1404495190 <== mon.2 v2:172.21.15.73:3301/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x5640f236c000 con 0x5640f206d400 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 4 Got MDS map 84 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 10 main: JournalTool::main 2023-12-19T18:01:52.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 4 main: JournalTool: connecting to RADOS... 2023-12-19T18:01:52.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 Processor -- start 2023-12-19T18:01:52.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 -- start start 2023-12-19T18:01:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2113600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 0x5640f2113b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2375000 0x5640f2114100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec500 con 0x5640f2374c00 2023-12-19T18:01:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec3c0 con 0x5640f2375000 2023-12-19T18:01:52.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.782+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f20eca00 con 0x5640f2374800 2023-12-19T18:01:52.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 0x5640f2113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 0x5640f2113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34318/0 (socket says 172.21.15.45:34318) 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 -- 172.21.15.45:0/536153365 learned_addr learned my addr 172.21.15.45:0/536153365 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa1814ff700 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa1804fd700 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2375000 0x5640f2114100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 -- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 msgr2=0x5640f2113600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2113600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 -- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2375000 msgr2=0x5640f2114100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2375000 0x5640f2114100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 -- 172.21.15.45:0/536153365 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f208eea0 con 0x5640f2374c00 2023-12-19T18:01:52.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa180cfe700 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 0x5640f2113b80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x5640f23cc030 tx=0x5640f2ef0c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdffbae1489039c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa17c4f5700 1 -- 172.21.15.45:0/536153365 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209d600 con 0x5640f2374c00 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa17c4f5700 1 -- 172.21.15.45:0/536153365 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640f20b8900 con 0x5640f2374c00 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa17c4f5700 1 -- 172.21.15.45:0/536153365 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209d1e0 con 0x5640f2374c00 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 -- 172.21.15.45:0/536153365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 msgr2=0x5640f2113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 0x5640f2113b80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x5640f23cc030 tx=0x5640f2ef0c00 comp rx=0 tx=0).stop 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 -- 172.21.15.45:0/536153365 shutdown_connections 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2375000 0x5640f2114100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2374c00 0x5640f2113b80 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 --2- 172.21.15.45:0/536153365 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2113600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 -- 172.21.15.45:0/536153365 >> 172.21.15.45:0/536153365 conn(0x5640f206cc00 msgr2=0x5640f2181800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 -- 172.21.15.45:0/536153365 shutdown_connections 2023-12-19T18:01:52.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 -- 172.21.15.45:0/536153365 wait complete. 2023-12-19T18:01:52.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.786+0000 7fa182544380 1 Processor -- start 2023-12-19T18:01:52.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 -- start start 2023-12-19T18:01:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2115180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2374c00 0x5640f2114c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 0x5640f2114680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec280 con 0x5640f2375000 2023-12-19T18:01:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec140 con 0x5640f2374c00 2023-12-19T18:01:52.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec000 con 0x5640f2374800 2023-12-19T18:01:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 0x5640f2114680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 0x5640f2114680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34334/0 (socket says 172.21.15.45:34334) 2023-12-19T18:01:52.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 -- 172.21.15.45:0/3426451059 learned_addr learned my addr 172.21.15.45:0/3426451059 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1814ff700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2115180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa180cfe700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2374c00 0x5640f2114c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 -- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 msgr2=0x5640f2115180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2115180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 -- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2374c00 msgr2=0x5640f2114c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2374c00 0x5640f2114c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 -- 172.21.15.45:0/3426451059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f208eb60 con 0x5640f2375000 2023-12-19T18:01:52.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa1804fd700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 0x5640f2114680 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x5640f23cd290 tx=0x5640f2eead80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa17acf2700 1 -- 172.21.15.45:0/3426451059 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209cf20 con 0x5640f2375000 2023-12-19T18:01:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa17acf2700 1 -- 172.21.15.45:0/3426451059 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640f2e50c00 con 0x5640f2375000 2023-12-19T18:01:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5640f208e340 con 0x5640f2375000 2023-12-19T18:01:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.790+0000 7fa17acf2700 1 -- 172.21.15.45:0/3426451059 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209d600 con 0x5640f2375000 2023-12-19T18:01:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.794+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640f208f520 con 0x5640f2375000 2023-12-19T18:01:52.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.794+0000 7fa182544380 4 main: JournalTool: resolving pool 14 2023-12-19T18:01:52.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.794+0000 7fa17acf2700 1 -- 172.21.15.45:0/3426451059 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5640f20ea840 con 0x5640f2375000 2023-12-19T18:01:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.794+0000 7fa17acf2700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5640f23e0800 0x5640f2115700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.794+0000 7fa17acf2700 1 -- 172.21.15.45:0/3426451059 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x5640f20a6a80 con 0x5640f2375000 2023-12-19T18:01:52.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 4 main: JournalTool: creating IoCtx.. 2023-12-19T18:01:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 4 main: Executing for rank 0 2023-12-19T18:01:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa1814ff700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5640f23e0800 0x5640f2115700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa1814ff700 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5640f23e0800 0x5640f2115700 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x5640f20c3830 tx=0x5640f2143380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 -- start start 2023-12-19T18:01:52.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 Processor -- start 2023-12-19T18:01:52.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2375800 0x5640f2114100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 0x5640f2113b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f23e0c00 0x5640f2113600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ed040 con 0x5640f2375c00 2023-12-19T18:01:52.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec000 con 0x5640f23e0c00 2023-12-19T18:01:52.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa182544380 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5640f20ec140 con 0x5640f2375800 2023-12-19T18:01:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa180cfe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 0x5640f2113b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa1814ff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2375800 0x5640f2114100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa180cfe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 0x5640f2113b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34340/0 (socket says 172.21.15.45:34340) 2023-12-19T18:01:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.798+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 learned_addr learned my addr 172.21.15.45:0/235255254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa1804fd700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f23e0c00 0x5640f2113600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2375800 msgr2=0x5640f2114100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa180cfe700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2375800 0x5640f2114100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f23e0c00 msgr2=0x5640f2113600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa180cfe700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f23e0c00 0x5640f2113600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640f2416ea0 con 0x5640f2375c00 2023-12-19T18:01:52.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa1814ff700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2375800 0x5640f2114100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:52.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa180cfe700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 0x5640f2113b80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x5640f249d0b0 tx=0x5640f2eead20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3fc699b712b3c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa177cec700 1 -- 172.21.15.45:0/235255254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209cdc0 con 0x5640f2375c00 2023-12-19T18:01:52.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa177cec700 1 -- 172.21.15.45:0/235255254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5640f2e51980 con 0x5640f2375c00 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5640f2416d00 con 0x5640f2375c00 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5640f2416b60 con 0x5640f2375c00 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa182544380 4 waiting for MDS map... 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa177cec700 1 -- 172.21.15.45:0/235255254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5640f209c6e0 con 0x5640f2375c00 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa177cec700 1 -- 172.21.15.45:0/235255254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x5640f20a6700 con 0x5640f2375c00 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa177cec700 1 -- 172.21.15.45:0/235255254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x5640f23ce600 con 0x5640f2375c00 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa182544380 4 Got MDS map 84 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5640f23e1000 0x5640f2540000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f23e1400 con 0x5640f23e1000 2023-12-19T18:01:52.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa1814ff700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5640f23e1000 0x5640f2540000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.802+0000 7fa1814ff700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5640f23e1000 0x5640f2540000 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=c144875def1a227 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.806+0000 7fa1814ff700 1 -- 172.21.15.45:0/235255254 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v112'4 uv4 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4eb40 con 0x5640f23e1000 2023-12-19T18:01:52.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.806+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5640f23e1800 0x5640f2540580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.806+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f23e1c00 con 0x5640f23e1800 2023-12-19T18:01:52.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.806+0000 7fa1804fd700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5640f23e1800 0x5640f2540580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.810+0000 7fa1804fd700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5640f23e1800 0x5640f2540580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=b8e48bb465908a85 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.810+0000 7fa1804fd700 1 -- 172.21.15.45:0/235255254 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v112'47 uv47 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4ed80 con 0x5640f23e1800 2023-12-19T18:01:52.816 INFO:teuthology.orchestra.run.smithi045.stdout:writing EResetJournal entry 2023-12-19T18:01:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.810+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f252cc00 con 0x5640f23e1800 2023-12-19T18:01:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.810+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5640f252d000 0x5640f2540b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.810+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f252d400 con 0x5640f252d000 2023-12-19T18:01:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.810+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5640f252d800 0x5640f2541080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 14.b 14:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f252dc00 con 0x5640f252d800 2023-12-19T18:01:52.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:6 14.1f 14:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f255e000 con 0x5640f252d800 2023-12-19T18:01:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 14.1a 14:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f255e400 con 0x5640f252d800 2023-12-19T18:01:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 14.1e 14:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f255e800 con 0x5640f23e1000 2023-12-19T18:01:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa180cfe700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5640f252d800 0x5640f2541080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa1814ff700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5640f252d000 0x5640f2540b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa1814ff700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5640f252d000 0x5640f2540b00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=1377940bd15510b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa180cfe700 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5640f252d800 0x5640f2541080 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=2001d99a32e5e93 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa1804fd700 1 -- 172.21.15.45:0/235255254 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(3 200.00000001 [delete] v112'48 uv47 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4ed80 con 0x5640f23e1800 2023-12-19T18:01:52.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.814+0000 7fa1814ff700 1 -- 172.21.15.45:0/235255254 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(8 200.00000006 [delete] v112'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4eb40 con 0x5640f23e1000 2023-12-19T18:01:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa1814ff700 1 -- 172.21.15.45:0/235255254 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(4 200.00000002 [delete] v112'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4eb40 con 0x5640f252d000 2023-12-19T18:01:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa1764e9700 1 -- 172.21.15.45:0/235255254 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 14.14 14:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5640f23e1400 con 0x5640f23e1800 2023-12-19T18:01:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(5 200.00000003 [delete] v112'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4f8c0 con 0x5640f252d800 2023-12-19T18:01:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(7 200.00000005 [delete] v112'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4f8c0 con 0x5640f252d800 2023-12-19T18:01:52.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(6 200.00000004 [delete] v112'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4f8c0 con 0x5640f252d800 2023-12-19T18:01:52.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa1804fd700 1 -- 172.21.15.45:0/235255254 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(9 200.00000001 [write 0~48] v112'49 uv49 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x5640f2e4ed80 con 0x5640f23e1800 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 4 Successfully wrote new journal pointer and header for rank 5:0 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5640f252d800 msgr2=0x5640f2541080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5640f252d800 0x5640f2541080 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5640f252d000 msgr2=0x5640f2540b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5640f252d000 0x5640f2540b00 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5640f23e1800 msgr2=0x5640f2540580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5640f23e1800 0x5640f2540580 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5640f23e1000 msgr2=0x5640f2540000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5640f23e1000 0x5640f2540000 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa180cfe700 1 -- 172.21.15.45:0/235255254 reap_dead start 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 msgr2=0x5640f2113b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 0x5640f2113b80 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x5640f249d0b0 tx=0x5640f2eead20 comp rx=0 tx=0).stop 2023-12-19T18:01:52.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 shutdown_connections 2023-12-19T18:01:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/235255254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375c00 0x5640f2113b80 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 >> 172.21.15.45:0/235255254 conn(0x5640f2375400 msgr2=0x5640f2182000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 shutdown_connections 2023-12-19T18:01:52.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/235255254 wait complete. 2023-12-19T18:01:52.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5640f23e0800 msgr2=0x5640f2115700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5640f23e0800 0x5640f2115700 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x5640f20c3830 tx=0x5640f2143380 comp rx=0 tx=0).stop 2023-12-19T18:01:52.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 msgr2=0x5640f2114680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 0x5640f2114680 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x5640f23cd290 tx=0x5640f2eead80 comp rx=0 tx=0).stop 2023-12-19T18:01:52.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.818+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 shutdown_connections 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5640f23e0800 0x5640f2115700 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f2375000 0x5640f2114680 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f2374c00 0x5640f2114c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/3426451059 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f2374800 0x5640f2115180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 >> 172.21.15.45:0/3426451059 conn(0x5640f206cc00 msgr2=0x5640f2181800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 shutdown_connections 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/3426451059 wait complete. 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 msgr2=0x5640f2112b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 0x5640f2112b00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x5640f2e3cea0 tx=0x5640f2eeae40 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 shutdown_connections 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5640f206d000 0x5640f2113080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5640f206d400 0x5640f2112b00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 --2- 172.21.15.45:0/1404495190 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5640f206d800 0x5640f2112580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 >> 172.21.15.45:0/1404495190 conn(0x5640f206dc00 msgr2=0x5640f2181000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 shutdown_connections 2023-12-19T18:01:52.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.822+0000 7fa182544380 1 -- 172.21.15.45:0/1404495190 wait complete. 2023-12-19T18:01:52.833 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.126667, result: writing EResetJournal entry 2023-12-19T18:01:52.834 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 init 2023-12-19T18:01:52.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.890+0000 7efd775bd840 1 -- start start 2023-12-19T18:01:52.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.890+0000 7efd775bd840 1 Processor -- start 2023-12-19T18:01:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8c67000 0x559ee8d0c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8c67400 0x559ee8d0cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 0x559ee8d0d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6a00 con 0x559ee8c67800 2023-12-19T18:01:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6780 con 0x559ee8c67000 2023-12-19T18:01:52.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6640 con 0x559ee8c67400 2023-12-19T18:01:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 0x559ee8d0d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 0x559ee8d0d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34372/0 (socket says 172.21.15.45:34372) 2023-12-19T18:01:52.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 -- 172.21.15.45:0/678749690 learned_addr learned my addr 172.21.15.45:0/678749690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd75578700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8c67400 0x559ee8d0cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd75d79700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8c67000 0x559ee8d0c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 -- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8c67400 msgr2=0x559ee8d0cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8c67400 0x559ee8d0cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 -- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8c67000 msgr2=0x559ee8d0c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8c67000 0x559ee8d0c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 -- 172.21.15.45:0/678749690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ee8c88b60 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd75d79700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8c67000 0x559ee8d0c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd75578700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8c67400 0x559ee8d0cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd7657a700 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 0x559ee8d0d080 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x559ee8dcd5c0 tx=0x559ee9a5c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9205ca5f2c674a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd73574700 1 -- 172.21.15.45:0/678749690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ee8c97600 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd73574700 1 -- 172.21.15.45:0/678749690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ee8cb2480 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd73574700 1 -- 172.21.15.45:0/678749690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ee8c971e0 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ee8c88340 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559ee8c88000 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 4 waiting for MDS map... 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd73574700 1 -- 172.21.15.45:0/678749690 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x559ee8ca0c40 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd73574700 1 -- 172.21.15.45:0/678749690 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x559ee8f54000 con 0x559ee8c67800 2023-12-19T18:01:52.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 4 Got MDS map 84 2023-12-19T18:01:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 4 datascan.main: Using metadata pool output 2023-12-19T18:01:52.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 4 datascan.main: connecting to RADOS... 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.894+0000 7efd775bd840 1 Processor -- start 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 -- start start 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ee8c9de00 con 0x559ee8fb8c00 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6780 con 0x559ee8fb8400 2023-12-19T18:01:52.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6500 con 0x559ee8fb8800 2023-12-19T18:01:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34380/0 (socket says 172.21.15.45:34380) 2023-12-19T18:01:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 -- 172.21.15.45:0/3010301837 learned_addr learned my addr 172.21.15.45:0/3010301837 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75d79700 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 -- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 msgr2=0x559ee8d0db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 -- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 msgr2=0x559ee8d0d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 -- 172.21.15.45:0/3010301837 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ee8c88ea0 con 0x559ee8fb8c00 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd75578700 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e100 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x559ee9a5e9c0 tx=0x559ee9a5c060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e07832d268408a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd71570700 1 -- 172.21.15.45:0/3010301837 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ee8c97080 con 0x559ee8fb8c00 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd71570700 1 -- 172.21.15.45:0/3010301837 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ee9a6b080 con 0x559ee8fb8c00 2023-12-19T18:01:52.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd71570700 1 -- 172.21.15.45:0/3010301837 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ee8c97600 con 0x559ee8fb8c00 2023-12-19T18:01:52.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 -- 172.21.15.45:0/3010301837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 msgr2=0x559ee8d0e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.898+0000 7efd775bd840 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e100 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x559ee9a5e9c0 tx=0x559ee9a5c060 comp rx=0 tx=0).stop 2023-12-19T18:01:52.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- 172.21.15.45:0/3010301837 shutdown_connections 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e100 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 --2- 172.21.15.45:0/3010301837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- 172.21.15.45:0/3010301837 >> 172.21.15.45:0/3010301837 conn(0x559ee8fb8000 msgr2=0x559ee8d7b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- 172.21.15.45:0/3010301837 shutdown_connections 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- 172.21.15.45:0/3010301837 wait complete. 2023-12-19T18:01:52.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 Processor -- start 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- start start 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce63c0 con 0x559ee8fb8c00 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6280 con 0x559ee8fb8400 2023-12-19T18:01:52.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd775bd840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ee8ce6140 con 0x559ee8fb8800 2023-12-19T18:01:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34384/0 (socket says 172.21.15.45:34384) 2023-12-19T18:01:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75d79700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 -- 172.21.15.45:0/4020542271 learned_addr learned my addr 172.21.15.45:0/4020542271 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 msgr2=0x559ee8d0ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8fb8800 0x559ee8d0ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 msgr2=0x559ee8d0f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8fb8400 0x559ee8d0f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.902+0000 7efd75578700 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ee8c891e0 con 0x559ee8fb8c00 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd75578700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e680 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x559ee9a5f680 tx=0x559ee9a5c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd6fd6d700 1 -- 172.21.15.45:0/4020542271 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ee8c971e0 con 0x559ee8fb8c00 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd6fd6d700 1 -- 172.21.15.45:0/4020542271 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ee9a6af00 con 0x559ee8fb8c00 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ee8c88ea0 con 0x559ee8fb8c00 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd6fd6d700 1 -- 172.21.15.45:0/4020542271 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ee8c96dc0 con 0x559ee8fb8c00 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ee8c88b60 con 0x559ee8fb8c00 2023-12-19T18:01:52.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd775bd840 4 datascan.init: resolving metadata pool 14 2023-12-19T18:01:52.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.906+0000 7efd6fd6d700 1 -- 172.21.15.45:0/4020542271 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x559ee8cc4840 con 0x559ee8fb8c00 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd6fd6d700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559ee8fb9400 0x559ee8d0f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd6fd6d700 1 -- 172.21.15.45:0/4020542271 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x559ee8ca0a80 con 0x559ee8fb8c00 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd775bd840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x559ee8fb9800 0x559ee8d0e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd75d79700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559ee8fb9400 0x559ee8d0f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x559ee8fb9c00 con 0x559ee8fb9800 2023-12-19T18:01:52.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd75578700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x559ee8fb9800 0x559ee8d0e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd75d79700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559ee8fb9400 0x559ee8d0f700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x559ee8dcc960 tx=0x559ee8f6fda0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd75578700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x559ee8fb9800 0x559ee8d0e100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd75578700 1 -- 172.21.15.45:0/4020542271 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 160+0+0 (crc 0 0 0) 0x559ee9a66b40 con 0x559ee8fb9800 2023-12-19T18:01:52.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.910+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:2 14.14 14:287034c4:::1.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x559ee90d8000 con 0x559ee8fb9800 2023-12-19T18:01:52.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.914+0000 7efd75578700 1 -- 172.21.15.45:0/4020542271 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(2 1.00000000.inode [writefull 0~582] v112'50 uv50 ondisk = 0) v8 ==== 160+0+0 (crc 0 0 0) 0x559ee9a66b40 con 0x559ee8fb9800 2023-12-19T18:01:52.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.914+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559ee90d8400 0x559ee8d0db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.914+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 14.1f 14:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x559ee90d8800 con 0x559ee90d8400 2023-12-19T18:01:52.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.914+0000 7efd7657a700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559ee90d8400 0x559ee8d0db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.914+0000 7efd7657a700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559ee90d8400 0x559ee8d0db80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.918+0000 7efd7657a700 1 -- 172.21.15.45:0/4020542271 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 100.00000000.inode [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 162+0+0 (crc 0 0 0) 0x559ee9a67200 con 0x559ee90d8400 2023-12-19T18:01:52.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.918+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:4 14.1f 14:fe07bba1:::100.00000000.inode:head [writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x559ee90d8c00 con 0x559ee90d8400 2023-12-19T18:01:52.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.918+0000 7efd7657a700 1 -- 172.21.15.45:0/4020542271 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(4 100.00000000.inode [writefull 0~582] v112'10 uv10 ondisk = 0) v8 ==== 162+0+0 (crc 0 0 0) 0x559ee9a67200 con 0x559ee90d8400 2023-12-19T18:01:52.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x559ee90d9000 0x559ee8d0d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:52.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:5 14.13 14:cd5a64a3:::100.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x559ee90d9400 con 0x559ee90d9000 2023-12-19T18:01:52.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd75d79700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x559ee90d9000 0x559ee8d0d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:52.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd75d79700 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x559ee90d9000 0x559ee8d0d600 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:52.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd75d79700 1 -- 172.21.15.45:0/4020542271 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(5 100.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x559ee9a678c0 con 0x559ee90d9000 2023-12-19T18:01:52.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd775bd840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:01:52.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.922+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:6 14.13 14:cd5a64a3:::100.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x559ee90d9800 con 0x559ee90d9000 2023-12-19T18:01:52.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd75d79700 1 -- 172.21.15.45:0/4020542271 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(6 100.00000000 [create,omap-set-header] v112'7 uv7 ondisk = 0) v8 ==== 198+0+0 (crc 0 0 0) 0x559ee9a678c0 con 0x559ee90d9000 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x100 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559ee90d8400 msgr2=0x559ee8d0db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x559ee90d8400 0x559ee8d0db80 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x559ee90d9000 msgr2=0x559ee8d0d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x559ee90d9000 0x559ee8d0d600 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x559ee8fb9800 msgr2=0x559ee8d0e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x559ee8fb9800 0x559ee8d0e100 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd75d79700 1 -- 172.21.15.45:0/4020542271 reap_dead start 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559ee8fb9400 msgr2=0x559ee8d0f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559ee8fb9400 0x559ee8d0f700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x559ee8dcc960 tx=0x559ee8f6fda0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 msgr2=0x559ee8d0e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e680 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x559ee9a5f680 tx=0x559ee9a5c0c0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 shutdown_connections 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x559ee8fb9400 0x559ee8d0f700 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/4020542271 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8fb8c00 0x559ee8d0e680 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 >> 172.21.15.45:0/4020542271 conn(0x559ee8fb8000 msgr2=0x559ee8d7b800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 shutdown_connections 2023-12-19T18:01:52.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/4020542271 wait complete. 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 msgr2=0x559ee8d0d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 0x559ee8d0d080 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x559ee8dcd5c0 tx=0x559ee9a5c480 comp rx=0 tx=0).stop 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 shutdown_connections 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x559ee8c67800 0x559ee8d0d080 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x559ee8c67400 0x559ee8d0cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 --2- 172.21.15.45:0/678749690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x559ee8c67000 0x559ee8d0c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 >> 172.21.15.45:0/678749690 conn(0x559ee8c66c00 msgr2=0x559ee8d7b000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 shutdown_connections 2023-12-19T18:01:52.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:52.926+0000 7efd775bd840 1 -- 172.21.15.45:0/678749690 wait complete. 2023-12-19T18:01:52.938 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'init'] in time 0:00:00.104592, result: 2023-12-19T18:01:52.938 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents 2023-12-19T18:01:53.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 -- start start 2023-12-19T18:01:53.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 Processor -- start 2023-12-19T18:01:53.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78ab79000 0x55b78ac1e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 0x55b78ac1eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78ab79800 0x55b78ac1f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8a00 con 0x55b78ab79400 2023-12-19T18:01:53.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8780 con 0x55b78ab79000 2023-12-19T18:01:53.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedda2c840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8640 con 0x55b78ab79800 2023-12-19T18:01:53.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedb9e7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 0x55b78ac1eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedb9e7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 0x55b78ac1eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34398/0 (socket says 172.21.15.45:34398) 2023-12-19T18:01:53.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedb9e7700 1 -- 172.21.15.45:0/1626340538 learned_addr learned my addr 172.21.15.45:0/1626340538 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78ab79800 0x55b78ac1f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.002+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78ab79000 0x55b78ac1e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedb9e7700 1 -- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78ab79800 msgr2=0x55b78ac1f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78ab79800 0x55b78ac1f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedb9e7700 1 -- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78ab79000 msgr2=0x55b78ac1e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78ab79000 0x55b78ac1e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedb9e7700 1 -- 172.21.15.45:0/1626340538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b78ab9ab60 con 0x55b78ab79400 2023-12-19T18:01:53.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 0x55b78ac1eb00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x55b78ac815f0 tx=0x55b78b960480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cde8fa03c0adf6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efed99e3700 1 -- 172.21.15.45:0/1626340538 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b78aba9600 con 0x55b78ab79400 2023-12-19T18:01:53.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efed99e3700 1 -- 172.21.15.45:0/1626340538 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b78abc4480 con 0x55b78ab79400 2023-12-19T18:01:53.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efed99e3700 1 -- 172.21.15.45:0/1626340538 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b78aba91e0 con 0x55b78ab79400 2023-12-19T18:01:53.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b78ab9a340 con 0x55b78ab79400 2023-12-19T18:01:53.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55b78ab9a000 con 0x55b78ab79400 2023-12-19T18:01:53.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 4 waiting for MDS map... 2023-12-19T18:01:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efed99e3700 1 -- 172.21.15.45:0/1626340538 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55b78abb2c40 con 0x55b78ab79400 2023-12-19T18:01:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efed99e3700 1 -- 172.21.15.45:0/1626340538 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x55b78b96a300 con 0x55b78ab79400 2023-12-19T18:01:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 4 Got MDS map 84 2023-12-19T18:01:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 4 datascan.main: Using metadata pool output 2023-12-19T18:01:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 4 datascan.main: connecting to RADOS... 2023-12-19T18:01:53.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 1 Processor -- start 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.006+0000 7efedda2c840 1 -- start start 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac1f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac1fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78abafe00 con 0x55b78aebc800 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8780 con 0x55b78aebc400 2023-12-19T18:01:53.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8500 con 0x55b78aebcc00 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac1fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac1fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34406/0 (socket says 172.21.15.45:34406) 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 -- 172.21.15.45:0/2495382856 learned_addr learned my addr 172.21.15.45:0/2495382856 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc9e9700 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac1f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedb9e7700 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 -- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 msgr2=0x55b78ac20100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 -- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 msgr2=0x55b78ac1f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac1f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 -- 172.21.15.45:0/2495382856 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b78ab9aea0 con 0x55b78aebc800 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedc1e8700 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac1fb80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x55b78b962a50 tx=0x55b78b958c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82534216c6e4ef3a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efed79df700 1 -- 172.21.15.45:0/2495382856 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b78aba9600 con 0x55b78aebc800 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efed79df700 1 -- 172.21.15.45:0/2495382856 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b78b96e780 con 0x55b78aebc800 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efed79df700 1 -- 172.21.15.45:0/2495382856 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b78aba91e0 con 0x55b78aebc800 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- 172.21.15.45:0/2495382856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 msgr2=0x55b78ac1fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac1fb80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x55b78b962a50 tx=0x55b78b958c00 comp rx=0 tx=0).stop 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- 172.21.15.45:0/2495382856 shutdown_connections 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac1fb80 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 --2- 172.21.15.45:0/2495382856 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac1f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- 172.21.15.45:0/2495382856 >> 172.21.15.45:0/2495382856 conn(0x55b78aebc000 msgr2=0x55b78ac69800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- 172.21.15.45:0/2495382856 shutdown_connections 2023-12-19T18:01:53.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.010+0000 7efedda2c840 1 -- 172.21.15.45:0/2495382856 wait complete. 2023-12-19T18:01:53.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 Processor -- start 2023-12-19T18:01:53.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 -- start start 2023-12-19T18:01:53.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac21180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac20c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf83c0 con 0x55b78aebc800 2023-12-19T18:01:53.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8280 con 0x55b78aebc400 2023-12-19T18:01:53.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedda2c840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b78abf8140 con 0x55b78aebcc00 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedc1e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac20c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedc1e8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac20c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34408/0 (socket says 172.21.15.45:34408) 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 learned_addr learned my addr 172.21.15.45:0/1376593367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac21180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 msgr2=0x55b78ac21180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78aebc400 0x55b78ac21180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 msgr2=0x55b78ac20c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac20c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b78ab9ab60 con 0x55b78aebcc00 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78aebc800 0x55b78ac20c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.014+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b78ac81980 tx=0x55b78b9602a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.018+0000 7efed61dc700 1 -- 172.21.15.45:0/1376593367 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b78aba8f20 con 0x55b78aebcc00 2023-12-19T18:01:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.018+0000 7efed61dc700 1 -- 172.21.15.45:0/1376593367 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b78b96ea80 con 0x55b78aebcc00 2023-12-19T18:01:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.018+0000 7efed61dc700 1 -- 172.21.15.45:0/1376593367 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55b78aba9600 con 0x55b78aebcc00 2023-12-19T18:01:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.018+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b78ab9a340 con 0x55b78aebcc00 2023-12-19T18:01:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.018+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b78ab9b520 con 0x55b78aebcc00 2023-12-19T18:01:53.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.018+0000 7efedda2c840 4 datascan.init: resolving metadata pool 14 2023-12-19T18:01:53.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efed61dc700 1 -- 172.21.15.45:0/1376593367 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55b78abd6840 con 0x55b78aebcc00 2023-12-19T18:01:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efed61dc700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b78aebdc00 0x55b78ac21700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efed61dc700 1 -- 172.21.15.45:0/1376593367 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55b78abb2a80 con 0x55b78aebcc00 2023-12-19T18:01:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:01:53.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 4 datascan.main: data pool 'cephfs_data' has ID 15 2023-12-19T18:01:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T18:01:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 4 datascan.main: data pool 'cephfs_data_extra' has ID 16 2023-12-19T18:01:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 4 datascan.main: opening data pool 'cephfs_data_extra' 2023-12-19T18:01:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b78afe6000 0x55b78ac20100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b78aebdc00 0x55b78ac21700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 15.0 15:00000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe6000 2023-12-19T18:01:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b78afe6000 0x55b78ac20100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b78aebdc00 0x55b78ac21700 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55b78ac80420 tx=0x55b78b960000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.022+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b78afe6000 0x55b78ac20100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efed71de700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b78afe7400 0x55b78afec000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 15.20 15:04000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78afe7400 2023-12-19T18:01:53.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b78afe7400 0x55b78afec000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b78afe7400 0x55b78afec000 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(2 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efed79df700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b78aff0000 0x55b78afec580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:3 15.10 15:08000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0400 con 0x55b78aff0000 2023-12-19T18:01:53.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.026+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b78aff0000 0x55b78afec580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.030+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b78aff0000 0x55b78afec580 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.030+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(3 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.030+0000 7efed71de700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b78afe7c00 0x55b78afecb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.030+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:4 15.30 15:0c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78afe7c00 2023-12-19T18:01:53.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.030+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b78afe7c00 0x55b78afecb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.030+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b78afe7c00 0x55b78afecb00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(4 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:5 15.8 15:10000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78afe6000 2023-12-19T18:01:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(5 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:6 15.28 15:14000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1000 con 0x55b78afe7c00 2023-12-19T18:01:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(6 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efed79df700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b78aff0400 0x55b78afed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:7 15.18 15:18000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78aff0400 2023-12-19T18:01:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.034+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b78aff0400 0x55b78afed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b78aff0400 0x55b78afed600 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(7 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efed71de700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55b78aff1400 0x55b78afed080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:8 15.38 15:1c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78aff1400 2023-12-19T18:01:53.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55b78aff1400 0x55b78afed080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efedc1e8700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55b78aff1400 0x55b78afed080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(8 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:9 15.4 15:20000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe7400 2023-12-19T18:01:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.038+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(9 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efed71de700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b78aff1800 0x55b78afee100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:10 15.24 15:24000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78aff1800 2023-12-19T18:01:53.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b78aff1800 0x55b78afee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efedb9e7700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b78aff1800 0x55b78afee100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(10 [pgnls start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:11 15.14 15:28000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78aff1800 2023-12-19T18:01:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(11 [pgnls start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.042+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:12 15.34 15:2c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78aff0000 2023-12-19T18:01:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(12 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efed79df700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b78aff1000 0x55b78afedb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:13 15.c 15:30000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78aff1000 2023-12-19T18:01:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b78aff1000 0x55b78afedb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efedc9e9700 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b78aff1000 0x55b78afedb80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(13 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:14 15.2c 15:34000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010000 con 0x55b78aff0000 2023-12-19T18:01:53.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.046+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(14 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:15 15.1c 15:38000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78afe7400 2023-12-19T18:01:53.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(15 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:16 15.3c 15:3c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff0400 2023-12-19T18:01:53.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(16 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:17 15.2 15:40000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011400 con 0x55b78afe6000 2023-12-19T18:01:53.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(17 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:18 15.22 15:44000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78afe6000 2023-12-19T18:01:53.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(18 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.050+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:19 15.12 15:48000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011800 con 0x55b78aff0400 2023-12-19T18:01:53.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(19 [pgnls start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:20 15.32 15:4c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010c00 con 0x55b78afe6000 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(20 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:21 15.a 15:50000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78afe6000 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(21 [pgnls start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:22 15.2a 15:54000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011000 con 0x55b78aff1400 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(22 [pgnls start_epoch 112 out=81b] v110'10 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:23 15.2a 15:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78aff1400 2023-12-19T18:01:53.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(23 100000001f6.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T18:01:53.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.054+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:24 15.2a 15:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78aff1400 2023-12-19T18:01:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.058+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(24 100000001f6.00000000 [call] v112'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.058+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:25 15.1a 15:58000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78aff1000 2023-12-19T18:01:53.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(25 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:26 15.3a 15:5c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78afe7c00 2023-12-19T18:01:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(26 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 15.6 15:60000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78aff1400 2023-12-19T18:01:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(27 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:28 15.26 15:64000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010c00 con 0x55b78aff1400 2023-12-19T18:01:53.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(28 [pgnls start_epoch 112 out=49b] v110'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.062+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 15.16 15:68000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78aff1400 2023-12-19T18:01:53.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(29 [pgnls start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:30 15.36 15:6c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78aff1800 2023-12-19T18:01:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(30 [pgnls start_epoch 112 out=101b] v110'17 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:31 15.36 15:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011000 con 0x55b78aff1800 2023-12-19T18:01:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(31 100000001f9.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T18:01:53.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.066+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010000 con 0x55b78aff1800 2023-12-19T18:01:53.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.070+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(32 100000001f9.00000000 [call] v112'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.070+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:33 15.36 15:6fe38dc2::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011400 con 0x55b78aff1800 2023-12-19T18:01:53.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.070+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(33 [pgnls start_epoch 112 out=81b] v112'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.070+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:34 15.36 15:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78aff1800 2023-12-19T18:01:53.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.070+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(34 100000001f7.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.070+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T18:01:53.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.074+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:35 15.36 15:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78aff1800 2023-12-19T18:01:53.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.074+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(35 100000001f7.00000000 [call] v112'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.074+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:36 15.e 15:70000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011000 con 0x55b78afe6000 2023-12-19T18:01:53.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(36 [pgnls start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:37 15.2e 15:74000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78aff0400 2023-12-19T18:01:53.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(37 [pgnls start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:38 15.1e 15:78000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78afe6000 2023-12-19T18:01:53.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(38 [pgnls start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:39 15.3e 15:7c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78aff1400 2023-12-19T18:01:53.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(39 [pgnls start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:40 15.1 15:80000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78aff1800 2023-12-19T18:01:53.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.078+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(40 [pgnls start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:41 15.21 15:84000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020800 con 0x55b78aff0400 2023-12-19T18:01:53.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(41 [pgnls start_epoch 112 out=49b] v110'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:42 15.11 15:88000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78afe6000 2023-12-19T18:01:53.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(42 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:43 15.31 15:8c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020c00 con 0x55b78aff0400 2023-12-19T18:01:53.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(43 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:44 15.9 15:90000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78aff1800 2023-12-19T18:01:53.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(44 [pgnls start_epoch 112 out=49b] v110'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.082+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:45 15.29 15:94000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021000 con 0x55b78aff1400 2023-12-19T18:01:53.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(45 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:46 15.19 15:98000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78aff0000 2023-12-19T18:01:53.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(46 [pgnls start_epoch 112 out=81b] v110'11 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:47 15.19 15:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010000 con 0x55b78aff0000 2023-12-19T18:01:53.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(47 100000001f8.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T18:01:53.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.086+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:48 15.19 15:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78aff0000 2023-12-19T18:01:53.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.090+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(48 100000001f8.00000000 [call] v112'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.090+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:49 15.39 15:9c000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78afe7c00 2023-12-19T18:01:53.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.090+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(49 [pgnls start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.090+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:50 15.5 15:a0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010c00 con 0x55b78aff1800 2023-12-19T18:01:53.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(50 [pgnls start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:51 15.25 15:a4000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021400 con 0x55b78afe7c00 2023-12-19T18:01:53.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(51 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:52 15.15 15:a8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011000 con 0x55b78afe7c00 2023-12-19T18:01:53.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(52 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:53 15.35 15:ac000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78afe7c00 2023-12-19T18:01:53.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(53 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.094+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:54 15.d 15:b0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78afe7c00 2023-12-19T18:01:53.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(54 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:55 15.2d 15:b4000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78afe6000 2023-12-19T18:01:53.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(55 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:56 15.1d 15:b8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011800 con 0x55b78aff0000 2023-12-19T18:01:53.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(56 [pgnls start_epoch 112 out=49b] v110'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:57 15.3d 15:bc000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78afe7400 2023-12-19T18:01:53.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(57 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.098+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:58 15.3 15:c0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78aff0000 2023-12-19T18:01:53.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.102+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(58 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.102+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:59 15.23 15:c4000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78aff1400 2023-12-19T18:01:53.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.102+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(59 [pgnls start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.102+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:60 15.13 15:c8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78afe7400 2023-12-19T18:01:53.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.102+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(60 [pgnls start_epoch 112 out=81b] v110'16 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.102+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:61 15.13 15:ca8fdbba:::100000001fb.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78afe7400 2023-12-19T18:01:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(61 100000001fb.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.0 2023-12-19T18:01:53.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:62 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021800 con 0x55b78afe7400 2023-12-19T18:01:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(62 100000001fb.00000000 [call] v112'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:63 15.33 15:cc000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021c00 con 0x55b78aff0400 2023-12-19T18:01:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(63 [pgnls start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.106+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:64 15.b 15:d0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021000 con 0x55b78afe6000 2023-12-19T18:01:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(64 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:65 15.2b 15:d4000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011400 con 0x55b78afe6000 2023-12-19T18:01:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(65 [pgnls start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:66 15.1b 15:d8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe7c00 2023-12-19T18:01:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(66 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:67 15.3b 15:dc000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78aff1800 2023-12-19T18:01:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(67 [pgnls start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.110+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:68 15.7 15:e0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78afe7400 2023-12-19T18:01:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.114+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(68 [pgnls start_epoch 112 out=81b] v110'6 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.114+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:69 15.7 15:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021400 con 0x55b78afe7400 2023-12-19T18:01:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.114+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(69 10000000001.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.114+0000 7efedda2c840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T18:01:53.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.114+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:70 15.7 15:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020800 con 0x55b78afe7400 2023-12-19T18:01:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.118+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(70 10000000001.00000000 [call] v112'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.118+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:71 15.27 15:e4000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78aff1800 2023-12-19T18:01:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.118+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(71 [pgnls start_epoch 112 out=49b] v110'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.118+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:72 15.17 15:e8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78aff0000 2023-12-19T18:01:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.118+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(72 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.118+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:73 15.37 15:ec000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78aff0000 2023-12-19T18:01:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(73 [pgnls start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:74 15.f 15:f0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78aff1800 2023-12-19T18:01:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(74 [pgnls start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:75 15.2f 15:f4000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020c00 con 0x55b78aff1400 2023-12-19T18:01:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(75 [pgnls start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:76 15.1f 15:f8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010000 con 0x55b78aff0400 2023-12-19T18:01:53.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(76 [pgnls start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.122+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:77 15.3f 15:fc000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78afe7400 2023-12-19T18:01:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.126+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(77 [pgnls start_epoch 112 out=81b] v110'9 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.126+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:78 15.3f 15:feb1c803:::100000001fa.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010c00 con 0x55b78afe7400 2023-12-19T18:01:53.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.126+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(78 100000001fa.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.126+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.0 2023-12-19T18:01:53.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.126+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:79 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011000 con 0x55b78afe7400 2023-12-19T18:01:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.130+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(79 100000001fa.00000000 [call] v112'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.130+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:80 16.0 16:00000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff1400 2023-12-19T18:01:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.130+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(80 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.130+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:81 16.10 16:08000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78afe6000 2023-12-19T18:01:53.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.130+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 13 ==== osd_op_reply(81 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.130+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:82 16.8 16:10000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78aff1400 2023-12-19T18:01:53.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(82 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:83 16.8 16:1247e94b:::100000001f9.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78aff1400 2023-12-19T18:01:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(83 100000001f9.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.1 2023-12-19T18:01:53.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:84 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78aff1800 2023-12-19T18:01:53.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(84 100000001f9.00000000 [call,setxattr (8)] v112'20 uv20 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.134+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:85 16.18 16:18000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78aff1400 2023-12-19T18:01:53.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(85 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:86 16.18 16:1cd44203:::100000001fb.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021800 con 0x55b78aff1400 2023-12-19T18:01:53.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(86 100000001fb.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.2 2023-12-19T18:01:53.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:87 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021c00 con 0x55b78afe7400 2023-12-19T18:01:53.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(87 100000001fb.00000000 [call,setxattr (8)] v112'18 uv18 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.138+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:88 16.4 16:20000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010000 con 0x55b78aff0400 2023-12-19T18:01:53.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(88 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:89 16.4 16:24ae92ec:::100000001fb.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011800 con 0x55b78aff0400 2023-12-19T18:01:53.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(89 100000001fb.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.1 2023-12-19T18:01:53.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:90 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011400 con 0x55b78afe7400 2023-12-19T18:01:53.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(90 100000001fb.00000000 [call,setxattr (8)] v112'19 uv19 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.142+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:91 16.14 16:28000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78aff1400 2023-12-19T18:01:53.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(91 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:92 16.c 16:30000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78aff1000 2023-12-19T18:01:53.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(92 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:93 16.c 16:30604137:::100000001fc.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78aff1000 2023-12-19T18:01:53.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(93 100000001fc.00000000 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628284.0 2023-12-19T18:01:53.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.146+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:94 15.c 15:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78aff1000 2023-12-19T18:01:53.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(94 100000001fc.00000000 [call,setxattr (8)] v112'7 uv7 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:95 16.1c 16:38000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78afe6000 2023-12-19T18:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 14 ==== osd_op_reply(95 [pgnls start_epoch 112 out=101b] v110'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:96 16.1c 16:398da958:::100000001f7.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78afe6000 2023-12-19T18:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 15 ==== osd_op_reply(96 100000001f7.00000002 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628279.2 2023-12-19T18:01:53.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.150+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:97 15.36 15:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78aff1800 2023-12-19T18:01:53.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.154+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 16 ==== osd_op_reply(97 100000001f7.00000000 [call,setxattr (8)] v112'21 uv21 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.154+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:98 16.1c 16:3c0114ac::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021800 con 0x55b78afe6000 2023-12-19T18:01:53.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.154+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 16 ==== osd_op_reply(98 [pgnls start_epoch 112 out=101b] v110'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.154+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:99 16.1c 16:3c0114ac:::100000001fa.00000004:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021000 con 0x55b78afe6000 2023-12-19T18:01:53.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.158+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 17 ==== osd_op_reply(99 100000001fa.00000004 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.158+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.4 2023-12-19T18:01:53.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.158+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:100 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020c00 con 0x55b78afe7400 2023-12-19T18:01:53.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 16 ==== osd_op_reply(100 100000001fa.00000000 [call,setxattr (8)] v112'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:101 16.1c 16:3d6db04b::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78afe6000 2023-12-19T18:01:53.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 18 ==== osd_op_reply(101 [pgnls start_epoch 112 out=81b] v110'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:102 16.1c 16:3d6db04b:::100000001f6.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78afe6000 2023-12-19T18:01:53.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 19 ==== osd_op_reply(102 100000001f6.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628278.1 2023-12-19T18:01:53.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.162+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:103 15.2a 15:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff1400 2023-12-19T18:01:53.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 18 ==== osd_op_reply(103 100000001f6.00000000 [call,setxattr (8)] v112'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:104 16.2 16:40000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78aff0000 2023-12-19T18:01:53.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(104 [pgnls start_epoch 112 out=101b] v110'2 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:105 16.2 16:40d56c48:::100000001fc.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78aff0000 2023-12-19T18:01:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(105 100000001fc.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628284.1 2023-12-19T18:01:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.166+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:106 15.c 15:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78aff1000 2023-12-19T18:01:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(106 100000001fc.00000000 [call,setxattr (8)] v112'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:107 16.2 16:46f89f8a::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78aff0000 2023-12-19T18:01:53.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(107 [pgnls start_epoch 112 out=81b] v110'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:108 16.2 16:46f89f8a:::100000001f9.00000005:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006000 con 0x55b78aff0000 2023-12-19T18:01:53.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(108 100000001f9.00000005 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.5 2023-12-19T18:01:53.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.170+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:109 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006400 con 0x55b78aff1800 2023-12-19T18:01:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.174+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 17 ==== osd_op_reply(109 100000001f9.00000000 [call,setxattr (8)] v112'22 uv22 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.174+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:110 16.12 16:48000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006800 con 0x55b78aff1800 2023-12-19T18:01:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.174+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 18 ==== osd_op_reply(110 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.174+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:111 16.a 16:50000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008000 con 0x55b78afe6000 2023-12-19T18:01:53.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 20 ==== osd_op_reply(111 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:112 16.a 16:544c5ef0:::100000001fc.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006c00 con 0x55b78afe6000 2023-12-19T18:01:53.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 21 ==== osd_op_reply(112 100000001fc.00000003 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628284.3 2023-12-19T18:01:53.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:113 15.c 15:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007000 con 0x55b78aff1000 2023-12-19T18:01:53.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(113 100000001fc.00000000 [call,setxattr (8)] v112'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.178+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:114 16.a 16:56c65d28::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007400 con 0x55b78afe6000 2023-12-19T18:01:53.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 22 ==== osd_op_reply(114 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:115 16.a 16:56c65d28:::100000001fa.00000006:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007800 con 0x55b78afe6000 2023-12-19T18:01:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 23 ==== osd_op_reply(115 100000001fa.00000006 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.6 2023-12-19T18:01:53.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:116 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007c00 con 0x55b78afe7400 2023-12-19T18:01:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 17 ==== osd_op_reply(116 100000001fa.00000000 [call,setxattr (8)] v112'12 uv12 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.182+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:117 16.a 16:57fe7535::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008000 con 0x55b78afe6000 2023-12-19T18:01:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.186+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 24 ==== osd_op_reply(117 [pgnls start_epoch 112 out=81b] v110'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.186+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:118 16.a 16:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006000 con 0x55b78afe6000 2023-12-19T18:01:53.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.186+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 25 ==== osd_op_reply(118 100000001f6.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.186+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T18:01:53.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.186+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:119 15.2a 15:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78aff1400 2023-12-19T18:01:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 19 ==== osd_op_reply(119 100000001f6.00000000 [call,setxattr (8)] v112'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:120 16.1a 16:58000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff0400 2023-12-19T18:01:53.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(120 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efed79df700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:121 16.6 16:60000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008400 con 0x55b78aff1800 2023-12-19T18:01:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 19 ==== osd_op_reply(121 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:122 16.6 16:613bf181:::100000001f7.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78aff1800 2023-12-19T18:01:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 20 ==== osd_op_reply(122 100000001f7.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628279.3 2023-12-19T18:01:53.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.190+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:123 15.36 15:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78aff1800 2023-12-19T18:01:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.194+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 21 ==== osd_op_reply(123 100000001f7.00000000 [call,setxattr (8)] v112'23 uv23 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.194+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:124 16.16 16:68000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78aff0400 2023-12-19T18:01:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.194+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(124 [pgnls start_epoch 112 out=101b] v110'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.194+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:125 16.16 16:6df493a7:::100000001f9.00000006:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78aff0400 2023-12-19T18:01:53.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.198+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(125 100000001f9.00000006 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.198+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.6 2023-12-19T18:01:53.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.198+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:126 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021800 con 0x55b78aff1800 2023-12-19T18:01:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.198+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 22 ==== osd_op_reply(126 100000001f9.00000000 [call,setxattr (8)] v112'24 uv24 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.198+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:127 16.16 16:6ee5e2c4::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021000 con 0x55b78aff0400 2023-12-19T18:01:53.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(127 [pgnls start_epoch 112 out=101b] v110'5 uv5 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:128 16.16 16:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006400 con 0x55b78aff0400 2023-12-19T18:01:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(128 100000001f9.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T18:01:53.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:129 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006800 con 0x55b78aff1800 2023-12-19T18:01:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 23 ==== osd_op_reply(129 100000001f9.00000000 [call,setxattr (8)] v112'25 uv25 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.202+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:130 16.16 16:6fe38dc2::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007000 con 0x55b78aff0400 2023-12-19T18:01:53.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(130 [pgnls start_epoch 112 out=81b] v110'5 uv5 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:131 16.16 16:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007c00 con 0x55b78aff0400 2023-12-19T18:01:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 17 ==== osd_op_reply(131 100000001f7.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T18:01:53.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:132 15.36 15:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78aff1800 2023-12-19T18:01:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 24 ==== osd_op_reply(132 100000001f7.00000000 [call,setxattr (8)] v112'26 uv26 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.206+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:133 16.e 16:70000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78afe6000 2023-12-19T18:01:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 26 ==== osd_op_reply(133 [pgnls start_epoch 112 out=101b] v110'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:134 16.e 16:72395991:::10000000001.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78afe6000 2023-12-19T18:01:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 27 ==== osd_op_reply(134 10000000001.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedda2c840 10 datascan.operator(): handling object 1099511627777.3 2023-12-19T18:01:53.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:135 15.7 15:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78afe7400 2023-12-19T18:01:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 18 ==== osd_op_reply(135 10000000001.00000000 [call,setxattr (8)] v112'8 uv8 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.210+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:136 16.e 16:728aa123::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe6000 2023-12-19T18:01:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 28 ==== osd_op_reply(136 [pgnls start_epoch 112 out=101b] v110'3 uv3 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:137 16.e 16:728aa123:::100000001f6.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78afe6000 2023-12-19T18:01:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 29 ==== osd_op_reply(137 100000001f6.00000003 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628278.3 2023-12-19T18:01:53.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:138 15.2a 15:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78aff1400 2023-12-19T18:01:53.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 20 ==== osd_op_reply(138 100000001f6.00000000 [call,setxattr (8)] v112'14 uv14 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.214+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:139 16.e 16:7780a862::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020c00 con 0x55b78afe6000 2023-12-19T18:01:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.218+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 30 ==== osd_op_reply(139 [pgnls start_epoch 112 out=81b] v110'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.218+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:140 16.e 16:7780a862:::100000001fa.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008400 con 0x55b78afe6000 2023-12-19T18:01:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.218+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 31 ==== osd_op_reply(140 100000001fa.00000003 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.218+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.3 2023-12-19T18:01:53.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.218+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:141 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78afe7400 2023-12-19T18:01:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 19 ==== osd_op_reply(141 100000001fa.00000000 [call,setxattr (8)] v112'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:142 16.1e 16:78000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78afe7c00 2023-12-19T18:01:53.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(142 [pgnls start_epoch 112 out=101b] v110'2 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:143 16.1e 16:7e4d8c81:::10000000001.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78afe7c00 2023-12-19T18:01:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(143 10000000001.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedda2c840 10 datascan.operator(): handling object 1099511627777.2 2023-12-19T18:01:53.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.222+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:144 15.7 15:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78afe7400 2023-12-19T18:01:53.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 20 ==== osd_op_reply(144 10000000001.00000000 [call,setxattr (8)] v112'9 uv9 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:145 16.1e 16:7e8133fb::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78afe7c00 2023-12-19T18:01:53.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(145 [pgnls start_epoch 112 out=81b] v110'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:146 16.1e 16:7e8133fb:::100000001fb.00000006:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78afe7c00 2023-12-19T18:01:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(146 100000001fb.00000006 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78afe7c00 2023-12-19T18:01:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.6 2023-12-19T18:01:53.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.226+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:147 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78afe7400 2023-12-19T18:01:53.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 21 ==== osd_op_reply(147 100000001fb.00000000 [call,setxattr (8)] v112'20 uv20 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:148 16.1 16:80000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe6000 2023-12-19T18:01:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 32 ==== osd_op_reply(148 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:149 16.1 16:848ebb0b:::100000001f7.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78afe6000 2023-12-19T18:01:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 33 ==== osd_op_reply(149 100000001f7.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628279.1 2023-12-19T18:01:53.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.230+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:150 15.36 15:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006c00 con 0x55b78aff1800 2023-12-19T18:01:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.234+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 25 ==== osd_op_reply(150 100000001f7.00000000 [call,setxattr (8)] v112'27 uv27 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.234+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:151 16.11 16:88000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007400 con 0x55b78aff1000 2023-12-19T18:01:53.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.234+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(151 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.238+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:152 16.11 16:893be98d:::100000001f8.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007800 con 0x55b78aff1000 2023-12-19T18:01:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.238+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(152 100000001f8.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.238+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628280.1 2023-12-19T18:01:53.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.238+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:153 15.19 15:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006000 con 0x55b78aff0000 2023-12-19T18:01:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.238+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(153 100000001f8.00000000 [call,setxattr (8)] v112'13 uv13 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.242+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:154 16.9 16:90000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008000 con 0x55b78afe7400 2023-12-19T18:01:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.242+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 22 ==== osd_op_reply(154 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.242+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:155 16.9 16:94f3e7b4:::100000001fa.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021800 con 0x55b78afe7400 2023-12-19T18:01:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.242+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 23 ==== osd_op_reply(155 100000001fa.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.242+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.2 2023-12-19T18:01:53.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.242+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:156 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78afe7400 2023-12-19T18:01:53.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 24 ==== osd_op_reply(156 100000001fa.00000000 [call,setxattr (8)] v112'14 uv14 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:157 16.19 16:98000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78aff0000 2023-12-19T18:01:53.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 16 ==== osd_op_reply(157 [pgnls start_epoch 112 out=81b] v110'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:158 16.19 16:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78aff0000 2023-12-19T18:01:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 17 ==== osd_op_reply(158 100000001f8.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T18:01:53.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.246+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:159 15.19 15:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78aff0000 2023-12-19T18:01:53.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 18 ==== osd_op_reply(159 100000001f8.00000000 [call,setxattr (8)] v112'14 uv14 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:160 16.5 16:a0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78aff1400 2023-12-19T18:01:53.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 21 ==== osd_op_reply(160 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:161 16.5 16:a238cdfc:::100000001f9.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78aff1400 2023-12-19T18:01:53.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 22 ==== osd_op_reply(161 100000001f9.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.2 2023-12-19T18:01:53.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.250+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:162 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7800 con 0x55b78aff1800 2023-12-19T18:01:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.254+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 26 ==== osd_op_reply(162 100000001f9.00000000 [call,setxattr (8)] v112'28 uv28 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.254+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:163 16.15 16:a8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006800 con 0x55b78aff1400 2023-12-19T18:01:53.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.254+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 23 ==== osd_op_reply(163 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.254+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:164 16.d 16:b0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021c00 con 0x55b78aff1800 2023-12-19T18:01:53.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.258+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 27 ==== osd_op_reply(164 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.258+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:165 16.d 16:b0a6c804:::100000001fc.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006c00 con 0x55b78aff1800 2023-12-19T18:01:53.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.258+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 28 ==== osd_op_reply(165 100000001fc.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.258+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628284.2 2023-12-19T18:01:53.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.258+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:166 15.c 15:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006400 con 0x55b78aff1000 2023-12-19T18:01:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(166 100000001fc.00000000 [call,setxattr (8)] v112'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:167 16.1d 16:b8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007000 con 0x55b78afe6000 2023-12-19T18:01:53.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 34 ==== osd_op_reply(167 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:168 16.3 16:c0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021400 con 0x55b78aff1000 2023-12-19T18:01:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(168 [pgnls start_epoch 112 out=101b] v110'2 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:169 16.3 16:c0957981:::100000001fa.00000005:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007c00 con 0x55b78aff1000 2023-12-19T18:01:53.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(169 100000001fa.00000005 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.5 2023-12-19T18:01:53.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.262+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:170 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78afe7400 2023-12-19T18:01:53.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.266+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 25 ==== osd_op_reply(170 100000001fa.00000000 [call,setxattr (8)] v112'15 uv15 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.266+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:171 16.3 16:c5d8c51d::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78aff1000 2023-12-19T18:01:53.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.266+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 13 ==== osd_op_reply(171 [pgnls start_epoch 112 out=81b] v110'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.266+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:172 16.3 16:c5d8c51d:::100000001fb.00000004:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff1000 2023-12-19T18:01:53.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.270+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 14 ==== osd_op_reply(172 100000001fb.00000004 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.270+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.4 2023-12-19T18:01:53.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.270+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:173 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007400 con 0x55b78afe7400 2023-12-19T18:01:53.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.270+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 26 ==== osd_op_reply(173 100000001fb.00000000 [call,setxattr (8)] v112'21 uv21 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.270+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:174 16.13 16:c8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007800 con 0x55b78afe7400 2023-12-19T18:01:53.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.270+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 27 ==== osd_op_reply(174 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.274+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:175 16.13 16:c9e7fe79:::100000001f9.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006400 con 0x55b78afe7400 2023-12-19T18:01:53.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.274+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 28 ==== osd_op_reply(175 100000001f9.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.274+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.3 2023-12-19T18:01:53.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.274+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:176 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007c00 con 0x55b78aff1800 2023-12-19T18:01:53.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.274+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 29 ==== osd_op_reply(176 100000001f9.00000000 [call,setxattr (8)] v112'29 uv29 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.274+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:177 16.13 16:ca8fdbba::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006000 con 0x55b78afe7400 2023-12-19T18:01:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.278+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 29 ==== osd_op_reply(177 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.278+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:178 16.13 16:ca8fdbba:::100000001fb.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006800 con 0x55b78afe7400 2023-12-19T18:01:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.278+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 30 ==== osd_op_reply(178 100000001fb.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.278+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.0 2023-12-19T18:01:53.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.278+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:179 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78afe7400 2023-12-19T18:01:53.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 31 ==== osd_op_reply(179 100000001fb.00000000 [call,setxattr (8)] v112'22 uv22 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:180 16.13 16:cb24bee2::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe7400 2023-12-19T18:01:53.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 32 ==== osd_op_reply(180 [pgnls start_epoch 112 out=81b] v110'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:181 16.13 16:cb24bee2:::100000001fa.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78afe7400 2023-12-19T18:01:53.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 33 ==== osd_op_reply(181 100000001fa.00000001 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.1 2023-12-19T18:01:53.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.282+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:182 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78afe7400 2023-12-19T18:01:53.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 34 ==== osd_op_reply(182 100000001fa.00000000 [call,setxattr (8)] v112'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:183 16.b 16:d0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff1c00 con 0x55b78afe7400 2023-12-19T18:01:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 35 ==== osd_op_reply(183 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efed71de700 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:184 16.1b 16:d8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020800 con 0x55b78aff1000 2023-12-19T18:01:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 15 ==== osd_op_reply(184 [pgnls start_epoch 112 out=81b] v110'1 uv1 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:185 16.1b 16:de1cf3c0:::100000001fb.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0c00 con 0x55b78aff1000 2023-12-19T18:01:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 16 ==== osd_op_reply(185 100000001fb.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.3 2023-12-19T18:01:53.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.286+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:186 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aff0800 con 0x55b78afe7400 2023-12-19T18:01:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.290+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 36 ==== osd_op_reply(186 100000001fb.00000000 [call,setxattr (8)] v112'23 uv23 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.290+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:187 16.7 16:e0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78aebd400 con 0x55b78aff0400 2023-12-19T18:01:53.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.290+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 18 ==== osd_op_reply(187 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.290+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:188 16.7 16:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008000 con 0x55b78aff0400 2023-12-19T18:01:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 19 ==== osd_op_reply(188 10000000001.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedda2c840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T18:01:53.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:189 15.7 15:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b008400 con 0x55b78afe7400 2023-12-19T18:01:53.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 37 ==== osd_op_reply(189 10000000001.00000000 [call,setxattr (8)] v112'10 uv10 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:190 16.7 16:e7ecf421::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010800 con 0x55b78aff0400 2023-12-19T18:01:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 20 ==== osd_op_reply(190 [pgnls start_epoch 112 out=81b] v110'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.294+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:191 16.7 16:e7ecf421:::100000001f9.00000004:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021800 con 0x55b78aff0400 2023-12-19T18:01:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.298+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.3 v2:172.21.15.45:6816/36284 21 ==== osd_op_reply(191 100000001f9.00000004 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff0400 2023-12-19T18:01:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.298+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.4 2023-12-19T18:01:53.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.298+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:192 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020400 con 0x55b78aff1800 2023-12-19T18:01:53.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 30 ==== osd_op_reply(192 100000001f9.00000000 [call,setxattr (8)] v112'30 uv30 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:193 16.17 16:e8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021400 con 0x55b78afe6000 2023-12-19T18:01:53.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 35 ==== osd_op_reply(193 [pgnls start_epoch 112 out=101b] v110'2 uv2 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:194 16.17 16:ee7e3069:::100000001f9.00000007:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020c00 con 0x55b78afe6000 2023-12-19T18:01:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 36 ==== osd_op_reply(194 100000001f9.00000007 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628281.7 2023-12-19T18:01:53.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.302+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:195 15.36 15:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021000 con 0x55b78aff1800 2023-12-19T18:01:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedb9e7700 1 -- 172.21.15.45:0/1376593367 <== osd.6 v2:172.21.15.73:6816/36537 31 ==== osd_op_reply(195 100000001f9.00000000 [call,setxattr (8)] v112'31 uv31 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968fc0 con 0x55b78aff1800 2023-12-19T18:01:53.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:196 16.17 16:eff9002a::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b020000 con 0x55b78afe6000 2023-12-19T18:01:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 37 ==== osd_op_reply(196 [pgnls start_epoch 112 out=81b] v110'2 uv2 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:197 16.17 16:eff9002a:::100000001f8.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007400 con 0x55b78afe6000 2023-12-19T18:01:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.2 v2:172.21.15.45:6824/36285 38 ==== osd_op_reply(197 100000001f8.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78afe6000 2023-12-19T18:01:53.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628280.3 2023-12-19T18:01:53.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.306+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:198 15.19 15:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007800 con 0x55b78aff0000 2023-12-19T18:01:53.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 19 ==== osd_op_reply(198 100000001f8.00000000 [call,setxattr (8)] v112'15 uv15 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:199 16.f 16:f0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006400 con 0x55b78aff1400 2023-12-19T18:01:53.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 24 ==== osd_op_reply(199 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:200 16.f 16:f26fdfa9:::100000001f8.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006000 con 0x55b78aff1400 2023-12-19T18:01:53.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 25 ==== osd_op_reply(200 100000001f8.00000002 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628280.2 2023-12-19T18:01:53.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.310+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:201 15.19 15:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006800 con 0x55b78aff0000 2023-12-19T18:01:53.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.314+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.4 v2:172.21.15.73:6805/36536 20 ==== osd_op_reply(201 100000001f8.00000000 [call,setxattr (8)] v112'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff0000 2023-12-19T18:01:53.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.314+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:202 16.f 16:f376f0dc::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007000 con 0x55b78aff1400 2023-12-19T18:01:53.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.314+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 26 ==== osd_op_reply(202 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.314+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:203 16.f 16:f376f0dc:::100000001fb.00000005:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78aff1400 2023-12-19T18:01:53.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.318+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 27 ==== osd_op_reply(203 100000001fb.00000005 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.318+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.5 2023-12-19T18:01:53.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.318+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:204 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6400 con 0x55b78afe7400 2023-12-19T18:01:53.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.318+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 38 ==== osd_op_reply(204 100000001fb.00000000 [call,setxattr (8)] v112'24 uv24 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.318+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:205 16.f 16:f526278d::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78aff1400 2023-12-19T18:01:53.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 28 ==== osd_op_reply(205 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:206 16.f 16:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78aff1400 2023-12-19T18:01:53.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 29 ==== osd_op_reply(206 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedda2c840 10 datascan.operator(): handling object 1099511627777.1 2023-12-19T18:01:53.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:207 15.7 15:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b011c00 con 0x55b78afe7400 2023-12-19T18:01:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 39 ==== osd_op_reply(207 10000000001.00000000 [call,setxattr (8)] v112'11 uv11 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.322+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:208 16.f 16:f776b802::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff1400 2023-12-19T18:01:53.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 30 ==== osd_op_reply(208 [pgnls start_epoch 112 out=81b] v110'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:209 16.f 16:f776b802:::100000001fb.00000007:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b010400 con 0x55b78aff1400 2023-12-19T18:01:53.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 31 ==== osd_op_reply(209 100000001fb.00000007 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628283.7 2023-12-19T18:01:53.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:210 15.13 15:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6800 con 0x55b78afe7400 2023-12-19T18:01:53.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 40 ==== osd_op_reply(210 100000001fb.00000000 [call,setxattr (8)] v112'25 uv25 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.326+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:211 16.1f 16:f8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe7000 con 0x55b78aff1000 2023-12-19T18:01:53.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.330+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 17 ==== osd_op_reply(211 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.330+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:212 16.1f 16:faedc8eb:::100000001f6.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78afe6c00 con 0x55b78aff1000 2023-12-19T18:01:53.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.330+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 18 ==== osd_op_reply(212 100000001f6.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.330+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628278.2 2023-12-19T18:01:53.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.330+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:213 15.2a 15:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007400 con 0x55b78aff1400 2023-12-19T18:01:53.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 <== osd.0 v2:172.21.15.45:6808/36279 32 ==== osd_op_reply(213 100000001f6.00000000 [call,setxattr (8)] v112'15 uv15 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968b40 con 0x55b78aff1400 2023-12-19T18:01:53.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:214 16.1f 16:fb032386::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007800 con 0x55b78aff1000 2023-12-19T18:01:53.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 19 ==== osd_op_reply(214 [pgnls start_epoch 112 out=101b] v110'4 uv4 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:215 16.1f 16:fb032386:::100000001fa.00000007:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006400 con 0x55b78aff1000 2023-12-19T18:01:53.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 20 ==== osd_op_reply(215 100000001fa.00000007 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.7 2023-12-19T18:01:53.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.334+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:216 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006000 con 0x55b78afe7400 2023-12-19T18:01:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.338+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 41 ==== osd_op_reply(216 100000001fa.00000000 [call,setxattr (8)] v112'17 uv17 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.338+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:217 16.1f 16:feb1c803::::head [pgnls start_epoch 112 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b006800 con 0x55b78aff1000 2023-12-19T18:01:53.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.338+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 21 ==== osd_op_reply(217 [pgnls start_epoch 112 out=81b] v110'4 uv4 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.338+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:218 16.1f 16:feb1c803:::100000001fa.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b007000 con 0x55b78aff1000 2023-12-19T18:01:53.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.5 v2:172.21.15.73:6824/36539 22 ==== osd_op_reply(218 100000001fa.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55b78b968d80 con 0x55b78aff1000 2023-12-19T18:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 10 datascan.operator(): handling object 1099511628282.0 2023-12-19T18:01:53.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:219 15.3f 15:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b,setxattr scan_pool_id (8) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55b78b021400 con 0x55b78afe7400 2023-12-19T18:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedc9e9700 1 -- 172.21.15.45:0/1376593367 <== osd.1 v2:172.21.15.45:6800/36282 42 ==== osd_op_reply(219 100000001fa.00000000 [call,setxattr (8)] v112'18 uv18 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55b78b968d80 con 0x55b78afe7400 2023-12-19T18:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55b78aff1400 msgr2=0x55b78afed080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55b78aff1400 0x55b78afed080 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b78afe7400 msgr2=0x55b78afec000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55b78afe7400 0x55b78afec000 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b78afe6000 msgr2=0x55b78ac20100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55b78afe6000 0x55b78ac20100 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b78aff0400 msgr2=0x55b78afed600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55b78aff0400 0x55b78afed600 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b78aff0000 msgr2=0x55b78afec580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55b78aff0000 0x55b78afec580 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b78aff1000 msgr2=0x55b78afedb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55b78aff1000 0x55b78afedb80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b78aff1800 msgr2=0x55b78afee100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b78aff1800 0x55b78afee100 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b78afe7c00 msgr2=0x55b78afecb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.342+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55b78afe7c00 0x55b78afecb00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 reap_dead start 2023-12-19T18:01:53.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b78aebdc00 msgr2=0x55b78ac21700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55b78aebdc00 0x55b78ac21700 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x55b78ac80420 tx=0x55b78b960000 comp rx=0 tx=0).stop 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 reap_dead start 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 reap_dead start 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 msgr2=0x55b78ac20680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 --2- 172.21.15.45:0/1376593367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78aebcc00 0x55b78ac20680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x55b78ac81980 tx=0x55b78b9602a0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedc1e8700 1 -- 172.21.15.45:0/1376593367 reap_dead start 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 shutdown_connections 2023-12-19T18:01:53.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 >> 172.21.15.45:0/1376593367 conn(0x55b78aebc000 msgr2=0x55b78ac69800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 shutdown_connections 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1376593367 wait complete. 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 msgr2=0x55b78ac1eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 0x55b78ac1eb00 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x55b78ac815f0 tx=0x55b78b960480 comp rx=0 tx=0).stop 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 shutdown_connections 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b78ab79800 0x55b78ac1f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b78ab79400 0x55b78ac1eb00 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 --2- 172.21.15.45:0/1626340538 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b78ab79000 0x55b78ac1e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 >> 172.21.15.45:0/1626340538 conn(0x55b78ab78c00 msgr2=0x55b78ac69000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 shutdown_connections 2023-12-19T18:01:53.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.346+0000 7efedda2c840 1 -- 172.21.15.45:0/1626340538 wait complete. 2023-12-19T18:01:53.359 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents'] in time 0:00:00.420883, result: 2023-12-19T18:01:53.360 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes 2023-12-19T18:01:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 -- start start 2023-12-19T18:01:53.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 Processor -- start 2023-12-19T18:01:53.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bbe13000 0x5584bbeb8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bbe13400 0x5584bbeb8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 0x5584bbeb9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92a00 con 0x5584bbe13800 2023-12-19T18:01:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92780 con 0x5584bbe13000 2023-12-19T18:01:53.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.426+0000 7feb6f37f840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92640 con 0x5584bbe13400 2023-12-19T18:01:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 0x5584bbeb9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 0x5584bbeb9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34418/0 (socket says 172.21.15.45:34418) 2023-12-19T18:01:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 -- 172.21.15.45:0/1306785162 learned_addr learned my addr 172.21.15.45:0/1306785162 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bbe13000 0x5584bbeb8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bbe13400 0x5584bbeb8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 -- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bbe13400 msgr2=0x5584bbeb8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bbe13400 0x5584bbeb8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 -- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bbe13000 msgr2=0x5584bbeb8580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bbe13000 0x5584bbeb8580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 -- 172.21.15.45:0/1306785162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bbe34b60 con 0x5584bbe13800 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 0x5584bbeb9080 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x5584bbf1b500 tx=0x5584bcb82480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40424e348131863 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6b336700 1 -- 172.21.15.45:0/1306785162 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5584bbe43600 con 0x5584bbe13800 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6b336700 1 -- 172.21.15.45:0/1306785162 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5584bbe5e480 con 0x5584bbe13800 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584bbe34340 con 0x5584bbe13800 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5584bbe34000 con 0x5584bbe13800 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 4 waiting for MDS map... 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6b336700 1 -- 172.21.15.45:0/1306785162 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5584bbe431e0 con 0x5584bbe13800 2023-12-19T18:01:53.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6b336700 1 -- 172.21.15.45:0/1306785162 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x5584bbe4cc40 con 0x5584bbe13800 2023-12-19T18:01:53.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6b336700 1 -- 172.21.15.45:0/1306785162 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x5584bcc03200 con 0x5584bbe13800 2023-12-19T18:01:53.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 4 Got MDS map 84 2023-12-19T18:01:53.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 4 datascan.main: Using metadata pool output 2023-12-19T18:01:53.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 4 datascan.main: connecting to RADOS... 2023-12-19T18:01:53.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.430+0000 7feb6f37f840 1 Processor -- start 2023-12-19T18:01:53.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 -- start start 2023-12-19T18:01:53.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160400 0x5584bbeb9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160800 0x5584bbeb9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 0x5584bbeba100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe49e00 con 0x5584bc160c00 2023-12-19T18:01:53.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92780 con 0x5584bc160400 2023-12-19T18:01:53.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92500 con 0x5584bc160800 2023-12-19T18:01:53.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 0x5584bbeba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 0x5584bbeba100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34420/0 (socket says 172.21.15.45:34420) 2023-12-19T18:01:53.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 -- 172.21.15.45:0/3853067099 learned_addr learned my addr 172.21.15.45:0/3853067099 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160400 0x5584bbeb9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6db3b700 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160800 0x5584bbeb9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 -- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160800 msgr2=0x5584bbeb9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160800 0x5584bbeb9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 -- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160400 msgr2=0x5584bbeb9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160400 0x5584bbeb9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 -- 172.21.15.45:0/3853067099 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bbe34ea0 con 0x5584bc160c00 2023-12-19T18:01:53.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6d33a700 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 0x5584bbeba100 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x5584bc10c8d0 tx=0x5584bcb820c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac9bad698f1541 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb69332700 1 -- 172.21.15.45:0/3853067099 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5584bbe43080 con 0x5584bc160c00 2023-12-19T18:01:53.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb69332700 1 -- 172.21.15.45:0/3853067099 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5584bcbf6600 con 0x5584bc160c00 2023-12-19T18:01:53.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb69332700 1 -- 172.21.15.45:0/3853067099 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5584bbe43600 con 0x5584bc160c00 2023-12-19T18:01:53.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 -- 172.21.15.45:0/3853067099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 msgr2=0x5584bbeba100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.434+0000 7feb6f37f840 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 0x5584bbeba100 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x5584bc10c8d0 tx=0x5584bcb820c0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- 172.21.15.45:0/3853067099 shutdown_connections 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160c00 0x5584bbeba100 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160800 0x5584bbeb9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 --2- 172.21.15.45:0/3853067099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160400 0x5584bbeb9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- 172.21.15.45:0/3853067099 >> 172.21.15.45:0/3853067099 conn(0x5584bc160000 msgr2=0x5584bbf03800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- 172.21.15.45:0/3853067099 shutdown_connections 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- 172.21.15.45:0/3853067099 wait complete. 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 Processor -- start 2023-12-19T18:01:53.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- start start 2023-12-19T18:01:53.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 0x5584bbebb180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160800 0x5584bbebac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160c00 0x5584bbeba680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe923c0 con 0x5584bc160400 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92280 con 0x5584bc160800 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6f37f840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584bbe92140 con 0x5584bc160c00 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 0x5584bbebb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 0x5584bbebb180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34428/0 (socket says 172.21.15.45:34428) 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 learned_addr learned my addr 172.21.15.45:0/1528392299 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160800 0x5584bbebac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160c00 msgr2=0x5584bbeba680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bc160c00 0x5584bbeba680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160800 msgr2=0x5584bbebac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bc160800 0x5584bbebac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.438+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bbe351e0 con 0x5584bc160400 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 0x5584bbebb180 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x5584bc10cb40 tx=0x5584bcb82360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb67b2f700 1 -- 172.21.15.45:0/1528392299 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5584bbe431e0 con 0x5584bc160400 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb67b2f700 1 -- 172.21.15.45:0/1528392299 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5584bcbf6900 con 0x5584bc160400 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb67b2f700 1 -- 172.21.15.45:0/1528392299 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5584bbe42dc0 con 0x5584bc160400 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5584bbe34ea0 con 0x5584bc160400 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584bbe34b60 con 0x5584bc160400 2023-12-19T18:01:53.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb6f37f840 4 datascan.init: resolving metadata pool 14 2023-12-19T18:01:53.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.442+0000 7feb67b2f700 1 -- 172.21.15.45:0/1528392299 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x5584bbe70840 con 0x5584bc160400 2023-12-19T18:01:53.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb67b2f700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5584bc161400 0x5584bbebb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb67b2f700 1 -- 172.21.15.45:0/1528392299 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x5584bbe4ca80 con 0x5584bc160400 2023-12-19T18:01:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6f37f840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:01:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6f37f840 4 datascan.main: data pool 'cephfs_data' has ID 15 2023-12-19T18:01:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6f37f840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T18:01:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5584bc161400 0x5584bbebb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5584bc161800 0x5584bbeba100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:1 14.14 14:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc161800 2023-12-19T18:01:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5584bc161800 0x5584bbeba100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5584bc161400 0x5584bbebb700 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x5584bbf1a840 tx=0x5584bc117da0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5584bc161800 0x5584bbeba100 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv50 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.446+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5584bc26e000 0x5584bbeb9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 14.1f 14:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc26e000 2023-12-19T18:01:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5584bc26e000 0x5584bbeb9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5584bc26e000 0x5584bbeb9b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5584bc26e800 0x5584bbeb9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:3 15.0 15:00000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc26e800 2023-12-19T18:01:53.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5584bc26e800 0x5584bbeb9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.450+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5584bc26e800 0x5584bbeb9600 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb68b31700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5584bc26f800 0x5584bc28e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 15.20 15:04000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26fc00 con 0x5584bc26f800 2023-12-19T18:01:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5584bc26f800 0x5584bc28e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5584bc26f800 0x5584bc28e000 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.454+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:5 15.10 15:08000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc161800 2023-12-19T18:01:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(5 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb68b31700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5584bc26fc00 0x5584bc28e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:6 15.30 15:0c000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc26fc00 2023-12-19T18:01:53.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5584bc26fc00 0x5584bc28e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5584bc26fc00 0x5584bc28e580 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:7 15.8 15:10000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26e800 2023-12-19T18:01:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.458+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:8 15.28 15:14000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26fc00 2023-12-19T18:01:53.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb69332700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5584bc298400 0x5584bc28f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:9 15.18 15:18000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc298400 2023-12-19T18:01:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5584bc298400 0x5584bc28f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb6db3b700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5584bc298400 0x5584bc28f080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(9 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:10 15.38 15:1c000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc26e000 2023-12-19T18:01:53.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.462+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:11 15.4 15:20000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc26f800 2023-12-19T18:01:53.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(11 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb68b31700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5584bc298c00 0x5584bc28eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:12 15.24 15:24000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc298c00 2023-12-19T18:01:53.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5584bc298c00 0x5584bc28eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb6d33a700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5584bc298c00 0x5584bc28eb00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(12 [pgnls-filter start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 15.14 15:28000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc298c00 2023-12-19T18:01:53.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(13 [pgnls-filter start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.466+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:14 15.34 15:2c000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299000 con 0x5584bc161800 2023-12-19T18:01:53.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(14 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb69332700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5584bc299000 0x5584bc28f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:15 15.c 15:30000000::::head [pgnls-filter start_epoch 112 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc299000 2023-12-19T18:01:53.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5584bc299000 0x5584bc28f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb6e33c700 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5584bc299000 0x5584bc28f600 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 112 out=81b] v112'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.470+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:16 15.0 15:00000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f000 con 0x5584bc26e800 2023-12-19T18:01:53.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.474+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.474+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:17 15.20 15:04000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc26f800 2023-12-19T18:01:53.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.474+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(17 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.474+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:18 15.10 15:08000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc161800 2023-12-19T18:01:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.474+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.474+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:19 15.30 15:0c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc26fc00 2023-12-19T18:01:53.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:20 15.8 15:10000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299800 con 0x5584bc26e800 2023-12-19T18:01:53.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(20 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:21 15.28 15:14000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26fc00 2023-12-19T18:01:53.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(21 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:22 15.18 15:18000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299c00 con 0x5584bc298400 2023-12-19T18:01:53.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(22 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:23 15.38 15:1c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299800 con 0x5584bc26e000 2023-12-19T18:01:53.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.478+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:24 15.4 15:20000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc26f800 2023-12-19T18:01:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(24 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 15.24 15:24000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f000 con 0x5584bc298c00 2023-12-19T18:01:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(25 [pgnls-filter start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 15.14 15:28000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc298c00 2023-12-19T18:01:53.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:27 15.34 15:2c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc161800 2023-12-19T18:01:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(27 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.482+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:28 15.c 15:30000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc299000 2023-12-19T18:01:53.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(28 [pgnls-filter start_epoch 112 out=81b] v112'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001fc.00000000 2023-12-19T18:01:53.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001fc.0 2023-12-19T18:01:53.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 15.c 15:30604137:::100000001fc.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f400 con 0x5584bc299000 2023-12-19T18:01:53.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(29 100000001fc.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+46 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:30 16.c 16:30604137:::100000001fc.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6000 con 0x5584bc299000 2023-12-19T18:01:53.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(30 100000001fc.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:31 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6400 con 0x5584bc26e000 2023-12-19T18:01:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(31 1.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.486+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:01:53.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 14.1f 14:ff5b34d6:::1.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6800 con 0x5584bc26e000 2023-12-19T18:01:53.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(32 1.00000000 [create,omap-set-header] v112'11 uv11 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x1 2023-12-19T18:01:53.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:33 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc26e000 2023-12-19T18:01:53.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(33 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6f37f840 20 datascan.read_dentry: oid=1.00000000 dname=lost+found frag=*, r=0 2023-12-19T18:01:53.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6f37f840 20 datascan.read_dentry: lost+found_head not found in result 2023-12-19T18:01:53.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.490+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:34 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7000 con 0x5584bc26e000 2023-12-19T18:01:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.494+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(34 1.00000000 [omap-set-vals] v112'12 uv12 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.494+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x1/lost+found pointing to 0x0x4 2023-12-19T18:01:53.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.494+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:35 14.3 14:c0ce80d4:::4.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7400 con 0x5584bc26e000 2023-12-19T18:01:53.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.494+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(35 4.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 154+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.494+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:01:53.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.494+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:36 14.3 14:c0ce80d4:::4.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7800 con 0x5584bc26e000 2023-12-19T18:01:53.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.498+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(36 4.00000000 [create,omap-set-header] v112'1 uv1 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.498+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x4 2023-12-19T18:01:53.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.498+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:37 14.3 14:c0ce80d4:::4.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6000 con 0x5584bc26e000 2023-12-19T18:01:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(37 4.00000000 [omap-set-vals] v112'2 uv2 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x4/100000001fc pointing to 0x0x100000001fc 2023-12-19T18:01:53.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:38 15.2c 15:34000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6400 con 0x5584bc161800 2023-12-19T18:01:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(38 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:39 15.1c 15:38000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc26f800 2023-12-19T18:01:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.502+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:40 15.3c 15:3c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc298400 2023-12-19T18:01:53.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(40 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:41 15.2 15:40000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6800 con 0x5584bc26e800 2023-12-19T18:01:53.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(41 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:42 15.22 15:44000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26e800 2023-12-19T18:01:53.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(42 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:43 15.12 15:48000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc298400 2023-12-19T18:01:53.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(43 [pgnls-filter start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:44 15.32 15:4c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc26e800 2023-12-19T18:01:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(44 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.506+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:45 15.a 15:50000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7000 con 0x5584bc26e800 2023-12-19T18:01:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(45 [pgnls-filter start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:46 15.2a 15:54000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f000 con 0x5584bc26e000 2023-12-19T18:01:53.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(46 [pgnls-filter start_epoch 112 out=81b] v112'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001f6.00000000 2023-12-19T18:01:53.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001f6.0 2023-12-19T18:01:53.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:47 15.2a 15:57fe7535:::100000001f6.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7c00 con 0x5584bc26e000 2023-12-19T18:01:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(47 100000001f6.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:48 16.a 16:57fe7535:::100000001f6.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f400 con 0x5584bc26e800 2023-12-19T18:01:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(48 100000001f6.00000000 [getxattr (30) out=30b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 0, partial objs: 4 2023-12-19T18:01:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:49 16.a 16:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc26e800 2023-12-19T18:01:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(49 100000001f6.00000000 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.510+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:50 16.1c 16:3d6db04b:::100000001f6.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299800 con 0x5584bc26e800 2023-12-19T18:01:53.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(50 100000001f6.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:51 16.1f 16:faedc8eb:::100000001f6.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299c00 con 0x5584bc299000 2023-12-19T18:01:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(51 100000001f6.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:52 16.e 16:728aa123:::100000001f6.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc26e800 2023-12-19T18:01:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(52 100000001f6.00000003 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f6 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_1 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_1 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:53 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26f800 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(53 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 4 datascan.get_frag_of: Unexpected error on '10000000000.00000000': (2) No such file or directory 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_1, will insert to root 2023-12-19T18:01:53.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:54 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc26f800 2023-12-19T18:01:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(54 10000000000.00000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:01:53.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.514+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:55 14.10 14:0cf6ad0f:::10000000000.00000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7000 con 0x5584bc26f800 2023-12-19T18:01:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(55 10000000000.00000000 [create,omap-set-header] v112'16 uv16 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-12-19T18:01:53.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:56 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6800 con 0x5584bc26f800 2023-12-19T18:01:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(56 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_1 frag=*, r=0 2023-12-19T18:01:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_1_head not found in result 2023-12-19T18:01:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f6 at 0x0x10000000000/flushed_file_1 with size=524288 bytes 2023-12-19T18:01:53.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.518+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:57 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc26f800 2023-12-19T18:01:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(57 10000000000.00000000 [omap-set-vals] v112'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_1 pointing to 0x0x100000001f6 2023-12-19T18:01:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x1/stripey 2023-12-19T18:01:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x1 target_dname=stripey 2023-12-19T18:01:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:58 14.1f 14:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc26e000 2023-12-19T18:01:53.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(58 1.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 154+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '1.00000000' 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/stripey, will insert to root 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:59 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f400 con 0x5584bc26e000 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(59 1.00000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-12-19T18:01:53.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.522+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:60 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6400 con 0x5584bc26e000 2023-12-19T18:01:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(60 1.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 154+0+4 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6f37f840 20 datascan.read_dentry: oid=1.00000000 dname=stripey frag=*, r=0 2023-12-19T18:01:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6f37f840 20 datascan.read_dentry: stripey_head not found in result 2023-12-19T18:01:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking ancestor directory of inode 0x0x10000000000 at 0x0x1:stripey 2023-12-19T18:01:53.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:61 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc26e000 2023-12-19T18:01:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(61 1.00000000 [omap-set-vals] v112'13 uv13 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x1/stripey pointing to 0x0x10000000000 2023-12-19T18:01:53.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:62 15.1a 15:58000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7000 con 0x5584bc299000 2023-12-19T18:01:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.526+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(62 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:63 15.3a 15:5c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7c00 con 0x5584bc26fc00 2023-12-19T18:01:53.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(63 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:64 15.6 15:60000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7400 con 0x5584bc26e000 2023-12-19T18:01:53.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:65 15.26 15:64000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6400 con 0x5584bc26e000 2023-12-19T18:01:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 18 ==== osd_op_reply(65 [pgnls-filter start_epoch 112 out=49b] v110'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:66 15.16 15:68000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7800 con 0x5584bc26e000 2023-12-19T18:01:53.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 19 ==== osd_op_reply(66 [pgnls-filter start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.530+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:67 15.36 15:6c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc298c00 2023-12-19T18:01:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(67 [pgnls-filter start_epoch 112 out=101b] v112'31 uv31 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001f9.00000000 2023-12-19T18:01:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001f9.0 2023-12-19T18:01:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:68 15.36 15:6ee5e2c4:::100000001f9.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc298c00 2023-12-19T18:01:53.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(68 100000001f9.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv31 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:69 16.16 16:6ee5e2c4:::100000001f9.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc298400 2023-12-19T18:01:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(69 100000001f9.00000000 [getxattr (30) out=30b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 4, partial objs: 4 2023-12-19T18:01:53.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:70 16.7 16:e7ecf421:::100000001f9.00000004:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc298400 2023-12-19T18:01:53.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(70 100000001f9.00000004 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:71 16.2 16:46f89f8a:::100000001f9.00000005:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2be000 con 0x5584bc161800 2023-12-19T18:01:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(71 100000001f9.00000005 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.534+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:72 16.16 16:6df493a7:::100000001f9.00000006:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2be400 con 0x5584bc298400 2023-12-19T18:01:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(72 100000001f9.00000006 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:73 16.17 16:ee7e3069:::100000001f9.00000007:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2be800 con 0x5584bc26e800 2023-12-19T18:01:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 13 ==== osd_op_reply(73 100000001f9.00000007 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f9 2023-12-19T18:01:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_4 2023-12-19T18:01:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_4 2023-12-19T18:01:53.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:74 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bec00 con 0x5584bc26f800 2023-12-19T18:01:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(74 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T18:01:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T18:01:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_4, will insert to root 2023-12-19T18:01:53.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:75 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bf000 con 0x5584bc26f800 2023-12-19T18:01:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(75 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-12-19T18:01:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T18:01:53.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:76 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bf400 con 0x5584bc26f800 2023-12-19T18:01:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(76 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_4 frag=*, r=0 2023-12-19T18:01:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_4_head not found in result 2023-12-19T18:01:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f9 at 0x0x10000000000/flushed_file_4 with size=1441792 bytes 2023-12-19T18:01:53.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.538+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:77 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bf800 con 0x5584bc26f800 2023-12-19T18:01:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(77 10000000000.00000000 [omap-set-vals] v112'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_4 pointing to 0x0x100000001f9 2023-12-19T18:01:53.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:78 15.36 15:6fe38dc2::::head [pgnls-filter start_epoch 112 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bfc00 con 0x5584bc298c00 2023-12-19T18:01:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(78 [pgnls-filter start_epoch 112 out=81b] v112'31 uv31 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2023-12-19T18:01:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001f7.0 2023-12-19T18:01:53.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:79 15.36 15:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2be000 con 0x5584bc298c00 2023-12-19T18:01:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(79 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv27 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.542+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:80 16.16 16:6fe38dc2:::100000001f7.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bec00 con 0x5584bc298400 2023-12-19T18:01:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(80 100000001f7.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 0, partial objs: 4 2023-12-19T18:01:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:81 16.16 16:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2bf000 con 0x5584bc298400 2023-12-19T18:01:53.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(81 100000001f7.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:82 16.1 16:848ebb0b:::100000001f7.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2be400 con 0x5584bc26e800 2023-12-19T18:01:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 14 ==== osd_op_reply(82 100000001f7.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:83 16.1c 16:398da958:::100000001f7.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc26e800 2023-12-19T18:01:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 15 ==== osd_op_reply(83 100000001f7.00000002 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:84 16.6 16:613bf181:::100000001f7.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc298c00 2023-12-19T18:01:53.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(84 100000001f7.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_2 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_2 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:85 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299800 con 0x5584bc26f800 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(85 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T18:01:53.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_2, will insert to root 2023-12-19T18:01:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.546+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:86 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc26f800 2023-12-19T18:01:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 16 ==== osd_op_reply(86 10000000000.00000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-12-19T18:01:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T18:01:53.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:87 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26f800 2023-12-19T18:01:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 17 ==== osd_op_reply(87 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_2 frag=*, r=0 2023-12-19T18:01:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_2_head not found in result 2023-12-19T18:01:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000000/flushed_file_2 with size=917504 bytes 2023-12-19T18:01:53.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.550+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:88 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6800 con 0x5584bc26f800 2023-12-19T18:01:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 18 ==== osd_op_reply(88 10000000000.00000000 [omap-set-vals] v112'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_2 pointing to 0x0x100000001f7 2023-12-19T18:01:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:89 15.e 15:70000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc26e800 2023-12-19T18:01:53.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:90 15.2e 15:74000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6000 con 0x5584bc298400 2023-12-19T18:01:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(90 [pgnls-filter start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:91 15.1e 15:78000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f000 con 0x5584bc26e800 2023-12-19T18:01:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 17 ==== osd_op_reply(91 [pgnls-filter start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:92 15.3e 15:7c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc26e000 2023-12-19T18:01:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 20 ==== osd_op_reply(92 [pgnls-filter start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.554+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:93 15.1 15:80000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc298c00 2023-12-19T18:01:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(93 [pgnls-filter start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:94 15.21 15:84000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299800 con 0x5584bc298400 2023-12-19T18:01:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(94 [pgnls-filter start_epoch 112 out=49b] v110'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:95 15.11 15:88000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f400 con 0x5584bc26e800 2023-12-19T18:01:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 18 ==== osd_op_reply(95 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:96 15.31 15:8c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc298400 2023-12-19T18:01:53.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(96 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.558+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:97 15.9 15:90000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299c00 con 0x5584bc298c00 2023-12-19T18:01:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(97 [pgnls-filter start_epoch 112 out=49b] v110'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:98 15.29 15:94000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26e000 2023-12-19T18:01:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 21 ==== osd_op_reply(98 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:99 15.19 15:98000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cc000 con 0x5584bc161800 2023-12-19T18:01:53.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(99 [pgnls-filter start_epoch 112 out=81b] v112'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001f8.00000000 2023-12-19T18:01:53.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001f8.0 2023-12-19T18:01:53.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:100 15.19 15:997b7129:::100000001f8.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc161800 2023-12-19T18:01:53.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(100 100000001f8.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.562+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:101 16.19 16:997b7129:::100000001f8.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce000 con 0x5584bc161800 2023-12-19T18:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(101 100000001f8.00000000 [getxattr (30) out=30b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 0, partial objs: 4 2023-12-19T18:01:53.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:102 16.19 16:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce400 con 0x5584bc161800 2023-12-19T18:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(102 100000001f8.00000000 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:103 16.11 16:893be98d:::100000001f8.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce800 con 0x5584bc299000 2023-12-19T18:01:53.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(103 100000001f8.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:104 16.f 16:f26fdfa9:::100000001f8.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cec00 con 0x5584bc26e000 2023-12-19T18:01:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 22 ==== osd_op_reply(104 100000001f8.00000002 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.566+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:105 16.17 16:eff9002a:::100000001f8.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf000 con 0x5584bc26e800 2023-12-19T18:01:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 19 ==== osd_op_reply(105 100000001f8.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f8 2023-12-19T18:01:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_3 2023-12-19T18:01:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_3 2023-12-19T18:01:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:106 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf400 con 0x5584bc26f800 2023-12-19T18:01:53.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 19 ==== osd_op_reply(106 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T18:01:53.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T18:01:53.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_3, will insert to root 2023-12-19T18:01:53.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:107 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf800 con 0x5584bc26f800 2023-12-19T18:01:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 20 ==== osd_op_reply(107 10000000000.00000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T18:01:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T18:01:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:108 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cfc00 con 0x5584bc26f800 2023-12-19T18:01:53.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 21 ==== osd_op_reply(108 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_3 frag=*, r=0 2023-12-19T18:01:53.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_3_head not found in result 2023-12-19T18:01:53.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f8 at 0x0x10000000000/flushed_file_3 with size=917503 bytes 2023-12-19T18:01:53.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.570+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:109 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce000 con 0x5584bc26f800 2023-12-19T18:01:53.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.574+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 22 ==== osd_op_reply(109 10000000000.00000000 [omap-set-vals] v112'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.574+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_3 pointing to 0x0x100000001f8 2023-12-19T18:01:53.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.574+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:110 15.39 15:9c000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce400 con 0x5584bc26fc00 2023-12-19T18:01:53.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(110 [pgnls-filter start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:111 15.5 15:a0000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cc400 con 0x5584bc298c00 2023-12-19T18:01:53.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(111 [pgnls-filter start_epoch 112 out=49b] v110'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:112 15.25 15:a4000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26ec00 con 0x5584bc26fc00 2023-12-19T18:01:53.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(112 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:113 15.15 15:a8000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cc800 con 0x5584bc26fc00 2023-12-19T18:01:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.578+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(113 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:114 15.35 15:ac000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26f000 con 0x5584bc26fc00 2023-12-19T18:01:53.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(114 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:115 15.d 15:b0000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ccc00 con 0x5584bc26fc00 2023-12-19T18:01:53.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(115 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:116 15.2d 15:b4000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc26e800 2023-12-19T18:01:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 20 ==== osd_op_reply(116 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.582+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:117 15.1d 15:b8000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cd000 con 0x5584bc161800 2023-12-19T18:01:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(117 [pgnls-filter start_epoch 112 out=49b] v110'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:118 15.3d 15:bc000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6000 con 0x5584bc26f800 2023-12-19T18:01:53.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 23 ==== osd_op_reply(118 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:119 15.3 15:c0000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cd400 con 0x5584bc161800 2023-12-19T18:01:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(119 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:120 15.23 15:c4000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf400 con 0x5584bc26e000 2023-12-19T18:01:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 23 ==== osd_op_reply(120 [pgnls-filter start_epoch 112 out=49b] v110'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.586+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:121 15.13 15:c8000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cd800 con 0x5584bc26f800 2023-12-19T18:01:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 24 ==== osd_op_reply(121 [pgnls-filter start_epoch 112 out=81b] v112'25 uv25 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001fb.00000000 2023-12-19T18:01:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001fb.0 2023-12-19T18:01:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:122 15.13 15:ca8fdbba:::100000001fb.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299c00 con 0x5584bc26f800 2023-12-19T18:01:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 25 ==== osd_op_reply(122 100000001fb.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv25 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:123 16.13 16:ca8fdbba:::100000001fb.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc26f800 2023-12-19T18:01:53.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 26 ==== osd_op_reply(123 100000001fb.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 4, partial objs: 4 2023-12-19T18:01:53.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.590+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:124 16.3 16:c5d8c51d:::100000001fb.00000004:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc299000 2023-12-19T18:01:53.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(124 100000001fb.00000004 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:125 16.f 16:f376f0dc:::100000001fb.00000005:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6800 con 0x5584bc26e000 2023-12-19T18:01:53.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 24 ==== osd_op_reply(125 100000001fb.00000005 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:126 16.1e 16:7e8133fb:::100000001fb.00000006:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7000 con 0x5584bc26fc00 2023-12-19T18:01:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(126 100000001fb.00000006 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:127 16.f 16:f776b802:::100000001fb.00000007:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7c00 con 0x5584bc26e000 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 25 ==== osd_op_reply(127 100000001fb.00000007 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fb 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_6 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_6 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:128 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7400 con 0x5584bc26f800 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 27 ==== osd_op_reply(128 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T18:01:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T18:01:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_6, will insert to root 2023-12-19T18:01:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:129 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6400 con 0x5584bc26f800 2023-12-19T18:01:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 28 ==== osd_op_reply(129 10000000000.00000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-12-19T18:01:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T18:01:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.594+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:130 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7800 con 0x5584bc26f800 2023-12-19T18:01:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 29 ==== osd_op_reply(130 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_6 frag=*, r=0 2023-12-19T18:01:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_6_head not found in result 2023-12-19T18:01:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fb at 0x0x10000000000/flushed_file_6 with size=1572864 bytes 2023-12-19T18:01:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:131 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc161c00 con 0x5584bc26f800 2023-12-19T18:01:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 30 ==== osd_op_reply(131 10000000000.00000000 [omap-set-vals] v112'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_6 pointing to 0x0x100000001fb 2023-12-19T18:01:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:132 15.33 15:cc000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cc000 con 0x5584bc298400 2023-12-19T18:01:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(132 [pgnls-filter start_epoch 112 out=49b] v110'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.598+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:133 15.b 15:d0000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cdc00 con 0x5584bc26e800 2023-12-19T18:01:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 21 ==== osd_op_reply(133 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:134 15.2b 15:d4000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf800 con 0x5584bc26e800 2023-12-19T18:01:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 22 ==== osd_op_reply(134 [pgnls-filter start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:135 15.1b 15:d8000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf000 con 0x5584bc26fc00 2023-12-19T18:01:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(135 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:136 15.3b 15:dc000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce800 con 0x5584bc298c00 2023-12-19T18:01:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(136 [pgnls-filter start_epoch 112 out=49b] v110'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.602+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:137 15.7 15:e0000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf800 con 0x5584bc26f800 2023-12-19T18:01:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 31 ==== osd_op_reply(137 [pgnls-filter start_epoch 112 out=81b] v112'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-12-19T18:01:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 10 datascan.operator(): handling object 10000000001.0 2023-12-19T18:01:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:138 15.7 15:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc26e400 con 0x5584bc26f800 2023-12-19T18:01:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 32 ==== osd_op_reply(138 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:139 16.7 16:e2e07930:::10000000001.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6c00 con 0x5584bc298400 2023-12-19T18:01:53.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(139 10000000001.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 0, partial objs: 4 2023-12-19T18:01:53.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:140 16.7 16:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6000 con 0x5584bc298400 2023-12-19T18:01:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(140 10000000001.00000000 [stat out=16b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:141 16.f 16:f526278d:::10000000001.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a7400 con 0x5584bc26e000 2023-12-19T18:01:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 26 ==== osd_op_reply(141 10000000001.00000001 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:142 16.1e 16:7e4d8c81:::10000000001.00000002:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2a6800 con 0x5584bc26fc00 2023-12-19T18:01:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(142 10000000001.00000002 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26fc00 2023-12-19T18:01:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.606+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:143 16.e 16:72395991:::10000000001.00000003:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299800 con 0x5584bc26e800 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 23 ==== osd_op_reply(143 10000000001.00000003 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_0 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_0 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:144 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc26f800 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 33 ==== osd_op_reply(144 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_0, will insert to root 2023-12-19T18:01:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:145 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299c00 con 0x5584bc26f800 2023-12-19T18:01:53.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 34 ==== osd_op_reply(145 10000000000.00000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-12-19T18:01:53.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T18:01:53.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:146 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc299400 con 0x5584bc26f800 2023-12-19T18:01:53.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 35 ==== osd_op_reply(146 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_0 frag=*, r=0 2023-12-19T18:01:53.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_0_head not found in result 2023-12-19T18:01:53.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/flushed_file_0 with size=1048576 bytes 2023-12-19T18:01:53.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.610+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:147 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298000 con 0x5584bc26f800 2023-12-19T18:01:53.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.614+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 36 ==== osd_op_reply(147 10000000000.00000000 [omap-set-vals] v112'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.614+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_0 pointing to 0x0x10000000001 2023-12-19T18:01:53.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.614+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:148 15.27 15:e4000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf400 con 0x5584bc298c00 2023-12-19T18:01:53.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.614+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(148 [pgnls-filter start_epoch 112 out=49b] v110'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.614+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:149 15.17 15:e8000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cfc00 con 0x5584bc161800 2023-12-19T18:01:53.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(149 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:150 15.37 15:ec000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce800 con 0x5584bc161800 2023-12-19T18:01:53.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(150 [pgnls-filter start_epoch 112 out=49b] v110'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc161800 2023-12-19T18:01:53.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:151 15.f 15:f0000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2ce000 con 0x5584bc298c00 2023-12-19T18:01:53.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(151 [pgnls-filter start_epoch 112 out=49b] v110'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc298c00 2023-12-19T18:01:53.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:152 15.2f 15:f4000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf800 con 0x5584bc26e000 2023-12-19T18:01:53.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.0 v2:172.21.15.45:6808/36279 27 ==== osd_op_reply(152 [pgnls-filter start_epoch 112 out=49b] v110'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc26e000 2023-12-19T18:01:53.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.618+0000 7feb69332700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:153 15.1f 15:f8000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cec00 con 0x5584bc298400 2023-12-19T18:01:53.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(153 [pgnls-filter start_epoch 112 out=49b] v110'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc298400 2023-12-19T18:01:53.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb68b31700 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:154 15.3f 15:fc000000::::head [pgnls-filter start_epoch 112 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc298800 con 0x5584bc26f800 2023-12-19T18:01:53.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 37 ==== osd_op_reply(154 [pgnls-filter start_epoch 112 out=81b] v112'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6f37f840 20 datascan.forall_objects: OSD matched oid 100000001fa.00000000 2023-12-19T18:01:53.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6f37f840 10 datascan.operator(): handling object 100000001fa.0 2023-12-19T18:01:53.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:155 15.3f 15:feb1c803:::100000001fa.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2cf400 con 0x5584bc26f800 2023-12-19T18:01:53.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 38 ==== osd_op_reply(155 100000001fa.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr (111) out=111b,getxattr,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.622+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:156 16.1f 16:feb1c803:::100000001fa.00000000:head [getxattr layout in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d8000 con 0x5584bc299000 2023-12-19T18:01:53.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(156 100000001fa.00000000 [getxattr (30) out=30b] v0'0 uv4 ondisk = 0) v8 ==== 164+0+30 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 20 datascan.operator(): loaded layout from xattr: pi: 16 os: 262144 sc: 4 su: 65536 2023-12-19T18:01:53.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 10 datascan.operator(): calculating striped size from complete objs: 4, partial objs: 4 2023-12-19T18:01:53.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:157 16.1c 16:3c0114ac:::100000001fa.00000004:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d8400 con 0x5584bc26e800 2023-12-19T18:01:53.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 24 ==== osd_op_reply(157 100000001fa.00000004 [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:158 16.3 16:c0957981:::100000001fa.00000005:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d8800 con 0x5584bc299000 2023-12-19T18:01:53.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(158 100000001fa.00000005 [stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:159 16.a 16:56c65d28:::100000001fa.00000006:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d8c00 con 0x5584bc26e800 2023-12-19T18:01:53.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 <== osd.2 v2:172.21.15.45:6824/36285 25 ==== osd_op_reply(159 100000001fa.00000006 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96fc0 con 0x5584bc26e800 2023-12-19T18:01:53.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:160 16.1f 16:fb032386:::100000001fa.00000007:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d9000 con 0x5584bc299000 2023-12-19T18:01:53.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6e33c700 1 -- 172.21.15.45:0/1528392299 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(160 100000001fa.00000007 [stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x5584bcc96d80 con 0x5584bc299000 2023-12-19T18:01:53.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.626+0000 7feb6f37f840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fa 2023-12-19T18:01:53.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/flushed_file_5 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=flushed_file_5 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:161 14.10 14:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d9400 con 0x5584bc26f800 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 39 ==== osd_op_reply(161 10000000000.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 10 datascan.get_frag_of: No backtrace on '10000000000.00000000' 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 4 datascan.get_frag_of: No backtrace on '10000000000.00000000': cannot determine fragtree 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x10000000000/flushed_file_5, will insert to root 2023-12-19T18:01:53.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:162 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d9800 con 0x5584bc26f800 2023-12-19T18:01:53.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 40 ==== osd_op_reply(162 10000000000.00000000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-12-19T18:01:53.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2023-12-19T18:01:53.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:163 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2d9c00 con 0x5584bc26f800 2023-12-19T18:01:53.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 41 ==== osd_op_reply(163 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_5 frag=*, r=0 2023-12-19T18:01:53.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 20 datascan.read_dentry: flushed_file_5_head not found in result 2023-12-19T18:01:53.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fa at 0x0x10000000000/flushed_file_5 with size=1441793 bytes 2023-12-19T18:01:53.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.630+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:164 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x5584bc2da000 con 0x5584bc26f800 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6d33a700 1 -- 172.21.15.45:0/1528392299 <== osd.1 v2:172.21.15.45:6800/36282 42 ==== osd_op_reply(164 10000000000.00000000 [omap-set-vals] v112'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5584bcc96b40 con 0x5584bc26f800 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_5 pointing to 0x0x100000001fa 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5584bc26e000 msgr2=0x5584bbeb9b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x5584bc26e000 0x5584bbeb9b80 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5584bc26f800 msgr2=0x5584bc28e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x5584bc26f800 0x5584bc28e000 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5584bc26e800 msgr2=0x5584bbeb9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x5584bc26e800 0x5584bbeb9600 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5584bc298400 msgr2=0x5584bc28f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5584bc298400 0x5584bc28f080 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5584bc161800 msgr2=0x5584bbeba100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x5584bc161800 0x5584bbeba100 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 reap_dead start 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5584bc299000 msgr2=0x5584bc28f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x5584bc299000 0x5584bc28f600 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5584bc298c00 msgr2=0x5584bc28eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5584bc298c00 0x5584bc28eb00 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5584bc26fc00 msgr2=0x5584bc28e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5584bc26fc00 0x5584bc28e580 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6db3b700 1 -- 172.21.15.45:0/1528392299 reap_dead start 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5584bc161400 msgr2=0x5584bbebb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5584bc161400 0x5584bbebb700 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x5584bbf1a840 tx=0x5584bc117da0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 msgr2=0x5584bbebb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 0x5584bbebb180 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x5584bc10cb40 tx=0x5584bcb82360 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 shutdown_connections 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x5584bc161400 0x5584bbebb700 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1528392299 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bc160400 0x5584bbebb180 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 >> 172.21.15.45:0/1528392299 conn(0x5584bc160000 msgr2=0x5584bbf03800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 shutdown_connections 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.634+0000 7feb6f37f840 1 -- 172.21.15.45:0/1528392299 wait complete. 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 msgr2=0x5584bbeb9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 0x5584bbeb9080 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x5584bbf1b500 tx=0x5584bcb82480 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 shutdown_connections 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5584bbe13800 0x5584bbeb9080 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5584bbe13400 0x5584bbeb8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 --2- 172.21.15.45:0/1306785162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5584bbe13000 0x5584bbeb8580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 >> 172.21.15.45:0/1306785162 conn(0x5584bbe12c00 msgr2=0x5584bbf03000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 shutdown_connections 2023-12-19T18:01:53.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.638+0000 7feb6f37f840 1 -- 172.21.15.45:0/1306785162 wait complete. 2023-12-19T18:01:53.648 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes'] in time 0:00:00.288654, result: 2023-12-19T18:01:53.648 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-12-19T18:01:53.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 -- start start 2023-12-19T18:01:53.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 Processor -- start 2023-12-19T18:01:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 0x55cd10c7c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10bd7400 0x55cd10c7cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10bd7000 0x55cd10c7d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56780 con 0x55cd10bd7800 2023-12-19T18:01:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56a00 con 0x55cd10bd7000 2023-12-19T18:01:53.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd042103840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56640 con 0x55cd10bd7400 2023-12-19T18:01:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.706+0000 7fd0408bf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 0x55cd10c7c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 0x55cd10c7c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34442/0 (socket says 172.21.15.45:34442) 2023-12-19T18:01:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 -- 172.21.15.45:0/2305278139 learned_addr learned my addr 172.21.15.45:0/2305278139 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0400be700 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10bd7400 0x55cd10c7cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0410c0700 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10bd7000 0x55cd10c7d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 -- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10bd7400 msgr2=0x55cd10c7cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10bd7400 0x55cd10c7cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 -- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10bd7000 msgr2=0x55cd10c7d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10bd7000 0x55cd10c7d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 -- 172.21.15.45:0/2305278139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd10bf8b60 con 0x55cd10bd7800 2023-12-19T18:01:53.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd0408bf700 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 0x55cd10c7c580 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x55cd10ce5380 tx=0x55cd11951020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d787c482c6f7387 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd03e0ba700 1 -- 172.21.15.45:0/2305278139 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cd10c07600 con 0x55cd10bd7800 2023-12-19T18:01:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd03e0ba700 1 -- 172.21.15.45:0/2305278139 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd10c22480 con 0x55cd10bd7800 2023-12-19T18:01:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd10bf8340 con 0x55cd10bd7800 2023-12-19T18:01:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55cd10bf8000 con 0x55cd10bd7800 2023-12-19T18:01:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 4 waiting for MDS map... 2023-12-19T18:01:53.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd03e0ba700 1 -- 172.21.15.45:0/2305278139 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cd10c071e0 con 0x55cd10bd7800 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd03e0ba700 1 -- 172.21.15.45:0/2305278139 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55cd10c10c40 con 0x55cd10bd7800 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd03e0ba700 1 -- 172.21.15.45:0/2305278139 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 84) v1 ==== 3126+0+0 (secure 0 0 0) 0x55cd119c8300 con 0x55cd10bd7800 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 4 Got MDS map 84 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 4 datascan.main: Using metadata pool output 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 4 datascan.main: connecting to RADOS... 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 1 Processor -- start 2023-12-19T18:01:53.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.710+0000 7fd042103840 1 -- start start 2023-12-19T18:01:53.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7db80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c0de00 con 0x55cd10ec4c00 2023-12-19T18:01:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56a00 con 0x55cd10ec4400 2023-12-19T18:01:53.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56500 con 0x55cd10ec4800 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34448/0 (socket says 172.21.15.45:34448) 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 -- 172.21.15.45:0/2031176589 learned_addr learned my addr 172.21.15.45:0/2031176589 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0410c0700 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0408bf700 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 -- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 msgr2=0x55cd10c7db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 -- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 msgr2=0x55cd10c7d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 -- 172.21.15.45:0/2031176589 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd10bf8ea0 con 0x55cd10ec4c00 2023-12-19T18:01:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd0400be700 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e100 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x55cd119bc690 tx=0x55cd119bf020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d12d1604895a957 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd03c0b6700 1 -- 172.21.15.45:0/2031176589 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cd10c07600 con 0x55cd10ec4c00 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd03c0b6700 1 -- 172.21.15.45:0/2031176589 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd10c22900 con 0x55cd10ec4c00 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd03c0b6700 1 -- 172.21.15.45:0/2031176589 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cd10c071e0 con 0x55cd10ec4c00 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 -- 172.21.15.45:0/2031176589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 msgr2=0x55cd10c7e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e100 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x55cd119bc690 tx=0x55cd119bf020 comp rx=0 tx=0).stop 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 -- 172.21.15.45:0/2031176589 shutdown_connections 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e100 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 --2- 172.21.15.45:0/2031176589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.714+0000 7fd042103840 1 -- 172.21.15.45:0/2031176589 >> 172.21.15.45:0/2031176589 conn(0x55cd10bd6c00 msgr2=0x55cd10ca5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 -- 172.21.15.45:0/2031176589 shutdown_connections 2023-12-19T18:01:53.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 -- 172.21.15.45:0/2031176589 wait complete. 2023-12-19T18:01:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 Processor -- start 2023-12-19T18:01:53.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 -- start start 2023-12-19T18:01:53.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c563c0 con 0x55cd10ec4c00 2023-12-19T18:01:53.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56280 con 0x55cd10ec4400 2023-12-19T18:01:53.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd042103840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cd10c56140 con 0x55cd10ec4800 2023-12-19T18:01:53.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34460/0 (socket says 172.21.15.45:34460) 2023-12-19T18:01:53.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 learned_addr learned my addr 172.21.15.45:0/1502245602 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:53.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 msgr2=0x55cd10c7ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10ec4800 0x55cd10c7ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 msgr2=0x55cd10c7f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10ec4400 0x55cd10c7f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.718+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd10bf8b60 con 0x55cd10ec4c00 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e680 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55cd119bd350 tx=0x55cd11950cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd03a8b3700 1 -- 172.21.15.45:0/1502245602 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cd10c06dc0 con 0x55cd10ec4c00 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd03a8b3700 1 -- 172.21.15.45:0/1502245602 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cd10c22480 con 0x55cd10ec4c00 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cd10bf8340 con 0x55cd10ec4c00 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd03a8b3700 1 -- 172.21.15.45:0/1502245602 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55cd10c07600 con 0x55cd10ec4c00 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cd10bf9520 con 0x55cd10ec4c00 2023-12-19T18:01:53.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd042103840 4 datascan.init: resolving metadata pool 14 2023-12-19T18:01:53.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.722+0000 7fd03a8b3700 1 -- 172.21.15.45:0/1502245602 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55cd10c34840 con 0x55cd10ec4c00 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd03a8b3700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55cd11026000 0x55cd10c7f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd03a8b3700 1 -- 172.21.15.45:0/1502245602 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x55cd10c10a80 con 0x55cd10ec4c00 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd042103840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd042103840 4 datascan.main: resolving metadata pool 14 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cd10ec5000 0x55cd10c7e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55cd11026000 0x55cd10c7f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:1 14.0 14:00000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd10ec5400 con 0x55cd10ec5000 2023-12-19T18:01:53.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cd10ec5000 0x55cd10c7e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55cd11026000 0x55cd10c7f700 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55cd10c2db00 tx=0x55cd119bed20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cd10ec5000 0x55cd10c7e100 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.726+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(1 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55cd10ec5400 0x55cd1103c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:2 14.10 14:08000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11026400 con 0x55cd10ec5400 2023-12-19T18:01:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55cd10ec5400 0x55cd1103c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55cd10ec5400 0x55cd1103c000 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(2 [pgnls start_epoch 112 out=81b] v112'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55cd11026400 0x55cd1103c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 14.8 14:10000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11026c00 con 0x55cd11026400 2023-12-19T18:01:53.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55cd11026400 0x55cd1103c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55cd11026400 0x55cd1103c580 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.730+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:4 14.18 14:18000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11026c00 con 0x55cd10ec5400 2023-12-19T18:01:53.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(4 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55cd11026c00 0x55cd1103cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:5 14.4 14:20000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027000 con 0x55cd11026c00 2023-12-19T18:01:53.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55cd11026c00 0x55cd1103cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55cd11026c00 0x55cd1103cb00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(5 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55cd11027000 0x55cd1103d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:6 14.14 14:28000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027800 con 0x55cd11027000 2023-12-19T18:01:53.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.734+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55cd11027000 0x55cd1103d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55cd11027000 0x55cd1103d600 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(6 [pgnls start_epoch 112 out=125b] v112'50 uv50 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11027000 2023-12-19T18:01:53.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:7 14.c 14:30000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027800 con 0x55cd11026400 2023-12-19T18:01:53.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(7 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:8 14.1c 14:38000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027800 con 0x55cd11026400 2023-12-19T18:01:53.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(8 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.738+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 14.2 14:40000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027800 con 0x55cd11026c00 2023-12-19T18:01:53.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(9 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:10 14.12 14:48000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027800 con 0x55cd10ec5000 2023-12-19T18:01:53.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(10 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55cd11027800 0x55cd1103db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:11 14.a 14:50000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11026800 con 0x55cd11027800 2023-12-19T18:01:53.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55cd11027800 0x55cd1103db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55cd11027800 0x55cd1103db80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(11 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11027800 2023-12-19T18:01:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.742+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 14.1a 14:58000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11026800 con 0x55cd11026400 2023-12-19T18:01:53.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(12 [pgnls start_epoch 112 out=49b] v112'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:13 14.6 14:60000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11026800 con 0x55cd11026400 2023-12-19T18:01:53.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(13 [pgnls start_epoch 112 out=49b] v111'8 uv8 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0408bf700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55cd11026800 0x55cd1103e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:14 14.16 14:68000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058000 con 0x55cd11026800 2023-12-19T18:01:53.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55cd11026800 0x55cd1103e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0400be700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55cd11026800 0x55cd1103e100 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(14 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026800 2023-12-19T18:01:53.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.746+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:15 14.e 14:70000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058000 con 0x55cd11027000 2023-12-19T18:01:53.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(15 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11027000 2023-12-19T18:01:53.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55cd11058000 0x55cd1103d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:53.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:16 14.1e 14:78000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11058000 2023-12-19T18:01:53.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55cd11058000 0x55cd1103d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:53.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55cd11058000 0x55cd1103d080 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:53.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(16 [pgnls start_epoch 112 out=49b] v112'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11058000 2023-12-19T18:01:53.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:17 14.1 14:80000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026800 2023-12-19T18:01:53.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(17 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026800 2023-12-19T18:01:53.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.750+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:18 14.11 14:88000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11027000 2023-12-19T18:01:53.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(18 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11027000 2023-12-19T18:01:53.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:19 14.9 14:90000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11027800 2023-12-19T18:01:53.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(19 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11027800 2023-12-19T18:01:53.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:20 14.19 14:98000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026c00 2023-12-19T18:01:53.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(20 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 14.5 14:a0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026400 2023-12-19T18:01:53.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(21 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.754+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:22 14.15 14:a8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11058000 2023-12-19T18:01:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(22 [pgnls start_epoch 112 out=73b] v111'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11058000 2023-12-19T18:01:53.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:23 14.d 14:b0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026c00 2023-12-19T18:01:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(23 [pgnls start_epoch 112 out=74b] v112'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:24 14.1d 14:b8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026400 2023-12-19T18:01:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(24 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 14.3 14:c0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026400 2023-12-19T18:01:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(25 [pgnls start_epoch 112 out=71b] v112'2 uv2 ondisk = 1) v8 ==== 144+0+71 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:26 14.13 14:c8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd10ec5000 2023-12-19T18:01:53.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.758+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(26 [pgnls start_epoch 112 out=98b] v112'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 14.b 14:d0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026400 2023-12-19T18:01:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(27 [pgnls start_epoch 112 out=76b] v112'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:28 14.1b 14:d8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd10ec5400 2023-12-19T18:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(28 [pgnls start_epoch 112 out=49b] v112'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:29 14.7 14:e0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11027800 2023-12-19T18:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(29 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11027800 2023-12-19T18:01:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:30 14.17 14:e8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd10ec5400 2023-12-19T18:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(30 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.762+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:31 14.f 14:f0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11058000 2023-12-19T18:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(31 [pgnls start_epoch 112 out=73b] v112'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11058000 2023-12-19T18:01:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:32 14.1f 14:f8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026400 2023-12-19T18:01:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(32 [pgnls start_epoch 112 out=101b] v112'13 uv13 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-12-19T18:01:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:33 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd10ec5800 con 0x55cd10ec5400 2023-12-19T18:01:53.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(33 10000000000.00000000 [omap-get-vals out=3582b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+3582 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T18:01:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 4.00000000 2023-12-19T18:01:53.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:34 14.3 14:c0ce80d4:::4.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058c00 con 0x55cd11026400 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(34 4.00000000 [omap-get-vals out=513b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+513 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.766+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:35 14.13 14:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059000 con 0x55cd10ec5000 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(35 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-12-19T18:01:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:36 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059400 con 0x55cd11026400 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(36 1.00000000 [omap-get-vals out=1016b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+1016 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:37 14.0 14:00000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5000 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(37 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:38 14.10 14:08000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5400 2023-12-19T18:01:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(38 [pgnls start_epoch 112 out=81b] v112'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.770+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:39 14.8 14:10000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(39 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:40 14.18 14:18000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5400 2023-12-19T18:01:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(40 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 14.4 14:20000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026c00 2023-12-19T18:01:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(41 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:42 14.14 14:28000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11027000 2023-12-19T18:01:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(42 [pgnls start_epoch 112 out=125b] v112'50 uv50 ondisk = 1) v8 ==== 144+0+125 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11027000 2023-12-19T18:01:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:43 14.c 14:30000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.774+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(43 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:44 14.1c 14:38000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(44 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:45 14.2 14:40000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026c00 2023-12-19T18:01:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(45 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:46 14.12 14:48000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5000 2023-12-19T18:01:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(46 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:47 14.a 14:50000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11027800 2023-12-19T18:01:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(47 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11027800 2023-12-19T18:01:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.778+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 14.1a 14:58000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(48 [pgnls start_epoch 112 out=49b] v112'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:49 14.6 14:60000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(49 [pgnls start_epoch 112 out=49b] v111'8 uv8 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:50 14.16 14:68000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026800 2023-12-19T18:01:53.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(50 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026800 2023-12-19T18:01:53.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:51 14.e 14:70000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11027000 2023-12-19T18:01:53.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(51 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11027000 2023-12-19T18:01:53.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.782+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:52 14.1e 14:78000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11058000 2023-12-19T18:01:53.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(52 [pgnls start_epoch 112 out=49b] v112'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11058000 2023-12-19T18:01:53.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:53 14.1 14:80000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026800 2023-12-19T18:01:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(53 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026800 2023-12-19T18:01:53.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:54 14.11 14:88000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11027000 2023-12-19T18:01:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(54 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11027000 2023-12-19T18:01:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:55 14.9 14:90000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11027800 2023-12-19T18:01:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(55 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11027800 2023-12-19T18:01:53.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.786+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:56 14.19 14:98000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026c00 2023-12-19T18:01:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(56 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:57 14.5 14:a0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 18 ==== osd_op_reply(57 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:58 14.15 14:a8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11058000 2023-12-19T18:01:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(58 [pgnls start_epoch 112 out=73b] v111'6 uv6 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11058000 2023-12-19T18:01:53.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:59 14.d 14:b0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026c00 2023-12-19T18:01:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(59 [pgnls start_epoch 112 out=74b] v112'3 uv3 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:60 14.1d 14:b8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.790+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 19 ==== osd_op_reply(60 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:61 14.3 14:c0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 20 ==== osd_op_reply(61 [pgnls start_epoch 112 out=71b] v112'2 uv2 ondisk = 1) v8 ==== 144+0+71 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:62 14.13 14:c8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5000 2023-12-19T18:01:53.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(62 [pgnls start_epoch 112 out=98b] v112'7 uv7 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:63 14.b 14:d0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 21 ==== osd_op_reply(63 [pgnls start_epoch 112 out=76b] v112'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:64 14.1b 14:d8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5400 2023-12-19T18:01:53.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(64 [pgnls start_epoch 112 out=49b] v112'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.794+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:65 14.7 14:e0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11027800 2023-12-19T18:01:53.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(65 [pgnls start_epoch 112 out=49b] v111'3 uv3 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11027800 2023-12-19T18:01:53.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:66 14.17 14:e8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd10ec5400 2023-12-19T18:01:53.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(66 [pgnls start_epoch 112 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:67 14.f 14:f0000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11058000 2023-12-19T18:01:53.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(67 [pgnls start_epoch 112 out=73b] v112'4 uv4 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd11058000 2023-12-19T18:01:53.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:68 14.1f 14:f8000000::::head [pgnls start_epoch 112 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 22 ==== osd_op_reply(68 [pgnls start_epoch 112 out=101b] v112'13 uv13 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-12-19T18:01:53.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:69 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059c00 con 0x55cd10ec5400 2023-12-19T18:01:53.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(69 10000000000.00000000 [omap-get-vals out=3582b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+3582 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001f6 for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001f8 for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001f9 for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001fa for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001fb for future processing to fix dnfirst 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T18:01:53.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.798+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 4.00000000 2023-12-19T18:01:53.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:70 14.3 14:c0ce80d4:::4.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058800 con 0x55cd11026400 2023-12-19T18:01:53.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 23 ==== osd_op_reply(70 4.00000000 [omap-get-vals out=513b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+513 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: adding 0x100000001fc for future processing to fix dnfirst 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:71 14.13 14:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058400 con 0x55cd10ec5000 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(71 100.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T18:01:53.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:72 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058c00 con 0x55cd11026400 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 24 ==== osd_op_reply(72 1.00000000 [omap-get-vals out=1016b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+1016 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: adding 0x4 for future processing to fix dnfirst 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: injected ino detected 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: adding 0x10000000000 for future processing to fix dnfirst 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: processing 10 injected_inos 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x4 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:lost+found 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:73 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059000 con 0x55cd11026400 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 25 ==== osd_op_reply(73 1.00000000 [omap-get-vals-by-keys out=511b] v0'0 uv13 ondisk = 0) v8 ==== 154+0+511 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.read_dentry: oid=1.00000000 dname=lost+found frag=*, r=0 2023-12-19T18:01:53.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.802+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:74 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=511b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11027400 con 0x55cd11026400 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 26 ==== osd_op_reply(74 1.00000000 [omap-set-vals] v112'14 uv14 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x1/lost+found pointing to 0x0x4 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x10000000000 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x1:stripey 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:75 14.1f 14:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059400 con 0x55cd11026400 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 27 ==== osd_op_reply(75 1.00000000 [omap-get-vals-by-keys out=508b] v0'0 uv14 ondisk = 0) v8 ==== 154+0+508 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 20 datascan.read_dentry: oid=1.00000000 dname=stripey frag=*, r=0 2023-12-19T18:01:53.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.806+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:76 14.1f 14:ff5b34d6:::1.00000000:head [omap-set-vals in=508b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059800 con 0x55cd11026400 2023-12-19T18:01:53.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 28 ==== osd_op_reply(76 1.00000000 [omap-set-vals] v112'15 uv15 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x1/stripey pointing to 0x0x10000000000 2023-12-19T18:01:53.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-12-19T18:01:53.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_0 2023-12-19T18:01:53.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:77 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058800 con 0x55cd10ec5400 2023-12-19T18:01:53.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(77 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_0 frag=*, r=0 2023-12-19T18:01:53.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.810+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:78 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058400 con 0x55cd10ec5400 2023-12-19T18:01:53.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(78 10000000000.00000000 [omap-set-vals] v112'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_0 pointing to 0x0x10000000001 2023-12-19T18:01:53.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001f6 2023-12-19T18:01:53.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_1 2023-12-19T18:01:53.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:79 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058c00 con 0x55cd10ec5400 2023-12-19T18:01:53.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(79 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_1 frag=*, r=0 2023-12-19T18:01:53.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.814+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:80 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059000 con 0x55cd10ec5400 2023-12-19T18:01:53.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(80 10000000000.00000000 [omap-set-vals] v112'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_1 pointing to 0x0x100000001f6 2023-12-19T18:01:53.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001f7 2023-12-19T18:01:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_2 2023-12-19T18:01:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:81 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059c00 con 0x55cd10ec5400 2023-12-19T18:01:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_2 frag=*, r=0 2023-12-19T18:01:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:82 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058800 con 0x55cd10ec5400 2023-12-19T18:01:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 16 ==== osd_op_reply(82 10000000000.00000000 [omap-set-vals] v112'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_2 pointing to 0x0x100000001f7 2023-12-19T18:01:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001f8 2023-12-19T18:01:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_3 2023-12-19T18:01:53.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.818+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:83 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058400 con 0x55cd10ec5400 2023-12-19T18:01:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 17 ==== osd_op_reply(83 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_3 frag=*, r=0 2023-12-19T18:01:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:84 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd10ec5800 con 0x55cd10ec5400 2023-12-19T18:01:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 18 ==== osd_op_reply(84 10000000000.00000000 [omap-set-vals] v112'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_3 pointing to 0x0x100000001f8 2023-12-19T18:01:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001f9 2023-12-19T18:01:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_4 2023-12-19T18:01:53.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:85 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058c00 con 0x55cd10ec5400 2023-12-19T18:01:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 19 ==== osd_op_reply(85 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_4 frag=*, r=0 2023-12-19T18:01:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.822+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:86 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059000 con 0x55cd10ec5400 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 20 ==== osd_op_reply(86 10000000000.00000000 [omap-set-vals] v112'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_4 pointing to 0x0x100000001f9 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001fa 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_5 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:87 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059c00 con 0x55cd10ec5400 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 21 ==== osd_op_reply(87 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_5 frag=*, r=0 2023-12-19T18:01:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.826+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:88 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058800 con 0x55cd10ec5400 2023-12-19T18:01:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 22 ==== osd_op_reply(88 10000000000.00000000 [omap-set-vals] v112'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_5 pointing to 0x0x100000001fa 2023-12-19T18:01:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001fb 2023-12-19T18:01:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:flushed_file_6 2023-12-19T18:01:53.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:89 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=27b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058400 con 0x55cd10ec5400 2023-12-19T18:01:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 23 ==== osd_op_reply(89 10000000000.00000000 [omap-get-vals-by-keys out=515b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+515 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed_file_6 frag=*, r=0 2023-12-19T18:01:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.830+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:90 14.10 14:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=515b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058c00 con 0x55cd10ec5400 2023-12-19T18:01:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd0410c0700 1 -- 172.21.15.45:0/1502245602 <== osd.1 v2:172.21.15.45:6800/36282 24 ==== osd_op_reply(90 10000000000.00000000 [omap-set-vals] v112'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55cd1194ed80 con 0x55cd10ec5400 2023-12-19T18:01:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/flushed_file_6 pointing to 0x0x100000001fb 2023-12-19T18:01:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 10 datascan.scan_links: handling injected_ino 0x100000001fc 2023-12-19T18:01:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x4:100000001fc 2023-12-19T18:01:53.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:91 14.3 14:c0ce80d4:::4.00000000:head [omap-get-vals-by-keys in=24b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059000 con 0x55cd11026400 2023-12-19T18:01:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 29 ==== osd_op_reply(91 4.00000000 [omap-get-vals-by-keys out=512b] v0'0 uv2 ondisk = 0) v8 ==== 154+0+512 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 20 datascan.read_dentry: oid=4.00000000 dname=100000001fc frag=*, r=0 2023-12-19T18:01:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 20 datascan.scan_links: first is now 2 2023-12-19T18:01:53.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:92 14.3 14:c0ce80d4:::4.00000000:head [omap-set-vals in=512b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11059c00 con 0x55cd11026400 2023-12-19T18:01:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.0 v2:172.21.15.45:6808/36279 30 ==== osd_op_reply(92 4.00000000 [omap-set-vals] v112'3 uv3 ondisk = 0) v8 ==== 154+0+0 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd11026400 2023-12-19T18:01:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 20 datascan.inject_linkage: Injected dentry 0x0x4/100000001fc pointing to 0x0x100000001fc 2023-12-19T18:01:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 10 datascan.scan_links: updating inotable 2023-12-19T18:01:53.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.834+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:93 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058800 con 0x55cd10ec5000 2023-12-19T18:01:53.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.838+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(93 mds0_inotable [read 0~34 out=34b] v0'0 uv6 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.838+0000 7fd042103840 10 mds.0.inotable: skip_inos was [0x10000000000~0x10000000000] 2023-12-19T18:01:53.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.838+0000 7fd042103840 10 mds.0.inotable: skip_inos now [0x100000001fd~0xfffffffe03] 2023-12-19T18:01:53.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.838+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:94 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd11058400 con 0x55cd10ec5000 2023-12-19T18:01:53.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd0408bf700 1 -- 172.21.15.45:0/1502245602 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(94 mds0_inotable [writefull 0~34] v112'8 uv8 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55cd1194eb40 con 0x55cd10ec5000 2023-12-19T18:01:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 10 datascan.scan_links: updating snaptable 2023-12-19T18:01:53.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:95 14.d 14:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e112) v8 -- 0x55cd10ec5800 con 0x55cd11026c00 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(95 mds_snaptable [read 0~70 out=70b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55cd1194efc0 con 0x55cd11026c00 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55cd11026400 msgr2=0x55cd1103c580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55cd11026400 0x55cd1103c580 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55cd10ec5400 msgr2=0x55cd1103c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55cd10ec5400 0x55cd1103c000 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cd10ec5000 msgr2=0x55cd10c7e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55cd10ec5000 0x55cd10c7e100 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55cd11026800 msgr2=0x55cd1103e100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55cd11026800 0x55cd1103e100 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55cd11027000 msgr2=0x55cd1103d600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55cd11027000 0x55cd1103d600 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 reap_dead start 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 reap_dead start 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55cd11027800 msgr2=0x55cd1103db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55cd11027800 0x55cd1103db80 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55cd11026c00 msgr2=0x55cd1103cb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55cd11026c00 0x55cd1103cb00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55cd11058000 msgr2=0x55cd1103d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55cd11058000 0x55cd1103d080 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55cd11026000 msgr2=0x55cd10c7f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55cd11026000 0x55cd10c7f700 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x55cd10c2db00 tx=0x55cd119bed20 comp rx=0 tx=0).stop 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 msgr2=0x55cd10c7e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e680 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x55cd119bd350 tx=0x55cd11950cc0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd0400be700 1 -- 172.21.15.45:0/1502245602 reap_dead start 2023-12-19T18:01:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 shutdown_connections 2023-12-19T18:01:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/1502245602 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10ec4c00 0x55cd10c7e680 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 >> 172.21.15.45:0/1502245602 conn(0x55cd10bd6c00 msgr2=0x55cd10ca5800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 shutdown_connections 2023-12-19T18:01:53.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/1502245602 wait complete. 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 msgr2=0x55cd10c7c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 0x55cd10c7c580 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x55cd10ce5380 tx=0x55cd11951020 comp rx=0 tx=0).stop 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 shutdown_connections 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55cd10bd7000 0x55cd10c7d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55cd10bd7400 0x55cd10c7cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 --2- 172.21.15.45:0/2305278139 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55cd10bd7800 0x55cd10c7c580 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 >> 172.21.15.45:0/2305278139 conn(0x55cd10bd7c00 msgr2=0x55cd10ca5000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.842+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 shutdown_connections 2023-12-19T18:01:53.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:53.846+0000 7fd042103840 1 -- 172.21.15.45:0/2305278139 wait complete. 2023-12-19T18:01:53.857 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.208669, result: 2023-12-19T18:01:53.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mds repaired 0 2023-12-19T18:01:54.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 Processor -- start 2023-12-19T18:01:54.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 -- start start 2023-12-19T18:01:54.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc96806ea90 0x7fc9680d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc9680b88b0 0x7fc9680b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9680b6dd0 con 0x7fc9680b6250 2023-12-19T18:01:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680d1820 con 0x7fc96806ea90 2023-12-19T18:01:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96f307700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9680d1b00 con 0x7fc9680b88b0 2023-12-19T18:01:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96e305700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc96806ea90 0x7fc9680d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96e305700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc96806ea90 0x7fc9680d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34462/0 (socket says 172.21.15.45:34462) 2023-12-19T18:01:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.038+0000 7fc96e305700 1 -- 172.21.15.45:0/1470465772 learned_addr learned my addr 172.21.15.45:0/1470465772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96db04700 1 --2- 172.21.15.45:0/1470465772 >> v2:172.21.15.73:3300/0 conn(0x7fc9680b88b0 0x7fc9680b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96e305700 1 -- 172.21.15.45:0/1470465772 >> v2:172.21.15.73:3300/0 conn(0x7fc9680b88b0 msgr2=0x7fc9680b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96e305700 1 --2- 172.21.15.45:0/1470465772 >> v2:172.21.15.73:3300/0 conn(0x7fc9680b88b0 0x7fc9680b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96e305700 1 -- 172.21.15.45:0/1470465772 >> v1:172.21.15.73:6789/0 conn(0x7fc9680b6250 legacy=0x7fc9680b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96e305700 1 -- 172.21.15.45:0/1470465772 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9680d1de0 con 0x7fc96806ea90 2023-12-19T18:01:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96db04700 1 --2- 172.21.15.45:0/1470465772 >> v2:172.21.15.73:3300/0 conn(0x7fc9680b88b0 0x7fc9680b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96e305700 1 --2- 172.21.15.45:0/1470465772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96806ea90 0x7fc9680d0f20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc9680b2610 tx=0x7fc964009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f064f42a2623dadc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96d303700 1 -- 172.21.15.45:0/1470465772 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400b8a0 con 0x7fc96806ea90 2023-12-19T18:01:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96d303700 1 -- 172.21.15.45:0/1470465772 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400ba00 con 0x7fc96806ea90 2023-12-19T18:01:54.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96d303700 1 -- 172.21.15.45:0/1470465772 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400bd90 con 0x7fc96806ea90 2023-12-19T18:01:54.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 -- 172.21.15.45:0/1470465772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96806ea90 msgr2=0x7fc9680d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 --2- 172.21.15.45:0/1470465772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96806ea90 0x7fc9680d0f20 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc9680b2610 tx=0x7fc964009bf0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 -- 172.21.15.45:0/1470465772 shutdown_connections 2023-12-19T18:01:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 --2- 172.21.15.45:0/1470465772 >> v2:172.21.15.73:3300/0 conn(0x7fc9680b88b0 0x7fc9680b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 --2- 172.21.15.45:0/1470465772 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc96806ea90 0x7fc9680d0f20 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 -- 172.21.15.45:0/1470465772 >> 172.21.15.45:0/1470465772 conn(0x7fc9680b46d0 msgr2=0x7fc9680b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 -- 172.21.15.45:0/1470465772 shutdown_connections 2023-12-19T18:01:54.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.042+0000 7fc96f307700 1 -- 172.21.15.45:0/1470465772 wait complete. 2023-12-19T18:01:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.046+0000 7fc96f307700 1 Processor -- start 2023-12-19T18:01:54.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 -- start start 2023-12-19T18:01:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc96806ea90 0x7fc968146a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 0x7fc96815b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9680b88b0 0x7fc968157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968157040 con 0x7fc9680b6250 2023-12-19T18:01:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc968157850 con 0x7fc96806ea90 2023-12-19T18:01:54.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96f307700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9680cbb70 con 0x7fc9680b88b0 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 0x7fc96815b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 0x7fc96815b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34472/0 (socket says 172.21.15.45:34472) 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 -- 172.21.15.45:0/347918776 learned_addr learned my addr 172.21.15.45:0/347918776 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96e305700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc96806ea90 0x7fc968146a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96eb06700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9680b88b0 0x7fc968157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 -- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9680b88b0 msgr2=0x7fc968157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9680b88b0 0x7fc968157fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 -- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc96806ea90 msgr2=0x7fc968146a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc96806ea90 0x7fc968146a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96db04700 1 -- 172.21.15.45:0/347918776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc964009570 con 0x7fc9680b6250 2023-12-19T18:01:54.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.050+0000 7fc96eb06700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9680b88b0 0x7fc968157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:01:54.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc96db04700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 0x7fc96815b310 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fc95800e840 tx=0x7fc95800eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc958004230 con 0x7fc9680b6250 2023-12-19T18:01:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc958004390 con 0x7fc9680b6250 2023-12-19T18:01:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc968146f40 con 0x7fc9680b6250 2023-12-19T18:01:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9580036c0 con 0x7fc9680b6250 2023-12-19T18:01:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc968157570 con 0x7fc9680b6250 2023-12-19T18:01:54.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.054+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9680cbd00 con 0x7fc9680b6250 2023-12-19T18:01:54.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.058+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc958003840 con 0x7fc9680b6250 2023-12-19T18:01:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.058+0000 7fc95effd700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc94c065b20 0x7fc94c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.058+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 6605+0+0 (secure 0 0 0) 0x7fc958082de0 con 0x7fc9680b6250 2023-12-19T18:01:54.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.058+0000 7fc96e305700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc94c065b20 0x7fc94c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.058+0000 7fc96e305700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc94c065b20 0x7fc94c067fe0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc964000c00 tx=0x7fc964008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:54.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.066+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc958050500 con 0x7fc9680b6250 2023-12-19T18:01:54.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.322+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "mds repaired", "role": "0"} v 0) v1 -- 0x7fc968067760 con 0x7fc9680b6250 2023-12-19T18:01:54.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.606+0000 7fc95effd700 1 -- 172.21.15.45:0/347918776 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "mds repaired", "role": "0"}]=0 repaired: restoring rank 5:0 v85) v1 ==== 101+0+0 (secure 0 0 0) 0x7fc958053b20 con 0x7fc9680b6250 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc94c065b20 msgr2=0x7fc94c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc94c065b20 0x7fc94c067fe0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fc964000c00 tx=0x7fc964008030 comp rx=0 tx=0).stop 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 msgr2=0x7fc96815b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 0x7fc96815b310 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fc95800e840 tx=0x7fc95800eb50 comp rx=0 tx=0).stop 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 shutdown_connections 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc94c065b20 0x7fc94c067fe0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc9680b88b0 0x7fc968157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc9680b6250 0x7fc96815b310 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 --2- 172.21.15.45:0/347918776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc96806ea90 0x7fc968146a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 >> 172.21.15.45:0/347918776 conn(0x7fc9680b46d0 msgr2=0x7fc968070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:54.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 shutdown_connections 2023-12-19T18:01:54.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.610+0000 7fc96f307700 1 -- 172.21.15.45:0/347918776 wait complete. 2023-12-19T18:01:54.617 INFO:teuthology.orchestra.run.smithi045.stderr:repaired: restoring rank 5:0 2023-12-19T18:01:54.620 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:01:54.619+0000 7f268054e700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T18:01:54.640 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T18:01:54.641 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T18:01:54.641 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T18:01:54.641 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:54.641 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T18:01:54.641 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T18:01:54.641 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T18:01:54.641 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:54.642 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T18:01:54.642 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T18:01:54.642 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T18:01:54.642 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:54.642 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T18:01:54.642 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T18:01:54.642 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T18:01:54.643 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:01:54.666 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T18:01:54.667 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T18:01:54.668 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T18:01:54.668 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T18:01:54.669 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T18:01:54.669 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T18:01:54.670 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T18:01:54.671 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T18:01:54.717 INFO:tasks.ceph.mds.d:Started 2023-12-19T18:01:54.718 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:54.722 INFO:tasks.ceph.mds.a:Started 2023-12-19T18:01:54.723 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:54.723 INFO:tasks.ceph.mds.b:Started 2023-12-19T18:01:54.724 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:54.726 INFO:tasks.ceph.mds.c:Started 2023-12-19T18:01:54.726 DEBUG:teuthology.parallel:result is None 2023-12-19T18:01:54.726 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:54.845 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T18:01:54.846 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T18:01:54.846 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T18:01:54.849 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:01:54.879 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:01:54.874+0000 7f4a6b7ef700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:01:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.890+0000 7f204d839700 1 Processor -- start 2023-12-19T18:01:54.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.890+0000 7f204d839700 1 -- start start 2023-12-19T18:01:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204d839700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f204806ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204d839700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f204806f3b0 0x7f204806f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204d839700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20480d1820 con 0x7f204806ea90 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204d839700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480d1630 con 0x7f204806f3b0 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204d839700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480d1b00 con 0x7f20480b88b0 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204c837700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f204806ea90 0x7f20480d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56494/0 (socket says 172.21.15.45:56494) 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204c837700 1 -- 172.21.15.45:0/3160624584 learned_addr learned my addr 172.21.15.45:0/3160624584 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f2047fff700 1 --2- 172.21.15.45:0/3160624584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f204806ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f204d038700 1 --2- 172.21.15.45:0/3160624584 >> v2:172.21.15.45:3300/0 conn(0x7f204806f3b0 0x7f204806f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f20477fe700 1 -- 172.21.15.45:0/3160624584 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133969596 0 0) 0x7f20480d1820 con 0x7f204806ea90 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f20477fe700 1 -- 172.21.15.45:0/3160624584 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20380035d0 con 0x7f204806ea90 2023-12-19T18:01:54.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f2047fff700 1 -- 172.21.15.45:0/3160624584 >> v2:172.21.15.45:3300/0 conn(0x7f204806f3b0 msgr2=0x7f204806f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f2047fff700 1 --2- 172.21.15.45:0/3160624584 >> v2:172.21.15.45:3300/0 conn(0x7f204806f3b0 0x7f204806f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f2047fff700 1 -- 172.21.15.45:0/3160624584 >> v1:172.21.15.45:6789/0 conn(0x7f204806ea90 legacy=0x7f20480d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f2047fff700 1 -- 172.21.15.45:0/3160624584 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480d1de0 con 0x7f20480b88b0 2023-12-19T18:01:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f2047fff700 1 --2- 172.21.15.45:0/3160624584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f204806ee70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2034009850 tx=0x7f2034009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=453b435c569ada34 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:54.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f20477fe700 1 -- 172.21.15.45:0/3160624584 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034011830 con 0x7f20480b88b0 2023-12-19T18:01:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f20477fe700 1 -- 172.21.15.45:0/3160624584 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2034011990 con 0x7f20480b88b0 2023-12-19T18:01:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.894+0000 7f20477fe700 1 -- 172.21.15.45:0/3160624584 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034011d40 con 0x7f20480b88b0 2023-12-19T18:01:54.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 -- 172.21.15.45:0/3160624584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 msgr2=0x7f204806ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 --2- 172.21.15.45:0/3160624584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f204806ee70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2034009850 tx=0x7f2034009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 -- 172.21.15.45:0/3160624584 shutdown_connections 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 --2- 172.21.15.45:0/3160624584 >> v2:172.21.15.45:3300/0 conn(0x7f204806f3b0 0x7f204806f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 --2- 172.21.15.45:0/3160624584 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f204806ee70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 -- 172.21.15.45:0/3160624584 >> 172.21.15.45:0/3160624584 conn(0x7f20480b46d0 msgr2=0x7f20480b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 -- 172.21.15.45:0/3160624584 shutdown_connections 2023-12-19T18:01:54.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 -- 172.21.15.45:0/3160624584 wait complete. 2023-12-19T18:01:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 Processor -- start 2023-12-19T18:01:54.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.898+0000 7f204d839700 1 -- start start 2023-12-19T18:01:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f204d839700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204806ea90 0x7f20480b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f204d839700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 0x7f20480cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f204d839700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f20480cbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f204d839700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480cc380 con 0x7f204806ea90 2023-12-19T18:01:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f204d839700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480c9d50 con 0x7f204806f3b0 2023-12-19T18:01:54.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f204d839700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480ca030 con 0x7f20480b88b0 2023-12-19T18:01:54.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.902+0000 7f2047fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 0x7f20480cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 0x7f20480cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:36844/0 (socket says 172.21.15.45:36844) 2023-12-19T18:01:54.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 -- 172.21.15.45:0/827416696 learned_addr learned my addr 172.21.15.45:0/827416696 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:54.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f204c837700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204806ea90 0x7f20480b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 -- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 msgr2=0x7f20480cbe40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-19T18:01:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f20480cbe40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 -- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204806ea90 msgr2=0x7f20480b3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204806ea90 0x7f20480b3a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 -- 172.21.15.45:0/827416696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20340094b0 con 0x7f204806f3b0 2023-12-19T18:01:54.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f2047fff700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 0x7f20480cb900 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f20340090b0 tx=0x7f2034004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:54.910 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:01:54.907+0000 7f4a41173700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T18:01:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034004610 con 0x7f204806f3b0 2023-12-19T18:01:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203401e070 con 0x7f204806f3b0 2023-12-19T18:01:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20340038c0 con 0x7f204806f3b0 2023-12-19T18:01:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20480ca310 con 0x7f204806f3b0 2023-12-19T18:01:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20480b3f60 con 0x7f204806f3b0 2023-12-19T18:01:54.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.906+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2048067760 con 0x7f204806f3b0 2023-12-19T18:01:54.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.910+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2034003a20 con 0x7f204806f3b0 2023-12-19T18:01:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.910+0000 7f20457fa700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.910+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f2034020070 con 0x7f204806f3b0 2023-12-19T18:01:54.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.910+0000 7f204c837700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:54.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.914+0000 7f204c837700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f203c001560 tx=0x7f203c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:54.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:54.914+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2034052220 con 0x7f204806f3b0 2023-12-19T18:01:55.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.122+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f204815c4f0 con 0x7f204806f3b0 2023-12-19T18:01:55.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.122+0000 7f20457fa700 1 -- 172.21.15.45:0/827416696 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f2034055840 con 0x7f204806f3b0 2023-12-19T18:01:55.128 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:55.128 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":88,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":88,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:54.889790+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 msgr2=0x7f202c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f203c001560 tx=0x7f203c009040 comp rx=0 tx=0).stop 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 msgr2=0x7f20480cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 0x7f20480cb900 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f20340090b0 tx=0x7f2034004770 comp rx=0 tx=0).stop 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 shutdown_connections 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f202c065ad0 0x7f202c067f90 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f20480b88b0 0x7f20480cbe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:55.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f204806f3b0 0x7f20480cb900 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 --2- 172.21.15.45:0/827416696 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f204806ea90 0x7f20480b3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 >> 172.21.15.45:0/827416696 conn(0x7f20480b46d0 msgr2=0x7f20480cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 shutdown_connections 2023-12-19T18:01:55.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:55.126+0000 7f204d839700 1 -- 172.21.15.45:0/827416696 wait complete. 2023-12-19T18:01:55.133 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 88 2023-12-19T18:01:55.557 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 88, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:01:48.985200+0000', 'modified': '2023-12-19T18:01:54.889790+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57227}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57227': {'gid': 57227, 'name': 'b', 'rank': 0, 'incarnation': 88, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.73:6835/280993181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 280993181}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 280993181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15, 16], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:01:55.558 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_57227:up:replay 2023-12-19T18:01:56.559 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:56.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.738+0000 7fee4c251700 1 Processor -- start 2023-12-19T18:01:56.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.738+0000 7fee4c251700 1 -- start start 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee4c251700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164690 0x7fee440c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee4c251700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee44164a70 0x7fee440c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee4c251700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee440cdb80 con 0x7fee440cce30 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee4c251700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee440cde60 con 0x7fee44164a70 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee4c251700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440ce140 con 0x7fee44164690 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee44164a70 0x7fee440c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fee44164a70 0x7fee440c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34560/0 (socket says 172.21.15.45:34560) 2023-12-19T18:01:56.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 -- 172.21.15.45:0/4251974252 learned_addr learned my addr 172.21.15.45:0/4251974252 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee49fed700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164690 0x7fee440c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 -- 172.21.15.45:0/4251974252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164690 msgr2=0x7fee440c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164690 0x7fee440c3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 -- 172.21.15.45:0/4251974252 >> v1:172.21.15.73:6789/0 conn(0x7fee440cce30 legacy=0x7fee440cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 -- 172.21.15.45:0/4251974252 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee440ce420 con 0x7fee44164a70 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee49fed700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164690 0x7fee440c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee497ec700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee44164a70 0x7fee440c4340 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fee34009910 tx=0x7fee34009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b49ed0397a79abe server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee48feb700 1 -- 172.21.15.45:0/4251974252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34004230 con 0x7fee44164a70 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee48feb700 1 -- 172.21.15.45:0/4251974252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee34004390 con 0x7fee44164a70 2023-12-19T18:01:56.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.742+0000 7fee48feb700 1 -- 172.21.15.45:0/4251974252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee34009e60 con 0x7fee44164a70 2023-12-19T18:01:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 -- 172.21.15.45:0/4251974252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee44164a70 msgr2=0x7fee440c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee44164a70 0x7fee440c4340 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fee34009910 tx=0x7fee34009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 -- 172.21.15.45:0/4251974252 shutdown_connections 2023-12-19T18:01:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee44164a70 0x7fee440c4340 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 --2- 172.21.15.45:0/4251974252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164690 0x7fee440c3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 -- 172.21.15.45:0/4251974252 >> 172.21.15.45:0/4251974252 conn(0x7fee440cba40 msgr2=0x7fee440ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 -- 172.21.15.45:0/4251974252 shutdown_connections 2023-12-19T18:01:56.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 -- 172.21.15.45:0/4251974252 wait complete. 2023-12-19T18:01:56.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 Processor -- start 2023-12-19T18:01:56.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.746+0000 7fee4c251700 1 -- start start 2023-12-19T18:01:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 0x7fee440b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee44164690 0x7fee440adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164a70 0x7fee44162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee440c5a60 con 0x7fee440cce30 2023-12-19T18:01:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee441f6630 con 0x7fee44164690 2023-12-19T18:01:56.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee440b47b0 con 0x7fee44164a70 2023-12-19T18:01:56.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 0x7fee440b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:56.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 0x7fee440b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34576/0 (socket says 172.21.15.45:34576) 2023-12-19T18:01:56.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 -- 172.21.15.45:0/1294079726 learned_addr learned my addr 172.21.15.45:0/1294079726 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:56.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee497ec700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee44164690 0x7fee440adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:56.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4a7ee700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164a70 0x7fee44162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 -- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164a70 msgr2=0x7fee44162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164a70 0x7fee44162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 -- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee44164690 msgr2=0x7fee440adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee44164690 0x7fee440adad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 -- 172.21.15.45:0/1294079726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee34009570 con 0x7fee440cce30 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee49fed700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 0x7fee440b4270 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fee4000cf60 tx=0x7fee4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee4000ada0 con 0x7fee440cce30 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee44160ea0 con 0x7fee440cce30 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee40015440 con 0x7fee440cce30 2023-12-19T18:01:56.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee400157d0 con 0x7fee440cce30 2023-12-19T18:01:56.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.750+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee44161460 con 0x7fee440cce30 2023-12-19T18:01:56.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.754+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee44067090 con 0x7fee440cce30 2023-12-19T18:01:56.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.754+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fee40015930 con 0x7fee440cce30 2023-12-19T18:01:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.758+0000 7fee3a7fc700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee28065ad0 0x7fee28067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.758+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fee40083950 con 0x7fee440cce30 2023-12-19T18:01:56.761 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.758+0000 7fee497ec700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee28065ad0 0x7fee28067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:56.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.758+0000 7fee497ec700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee28065ad0 0x7fee28067f90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fee34009910 tx=0x7fee34008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:56.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.766+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fee40050f50 con 0x7fee440cce30 2023-12-19T18:01:56.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.978+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee4404ed30 con 0x7fee440cce30 2023-12-19T18:01:56.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.978+0000 7fee3a7fc700 1 -- 172.21.15.45:0/1294079726 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 90 v90) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fee40054570 con 0x7fee440cce30 2023-12-19T18:01:56.984 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:56.984 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":90,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":90,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:56.895879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee28065ad0 msgr2=0x7fee28067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee28065ad0 0x7fee28067f90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fee34009910 tx=0x7fee34008030 comp rx=0 tx=0).stop 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 msgr2=0x7fee440b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 0x7fee440b4270 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7fee4000cf60 tx=0x7fee4000cf90 comp rx=0 tx=0).stop 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 shutdown_connections 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fee28065ad0 0x7fee28067f90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fee44164a70 0x7fee44162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fee44164690 0x7fee440adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 --2- 172.21.15.45:0/1294079726 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fee440cce30 0x7fee440b4270 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 >> 172.21.15.45:0/1294079726 conn(0x7fee440cba40 msgr2=0x7fee440aead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:56.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 shutdown_connections 2023-12-19T18:01:56.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:56.982+0000 7fee4c251700 1 -- 172.21.15.45:0/1294079726 wait complete. 2023-12-19T18:01:56.989 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 90 2023-12-19T18:01:57.410 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 90, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:01:48.985200+0000', 'modified': '2023-12-19T18:01:56.895879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57227}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57227': {'gid': 57227, 'name': 'b', 'rank': 0, 'incarnation': 88, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.73:6835/280993181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 280993181}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 280993181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15, 16], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:01:57.411 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_57227:up:rejoin 2023-12-19T18:01:58.411 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:58.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.598+0000 7fd540c66700 1 Processor -- start 2023-12-19T18:01:58.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.598+0000 7fd540c66700 1 -- start start 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd53c15d030 0x7fd53c0cca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c160a20 0x7fd53c160e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c0cb770 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c161390 con 0x7fd53c15d030 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0cf850 con 0x7fd53c160a20 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53affd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd53c0cb2e0 0x7fd53c0cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56504/0 (socket says 172.21.15.45:56504) 2023-12-19T18:01:58.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53affd700 1 -- 172.21.15.45:0/4104673656 learned_addr learned my addr 172.21.15.45:0/4104673656 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:01:58.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53b7fe700 1 --2- 172.21.15.45:0/4104673656 >> v2:172.21.15.73:3300/0 conn(0x7fd53c15d030 0x7fd53c0cca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:58.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53bfff700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c160a20 0x7fd53c160e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:58.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53a7fc700 1 -- 172.21.15.45:0/4104673656 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667563585 0 0) 0x7fd53c0cb770 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53a7fc700 1 -- 172.21.15.45:0/4104673656 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd5240035d0 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53b7fe700 1 -- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c160a20 msgr2=0x7fd53c160e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53b7fe700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c160a20 0x7fd53c160e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53b7fe700 1 -- 172.21.15.45:0/4104673656 >> v1:172.21.15.45:6789/0 conn(0x7fd53c0cb2e0 legacy=0x7fd53c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53b7fe700 1 -- 172.21.15.45:0/4104673656 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0cb9c0 con 0x7fd53c15d030 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53bfff700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c160a20 0x7fd53c160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53b7fe700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c15d030 0x7fd53c0cca60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009850 tx=0x7fd52c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cc1dce9e417f591 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:58.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53a7fc700 1 -- 172.21.15.45:0/4104673656 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c011830 con 0x7fd53c15d030 2023-12-19T18:01:58.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53a7fc700 1 -- 172.21.15.45:0/4104673656 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c011990 con 0x7fd53c15d030 2023-12-19T18:01:58.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd53a7fc700 1 -- 172.21.15.45:0/4104673656 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c011d40 con 0x7fd53c15d030 2023-12-19T18:01:58.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 -- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c15d030 msgr2=0x7fd53c0cca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:58.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.602+0000 7fd540c66700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c15d030 0x7fd53c0cca60 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009850 tx=0x7fd52c009b60 comp rx=0 tx=0).stop 2023-12-19T18:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 -- 172.21.15.45:0/4104673656 shutdown_connections 2023-12-19T18:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c160a20 0x7fd53c160e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 --2- 172.21.15.45:0/4104673656 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c15d030 0x7fd53c0cca60 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 -- 172.21.15.45:0/4104673656 >> 172.21.15.45:0/4104673656 conn(0x7fd53c0b2540 msgr2=0x7fd53c0b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 -- 172.21.15.45:0/4104673656 shutdown_connections 2023-12-19T18:01:58.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 -- 172.21.15.45:0/4104673656 wait complete. 2023-12-19T18:01:58.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.606+0000 7fd540c66700 1 Processor -- start 2023-12-19T18:01:58.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 -- start start 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 0x7fd53c15b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c15d030 0x7fd53c15d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53c160a20 0x7fd53c0c3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b5760 con 0x7fd53c160a20 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b5a40 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd540c66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c0b5d20 con 0x7fd53c15d030 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53c160a20 0x7fd53c0c3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:58.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 0x7fd53c15b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c15d030 0x7fd53c15d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53c160a20 0x7fd53c0c3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34580/0 (socket says 172.21.15.45:34580) 2023-12-19T18:01:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 0x7fd53c15b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:36862/0 (socket says 172.21.15.45:36862) 2023-12-19T18:01:58.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 -- 172.21.15.45:0/2175970344 learned_addr learned my addr 172.21.15.45:0/2175970344 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 -- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c15d030 msgr2=0x7fd53c15d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c15d030 0x7fd53c15d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 -- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53c160a20 msgr2=0x7fd53c0c3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53c160a20 0x7fd53c0c3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 -- 172.21.15.45:0/2175970344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009a70 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.610+0000 7fd53b7fe700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 0x7fd53c15b130 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd52c014040 tx=0x7fd52c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0044d0 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c01e070 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd52c0094b0 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c003900 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0b5410 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c1fa1e0 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.614+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd52c003a60 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.618+0000 7fd523fff700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd528065ad0 0x7fd528067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.618+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd52c020070 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.618+0000 7fd53affd700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd528065ad0 0x7fd528067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:58.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.618+0000 7fd53affd700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd528065ad0 0x7fd528067f90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0b4d80 tx=0x7fd530007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:58.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.622+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd53c1fa1e0 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.838+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd53c067760 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.842+0000 7fd523fff700 1 -- 172.21.15.45:0/2175970344 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fd52c051dd0 con 0x7fd53c0cb2e0 2023-12-19T18:01:58.846 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:01:58.847 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:57.899642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:01:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd528065ad0 msgr2=0x7fd528067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd528065ad0 0x7fd528067f90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fd53c0b4d80 tx=0x7fd530007de0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 msgr2=0x7fd53c15b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:58.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 0x7fd53c15b130 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fd52c014040 tx=0x7fd52c004770 comp rx=0 tx=0).stop 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 shutdown_connections 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd528065ad0 0x7fd528067f90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd53c160a20 0x7fd53c0c3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd53c15d030 0x7fd53c15d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 --2- 172.21.15.45:0/2175970344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd53c0cb2e0 0x7fd53c15b130 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 >> 172.21.15.45:0/2175970344 conn(0x7fd53c0b2540 msgr2=0x7fd53c06b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 shutdown_connections 2023-12-19T18:01:58.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:58.846+0000 7fd540c66700 1 -- 172.21.15.45:0/2175970344 wait complete. 2023-12-19T18:01:58.854 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-12-19T18:01:59.277 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 91, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:01:48.985200+0000', 'modified': '2023-12-19T18:01:57.899642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 116, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57227}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57227': {'gid': 57227, 'name': 'b', 'rank': 0, 'incarnation': 88, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.73:6835/280993181', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 280993181}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 280993181}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15, 16], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:01:59.278 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:01:59.278 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T18:01:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.462+0000 7fa77759e700 1 Processor -- start 2023-12-19T18:01:59.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.462+0000 7fa77759e700 1 -- start start 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa77806ea90 0x7fa7780d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa7780b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7780d1820 con 0x7fa7780b88b0 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7780d1b00 con 0x7fa77806ea90 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7780d1de0 con 0x7fa77806fe80 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa77806ea90 0x7fa7780d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa77806ea90 0x7fa7780d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42812/0 (socket says 172.21.15.45:42812) 2023-12-19T18:01:59.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 -- 172.21.15.45:0/968219075 learned_addr learned my addr 172.21.15.45:0/968219075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa776d9d700 1 --2- 172.21.15.45:0/968219075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa7780b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 -- 172.21.15.45:0/968219075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 msgr2=0x7fa7780b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 --2- 172.21.15.45:0/968219075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa7780b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 -- 172.21.15.45:0/968219075 >> v1:172.21.15.45:6789/0 conn(0x7fa7780b88b0 legacy=0x7fa7780b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 -- 172.21.15.45:0/968219075 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7780d20c0 con 0x7fa77806ea90 2023-12-19T18:01:59.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77659c700 1 --2- 172.21.15.45:0/968219075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa77806ea90 0x7fa7780d0f20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa768009910 tx=0x7fa768009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b51807b1a4fba78 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77559a700 1 -- 172.21.15.45:0/968219075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768011830 con 0x7fa77806ea90 2023-12-19T18:01:59.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77559a700 1 -- 172.21.15.45:0/968219075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa768011990 con 0x7fa77806ea90 2023-12-19T18:01:59.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.466+0000 7fa77559a700 1 -- 172.21.15.45:0/968219075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768011d40 con 0x7fa77806ea90 2023-12-19T18:01:59.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 -- 172.21.15.45:0/968219075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa77806ea90 msgr2=0x7fa7780d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 --2- 172.21.15.45:0/968219075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa77806ea90 0x7fa7780d0f20 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7fa768009910 tx=0x7fa768009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:59.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 -- 172.21.15.45:0/968219075 shutdown_connections 2023-12-19T18:01:59.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 --2- 172.21.15.45:0/968219075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa7780b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 --2- 172.21.15.45:0/968219075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa77806ea90 0x7fa7780d0f20 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 -- 172.21.15.45:0/968219075 >> 172.21.15.45:0/968219075 conn(0x7fa7780b46d0 msgr2=0x7fa7780b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 -- 172.21.15.45:0/968219075 shutdown_connections 2023-12-19T18:01:59.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.470+0000 7fa77759e700 1 -- 172.21.15.45:0/968219075 wait complete. 2023-12-19T18:01:59.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 Processor -- start 2023-12-19T18:01:59.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 -- start start 2023-12-19T18:01:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa77806ea90 0x7fa7781562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa778156a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 0x7fa7780c8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781596e0 con 0x7fa7780b88b0 2023-12-19T18:01:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7781599c0 con 0x7fa77806ea90 2023-12-19T18:01:59.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.474+0000 7fa77759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa778159ca0 con 0x7fa77806fe80 2023-12-19T18:01:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 0x7fa7780c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 0x7fa7780c8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42822/0 (socket says 172.21.15.45:42822) 2023-12-19T18:01:59.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 -- 172.21.15.45:0/1737515055 learned_addr learned my addr 172.21.15.45:0/1737515055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa775d9b700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa778156a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa77659c700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa77806ea90 0x7fa7781562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 -- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 msgr2=0x7fa778156a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa778156a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 -- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa77806ea90 msgr2=0x7fa7781562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa77806ea90 0x7fa7781562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 -- 172.21.15.45:0/1737515055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa768009570 con 0x7fa7780b88b0 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa775d9b700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa778156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:59.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa776d9d700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 0x7fa7780c8720 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fa77000efc0 tx=0x7fa77000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa766ffd700 1 -- 172.21.15.45:0/1737515055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77000cad0 con 0x7fa7780b88b0 2023-12-19T18:01:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa766ffd700 1 -- 172.21.15.45:0/1737515055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77000f040 con 0x7fa7780b88b0 2023-12-19T18:01:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa766ffd700 1 -- 172.21.15.45:0/1737515055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77000ce70 con 0x7fa7780b88b0 2023-12-19T18:01:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7780c9cb0 con 0x7fa7780b88b0 2023-12-19T18:01:59.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.478+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778156810 con 0x7fa7780b88b0 2023-12-19T18:01:59.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.482+0000 7fa766ffd700 1 -- 172.21.15.45:0/1737515055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa770014480 con 0x7fa7780b88b0 2023-12-19T18:01:59.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.486+0000 7fa766ffd700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa758065ad0 0x7fa758067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.486+0000 7fa766ffd700 1 -- 172.21.15.45:0/1737515055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fa770083f80 con 0x7fa7780b88b0 2023-12-19T18:01:59.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.486+0000 7fa77659c700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa758065ad0 0x7fa758067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.486+0000 7fa780040740 1 Processor -- start 2023-12-19T18:01:59.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.486+0000 7fa780040740 1 -- start start 2023-12-19T18:01:59.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.486+0000 7fa77659c700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa758065ad0 0x7fa758067f90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa768000c00 tx=0x7fa768008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x2805ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 0x28061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2830390 0x2806720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x27795b0 con 0x2830920 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2776d40 con 0x2830390 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2772630 con 0x28058c0 2023-12-19T18:01:59.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 0x28061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 0x28061e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42826/0 (socket says 172.21.15.45:42826) 2023-12-19T18:01:59.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 -- 172.21.15.45:0/1053654625 learned_addr learned my addr 172.21.15.45:0/1053654625 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa77659c700 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x2805ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa776d9d700 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2830390 0x2806720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 -- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 msgr2=0x2805ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x2805ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 -- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2830390 msgr2=0x2806720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2830390 0x2806720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 -- 172.21.15.45:0/1053654625 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x25e5960 con 0x2830920 2023-12-19T18:01:59.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa775d9b700 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 0x28061e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa76c001b60 tx=0x7fa76c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab8f5095edb0e4f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa757fff700 1 -- 172.21.15.45:0/1053654625 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0052e0 con 0x2830920 2023-12-19T18:01:59.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa757fff700 1 -- 172.21.15.45:0/1053654625 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c005440 con 0x2830920 2023-12-19T18:01:59.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa757fff700 1 -- 172.21.15.45:0/1053654625 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00f920 con 0x2830920 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 -- 172.21.15.45:0/1053654625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 msgr2=0x28061e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 0x28061e0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fa76c001b60 tx=0x7fa76c007ee0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 -- 172.21.15.45:0/1053654625 shutdown_connections 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2830390 0x2806720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830920 0x28061e0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 --2- 172.21.15.45:0/1053654625 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x2805ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.490+0000 7fa780040740 1 -- 172.21.15.45:0/1053654625 >> 172.21.15.45:0/1053654625 conn(0x259a4d0 msgr2=0x280bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 -- 172.21.15.45:0/1053654625 shutdown_connections 2023-12-19T18:01:59.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 -- 172.21.15.45:0/1053654625 wait complete. 2023-12-19T18:01:59.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 -- start start 2023-12-19T18:01:59.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 Processor -- start 2023-12-19T18:01:59.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x28333a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 0x2834680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2834bc0 0x285aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x272fc80 con 0x2830390 2023-12-19T18:01:59.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2735b00 con 0x2834bc0 2023-12-19T18:01:59.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x261eaa0 con 0x28058c0 2023-12-19T18:01:59.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.494+0000 7fa780040740 10 client.0 _ll_register_callbacks cb 0x276bf70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:01:59.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 0x2834680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 0x2834680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42834/0 (socket says 172.21.15.45:42834) 2023-12-19T18:01:59.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 -- 172.21.15.45:0/3542932679 learned_addr learned my addr 172.21.15.45:0/3542932679 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa77659c700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x28333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa776d9d700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2834bc0 0x285aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 -- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 msgr2=0x28333a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x28333a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 -- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2834bc0 msgr2=0x285aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2834bc0 0x285aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 -- 172.21.15.45:0/3542932679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7780d1820 con 0x2830390 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa775d9b700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 0x2834680 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x26fcd60 tx=0x7fa76c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3fd7bcdfdce2f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa7557fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa7557fa700 1 -- 172.21.15.45:0/3542932679 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c0052e0 con 0x2830390 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa7557fa700 1 -- 172.21.15.45:0/3542932679 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fa76c007ba0 con 0x2830390 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x276b6b0 con 0x2830390 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa7557fa700 1 -- 172.21.15.45:0/3542932679 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa76c00fb30 con 0x2830390 2023-12-19T18:01:59.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 10 client.8574 fetch_fsmap learned FSMap version 91 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x2738770 con 0x2830390 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa7557fa700 1 -- 172.21.15.45:0/3542932679 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x276b6b0 con 0x2830390 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa7557fa700 1 -- 172.21.15.45:0/3542932679 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa76c012070 con 0x2830390 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 10 client.8574 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 10 client.8574 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 20 client.8574 populate_metadata read hostname 'smithi045' 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x281eb10 0x2865b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 4 client.8574 mds_command: new command op to 57227 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.498+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x272da00 con 0x281eb10 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa77659c700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x281eb10 0x2865b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa77659c700 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x281eb10 0x2865b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37ad126928740b68 server_cookie=d9f9cdab5677a627 in_seq=0 out_seq=0 2023-12-19T18:01:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa7557fa700 10 client.8574 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:01:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa7557fa700 1 -- 172.21.15.45:0/3542932679 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x272da00 con 0x281eb10 2023-12-19T18:01:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa7557fa700 10 client.8574 handle_command_reply: tid=0 2023-12-19T18:01:59.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa780040740 1 client.8574 shutdown 2023-12-19T18:01:59.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 msgr2=0x2834680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.502+0000 7fa780040740 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 0x2834680 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x26fcd60 tx=0x7fa76c000ed0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 shutdown_connections 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x281eb10 0x2865b00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2834bc0 0x285aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2830390 0x2834680 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 --2- 172.21.15.45:0/3542932679 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x28058c0 0x28333a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa7557fa700 0 client.8574 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 >> 172.21.15.45:0/3542932679 conn(0x259a4d0 msgr2=0x28084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 shutdown_connections 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 1 -- 172.21.15.45:0/3542932679 wait complete. 2023-12-19T18:01:59.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.506+0000 7fa780040740 20 client.8574 trim_cache size 0 max 16384 2023-12-19T18:01:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 Processor -- start 2023-12-19T18:01:59.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 -- start start 2023-12-19T18:01:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x285a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x282e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x282eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x26abcc0 con 0x2834bc0 2023-12-19T18:01:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x273c6b0 con 0x28058c0 2023-12-19T18:01:59.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.526+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2771e40 con 0x2830390 2023-12-19T18:01:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa776d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x282eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x285a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa776d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x282eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42840/0 (socket says 172.21.15.45:42840) 2023-12-19T18:01:59.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa776d9d700 1 -- 172.21.15.45:0/2452147108 learned_addr learned my addr 172.21.15.45:0/2452147108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x285a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:34428/0 (socket says 172.21.15.45:34428) 2023-12-19T18:01:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa775d9b700 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x282e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 -- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 msgr2=0x282e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x282e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 -- 172.21.15.45:0/2452147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 msgr2=0x282eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x282eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 -- 172.21.15.45:0/2452147108 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x271e9a0 con 0x28058c0 2023-12-19T18:01:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa776d9d700 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x282eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:59.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa77659c700 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x285a5e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa768016000 tx=0x7fa768011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=351c72c4e8f4b5b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa764ff9700 1 -- 172.21.15.45:0/2452147108 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76801f070 con 0x28058c0 2023-12-19T18:01:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa764ff9700 1 -- 172.21.15.45:0/2452147108 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76802e040 con 0x28058c0 2023-12-19T18:01:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa764ff9700 1 -- 172.21.15.45:0/2452147108 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa768034430 con 0x28058c0 2023-12-19T18:01:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 -- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 msgr2=0x285a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x285a5e0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa768016000 tx=0x7fa768011000 comp rx=0 tx=0).stop 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 -- 172.21.15.45:0/2452147108 shutdown_connections 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x282eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x282e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 --2- 172.21.15.45:0/2452147108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x285a5e0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 -- 172.21.15.45:0/2452147108 >> 172.21.15.45:0/2452147108 conn(0x259a4d0 msgr2=0x2861880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 -- 172.21.15.45:0/2452147108 shutdown_connections 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.530+0000 7fa780040740 1 -- 172.21.15.45:0/2452147108 wait complete. 2023-12-19T18:01:59.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 -- start start 2023-12-19T18:01:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 Processor -- start 2023-12-19T18:01:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x28b3860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x28b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x2864d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2857160 con 0x2834bc0 2023-12-19T18:01:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x28b42e0 con 0x28058c0 2023-12-19T18:01:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x28358d0 con 0x2830390 2023-12-19T18:01:59.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa780040740 10 client.0 _ll_register_callbacks cb 0x26abe10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:01:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x2864d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa77659c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x28b3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x2864d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42848/0 (socket says 172.21.15.45:42848) 2023-12-19T18:01:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 -- 172.21.15.45:0/163911012 learned_addr learned my addr 172.21.15.45:0/163911012 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa775d9b700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x28b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 -- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 msgr2=0x28b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x28b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 -- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 msgr2=0x28b3860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x28b3860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 -- 172.21.15.45:0/163911012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa778156810 con 0x2834bc0 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa77659c700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x28b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa776d9d700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x2864d70 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c410 tx=0x7fa770059190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0e77bad7736ffd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.534+0000 7fa7557fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 1 -- 172.21.15.45:0/163911012 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa770054900 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa76c005440 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 1 -- 172.21.15.45:0/163911012 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fa770053670 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 1 -- 172.21.15.45:0/163911012 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa77005cd60 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 10 client.8580 fetch_fsmap learned FSMap version 91 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x7fa7780d20c0 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 1 -- 172.21.15.45:0/163911012 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa770075030 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 1 -- 172.21.15.45:0/163911012 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7fa770051000 con 0x2834bc0 2023-12-19T18:01:59.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 10 client.8580 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:01:59.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 10 client.8580 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:01:59.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 20 client.8580 populate_metadata read hostname 'smithi045' 2023-12-19T18:01:59.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2865ab0 0x28574b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 4 client.8580 mds_command: new command op to 57227 tid=0[{"prefix": "status"}] 2023-12-19T18:01:59.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "status"}) v1 -- 0x25f1460 con 0x2865ab0 2023-12-19T18:01:59.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa77659c700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2865ab0 0x28574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa77659c700 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2865ab0 0x28574b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd6bb839806cd55 server_cookie=b8d19459ab81bac9 in_seq=0 out_seq=0 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 10 client.8580 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 1 -- 172.21.15.45:0/163911012 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x25f1460 con 0x2865ab0 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa7557fa700 10 client.8580 handle_command_reply: tid=0 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.538+0000 7fa780040740 1 client.8580 shutdown 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 msgr2=0x2864d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x2864d70 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fa77000c410 tx=0x7fa770059190 comp rx=0 tx=0).stop 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 shutdown_connections 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2865ab0 0x28574b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2834bc0 0x2864d70 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2830390 0x28b3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 --2- 172.21.15.45:0/163911012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x28058c0 0x28b3860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa7557fa700 0 client.8580 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 >> 172.21.15.45:0/163911012 conn(0x259a4d0 msgr2=0x280b640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 shutdown_connections 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 1 -- 172.21.15.45:0/163911012 wait complete. 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa780040740 20 client.8580 trim_cache size 0 max 16384 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T18:01:59.547 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 57227, 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.6465259080000001, 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 91, 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 116, 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 116, 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 4.6890734549999999 2023-12-19T18:01:59.548 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa758065ad0 msgr2=0x7fa758067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa758065ad0 0x7fa758067f90 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa768000c00 tx=0x7fa768008030 comp rx=0 tx=0).stop 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 msgr2=0x7fa7780c8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 0x7fa7780c8720 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7fa77000efc0 tx=0x7fa77000c0c0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 shutdown_connections 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa758065ad0 0x7fa758067f90 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa7780b88b0 0x7fa7780c8720 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa77806fe80 0x7fa778156a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 --2- 172.21.15.45:0/1737515055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa77806ea90 0x7fa7781562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 >> 172.21.15.45:0/1737515055 conn(0x7fa7780b46d0 msgr2=0x7fa7780b3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 shutdown_connections 2023-12-19T18:01:59.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.542+0000 7fa77759e700 1 -- 172.21.15.45:0/1737515055 wait complete. 2023-12-19T18:01:59.572 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:01:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.758+0000 7fcbce784700 1 Processor -- start 2023-12-19T18:01:59.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.758+0000 7fcbce784700 1 -- start start 2023-12-19T18:01:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbce784700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc815ade0 0x7fcbc80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbce784700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbc80b6540 0x7fcbc80b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbce784700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc80b69a0 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbce784700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc815b1c0 con 0x7fcbc80b6540 2023-12-19T18:01:59.765 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbce784700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80b13a0 con 0x7fcbc815ade0 2023-12-19T18:01:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbc80b6540 0x7fcbc80b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbcd782700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc815ade0 0x7fcbc80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcbc80b6540 0x7fcbc80b3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42862/0 (socket says 172.21.15.45:42862) 2023-12-19T18:01:59.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 -- 172.21.15.45:0/2302055070 learned_addr learned my addr 172.21.15.45:0/2302055070 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbbffff700 1 -- 172.21.15.45:0/2302055070 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 850166256 0 0) 0x7fcbc0001110 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 -- 172.21.15.45:0/2302055070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc815ade0 msgr2=0x7fcbc80b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:01:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 --2- 172.21.15.45:0/2302055070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc815ade0 0x7fcbc80b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 -- 172.21.15.45:0/2302055070 >> v1:172.21.15.73:6789/0 conn(0x7fcbc80b3fc0 legacy=0x7fcbc80ce9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 -- 172.21.15.45:0/2302055070 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc80cfc90 con 0x7fcbc80b6540 2023-12-19T18:01:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbccf81700 1 --2- 172.21.15.45:0/2302055070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b6540 0x7fcbc80b3a80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009910 tx=0x7fcbb8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b320c87991e2a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbbffff700 1 -- 172.21.15.45:0/2302055070 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8011830 con 0x7fcbc80b6540 2023-12-19T18:01:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbbffff700 1 -- 172.21.15.45:0/2302055070 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb8011990 con 0x7fcbc80b6540 2023-12-19T18:01:59.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.762+0000 7fcbbffff700 1 -- 172.21.15.45:0/2302055070 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb8011d40 con 0x7fcbc80b6540 2023-12-19T18:01:59.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 -- 172.21.15.45:0/2302055070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b6540 msgr2=0x7fcbc80b3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 --2- 172.21.15.45:0/2302055070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b6540 0x7fcbc80b3a80 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fcbb8009910 tx=0x7fcbb8009c20 comp rx=0 tx=0).stop 2023-12-19T18:01:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 -- 172.21.15.45:0/2302055070 shutdown_connections 2023-12-19T18:01:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 --2- 172.21.15.45:0/2302055070 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b6540 0x7fcbc80b3a80 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 --2- 172.21.15.45:0/2302055070 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc815ade0 0x7fcbc80b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 -- 172.21.15.45:0/2302055070 >> 172.21.15.45:0/2302055070 conn(0x7fcbc80b2540 msgr2=0x7fcbc80b2950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:01:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 -- 172.21.15.45:0/2302055070 shutdown_connections 2023-12-19T18:01:59.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 -- 172.21.15.45:0/2302055070 wait complete. 2023-12-19T18:01:59.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.766+0000 7fcbce784700 1 Processor -- start 2023-12-19T18:01:59.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 -- start start 2023-12-19T18:01:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 0x7fcbc8157920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc80b6540 0x7fcbc80b5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbc815ade0 0x7fcbc8151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc80c8a50 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8156290 con 0x7fcbc815ade0 2023-12-19T18:01:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc8156570 con 0x7fcbc80b6540 2023-12-19T18:01:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 0x7fcbc8157920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 0x7fcbc8157920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42866/0 (socket says 172.21.15.45:42866) 2023-12-19T18:01:59.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 -- 172.21.15.45:0/739653160 learned_addr learned my addr 172.21.15.45:0/739653160 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbccf81700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc80b6540 0x7fcbc80b5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcdf83700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbc815ade0 0x7fcbc8151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 -- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc80b6540 msgr2=0x7fcbc80b5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc80b6540 0x7fcbc80b5380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 -- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbc815ade0 msgr2=0x7fcbc8151ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbc815ade0 0x7fcbc8151ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:01:59.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 -- 172.21.15.45:0/739653160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8009570 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbcd782700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 0x7fcbc8157920 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400efc0 tx=0x7fcbc400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4009b80 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbc400f040 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc8156850 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.770+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4014480 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.774+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc8157e60 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.774+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc80c8bc0 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.774+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcbc40145e0 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.778+0000 7fcbbdffb700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcbac065ad0 0x7fcbac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:01:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.778+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fcbc4083ea0 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.778+0000 7fcbccf81700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcbac065ad0 0x7fcbac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:01:59.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.778+0000 7fcbccf81700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcbac065ad0 0x7fcbac067f90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80b4830 tx=0x7fcbb8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:01:59.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.782+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcbc80c8bc0 con 0x7fcbc80b3fc0 2023-12-19T18:01:59.901 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:01:59.899+0000 7f4a4497a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:01:59.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.994+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbc80c8b90 con 0x7fcbc80b3fc0 2023-12-19T18:02:00.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbbdffb700 1 -- 172.21.15.45:0/739653160 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fcbc4051470 con 0x7fcbc80b3fc0 2023-12-19T18:02:00.001 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:00.001 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:57.899642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcbac065ad0 msgr2=0x7fcbac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcbac065ad0 0x7fcbac067f90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fcbc80b4830 tx=0x7fcbb8008030 comp rx=0 tx=0).stop 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 msgr2=0x7fcbc8157920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 0x7fcbc8157920 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fcbc400efc0 tx=0x7fcbc400c3a0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 shutdown_connections 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcbac065ad0 0x7fcbac067f90 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcbc815ade0 0x7fcbc8151ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcbc80b6540 0x7fcbc80b5380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 --2- 172.21.15.45:0/739653160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcbc80b3fc0 0x7fcbc8157920 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 >> 172.21.15.45:0/739653160 conn(0x7fcbc80b2540 msgr2=0x7fcbc80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:00.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 shutdown_connections 2023-12-19T18:02:00.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:01:59.998+0000 7fcbce784700 1 -- 172.21.15.45:0/739653160 wait complete. 2023-12-19T18:02:00.006 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-12-19T18:02:00.027 INFO:tasks.cephfs.test_data_scan:{ "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 5, "epoch": 91, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 5, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2023-12-19T18:01:48.985200+0000", "damaged": [], "data_pools": [ 15, 16 ], "enabled": true, "epoch": 91, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "cephfs", "in": [ 0 ], "info": { "gid_57227": { "addr": "172.21.15.73:6835/280993181", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6834", "nonce": 280993181, "type": "v2" }, { "addr": "172.21.15.73:6835", "nonce": 280993181, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 57227, "incarnation": 88, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 4 } }, "last_failure": 0, "last_failure_osd_epoch": 116, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 14, "modified": "2023-12-19T18:01:57.899642+0000", "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 60, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 57227 } } } ], "standbys": [ { "addr": "172.21.15.73:6833/2746622106", "addrs": { "addrvec": [ { "addr": "172.21.15.73:6832", "nonce": 2746622106, "type": "v2" }, { "addr": "172.21.15.73:6833", "nonce": 2746622106, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8230, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.45:6836/2541743650", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6834", "nonce": 2541743650, "type": "v2" }, { "addr": "172.21.15.45:6836", "nonce": 2541743650, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 8529, "incarnation": 0, "join_fscid": -1, "name": "a", "rank": -1, "state": "up:standby", "state_seq": 1 }, { "addr": "172.21.15.45:6837/1935321736", "addrs": { "addrvec": [ { "addr": "172.21.15.45:6835", "nonce": 1935321736, "type": "v2" }, { "addr": "172.21.15.45:6837", "nonce": 1935321736, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 87, "export_targets": [], "features": 4540138322906710015, "flags": 0, "gid": 57224, "incarnation": 0, "join_fscid": -1, "name": "c", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2023-12-19T18:02:00.027 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:02:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.198+0000 7f28672b5700 1 Processor -- start 2023-12-19T18:02:00.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.198+0000 7f28672b5700 1 -- start start 2023-12-19T18:02:00.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f28672b5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28600b8ab0 0x7f28600cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:00.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f28672b5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f28600d2840 0x7f28600ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:00.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f28672b5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28600d17a0 con 0x7f286015d030 2023-12-19T18:02:00.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f28672b5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28600d15b0 con 0x7f28600b8ab0 2023-12-19T18:02:00.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f28672b5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28600b6ef0 con 0x7f28600d2840 2023-12-19T18:02:00.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2864850700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f28600b8ab0 0x7f28600cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:00.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2865051700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f286015d030 0x7f28600d0ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52440/0 (socket says 172.21.15.45:52440) 2023-12-19T18:02:00.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2865051700 1 -- 172.21.15.45:0/1503905994 learned_addr learned my addr 172.21.15.45:0/1503905994 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:00.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2865852700 1 --2- 172.21.15.45:0/1503905994 >> v2:172.21.15.73:3300/0 conn(0x7f28600d2840 0x7f28600ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:00.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2864850700 1 -- 172.21.15.45:0/1503905994 >> v2:172.21.15.73:3300/0 conn(0x7f28600d2840 msgr2=0x7f28600ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:00.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2864850700 1 --2- 172.21.15.45:0/1503905994 >> v2:172.21.15.73:3300/0 conn(0x7f28600d2840 0x7f28600ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2864850700 1 -- 172.21.15.45:0/1503905994 >> v1:172.21.15.45:6789/0 conn(0x7f286015d030 legacy=0x7f28600d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2864850700 1 -- 172.21.15.45:0/1503905994 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28600d1a80 con 0x7f28600b8ab0 2023-12-19T18:02:00.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.202+0000 7f2865852700 1 --2- 172.21.15.45:0/1503905994 >> v2:172.21.15.73:3300/0 conn(0x7f28600d2840 0x7f28600ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:00.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f2864850700 1 --2- 172.21.15.45:0/1503905994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600b8ab0 0x7f28600cdb80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f28600cf2a0 tx=0x7f2850009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb43e7d3e1454c8f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f2857fff700 1 -- 172.21.15.45:0/1503905994 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850011830 con 0x7f28600b8ab0 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f2857fff700 1 -- 172.21.15.45:0/1503905994 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2850011990 con 0x7f28600b8ab0 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f2857fff700 1 -- 172.21.15.45:0/1503905994 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850011d40 con 0x7f28600b8ab0 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 -- 172.21.15.45:0/1503905994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600b8ab0 msgr2=0x7f28600cdb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 --2- 172.21.15.45:0/1503905994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600b8ab0 0x7f28600cdb80 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f28600cf2a0 tx=0x7f2850009b30 comp rx=0 tx=0).stop 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 -- 172.21.15.45:0/1503905994 shutdown_connections 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 --2- 172.21.15.45:0/1503905994 >> v2:172.21.15.73:3300/0 conn(0x7f28600d2840 0x7f28600ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 --2- 172.21.15.45:0/1503905994 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600b8ab0 0x7f28600cdb80 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 -- 172.21.15.45:0/1503905994 >> 172.21.15.45:0/1503905994 conn(0x7f28600cf830 msgr2=0x7f28600cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 -- 172.21.15.45:0/1503905994 shutdown_connections 2023-12-19T18:02:00.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.206+0000 7f28672b5700 1 -- 172.21.15.45:0/1503905994 wait complete. 2023-12-19T18:02:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 Processor -- start 2023-12-19T18:02:00.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 -- start start 2023-12-19T18:02:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28600b8ab0 0x7f286015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 0x7f286015f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286015d030 0x7f2860151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:00.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2860156f50 con 0x7f28600d2840 2023-12-19T18:02:00.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2860157230 con 0x7f286015d030 2023-12-19T18:02:00.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28600c7bd0 con 0x7f28600b8ab0 2023-12-19T18:02:00.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 0x7f286015f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:00.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 0x7f286015f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42890/0 (socket says 172.21.15.45:42890) 2023-12-19T18:02:00.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 -- 172.21.15.45:0/1221783328 learned_addr learned my addr 172.21.15.45:0/1221783328 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:00.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2865051700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28600b8ab0 0x7f286015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:00.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2865852700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286015d030 0x7f2860151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:00.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 -- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28600b8ab0 msgr2=0x7f286015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28600b8ab0 0x7f286015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 -- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286015d030 msgr2=0x7f2860151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286015d030 0x7f2860151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 -- 172.21.15.45:0/1221783328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28500094b0 con 0x7f28600d2840 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2865852700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286015d030 0x7f2860151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2865051700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28600b8ab0 0x7f286015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2864850700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 0x7f286015f4e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f28500090b0 tx=0x7f2850004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850004570 con 0x7f28600d2840 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285001f070 con 0x7f28600d2840 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2850003900 con 0x7f28600d2840 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.210+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28600c7eb0 con 0x7f28600d2840 2023-12-19T18:02:00.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.214+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2860159390 con 0x7f28600d2840 2023-12-19T18:02:00.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.214+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2860156ca0 con 0x7f28600d2840 2023-12-19T18:02:00.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.214+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2850021030 con 0x7f28600d2840 2023-12-19T18:02:00.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.218+0000 7f2855ffb700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2844065ad0 0x7f2844067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:00.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.218+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f2850084a10 con 0x7f28600d2840 2023-12-19T18:02:00.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.218+0000 7f2865051700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2844065ad0 0x7f2844067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:00.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.218+0000 7f2865051700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2844065ad0 0x7f2844067f90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f285c005930 tx=0x7f285c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:00.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.226+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2850052080 con 0x7f28600d2840 2023-12-19T18:02:00.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f286004ed30 con 0x7f28600d2840 2023-12-19T18:02:00.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f2855ffb700 1 -- 172.21.15.45:0/1221783328 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v91) v1 ==== 53+0+91 (secure 0 0 0) 0x7f2850015070 con 0x7f28600d2840 2023-12-19T18:02:00.446 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_extra ] 2023-12-19T18:02:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2844065ad0 msgr2=0x7f2844067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2844065ad0 0x7f2844067f90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f285c005930 tx=0x7f285c009040 comp rx=0 tx=0).stop 2023-12-19T18:02:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 msgr2=0x7f286015f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:00.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 0x7f286015f4e0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f28500090b0 tx=0x7f2850004770 comp rx=0 tx=0).stop 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 shutdown_connections 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2844065ad0 0x7f2844067f90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f286015d030 0x7f2860151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f28600d2840 0x7f286015f4e0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.442+0000 7f28672b5700 1 --2- 172.21.15.45:0/1221783328 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f28600b8ab0 0x7f286015efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.446+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 >> 172.21.15.45:0/1221783328 conn(0x7f28600cf830 msgr2=0x7f28600b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:00.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.446+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 shutdown_connections 2023-12-19T18:02:00.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:00.446+0000 7f28672b5700 1 -- 172.21.15.45:0/1221783328 wait complete. 2023-12-19T18:02:00.470 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:02:00.470 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:02:00.470 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T18:02:00.471 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:02:00.471 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:00.471 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:02:00.471 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:02:00.471 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:02:00.471 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:02:00.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:00.471 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:02:00.492 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41745sec preferred_lft 41745sec 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T18:02:00.493 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:02:00.494 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:02:00.495 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T18:02:00.495 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:02:00.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:00.495 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:02:00.574 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:02:00.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:00.577 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T18:02:00.647 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T18:02:00.647 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:02:00.647 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T18:02:00.648 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:02:00.648 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T18:02:00.648 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:02:00.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:00.649 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T18:02:00.649 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T18:02:00.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T18:02:00.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T18:02:00.649 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T18:02:00.649 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T18:02:00.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:00.786 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:02:00.803 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:02:00.803 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:02:00.804 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:02:00.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:00.804 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T18:02:00.884 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T18:02:00.885 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:02:00.885 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:00.947 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:02:00.948 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:02:00.948 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:01.006 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:02:01.085 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:02:01.085 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:02:01.166 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:02:01.168 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:02:01.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:01.169 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:02:01.232 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T18:02:01.232 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T18:02:01.283 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:02:01.320 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:02:01.321 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:02:01.395 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:02:01.397 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:02:01.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:01.397 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:02:01.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T18:02:01.426+0000 7f3ce9131640 -1 init, newargv = 0x55f788374fe0 newargc=15 2023-12-19T18:02:01.429 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[57013]: starting ceph client 2023-12-19T18:02:01.442 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[57013]: starting fuse 2023-12-19T18:02:01.867 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:02:01.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:02:02.542 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:02:02.581 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:02:02.581 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:02:02.660 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:02:02.662 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:02:02.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:02.663 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:02:02.722 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:02:02.722 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:02:02.723 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T18:02:02.724 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:02:02.725 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T18:02:02.725 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:02.888 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.57013.asok 2023-12-19T18:02:03.073 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.57013.asok 2023-12-19T18:02:03.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:03.074 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.57013.asok status 2023-12-19T18:02:03.275 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "57013", 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 8604, 2023-12-19T18:02:03.276 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 8604 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 46993605 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:02:03.277 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 46993605 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.8604 192.168.0.1:0/46993605", 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/46993605", 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 91, 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 116, 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T18:02:03.278 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:02:03.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:03.291 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T18:02:03.291 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:03.311 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T18:02:03.311 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:03.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:03.312 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:03.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub start / repair,recursive 2023-12-19T18:02:03.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.650+0000 7f9760d70700 1 Processor -- start 2023-12-19T18:02:03.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.650+0000 7f9760d70700 1 -- start start 2023-12-19T18:02:03.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f9760d70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c159d20 0x7f975c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f9760d70700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0ccba0 con 0x7f975c0c9740 2023-12-19T18:02:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f9760d70700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f975c0700a0 con 0x7f975c0c4fc0 2023-12-19T18:02:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f9760d70700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15a100 con 0x7f975c159d20 2023-12-19T18:02:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975affd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f975c0c9740 0x7f975c0c48b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52444/0 (socket says 172.21.15.45:52444) 2023-12-19T18:02:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975affd700 1 -- 172.21.15.45:0/1571183791 learned_addr learned my addr 172.21.15.45:0/1571183791 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:03.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975b7fe700 1 --2- 172.21.15.45:0/1571183791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c159d20 0x7f975c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3653726951 0 0) 0x7f975c0ccba0 con 0x7f975c0c9740 2023-12-19T18:02:03.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97440057e0 con 0x7f975c0c9740 2023-12-19T18:02:03.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1748819803 0 0) 0x7f975c0700a0 con 0x7f975c0c4fc0 2023-12-19T18:02:03.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.654+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f975c0ccba0 con 0x7f975c0c4fc0 2023-12-19T18:02:03.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975b7fe700 1 -- 172.21.15.45:0/1571183791 >> v1:172.21.15.73:6789/0 conn(0x7f975c0c4fc0 legacy=0x7f975c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975b7fe700 1 -- 172.21.15.45:0/1571183791 >> v1:172.21.15.45:6789/0 conn(0x7f975c0c9740 legacy=0x7f975c0c48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975b7fe700 1 -- 172.21.15.45:0/1571183791 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c06f800 con 0x7f975c159d20 2023-12-19T18:02:03.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975b7fe700 1 --2- 172.21.15.45:0/1571183791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c159d20 0x7f975c06eeb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f974c009880 tx=0x7f974c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f14e3bcac95fa5b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c011830 con 0x7f975c159d20 2023-12-19T18:02:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c011990 con 0x7f975c159d20 2023-12-19T18:02:03.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f975a7fc700 1 -- 172.21.15.45:0/1571183791 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c011d20 con 0x7f975c159d20 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 -- 172.21.15.45:0/1571183791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c159d20 msgr2=0x7f975c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 --2- 172.21.15.45:0/1571183791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c159d20 0x7f975c06eeb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f974c009880 tx=0x7f974c009b90 comp rx=0 tx=0).stop 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 -- 172.21.15.45:0/1571183791 shutdown_connections 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 --2- 172.21.15.45:0/1571183791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c159d20 0x7f975c06eeb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 -- 172.21.15.45:0/1571183791 >> 172.21.15.45:0/1571183791 conn(0x7f975c0cecd0 msgr2=0x7f975c0cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 -- 172.21.15.45:0/1571183791 shutdown_connections 2023-12-19T18:02:03.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.658+0000 7f9760d70700 1 -- 172.21.15.45:0/1571183791 wait complete. 2023-12-19T18:02:03.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.662+0000 7f9760d70700 1 Processor -- start 2023-12-19T18:02:03.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.662+0000 7f9760d70700 1 -- start start 2023-12-19T18:02:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c0c4fc0 0x7f975c15ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c0c9740 0x7f975c151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 0x7f975c155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15b5a0 con 0x7f975c159d20 2023-12-19T18:02:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15b880 con 0x7f975c0c4fc0 2023-12-19T18:02:03.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f975c15bb60 con 0x7f975c0c9740 2023-12-19T18:02:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 0x7f975c155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975affd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c0c9740 0x7f975c151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 0x7f975c155d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42892/0 (socket says 172.21.15.45:42892) 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c0c4fc0 0x7f975c15ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 -- 172.21.15.45:0/102422606 learned_addr learned my addr 172.21.15.45:0/102422606 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 -- 172.21.15.45:0/102422606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c0c9740 msgr2=0x7f975c151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c0c9740 0x7f975c151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 -- 172.21.15.45:0/102422606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c0c4fc0 msgr2=0x7f975c15ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c0c4fc0 0x7f975c15ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 -- 172.21.15.45:0/102422606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c0094b0 con 0x7f975c159d20 2023-12-19T18:02:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f975bfff700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 0x7f975c155d00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f975400cc50 tx=0x7f975400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9743fff700 1 -- 172.21.15.45:0/102422606 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754003c20 con 0x7f975c159d20 2023-12-19T18:02:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9743fff700 1 -- 172.21.15.45:0/102422606 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754003d80 con 0x7f975c159d20 2023-12-19T18:02:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c15be40 con 0x7f975c159d20 2023-12-19T18:02:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9743fff700 1 -- 172.21.15.45:0/102422606 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975400aab0 con 0x7f975c159d20 2023-12-19T18:02:03.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.666+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c15b190 con 0x7f975c159d20 2023-12-19T18:02:03.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.670+0000 7f9743fff700 1 -- 172.21.15.45:0/102422606 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f975400ac10 con 0x7f975c159d20 2023-12-19T18:02:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.674+0000 7f9743fff700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9748065b00 0x7f9748067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.674+0000 7f9743fff700 1 -- 172.21.15.45:0/102422606 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f9754083500 con 0x7f975c159d20 2023-12-19T18:02:03.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.674+0000 7f975b7fe700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9748065b00 0x7f9748067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f975b7fe700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9748065b00 0x7f9748067fc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f974c0090b0 tx=0x7f974c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 Processor -- start 2023-12-19T18:02:03.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 -- start start 2023-12-19T18:02:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1b2efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b2f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8ecf0 con 0x1b45e40 2023-12-19T18:02:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a8c480 con 0x1b2f500 2023-12-19T18:02:03.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a87d70 con 0x1b2e6a0 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f975affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1b2efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f975affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1b2efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42898/0 (socket says 172.21.15.45:42898) 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f975affd700 1 -- 172.21.15.45:0/1515656630 learned_addr learned my addr 172.21.15.45:0/1515656630 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f975bfff700 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b2f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.678+0000 7f975b7fe700 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f975affd700 1 -- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 msgr2=0x1b2ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f975affd700 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f975affd700 1 -- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 msgr2=0x1b2f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f975affd700 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b2f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f975affd700 1 -- 172.21.15.45:0/1515656630 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x197aee0 con 0x1b45e40 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f975affd700 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1b2efc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f975c0c9b40 tx=0x7f9750007320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5652ae0242f2f35e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f97417fa700 1 -- 172.21.15.45:0/1515656630 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750001390 con 0x1b45e40 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f97417fa700 1 -- 172.21.15.45:0/1515656630 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97500014f0 con 0x1b45e40 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f97417fa700 1 -- 172.21.15.45:0/1515656630 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9750001880 con 0x1b45e40 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 -- 172.21.15.45:0/1515656630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 msgr2=0x1b2efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1b2efc0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f975c0c9b40 tx=0x7f9750007320 comp rx=0 tx=0).stop 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 -- 172.21.15.45:0/1515656630 shutdown_connections 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b2f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1b2efc0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 --2- 172.21.15.45:0/1515656630 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 -- 172.21.15.45:0/1515656630 >> 172.21.15.45:0/1515656630 conn(0x18af780 msgr2=0x1b48e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 -- 172.21.15.45:0/1515656630 shutdown_connections 2023-12-19T18:02:03.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 -- 172.21.15.45:0/1515656630 wait complete. 2023-12-19T18:02:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.682+0000 7f9765265740 1 -- start start 2023-12-19T18:02:03.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 Processor -- start 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b2d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b45e40 0x1b25870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4ae70 con 0x1b2e6a0 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a4ab10 con 0x1b2f500 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a1d360 con 0x1b45e40 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f9765265740 10 client.0 _ll_register_callbacks cb 0x1a816b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b2d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b2d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42912/0 (socket says 172.21.15.45:42912) 2023-12-19T18:02:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 -- 172.21.15.45:0/2011182273 learned_addr learned my addr 172.21.15.45:0/2011182273 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975affd700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975bfff700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b45e40 0x1b25870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 -- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b45e40 msgr2=0x1b25870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b45e40 0x1b25870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 -- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 msgr2=0x1b488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 -- 172.21.15.45:0/2011182273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97440057e0 con 0x1b2e6a0 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f975b7fe700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b2d9a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f974c013040 tx=0x7f974c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ae9ab4e9a5684a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.686+0000 7f973a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f973a7fc700 1 -- 172.21.15.45:0/2011182273 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c02f5f0 con 0x1b2e6a0 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f973a7fc700 1 -- 172.21.15.45:0/2011182273 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f974c01f070 con 0x1b2e6a0 2023-12-19T18:02:03.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x1a51810 con 0x1b2e6a0 2023-12-19T18:02:03.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f973a7fc700 1 -- 172.21.15.45:0/2011182273 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f974c024e90 con 0x1b2e6a0 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 10 client.8616 fetch_fsmap learned FSMap version 91 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x1a4db50 con 0x1b2e6a0 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f973a7fc700 1 -- 172.21.15.45:0/2011182273 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x1a51810 con 0x1b2e6a0 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f973a7fc700 1 -- 172.21.15.45:0/2011182273 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f974c02e070 con 0x1b2e6a0 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 10 client.8616 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 10 client.8616 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 20 client.8616 populate_metadata read hostname 'smithi045' 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b72700 0x1b231d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 4 client.8616 mds_command: new command op to 57227 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:02:03.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1a44980 con 0x1b72700 2023-12-19T18:02:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f975affd700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b72700 0x1b231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f975affd700 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b72700 0x1b231d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdc97dfb77b8ed10 server_cookie=cac18eb627fdc313 in_seq=0 out_seq=0 2023-12-19T18:02:03.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.690+0000 7f973a7fc700 10 client.8616 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:03.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f973a7fc700 1 -- 172.21.15.45:0/2011182273 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1a44980 con 0x1b72700 2023-12-19T18:02:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f973a7fc700 10 client.8616 handle_command_reply: tid=0 2023-12-19T18:02:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 client.8616 shutdown 2023-12-19T18:02:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 msgr2=0x1b2d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b2d9a0 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f974c013040 tx=0x7f974c0047e0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 shutdown_connections 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b72700 0x1b231d0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b45e40 0x1b25870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1b488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f973a7fc700 0 client.8616 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 --2- 172.21.15.45:0/2011182273 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b2d9a0 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 >> 172.21.15.45:0/2011182273 conn(0x18af780 msgr2=0x1b62fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 shutdown_connections 2023-12-19T18:02:03.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 1 -- 172.21.15.45:0/2011182273 wait complete. 2023-12-19T18:02:03.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.694+0000 7f9765265740 20 client.8616 trim_cache size 0 max 16384 2023-12-19T18:02:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 Processor -- start 2023-12-19T18:02:03.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 -- start start 2023-12-19T18:02:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b7c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2f500 0x1b23f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b45e40 0x1b244d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a836e0 con 0x1b2e6a0 2023-12-19T18:02:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1b21fb0 con 0x1b45e40 2023-12-19T18:02:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a41f00 con 0x1b2f500 2023-12-19T18:02:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b7c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b7c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42924/0 (socket says 172.21.15.45:42924) 2023-12-19T18:02:03.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 -- 172.21.15.45:0/2252762841 learned_addr learned my addr 172.21.15.45:0/2252762841 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975bfff700 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b45e40 0x1b244d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975affd700 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2f500 0x1b23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 -- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2f500 msgr2=0x1b23f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2f500 0x1b23f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 -- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b45e40 msgr2=0x1b244d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b45e40 0x1b244d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 -- 172.21.15.45:0/2252762841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x1a33d80 con 0x1b2e6a0 2023-12-19T18:02:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.718+0000 7f975b7fe700 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b7c140 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f974c011ba0 tx=0x7f974c027070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed4eced36ca1c931 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9741ffb700 1 -- 172.21.15.45:0/2252762841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c02f5f0 con 0x1b2e6a0 2023-12-19T18:02:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9741ffb700 1 -- 172.21.15.45:0/2252762841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c024e90 con 0x1b2e6a0 2023-12-19T18:02:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9741ffb700 1 -- 172.21.15.45:0/2252762841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c02fbd0 con 0x1b2e6a0 2023-12-19T18:02:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- 172.21.15.45:0/2252762841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 msgr2=0x1b7c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b7c140 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f974c011ba0 tx=0x7f974c027070 comp rx=0 tx=0).stop 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- 172.21.15.45:0/2252762841 shutdown_connections 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b45e40 0x1b244d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2f500 0x1b23f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- 172.21.15.45:0/2252762841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b2e6a0 0x1b7c140 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- 172.21.15.45:0/2252762841 >> 172.21.15.45:0/2252762841 conn(0x18af780 msgr2=0x1b61050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- 172.21.15.45:0/2252762841 shutdown_connections 2023-12-19T18:02:03.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- 172.21.15.45:0/2252762841 wait complete. 2023-12-19T18:02:03.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- start start 2023-12-19T18:02:03.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 Processor -- start 2023-12-19T18:02:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1bcc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1bccf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a85580 con 0x1b45e40 2023-12-19T18:02:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1a85170 con 0x1b2f500 2023-12-19T18:02:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.722+0000 7f9765265740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1a8a8d0 con 0x1b2e6a0 2023-12-19T18:02:03.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 10 client.0 _ll_register_callbacks cb 0x1a4ef00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1bccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1bccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42930/0 (socket says 172.21.15.45:42930) 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 -- 172.21.15.45:0/1651783173 learned_addr learned my addr 172.21.15.45:0/1651783173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975b7fe700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975affd700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1bcc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 -- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 msgr2=0x1b2c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 -- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 msgr2=0x1bcc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1bcc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 -- 172.21.15.45:0/1651783173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1a4db50 con 0x1b45e40 2023-12-19T18:02:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975affd700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1bcc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975bfff700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1bccf10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f9754015000 tx=0x7f97540014d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ab0b866a58d8e9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f973a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f973a7fc700 1 -- 172.21.15.45:0/1651783173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754019500 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f973a7fc700 1 -- 172.21.15.45:0/1651783173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f97540830b0 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97500014f0 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f973a7fc700 1 -- 172.21.15.45:0/1651783173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9754083270 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 10 client.8622 fetch_fsmap learned FSMap version 91 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x18fac10 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f973a7fc700 1 -- 172.21.15.45:0/1651783173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97500014f0 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f973a7fc700 1 -- 172.21.15.45:0/1651783173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f97540721f0 con 0x1b45e40 2023-12-19T18:02:03.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 10 client.8622 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 10 client.8622 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 20 client.8622 populate_metadata read hostname 'smithi045' 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b23ae0 0x1b23ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 4 client.8622 mds_command: new command op to 57227 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x1906710 con 0x1b23ae0 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.726+0000 7f975b7fe700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b23ae0 0x1b23ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f975b7fe700 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b23ae0 0x1b23ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ac256140e3a7110 server_cookie=6ad8be134bec6055 in_seq=0 out_seq=0 2023-12-19T18:02:03.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f973a7fc700 10 client.8622 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f973a7fc700 1 -- 172.21.15.45:0/1651783173 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x1906710 con 0x1b23ae0 2023-12-19T18:02:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f973a7fc700 10 client.8622 handle_command_reply: tid=0 2023-12-19T18:02:03.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 client.8622 shutdown 2023-12-19T18:02:03.735 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.730+0000 7f4a41173700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x4 2023-12-19T18:02:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 msgr2=0x1bccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1bccf10 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f9754015000 tx=0x7f97540014d0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 shutdown_connections 2023-12-19T18:02:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b23ae0 0x1b23ef0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1b45e40 0x1bccf10 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1b2f500 0x1bcc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 --2- 172.21.15.45:0/1651783173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1b2e6a0 0x1b2c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f973a7fc700 0 client.8622 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 >> 172.21.15.45:0/1651783173 conn(0x18af780 msgr2=0x1b30960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 shutdown_connections 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 1 -- 172.21.15.45:0/1651783173 wait complete. 2023-12-19T18:02:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.730+0000 7f9765265740 20 client.8622 trim_cache size 0 max 16384 2023-12-19T18:02:03.738 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:02:03.738 INFO:teuthology.orchestra.run.smithi045.stdout: "return_code": 0, 2023-12-19T18:02:03.738 INFO:teuthology.orchestra.run.smithi045.stdout: "scrub_tag": "beeab2b4-eb88-4dbb-b423-206322d7b813", 2023-12-19T18:02:03.738 INFO:teuthology.orchestra.run.smithi045.stdout: "mode": "asynchronous" 2023-12-19T18:02:03.738 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:02:03.739 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.734+0000 7f4a41173700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T18:02:03.739 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.734+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x4 [...2,head] /lost+found/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559bc7b6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x4:[<0x1/lost+found v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:02:03.739 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.734+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /stripey/ auth v1 pv6 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559bc7b6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000000:[<0x1/stripey v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:02:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9748065b00 msgr2=0x7f9748067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9748065b00 0x7f9748067fc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f974c0090b0 tx=0x7f974c01c040 comp rx=0 tx=0).stop 2023-12-19T18:02:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 msgr2=0x7f975c155d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 0x7f975c155d00 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f975400cc50 tx=0x7f975400cf60 comp rx=0 tx=0).stop 2023-12-19T18:02:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 shutdown_connections 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9748065b00 0x7f9748067fc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f975c159d20 0x7f975c155d00 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f975c0c9740 0x7f975c151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 --2- 172.21.15.45:0/102422606 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f975c0c4fc0 0x7f975c15ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 >> 172.21.15.45:0/102422606 conn(0x7f975c0cecd0 msgr2=0x7f975c158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 shutdown_connections 2023-12-19T18:02:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.734+0000 7f9760d70700 1 -- 172.21.15.45:0/102422606 wait complete. 2023-12-19T18:02:03.741 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fb [2,head] /stripey/flushed_file_6 auth v1 ap=1 DIRTYPARENT s=1572864 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7ba5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001fb:[<0x10000000000/flushed_file_6 v68>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001fb:[<0x10000000000/flushed_file_6 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.741 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [2,head] /stripey/flushed_file_3 auth v1 ap=1 DIRTYPARENT s=917503 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f8:[<0x10000000000/flushed_file_3 v64>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f8:[<0x10000000000/flushed_file_3 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.741 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f9 [2,head] /stripey/flushed_file_4 auth v1 ap=1 DIRTYPARENT s=1441792 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f9:[<0x10000000000/flushed_file_4 v70>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f9:[<0x10000000000/flushed_file_4 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.742 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f7 [2,head] /stripey/flushed_file_2 auth v1 ap=1 DIRTYPARENT s=917504 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f7:[<0x10000000000/flushed_file_2 v56>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f7:[<0x10000000000/flushed_file_2 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.742 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fc [2,head] /lost+found/100000001fc auth v1 ap=1 DIRTYPARENT s=524288 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7ba4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x100000001fc:[<0x4/100000001fc v1>,<0x1/lost+found v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-12-19T18:02:03.742 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fa [2,head] /stripey/flushed_file_5 auth v1 ap=1 DIRTYPARENT s=1441793 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7ba5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001fa:[<0x10000000000/flushed_file_5 v54>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001fa:[<0x10000000000/flushed_file_5 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.742 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f6 [2,head] /stripey/flushed_file_1 auth v1 ap=1 DIRTYPARENT s=524288 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f6:[<0x10000000000/flushed_file_1 v44>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f6:[<0x10000000000/flushed_file_1 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.742 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /stripey/flushed_file_0 auth v1 ap=1 DIRTYPARENT s=1048576 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x10000000001:[<0x10000000000/flushed_file_0 v38>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x10000000001:[<0x10000000000/flushed_file_0 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:03.749 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:02:03.746+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v7 ap=5 snaprealm=0x559bc7b76d80 DIRTYPARENT f(v1 2=0+2) n(v0 rc2023-12-19T18:02:03.384801+0000 2=0+2)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={8604=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x559bc7b6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 2=0+2)","ondisk_value.rstat":"n(v0 3=0+3)","memory_value.dirstat":"f(v1 2=0+2)","memory_value.rstat":"n(v0 rc2023-12-19T18:02:03.384801+0000 2=0+2)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:02:03.762 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-12-19T18:02:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 Processor -- start 2023-12-19T18:02:03.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 -- start start 2023-12-19T18:02:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335015b920 0x7f33500713d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3350071910 0x7f33500af8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33500b1bb0 con 0x7f335015b540 2023-12-19T18:02:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33500b2830 con 0x7f3350071910 2023-12-19T18:02:03.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33568d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3350071da0 con 0x7f335015b920 2023-12-19T18:02:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33560d2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3350071910 0x7f33500af8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33558d1700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f335015b540 0x7f33501621c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:52458/0 (socket says 172.21.15.45:52458) 2023-12-19T18:02:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33558d1700 1 -- 172.21.15.45:0/2042516418 learned_addr learned my addr 172.21.15.45:0/2042516418 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:03.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.946+0000 7f33550d0700 1 --2- 172.21.15.45:0/2042516418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335015b920 0x7f33500713d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33560d2700 1 -- 172.21.15.45:0/2042516418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335015b920 msgr2=0x7f33500713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33560d2700 1 --2- 172.21.15.45:0/2042516418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335015b920 0x7f33500713d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33560d2700 1 -- 172.21.15.45:0/2042516418 >> v1:172.21.15.45:6789/0 conn(0x7f335015b540 legacy=0x7f33501621c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33560d2700 1 -- 172.21.15.45:0/2042516418 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33500b1e90 con 0x7f3350071910 2023-12-19T18:02:03.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33548cf700 1 -- 172.21.15.45:0/2042516418 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859580785 0 0) 0x7f33500b1bb0 con 0x7f335015b540 2023-12-19T18:02:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33560d2700 1 --2- 172.21.15.45:0/2042516418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3350071910 0x7f33500af8e0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3348009840 tx=0x7f3348009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37cb81fa44577e71 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33548cf700 1 -- 172.21.15.45:0/2042516418 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348005ea0 con 0x7f3350071910 2023-12-19T18:02:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33548cf700 1 -- 172.21.15.45:0/2042516418 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3348006030 con 0x7f3350071910 2023-12-19T18:02:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33548cf700 1 -- 172.21.15.45:0/2042516418 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33480063c0 con 0x7f3350071910 2023-12-19T18:02:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 -- 172.21.15.45:0/2042516418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3350071910 msgr2=0x7f33500af8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 --2- 172.21.15.45:0/2042516418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3350071910 0x7f33500af8e0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f3348009840 tx=0x7f3348009b50 comp rx=0 tx=0).stop 2023-12-19T18:02:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 -- 172.21.15.45:0/2042516418 shutdown_connections 2023-12-19T18:02:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 --2- 172.21.15.45:0/2042516418 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3350071910 0x7f33500af8e0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 --2- 172.21.15.45:0/2042516418 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f335015b920 0x7f33500713d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 -- 172.21.15.45:0/2042516418 >> 172.21.15.45:0/2042516418 conn(0x7f33500cf5a0 msgr2=0x7f3350070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 -- 172.21.15.45:0/2042516418 shutdown_connections 2023-12-19T18:02:03.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.950+0000 7f33568d3700 1 -- 172.21.15.45:0/2042516418 wait complete. 2023-12-19T18:02:03.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 Processor -- start 2023-12-19T18:02:03.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 -- start start 2023-12-19T18:02:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 0x7f3350155fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335015b920 0x7f3350145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3350159e40 0x7f3350153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350156830 con 0x7f335015b540 2023-12-19T18:02:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3350156b10 con 0x7f335015b920 2023-12-19T18:02:03.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.954+0000 7f33568d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3350156df0 con 0x7f3350159e40 2023-12-19T18:02:03.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 0x7f3350155fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 0x7f3350155fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42950/0 (socket says 172.21.15.45:42950) 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 -- 172.21.15.45:0/3913354971 learned_addr learned my addr 172.21.15.45:0/3913354971 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33550d0700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335015b920 0x7f3350145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33560d2700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3350159e40 0x7f3350153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 -- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3350159e40 msgr2=0x7f3350153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3350159e40 0x7f3350153ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 -- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335015b920 msgr2=0x7f3350145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335015b920 0x7f3350145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 -- 172.21.15.45:0/3913354971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480094a0 con 0x7f335015b540 2023-12-19T18:02:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33558d1700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 0x7f3350155fc0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f334c001460 tx=0x7f334c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33467fc700 1 -- 172.21.15.45:0/3913354971 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c0020e0 con 0x7f335015b540 2023-12-19T18:02:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33467fc700 1 -- 172.21.15.45:0/3913354971 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334c00a8e0 con 0x7f335015b540 2023-12-19T18:02:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33501570d0 con 0x7f335015b540 2023-12-19T18:02:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33467fc700 1 -- 172.21.15.45:0/3913354971 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c00ac50 con 0x7f335015b540 2023-12-19T18:02:03.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.958+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3350156500 con 0x7f335015b540 2023-12-19T18:02:03.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.962+0000 7f33467fc700 1 -- 172.21.15.45:0/3913354971 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f334c007070 con 0x7f335015b540 2023-12-19T18:02:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.962+0000 7f33467fc700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3334065ad0 0x7f3334067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.962+0000 7f33467fc700 1 -- 172.21.15.45:0/3913354971 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f334c0830c0 con 0x7f335015b540 2023-12-19T18:02:03.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.962+0000 7f33550d0700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3334065ad0 0x7f3334067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.966+0000 7f33550d0700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3334065ad0 0x7f3334067f90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3350159930 tx=0x7f3340009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.966+0000 7f335adc4740 1 Processor -- start 2023-12-19T18:02:03.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.966+0000 7f335adc4740 1 -- start start 2023-12-19T18:02:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x244c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244c290 0x24229a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 0x24235d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x23481f0 con 0x244f560 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2342890 con 0x24225c0 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2395640 con 0x244c290 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 0x24235d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 0x24235d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42954/0 (socket says 172.21.15.45:42954) 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 -- 172.21.15.45:0/208573000 learned_addr learned my addr 172.21.15.45:0/208573000 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33558d1700 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x244c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33550d0700 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244c290 0x24229a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 -- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244c290 msgr2=0x24229a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244c290 0x24229a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 -- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 msgr2=0x244c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x244c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 -- 172.21.15.45:0/208573000 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23b36e0 con 0x244f560 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33560d2700 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 0x24235d0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f33500720e0 tx=0x7f3348010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc16d92c0ffb9de server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33337fe700 1 -- 172.21.15.45:0/208573000 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348022070 con 0x244f560 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33337fe700 1 -- 172.21.15.45:0/208573000 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3348006380 con 0x244f560 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f33337fe700 1 -- 172.21.15.45:0/208573000 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3348006570 con 0x244f560 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- 172.21.15.45:0/208573000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 msgr2=0x24235d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 0x24235d0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f33500720e0 tx=0x7f3348010000 comp rx=0 tx=0).stop 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- 172.21.15.45:0/208573000 shutdown_connections 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x244f560 0x24235d0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244c290 0x24229a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 --2- 172.21.15.45:0/208573000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x244c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- 172.21.15.45:0/208573000 >> 172.21.15.45:0/208573000 conn(0x21b65b0 msgr2=0x244ee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- 172.21.15.45:0/208573000 shutdown_connections 2023-12-19T18:02:03.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.970+0000 7f335adc4740 1 -- 172.21.15.45:0/208573000 wait complete. 2023-12-19T18:02:03.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 -- start start 2023-12-19T18:02:03.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 Processor -- start 2023-12-19T18:02:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24225c0 0x244bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x244f560 0x2453a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x2451aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2390960 con 0x2453f80 2023-12-19T18:02:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x238e6c0 con 0x244f560 2023-12-19T18:02:03.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x234be30 con 0x24225c0 2023-12-19T18:02:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f335adc4740 10 client.0 _ll_register_callbacks cb 0x23dee80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:02:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f33560d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x2451aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f33560d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x2451aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42960/0 (socket says 172.21.15.45:42960) 2023-12-19T18:02:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.974+0000 7f33560d2700 1 -- 172.21.15.45:0/666002216 learned_addr learned my addr 172.21.15.45:0/666002216 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33558d1700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24225c0 0x244bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33550d0700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x244f560 0x2453a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33560d2700 1 -- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24225c0 msgr2=0x244bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33560d2700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24225c0 0x244bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33560d2700 1 -- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x244f560 msgr2=0x2453a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33560d2700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x244f560 0x2453a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33560d2700 1 -- 172.21.15.45:0/666002216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33500b1e90 con 0x2453f80 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33560d2700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x2451aa0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3348000ea0 tx=0x7f3348004830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d244778fd1200b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:03.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f3330ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:02:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f3330ff9700 1 -- 172.21.15.45:0/666002216 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334802c070 con 0x2453f80 2023-12-19T18:02:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f3330ff9700 1 -- 172.21.15.45:0/666002216 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f3348006800 con 0x2453f80 2023-12-19T18:02:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2387740 con 0x2453f80 2023-12-19T18:02:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f3330ff9700 1 -- 172.21.15.45:0/666002216 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f33480069c0 con 0x2453f80 2023-12-19T18:02:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 10 client.8637 fetch_fsmap learned FSMap version 91 2023-12-19T18:02:03.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x2201a40 con 0x2453f80 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f3330ff9700 1 -- 172.21.15.45:0/666002216 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2387740 con 0x2453f80 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f3330ff9700 1 -- 172.21.15.45:0/666002216 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f3348004040 con 0x2453f80 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 10 client.8637 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 10 client.8637 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 20 client.8637 populate_metadata read hostname 'smithi045' 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2450080 0x2450490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 4 client.8637 mds_command: new command op to 57227 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:02:03.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x234b150 con 0x2450080 2023-12-19T18:02:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.978+0000 7f33558d1700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2450080 0x2450490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f33558d1700 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2450080 0x2450490 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c1e2f1c12d79f6c server_cookie=db5cebbff58460f in_seq=0 out_seq=0 2023-12-19T18:02:03.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f3330ff9700 10 client.8637 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:03.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f3330ff9700 1 -- 172.21.15.45:0/666002216 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x234b150 con 0x2450080 2023-12-19T18:02:03.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f3330ff9700 10 client.8637 handle_command_reply: tid=0 2023-12-19T18:02:03.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 client.8637 shutdown 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 msgr2=0x2451aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x2451aa0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f3348000ea0 tx=0x7f3348004830 comp rx=0 tx=0).stop 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 shutdown_connections 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2450080 0x2450490 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x2451aa0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x244f560 0x2453a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 --2- 172.21.15.45:0/666002216 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x24225c0 0x244bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f3330ff9700 0 client.8637 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:03.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 >> 172.21.15.45:0/666002216 conn(0x21b65b0 msgr2=0x2427630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:03.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 shutdown_connections 2023-12-19T18:02:03.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 1 -- 172.21.15.45:0/666002216 wait complete. 2023-12-19T18:02:03.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:03.982+0000 7f335adc4740 20 client.8637 trim_cache size 0 max 16384 2023-12-19T18:02:04.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.002+0000 7f335adc4740 1 Processor -- start 2023-12-19T18:02:04.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.002+0000 7f335adc4740 1 -- start start 2023-12-19T18:02:04.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x2423380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x2451470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x24519b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x223ab80 con 0x2453f80 2023-12-19T18:02:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2391620 con 0x24225c0 2023-12-19T18:02:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x23885b0 con 0x244f560 2023-12-19T18:02:04.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33560d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x24519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x2451470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33558d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x2423380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33560d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x24519b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42962/0 (socket says 172.21.15.45:42962) 2023-12-19T18:02:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33560d2700 1 -- 172.21.15.45:0/2534926046 learned_addr learned my addr 172.21.15.45:0/2534926046 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 -- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 msgr2=0x2423380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:04.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x2423380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 -- 172.21.15.45:0/2534926046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 msgr2=0x24519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x24519b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 -- 172.21.15.45:0/2534926046 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x23547e0 con 0x244f560 2023-12-19T18:02:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f33550d0700 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x2451470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f33500cdca0 tx=0x7f3340009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1df9d4db824d422 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f3333fff700 1 -- 172.21.15.45:0/2534926046 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340004540 con 0x244f560 2023-12-19T18:02:04.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f3333fff700 1 -- 172.21.15.45:0/2534926046 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33400038d0 con 0x244f560 2023-12-19T18:02:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f3333fff700 1 -- 172.21.15.45:0/2534926046 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340003c40 con 0x244f560 2023-12-19T18:02:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 -- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 msgr2=0x2451470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:04.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.006+0000 7f335adc4740 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x2451470 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f33500cdca0 tx=0x7f3340009f90 comp rx=0 tx=0).stop 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- 172.21.15.45:0/2534926046 shutdown_connections 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2453f80 0x24519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x2451470 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 --2- 172.21.15.45:0/2534926046 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x24225c0 0x2423380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- 172.21.15.45:0/2534926046 >> 172.21.15.45:0/2534926046 conn(0x21b65b0 msgr2=0x2452fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- 172.21.15.45:0/2534926046 shutdown_connections 2023-12-19T18:02:04.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- 172.21.15.45:0/2534926046 wait complete. 2023-12-19T18:02:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- start start 2023-12-19T18:02:04.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 Processor -- start 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 0x24cdfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x24ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2453f80 0x2480aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2452810 con 0x24225c0 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x24cea20 con 0x2453f80 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2452570 con 0x244f560 2023-12-19T18:02:04.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.010+0000 7f335adc4740 10 client.0 _ll_register_callbacks cb 0x7f33400090e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 0x24cdfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 0x24cdfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42964/0 (socket says 172.21.15.45:42964) 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 -- 172.21.15.45:0/991269129 learned_addr learned my addr 172.21.15.45:0/991269129 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33560d2700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2453f80 0x2480aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33550d0700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x24ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 -- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 msgr2=0x24ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x24ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 -- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2453f80 msgr2=0x2480aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2453f80 0x2480aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 -- 172.21.15.45:0/991269129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3340004220 con 0x24225c0 2023-12-19T18:02:04.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33560d2700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2453f80 0x2480aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33558d1700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 0x24cdfa0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f334c053fc0 tx=0x7f334c05a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4686185581381827 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f3330ff9700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:02:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f3330ff9700 1 -- 172.21.15.45:0/991269129 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f334c080450 con 0x24225c0 2023-12-19T18:02:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f3330ff9700 1 -- 172.21.15.45:0/991269129 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f334c052660 con 0x24225c0 2023-12-19T18:02:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3348006380 con 0x24225c0 2023-12-19T18:02:04.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f3330ff9700 1 -- 172.21.15.45:0/991269129 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f334c0509d0 con 0x24225c0 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 10 client.8643 fetch_fsmap learned FSMap version 91 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x233aa10 con 0x24225c0 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f3330ff9700 1 -- 172.21.15.45:0/991269129 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3348006380 con 0x24225c0 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f3330ff9700 1 -- 172.21.15.45:0/991269129 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f334c07c040 con 0x24225c0 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 10 client.8643 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 10 client.8643 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 20 client.8643 populate_metadata read hostname 'smithi045' 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2422180 0x2480fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 4 client.8643 mds_command: new command op to 57227 tid=0[{"prefix": "scrub status"}] 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x220d540 con 0x2422180 2023-12-19T18:02:04.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.014+0000 7f33550d0700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2422180 0x2480fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33550d0700 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2422180 0x2480fe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=813158be98af72a1 server_cookie=d87e2447210a81ba in_seq=0 out_seq=0 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f3330ff9700 10 client.8643 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f3330ff9700 1 -- 172.21.15.45:0/991269129 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x220d540 con 0x2422180 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f3330ff9700 10 client.8643 handle_command_reply: tid=0 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 client.8643 shutdown 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 msgr2=0x24cdfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 0x24cdfa0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f334c053fc0 tx=0x7f334c05a040 comp rx=0 tx=0).stop 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 shutdown_connections 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x2422180 0x2480fe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2453f80 0x2480aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x244f560 0x24ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 --2- 172.21.15.45:0/991269129 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x24225c0 0x24cdfa0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 >> 172.21.15.45:0/991269129 conn(0x21b65b0 msgr2=0x2452f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f3330ff9700 0 client.8643 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 shutdown_connections 2023-12-19T18:02:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 1 -- 172.21.15.45:0/991269129 wait complete. 2023-12-19T18:02:04.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f335adc4740 20 client.8643 trim_cache size 0 max 16384 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "IDLE (waiting for more scrubs)", 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": { 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: "beeab2b4-eb88-4dbb-b423-206322d7b813": { 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: "path": "/", 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: "tag": "beeab2b4-eb88-4dbb-b423-206322d7b813", 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: "options": "recursive,repair" 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:04.025 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:04.026 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:02:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3334065ad0 msgr2=0x7f3334067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:04.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3334065ad0 0x7f3334067f90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3350159930 tx=0x7f3340009240 comp rx=0 tx=0).stop 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 msgr2=0x7f3350155fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 0x7f3350155fc0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f334c001460 tx=0x7f334c00a340 comp rx=0 tx=0).stop 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 shutdown_connections 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3334065ad0 0x7f3334067f90 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3350159e40 0x7f3350153ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f335015b920 0x7f3350145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 --2- 172.21.15.45:0/3913354971 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f335015b540 0x7f3350155fc0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.018+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 >> 172.21.15.45:0/3913354971 conn(0x7f3350071910 msgr2=0x7f335006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.022+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 shutdown_connections 2023-12-19T18:02:04.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:04.022+0000 7f33568d3700 1 -- 172.21.15.45:0/3913354971 wait complete. 2023-12-19T18:02:04.047 INFO:tasks.cephfs.filesystem:scrub status for tag:beeab2b4-eb88-4dbb-b423-206322d7b813 - {'path': '/', 'tag': 'beeab2b4-eb88-4dbb-b423-206322d7b813', 'options': 'recursive,repair'} 2023-12-19T18:02:31.992 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:02:31.999 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:02:34.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.5:0 scrub status 2023-12-19T18:02:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 Processor -- start 2023-12-19T18:02:34.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 -- start start 2023-12-19T18:02:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a98159e10 0x7f0a98071670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 0x7f0a980cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a980cf760 con 0x7f0a980cf350 2023-12-19T18:02:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9815a1f0 con 0x7f0a98159e10 2023-12-19T18:02:34.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.245+0000 7f0aa02bf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a980ce500 con 0x7f0a980ce070 2023-12-19T18:02:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a98159e10 0x7f0a98071670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 0x7f0a980cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0a98159e10 0x7f0a98071670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:35120/0 (socket says 172.21.15.45:35120) 2023-12-19T18:02:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 -- 172.21.15.45:0/2257307974 learned_addr learned my addr 172.21.15.45:0/2257307974 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 0x7f0a980cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:40702/0 (socket says 172.21.15.45:40702) 2023-12-19T18:02:34.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e85c700 1 --1- 172.21.15.45:0/2257307974 >> v1:172.21.15.73:6789/0 conn(0x7f0a980cf350 0x7f0a980b1510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:41998/0 (socket says 172.21.15.45:41998) 2023-12-19T18:02:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 -- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 msgr2=0x7f0a980cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 0x7f0a980cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 -- 172.21.15.45:0/2257307974 >> v1:172.21.15.73:6789/0 conn(0x7f0a980cf350 legacy=0x7f0a980b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 -- 172.21.15.45:0/2257307974 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a980ce7e0 con 0x7f0a98159e10 2023-12-19T18:02:34.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 0x7f0a980cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a98159e10 0x7f0a98071670 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009910 tx=0x7f0a94009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d81acd282ed64eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9d059700 1 -- 172.21.15.45:0/2257307974 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94011830 con 0x7f0a98159e10 2023-12-19T18:02:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9d059700 1 -- 172.21.15.45:0/2257307974 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a94011990 con 0x7f0a98159e10 2023-12-19T18:02:34.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0a9d059700 1 -- 172.21.15.45:0/2257307974 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94011d40 con 0x7f0a98159e10 2023-12-19T18:02:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0aa02bf700 1 -- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a98159e10 msgr2=0x7f0a98071670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.249+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a98159e10 0x7f0a98071670 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0a94009910 tx=0x7f0a94009c20 comp rx=0 tx=0).stop 2023-12-19T18:02:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 -- 172.21.15.45:0/2257307974 shutdown_connections 2023-12-19T18:02:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ce070 0x7f0a980cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/2257307974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a98159e10 0x7f0a98071670 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 -- 172.21.15.45:0/2257307974 >> 172.21.15.45:0/2257307974 conn(0x7f0a9806a010 msgr2=0x7f0a9806a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 -- 172.21.15.45:0/2257307974 shutdown_connections 2023-12-19T18:02:34.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 -- 172.21.15.45:0/2257307974 wait complete. 2023-12-19T18:02:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 Processor -- start 2023-12-19T18:02:34.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.253+0000 7f0aa02bf700 1 -- start start 2023-12-19T18:02:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a980cf350 0x7f0a9814a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 0x7f0a9815b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ac590 0x7f0a981578e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9815c010 con 0x7f0a98159e10 2023-12-19T18:02:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9815c2f0 con 0x7f0a980cf350 2023-12-19T18:02:34.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9815c5d0 con 0x7f0a980ac590 2023-12-19T18:02:34.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 0x7f0a9815b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 0x7f0a9815b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44386/0 (socket says 172.21.15.45:44386) 2023-12-19T18:02:34.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9d85a700 1 -- 172.21.15.45:0/3074411616 learned_addr learned my addr 172.21.15.45:0/3074411616 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e85c700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ac590 0x7f0a981578e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a980cf350 0x7f0a9814a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 -- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ac590 msgr2=0x7f0a981578e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ac590 0x7f0a981578e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 -- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 msgr2=0x7f0a9815b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 0x7f0a9815b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 -- 172.21.15.45:0/3074411616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a880094b0 con 0x7f0a980cf350 2023-12-19T18:02:34.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 0x7f0a9815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:34.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a980cf350 0x7f0a9814a860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0a94016000 tx=0x7f0a94004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a8effd700 1 -- 172.21.15.45:0/3074411616 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94004510 con 0x7f0a980cf350 2023-12-19T18:02:34.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a8effd700 1 -- 172.21.15.45:0/3074411616 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a940036c0 con 0x7f0a980cf350 2023-12-19T18:02:34.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a94009570 con 0x7f0a980cf350 2023-12-19T18:02:34.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0a8effd700 1 -- 172.21.15.45:0/3074411616 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a94003a70 con 0x7f0a980cf350 2023-12-19T18:02:34.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.257+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9815cb90 con 0x7f0a980cf350 2023-12-19T18:02:34.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.261+0000 7f0a8effd700 1 -- 172.21.15.45:0/3074411616 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0a94003bd0 con 0x7f0a980cf350 2023-12-19T18:02:34.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0a8effd700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065b00 0x7f0a7c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0a8effd700 1 -- 172.21.15.45:0/3074411616 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0a94021030 con 0x7f0a980cf350 2023-12-19T18:02:34.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065b00 0x7f0a7c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065b00 0x7f0a7c067fc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0a98157520 tx=0x7f0a88009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 Processor -- start 2023-12-19T18:02:34.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 -- start start 2023-12-19T18:02:34.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a6e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1aba560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x19941f0 con 0x1a986a0 2023-12-19T18:02:34.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x198e890 con 0x1a6e5c0 2023-12-19T18:02:34.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.265+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x19e1640 con 0x1ab13e0 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a6e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a6e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44390/0 (socket says 172.21.15.45:44390) 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 -- 172.21.15.45:0/258375526 learned_addr learned my addr 172.21.15.45:0/258375526 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9e85c700 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1aba560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 -- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 msgr2=0x1aba560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1aba560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 -- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 msgr2=0x1a980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 -- 172.21.15.45:0/258375526 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19ff6e0 con 0x1a986a0 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9e85c700 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1aba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:34.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a6e9a0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0a88014790 tx=0x7f0a88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4745af88c2f8e6a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a7bfff700 1 -- 172.21.15.45:0/258375526 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88011e60 con 0x1a986a0 2023-12-19T18:02:34.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a7bfff700 1 -- 172.21.15.45:0/258375526 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88021600 con 0x1a986a0 2023-12-19T18:02:34.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0a7bfff700 1 -- 172.21.15.45:0/258375526 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a880219b0 con 0x1a986a0 2023-12-19T18:02:34.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 -- 172.21.15.45:0/258375526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 msgr2=0x1a6e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a6e9a0 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f0a88014790 tx=0x7f0a88014000 comp rx=0 tx=0).stop 2023-12-19T18:02:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 -- 172.21.15.45:0/258375526 shutdown_connections 2023-12-19T18:02:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1aba560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a6e9a0 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 --2- 172.21.15.45:0/258375526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 -- 172.21.15.45:0/258375526 >> 172.21.15.45:0/258375526 conn(0x18025b0 msgr2=0x1a9ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:34.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 -- 172.21.15.45:0/258375526 shutdown_connections 2023-12-19T18:02:34.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.269+0000 7f0aa354f740 1 -- 172.21.15.45:0/258375526 wait complete. 2023-12-19T18:02:34.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 -- start start 2023-12-19T18:02:34.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 Processor -- start 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a6cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1a88dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x19dc960 con 0x1a986a0 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x19da6c0 con 0x1a6e5c0 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1997e30 con 0x1ab13e0 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0aa354f740 10 client.0 _ll_register_callbacks cb 0x1a2ae80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:02:34.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0a9e05b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a6cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.273+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44404/0 (socket says 172.21.15.45:44404) 2023-12-19T18:02:34.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 -- 172.21.15.45:0/1877467072 learned_addr learned my addr 172.21.15.45:0/1877467072 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:34.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9e85c700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1a88dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 -- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 msgr2=0x1a88dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1a88dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 -- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 msgr2=0x1a6cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a6cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 -- 172.21.15.45:0/1877467072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a88014440 con 0x1a986a0 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a6cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88880 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0a88021dd0 tx=0x7f0a880047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c724b0115705f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a797fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a797fa700 1 -- 172.21.15.45:0/1877467072 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88005e50 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a797fa700 1 -- 172.21.15.45:0/1877467072 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0a8801c040 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x19d3740 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a797fa700 1 -- 172.21.15.45:0/1877467072 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a88011e60 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 10 client.8652 fetch_fsmap learned FSMap version 91 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x184da40 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a797fa700 1 -- 172.21.15.45:0/1877467072 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x19d3740 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a797fa700 1 -- 172.21.15.45:0/1877467072 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0a88006050 con 0x1a986a0 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 10 client.8652 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 10 client.8652 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 20 client.8652 populate_metadata read hostname 'smithi045' 2023-12-19T18:02:34.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1a9ea80 0x1a8a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 4 client.8652 mds_command: new command op to 57227 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:02:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x1997150 con 0x1a9ea80 2023-12-19T18:02:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.277+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1a9ea80 0x1a8a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1a9ea80 0x1a8a8a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9d7511446d2f1b server_cookie=8994eebefb3b18e1 in_seq=0 out_seq=0 2023-12-19T18:02:34.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0a797fa700 10 client.8652 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:34.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0a797fa700 1 -- 172.21.15.45:0/1877467072 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x1997150 con 0x1a9ea80 2023-12-19T18:02:34.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0a797fa700 10 client.8652 handle_command_reply: tid=0 2023-12-19T18:02:34.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 client.8652 shutdown 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 msgr2=0x1a88880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88880 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f0a88021dd0 tx=0x7f0a880047e0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 shutdown_connections 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1a9ea80 0x1a8a8a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1a88dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88880 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 --2- 172.21.15.45:0/1877467072 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1a6cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0a797fa700 0 client.8652 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 >> 172.21.15.45:0/1877467072 conn(0x18025b0 msgr2=0x1a6da80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 shutdown_connections 2023-12-19T18:02:34.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.281+0000 7f0aa354f740 1 -- 172.21.15.45:0/1877467072 wait complete. 2023-12-19T18:02:34.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.285+0000 7f0aa354f740 20 client.8652 trim_cache size 0 max 16384 2023-12-19T18:02:34.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 Processor -- start 2023-12-19T18:02:34.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 -- start start 2023-12-19T18:02:34.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a6e5c0 0x1ab1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ab13e0 0x1a88cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1886b80 con 0x1a986a0 2023-12-19T18:02:34.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x199c680 con 0x1ab13e0 2023-12-19T18:02:34.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x19d6030 con 0x1a6e5c0 2023-12-19T18:02:34.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44420/0 (socket says 172.21.15.45:44420) 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0a9d85a700 1 -- 172.21.15.45:0/3253536115 learned_addr learned my addr 172.21.15.45:0/3253536115 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0a9e85c700 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ab13e0 0x1a88cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.305+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a6e5c0 0x1ab1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a9d85a700 1 -- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a6e5c0 msgr2=0x1ab1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a6e5c0 0x1ab1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a9d85a700 1 -- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ab13e0 msgr2=0x1a88cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ab13e0 0x1a88cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a9d85a700 1 -- 172.21.15.45:0/3253536115 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x19a07e0 con 0x1a986a0 2023-12-19T18:02:34.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88790 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009850 tx=0x7f0a8802c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a062da9572701fc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a8cbff700 1 -- 172.21.15.45:0/3253536115 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88014660 con 0x1a986a0 2023-12-19T18:02:34.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a8cbff700 1 -- 172.21.15.45:0/3253536115 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a880112c0 con 0x1a986a0 2023-12-19T18:02:34.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0a8cbff700 1 -- 172.21.15.45:0/3253536115 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88005e90 con 0x1a986a0 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 -- 172.21.15.45:0/3253536115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 msgr2=0x1a88790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88790 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009850 tx=0x7f0a8802c040 comp rx=0 tx=0).stop 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 -- 172.21.15.45:0/3253536115 shutdown_connections 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1ab13e0 0x1a88cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1a88790 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 --2- 172.21.15.45:0/3253536115 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1a6e5c0 0x1ab1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 -- 172.21.15.45:0/3253536115 >> 172.21.15.45:0/3253536115 conn(0x18025b0 msgr2=0x1ab0470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 -- 172.21.15.45:0/3253536115 shutdown_connections 2023-12-19T18:02:34.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 -- 172.21.15.45:0/3253536115 wait complete. 2023-12-19T18:02:34.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 -- start start 2023-12-19T18:02:34.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.309+0000 7f0aa354f740 1 Processor -- start 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1ab0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1ab09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1acd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x1978b70 con 0x1a986a0 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x19d7ed0 con 0x1a6e5c0 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x19a48e0 con 0x1ab13e0 2023-12-19T18:02:34.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 10 client.0 _ll_register_callbacks cb 0x7f0a88011db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:02:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1ab09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9e05b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1ab0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1ab09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44424/0 (socket says 172.21.15.45:44424) 2023-12-19T18:02:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 -- 172.21.15.45:0/2487890781 learned_addr learned my addr 172.21.15.45:0/2487890781 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:34.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9e85c700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1acd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 -- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 msgr2=0x1acd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1acd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 -- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 msgr2=0x1ab0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1ab0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 -- 172.21.15.45:0/2487890781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x184da40 con 0x1a986a0 2023-12-19T18:02:34.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1ab0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a9d85a700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1ab09b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009f50 tx=0x7f0a88018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa1548172e0eaff4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:34.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a797fa700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a797fa700 1 -- 172.21.15.45:0/2487890781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a88014660 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a88021600 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a797fa700 1 -- 172.21.15.45:0/2487890781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0a88011e60 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0a797fa700 1 -- 172.21.15.45:0/2487890781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a88050ea0 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 10 client.8658 fetch_fsmap learned FSMap version 91 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.313+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=2+}) v3 -- 0x1986a10 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a797fa700 1 -- 172.21.15.45:0/2487890781 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a88021600 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a797fa700 1 -- 172.21.15.45:0/2487890781 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 91) v1 ==== 3122+0+0 (secure 0 0 0) 0x7f0a8803d470 con 0x1a986a0 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 10 client.8658 fetch_fsmap finished waiting for FSMap version 91 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 10 client.8658 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.b 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 20 client.8658 populate_metadata read hostname 'smithi045' 2023-12-19T18:02:34.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b162e0 0x1acd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:34.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 4 client.8658 mds_command: new command op to 57227 tid=0[{"prefix": "scrub status"}] 2023-12-19T18:02:34.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 --> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x1859540 con 0x1b162e0 2023-12-19T18:02:34.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b162e0 0x1acd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:34.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a9e05b700 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b162e0 0x1acd9f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95025e16c8d75c0a server_cookie=74a7b0a487defcf4 in_seq=0 out_seq=0 2023-12-19T18:02:34.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a797fa700 10 client.8658 ms_handle_connect on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:34.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a797fa700 1 -- 172.21.15.45:0/2487890781 <== mds.0 v2:172.21.15.73:6834/280993181 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x1859540 con 0x1b162e0 2023-12-19T18:02:34.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a797fa700 10 client.8658 handle_command_reply: tid=0 2023-12-19T18:02:34.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 client.8658 shutdown 2023-12-19T18:02:34.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 msgr2=0x1ab09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1ab09b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0a88009f50 tx=0x7f0a88018000 comp rx=0 tx=0).stop 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 shutdown_connections 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:6834/280993181,v1:172.21.15.73:6835/280993181] conn(0x1b162e0 0x1acd9f0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x1ab13e0 0x1acd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x1a986a0 0x1ab09b0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 --2- 172.21.15.45:0/2487890781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x1a6e5c0 0x1ab0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0a797fa700 0 client.8658 ms_handle_reset on v2:172.21.15.73:6834/280993181 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 >> 172.21.15.45:0/2487890781 conn(0x18025b0 msgr2=0x1ab2030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:34.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 shutdown_connections 2023-12-19T18:02:34.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 1 -- 172.21.15.45:0/2487890781 wait complete. 2023-12-19T18:02:34.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.317+0000 7f0aa354f740 20 client.8658 trim_cache size 0 max 16384 2023-12-19T18:02:34.325 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:02:34.325 INFO:teuthology.orchestra.run.smithi045.stdout: "status": "no active scrubs running", 2023-12-19T18:02:34.325 INFO:teuthology.orchestra.run.smithi045.stdout: "scrubs": {} 2023-12-19T18:02:34.325 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065b00 msgr2=0x7f0a7c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065b00 0x7f0a7c067fc0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f0a98157520 tx=0x7f0a88009240 comp rx=0 tx=0).stop 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a980cf350 msgr2=0x7f0a9814a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a980cf350 0x7f0a9814a860 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0a94016000 tx=0x7f0a94004770 comp rx=0 tx=0).stop 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 shutdown_connections 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0a7c065b00 0x7f0a7c067fc0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0a980ac590 0x7f0a981578e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0a98159e10 0x7f0a9815b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 --2- 172.21.15.45:0/3074411616 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a980cf350 0x7f0a9814a860 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 >> 172.21.15.45:0/3074411616 conn(0x7f0a9806a010 msgr2=0x7f0a980b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 shutdown_connections 2023-12-19T18:02:34.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:34.321+0000 7f0aa02bf700 1 -- 172.21.15.45:0/3074411616 wait complete. 2023-12-19T18:02:34.348 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-12-19T18:02:34.348 INFO:tasks.cephfs.mount:Validating 1048576 bytes from stripey/flushed_file_0 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_0" 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1048576: 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1048576 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:34.349 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:34.350 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:34.350 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:35.062 INFO:tasks.cephfs.mount:Validating 524288 bytes from stripey/flushed_file_1 2023-12-19T18:02:35.062 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_1" 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 524288: 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 524288 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:35.063 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:35.614 INFO:tasks.cephfs.mount:Validating 917504 bytes from stripey/flushed_file_2 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_2" 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 917504: 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 917504 2023-12-19T18:02:35.614 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:35.615 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:35.615 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:35.615 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:35.615 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:35.615 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:36.374 INFO:tasks.cephfs.mount:Validating 917503 bytes from stripey/flushed_file_3 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_3" 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 917503: 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 917503 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:36.374 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:36.375 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:36.375 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:36.375 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:37.122 INFO:tasks.cephfs.mount:Validating 1441792 bytes from stripey/flushed_file_4 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_4" 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1441792: 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1441792 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:37.123 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:38.069 INFO:tasks.cephfs.mount:Validating 1441793 bytes from stripey/flushed_file_5 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_5" 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1441793: 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1441793 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:38.070 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:38.071 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:39.023 INFO:tasks.cephfs.mount:Validating 1572864 bytes from stripey/flushed_file_6 2023-12-19T18:02:39.023 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:39.023 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:39.023 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/stripey/flushed_file_6" 2023-12-19T18:02:39.023 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:39.023 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 1572864: 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 1572864 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:39.024 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:40.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:40.171 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo ls lost+found) 2023-12-19T18:02:40.263 INFO:teuthology.orchestra.run.smithi045.stdout:100000001fc 2023-12-19T18:02:40.267 INFO:tasks.cephfs.mount:Validating 524288 bytes from lost+found/100000001fc 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> import zlib 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> path = "/home/ubuntu/cephtest/mnt.0/lost+found/100000001fc" 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> with open(path, '"'"'r'"'"') as f: 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> bytes = f.read() 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> if len(bytes) != 524288: 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad length {0} vs. expected {1}".format( 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> len(bytes), 524288 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> )) 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> for i, b in enumerate(bytes): 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> val = zlib.crc32(str(i).encode('"'"'utf-8'"'"')) & 7 2023-12-19T18:02:40.268 DEBUG:teuthology.orchestra.run.smithi045:> if b != chr(val): 2023-12-19T18:02:40.269 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Bad data at offset {0}".format(i)) 2023-12-19T18:02:40.269 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:02:40.478 INFO:teuthology.orchestra.run.smithi045.stderr:Traceback (most recent call last): 2023-12-19T18:02:40.478 INFO:teuthology.orchestra.run.smithi045.stderr: File "", line 13, in 2023-12-19T18:02:40.478 INFO:teuthology.orchestra.run.smithi045.stderr:RuntimeError: Bad data at offset 65536 2023-12-19T18:02:40.599 INFO:teuthology.orchestra.run.smithi045.stderr:daemon-helper: command failed with exit status 1 2023-12-19T18:02:40.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:02:40.616 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:02:40.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:02:40.711 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:02:40.757 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:02:40.757 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:02:40.757 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:40.779 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:02:41.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.005+0000 7f8655efe700 1 Processor -- start 2023-12-19T18:02:41.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.005+0000 7f8655efe700 1 -- start start 2023-12-19T18:02:41.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8655efe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f86501615a0 0x7f86500c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8655efe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 0x7f86500afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8655efe700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500c3f90 con 0x7f86501611c0 2023-12-19T18:02:41.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8655efe700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86500b00f0 con 0x7f86501615a0 2023-12-19T18:02:41.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8655efe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8650070340 con 0x7f86500af720 2023-12-19T18:02:41.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8654efc700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f86501611c0 0x7f865006d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48778/0 (socket says 172.21.15.45:48778) 2023-12-19T18:02:41.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8654efc700 1 -- 172.21.15.45:0/3842857791 learned_addr learned my addr 172.21.15.45:0/3842857791 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:41.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 --2- 172.21.15.45:0/3842857791 >> v2:172.21.15.73:3300/0 conn(0x7f86501615a0 0x7f86500c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f86556fd700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 0x7f86500afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223704182 0 0) 0x7f86500c3f90 con 0x7f86501611c0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86400035d0 con 0x7f86501611c0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4199887288 0 0) 0x7f86400035d0 con 0x7f86501611c0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 msgr2=0x7f86500afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 0x7f86500afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 >> v2:172.21.15.73:3300/0 conn(0x7f86501615a0 msgr2=0x7f86500c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 --2- 172.21.15.45:0/3842857791 >> v2:172.21.15.73:3300/0 conn(0x7f86501615a0 0x7f86500c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500c4270 con 0x7f86501611c0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f8644001670 con 0x7f86501611c0 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 >> v1:172.21.15.45:6789/0 conn(0x7f86501611c0 legacy=0x7f865006d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8640003a20 0x7f8640003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8640004870 0x7f8640004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 0x7f8640005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500b00f0 con 0x7f8640004870 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650070340 con 0x7f8640003a20 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864000ba60 con 0x7f86500af720 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 --2- 172.21.15.45:0/3842857791 >> v2:172.21.15.73:3300/0 conn(0x7f86501615a0 0x7f86500c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8640004870 0x7f8640004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f8654efc700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8640003a20 0x7f8640003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f86556fd700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 0x7f8640005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 -- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 msgr2=0x7f8640005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f86500af720 0x7f8640005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 -- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8640003a20 msgr2=0x7f8640003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8640003a20 0x7f8640003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.009+0000 7f864ffff700 1 -- 172.21.15.45:0/3842857791 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86400035d0 con 0x7f8640004870 2023-12-19T18:02:41.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f864ffff700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8640004870 0x7f8640004cf0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f863c009d10 tx=0x7f86400058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26507d264381097 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c009e60 con 0x7f8640004870 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c004030 con 0x7f8640004870 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f864f7fe700 1 -- 172.21.15.45:0/3842857791 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0043e0 con 0x7f8640004870 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f8655efe700 1 -- 172.21.15.45:0/3842857791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8640004870 msgr2=0x7f8640004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f8655efe700 1 --2- 172.21.15.45:0/3842857791 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8640004870 0x7f8640004cf0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f863c009d10 tx=0x7f86400058a0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f86556fd700 1 -- 172.21.15.45:0/3842857791 reap_dead start 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f8655efe700 1 -- 172.21.15.45:0/3842857791 shutdown_connections 2023-12-19T18:02:41.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f8655efe700 1 -- 172.21.15.45:0/3842857791 >> 172.21.15.45:0/3842857791 conn(0x7f86500cb900 msgr2=0x7f86500b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f8655efe700 1 -- 172.21.15.45:0/3842857791 shutdown_connections 2023-12-19T18:02:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.013+0000 7f8655efe700 1 -- 172.21.15.45:0/3842857791 wait complete. 2023-12-19T18:02:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 Processor -- start 2023-12-19T18:02:41.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 -- start start 2023-12-19T18:02:41.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8640004870 0x7f86500b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500b2900 0x7f8650152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 0x7f865015fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86501601c0 con 0x7f865015f800 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8650162450 con 0x7f86500b2900 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8655efe700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8650152ed0 con 0x7f8640004870 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 0x7f865015fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 0x7f865015fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53242/0 (socket says 172.21.15.45:53242) 2023-12-19T18:02:41.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 -- 172.21.15.45:0/2161635825 learned_addr learned my addr 172.21.15.45:0/2161635825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f8654efc700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8640004870 0x7f86500b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f864ffff700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500b2900 0x7f8650152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 -- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8640004870 msgr2=0x7f86500b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8640004870 0x7f86500b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 -- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500b2900 msgr2=0x7f8650152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500b2900 0x7f8650152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.017+0000 7f86556fd700 1 -- 172.21.15.45:0/2161635825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86501626a0 con 0x7f865015f800 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f86556fd700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 0x7f865015fc80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8650164ea0 tx=0x7f8648011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864800e040 con 0x7f865015f800 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864800f040 con 0x7f865015f800 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8650162980 con 0x7f865015f800 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864800fc40 con 0x7f865015f800 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8650162f40 con 0x7f865015f800 2023-12-19T18:02:41.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.021+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f865006e760 con 0x7f865015f800 2023-12-19T18:02:41.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.025+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8648022460 con 0x7f865015f800 2023-12-19T18:02:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.025+0000 7f864d7fa700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8634065ad0 0x7f8634067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.025+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f8648083980 con 0x7f865015f800 2023-12-19T18:02:41.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.025+0000 7f8654efc700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8634065ad0 0x7f8634067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.029+0000 7f8654efc700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8634065ad0 0x7f8634067f90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8644001050 tx=0x7f86440079a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.033+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8648050ec0 con 0x7f865015f800 2023-12-19T18:02:41.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.209+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8650067760 con 0x7f865015f800 2023-12-19T18:02:41.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f864d7fa700 1 -- 172.21.15.45:0/2161635825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18385 (secure 0 0 0) 0x7f86480544e0 con 0x7f865015f800 2023-12-19T18:02:41.217 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:41.218 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":116,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:54.876376+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6834/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6832/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6832/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6834/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6834/723317362":"2023-12-20T18:01:48.074941+0000","172.21.15.73:6832/723317362":"2023-12-20T18:01:48.074941+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:02:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8634065ad0 msgr2=0x7f8634067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8634065ad0 0x7f8634067f90 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8644001050 tx=0x7f86440079a0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 msgr2=0x7f865015fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 0x7f865015fc80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f8650164ea0 tx=0x7f8648011ed0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 shutdown_connections 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8634065ad0 0x7f8634067f90 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f865015f800 0x7f865015fc80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f86500b2900 0x7f8650152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 --2- 172.21.15.45:0/2161635825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8640004870 0x7f86500b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 >> 172.21.15.45:0/2161635825 conn(0x7f86500cb900 msgr2=0x7f865006f230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 shutdown_connections 2023-12-19T18:02:41.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.213+0000 7f8655efe700 1 -- 172.21.15.45:0/2161635825 wait complete. 2023-12-19T18:02:41.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:01:08.640298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:01:10.079199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T18:01:20.655255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:02:41.242 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:02:41.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.413+0000 7f3c51de8700 1 Processor -- start 2023-12-19T18:02:41.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c51de8700 1 -- start start 2023-12-19T18:02:41.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c51de8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c4c0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c51de8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0d2200 con 0x7f3c4c15d220 2023-12-19T18:02:41.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c51de8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0d1920 con 0x7f3c4c0d0e30 2023-12-19T18:02:41.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c51de8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0d2aa0 con 0x7f3c4c0d2690 2023-12-19T18:02:41.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c4bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3c4c15d220 0x7f3c4c06ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48782/0 (socket says 172.21.15.45:48782) 2023-12-19T18:02:41.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c4bfff700 1 -- 172.21.15.45:0/2528547822 learned_addr learned my addr 172.21.15.45:0/2528547822 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.417+0000 7f3c515e7700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c4c0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052778307 0 0) 0x7f3c4c0d2200 con 0x7f3c4c15d220 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c340035d0 con 0x7f3c4c15d220 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796261988 0 0) 0x7f3c4c0d1920 con 0x7f3c4c0d0e30 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4c0d2200 con 0x7f3c4c0d0e30 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 80752576 0 0) 0x7f3c340035d0 con 0x7f3c4c15d220 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 msgr2=0x7f3c4c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c4c0cd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 >> v1:172.21.15.73:6789/0 conn(0x7f3c4c0d0e30 legacy=0x7f3c4c0d1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c070210 con 0x7f3c4c15d220 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f3c3c001670 con 0x7f3c4c15d220 2023-12-19T18:02:41.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c515e7700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c4c0cd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 >> v1:172.21.15.45:6789/0 conn(0x7f3c4c15d220 legacy=0x7f3c4c06ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c34003be0 0x7f3c34003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34004870 0x7f3c34004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c34005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0d2aa0 con 0x7f3c34003be0 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400bb10 con 0x7f3c34004870 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400bcd0 con 0x7f3c4c0d2690 2023-12-19T18:02:41.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c34003be0 0x7f3c34003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c515e7700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c34005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4bfff700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34004870 0x7f3c34004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 -- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 msgr2=0x7f3c34005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c0d2690 0x7f3c34005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 -- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34004870 msgr2=0x7f3c34004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34004870 0x7f3c34004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 -- 172.21.15.45:0/2528547822 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44009a70 con 0x7f3c34003be0 2023-12-19T18:02:41.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c50de6700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c34003be0 0x7f3c34003fe0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007fd0 tx=0x7f3c340058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e787ff3b84f9be9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40001450 con 0x7f3c34003be0 2023-12-19T18:02:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400052f0 con 0x7f3c34003be0 2023-12-19T18:02:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.421+0000 7f3c4b7fe700 1 -- 172.21.15.45:0/2528547822 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40001d60 con 0x7f3c34003be0 2023-12-19T18:02:41.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 -- 172.21.15.45:0/2528547822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c34003be0 msgr2=0x7f3c34003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 --2- 172.21.15.45:0/2528547822 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c34003be0 0x7f3c34003fe0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007fd0 tx=0x7f3c340058a0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c515e7700 1 -- 172.21.15.45:0/2528547822 reap_dead start 2023-12-19T18:02:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 -- 172.21.15.45:0/2528547822 shutdown_connections 2023-12-19T18:02:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 -- 172.21.15.45:0/2528547822 >> 172.21.15.45:0/2528547822 conn(0x7f3c4c0b46d0 msgr2=0x7f3c4c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 -- 172.21.15.45:0/2528547822 shutdown_connections 2023-12-19T18:02:41.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 -- 172.21.15.45:0/2528547822 wait complete. 2023-12-19T18:02:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.425+0000 7f3c51de8700 1 Processor -- start 2023-12-19T18:02:41.432 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 -- start start 2023-12-19T18:02:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34003be0 0x7f3c4c157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1f62d0 0x7f3c4c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 0x7f3c4c0b77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c7300 con 0x7f3c4c0b7370 2023-12-19T18:02:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b7d30 con 0x7f3c34003be0 2023-12-19T18:02:41.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c51de8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0c6680 con 0x7f3c4c1f62d0 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 0x7f3c4c0b77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 0x7f3c4c0b77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53262/0 (socket says 172.21.15.45:53262) 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 -- 172.21.15.45:0/1277525092 learned_addr learned my addr 172.21.15.45:0/1277525092 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c50de6700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34003be0 0x7f3c4c157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c4bfff700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1f62d0 0x7f3c4c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 -- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1f62d0 msgr2=0x7f3c4c15a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1f62d0 0x7f3c4c15a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 -- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34003be0 msgr2=0x7f3c4c157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34003be0 0x7f3c4c157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.429+0000 7f3c515e7700 1 -- 172.21.15.45:0/1277525092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0c6960 con 0x7f3c4c0b7370 2023-12-19T18:02:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c515e7700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 0x7f3c4c0b77f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0724d0 tx=0x7f3c440116e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4400e070 con 0x7f3c4c0b7370 2023-12-19T18:02:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c44011d40 con 0x7f3c4c0b7370 2023-12-19T18:02:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c44009ea0 con 0x7f3c4c0b7370 2023-12-19T18:02:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0c6c40 con 0x7f3c4c0b7370 2023-12-19T18:02:41.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c15aa00 con 0x7f3c4c0b7370 2023-12-19T18:02:41.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.433+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c072a90 con 0x7f3c4c0b7370 2023-12-19T18:02:41.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.437+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3c44003a40 con 0x7f3c4c0b7370 2023-12-19T18:02:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.437+0000 7f3c497fa700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c38065ad0 0x7f3c38067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.437+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f3c44083b20 con 0x7f3c4c0b7370 2023-12-19T18:02:41.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.437+0000 7f3c50de6700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c38065ad0 0x7f3c38067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.437+0000 7f3c50de6700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c38065ad0 0x7f3c38067f90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3c40000c00 tx=0x7f3c4000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.445+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3c44051190 con 0x7f3c4c0b7370 2023-12-19T18:02:41.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.617+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c4c1f66b0 con 0x7f3c4c0b7370 2023-12-19T18:02:41.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.617+0000 7f3c497fa700 1 -- 172.21.15.45:0/1277525092 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c44014350 con 0x7f3c4c0b7370 2023-12-19T18:02:41.623 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:02:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c38065ad0 msgr2=0x7f3c38067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c38065ad0 0x7f3c38067f90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3c40000c00 tx=0x7f3c4000a000 comp rx=0 tx=0).stop 2023-12-19T18:02:41.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 msgr2=0x7f3c4c0b77f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 0x7f3c4c0b77f0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0724d0 tx=0x7f3c440116e0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 shutdown_connections 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3c38065ad0 0x7f3c38067f90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3c4c0b7370 0x7f3c4c0b77f0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3c4c1f62d0 0x7f3c4c15a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 --2- 172.21.15.45:0/1277525092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c34003be0 0x7f3c4c157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 >> 172.21.15.45:0/1277525092 conn(0x7f3c4c0b46d0 msgr2=0x7f3c4c1e82d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 shutdown_connections 2023-12-19T18:02:41.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.621+0000 7f3c51de8700 1 -- 172.21.15.45:0/1277525092 wait complete. 2023-12-19T18:02:41.645 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:02:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.821+0000 7fd395208700 1 Processor -- start 2023-12-19T18:02:41.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.821+0000 7fd395208700 1 -- start start 2023-12-19T18:02:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd395208700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd39015cf20 0x7fd3900d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd395208700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3900b8580 0x7fd3900cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd395208700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3900cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd395208700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39015d300 con 0x7fd3900b8580 2023-12-19T18:02:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd395208700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3900d1550 con 0x7fd39015cf20 2023-12-19T18:02:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd395208700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900d1830 con 0x7fd3900d25f0 2023-12-19T18:02:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3900b8580 0x7fd3900cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd3900b8580 0x7fd3900cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53274/0 (socket says 172.21.15.45:53274) 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 -- 172.21.15.45:0/960791187 learned_addr learned my addr 172.21.15.45:0/960791187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd394a07700 1 --2- 172.21.15.45:0/960791187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3900cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38ffff700 1 --2- 172.21.15.45:0/960791187 >> v2:172.21.15.73:3300/0 conn(0x7fd39015cf20 0x7fd3900d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 -- 172.21.15.45:0/960791187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 msgr2=0x7fd3900cde00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 --2- 172.21.15.45:0/960791187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3900cde00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 -- 172.21.15.45:0/960791187 >> v2:172.21.15.73:3300/0 conn(0x7fd39015cf20 msgr2=0x7fd3900d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 --2- 172.21.15.45:0/960791187 >> v2:172.21.15.73:3300/0 conn(0x7fd39015cf20 0x7fd3900d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.825+0000 7fd38f7fe700 1 -- 172.21.15.45:0/960791187 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3900d1b10 con 0x7fd3900b8580 2023-12-19T18:02:41.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd38ffff700 1 --2- 172.21.15.45:0/960791187 >> v2:172.21.15.73:3300/0 conn(0x7fd39015cf20 0x7fd3900d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:02:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd38f7fe700 1 --2- 172.21.15.45:0/960791187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cd8c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd39008bc50 tx=0x7fd384009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c019f13ecdf60d1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd38effd700 1 -- 172.21.15.45:0/960791187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400b8a0 con 0x7fd3900b8580 2023-12-19T18:02:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd38effd700 1 -- 172.21.15.45:0/960791187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38400ba00 con 0x7fd3900b8580 2023-12-19T18:02:41.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd38effd700 1 -- 172.21.15.45:0/960791187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38400bd90 con 0x7fd3900b8580 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 -- 172.21.15.45:0/960791187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 msgr2=0x7fd3900cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 --2- 172.21.15.45:0/960791187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cd8c0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd39008bc50 tx=0x7fd384009bf0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 -- 172.21.15.45:0/960791187 shutdown_connections 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 --2- 172.21.15.45:0/960791187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3900cde00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 --2- 172.21.15.45:0/960791187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cd8c0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 --2- 172.21.15.45:0/960791187 >> v2:172.21.15.73:3300/0 conn(0x7fd39015cf20 0x7fd3900d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 -- 172.21.15.45:0/960791187 >> 172.21.15.45:0/960791187 conn(0x7fd3900b4670 msgr2=0x7fd3900b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 -- 172.21.15.45:0/960791187 shutdown_connections 2023-12-19T18:02:41.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.829+0000 7fd395208700 1 -- 172.21.15.45:0/960791187 wait complete. 2023-12-19T18:02:41.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 Processor -- start 2023-12-19T18:02:41.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 -- start start 2023-12-19T18:02:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3901f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39015cf20 0x7fd3900cc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd390150ad0 con 0x7fd3900b8580 2023-12-19T18:02:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3900caca0 con 0x7fd39015cf20 2023-12-19T18:02:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd395208700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3901514d0 con 0x7fd3900d25f0 2023-12-19T18:02:41.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd38ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53284/0 (socket says 172.21.15.45:53284) 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd38ffff700 1 -- 172.21.15.45:0/2037975578 learned_addr learned my addr 172.21.15.45:0/2037975578 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd38f7fe700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3901f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.833+0000 7fd394a07700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39015cf20 0x7fd3900cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38ffff700 1 -- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 msgr2=0x7fd3901f1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38ffff700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3901f1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38ffff700 1 -- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39015cf20 msgr2=0x7fd3900cc040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38ffff700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39015cf20 0x7fd3900cc040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:41.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38ffff700 1 -- 172.21.15.45:0/2037975578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384009570 con 0x7fd3900b8580 2023-12-19T18:02:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38ffff700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cb990 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c770 tx=0x7fd38000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380011800 con 0x7fd3900b8580 2023-12-19T18:02:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd380011960 con 0x7fd3900b8580 2023-12-19T18:02:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd380011d10 con 0x7fd3900b8580 2023-12-19T18:02:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3901f23c0 con 0x7fd3900b8580 2023-12-19T18:02:41.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3900caeb0 con 0x7fd3900b8580 2023-12-19T18:02:41.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.837+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39004ed30 con 0x7fd3900b8580 2023-12-19T18:02:41.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.841+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd380018360 con 0x7fd3900b8580 2023-12-19T18:02:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.841+0000 7fd38cff9700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd37c065ad0 0x7fd37c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:41.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.841+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fd3800834a0 con 0x7fd3900b8580 2023-12-19T18:02:41.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.841+0000 7fd38f7fe700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd37c065ad0 0x7fd37c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:41.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.841+0000 7fd38f7fe700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd37c065ad0 0x7fd37c067f90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd384000c00 tx=0x7fd384008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:41.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:41.849+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd3800509e0 con 0x7fd3900b8580 2023-12-19T18:02:42.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.037+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3900c94e0 con 0x7fd3900b8580 2023-12-19T18:02:42.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.037+0000 7fd38cff9700 1 -- 172.21.15.45:0/2037975578 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd380054000 con 0x7fd3900b8580 2023-12-19T18:02:42.043 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd37c065ad0 msgr2=0x7fd37c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd37c065ad0 0x7fd37c067f90 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fd384000c00 tx=0x7fd384008030 comp rx=0 tx=0).stop 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 msgr2=0x7fd3900cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cb990 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fd38000c770 tx=0x7fd38000ca80 comp rx=0 tx=0).stop 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 shutdown_connections 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd37c065ad0 0x7fd37c067f90 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd39015cf20 0x7fd3900cc040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd3900d25f0 0x7fd3901f1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 --2- 172.21.15.45:0/2037975578 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd3900b8580 0x7fd3900cb990 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 >> 172.21.15.45:0/2037975578 conn(0x7fd3900b4670 msgr2=0x7fd39015c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 shutdown_connections 2023-12-19T18:02:42.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.041+0000 7fd395208700 1 -- 172.21.15.45:0/2037975578 wait complete. 2023-12-19T18:02:42.072 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:02:42.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.249+0000 7f1779fe1700 1 Processor -- start 2023-12-19T18:02:42.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.249+0000 7f1779fe1700 1 -- start start 2023-12-19T18:02:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f1779fe1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cdfd0 0x7f1774167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f1779fe1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f177415d300 con 0x7f17740b8580 2023-12-19T18:02:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f1779fe1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17740d1550 con 0x7f177415cf20 2023-12-19T18:02:42.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f1779fe1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740d1360 con 0x7f17740cdfd0 2023-12-19T18:02:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f1773fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f17740b8580 0x7f17740cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48784/0 (socket says 172.21.15.45:48784) 2023-12-19T18:02:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f1773fff700 1 -- 172.21.15.45:0/3940205521 learned_addr learned my addr 172.21.15.45:0/3940205521 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17797e0700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cdfd0 0x7f1774167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700160567 0 0) 0x7f177415d300 con 0x7f17740b8580 2023-12-19T18:02:42.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17640035d0 con 0x7f17740b8580 2023-12-19T18:02:42.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681016889 0 0) 0x7f17740d1550 con 0x7f177415cf20 2023-12-19T18:02:42.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f177415d300 con 0x7f177415cf20 2023-12-19T18:02:42.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 768947308 0 0) 0x7f17640035d0 con 0x7f17740b8580 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cdfd0 msgr2=0x7f1774167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cdfd0 0x7f1774167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 >> v1:172.21.15.73:6789/0 conn(0x7f177415cf20 legacy=0x7f17740d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740d1830 con 0x7f17740b8580 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f1760001690 con 0x7f17740b8580 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 >> v1:172.21.15.45:6789/0 conn(0x7f17740b8580 legacy=0x7f17740cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1764003be0 0x7f1764003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1764004870 0x7f1764004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764005230 0x7f176400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176400c020 con 0x7f1764004870 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176400c190 con 0x7f1764005230 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.253+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176400c350 con 0x7f1764003be0 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1764004870 0x7f1764004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1778fdf700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1764003be0 0x7f1764003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f17797e0700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764005230 0x7f176400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 -- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1764003be0 msgr2=0x7f1764003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1764003be0 0x7f1764003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 -- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764005230 msgr2=0x7f176400ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764005230 0x7f176400ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 -- 172.21.15.45:0/3940205521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17640035d0 con 0x7f1764004870 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1773fff700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1764004870 0x7f1764004cf0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1774072550 tx=0x7f17640058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10f1fd1cbaa1974 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000cc90 con 0x7f1764004870 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000cdf0 con 0x7f1764004870 2023-12-19T18:02:42.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f17737fe700 1 -- 172.21.15.45:0/3940205521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760005bc0 con 0x7f1764004870 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1779fe1700 1 -- 172.21.15.45:0/3940205521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1764004870 msgr2=0x7f1764004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1779fe1700 1 --2- 172.21.15.45:0/3940205521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1764004870 0x7f1764004cf0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f1774072550 tx=0x7f17640058a0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f17797e0700 1 -- 172.21.15.45:0/3940205521 reap_dead start 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1779fe1700 1 -- 172.21.15.45:0/3940205521 shutdown_connections 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1779fe1700 1 -- 172.21.15.45:0/3940205521 >> 172.21.15.45:0/3940205521 conn(0x7f17740b4670 msgr2=0x7f17740b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1779fe1700 1 -- 172.21.15.45:0/3940205521 shutdown_connections 2023-12-19T18:02:42.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.257+0000 7f1779fe1700 1 -- 172.21.15.45:0/3940205521 wait complete. 2023-12-19T18:02:42.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 Processor -- start 2023-12-19T18:02:42.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 -- start start 2023-12-19T18:02:42.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764004870 0x7f177414c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 0x7f17740ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cc090 0x7f177414ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740a9880 con 0x7f177415b600 2023-12-19T18:02:42.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17740cadc0 con 0x7f1764004870 2023-12-19T18:02:42.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1779fe1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17740cbc00 con 0x7f17740cc090 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 0x7f17740ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 0x7f17740ca880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53300/0 (socket says 172.21.15.45:53300) 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 -- 172.21.15.45:0/4124492545 learned_addr learned my addr 172.21.15.45:0/4124492545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1778fdf700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764004870 0x7f177414c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f17797e0700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cc090 0x7f177414ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 -- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cc090 msgr2=0x7f177414ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cc090 0x7f177414ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 -- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764004870 msgr2=0x7f177414c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764004870 0x7f177414c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 -- 172.21.15.45:0/4124492545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17740caff0 con 0x7f177415b600 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.261+0000 7f1773fff700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 0x7f17740ca880 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f176400c160 tx=0x7f1760001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760000ed0 con 0x7f177415b600 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600070d0 con 0x7f177415b600 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17740cb2d0 con 0x7f177415b600 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1760007480 con 0x7f177415b600 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17740cb890 con 0x7f177415b600 2023-12-19T18:02:42.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17740cbd70 con 0x7f177415b600 2023-12-19T18:02:42.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.265+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f17600075e0 con 0x7f177415b600 2023-12-19T18:02:42.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.269+0000 7f17717fa700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1758065ad0 0x7f1758067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.269+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f1760084790 con 0x7f177415b600 2023-12-19T18:02:42.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.269+0000 7f1778fdf700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1758065ad0 0x7f1758067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.269+0000 7f1778fdf700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1758065ad0 0x7f1758067f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f17741f56f0 tx=0x7f1768009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:42.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.273+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1760051d60 con 0x7f177415b600 2023-12-19T18:02:42.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.461+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f17740d1ae0 con 0x7f177415b600 2023-12-19T18:02:42.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.465+0000 7f17717fa700 1 -- 172.21.15.45:0/4124492545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1760055380 con 0x7f177415b600 2023-12-19T18:02:42.469 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:02:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1758065ad0 msgr2=0x7f1758067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1758065ad0 0x7f1758067f90 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f17741f56f0 tx=0x7f1768009040 comp rx=0 tx=0).stop 2023-12-19T18:02:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 msgr2=0x7f17740ca880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 0x7f17740ca880 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f176400c160 tx=0x7f1760001950 comp rx=0 tx=0).stop 2023-12-19T18:02:42.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 shutdown_connections 2023-12-19T18:02:42.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1758065ad0 0x7f1758067f90 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17740cc090 0x7f177414ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f177415b600 0x7f17740ca880 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 --2- 172.21.15.45:0/4124492545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1764004870 0x7f177414c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 >> 172.21.15.45:0/4124492545 conn(0x7f17740b4670 msgr2=0x7f177415be80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 shutdown_connections 2023-12-19T18:02:42.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.469+0000 7f1779fe1700 1 -- 172.21.15.45:0/4124492545 wait complete. 2023-12-19T18:02:42.499 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T18:02:42.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 Processor -- start 2023-12-19T18:02:42.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 -- start start 2023-12-19T18:02:42.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f014015d170 0x7f01400ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01400b19f0 0x7f014006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014006efd0 0x7f01400acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0140161710 con 0x7f01400b19f0 2023-12-19T18:02:42.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01401619f0 con 0x7f014015d170 2023-12-19T18:02:42.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.685+0000 7f014750c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01400ac520 con 0x7f014006efd0 2023-12-19T18:02:42.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01400b19f0 0x7f014006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f01400b19f0 0x7f014006ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53314/0 (socket says 172.21.15.45:53314) 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 -- 172.21.15.45:0/2609687689 learned_addr learned my addr 172.21.15.45:0/2609687689 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f01452a8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f014015d170 0x7f01400ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0145aa9700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014006efd0 0x7f01400acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 -- 172.21.15.45:0/2609687689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014006efd0 msgr2=0x7f01400acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014006efd0 0x7f01400acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 -- 172.21.15.45:0/2609687689 >> v2:172.21.15.73:3300/0 conn(0x7f014015d170 msgr2=0x7f01400ada60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 --2- 172.21.15.45:0/2609687689 >> v2:172.21.15.73:3300/0 conn(0x7f014015d170 0x7f01400ada60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 -- 172.21.15.45:0/2609687689 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01400ac800 con 0x7f01400b19f0 2023-12-19T18:02:42.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0145aa9700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014006efd0 0x7f01400acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0144aa7700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400b19f0 0x7f014006ea90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f01400b0e20 tx=0x7f0130009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75893cabb3b94e87 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0137fff700 1 -- 172.21.15.45:0/2609687689 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130011830 con 0x7f01400b19f0 2023-12-19T18:02:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0137fff700 1 -- 172.21.15.45:0/2609687689 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130011990 con 0x7f01400b19f0 2023-12-19T18:02:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f0137fff700 1 -- 172.21.15.45:0/2609687689 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130011d20 con 0x7f01400b19f0 2023-12-19T18:02:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 -- 172.21.15.45:0/2609687689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400b19f0 msgr2=0x7f014006ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400b19f0 0x7f014006ea90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f01400b0e20 tx=0x7f0130009bf0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 -- 172.21.15.45:0/2609687689 shutdown_connections 2023-12-19T18:02:42.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014006efd0 0x7f01400acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 --2- 172.21.15.45:0/2609687689 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f01400b19f0 0x7f014006ea90 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 --2- 172.21.15.45:0/2609687689 >> v2:172.21.15.73:3300/0 conn(0x7f014015d170 0x7f01400ada60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.689+0000 7f014750c700 1 -- 172.21.15.45:0/2609687689 >> 172.21.15.45:0/2609687689 conn(0x7f0140071990 msgr2=0x7f01400b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:42.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.693+0000 7f014750c700 1 -- 172.21.15.45:0/2609687689 shutdown_connections 2023-12-19T18:02:42.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.693+0000 7f014750c700 1 -- 172.21.15.45:0/2609687689 wait complete. 2023-12-19T18:02:42.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.693+0000 7f014750c700 1 Processor -- start 2023-12-19T18:02:42.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.693+0000 7f014750c700 1 -- start start 2023-12-19T18:02:42.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f014750c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 0x7f014014d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f014750c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400b19f0 0x7f0140158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f014750c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015d170 0x7f01401591c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f014750c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01401529b0 con 0x7f014006efd0 2023-12-19T18:02:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f014750c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014014dcb0 con 0x7f01400b19f0 2023-12-19T18:02:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f014750c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0140151000 con 0x7f014015d170 2023-12-19T18:02:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 0x7f014014d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 0x7f014014d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53326/0 (socket says 172.21.15.45:53326) 2023-12-19T18:02:42.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 -- 172.21.15.45:0/3262464563 learned_addr learned my addr 172.21.15.45:0/3262464563 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f0145aa9700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015d170 0x7f01401591c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f0144aa7700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400b19f0 0x7f0140158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 -- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015d170 msgr2=0x7f01401591c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015d170 0x7f01401591c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 -- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400b19f0 msgr2=0x7f0140158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400b19f0 0x7f0140158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 -- 172.21.15.45:0/3262464563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009570 con 0x7f014006efd0 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f0145aa9700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015d170 0x7f01401591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:42.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.697+0000 7f01452a8700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 0x7f014014d770 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e840 tx=0x7f013c00eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:42.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0095a0 con 0x7f014006efd0 2023-12-19T18:02:42.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013c013680 con 0x7f014006efd0 2023-12-19T18:02:42.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140152c00 con 0x7f014006efd0 2023-12-19T18:02:42.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013c0139f0 con 0x7f014006efd0 2023-12-19T18:02:42.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01401531c0 con 0x7f014006efd0 2023-12-19T18:02:42.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014004ed30 con 0x7f014006efd0 2023-12-19T18:02:42.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.701+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f013c013b50 con 0x7f014006efd0 2023-12-19T18:02:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.705+0000 7f0135ffb700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.705+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f013c083460 con 0x7f014006efd0 2023-12-19T18:02:42.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.705+0000 7f0144aa7700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:42.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.705+0000 7f0144aa7700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0130000c00 tx=0x7f0130008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:42.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.709+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f013c050a30 con 0x7f014006efd0 2023-12-19T18:02:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.893+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7f014006cef0 con 0x7f014006efd0 2023-12-19T18:02:42.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.893+0000 7f0135ffb700 1 -- 172.21.15.45:0/3262464563 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v116) v1 ==== 106+0+11 (secure 0 0 0) 0x7f013c054050 con 0x7f014006efd0 2023-12-19T18:02:42.898 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:02:42.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 msgr2=0x7f0124067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0130000c00 tx=0x7f0130008030 comp rx=0 tx=0).stop 2023-12-19T18:02:42.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 msgr2=0x7f014014d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:42.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 0x7f014014d770 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f013c00e840 tx=0x7f013c00eb50 comp rx=0 tx=0).stop 2023-12-19T18:02:42.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 shutdown_connections 2023-12-19T18:02:42.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0124065ad0 0x7f0124067f90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f014015d170 0x7f01401591c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01400b19f0 0x7f0140158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 --2- 172.21.15.45:0/3262464563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f014006efd0 0x7f014014d770 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 >> 172.21.15.45:0/3262464563 conn(0x7f0140071990 msgr2=0x7f0140157600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 shutdown_connections 2023-12-19T18:02:42.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:42.897+0000 7f014750c700 1 -- 172.21.15.45:0/3262464563 wait complete. 2023-12-19T18:02:42.925 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:02:43.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 Processor -- start 2023-12-19T18:02:43.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 -- start start 2023-12-19T18:02:43.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f03a806ea90 0x7f03a80d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a80b88b0 0x7f03a80b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a80b6df0 con 0x7f03a80b6250 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a80d1820 con 0x7f03a806ea90 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ade66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a80d1b00 con 0x7f03a80b88b0 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ad665700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f03a80b6250 0x7f03a80b66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48794/0 (socket says 172.21.15.45:48794) 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ad665700 1 -- 172.21.15.45:0/4067916305 learned_addr learned my addr 172.21.15.45:0/4067916305 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:43.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03ace64700 1 --2- 172.21.15.45:0/4067916305 >> v2:172.21.15.73:3300/0 conn(0x7f03a806ea90 0x7f03a80d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.109+0000 7f03a7fff700 1 --2- 172.21.15.45:0/4067916305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a80b88b0 0x7f03a80b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a77fe700 1 -- 172.21.15.45:0/4067916305 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1763478981 0 0) 0x7f03a80b6df0 con 0x7f03a80b6250 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a77fe700 1 -- 172.21.15.45:0/4067916305 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03980035d0 con 0x7f03a80b6250 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a7fff700 1 -- 172.21.15.45:0/4067916305 >> v2:172.21.15.73:3300/0 conn(0x7f03a806ea90 msgr2=0x7f03a80d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a7fff700 1 --2- 172.21.15.45:0/4067916305 >> v2:172.21.15.73:3300/0 conn(0x7f03a806ea90 0x7f03a80d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a7fff700 1 -- 172.21.15.45:0/4067916305 >> v1:172.21.15.45:6789/0 conn(0x7f03a80b6250 legacy=0x7f03a80b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a7fff700 1 -- 172.21.15.45:0/4067916305 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a80d1de0 con 0x7f03a80b88b0 2023-12-19T18:02:43.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a7fff700 1 --2- 172.21.15.45:0/4067916305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a80b88b0 0x7f03a80b5d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0394009850 tx=0x7f0394009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8635e3885f04b285 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a77fe700 1 -- 172.21.15.45:0/4067916305 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394011830 con 0x7f03a80b88b0 2023-12-19T18:02:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a77fe700 1 -- 172.21.15.45:0/4067916305 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394011990 con 0x7f03a80b88b0 2023-12-19T18:02:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03a77fe700 1 -- 172.21.15.45:0/4067916305 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394011d40 con 0x7f03a80b88b0 2023-12-19T18:02:43.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 -- 172.21.15.45:0/4067916305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a80b88b0 msgr2=0x7f03a80b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 --2- 172.21.15.45:0/4067916305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a80b88b0 0x7f03a80b5d10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0394009850 tx=0x7f0394009b60 comp rx=0 tx=0).stop 2023-12-19T18:02:43.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 -- 172.21.15.45:0/4067916305 shutdown_connections 2023-12-19T18:02:43.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 --2- 172.21.15.45:0/4067916305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a80b88b0 0x7f03a80b5d10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 --2- 172.21.15.45:0/4067916305 >> v2:172.21.15.73:3300/0 conn(0x7f03a806ea90 0x7f03a80d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 -- 172.21.15.45:0/4067916305 >> 172.21.15.45:0/4067916305 conn(0x7f03a80b46d0 msgr2=0x7f03a80b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 -- 172.21.15.45:0/4067916305 shutdown_connections 2023-12-19T18:02:43.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.113+0000 7f03ade66700 1 -- 172.21.15.45:0/4067916305 wait complete. 2023-12-19T18:02:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.117+0000 7f03ade66700 1 Processor -- start 2023-12-19T18:02:43.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.117+0000 7f03ade66700 1 -- start start 2023-12-19T18:02:43.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.117+0000 7f03ade66700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a806ea90 0x7f03a814af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.117+0000 7f03ade66700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 0x7f03a80c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.117+0000 7f03ade66700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a80b88b0 0x7f03a815e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ade66700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815d5f0 con 0x7f03a80b6250 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ade66700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815d8d0 con 0x7f03a80b88b0 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ade66700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a815dbb0 con 0x7f03a806ea90 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 0x7f03a80c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 0x7f03a80c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53330/0 (socket says 172.21.15.45:53330) 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 -- 172.21.15.45:0/27309125 learned_addr learned my addr 172.21.15.45:0/27309125 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ace64700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a806ea90 0x7f03a814af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ad665700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a80b88b0 0x7f03a815e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 -- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a806ea90 msgr2=0x7f03a814af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a806ea90 0x7f03a814af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 -- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a80b88b0 msgr2=0x7f03a815e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a80b88b0 0x7f03a815e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 -- 172.21.15.45:0/27309125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03940094b0 con 0x7f03a80b6250 2023-12-19T18:02:43.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a7fff700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 0x7f03a80c8e20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f03a80d1c40 tx=0x7f0394004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394004480 con 0x7f03a80b6250 2023-12-19T18:02:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a815de90 con 0x7f03a80b6250 2023-12-19T18:02:43.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039401f070 con 0x7f03a80b6250 2023-12-19T18:02:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940038e0 con 0x7f03a80b6250 2023-12-19T18:02:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a814b4b0 con 0x7f03a80b6250 2023-12-19T18:02:43.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.121+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a8067760 con 0x7f03a80b6250 2023-12-19T18:02:43.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.125+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0394021030 con 0x7f03a80b6250 2023-12-19T18:02:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.125+0000 7f03a57fa700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f038c065b00 0x7f038c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.125+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f0394084af0 con 0x7f03a80b6250 2023-12-19T18:02:43.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.125+0000 7f03ace64700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f038c065b00 0x7f038c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.129+0000 7f03ace64700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f038c065b00 0x7f038c067fc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f039c009ae0 tx=0x7f039c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:43.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.129+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0394052040 con 0x7f03a80b6250 2023-12-19T18:02:43.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.321+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f03a815e3b0 con 0x7f03a80b6250 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.321+0000 7f03a57fa700 1 -- 172.21.15.45:0/27309125 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v116) v1 ==== 80+0+364 (secure 0 0 0) 0x7f0394006ce0 con 0x7f03a80b6250 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6834/4041369678 2023-12-20T18:01:54.876335+0000 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6832/1559385747 2023-12-20T18:01:49.122746+0000 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6832/4041369678 2023-12-20T18:01:54.876335+0000 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6834/1559385747 2023-12-20T18:01:49.122746+0000 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6834/723317362 2023-12-20T18:01:48.074941+0000 2023-12-19T18:02:43.328 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6832/723317362 2023-12-20T18:01:48.074941+0000 2023-12-19T18:02:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f038c065b00 msgr2=0x7f038c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f038c065b00 0x7f038c067fc0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f039c009ae0 tx=0x7f039c008040 comp rx=0 tx=0).stop 2023-12-19T18:02:43.330 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 msgr2=0x7f03a80c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 0x7f03a80c8e20 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f03a80d1c40 tx=0x7f0394004770 comp rx=0 tx=0).stop 2023-12-19T18:02:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 shutdown_connections 2023-12-19T18:02:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f038c065b00 0x7f038c067fc0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03a80b88b0 0x7f03a815e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03a80b6250 0x7f03a80c8e20 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 --2- 172.21.15.45:0/27309125 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f03a806ea90 0x7f03a814af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 >> 172.21.15.45:0/27309125 conn(0x7f03a80b46d0 msgr2=0x7f03a80b6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 shutdown_connections 2023-12-19T18:02:43.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.325+0000 7f03ade66700 1 -- 172.21.15.45:0/27309125 wait complete. 2023-12-19T18:02:43.333 INFO:teuthology.orchestra.run.smithi045.stderr:listed 6 entries 2023-12-19T18:02:43.352 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T18:02:43.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:43.352 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T18:02:43.382 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[57013]: fuse finished with error 0 and tester_r 0 2023-12-19T18:02:43.392 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:02:43.393 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:43.393 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:02:43.469 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:02:43.470 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:43.489 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:02:43.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:02:43.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:43.490 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T18:02:43.552 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T18:02:43.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:02:43.554 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:02:43.554 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:43.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:02:43.575 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:02:43.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:43.575 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T18:02:43.633 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T18:02:43.634 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:02:43.634 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:02:43.634 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:43.651 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:02:43.652 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:02:43.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:02:43.652 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T18:02:43.720 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T18:02:43.721 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:02:43.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:02:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.909+0000 7f88b54bf700 1 Processor -- start 2023-12-19T18:02:43.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.909+0000 7f88b54bf700 1 -- start start 2023-12-19T18:02:43.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.909+0000 7f88b54bf700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f88b015d040 0x7f88b00cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88b54bf700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b00b6060 con 0x7f88b015d420 2023-12-19T18:02:43.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88b54bf700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88b006f930 con 0x7f88b006f4a0 2023-12-19T18:02:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88b54bf700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88b006fc10 con 0x7f88b015d040 2023-12-19T18:02:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88af7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f88b015d420 0x7f88b00b6500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48800/0 (socket says 172.21.15.45:48800) 2023-12-19T18:02:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88af7fe700 1 -- 172.21.15.45:0/1298845325 learned_addr learned my addr 172.21.15.45:0/1298845325 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:43.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88aeffd700 1 --2- 172.21.15.45:0/1298845325 >> v2:172.21.15.73:3300/0 conn(0x7f88b015d040 0x7f88b00cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88adffb700 1 -- 172.21.15.45:0/1298845325 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557691356 0 0) 0x7f88b00b6060 con 0x7f88b015d420 2023-12-19T18:02:43.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88adffb700 1 -- 172.21.15.45:0/1298845325 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88980035d0 con 0x7f88b015d420 2023-12-19T18:02:43.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88aeffd700 1 -- 172.21.15.45:0/1298845325 >> v1:172.21.15.73:6789/0 conn(0x7f88b006f4a0 legacy=0x7f88b00d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88aeffd700 1 -- 172.21.15.45:0/1298845325 >> v1:172.21.15.45:6789/0 conn(0x7f88b015d420 legacy=0x7f88b00b6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88aeffd700 1 -- 172.21.15.45:0/1298845325 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b006fef0 con 0x7f88b015d040 2023-12-19T18:02:43.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88aeffd700 1 --2- 172.21.15.45:0/1298845325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d040 0x7f88b00cdf20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009850 tx=0x7f88a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d915d27ceb0b522 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:43.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88adffb700 1 -- 172.21.15.45:0/1298845325 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011830 con 0x7f88b015d040 2023-12-19T18:02:43.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88adffb700 1 -- 172.21.15.45:0/1298845325 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a0011990 con 0x7f88b015d040 2023-12-19T18:02:43.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.913+0000 7f88adffb700 1 -- 172.21.15.45:0/1298845325 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a0011d40 con 0x7f88b015d040 2023-12-19T18:02:43.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 -- 172.21.15.45:0/1298845325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d040 msgr2=0x7f88b00cdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 --2- 172.21.15.45:0/1298845325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d040 0x7f88b00cdf20 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f88a0009850 tx=0x7f88a0009b60 comp rx=0 tx=0).stop 2023-12-19T18:02:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 -- 172.21.15.45:0/1298845325 shutdown_connections 2023-12-19T18:02:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 --2- 172.21.15.45:0/1298845325 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d040 0x7f88b00cdf20 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 -- 172.21.15.45:0/1298845325 >> 172.21.15.45:0/1298845325 conn(0x7f88b00d2e50 msgr2=0x7f88b00d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 -- 172.21.15.45:0/1298845325 shutdown_connections 2023-12-19T18:02:43.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.917+0000 7f88b54bf700 1 -- 172.21.15.45:0/1298845325 wait complete. 2023-12-19T18:02:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 Processor -- start 2023-12-19T18:02:43.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 -- start start 2023-12-19T18:02:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88b015d040 0x7f88b00cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d420 0x7f88b00cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 0x7f88b015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b00cc9b0 con 0x7f88b0149060 2023-12-19T18:02:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01495d0 con 0x7f88b015d420 2023-12-19T18:02:43.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88b54bf700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b01498b0 con 0x7f88b015d040 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 0x7f88b015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88aeffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88b015d040 0x7f88b00cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88ae7fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d420 0x7f88b00cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 0x7f88b015fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53346/0 (socket says 172.21.15.45:53346) 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 -- 172.21.15.45:0/3794446848 learned_addr learned my addr 172.21.15.45:0/3794446848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 -- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88b015d040 msgr2=0x7f88b00cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88b015d040 0x7f88b00cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 -- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d420 msgr2=0x7f88b00cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d420 0x7f88b00cb580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88af7fe700 1 -- 172.21.15.45:0/3794446848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a00094b0 con 0x7f88b0149060 2023-12-19T18:02:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.921+0000 7f88ae7fc700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d420 0x7f88b00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:43.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88af7fe700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 0x7f88b015fd60 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f88a800ca70 tx=0x7f88a800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8007480 con 0x7f88b0149060 2023-12-19T18:02:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88a80075e0 con 0x7f88b0149060 2023-12-19T18:02:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88b0149b90 con 0x7f88b0149060 2023-12-19T18:02:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88a8007950 con 0x7f88b0149060 2023-12-19T18:02:43.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88b014a150 con 0x7f88b0149060 2023-12-19T18:02:43.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.925+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88b004ed30 con 0x7f88b0149060 2023-12-19T18:02:43.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.929+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f88a801b3b0 con 0x7f88b0149060 2023-12-19T18:02:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.929+0000 7f88977fe700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f889c065b00 0x7f889c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:43.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.929+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f88a8082ce0 con 0x7f88b0149060 2023-12-19T18:02:43.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.929+0000 7f88aeffd700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f889c065b00 0x7f889c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:43.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.929+0000 7f88aeffd700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f889c065b00 0x7f889c067fc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f88a00090b0 tx=0x7f88a0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:43.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:43.937+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f88a80502d0 con 0x7f88b0149060 2023-12-19T18:02:44.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.149+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88b014a310 con 0x7f88b0149060 2023-12-19T18:02:44.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.149+0000 7f88977fe700 1 -- 172.21.15.45:0/3794446848 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f88a8017020 con 0x7f88b0149060 2023-12-19T18:02:44.155 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:44.155 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:57.899642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f889c065b00 msgr2=0x7f889c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f889c065b00 0x7f889c067fc0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f88a00090b0 tx=0x7f88a0008030 comp rx=0 tx=0).stop 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 msgr2=0x7f88b015fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 0x7f88b015fd60 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f88a800ca70 tx=0x7f88a800caa0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 shutdown_connections 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f889c065b00 0x7f889c067fc0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f88b0149060 0x7f88b015fd60 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88b015d420 0x7f88b00cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 --2- 172.21.15.45:0/3794446848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f88b015d040 0x7f88b00cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 >> 172.21.15.45:0/3794446848 conn(0x7f88b00d2e50 msgr2=0x7f88b01e72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 shutdown_connections 2023-12-19T18:02:44.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.153+0000 7f88b54bf700 1 -- 172.21.15.45:0/3794446848 wait complete. 2023-12-19T18:02:44.161 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-12-19T18:02:44.181 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:02:44.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 Processor -- start 2023-12-19T18:02:44.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 -- start start 2023-12-19T18:02:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff00415ae50 0x7ff0040cb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0040b1900 0x7ff00415ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0040cb950 con 0x7ff0040b1d60 2023-12-19T18:02:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0040cc4b0 con 0x7ff00415ae50 2023-12-19T18:02:44.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00b4ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0040b0ef0 con 0x7ff0040b1900 2023-12-19T18:02:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00928a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff00415ae50 0x7ff0040cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff008a89700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0040b1900 0x7ff00415ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00928a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff00415ae50 0x7ff0040cb410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53354/0 (socket says 172.21.15.45:53354) 2023-12-19T18:02:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff009a8b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7ff0040b1d60 0x7ff0040ced80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:34022/0 (socket says 172.21.15.45:34022) 2023-12-19T18:02:44.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.353+0000 7ff00928a700 1 -- 172.21.15.45:0/1996700762 learned_addr learned my addr 172.21.15.45:0/1996700762 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:44.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00928a700 1 -- 172.21.15.45:0/1996700762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0040b1900 msgr2=0x7ff00415ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:44.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00928a700 1 --2- 172.21.15.45:0/1996700762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0040b1900 0x7ff00415ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00928a700 1 -- 172.21.15.45:0/1996700762 >> v1:172.21.15.73:6789/0 conn(0x7ff0040b1d60 legacy=0x7ff0040ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00928a700 1 -- 172.21.15.45:0/1996700762 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0040cbc10 con 0x7ff00415ae50 2023-12-19T18:02:44.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00928a700 1 --2- 172.21.15.45:0/1996700762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff00415ae50 0x7ff0040cb410 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e50 tx=0x7ff00000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a4de071f45fa0c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:44.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7feffbfff700 1 -- 172.21.15.45:0/1996700762 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000e070 con 0x7ff00415ae50 2023-12-19T18:02:44.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7feffbfff700 1 -- 172.21.15.45:0/1996700762 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00000b910 con 0x7ff00415ae50 2023-12-19T18:02:44.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7feffbfff700 1 -- 172.21.15.45:0/1996700762 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000bcc0 con 0x7ff00415ae50 2023-12-19T18:02:44.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1996700762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff00415ae50 msgr2=0x7ff0040cb410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1996700762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff00415ae50 0x7ff0040cb410 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7ff000009e50 tx=0x7ff00000b330 comp rx=0 tx=0).stop 2023-12-19T18:02:44.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1996700762 shutdown_connections 2023-12-19T18:02:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1996700762 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff0040b1900 0x7ff00415ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1996700762 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff00415ae50 0x7ff0040cb410 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1996700762 >> 172.21.15.45:0/1996700762 conn(0x7ff0040b26a0 msgr2=0x7ff0040b2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1996700762 shutdown_connections 2023-12-19T18:02:44.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.357+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1996700762 wait complete. 2023-12-19T18:02:44.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.361+0000 7ff00b4ee700 1 Processor -- start 2023-12-19T18:02:44.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.361+0000 7ff00b4ee700 1 -- start start 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 0x7ff0041570b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0040b1d60 0x7ff004071dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff00415ae50 0x7ff0040c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041f6d00 con 0x7ff0040b1900 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041f60f0 con 0x7ff0040b1d60 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0041f63d0 con 0x7ff00415ae50 2023-12-19T18:02:44.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 0x7ff0041570b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 0x7ff0041570b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53358/0 (socket says 172.21.15.45:53358) 2023-12-19T18:02:44.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 -- 172.21.15.45:0/1249493649 learned_addr learned my addr 172.21.15.45:0/1249493649 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff008a89700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0040b1d60 0x7ff004071dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff009a8b700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff00415ae50 0x7ff0040c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 -- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff00415ae50 msgr2=0x7ff0040c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff00415ae50 0x7ff0040c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 -- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0040b1d60 msgr2=0x7ff004071dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0040b1d60 0x7ff004071dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 -- 172.21.15.45:0/1249493649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000009b30 con 0x7ff0040b1900 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00928a700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 0x7ff0041570b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b370 tx=0x7ff000004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff000004960 con 0x7ff0040b1900 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0000092e0 con 0x7ff0040b1900 2023-12-19T18:02:44.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00001c6a0 con 0x7ff0040b1900 2023-12-19T18:02:44.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.365+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0041f66b0 con 0x7ff0040b1900 2023-12-19T18:02:44.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.369+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0041575f0 con 0x7ff0040b1900 2023-12-19T18:02:44.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.369+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00404ed30 con 0x7ff0040b1900 2023-12-19T18:02:44.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.369+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff00001c800 con 0x7ff0040b1900 2023-12-19T18:02:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.373+0000 7feff9ffb700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe8065ad0 0x7fefe8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.373+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7ff000084f90 con 0x7ff0040b1900 2023-12-19T18:02:44.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.373+0000 7ff008a89700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe8065ad0 0x7fefe8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.373+0000 7ff008a89700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe8065ad0 0x7fefe8067f90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff0040af640 tx=0x7feff4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:44.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.381+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff000052560 con 0x7ff0040b1900 2023-12-19T18:02:44.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.561+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0040cfab0 con 0x7ff0040b1900 2023-12-19T18:02:44.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.565+0000 7feff9ffb700 1 -- 172.21.15.45:0/1249493649 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18385 (secure 0 0 0) 0x7ff000055b80 con 0x7ff0040b1900 2023-12-19T18:02:44.570 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:44.570 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":116,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:54.876376+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6834/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6832/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6832/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6834/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6834/723317362":"2023-12-20T18:01:48.074941+0000","172.21.15.73:6832/723317362":"2023-12-20T18:01:48.074941+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:02:44.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe8065ad0 msgr2=0x7fefe8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe8065ad0 0x7fefe8067f90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff0040af640 tx=0x7feff4008040 comp rx=0 tx=0).stop 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 msgr2=0x7ff0041570b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 0x7ff0041570b0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7ff00000b370 tx=0x7ff000004af0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 shutdown_connections 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fefe8065ad0 0x7fefe8067f90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff00415ae50 0x7ff0040c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff0040b1d60 0x7ff004071dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 --2- 172.21.15.45:0/1249493649 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff0040b1900 0x7ff0041570b0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 >> 172.21.15.45:0/1249493649 conn(0x7ff0040b26a0 msgr2=0x7ff0040b49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 shutdown_connections 2023-12-19T18:02:44.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.569+0000 7ff00b4ee700 1 -- 172.21.15.45:0/1249493649 wait complete. 2023-12-19T18:02:44.595 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:01:08.640298+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '106', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:01:10.079199+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_data_extra', 'create_time': '2023-12-19T18:01:20.655255+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:02:44.596 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:02:44.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.789+0000 7f4fbc27b700 1 Processor -- start 2023-12-19T18:02:44.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.789+0000 7f4fbc27b700 1 -- start start 2023-12-19T18:02:44.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fbc27b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fb415d170 0x7f4fb40ada60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fbc27b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4fb40acd20 0x7f4fb40ad170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fbc27b700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb4161710 con 0x7f4fb40b19f0 2023-12-19T18:02:44.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fbc27b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb41619f0 con 0x7f4fb415d170 2023-12-19T18:02:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fbc27b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb40ac520 con 0x7f4fb40acd20 2023-12-19T18:02:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba017700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fb415d170 0x7f4fb40ada60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba017700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4fb415d170 0x7f4fb40ada60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53370/0 (socket says 172.21.15.45:53370) 2023-12-19T18:02:44.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba017700 1 -- 172.21.15.45:0/2108812438 learned_addr learned my addr 172.21.15.45:0/2108812438 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba818700 1 --2- 172.21.15.45:0/2108812438 >> v2:172.21.15.73:3300/0 conn(0x7f4fb40acd20 0x7f4fb40ad170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba017700 1 -- 172.21.15.45:0/2108812438 >> v2:172.21.15.73:3300/0 conn(0x7f4fb40acd20 msgr2=0x7f4fb40ad170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba017700 1 --2- 172.21.15.45:0/2108812438 >> v2:172.21.15.73:3300/0 conn(0x7f4fb40acd20 0x7f4fb40ad170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.793+0000 7f4fba017700 1 -- 172.21.15.45:0/2108812438 >> v1:172.21.15.73:6789/0 conn(0x7f4fb40b19f0 legacy=0x7f4fb406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fba017700 1 -- 172.21.15.45:0/2108812438 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb40ac800 con 0x7f4fb415d170 2023-12-19T18:02:44.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fba017700 1 --2- 172.21.15.45:0/2108812438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb40ada60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40cea10 tx=0x7f4fb0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72026726af7c41d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fb9015700 1 -- 172.21.15.45:0/2108812438 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb0004230 con 0x7f4fb415d170 2023-12-19T18:02:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fb9015700 1 -- 172.21.15.45:0/2108812438 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb0004390 con 0x7f4fb415d170 2023-12-19T18:02:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fb9015700 1 -- 172.21.15.45:0/2108812438 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb00036c0 con 0x7f4fb415d170 2023-12-19T18:02:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2108812438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 msgr2=0x7f4fb40ada60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2108812438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb40ada60 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40cea10 tx=0x7f4fb0009bf0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2108812438 shutdown_connections 2023-12-19T18:02:44.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2108812438 >> v2:172.21.15.73:3300/0 conn(0x7f4fb40acd20 0x7f4fb40ad170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2108812438 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb40ada60 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2108812438 >> 172.21.15.45:0/2108812438 conn(0x7f4fb4071990 msgr2=0x7f4fb40b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:44.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2108812438 shutdown_connections 2023-12-19T18:02:44.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.797+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2108812438 wait complete. 2023-12-19T18:02:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.801+0000 7f4fbc27b700 1 Processor -- start 2023-12-19T18:02:44.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.801+0000 7f4fbc27b700 1 -- start start 2023-12-19T18:02:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb40acd20 0x7f4fb41342b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4fb40b19f0 0x7f4fb4147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb4147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb4137c30 con 0x7f4fb415d170 2023-12-19T18:02:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41f5ce0 con 0x7f4fb40acd20 2023-12-19T18:02:44.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb41f5fc0 con 0x7f4fb40b19f0 2023-12-19T18:02:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb4147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb4147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53386/0 (socket says 172.21.15.45:53386) 2023-12-19T18:02:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 -- 172.21.15.45:0/2903881057 learned_addr learned my addr 172.21.15.45:0/2903881057 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba017700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb40acd20 0x7f4fb41342b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fb9816700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4fb40b19f0 0x7f4fb4147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 -- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4fb40b19f0 msgr2=0x7f4fb4147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4fb40b19f0 0x7f4fb4147020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 -- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb40acd20 msgr2=0x7f4fb41342b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:44.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb40acd20 0x7f4fb41342b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:44.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 -- 172.21.15.45:0/2903881057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb0009570 con 0x7f4fb415d170 2023-12-19T18:02:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fba818700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb4147560 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f4fac007e40 tx=0x7f4fac00e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00ed30 con 0x7f4fb415d170 2023-12-19T18:02:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac014420 con 0x7f4fb415d170 2023-12-19T18:02:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fb41f62a0 con 0x7f4fb415d170 2023-12-19T18:02:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac0147d0 con 0x7f4fb415d170 2023-12-19T18:02:44.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.805+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb414f620 con 0x7f4fb415d170 2023-12-19T18:02:44.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.809+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb40b1e30 con 0x7f4fb415d170 2023-12-19T18:02:44.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.809+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4fac014930 con 0x7f4fb415d170 2023-12-19T18:02:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.813+0000 7f4faaffd700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4f98065ad0 0x7f4f98067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.813+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f4fac083ce0 con 0x7f4fb415d170 2023-12-19T18:02:44.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.813+0000 7f4fba017700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4f98065ad0 0x7f4f98067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:44.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.813+0000 7f4fba017700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4f98065ad0 0x7f4f98067f90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40cea10 tx=0x7f4fb0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:44.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.817+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4fb40b1e30 con 0x7f4fb415d170 2023-12-19T18:02:44.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.993+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4fb41f67c0 con 0x7f4fb415d170 2023-12-19T18:02:44.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.993+0000 7f4faaffd700 1 -- 172.21.15.45:0/2903881057 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4fb41f67c0 con 0x7f4fb415d170 2023-12-19T18:02:44.999 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:02:45.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4f98065ad0 msgr2=0x7f4f98067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4f98065ad0 0x7f4f98067f90 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4fb40cea10 tx=0x7f4fb0008030 comp rx=0 tx=0).stop 2023-12-19T18:02:45.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 msgr2=0x7f4fb4147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb4147560 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f4fac007e40 tx=0x7f4fac00e3c0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 shutdown_connections 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4f98065ad0 0x7f4f98067f90 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4fb415d170 0x7f4fb4147560 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4fb40b19f0 0x7f4fb4147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 --2- 172.21.15.45:0/2903881057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4fb40acd20 0x7f4fb41342b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 >> 172.21.15.45:0/2903881057 conn(0x7f4fb4071990 msgr2=0x7f4fb40af710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:45.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 shutdown_connections 2023-12-19T18:02:45.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:44.997+0000 7f4fbc27b700 1 -- 172.21.15.45:0/2903881057 wait complete. 2023-12-19T18:02:45.026 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:02:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.209+0000 7f644dd97700 1 Processor -- start 2023-12-19T18:02:45.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.209+0000 7f644dd97700 1 -- start start 2023-12-19T18:02:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644dd97700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644dd97700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644815d300 con 0x7f64480cdfd0 2023-12-19T18:02:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644dd97700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64480d1550 con 0x7f64480b8580 2023-12-19T18:02:45.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644dd97700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480d1830 con 0x7f644815cf20 2023-12-19T18:02:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644d596700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f64480cdfd0 0x7f64480b5d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48802/0 (socket says 172.21.15.45:48802) 2023-12-19T18:02:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644d596700 1 -- 172.21.15.45:0/1500315367 learned_addr learned my addr 172.21.15.45:0/1500315367 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:45.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644cd95700 1 --2- 172.21.15.45:0/1500315367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104139160 0 0) 0x7f644815d300 con 0x7f64480cdfd0 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f64380035d0 con 0x7f64480cdfd0 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318960677 0 0) 0x7f64480d1550 con 0x7f64480b8580 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f644815d300 con 0x7f64480b8580 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644cd95700 1 -- 172.21.15.45:0/1500315367 >> v1:172.21.15.73:6789/0 conn(0x7f64480b8580 legacy=0x7f64480cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644cd95700 1 -- 172.21.15.45:0/1500315367 >> v1:172.21.15.45:6789/0 conn(0x7f64480cdfd0 legacy=0x7f64480b5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.213+0000 7f644cd95700 1 -- 172.21.15.45:0/1500315367 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64480d1b10 con 0x7f644815cf20 2023-12-19T18:02:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644cd95700 1 --2- 172.21.15.45:0/1500315367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480d0c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f643c009880 tx=0x7f643c009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b85b6b2d1247cc4d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:45.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011830 con 0x7f644815cf20 2023-12-19T18:02:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c011990 con 0x7f644815cf20 2023-12-19T18:02:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f64477fe700 1 -- 172.21.15.45:0/1500315367 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c011d20 con 0x7f644815cf20 2023-12-19T18:02:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 -- 172.21.15.45:0/1500315367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 msgr2=0x7f64480d0c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 --2- 172.21.15.45:0/1500315367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480d0c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f643c009880 tx=0x7f643c009b90 comp rx=0 tx=0).stop 2023-12-19T18:02:45.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 -- 172.21.15.45:0/1500315367 shutdown_connections 2023-12-19T18:02:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 --2- 172.21.15.45:0/1500315367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480d0c50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 -- 172.21.15.45:0/1500315367 >> 172.21.15.45:0/1500315367 conn(0x7f64480b4670 msgr2=0x7f64480b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 -- 172.21.15.45:0/1500315367 shutdown_connections 2023-12-19T18:02:45.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.217+0000 7f644dd97700 1 -- 172.21.15.45:0/1500315367 wait complete. 2023-12-19T18:02:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 Processor -- start 2023-12-19T18:02:45.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 -- start start 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 0x7f64481f35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64480cdfd0 0x7f64480aa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480abc10 con 0x7f64480b8580 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64480c9d60 con 0x7f64480cdfd0 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644dd97700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64480ca040 con 0x7f644815cf20 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644cd95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 0x7f64481f35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644cd95700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 0x7f64481f35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53396/0 (socket says 172.21.15.45:53396) 2023-12-19T18:02:45.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.221+0000 7f644cd95700 1 -- 172.21.15.45:0/4266958252 learned_addr learned my addr 172.21.15.45:0/4266958252 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644d596700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f6447fff700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64480cdfd0 0x7f64480aa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644cd95700 1 -- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 msgr2=0x7f64480ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644cd95700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644cd95700 1 -- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64480cdfd0 msgr2=0x7f64480aa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644cd95700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64480cdfd0 0x7f64480aa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644cd95700 1 -- 172.21.15.45:0/4266958252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f643c0094b0 con 0x7f64480b8580 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644cd95700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 0x7f64481f35a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f643c013040 tx=0x7f643c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:45.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c019950 con 0x7f64480b8580 2023-12-19T18:02:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c01e070 con 0x7f64480b8580 2023-12-19T18:02:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64480ca320 con 0x7f64480b8580 2023-12-19T18:02:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f643c019cf0 con 0x7f64480b8580 2023-12-19T18:02:45.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64480ab900 con 0x7f64480b8580 2023-12-19T18:02:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.225+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f644804ed30 con 0x7f64480b8580 2023-12-19T18:02:45.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.229+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f643c02d450 con 0x7f64480b8580 2023-12-19T18:02:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.229+0000 7f64457fa700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f642c065ad0 0x7f642c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.229+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f643c084480 con 0x7f64480b8580 2023-12-19T18:02:45.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.229+0000 7f6447fff700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f642c065ad0 0x7f642c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.229+0000 7f6447fff700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f642c065ad0 0x7f642c067f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f64480cef30 tx=0x7f6434009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:45.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.237+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f643c051af0 con 0x7f64480b8580 2023-12-19T18:02:45.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.409+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64480b3400 con 0x7f64480b8580 2023-12-19T18:02:45.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f64457fa700 1 -- 172.21.15.45:0/4266958252 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7f643c055110 con 0x7f64480b8580 2023-12-19T18:02:45.417 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:02:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f642c065ad0 msgr2=0x7f642c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f642c065ad0 0x7f642c067f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f64480cef30 tx=0x7f6434009040 comp rx=0 tx=0).stop 2023-12-19T18:02:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 msgr2=0x7f64481f35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 0x7f64481f35a0 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f643c013040 tx=0x7f643c004770 comp rx=0 tx=0).stop 2023-12-19T18:02:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 shutdown_connections 2023-12-19T18:02:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f642c065ad0 0x7f642c067f90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f644815cf20 0x7f64480ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f64480cdfd0 0x7f64480aa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 --2- 172.21.15.45:0/4266958252 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f64480b8580 0x7f64481f35a0 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 >> 172.21.15.45:0/4266958252 conn(0x7f64480b4670 msgr2=0x7f64480b3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 shutdown_connections 2023-12-19T18:02:45.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.413+0000 7f644dd97700 1 -- 172.21.15.45:0/4266958252 wait complete. 2023-12-19T18:02:45.443 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:02:45.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.621+0000 7fcde5b16700 1 Processor -- start 2023-12-19T18:02:45.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.625+0000 7fcde5b16700 1 -- start start 2023-12-19T18:02:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.625+0000 7fcde5b16700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcde0157350 0x7fcde015d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.625+0000 7fcde5b16700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcde00cf460 0x7fcde00b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.625+0000 7fcde5b16700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde006ede0 con 0x7fcde015e5a0 2023-12-19T18:02:45.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde015d920 con 0x7fcde00cf460 2023-12-19T18:02:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde015e3b0 con 0x7fcde0157350 2023-12-19T18:02:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcde00cf460 0x7fcde00b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde4b14700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcde0157350 0x7fcde015d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcde00cf460 0x7fcde00b34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53406/0 (socket says 172.21.15.45:53406) 2023-12-19T18:02:45.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 -- 172.21.15.45:0/2964731529 learned_addr learned my addr 172.21.15.45:0/2964731529 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 -- 172.21.15.45:0/2964731529 >> v2:172.21.15.73:3300/0 conn(0x7fcde0157350 msgr2=0x7fcde015d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:45.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 --2- 172.21.15.45:0/2964731529 >> v2:172.21.15.73:3300/0 conn(0x7fcde0157350 0x7fcde015d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 -- 172.21.15.45:0/2964731529 >> v1:172.21.15.73:6789/0 conn(0x7fcde015e5a0 legacy=0x7fcde00ced50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 -- 172.21.15.45:0/2964731529 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde015db10 con 0x7fcde00cf460 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5315700 1 --2- 172.21.15.45:0/2964731529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde00b34e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009e50 tx=0x7fcdd800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d9fd7affba9223 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcddf7fe700 1 -- 172.21.15.45:0/2964731529 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800e070 con 0x7fcde00cf460 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcddf7fe700 1 -- 172.21.15.45:0/2964731529 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd800b8d0 con 0x7fcde00cf460 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcddf7fe700 1 -- 172.21.15.45:0/2964731529 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd800bc80 con 0x7fcde00cf460 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- 172.21.15.45:0/2964731529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 msgr2=0x7fcde00b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2964731529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde00b34e0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009e50 tx=0x7fcdd800b330 comp rx=0 tx=0).stop 2023-12-19T18:02:45.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- 172.21.15.45:0/2964731529 shutdown_connections 2023-12-19T18:02:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2964731529 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde00b34e0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2964731529 >> v2:172.21.15.73:3300/0 conn(0x7fcde0157350 0x7fcde015d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- 172.21.15.45:0/2964731529 >> 172.21.15.45:0/2964731529 conn(0x7fcde006a010 msgr2=0x7fcde006a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- 172.21.15.45:0/2964731529 shutdown_connections 2023-12-19T18:02:45.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.629+0000 7fcde5b16700 1 -- 172.21.15.45:0/2964731529 wait complete. 2023-12-19T18:02:45.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.633+0000 7fcde5b16700 1 Processor -- start 2023-12-19T18:02:45.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.633+0000 7fcde5b16700 1 -- start start 2023-12-19T18:02:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde01f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0157350 0x7fcde00ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcde015e5a0 0x7fcde00aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00b0570 con 0x7fcde00cf460 2023-12-19T18:02:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00af4d0 con 0x7fcde0157350 2023-12-19T18:02:45.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00af7b0 con 0x7fcde015e5a0 2023-12-19T18:02:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde01f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde01f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53414/0 (socket says 172.21.15.45:53414) 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 -- 172.21.15.45:0/2366813337 learned_addr learned my addr 172.21.15.45:0/2366813337 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcddffff700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0157350 0x7fcde00ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5315700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcde015e5a0 0x7fcde00aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 -- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcde015e5a0 msgr2=0x7fcde00aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcde015e5a0 0x7fcde00aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 -- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0157350 msgr2=0x7fcde00ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0157350 0x7fcde00ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 -- 172.21.15.45:0/2366813337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd8009b30 con 0x7fcde00cf460 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcddffff700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0157350 0x7fcde00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:45.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde4b14700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde01f1df0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400e9d0 tx=0x7fcdd400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4009720 con 0x7fcde00cf460 2023-12-19T18:02:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd400ee70 con 0x7fcde00cf460 2023-12-19T18:02:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd400ca50 con 0x7fcde00cf460 2023-12-19T18:02:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.637+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde00afa90 con 0x7fcde00cf460 2023-12-19T18:02:45.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.641+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde00b0050 con 0x7fcde00cf460 2023-12-19T18:02:45.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.641+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde0067260 con 0x7fcde00cf460 2023-12-19T18:02:45.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.641+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcdd400cbb0 con 0x7fcde00cf460 2023-12-19T18:02:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.645+0000 7fcddd7fa700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdc4065ad0 0x7fcdc4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.645+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fcdd4083590 con 0x7fcde00cf460 2023-12-19T18:02:45.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.645+0000 7fcddffff700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdc4065ad0 0x7fcdc4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:45.650 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.645+0000 7fcddffff700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdc4065ad0 0x7fcdc4067f90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcde01f5b00 tx=0x7fcdcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:45.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.649+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcdd4050ad0 con 0x7fcde00cf460 2023-12-19T18:02:45.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.833+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcde004ed30 con 0x7fcde00cf460 2023-12-19T18:02:45.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.833+0000 7fcddd7fa700 1 -- 172.21.15.45:0/2366813337 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcdd400ce60 con 0x7fcde00cf460 2023-12-19T18:02:45.838 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.833+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdc4065ad0 msgr2=0x7fcdc4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.833+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdc4065ad0 0x7fcdc4067f90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fcde01f5b00 tx=0x7fcdcc009040 comp rx=0 tx=0).stop 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.833+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 msgr2=0x7fcde01f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.833+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde01f1df0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fcdd400e9d0 tx=0x7fcdd400ece0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 shutdown_connections 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdc4065ad0 0x7fcdc4067f90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcde015e5a0 0x7fcde00aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcde0157350 0x7fcde00ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 --2- 172.21.15.45:0/2366813337 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcde00cf460 0x7fcde01f1df0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 >> 172.21.15.45:0/2366813337 conn(0x7fcde006a010 msgr2=0x7fcde015f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 shutdown_connections 2023-12-19T18:02:45.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:45.837+0000 7fcde5b16700 1 -- 172.21.15.45:0/2366813337 wait complete. 2023-12-19T18:02:45.862 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_extra pg_num 2023-12-19T18:02:46.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.045+0000 7fac6f59e700 1 Processor -- start 2023-12-19T18:02:46.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.045+0000 7fac6f59e700 1 -- start start 2023-12-19T18:02:46.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac700b8580 0x7fac700cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac700d25f0 0x7fac700cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac7015d300 con 0x7fac7015cf20 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700d1360 con 0x7fac700d25f0 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700d1550 con 0x7fac700b8580 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac700d25f0 0x7fac700cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fac700d25f0 0x7fac700cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53418/0 (socket says 172.21.15.45:53418) 2023-12-19T18:02:46.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 -- 172.21.15.45:0/4081407574 learned_addr learned my addr 172.21.15.45:0/4081407574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:46.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6dd9b700 1 --2- 172.21.15.45:0/4081407574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac700b8580 0x7fac700cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 -- 172.21.15.45:0/4081407574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac700b8580 msgr2=0x7fac700cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 --2- 172.21.15.45:0/4081407574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac700b8580 0x7fac700cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 -- 172.21.15.45:0/4081407574 >> v1:172.21.15.73:6789/0 conn(0x7fac7015cf20 legacy=0x7fac700d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 -- 172.21.15.45:0/4081407574 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700d1830 con 0x7fac700d25f0 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6ed9d700 1 --2- 172.21.15.45:0/4081407574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700d25f0 0x7fac700cde00 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fac68009e50 tx=0x7fac6800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3e7a6c56b7673 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6d59a700 1 -- 172.21.15.45:0/4081407574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6800e070 con 0x7fac700d25f0 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6d59a700 1 -- 172.21.15.45:0/4081407574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6800b9c0 con 0x7fac700d25f0 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.049+0000 7fac6d59a700 1 -- 172.21.15.45:0/4081407574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6800bd70 con 0x7fac700d25f0 2023-12-19T18:02:46.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 -- 172.21.15.45:0/4081407574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700d25f0 msgr2=0x7fac700cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 --2- 172.21.15.45:0/4081407574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700d25f0 0x7fac700cde00 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fac68009e50 tx=0x7fac6800b330 comp rx=0 tx=0).stop 2023-12-19T18:02:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 -- 172.21.15.45:0/4081407574 shutdown_connections 2023-12-19T18:02:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 --2- 172.21.15.45:0/4081407574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700d25f0 0x7fac700cde00 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 --2- 172.21.15.45:0/4081407574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac700b8580 0x7fac700cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 -- 172.21.15.45:0/4081407574 >> 172.21.15.45:0/4081407574 conn(0x7fac700b4670 msgr2=0x7fac700b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:46.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 -- 172.21.15.45:0/4081407574 shutdown_connections 2023-12-19T18:02:46.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.053+0000 7fac6f59e700 1 -- 172.21.15.45:0/4081407574 wait complete. 2023-12-19T18:02:46.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 Processor -- start 2023-12-19T18:02:46.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 -- start start 2023-12-19T18:02:46.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 0x7fac7015d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac700d25f0 0x7fac701f1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac7015cf20 0x7fac7015f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7015e550 con 0x7fac700b8580 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac7015da30 con 0x7fac700d25f0 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac7015dcb0 con 0x7fac7015cf20 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 0x7fac7015d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.057+0000 7fac6e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 0x7fac7015d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53428/0 (socket says 172.21.15.45:53428) 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 -- 172.21.15.45:0/1347415189 learned_addr learned my addr 172.21.15.45:0/1347415189 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6dd9b700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac700d25f0 0x7fac701f1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6ed9d700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac7015cf20 0x7fac7015f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 -- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac7015cf20 msgr2=0x7fac7015f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac7015cf20 0x7fac7015f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 -- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac700d25f0 msgr2=0x7fac701f1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac700d25f0 0x7fac701f1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 -- 172.21.15.45:0/1347415189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac68009b30 con 0x7fac700b8580 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6e59c700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 0x7fac7015d4f0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c500 tx=0x7fac6000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600052d0 con 0x7fac700b8580 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac60005430 con 0x7fac700b8580 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac7015df90 con 0x7fac700b8580 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac600055a0 con 0x7fac700b8580 2023-12-19T18:02:46.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac700c9d80 con 0x7fac700b8580 2023-12-19T18:02:46.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.061+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac700c9f70 con 0x7fac700b8580 2023-12-19T18:02:46.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.065+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fac600038e0 con 0x7fac700b8580 2023-12-19T18:02:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.065+0000 7fac5effd700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac50065b00 0x7fac50067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.065+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fac600828c0 con 0x7fac700b8580 2023-12-19T18:02:46.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.065+0000 7fac6dd9b700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac50065b00 0x7fac50067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.069+0000 7fac6dd9b700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac50065b00 0x7fac50067fc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fac700b3d40 tx=0x7fac64008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.069+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fac6004fe90 con 0x7fac700b8580 2023-12-19T18:02:46.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.245+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"} v 0) v1 -- 0x7fac7004ed30 con 0x7fac700b8580 2023-12-19T18:02:46.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.245+0000 7fac5effd700 1 -- 172.21.15.45:0/1347415189 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_extra", "var": "pg_num"}]=0 v116) v1 ==== 106+0+11 (secure 0 0 0) 0x7fac600534b0 con 0x7fac700b8580 2023-12-19T18:02:46.253 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac50065b00 msgr2=0x7fac50067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac50065b00 0x7fac50067fc0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fac700b3d40 tx=0x7fac64008040 comp rx=0 tx=0).stop 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 msgr2=0x7fac7015d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 0x7fac7015d4f0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fac6000c500 tx=0x7fac6000c810 comp rx=0 tx=0).stop 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 shutdown_connections 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fac50065b00 0x7fac50067fc0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fac7015cf20 0x7fac7015f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac700d25f0 0x7fac701f1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 --2- 172.21.15.45:0/1347415189 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fac700b8580 0x7fac7015d4f0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 >> 172.21.15.45:0/1347415189 conn(0x7fac700b4670 msgr2=0x7fac700d0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 shutdown_connections 2023-12-19T18:02:46.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.249+0000 7fac6f59e700 1 -- 172.21.15.45:0/1347415189 wait complete. 2023-12-19T18:02:46.276 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:02:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.465+0000 7fe977263700 1 Processor -- start 2023-12-19T18:02:46.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.465+0000 7fe977263700 1 -- start start 2023-12-19T18:02:46.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe977263700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe970164690 0x7fe9700c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe977263700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe9700c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe977263700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9700cdb80 con 0x7fe9700cce30 2023-12-19T18:02:46.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe977263700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9700cde60 con 0x7fe970164690 2023-12-19T18:02:46.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe977263700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9700ce140 con 0x7fe970164a70 2023-12-19T18:02:46.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe970164690 0x7fe9700c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe970164690 0x7fe9700c3e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53432/0 (socket says 172.21.15.45:53432) 2023-12-19T18:02:46.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 -- 172.21.15.45:0/130949441 learned_addr learned my addr 172.21.15.45:0/130949441 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:46.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe967fff700 1 --2- 172.21.15.45:0/130949441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe9700c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 -- 172.21.15.45:0/130949441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 msgr2=0x7fe9700c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:46.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 --2- 172.21.15.45:0/130949441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe9700c4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 -- 172.21.15.45:0/130949441 >> v1:172.21.15.73:6789/0 conn(0x7fe9700cce30 legacy=0x7fe9700cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 -- 172.21.15.45:0/130949441 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9700ce420 con 0x7fe970164690 2023-12-19T18:02:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.469+0000 7fe974fff700 1 --2- 172.21.15.45:0/130949441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe970164690 0x7fe9700c3e00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009910 tx=0x7fe96c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa1c98ffceb5dc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe9677fe700 1 -- 172.21.15.45:0/130949441 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c011830 con 0x7fe970164690 2023-12-19T18:02:46.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe9677fe700 1 -- 172.21.15.45:0/130949441 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c011990 con 0x7fe970164690 2023-12-19T18:02:46.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe9677fe700 1 -- 172.21.15.45:0/130949441 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c011d40 con 0x7fe970164690 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 -- 172.21.15.45:0/130949441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe970164690 msgr2=0x7fe9700c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 --2- 172.21.15.45:0/130949441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe970164690 0x7fe9700c3e00 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009910 tx=0x7fe96c009c20 comp rx=0 tx=0).stop 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 -- 172.21.15.45:0/130949441 shutdown_connections 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 --2- 172.21.15.45:0/130949441 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe9700c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 --2- 172.21.15.45:0/130949441 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe970164690 0x7fe9700c3e00 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 -- 172.21.15.45:0/130949441 >> 172.21.15.45:0/130949441 conn(0x7fe9700cba40 msgr2=0x7fe9700ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:46.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 -- 172.21.15.45:0/130949441 shutdown_connections 2023-12-19T18:02:46.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 -- 172.21.15.45:0/130949441 wait complete. 2023-12-19T18:02:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.473+0000 7fe977263700 1 Processor -- start 2023-12-19T18:02:46.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 -- start start 2023-12-19T18:02:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 0x7fe970155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970164690 0x7fe970157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe97006f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe970156c40 con 0x7fe9700cce30 2023-12-19T18:02:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701577c0 con 0x7fe970164690 2023-12-19T18:02:46.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe977263700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970156e90 con 0x7fe970164a70 2023-12-19T18:02:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 0x7fe970155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 0x7fe970155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53446/0 (socket says 172.21.15.45:53446) 2023-12-19T18:02:46.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 -- 172.21.15.45:0/2199952187 learned_addr learned my addr 172.21.15.45:0/2199952187 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe967fff700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970164690 0x7fe970157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe975800700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe97006f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 -- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 msgr2=0x7fe97006f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe97006f4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 -- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970164690 msgr2=0x7fe970157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970164690 0x7fe970157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 -- 172.21.15.45:0/2199952187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c009570 con 0x7fe9700cce30 2023-12-19T18:02:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.477+0000 7fe974fff700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 0x7fe970155db0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fe96c000c00 tx=0x7fe96c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c004510 con 0x7fe9700cce30 2023-12-19T18:02:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c0036c0 con 0x7fe9700cce30 2023-12-19T18:02:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe970157170 con 0x7fe9700cce30 2023-12-19T18:02:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c003a70 con 0x7fe9700cce30 2023-12-19T18:02:46.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe970158190 con 0x7fe9700cce30 2023-12-19T18:02:46.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97004ed30 con 0x7fe9700cce30 2023-12-19T18:02:46.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.481+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe96c003bd0 con 0x7fe9700cce30 2023-12-19T18:02:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.485+0000 7fe9657fa700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe95c065b20 0x7fe95c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.485+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fe96c021030 con 0x7fe9700cce30 2023-12-19T18:02:46.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.485+0000 7fe967fff700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe95c065b20 0x7fe95c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.485+0000 7fe967fff700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe95c065b20 0x7fe95c067fe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe9700c6ae0 tx=0x7fe960009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.489+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe96c052120 con 0x7fe9700cce30 2023-12-19T18:02:46.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.713+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe97006c990 con 0x7fe9700cce30 2023-12-19T18:02:46.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.713+0000 7fe9657fa700 1 -- 172.21.15.45:0/2199952187 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fe96c055740 con 0x7fe9700cce30 2023-12-19T18:02:46.718 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:46.719 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:57.899642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:02:46.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe95c065b20 msgr2=0x7fe95c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe95c065b20 0x7fe95c067fe0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fe9700c6ae0 tx=0x7fe960009240 comp rx=0 tx=0).stop 2023-12-19T18:02:46.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 msgr2=0x7fe970155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 0x7fe970155db0 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7fe96c000c00 tx=0x7fe96c004770 comp rx=0 tx=0).stop 2023-12-19T18:02:46.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 shutdown_connections 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe95c065b20 0x7fe95c067fe0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe970164a70 0x7fe97006f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe970164690 0x7fe970157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 --2- 172.21.15.45:0/2199952187 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9700cce30 0x7fe970155db0 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 >> 172.21.15.45:0/2199952187 conn(0x7fe9700cba40 msgr2=0x7fe9700cd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.717+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 shutdown_connections 2023-12-19T18:02:46.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.721+0000 7fe977263700 1 -- 172.21.15.45:0/2199952187 wait complete. 2023-12-19T18:02:46.727 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-12-19T18:02:46.747 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:02:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 Processor -- start 2023-12-19T18:02:46.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 -- start start 2023-12-19T18:02:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbbc1615a0 0x7ffbbc06d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc06dc80 con 0x7ffbbc0af720 2023-12-19T18:02:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc070340 con 0x7ffbbc1615a0 2023-12-19T18:02:46.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbc0c6d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc0c3f90 con 0x7ffbbc1611c0 2023-12-19T18:02:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbbaffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ffbbc1615a0 0x7ffbbc06d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbbbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7ffbbc0af720 0x7ffbbc164f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48804/0 (socket says 172.21.15.45:48804) 2023-12-19T18:02:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbbbfff700 1 -- 172.21.15.45:0/3021698771 learned_addr learned my addr 172.21.15.45:0/3021698771 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:46.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.921+0000 7ffbbb7fe700 1 --2- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbbaffd700 1 -- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 msgr2=0x7ffbbc0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbbaffd700 1 --2- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc0c3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbbaffd700 1 -- 172.21.15.45:0/3021698771 >> v1:172.21.15.45:6789/0 conn(0x7ffbbc0af720 legacy=0x7ffbbc164f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbbaffd700 1 -- 172.21.15.45:0/3021698771 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0c4270 con 0x7ffbbc1615a0 2023-12-19T18:02:46.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbbaffd700 1 --2- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc06d740 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009850 tx=0x7ffbb0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b8831dd86e4169a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbba7fc700 1 -- 172.21.15.45:0/3021698771 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0011830 con 0x7ffbbc1615a0 2023-12-19T18:02:46.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbba7fc700 1 -- 172.21.15.45:0/3021698771 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb0011990 con 0x7ffbbc1615a0 2023-12-19T18:02:46.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbba7fc700 1 -- 172.21.15.45:0/3021698771 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0011d40 con 0x7ffbbc1615a0 2023-12-19T18:02:46.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc1615a0 msgr2=0x7ffbbc06d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc06d740 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0009850 tx=0x7ffbb0009b60 comp rx=0 tx=0).stop 2023-12-19T18:02:46.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/3021698771 shutdown_connections 2023-12-19T18:02:46.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc06d740 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/3021698771 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc0c3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/3021698771 >> 172.21.15.45:0/3021698771 conn(0x7ffbbc0cb900 msgr2=0x7ffbbc0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:46.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/3021698771 shutdown_connections 2023-12-19T18:02:46.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.925+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/3021698771 wait complete. 2023-12-19T18:02:46.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.929+0000 7ffbc0c6d700 1 Processor -- start 2023-12-19T18:02:46.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.929+0000 7ffbc0c6d700 1 -- start start 2023-12-19T18:02:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbc0c6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc0af720 0x7ffbbc0b2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbc0c6d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbc0c6d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc162d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbc0c6d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1f6ec0 con 0x7ffbbc1615a0 2023-12-19T18:02:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbc0c6d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc163400 con 0x7ffbbc0af720 2023-12-19T18:02:46.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbc0c6d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc1f7e70 con 0x7ffbbc1611c0 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc162d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc162800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:33372/0 (socket says 172.21.15.45:33372) 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc162d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53458/0 (socket says 172.21.15.45:53458) 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 -- 172.21.15.45:0/222717879 learned_addr learned my addr 172.21.15.45:0/222717879 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbb7fe700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc0af720 0x7ffbbc0b2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 -- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc0af720 msgr2=0x7ffbbc0b2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc0af720 0x7ffbbc0b2850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 -- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc1615a0 msgr2=0x7ffbbc162d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc162d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 -- 172.21.15.45:0/222717879 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbb00094b0 con 0x7ffbbc1611c0 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.933+0000 7ffbbaffd700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc162800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0014040 tx=0x7ffbb0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.937+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb00036c0 con 0x7ffbbc1611c0 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.937+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb001e070 con 0x7ffbbc1611c0 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.937+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0003a80 con 0x7ffbbc1611c0 2023-12-19T18:02:46.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.937+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc1f70b0 con 0x7ffbbc1611c0 2023-12-19T18:02:46.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.937+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc1f7670 con 0x7ffbbc1611c0 2023-12-19T18:02:46.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.937+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc06e760 con 0x7ffbbc1611c0 2023-12-19T18:02:46.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.941+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffbb0003be0 con 0x7ffbbc1611c0 2023-12-19T18:02:46.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.941+0000 7ffba3fff700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffba8065ad0 0x7ffba8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:46.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.941+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7ffbb0020070 con 0x7ffbbc1611c0 2023-12-19T18:02:46.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.941+0000 7ffbbb7fe700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffba8065ad0 0x7ffba8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:46.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.941+0000 7ffbbb7fe700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffba8065ad0 0x7ffba8067f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0b32c0 tx=0x7ffbac009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:46.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:46.949+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffbb0051f50 con 0x7ffbbc1611c0 2023-12-19T18:02:47.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.133+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbbc067760 con 0x7ffbbc1611c0 2023-12-19T18:02:47.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.133+0000 7ffba3fff700 1 -- 172.21.15.45:0/222717879 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18385 (secure 0 0 0) 0x7ffbb0055570 con 0x7ffbbc1611c0 2023-12-19T18:02:47.139 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:47.139 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":116,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:54.876376+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6834/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6832/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6832/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6834/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6834/723317362":"2023-12-20T18:01:48.074941+0000","172.21.15.73:6832/723317362":"2023-12-20T18:01:48.074941+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffba8065ad0 msgr2=0x7ffba8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffba8065ad0 0x7ffba8067f90 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ffbbc0b32c0 tx=0x7ffbac009240 comp rx=0 tx=0).stop 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 msgr2=0x7ffbbc162800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc162800 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0014040 tx=0x7ffbb0004770 comp rx=0 tx=0).stop 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 shutdown_connections 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffba8065ad0 0x7ffba8067f90 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffbbc1615a0 0x7ffbbc162d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffbbc1611c0 0x7ffbbc162800 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 --2- 172.21.15.45:0/222717879 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffbbc0af720 0x7ffbbc0b2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 >> 172.21.15.45:0/222717879 conn(0x7ffbbc0cb900 msgr2=0x7ffbbc0c9080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:47.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 shutdown_connections 2023-12-19T18:02:47.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.137+0000 7ffbc0c6d700 1 -- 172.21.15.45:0/222717879 wait complete. 2023-12-19T18:02:47.168 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T18:02:47.168 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:02:47.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 Processor -- start 2023-12-19T18:02:47.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 -- start start 2023-12-19T18:02:47.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffad40b88b0 0x7ffad406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad406f3b0 0x7ffad406f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffad40d1820 con 0x7ffad406ea90 2023-12-19T18:02:47.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffad40d1630 con 0x7ffad40b88b0 2023-12-19T18:02:47.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffad970e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40d1b00 con 0x7ffad406f3b0 2023-12-19T18:02:47.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.349+0000 7ffacbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffad40b88b0 0x7ffad406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ffad40b88b0 0x7ffad406ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53470/0 (socket says 172.21.15.45:53470) 2023-12-19T18:02:47.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 -- 172.21.15.45:0/3812581944 learned_addr learned my addr 172.21.15.45:0/3812581944 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:47.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad8f0d700 1 --2- 172.21.15.45:0/3812581944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad406f3b0 0x7ffad406f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 -- 172.21.15.45:0/3812581944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad406f3b0 msgr2=0x7ffad406f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:47.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 --2- 172.21.15.45:0/3812581944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad406f3b0 0x7ffad406f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 -- 172.21.15.45:0/3812581944 >> v1:172.21.15.73:6789/0 conn(0x7ffad406ea90 legacy=0x7ffad40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad37fe700 1 -- 172.21.15.45:0/3812581944 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880856874 0 0) 0x7ffad40d1820 con 0x7ffad406ea90 2023-12-19T18:02:47.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 -- 172.21.15.45:0/3812581944 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffad40d1de0 con 0x7ffad40b88b0 2023-12-19T18:02:47.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffacbfff700 1 --2- 172.21.15.45:0/3812581944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad40b88b0 0x7ffad406ee70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009910 tx=0x7ffabc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d88b2033cd46ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:47.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad37fe700 1 -- 172.21.15.45:0/3812581944 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc011830 con 0x7ffad40b88b0 2023-12-19T18:02:47.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad37fe700 1 -- 172.21.15.45:0/3812581944 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc011990 con 0x7ffad40b88b0 2023-12-19T18:02:47.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad37fe700 1 -- 172.21.15.45:0/3812581944 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc011d40 con 0x7ffad40b88b0 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 -- 172.21.15.45:0/3812581944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad40b88b0 msgr2=0x7ffad406ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 --2- 172.21.15.45:0/3812581944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad40b88b0 0x7ffad406ee70 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7ffabc009910 tx=0x7ffabc009c20 comp rx=0 tx=0).stop 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 -- 172.21.15.45:0/3812581944 shutdown_connections 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 --2- 172.21.15.45:0/3812581944 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad406f3b0 0x7ffad406f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 --2- 172.21.15.45:0/3812581944 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad40b88b0 0x7ffad406ee70 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 -- 172.21.15.45:0/3812581944 >> 172.21.15.45:0/3812581944 conn(0x7ffad40b46d0 msgr2=0x7ffad40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 -- 172.21.15.45:0/3812581944 shutdown_connections 2023-12-19T18:02:47.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.353+0000 7ffad970e700 1 -- 172.21.15.45:0/3812581944 wait complete. 2023-12-19T18:02:47.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 Processor -- start 2023-12-19T18:02:47.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 -- start start 2023-12-19T18:02:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffad406ea90 0x7ffad40c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 0x7ffad4154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad40b88b0 0x7ffad40c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ccca0 con 0x7ffad406f3b0 2023-12-19T18:02:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ca1f0 con 0x7ffad406ea90 2023-12-19T18:02:47.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad970e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffad40ca6e0 con 0x7ffad40b88b0 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 0x7ffad4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 0x7ffad4154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53482/0 (socket says 172.21.15.45:53482) 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffacbfff700 1 -- 172.21.15.45:0/2111034410 learned_addr learned my addr 172.21.15.45:0/2111034410 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad8f0d700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad40b88b0 0x7ffad40c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.357+0000 7ffad3fff700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffad406ea90 0x7ffad40c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffacbfff700 1 -- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad40b88b0 msgr2=0x7ffad40c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffacbfff700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad40b88b0 0x7ffad40c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffacbfff700 1 -- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffad406ea90 msgr2=0x7ffad40c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffacbfff700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffad406ea90 0x7ffad40c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffacbfff700 1 -- 172.21.15.45:0/2111034410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc009570 con 0x7ffad406f3b0 2023-12-19T18:02:47.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffacbfff700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 0x7ffad4154000 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ffad4072a40 tx=0x7ffabc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:47.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc01a8f0 con 0x7ffad406f3b0 2023-12-19T18:02:47.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffabc01e070 con 0x7ffad406f3b0 2023-12-19T18:02:47.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad40c6c20 con 0x7ffad406f3b0 2023-12-19T18:02:47.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffabc01acb0 con 0x7ffad406f3b0 2023-12-19T18:02:47.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad40c71e0 con 0x7ffad406f3b0 2023-12-19T18:02:47.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.361+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad4067760 con 0x7ffad406f3b0 2023-12-19T18:02:47.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.365+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ffabc024400 con 0x7ffad406f3b0 2023-12-19T18:02:47.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.365+0000 7ffad17fa700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffab4065ad0 0x7ffab4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.365+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7ffabc084410 con 0x7ffad406f3b0 2023-12-19T18:02:47.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.365+0000 7ffad3fff700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffab4065ad0 0x7ffab4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.365+0000 7ffad3fff700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffab4065ad0 0x7ffab4067f90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000f60 tx=0x7ffac4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:47.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.369+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ffabc051a80 con 0x7ffad406f3b0 2023-12-19T18:02:47.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.581+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffad40d1020 con 0x7ffad406f3b0 2023-12-19T18:02:47.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.581+0000 7ffad17fa700 1 -- 172.21.15.45:0/2111034410 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4717 (secure 0 0 0) 0x7ffabc006da0 con 0x7ffad406f3b0 2023-12-19T18:02:47.588 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:47.588 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:57.899642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:02:47.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffab4065ad0 msgr2=0x7ffab4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffab4065ad0 0x7ffab4067f90 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ffac4000f60 tx=0x7ffac4009040 comp rx=0 tx=0).stop 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 msgr2=0x7ffad4154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 0x7ffad4154000 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7ffad4072a40 tx=0x7ffabc004770 comp rx=0 tx=0).stop 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 shutdown_connections 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ffab4065ad0 0x7ffab4067f90 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ffad40b88b0 0x7ffad40c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ffad406f3b0 0x7ffad4154000 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 --2- 172.21.15.45:0/2111034410 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffad406ea90 0x7ffad40c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 >> 172.21.15.45:0/2111034410 conn(0x7ffad40b46d0 msgr2=0x7ffad40b2ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 shutdown_connections 2023-12-19T18:02:47.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.585+0000 7ffad970e700 1 -- 172.21.15.45:0/2111034410 wait complete. 2023-12-19T18:02:47.594 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-12-19T18:02:47.617 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:02:47.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 Processor -- start 2023-12-19T18:02:47.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 -- start start 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f11ec06cad0 0x7f11ec15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f11ec0af720 0x7f11ec0afb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11ec06f0a0 con 0x7f11ec15ae20 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec0b00d0 con 0x7f11ec06cad0 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1d77700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11ec06ea90 con 0x7f11ec0af720 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f0d75700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f11ec15ae20 0x7f11ec0c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48818/0 (socket says 172.21.15.45:48818) 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f0d75700 1 -- 172.21.15.45:0/1048736642 learned_addr learned my addr 172.21.15.45:0/1048736642 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:47.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11ebfff700 1 --2- 172.21.15.45:0/1048736642 >> v2:172.21.15.45:3300/0 conn(0x7f11ec06cad0 0x7f11ec15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11f1576700 1 --2- 172.21.15.45:0/1048736642 >> v2:172.21.15.73:3300/0 conn(0x7f11ec0af720 0x7f11ec0afb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11eb7fe700 1 -- 172.21.15.45:0/1048736642 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121697842 0 0) 0x7f11ec06f0a0 con 0x7f11ec15ae20 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.793+0000 7f11eb7fe700 1 -- 172.21.15.45:0/1048736642 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11dc0035d0 con 0x7f11ec15ae20 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11eb7fe700 1 -- 172.21.15.45:0/1048736642 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 512734638 0 0) 0x7f11dc0035d0 con 0x7f11ec15ae20 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11ebfff700 1 -- 172.21.15.45:0/1048736642 >> v2:172.21.15.73:3300/0 conn(0x7f11ec0af720 msgr2=0x7f11ec0afb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11ebfff700 1 --2- 172.21.15.45:0/1048736642 >> v2:172.21.15.73:3300/0 conn(0x7f11ec0af720 0x7f11ec0afb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11ebfff700 1 -- 172.21.15.45:0/1048736642 >> v1:172.21.15.45:6789/0 conn(0x7f11ec15ae20 legacy=0x7f11ec0c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11ebfff700 1 -- 172.21.15.45:0/1048736642 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11ec0c3f60 con 0x7f11ec06cad0 2023-12-19T18:02:47.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11ebfff700 1 --2- 172.21.15.45:0/1048736642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec15be40 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0cc270 tx=0x7f11d8009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abfcd79c197e4e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:47.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11eb7fe700 1 -- 172.21.15.45:0/1048736642 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0001670 con 0x7f11ec06cad0 2023-12-19T18:02:47.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11eb7fe700 1 -- 172.21.15.45:0/1048736642 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d8004030 con 0x7f11ec06cad0 2023-12-19T18:02:47.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11eb7fe700 1 -- 172.21.15.45:0/1048736642 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d80043c0 con 0x7f11ec06cad0 2023-12-19T18:02:47.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 -- 172.21.15.45:0/1048736642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 msgr2=0x7f11ec15be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 --2- 172.21.15.45:0/1048736642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec15be40 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f11ec0cc270 tx=0x7f11d8009b30 comp rx=0 tx=0).stop 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 -- 172.21.15.45:0/1048736642 shutdown_connections 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 --2- 172.21.15.45:0/1048736642 >> v2:172.21.15.73:3300/0 conn(0x7f11ec0af720 0x7f11ec0afb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 --2- 172.21.15.45:0/1048736642 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec15be40 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 -- 172.21.15.45:0/1048736642 >> 172.21.15.45:0/1048736642 conn(0x7f11ec0cb900 msgr2=0x7f11ec0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 -- 172.21.15.45:0/1048736642 shutdown_connections 2023-12-19T18:02:47.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.797+0000 7f11f1d77700 1 -- 172.21.15.45:0/1048736642 wait complete. 2023-12-19T18:02:47.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 Processor -- start 2023-12-19T18:02:47.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 -- start start 2023-12-19T18:02:47.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec14e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11ec0af720 0x7f11ec14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11ec15ae20 0x7f11ec0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec14da20 con 0x7f11ec06cad0 2023-12-19T18:02:47.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec14d4a0 con 0x7f11ec0af720 2023-12-19T18:02:47.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f1d77700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11ec14fcb0 con 0x7f11ec15ae20 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f0d75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec14e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f0d75700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec14e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53508/0 (socket says 172.21.15.45:53508) 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11f0d75700 1 -- 172.21.15.45:0/155722193 learned_addr learned my addr 172.21.15.45:0/155722193 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.801+0000 7f11ebfff700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11ec0af720 0x7f11ec14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f1576700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11ec15ae20 0x7f11ec0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f0d75700 1 -- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11ec15ae20 msgr2=0x7f11ec0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f0d75700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11ec15ae20 0x7f11ec0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f0d75700 1 -- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11ec0af720 msgr2=0x7f11ec14c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:47.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f0d75700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11ec0af720 0x7f11ec14c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:47.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f0d75700 1 -- 172.21.15.45:0/155722193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d80094b0 con 0x7f11ec06cad0 2023-12-19T18:02:47.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f0d75700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec14e400 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f11e000c750 tx=0x7f11e000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:47.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e0004ca0 con 0x7f11ec06cad0 2023-12-19T18:02:47.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11e0004e00 con 0x7f11ec06cad0 2023-12-19T18:02:47.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11e00072d0 con 0x7f11ec06cad0 2023-12-19T18:02:47.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11ec14c940 con 0x7f11ec06cad0 2023-12-19T18:02:47.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.805+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11ec14ff50 con 0x7f11ec06cad0 2023-12-19T18:02:47.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.809+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11ec06f510 con 0x7f11ec06cad0 2023-12-19T18:02:47.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.809+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f11e0007430 con 0x7f11ec06cad0 2023-12-19T18:02:47.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.809+0000 7f11e97fa700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f11d0065ad0 0x7f11d0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:47.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.809+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f11e0083250 con 0x7f11ec06cad0 2023-12-19T18:02:47.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.809+0000 7f11ebfff700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f11d0065ad0 0x7f11d0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:47.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.813+0000 7f11ebfff700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f11d0065ad0 0x7f11d0067f90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f11ec06cf10 tx=0x7f11d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:47.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:47.817+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f11ec06f510 con 0x7f11ec06cad0 2023-12-19T18:02:48.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.029+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f11ec06f510 con 0x7f11ec06cad0 2023-12-19T18:02:48.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.029+0000 7f11e97fa700 1 -- 172.21.15.45:0/155722193 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f11ec06f510 con 0x7f11ec06cad0 2023-12-19T18:02:48.035 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:48.035 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":91,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[{"mdsmap":{"epoch":91,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:01:48.985200+0000","modified":"2023-12-19T18:01:57.899642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":116,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57227},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57227":{"gid":57227,"name":"b","rank":0,"incarnation":88,"state":"up:active","state_seq":4,"addr":"172.21.15.73:6835/280993181","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":280993181},{"type":"v1","addr":"172.21.15.73:6835","nonce":280993181}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15,16],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-19T18:02:48.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f11d0065ad0 msgr2=0x7f11d0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f11d0065ad0 0x7f11d0067f90 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f11ec06cf10 tx=0x7f11d8008030 comp rx=0 tx=0).stop 2023-12-19T18:02:48.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 msgr2=0x7f11ec14e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec14e400 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f11e000c750 tx=0x7f11e000ca60 comp rx=0 tx=0).stop 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 shutdown_connections 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f11d0065ad0 0x7f11d0067f90 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f11ec15ae20 0x7f11ec0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11ec0af720 0x7f11ec14c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 --2- 172.21.15.45:0/155722193 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f11ec06cad0 0x7f11ec14e400 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 >> 172.21.15.45:0/155722193 conn(0x7f11ec0cb900 msgr2=0x7f11ec0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 shutdown_connections 2023-12-19T18:02:48.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.033+0000 7f11f1d77700 1 -- 172.21.15.45:0/155722193 wait complete. 2023-12-19T18:02:48.041 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 91 2023-12-19T18:02:48.061 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:02:48.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.225+0000 7f4ba2107700 1 Processor -- start 2023-12-19T18:02:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.225+0000 7f4ba2107700 1 -- start start 2023-12-19T18:02:48.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba2107700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c1611c0 0x7f4b9c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba2107700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0c3f90 con 0x7f4b9c0af720 2023-12-19T18:02:48.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba2107700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b9c0c4270 con 0x7f4b9c1615a0 2023-12-19T18:02:48.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba2107700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c06eb30 con 0x7f4b9c1611c0 2023-12-19T18:02:48.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1906700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4b9c0af720 0x7f4b9c06f330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48826/0 (socket says 172.21.15.45:48826) 2023-12-19T18:02:48.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1906700 1 -- 172.21.15.45:0/370960458 learned_addr learned my addr 172.21.15.45:0/370960458 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:48.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1105700 1 --2- 172.21.15.45:0/370960458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c1611c0 0x7f4b9c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3408503388 0 0) 0x7f4b9c0c4270 con 0x7f4b9c1615a0 2023-12-19T18:02:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b880035d0 con 0x7f4b9c1615a0 2023-12-19T18:02:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3915025760 0 0) 0x7f4b9c0c3f90 con 0x7f4b9c0af720 2023-12-19T18:02:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4b9c0c4270 con 0x7f4b9c0af720 2023-12-19T18:02:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1105700 1 -- 172.21.15.45:0/370960458 >> v1:172.21.15.73:6789/0 conn(0x7f4b9c1615a0 legacy=0x7f4b9c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1105700 1 -- 172.21.15.45:0/370960458 >> v1:172.21.15.45:6789/0 conn(0x7f4b9c0af720 legacy=0x7f4b9c06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1105700 1 -- 172.21.15.45:0/370960458 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c06ee10 con 0x7f4b9c1611c0 2023-12-19T18:02:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.229+0000 7f4ba1105700 1 --2- 172.21.15.45:0/370960458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c1611c0 0x7f4b9c0c3920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009880 tx=0x7f4b98009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbab30495935e96 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98011830 con 0x7f4b9c1611c0 2023-12-19T18:02:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98011990 con 0x7f4b9c1611c0 2023-12-19T18:02:48.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4b93fff700 1 -- 172.21.15.45:0/370960458 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98011d20 con 0x7f4b9c1611c0 2023-12-19T18:02:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 -- 172.21.15.45:0/370960458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c1611c0 msgr2=0x7f4b9c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 --2- 172.21.15.45:0/370960458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c1611c0 0x7f4b9c0c3920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009880 tx=0x7f4b98009b90 comp rx=0 tx=0).stop 2023-12-19T18:02:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 -- 172.21.15.45:0/370960458 shutdown_connections 2023-12-19T18:02:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 --2- 172.21.15.45:0/370960458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c1611c0 0x7f4b9c0c3920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 -- 172.21.15.45:0/370960458 >> 172.21.15.45:0/370960458 conn(0x7f4b9c0cb900 msgr2=0x7f4b9c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 -- 172.21.15.45:0/370960458 shutdown_connections 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.233+0000 7f4ba2107700 1 -- 172.21.15.45:0/370960458 wait complete. 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 Processor -- start 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 -- start start 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c0af720 0x7f4b9c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b9c1611c0 0x7f4b9c0b25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 0x7f4b9c0b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c8480 con 0x7f4b9c1615a0 2023-12-19T18:02:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c7870 con 0x7f4b9c1611c0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba2107700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c0c7b50 con 0x7f4b9c0af720 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba1906700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 0x7f4b9c0b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba1906700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 0x7f4b9c0b2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53522/0 (socket says 172.21.15.45:53522) 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba1906700 1 -- 172.21.15.45:0/3153173254 learned_addr learned my addr 172.21.15.45:0/3153173254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba0904700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b9c1611c0 0x7f4b9c0b25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.237+0000 7f4ba1105700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c0af720 0x7f4b9c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba1906700 1 -- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c0af720 msgr2=0x7f4b9c148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba1906700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c0af720 0x7f4b9c148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba1906700 1 -- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b9c1611c0 msgr2=0x7f4b9c0b25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba1906700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b9c1611c0 0x7f4b9c0b25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba1906700 1 -- 172.21.15.45:0/3153173254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b980094b0 con 0x7f4b9c1615a0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba1906700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 0x7f4b9c0b2b20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400cb40 tx=0x7f4b9400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b94007500 con 0x7f4b9c1615a0 2023-12-19T18:02:48.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b94007660 con 0x7f4b9c1615a0 2023-12-19T18:02:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c0c7e30 con 0x7f4b9c1615a0 2023-12-19T18:02:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b940079f0 con 0x7f4b9c1615a0 2023-12-19T18:02:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c1490c0 con 0x7f4b9c1615a0 2023-12-19T18:02:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.241+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b9c06e760 con 0x7f4b9c1615a0 2023-12-19T18:02:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.245+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4b9401b3b0 con 0x7f4b9c1615a0 2023-12-19T18:02:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.245+0000 7f4b91ffb700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b80065b00 0x7f4b80067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.245+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7f4b94082e40 con 0x7f4b9c1615a0 2023-12-19T18:02:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.249+0000 7f4ba1105700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b80065b00 0x7f4b80067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.249+0000 7f4ba1105700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b80065b00 0x7f4b80067fc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4b98000c00 tx=0x7f4b9801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:48.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.253+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4b940504b0 con 0x7f4b9c1615a0 2023-12-19T18:02:48.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.433+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b9c067760 con 0x7f4b9c1615a0 2023-12-19T18:02:48.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4b91ffb700 1 -- 172.21.15.45:0/3153173254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+18385 (secure 0 0 0) 0x7f4b94017090 con 0x7f4b9c1615a0 2023-12-19T18:02:48.441 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:48.441 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":116,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:01:54.876376+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:01:08.640298+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"106","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-19T18:01:10.079199+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"107","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_data_extra","create_time":"2023-12-19T18:01:20.655255+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6834/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6832/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6832/4041369678":"2023-12-20T18:01:54.876335+0000","172.21.15.73:6834/1559385747":"2023-12-20T18:01:49.122746+0000","172.21.15.73:6834/723317362":"2023-12-20T18:01:48.074941+0000","172.21.15.73:6832/723317362":"2023-12-20T18:01:48.074941+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b80065b00 msgr2=0x7f4b80067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b80065b00 0x7f4b80067fc0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f4b98000c00 tx=0x7f4b9801c040 comp rx=0 tx=0).stop 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 msgr2=0x7f4b9c0b2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 0x7f4b9c0b2b20 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f4b9400cb40 tx=0x7f4b9400cb70 comp rx=0 tx=0).stop 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 shutdown_connections 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4b80065b00 0x7f4b80067fc0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4b9c1615a0 0x7f4b9c0b2b20 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b9c1611c0 0x7f4b9c0b25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 --2- 172.21.15.45:0/3153173254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4b9c0af720 0x7f4b9c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 >> 172.21.15.45:0/3153173254 conn(0x7f4b9c0cb900 msgr2=0x7f4b9c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:48.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 shutdown_connections 2023-12-19T18:02:48.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.437+0000 7f4ba2107700 1 -- 172.21.15.45:0/3153173254 wait complete. 2023-12-19T18:02:48.466 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:02:48.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.649+0000 7fcb48f51700 1 Processor -- start 2023-12-19T18:02:48.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.649+0000 7fcb48f51700 1 -- start start 2023-12-19T18:02:48.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb48f51700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb440cf720 0x7fcb440ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb48f51700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb44070ac0 con 0x7fcb44070640 2023-12-19T18:02:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb48f51700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb44070d40 con 0x7fcb44160610 2023-12-19T18:02:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb48f51700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb440724f0 con 0x7fcb440cf720 2023-12-19T18:02:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb3bfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcb44070640 0x7fcb440cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:48838/0 (socket says 172.21.15.45:48838) 2023-12-19T18:02:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb3bfff700 1 -- 172.21.15.45:0/3955571007 learned_addr learned my addr 172.21.15.45:0/3955571007 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:48.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb43fff700 1 --2- 172.21.15.45:0/3955571007 >> v2:172.21.15.73:3300/0 conn(0x7fcb440cf720 0x7fcb440ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651626032 0 0) 0x7fcb44070ac0 con 0x7fcb44070640 2023-12-19T18:02:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb300035d0 con 0x7fcb44070640 2023-12-19T18:02:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3683704477 0 0) 0x7fcb44070d40 con 0x7fcb44160610 2023-12-19T18:02:48.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb44070ac0 con 0x7fcb44160610 2023-12-19T18:02:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb43fff700 1 -- 172.21.15.45:0/3955571007 >> v1:172.21.15.73:6789/0 conn(0x7fcb44160610 legacy=0x7fcb44071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb43fff700 1 -- 172.21.15.45:0/3955571007 >> v1:172.21.15.45:6789/0 conn(0x7fcb44070640 legacy=0x7fcb440cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb43fff700 1 -- 172.21.15.45:0/3955571007 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb44071020 con 0x7fcb440cf720 2023-12-19T18:02:48.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb43fff700 1 --2- 172.21.15.45:0/3955571007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb440cf720 0x7fcb440ccda0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009d90 tx=0x7fcb3c00b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=328b2a6cd2f0c1a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00e070 con 0x7fcb440cf720 2023-12-19T18:02:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00bb20 con 0x7fcb440cf720 2023-12-19T18:02:48.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.653+0000 7fcb42ffd700 1 -- 172.21.15.45:0/3955571007 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c012430 con 0x7fcb440cf720 2023-12-19T18:02:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 -- 172.21.15.45:0/3955571007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb440cf720 msgr2=0x7fcb440ccda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 --2- 172.21.15.45:0/3955571007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb440cf720 0x7fcb440ccda0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009d90 tx=0x7fcb3c00b330 comp rx=0 tx=0).stop 2023-12-19T18:02:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 -- 172.21.15.45:0/3955571007 shutdown_connections 2023-12-19T18:02:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 --2- 172.21.15.45:0/3955571007 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb440cf720 0x7fcb440ccda0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 -- 172.21.15.45:0/3955571007 >> 172.21.15.45:0/3955571007 conn(0x7fcb440d0ac0 msgr2=0x7fcb440d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 -- 172.21.15.45:0/3955571007 shutdown_connections 2023-12-19T18:02:48.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 -- 172.21.15.45:0/3955571007 wait complete. 2023-12-19T18:02:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.657+0000 7fcb48f51700 1 Processor -- start 2023-12-19T18:02:48.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 -- start start 2023-12-19T18:02:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb44070640 0x7fcb441f2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb440cf720 0x7fcb44153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 0x7fcb4414fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44156df0 con 0x7fcb44160610 2023-12-19T18:02:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb441f37c0 con 0x7fcb44070640 2023-12-19T18:02:48.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb48f51700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb440b40f0 con 0x7fcb440cf720 2023-12-19T18:02:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 0x7fcb4414fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb3bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb440cf720 0x7fcb44153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb437fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb44070640 0x7fcb441f2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 0x7fcb4414fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:53538/0 (socket says 172.21.15.45:53538) 2023-12-19T18:02:48.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 -- 172.21.15.45:0/4027578102 learned_addr learned my addr 172.21.15.45:0/4027578102 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 -- 172.21.15.45:0/4027578102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb440cf720 msgr2=0x7fcb44153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb440cf720 0x7fcb44153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 -- 172.21.15.45:0/4027578102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb44070640 msgr2=0x7fcb441f2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb44070640 0x7fcb441f2b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 -- 172.21.15.45:0/4027578102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c009a70 con 0x7fcb44160610 2023-12-19T18:02:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.661+0000 7fcb43fff700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 0x7fcb4414fbb0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c013000 tx=0x7fcb3c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.665+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c012430 con 0x7fcb44160610 2023-12-19T18:02:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.665+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c020070 con 0x7fcb44160610 2023-12-19T18:02:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.665+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb44156270 con 0x7fcb44160610 2023-12-19T18:02:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.665+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c01ba50 con 0x7fcb44160610 2023-12-19T18:02:48.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.665+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb44156830 con 0x7fcb44160610 2023-12-19T18:02:48.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.665+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb440caf10 con 0x7fcb44160610 2023-12-19T18:02:48.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.669+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcb3c01bbb0 con 0x7fcb44160610 2023-12-19T18:02:48.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.669+0000 7fcb40ff9700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb24065b20 0x7fcb24067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:48.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.669+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 6691+0+0 (secure 0 0 0) 0x7fcb3c022070 con 0x7fcb44160610 2023-12-19T18:02:48.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.669+0000 7fcb437fe700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb24065b20 0x7fcb24067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:48.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.673+0000 7fcb437fe700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb24065b20 0x7fcb24067fe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcb340011e0 tx=0x7fcb34009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:48.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.677+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcb3c052dd0 con 0x7fcb44160610 2023-12-19T18:02:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.889+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fcb440b3f50 con 0x7fcb44160610 2023-12-19T18:02:48.897 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:02:48.893+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:02:48.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.909+0000 7fcb40ff9700 1 -- 172.21.15.45:0/4027578102 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v92) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcb440b3f50 con 0x7fcb44160610 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb24065b20 msgr2=0x7fcb24067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb24065b20 0x7fcb24067fe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fcb340011e0 tx=0x7fcb34009040 comp rx=0 tx=0).stop 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 msgr2=0x7fcb4414fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 0x7fcb4414fbb0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c013000 tx=0x7fcb3c004af0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 shutdown_connections 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb24065b20 0x7fcb24067fe0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb44160610 0x7fcb4414fbb0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb440cf720 0x7fcb44153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 --2- 172.21.15.45:0/4027578102 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb44070640 0x7fcb441f2b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 >> 172.21.15.45:0/4027578102 conn(0x7fcb440d0ac0 msgr2=0x7fcb440ce8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 shutdown_connections 2023-12-19T18:02:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:48.913+0000 7fcb48f51700 1 -- 172.21.15.45:0/4027578102 wait complete. 2023-12-19T18:02:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:02:48.924 INFO:tasks.ceph.mds.b.smithi073.stderr: -6356> 2023-12-19T18:01:54.907+0000 7f4a41173700 -1 mds.0.openfiles _load_finish got (2) No such file or directory 2023-12-19T18:02:48.928 INFO:tasks.ceph.mds.b.smithi073.stderr: -4909> 2023-12-19T18:01:59.899+0000 7f4a4497a700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:02:48.929 INFO:tasks.ceph.mds.b.smithi073.stderr: -4450> 2023-12-19T18:02:03.730+0000 7f4a41173700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x4 2023-12-19T18:02:48.929 INFO:tasks.ceph.mds.b.smithi073.stderr: -4406> 2023-12-19T18:02:03.734+0000 7f4a41173700 -1 log_channel(cluster) log [ERR] : bad backtrace on directory inode 0x10000000000 2023-12-19T18:02:48.930 INFO:tasks.ceph.mds.b.smithi073.stderr: -4244> 2023-12-19T18:02:03.734+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x4 [...2,head] /lost+found/ auth v1 pv4 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559bc7b6e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x4:[<0x1/lost+found v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:02:48.930 INFO:tasks.ceph.mds.b.smithi073.stderr: -4135> 2023-12-19T18:02:03.734+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /stripey/ auth v1 pv6 ap=3 DIRTYPARENT f(v0 1=1+0) n() (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x559bc7b6e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x10000000000:[<0x1/stripey v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 1=1+0)","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 1=1+0)","memory_value.rstat":"n()","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3942> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fb [2,head] /stripey/flushed_file_6 auth v1 ap=1 DIRTYPARENT s=1572864 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7ba5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001fb:[<0x10000000000/flushed_file_6 v68>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001fb:[<0x10000000000/flushed_file_6 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3919> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f8 [2,head] /stripey/flushed_file_3 auth v1 ap=1 DIRTYPARENT s=917503 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f8:[<0x10000000000/flushed_file_3 v64>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f8:[<0x10000000000/flushed_file_3 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3895> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f9 [2,head] /stripey/flushed_file_4 auth v1 ap=1 DIRTYPARENT s=1441792 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f9:[<0x10000000000/flushed_file_4 v70>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f9:[<0x10000000000/flushed_file_4 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3812> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f7 [2,head] /stripey/flushed_file_2 auth v1 ap=1 DIRTYPARENT s=917504 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f7:[<0x10000000000/flushed_file_2 v56>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f7:[<0x10000000000/flushed_file_2 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3791> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fc [2,head] /lost+found/100000001fc auth v1 ap=1 DIRTYPARENT s=524288 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7ba4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(16)0x100000001fc:[<0x4/100000001fc v1>,<0x1/lost+found v1>]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":-61} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3775> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001fa [2,head] /stripey/flushed_file_5 auth v1 ap=1 DIRTYPARENT s=1441793 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7ba5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001fa:[<0x10000000000/flushed_file_5 v54>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001fa:[<0x10000000000/flushed_file_5 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3759> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x100000001f6 [2,head] /stripey/flushed_file_1 auth v1 ap=1 DIRTYPARENT s=524288 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x100000001f6:[<0x10000000000/flushed_file_1 v44>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x100000001f6:[<0x10000000000/flushed_file_1 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.932 INFO:tasks.ceph.mds.b.smithi073.stderr: -3742> 2023-12-19T18:02:03.738+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /stripey/flushed_file_0 auth v1 ap=1 DIRTYPARENT s=1048576 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x559bc7bf2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(16)0x10000000001:[<0x10000000000/flushed_file_0 v38>,<0x1/stripey v75>]//[15]","memoryvalue":"(16)0x10000000001:[<0x10000000000/flushed_file_0 v1>,<0x1/stripey v1>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-12-19T18:02:48.933 INFO:tasks.ceph.mds.b.smithi073.stderr: -3362> 2023-12-19T18:02:03.746+0000 7f4a41173700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1 [...2,head] / auth v7 ap=5 snaprealm=0x559bc7b76d80 DIRTYPARENT f(v1 2=0+2) n(v0 rc2023-12-19T18:02:03.384801+0000 2=0+2)/n() (idft sync r=1) (inest sync r=1) (ifile sync->mix r=1) (iversion lock) caps={8604=pLsXs/-@3} | dirtyscattered=0 request=0 lock=3 dirfrag=1 caps=1 openingsnapparents=0 dirtyparent=1 dirty=1 waiter=1 authpin=1 scrubqueue=0 0x559bc7b6d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-61,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(14)0x1:[]//[]","error_str":"failed to read off disk; see retval"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 2=0+2)","ondisk_value.rstat":"n(v0 3=0+3)","memory_value.dirstat":"f(v1 2=0+2)","memory_value.rstat":"n(v0 rc2023-12-19T18:02:03.384801+0000 2=0+2)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-61} 2023-12-19T18:02:48.940 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T18:02:48.989 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:02:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.125+0000 7fdd520d3700 1 Processor -- start 2023-12-19T18:02:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.125+0000 7fdd520d3700 1 -- start start 2023-12-19T18:02:49.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.125+0000 7fdd520d3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fdd4c0713d0 0x7fdd4c071860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:49.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.125+0000 7fdd520d3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c0b2a40 con 0x7fdd4c159a40 2023-12-19T18:02:49.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.125+0000 7fdd520d3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd4c0b2c90 con 0x7fdd4c0ccd70 2023-12-19T18:02:49.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.125+0000 7fdd520d3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4c0ccb50 con 0x7fdd4c0713d0 2023-12-19T18:02:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd510d1700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fdd4c159a40 0x7fdd4c0ae090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46776/0 (socket says 172.21.15.45:46776) 2023-12-19T18:02:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd510d1700 1 -- 172.21.15.45:0/2149042769 learned_addr learned my addr 172.21.15.45:0/2149042769 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd508d0700 1 --2- 172.21.15.45:0/2149042769 >> v2:172.21.15.73:3300/0 conn(0x7fdd4c0713d0 0x7fdd4c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd508d0700 1 -- 172.21.15.45:0/2149042769 >> v1:172.21.15.73:6789/0 conn(0x7fdd4c0ccd70 legacy=0x7fdd4c0cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd508d0700 1 -- 172.21.15.45:0/2149042769 >> v1:172.21.15.45:6789/0 conn(0x7fdd4c159a40 legacy=0x7fdd4c0ae090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd508d0700 1 -- 172.21.15.45:0/2149042769 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c0b2f70 con 0x7fdd4c0713d0 2023-12-19T18:02:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd43fff700 1 -- 172.21.15.45:0/2149042769 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4196126508 0 0) 0x7fdd4c0b2a40 con 0x7fdd4c159a40 2023-12-19T18:02:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd508d0700 1 --2- 172.21.15.45:0/2149042769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0713d0 0x7fdd4c071860 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009850 tx=0x7fdd3c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bc233fe86bff9d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd43fff700 1 -- 172.21.15.45:0/2149042769 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c011830 con 0x7fdd4c0713d0 2023-12-19T18:02:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd43fff700 1 -- 172.21.15.45:0/2149042769 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c011990 con 0x7fdd4c0713d0 2023-12-19T18:02:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd43fff700 1 -- 172.21.15.45:0/2149042769 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c011d20 con 0x7fdd4c0713d0 2023-12-19T18:02:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd520d3700 1 -- 172.21.15.45:0/2149042769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0713d0 msgr2=0x7fdd4c071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.129+0000 7fdd520d3700 1 --2- 172.21.15.45:0/2149042769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0713d0 0x7fdd4c071860 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c009850 tx=0x7fdd3c009b60 comp rx=0 tx=0).stop 2023-12-19T18:02:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.133+0000 7fdd520d3700 1 -- 172.21.15.45:0/2149042769 shutdown_connections 2023-12-19T18:02:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.133+0000 7fdd520d3700 1 --2- 172.21.15.45:0/2149042769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c0713d0 0x7fdd4c071860 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.133+0000 7fdd520d3700 1 -- 172.21.15.45:0/2149042769 >> 172.21.15.45:0/2149042769 conn(0x7fdd4c0cf5a0 msgr2=0x7fdd4c070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.133+0000 7fdd520d3700 1 -- 172.21.15.45:0/2149042769 shutdown_connections 2023-12-19T18:02:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.133+0000 7fdd520d3700 1 -- 172.21.15.45:0/2149042769 wait complete. 2023-12-19T18:02:49.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 Processor -- start 2023-12-19T18:02:49.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 -- start start 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd4c0ccd70 0x7fdd4c15aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 0x7fdd4c15af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c06d8d0 0x7fdd4c14e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c152e50 con 0x7fdd4c159a40 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c153130 con 0x7fdd4c06d8d0 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd520d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c153410 con 0x7fdd4c0ccd70 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 0x7fdd4c15af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 0x7fdd4c15af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34166/0 (socket says 172.21.15.45:34166) 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 -- 172.21.15.45:0/3466758883 learned_addr learned my addr 172.21.15.45:0/3466758883 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd510d1700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd4c0ccd70 0x7fdd4c15aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd518d2700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c06d8d0 0x7fdd4c14e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 -- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd4c0ccd70 msgr2=0x7fdd4c15aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd4c0ccd70 0x7fdd4c15aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 -- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c06d8d0 msgr2=0x7fdd4c14e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c06d8d0 0x7fdd4c14e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 -- 172.21.15.45:0/3466758883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3c0094b0 con 0x7fdd4c159a40 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd510d1700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd4c0ccd70 0x7fdd4c15aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd508d0700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 0x7fdd4c15af80 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0090b0 tx=0x7fdd3c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c00bb60 con 0x7fdd4c159a40 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3c01f070 con 0x7fdd4c159a40 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.137+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3c01a430 con 0x7fdd4c159a40 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.141+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c1536f0 con 0x7fdd4c159a40 2023-12-19T18:02:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.141+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c14b950 con 0x7fdd4c159a40 2023-12-19T18:02:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.141+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c04ed30 con 0x7fdd4c159a40 2023-12-19T18:02:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.141+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fdd3c01a590 con 0x7fdd4c159a40 2023-12-19T18:02:49.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.145+0000 7fdd41ffb700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd30065b50 0x7fdd30068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:49.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.145+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fdd3c021070 con 0x7fdd4c159a40 2023-12-19T18:02:49.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.145+0000 7fdd510d1700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd30065b50 0x7fdd30068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:49.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.145+0000 7fdd510d1700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd30065b50 0x7fdd30068010 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdd48004920 tx=0x7fdd48008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:49.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.149+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fdd3c052300 con 0x7fdd4c159a40 2023-12-19T18:02:49.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.369+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdd4c0cb8d0 con 0x7fdd4c159a40 2023-12-19T18:02:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.917+0000 7fdd41ffb700 1 -- 172.21.15.45:0/3466758883 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v93) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdd3c055920 con 0x7fdd4c159a40 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd30065b50 msgr2=0x7fdd30068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd30065b50 0x7fdd30068010 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fdd48004920 tx=0x7fdd48008040 comp rx=0 tx=0).stop 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 msgr2=0x7fdd4c15af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 0x7fdd4c15af80 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c0090b0 tx=0x7fdd3c004770 comp rx=0 tx=0).stop 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 shutdown_connections 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fdd30065b50 0x7fdd30068010 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdd4c06d8d0 0x7fdd4c14e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fdd4c159a40 0x7fdd4c15af80 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 --2- 172.21.15.45:0/3466758883 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fdd4c0ccd70 0x7fdd4c15aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 >> 172.21.15.45:0/3466758883 conn(0x7fdd4c0713d0 msgr2=0x7fdd4c0af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 shutdown_connections 2023-12-19T18:02:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:49.921+0000 7fdd520d3700 1 -- 172.21.15.45:0/3466758883 wait complete. 2023-12-19T18:02:49.951 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T18:02:50.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.137+0000 7fbace808700 1 Processor -- start 2023-12-19T18:02:50.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.137+0000 7fbace808700 1 -- start start 2023-12-19T18:02:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbace808700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbac815ccb0 0x7fbac80b8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbace808700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac80d2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbace808700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbac80d15b0 con 0x7fbac815d090 2023-12-19T18:02:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbace808700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbac80d2b90 con 0x7fbac815ccb0 2023-12-19T18:02:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbace808700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac80d1890 con 0x7fbac8071160 2023-12-19T18:02:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbacd005700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fbac815d090 0x7fbac8070a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46782/0 (socket says 172.21.15.45:46782) 2023-12-19T18:02:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbacd005700 1 -- 172.21.15.45:0/1700434106 learned_addr learned my addr 172.21.15.45:0/1700434106 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbacd806700 1 --2- 172.21.15.45:0/1700434106 >> v2:172.21.15.45:3300/0 conn(0x7fbac815ccb0 0x7fbac80b8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.141+0000 7fbace007700 1 --2- 172.21.15.45:0/1700434106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac80d2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:50.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace007700 1 -- 172.21.15.45:0/1700434106 >> v2:172.21.15.45:3300/0 conn(0x7fbac815ccb0 msgr2=0x7fbac80b8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:50.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace007700 1 --2- 172.21.15.45:0/1700434106 >> v2:172.21.15.45:3300/0 conn(0x7fbac815ccb0 0x7fbac80b8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace007700 1 -- 172.21.15.45:0/1700434106 >> v1:172.21.15.45:6789/0 conn(0x7fbac815d090 legacy=0x7fbac8070a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:50.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace007700 1 -- 172.21.15.45:0/1700434106 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac80d1b70 con 0x7fbac8071160 2023-12-19T18:02:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace007700 1 --2- 172.21.15.45:0/1700434106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac80d2650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009d90 tx=0x7fbac000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de862bdefb3f4034 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbacc804700 1 -- 172.21.15.45:0/1700434106 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac000e070 con 0x7fbac8071160 2023-12-19T18:02:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbacc804700 1 -- 172.21.15.45:0/1700434106 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac000bb20 con 0x7fbac8071160 2023-12-19T18:02:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbacc804700 1 -- 172.21.15.45:0/1700434106 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0012430 con 0x7fbac8071160 2023-12-19T18:02:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 -- 172.21.15.45:0/1700434106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 msgr2=0x7fbac80d2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 --2- 172.21.15.45:0/1700434106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac80d2650 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbac0009d90 tx=0x7fbac000b330 comp rx=0 tx=0).stop 2023-12-19T18:02:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 -- 172.21.15.45:0/1700434106 shutdown_connections 2023-12-19T18:02:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 --2- 172.21.15.45:0/1700434106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac80d2650 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 --2- 172.21.15.45:0/1700434106 >> v2:172.21.15.45:3300/0 conn(0x7fbac815ccb0 0x7fbac80b8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 -- 172.21.15.45:0/1700434106 >> 172.21.15.45:0/1700434106 conn(0x7fbac80d2f50 msgr2=0x7fbac80d3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 -- 172.21.15.45:0/1700434106 shutdown_connections 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.145+0000 7fbace808700 1 -- 172.21.15.45:0/1700434106 wait complete. 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 Processor -- start 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 -- start start 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac8151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbac815ccb0 0x7fbac80b7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 0x7fbac8150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8154340 con 0x7fbac815d090 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8154590 con 0x7fbac815ccb0 2023-12-19T18:02:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace808700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac8154870 con 0x7fbac8071160 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 0x7fbac8150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 0x7fbac8150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34190/0 (socket says 172.21.15.45:34190) 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 -- 172.21.15.45:0/2628293945 learned_addr learned my addr 172.21.15.45:0/2628293945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbacd806700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac8151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbacd005700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbac815ccb0 0x7fbac80b7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 -- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 msgr2=0x7fbac8151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac8151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 -- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbac815ccb0 msgr2=0x7fbac80b7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbac815ccb0 0x7fbac80b7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 -- 172.21.15.45:0/2628293945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0009a70 con 0x7fbac815d090 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbacd005700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbac815ccb0 0x7fbac80b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:02:50.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbace007700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 0x7fbac8150390 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fbac0014040 tx=0x7fbac0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.149+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0012430 con 0x7fbac815d090 2023-12-19T18:02:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.153+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbac0020070 con 0x7fbac815d090 2023-12-19T18:02:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.153+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbac8154b50 con 0x7fbac815d090 2023-12-19T18:02:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.153+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbac0004280 con 0x7fbac815d090 2023-12-19T18:02:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.153+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbac8152100 con 0x7fbac815d090 2023-12-19T18:02:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.153+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbac8067c10 con 0x7fbac815d090 2023-12-19T18:02:50.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.153+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbac00043e0 con 0x7fbac815d090 2023-12-19T18:02:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.157+0000 7fbabe7fc700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbaac065ad0 0x7fbaac067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.157+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6777+0+0 (secure 0 0 0) 0x7fbac0022070 con 0x7fbac815d090 2023-12-19T18:02:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.157+0000 7fbacd806700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbaac065ad0 0x7fbaac067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:50.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.157+0000 7fbacd806700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbaac065ad0 0x7fbaac067f90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009b80 tx=0x7fbac4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:50.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.161+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbac0052880 con 0x7fbac815d090 2023-12-19T18:02:50.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.337+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbac804ed30 con 0x7fbac815d090 2023-12-19T18:02:50.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.929+0000 7fbabe7fc700 1 -- 172.21.15.45:0/2628293945 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v118) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbac0055ea0 con 0x7fbac815d090 2023-12-19T18:02:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbaac065ad0 msgr2=0x7fbaac067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbaac065ad0 0x7fbaac067f90 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbac4009b80 tx=0x7fbac4008040 comp rx=0 tx=0).stop 2023-12-19T18:02:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 msgr2=0x7fbac8150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:50.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 0x7fbac8150390 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fbac0014040 tx=0x7fbac0004af0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 shutdown_connections 2023-12-19T18:02:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbaac065ad0 0x7fbaac067f90 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbac815d090 0x7fbac8150390 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbac815ccb0 0x7fbac80b7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 --2- 172.21.15.45:0/2628293945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbac8071160 0x7fbac8151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:50.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 >> 172.21.15.45:0/2628293945 conn(0x7fbac80d2f50 msgr2=0x7fbac80d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 shutdown_connections 2023-12-19T18:02:50.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:50.933+0000 7fbace808700 1 -- 172.21.15.45:0/2628293945 wait complete. 2023-12-19T18:02:50.943 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-19T18:02:50.965 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T18:02:51.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.157+0000 7fa99ecb0700 1 Processor -- start 2023-12-19T18:02:51.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ecb0700 1 -- start start 2023-12-19T18:02:51.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ecb0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa99806a010 0x7fa9980700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ecb0700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa99806a3f0 0x7fa9980aec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ecb0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa99815b550 con 0x7fa99815b9e0 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ecb0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa99815b2b0 con 0x7fa99806a010 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ecb0700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa998070f60 con 0x7fa99806a3f0 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99e4af700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa99815b9e0 0x7fa99815c680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46786/0 (socket says 172.21.15.45:46786) 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99e4af700 1 -- 172.21.15.45:0/1134212686 learned_addr learned my addr 172.21.15.45:0/1134212686 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99d4ad700 1 --2- 172.21.15.45:0/1134212686 >> v2:172.21.15.73:3300/0 conn(0x7fa99806a3f0 0x7fa9980aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:51.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99dcae700 1 --2- 172.21.15.45:0/1134212686 >> v2:172.21.15.45:3300/0 conn(0x7fa99806a010 0x7fa9980700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:51.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ccac700 1 -- 172.21.15.45:0/1134212686 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2324257726 0 0) 0x7fa99815b550 con 0x7fa99815b9e0 2023-12-19T18:02:51.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.161+0000 7fa99ccac700 1 -- 172.21.15.45:0/1134212686 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9840035d0 con 0x7fa99815b9e0 2023-12-19T18:02:51.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99d4ad700 1 -- 172.21.15.45:0/1134212686 >> v2:172.21.15.45:3300/0 conn(0x7fa99806a010 msgr2=0x7fa9980700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:51.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99d4ad700 1 --2- 172.21.15.45:0/1134212686 >> v2:172.21.15.45:3300/0 conn(0x7fa99806a010 0x7fa9980700e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99d4ad700 1 -- 172.21.15.45:0/1134212686 >> v1:172.21.15.45:6789/0 conn(0x7fa99815b9e0 legacy=0x7fa99815c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:51.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99d4ad700 1 -- 172.21.15.45:0/1134212686 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9980706c0 con 0x7fa99806a3f0 2023-12-19T18:02:51.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99d4ad700 1 --2- 172.21.15.45:0/1134212686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa9980aec70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa9980b55c0 tx=0x7fa988009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82a4a8018593a67c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:51.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ccac700 1 -- 172.21.15.45:0/1134212686 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988011830 con 0x7fa99806a3f0 2023-12-19T18:02:51.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ccac700 1 -- 172.21.15.45:0/1134212686 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa988011990 con 0x7fa99806a3f0 2023-12-19T18:02:51.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ccac700 1 -- 172.21.15.45:0/1134212686 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988011d20 con 0x7fa99806a3f0 2023-12-19T18:02:51.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1134212686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 msgr2=0x7fa9980aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:51.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1134212686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa9980aec70 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fa9980b55c0 tx=0x7fa988009b30 comp rx=0 tx=0).stop 2023-12-19T18:02:51.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1134212686 shutdown_connections 2023-12-19T18:02:51.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1134212686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa9980aec70 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1134212686 >> v2:172.21.15.45:3300/0 conn(0x7fa99806a010 0x7fa9980700e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1134212686 >> 172.21.15.45:0/1134212686 conn(0x7fa9980cf970 msgr2=0x7fa9980cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:51.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1134212686 shutdown_connections 2023-12-19T18:02:51.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.165+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1134212686 wait complete. 2023-12-19T18:02:51.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.169+0000 7fa99ecb0700 1 Processor -- start 2023-12-19T18:02:51.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.169+0000 7fa99ecb0700 1 -- start start 2023-12-19T18:02:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa99806a010 0x7fa9980c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa998152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 0x7fa99815a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:51.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980c6120 con 0x7fa99815b9e0 2023-12-19T18:02:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980c6400 con 0x7fa99806a3f0 2023-12-19T18:02:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9980c66e0 con 0x7fa99806a010 2023-12-19T18:02:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 0x7fa99815a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 0x7fa99815a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34196/0 (socket says 172.21.15.45:34196) 2023-12-19T18:02:51.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 -- 172.21.15.45:0/1093267015 learned_addr learned my addr 172.21.15.45:0/1093267015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99d4ad700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa998152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99dcae700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa99806a010 0x7fa9980c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 -- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa99806a010 msgr2=0x7fa9980c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa99806a010 0x7fa9980c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 -- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 msgr2=0x7fa998152550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa998152550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 -- 172.21.15.45:0/1093267015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9880094b0 con 0x7fa99815b9e0 2023-12-19T18:02:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99e4af700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 0x7fa99815a150 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fa99000caa0 tx=0x7fa99000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990007480 con 0x7fa99815b9e0 2023-12-19T18:02:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9900075e0 con 0x7fa99815b9e0 2023-12-19T18:02:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990007970 con 0x7fa99815b9e0 2023-12-19T18:02:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9980c7af0 con 0x7fa99815b9e0 2023-12-19T18:02:51.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.173+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa998152a90 con 0x7fa99815b9e0 2023-12-19T18:02:51.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.177+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9980c8010 con 0x7fa99815b9e0 2023-12-19T18:02:51.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.177+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa99001b3b0 con 0x7fa99815b9e0 2023-12-19T18:02:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.177+0000 7fa98e7fc700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa97c065ad0 0x7fa97c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.177+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 6339+0+0 (secure 0 0 0) 0x7fa990082d50 con 0x7fa99815b9e0 2023-12-19T18:02:51.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.181+0000 7fa99dcae700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa97c065ad0 0x7fa97c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:51.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.181+0000 7fa99dcae700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa97c065ad0 0x7fa97c067f90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa994009b80 tx=0x7fa994008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:51.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.185+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa9980c8010 con 0x7fa99815b9e0 2023-12-19T18:02:51.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.369+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa9980c8010 con 0x7fa99815b9e0 2023-12-19T18:02:51.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.937+0000 7fa98e7fc700 1 -- 172.21.15.45:0/1093267015 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v119) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa9980c8010 con 0x7fa99815b9e0 2023-12-19T18:02:51.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.941+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa97c065ad0 msgr2=0x7fa97c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:51.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.941+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa97c065ad0 0x7fa97c067f90 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fa994009b80 tx=0x7fa994008040 comp rx=0 tx=0).stop 2023-12-19T18:02:51.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.941+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 msgr2=0x7fa99815a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:51.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.941+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 0x7fa99815a150 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fa99000caa0 tx=0x7fa99000cad0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 shutdown_connections 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa97c065ad0 0x7fa97c067f90 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa99815b9e0 0x7fa99815a150 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa99806a3f0 0x7fa998152550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 --2- 172.21.15.45:0/1093267015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa99806a010 0x7fa9980c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 >> 172.21.15.45:0/1093267015 conn(0x7fa9980cf970 msgr2=0x7fa9981536d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:51.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 shutdown_connections 2023-12-19T18:02:51.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:51.945+0000 7fa99ecb0700 1 -- 172.21.15.45:0/1093267015 wait complete. 2023-12-19T18:02:51.951 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-19T18:02:51.970 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_extra cephfs_data_extra --yes-i-really-really-mean-it 2023-12-19T18:02:52.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.153+0000 7fb974f88700 1 Processor -- start 2023-12-19T18:02:52.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.153+0000 7fb974f88700 1 -- start start 2023-12-19T18:02:52.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb974f88700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 0x7fb97006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:52.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb974f88700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb970143b30 0x7fb97006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:52.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb974f88700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9700b1430 con 0x7fb9700b03e0 2023-12-19T18:02:52.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb974f88700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9700b0f50 con 0x7fb970143b30 2023-12-19T18:02:52.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb974f88700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700c38d0 con 0x7fb970143750 2023-12-19T18:02:52.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96f7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 0x7fb97006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:52.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96f7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 0x7fb97006eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:52204/0 (socket says 172.21.15.45:52204) 2023-12-19T18:02:52.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96f7fe700 1 -- 172.21.15.45:0/2327120639 learned_addr learned my addr 172.21.15.45:0/2327120639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:52.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96effd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb970143b30 0x7fb97006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:52.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96effd700 1 -- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 msgr2=0x7fb97006eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:52.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96effd700 1 --2- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 0x7fb97006eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96effd700 1 -- 172.21.15.45:0/2327120639 >> v1:172.21.15.73:6789/0 conn(0x7fb9700b03e0 legacy=0x7fb9700b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:52.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96effd700 1 -- 172.21.15.45:0/2327120639 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9700b1150 con 0x7fb970143b30 2023-12-19T18:02:52.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96f7fe700 1 --2- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 0x7fb97006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:52.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96effd700 1 --2- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb970143b30 0x7fb97006f3f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb964009850 tx=0x7fb964009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cdab812036c3384 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96e7fc700 1 -- 172.21.15.45:0/2327120639 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964011830 con 0x7fb970143b30 2023-12-19T18:02:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96e7fc700 1 -- 172.21.15.45:0/2327120639 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964011990 con 0x7fb970143b30 2023-12-19T18:02:52.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.157+0000 7fb96e7fc700 1 -- 172.21.15.45:0/2327120639 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964011d40 con 0x7fb970143b30 2023-12-19T18:02:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 -- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb970143b30 msgr2=0x7fb97006f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 --2- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb970143b30 0x7fb97006f3f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fb964009850 tx=0x7fb964009b60 comp rx=0 tx=0).stop 2023-12-19T18:02:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 -- 172.21.15.45:0/2327120639 shutdown_connections 2023-12-19T18:02:52.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 --2- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb970143b30 0x7fb97006f3f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 --2- 172.21.15.45:0/2327120639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb970143750 0x7fb97006eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 -- 172.21.15.45:0/2327120639 >> 172.21.15.45:0/2327120639 conn(0x7fb9700cecd0 msgr2=0x7fb9700cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 -- 172.21.15.45:0/2327120639 shutdown_connections 2023-12-19T18:02:52.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.161+0000 7fb974f88700 1 -- 172.21.15.45:0/2327120639 wait complete. 2023-12-19T18:02:52.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 Processor -- start 2023-12-19T18:02:52.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 -- start start 2023-12-19T18:02:52.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9700b03e0 0x7fb9700b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:52.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 0x7fb97006d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:52.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb97006d590 0x7fb97013a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:52.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97006da20 con 0x7fb970143750 2023-12-19T18:02:52.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700b1ad0 con 0x7fb97006d590 2023-12-19T18:02:52.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb974f88700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9700b4800 con 0x7fb9700b03e0 2023-12-19T18:02:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 0x7fb97006d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 0x7fb97006d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34210/0 (socket says 172.21.15.45:34210) 2023-12-19T18:02:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 -- 172.21.15.45:0/1518477017 learned_addr learned my addr 172.21.15.45:0/1518477017 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96f7fe700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9700b03e0 0x7fb9700b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:52.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96ffff700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb97006d590 0x7fb97013a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 -- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9700b03e0 msgr2=0x7fb9700b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9700b03e0 0x7fb9700b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 -- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb97006d590 msgr2=0x7fb97013a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb97006d590 0x7fb97013a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.165+0000 7fb96effd700 1 -- 172.21.15.45:0/1518477017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb960009570 con 0x7fb970143750 2023-12-19T18:02:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb96effd700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 0x7fb97006d050 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fb964014040 tx=0x7fb964004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9640036c0 con 0x7fb970143750 2023-12-19T18:02:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96401e070 con 0x7fb970143750 2023-12-19T18:02:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9640094b0 con 0x7fb970143750 2023-12-19T18:02:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964003a80 con 0x7fb970143750 2023-12-19T18:02:52.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9700b1ce0 con 0x7fb970143750 2023-12-19T18:02:52.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.169+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb97004ed30 con 0x7fb970143750 2023-12-19T18:02:52.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.173+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb964003be0 con 0x7fb970143750 2023-12-19T18:02:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.173+0000 7fb957fff700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb95c065b00 0x7fb95c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:52.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.173+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5925+0+0 (secure 0 0 0) 0x7fb964020070 con 0x7fb970143750 2023-12-19T18:02:52.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.173+0000 7fb96f7fe700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb95c065b00 0x7fb95c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:52.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.173+0000 7fb96f7fe700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb95c065b00 0x7fb95c067fc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb960006d50 tx=0x7fb9600092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:52.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.177+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb964051eb0 con 0x7fb970143750 2023-12-19T18:02:52.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.353+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9700cb170 con 0x7fb970143750 2023-12-19T18:02:52.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.945+0000 7fb957fff700 1 -- 172.21.15.45:0/1518477017 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_extra", "pool2": "cephfs_data_extra", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_extra' removed v120) v1 ==== 187+0+0 (secure 0 0 0) 0x7fb9640554d0 con 0x7fb970143750 2023-12-19T18:02:52.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb95c065b00 msgr2=0x7fb95c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb95c065b00 0x7fb95c067fc0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb960006d50 tx=0x7fb9600092e0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 msgr2=0x7fb97006d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 0x7fb97006d050 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fb964014040 tx=0x7fb964004770 comp rx=0 tx=0).stop 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 shutdown_connections 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb95c065b00 0x7fb95c067fc0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb97006d590 0x7fb97013a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb970143750 0x7fb97006d050 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 --2- 172.21.15.45:0/1518477017 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb9700b03e0 0x7fb9700b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:52.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.949+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 >> 172.21.15.45:0/1518477017 conn(0x7fb9700cecd0 msgr2=0x7fb97006c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:52.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.953+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 shutdown_connections 2023-12-19T18:02:52.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:52.953+0000 7fb974f88700 1 -- 172.21.15.45:0/1518477017 wait complete. 2023-12-19T18:02:52.960 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data_extra' removed 2023-12-19T18:02:52.980 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T18:02:53.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.161+0000 7fcdc087b700 1 Processor -- start 2023-12-19T18:02:53.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.161+0000 7fcdc087b700 1 -- start start 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc06dd70 0x7fcdbc1619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcdbc0b2490 0x7fcdbc06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdbc0b1d20 con 0x7fcdbc1626c0 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdbc06ec50 con 0x7fcdbc0b2490 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc0b2c00 con 0x7fcdbc06dd70 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdbad9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcdbc0b2490 0x7fcdbc06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdba59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcdbc1626c0 0x7fcdbc06d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46790/0 (socket says 172.21.15.45:46790) 2023-12-19T18:02:53.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdba59c700 1 -- 172.21.15.45:0/2880790655 learned_addr learned my addr 172.21.15.45:0/2880790655 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdb3fff700 1 --2- 172.21.15.45:0/2880790655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc06dd70 0x7fcdbc1619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdb9d9b700 1 -- 172.21.15.45:0/2880790655 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403895729 0 0) 0x7fcdbc0b1d20 con 0x7fcdbc1626c0 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdb9d9b700 1 -- 172.21.15.45:0/2880790655 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcda80035d0 con 0x7fcdbc1626c0 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdbad9d700 1 -- 172.21.15.45:0/2880790655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc06dd70 msgr2=0x7fcdbc1619b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdbad9d700 1 --2- 172.21.15.45:0/2880790655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc06dd70 0x7fcdbc1619b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdbad9d700 1 -- 172.21.15.45:0/2880790655 >> v1:172.21.15.45:6789/0 conn(0x7fcdbc1626c0 legacy=0x7fcdbc06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdbad9d700 1 -- 172.21.15.45:0/2880790655 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc0b2ee0 con 0x7fcdbc0b2490 2023-12-19T18:02:53.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdbad9d700 1 --2- 172.21.15.45:0/2880790655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc06f0e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009d90 tx=0x7fcdb400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7dd605c2e509e27 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:53.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdb9d9b700 1 -- 172.21.15.45:0/2880790655 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb400e070 con 0x7fcdbc0b2490 2023-12-19T18:02:53.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdb9d9b700 1 -- 172.21.15.45:0/2880790655 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb400bb20 con 0x7fcdbc0b2490 2023-12-19T18:02:53.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdb9d9b700 1 -- 172.21.15.45:0/2880790655 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb4012430 con 0x7fcdbc0b2490 2023-12-19T18:02:53.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- 172.21.15.45:0/2880790655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 msgr2=0x7fcdbc06f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 --2- 172.21.15.45:0/2880790655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc06f0e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009d90 tx=0x7fcdb400b330 comp rx=0 tx=0).stop 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- 172.21.15.45:0/2880790655 shutdown_connections 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 --2- 172.21.15.45:0/2880790655 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc06f0e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 --2- 172.21.15.45:0/2880790655 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc06dd70 0x7fcdbc1619b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- 172.21.15.45:0/2880790655 >> 172.21.15.45:0/2880790655 conn(0x7fcdbc071990 msgr2=0x7fcdbc0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- 172.21.15.45:0/2880790655 shutdown_connections 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.165+0000 7fcdc087b700 1 -- 172.21.15.45:0/2880790655 wait complete. 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 Processor -- start 2023-12-19T18:02:53.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 -- start start 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc06dd70 0x7fcdbc152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc1656c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc1626c0 0x7fcdbc06efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc164c00 con 0x7fcdbc0b2490 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc153200 con 0x7fcdbc06dd70 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdc087b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdbc163ff0 con 0x7fcdbc1626c0 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdb3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc1656c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdb3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc1656c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34226/0 (socket says 172.21.15.45:34226) 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdb3fff700 1 -- 172.21.15.45:0/4252988163 learned_addr learned my addr 172.21.15.45:0/4252988163 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdbad9d700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc1626c0 0x7fcdbc06efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.169+0000 7fcdba59c700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc06dd70 0x7fcdbc152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb3fff700 1 -- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc1626c0 msgr2=0x7fcdbc06efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb3fff700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc1626c0 0x7fcdbc06efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb3fff700 1 -- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc06dd70 msgr2=0x7fcdbc152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb3fff700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc06dd70 0x7fcdbc152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb3fff700 1 -- 172.21.15.45:0/4252988163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb4009a70 con 0x7fcdbc0b2490 2023-12-19T18:02:53.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdba59c700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc06dd70 0x7fcdbc152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:02:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb3fff700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc1656c0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e9d0 tx=0x7fcda400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4009720 con 0x7fcdbc0b2490 2023-12-19T18:02:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda400c850 con 0x7fcdbc0b2490 2023-12-19T18:02:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdbc1642d0 con 0x7fcdbc0b2490 2023-12-19T18:02:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda400cbc0 con 0x7fcdbc0b2490 2023-12-19T18:02:53.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdbc164890 con 0x7fcdbc0b2490 2023-12-19T18:02:53.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.173+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdbc164a50 con 0x7fcdbc0b2490 2023-12-19T18:02:53.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.177+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcda400cd20 con 0x7fcdbc0b2490 2023-12-19T18:02:53.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.177+0000 7fcdb2ffd700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd9c065ad0 0x7fcd9c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.177+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5521+0+0 (secure 0 0 0) 0x7fcda4083200 con 0x7fcdbc0b2490 2023-12-19T18:02:53.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.177+0000 7fcdba59c700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd9c065ad0 0x7fcd9c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.177+0000 7fcdba59c700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd9c065ad0 0x7fcd9c067f90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0011e0 tx=0x7fcdac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:53.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.181+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcda4050bd0 con 0x7fcdbc0b2490 2023-12-19T18:02:53.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.361+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fcdbc04ed30 con 0x7fcdbc0b2490 2023-12-19T18:02:53.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.373+0000 7fcdb2ffd700 1 -- 172.21.15.45:0/4252988163 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcda40541f0 con 0x7fcdbc0b2490 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd9c065ad0 msgr2=0x7fcd9c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd9c065ad0 0x7fcd9c067f90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fcdac0011e0 tx=0x7fcdac009040 comp rx=0 tx=0).stop 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 msgr2=0x7fcdbc1656c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc1656c0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fcda400e9d0 tx=0x7fcda400ece0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 shutdown_connections 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd9c065ad0 0x7fcd9c067f90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdbc1626c0 0x7fcdbc06efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdbc0b2490 0x7fcdbc1656c0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 --2- 172.21.15.45:0/4252988163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdbc06dd70 0x7fcdbc152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 >> 172.21.15.45:0/4252988163 conn(0x7fcdbc071990 msgr2=0x7fcdbc0cc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:53.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 shutdown_connections 2023-12-19T18:02:53.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.377+0000 7fcdc087b700 1 -- 172.21.15.45:0/4252988163 wait complete. 2023-12-19T18:02:53.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_stashed_layout' 2023-12-19T18:02:53.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.589+0000 7ff5a8bd3700 1 Processor -- start 2023-12-19T18:02:53.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.589+0000 7ff5a8bd3700 1 -- start start 2023-12-19T18:02:53.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a8bd3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff5a406ea90 0x7ff5a40d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a8bd3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5a40b88b0 0x7ff5a40b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a8bd3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5a40b6dd0 con 0x7ff5a40b6250 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a8bd3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40d1820 con 0x7ff5a40b88b0 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a8bd3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5a40d1b00 con 0x7ff5a406ea90 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5a40b88b0 0x7ff5a40b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff5a40b88b0 0x7ff5a40b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34234/0 (socket says 172.21.15.45:34234) 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 -- 172.21.15.45:0/4273943605 learned_addr learned my addr 172.21.15.45:0/4273943605 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:53.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a37fe700 1 --2- 172.21.15.45:0/4273943605 >> v2:172.21.15.73:3300/0 conn(0x7ff5a406ea90 0x7ff5a40d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 -- 172.21.15.45:0/4273943605 >> v2:172.21.15.73:3300/0 conn(0x7ff5a406ea90 msgr2=0x7ff5a40d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 --2- 172.21.15.45:0/4273943605 >> v2:172.21.15.73:3300/0 conn(0x7ff5a406ea90 0x7ff5a40d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 -- 172.21.15.45:0/4273943605 >> v1:172.21.15.73:6789/0 conn(0x7ff5a40b6250 legacy=0x7ff5a40b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 -- 172.21.15.45:0/4273943605 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5a40d1de0 con 0x7ff5a40b88b0 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a2ffd700 1 --2- 172.21.15.45:0/4273943605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a40b88b0 0x7ff5a40b5d10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40b57b0 tx=0x7ff598009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bb3372ff731b52 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a27fc700 1 -- 172.21.15.45:0/4273943605 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800b8a0 con 0x7ff5a40b88b0 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a27fc700 1 -- 172.21.15.45:0/4273943605 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59800ba00 con 0x7ff5a40b88b0 2023-12-19T18:02:53.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.593+0000 7ff5a27fc700 1 -- 172.21.15.45:0/4273943605 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59800bd90 con 0x7ff5a40b88b0 2023-12-19T18:02:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/4273943605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a40b88b0 msgr2=0x7ff5a40b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/4273943605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a40b88b0 0x7ff5a40b5d10 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40b57b0 tx=0x7ff598009bf0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/4273943605 shutdown_connections 2023-12-19T18:02:53.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/4273943605 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a40b88b0 0x7ff5a40b5d10 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/4273943605 >> v2:172.21.15.73:3300/0 conn(0x7ff5a406ea90 0x7ff5a40d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/4273943605 >> 172.21.15.45:0/4273943605 conn(0x7ff5a40b46d0 msgr2=0x7ff5a40b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/4273943605 shutdown_connections 2023-12-19T18:02:53.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/4273943605 wait complete. 2023-12-19T18:02:53.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 Processor -- start 2023-12-19T18:02:53.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.597+0000 7ff5a8bd3700 1 -- start start 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a8bd3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 0x7ff5a40c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a8bd3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5a40b6250 0x7ff5a41f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a8bd3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5a40b88b0 0x7ff5a40b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a8bd3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40c84a0 con 0x7ff5a406ea90 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a8bd3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40703a0 con 0x7ff5a40b6250 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a8bd3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a40c7820 con 0x7ff5a40b88b0 2023-12-19T18:02:53.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 0x7ff5a40c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 0x7ff5a40c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34248/0 (socket says 172.21.15.45:34248) 2023-12-19T18:02:53.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 -- 172.21.15.45:0/2980209690 learned_addr learned my addr 172.21.15.45:0/2980209690 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a2ffd700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5a40b6250 0x7ff5a41f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a3fff700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5a40b88b0 0x7ff5a40b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 -- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5a40b88b0 msgr2=0x7ff5a40b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5a40b88b0 0x7ff5a40b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 -- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5a40b6250 msgr2=0x7ff5a41f1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5a40b6250 0x7ff5a41f1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 -- 172.21.15.45:0/2980209690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff598009570 con 0x7ff5a406ea90 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff5a37fe700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 0x7ff5a40c7120 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff59400d800 tx=0x7ff59400db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.601+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5940125f0 con 0x7ff5a406ea90 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.605+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594012750 con 0x7ff5a406ea90 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.605+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594012ac0 con 0x7ff5a406ea90 2023-12-19T18:02:53.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.605+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a40c7b00 con 0x7ff5a406ea90 2023-12-19T18:02:53.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.605+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a40c80c0 con 0x7ff5a406ea90 2023-12-19T18:02:53.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.605+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5a4067760 con 0x7ff5a406ea90 2023-12-19T18:02:53.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.609+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff594012c20 con 0x7ff5a406ea90 2023-12-19T18:02:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.609+0000 7ff58bfff700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff590065ad0 0x7ff590067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.609+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5521+0+0 (secure 0 0 0) 0x7ff5940830d0 con 0x7ff5a406ea90 2023-12-19T18:02:53.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.609+0000 7ff5a2ffd700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff590065ad0 0x7ff590067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:53.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.609+0000 7ff5a2ffd700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff590065ad0 0x7ff590067f90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff598000c00 tx=0x7ff598008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:53.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.617+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff594050b40 con 0x7ff5a406ea90 2023-12-19T18:02:53.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.861+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_stashed_layout"]} v 0) v1 -- 0x7ff5a40cc6a0 con 0x7ff5a406ea90 2023-12-19T18:02:53.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.953+0000 7ff58bfff700 1 -- 172.21.15.45:0/2980209690 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_extra_data_pool_stashed_layout"]}]=0 v496) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff594054160 con 0x7ff5a406ea90 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff590065ad0 msgr2=0x7ff590067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff590065ad0 0x7ff590067f90 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff598000c00 tx=0x7ff598008030 comp rx=0 tx=0).stop 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 msgr2=0x7ff5a40c7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 0x7ff5a40c7120 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7ff59400d800 tx=0x7ff59400db10 comp rx=0 tx=0).stop 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 shutdown_connections 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff590065ad0 0x7ff590067f90 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff5a40b88b0 0x7ff5a40b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff5a40b6250 0x7ff5a41f1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 --2- 172.21.15.45:0/2980209690 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff5a406ea90 0x7ff5a40c7120 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:53.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 >> 172.21.15.45:0/2980209690 conn(0x7ff5a40b46d0 msgr2=0x7ff5a40cbcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 shutdown_connections 2023-12-19T18:02:53.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:53.957+0000 7ff5a8bd3700 1 -- 172.21.15.45:0/2980209690 wait complete. 2023-12-19T18:02:53.984 INFO:tasks.cephfs_test_runner:test_extra_data_pool_stashed_layout (tasks.cephfs.test_data_scan.TestDataScan) ... ok 2023-12-19T18:02:53.984 INFO:tasks.cephfs_test_runner:Starting test: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-12-19T18:02:53.985 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T18:02:53.985 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-12-19T18:02:54.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.153+0000 7f1d8759e700 1 Processor -- start 2023-12-19T18:02:54.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.153+0000 7f1d8759e700 1 -- start start 2023-12-19T18:02:54.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d8815ae20 0x7f1d8815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d880af720 0x7f1d880afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880b0110 con 0x7f1d880af720 2023-12-19T18:02:54.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8806f0a0 con 0x7f1d8815ae20 2023-12-19T18:02:54.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8806ea90 con 0x7f1d8806cad0 2023-12-19T18:02:54.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d86d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d880af720 0x7f1d880afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d7dd9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1d8815ae20 0x7f1d8815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d86d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1d880af720 0x7f1d880afbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34262/0 (socket says 172.21.15.45:34262) 2023-12-19T18:02:54.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d86d9d700 1 -- 172.21.15.45:0/1979694733 learned_addr learned my addr 172.21.15.45:0/1979694733 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:54.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 -- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 msgr2=0x7f1d880c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:54.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 --2- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 -- 172.21.15.45:0/1979694733 >> v2:172.21.15.45:3300/0 conn(0x7f1d880af720 msgr2=0x7f1d880afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:54.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 --2- 172.21.15.45:0/1979694733 >> v2:172.21.15.45:3300/0 conn(0x7f1d880af720 0x7f1d880afbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 -- 172.21.15.45:0/1979694733 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d880c3f60 con 0x7f1d8815ae20 2023-12-19T18:02:54.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d8659c700 1 --2- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815be40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1d88070660 tx=0x7f1d78009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34e0bea2ca853da8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:54.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d85d9b700 1 -- 172.21.15.45:0/1979694733 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78011830 con 0x7f1d8815ae20 2023-12-19T18:02:54.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d85d9b700 1 -- 172.21.15.45:0/1979694733 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d78011990 con 0x7f1d8815ae20 2023-12-19T18:02:54.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.157+0000 7f1d85d9b700 1 -- 172.21.15.45:0/1979694733 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d78011d20 con 0x7f1d8815ae20 2023-12-19T18:02:54.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 -- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 msgr2=0x7f1d8815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:54.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 --2- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815be40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1d88070660 tx=0x7f1d78009b30 comp rx=0 tx=0).stop 2023-12-19T18:02:54.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 -- 172.21.15.45:0/1979694733 shutdown_connections 2023-12-19T18:02:54.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 --2- 172.21.15.45:0/1979694733 >> v2:172.21.15.45:3300/0 conn(0x7f1d880af720 0x7f1d880afbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 --2- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 --2- 172.21.15.45:0/1979694733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815be40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 -- 172.21.15.45:0/1979694733 >> 172.21.15.45:0/1979694733 conn(0x7f1d880cb900 msgr2=0x7f1d880b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:54.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 -- 172.21.15.45:0/1979694733 shutdown_connections 2023-12-19T18:02:54.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.161+0000 7f1d8759e700 1 -- 172.21.15.45:0/1979694733 wait complete. 2023-12-19T18:02:54.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 Processor -- start 2023-12-19T18:02:54.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 -- start start 2023-12-19T18:02:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c6e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 0x7f1d8815d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d881f4290 con 0x7f1d880af720 2023-12-19T18:02:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d881f3980 con 0x7f1d8815ae20 2023-12-19T18:02:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d880b22c0 con 0x7f1d8806cad0 2023-12-19T18:02:54.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 0x7f1d8815d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 0x7f1d8815d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34270/0 (socket says 172.21.15.45:34270) 2023-12-19T18:02:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 -- 172.21.15.45:0/2763893114 learned_addr learned my addr 172.21.15.45:0/2763893114 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d86d9d700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d8659c700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c6e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 -- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 msgr2=0x7f1d880c6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c6e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 -- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 msgr2=0x7f1d8815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.165+0000 7f1d7dd9b700 1 -- 172.21.15.45:0/2763893114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780094b0 con 0x7f1d880af720 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d7dd9b700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 0x7f1d8815d420 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e910 tx=0x7f1d7000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70013680 con 0x7f1d880af720 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d700137e0 con 0x7f1d880af720 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70013b90 con 0x7f1d880af720 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d881f3bd0 con 0x7f1d880af720 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d881f46b0 con 0x7f1d880af720 2023-12-19T18:02:54.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d881f4500 con 0x7f1d880af720 2023-12-19T18:02:54.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.169+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1d70013cf0 con 0x7f1d880af720 2023-12-19T18:02:54.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.173+0000 7f1d7f7fe700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d68065ad0 0x7f1d68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:54.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.173+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f1d70082fa0 con 0x7f1d880af720 2023-12-19T18:02:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.173+0000 7f1d8659c700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d68065ad0 0x7f1d68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:54.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.177+0000 7f1d8659c700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d68065ad0 0x7f1d68067f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009fd0 tx=0x7f1d78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:54.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.181+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1d70050a00 con 0x7f1d880af720 2023-12-19T18:02:54.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.429+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f1d88067760 con 0x7f1d880af720 2023-12-19T18:02:54.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.961+0000 7f1d7f7fe700 1 -- 172.21.15.45:0/2763893114 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v497) v1 ==== 148+0+0 (secure 0 0 0) 0x7f1d700210d0 con 0x7f1d880af720 2023-12-19T18:02:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.965+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d68065ad0 msgr2=0x7f1d68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:54.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.965+0000 7f1d8759e700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d68065ad0 0x7f1d68067f90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009fd0 tx=0x7f1d78008030 comp rx=0 tx=0).stop 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.965+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 msgr2=0x7f1d8815d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.965+0000 7f1d8759e700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 0x7f1d8815d420 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e910 tx=0x7f1d7000ec20 comp rx=0 tx=0).stop 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 shutdown_connections 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1d68065ad0 0x7f1d68067f90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1d8815ae20 0x7f1d8815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1d880af720 0x7f1d8815d420 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 --2- 172.21.15.45:0/2763893114 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1d8806cad0 0x7f1d880c6e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 >> 172.21.15.45:0/2763893114 conn(0x7f1d880cb900 msgr2=0x7f1d8806df40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 shutdown_connections 2023-12-19T18:02:54.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:54.969+0000 7f1d8759e700 1 -- 172.21.15.45:0/2763893114 wait complete. 2023-12-19T18:02:54.998 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-19T18:02:55.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 Processor -- start 2023-12-19T18:02:55.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 -- start start 2023-12-19T18:02:55.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f436815cf20 0x7f43680d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f43680b8580 0x7f43680cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436815d300 con 0x7f43680d25f0 2023-12-19T18:02:55.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680d1550 con 0x7f43680b8580 2023-12-19T18:02:55.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.181+0000 7f436759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680d1830 con 0x7f436815cf20 2023-12-19T18:02:55.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f43680b8580 0x7f43680cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f43680b8580 0x7f43680cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34286/0 (socket says 172.21.15.45:34286) 2023-12-19T18:02:55.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 -- 172.21.15.45:0/694130641 learned_addr learned my addr 172.21.15.45:0/694130641 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:55.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f436659c700 1 --2- 172.21.15.45:0/694130641 >> v2:172.21.15.73:3300/0 conn(0x7f436815cf20 0x7f43680d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 -- 172.21.15.45:0/694130641 >> v2:172.21.15.73:3300/0 conn(0x7f436815cf20 msgr2=0x7f43680d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:55.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 --2- 172.21.15.45:0/694130641 >> v2:172.21.15.73:3300/0 conn(0x7f436815cf20 0x7f43680d0c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 -- 172.21.15.45:0/694130641 >> v1:172.21.15.45:6789/0 conn(0x7f43680d25f0 legacy=0x7f436806ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 -- 172.21.15.45:0/694130641 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680d1b10 con 0x7f43680b8580 2023-12-19T18:02:55.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f4365d9b700 1 --2- 172.21.15.45:0/694130641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680b8580 0x7f43680cd8c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f436808bc50 tx=0x7f435c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de650f560036490 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:55.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f436559a700 1 -- 172.21.15.45:0/694130641 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c011830 con 0x7f43680b8580 2023-12-19T18:02:55.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f436559a700 1 -- 172.21.15.45:0/694130641 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c011990 con 0x7f43680b8580 2023-12-19T18:02:55.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f436559a700 1 -- 172.21.15.45:0/694130641 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c011d20 con 0x7f43680b8580 2023-12-19T18:02:55.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f436759e700 1 -- 172.21.15.45:0/694130641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680b8580 msgr2=0x7f43680cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.185+0000 7f436759e700 1 --2- 172.21.15.45:0/694130641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680b8580 0x7f43680cd8c0 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f436808bc50 tx=0x7f435c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.189+0000 7f436759e700 1 -- 172.21.15.45:0/694130641 shutdown_connections 2023-12-19T18:02:55.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.189+0000 7f436759e700 1 --2- 172.21.15.45:0/694130641 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680b8580 0x7f43680cd8c0 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.189+0000 7f436759e700 1 --2- 172.21.15.45:0/694130641 >> v2:172.21.15.73:3300/0 conn(0x7f436815cf20 0x7f43680d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.189+0000 7f436759e700 1 -- 172.21.15.45:0/694130641 >> 172.21.15.45:0/694130641 conn(0x7f43680b4670 msgr2=0x7f43680b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:55.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.189+0000 7f436759e700 1 -- 172.21.15.45:0/694130641 shutdown_connections 2023-12-19T18:02:55.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.189+0000 7f436759e700 1 -- 172.21.15.45:0/694130641 wait complete. 2023-12-19T18:02:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 Processor -- start 2023-12-19T18:02:55.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 -- start start 2023-12-19T18:02:55.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43680b8580 0x7f4368152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 0x7f4368154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436815cf20 0x7f43681f7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4368155730 con 0x7f43680d25f0 2023-12-19T18:02:55.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4368152550 con 0x7f436815cf20 2023-12-19T18:02:55.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436815e6e0 con 0x7f43680b8580 2023-12-19T18:02:55.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f4365d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 0x7f4368154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43680b8580 0x7f4368152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f4365d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 0x7f4368154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34302/0 (socket says 172.21.15.45:34302) 2023-12-19T18:02:55.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f436659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43680b8580 0x7f4368152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:52264/0 (socket says 172.21.15.45:52264) 2023-12-19T18:02:55.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f4365d9b700 1 -- 172.21.15.45:0/700707918 learned_addr learned my addr 172.21.15.45:0/700707918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:55.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f4366d9d700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436815cf20 0x7f43681f7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f4365d9b700 1 -- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43680b8580 msgr2=0x7f4368152010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.193+0000 7f4365d9b700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43680b8580 0x7f4368152010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4365d9b700 1 -- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436815cf20 msgr2=0x7f43681f7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4365d9b700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436815cf20 0x7f43681f7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4365d9b700 1 -- 172.21.15.45:0/700707918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c009570 con 0x7f43680d25f0 2023-12-19T18:02:55.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4365d9b700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 0x7f4368154de0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c00 tx=0x7f435c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:55.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c004510 con 0x7f43680d25f0 2023-12-19T18:02:55.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c01e070 con 0x7f43680d25f0 2023-12-19T18:02:55.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c003900 con 0x7f43680d25f0 2023-12-19T18:02:55.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436815e9c0 con 0x7f43680d25f0 2023-12-19T18:02:55.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436815ef80 con 0x7f43680d25f0 2023-12-19T18:02:55.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.197+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f436815f170 con 0x7f43680d25f0 2023-12-19T18:02:55.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.201+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f435c003a60 con 0x7f43680d25f0 2023-12-19T18:02:55.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.201+0000 7f4356ffd700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4348065ad0 0x7f4348067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.201+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f435c083b90 con 0x7f43680d25f0 2023-12-19T18:02:55.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.201+0000 7f436659c700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4348065ad0 0x7f4348067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.205+0000 7f436659c700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4348065ad0 0x7f4348067f90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4358009bf0 tx=0x7f4358009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:55.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.209+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f435c051690 con 0x7f43680d25f0 2023-12-19T18:02:55.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.389+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f436804ed30 con 0x7f43680d25f0 2023-12-19T18:02:55.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.401+0000 7f4356ffd700 1 -- 172.21.15.45:0/700707918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f435c0200c0 con 0x7f43680d25f0 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4348065ad0 msgr2=0x7f4348067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4348065ad0 0x7f4348067f90 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4358009bf0 tx=0x7f4358009240 comp rx=0 tx=0).stop 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 msgr2=0x7f4368154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 0x7f4368154de0 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f435c000c00 tx=0x7f435c004770 comp rx=0 tx=0).stop 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 shutdown_connections 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4348065ad0 0x7f4348067f90 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436815cf20 0x7f43681f7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f43680d25f0 0x7f4368154de0 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 --2- 172.21.15.45:0/700707918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f43680b8580 0x7f4368152010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 >> 172.21.15.45:0/700707918 conn(0x7f43680b4670 msgr2=0x7f43680b6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 shutdown_connections 2023-12-19T18:02:55.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.405+0000 7f436759e700 1 -- 172.21.15.45:0/700707918 wait complete. 2023-12-19T18:02:55.433 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:02:55.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:02:55.478 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:02:55.529 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:02:55.529 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:02:55.529 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:55.548 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:02:55.548 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:02:55.549 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:55.567 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:02:55.567 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:02:55.567 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:55.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:02:55.617 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:02:55.618 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:02:55.637 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:02:55.637 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-19T18:02:55.637 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:02:55.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 Processor -- start 2023-12-19T18:02:55.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 -- start start 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e7415ae20 0x7f6e7415be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f6e740af720 0x7f6e740afbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7406f0a0 con 0x7f6e7406cad0 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e740b0110 con 0x7f6e740af720 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7b351700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7406ea90 con 0x7f6e7415ae20 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e79b4e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f6e7406cad0 0x7f6e740c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46806/0 (socket says 172.21.15.45:46806) 2023-12-19T18:02:55.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e79b4e700 1 -- 172.21.15.45:0/1052124088 learned_addr learned my addr 172.21.15.45:0/1052124088 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7ab50700 1 --2- 172.21.15.45:0/1052124088 >> v2:172.21.15.73:3300/0 conn(0x7f6e740af720 0x7f6e740afbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7a34f700 1 --2- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e7415ae20 0x7f6e7415be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7934d700 1 -- 172.21.15.45:0/1052124088 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2672976480 0 0) 0x7f6e7406f0a0 con 0x7f6e7406cad0 2023-12-19T18:02:55.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.837+0000 7f6e7934d700 1 -- 172.21.15.45:0/1052124088 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e600035d0 con 0x7f6e7406cad0 2023-12-19T18:02:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7ab50700 1 -- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e7415ae20 msgr2=0x7f6e7415be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7ab50700 1 --2- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e7415ae20 0x7f6e7415be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7ab50700 1 -- 172.21.15.45:0/1052124088 >> v1:172.21.15.45:6789/0 conn(0x7f6e7406cad0 legacy=0x7f6e740c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7ab50700 1 -- 172.21.15.45:0/1052124088 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e740c3f60 con 0x7f6e740af720 2023-12-19T18:02:55.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7ab50700 1 --2- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e740af720 0x7f6e740afbd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009850 tx=0x7f6e6c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d09655c1b95a34e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7934d700 1 -- 172.21.15.45:0/1052124088 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c011830 con 0x7f6e740af720 2023-12-19T18:02:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7934d700 1 -- 172.21.15.45:0/1052124088 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c011990 con 0x7f6e740af720 2023-12-19T18:02:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7934d700 1 -- 172.21.15.45:0/1052124088 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c011d40 con 0x7f6e740af720 2023-12-19T18:02:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 -- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e740af720 msgr2=0x7f6e740afbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 --2- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e740af720 0x7f6e740afbd0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f6e6c009850 tx=0x7f6e6c009b60 comp rx=0 tx=0).stop 2023-12-19T18:02:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 -- 172.21.15.45:0/1052124088 shutdown_connections 2023-12-19T18:02:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 --2- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e740af720 0x7f6e740afbd0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 --2- 172.21.15.45:0/1052124088 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e7415ae20 0x7f6e7415be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 -- 172.21.15.45:0/1052124088 >> 172.21.15.45:0/1052124088 conn(0x7f6e740cb900 msgr2=0x7f6e740b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 -- 172.21.15.45:0/1052124088 shutdown_connections 2023-12-19T18:02:55.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.841+0000 7f6e7b351700 1 -- 172.21.15.45:0/1052124088 wait complete. 2023-12-19T18:02:55.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 Processor -- start 2023-12-19T18:02:55.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 -- start start 2023-12-19T18:02:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e7406cad0 0x7f6e7414b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e740af720 0x7f6e740c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 0x7f6e7415c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e740c6a30 con 0x7f6e7415ae20 2023-12-19T18:02:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7414f840 con 0x7f6e7406cad0 2023-12-19T18:02:55.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7b351700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e7414c3f0 con 0x7f6e740af720 2023-12-19T18:02:55.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7ab50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 0x7f6e7415c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7ab50700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 0x7f6e7415c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34314/0 (socket says 172.21.15.45:34314) 2023-12-19T18:02:55.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7ab50700 1 -- 172.21.15.45:0/2653386828 learned_addr learned my addr 172.21.15.45:0/2653386828 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:55.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e79b4e700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e740af720 0x7f6e740c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.845+0000 7f6e7a34f700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e7406cad0 0x7f6e7414b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7ab50700 1 -- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e740af720 msgr2=0x7f6e740c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7ab50700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e740af720 0x7f6e740c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7ab50700 1 -- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e7406cad0 msgr2=0x7f6e7414b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7ab50700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e7406cad0 0x7f6e7414b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7ab50700 1 -- 172.21.15.45:0/2653386828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e6c0094b0 con 0x7f6e7415ae20 2023-12-19T18:02:55.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7ab50700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 0x7f6e7415c3d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6e740cb1b0 tx=0x7f6e6c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c004380 con 0x7f6e7415ae20 2023-12-19T18:02:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c01f070 con 0x7f6e7415ae20 2023-12-19T18:02:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e740c6190 con 0x7f6e7415ae20 2023-12-19T18:02:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e6c0036c0 con 0x7f6e7415ae20 2023-12-19T18:02:55.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e740c6750 con 0x7f6e7415ae20 2023-12-19T18:02:55.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.849+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7414c5f0 con 0x7f6e7415ae20 2023-12-19T18:02:55.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.853+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6e6c021030 con 0x7f6e7415ae20 2023-12-19T18:02:55.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.853+0000 7f6e6affd700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6e58065ad0 0x7f6e58067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.853+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f6e6c083e40 con 0x7f6e7415ae20 2023-12-19T18:02:55.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.853+0000 7f6e7a34f700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6e58065ad0 0x7f6e58067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:55.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.857+0000 7f6e7a34f700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6e58065ad0 0x7f6e58067f90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6e70011340 tx=0x7f6e7000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:55.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:55.861+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6e7414c5f0 con 0x7f6e7415ae20 2023-12-19T18:02:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.073+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e7414c5b0 con 0x7f6e7415ae20 2023-12-19T18:02:56.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.073+0000 7f6e6affd700 1 -- 172.21.15.45:0/2653386828 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+3530 (secure 0 0 0) 0x7f6e6c02a090 con 0x7f6e7415ae20 2023-12-19T18:02:56.078 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:56.078 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":93,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8230,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/2746622106","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":2746622106},{"type":"v1","addr":"172.21.15.73:6833","nonce":2746622106}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":8449,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1181766947","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1181766947},{"type":"v1","addr":"172.21.15.73:6835","nonce":1181766947}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":93},{"gid":8529,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/2541743650","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":2541743650},{"type":"v1","addr":"172.21.15.45:6836","nonce":2541743650}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87},{"gid":57224,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/1935321736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":1935321736},{"type":"v1","addr":"172.21.15.45:6837","nonce":1935321736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-12-19T18:02:56.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6e58065ad0 msgr2=0x7f6e58067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6e58065ad0 0x7f6e58067f90 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6e70011340 tx=0x7f6e7000b040 comp rx=0 tx=0).stop 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 msgr2=0x7f6e7415c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 0x7f6e7415c3d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f6e740cb1b0 tx=0x7f6e6c004770 comp rx=0 tx=0).stop 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 shutdown_connections 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6e58065ad0 0x7f6e58067f90 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6e7415ae20 0x7f6e7415c3d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6e740af720 0x7f6e740c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 --2- 172.21.15.45:0/2653386828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6e7406cad0 0x7f6e7414b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 >> 172.21.15.45:0/2653386828 conn(0x7f6e740cb900 msgr2=0x7f6e7415d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 shutdown_connections 2023-12-19T18:02:56.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.077+0000 7f6e7b351700 1 -- 172.21.15.45:0/2653386828 wait complete. 2023-12-19T18:02:56.084 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 93 2023-12-19T18:02:56.105 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-19T18:02:56.105 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-19T18:02:56.105 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T18:02:56.105 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:02:56.105 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-19T18:02:56.105 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-19T18:02:56.106 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T18:02:56.106 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:02:56.106 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-19T18:02:56.106 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-19T18:02:56.106 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T18:02:56.106 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:02:56.106 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-19T18:02:56.106 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-19T18:02:56.107 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T18:02:56.107 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:02:56.126 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T18:02:56.126 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-19T18:02:56.128 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T18:02:56.129 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-19T18:02:56.129 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T18:02:56.130 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-19T18:02:56.133 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T18:02:56.133 DEBUG:teuthology.orchestra.run.smithi073:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-19T18:02:56.178 INFO:tasks.ceph.mds.a:Started 2023-12-19T18:02:56.179 DEBUG:teuthology.parallel:result is None 2023-12-19T18:02:56.181 INFO:tasks.ceph.mds.d:Started 2023-12-19T18:02:56.181 DEBUG:teuthology.parallel:result is None 2023-12-19T18:02:56.182 INFO:tasks.ceph.mds.c:Started 2023-12-19T18:02:56.183 DEBUG:teuthology.parallel:result is None 2023-12-19T18:02:56.184 INFO:tasks.ceph.mds.b:Started 2023-12-19T18:02:56.185 DEBUG:teuthology.parallel:result is None 2023-12-19T18:02:56.185 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-19T18:02:56.300 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:02:56.305 INFO:tasks.ceph.mds.a.smithi045.stdout:starting mds.a at 2023-12-19T18:02:56.307 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T18:02:56.312 INFO:tasks.ceph.mds.d.smithi073.stdout:starting mds.d at 2023-12-19T18:02:56.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2023-12-19T18:02:56.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-19T18:02:56.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 Processor -- start 2023-12-19T18:02:56.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 -- start start 2023-12-19T18:02:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b5c06ea90 0x7f7b5c0d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:56.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c0d1820 con 0x7f7b5c0b88b0 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0d1b00 con 0x7f7b5c06ea90 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b62564700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0d1de0 con 0x7f7b5c06fe80 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b61562700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b5c06ea90 0x7f7b5c0d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b61562700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7b5c06ea90 0x7f7b5c0d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:45762/0 (socket says 172.21.15.45:45762) 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b61562700 1 -- 172.21.15.45:0/3374731519 learned_addr learned my addr 172.21.15.45:0/3374731519 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b60d61700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f7b5c0b88b0 0x7f7b5c0b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:42412/0 (socket says 172.21.15.45:42412) 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.353+0000 7f7b61d63700 1 --2- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b61562700 1 -- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 msgr2=0x7f7b5c0b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b61562700 1 --2- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b61562700 1 -- 172.21.15.45:0/3374731519 >> v1:172.21.15.73:6789/0 conn(0x7f7b5c0b88b0 legacy=0x7f7b5c0b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:56.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b61562700 1 -- 172.21.15.45:0/3374731519 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c0d20c0 con 0x7f7b5c06ea90 2023-12-19T18:02:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b61562700 1 --2- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c0d0f20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009910 tx=0x7f7b58009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b673c625fbe8bcb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b53fff700 1 -- 172.21.15.45:0/3374731519 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011830 con 0x7f7b5c06ea90 2023-12-19T18:02:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b53fff700 1 -- 172.21.15.45:0/3374731519 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58011990 con 0x7f7b5c06ea90 2023-12-19T18:02:56.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b53fff700 1 -- 172.21.15.45:0/3374731519 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58011d40 con 0x7f7b5c06ea90 2023-12-19T18:02:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 -- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c06ea90 msgr2=0x7f7b5c0d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 --2- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c0d0f20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009910 tx=0x7f7b58009c20 comp rx=0 tx=0).stop 2023-12-19T18:02:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 -- 172.21.15.45:0/3374731519 shutdown_connections 2023-12-19T18:02:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 --2- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 --2- 172.21.15.45:0/3374731519 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c0d0f20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 -- 172.21.15.45:0/3374731519 >> 172.21.15.45:0/3374731519 conn(0x7f7b5c0b46d0 msgr2=0x7f7b5c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 -- 172.21.15.45:0/3374731519 shutdown_connections 2023-12-19T18:02:56.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.357+0000 7f7b62564700 1 -- 172.21.15.45:0/3374731519 wait complete. 2023-12-19T18:02:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 Processor -- start 2023-12-19T18:02:56.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 -- start start 2023-12-19T18:02:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c0b88b0 0x7f7b5c0ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:56.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c1467d0 con 0x7f7b5c06ea90 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0b7ed0 con 0x7f7b5c0b88b0 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b62564700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c0cad60 con 0x7f7b5c06fe80 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.361+0000 7f7b61562700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34368/0 (socket says 172.21.15.45:34368) 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b60d61700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 -- 172.21.15.45:0/3010018460 learned_addr learned my addr 172.21.15.45:0/3010018460 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:56.369 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61d63700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c0b88b0 0x7f7b5c0ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 -- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 msgr2=0x7f7b5c0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 -- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c0b88b0 msgr2=0x7f7b5c0ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c0b88b0 0x7f7b5c0ca1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 -- 172.21.15.45:0/3010018460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009570 con 0x7f7b5c06ea90 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b61562700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c1579c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c072a40 tx=0x7f7b58004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:56.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58004510 con 0x7f7b5c06ea90 2023-12-19T18:02:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5801e070 con 0x7f7b5c06ea90 2023-12-19T18:02:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58003900 con 0x7f7b5c06ea90 2023-12-19T18:02:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c0cb040 con 0x7f7b5c06ea90 2023-12-19T18:02:56.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c0cb600 con 0x7f7b5c06ea90 2023-12-19T18:02:56.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.365+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c067760 con 0x7f7b5c06ea90 2023-12-19T18:02:56.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.369+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7b58003a60 con 0x7f7b5c06ea90 2023-12-19T18:02:56.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.369+0000 7f7b51ffb700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7b40065ad0 0x7f7b40067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:56.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.369+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5521+0+0 (secure 0 0 0) 0x7f7b58083c70 con 0x7f7b5c06ea90 2023-12-19T18:02:56.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.369+0000 7f7b60d61700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7b40065ad0 0x7f7b40067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:56.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.373+0000 7f7b60d61700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7b40065ad0 0x7f7b40067f90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0b2ca0 tx=0x7f7b4c007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:56.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.373+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7b580516d0 con 0x7f7b5c06ea90 2023-12-19T18:02:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:56.561+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7b5c0c5dc0 con 0x7f7b5c06ea90 2023-12-19T18:02:57.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.373+0000 7f7b51ffb700 1 -- 172.21.15.45:0/3010018460 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v125) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7b58020080 con 0x7f7b5c06ea90 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7b40065ad0 msgr2=0x7f7b40067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7b40065ad0 0x7f7b40067f90 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0b2ca0 tx=0x7f7b4c007ef0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 msgr2=0x7f7b5c1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c1579c0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c072a40 tx=0x7f7b58004770 comp rx=0 tx=0).stop 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 shutdown_connections 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7b40065ad0 0x7f7b40067f90 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b5c0b88b0 0x7f7b5c0ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7b5c06fe80 0x7f7b5c0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 --2- 172.21.15.45:0/3010018460 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7b5c06ea90 0x7f7b5c1579c0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 >> 172.21.15.45:0/3010018460 conn(0x7f7b5c0b46d0 msgr2=0x7f7b5c0b37e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:57.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 shutdown_connections 2023-12-19T18:02:57.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.377+0000 7f7b62564700 1 -- 172.21.15.45:0/3010018460 wait complete. 2023-12-19T18:02:57.385 INFO:teuthology.orchestra.run.smithi045.stderr: removed all blocklist entries 2023-12-19T18:02:57.407 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-19T18:02:57.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.585+0000 7fcba33b5700 1 Processor -- start 2023-12-19T18:02:57.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.585+0000 7fcba33b5700 1 -- start start 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba33b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b88b0 0x7fcb9c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba33b5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcb9c06f3b0 0x7fcb9c06f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba33b5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb9c0d1820 con 0x7fcb9c06ea90 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba33b5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb9c0d1630 con 0x7fcb9c06f3b0 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba33b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0d1b00 con 0x7fcb9c0b88b0 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba23b3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fcb9c06ea90 0x7fcb9c0d0f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:46824/0 (socket says 172.21.15.45:46824) 2023-12-19T18:02:57.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba23b3700 1 -- 172.21.15.45:0/3297243908 learned_addr learned my addr 172.21.15.45:0/3297243908 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:57.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba1bb2700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b88b0 0x7fcb9c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba2bb4700 1 --2- 172.21.15.45:0/3297243908 >> v2:172.21.15.73:3300/0 conn(0x7fcb9c06f3b0 0x7fcb9c06f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158866609 0 0) 0x7fcb9c0d1820 con 0x7fcb9c06ea90 2023-12-19T18:02:57.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.589+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb880035d0 con 0x7fcb9c06ea90 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2266263349 0 0) 0x7fcb880035d0 con 0x7fcb9c06ea90 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b88b0 msgr2=0x7fcb9c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b88b0 0x7fcb9c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 >> v2:172.21.15.73:3300/0 conn(0x7fcb9c06f3b0 msgr2=0x7fcb9c06f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 --2- 172.21.15.45:0/3297243908 >> v2:172.21.15.73:3300/0 conn(0x7fcb9c06f3b0 0x7fcb9c06f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c0d1de0 con 0x7fcb9c06ea90 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fcb98001670 con 0x7fcb9c06ea90 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 >> v1:172.21.15.45:6789/0 conn(0x7fcb9c06ea90 legacy=0x7fcb9c0d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb88003a20 0x7fcb88003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb88004870 0x7fcb88004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb8800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0d1b00 con 0x7fcb88005230 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8800bf70 con 0x7fcb88003a20 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8800c130 con 0x7fcb88004870 2023-12-19T18:02:57.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb8800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba23b3700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb88003a20 0x7fcb88003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba1bb2700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb88004870 0x7fcb88004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 -- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb88004870 msgr2=0x7fcb88004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb88004870 0x7fcb88004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 -- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb88003a20 msgr2=0x7fcb88003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb88003a20 0x7fcb88003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 -- 172.21.15.45:0/3297243908 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880035d0 con 0x7fcb88005230 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb8800ba30 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009fc0 tx=0x7fcb880058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c08cd3b9b926c59 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9400ec30 con 0x7fcb88005230 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9400f040 con 0x7fcb88005230 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba13b1700 1 -- 172.21.15.45:0/3297243908 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb94014480 con 0x7fcb88005230 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba33b5700 1 -- 172.21.15.45:0/3297243908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 msgr2=0x7fcb8800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba33b5700 1 --2- 172.21.15.45:0/3297243908 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb8800ba30 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fcb94009fc0 tx=0x7fcb880058a0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba2bb4700 1 -- 172.21.15.45:0/3297243908 reap_dead start 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba33b5700 1 -- 172.21.15.45:0/3297243908 shutdown_connections 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.593+0000 7fcba33b5700 1 -- 172.21.15.45:0/3297243908 >> 172.21.15.45:0/3297243908 conn(0x7fcb9c0b46d0 msgr2=0x7fcb9c0b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 -- 172.21.15.45:0/3297243908 shutdown_connections 2023-12-19T18:02:57.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 -- 172.21.15.45:0/3297243908 wait complete. 2023-12-19T18:02:57.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 Processor -- start 2023-12-19T18:02:57.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 -- start start 2023-12-19T18:02:57.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb9c0b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb9c0cc530 0x7fcb9c0b2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b3190 0x7fcb9c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0b3640 con 0x7fcb88005230 2023-12-19T18:02:57.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c0b41d0 con 0x7fcb9c0cc530 2023-12-19T18:02:57.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.597+0000 7fcba33b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9c14cd20 con 0x7fcb9c0b3190 2023-12-19T18:02:57.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb9c0b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb9c0b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34384/0 (socket says 172.21.15.45:34384) 2023-12-19T18:02:57.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 -- 172.21.15.45:0/318454551 learned_addr learned my addr 172.21.15.45:0/318454551 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba1bb2700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb9c0cc530 0x7fcb9c0b2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba2bb4700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b3190 0x7fcb9c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 -- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b3190 msgr2=0x7fcb9c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b3190 0x7fcb9c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 -- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb9c0cc530 msgr2=0x7fcb9c0b2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb9c0cc530 0x7fcb9c0b2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 -- 172.21.15.45:0/318454551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9c14d000 con 0x7fcb88005230 2023-12-19T18:02:57.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba23b3700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb9c0b3c90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800eaf0 tx=0x7fcb9800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb98005e00 con 0x7fcb88005230 2023-12-19T18:02:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb9800c7b0 con 0x7fcb88005230 2023-12-19T18:02:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb9c14d2e0 con 0x7fcb88005230 2023-12-19T18:02:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb9800cb60 con 0x7fcb88005230 2023-12-19T18:02:57.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb9c0cc9b0 con 0x7fcb88005230 2023-12-19T18:02:57.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.601+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9c14d800 con 0x7fcb88005230 2023-12-19T18:02:57.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.605+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcb9800ccc0 con 0x7fcb88005230 2023-12-19T18:02:57.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.605+0000 7fcb92ffd700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb80065b00 0x7fcb80067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:57.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.605+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcb98082ec0 con 0x7fcb88005230 2023-12-19T18:02:57.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.605+0000 7fcba1bb2700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb80065b00 0x7fcb80067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:57.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.609+0000 7fcba1bb2700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb80065b00 0x7fcb80067fc0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c15cb80 tx=0x7fcb8c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:57.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.609+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcb9c14d800 con 0x7fcb88005230 2023-12-19T18:02:57.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.841+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcb9c14d800 con 0x7fcb88005230 2023-12-19T18:02:57.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcb92ffd700 1 -- 172.21.15.45:0/318454551 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcb9c14d800 con 0x7fcb88005230 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: "auth_dump": [ 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.a", 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlqjYuNxAA52SvQWEPiy5N5kPnks380A==", 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.849 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.b", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlzVTmDhAAFxYOHsvpU+lYYXgd4f8Geg==", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.850 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.c", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlfwJKBhAAzo//QxR2szjCYG3qYyrKPA==", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mds.d", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlmbgpGhAAav7TcY3Q0NUCEuHDwTREUQ==", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:02:57.851 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.0", 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDr14FlbcU1EhAApmP+MixCM2GqXK+juxttkg==", 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.852 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.1", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDu14Flk+rjHhAAMQPrx81Kuh0kcZOFN3ezQA==", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.2", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDx14Fl4EAELhAA9VsnYtv5h7vE3R80jpdy3w==", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.853 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.3", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD114FlxpmDARAAmbLMTmBaHHl/8AX+AK0QLQ==", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.4", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD714Flw3pqGxAAxsWqNXCFPNg8IJfqo0fwJg==", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.854 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.5", 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQD+14FlIrMcKhAAKAizQ4+ScWNlWgezN3JQnA==", 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.6", 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAB2IFlTgzENxAACfJB2hM++2lloCgGciRX/w==", 2023-12-19T18:02:57.855 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "osd.7", 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQAF2IFlIkbYCRAADPX2uhb1d0DYK6MwrfMqAA==", 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow profile osd", 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile osd", 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.856 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.0", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlDqRaIRAApaHIvb2MdTzjHT0e0H7dDA==", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow r", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.1", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlJoVRLhAAwOl5/5cad4g4mdfW31Bm9A==", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T18:02:57.857 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.2", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14Flep7TJxAAZYT8HHvGuzZtgWnIB+MyfQ==", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.3", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDp14FlWXJ7NBAAK9F5kqvLobEs52LmupdyqQ==", 2023-12-19T18:02:57.858 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow r", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow rw", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow rwx" 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "client.admin", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl3IfBDBAAsKhx3aytTBDBVKorcbcCHw==", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "mgr": "allow *", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow *", 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.859 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.x", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14FlfCaRLxAArMtAAf0rS4aNPLGYNpERYA==", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "entity": "mgr.y", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "key": "AQDo14Fl9/FjKRAA+7Ky6r7ItBK8V+WBH++z1Q==", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "caps": { 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "mds": "allow *", 2023-12-19T18:02:57.860 INFO:teuthology.orchestra.run.smithi045.stdout: "mon": "allow profile mgr", 2023-12-19T18:02:57.861 INFO:teuthology.orchestra.run.smithi045.stdout: "osd": "allow *" 2023-12-19T18:02:57.861 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.861 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:57.861 INFO:teuthology.orchestra.run.smithi045.stdout: ] 2023-12-19T18:02:57.861 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb80065b00 msgr2=0x7fcb80067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb80065b00 0x7fcb80067fc0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c15cb80 tx=0x7fcb8c008040 comp rx=0 tx=0).stop 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 msgr2=0x7fcb9c0b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb9c0b3c90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fcb9800eaf0 tx=0x7fcb9800eeb0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 shutdown_connections 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcb80065b00 0x7fcb80067fc0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcb9c0b3190 0x7fcb9c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb9c0cc530 0x7fcb9c0b2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 --2- 172.21.15.45:0/318454551 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcb88005230 0x7fcb9c0b3c90 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:57.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 >> 172.21.15.45:0/318454551 conn(0x7fcb9c0b46d0 msgr2=0x7fcb9c15c2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:57.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 shutdown_connections 2023-12-19T18:02:57.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:57.845+0000 7fcba33b5700 1 -- 172.21.15.45:0/318454551 wait complete. 2023-12-19T18:02:57.872 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:02:58.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.049+0000 7f1a6a8aa700 1 Processor -- start 2023-12-19T18:02:58.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.049+0000 7f1a6a8aa700 1 -- start start 2023-12-19T18:02:58.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.049+0000 7f1a6a8aa700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a6406ea90 0x7f1a640d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1a6406fe80 0x7f1a640b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a640d1820 con 0x7f1a640b88b0 2023-12-19T18:02:58.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640d1b00 con 0x7f1a6406fe80 2023-12-19T18:02:58.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640d1de0 con 0x7f1a6406ea90 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1a6406fe80 0x7f1a640b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1a6406fe80 0x7f1a640b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34386/0 (socket says 172.21.15.45:34386) 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 -- 172.21.15.45:0/2634842283 learned_addr learned my addr 172.21.15.45:0/2634842283 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a698a8700 1 --2- 172.21.15.45:0/2634842283 >> v2:172.21.15.73:3300/0 conn(0x7f1a6406ea90 0x7f1a640d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 -- 172.21.15.45:0/2634842283 >> v2:172.21.15.73:3300/0 conn(0x7f1a6406ea90 msgr2=0x7f1a640d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 --2- 172.21.15.45:0/2634842283 >> v2:172.21.15.73:3300/0 conn(0x7f1a6406ea90 0x7f1a640d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 -- 172.21.15.45:0/2634842283 >> v1:172.21.15.45:6789/0 conn(0x7f1a640b88b0 legacy=0x7f1a640b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 -- 172.21.15.45:0/2634842283 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640d20c0 con 0x7f1a6406fe80 2023-12-19T18:02:58.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a688a6700 1 -- 172.21.15.45:0/2634842283 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 841124293 0 0) 0x7f1a640d1820 con 0x7f1a640b88b0 2023-12-19T18:02:58.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a0a9700 1 --2- 172.21.15.45:0/2634842283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a640b6420 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1a640b57b0 tx=0x7f1a5c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727e090e9712c760 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a688a6700 1 -- 172.21.15.45:0/2634842283 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00e070 con 0x7f1a6406fe80 2023-12-19T18:02:58.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a688a6700 1 -- 172.21.15.45:0/2634842283 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c00b910 con 0x7f1a6406fe80 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a688a6700 1 -- 172.21.15.45:0/2634842283 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c00bcc0 con 0x7f1a6406fe80 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/2634842283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 msgr2=0x7f1a640b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/2634842283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a640b6420 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f1a640b57b0 tx=0x7f1a5c00b330 comp rx=0 tx=0).stop 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/2634842283 shutdown_connections 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/2634842283 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a640b6420 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/2634842283 >> v2:172.21.15.73:3300/0 conn(0x7f1a6406ea90 0x7f1a640d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/2634842283 >> 172.21.15.45:0/2634842283 conn(0x7f1a640b46d0 msgr2=0x7f1a640b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/2634842283 shutdown_connections 2023-12-19T18:02:58.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.053+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/2634842283 wait complete. 2023-12-19T18:02:58.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.057+0000 7f1a6a8aa700 1 Processor -- start 2023-12-19T18:02:58.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.057+0000 7f1a6a8aa700 1 -- start start 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a6406ea90 0x7f1a64156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a64071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a640b88b0 0x7f1a6406d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641596e0 con 0x7f1a6406fe80 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641599c0 con 0x7f1a6406ea90 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64159ca0 con 0x7f1a640b88b0 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a64071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a64071230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34388/0 (socket says 172.21.15.45:34388) 2023-12-19T18:02:58.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 -- 172.21.15.45:0/3582220221 learned_addr learned my addr 172.21.15.45:0/3582220221 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a698a8700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a6406ea90 0x7f1a64156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a0a9700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a640b88b0 0x7f1a6406d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 -- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a640b88b0 msgr2=0x7f1a6406d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a640b88b0 0x7f1a6406d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 -- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a6406ea90 msgr2=0x7f1a64156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a6406ea90 0x7f1a64156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 -- 172.21.15.45:0/3582220221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c009b30 con 0x7f1a6406fe80 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a690a7700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a64071230 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c520 tx=0x7f1a5400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540054e0 con 0x7f1a6406fe80 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a540036a0 con 0x7f1a6406fe80 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a64159f80 con 0x7f1a6406fe80 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64071770 con 0x7f1a6406fe80 2023-12-19T18:02:58.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.061+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a54003a50 con 0x7f1a6406fe80 2023-12-19T18:02:58.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.065+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a64067760 con 0x7f1a6406fe80 2023-12-19T18:02:58.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.065+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a54003bb0 con 0x7f1a6406fe80 2023-12-19T18:02:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.065+0000 7f1a5a7fc700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a48065ad0 0x7f1a48067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.065+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1a54082560 con 0x7f1a6406fe80 2023-12-19T18:02:58.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.065+0000 7f1a698a8700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a48065ad0 0x7f1a48067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.069+0000 7f1a698a8700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a48065ad0 0x7f1a48067f90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009ae0 tx=0x7f1a60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.073+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1a54050010 con 0x7f1a6406fe80 2023-12-19T18:02:58.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.253+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a6415c340 con 0x7f1a6406fe80 2023-12-19T18:02:58.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.253+0000 7f1a5a7fc700 1 -- 172.21.15.45:0/3582220221 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+12556 (secure 0 0 0) 0x7f1a54003e60 con 0x7f1a6406fe80 2023-12-19T18:02:58.260 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:58.260 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":125,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:02:57.362156+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":16,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":108,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:02:58.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a48065ad0 msgr2=0x7f1a48067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a48065ad0 0x7f1a48067f90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f1a60009ae0 tx=0x7f1a60008040 comp rx=0 tx=0).stop 2023-12-19T18:02:58.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 msgr2=0x7f1a64071230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a64071230 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f1a5400c520 tx=0x7f1a5400c8e0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 shutdown_connections 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1a48065ad0 0x7f1a48067f90 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a640b88b0 0x7f1a6406d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a6406fe80 0x7f1a64071230 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 --2- 172.21.15.45:0/3582220221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a6406ea90 0x7f1a64156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 >> 172.21.15.45:0/3582220221 conn(0x7f1a640b46d0 msgr2=0x7f1a640b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 shutdown_connections 2023-12-19T18:02:58.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.257+0000 7f1a6a8aa700 1 -- 172.21.15.45:0/3582220221 wait complete. 2023-12-19T18:02:58.286 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:02:58.287 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:02:58.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 Processor -- start 2023-12-19T18:02:58.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 -- start start 2023-12-19T18:02:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 0x7f74f80cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74f80d25f0 0x7f74f80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74f815d300 con 0x7f74f815cf20 2023-12-19T18:02:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80d1360 con 0x7f74f80d25f0 2023-12-19T18:02:58.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fd6d3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74f80d1550 con 0x7f74f80b8580 2023-12-19T18:02:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74fced2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f74f80d25f0 0x7f74f80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74effff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 0x7f74f80cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74effff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 0x7f74f80cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:45846/0 (socket says 172.21.15.45:45846) 2023-12-19T18:02:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74effff700 1 -- 172.21.15.45:0/2586808949 learned_addr learned my addr 172.21.15.45:0/2586808949 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:58.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.465+0000 7f74f7fff700 1 --1- 172.21.15.45:0/2586808949 >> v1:172.21.15.73:6789/0 conn(0x7f74f815cf20 0x7f74f80d0c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:42416/0 (socket says 172.21.15.45:42416) 2023-12-19T18:02:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fced2700 1 -- 172.21.15.45:0/2586808949 >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 msgr2=0x7f74f80cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fced2700 1 --2- 172.21.15.45:0/2586808949 >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 0x7f74f80cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fced2700 1 -- 172.21.15.45:0/2586808949 >> v1:172.21.15.73:6789/0 conn(0x7f74f815cf20 legacy=0x7f74f80d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fced2700 1 -- 172.21.15.45:0/2586808949 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74f80d1830 con 0x7f74f80d25f0 2023-12-19T18:02:58.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74effff700 1 --2- 172.21.15.45:0/2586808949 >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 0x7f74f80cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fced2700 1 --2- 172.21.15.45:0/2586808949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f80cde00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f74f80ce9d0 tx=0x7f74f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c963071be3dc01 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74f77fe700 1 -- 172.21.15.45:0/2586808949 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f000e070 con 0x7f74f80d25f0 2023-12-19T18:02:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74f77fe700 1 -- 172.21.15.45:0/2586808949 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f000bb20 con 0x7f74f80d25f0 2023-12-19T18:02:58.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74f77fe700 1 -- 172.21.15.45:0/2586808949 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0012430 con 0x7f74f80d25f0 2023-12-19T18:02:58.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 -- 172.21.15.45:0/2586808949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 msgr2=0x7f74f80cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/2586808949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f80cde00 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f74f80ce9d0 tx=0x7f74f000b330 comp rx=0 tx=0).stop 2023-12-19T18:02:58.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 -- 172.21.15.45:0/2586808949 shutdown_connections 2023-12-19T18:02:58.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/2586808949 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f80cde00 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/2586808949 >> v2:172.21.15.73:3300/0 conn(0x7f74f80b8580 0x7f74f80cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 -- 172.21.15.45:0/2586808949 >> 172.21.15.45:0/2586808949 conn(0x7f74f80b4670 msgr2=0x7f74f80b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:58.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 -- 172.21.15.45:0/2586808949 shutdown_connections 2023-12-19T18:02:58.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.469+0000 7f74fd6d3700 1 -- 172.21.15.45:0/2586808949 wait complete. 2023-12-19T18:02:58.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 Processor -- start 2023-12-19T18:02:58.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 -- start start 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f80b8580 0x7f74f80c8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f81f3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74f815cf20 0x7f74f8156800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80b2680 con 0x7f74f80d25f0 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80c8c40 con 0x7f74f80b8580 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fd6d3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74f80b28f0 con 0x7f74f815cf20 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f81f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74effff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f81f3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:34398/0 (socket says 172.21.15.45:34398) 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74effff700 1 -- 172.21.15.45:0/3178916571 learned_addr learned my addr 172.21.15.45:0/3178916571 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:58.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74f7fff700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f80b8580 0x7f74f80c8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.473+0000 7f74fced2700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74f815cf20 0x7f74f8156800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74effff700 1 -- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74f815cf20 msgr2=0x7f74f8156800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74effff700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74f815cf20 0x7f74f8156800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74effff700 1 -- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f80b8580 msgr2=0x7f74f80c8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74effff700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f80b8580 0x7f74f80c8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74effff700 1 -- 172.21.15.45:0/3178916571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009570 con 0x7f74f80d25f0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74effff700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f81f3850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e9d0 tx=0x7f74e000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000ee70 con 0x7f74f80d25f0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e000c850 con 0x7f74f80d25f0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f0009a70 con 0x7f74f80d25f0 2023-12-19T18:02:58.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e000cbc0 con 0x7f74f80d25f0 2023-12-19T18:02:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f80b2eb0 con 0x7f74f80d25f0 2023-12-19T18:02:58.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.477+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f804ed30 con 0x7f74f80d25f0 2023-12-19T18:02:58.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.481+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f74e000cd20 con 0x7f74f80d25f0 2023-12-19T18:02:58.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.481+0000 7f74f57fa700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f74d8065ad0 0x7f74d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.481+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f74e0082fb0 con 0x7f74f80d25f0 2023-12-19T18:02:58.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.481+0000 7f74f7fff700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f74d8065ad0 0x7f74d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.485+0000 7f74f7fff700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f74d8065ad0 0x7f74d8067f90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f74e8000f60 tx=0x7f74e8007ef0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.485+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f74e0050ae0 con 0x7f74f80d25f0 2023-12-19T18:02:58.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.665+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74f80d1ae0 con 0x7f74f80d25f0 2023-12-19T18:02:58.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.665+0000 7f74f57fa700 1 -- 172.21.15.45:0/3178916571 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74e0054100 con 0x7f74f80d25f0 2023-12-19T18:02:58.671 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:02:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f74d8065ad0 msgr2=0x7f74d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f74d8065ad0 0x7f74d8067f90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f74e8000f60 tx=0x7f74e8007ef0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 msgr2=0x7f74f81f3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f81f3850 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f74e000e9d0 tx=0x7f74e000ece0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 shutdown_connections 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f74d8065ad0 0x7f74d8067f90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f74f815cf20 0x7f74f8156800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f74f80d25f0 0x7f74f81f3850 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 --2- 172.21.15.45:0/3178916571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f74f80b8580 0x7f74f80c8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 >> 172.21.15.45:0/3178916571 conn(0x7f74f80b4670 msgr2=0x7f74f815c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 shutdown_connections 2023-12-19T18:02:58.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.669+0000 7f74fd6d3700 1 -- 172.21.15.45:0/3178916571 wait complete. 2023-12-19T18:02:58.696 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-19T18:02:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.873+0000 7f1b2ba5e700 1 Processor -- start 2023-12-19T18:02:58.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.873+0000 7f1b2ba5e700 1 -- start start 2023-12-19T18:02:58.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b2ba5e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1b24164690 0x7f1b240c3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b2ba5e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b240cdb80 con 0x7f1b24164a70 2023-12-19T18:02:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b2ba5e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b240cde60 con 0x7f1b240cd540 2023-12-19T18:02:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b2ba5e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b240cd970 con 0x7f1b24164690 2023-12-19T18:02:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b28ff9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1b24164a70 0x7f1b240cce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56326/0 (socket says 172.21.15.45:56326) 2023-12-19T18:02:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b28ff9700 1 -- 172.21.15.45:0/1394211097 learned_addr learned my addr 172.21.15.45:0/1394211097 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:58.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b297fa700 1 --2- 172.21.15.45:0/1394211097 >> v2:172.21.15.73:3300/0 conn(0x7f1b24164690 0x7f1b240c3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b1bfff700 1 -- 172.21.15.45:0/1394211097 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1004147683 0 0) 0x7f1b240cdb80 con 0x7f1b24164a70 2023-12-19T18:02:58.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.877+0000 7f1b1bfff700 1 -- 172.21.15.45:0/1394211097 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b100035d0 con 0x7f1b24164a70 2023-12-19T18:02:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b297fa700 1 -- 172.21.15.45:0/1394211097 >> v1:172.21.15.73:6789/0 conn(0x7f1b240cd540 legacy=0x7f1b2406ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b297fa700 1 -- 172.21.15.45:0/1394211097 >> v1:172.21.15.45:6789/0 conn(0x7f1b24164a70 legacy=0x7f1b240cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b297fa700 1 -- 172.21.15.45:0/1394211097 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b240ce140 con 0x7f1b24164690 2023-12-19T18:02:58.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b297fa700 1 --2- 172.21.15.45:0/1394211097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c3e00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1b240cdab0 tx=0x7f1b20009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c803710013d507a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b1bfff700 1 -- 172.21.15.45:0/1394211097 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20004020 con 0x7f1b24164690 2023-12-19T18:02:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b1bfff700 1 -- 172.21.15.45:0/1394211097 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20004180 con 0x7f1b24164690 2023-12-19T18:02:58.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b1bfff700 1 -- 172.21.15.45:0/1394211097 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20004530 con 0x7f1b24164690 2023-12-19T18:02:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/1394211097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 msgr2=0x7f1b240c3e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/1394211097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c3e00 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1b240cdab0 tx=0x7f1b20009b30 comp rx=0 tx=0).stop 2023-12-19T18:02:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/1394211097 shutdown_connections 2023-12-19T18:02:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/1394211097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c3e00 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/1394211097 >> 172.21.15.45:0/1394211097 conn(0x7f1b240cba40 msgr2=0x7f1b240ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/1394211097 shutdown_connections 2023-12-19T18:02:58.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.881+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/1394211097 wait complete. 2023-12-19T18:02:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.885+0000 7f1b2ba5e700 1 Processor -- start 2023-12-19T18:02:58.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 -- start start 2023-12-19T18:02:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 0x7f1b24156280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b24164a70 0x7f1b241fa230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240c6ff0 con 0x7f1b240cd540 2023-12-19T18:02:58.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240c7e30 con 0x7f1b24164690 2023-12-19T18:02:58.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b2ba5e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b240c7220 con 0x7f1b24164a70 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 0x7f1b24156280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 0x7f1b24156280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47044/0 (socket says 172.21.15.45:47044) 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 -- 172.21.15.45:0/2912262332 learned_addr learned my addr 172.21.15.45:0/2912262332 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b28ff9700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b29ffb700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b24164a70 0x7f1b241fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 -- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b24164a70 msgr2=0x7f1b241fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b24164a70 0x7f1b241fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 -- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 msgr2=0x7f1b240c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:58.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 -- 172.21.15.45:0/2912262332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b200094b0 con 0x7f1b240cd540 2023-12-19T18:02:58.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.889+0000 7f1b297fa700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 0x7f1b24156280 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f1b240ce740 tx=0x7f1b20004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.893+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20011cf0 con 0x7f1b240cd540 2023-12-19T18:02:58.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.893+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b20011e50 con 0x7f1b240cd540 2023-12-19T18:02:58.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.893+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b240c7500 con 0x7f1b240cd540 2023-12-19T18:02:58.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.893+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b20003900 con 0x7f1b240cd540 2023-12-19T18:02:58.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.893+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b240c7ac0 con 0x7f1b240cd540 2023-12-19T18:02:58.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.893+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b2404ed30 con 0x7f1b240cd540 2023-12-19T18:02:58.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.897+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1b20003a60 con 0x7f1b240cd540 2023-12-19T18:02:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.897+0000 7f1b19ffb700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1b08065b00 0x7f1b08067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:58.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.897+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f1b200842e0 con 0x7f1b240cd540 2023-12-19T18:02:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.897+0000 7f1b28ff9700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1b08065b00 0x7f1b08067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:58.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.897+0000 7f1b28ff9700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1b08065b00 0x7f1b08067fc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1b240ad920 tx=0x7f1b14007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:58.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:58.905+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1b20051fc0 con 0x7f1b240cd540 2023-12-19T18:02:59.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f1b240cce90 con 0x7f1b240cd540 2023-12-19T18:02:59.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b19ffb700 1 -- 172.21.15.45:0/2912262332 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) v1 ==== 84+0+65 (secure 0 0 0) 0x7f1b2002a060 con 0x7f1b240cd540 2023-12-19T18:02:59.097 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:02:59.097 INFO:teuthology.orchestra.run.smithi045.stdout:[ 2023-12-19T18:02:59.098 INFO:teuthology.orchestra.run.smithi045.stdout: { 2023-12-19T18:02:59.098 INFO:teuthology.orchestra.run.smithi045.stdout: "poolnum": 1, 2023-12-19T18:02:59.098 INFO:teuthology.orchestra.run.smithi045.stdout: "poolname": ".mgr" 2023-12-19T18:02:59.098 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:02:59.098 INFO:teuthology.orchestra.run.smithi045.stdout:] 2023-12-19T18:02:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1b08065b00 msgr2=0x7f1b08067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1b08065b00 0x7f1b08067fc0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f1b240ad920 tx=0x7f1b14007de0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 msgr2=0x7f1b24156280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:59.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 0x7f1b24156280 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f1b240ce740 tx=0x7f1b20004770 comp rx=0 tx=0).stop 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 shutdown_connections 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1b08065b00 0x7f1b08067fc0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1b24164a70 0x7f1b241fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1b24164690 0x7f1b240c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 --2- 172.21.15.45:0/2912262332 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1b240cd540 0x7f1b24156280 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.093+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 >> 172.21.15.45:0/2912262332 conn(0x7f1b240cba40 msgr2=0x7f1b2406ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.097+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 shutdown_connections 2023-12-19T18:02:59.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.097+0000 7f1b2ba5e700 1 -- 172.21.15.45:0/2912262332 wait complete. 2023-12-19T18:02:59.121 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-19T18:02:59.122 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-19T18:02:59.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.293+0000 7fcdef59e700 1 Processor -- start 2023-12-19T18:02:59.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.293+0000 7fcdef59e700 1 -- start start 2023-12-19T18:02:59.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdef59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdf00ce090 0x7fcdf015d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:59.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdef59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:59.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdef59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdf015a370 con 0x7fcdf015d580 2023-12-19T18:02:59.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdef59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdf0159a40 con 0x7fcdf00ce090 2023-12-19T18:02:59.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdef59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf0159d20 con 0x7fcdf0150240 2023-12-19T18:02:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdee59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcdf00ce090 0x7fcdf015d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdeed9d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdedd9b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fcdf015d580 0x7fcdf014fb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:57796/0 (socket says 172.21.15.45:57796) 2023-12-19T18:02:59.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdedd9b700 1 -- 172.21.15.45:0/1067951806 learned_addr learned my addr 172.21.15.45:0/1067951806 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcded59a700 1 -- 172.21.15.45:0/1067951806 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 505116404 0 0) 0x7fcdf015a370 con 0x7fcdf015d580 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcded59a700 1 -- 172.21.15.45:0/1067951806 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdd80035d0 con 0x7fcdf015d580 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdeed9d700 1 -- 172.21.15.45:0/1067951806 >> v2:172.21.15.73:3300/0 conn(0x7fcdf00ce090 msgr2=0x7fcdf015d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdeed9d700 1 --2- 172.21.15.45:0/1067951806 >> v2:172.21.15.73:3300/0 conn(0x7fcdf00ce090 0x7fcdf015d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdeed9d700 1 -- 172.21.15.45:0/1067951806 >> v1:172.21.15.73:6789/0 conn(0x7fcdf015d580 legacy=0x7fcdf014fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdeed9d700 1 -- 172.21.15.45:0/1067951806 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf015a000 con 0x7fcdf0150240 2023-12-19T18:02:59.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.297+0000 7fcdee59c700 1 --2- 172.21.15.45:0/1067951806 >> v2:172.21.15.73:3300/0 conn(0x7fcdf00ce090 0x7fcdf015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:02:59.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdeed9d700 1 --2- 172.21.15.45:0/1067951806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf006eeb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009d90 tx=0x7fcde800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f43091b170a78a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcded59a700 1 -- 172.21.15.45:0/1067951806 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde800e070 con 0x7fcdf0150240 2023-12-19T18:02:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcded59a700 1 -- 172.21.15.45:0/1067951806 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde800bb20 con 0x7fcdf0150240 2023-12-19T18:02:59.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcded59a700 1 -- 172.21.15.45:0/1067951806 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde8012430 con 0x7fcdf0150240 2023-12-19T18:02:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 -- 172.21.15.45:0/1067951806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 msgr2=0x7fcdf006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:59.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1067951806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf006eeb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcde8009d90 tx=0x7fcde800b330 comp rx=0 tx=0).stop 2023-12-19T18:02:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 -- 172.21.15.45:0/1067951806 shutdown_connections 2023-12-19T18:02:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1067951806 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf006eeb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1067951806 >> v2:172.21.15.73:3300/0 conn(0x7fcdf00ce090 0x7fcdf015d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 -- 172.21.15.45:0/1067951806 >> 172.21.15.45:0/1067951806 conn(0x7fcdf00cecd0 msgr2=0x7fcdf00cf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:02:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 -- 172.21.15.45:0/1067951806 shutdown_connections 2023-12-19T18:02:59.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.301+0000 7fcdef59e700 1 -- 172.21.15.45:0/1067951806 wait complete. 2023-12-19T18:02:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.305+0000 7fcdef59e700 1 Processor -- start 2023-12-19T18:02:59.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.305+0000 7fcdef59e700 1 -- start start 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.305+0000 7fcdef59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 0x7fcdf0146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.305+0000 7fcdef59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf00b2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdef59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf015d580 0x7fcdf00b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdef59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00b3c70 con 0x7fcdf00ce090 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdef59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00b30f0 con 0x7fcdf015d580 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdef59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf00b33d0 con 0x7fcdf0150240 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 0x7fcdf0146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 0x7fcdf0146c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47056/0 (socket says 172.21.15.45:47056) 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 -- 172.21.15.45:0/1992361645 learned_addr learned my addr 172.21.15.45:0/1992361645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdedd9b700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf00b2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:59.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdeed9d700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf015d580 0x7fcdf00b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 -- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 msgr2=0x7fcdf00b2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf00b2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 -- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf015d580 msgr2=0x7fcdf00b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:02:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf015d580 0x7fcdf00b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:02:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 -- 172.21.15.45:0/1992361645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00094b0 con 0x7fcdf00ce090 2023-12-19T18:02:59.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdee59c700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 0x7fcdf0146c80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fcde000ebe0 tx=0x7fcde000eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000c850 con 0x7fcdf00ce090 2023-12-19T18:02:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde000c9b0 con 0x7fcdf00ce090 2023-12-19T18:02:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde000cd40 con 0x7fcdf00ce090 2023-12-19T18:02:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde8009a70 con 0x7fcdf00ce090 2023-12-19T18:02:59.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.309+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdf00b3990 con 0x7fcdf00ce090 2023-12-19T18:02:59.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.313+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdf004ed30 con 0x7fcdf00ce090 2023-12-19T18:02:59.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.313+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcde0013470 con 0x7fcdf00ce090 2023-12-19T18:02:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.313+0000 7fcddeffd700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdd0065ad0 0x7fcdd0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:02:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.313+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fcde00830d0 con 0x7fcdf00ce090 2023-12-19T18:02:59.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.313+0000 7fcdedd9b700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdd0065ad0 0x7fcdd0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:02:59.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.317+0000 7fcdedd9b700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdd0065ad0 0x7fcdd0067f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcdf014d370 tx=0x7fcde4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:02:59.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.321+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcde0050c00 con 0x7fcdf00ce090 2023-12-19T18:02:59.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:02:59.505+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcdf014afc0 con 0x7fcdf00ce090 2023-12-19T18:03:00.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.013+0000 7fcddeffd700 1 -- 172.21.15.45:0/1992361645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcde000cea0 con 0x7fcdf00ce090 2023-12-19T18:03:00.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdd0065ad0 msgr2=0x7fcdd0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:00.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdd0065ad0 0x7fcdd0067f90 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcdf014d370 tx=0x7fcde4009040 comp rx=0 tx=0).stop 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 msgr2=0x7fcdf0146c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 0x7fcdf0146c80 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fcde000ebe0 tx=0x7fcde000eef0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 shutdown_connections 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcdd0065ad0 0x7fcdd0067f90 secure :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcdf014d370 tx=0x7fcde4009040 comp rx=0 tx=0).stop 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcdf015d580 0x7fcdf00b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcdf0150240 0x7fcdf00b2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 --2- 172.21.15.45:0/1992361645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcdf00ce090 0x7fcdf0146c80 secure :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fcde000ebe0 tx=0x7fcde000eef0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 >> 172.21.15.45:0/1992361645 conn(0x7fcdf00cecd0 msgr2=0x7fcdf015cdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 shutdown_connections 2023-12-19T18:03:00.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.017+0000 7fcdef59e700 1 -- 172.21.15.45:0/1992361645 wait complete. 2023-12-19T18:03:00.028 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' created 2023-12-19T18:03:00.047 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-19T18:03:00.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.233+0000 7f2123335700 1 Processor -- start 2023-12-19T18:03:00.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.233+0000 7f2123335700 1 -- start start 2023-12-19T18:03:00.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2123335700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 0x7f211c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:00.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2123335700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f211c0d2620 0x7f211c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2123335700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211c0d2190 con 0x7f211c070ab0 2023-12-19T18:03:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2123335700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c0d2ad0 con 0x7f211c0d2620 2023-12-19T18:03:00.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2123335700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0ce350 con 0x7f211c0b2040 2023-12-19T18:03:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 0x7f211c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2122333700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f211c070ab0 0x7f211c070e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:57812/0 (socket says 172.21.15.45:57812) 2023-12-19T18:03:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2122333700 1 -- 172.21.15.45:0/1486301677 learned_addr learned my addr 172.21.15.45:0/1486301677 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:00.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 --2- 172.21.15.45:0/1486301677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 0x7f211c0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:43010/0 (socket says 172.21.15.45:43010) 2023-12-19T18:03:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2122b34700 1 --2- 172.21.15.45:0/1486301677 >> v2:172.21.15.73:3300/0 conn(0x7f211c0d2620 0x7f211c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 -- 172.21.15.45:0/1486301677 >> v2:172.21.15.73:3300/0 conn(0x7f211c0d2620 msgr2=0x7f211c0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 --2- 172.21.15.45:0/1486301677 >> v2:172.21.15.73:3300/0 conn(0x7f211c0d2620 0x7f211c0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 -- 172.21.15.45:0/1486301677 >> v1:172.21.15.73:6789/0 conn(0x7f211c070ab0 legacy=0x7f211c070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 -- 172.21.15.45:0/1486301677 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c0ce070 con 0x7f211c0b2040 2023-12-19T18:03:00.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121331700 1 -- 172.21.15.45:0/1486301677 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 555377934 0 0) 0x7f211c0d2190 con 0x7f211c070ab0 2023-12-19T18:03:00.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.237+0000 7f2121b32700 1 --2- 172.21.15.45:0/1486301677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 0x7f211c0cd500 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f210c009850 tx=0x7f210c009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8564b1ff16e57f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2121331700 1 -- 172.21.15.45:0/1486301677 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c011830 con 0x7f211c0b2040 2023-12-19T18:03:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2121331700 1 -- 172.21.15.45:0/1486301677 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c011990 con 0x7f211c0b2040 2023-12-19T18:03:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2121331700 1 -- 172.21.15.45:0/1486301677 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c011d40 con 0x7f211c0b2040 2023-12-19T18:03:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 -- 172.21.15.45:0/1486301677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 msgr2=0x7f211c0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:00.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 --2- 172.21.15.45:0/1486301677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 0x7f211c0cd500 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f210c009850 tx=0x7f210c009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 -- 172.21.15.45:0/1486301677 shutdown_connections 2023-12-19T18:03:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 --2- 172.21.15.45:0/1486301677 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c0b2040 0x7f211c0cd500 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 --2- 172.21.15.45:0/1486301677 >> v2:172.21.15.73:3300/0 conn(0x7f211c0d2620 0x7f211c0b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 -- 172.21.15.45:0/1486301677 >> 172.21.15.45:0/1486301677 conn(0x7f211c0d2ca0 msgr2=0x7f211c0d30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:00.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 -- 172.21.15.45:0/1486301677 shutdown_connections 2023-12-19T18:03:00.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.241+0000 7f2123335700 1 -- 172.21.15.45:0/1486301677 wait complete. 2023-12-19T18:03:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 Processor -- start 2023-12-19T18:03:00.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 -- start start 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c070ab0 0x7f211c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f211c0b2040 0x7f211c0cb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 0x7f211c0c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0c9d70 con 0x7f211c0d2620 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0ca010 con 0x7f211c0b2040 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2123335700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0ca2f0 con 0x7f211c070ab0 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2122b34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 0x7f211c0c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2122b34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 0x7f211c0c7170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47060/0 (socket says 172.21.15.45:47060) 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2122b34700 1 -- 172.21.15.45:0/465885128 learned_addr learned my addr 172.21.15.45:0/465885128 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:00.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2122333700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c070ab0 0x7f211c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.245+0000 7f2121b32700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f211c0b2040 0x7f211c0cb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2121b32700 1 -- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c070ab0 msgr2=0x7f211c156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2121b32700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c070ab0 0x7f211c156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2121b32700 1 -- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 msgr2=0x7f211c0c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2121b32700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 0x7f211c0c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2121b32700 1 -- 172.21.15.45:0/465885128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210c0094b0 con 0x7f211c0b2040 2023-12-19T18:03:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2122b34700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 0x7f211c0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2121b32700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f211c0b2040 0x7f211c0cb0b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f210c016000 tx=0x7f210c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:00.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c019980 con 0x7f211c0b2040 2023-12-19T18:03:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210c01e070 con 0x7f211c0b2040 2023-12-19T18:03:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c019d60 con 0x7f211c0b2040 2023-12-19T18:03:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c0ca5d0 con 0x7f211c0b2040 2023-12-19T18:03:00.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.249+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c0cab90 con 0x7f211c0b2040 2023-12-19T18:03:00.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.253+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c0cad80 con 0x7f211c0b2040 2023-12-19T18:03:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.253+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f210c01a420 con 0x7f211c0b2040 2023-12-19T18:03:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.253+0000 7f2112ffd700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2100065b20 0x7f2100067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:00.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.253+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f210c083fd0 con 0x7f211c0b2040 2023-12-19T18:03:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.257+0000 7f2122333700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2100065b20 0x7f2100067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.257+0000 7f2122333700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2100065b20 0x7f2100067fe0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2118000f60 tx=0x7f2118007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.265+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f210c051a10 con 0x7f211c0b2040 2023-12-19T18:03:00.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:00.457+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f211c0d1b10 con 0x7f211c0b2040 2023-12-19T18:03:01.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.017+0000 7f2112ffd700 1 -- 172.21.15.45:0/465885128 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) v1 ==== 170+0+0 (secure 0 0 0) 0x7f210c006ce0 con 0x7f211c0b2040 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2100065b20 msgr2=0x7f2100067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2100065b20 0x7f2100067fe0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2118000f60 tx=0x7f2118007e90 comp rx=0 tx=0).stop 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f211c0b2040 msgr2=0x7f211c0cb0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f211c0b2040 0x7f211c0cb0b0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f210c016000 tx=0x7f210c004770 comp rx=0 tx=0).stop 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 shutdown_connections 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2100065b20 0x7f2100067fe0 secure :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2118000f60 tx=0x7f2118007e90 comp rx=0 tx=0).stop 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f211c0d2620 0x7f211c0c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f211c0b2040 0x7f211c0cb0b0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 --2- 172.21.15.45:0/465885128 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f211c070ab0 0x7f211c156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.033+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 >> 172.21.15.45:0/465885128 conn(0x7f211c0d2ca0 msgr2=0x7f211c0b6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:01.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.037+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 shutdown_connections 2023-12-19T18:03:01.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.037+0000 7f2123335700 1 -- 172.21.15.45:0/465885128 wait complete. 2023-12-19T18:03:01.049 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' created 2023-12-19T18:03:01.068 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-19T18:03:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.237+0000 7f5bcdb12700 1 Processor -- start 2023-12-19T18:03:01.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.237+0000 7f5bcdb12700 1 -- start start 2023-12-19T18:03:01.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bcdb12700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc81619b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bcdb12700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5bc80b2490 0x7f5bc806f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bcdb12700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc80b1d20 con 0x7f5bc81626c0 2023-12-19T18:03:01.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bcdb12700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc806ec50 con 0x7f5bc80b2490 2023-12-19T18:03:01.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bcdb12700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc80b2c00 con 0x7f5bc806dd70 2023-12-19T18:03:01.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc81619b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc81619b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:43022/0 (socket says 172.21.15.45:43022) 2023-12-19T18:03:01.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 -- 172.21.15.45:0/2349724967 learned_addr learned my addr 172.21.15.45:0/2349724967 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:01.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bc7fff700 1 --2- 172.21.15.45:0/2349724967 >> v2:172.21.15.45:3300/0 conn(0x7f5bc80b2490 0x7f5bc806f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bc6ffd700 1 -- 172.21.15.45:0/2349724967 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3101874507 0 0) 0x7f5bc80b1d20 con 0x7f5bc81626c0 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bc6ffd700 1 -- 172.21.15.45:0/2349724967 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb40035d0 con 0x7f5bc81626c0 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 -- 172.21.15.45:0/2349724967 >> v2:172.21.15.45:3300/0 conn(0x7f5bc80b2490 msgr2=0x7f5bc806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 --2- 172.21.15.45:0/2349724967 >> v2:172.21.15.45:3300/0 conn(0x7f5bc80b2490 0x7f5bc806f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 -- 172.21.15.45:0/2349724967 >> v1:172.21.15.73:6789/0 conn(0x7f5bc81626c0 legacy=0x7f5bc806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bbeffd700 1 -- 172.21.15.45:0/2349724967 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc80b2ee0 con 0x7f5bc806dd70 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.241+0000 7f5bc7fff700 1 --2- 172.21.15.45:0/2349724967 >> v2:172.21.15.45:3300/0 conn(0x7f5bc80b2490 0x7f5bc806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:01.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bbeffd700 1 --2- 172.21.15.45:0/2349724967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc81619b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009e50 tx=0x7f5bb000b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=354fa095a831a5b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:01.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bc6ffd700 1 -- 172.21.15.45:0/2349724967 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000e070 con 0x7f5bc806dd70 2023-12-19T18:03:01.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bc6ffd700 1 -- 172.21.15.45:0/2349724967 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb000b910 con 0x7f5bc806dd70 2023-12-19T18:03:01.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bc6ffd700 1 -- 172.21.15.45:0/2349724967 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb000bcc0 con 0x7f5bc806dd70 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 -- 172.21.15.45:0/2349724967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 msgr2=0x7f5bc81619b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/2349724967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc81619b0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009e50 tx=0x7f5bb000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 -- 172.21.15.45:0/2349724967 shutdown_connections 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/2349724967 >> v2:172.21.15.45:3300/0 conn(0x7f5bc80b2490 0x7f5bc806f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/2349724967 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc81619b0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 -- 172.21.15.45:0/2349724967 >> 172.21.15.45:0/2349724967 conn(0x7f5bc8071990 msgr2=0x7f5bc80b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:01.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 -- 172.21.15.45:0/2349724967 shutdown_connections 2023-12-19T18:03:01.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 -- 172.21.15.45:0/2349724967 wait complete. 2023-12-19T18:03:01.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 Processor -- start 2023-12-19T18:03:01.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.245+0000 7f5bcdb12700 1 -- start start 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc8151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 0x7f5bc8164b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc81626c0 0x7f5bc8165080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc815c110 con 0x7f5bc80b2490 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc815c3f0 con 0x7f5bc81626c0 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc815c6d0 con 0x7f5bc806dd70 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 0x7f5bc8164b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 0x7f5bc8164b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47086/0 (socket says 172.21.15.45:47086) 2023-12-19T18:03:01.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 -- 172.21.15.45:0/3157899547 learned_addr learned my addr 172.21.15.45:0/3157899547 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bc77fe700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc8151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bc7fff700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc81626c0 0x7f5bc8165080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 -- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 msgr2=0x7f5bc8151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc8151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 -- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc81626c0 msgr2=0x7f5bc8165080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc81626c0 0x7f5bc8165080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 -- 172.21.15.45:0/3157899547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc00094b0 con 0x7f5bc80b2490 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bc7fff700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc81626c0 0x7f5bc8165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bbeffd700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 0x7f5bc8164b40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b370 tx=0x7f5bb0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0004960 con 0x7f5bc80b2490 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb00092e0 con 0x7f5bc80b2490 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb001c6a0 con 0x7f5bc80b2490 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0009b30 con 0x7f5bc80b2490 2023-12-19T18:03:01.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.249+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc815cc90 con 0x7f5bc80b2490 2023-12-19T18:03:01.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.253+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc804ed30 con 0x7f5bc80b2490 2023-12-19T18:03:01.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.253+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5bb001c800 con 0x7f5bc80b2490 2023-12-19T18:03:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.257+0000 7f5bc4ff9700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ba8065ad0 0x7f5ba8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.257+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f5bb0084ba0 con 0x7f5bc80b2490 2023-12-19T18:03:01.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.257+0000 7f5bc77fe700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ba8065ad0 0x7f5ba8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.257+0000 7f5bc77fe700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ba8065ad0 0x7f5ba8067f90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80011e0 tx=0x7f5bb8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:01.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.261+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5bb0052510 con 0x7f5bc80b2490 2023-12-19T18:03:01.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.473+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5bc806cef0 con 0x7f5bc80b2490 2023-12-19T18:03:01.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.489+0000 7f5bc4ff9700 1 -- 172.21.15.45:0/3157899547 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 17 and data pool 18 v95) v1 ==== 174+0+0 (secure 0 0 0) 0x7f5bb0055b30 con 0x7f5bc80b2490 2023-12-19T18:03:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.501+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ba8065ad0 msgr2=0x7f5ba8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.501+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ba8065ad0 0x7f5ba8067f90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80011e0 tx=0x7f5bb8009040 comp rx=0 tx=0).stop 2023-12-19T18:03:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.501+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 msgr2=0x7f5bc8164b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.501+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 0x7f5bc8164b40 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000b370 tx=0x7f5bb0004af0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.505+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 shutdown_connections 2023-12-19T18:03:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.505+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ba8065ad0 0x7f5ba8067f90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.505+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5bc81626c0 0x7f5bc8165080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.505+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5bc80b2490 0x7f5bc8164b40 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.505+0000 7f5bcdb12700 1 --2- 172.21.15.45:0/3157899547 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5bc806dd70 0x7f5bc8151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.505+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 >> 172.21.15.45:0/3157899547 conn(0x7f5bc8071990 msgr2=0x7f5bc80cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.509+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 shutdown_connections 2023-12-19T18:03:01.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.509+0000 7f5bcdb12700 1 -- 172.21.15.45:0/3157899547 wait complete. 2023-12-19T18:03:01.524 INFO:teuthology.orchestra.run.smithi045.stderr:new fs with metadata pool 17 and data pool 18 2023-12-19T18:03:01.546 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.713+0000 7fb951076700 1 Processor -- start 2023-12-19T18:03:01.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.713+0000 7fb951076700 1 -- start start 2023-12-19T18:03:01.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb951076700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c0c4030 0x7fb94c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb951076700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c06e310 con 0x7fb94c161530 2023-12-19T18:03:01.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb951076700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb94c161990 con 0x7fb94c15cff0 2023-12-19T18:03:01.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb951076700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c15d3d0 con 0x7fb94c0c4030 2023-12-19T18:03:01.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb94b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb94c161530 0x7fb94c0c3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56328/0 (socket says 172.21.15.45:56328) 2023-12-19T18:03:01.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb94b7fe700 1 -- 172.21.15.45:0/3183766458 learned_addr learned my addr 172.21.15.45:0/3183766458 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb950875700 1 --2- 172.21.15.45:0/3183766458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c0c4030 0x7fb94c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb94affd700 1 -- 172.21.15.45:0/3183766458 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849230019 0 0) 0x7fb94c06e310 con 0x7fb94c161530 2023-12-19T18:03:01.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb94affd700 1 -- 172.21.15.45:0/3183766458 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9340035d0 con 0x7fb94c161530 2023-12-19T18:03:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb950875700 1 -- 172.21.15.45:0/3183766458 >> v1:172.21.15.73:6789/0 conn(0x7fb94c15cff0 legacy=0x7fb94c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb950875700 1 -- 172.21.15.45:0/3183766458 >> v1:172.21.15.45:6789/0 conn(0x7fb94c161530 legacy=0x7fb94c0c3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb94affd700 1 -- 172.21.15.45:0/3183766458 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1027577257 0 0) 0x7fb94c161990 con 0x7fb94c15cff0 2023-12-19T18:03:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.717+0000 7fb950875700 1 -- 172.21.15.45:0/3183766458 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c0ca6f0 con 0x7fb94c0c4030 2023-12-19T18:03:01.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb950875700 1 --2- 172.21.15.45:0/3183766458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c0c4030 0x7fb94c06ddd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb944009dc0 tx=0x7fb94400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2668b5b4af78342 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:01.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb94affd700 1 -- 172.21.15.45:0/3183766458 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94400e070 con 0x7fb94c0c4030 2023-12-19T18:03:01.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb94affd700 1 -- 172.21.15.45:0/3183766458 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944003a40 con 0x7fb94c0c4030 2023-12-19T18:03:01.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb94affd700 1 -- 172.21.15.45:0/3183766458 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb940001670 con 0x7fb94c0c4030 2023-12-19T18:03:01.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 -- 172.21.15.45:0/3183766458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c0c4030 msgr2=0x7fb94c06ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 --2- 172.21.15.45:0/3183766458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c0c4030 0x7fb94c06ddd0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb944009dc0 tx=0x7fb94400b330 comp rx=0 tx=0).stop 2023-12-19T18:03:01.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 -- 172.21.15.45:0/3183766458 shutdown_connections 2023-12-19T18:03:01.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 --2- 172.21.15.45:0/3183766458 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c0c4030 0x7fb94c06ddd0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 -- 172.21.15.45:0/3183766458 >> 172.21.15.45:0/3183766458 conn(0x7fb94c0cb900 msgr2=0x7fb94c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:01.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 -- 172.21.15.45:0/3183766458 shutdown_connections 2023-12-19T18:03:01.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.721+0000 7fb951076700 1 -- 172.21.15.45:0/3183766458 wait complete. 2023-12-19T18:03:01.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 Processor -- start 2023-12-19T18:03:01.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 -- start start 2023-12-19T18:03:01.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb94c0c4030 0x7fb94c0b3360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c15cff0 0x7fb94c0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 0x7fb94c15e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0b38a0 con 0x7fb94c161530 2023-12-19T18:03:01.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0c79e0 con 0x7fb94c0c4030 2023-12-19T18:03:01.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb951076700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94c0c7cc0 con 0x7fb94c15cff0 2023-12-19T18:03:01.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb950875700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 0x7fb94c15e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb950875700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 0x7fb94c15e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47092/0 (socket says 172.21.15.45:47092) 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb950875700 1 -- 172.21.15.45:0/3773553521 learned_addr learned my addr 172.21.15.45:0/3773553521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.725+0000 7fb94bfff700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb94c0c4030 0x7fb94c0b3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb94b7fe700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c15cff0 0x7fb94c0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb950875700 1 -- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c15cff0 msgr2=0x7fb94c0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb950875700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c15cff0 0x7fb94c0c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb950875700 1 -- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb94c0c4030 msgr2=0x7fb94c0b3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb950875700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb94c0c4030 0x7fb94c0b3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb950875700 1 -- 172.21.15.45:0/3773553521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb944009a70 con 0x7fb94c161530 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb94b7fe700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c15cff0 0x7fb94c0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb950875700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 0x7fb94c15e560 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fb944009d90 tx=0x7fb944004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944004580 con 0x7fb94c161530 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb944004700 con 0x7fb94c161530 2023-12-19T18:03:01.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb94c0c7fa0 con 0x7fb94c161530 2023-12-19T18:03:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb944012450 con 0x7fb94c161530 2023-12-19T18:03:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb94c0c8560 con 0x7fb94c161530 2023-12-19T18:03:01.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.729+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94c067760 con 0x7fb94c161530 2023-12-19T18:03:01.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.733+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb944019030 con 0x7fb94c161530 2023-12-19T18:03:01.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.733+0000 7fb948ff9700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb938065ad0 0x7fb938067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:01.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.733+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb944084ff0 con 0x7fb94c161530 2023-12-19T18:03:01.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.733+0000 7fb94bfff700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb938065ad0 0x7fb938067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:01.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.733+0000 7fb94bfff700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb938065ad0 0x7fb938067f90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb93c007fd0 tx=0x7fb93c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:01.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.737+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb9440562f0 con 0x7fb94c161530 2023-12-19T18:03:01.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.925+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb94c0b1170 con 0x7fb94c161530 2023-12-19T18:03:01.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.925+0000 7fb948ff9700 1 -- 172.21.15.45:0/3773553521 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16281 (secure 0 0 0) 0x7fb944055e80 con 0x7fb94c161530 2023-12-19T18:03:01.933 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:01.933 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":128,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:01.479357+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb938065ad0 msgr2=0x7fb938067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb938065ad0 0x7fb938067f90 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb93c007fd0 tx=0x7fb93c009040 comp rx=0 tx=0).stop 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 msgr2=0x7fb94c15e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 0x7fb94c15e560 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fb944009d90 tx=0x7fb944004af0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 shutdown_connections 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb938065ad0 0x7fb938067f90 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb94c161530 0x7fb94c15e560 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb94c15cff0 0x7fb94c0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 --2- 172.21.15.45:0/3773553521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb94c0c4030 0x7fb94c0b3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:01.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 >> 172.21.15.45:0/3773553521 conn(0x7fb94c0cb900 msgr2=0x7fb94c15c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 shutdown_connections 2023-12-19T18:03:01.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:01.933+0000 7fb951076700 1 -- 172.21.15.45:0/3773553521 wait complete. 2023-12-19T18:03:01.961 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:02.077 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:03:02.085 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:03:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 Processor -- start 2023-12-19T18:03:02.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 -- start start 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f80000d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f800006fe80 0x7f80000b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80000d1820 con 0x7f80000b88b0 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80000d1b00 con 0x7f800006fe80 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7fff59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000d1de0 con 0x7f800006ea90 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7ffdd9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f80000b88b0 0x7f80000b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56330/0 (socket says 172.21.15.45:56330) 2023-12-19T18:03:02.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.137+0000 7f7ffdd9b700 1 -- 172.21.15.45:0/3953485871 learned_addr learned my addr 172.21.15.45:0/3953485871 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:02.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffed9d700 1 --2- 172.21.15.45:0/3953485871 >> v2:172.21.15.73:3300/0 conn(0x7f800006fe80 0x7f80000b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffe59c700 1 --2- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f80000d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffd59a700 1 -- 172.21.15.45:0/3953485871 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927290681 0 0) 0x7f80000d1820 con 0x7f80000b88b0 2023-12-19T18:03:02.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffd59a700 1 -- 172.21.15.45:0/3953485871 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fec0035d0 con 0x7f80000b88b0 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffed9d700 1 -- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 msgr2=0x7f80000d0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffed9d700 1 --2- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f80000d0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffed9d700 1 -- 172.21.15.45:0/3953485871 >> v1:172.21.15.45:6789/0 conn(0x7f80000b88b0 legacy=0x7f80000b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffed9d700 1 -- 172.21.15.45:0/3953485871 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80000d20c0 con 0x7f800006fe80 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffed9d700 1 --2- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000b6420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009d90 tx=0x7f7ff800b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c792da65d6386f0a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffd59a700 1 -- 172.21.15.45:0/3953485871 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800e070 con 0x7f800006fe80 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffd59a700 1 -- 172.21.15.45:0/3953485871 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800bb20 con 0x7f800006fe80 2023-12-19T18:03:02.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7ffd59a700 1 -- 172.21.15.45:0/3953485871 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8012430 con 0x7f800006fe80 2023-12-19T18:03:02.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 -- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 msgr2=0x7f80000b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 --2- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000b6420 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009d90 tx=0x7f7ff800b330 comp rx=0 tx=0).stop 2023-12-19T18:03:02.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 -- 172.21.15.45:0/3953485871 shutdown_connections 2023-12-19T18:03:02.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 --2- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000b6420 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 --2- 172.21.15.45:0/3953485871 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f80000d0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 -- 172.21.15.45:0/3953485871 >> 172.21.15.45:0/3953485871 conn(0x7f80000b46d0 msgr2=0x7f80000b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:02.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 -- 172.21.15.45:0/3953485871 shutdown_connections 2023-12-19T18:03:02.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.141+0000 7f7fff59e700 1 -- 172.21.15.45:0/3953485871 wait complete. 2023-12-19T18:03:02.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 Processor -- start 2023-12-19T18:03:02.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 -- start start 2023-12-19T18:03:02.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f8000159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80000b88b0 0x7f8000070c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000c6dd0 con 0x7f80000b88b0 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000ccbe0 con 0x7f800006fe80 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800015a1e0 con 0x7f800006ea90 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f8000159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f8000159ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:43044/0 (socket says 172.21.15.45:43044) 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 -- 172.21.15.45:0/2679000398 learned_addr learned my addr 172.21.15.45:0/2679000398 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:02.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80000b88b0 0x7f8000070c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffdd9b700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 -- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 msgr2=0x7f80000c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 -- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80000b88b0 msgr2=0x7f8000070c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80000b88b0 0x7f8000070c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 -- 172.21.15.45:0/2679000398 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8009a70 con 0x7f800006ea90 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ffe59c700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f8000159ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000e840 tx=0x7f7ff000eb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00095a0 con 0x7f800006ea90 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff0013680 con 0x7f800006ea90 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80001e6f70 con 0x7f800006ea90 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.149+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff00139f0 con 0x7f800006ea90 2023-12-19T18:03:02.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.153+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80000c6710 con 0x7f800006ea90 2023-12-19T18:03:02.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.153+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000067760 con 0x7f800006ea90 2023-12-19T18:03:02.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.153+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ff0013b50 con 0x7f800006ea90 2023-12-19T18:03:02.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.153+0000 7f7ff6ffd700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7fe0065ad0 0x7f7fe0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.153+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7ff0083220 con 0x7f800006ea90 2023-12-19T18:03:02.160 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.157+0000 7f7ffdd9b700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7fe0065ad0 0x7f7fe0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.157+0000 7f7ffdd9b700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7fe0065ad0 0x7f7fe0067f90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f80001f9800 tx=0x7f7fe8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:02.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.161+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7ff0050a90 con 0x7f800006ea90 2023-12-19T18:03:02.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.341+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80000b7a90 con 0x7f800006ea90 2023-12-19T18:03:02.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.345+0000 7f7ff6ffd700 1 -- 172.21.15.45:0/2679000398 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+16281 (secure 0 0 0) 0x7f7ff00540b0 con 0x7f800006ea90 2023-12-19T18:03:02.350 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:02.350 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":128,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:01.479357+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7fe0065ad0 msgr2=0x7f7fe0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7fe0065ad0 0x7f7fe0067f90 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f80001f9800 tx=0x7f7fe8009040 comp rx=0 tx=0).stop 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 msgr2=0x7f8000159ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f8000159ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7ff000e840 tx=0x7f7ff000eb50 comp rx=0 tx=0).stop 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 shutdown_connections 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7fe0065ad0 0x7f7fe0067f90 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f80000b88b0 0x7f8000070c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f800006fe80 0x7f80000c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 --2- 172.21.15.45:0/2679000398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f800006ea90 0x7f8000159ca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 >> 172.21.15.45:0/2679000398 conn(0x7f80000b46d0 msgr2=0x7f80000b6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:02.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 shutdown_connections 2023-12-19T18:03:02.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.349+0000 7f7fff59e700 1 -- 172.21.15.45:0/2679000398 wait complete. 2023-12-19T18:03:02.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-19T18:03:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.565+0000 7fe91f59e700 1 Processor -- start 2023-12-19T18:03:02.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.565+0000 7fe91f59e700 1 -- start start 2023-12-19T18:03:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9200cdfd0 0x7fe920167a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91f59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92015d300 con 0x7fe9200b8580 2023-12-19T18:03:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9200d1550 con 0x7fe92015cf20 2023-12-19T18:03:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200d1360 con 0x7fe9200cdfd0 2023-12-19T18:03:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe917fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe9200b8580 0x7fe9200cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56340/0 (socket says 172.21.15.45:56340) 2023-12-19T18:03:02.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe917fff700 1 -- 172.21.15.45:0/2968831760 learned_addr learned my addr 172.21.15.45:0/2968831760 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91ed9d700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9200cdfd0 0x7fe920167a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719795663 0 0) 0x7fe92015d300 con 0x7fe9200b8580 2023-12-19T18:03:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90c0035d0 con 0x7fe9200b8580 2023-12-19T18:03:02.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170599019 0 0) 0x7fe9200d1550 con 0x7fe92015cf20 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe92015d300 con 0x7fe92015cf20 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 706878179 0 0) 0x7fe90c0035d0 con 0x7fe9200b8580 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9200cdfd0 msgr2=0x7fe920167a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9200cdfd0 0x7fe920167a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 >> v1:172.21.15.73:6789/0 conn(0x7fe92015cf20 legacy=0x7fe9200d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9200d1830 con 0x7fe9200b8580 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fe908001690 con 0x7fe9200b8580 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 >> v1:172.21.15.45:6789/0 conn(0x7fe9200b8580 legacy=0x7fe9200cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe90c003be0 0x7fe90c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c004870 0x7fe90c004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe90c005230 0x7fe90c00ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00c020 con 0x7fe90c005230 2023-12-19T18:03:02.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00c190 con 0x7fe90c004870 2023-12-19T18:03:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00c350 con 0x7fe90c003be0 2023-12-19T18:03:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91e59c700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe90c003be0 0x7fe90c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe91ed9d700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe90c005230 0x7fe90c00ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.569+0000 7fe917fff700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c004870 0x7fe90c004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91e59c700 1 -- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c004870 msgr2=0x7fe90c004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91e59c700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c004870 0x7fe90c004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91e59c700 1 -- 172.21.15.45:0/2968831760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe90c005230 msgr2=0x7fe90c00ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91e59c700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe90c005230 0x7fe90c00ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91e59c700 1 -- 172.21.15.45:0/2968831760 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0035d0 con 0x7fe90c003be0 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91ed9d700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe90c005230 0x7fe90c00ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91e59c700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe90c003be0 0x7fe90c003fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe910001960 tx=0x7fe90c0058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b83942108d77b7a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910001450 con 0x7fe90c003be0 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9100052f0 con 0x7fe90c003be0 2023-12-19T18:03:02.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91dd9b700 1 -- 172.21.15.45:0/2968831760 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100036a0 con 0x7fe90c003be0 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91f59e700 1 -- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe90c003be0 msgr2=0x7fe90c003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91f59e700 1 --2- 172.21.15.45:0/2968831760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe90c003be0 0x7fe90c003fe0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe910001960 tx=0x7fe90c0058a0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91ed9d700 1 -- 172.21.15.45:0/2968831760 reap_dead start 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91f59e700 1 -- 172.21.15.45:0/2968831760 shutdown_connections 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91f59e700 1 -- 172.21.15.45:0/2968831760 >> 172.21.15.45:0/2968831760 conn(0x7fe9200b4670 msgr2=0x7fe9200b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91f59e700 1 -- 172.21.15.45:0/2968831760 shutdown_connections 2023-12-19T18:03:02.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.573+0000 7fe91f59e700 1 -- 172.21.15.45:0/2968831760 wait complete. 2023-12-19T18:03:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.577+0000 7fe91f59e700 1 Processor -- start 2023-12-19T18:03:02.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.577+0000 7fe91f59e700 1 -- start start 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c003be0 0x7fe920159330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 0x7fe9201f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9201f3ac0 0x7fe9200a95e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe920159870 con 0x7fe9201f5030 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f3f90 con 0x7fe90c003be0 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201f4270 con 0x7fe9201f3ac0 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 0x7fe9201f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 0x7fe9201f3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47122/0 (socket says 172.21.15.45:47122) 2023-12-19T18:03:02.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 -- 172.21.15.45:0/3152425267 learned_addr learned my addr 172.21.15.45:0/3152425267 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91e59c700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c003be0 0x7fe920159330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91ed9d700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9201f3ac0 0x7fe9200a95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 -- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9201f3ac0 msgr2=0x7fe9200a95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9201f3ac0 0x7fe9200a95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 -- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c003be0 msgr2=0x7fe920159330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c003be0 0x7fe920159330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 -- 172.21.15.45:0/3152425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9201f4550 con 0x7fe9201f5030 2023-12-19T18:03:02.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe917fff700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 0x7fe9201f3580 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe908007290 tx=0x7fe9080075a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908012620 con 0x7fe9201f5030 2023-12-19T18:03:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe908012780 con 0x7fe9201f5030 2023-12-19T18:03:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9201f4830 con 0x7fe9201f5030 2023-12-19T18:03:02.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.581+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe908012b30 con 0x7fe9201f5030 2023-12-19T18:03:02.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.585+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9200b7660 con 0x7fe9201f5030 2023-12-19T18:03:02.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.585+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9201f4d50 con 0x7fe9201f5030 2023-12-19T18:03:02.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.585+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe908012c90 con 0x7fe9201f5030 2023-12-19T18:03:02.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.589+0000 7fe916ffd700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe900065ad0 0x7fe900067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:02.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.589+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe908083220 con 0x7fe9201f5030 2023-12-19T18:03:02.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.589+0000 7fe91e59c700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe900065ad0 0x7fe900067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:02.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.589+0000 7fe91e59c700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe900065ad0 0x7fe900067f90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe910015040 tx=0x7fe91000a000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:02.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.593+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe9201f4d50 con 0x7fe9201f5030 2023-12-19T18:03:02.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:02.805+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe9201f4d50 con 0x7fe9201f5030 2023-12-19T18:03:03.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2023-12-19T18:03:03.047 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-19T18:03:03.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.505+0000 7fe916ffd700 1 -- 172.21.15.45:0/3152425267 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v98) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe9201f4d50 con 0x7fe9201f5030 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe900065ad0 msgr2=0x7fe900067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe900065ad0 0x7fe900067f90 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe910015040 tx=0x7fe91000a000 comp rx=0 tx=0).stop 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 msgr2=0x7fe9201f3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 0x7fe9201f3580 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fe908007290 tx=0x7fe9080075a0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 shutdown_connections 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe900065ad0 0x7fe900067f90 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe9201f3ac0 0x7fe9200a95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe9201f5030 0x7fe9201f3580 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 --2- 172.21.15.45:0/3152425267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe90c003be0 0x7fe920159330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 >> 172.21.15.45:0/3152425267 conn(0x7fe9200b4670 msgr2=0x7fe9200cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:03.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 shutdown_connections 2023-12-19T18:03:03.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.509+0000 7fe91f59e700 1 -- 172.21.15.45:0/3152425267 wait complete. 2023-12-19T18:03:03.541 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-19T18:03:03.541 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-19T18:03:03.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.729+0000 7fa045439700 1 Processor -- start 2023-12-19T18:03:03.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.729+0000 7fa045439700 1 -- start start 2023-12-19T18:03:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.729+0000 7fa045439700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa0400713d0 0x7fa0400717f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.729+0000 7fa045439700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0400b1f20 con 0x7fa0400b3a30 2023-12-19T18:03:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.729+0000 7fa045439700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa040071d30 con 0x7fa04015cf00 2023-12-19T18:03:03.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.729+0000 7fa045439700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0400ad8b0 con 0x7fa0400713d0 2023-12-19T18:03:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa0377fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa0400b3a30 0x7fa0400acff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56354/0 (socket says 172.21.15.45:56354) 2023-12-19T18:03:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa0377fe700 1 -- 172.21.15.45:0/1334847922 learned_addr learned my addr 172.21.15.45:0/1334847922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:03.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa044c38700 1 --2- 172.21.15.45:0/1334847922 >> v2:172.21.15.45:3300/0 conn(0x7fa0400713d0 0x7fa0400717f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2502279323 0 0) 0x7fa0400b1f20 con 0x7fa0400b3a30 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa02c0035d0 con 0x7fa0400b3a30 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2424501453 0 0) 0x7fa040071d30 con 0x7fa04015cf00 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa0400b1f20 con 0x7fa04015cf00 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa044c38700 1 -- 172.21.15.45:0/1334847922 >> v1:172.21.15.73:6789/0 conn(0x7fa04015cf00 legacy=0x7fa0400b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa044c38700 1 -- 172.21.15.45:0/1334847922 >> v1:172.21.15.45:6789/0 conn(0x7fa0400b3a30 legacy=0x7fa0400acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa044c38700 1 -- 172.21.15.45:0/1334847922 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0400adb90 con 0x7fa0400713d0 2023-12-19T18:03:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa044c38700 1 --2- 172.21.15.45:0/1334847922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0400713d0 0x7fa0400717f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa038009840 tx=0x7fa038009b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ed86eaf0b49a8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa038005ea0 con 0x7fa0400713d0 2023-12-19T18:03:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa038006030 con 0x7fa0400713d0 2023-12-19T18:03:03.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa03f7fe700 1 -- 172.21.15.45:0/1334847922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0380063a0 con 0x7fa0400713d0 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa045439700 1 -- 172.21.15.45:0/1334847922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0400713d0 msgr2=0x7fa0400717f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa045439700 1 --2- 172.21.15.45:0/1334847922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0400713d0 0x7fa0400717f0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7fa038009840 tx=0x7fa038009b50 comp rx=0 tx=0).stop 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa045439700 1 -- 172.21.15.45:0/1334847922 shutdown_connections 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa045439700 1 --2- 172.21.15.45:0/1334847922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa0400713d0 0x7fa0400717f0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.733+0000 7fa045439700 1 -- 172.21.15.45:0/1334847922 >> 172.21.15.45:0/1334847922 conn(0x7fa0400cf5a0 msgr2=0x7fa040070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.737+0000 7fa045439700 1 -- 172.21.15.45:0/1334847922 shutdown_connections 2023-12-19T18:03:03.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.737+0000 7fa045439700 1 -- 172.21.15.45:0/1334847922 wait complete. 2023-12-19T18:03:03.742 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.737+0000 7fa045439700 1 Processor -- start 2023-12-19T18:03:03.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.737+0000 7fa045439700 1 -- start start 2023-12-19T18:03:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0400b3a30 0x7fa0400c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa04015cf00 0x7fa0400c4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 0x7fa04015e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401f3f70 con 0x7fa04006d6d0 2023-12-19T18:03:03.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa04006db50 con 0x7fa0400b3a30 2023-12-19T18:03:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0401f35f0 con 0x7fa04015cf00 2023-12-19T18:03:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa044c38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 0x7fa04015e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa044c38700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 0x7fa04015e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47148/0 (socket says 172.21.15.45:47148) 2023-12-19T18:03:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa044c38700 1 -- 172.21.15.45:0/1348893240 learned_addr learned my addr 172.21.15.45:0/1348893240 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0400b3a30 0x7fa0400c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:03.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa0377fe700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa04015cf00 0x7fa0400c4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 -- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa04015cf00 msgr2=0x7fa0400c4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa04015cf00 0x7fa0400c4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 -- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 msgr2=0x7fa04015e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 0x7fa04015e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 -- 172.21.15.45:0/1348893240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380094a0 con 0x7fa0400b3a30 2023-12-19T18:03:03.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa044c38700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 0x7fa04015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03ffff700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0400b3a30 0x7fa0400c37a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa03000cab0 tx=0x7fa03000cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa030003c70 con 0x7fa0400b3a30 2023-12-19T18:03:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa030003df0 con 0x7fa0400b3a30 2023-12-19T18:03:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0400c3e80 con 0x7fa0400b3a30 2023-12-19T18:03:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03000a9e0 con 0x7fa0400b3a30 2023-12-19T18:03:03.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.741+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0401f3b90 con 0x7fa0400b3a30 2023-12-19T18:03:03.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.745+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0401f3d20 con 0x7fa0400b3a30 2023-12-19T18:03:03.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.745+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa03000ab40 con 0x7fa0400b3a30 2023-12-19T18:03:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.745+0000 7fa03d7fa700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa020065b00 0x7fa020067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:03.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.745+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa030083250 con 0x7fa0400b3a30 2023-12-19T18:03:03.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.745+0000 7fa0377fe700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa020065b00 0x7fa020067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:03.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.749+0000 7fa0377fe700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa020065b00 0x7fa020067fc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa04015f0f0 tx=0x7fa028007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:03.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.753+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa030050a60 con 0x7fa0400b3a30 2023-12-19T18:03:03.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:03.977+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa04004ed30 con 0x7fa0400b3a30 2023-12-19T18:03:04.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.637+0000 7fa03d7fa700 1 -- 172.21.15.45:0/1348893240 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v99) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa030054080 con 0x7fa0400b3a30 2023-12-19T18:03:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa020065b00 msgr2=0x7fa020067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa020065b00 0x7fa020067fc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa04015f0f0 tx=0x7fa028007de0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0400b3a30 msgr2=0x7fa0400c37a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:04.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0400b3a30 0x7fa0400c37a0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fa03000cab0 tx=0x7fa03000cdc0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 shutdown_connections 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa020065b00 0x7fa020067fc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa04006d6d0 0x7fa04015e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa04015cf00 0x7fa0400c4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 --2- 172.21.15.45:0/1348893240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0400b3a30 0x7fa0400c37a0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 >> 172.21.15.45:0/1348893240 conn(0x7fa0400713d0 msgr2=0x7fa04006c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 shutdown_connections 2023-12-19T18:03:04.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.641+0000 7fa045439700 1 -- 172.21.15.45:0/1348893240 wait complete. 2023-12-19T18:03:04.672 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-19T18:03:04.672 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.857+0000 7f0042a98700 1 Processor -- start 2023-12-19T18:03:04.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.857+0000 7f0042a98700 1 -- start start 2023-12-19T18:03:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0042a98700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f003c1611c0 0x7f003c0c3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0042a98700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f003c0af720 0x7f003c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0042a98700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c0c3f90 con 0x7f003c1615a0 2023-12-19T18:03:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0042a98700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003c0b00f0 con 0x7f003c1611c0 2023-12-19T18:03:04.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0042a98700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003c070340 con 0x7f003c0af720 2023-12-19T18:03:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041a96700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f003c1611c0 0x7f003c0c3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041295700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f003c1615a0 0x7f003c06d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56370/0 (socket says 172.21.15.45:56370) 2023-12-19T18:03:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041295700 1 -- 172.21.15.45:0/1987155116 learned_addr learned my addr 172.21.15.45:0/1987155116 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:04.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0042297700 1 --2- 172.21.15.45:0/1987155116 >> v2:172.21.15.73:3300/0 conn(0x7f003c0af720 0x7f003c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041a96700 1 -- 172.21.15.45:0/1987155116 >> v2:172.21.15.73:3300/0 conn(0x7f003c0af720 msgr2=0x7f003c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041a96700 1 --2- 172.21.15.45:0/1987155116 >> v2:172.21.15.73:3300/0 conn(0x7f003c0af720 0x7f003c0afbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041a96700 1 -- 172.21.15.45:0/1987155116 >> v1:172.21.15.45:6789/0 conn(0x7f003c1615a0 legacy=0x7f003c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041a96700 1 -- 172.21.15.45:0/1987155116 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0c4270 con 0x7f003c1611c0 2023-12-19T18:03:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0041a96700 1 --2- 172.21.15.45:0/1987155116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c1611c0 0x7f003c0c3920 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f003c0c55f0 tx=0x7f0038009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d55af67b3880057 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:04.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0040a94700 1 -- 172.21.15.45:0/1987155116 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038011830 con 0x7f003c1611c0 2023-12-19T18:03:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0040a94700 1 -- 172.21.15.45:0/1987155116 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0038011990 con 0x7f003c1611c0 2023-12-19T18:03:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.861+0000 7f0040a94700 1 -- 172.21.15.45:0/1987155116 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038011d40 con 0x7f003c1611c0 2023-12-19T18:03:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 -- 172.21.15.45:0/1987155116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c1611c0 msgr2=0x7f003c0c3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:04.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 --2- 172.21.15.45:0/1987155116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c1611c0 0x7f003c0c3920 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f003c0c55f0 tx=0x7f0038009b30 comp rx=0 tx=0).stop 2023-12-19T18:03:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 -- 172.21.15.45:0/1987155116 shutdown_connections 2023-12-19T18:03:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 --2- 172.21.15.45:0/1987155116 >> v2:172.21.15.73:3300/0 conn(0x7f003c0af720 0x7f003c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 --2- 172.21.15.45:0/1987155116 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c1611c0 0x7f003c0c3920 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 -- 172.21.15.45:0/1987155116 >> 172.21.15.45:0/1987155116 conn(0x7f003c0cb900 msgr2=0x7f003c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 -- 172.21.15.45:0/1987155116 shutdown_connections 2023-12-19T18:03:04.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 -- 172.21.15.45:0/1987155116 wait complete. 2023-12-19T18:03:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 Processor -- start 2023-12-19T18:03:04.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.865+0000 7f0042a98700 1 -- start start 2023-12-19T18:03:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 0x7f003c153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f003c1611c0 0x7f003c0b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f003c1615a0 0x7f003c1f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c153640 con 0x7f003c0af720 2023-12-19T18:03:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0b2f00 con 0x7f003c1615a0 2023-12-19T18:03:04.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0b22e0 con 0x7f003c1611c0 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 0x7f003c153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 0x7f003c153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47168/0 (socket says 172.21.15.45:47168) 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 -- 172.21.15.45:0/2406546210 learned_addr learned my addr 172.21.15.45:0/2406546210 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042297700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f003c1615a0 0x7f003c1f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041295700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f003c1611c0 0x7f003c0b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 -- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f003c1611c0 msgr2=0x7f003c0b1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:04.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f003c1611c0 0x7f003c0b1da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 -- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f003c1615a0 msgr2=0x7f003c1f7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f003c1615a0 0x7f003c1f7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 -- 172.21.15.45:0/2406546210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380094b0 con 0x7f003c0af720 2023-12-19T18:03:04.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0041a96700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 0x7f003c153100 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f00380090b0 tx=0x7f0038004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038004480 con 0x7f003c0af720 2023-12-19T18:03:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003801f070 con 0x7f003c0af720 2023-12-19T18:03:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0038003900 con 0x7f003c0af720 2023-12-19T18:03:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c15d3f0 con 0x7f003c0af720 2023-12-19T18:03:04.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.869+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c15d9b0 con 0x7f003c0af720 2023-12-19T18:03:04.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.873+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c06e760 con 0x7f003c0af720 2023-12-19T18:03:04.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.873+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0038021030 con 0x7f003c0af720 2023-12-19T18:03:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.873+0000 7f00327fc700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0020065ad0 0x7f0020067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:04.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.877+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f00380845a0 con 0x7f003c0af720 2023-12-19T18:03:04.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.877+0000 7f0041295700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0020065ad0 0x7f0020067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:04.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.877+0000 7f0041295700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0020065ad0 0x7f0020067f90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b2b90 tx=0x7f002c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:04.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:04.881+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0038051eb0 con 0x7f003c0af720 2023-12-19T18:03:05.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.097+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f003c067760 con 0x7f003c0af720 2023-12-19T18:03:05.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.097+0000 7f00327fc700 1 -- 172.21.15.45:0/2406546210 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f00380554d0 con 0x7f003c0af720 2023-12-19T18:03:05.103 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:05.103 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":57464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:04.628359+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57470":{"gid":57470,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/3417552399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3417552399},{"type":"v1","addr":"172.21.15.45:6837","nonce":3417552399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0020065ad0 msgr2=0x7f0020067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0020065ad0 0x7f0020067f90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f003c0b2b90 tx=0x7f002c009040 comp rx=0 tx=0).stop 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 msgr2=0x7f003c153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 0x7f003c153100 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f00380090b0 tx=0x7f0038004770 comp rx=0 tx=0).stop 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 shutdown_connections 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0020065ad0 0x7f0020067f90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f003c1615a0 0x7f003c1f7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f003c1611c0 0x7f003c0b1da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 --2- 172.21.15.45:0/2406546210 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f003c0af720 0x7f003c153100 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 >> 172.21.15.45:0/2406546210 conn(0x7f003c0cb900 msgr2=0x7f003c160420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:05.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 shutdown_connections 2023-12-19T18:03:05.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.101+0000 7f0042a98700 1 -- 172.21.15.45:0/2406546210 wait complete. 2023-12-19T18:03:05.110 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 99 2023-12-19T18:03:05.133 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:05.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.313+0000 7f71fd3d5700 1 Processor -- start 2023-12-19T18:03:05.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.313+0000 7f71fd3d5700 1 -- start start 2023-12-19T18:03:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71fd3d5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f71f806cad0 0x7f71f815be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71fd3d5700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f806f0a0 con 0x7f71f815ae20 2023-12-19T18:03:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71fd3d5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f806ea90 con 0x7f71f80af720 2023-12-19T18:03:05.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71fd3d5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71f80c3f60 con 0x7f71f806cad0 2023-12-19T18:03:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f7fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f71f815ae20 0x7f71f80c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56382/0 (socket says 172.21.15.45:56382) 2023-12-19T18:03:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f7fff700 1 -- 172.21.15.45:0/3315044045 learned_addr learned my addr 172.21.15.45:0/3315044045 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:05.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71ef7fe700 1 --2- 172.21.15.45:0/3315044045 >> v2:172.21.15.73:3300/0 conn(0x7f71f806cad0 0x7f71f815be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f77fe700 1 -- 172.21.15.45:0/3315044045 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 436004849 0 0) 0x7f71f806f0a0 con 0x7f71f815ae20 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f77fe700 1 -- 172.21.15.45:0/3315044045 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d80035d0 con 0x7f71f815ae20 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f77fe700 1 -- 172.21.15.45:0/3315044045 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1802247574 0 0) 0x7f71d80035d0 con 0x7f71f815ae20 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71ef7fe700 1 -- 172.21.15.45:0/3315044045 >> v1:172.21.15.73:6789/0 conn(0x7f71f80af720 legacy=0x7f71f806f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71ef7fe700 1 -- 172.21.15.45:0/3315044045 >> v1:172.21.15.45:6789/0 conn(0x7f71f815ae20 legacy=0x7f71f80c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71ef7fe700 1 -- 172.21.15.45:0/3315044045 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f80c4240 con 0x7f71f806cad0 2023-12-19T18:03:05.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71ef7fe700 1 --2- 172.21.15.45:0/3315044045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806cad0 0x7f71f815be40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009850 tx=0x7f71e0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7b2dc282061341 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f77fe700 1 -- 172.21.15.45:0/3315044045 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8001670 con 0x7f71f806cad0 2023-12-19T18:03:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f77fe700 1 -- 172.21.15.45:0/3315044045 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e0004030 con 0x7f71f806cad0 2023-12-19T18:03:05.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.317+0000 7f71f77fe700 1 -- 172.21.15.45:0/3315044045 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e00043c0 con 0x7f71f806cad0 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 -- 172.21.15.45:0/3315044045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806cad0 msgr2=0x7f71f815be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/3315044045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806cad0 0x7f71f815be40 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f71e0009850 tx=0x7f71e0009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 -- 172.21.15.45:0/3315044045 shutdown_connections 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/3315044045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f806cad0 0x7f71f815be40 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 -- 172.21.15.45:0/3315044045 >> 172.21.15.45:0/3315044045 conn(0x7f71f80cb900 msgr2=0x7f71f80b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 -- 172.21.15.45:0/3315044045 shutdown_connections 2023-12-19T18:03:05.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 -- 172.21.15.45:0/3315044045 wait complete. 2023-12-19T18:03:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.321+0000 7f71fd3d5700 1 Processor -- start 2023-12-19T18:03:05.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 -- start start 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 0x7f71f80af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80af720 0x7f71f80c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f815ae20 0x7f71f815b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80aeeb0 con 0x7f71f806cad0 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c5930 con 0x7f71f815ae20 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fd3d5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f80c5c10 con 0x7f71f80af720 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 0x7f71f80af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 0x7f71f80af0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47184/0 (socket says 172.21.15.45:47184) 2023-12-19T18:03:05.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 -- 172.21.15.45:0/1386603065 learned_addr learned my addr 172.21.15.45:0/1386603065 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71ef7fe700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80af720 0x7f71f80c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fcbd4700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f815ae20 0x7f71f815b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 -- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80af720 msgr2=0x7f71f80c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80af720 0x7f71f80c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 -- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f815ae20 msgr2=0x7f71f815b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f815ae20 0x7f71f815b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71f7fff700 1 -- 172.21.15.45:0/1386603065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71e00094b0 con 0x7f71f806cad0 2023-12-19T18:03:05.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.325+0000 7f71fcbd4700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f815ae20 0x7f71f815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71f7fff700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 0x7f71f80af0d0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c520 tx=0x7f71e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8004ca0 con 0x7f71f806cad0 2023-12-19T18:03:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8004e20 con 0x7f71f806cad0 2023-12-19T18:03:05.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8007310 con 0x7f71f806cad0 2023-12-19T18:03:05.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f80c5ef0 con 0x7f71f806cad0 2023-12-19T18:03:05.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f80ca410 con 0x7f71f806cad0 2023-12-19T18:03:05.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.329+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f80c6410 con 0x7f71f806cad0 2023-12-19T18:03:05.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.333+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f71e8007470 con 0x7f71f806cad0 2023-12-19T18:03:05.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.333+0000 7f71f57fa700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f71dc065ad0 0x7f71dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.333+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f71e8083070 con 0x7f71f806cad0 2023-12-19T18:03:05.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.333+0000 7f71ef7fe700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f71dc065ad0 0x7f71dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.333+0000 7f71ef7fe700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f71dc065ad0 0x7f71dc067f90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f71f806cf10 tx=0x7f71e0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:05.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.341+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f71e80b40a0 con 0x7f71f806cad0 2023-12-19T18:03:05.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.517+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71f8067760 con 0x7f71f806cad0 2023-12-19T18:03:05.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.517+0000 7f71f57fa700 1 -- 172.21.15.45:0/1386603065 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16268 (secure 0 0 0) 0x7f71f80c6410 con 0x7f71f806cad0 2023-12-19T18:03:05.522 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:05.522 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":129,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:02.485924+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f71dc065ad0 msgr2=0x7f71dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f71dc065ad0 0x7f71dc067f90 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f71f806cf10 tx=0x7f71e0008030 comp rx=0 tx=0).stop 2023-12-19T18:03:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 msgr2=0x7f71f80af0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 0x7f71f80af0d0 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f71e800c520 tx=0x7f71e800c830 comp rx=0 tx=0).stop 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 shutdown_connections 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f71dc065ad0 0x7f71dc067f90 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71f815ae20 0x7f71f815b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f71f80af720 0x7f71f80c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 --2- 172.21.15.45:0/1386603065 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f71f806cad0 0x7f71f80af0d0 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 >> 172.21.15.45:0/1386603065 conn(0x7f71f80cb900 msgr2=0x7f71f8065cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 shutdown_connections 2023-12-19T18:03:05.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.521+0000 7f71fd3d5700 1 -- 172.21.15.45:0/1386603065 wait complete. 2023-12-19T18:03:05.550 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-19T18:03:05.550 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:03:05.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.725+0000 7fd68bfbd700 1 Processor -- start 2023-12-19T18:03:05.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.725+0000 7fd68bfbd700 1 -- start start 2023-12-19T18:03:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68bfbd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd68415d040 0x7fd6840cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68bfbd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd68406f4a0 0x7fd6840d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68bfbd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd68415d420 0x7fd6840d26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68bfbd700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6840b6060 con 0x7fd68415d420 2023-12-19T18:03:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68bfbd700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406f930 con 0x7fd68415d040 2023-12-19T18:03:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68bfbd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd68406fc10 con 0x7fd68406f4a0 2023-12-19T18:03:05.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd68415d420 0x7fd6840d26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd689d59700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd68415d040 0x7fd6840cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd68415d420 0x7fd6840d26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47190/0 (socket says 172.21.15.45:47190) 2023-12-19T18:03:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd689558700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd68406f4a0 0x7fd6840d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 -- 172.21.15.45:0/804603288 learned_addr learned my addr 172.21.15.45:0/804603288 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 -- 172.21.15.45:0/804603288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd68406f4a0 msgr2=0x7fd6840d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd68406f4a0 0x7fd6840d21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 -- 172.21.15.45:0/804603288 >> v2:172.21.15.73:3300/0 conn(0x7fd68415d040 msgr2=0x7fd6840cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.729+0000 7fd68a55a700 1 --2- 172.21.15.45:0/804603288 >> v2:172.21.15.73:3300/0 conn(0x7fd68415d040 0x7fd6840cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68a55a700 1 -- 172.21.15.45:0/804603288 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68406fef0 con 0x7fd68415d420 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd689558700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd68406f4a0 0x7fd6840d21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd689d59700 1 --2- 172.21.15.45:0/804603288 >> v2:172.21.15.73:3300/0 conn(0x7fd68415d040 0x7fd6840cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:05.737 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68a55a700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d420 0x7fd6840d26e0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fd6840679f0 tx=0x7fd67c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932e8aa85c6ab0b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:05.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd688d57700 1 -- 172.21.15.45:0/804603288 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00e070 con 0x7fd68415d420 2023-12-19T18:03:05.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd688d57700 1 -- 172.21.15.45:0/804603288 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67c00b910 con 0x7fd68415d420 2023-12-19T18:03:05.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd688d57700 1 -- 172.21.15.45:0/804603288 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67c00bcc0 con 0x7fd68415d420 2023-12-19T18:03:05.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 -- 172.21.15.45:0/804603288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d420 msgr2=0x7fd6840d26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d420 0x7fd6840d26e0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7fd6840679f0 tx=0x7fd67c00b330 comp rx=0 tx=0).stop 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 -- 172.21.15.45:0/804603288 shutdown_connections 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d420 0x7fd6840d26e0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/804603288 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd68406f4a0 0x7fd6840d21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/804603288 >> v2:172.21.15.73:3300/0 conn(0x7fd68415d040 0x7fd6840cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 -- 172.21.15.45:0/804603288 >> 172.21.15.45:0/804603288 conn(0x7fd6840d2e50 msgr2=0x7fd6840d3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 -- 172.21.15.45:0/804603288 shutdown_connections 2023-12-19T18:03:05.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.733+0000 7fd68bfbd700 1 -- 172.21.15.45:0/804603288 wait complete. 2023-12-19T18:03:05.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 Processor -- start 2023-12-19T18:03:05.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 -- start start 2023-12-19T18:03:05.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 0x7fd6840ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd68415d420 0x7fd684158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6840c54c0 0x7fd6840b3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd684155670 con 0x7fd68415d040 2023-12-19T18:03:05.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840cb670 con 0x7fd68415d420 2023-12-19T18:03:05.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.737+0000 7fd68bfbd700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840caa60 con 0x7fd6840c54c0 2023-12-19T18:03:05.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 0x7fd6840ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 0x7fd6840ca480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47198/0 (socket says 172.21.15.45:47198) 2023-12-19T18:03:05.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 -- 172.21.15.45:0/1640472514 learned_addr learned my addr 172.21.15.45:0/1640472514 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689558700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd68415d420 0x7fd684158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd68a55a700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6840c54c0 0x7fd6840b3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 -- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6840c54c0 msgr2=0x7fd6840b3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6840c54c0 0x7fd6840b3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 -- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd68415d420 msgr2=0x7fd684158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd68415d420 0x7fd684158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 -- 172.21.15.45:0/1640472514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6740094b0 con 0x7fd68415d040 2023-12-19T18:03:05.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd689d59700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 0x7fd6840ca480 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fd68000ec10 tx=0x7fd68000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:05.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000c850 con 0x7fd68415d040 2023-12-19T18:03:05.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd68000c9b0 con 0x7fd68415d040 2023-12-19T18:03:05.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6800094b0 con 0x7fd68415d040 2023-12-19T18:03:05.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68000cd40 con 0x7fd68415d040 2023-12-19T18:03:05.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67c009b30 con 0x7fd68415d040 2023-12-19T18:03:05.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.741+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68404ed30 con 0x7fd68415d040 2023-12-19T18:03:05.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.745+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd680013470 con 0x7fd68415d040 2023-12-19T18:03:05.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.745+0000 7fd67a7fc700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd668065b00 0x7fd668067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:05.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.745+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd680083390 con 0x7fd68415d040 2023-12-19T18:03:05.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.745+0000 7fd689558700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd668065b00 0x7fd668067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:05.753 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.749+0000 7fd689558700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd668065b00 0x7fd668067fc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd684152a90 tx=0x7fd674009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:05.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.753+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd680050af0 con 0x7fd68415d040 2023-12-19T18:03:05.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.925+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6840701d0 con 0x7fd668065b00 2023-12-19T18:03:05.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.945+0000 7fd67a7fc700 1 -- 172.21.15.45:0/1640472514 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284187 (secure 0 0 0) 0x7fd6740099d0 con 0x7fd668065b00 2023-12-19T18:03:05.954 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd668065b00 msgr2=0x7fd668067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd668065b00 0x7fd668067fc0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fd684152a90 tx=0x7fd674009240 comp rx=0 tx=0).stop 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 msgr2=0x7fd6840ca480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 0x7fd6840ca480 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fd68000ec10 tx=0x7fd68000ef20 comp rx=0 tx=0).stop 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 shutdown_connections 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd668065b00 0x7fd668067fc0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6840c54c0 0x7fd6840b3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd68415d420 0x7fd684158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 --2- 172.21.15.45:0/1640472514 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd68415d040 0x7fd6840ca480 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 >> 172.21.15.45:0/1640472514 conn(0x7fd6840d2e50 msgr2=0x7fd6840b83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 shutdown_connections 2023-12-19T18:03:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:05.949+0000 7fd68bfbd700 1 -- 172.21.15.45:0/1640472514 wait complete. 2023-12-19T18:03:05.960 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:03:05.978 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":471,"stamp":"2023-12-19T18:03:04.451452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261832,"kb_used_data":13448,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754712888,"statfs":{"total":773094113280,"available":772825997312,"internally_reserved":0,"allocated":13770752,"data_stored":7301790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.446114"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.030400+0000","last_change":"2023-12-19T18:03:01.030400+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.030400+0000","last_undegraded":"2023-12-19T18:03:01.030400+0000","last_fullsized":"2023-12-19T18:03:01.030400+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.032900+0000","last_change":"2023-12-19T18:03:01.032900+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.032900+0000","last_undegraded":"2023-12-19T18:03:01.032900+0000","last_fullsized":"2023-12-19T18:03:01.032900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:53.820748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023894+0000","last_change":"2023-12-19T18:03:01.023894+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023894+0000","last_undegraded":"2023-12-19T18:03:01.023894+0000","last_fullsized":"2023-12-19T18:03:01.023894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:49.326082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022521+0000","last_change":"2023-12-19T18:03:01.022521+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022521+0000","last_undegraded":"2023-12-19T18:03:01.022521+0000","last_fullsized":"2023-12-19T18:03:01.022521+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:09:24.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031016+0000","last_change":"2023-12-19T18:03:01.031016+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031016+0000","last_undegraded":"2023-12-19T18:03:01.031016+0000","last_fullsized":"2023-12-19T18:03:01.031016+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022413+0000","last_change":"2023-12-19T18:03:01.022413+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022413+0000","last_undegraded":"2023-12-19T18:03:01.022413+0000","last_fullsized":"2023-12-19T18:03:01.022413+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:26:31.507606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023630+0000","last_change":"2023-12-19T18:03:01.023630+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023630+0000","last_undegraded":"2023-12-19T18:03:01.023630+0000","last_fullsized":"2023-12-19T18:03:01.023630+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.842744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025371+0000","last_change":"2023-12-19T18:03:01.025371+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025371+0000","last_undegraded":"2023-12-19T18:03:01.025371+0000","last_fullsized":"2023-12-19T18:03:01.025371+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:47.570305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023780+0000","last_change":"2023-12-19T18:03:01.023780+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023780+0000","last_undegraded":"2023-12-19T18:03:01.023780+0000","last_fullsized":"2023-12-19T18:03:01.023780+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:05.296698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026754+0000","last_change":"2023-12-19T18:03:01.026754+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026754+0000","last_undegraded":"2023-12-19T18:03:01.026754+0000","last_fullsized":"2023-12-19T18:03:01.026754+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.033514+0000","last_change":"2023-12-19T18:03:01.033514+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.033514+0000","last_undegraded":"2023-12-19T18:03:01.033514+0000","last_fullsized":"2023-12-19T18:03:01.033514+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025174+0000","last_change":"2023-12-19T18:03:01.025174+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025174+0000","last_undegraded":"2023-12-19T18:03:01.025174+0000","last_fullsized":"2023-12-19T18:03:01.025174+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:36.056772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026405+0000","last_change":"2023-12-19T18:03:01.026405+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026405+0000","last_undegraded":"2023-12-19T18:03:01.026405+0000","last_fullsized":"2023-12-19T18:03:01.026405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029253+0000","last_change":"2023-12-19T18:03:01.029253+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029253+0000","last_undegraded":"2023-12-19T18:03:01.029253+0000","last_fullsized":"2023-12-19T18:03:01.029253+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:24.463386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031555+0000","last_change":"2023-12-19T18:03:01.031555+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031555+0000","last_undegraded":"2023-12-19T18:03:01.031555+0000","last_fullsized":"2023-12-19T18:03:01.031555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.024560+0000","last_change":"2023-12-19T18:03:01.024560+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.024560+0000","last_undegraded":"2023-12-19T18:03:01.024560+0000","last_fullsized":"2023-12-19T18:03:01.024560+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:12.676472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025837+0000","last_change":"2023-12-19T18:03:01.025837+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025837+0000","last_undegraded":"2023-12-19T18:03:01.025837+0000","last_fullsized":"2023-12-19T18:03:01.025837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029034+0000","last_change":"2023-12-19T18:03:01.029034+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029034+0000","last_undegraded":"2023-12-19T18:03:01.029034+0000","last_fullsized":"2023-12-19T18:03:01.029034+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:10.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.021715+0000","last_change":"2023-12-19T18:03:01.021715+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.021715+0000","last_undegraded":"2023-12-19T18:03:01.021715+0000","last_fullsized":"2023-12-19T18:03:01.021715+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026604+0000","last_change":"2023-12-19T18:03:01.026604+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026604+0000","last_undegraded":"2023-12-19T18:03:01.026604+0000","last_fullsized":"2023-12-19T18:03:01.026604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022278+0000","last_change":"2023-12-19T18:03:01.022278+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022278+0000","last_undegraded":"2023-12-19T18:03:01.022278+0000","last_fullsized":"2023-12-19T18:03:01.022278+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:25.460640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031097+0000","last_change":"2023-12-19T18:03:01.031097+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031097+0000","last_undegraded":"2023-12-19T18:03:01.031097+0000","last_fullsized":"2023-12-19T18:03:01.031097+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022320+0000","last_change":"2023-12-19T18:03:01.022320+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022320+0000","last_undegraded":"2023-12-19T18:03:01.022320+0000","last_fullsized":"2023-12-19T18:03:01.022320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:09:23.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029538+0000","last_change":"2023-12-19T18:03:01.029538+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029538+0000","last_undegraded":"2023-12-19T18:03:01.029538+0000","last_fullsized":"2023-12-19T18:03:01.029538+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028864+0000","last_change":"2023-12-19T18:03:01.028864+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028864+0000","last_undegraded":"2023-12-19T18:03:01.028864+0000","last_fullsized":"2023-12-19T18:03:01.028864+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027878+0000","last_change":"2023-12-19T18:03:01.027878+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027878+0000","last_undegraded":"2023-12-19T18:03:01.027878+0000","last_fullsized":"2023-12-19T18:03:01.027878+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.020070+0000","last_change":"2023-12-19T18:03:01.020070+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.020070+0000","last_undegraded":"2023-12-19T18:03:01.020070+0000","last_fullsized":"2023-12-19T18:03:01.020070+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.024508+0000","last_change":"2023-12-19T18:03:01.024508+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.024508+0000","last_undegraded":"2023-12-19T18:03:01.024508+0000","last_fullsized":"2023-12-19T18:03:01.024508+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:50.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029552+0000","last_change":"2023-12-19T18:03:01.029552+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029552+0000","last_undegraded":"2023-12-19T18:03:01.029552+0000","last_fullsized":"2023-12-19T18:03:01.029552+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:43.950078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027908+0000","last_change":"2023-12-19T18:03:01.027908+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027908+0000","last_undegraded":"2023-12-19T18:03:01.027908+0000","last_fullsized":"2023-12-19T18:03:01.027908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:27.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028880+0000","last_change":"2023-12-19T18:03:01.028880+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028880+0000","last_undegraded":"2023-12-19T18:03:01.028880+0000","last_fullsized":"2023-12-19T18:03:01.028880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027269+0000","last_change":"2023-12-19T18:03:01.027269+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027269+0000","last_undegraded":"2023-12-19T18:03:01.027269+0000","last_fullsized":"2023-12-19T18:03:01.027269+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.034522+0000","last_change":"2023-12-19T18:03:01.034522+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.034522+0000","last_undegraded":"2023-12-19T18:03:01.034522+0000","last_fullsized":"2023-12-19T18:03:01.034522+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:36.817532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.037678+0000","last_change":"2023-12-19T18:03:01.031247+0000","last_active":"2023-12-19T18:03:01.037678+0000","last_peered":"2023-12-19T18:03:01.037678+0000","last_clean":"2023-12-19T18:03:01.037678+0000","last_became_active":"2023-12-19T18:03:01.029901+0000","last_became_peered":"2023-12-19T18:03:01.029901+0000","last_unstale":"2023-12-19T18:03:01.037678+0000","last_undegraded":"2023-12-19T18:03:01.037678+0000","last_fullsized":"2023-12-19T18:03:01.037678+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:39.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026352+0000","last_change":"2023-12-19T18:03:01.026352+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026352+0000","last_undegraded":"2023-12-19T18:03:01.026352+0000","last_fullsized":"2023-12-19T18:03:01.026352+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:10.478715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046661+0000","last_change":"2023-12-19T18:03:01.043692+0000","last_active":"2023-12-19T18:03:01.046661+0000","last_peered":"2023-12-19T18:03:01.046661+0000","last_clean":"2023-12-19T18:03:01.046661+0000","last_became_active":"2023-12-19T18:03:01.043406+0000","last_became_peered":"2023-12-19T18:03:01.043406+0000","last_unstale":"2023-12-19T18:03:01.046661+0000","last_undegraded":"2023-12-19T18:03:01.046661+0000","last_fullsized":"2023-12-19T18:03:01.046661+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027273+0000","last_change":"2023-12-19T18:03:01.027273+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027273+0000","last_undegraded":"2023-12-19T18:03:01.027273+0000","last_fullsized":"2023-12-19T18:03:01.027273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047337+0000","last_change":"2023-12-19T18:03:01.044240+0000","last_active":"2023-12-19T18:03:01.047337+0000","last_peered":"2023-12-19T18:03:01.047337+0000","last_clean":"2023-12-19T18:03:01.047337+0000","last_became_active":"2023-12-19T18:03:01.043989+0000","last_became_peered":"2023-12-19T18:03:01.043989+0000","last_unstale":"2023-12-19T18:03:01.047337+0000","last_undegraded":"2023-12-19T18:03:01.047337+0000","last_fullsized":"2023-12-19T18:03:01.047337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.479629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022708+0000","last_change":"2023-12-19T18:03:01.022708+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022708+0000","last_undegraded":"2023-12-19T18:03:01.022708+0000","last_fullsized":"2023-12-19T18:03:01.022708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:52.886192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046598+0000","last_change":"2023-12-19T18:03:01.043134+0000","last_active":"2023-12-19T18:03:01.046598+0000","last_peered":"2023-12-19T18:03:01.046598+0000","last_clean":"2023-12-19T18:03:01.046598+0000","last_became_active":"2023-12-19T18:03:01.042431+0000","last_became_peered":"2023-12-19T18:03:01.042431+0000","last_unstale":"2023-12-19T18:03:01.046598+0000","last_undegraded":"2023-12-19T18:03:01.046598+0000","last_fullsized":"2023-12-19T18:03:01.046598+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:32.570496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022840+0000","last_change":"2023-12-19T18:03:01.022840+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022840+0000","last_undegraded":"2023-12-19T18:03:01.022840+0000","last_fullsized":"2023-12-19T18:03:01.022840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046824+0000","last_change":"2023-12-19T18:03:01.045236+0000","last_active":"2023-12-19T18:03:01.046824+0000","last_peered":"2023-12-19T18:03:01.046824+0000","last_clean":"2023-12-19T18:03:01.046824+0000","last_became_active":"2023-12-19T18:03:01.044907+0000","last_became_peered":"2023-12-19T18:03:01.044907+0000","last_unstale":"2023-12-19T18:03:01.046824+0000","last_undegraded":"2023-12-19T18:03:01.046824+0000","last_fullsized":"2023-12-19T18:03:01.046824+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031039+0000","last_change":"2023-12-19T18:03:01.031039+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031039+0000","last_undegraded":"2023-12-19T18:03:01.031039+0000","last_fullsized":"2023-12-19T18:03:01.031039+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044871+0000","last_change":"2023-12-19T18:03:01.041854+0000","last_active":"2023-12-19T18:03:01.044871+0000","last_peered":"2023-12-19T18:03:01.044871+0000","last_clean":"2023-12-19T18:03:01.044871+0000","last_became_active":"2023-12-19T18:03:01.040426+0000","last_became_peered":"2023-12-19T18:03:01.040426+0000","last_unstale":"2023-12-19T18:03:01.044871+0000","last_undegraded":"2023-12-19T18:03:01.044871+0000","last_fullsized":"2023-12-19T18:03:01.044871+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:25.067419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027386+0000","last_change":"2023-12-19T18:03:01.027386+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027386+0000","last_undegraded":"2023-12-19T18:03:01.027386+0000","last_fullsized":"2023-12-19T18:03:01.027386+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:17.957563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.040874+0000","last_change":"2023-12-19T18:03:01.037069+0000","last_active":"2023-12-19T18:03:01.040874+0000","last_peered":"2023-12-19T18:03:01.040874+0000","last_clean":"2023-12-19T18:03:01.040874+0000","last_became_active":"2023-12-19T18:03:01.036794+0000","last_became_peered":"2023-12-19T18:03:01.036794+0000","last_unstale":"2023-12-19T18:03:01.040874+0000","last_undegraded":"2023-12-19T18:03:01.040874+0000","last_fullsized":"2023-12-19T18:03:01.040874+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:42.153731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025754+0000","last_change":"2023-12-19T18:03:01.025754+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025754+0000","last_undegraded":"2023-12-19T18:03:01.025754+0000","last_fullsized":"2023-12-19T18:03:01.025754+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:48.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044383+0000","last_change":"2023-12-19T18:03:01.041603+0000","last_active":"2023-12-19T18:03:01.044383+0000","last_peered":"2023-12-19T18:03:01.044383+0000","last_clean":"2023-12-19T18:03:01.044383+0000","last_became_active":"2023-12-19T18:03:01.040273+0000","last_became_peered":"2023-12-19T18:03:01.040273+0000","last_unstale":"2023-12-19T18:03:01.044383+0000","last_undegraded":"2023-12-19T18:03:01.044383+0000","last_fullsized":"2023-12-19T18:03:01.044383+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:23.457722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.020022+0000","last_change":"2023-12-19T18:03:01.020022+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.020022+0000","last_undegraded":"2023-12-19T18:03:01.020022+0000","last_fullsized":"2023-12-19T18:03:01.020022+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047320+0000","last_change":"2023-12-19T18:03:01.046117+0000","last_active":"2023-12-19T18:03:01.047320+0000","last_peered":"2023-12-19T18:03:01.047320+0000","last_clean":"2023-12-19T18:03:01.047320+0000","last_became_active":"2023-12-19T18:03:01.045799+0000","last_became_peered":"2023-12-19T18:03:01.045799+0000","last_unstale":"2023-12-19T18:03:01.047320+0000","last_undegraded":"2023-12-19T18:03:01.047320+0000","last_fullsized":"2023-12-19T18:03:01.047320+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027493+0000","last_change":"2023-12-19T18:03:01.027493+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027493+0000","last_undegraded":"2023-12-19T18:03:01.027493+0000","last_fullsized":"2023-12-19T18:03:01.027493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.050093+0000","last_change":"2023-12-19T18:03:01.049167+0000","last_active":"2023-12-19T18:03:01.050093+0000","last_peered":"2023-12-19T18:03:01.050093+0000","last_clean":"2023-12-19T18:03:01.050093+0000","last_became_active":"2023-12-19T18:03:01.048925+0000","last_became_peered":"2023-12-19T18:03:01.048925+0000","last_unstale":"2023-12-19T18:03:01.050093+0000","last_undegraded":"2023-12-19T18:03:01.050093+0000","last_fullsized":"2023-12-19T18:03:01.050093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028503+0000","last_change":"2023-12-19T18:03:01.028503+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028503+0000","last_undegraded":"2023-12-19T18:03:01.028503+0000","last_fullsized":"2023-12-19T18:03:01.028503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:02.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.040881+0000","last_change":"2023-12-19T18:03:01.035484+0000","last_active":"2023-12-19T18:03:01.040881+0000","last_peered":"2023-12-19T18:03:01.040881+0000","last_clean":"2023-12-19T18:03:01.040881+0000","last_became_active":"2023-12-19T18:03:01.035096+0000","last_became_peered":"2023-12-19T18:03:01.035096+0000","last_unstale":"2023-12-19T18:03:01.040881+0000","last_undegraded":"2023-12-19T18:03:01.040881+0000","last_fullsized":"2023-12-19T18:03:01.040881+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:31:55.570736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028268+0000","last_change":"2023-12-19T18:03:01.028268+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028268+0000","last_undegraded":"2023-12-19T18:03:01.028268+0000","last_fullsized":"2023-12-19T18:03:01.028268+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046567+0000","last_change":"2023-12-19T18:03:01.043052+0000","last_active":"2023-12-19T18:03:01.046567+0000","last_peered":"2023-12-19T18:03:01.046567+0000","last_clean":"2023-12-19T18:03:01.046567+0000","last_became_active":"2023-12-19T18:03:01.042700+0000","last_became_peered":"2023-12-19T18:03:01.042700+0000","last_unstale":"2023-12-19T18:03:01.046567+0000","last_undegraded":"2023-12-19T18:03:01.046567+0000","last_fullsized":"2023-12-19T18:03:01.046567+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:07.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.020027+0000","last_change":"2023-12-19T18:03:01.020027+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.020027+0000","last_undegraded":"2023-12-19T18:03:01.020027+0000","last_fullsized":"2023-12-19T18:03:01.020027+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.040841+0000","last_change":"2023-12-19T18:03:01.037229+0000","last_active":"2023-12-19T18:03:01.040841+0000","last_peered":"2023-12-19T18:03:01.040841+0000","last_clean":"2023-12-19T18:03:01.040841+0000","last_became_active":"2023-12-19T18:03:01.036922+0000","last_became_peered":"2023-12-19T18:03:01.036922+0000","last_unstale":"2023-12-19T18:03:01.040841+0000","last_undegraded":"2023-12-19T18:03:01.040841+0000","last_fullsized":"2023-12-19T18:03:01.040841+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:16.787802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023567+0000","last_change":"2023-12-19T18:03:01.023567+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023567+0000","last_undegraded":"2023-12-19T18:03:01.023567+0000","last_fullsized":"2023-12-19T18:03:01.023567+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045979+0000","last_change":"2023-12-19T18:03:01.041706+0000","last_active":"2023-12-19T18:03:01.045979+0000","last_peered":"2023-12-19T18:03:01.045979+0000","last_clean":"2023-12-19T18:03:01.045979+0000","last_became_active":"2023-12-19T18:03:01.040042+0000","last_became_peered":"2023-12-19T18:03:01.040042+0000","last_unstale":"2023-12-19T18:03:01.045979+0000","last_undegraded":"2023-12-19T18:03:01.045979+0000","last_fullsized":"2023-12-19T18:03:01.045979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:53.747846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.030320+0000","last_change":"2023-12-19T18:03:01.030320+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.030320+0000","last_undegraded":"2023-12-19T18:03:01.030320+0000","last_fullsized":"2023-12-19T18:03:01.030320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046041+0000","last_change":"2023-12-19T18:03:01.041523+0000","last_active":"2023-12-19T18:03:01.046041+0000","last_peered":"2023-12-19T18:03:01.046041+0000","last_clean":"2023-12-19T18:03:01.046041+0000","last_became_active":"2023-12-19T18:03:01.041293+0000","last_became_peered":"2023-12-19T18:03:01.041293+0000","last_unstale":"2023-12-19T18:03:01.046041+0000","last_undegraded":"2023-12-19T18:03:01.046041+0000","last_fullsized":"2023-12-19T18:03:01.046041+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:54.430060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027170+0000","last_change":"2023-12-19T18:03:01.027170+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027170+0000","last_undegraded":"2023-12-19T18:03:01.027170+0000","last_fullsized":"2023-12-19T18:03:01.027170+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046614+0000","last_change":"2023-12-19T18:03:01.043501+0000","last_active":"2023-12-19T18:03:01.046614+0000","last_peered":"2023-12-19T18:03:01.046614+0000","last_clean":"2023-12-19T18:03:01.046614+0000","last_became_active":"2023-12-19T18:03:01.042962+0000","last_became_peered":"2023-12-19T18:03:01.042962+0000","last_unstale":"2023-12-19T18:03:01.046614+0000","last_undegraded":"2023-12-19T18:03:01.046614+0000","last_fullsized":"2023-12-19T18:03:01.046614+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.030725+0000","last_change":"2023-12-19T18:03:01.030725+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.030725+0000","last_undegraded":"2023-12-19T18:03:01.030725+0000","last_fullsized":"2023-12-19T18:03:01.030725+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047422+0000","last_change":"2023-12-19T18:03:01.044609+0000","last_active":"2023-12-19T18:03:01.047422+0000","last_peered":"2023-12-19T18:03:01.047422+0000","last_clean":"2023-12-19T18:03:01.047422+0000","last_became_active":"2023-12-19T18:03:01.044346+0000","last_became_peered":"2023-12-19T18:03:01.044346+0000","last_unstale":"2023-12-19T18:03:01.047422+0000","last_undegraded":"2023-12-19T18:03:01.047422+0000","last_fullsized":"2023-12-19T18:03:01.047422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022657+0000","last_change":"2023-12-19T18:03:01.022657+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022657+0000","last_undegraded":"2023-12-19T18:03:01.022657+0000","last_fullsized":"2023-12-19T18:03:01.022657+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:48.707978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.041935+0000","last_change":"2023-12-19T18:03:01.037450+0000","last_active":"2023-12-19T18:03:01.041935+0000","last_peered":"2023-12-19T18:03:01.041935+0000","last_clean":"2023-12-19T18:03:01.041935+0000","last_became_active":"2023-12-19T18:03:01.037175+0000","last_became_peered":"2023-12-19T18:03:01.037175+0000","last_unstale":"2023-12-19T18:03:01.041935+0000","last_undegraded":"2023-12-19T18:03:01.041935+0000","last_fullsized":"2023-12-19T18:03:01.041935+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:54.253683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026832+0000","last_change":"2023-12-19T18:03:01.026832+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026832+0000","last_undegraded":"2023-12-19T18:03:01.026832+0000","last_fullsized":"2023-12-19T18:03:01.026832+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047821+0000","last_change":"2023-12-19T18:03:01.046428+0000","last_active":"2023-12-19T18:03:01.047821+0000","last_peered":"2023-12-19T18:03:01.047821+0000","last_clean":"2023-12-19T18:03:01.047821+0000","last_became_active":"2023-12-19T18:03:01.046121+0000","last_became_peered":"2023-12-19T18:03:01.046121+0000","last_unstale":"2023-12-19T18:03:01.047821+0000","last_undegraded":"2023-12-19T18:03:01.047821+0000","last_fullsized":"2023-12-19T18:03:01.047821+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:12.408666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.024064+0000","last_change":"2023-12-19T18:03:01.024064+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.024064+0000","last_undegraded":"2023-12-19T18:03:01.024064+0000","last_fullsized":"2023-12-19T18:03:01.024064+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:35.371295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.041729+0000","last_change":"2023-12-19T18:03:01.039131+0000","last_active":"2023-12-19T18:03:01.041729+0000","last_peered":"2023-12-19T18:03:01.041729+0000","last_clean":"2023-12-19T18:03:01.041729+0000","last_became_active":"2023-12-19T18:03:01.038734+0000","last_became_peered":"2023-12-19T18:03:01.038734+0000","last_unstale":"2023-12-19T18:03:01.041729+0000","last_undegraded":"2023-12-19T18:03:01.041729+0000","last_fullsized":"2023-12-19T18:03:01.041729+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:46.564642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027977+0000","last_change":"2023-12-19T18:03:01.027977+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027977+0000","last_undegraded":"2023-12-19T18:03:01.027977+0000","last_fullsized":"2023-12-19T18:03:01.027977+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:49.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.042560+0000","last_change":"2023-12-19T18:03:01.040136+0000","last_active":"2023-12-19T18:03:01.042560+0000","last_peered":"2023-12-19T18:03:01.042560+0000","last_clean":"2023-12-19T18:03:01.042560+0000","last_became_active":"2023-12-19T18:03:01.039868+0000","last_became_peered":"2023-12-19T18:03:01.039868+0000","last_unstale":"2023-12-19T18:03:01.042560+0000","last_undegraded":"2023-12-19T18:03:01.042560+0000","last_fullsized":"2023-12-19T18:03:01.042560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:40.552341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026723+0000","last_change":"2023-12-19T18:03:01.026723+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026723+0000","last_undegraded":"2023-12-19T18:03:01.026723+0000","last_fullsized":"2023-12-19T18:03:01.026723+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:34.035010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046060+0000","last_change":"2023-12-19T18:03:01.042852+0000","last_active":"2023-12-19T18:03:01.046060+0000","last_peered":"2023-12-19T18:03:01.046060+0000","last_clean":"2023-12-19T18:03:01.046060+0000","last_became_active":"2023-12-19T18:03:01.042591+0000","last_became_peered":"2023-12-19T18:03:01.042591+0000","last_unstale":"2023-12-19T18:03:01.046060+0000","last_undegraded":"2023-12-19T18:03:01.046060+0000","last_fullsized":"2023-12-19T18:03:01.046060+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:36.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026761+0000","last_change":"2023-12-19T18:03:01.026761+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026761+0000","last_undegraded":"2023-12-19T18:03:01.026761+0000","last_fullsized":"2023-12-19T18:03:01.026761+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045431+0000","last_change":"2023-12-19T18:03:01.042245+0000","last_active":"2023-12-19T18:03:01.045431+0000","last_peered":"2023-12-19T18:03:01.045431+0000","last_clean":"2023-12-19T18:03:01.045431+0000","last_became_active":"2023-12-19T18:03:01.041594+0000","last_became_peered":"2023-12-19T18:03:01.041594+0000","last_unstale":"2023-12-19T18:03:01.045431+0000","last_undegraded":"2023-12-19T18:03:01.045431+0000","last_fullsized":"2023-12-19T18:03:01.045431+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:47.506271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023812+0000","last_change":"2023-12-19T18:03:01.023812+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023812+0000","last_undegraded":"2023-12-19T18:03:01.023812+0000","last_fullsized":"2023-12-19T18:03:01.023812+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:09.235125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045652+0000","last_change":"2023-12-19T18:03:01.043296+0000","last_active":"2023-12-19T18:03:01.045652+0000","last_peered":"2023-12-19T18:03:01.045652+0000","last_clean":"2023-12-19T18:03:01.045652+0000","last_became_active":"2023-12-19T18:03:01.040391+0000","last_became_peered":"2023-12-19T18:03:01.040391+0000","last_unstale":"2023-12-19T18:03:01.045652+0000","last_undegraded":"2023-12-19T18:03:01.045652+0000","last_fullsized":"2023-12-19T18:03:01.045652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:48.320418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022921+0000","last_change":"2023-12-19T18:03:01.022921+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022921+0000","last_undegraded":"2023-12-19T18:03:01.022921+0000","last_fullsized":"2023-12-19T18:03:01.022921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.039770+0000","last_change":"2023-12-19T18:03:01.036153+0000","last_active":"2023-12-19T18:03:01.039770+0000","last_peered":"2023-12-19T18:03:01.039770+0000","last_clean":"2023-12-19T18:03:01.039770+0000","last_became_active":"2023-12-19T18:03:01.035798+0000","last_became_peered":"2023-12-19T18:03:01.035798+0000","last_unstale":"2023-12-19T18:03:01.039770+0000","last_undegraded":"2023-12-19T18:03:01.039770+0000","last_fullsized":"2023-12-19T18:03:01.039770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:43.399399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022219+0000","last_change":"2023-12-19T18:03:01.022219+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022219+0000","last_undegraded":"2023-12-19T18:03:01.022219+0000","last_fullsized":"2023-12-19T18:03:01.022219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:22.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046608+0000","last_change":"2023-12-19T18:03:01.044483+0000","last_active":"2023-12-19T18:03:01.046608+0000","last_peered":"2023-12-19T18:03:01.046608+0000","last_clean":"2023-12-19T18:03:01.046608+0000","last_became_active":"2023-12-19T18:03:01.043913+0000","last_became_peered":"2023-12-19T18:03:01.043913+0000","last_unstale":"2023-12-19T18:03:01.046608+0000","last_undegraded":"2023-12-19T18:03:01.046608+0000","last_fullsized":"2023-12-19T18:03:01.046608+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028633+0000","last_change":"2023-12-19T18:03:01.028633+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028633+0000","last_undegraded":"2023-12-19T18:03:01.028633+0000","last_fullsized":"2023-12-19T18:03:01.028633+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044761+0000","last_change":"2023-12-19T18:03:01.041437+0000","last_active":"2023-12-19T18:03:01.044761+0000","last_peered":"2023-12-19T18:03:01.044761+0000","last_clean":"2023-12-19T18:03:01.044761+0000","last_became_active":"2023-12-19T18:03:01.041139+0000","last_became_peered":"2023-12-19T18:03:01.041139+0000","last_unstale":"2023-12-19T18:03:01.044761+0000","last_undegraded":"2023-12-19T18:03:01.044761+0000","last_fullsized":"2023-12-19T18:03:01.044761+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:01.261039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023519+0000","last_change":"2023-12-19T18:03:01.023519+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023519+0000","last_undegraded":"2023-12-19T18:03:01.023519+0000","last_fullsized":"2023-12-19T18:03:01.023519+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:32:20.489876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.050404+0000","last_change":"2023-12-19T18:03:01.049301+0000","last_active":"2023-12-19T18:03:01.050404+0000","last_peered":"2023-12-19T18:03:01.050404+0000","last_clean":"2023-12-19T18:03:01.050404+0000","last_became_active":"2023-12-19T18:03:01.048995+0000","last_became_peered":"2023-12-19T18:03:01.048995+0000","last_unstale":"2023-12-19T18:03:01.050404+0000","last_undegraded":"2023-12-19T18:03:01.050404+0000","last_fullsized":"2023-12-19T18:03:01.050404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027469+0000","last_change":"2023-12-19T18:03:01.027469+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027469+0000","last_undegraded":"2023-12-19T18:03:01.027469+0000","last_fullsized":"2023-12-19T18:03:01.027469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:26.073083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045027+0000","last_change":"2023-12-19T18:03:01.042324+0000","last_active":"2023-12-19T18:03:01.045027+0000","last_peered":"2023-12-19T18:03:01.045027+0000","last_clean":"2023-12-19T18:03:01.045027+0000","last_became_active":"2023-12-19T18:03:01.041724+0000","last_became_peered":"2023-12-19T18:03:01.041724+0000","last_unstale":"2023-12-19T18:03:01.045027+0000","last_undegraded":"2023-12-19T18:03:01.045027+0000","last_fullsized":"2023-12-19T18:03:01.045027+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:41:28.074168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022705+0000","last_change":"2023-12-19T18:03:01.022705+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022705+0000","last_undegraded":"2023-12-19T18:03:01.022705+0000","last_fullsized":"2023-12-19T18:03:01.022705+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:43.324973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044526+0000","last_change":"2023-12-19T18:03:01.041166+0000","last_active":"2023-12-19T18:03:01.044526+0000","last_peered":"2023-12-19T18:03:01.044526+0000","last_clean":"2023-12-19T18:03:01.044526+0000","last_became_active":"2023-12-19T18:03:01.039307+0000","last_became_peered":"2023-12-19T18:03:01.039307+0000","last_unstale":"2023-12-19T18:03:01.044526+0000","last_undegraded":"2023-12-19T18:03:01.044526+0000","last_fullsized":"2023-12-19T18:03:01.044526+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:26.463539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022127+0000","last_change":"2023-12-19T18:03:01.022127+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022127+0000","last_undegraded":"2023-12-19T18:03:01.022127+0000","last_fullsized":"2023-12-19T18:03:01.022127+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.041242+0000","last_change":"2023-12-19T18:03:01.036205+0000","last_active":"2023-12-19T18:03:01.041242+0000","last_peered":"2023-12-19T18:03:01.041242+0000","last_clean":"2023-12-19T18:03:01.041242+0000","last_became_active":"2023-12-19T18:03:01.035940+0000","last_became_peered":"2023-12-19T18:03:01.035940+0000","last_unstale":"2023-12-19T18:03:01.041242+0000","last_undegraded":"2023-12-19T18:03:01.041242+0000","last_fullsized":"2023-12-19T18:03:01.041242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:11.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.021583+0000","last_change":"2023-12-19T18:03:01.021583+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.021583+0000","last_undegraded":"2023-12-19T18:03:01.021583+0000","last_fullsized":"2023-12-19T18:03:01.021583+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:45.843330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.039393+0000","last_change":"2023-12-19T18:03:01.036635+0000","last_active":"2023-12-19T18:03:01.039393+0000","last_peered":"2023-12-19T18:03:01.039393+0000","last_clean":"2023-12-19T18:03:01.039393+0000","last_became_active":"2023-12-19T18:03:01.036255+0000","last_became_peered":"2023-12-19T18:03:01.036255+0000","last_unstale":"2023-12-19T18:03:01.039393+0000","last_undegraded":"2023-12-19T18:03:01.039393+0000","last_fullsized":"2023-12-19T18:03:01.039393+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:44.837666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":276,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-12-19T18:03:00.015797+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:03:00.015797+0000","last_peered":"2023-12-19T18:03:00.015797+0000","last_clean":"2023-12-19T18:03:00.015797+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:03:00.015797+0000","last_undegraded":"2023-12-19T18:03:00.015797+0000","last_fullsized":"2023-12-19T18:03:00.015797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2162688,"data_stored":1353154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2150000000000001,"15min":1.117},"min":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.8959999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.276,"15min":1.179},"min":{"1min":0.747,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4770000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.21}]},{"osd":1,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.175,"15min":1.1040000000000001},"min":{"1min":0.63400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.444,"5min":12.625,"15min":12.625},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.169,"15min":1.1379999999999999},"min":{"1min":0.752,"5min":0.60899999999999999,"15min":0.52600000000000002},"max":{"1min":1.3540000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.873}]},{"osd":2,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1839999999999999,"15min":1.097},"min":{"1min":0.84499999999999997,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":1.371,"5min":13.041,"15min":13.041},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.587,"15min":1.288},"min":{"1min":0.86499999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.431,"5min":48.889000000000003,"15min":48.889000000000003},"last":0.74199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.26,"15min":1.171},"min":{"1min":0.82799999999999996,"5min":0.67100000000000004,"15min":0.51600000000000001},"max":{"1min":1.409,"5min":12.917,"15min":12.917},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":1.083,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5860000000000001,"5min":46.375,"15min":46.375},"last":0.92200000000000004}]},{"osd":4,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.601,"5min":13.137,"15min":13.137},"last":1.002},{"interface":"front","average":{"1min":1.238,"5min":1.3640000000000001,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4810000000000001,"5min":13.109,"15min":13.109},"last":1.165}]},{"osd":5,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.29,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.492,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3069999999999999,"15min":1.286},"min":{"1min":0.89200000000000002,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":1.522,"5min":13.198,"15min":13.198},"last":1.0800000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.478,"15min":1.4179999999999999},"min":{"1min":0.98299999999999998,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":1.675,"5min":13.442,"15min":13.442},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4199999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.792,"5min":13.981,"15min":13.981},"last":1.605}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":762786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.997,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.381,"5min":1.399,"15min":4.5979999999999999},"last":1.268},{"interface":"front","average":{"1min":1.103,"5min":1.04,"15min":1.0740000000000001},"min":{"1min":0.755,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4490000000000001,"5min":1.756,"15min":1.756},"last":0.71099999999999997}]},{"osd":1,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.0900000000000001},"min":{"1min":0.70499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.111},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.415,"5min":1.583,"15min":1.621},"last":1.083}]},{"osd":2,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.131,"15min":1.282},"min":{"1min":0.94699999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.1890000000000001,"15min":1.2170000000000001},"min":{"1min":0.90900000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.673,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.0389999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.2490000000000001},"min":{"1min":0.91200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5529999999999999,"5min":1.651,"15min":4.5380000000000003},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.218,"15min":1.29},"min":{"1min":0.83099999999999996,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":4.508},"last":1.4179999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.149,"15min":1.137},"min":{"1min":0.76000000000000001,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.5129999999999999,"5min":1.577,"15min":1.8360000000000001},"last":1.163},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2290000000000001,"15min":1.2390000000000001},"min":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.579,"5min":1.802,"15min":1.899},"last":1.4950000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2569999999999999,"15min":1.2589999999999999},"min":{"1min":0.89400000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.329},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2729999999999999,"15min":1.2689999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.724,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.4470000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.857,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.385,"15min":1.395},"min":{"1min":1.056,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.827,"5min":1.841,"15min":2.2440000000000002},"last":1.482}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":769381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5109999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.60599999999999998},"max":{"1min":1.409,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.3460000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.135,"15min":1.113},"min":{"1min":0.78700000000000003,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.3540000000000001,"5min":1.974,"15min":1.974},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.145,"15min":1.179},"min":{"1min":0.77700000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.399,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.7709999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.891,"15min":2.9929999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.3720000000000001,"5min":2.024,"15min":2.024},"last":1.4199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.482,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.25,"15min":1.3120000000000001},"min":{"1min":1.079,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.536,"5min":1.829,"15min":3.0350000000000001},"last":1.4590000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1890000000000001,"15min":1.244},"min":{"1min":0.79800000000000004,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.4650000000000001,"5min":3.633,"15min":3.633},"last":1.681},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":1.1830000000000001,"5min":0.78600000000000003,"15min":0.745},"max":{"1min":1.5600000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.9370000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.323},"min":{"1min":1.0429999999999999,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.609,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.3029999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.802}]},{"osd":7,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3180000000000001,"15min":1.411},"min":{"1min":0.85899999999999999,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.9279999999999999,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.992},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3759999999999999,"15min":1.4870000000000001},"min":{"1min":1.0429999999999999,"5min":0.98099999999999998,"15min":0.82499999999999996},"max":{"1min":1.7350000000000001,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.895}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":762786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.077,"15min":1.1739999999999999},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.458,"5min":1.556,"15min":5.4420000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.1890000000000001,"15min":1.252},"min":{"1min":0.90400000000000003,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.53,"5min":1.657,"15min":5.5049999999999999},"last":1.0509999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1100000000000001,"15min":1.181},"min":{"1min":0.83199999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.5580000000000001,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.161},"min":{"1min":0.85699999999999998,"5min":0.70999999999999996,"15min":0.66000000000000003},"max":{"1min":1.4319999999999999,"5min":1.5589999999999999,"15min":3.254},"last":1.1599999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.1970000000000001},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.4850000000000001,"5min":1.623,"15min":4.593},"last":0.879},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.173,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.454,"5min":1.871,"15min":2.3799999999999999},"last":1.2070000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1220000000000001,"15min":1.2070000000000001},"min":{"1min":0.90000000000000002,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.3939999999999999,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.266,"5min":1.2110000000000001,"15min":1.3160000000000001},"min":{"1min":0.93700000000000006,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5409999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.2569999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.88600000000000001,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.502,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.306}]},{"osd":6,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2350000000000001,"15min":1.252},"min":{"1min":0.872,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.5609999999999999,"5min":1.6910000000000001,"15min":2.915},"last":1.117},{"interface":"front","average":{"1min":1.409,"5min":1.4019999999999999,"15min":1.4039999999999999},"min":{"1min":1.266,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6200000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.411}]},{"osd":7,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.296,"15min":1.306},"min":{"1min":0.99299999999999999,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.556,"5min":1.907,"15min":2.4340000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.369},"min":{"1min":1.0600000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7,"5min":1.833,"15min":5.6859999999999999},"last":1.389}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":762786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.874},"min":{"1min":0.61399999999999999,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":1.329,"5min":1.6599999999999999,"15min":1.825},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.92100000000000004},"min":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.435},"max":{"1min":1.6299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3859999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.163,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.80900000000000005,"5min":0.311,"15min":0.311},"max":{"1min":1.6180000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.65900000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5680000000000001,"5min":1.679,"15min":2.177},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.1599999999999999,"15min":1.2010000000000001},"min":{"1min":0.71599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.8520000000000001},"last":0.85799999999999998}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1599999999999999,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7070000000000001,"5min":1.7310000000000001,"15min":2.234},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3109999999999999,"15min":1.302},"min":{"1min":0.873,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.591,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.73299999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3340000000000001,"15min":1.369},"min":{"1min":1.0129999999999999,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":1.964,"5min":2.0699999999999998,"15min":2.5419999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2729999999999999,"15min":1.3149999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.74299999999999999},"max":{"1min":1.5740000000000001,"5min":1.776,"15min":2.754},"last":0.52500000000000002}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.345,"15min":1.379},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6859999999999999,"5min":1.946,"15min":2.6880000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.504,"5min":1.411,"15min":1.444},"min":{"1min":0.98499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.8089999999999999,"5min":2.274,"15min":2.6429999999999998},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.351,"15min":1.3999999999999999},"min":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.77700000000000002},"max":{"1min":1.7909999999999999,"5min":1.9730000000000001,"15min":3.02},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4279999999999999,"15min":1.4630000000000001},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.83099999999999996},"max":{"1min":1.7809999999999999,"5min":2.323,"15min":2.8170000000000002},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":769381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91900000000000004,"15min":1.119},"min":{"1min":0.65600000000000003,"5min":0.497,"15min":0.29599999999999999},"max":{"1min":1.4710000000000001,"5min":3.9209999999999998,"15min":13.32},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":1.222},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":3.8149999999999999,"15min":13.206},"last":1.022}]},{"osd":1,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93799999999999994,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.4079999999999999,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.70299999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.653,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.129}]},{"osd":3,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92600000000000005,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.4610000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.1619999999999999,"15min":1.1890000000000001},"min":{"1min":0.89900000000000002,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.647,"5min":2.75,"15min":2.75},"last":0.78500000000000003}]},{"osd":4,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2490000000000001},"min":{"1min":1.01,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4339999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.278},"min":{"1min":1.0389999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.429,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.2669999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.218,"15min":1.264},"min":{"1min":0.874,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7110000000000001,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.21},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3380000000000001,"15min":1.403},"min":{"1min":1.008,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.571,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.3720000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.389},"min":{"1min":0.98799999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6359999999999999,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3109999999999999,"15min":1.3380000000000001},"min":{"1min":0.92600000000000005,"5min":0.872,"15min":0.872},"max":{"1min":1.6040000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.3320000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.92900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.766,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.95799999999999996,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7,"5min":5.375,"15min":5.375},"last":1.4430000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":769381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.72599999999999998,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.931},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.335,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":1.3240000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82499999999999996,"15min":0.91600000000000004},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1619999999999999,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.97599999999999998,"15min":1.0609999999999999},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.387,"5min":1.5580000000000001,"15min":3.4199999999999999},"last":1.631}]},{"osd":3,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.075,"15min":1.1819999999999999},"min":{"1min":0.751,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":3.4950000000000001},"last":1.159},{"interface":"front","average":{"1min":1,"5min":0.95499999999999996,"15min":1.0840000000000001},"min":{"1min":0.60299999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4279999999999999,"5min":1.55,"15min":4.2030000000000003},"last":1.21}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2789999999999999,"15min":1.345},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8779999999999999,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.56999999999999995},"max":{"1min":1.6299999999999999,"5min":1.681,"15min":2.6960000000000002},"last":1.506}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.296},"min":{"1min":0.93400000000000005,"5min":0.82999999999999996,"15min":0.69599999999999995},"max":{"1min":1.7130000000000001,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.91100000000000003,"5min":0.83299999999999996,"15min":0.69399999999999995},"max":{"1min":1.915,"5min":1.915,"15min":3.8420000000000001},"last":1.2529999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3240000000000001,"15min":1.4470000000000001},"min":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9930000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.333,"15min":1.4610000000000001},"min":{"1min":0.997,"5min":0.84499999999999997,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.917,"15min":3.214},"last":1.7350000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.359,"15min":1.5069999999999999},"min":{"1min":1.028,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":4.0910000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.337,"15min":1.452},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":4.6390000000000002},"last":1.7909999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2158592,"data_stored":1352135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.94499999999999995},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.129,"5min":1.53,"15min":2.2250000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.94599999999999995,"15min":1.077},"min":{"1min":0.80500000000000005,"5min":0.505,"15min":0.499},"max":{"1min":1.4239999999999999,"5min":1.73,"15min":2.3599999999999999},"last":1.125}]},{"osd":2,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.89200000000000002,"15min":0.94399999999999995},"min":{"1min":0.57899999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2649999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.94199999999999995},"min":{"1min":0.64000000000000001,"5min":0.497,"15min":0.45300000000000001},"max":{"1min":1.1879999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.024}]},{"osd":3,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.69199999999999995,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.4630000000000001,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.151,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.609,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.214}]},{"osd":4,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2529999999999999,"15min":1.3200000000000001},"min":{"1min":0.86399999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6459999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.2629999999999999,"15min":1.333},"min":{"1min":0.92800000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.641,"5min":1.738,"15min":2.7799999999999998},"last":1.0940000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.2549999999999999},"min":{"1min":0.80800000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":1.758,"15min":2.0579999999999998},"last":1.367},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.891,"5min":1.891,"15min":2.0030000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":2.1000000000000001},"last":1.286},{"interface":"front","average":{"1min":1.304,"5min":1.266,"15min":1.373},"min":{"1min":0.97399999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7030000000000001,"5min":1.8300000000000001,"15min":2.3889999999999998},"last":1.2430000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.333,"15min":1.4870000000000001},"min":{"1min":1.131,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7829999999999999,"5min":1.9339999999999999,"15min":4.9400000000000004},"last":1.333},{"interface":"front","average":{"1min":1.367,"5min":1.3220000000000001,"15min":1.46},"min":{"1min":0.95099999999999996,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.8280000000000001,"5min":1.875,"15min":4.8250000000000002},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:03:05.983 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:03:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.193+0000 7f30419e1700 1 Processor -- start 2023-12-19T18:03:06.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.193+0000 7f30419e1700 1 -- start start 2023-12-19T18:03:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.193+0000 7f30419e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c15ae20 0x7f303c15be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.193+0000 7f30419e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f303c06cad0 0x7f303c0c3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.193+0000 7f30419e1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f303c06f0a0 con 0x7f303c0af720 2023-12-19T18:03:06.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.193+0000 7f30419e1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f303c06ea90 con 0x7f303c06cad0 2023-12-19T18:03:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f30419e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0c3f60 con 0x7f303c15ae20 2023-12-19T18:03:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f303c06cad0 0x7f303c0c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f303c06cad0 0x7f303c0c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47206/0 (socket says 172.21.15.45:47206) 2023-12-19T18:03:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 -- 172.21.15.45:0/3644030026 learned_addr learned my addr 172.21.15.45:0/3644030026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:06.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f30409df700 1 --2- 172.21.15.45:0/3644030026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c15ae20 0x7f303c15be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 -- 172.21.15.45:0/3644030026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c15ae20 msgr2=0x7f303c15be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 --2- 172.21.15.45:0/3644030026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c15ae20 0x7f303c15be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 -- 172.21.15.45:0/3644030026 >> v1:172.21.15.73:6789/0 conn(0x7f303c0af720 legacy=0x7f303c15e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 -- 172.21.15.45:0/3644030026 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f303c0c4240 con 0x7f303c06cad0 2023-12-19T18:03:06.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303bfff700 1 --2- 172.21.15.45:0/3644030026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c06cad0 0x7f303c0c3710 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f3028009910 tx=0x7f3028009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6682fa58a823ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303b7fe700 1 -- 172.21.15.45:0/3644030026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028010a90 con 0x7f303c06cad0 2023-12-19T18:03:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303b7fe700 1 -- 172.21.15.45:0/3644030026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3028010bf0 con 0x7f303c06cad0 2023-12-19T18:03:06.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f303b7fe700 1 -- 172.21.15.45:0/3644030026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3028018440 con 0x7f303c06cad0 2023-12-19T18:03:06.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f30419e1700 1 -- 172.21.15.45:0/3644030026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c06cad0 msgr2=0x7f303c0c3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f30419e1700 1 --2- 172.21.15.45:0/3644030026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c06cad0 0x7f303c0c3710 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f3028009910 tx=0x7f3028009c20 comp rx=0 tx=0).stop 2023-12-19T18:03:06.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.197+0000 7f30419e1700 1 -- 172.21.15.45:0/3644030026 shutdown_connections 2023-12-19T18:03:06.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 --2- 172.21.15.45:0/3644030026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c06cad0 0x7f303c0c3710 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 --2- 172.21.15.45:0/3644030026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c15ae20 0x7f303c15be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 -- 172.21.15.45:0/3644030026 >> 172.21.15.45:0/3644030026 conn(0x7f303c0cb900 msgr2=0x7f303c0b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:06.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 -- 172.21.15.45:0/3644030026 shutdown_connections 2023-12-19T18:03:06.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 -- 172.21.15.45:0/3644030026 wait complete. 2023-12-19T18:03:06.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 Processor -- start 2023-12-19T18:03:06.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.201+0000 7f30419e1700 1 -- start start 2023-12-19T18:03:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30419e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c06cad0 0x7f303c1eed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30419e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 0x7f303c152530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30419e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c15ae20 0x7f303c0b4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30419e1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0b4860 con 0x7f303c0af720 2023-12-19T18:03:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30419e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303c1ef420 con 0x7f303c15ae20 2023-12-19T18:03:06.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30419e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f303c0cdac0 con 0x7f303c06cad0 2023-12-19T18:03:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f303bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 0x7f303c152530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f303bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 0x7f303c152530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47216/0 (socket says 172.21.15.45:47216) 2023-12-19T18:03:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30409df700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c06cad0 0x7f303c1eed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f303bfff700 1 -- 172.21.15.45:0/2726540842 learned_addr learned my addr 172.21.15.45:0/2726540842 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:06.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30411e0700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c15ae20 0x7f303c0b4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30409df700 1 -- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c15ae20 msgr2=0x7f303c0b4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30409df700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c15ae20 0x7f303c0b4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30409df700 1 -- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 msgr2=0x7f303c152530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30409df700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 0x7f303c152530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f30409df700 1 -- 172.21.15.45:0/2726540842 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3028009570 con 0x7f303c06cad0 2023-12-19T18:03:06.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.205+0000 7f303bfff700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 0x7f303c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30409df700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c06cad0 0x7f303c1eed20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f303000e870 tx=0x7f303000eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030013680 con 0x7f303c06cad0 2023-12-19T18:03:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30300137e0 con 0x7f303c06cad0 2023-12-19T18:03:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030013b70 con 0x7f303c06cad0 2023-12-19T18:03:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303c0cdd60 con 0x7f303c06cad0 2023-12-19T18:03:06.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303c0b2950 con 0x7f303c06cad0 2023-12-19T18:03:06.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.209+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303c067760 con 0x7f303c06cad0 2023-12-19T18:03:06.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.213+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3030013cd0 con 0x7f303c06cad0 2023-12-19T18:03:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.213+0000 7f30397fa700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3020065b20 0x7f3020067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.213+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3030082ff0 con 0x7f303c06cad0 2023-12-19T18:03:06.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.213+0000 7f303bfff700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3020065b20 0x7f3020067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.213+0000 7f303bfff700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3020065b20 0x7f3020067fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3028009150 tx=0x7f3028014000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:06.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.221+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f30300508e0 con 0x7f303c06cad0 2023-12-19T18:03:06.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.393+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f303c0b27d0 con 0x7f3020065b20 2023-12-19T18:03:06.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.413+0000 7f30397fa700 1 -- 172.21.15.45:0/2726540842 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284187 (secure 0 0 0) 0x7f3028011e90 con 0x7f3020065b20 2023-12-19T18:03:06.421 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3020065b20 msgr2=0x7f3020067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3020065b20 0x7f3020067fe0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3028009150 tx=0x7f3028014000 comp rx=0 tx=0).stop 2023-12-19T18:03:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c06cad0 msgr2=0x7f303c1eed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c06cad0 0x7f303c1eed20 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f303000e870 tx=0x7f303000eb80 comp rx=0 tx=0).stop 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 shutdown_connections 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3020065b20 0x7f3020067fe0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f303c15ae20 0x7f303c0b4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f303c0af720 0x7f303c152530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 --2- 172.21.15.45:0/2726540842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f303c06cad0 0x7f303c1eed20 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 >> 172.21.15.45:0/2726540842 conn(0x7f303c0cb900 msgr2=0x7f303c159ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 shutdown_connections 2023-12-19T18:03:06.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.421+0000 7f30419e1700 1 -- 172.21.15.45:0/2726540842 wait complete. 2023-12-19T18:03:06.428 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:03:06.448 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":471,"stamp":"2023-12-19T18:03:04.451452+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":8,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261832,"kb_used_data":13448,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754712888,"statfs":{"total":773094113280,"available":772825997312,"internally_reserved":0,"allocated":13770752,"data_stored":7301790,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.446114"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.030400+0000","last_change":"2023-12-19T18:03:01.030400+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.030400+0000","last_undegraded":"2023-12-19T18:03:01.030400+0000","last_fullsized":"2023-12-19T18:03:01.030400+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.032900+0000","last_change":"2023-12-19T18:03:01.032900+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.032900+0000","last_undegraded":"2023-12-19T18:03:01.032900+0000","last_fullsized":"2023-12-19T18:03:01.032900+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:53.820748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023894+0000","last_change":"2023-12-19T18:03:01.023894+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023894+0000","last_undegraded":"2023-12-19T18:03:01.023894+0000","last_fullsized":"2023-12-19T18:03:01.023894+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:49.326082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022521+0000","last_change":"2023-12-19T18:03:01.022521+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022521+0000","last_undegraded":"2023-12-19T18:03:01.022521+0000","last_fullsized":"2023-12-19T18:03:01.022521+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:09:24.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031016+0000","last_change":"2023-12-19T18:03:01.031016+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031016+0000","last_undegraded":"2023-12-19T18:03:01.031016+0000","last_fullsized":"2023-12-19T18:03:01.031016+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022413+0000","last_change":"2023-12-19T18:03:01.022413+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022413+0000","last_undegraded":"2023-12-19T18:03:01.022413+0000","last_fullsized":"2023-12-19T18:03:01.022413+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:26:31.507606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023630+0000","last_change":"2023-12-19T18:03:01.023630+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023630+0000","last_undegraded":"2023-12-19T18:03:01.023630+0000","last_fullsized":"2023-12-19T18:03:01.023630+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.842744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025371+0000","last_change":"2023-12-19T18:03:01.025371+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025371+0000","last_undegraded":"2023-12-19T18:03:01.025371+0000","last_fullsized":"2023-12-19T18:03:01.025371+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:47.570305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023780+0000","last_change":"2023-12-19T18:03:01.023780+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023780+0000","last_undegraded":"2023-12-19T18:03:01.023780+0000","last_fullsized":"2023-12-19T18:03:01.023780+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:05.296698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026754+0000","last_change":"2023-12-19T18:03:01.026754+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026754+0000","last_undegraded":"2023-12-19T18:03:01.026754+0000","last_fullsized":"2023-12-19T18:03:01.026754+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.033514+0000","last_change":"2023-12-19T18:03:01.033514+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.033514+0000","last_undegraded":"2023-12-19T18:03:01.033514+0000","last_fullsized":"2023-12-19T18:03:01.033514+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025174+0000","last_change":"2023-12-19T18:03:01.025174+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025174+0000","last_undegraded":"2023-12-19T18:03:01.025174+0000","last_fullsized":"2023-12-19T18:03:01.025174+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:36.056772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026405+0000","last_change":"2023-12-19T18:03:01.026405+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026405+0000","last_undegraded":"2023-12-19T18:03:01.026405+0000","last_fullsized":"2023-12-19T18:03:01.026405+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029253+0000","last_change":"2023-12-19T18:03:01.029253+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029253+0000","last_undegraded":"2023-12-19T18:03:01.029253+0000","last_fullsized":"2023-12-19T18:03:01.029253+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:24.463386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031555+0000","last_change":"2023-12-19T18:03:01.031555+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031555+0000","last_undegraded":"2023-12-19T18:03:01.031555+0000","last_fullsized":"2023-12-19T18:03:01.031555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.024560+0000","last_change":"2023-12-19T18:03:01.024560+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.024560+0000","last_undegraded":"2023-12-19T18:03:01.024560+0000","last_fullsized":"2023-12-19T18:03:01.024560+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:12.676472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025837+0000","last_change":"2023-12-19T18:03:01.025837+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025837+0000","last_undegraded":"2023-12-19T18:03:01.025837+0000","last_fullsized":"2023-12-19T18:03:01.025837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029034+0000","last_change":"2023-12-19T18:03:01.029034+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029034+0000","last_undegraded":"2023-12-19T18:03:01.029034+0000","last_fullsized":"2023-12-19T18:03:01.029034+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:10.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.021715+0000","last_change":"2023-12-19T18:03:01.021715+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.021715+0000","last_undegraded":"2023-12-19T18:03:01.021715+0000","last_fullsized":"2023-12-19T18:03:01.021715+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026604+0000","last_change":"2023-12-19T18:03:01.026604+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026604+0000","last_undegraded":"2023-12-19T18:03:01.026604+0000","last_fullsized":"2023-12-19T18:03:01.026604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022278+0000","last_change":"2023-12-19T18:03:01.022278+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022278+0000","last_undegraded":"2023-12-19T18:03:01.022278+0000","last_fullsized":"2023-12-19T18:03:01.022278+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:25.460640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031097+0000","last_change":"2023-12-19T18:03:01.031097+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031097+0000","last_undegraded":"2023-12-19T18:03:01.031097+0000","last_fullsized":"2023-12-19T18:03:01.031097+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022320+0000","last_change":"2023-12-19T18:03:01.022320+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022320+0000","last_undegraded":"2023-12-19T18:03:01.022320+0000","last_fullsized":"2023-12-19T18:03:01.022320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:09:23.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029538+0000","last_change":"2023-12-19T18:03:01.029538+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029538+0000","last_undegraded":"2023-12-19T18:03:01.029538+0000","last_fullsized":"2023-12-19T18:03:01.029538+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028864+0000","last_change":"2023-12-19T18:03:01.028864+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028864+0000","last_undegraded":"2023-12-19T18:03:01.028864+0000","last_fullsized":"2023-12-19T18:03:01.028864+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027878+0000","last_change":"2023-12-19T18:03:01.027878+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027878+0000","last_undegraded":"2023-12-19T18:03:01.027878+0000","last_fullsized":"2023-12-19T18:03:01.027878+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.020070+0000","last_change":"2023-12-19T18:03:01.020070+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.020070+0000","last_undegraded":"2023-12-19T18:03:01.020070+0000","last_fullsized":"2023-12-19T18:03:01.020070+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.024508+0000","last_change":"2023-12-19T18:03:01.024508+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.024508+0000","last_undegraded":"2023-12-19T18:03:01.024508+0000","last_fullsized":"2023-12-19T18:03:01.024508+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:50.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.029552+0000","last_change":"2023-12-19T18:03:01.029552+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.029552+0000","last_undegraded":"2023-12-19T18:03:01.029552+0000","last_fullsized":"2023-12-19T18:03:01.029552+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:43.950078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027908+0000","last_change":"2023-12-19T18:03:01.027908+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027908+0000","last_undegraded":"2023-12-19T18:03:01.027908+0000","last_fullsized":"2023-12-19T18:03:01.027908+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:27.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028880+0000","last_change":"2023-12-19T18:03:01.028880+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028880+0000","last_undegraded":"2023-12-19T18:03:01.028880+0000","last_fullsized":"2023-12-19T18:03:01.028880+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027269+0000","last_change":"2023-12-19T18:03:01.027269+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027269+0000","last_undegraded":"2023-12-19T18:03:01.027269+0000","last_fullsized":"2023-12-19T18:03:01.027269+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.034522+0000","last_change":"2023-12-19T18:03:01.034522+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.034522+0000","last_undegraded":"2023-12-19T18:03:01.034522+0000","last_fullsized":"2023-12-19T18:03:01.034522+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:36.817532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.037678+0000","last_change":"2023-12-19T18:03:01.031247+0000","last_active":"2023-12-19T18:03:01.037678+0000","last_peered":"2023-12-19T18:03:01.037678+0000","last_clean":"2023-12-19T18:03:01.037678+0000","last_became_active":"2023-12-19T18:03:01.029901+0000","last_became_peered":"2023-12-19T18:03:01.029901+0000","last_unstale":"2023-12-19T18:03:01.037678+0000","last_undegraded":"2023-12-19T18:03:01.037678+0000","last_fullsized":"2023-12-19T18:03:01.037678+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:39.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026352+0000","last_change":"2023-12-19T18:03:01.026352+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026352+0000","last_undegraded":"2023-12-19T18:03:01.026352+0000","last_fullsized":"2023-12-19T18:03:01.026352+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:10.478715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046661+0000","last_change":"2023-12-19T18:03:01.043692+0000","last_active":"2023-12-19T18:03:01.046661+0000","last_peered":"2023-12-19T18:03:01.046661+0000","last_clean":"2023-12-19T18:03:01.046661+0000","last_became_active":"2023-12-19T18:03:01.043406+0000","last_became_peered":"2023-12-19T18:03:01.043406+0000","last_unstale":"2023-12-19T18:03:01.046661+0000","last_undegraded":"2023-12-19T18:03:01.046661+0000","last_fullsized":"2023-12-19T18:03:01.046661+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027273+0000","last_change":"2023-12-19T18:03:01.027273+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027273+0000","last_undegraded":"2023-12-19T18:03:01.027273+0000","last_fullsized":"2023-12-19T18:03:01.027273+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047337+0000","last_change":"2023-12-19T18:03:01.044240+0000","last_active":"2023-12-19T18:03:01.047337+0000","last_peered":"2023-12-19T18:03:01.047337+0000","last_clean":"2023-12-19T18:03:01.047337+0000","last_became_active":"2023-12-19T18:03:01.043989+0000","last_became_peered":"2023-12-19T18:03:01.043989+0000","last_unstale":"2023-12-19T18:03:01.047337+0000","last_undegraded":"2023-12-19T18:03:01.047337+0000","last_fullsized":"2023-12-19T18:03:01.047337+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.479629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022708+0000","last_change":"2023-12-19T18:03:01.022708+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022708+0000","last_undegraded":"2023-12-19T18:03:01.022708+0000","last_fullsized":"2023-12-19T18:03:01.022708+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:52.886192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046598+0000","last_change":"2023-12-19T18:03:01.043134+0000","last_active":"2023-12-19T18:03:01.046598+0000","last_peered":"2023-12-19T18:03:01.046598+0000","last_clean":"2023-12-19T18:03:01.046598+0000","last_became_active":"2023-12-19T18:03:01.042431+0000","last_became_peered":"2023-12-19T18:03:01.042431+0000","last_unstale":"2023-12-19T18:03:01.046598+0000","last_undegraded":"2023-12-19T18:03:01.046598+0000","last_fullsized":"2023-12-19T18:03:01.046598+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:32.570496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022840+0000","last_change":"2023-12-19T18:03:01.022840+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022840+0000","last_undegraded":"2023-12-19T18:03:01.022840+0000","last_fullsized":"2023-12-19T18:03:01.022840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046824+0000","last_change":"2023-12-19T18:03:01.045236+0000","last_active":"2023-12-19T18:03:01.046824+0000","last_peered":"2023-12-19T18:03:01.046824+0000","last_clean":"2023-12-19T18:03:01.046824+0000","last_became_active":"2023-12-19T18:03:01.044907+0000","last_became_peered":"2023-12-19T18:03:01.044907+0000","last_unstale":"2023-12-19T18:03:01.046824+0000","last_undegraded":"2023-12-19T18:03:01.046824+0000","last_fullsized":"2023-12-19T18:03:01.046824+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.031039+0000","last_change":"2023-12-19T18:03:01.031039+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.031039+0000","last_undegraded":"2023-12-19T18:03:01.031039+0000","last_fullsized":"2023-12-19T18:03:01.031039+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044871+0000","last_change":"2023-12-19T18:03:01.041854+0000","last_active":"2023-12-19T18:03:01.044871+0000","last_peered":"2023-12-19T18:03:01.044871+0000","last_clean":"2023-12-19T18:03:01.044871+0000","last_became_active":"2023-12-19T18:03:01.040426+0000","last_became_peered":"2023-12-19T18:03:01.040426+0000","last_unstale":"2023-12-19T18:03:01.044871+0000","last_undegraded":"2023-12-19T18:03:01.044871+0000","last_fullsized":"2023-12-19T18:03:01.044871+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:25.067419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027386+0000","last_change":"2023-12-19T18:03:01.027386+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027386+0000","last_undegraded":"2023-12-19T18:03:01.027386+0000","last_fullsized":"2023-12-19T18:03:01.027386+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:17.957563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.040874+0000","last_change":"2023-12-19T18:03:01.037069+0000","last_active":"2023-12-19T18:03:01.040874+0000","last_peered":"2023-12-19T18:03:01.040874+0000","last_clean":"2023-12-19T18:03:01.040874+0000","last_became_active":"2023-12-19T18:03:01.036794+0000","last_became_peered":"2023-12-19T18:03:01.036794+0000","last_unstale":"2023-12-19T18:03:01.040874+0000","last_undegraded":"2023-12-19T18:03:01.040874+0000","last_fullsized":"2023-12-19T18:03:01.040874+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:42.153731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.025754+0000","last_change":"2023-12-19T18:03:01.025754+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.025754+0000","last_undegraded":"2023-12-19T18:03:01.025754+0000","last_fullsized":"2023-12-19T18:03:01.025754+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:48.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044383+0000","last_change":"2023-12-19T18:03:01.041603+0000","last_active":"2023-12-19T18:03:01.044383+0000","last_peered":"2023-12-19T18:03:01.044383+0000","last_clean":"2023-12-19T18:03:01.044383+0000","last_became_active":"2023-12-19T18:03:01.040273+0000","last_became_peered":"2023-12-19T18:03:01.040273+0000","last_unstale":"2023-12-19T18:03:01.044383+0000","last_undegraded":"2023-12-19T18:03:01.044383+0000","last_fullsized":"2023-12-19T18:03:01.044383+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:23.457722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.020022+0000","last_change":"2023-12-19T18:03:01.020022+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.020022+0000","last_undegraded":"2023-12-19T18:03:01.020022+0000","last_fullsized":"2023-12-19T18:03:01.020022+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047320+0000","last_change":"2023-12-19T18:03:01.046117+0000","last_active":"2023-12-19T18:03:01.047320+0000","last_peered":"2023-12-19T18:03:01.047320+0000","last_clean":"2023-12-19T18:03:01.047320+0000","last_became_active":"2023-12-19T18:03:01.045799+0000","last_became_peered":"2023-12-19T18:03:01.045799+0000","last_unstale":"2023-12-19T18:03:01.047320+0000","last_undegraded":"2023-12-19T18:03:01.047320+0000","last_fullsized":"2023-12-19T18:03:01.047320+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027493+0000","last_change":"2023-12-19T18:03:01.027493+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027493+0000","last_undegraded":"2023-12-19T18:03:01.027493+0000","last_fullsized":"2023-12-19T18:03:01.027493+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.050093+0000","last_change":"2023-12-19T18:03:01.049167+0000","last_active":"2023-12-19T18:03:01.050093+0000","last_peered":"2023-12-19T18:03:01.050093+0000","last_clean":"2023-12-19T18:03:01.050093+0000","last_became_active":"2023-12-19T18:03:01.048925+0000","last_became_peered":"2023-12-19T18:03:01.048925+0000","last_unstale":"2023-12-19T18:03:01.050093+0000","last_undegraded":"2023-12-19T18:03:01.050093+0000","last_fullsized":"2023-12-19T18:03:01.050093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028503+0000","last_change":"2023-12-19T18:03:01.028503+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028503+0000","last_undegraded":"2023-12-19T18:03:01.028503+0000","last_fullsized":"2023-12-19T18:03:01.028503+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:02.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.040881+0000","last_change":"2023-12-19T18:03:01.035484+0000","last_active":"2023-12-19T18:03:01.040881+0000","last_peered":"2023-12-19T18:03:01.040881+0000","last_clean":"2023-12-19T18:03:01.040881+0000","last_became_active":"2023-12-19T18:03:01.035096+0000","last_became_peered":"2023-12-19T18:03:01.035096+0000","last_unstale":"2023-12-19T18:03:01.040881+0000","last_undegraded":"2023-12-19T18:03:01.040881+0000","last_fullsized":"2023-12-19T18:03:01.040881+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:31:55.570736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028268+0000","last_change":"2023-12-19T18:03:01.028268+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028268+0000","last_undegraded":"2023-12-19T18:03:01.028268+0000","last_fullsized":"2023-12-19T18:03:01.028268+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046567+0000","last_change":"2023-12-19T18:03:01.043052+0000","last_active":"2023-12-19T18:03:01.046567+0000","last_peered":"2023-12-19T18:03:01.046567+0000","last_clean":"2023-12-19T18:03:01.046567+0000","last_became_active":"2023-12-19T18:03:01.042700+0000","last_became_peered":"2023-12-19T18:03:01.042700+0000","last_unstale":"2023-12-19T18:03:01.046567+0000","last_undegraded":"2023-12-19T18:03:01.046567+0000","last_fullsized":"2023-12-19T18:03:01.046567+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:07.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.020027+0000","last_change":"2023-12-19T18:03:01.020027+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.020027+0000","last_undegraded":"2023-12-19T18:03:01.020027+0000","last_fullsized":"2023-12-19T18:03:01.020027+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.040841+0000","last_change":"2023-12-19T18:03:01.037229+0000","last_active":"2023-12-19T18:03:01.040841+0000","last_peered":"2023-12-19T18:03:01.040841+0000","last_clean":"2023-12-19T18:03:01.040841+0000","last_became_active":"2023-12-19T18:03:01.036922+0000","last_became_peered":"2023-12-19T18:03:01.036922+0000","last_unstale":"2023-12-19T18:03:01.040841+0000","last_undegraded":"2023-12-19T18:03:01.040841+0000","last_fullsized":"2023-12-19T18:03:01.040841+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:16.787802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023567+0000","last_change":"2023-12-19T18:03:01.023567+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023567+0000","last_undegraded":"2023-12-19T18:03:01.023567+0000","last_fullsized":"2023-12-19T18:03:01.023567+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045979+0000","last_change":"2023-12-19T18:03:01.041706+0000","last_active":"2023-12-19T18:03:01.045979+0000","last_peered":"2023-12-19T18:03:01.045979+0000","last_clean":"2023-12-19T18:03:01.045979+0000","last_became_active":"2023-12-19T18:03:01.040042+0000","last_became_peered":"2023-12-19T18:03:01.040042+0000","last_unstale":"2023-12-19T18:03:01.045979+0000","last_undegraded":"2023-12-19T18:03:01.045979+0000","last_fullsized":"2023-12-19T18:03:01.045979+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:53.747846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.030320+0000","last_change":"2023-12-19T18:03:01.030320+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.030320+0000","last_undegraded":"2023-12-19T18:03:01.030320+0000","last_fullsized":"2023-12-19T18:03:01.030320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046041+0000","last_change":"2023-12-19T18:03:01.041523+0000","last_active":"2023-12-19T18:03:01.046041+0000","last_peered":"2023-12-19T18:03:01.046041+0000","last_clean":"2023-12-19T18:03:01.046041+0000","last_became_active":"2023-12-19T18:03:01.041293+0000","last_became_peered":"2023-12-19T18:03:01.041293+0000","last_unstale":"2023-12-19T18:03:01.046041+0000","last_undegraded":"2023-12-19T18:03:01.046041+0000","last_fullsized":"2023-12-19T18:03:01.046041+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:54.430060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027170+0000","last_change":"2023-12-19T18:03:01.027170+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027170+0000","last_undegraded":"2023-12-19T18:03:01.027170+0000","last_fullsized":"2023-12-19T18:03:01.027170+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046614+0000","last_change":"2023-12-19T18:03:01.043501+0000","last_active":"2023-12-19T18:03:01.046614+0000","last_peered":"2023-12-19T18:03:01.046614+0000","last_clean":"2023-12-19T18:03:01.046614+0000","last_became_active":"2023-12-19T18:03:01.042962+0000","last_became_peered":"2023-12-19T18:03:01.042962+0000","last_unstale":"2023-12-19T18:03:01.046614+0000","last_undegraded":"2023-12-19T18:03:01.046614+0000","last_fullsized":"2023-12-19T18:03:01.046614+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.030725+0000","last_change":"2023-12-19T18:03:01.030725+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.030725+0000","last_undegraded":"2023-12-19T18:03:01.030725+0000","last_fullsized":"2023-12-19T18:03:01.030725+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047422+0000","last_change":"2023-12-19T18:03:01.044609+0000","last_active":"2023-12-19T18:03:01.047422+0000","last_peered":"2023-12-19T18:03:01.047422+0000","last_clean":"2023-12-19T18:03:01.047422+0000","last_became_active":"2023-12-19T18:03:01.044346+0000","last_became_peered":"2023-12-19T18:03:01.044346+0000","last_unstale":"2023-12-19T18:03:01.047422+0000","last_undegraded":"2023-12-19T18:03:01.047422+0000","last_fullsized":"2023-12-19T18:03:01.047422+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022657+0000","last_change":"2023-12-19T18:03:01.022657+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022657+0000","last_undegraded":"2023-12-19T18:03:01.022657+0000","last_fullsized":"2023-12-19T18:03:01.022657+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:48.707978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.041935+0000","last_change":"2023-12-19T18:03:01.037450+0000","last_active":"2023-12-19T18:03:01.041935+0000","last_peered":"2023-12-19T18:03:01.041935+0000","last_clean":"2023-12-19T18:03:01.041935+0000","last_became_active":"2023-12-19T18:03:01.037175+0000","last_became_peered":"2023-12-19T18:03:01.037175+0000","last_unstale":"2023-12-19T18:03:01.041935+0000","last_undegraded":"2023-12-19T18:03:01.041935+0000","last_fullsized":"2023-12-19T18:03:01.041935+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:54.253683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026832+0000","last_change":"2023-12-19T18:03:01.026832+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026832+0000","last_undegraded":"2023-12-19T18:03:01.026832+0000","last_fullsized":"2023-12-19T18:03:01.026832+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.047821+0000","last_change":"2023-12-19T18:03:01.046428+0000","last_active":"2023-12-19T18:03:01.047821+0000","last_peered":"2023-12-19T18:03:01.047821+0000","last_clean":"2023-12-19T18:03:01.047821+0000","last_became_active":"2023-12-19T18:03:01.046121+0000","last_became_peered":"2023-12-19T18:03:01.046121+0000","last_unstale":"2023-12-19T18:03:01.047821+0000","last_undegraded":"2023-12-19T18:03:01.047821+0000","last_fullsized":"2023-12-19T18:03:01.047821+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:12.408666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.024064+0000","last_change":"2023-12-19T18:03:01.024064+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.024064+0000","last_undegraded":"2023-12-19T18:03:01.024064+0000","last_fullsized":"2023-12-19T18:03:01.024064+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:35.371295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.041729+0000","last_change":"2023-12-19T18:03:01.039131+0000","last_active":"2023-12-19T18:03:01.041729+0000","last_peered":"2023-12-19T18:03:01.041729+0000","last_clean":"2023-12-19T18:03:01.041729+0000","last_became_active":"2023-12-19T18:03:01.038734+0000","last_became_peered":"2023-12-19T18:03:01.038734+0000","last_unstale":"2023-12-19T18:03:01.041729+0000","last_undegraded":"2023-12-19T18:03:01.041729+0000","last_fullsized":"2023-12-19T18:03:01.041729+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:46.564642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027977+0000","last_change":"2023-12-19T18:03:01.027977+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027977+0000","last_undegraded":"2023-12-19T18:03:01.027977+0000","last_fullsized":"2023-12-19T18:03:01.027977+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:49.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.042560+0000","last_change":"2023-12-19T18:03:01.040136+0000","last_active":"2023-12-19T18:03:01.042560+0000","last_peered":"2023-12-19T18:03:01.042560+0000","last_clean":"2023-12-19T18:03:01.042560+0000","last_became_active":"2023-12-19T18:03:01.039868+0000","last_became_peered":"2023-12-19T18:03:01.039868+0000","last_unstale":"2023-12-19T18:03:01.042560+0000","last_undegraded":"2023-12-19T18:03:01.042560+0000","last_fullsized":"2023-12-19T18:03:01.042560+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:40.552341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026723+0000","last_change":"2023-12-19T18:03:01.026723+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026723+0000","last_undegraded":"2023-12-19T18:03:01.026723+0000","last_fullsized":"2023-12-19T18:03:01.026723+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:34.035010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046060+0000","last_change":"2023-12-19T18:03:01.042852+0000","last_active":"2023-12-19T18:03:01.046060+0000","last_peered":"2023-12-19T18:03:01.046060+0000","last_clean":"2023-12-19T18:03:01.046060+0000","last_became_active":"2023-12-19T18:03:01.042591+0000","last_became_peered":"2023-12-19T18:03:01.042591+0000","last_unstale":"2023-12-19T18:03:01.046060+0000","last_undegraded":"2023-12-19T18:03:01.046060+0000","last_fullsized":"2023-12-19T18:03:01.046060+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:36.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.026761+0000","last_change":"2023-12-19T18:03:01.026761+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.026761+0000","last_undegraded":"2023-12-19T18:03:01.026761+0000","last_fullsized":"2023-12-19T18:03:01.026761+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045431+0000","last_change":"2023-12-19T18:03:01.042245+0000","last_active":"2023-12-19T18:03:01.045431+0000","last_peered":"2023-12-19T18:03:01.045431+0000","last_clean":"2023-12-19T18:03:01.045431+0000","last_became_active":"2023-12-19T18:03:01.041594+0000","last_became_peered":"2023-12-19T18:03:01.041594+0000","last_unstale":"2023-12-19T18:03:01.045431+0000","last_undegraded":"2023-12-19T18:03:01.045431+0000","last_fullsized":"2023-12-19T18:03:01.045431+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:47.506271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023812+0000","last_change":"2023-12-19T18:03:01.023812+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023812+0000","last_undegraded":"2023-12-19T18:03:01.023812+0000","last_fullsized":"2023-12-19T18:03:01.023812+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:09.235125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045652+0000","last_change":"2023-12-19T18:03:01.043296+0000","last_active":"2023-12-19T18:03:01.045652+0000","last_peered":"2023-12-19T18:03:01.045652+0000","last_clean":"2023-12-19T18:03:01.045652+0000","last_became_active":"2023-12-19T18:03:01.040391+0000","last_became_peered":"2023-12-19T18:03:01.040391+0000","last_unstale":"2023-12-19T18:03:01.045652+0000","last_undegraded":"2023-12-19T18:03:01.045652+0000","last_fullsized":"2023-12-19T18:03:01.045652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:48.320418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022921+0000","last_change":"2023-12-19T18:03:01.022921+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022921+0000","last_undegraded":"2023-12-19T18:03:01.022921+0000","last_fullsized":"2023-12-19T18:03:01.022921+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.039770+0000","last_change":"2023-12-19T18:03:01.036153+0000","last_active":"2023-12-19T18:03:01.039770+0000","last_peered":"2023-12-19T18:03:01.039770+0000","last_clean":"2023-12-19T18:03:01.039770+0000","last_became_active":"2023-12-19T18:03:01.035798+0000","last_became_peered":"2023-12-19T18:03:01.035798+0000","last_unstale":"2023-12-19T18:03:01.039770+0000","last_undegraded":"2023-12-19T18:03:01.039770+0000","last_fullsized":"2023-12-19T18:03:01.039770+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:43.399399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022219+0000","last_change":"2023-12-19T18:03:01.022219+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022219+0000","last_undegraded":"2023-12-19T18:03:01.022219+0000","last_fullsized":"2023-12-19T18:03:01.022219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:22.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.046608+0000","last_change":"2023-12-19T18:03:01.044483+0000","last_active":"2023-12-19T18:03:01.046608+0000","last_peered":"2023-12-19T18:03:01.046608+0000","last_clean":"2023-12-19T18:03:01.046608+0000","last_became_active":"2023-12-19T18:03:01.043913+0000","last_became_peered":"2023-12-19T18:03:01.043913+0000","last_unstale":"2023-12-19T18:03:01.046608+0000","last_undegraded":"2023-12-19T18:03:01.046608+0000","last_fullsized":"2023-12-19T18:03:01.046608+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.028633+0000","last_change":"2023-12-19T18:03:01.028633+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.028633+0000","last_undegraded":"2023-12-19T18:03:01.028633+0000","last_fullsized":"2023-12-19T18:03:01.028633+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044761+0000","last_change":"2023-12-19T18:03:01.041437+0000","last_active":"2023-12-19T18:03:01.044761+0000","last_peered":"2023-12-19T18:03:01.044761+0000","last_clean":"2023-12-19T18:03:01.044761+0000","last_became_active":"2023-12-19T18:03:01.041139+0000","last_became_peered":"2023-12-19T18:03:01.041139+0000","last_unstale":"2023-12-19T18:03:01.044761+0000","last_undegraded":"2023-12-19T18:03:01.044761+0000","last_fullsized":"2023-12-19T18:03:01.044761+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:01.261039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.023519+0000","last_change":"2023-12-19T18:03:01.023519+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.023519+0000","last_undegraded":"2023-12-19T18:03:01.023519+0000","last_fullsized":"2023-12-19T18:03:01.023519+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:32:20.489876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.050404+0000","last_change":"2023-12-19T18:03:01.049301+0000","last_active":"2023-12-19T18:03:01.050404+0000","last_peered":"2023-12-19T18:03:01.050404+0000","last_clean":"2023-12-19T18:03:01.050404+0000","last_became_active":"2023-12-19T18:03:01.048995+0000","last_became_peered":"2023-12-19T18:03:01.048995+0000","last_unstale":"2023-12-19T18:03:01.050404+0000","last_undegraded":"2023-12-19T18:03:01.050404+0000","last_fullsized":"2023-12-19T18:03:01.050404+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.027469+0000","last_change":"2023-12-19T18:03:01.027469+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.027469+0000","last_undegraded":"2023-12-19T18:03:01.027469+0000","last_fullsized":"2023-12-19T18:03:01.027469+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:26.073083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.045027+0000","last_change":"2023-12-19T18:03:01.042324+0000","last_active":"2023-12-19T18:03:01.045027+0000","last_peered":"2023-12-19T18:03:01.045027+0000","last_clean":"2023-12-19T18:03:01.045027+0000","last_became_active":"2023-12-19T18:03:01.041724+0000","last_became_peered":"2023-12-19T18:03:01.041724+0000","last_unstale":"2023-12-19T18:03:01.045027+0000","last_undegraded":"2023-12-19T18:03:01.045027+0000","last_fullsized":"2023-12-19T18:03:01.045027+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:41:28.074168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022705+0000","last_change":"2023-12-19T18:03:01.022705+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022705+0000","last_undegraded":"2023-12-19T18:03:01.022705+0000","last_fullsized":"2023-12-19T18:03:01.022705+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:43.324973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.044526+0000","last_change":"2023-12-19T18:03:01.041166+0000","last_active":"2023-12-19T18:03:01.044526+0000","last_peered":"2023-12-19T18:03:01.044526+0000","last_clean":"2023-12-19T18:03:01.044526+0000","last_became_active":"2023-12-19T18:03:01.039307+0000","last_became_peered":"2023-12-19T18:03:01.039307+0000","last_unstale":"2023-12-19T18:03:01.044526+0000","last_undegraded":"2023-12-19T18:03:01.044526+0000","last_fullsized":"2023-12-19T18:03:01.044526+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:26.463539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.022127+0000","last_change":"2023-12-19T18:03:01.022127+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.022127+0000","last_undegraded":"2023-12-19T18:03:01.022127+0000","last_fullsized":"2023-12-19T18:03:01.022127+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.041242+0000","last_change":"2023-12-19T18:03:01.036205+0000","last_active":"2023-12-19T18:03:01.041242+0000","last_peered":"2023-12-19T18:03:01.041242+0000","last_clean":"2023-12-19T18:03:01.041242+0000","last_became_active":"2023-12-19T18:03:01.035940+0000","last_became_peered":"2023-12-19T18:03:01.035940+0000","last_unstale":"2023-12-19T18:03:01.041242+0000","last_undegraded":"2023-12-19T18:03:01.041242+0000","last_fullsized":"2023-12-19T18:03:01.041242+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:11.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":1,"reported_epoch":127,"state":"creating+peering","last_fresh":"2023-12-19T18:03:01.021583+0000","last_change":"2023-12-19T18:03:01.021583+0000","last_active":"2023-12-19T18:03:01.001712+0000","last_peered":"2023-12-19T18:03:01.001712+0000","last_clean":"2023-12-19T18:03:01.001712+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-19T18:03:01.021583+0000","last_undegraded":"2023-12-19T18:03:01.021583+0000","last_fullsized":"2023-12-19T18:03:01.021583+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:45.843330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":127,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.039393+0000","last_change":"2023-12-19T18:03:01.036635+0000","last_active":"2023-12-19T18:03:01.039393+0000","last_peered":"2023-12-19T18:03:01.039393+0000","last_clean":"2023-12-19T18:03:01.039393+0000","last_became_active":"2023-12-19T18:03:01.036255+0000","last_became_peered":"2023-12-19T18:03:01.036255+0000","last_unstale":"2023-12-19T18:03:01.039393+0000","last_undegraded":"2023-12-19T18:03:01.039393+0000","last_fullsized":"2023-12-19T18:03:01.039393+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:44.837666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":276,"reported_epoch":126,"state":"active+clean","last_fresh":"2023-12-19T18:03:00.015797+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:03:00.015797+0000","last_peered":"2023-12-19T18:03:00.015797+0000","last_clean":"2023-12-19T18:03:00.015797+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:03:00.015797+0000","last_undegraded":"2023-12-19T18:03:00.015797+0000","last_fullsized":"2023-12-19T18:03:00.015797+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574989,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33160,"kb_used_data":2112,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338680,"statfs":{"total":96636764160,"available":96602808320,"internally_reserved":0,"allocated":2162688,"data_stored":1353154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2150000000000001,"15min":1.117},"min":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.8959999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.1220000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.276,"15min":1.179},"min":{"1min":0.747,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4770000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.21}]},{"osd":1,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.175,"15min":1.1040000000000001},"min":{"1min":0.63400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.444,"5min":12.625,"15min":12.625},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.169,"15min":1.1379999999999999},"min":{"1min":0.752,"5min":0.60899999999999999,"15min":0.52600000000000002},"max":{"1min":1.3540000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.873}]},{"osd":2,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1839999999999999,"15min":1.097},"min":{"1min":0.84499999999999997,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":1.371,"5min":13.041,"15min":13.041},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.587,"15min":1.288},"min":{"1min":0.86499999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.431,"5min":48.889000000000003,"15min":48.889000000000003},"last":0.74199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.26,"15min":1.171},"min":{"1min":0.82799999999999996,"5min":0.67100000000000004,"15min":0.51600000000000001},"max":{"1min":1.409,"5min":12.917,"15min":12.917},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":1.083,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5860000000000001,"5min":46.375,"15min":46.375},"last":0.92200000000000004}]},{"osd":4,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.601,"5min":13.137,"15min":13.137},"last":1.002},{"interface":"front","average":{"1min":1.238,"5min":1.3640000000000001,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4810000000000001,"5min":13.109,"15min":13.109},"last":1.165}]},{"osd":5,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.29,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.492,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3069999999999999,"15min":1.286},"min":{"1min":0.89200000000000002,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":1.522,"5min":13.198,"15min":13.198},"last":1.0800000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.478,"15min":1.4179999999999999},"min":{"1min":0.98299999999999998,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":1.675,"5min":13.442,"15min":13.442},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4199999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.792,"5min":13.981,"15min":13.981},"last":1.605}]}]},{"osd":6,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":762786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.997,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.381,"5min":1.399,"15min":4.5979999999999999},"last":1.268},{"interface":"front","average":{"1min":1.103,"5min":1.04,"15min":1.0740000000000001},"min":{"1min":0.755,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4490000000000001,"5min":1.756,"15min":1.756},"last":0.71099999999999997}]},{"osd":1,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.0900000000000001},"min":{"1min":0.70499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.111},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.415,"5min":1.583,"15min":1.621},"last":1.083}]},{"osd":2,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.131,"15min":1.282},"min":{"1min":0.94699999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.1890000000000001,"15min":1.2170000000000001},"min":{"1min":0.90900000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.673,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.0389999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.2490000000000001},"min":{"1min":0.91200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5529999999999999,"5min":1.651,"15min":4.5380000000000003},"last":1.1990000000000001},{"interface":"front","average":{"1min":1.248,"5min":1.218,"15min":1.29},"min":{"1min":0.83099999999999996,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":4.508},"last":1.4179999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.149,"15min":1.137},"min":{"1min":0.76000000000000001,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.5129999999999999,"5min":1.577,"15min":1.8360000000000001},"last":1.163},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2290000000000001,"15min":1.2390000000000001},"min":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.579,"5min":1.802,"15min":1.899},"last":1.4950000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2569999999999999,"15min":1.2589999999999999},"min":{"1min":0.89400000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.329},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2729999999999999,"15min":1.2689999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.724,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.4470000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.857,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3640000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.385,"15min":1.395},"min":{"1min":1.056,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.827,"5min":1.841,"15min":2.2440000000000002},"last":1.482}]}]},{"osd":5,"up_from":13,"seq":55834574990,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":769381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5109999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.0860000000000001},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.60599999999999998},"max":{"1min":1.409,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.3460000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.135,"15min":1.113},"min":{"1min":0.78700000000000003,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.3540000000000001,"5min":1.974,"15min":1.974},"last":1.1519999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.145,"15min":1.179},"min":{"1min":0.77700000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.399,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.7709999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.891,"15min":2.9929999999999999},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.3720000000000001,"5min":2.024,"15min":2.024},"last":1.4199999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.482,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.25,"15min":1.3120000000000001},"min":{"1min":1.079,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.536,"5min":1.829,"15min":3.0350000000000001},"last":1.4590000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1890000000000001,"15min":1.244},"min":{"1min":0.79800000000000004,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.4650000000000001,"5min":3.633,"15min":3.633},"last":1.681},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":1.1830000000000001,"5min":0.78600000000000003,"15min":0.745},"max":{"1min":1.5600000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.9370000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.323},"min":{"1min":1.0429999999999999,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.609,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.7310000000000001},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.3029999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.802}]},{"osd":7,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3180000000000001,"15min":1.411},"min":{"1min":0.85899999999999999,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.9279999999999999,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.992},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3759999999999999,"15min":1.4870000000000001},"min":{"1min":1.0429999999999999,"5min":0.98099999999999998,"15min":0.82499999999999996},"max":{"1min":1.7350000000000001,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.895}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":762786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.077,"15min":1.1739999999999999},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.458,"5min":1.556,"15min":5.4420000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.24,"5min":1.1890000000000001,"15min":1.252},"min":{"1min":0.90400000000000003,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.53,"5min":1.657,"15min":5.5049999999999999},"last":1.0509999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1100000000000001,"15min":1.181},"min":{"1min":0.83199999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.5580000000000001,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.161},"min":{"1min":0.85699999999999998,"5min":0.70999999999999996,"15min":0.66000000000000003},"max":{"1min":1.4319999999999999,"5min":1.5589999999999999,"15min":3.254},"last":1.1599999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.1970000000000001},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.4850000000000001,"5min":1.623,"15min":4.593},"last":0.879},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.173,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.454,"5min":1.871,"15min":2.3799999999999999},"last":1.2070000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1220000000000001,"15min":1.2070000000000001},"min":{"1min":0.90000000000000002,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.3939999999999999,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.266,"5min":1.2110000000000001,"15min":1.3160000000000001},"min":{"1min":0.93700000000000006,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5409999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.2569999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.88600000000000001,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.502,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.3460000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.306}]},{"osd":6,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2350000000000001,"15min":1.252},"min":{"1min":0.872,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.5609999999999999,"5min":1.6910000000000001,"15min":2.915},"last":1.117},{"interface":"front","average":{"1min":1.409,"5min":1.4019999999999999,"15min":1.4039999999999999},"min":{"1min":1.266,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6200000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.411}]},{"osd":7,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.296,"15min":1.306},"min":{"1min":0.99299999999999999,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.556,"5min":1.907,"15min":2.4340000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.369},"min":{"1min":1.0600000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7,"5min":1.833,"15min":5.6859999999999999},"last":1.389}]}]},{"osd":3,"up_from":13,"seq":55834574991,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1532,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1568768,"data_stored":762786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.874},"min":{"1min":0.61399999999999999,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":1.329,"5min":1.6599999999999999,"15min":1.825},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.92100000000000004},"min":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.435},"max":{"1min":1.6299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3859999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":1.163,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.80900000000000005,"5min":0.311,"15min":0.311},"max":{"1min":1.6180000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.65900000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5680000000000001,"5min":1.679,"15min":2.177},"last":0.79600000000000004},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.1599999999999999,"15min":1.2010000000000001},"min":{"1min":0.71599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.8520000000000001},"last":0.85799999999999998}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1599999999999999,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7070000000000001,"5min":1.7310000000000001,"15min":2.234},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3109999999999999,"15min":1.302},"min":{"1min":0.873,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.591,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":0.73299999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3340000000000001,"15min":1.369},"min":{"1min":1.0129999999999999,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":1.964,"5min":2.0699999999999998,"15min":2.5419999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2729999999999999,"15min":1.3149999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.74299999999999999},"max":{"1min":1.5740000000000001,"5min":1.776,"15min":2.754},"last":0.52500000000000002}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.345,"15min":1.379},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6859999999999999,"5min":1.946,"15min":2.6880000000000002},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.504,"5min":1.411,"15min":1.444},"min":{"1min":0.98499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.8089999999999999,"5min":2.274,"15min":2.6429999999999998},"last":0.90700000000000003}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.351,"15min":1.3999999999999999},"min":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.77700000000000002},"max":{"1min":1.7909999999999999,"5min":1.9730000000000001,"15min":3.02},"last":0.57799999999999996},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4279999999999999,"15min":1.4630000000000001},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.83099999999999996},"max":{"1min":1.7809999999999999,"5min":2.323,"15min":2.8170000000000002},"last":0.88300000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574990,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":769381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91900000000000004,"15min":1.119},"min":{"1min":0.65600000000000003,"5min":0.497,"15min":0.29599999999999999},"max":{"1min":1.4710000000000001,"5min":3.9209999999999998,"15min":13.32},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":1.222},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":3.8149999999999999,"15min":13.206},"last":1.022}]},{"osd":1,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93799999999999994,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.4079999999999999,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.70299999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.653,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.129}]},{"osd":3,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92600000000000005,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.4610000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.1619999999999999,"15min":1.1890000000000001},"min":{"1min":0.89900000000000002,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.647,"5min":2.75,"15min":2.75},"last":0.78500000000000003}]},{"osd":4,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2490000000000001},"min":{"1min":1.01,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4339999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.278},"min":{"1min":1.0389999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.429,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.2669999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.218,"15min":1.264},"min":{"1min":0.874,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7110000000000001,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.21},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3380000000000001,"15min":1.403},"min":{"1min":1.008,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.571,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.3720000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.389},"min":{"1min":0.98799999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6359999999999999,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3109999999999999,"15min":1.3380000000000001},"min":{"1min":0.92600000000000005,"5min":0.872,"15min":0.872},"max":{"1min":1.6040000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.3320000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.92900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.766,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.95799999999999996,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7,"5min":5.375,"15min":5.375},"last":1.4430000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32592,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339248,"statfs":{"total":96636764160,"available":96603389952,"internally_reserved":0,"allocated":1581056,"data_stored":769381,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.72599999999999998,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.931},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.335,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":1.3240000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82499999999999996,"15min":0.91600000000000004},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1619999999999999,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.97599999999999998,"15min":1.0609999999999999},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.387,"5min":1.5580000000000001,"15min":3.4199999999999999},"last":1.631}]},{"osd":3,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.075,"15min":1.1819999999999999},"min":{"1min":0.751,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":3.4950000000000001},"last":1.159},{"interface":"front","average":{"1min":1,"5min":0.95499999999999996,"15min":1.0840000000000001},"min":{"1min":0.60299999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4279999999999999,"5min":1.55,"15min":4.2030000000000003},"last":1.21}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2789999999999999,"15min":1.345},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8779999999999999,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.4590000000000001},{"interface":"front","average":{"1min":1.226,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.56999999999999995},"max":{"1min":1.6299999999999999,"5min":1.681,"15min":2.6960000000000002},"last":1.506}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.296},"min":{"1min":0.93400000000000005,"5min":0.82999999999999996,"15min":0.69599999999999995},"max":{"1min":1.7130000000000001,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.91100000000000003,"5min":0.83299999999999996,"15min":0.69399999999999995},"max":{"1min":1.915,"5min":1.915,"15min":3.8420000000000001},"last":1.2529999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3240000000000001,"15min":1.4470000000000001},"min":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9930000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.333,"15min":1.4610000000000001},"min":{"1min":0.997,"5min":0.84499999999999997,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.917,"15min":3.214},"last":1.7350000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.359,"15min":1.5069999999999999},"min":{"1min":1.028,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":4.0910000000000002},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.359,"5min":1.337,"15min":1.452},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":4.6390000000000002},"last":1.7909999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574990,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33156,"kb_used_data":2108,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338684,"statfs":{"total":96636764160,"available":96602812416,"internally_reserved":0,"allocated":2158592,"data_stored":1352135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.94499999999999995},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.129,"5min":1.53,"15min":2.2250000000000001},"last":1.0700000000000001},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.94599999999999995,"15min":1.077},"min":{"1min":0.80500000000000005,"5min":0.505,"15min":0.499},"max":{"1min":1.4239999999999999,"5min":1.73,"15min":2.3599999999999999},"last":1.125}]},{"osd":2,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.89200000000000002,"15min":0.94399999999999995},"min":{"1min":0.57899999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2649999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.94199999999999995},"min":{"1min":0.64000000000000001,"5min":0.497,"15min":0.45300000000000001},"max":{"1min":1.1879999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.024}]},{"osd":3,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.69199999999999995,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.4630000000000001,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.151,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.609,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.214}]},{"osd":4,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2529999999999999,"15min":1.3200000000000001},"min":{"1min":0.86399999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6459999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.306,"5min":1.2629999999999999,"15min":1.333},"min":{"1min":0.92800000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.641,"5min":1.738,"15min":2.7799999999999998},"last":1.0940000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.2549999999999999},"min":{"1min":0.80800000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":1.758,"15min":2.0579999999999998},"last":1.367},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.891,"5min":1.891,"15min":2.0030000000000001},"last":1.1559999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":2.1000000000000001},"last":1.286},{"interface":"front","average":{"1min":1.304,"5min":1.266,"15min":1.373},"min":{"1min":0.97399999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7030000000000001,"5min":1.8300000000000001,"15min":2.3889999999999998},"last":1.2430000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.333,"15min":1.4870000000000001},"min":{"1min":1.131,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7829999999999999,"5min":1.9339999999999999,"15min":4.9400000000000004},"last":1.333},{"interface":"front","average":{"1min":1.367,"5min":1.3220000000000001,"15min":1.46},"min":{"1min":0.95099999999999996,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.8280000000000001,"5min":1.875,"15min":4.8250000000000002},"last":1.4379999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:03:06.453 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:03:06.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.661+0000 7f6f99ee5700 1 Processor -- start 2023-12-19T18:03:06.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.661+0000 7f6f99ee5700 1 -- start start 2023-12-19T18:03:06.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f94164a70 0x7f6f940cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f940cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f940cd8b0 con 0x7f6f94164690 2023-12-19T18:03:06.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f940cdb80 con 0x7f6f94164a70 2023-12-19T18:03:06.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940cde60 con 0x7f6f940c4510 2023-12-19T18:03:06.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f94164a70 0x7f6f940cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f6f94164a70 0x7f6f940cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47224/0 (socket says 172.21.15.45:47224) 2023-12-19T18:03:06.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 -- 172.21.15.45:0/1237388654 learned_addr learned my addr 172.21.15.45:0/1237388654 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:06.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f93fff700 1 --2- 172.21.15.45:0/1237388654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f940cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 -- 172.21.15.45:0/1237388654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 msgr2=0x7f6f940cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:06.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 --2- 172.21.15.45:0/1237388654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f940cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 -- 172.21.15.45:0/1237388654 >> v1:172.21.15.73:6789/0 conn(0x7f6f94164690 legacy=0x7f6f940c3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 -- 172.21.15.45:0/1237388654 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f940ce140 con 0x7f6f94164a70 2023-12-19T18:03:06.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f92ffd700 1 -- 172.21.15.45:0/1237388654 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491169330 0 0) 0x7f6f940cd8b0 con 0x7f6f94164690 2023-12-19T18:03:06.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f8affd700 1 --2- 172.21.15.45:0/1237388654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164a70 0x7f6f940cce30 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009910 tx=0x7f6f7c009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db7fce5bd99f1a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:06.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f92ffd700 1 -- 172.21.15.45:0/1237388654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011830 con 0x7f6f94164a70 2023-12-19T18:03:06.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f92ffd700 1 -- 172.21.15.45:0/1237388654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c011990 con 0x7f6f94164a70 2023-12-19T18:03:06.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f92ffd700 1 -- 172.21.15.45:0/1237388654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c011d40 con 0x7f6f94164a70 2023-12-19T18:03:06.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 -- 172.21.15.45:0/1237388654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164a70 msgr2=0x7f6f940cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.665+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/1237388654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164a70 0x7f6f940cce30 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c009910 tx=0x7f6f7c009c20 comp rx=0 tx=0).stop 2023-12-19T18:03:06.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 -- 172.21.15.45:0/1237388654 shutdown_connections 2023-12-19T18:03:06.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/1237388654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f940cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/1237388654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164a70 0x7f6f940cce30 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 -- 172.21.15.45:0/1237388654 >> 172.21.15.45:0/1237388654 conn(0x7f6f940cba40 msgr2=0x7f6f940ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:06.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 -- 172.21.15.45:0/1237388654 shutdown_connections 2023-12-19T18:03:06.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 -- 172.21.15.45:0/1237388654 wait complete. 2023-12-19T18:03:06.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 Processor -- start 2023-12-19T18:03:06.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.669+0000 7f6f99ee5700 1 -- start start 2023-12-19T18:03:06.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f99ee5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f94162b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f99ee5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 0x7f6f940b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f99ee5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f94164a70 0x7f6f941f9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f99ee5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940b2c60 con 0x7f6f94164690 2023-12-19T18:03:06.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f99ee5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f940b3080 con 0x7f6f94164a70 2023-12-19T18:03:06.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f99ee5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f94163060 con 0x7f6f940c4510 2023-12-19T18:03:06.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 0x7f6f940b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 0x7f6f940b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47232/0 (socket says 172.21.15.45:47232) 2023-12-19T18:03:06.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 -- 172.21.15.45:0/2833245030 learned_addr learned my addr 172.21.15.45:0/2833245030 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f937fe700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f94162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f93fff700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f94164a70 0x7f6f941f9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 -- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 msgr2=0x7f6f94162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f94162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 -- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f94164a70 msgr2=0x7f6f941f9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f94164a70 0x7f6f941f9e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 -- 172.21.15.45:0/2833245030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7c009570 con 0x7f6f94164690 2023-12-19T18:03:06.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.673+0000 7f6f8affd700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 0x7f6f940b1690 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6f940b1660 tx=0x7f6f7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:06.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c01a8f0 con 0x7f6f94164690 2023-12-19T18:03:06.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c01e070 con 0x7f6f94164690 2023-12-19T18:03:06.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f940b2040 con 0x7f6f94164690 2023-12-19T18:03:06.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c01acb0 con 0x7f6f94164690 2023-12-19T18:03:06.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f940b2880 con 0x7f6f94164690 2023-12-19T18:03:06.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f941504e0 con 0x7f6f94164690 2023-12-19T18:03:06.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.677+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6f7c024400 con 0x7f6f94164690 2023-12-19T18:03:06.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.681+0000 7f6f90ff9700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f74065ad0 0x7f6f74067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:06.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.681+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f6f7c0842b0 con 0x7f6f94164690 2023-12-19T18:03:06.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.681+0000 7f6f937fe700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f74065ad0 0x7f6f74067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:06.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.681+0000 7f6f937fe700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f74065ad0 0x7f6f74067f90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f84007fd0 tx=0x7f6f84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:06.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.689+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f6f7c051aa0 con 0x7f6f94164690 2023-12-19T18:03:06.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.877+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6f940ce420 con 0x7f6f74065ad0 2023-12-19T18:03:06.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.885+0000 7f6f90ff9700 1 -- 172.21.15.45:0/2833245030 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287033 (secure 0 0 0) 0x7f6f840015d0 con 0x7f6f74065ad0 2023-12-19T18:03:06.895 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:06.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f74065ad0 msgr2=0x7f6f74067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f74065ad0 0x7f6f74067f90 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f6f84007fd0 tx=0x7f6f84009040 comp rx=0 tx=0).stop 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 msgr2=0x7f6f940b1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 0x7f6f940b1690 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6f940b1660 tx=0x7f6f7c004770 comp rx=0 tx=0).stop 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 shutdown_connections 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6f74065ad0 0x7f6f74067f90 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6f94164a70 0x7f6f941f9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6f94164690 0x7f6f940b1690 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 --2- 172.21.15.45:0/2833245030 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6f940c4510 0x7f6f94162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.889+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 >> 172.21.15.45:0/2833245030 conn(0x7f6f940cba40 msgr2=0x7f6f940710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.893+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 shutdown_connections 2023-12-19T18:03:06.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:06.893+0000 7f6f99ee5700 1 -- 172.21.15.45:0/2833245030 wait complete. 2023-12-19T18:03:06.899 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:03:06.917 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2023-12-19T18:03:06.452063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262148,"kb_used_data":13764,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754712572,"statfs":{"total":773094113280,"available":772825673728,"internally_reserved":0,"allocated":14094336,"data_stored":7449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001882"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530724+0000","last_change":"2023-12-19T18:03:01.528559+0000","last_active":"2023-12-19T18:03:01.530724+0000","last_peered":"2023-12-19T18:03:01.530724+0000","last_clean":"2023-12-19T18:03:01.530724+0000","last_became_active":"2023-12-19T18:03:01.528053+0000","last_became_peered":"2023-12-19T18:03:01.528053+0000","last_unstale":"2023-12-19T18:03:01.530724+0000","last_undegraded":"2023-12-19T18:03:01.530724+0000","last_fullsized":"2023-12-19T18:03:01.530724+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528837+0000","last_change":"2023-12-19T18:03:01.515763+0000","last_active":"2023-12-19T18:03:01.528837+0000","last_peered":"2023-12-19T18:03:01.528837+0000","last_clean":"2023-12-19T18:03:01.528837+0000","last_became_active":"2023-12-19T18:03:01.515391+0000","last_became_peered":"2023-12-19T18:03:01.515391+0000","last_unstale":"2023-12-19T18:03:01.528837+0000","last_undegraded":"2023-12-19T18:03:01.528837+0000","last_fullsized":"2023-12-19T18:03:01.528837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:53.820748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529918+0000","last_change":"2023-12-19T18:03:01.522348+0000","last_active":"2023-12-19T18:03:01.529918+0000","last_peered":"2023-12-19T18:03:01.529918+0000","last_clean":"2023-12-19T18:03:01.529918+0000","last_became_active":"2023-12-19T18:03:01.522042+0000","last_became_peered":"2023-12-19T18:03:01.522042+0000","last_unstale":"2023-12-19T18:03:01.529918+0000","last_undegraded":"2023-12-19T18:03:01.529918+0000","last_fullsized":"2023-12-19T18:03:01.529918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:49.326082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522604+0000","last_change":"2023-12-19T18:03:01.513678+0000","last_active":"2023-12-19T18:03:01.522604+0000","last_peered":"2023-12-19T18:03:01.522604+0000","last_clean":"2023-12-19T18:03:01.522604+0000","last_became_active":"2023-12-19T18:03:01.513401+0000","last_became_peered":"2023-12-19T18:03:01.513401+0000","last_unstale":"2023-12-19T18:03:01.522604+0000","last_undegraded":"2023-12-19T18:03:01.522604+0000","last_fullsized":"2023-12-19T18:03:01.522604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:09:24.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527137+0000","last_change":"2023-12-19T18:03:01.518794+0000","last_active":"2023-12-19T18:03:01.527137+0000","last_peered":"2023-12-19T18:03:01.527137+0000","last_clean":"2023-12-19T18:03:01.527137+0000","last_became_active":"2023-12-19T18:03:01.518534+0000","last_became_peered":"2023-12-19T18:03:01.518534+0000","last_unstale":"2023-12-19T18:03:01.527137+0000","last_undegraded":"2023-12-19T18:03:01.527137+0000","last_fullsized":"2023-12-19T18:03:01.527137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.520219+0000","last_change":"2023-12-19T18:03:01.515271+0000","last_active":"2023-12-19T18:03:01.520219+0000","last_peered":"2023-12-19T18:03:01.520219+0000","last_clean":"2023-12-19T18:03:01.520219+0000","last_became_active":"2023-12-19T18:03:01.515009+0000","last_became_peered":"2023-12-19T18:03:01.515009+0000","last_unstale":"2023-12-19T18:03:01.520219+0000","last_undegraded":"2023-12-19T18:03:01.520219+0000","last_fullsized":"2023-12-19T18:03:01.520219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:26:31.507606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527771+0000","last_change":"2023-12-19T18:03:01.522171+0000","last_active":"2023-12-19T18:03:01.527771+0000","last_peered":"2023-12-19T18:03:01.527771+0000","last_clean":"2023-12-19T18:03:01.527771+0000","last_became_active":"2023-12-19T18:03:01.521093+0000","last_became_peered":"2023-12-19T18:03:01.521093+0000","last_unstale":"2023-12-19T18:03:01.527771+0000","last_undegraded":"2023-12-19T18:03:01.527771+0000","last_fullsized":"2023-12-19T18:03:01.527771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.842744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530628+0000","last_change":"2023-12-19T18:03:01.524263+0000","last_active":"2023-12-19T18:03:01.530628+0000","last_peered":"2023-12-19T18:03:01.530628+0000","last_clean":"2023-12-19T18:03:01.530628+0000","last_became_active":"2023-12-19T18:03:01.523901+0000","last_became_peered":"2023-12-19T18:03:01.523901+0000","last_unstale":"2023-12-19T18:03:01.530628+0000","last_undegraded":"2023-12-19T18:03:01.530628+0000","last_fullsized":"2023-12-19T18:03:01.530628+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:47.570305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.517954+0000","last_change":"2023-12-19T18:03:01.510715+0000","last_active":"2023-12-19T18:03:01.517954+0000","last_peered":"2023-12-19T18:03:01.517954+0000","last_clean":"2023-12-19T18:03:01.517954+0000","last_became_active":"2023-12-19T18:03:01.510278+0000","last_became_peered":"2023-12-19T18:03:01.510278+0000","last_unstale":"2023-12-19T18:03:01.517954+0000","last_undegraded":"2023-12-19T18:03:01.517954+0000","last_fullsized":"2023-12-19T18:03:01.517954+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:05.296698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529865+0000","last_change":"2023-12-19T18:03:01.525079+0000","last_active":"2023-12-19T18:03:01.529865+0000","last_peered":"2023-12-19T18:03:01.529865+0000","last_clean":"2023-12-19T18:03:01.529865+0000","last_became_active":"2023-12-19T18:03:01.524733+0000","last_became_peered":"2023-12-19T18:03:01.524733+0000","last_unstale":"2023-12-19T18:03:01.529865+0000","last_undegraded":"2023-12-19T18:03:01.529865+0000","last_fullsized":"2023-12-19T18:03:01.529865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524580+0000","last_change":"2023-12-19T18:03:01.516482+0000","last_active":"2023-12-19T18:03:01.524580+0000","last_peered":"2023-12-19T18:03:01.524580+0000","last_clean":"2023-12-19T18:03:01.524580+0000","last_became_active":"2023-12-19T18:03:01.516203+0000","last_became_peered":"2023-12-19T18:03:01.516203+0000","last_unstale":"2023-12-19T18:03:01.524580+0000","last_undegraded":"2023-12-19T18:03:01.524580+0000","last_fullsized":"2023-12-19T18:03:01.524580+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527320+0000","last_change":"2023-12-19T18:03:01.520729+0000","last_active":"2023-12-19T18:03:01.527320+0000","last_peered":"2023-12-19T18:03:01.527320+0000","last_clean":"2023-12-19T18:03:01.527320+0000","last_became_active":"2023-12-19T18:03:01.520331+0000","last_became_peered":"2023-12-19T18:03:01.520331+0000","last_unstale":"2023-12-19T18:03:01.527320+0000","last_undegraded":"2023-12-19T18:03:01.527320+0000","last_fullsized":"2023-12-19T18:03:01.527320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:36.056772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529261+0000","last_change":"2023-12-19T18:03:01.522128+0000","last_active":"2023-12-19T18:03:01.529261+0000","last_peered":"2023-12-19T18:03:01.529261+0000","last_clean":"2023-12-19T18:03:01.529261+0000","last_became_active":"2023-12-19T18:03:01.521849+0000","last_became_peered":"2023-12-19T18:03:01.521849+0000","last_unstale":"2023-12-19T18:03:01.529261+0000","last_undegraded":"2023-12-19T18:03:01.529261+0000","last_fullsized":"2023-12-19T18:03:01.529261+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529831+0000","last_change":"2023-12-19T18:03:01.521821+0000","last_active":"2023-12-19T18:03:01.529831+0000","last_peered":"2023-12-19T18:03:01.529831+0000","last_clean":"2023-12-19T18:03:01.529831+0000","last_became_active":"2023-12-19T18:03:01.521471+0000","last_became_peered":"2023-12-19T18:03:01.521471+0000","last_unstale":"2023-12-19T18:03:01.529831+0000","last_undegraded":"2023-12-19T18:03:01.529831+0000","last_fullsized":"2023-12-19T18:03:01.529831+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:24.463386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524214+0000","last_change":"2023-12-19T18:03:01.514815+0000","last_active":"2023-12-19T18:03:01.524214+0000","last_peered":"2023-12-19T18:03:01.524214+0000","last_clean":"2023-12-19T18:03:01.524214+0000","last_became_active":"2023-12-19T18:03:01.514537+0000","last_became_peered":"2023-12-19T18:03:01.514537+0000","last_unstale":"2023-12-19T18:03:01.524214+0000","last_undegraded":"2023-12-19T18:03:01.524214+0000","last_fullsized":"2023-12-19T18:03:01.524214+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522052+0000","last_change":"2023-12-19T18:03:01.515786+0000","last_active":"2023-12-19T18:03:01.522052+0000","last_peered":"2023-12-19T18:03:01.522052+0000","last_clean":"2023-12-19T18:03:01.522052+0000","last_became_active":"2023-12-19T18:03:01.515521+0000","last_became_peered":"2023-12-19T18:03:01.515521+0000","last_unstale":"2023-12-19T18:03:01.522052+0000","last_undegraded":"2023-12-19T18:03:01.522052+0000","last_fullsized":"2023-12-19T18:03:01.522052+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:12.676472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529583+0000","last_change":"2023-12-19T18:03:01.522484+0000","last_active":"2023-12-19T18:03:01.529583+0000","last_peered":"2023-12-19T18:03:01.529583+0000","last_clean":"2023-12-19T18:03:01.529583+0000","last_became_active":"2023-12-19T18:03:01.522110+0000","last_became_peered":"2023-12-19T18:03:01.522110+0000","last_unstale":"2023-12-19T18:03:01.529583+0000","last_undegraded":"2023-12-19T18:03:01.529583+0000","last_fullsized":"2023-12-19T18:03:01.529583+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528270+0000","last_change":"2023-12-19T18:03:01.510928+0000","last_active":"2023-12-19T18:03:01.528270+0000","last_peered":"2023-12-19T18:03:01.528270+0000","last_clean":"2023-12-19T18:03:01.528270+0000","last_became_active":"2023-12-19T18:03:01.510469+0000","last_became_peered":"2023-12-19T18:03:01.510469+0000","last_unstale":"2023-12-19T18:03:01.528270+0000","last_undegraded":"2023-12-19T18:03:01.528270+0000","last_fullsized":"2023-12-19T18:03:01.528270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:10.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526108+0000","last_change":"2023-12-19T18:03:01.522447+0000","last_active":"2023-12-19T18:03:01.526108+0000","last_peered":"2023-12-19T18:03:01.526108+0000","last_clean":"2023-12-19T18:03:01.526108+0000","last_became_active":"2023-12-19T18:03:01.521599+0000","last_became_peered":"2023-12-19T18:03:01.521599+0000","last_unstale":"2023-12-19T18:03:01.526108+0000","last_undegraded":"2023-12-19T18:03:01.526108+0000","last_fullsized":"2023-12-19T18:03:01.526108+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525374+0000","last_change":"2023-12-19T18:03:01.513609+0000","last_active":"2023-12-19T18:03:01.525374+0000","last_peered":"2023-12-19T18:03:01.525374+0000","last_clean":"2023-12-19T18:03:01.525374+0000","last_became_active":"2023-12-19T18:03:01.513287+0000","last_became_peered":"2023-12-19T18:03:01.513287+0000","last_unstale":"2023-12-19T18:03:01.525374+0000","last_undegraded":"2023-12-19T18:03:01.525374+0000","last_fullsized":"2023-12-19T18:03:01.525374+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519969+0000","last_change":"2023-12-19T18:03:01.513578+0000","last_active":"2023-12-19T18:03:01.519969+0000","last_peered":"2023-12-19T18:03:01.519969+0000","last_clean":"2023-12-19T18:03:01.519969+0000","last_became_active":"2023-12-19T18:03:01.511971+0000","last_became_peered":"2023-12-19T18:03:01.511971+0000","last_unstale":"2023-12-19T18:03:01.519969+0000","last_undegraded":"2023-12-19T18:03:01.519969+0000","last_fullsized":"2023-12-19T18:03:01.519969+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:25.460640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524478+0000","last_change":"2023-12-19T18:03:01.514110+0000","last_active":"2023-12-19T18:03:01.524478+0000","last_peered":"2023-12-19T18:03:01.524478+0000","last_clean":"2023-12-19T18:03:01.524478+0000","last_became_active":"2023-12-19T18:03:01.513837+0000","last_became_peered":"2023-12-19T18:03:01.513837+0000","last_unstale":"2023-12-19T18:03:01.524478+0000","last_undegraded":"2023-12-19T18:03:01.524478+0000","last_fullsized":"2023-12-19T18:03:01.524478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.518191+0000","last_change":"2023-12-19T18:03:01.511423+0000","last_active":"2023-12-19T18:03:01.518191+0000","last_peered":"2023-12-19T18:03:01.518191+0000","last_clean":"2023-12-19T18:03:01.518191+0000","last_became_active":"2023-12-19T18:03:01.511160+0000","last_became_peered":"2023-12-19T18:03:01.511160+0000","last_unstale":"2023-12-19T18:03:01.518191+0000","last_undegraded":"2023-12-19T18:03:01.518191+0000","last_fullsized":"2023-12-19T18:03:01.518191+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:09:23.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528573+0000","last_change":"2023-12-19T18:03:01.522191+0000","last_active":"2023-12-19T18:03:01.528573+0000","last_peered":"2023-12-19T18:03:01.528573+0000","last_clean":"2023-12-19T18:03:01.528573+0000","last_became_active":"2023-12-19T18:03:01.521904+0000","last_became_peered":"2023-12-19T18:03:01.521904+0000","last_unstale":"2023-12-19T18:03:01.528573+0000","last_undegraded":"2023-12-19T18:03:01.528573+0000","last_fullsized":"2023-12-19T18:03:01.528573+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528541+0000","last_change":"2023-12-19T18:03:01.519293+0000","last_active":"2023-12-19T18:03:01.528541+0000","last_peered":"2023-12-19T18:03:01.528541+0000","last_clean":"2023-12-19T18:03:01.528541+0000","last_became_active":"2023-12-19T18:03:01.517195+0000","last_became_peered":"2023-12-19T18:03:01.517195+0000","last_unstale":"2023-12-19T18:03:01.528541+0000","last_undegraded":"2023-12-19T18:03:01.528541+0000","last_fullsized":"2023-12-19T18:03:01.528541+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530555+0000","last_change":"2023-12-19T18:03:01.527442+0000","last_active":"2023-12-19T18:03:01.530555+0000","last_peered":"2023-12-19T18:03:01.530555+0000","last_clean":"2023-12-19T18:03:01.530555+0000","last_became_active":"2023-12-19T18:03:01.527114+0000","last_became_peered":"2023-12-19T18:03:01.527114+0000","last_unstale":"2023-12-19T18:03:01.530555+0000","last_undegraded":"2023-12-19T18:03:01.530555+0000","last_fullsized":"2023-12-19T18:03:01.530555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521427+0000","last_change":"2023-12-19T18:03:01.511940+0000","last_active":"2023-12-19T18:03:01.521427+0000","last_peered":"2023-12-19T18:03:01.521427+0000","last_clean":"2023-12-19T18:03:01.521427+0000","last_became_active":"2023-12-19T18:03:01.510938+0000","last_became_peered":"2023-12-19T18:03:01.510938+0000","last_unstale":"2023-12-19T18:03:01.521427+0000","last_undegraded":"2023-12-19T18:03:01.521427+0000","last_fullsized":"2023-12-19T18:03:01.521427+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527301+0000","last_change":"2023-12-19T18:03:01.520569+0000","last_active":"2023-12-19T18:03:01.527301+0000","last_peered":"2023-12-19T18:03:01.527301+0000","last_clean":"2023-12-19T18:03:01.527301+0000","last_became_active":"2023-12-19T18:03:01.519863+0000","last_became_peered":"2023-12-19T18:03:01.519863+0000","last_unstale":"2023-12-19T18:03:01.527301+0000","last_undegraded":"2023-12-19T18:03:01.527301+0000","last_fullsized":"2023-12-19T18:03:01.527301+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:50.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525995+0000","last_change":"2023-12-19T18:03:01.511551+0000","last_active":"2023-12-19T18:03:01.525995+0000","last_peered":"2023-12-19T18:03:01.525995+0000","last_clean":"2023-12-19T18:03:01.525995+0000","last_became_active":"2023-12-19T18:03:01.511295+0000","last_became_peered":"2023-12-19T18:03:01.511295+0000","last_unstale":"2023-12-19T18:03:01.525995+0000","last_undegraded":"2023-12-19T18:03:01.525995+0000","last_fullsized":"2023-12-19T18:03:01.525995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:43.950078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528947+0000","last_change":"2023-12-19T18:03:01.515786+0000","last_active":"2023-12-19T18:03:01.528947+0000","last_peered":"2023-12-19T18:03:01.528947+0000","last_clean":"2023-12-19T18:03:01.528947+0000","last_became_active":"2023-12-19T18:03:01.515500+0000","last_became_peered":"2023-12-19T18:03:01.515500+0000","last_unstale":"2023-12-19T18:03:01.528947+0000","last_undegraded":"2023-12-19T18:03:01.528947+0000","last_fullsized":"2023-12-19T18:03:01.528947+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:27.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524875+0000","last_change":"2023-12-19T18:03:01.516316+0000","last_active":"2023-12-19T18:03:01.524875+0000","last_peered":"2023-12-19T18:03:01.524875+0000","last_clean":"2023-12-19T18:03:01.524875+0000","last_became_active":"2023-12-19T18:03:01.516021+0000","last_became_peered":"2023-12-19T18:03:01.516021+0000","last_unstale":"2023-12-19T18:03:01.524875+0000","last_undegraded":"2023-12-19T18:03:01.524875+0000","last_fullsized":"2023-12-19T18:03:01.524875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528592+0000","last_change":"2023-12-19T18:03:01.522278+0000","last_active":"2023-12-19T18:03:01.528592+0000","last_peered":"2023-12-19T18:03:01.528592+0000","last_clean":"2023-12-19T18:03:01.528592+0000","last_became_active":"2023-12-19T18:03:01.521996+0000","last_became_peered":"2023-12-19T18:03:01.521996+0000","last_unstale":"2023-12-19T18:03:01.528592+0000","last_undegraded":"2023-12-19T18:03:01.528592+0000","last_fullsized":"2023-12-19T18:03:01.528592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529818+0000","last_change":"2023-12-19T18:03:01.522848+0000","last_active":"2023-12-19T18:03:01.529818+0000","last_peered":"2023-12-19T18:03:01.529818+0000","last_clean":"2023-12-19T18:03:01.529818+0000","last_became_active":"2023-12-19T18:03:01.522590+0000","last_became_peered":"2023-12-19T18:03:01.522590+0000","last_unstale":"2023-12-19T18:03:01.529818+0000","last_undegraded":"2023-12-19T18:03:01.529818+0000","last_fullsized":"2023-12-19T18:03:01.529818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:36.817532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530700+0000","last_change":"2023-12-19T18:03:01.031247+0000","last_active":"2023-12-19T18:03:01.530700+0000","last_peered":"2023-12-19T18:03:01.530700+0000","last_clean":"2023-12-19T18:03:01.530700+0000","last_became_active":"2023-12-19T18:03:01.029901+0000","last_became_peered":"2023-12-19T18:03:01.029901+0000","last_unstale":"2023-12-19T18:03:01.530700+0000","last_undegraded":"2023-12-19T18:03:01.530700+0000","last_fullsized":"2023-12-19T18:03:01.530700+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:39.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524851+0000","last_change":"2023-12-19T18:03:01.518433+0000","last_active":"2023-12-19T18:03:01.524851+0000","last_peered":"2023-12-19T18:03:01.524851+0000","last_clean":"2023-12-19T18:03:01.524851+0000","last_became_active":"2023-12-19T18:03:01.518170+0000","last_became_peered":"2023-12-19T18:03:01.518170+0000","last_unstale":"2023-12-19T18:03:01.524851+0000","last_undegraded":"2023-12-19T18:03:01.524851+0000","last_fullsized":"2023-12-19T18:03:01.524851+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:10.478715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528394+0000","last_change":"2023-12-19T18:03:01.043692+0000","last_active":"2023-12-19T18:03:01.528394+0000","last_peered":"2023-12-19T18:03:01.528394+0000","last_clean":"2023-12-19T18:03:01.528394+0000","last_became_active":"2023-12-19T18:03:01.043406+0000","last_became_peered":"2023-12-19T18:03:01.043406+0000","last_unstale":"2023-12-19T18:03:01.528394+0000","last_undegraded":"2023-12-19T18:03:01.528394+0000","last_fullsized":"2023-12-19T18:03:01.528394+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525008+0000","last_change":"2023-12-19T18:03:01.515860+0000","last_active":"2023-12-19T18:03:01.525008+0000","last_peered":"2023-12-19T18:03:01.525008+0000","last_clean":"2023-12-19T18:03:01.525008+0000","last_became_active":"2023-12-19T18:03:01.515586+0000","last_became_peered":"2023-12-19T18:03:01.515586+0000","last_unstale":"2023-12-19T18:03:01.525008+0000","last_undegraded":"2023-12-19T18:03:01.525008+0000","last_fullsized":"2023-12-19T18:03:01.525008+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532808+0000","last_change":"2023-12-19T18:03:01.044240+0000","last_active":"2023-12-19T18:03:01.532808+0000","last_peered":"2023-12-19T18:03:01.532808+0000","last_clean":"2023-12-19T18:03:01.532808+0000","last_became_active":"2023-12-19T18:03:01.043989+0000","last_became_peered":"2023-12-19T18:03:01.043989+0000","last_unstale":"2023-12-19T18:03:01.532808+0000","last_undegraded":"2023-12-19T18:03:01.532808+0000","last_fullsized":"2023-12-19T18:03:01.532808+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.479629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524871+0000","last_change":"2023-12-19T18:03:01.514941+0000","last_active":"2023-12-19T18:03:01.524871+0000","last_peered":"2023-12-19T18:03:01.524871+0000","last_clean":"2023-12-19T18:03:01.524871+0000","last_became_active":"2023-12-19T18:03:01.511917+0000","last_became_peered":"2023-12-19T18:03:01.511917+0000","last_unstale":"2023-12-19T18:03:01.524871+0000","last_undegraded":"2023-12-19T18:03:01.524871+0000","last_fullsized":"2023-12-19T18:03:01.524871+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:52.886192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530719+0000","last_change":"2023-12-19T18:03:01.043134+0000","last_active":"2023-12-19T18:03:01.530719+0000","last_peered":"2023-12-19T18:03:01.530719+0000","last_clean":"2023-12-19T18:03:01.530719+0000","last_became_active":"2023-12-19T18:03:01.042431+0000","last_became_peered":"2023-12-19T18:03:01.042431+0000","last_unstale":"2023-12-19T18:03:01.530719+0000","last_undegraded":"2023-12-19T18:03:01.530719+0000","last_fullsized":"2023-12-19T18:03:01.530719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:32.570496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529172+0000","last_change":"2023-12-19T18:03:01.518227+0000","last_active":"2023-12-19T18:03:01.529172+0000","last_peered":"2023-12-19T18:03:01.529172+0000","last_clean":"2023-12-19T18:03:01.529172+0000","last_became_active":"2023-12-19T18:03:01.517946+0000","last_became_peered":"2023-12-19T18:03:01.517946+0000","last_unstale":"2023-12-19T18:03:01.529172+0000","last_undegraded":"2023-12-19T18:03:01.529172+0000","last_fullsized":"2023-12-19T18:03:01.529172+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.533045+0000","last_change":"2023-12-19T18:03:01.045236+0000","last_active":"2023-12-19T18:03:01.533045+0000","last_peered":"2023-12-19T18:03:01.533045+0000","last_clean":"2023-12-19T18:03:01.533045+0000","last_became_active":"2023-12-19T18:03:01.044907+0000","last_became_peered":"2023-12-19T18:03:01.044907+0000","last_unstale":"2023-12-19T18:03:01.533045+0000","last_undegraded":"2023-12-19T18:03:01.533045+0000","last_fullsized":"2023-12-19T18:03:01.533045+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519111+0000","last_change":"2023-12-19T18:03:01.509590+0000","last_active":"2023-12-19T18:03:01.519111+0000","last_peered":"2023-12-19T18:03:01.519111+0000","last_clean":"2023-12-19T18:03:01.519111+0000","last_became_active":"2023-12-19T18:03:01.509262+0000","last_became_peered":"2023-12-19T18:03:01.509262+0000","last_unstale":"2023-12-19T18:03:01.519111+0000","last_undegraded":"2023-12-19T18:03:01.519111+0000","last_fullsized":"2023-12-19T18:03:01.519111+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.531136+0000","last_change":"2023-12-19T18:03:01.041854+0000","last_active":"2023-12-19T18:03:01.531136+0000","last_peered":"2023-12-19T18:03:01.531136+0000","last_clean":"2023-12-19T18:03:01.531136+0000","last_became_active":"2023-12-19T18:03:01.040426+0000","last_became_peered":"2023-12-19T18:03:01.040426+0000","last_unstale":"2023-12-19T18:03:01.531136+0000","last_undegraded":"2023-12-19T18:03:01.531136+0000","last_fullsized":"2023-12-19T18:03:01.531136+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:25.067419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528829+0000","last_change":"2023-12-19T18:03:01.515644+0000","last_active":"2023-12-19T18:03:01.528829+0000","last_peered":"2023-12-19T18:03:01.528829+0000","last_clean":"2023-12-19T18:03:01.528829+0000","last_became_active":"2023-12-19T18:03:01.512734+0000","last_became_peered":"2023-12-19T18:03:01.512734+0000","last_unstale":"2023-12-19T18:03:01.528829+0000","last_undegraded":"2023-12-19T18:03:01.528829+0000","last_fullsized":"2023-12-19T18:03:01.528829+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:17.957563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.496190+0000","last_change":"2023-12-19T18:03:01.037069+0000","last_active":"2023-12-19T18:03:01.496190+0000","last_peered":"2023-12-19T18:03:01.496190+0000","last_clean":"2023-12-19T18:03:01.496190+0000","last_became_active":"2023-12-19T18:03:01.036794+0000","last_became_peered":"2023-12-19T18:03:01.036794+0000","last_unstale":"2023-12-19T18:03:01.496190+0000","last_undegraded":"2023-12-19T18:03:01.496190+0000","last_fullsized":"2023-12-19T18:03:01.496190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:42.153731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.531078+0000","last_change":"2023-12-19T18:03:01.526473+0000","last_active":"2023-12-19T18:03:01.531078+0000","last_peered":"2023-12-19T18:03:01.531078+0000","last_clean":"2023-12-19T18:03:01.531078+0000","last_became_active":"2023-12-19T18:03:01.526149+0000","last_became_peered":"2023-12-19T18:03:01.526149+0000","last_unstale":"2023-12-19T18:03:01.531078+0000","last_undegraded":"2023-12-19T18:03:01.531078+0000","last_fullsized":"2023-12-19T18:03:01.531078+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:48.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.504573+0000","last_change":"2023-12-19T18:03:01.041603+0000","last_active":"2023-12-19T18:03:01.504573+0000","last_peered":"2023-12-19T18:03:01.504573+0000","last_clean":"2023-12-19T18:03:01.504573+0000","last_became_active":"2023-12-19T18:03:01.040273+0000","last_became_peered":"2023-12-19T18:03:01.040273+0000","last_unstale":"2023-12-19T18:03:01.504573+0000","last_undegraded":"2023-12-19T18:03:01.504573+0000","last_fullsized":"2023-12-19T18:03:01.504573+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:23.457722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.520029+0000","last_change":"2023-12-19T18:03:01.510473+0000","last_active":"2023-12-19T18:03:01.520029+0000","last_peered":"2023-12-19T18:03:01.520029+0000","last_clean":"2023-12-19T18:03:01.520029+0000","last_became_active":"2023-12-19T18:03:01.510147+0000","last_became_peered":"2023-12-19T18:03:01.510147+0000","last_unstale":"2023-12-19T18:03:01.520029+0000","last_undegraded":"2023-12-19T18:03:01.520029+0000","last_fullsized":"2023-12-19T18:03:01.520029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503580+0000","last_change":"2023-12-19T18:03:01.046117+0000","last_active":"2023-12-19T18:03:01.503580+0000","last_peered":"2023-12-19T18:03:01.503580+0000","last_clean":"2023-12-19T18:03:01.503580+0000","last_became_active":"2023-12-19T18:03:01.045799+0000","last_became_peered":"2023-12-19T18:03:01.045799+0000","last_unstale":"2023-12-19T18:03:01.503580+0000","last_undegraded":"2023-12-19T18:03:01.503580+0000","last_fullsized":"2023-12-19T18:03:01.503580+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524797+0000","last_change":"2023-12-19T18:03:01.515473+0000","last_active":"2023-12-19T18:03:01.524797+0000","last_peered":"2023-12-19T18:03:01.524797+0000","last_clean":"2023-12-19T18:03:01.524797+0000","last_became_active":"2023-12-19T18:03:01.512986+0000","last_became_peered":"2023-12-19T18:03:01.512986+0000","last_unstale":"2023-12-19T18:03:01.524797+0000","last_undegraded":"2023-12-19T18:03:01.524797+0000","last_fullsized":"2023-12-19T18:03:01.524797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.497069+0000","last_change":"2023-12-19T18:03:01.049167+0000","last_active":"2023-12-19T18:03:01.497069+0000","last_peered":"2023-12-19T18:03:01.497069+0000","last_clean":"2023-12-19T18:03:01.497069+0000","last_became_active":"2023-12-19T18:03:01.048925+0000","last_became_peered":"2023-12-19T18:03:01.048925+0000","last_unstale":"2023-12-19T18:03:01.497069+0000","last_undegraded":"2023-12-19T18:03:01.497069+0000","last_fullsized":"2023-12-19T18:03:01.497069+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527893+0000","last_change":"2023-12-19T18:03:01.509372+0000","last_active":"2023-12-19T18:03:01.527893+0000","last_peered":"2023-12-19T18:03:01.527893+0000","last_clean":"2023-12-19T18:03:01.527893+0000","last_became_active":"2023-12-19T18:03:01.509107+0000","last_became_peered":"2023-12-19T18:03:01.509107+0000","last_unstale":"2023-12-19T18:03:01.527893+0000","last_undegraded":"2023-12-19T18:03:01.527893+0000","last_fullsized":"2023-12-19T18:03:01.527893+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:02.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530837+0000","last_change":"2023-12-19T18:03:01.035484+0000","last_active":"2023-12-19T18:03:01.530837+0000","last_peered":"2023-12-19T18:03:01.530837+0000","last_clean":"2023-12-19T18:03:01.530837+0000","last_became_active":"2023-12-19T18:03:01.035096+0000","last_became_peered":"2023-12-19T18:03:01.035096+0000","last_unstale":"2023-12-19T18:03:01.530837+0000","last_undegraded":"2023-12-19T18:03:01.530837+0000","last_fullsized":"2023-12-19T18:03:01.530837+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:31:55.570736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525082+0000","last_change":"2023-12-19T18:03:01.517319+0000","last_active":"2023-12-19T18:03:01.525082+0000","last_peered":"2023-12-19T18:03:01.525082+0000","last_clean":"2023-12-19T18:03:01.525082+0000","last_became_active":"2023-12-19T18:03:01.515999+0000","last_became_peered":"2023-12-19T18:03:01.515999+0000","last_unstale":"2023-12-19T18:03:01.525082+0000","last_undegraded":"2023-12-19T18:03:01.525082+0000","last_fullsized":"2023-12-19T18:03:01.525082+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.533411+0000","last_change":"2023-12-19T18:03:01.043052+0000","last_active":"2023-12-19T18:03:01.533411+0000","last_peered":"2023-12-19T18:03:01.533411+0000","last_clean":"2023-12-19T18:03:01.533411+0000","last_became_active":"2023-12-19T18:03:01.042700+0000","last_became_peered":"2023-12-19T18:03:01.042700+0000","last_unstale":"2023-12-19T18:03:01.533411+0000","last_undegraded":"2023-12-19T18:03:01.533411+0000","last_fullsized":"2023-12-19T18:03:01.533411+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:07.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521909+0000","last_change":"2023-12-19T18:03:01.514894+0000","last_active":"2023-12-19T18:03:01.521909+0000","last_peered":"2023-12-19T18:03:01.521909+0000","last_clean":"2023-12-19T18:03:01.521909+0000","last_became_active":"2023-12-19T18:03:01.514612+0000","last_became_peered":"2023-12-19T18:03:01.514612+0000","last_unstale":"2023-12-19T18:03:01.521909+0000","last_undegraded":"2023-12-19T18:03:01.521909+0000","last_fullsized":"2023-12-19T18:03:01.521909+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529676+0000","last_change":"2023-12-19T18:03:01.037229+0000","last_active":"2023-12-19T18:03:01.529676+0000","last_peered":"2023-12-19T18:03:01.529676+0000","last_clean":"2023-12-19T18:03:01.529676+0000","last_became_active":"2023-12-19T18:03:01.036922+0000","last_became_peered":"2023-12-19T18:03:01.036922+0000","last_unstale":"2023-12-19T18:03:01.529676+0000","last_undegraded":"2023-12-19T18:03:01.529676+0000","last_fullsized":"2023-12-19T18:03:01.529676+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:16.787802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528559+0000","last_change":"2023-12-19T18:03:01.514274+0000","last_active":"2023-12-19T18:03:01.528559+0000","last_peered":"2023-12-19T18:03:01.528559+0000","last_clean":"2023-12-19T18:03:01.528559+0000","last_became_active":"2023-12-19T18:03:01.513969+0000","last_became_peered":"2023-12-19T18:03:01.513969+0000","last_unstale":"2023-12-19T18:03:01.528559+0000","last_undegraded":"2023-12-19T18:03:01.528559+0000","last_fullsized":"2023-12-19T18:03:01.528559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.499722+0000","last_change":"2023-12-19T18:03:01.041706+0000","last_active":"2023-12-19T18:03:01.499722+0000","last_peered":"2023-12-19T18:03:01.499722+0000","last_clean":"2023-12-19T18:03:01.499722+0000","last_became_active":"2023-12-19T18:03:01.040042+0000","last_became_peered":"2023-12-19T18:03:01.040042+0000","last_unstale":"2023-12-19T18:03:01.499722+0000","last_undegraded":"2023-12-19T18:03:01.499722+0000","last_fullsized":"2023-12-19T18:03:01.499722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:53.747846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528738+0000","last_change":"2023-12-19T18:03:01.519394+0000","last_active":"2023-12-19T18:03:01.528738+0000","last_peered":"2023-12-19T18:03:01.528738+0000","last_clean":"2023-12-19T18:03:01.528738+0000","last_became_active":"2023-12-19T18:03:01.519108+0000","last_became_peered":"2023-12-19T18:03:01.519108+0000","last_unstale":"2023-12-19T18:03:01.528738+0000","last_undegraded":"2023-12-19T18:03:01.528738+0000","last_fullsized":"2023-12-19T18:03:01.528738+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.500947+0000","last_change":"2023-12-19T18:03:01.041523+0000","last_active":"2023-12-19T18:03:01.500947+0000","last_peered":"2023-12-19T18:03:01.500947+0000","last_clean":"2023-12-19T18:03:01.500947+0000","last_became_active":"2023-12-19T18:03:01.041293+0000","last_became_peered":"2023-12-19T18:03:01.041293+0000","last_unstale":"2023-12-19T18:03:01.500947+0000","last_undegraded":"2023-12-19T18:03:01.500947+0000","last_fullsized":"2023-12-19T18:03:01.500947+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:54.430060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521058+0000","last_change":"2023-12-19T18:03:01.514191+0000","last_active":"2023-12-19T18:03:01.521058+0000","last_peered":"2023-12-19T18:03:01.521058+0000","last_clean":"2023-12-19T18:03:01.521058+0000","last_became_active":"2023-12-19T18:03:01.513939+0000","last_became_peered":"2023-12-19T18:03:01.513939+0000","last_unstale":"2023-12-19T18:03:01.521058+0000","last_undegraded":"2023-12-19T18:03:01.521058+0000","last_fullsized":"2023-12-19T18:03:01.521058+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526652+0000","last_change":"2023-12-19T18:03:01.043501+0000","last_active":"2023-12-19T18:03:01.526652+0000","last_peered":"2023-12-19T18:03:01.526652+0000","last_clean":"2023-12-19T18:03:01.526652+0000","last_became_active":"2023-12-19T18:03:01.042962+0000","last_became_peered":"2023-12-19T18:03:01.042962+0000","last_unstale":"2023-12-19T18:03:01.526652+0000","last_undegraded":"2023-12-19T18:03:01.526652+0000","last_fullsized":"2023-12-19T18:03:01.526652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524563+0000","last_change":"2023-12-19T18:03:01.515905+0000","last_active":"2023-12-19T18:03:01.524563+0000","last_peered":"2023-12-19T18:03:01.524563+0000","last_clean":"2023-12-19T18:03:01.524563+0000","last_became_active":"2023-12-19T18:03:01.515582+0000","last_became_peered":"2023-12-19T18:03:01.515582+0000","last_unstale":"2023-12-19T18:03:01.524563+0000","last_undegraded":"2023-12-19T18:03:01.524563+0000","last_fullsized":"2023-12-19T18:03:01.524563+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526448+0000","last_change":"2023-12-19T18:03:01.044609+0000","last_active":"2023-12-19T18:03:01.526448+0000","last_peered":"2023-12-19T18:03:01.526448+0000","last_clean":"2023-12-19T18:03:01.526448+0000","last_became_active":"2023-12-19T18:03:01.044346+0000","last_became_peered":"2023-12-19T18:03:01.044346+0000","last_unstale":"2023-12-19T18:03:01.526448+0000","last_undegraded":"2023-12-19T18:03:01.526448+0000","last_fullsized":"2023-12-19T18:03:01.526448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525826+0000","last_change":"2023-12-19T18:03:01.518694+0000","last_active":"2023-12-19T18:03:01.525826+0000","last_peered":"2023-12-19T18:03:01.525826+0000","last_clean":"2023-12-19T18:03:01.525826+0000","last_became_active":"2023-12-19T18:03:01.518441+0000","last_became_peered":"2023-12-19T18:03:01.518441+0000","last_unstale":"2023-12-19T18:03:01.525826+0000","last_undegraded":"2023-12-19T18:03:01.525826+0000","last_fullsized":"2023-12-19T18:03:01.525826+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:48.707978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529270+0000","last_change":"2023-12-19T18:03:01.037450+0000","last_active":"2023-12-19T18:03:01.529270+0000","last_peered":"2023-12-19T18:03:01.529270+0000","last_clean":"2023-12-19T18:03:01.529270+0000","last_became_active":"2023-12-19T18:03:01.037175+0000","last_became_peered":"2023-12-19T18:03:01.037175+0000","last_unstale":"2023-12-19T18:03:01.529270+0000","last_undegraded":"2023-12-19T18:03:01.529270+0000","last_fullsized":"2023-12-19T18:03:01.529270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:54.253683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.510887+0000","last_change":"2023-12-19T18:03:01.506907+0000","last_active":"2023-12-19T18:03:01.510887+0000","last_peered":"2023-12-19T18:03:01.510887+0000","last_clean":"2023-12-19T18:03:01.510887+0000","last_became_active":"2023-12-19T18:03:01.505913+0000","last_became_peered":"2023-12-19T18:03:01.505913+0000","last_unstale":"2023-12-19T18:03:01.510887+0000","last_undegraded":"2023-12-19T18:03:01.510887+0000","last_fullsized":"2023-12-19T18:03:01.510887+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.496923+0000","last_change":"2023-12-19T18:03:01.046428+0000","last_active":"2023-12-19T18:03:01.496923+0000","last_peered":"2023-12-19T18:03:01.496923+0000","last_clean":"2023-12-19T18:03:01.496923+0000","last_became_active":"2023-12-19T18:03:01.046121+0000","last_became_peered":"2023-12-19T18:03:01.046121+0000","last_unstale":"2023-12-19T18:03:01.496923+0000","last_undegraded":"2023-12-19T18:03:01.496923+0000","last_fullsized":"2023-12-19T18:03:01.496923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:12.408666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522071+0000","last_change":"2023-12-19T18:03:01.517333+0000","last_active":"2023-12-19T18:03:01.522071+0000","last_peered":"2023-12-19T18:03:01.522071+0000","last_clean":"2023-12-19T18:03:01.522071+0000","last_became_active":"2023-12-19T18:03:01.517092+0000","last_became_peered":"2023-12-19T18:03:01.517092+0000","last_unstale":"2023-12-19T18:03:01.522071+0000","last_undegraded":"2023-12-19T18:03:01.522071+0000","last_fullsized":"2023-12-19T18:03:01.522071+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:35.371295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526569+0000","last_change":"2023-12-19T18:03:01.039131+0000","last_active":"2023-12-19T18:03:01.526569+0000","last_peered":"2023-12-19T18:03:01.526569+0000","last_clean":"2023-12-19T18:03:01.526569+0000","last_became_active":"2023-12-19T18:03:01.038734+0000","last_became_peered":"2023-12-19T18:03:01.038734+0000","last_unstale":"2023-12-19T18:03:01.526569+0000","last_undegraded":"2023-12-19T18:03:01.526569+0000","last_fullsized":"2023-12-19T18:03:01.526569+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:46.564642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.515420+0000","last_change":"2023-12-19T18:03:01.508354+0000","last_active":"2023-12-19T18:03:01.515420+0000","last_peered":"2023-12-19T18:03:01.515420+0000","last_clean":"2023-12-19T18:03:01.515420+0000","last_became_active":"2023-12-19T18:03:01.508038+0000","last_became_peered":"2023-12-19T18:03:01.508038+0000","last_unstale":"2023-12-19T18:03:01.515420+0000","last_undegraded":"2023-12-19T18:03:01.515420+0000","last_fullsized":"2023-12-19T18:03:01.515420+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:49.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.498504+0000","last_change":"2023-12-19T18:03:01.040136+0000","last_active":"2023-12-19T18:03:01.498504+0000","last_peered":"2023-12-19T18:03:01.498504+0000","last_clean":"2023-12-19T18:03:01.498504+0000","last_became_active":"2023-12-19T18:03:01.039868+0000","last_became_peered":"2023-12-19T18:03:01.039868+0000","last_unstale":"2023-12-19T18:03:01.498504+0000","last_undegraded":"2023-12-19T18:03:01.498504+0000","last_fullsized":"2023-12-19T18:03:01.498504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:40.552341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.515506+0000","last_change":"2023-12-19T18:03:01.507780+0000","last_active":"2023-12-19T18:03:01.515506+0000","last_peered":"2023-12-19T18:03:01.515506+0000","last_clean":"2023-12-19T18:03:01.515506+0000","last_became_active":"2023-12-19T18:03:01.507503+0000","last_became_peered":"2023-12-19T18:03:01.507503+0000","last_unstale":"2023-12-19T18:03:01.515506+0000","last_undegraded":"2023-12-19T18:03:01.515506+0000","last_fullsized":"2023-12-19T18:03:01.515506+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:34.035010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.501050+0000","last_change":"2023-12-19T18:03:01.042852+0000","last_active":"2023-12-19T18:03:01.501050+0000","last_peered":"2023-12-19T18:03:01.501050+0000","last_clean":"2023-12-19T18:03:01.501050+0000","last_became_active":"2023-12-19T18:03:01.042591+0000","last_became_peered":"2023-12-19T18:03:01.042591+0000","last_unstale":"2023-12-19T18:03:01.501050+0000","last_undegraded":"2023-12-19T18:03:01.501050+0000","last_fullsized":"2023-12-19T18:03:01.501050+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:36.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528707+0000","last_change":"2023-12-19T18:03:01.522686+0000","last_active":"2023-12-19T18:03:01.528707+0000","last_peered":"2023-12-19T18:03:01.528707+0000","last_clean":"2023-12-19T18:03:01.528707+0000","last_became_active":"2023-12-19T18:03:01.522364+0000","last_became_peered":"2023-12-19T18:03:01.522364+0000","last_unstale":"2023-12-19T18:03:01.528707+0000","last_undegraded":"2023-12-19T18:03:01.528707+0000","last_fullsized":"2023-12-19T18:03:01.528707+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.494973+0000","last_change":"2023-12-19T18:03:01.042245+0000","last_active":"2023-12-19T18:03:01.494973+0000","last_peered":"2023-12-19T18:03:01.494973+0000","last_clean":"2023-12-19T18:03:01.494973+0000","last_became_active":"2023-12-19T18:03:01.041594+0000","last_became_peered":"2023-12-19T18:03:01.041594+0000","last_unstale":"2023-12-19T18:03:01.494973+0000","last_undegraded":"2023-12-19T18:03:01.494973+0000","last_fullsized":"2023-12-19T18:03:01.494973+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:47.506271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532721+0000","last_change":"2023-12-19T18:03:01.530430+0000","last_active":"2023-12-19T18:03:01.532721+0000","last_peered":"2023-12-19T18:03:01.532721+0000","last_clean":"2023-12-19T18:03:01.532721+0000","last_became_active":"2023-12-19T18:03:01.530152+0000","last_became_peered":"2023-12-19T18:03:01.530152+0000","last_unstale":"2023-12-19T18:03:01.532721+0000","last_undegraded":"2023-12-19T18:03:01.532721+0000","last_fullsized":"2023-12-19T18:03:01.532721+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:09.235125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525367+0000","last_change":"2023-12-19T18:03:01.043296+0000","last_active":"2023-12-19T18:03:01.525367+0000","last_peered":"2023-12-19T18:03:01.525367+0000","last_clean":"2023-12-19T18:03:01.525367+0000","last_became_active":"2023-12-19T18:03:01.040391+0000","last_became_peered":"2023-12-19T18:03:01.040391+0000","last_unstale":"2023-12-19T18:03:01.525367+0000","last_undegraded":"2023-12-19T18:03:01.525367+0000","last_fullsized":"2023-12-19T18:03:01.525367+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:48.320418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529244+0000","last_change":"2023-12-19T18:03:01.521630+0000","last_active":"2023-12-19T18:03:01.529244+0000","last_peered":"2023-12-19T18:03:01.529244+0000","last_clean":"2023-12-19T18:03:01.529244+0000","last_became_active":"2023-12-19T18:03:01.521375+0000","last_became_peered":"2023-12-19T18:03:01.521375+0000","last_unstale":"2023-12-19T18:03:01.529244+0000","last_undegraded":"2023-12-19T18:03:01.529244+0000","last_fullsized":"2023-12-19T18:03:01.529244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-12-19T18:03:02.508719+0000","last_change":"2023-12-19T18:03:01.036153+0000","last_active":"2023-12-19T18:03:02.508719+0000","last_peered":"2023-12-19T18:03:02.508719+0000","last_clean":"2023-12-19T18:03:02.508719+0000","last_became_active":"2023-12-19T18:03:01.035798+0000","last_became_peered":"2023-12-19T18:03:01.035798+0000","last_unstale":"2023-12-19T18:03:02.508719+0000","last_undegraded":"2023-12-19T18:03:02.508719+0000","last_fullsized":"2023-12-19T18:03:02.508719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:43.399399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526935+0000","last_change":"2023-12-19T18:03:01.516512+0000","last_active":"2023-12-19T18:03:01.526935+0000","last_peered":"2023-12-19T18:03:01.526935+0000","last_clean":"2023-12-19T18:03:01.526935+0000","last_became_active":"2023-12-19T18:03:01.516230+0000","last_became_peered":"2023-12-19T18:03:01.516230+0000","last_unstale":"2023-12-19T18:03:01.526935+0000","last_undegraded":"2023-12-19T18:03:01.526935+0000","last_fullsized":"2023-12-19T18:03:01.526935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:22.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503824+0000","last_change":"2023-12-19T18:03:01.044483+0000","last_active":"2023-12-19T18:03:01.503824+0000","last_peered":"2023-12-19T18:03:01.503824+0000","last_clean":"2023-12-19T18:03:01.503824+0000","last_became_active":"2023-12-19T18:03:01.043913+0000","last_became_peered":"2023-12-19T18:03:01.043913+0000","last_unstale":"2023-12-19T18:03:01.503824+0000","last_undegraded":"2023-12-19T18:03:01.503824+0000","last_fullsized":"2023-12-19T18:03:01.503824+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519198+0000","last_change":"2023-12-19T18:03:01.512256+0000","last_active":"2023-12-19T18:03:01.519198+0000","last_peered":"2023-12-19T18:03:01.519198+0000","last_clean":"2023-12-19T18:03:01.519198+0000","last_became_active":"2023-12-19T18:03:01.512017+0000","last_became_peered":"2023-12-19T18:03:01.512017+0000","last_unstale":"2023-12-19T18:03:01.519198+0000","last_undegraded":"2023-12-19T18:03:01.519198+0000","last_fullsized":"2023-12-19T18:03:01.519198+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.505492+0000","last_change":"2023-12-19T18:03:01.041437+0000","last_active":"2023-12-19T18:03:01.505492+0000","last_peered":"2023-12-19T18:03:01.505492+0000","last_clean":"2023-12-19T18:03:01.505492+0000","last_became_active":"2023-12-19T18:03:01.041139+0000","last_became_peered":"2023-12-19T18:03:01.041139+0000","last_unstale":"2023-12-19T18:03:01.505492+0000","last_undegraded":"2023-12-19T18:03:01.505492+0000","last_fullsized":"2023-12-19T18:03:01.505492+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:01.261039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524846+0000","last_change":"2023-12-19T18:03:01.518874+0000","last_active":"2023-12-19T18:03:01.524846+0000","last_peered":"2023-12-19T18:03:01.524846+0000","last_clean":"2023-12-19T18:03:01.524846+0000","last_became_active":"2023-12-19T18:03:01.518634+0000","last_became_peered":"2023-12-19T18:03:01.518634+0000","last_unstale":"2023-12-19T18:03:01.524846+0000","last_undegraded":"2023-12-19T18:03:01.524846+0000","last_fullsized":"2023-12-19T18:03:01.524846+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:32:20.489876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.505022+0000","last_change":"2023-12-19T18:03:01.049301+0000","last_active":"2023-12-19T18:03:01.505022+0000","last_peered":"2023-12-19T18:03:01.505022+0000","last_clean":"2023-12-19T18:03:01.505022+0000","last_became_active":"2023-12-19T18:03:01.048995+0000","last_became_peered":"2023-12-19T18:03:01.048995+0000","last_unstale":"2023-12-19T18:03:01.505022+0000","last_undegraded":"2023-12-19T18:03:01.505022+0000","last_fullsized":"2023-12-19T18:03:01.505022+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530017+0000","last_change":"2023-12-19T18:03:01.523203+0000","last_active":"2023-12-19T18:03:01.530017+0000","last_peered":"2023-12-19T18:03:01.530017+0000","last_clean":"2023-12-19T18:03:01.530017+0000","last_became_active":"2023-12-19T18:03:01.522763+0000","last_became_peered":"2023-12-19T18:03:01.522763+0000","last_unstale":"2023-12-19T18:03:01.530017+0000","last_undegraded":"2023-12-19T18:03:01.530017+0000","last_fullsized":"2023-12-19T18:03:01.530017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:26.073083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.504691+0000","last_change":"2023-12-19T18:03:01.042324+0000","last_active":"2023-12-19T18:03:01.504691+0000","last_peered":"2023-12-19T18:03:01.504691+0000","last_clean":"2023-12-19T18:03:01.504691+0000","last_became_active":"2023-12-19T18:03:01.041724+0000","last_became_peered":"2023-12-19T18:03:01.041724+0000","last_unstale":"2023-12-19T18:03:01.504691+0000","last_undegraded":"2023-12-19T18:03:01.504691+0000","last_fullsized":"2023-12-19T18:03:01.504691+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:41:28.074168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524623+0000","last_change":"2023-12-19T18:03:01.515603+0000","last_active":"2023-12-19T18:03:01.524623+0000","last_peered":"2023-12-19T18:03:01.524623+0000","last_clean":"2023-12-19T18:03:01.524623+0000","last_became_active":"2023-12-19T18:03:01.515306+0000","last_became_peered":"2023-12-19T18:03:01.515306+0000","last_unstale":"2023-12-19T18:03:01.524623+0000","last_undegraded":"2023-12-19T18:03:01.524623+0000","last_fullsized":"2023-12-19T18:03:01.524623+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:43.324973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503093+0000","last_change":"2023-12-19T18:03:01.041166+0000","last_active":"2023-12-19T18:03:01.503093+0000","last_peered":"2023-12-19T18:03:01.503093+0000","last_clean":"2023-12-19T18:03:01.503093+0000","last_became_active":"2023-12-19T18:03:01.039307+0000","last_became_peered":"2023-12-19T18:03:01.039307+0000","last_unstale":"2023-12-19T18:03:01.503093+0000","last_undegraded":"2023-12-19T18:03:01.503093+0000","last_fullsized":"2023-12-19T18:03:01.503093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:26.463539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529240+0000","last_change":"2023-12-19T18:03:01.521534+0000","last_active":"2023-12-19T18:03:01.529240+0000","last_peered":"2023-12-19T18:03:01.529240+0000","last_clean":"2023-12-19T18:03:01.529240+0000","last_became_active":"2023-12-19T18:03:01.521276+0000","last_became_peered":"2023-12-19T18:03:01.521276+0000","last_unstale":"2023-12-19T18:03:01.529240+0000","last_undegraded":"2023-12-19T18:03:01.529240+0000","last_fullsized":"2023-12-19T18:03:01.529240+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.495081+0000","last_change":"2023-12-19T18:03:01.036205+0000","last_active":"2023-12-19T18:03:01.495081+0000","last_peered":"2023-12-19T18:03:01.495081+0000","last_clean":"2023-12-19T18:03:01.495081+0000","last_became_active":"2023-12-19T18:03:01.035940+0000","last_became_peered":"2023-12-19T18:03:01.035940+0000","last_unstale":"2023-12-19T18:03:01.495081+0000","last_undegraded":"2023-12-19T18:03:01.495081+0000","last_fullsized":"2023-12-19T18:03:01.495081+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:11.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519948+0000","last_change":"2023-12-19T18:03:01.513336+0000","last_active":"2023-12-19T18:03:01.519948+0000","last_peered":"2023-12-19T18:03:01.519948+0000","last_clean":"2023-12-19T18:03:01.519948+0000","last_became_active":"2023-12-19T18:03:01.512097+0000","last_became_peered":"2023-12-19T18:03:01.512097+0000","last_unstale":"2023-12-19T18:03:01.519948+0000","last_undegraded":"2023-12-19T18:03:01.519948+0000","last_fullsized":"2023-12-19T18:03:01.519948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:45.843330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532039+0000","last_change":"2023-12-19T18:03:01.036635+0000","last_active":"2023-12-19T18:03:01.532039+0000","last_peered":"2023-12-19T18:03:01.532039+0000","last_clean":"2023-12-19T18:03:01.532039+0000","last_became_active":"2023-12-19T18:03:01.036255+0000","last_became_peered":"2023-12-19T18:03:01.036255+0000","last_unstale":"2023-12-19T18:03:01.532039+0000","last_undegraded":"2023-12-19T18:03:01.532039+0000","last_fullsized":"2023-12-19T18:03:01.532039+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:44.837666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.495247+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:03:01.495247+0000","last_peered":"2023-12-19T18:03:01.495247+0000","last_clean":"2023-12-19T18:03:01.495247+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:03:01.495247+0000","last_undegraded":"2023-12-19T18:03:01.495247+0000","last_fullsized":"2023-12-19T18:03:01.495247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2215936,"data_stored":1374240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2150000000000001,"15min":1.117},"min":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.8959999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.276,"15min":1.179},"min":{"1min":0.747,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4770000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.151}]},{"osd":1,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.175,"15min":1.1040000000000001},"min":{"1min":0.63400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.444,"5min":12.625,"15min":12.625},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.169,"15min":1.1379999999999999},"min":{"1min":0.752,"5min":0.60899999999999999,"15min":0.52600000000000002},"max":{"1min":1.3540000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1839999999999999,"15min":1.097},"min":{"1min":0.84499999999999997,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":1.371,"5min":13.041,"15min":13.041},"last":1.353},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.587,"15min":1.288},"min":{"1min":0.86499999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.431,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.113}]},{"osd":3,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.26,"15min":1.171},"min":{"1min":0.82799999999999996,"5min":0.67100000000000004,"15min":0.51600000000000001},"max":{"1min":1.409,"5min":12.917,"15min":12.917},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":1.083,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5860000000000001,"5min":46.375,"15min":46.375},"last":1.2969999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.601,"5min":13.137,"15min":13.137},"last":1.232},{"interface":"front","average":{"1min":1.238,"5min":1.3640000000000001,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4810000000000001,"5min":13.109,"15min":13.109},"last":1.2629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.29,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.492,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3069999999999999,"15min":1.286},"min":{"1min":0.89200000000000002,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":1.522,"5min":13.198,"15min":13.198},"last":1.3220000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.478,"15min":1.4179999999999999},"min":{"1min":0.98299999999999998,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":1.675,"5min":13.442,"15min":13.442},"last":1.421},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4199999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.792,"5min":13.981,"15min":13.981},"last":1.4350000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1609728,"data_stored":783678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.997,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.381,"5min":1.399,"15min":4.5979999999999999},"last":1.129},{"interface":"front","average":{"1min":1.103,"5min":1.04,"15min":1.0740000000000001},"min":{"1min":0.755,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4490000000000001,"5min":1.756,"15min":1.756},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.0900000000000001},"min":{"1min":0.70499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.415,"5min":1.583,"15min":1.621},"last":1.2689999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.131,"15min":1.282},"min":{"1min":0.94699999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.371},{"interface":"front","average":{"1min":1.244,"5min":1.1890000000000001,"15min":1.2170000000000001},"min":{"1min":0.90900000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.673,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.3380000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.2490000000000001},"min":{"1min":0.91200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5529999999999999,"5min":1.651,"15min":4.5380000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.218,"15min":1.29},"min":{"1min":0.83099999999999996,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":4.508},"last":1.419}]},{"osd":4,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.149,"15min":1.137},"min":{"1min":0.76000000000000001,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.5129999999999999,"5min":1.577,"15min":1.8360000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2290000000000001,"15min":1.2390000000000001},"min":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.579,"5min":1.802,"15min":1.899},"last":0.98199999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2569999999999999,"15min":1.2589999999999999},"min":{"1min":0.89400000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2729999999999999,"15min":1.2689999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.724,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.857,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.385,"15min":1.395},"min":{"1min":1.056,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.827,"5min":1.841,"15min":2.2440000000000002},"last":1.4670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1613824,"data_stored":783256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5109999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.60599999999999998},"max":{"1min":1.409,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.73}]},{"osd":1,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.135,"15min":1.113},"min":{"1min":0.78700000000000003,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.3540000000000001,"5min":1.974,"15min":1.974},"last":1.591},{"interface":"front","average":{"1min":1.173,"5min":1.145,"15min":1.179},"min":{"1min":0.77700000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.399,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.347}]},{"osd":2,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.891,"15min":2.9929999999999999},"last":1.397},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.3720000000000001,"5min":2.024,"15min":2.024},"last":1.5229999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.482,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.25,"15min":1.3120000000000001},"min":{"1min":1.079,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.536,"5min":1.829,"15min":3.0350000000000001},"last":1.2190000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1890000000000001,"15min":1.244},"min":{"1min":0.79800000000000004,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.4650000000000001,"5min":3.633,"15min":3.633},"last":1.704},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":1.1830000000000001,"5min":0.78600000000000003,"15min":0.745},"max":{"1min":1.5600000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.323},"min":{"1min":1.0429999999999999,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.609,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.3029999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.296}]},{"osd":7,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3180000000000001,"15min":1.411},"min":{"1min":0.85899999999999999,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.9279999999999999,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.492},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3759999999999999,"15min":1.4870000000000001},"min":{"1min":1.0429999999999999,"5min":0.98099999999999998,"15min":0.82499999999999996},"max":{"1min":1.7350000000000001,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.8280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1617920,"data_stored":784660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.077,"15min":1.1739999999999999},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.458,"5min":1.556,"15min":5.4420000000000002},"last":1.423},{"interface":"front","average":{"1min":1.24,"5min":1.1890000000000001,"15min":1.252},"min":{"1min":0.90400000000000003,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.53,"5min":1.657,"15min":5.5049999999999999},"last":1.3100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1100000000000001,"15min":1.181},"min":{"1min":0.83199999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.5580000000000001,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.161},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.161},"min":{"1min":0.85699999999999998,"5min":0.70999999999999996,"15min":0.66000000000000003},"max":{"1min":1.4319999999999999,"5min":1.5589999999999999,"15min":3.254},"last":1.349}]},{"osd":2,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.1970000000000001},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.4850000000000001,"5min":1.623,"15min":4.593},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.173,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.454,"5min":1.871,"15min":2.3799999999999999},"last":1.534}]},{"osd":3,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1220000000000001,"15min":1.2070000000000001},"min":{"1min":0.90000000000000002,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.3939999999999999,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.044},{"interface":"front","average":{"1min":1.266,"5min":1.2110000000000001,"15min":1.3160000000000001},"min":{"1min":0.93700000000000006,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5409999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.5629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.88600000000000001,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.502,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.46},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.667}]},{"osd":6,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2350000000000001,"15min":1.252},"min":{"1min":0.872,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.5609999999999999,"5min":1.6910000000000001,"15min":2.915},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4019999999999999,"15min":1.4039999999999999},"min":{"1min":1.266,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6200000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.631}]},{"osd":7,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.296,"15min":1.306},"min":{"1min":0.99299999999999999,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.556,"5min":1.907,"15min":2.4340000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.369},"min":{"1min":1.0600000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7,"5min":1.833,"15min":5.6859999999999999},"last":1.5049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1622016,"data_stored":784694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.874},"min":{"1min":0.61399999999999999,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":1.329,"5min":1.6599999999999999,"15min":1.825},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.92100000000000004},"min":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.435},"max":{"1min":1.6299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3859999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.80900000000000005,"5min":0.311,"15min":0.311},"max":{"1min":1.6180000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.91700000000000004}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5680000000000001,"5min":1.679,"15min":2.177},"last":1.204},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.1599999999999999,"15min":1.2010000000000001},"min":{"1min":0.71599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.8520000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1599999999999999,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7070000000000001,"5min":1.7310000000000001,"15min":2.234},"last":1.054},{"interface":"front","average":{"1min":1.357,"5min":1.3109999999999999,"15min":1.302},"min":{"1min":0.873,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.591,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.702}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3340000000000001,"15min":1.369},"min":{"1min":1.0129999999999999,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":1.964,"5min":2.0699999999999998,"15min":2.5419999999999998},"last":1.353},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2729999999999999,"15min":1.3149999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.74299999999999999},"max":{"1min":1.5740000000000001,"5min":1.776,"15min":2.754},"last":1.46}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.345,"15min":1.379},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6859999999999999,"5min":1.946,"15min":2.6880000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.411,"15min":1.444},"min":{"1min":0.98499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.8089999999999999,"5min":2.274,"15min":2.6429999999999998},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.351,"15min":1.3999999999999999},"min":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.77700000000000002},"max":{"1min":1.7909999999999999,"5min":1.9730000000000001,"15min":3.02},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4279999999999999,"15min":1.4630000000000001},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.83099999999999996},"max":{"1min":1.7809999999999999,"5min":2.323,"15min":2.8170000000000002},"last":1.79}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1605632,"data_stored":783096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91900000000000004,"15min":1.119},"min":{"1min":0.65600000000000003,"5min":0.497,"15min":0.29599999999999999},"max":{"1min":1.4710000000000001,"5min":3.9209999999999998,"15min":13.32},"last":0.87},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":1.222},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":3.8149999999999999,"15min":13.206},"last":1.1060000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93799999999999994,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.4079999999999999,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.284},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.70299999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.653,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.337}]},{"osd":3,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92600000000000005,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.4610000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.1619999999999999,"15min":1.1890000000000001},"min":{"1min":0.89900000000000002,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.647,"5min":2.75,"15min":2.75},"last":1.381}]},{"osd":4,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2490000000000001},"min":{"1min":1.01,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4339999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.532},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.278},"min":{"1min":1.0389999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.429,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.4370000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.218,"15min":1.264},"min":{"1min":0.874,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7110000000000001,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.504},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3380000000000001,"15min":1.403},"min":{"1min":1.008,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.571,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.389},"min":{"1min":0.98799999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6359999999999999,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3109999999999999,"15min":1.3380000000000001},"min":{"1min":0.92600000000000005,"5min":0.872,"15min":0.872},"max":{"1min":1.6040000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.413}]},{"osd":7,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.92900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.766,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.95799999999999996,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7,"5min":5.375,"15min":5.375},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1609728,"data_stored":783118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.72599999999999998,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.931},"last":1.103},{"interface":"front","average":{"1min":0.995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.335,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82499999999999996,"15min":0.91600000000000004},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1619999999999999,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.97599999999999998,"15min":1.0609999999999999},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.387,"5min":1.5580000000000001,"15min":3.4199999999999999},"last":1.2949999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.075,"15min":1.1819999999999999},"min":{"1min":0.751,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":3.4950000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1,"5min":0.95499999999999996,"15min":1.0840000000000001},"min":{"1min":0.60299999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4279999999999999,"5min":1.55,"15min":4.2030000000000003},"last":0.93999999999999995}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2789999999999999,"15min":1.345},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8779999999999999,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.56999999999999995},"max":{"1min":1.6299999999999999,"5min":1.681,"15min":2.6960000000000002},"last":0.75900000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.296},"min":{"1min":0.93400000000000005,"5min":0.82999999999999996,"15min":0.69599999999999995},"max":{"1min":1.7130000000000001,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.91100000000000003,"5min":0.83299999999999996,"15min":0.69399999999999995},"max":{"1min":1.915,"5min":1.915,"15min":3.8420000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3240000000000001,"15min":1.4470000000000001},"min":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9930000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.23},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.333,"15min":1.4610000000000001},"min":{"1min":0.997,"5min":0.84499999999999997,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.917,"15min":3.214},"last":1.171}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.359,"15min":1.5069999999999999},"min":{"1min":1.028,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":4.0910000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.337,"15min":1.452},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":4.6390000000000002},"last":1.0629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2199552,"data_stored":1372467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.94499999999999995},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.129,"5min":1.53,"15min":2.2250000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.94599999999999995,"15min":1.077},"min":{"1min":0.80500000000000005,"5min":0.505,"15min":0.499},"max":{"1min":1.4239999999999999,"5min":1.73,"15min":2.3599999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.89200000000000002,"15min":0.94399999999999995},"min":{"1min":0.57899999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2649999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.94199999999999995},"min":{"1min":0.64000000000000001,"5min":0.497,"15min":0.45300000000000001},"max":{"1min":1.1879999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.69199999999999995,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.4630000000000001,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.151,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.609,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.149}]},{"osd":4,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2529999999999999,"15min":1.3200000000000001},"min":{"1min":0.86399999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6459999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.198},{"interface":"front","average":{"1min":1.306,"5min":1.2629999999999999,"15min":1.333},"min":{"1min":0.92800000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.641,"5min":1.738,"15min":2.7799999999999998},"last":1.218}]},{"osd":5,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.2549999999999999},"min":{"1min":0.80800000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":1.758,"15min":2.0579999999999998},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.891,"5min":1.891,"15min":2.0030000000000001},"last":0.93799999999999994}]},{"osd":6,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":2.1000000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.266,"15min":1.373},"min":{"1min":0.97399999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7030000000000001,"5min":1.8300000000000001,"15min":2.3889999999999998},"last":1.022}]},{"osd":7,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.333,"15min":1.4870000000000001},"min":{"1min":1.131,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7829999999999999,"5min":1.9339999999999999,"15min":4.9400000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.3220000000000001,"15min":1.46},"min":{"1min":0.95099999999999996,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.8280000000000001,"5min":1.875,"15min":4.8250000000000002},"last":1.107}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:03:06.922 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-19T18:03:06.997 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T18:03:06.993+0000 7f3aace45700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:03:07.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 Processor -- start 2023-12-19T18:03:07.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 -- start start 2023-12-19T18:03:07.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe24815ab50 0x7fe2480ccd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe24815af30 0x7fe2480cd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24806cbb0 con 0x7fe24806f4a0 2023-12-19T18:03:07.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24806fa10 con 0x7fe24815af30 2023-12-19T18:03:07.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.121+0000 7fe24d56e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24806fcf0 con 0x7fe24815ab50 2023-12-19T18:03:07.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe24815af30 0x7fe2480cd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fe24815af30 0x7fe2480cd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47236/0 (socket says 172.21.15.45:47236) 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 -- 172.21.15.45:0/3107323603 learned_addr learned my addr 172.21.15.45:0/3107323603 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe246ffd700 1 --2- 172.21.15.45:0/3107323603 >> v2:172.21.15.73:3300/0 conn(0x7fe24815ab50 0x7fe2480ccd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 -- 172.21.15.45:0/3107323603 >> v2:172.21.15.73:3300/0 conn(0x7fe24815ab50 msgr2=0x7fe2480ccd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 --2- 172.21.15.45:0/3107323603 >> v2:172.21.15.73:3300/0 conn(0x7fe24815ab50 0x7fe2480ccd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 -- 172.21.15.45:0/3107323603 >> v1:172.21.15.73:6789/0 conn(0x7fe24806f4a0 legacy=0x7fe24815e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 -- 172.21.15.45:0/3107323603 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24806ffd0 con 0x7fe24815af30 2023-12-19T18:03:07.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe246ffd700 1 --2- 172.21.15.45:0/3107323603 >> v2:172.21.15.73:3300/0 conn(0x7fe24815ab50 0x7fe2480ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:07.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe2467fc700 1 --2- 172.21.15.45:0/3107323603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24815af30 0x7fe2480cd2b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fe248070630 tx=0x7fe23c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede31a49fa1d3d8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:07.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe245ffb700 1 -- 172.21.15.45:0/3107323603 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00b8a0 con 0x7fe24815af30 2023-12-19T18:03:07.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe245ffb700 1 -- 172.21.15.45:0/3107323603 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00ba00 con 0x7fe24815af30 2023-12-19T18:03:07.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe245ffb700 1 -- 172.21.15.45:0/3107323603 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00bd90 con 0x7fe24815af30 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 -- 172.21.15.45:0/3107323603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24815af30 msgr2=0x7fe2480cd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3107323603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24815af30 0x7fe2480cd2b0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7fe248070630 tx=0x7fe23c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 -- 172.21.15.45:0/3107323603 shutdown_connections 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3107323603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24815af30 0x7fe2480cd2b0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3107323603 >> v2:172.21.15.73:3300/0 conn(0x7fe24815ab50 0x7fe2480ccd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 -- 172.21.15.45:0/3107323603 >> 172.21.15.45:0/3107323603 conn(0x7fe2480cba40 msgr2=0x7fe2480ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 -- 172.21.15.45:0/3107323603 shutdown_connections 2023-12-19T18:03:07.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.125+0000 7fe24d56e700 1 -- 172.21.15.45:0/3107323603 wait complete. 2023-12-19T18:03:07.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.129+0000 7fe24d56e700 1 Processor -- start 2023-12-19T18:03:07.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.129+0000 7fe24d56e700 1 -- start start 2023-12-19T18:03:07.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 0x7fe248144480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe24815ab50 0x7fe2480c6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe24815af30 0x7fe2480c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2481449c0 con 0x7fe24806f4a0 2023-12-19T18:03:07.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2480c5b00 con 0x7fe24815ab50 2023-12-19T18:03:07.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2480c7dd0 con 0x7fe24815af30 2023-12-19T18:03:07.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 0x7fe248144480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 0x7fe248144480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47252/0 (socket says 172.21.15.45:47252) 2023-12-19T18:03:07.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 -- 172.21.15.45:0/3501626724 learned_addr learned my addr 172.21.15.45:0/3501626724 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:07.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe2467fc700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe24815ab50 0x7fe2480c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe2477fe700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe24815af30 0x7fe2480c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 -- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe24815af30 msgr2=0x7fe2480c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe24815af30 0x7fe2480c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 -- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe24815ab50 msgr2=0x7fe2480c6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe24815ab50 0x7fe2480c6570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 -- 172.21.15.45:0/3501626724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c009570 con 0x7fe24806f4a0 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe246ffd700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 0x7fe248144480 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fe23800e880 tx=0x7fe23800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238013610 con 0x7fe24806f4a0 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe238013770 con 0x7fe24806f4a0 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2480c5d70 con 0x7fe24806f4a0 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe238013b00 con 0x7fe24806f4a0 2023-12-19T18:03:07.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.133+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe248151bb0 con 0x7fe24806f4a0 2023-12-19T18:03:07.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.137+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24804ed30 con 0x7fe24806f4a0 2023-12-19T18:03:07.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.137+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe238013c60 con 0x7fe24806f4a0 2023-12-19T18:03:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.137+0000 7fe22f7fe700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe234065ad0 0x7fe234067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.137+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe238082f00 con 0x7fe24806f4a0 2023-12-19T18:03:07.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.141+0000 7fe2467fc700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe234065ad0 0x7fe234067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.141+0000 7fe2467fc700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe234065ad0 0x7fe234067f90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe24815b330 tx=0x7fe23c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:07.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.145+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe238050700 con 0x7fe24806f4a0 2023-12-19T18:03:07.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.381+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe24806c990 con 0x7fe24806f4a0 2023-12-19T18:03:07.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.381+0000 7fe22f7fe700 1 -- 172.21.15.45:0/3501626724 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1176 (secure 0 0 0) 0x7fe238053d20 con 0x7fe24806f4a0 2023-12-19T18:03:07.388 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:07.388 INFO:teuthology.orchestra.run.smithi045.stdout:{"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":712,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1703008286,"num_in_osds":8,"osd_in_since":1703008276,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592730,"bytes_used":268439552,"bytes_avail":772825673728,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":99,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"c","status":"up:active","gid":57470}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":26,"modified":"2023-12-19T18:02:56.449116+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe234065ad0 msgr2=0x7fe234067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe234065ad0 0x7fe234067f90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fe24815b330 tx=0x7fe23c008030 comp rx=0 tx=0).stop 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 msgr2=0x7fe248144480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 0x7fe248144480 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7fe23800e880 tx=0x7fe23800eb90 comp rx=0 tx=0).stop 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 shutdown_connections 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe234065ad0 0x7fe234067f90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe24815af30 0x7fe2480c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe24815ab50 0x7fe2480c6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 --2- 172.21.15.45:0/3501626724 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe24806f4a0 0x7fe248144480 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 >> 172.21.15.45:0/3501626724 conn(0x7fe2480cba40 msgr2=0x7fe24806de80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 shutdown_connections 2023-12-19T18:03:07.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.385+0000 7fe24d56e700 1 -- 172.21.15.45:0/3501626724 wait complete. 2023-12-19T18:03:07.416 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-19T18:03:07.416 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:03:07.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.633+0000 7f39b5c69700 1 Processor -- start 2023-12-19T18:03:07.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.637+0000 7f39b5c69700 1 -- start start 2023-12-19T18:03:07.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.637+0000 7f39b5c69700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f39b0159590 0x7f39b006ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39b5c69700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b00c3e20 con 0x7f39b01591b0 2023-12-19T18:03:07.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39b5c69700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b00ca7f0 con 0x7f39b00c4120 2023-12-19T18:03:07.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39b5c69700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b00cadb0 con 0x7f39b0159590 2023-12-19T18:03:07.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39b4c67700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f39b01591b0 0x7f39b00c3710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:56394/0 (socket says 172.21.15.45:56394) 2023-12-19T18:03:07.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39b4c67700 1 -- 172.21.15.45:0/1843285209 learned_addr learned my addr 172.21.15.45:0/1843285209 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:07.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39a7fff700 1 --2- 172.21.15.45:0/1843285209 >> v2:172.21.15.73:3300/0 conn(0x7f39b0159590 0x7f39b006ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39a7fff700 1 -- 172.21.15.45:0/1843285209 >> v1:172.21.15.73:6789/0 conn(0x7f39b00c4120 legacy=0x7f39b006d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39a7fff700 1 -- 172.21.15.45:0/1843285209 >> v1:172.21.15.45:6789/0 conn(0x7f39b01591b0 legacy=0x7f39b00c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39a7fff700 1 -- 172.21.15.45:0/1843285209 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b00caad0 con 0x7f39b0159590 2023-12-19T18:03:07.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.641+0000 7f39a7fff700 1 --2- 172.21.15.45:0/1843285209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b0159590 0x7f39b006ea90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009850 tx=0x7f39a0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c7a9ba41917a0ec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:07.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.645+0000 7f39a77fe700 1 -- 172.21.15.45:0/1843285209 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0011830 con 0x7f39b0159590 2023-12-19T18:03:07.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.645+0000 7f39a77fe700 1 -- 172.21.15.45:0/1843285209 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a0011990 con 0x7f39b0159590 2023-12-19T18:03:07.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.645+0000 7f39a77fe700 1 -- 172.21.15.45:0/1843285209 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a0011d20 con 0x7f39b0159590 2023-12-19T18:03:07.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.645+0000 7f39b5c69700 1 -- 172.21.15.45:0/1843285209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b0159590 msgr2=0x7f39b006ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.645+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1843285209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b0159590 0x7f39b006ea90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f39a0009850 tx=0x7f39a0009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 -- 172.21.15.45:0/1843285209 shutdown_connections 2023-12-19T18:03:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1843285209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b0159590 0x7f39b006ea90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 -- 172.21.15.45:0/1843285209 >> 172.21.15.45:0/1843285209 conn(0x7f39b00cb900 msgr2=0x7f39b00b04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 -- 172.21.15.45:0/1843285209 shutdown_connections 2023-12-19T18:03:07.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 -- 172.21.15.45:0/1843285209 wait complete. 2023-12-19T18:03:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 Processor -- start 2023-12-19T18:03:07.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.649+0000 7f39b5c69700 1 -- start start 2023-12-19T18:03:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5c69700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39b00c4120 0x7f39b00b3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5c69700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 0x7f39b015ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5c69700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b006f8c0 0x7f39b015b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5c69700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b00b4200 con 0x7f39b01591b0 2023-12-19T18:03:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5c69700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b01f3b90 con 0x7f39b006f8c0 2023-12-19T18:03:07.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5c69700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b01f3010 con 0x7f39b00c4120 2023-12-19T18:03:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 0x7f39b015ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39a7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 0x7f39b015ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47260/0 (socket says 172.21.15.45:47260) 2023-12-19T18:03:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39a7fff700 1 -- 172.21.15.45:0/1476890959 learned_addr learned my addr 172.21.15.45:0/1476890959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b006f8c0 0x7f39b015b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.659 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b4c67700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39b00c4120 0x7f39b00b3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 -- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39b00c4120 msgr2=0x7f39b00b3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39b00c4120 0x7f39b00b3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 -- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 msgr2=0x7f39b015ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 0x7f39b015ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 -- 172.21.15.45:0/1476890959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a00094b0 con 0x7f39b006f8c0 2023-12-19T18:03:07.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39a7fff700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 0x7f39b015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39b5468700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b006f8c0 0x7f39b015b630 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f39a8001eb0 tx=0x7f39a800c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.653+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80052d0 con 0x7f39b006f8c0 2023-12-19T18:03:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.657+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8005430 con 0x7f39b006f8c0 2023-12-19T18:03:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.657+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a80055a0 con 0x7f39b006f8c0 2023-12-19T18:03:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.657+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b01f32f0 con 0x7f39b006f8c0 2023-12-19T18:03:07.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.657+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b01f38b0 con 0x7f39b006f8c0 2023-12-19T18:03:07.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.657+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b00ca3b0 con 0x7f39b006f8c0 2023-12-19T18:03:07.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.661+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f39a8003af0 con 0x7f39b006f8c0 2023-12-19T18:03:07.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.661+0000 7f39a57fa700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f399c065ad0 0x7f399c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.661+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f39a80826d0 con 0x7f39b006f8c0 2023-12-19T18:03:07.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.661+0000 7f39b4c67700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f399c065ad0 0x7f399c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:07.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.661+0000 7f39b4c67700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f399c065ad0 0x7f399c067f90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0012e0 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:07.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.669+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f39a804ff40 con 0x7f39b006f8c0 2023-12-19T18:03:07.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.857+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f39b006d3e0 con 0x7f399c065ad0 2023-12-19T18:03:07.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.869+0000 7f39a57fa700 1 -- 172.21.15.45:0/1476890959 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287033 (secure 0 0 0) 0x7f39ac00fab0 con 0x7f399c065ad0 2023-12-19T18:03:07.879 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f399c065ad0 msgr2=0x7f399c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f399c065ad0 0x7f399c067f90 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f39ac0012e0 tx=0x7f39ac009040 comp rx=0 tx=0).stop 2023-12-19T18:03:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b006f8c0 msgr2=0x7f39b015b630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:07.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b006f8c0 0x7f39b015b630 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f39a8001eb0 tx=0x7f39a800c6e0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 shutdown_connections 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f399c065ad0 0x7f399c067f90 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39b006f8c0 0x7f39b015b630 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f39b01591b0 0x7f39b015ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 --2- 172.21.15.45:0/1476890959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f39b00c4120 0x7f39b00b3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 >> 172.21.15.45:0/1476890959 conn(0x7f39b00cb900 msgr2=0x7f39b01e32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 shutdown_connections 2023-12-19T18:03:07.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:07.881+0000 7f39b5c69700 1 -- 172.21.15.45:0/1476890959 wait complete. 2023-12-19T18:03:07.887 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:03:07.907 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":472,"stamp":"2023-12-19T18:03:06.452063+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262148,"kb_used_data":13764,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754712572,"statfs":{"total":773094113280,"available":772825673728,"internally_reserved":0,"allocated":14094336,"data_stored":7449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001882"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530724+0000","last_change":"2023-12-19T18:03:01.528559+0000","last_active":"2023-12-19T18:03:01.530724+0000","last_peered":"2023-12-19T18:03:01.530724+0000","last_clean":"2023-12-19T18:03:01.530724+0000","last_became_active":"2023-12-19T18:03:01.528053+0000","last_became_peered":"2023-12-19T18:03:01.528053+0000","last_unstale":"2023-12-19T18:03:01.530724+0000","last_undegraded":"2023-12-19T18:03:01.530724+0000","last_fullsized":"2023-12-19T18:03:01.530724+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528837+0000","last_change":"2023-12-19T18:03:01.515763+0000","last_active":"2023-12-19T18:03:01.528837+0000","last_peered":"2023-12-19T18:03:01.528837+0000","last_clean":"2023-12-19T18:03:01.528837+0000","last_became_active":"2023-12-19T18:03:01.515391+0000","last_became_peered":"2023-12-19T18:03:01.515391+0000","last_unstale":"2023-12-19T18:03:01.528837+0000","last_undegraded":"2023-12-19T18:03:01.528837+0000","last_fullsized":"2023-12-19T18:03:01.528837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:53.820748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529918+0000","last_change":"2023-12-19T18:03:01.522348+0000","last_active":"2023-12-19T18:03:01.529918+0000","last_peered":"2023-12-19T18:03:01.529918+0000","last_clean":"2023-12-19T18:03:01.529918+0000","last_became_active":"2023-12-19T18:03:01.522042+0000","last_became_peered":"2023-12-19T18:03:01.522042+0000","last_unstale":"2023-12-19T18:03:01.529918+0000","last_undegraded":"2023-12-19T18:03:01.529918+0000","last_fullsized":"2023-12-19T18:03:01.529918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:49.326082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522604+0000","last_change":"2023-12-19T18:03:01.513678+0000","last_active":"2023-12-19T18:03:01.522604+0000","last_peered":"2023-12-19T18:03:01.522604+0000","last_clean":"2023-12-19T18:03:01.522604+0000","last_became_active":"2023-12-19T18:03:01.513401+0000","last_became_peered":"2023-12-19T18:03:01.513401+0000","last_unstale":"2023-12-19T18:03:01.522604+0000","last_undegraded":"2023-12-19T18:03:01.522604+0000","last_fullsized":"2023-12-19T18:03:01.522604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:09:24.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527137+0000","last_change":"2023-12-19T18:03:01.518794+0000","last_active":"2023-12-19T18:03:01.527137+0000","last_peered":"2023-12-19T18:03:01.527137+0000","last_clean":"2023-12-19T18:03:01.527137+0000","last_became_active":"2023-12-19T18:03:01.518534+0000","last_became_peered":"2023-12-19T18:03:01.518534+0000","last_unstale":"2023-12-19T18:03:01.527137+0000","last_undegraded":"2023-12-19T18:03:01.527137+0000","last_fullsized":"2023-12-19T18:03:01.527137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.520219+0000","last_change":"2023-12-19T18:03:01.515271+0000","last_active":"2023-12-19T18:03:01.520219+0000","last_peered":"2023-12-19T18:03:01.520219+0000","last_clean":"2023-12-19T18:03:01.520219+0000","last_became_active":"2023-12-19T18:03:01.515009+0000","last_became_peered":"2023-12-19T18:03:01.515009+0000","last_unstale":"2023-12-19T18:03:01.520219+0000","last_undegraded":"2023-12-19T18:03:01.520219+0000","last_fullsized":"2023-12-19T18:03:01.520219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:26:31.507606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527771+0000","last_change":"2023-12-19T18:03:01.522171+0000","last_active":"2023-12-19T18:03:01.527771+0000","last_peered":"2023-12-19T18:03:01.527771+0000","last_clean":"2023-12-19T18:03:01.527771+0000","last_became_active":"2023-12-19T18:03:01.521093+0000","last_became_peered":"2023-12-19T18:03:01.521093+0000","last_unstale":"2023-12-19T18:03:01.527771+0000","last_undegraded":"2023-12-19T18:03:01.527771+0000","last_fullsized":"2023-12-19T18:03:01.527771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.842744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530628+0000","last_change":"2023-12-19T18:03:01.524263+0000","last_active":"2023-12-19T18:03:01.530628+0000","last_peered":"2023-12-19T18:03:01.530628+0000","last_clean":"2023-12-19T18:03:01.530628+0000","last_became_active":"2023-12-19T18:03:01.523901+0000","last_became_peered":"2023-12-19T18:03:01.523901+0000","last_unstale":"2023-12-19T18:03:01.530628+0000","last_undegraded":"2023-12-19T18:03:01.530628+0000","last_fullsized":"2023-12-19T18:03:01.530628+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:47.570305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.517954+0000","last_change":"2023-12-19T18:03:01.510715+0000","last_active":"2023-12-19T18:03:01.517954+0000","last_peered":"2023-12-19T18:03:01.517954+0000","last_clean":"2023-12-19T18:03:01.517954+0000","last_became_active":"2023-12-19T18:03:01.510278+0000","last_became_peered":"2023-12-19T18:03:01.510278+0000","last_unstale":"2023-12-19T18:03:01.517954+0000","last_undegraded":"2023-12-19T18:03:01.517954+0000","last_fullsized":"2023-12-19T18:03:01.517954+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:05.296698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529865+0000","last_change":"2023-12-19T18:03:01.525079+0000","last_active":"2023-12-19T18:03:01.529865+0000","last_peered":"2023-12-19T18:03:01.529865+0000","last_clean":"2023-12-19T18:03:01.529865+0000","last_became_active":"2023-12-19T18:03:01.524733+0000","last_became_peered":"2023-12-19T18:03:01.524733+0000","last_unstale":"2023-12-19T18:03:01.529865+0000","last_undegraded":"2023-12-19T18:03:01.529865+0000","last_fullsized":"2023-12-19T18:03:01.529865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524580+0000","last_change":"2023-12-19T18:03:01.516482+0000","last_active":"2023-12-19T18:03:01.524580+0000","last_peered":"2023-12-19T18:03:01.524580+0000","last_clean":"2023-12-19T18:03:01.524580+0000","last_became_active":"2023-12-19T18:03:01.516203+0000","last_became_peered":"2023-12-19T18:03:01.516203+0000","last_unstale":"2023-12-19T18:03:01.524580+0000","last_undegraded":"2023-12-19T18:03:01.524580+0000","last_fullsized":"2023-12-19T18:03:01.524580+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527320+0000","last_change":"2023-12-19T18:03:01.520729+0000","last_active":"2023-12-19T18:03:01.527320+0000","last_peered":"2023-12-19T18:03:01.527320+0000","last_clean":"2023-12-19T18:03:01.527320+0000","last_became_active":"2023-12-19T18:03:01.520331+0000","last_became_peered":"2023-12-19T18:03:01.520331+0000","last_unstale":"2023-12-19T18:03:01.527320+0000","last_undegraded":"2023-12-19T18:03:01.527320+0000","last_fullsized":"2023-12-19T18:03:01.527320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:36.056772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529261+0000","last_change":"2023-12-19T18:03:01.522128+0000","last_active":"2023-12-19T18:03:01.529261+0000","last_peered":"2023-12-19T18:03:01.529261+0000","last_clean":"2023-12-19T18:03:01.529261+0000","last_became_active":"2023-12-19T18:03:01.521849+0000","last_became_peered":"2023-12-19T18:03:01.521849+0000","last_unstale":"2023-12-19T18:03:01.529261+0000","last_undegraded":"2023-12-19T18:03:01.529261+0000","last_fullsized":"2023-12-19T18:03:01.529261+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529831+0000","last_change":"2023-12-19T18:03:01.521821+0000","last_active":"2023-12-19T18:03:01.529831+0000","last_peered":"2023-12-19T18:03:01.529831+0000","last_clean":"2023-12-19T18:03:01.529831+0000","last_became_active":"2023-12-19T18:03:01.521471+0000","last_became_peered":"2023-12-19T18:03:01.521471+0000","last_unstale":"2023-12-19T18:03:01.529831+0000","last_undegraded":"2023-12-19T18:03:01.529831+0000","last_fullsized":"2023-12-19T18:03:01.529831+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:24.463386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524214+0000","last_change":"2023-12-19T18:03:01.514815+0000","last_active":"2023-12-19T18:03:01.524214+0000","last_peered":"2023-12-19T18:03:01.524214+0000","last_clean":"2023-12-19T18:03:01.524214+0000","last_became_active":"2023-12-19T18:03:01.514537+0000","last_became_peered":"2023-12-19T18:03:01.514537+0000","last_unstale":"2023-12-19T18:03:01.524214+0000","last_undegraded":"2023-12-19T18:03:01.524214+0000","last_fullsized":"2023-12-19T18:03:01.524214+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522052+0000","last_change":"2023-12-19T18:03:01.515786+0000","last_active":"2023-12-19T18:03:01.522052+0000","last_peered":"2023-12-19T18:03:01.522052+0000","last_clean":"2023-12-19T18:03:01.522052+0000","last_became_active":"2023-12-19T18:03:01.515521+0000","last_became_peered":"2023-12-19T18:03:01.515521+0000","last_unstale":"2023-12-19T18:03:01.522052+0000","last_undegraded":"2023-12-19T18:03:01.522052+0000","last_fullsized":"2023-12-19T18:03:01.522052+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:12.676472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529583+0000","last_change":"2023-12-19T18:03:01.522484+0000","last_active":"2023-12-19T18:03:01.529583+0000","last_peered":"2023-12-19T18:03:01.529583+0000","last_clean":"2023-12-19T18:03:01.529583+0000","last_became_active":"2023-12-19T18:03:01.522110+0000","last_became_peered":"2023-12-19T18:03:01.522110+0000","last_unstale":"2023-12-19T18:03:01.529583+0000","last_undegraded":"2023-12-19T18:03:01.529583+0000","last_fullsized":"2023-12-19T18:03:01.529583+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528270+0000","last_change":"2023-12-19T18:03:01.510928+0000","last_active":"2023-12-19T18:03:01.528270+0000","last_peered":"2023-12-19T18:03:01.528270+0000","last_clean":"2023-12-19T18:03:01.528270+0000","last_became_active":"2023-12-19T18:03:01.510469+0000","last_became_peered":"2023-12-19T18:03:01.510469+0000","last_unstale":"2023-12-19T18:03:01.528270+0000","last_undegraded":"2023-12-19T18:03:01.528270+0000","last_fullsized":"2023-12-19T18:03:01.528270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:10.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526108+0000","last_change":"2023-12-19T18:03:01.522447+0000","last_active":"2023-12-19T18:03:01.526108+0000","last_peered":"2023-12-19T18:03:01.526108+0000","last_clean":"2023-12-19T18:03:01.526108+0000","last_became_active":"2023-12-19T18:03:01.521599+0000","last_became_peered":"2023-12-19T18:03:01.521599+0000","last_unstale":"2023-12-19T18:03:01.526108+0000","last_undegraded":"2023-12-19T18:03:01.526108+0000","last_fullsized":"2023-12-19T18:03:01.526108+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525374+0000","last_change":"2023-12-19T18:03:01.513609+0000","last_active":"2023-12-19T18:03:01.525374+0000","last_peered":"2023-12-19T18:03:01.525374+0000","last_clean":"2023-12-19T18:03:01.525374+0000","last_became_active":"2023-12-19T18:03:01.513287+0000","last_became_peered":"2023-12-19T18:03:01.513287+0000","last_unstale":"2023-12-19T18:03:01.525374+0000","last_undegraded":"2023-12-19T18:03:01.525374+0000","last_fullsized":"2023-12-19T18:03:01.525374+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519969+0000","last_change":"2023-12-19T18:03:01.513578+0000","last_active":"2023-12-19T18:03:01.519969+0000","last_peered":"2023-12-19T18:03:01.519969+0000","last_clean":"2023-12-19T18:03:01.519969+0000","last_became_active":"2023-12-19T18:03:01.511971+0000","last_became_peered":"2023-12-19T18:03:01.511971+0000","last_unstale":"2023-12-19T18:03:01.519969+0000","last_undegraded":"2023-12-19T18:03:01.519969+0000","last_fullsized":"2023-12-19T18:03:01.519969+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:25.460640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524478+0000","last_change":"2023-12-19T18:03:01.514110+0000","last_active":"2023-12-19T18:03:01.524478+0000","last_peered":"2023-12-19T18:03:01.524478+0000","last_clean":"2023-12-19T18:03:01.524478+0000","last_became_active":"2023-12-19T18:03:01.513837+0000","last_became_peered":"2023-12-19T18:03:01.513837+0000","last_unstale":"2023-12-19T18:03:01.524478+0000","last_undegraded":"2023-12-19T18:03:01.524478+0000","last_fullsized":"2023-12-19T18:03:01.524478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.518191+0000","last_change":"2023-12-19T18:03:01.511423+0000","last_active":"2023-12-19T18:03:01.518191+0000","last_peered":"2023-12-19T18:03:01.518191+0000","last_clean":"2023-12-19T18:03:01.518191+0000","last_became_active":"2023-12-19T18:03:01.511160+0000","last_became_peered":"2023-12-19T18:03:01.511160+0000","last_unstale":"2023-12-19T18:03:01.518191+0000","last_undegraded":"2023-12-19T18:03:01.518191+0000","last_fullsized":"2023-12-19T18:03:01.518191+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:09:23.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528573+0000","last_change":"2023-12-19T18:03:01.522191+0000","last_active":"2023-12-19T18:03:01.528573+0000","last_peered":"2023-12-19T18:03:01.528573+0000","last_clean":"2023-12-19T18:03:01.528573+0000","last_became_active":"2023-12-19T18:03:01.521904+0000","last_became_peered":"2023-12-19T18:03:01.521904+0000","last_unstale":"2023-12-19T18:03:01.528573+0000","last_undegraded":"2023-12-19T18:03:01.528573+0000","last_fullsized":"2023-12-19T18:03:01.528573+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528541+0000","last_change":"2023-12-19T18:03:01.519293+0000","last_active":"2023-12-19T18:03:01.528541+0000","last_peered":"2023-12-19T18:03:01.528541+0000","last_clean":"2023-12-19T18:03:01.528541+0000","last_became_active":"2023-12-19T18:03:01.517195+0000","last_became_peered":"2023-12-19T18:03:01.517195+0000","last_unstale":"2023-12-19T18:03:01.528541+0000","last_undegraded":"2023-12-19T18:03:01.528541+0000","last_fullsized":"2023-12-19T18:03:01.528541+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530555+0000","last_change":"2023-12-19T18:03:01.527442+0000","last_active":"2023-12-19T18:03:01.530555+0000","last_peered":"2023-12-19T18:03:01.530555+0000","last_clean":"2023-12-19T18:03:01.530555+0000","last_became_active":"2023-12-19T18:03:01.527114+0000","last_became_peered":"2023-12-19T18:03:01.527114+0000","last_unstale":"2023-12-19T18:03:01.530555+0000","last_undegraded":"2023-12-19T18:03:01.530555+0000","last_fullsized":"2023-12-19T18:03:01.530555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521427+0000","last_change":"2023-12-19T18:03:01.511940+0000","last_active":"2023-12-19T18:03:01.521427+0000","last_peered":"2023-12-19T18:03:01.521427+0000","last_clean":"2023-12-19T18:03:01.521427+0000","last_became_active":"2023-12-19T18:03:01.510938+0000","last_became_peered":"2023-12-19T18:03:01.510938+0000","last_unstale":"2023-12-19T18:03:01.521427+0000","last_undegraded":"2023-12-19T18:03:01.521427+0000","last_fullsized":"2023-12-19T18:03:01.521427+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527301+0000","last_change":"2023-12-19T18:03:01.520569+0000","last_active":"2023-12-19T18:03:01.527301+0000","last_peered":"2023-12-19T18:03:01.527301+0000","last_clean":"2023-12-19T18:03:01.527301+0000","last_became_active":"2023-12-19T18:03:01.519863+0000","last_became_peered":"2023-12-19T18:03:01.519863+0000","last_unstale":"2023-12-19T18:03:01.527301+0000","last_undegraded":"2023-12-19T18:03:01.527301+0000","last_fullsized":"2023-12-19T18:03:01.527301+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:50.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525995+0000","last_change":"2023-12-19T18:03:01.511551+0000","last_active":"2023-12-19T18:03:01.525995+0000","last_peered":"2023-12-19T18:03:01.525995+0000","last_clean":"2023-12-19T18:03:01.525995+0000","last_became_active":"2023-12-19T18:03:01.511295+0000","last_became_peered":"2023-12-19T18:03:01.511295+0000","last_unstale":"2023-12-19T18:03:01.525995+0000","last_undegraded":"2023-12-19T18:03:01.525995+0000","last_fullsized":"2023-12-19T18:03:01.525995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:43.950078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528947+0000","last_change":"2023-12-19T18:03:01.515786+0000","last_active":"2023-12-19T18:03:01.528947+0000","last_peered":"2023-12-19T18:03:01.528947+0000","last_clean":"2023-12-19T18:03:01.528947+0000","last_became_active":"2023-12-19T18:03:01.515500+0000","last_became_peered":"2023-12-19T18:03:01.515500+0000","last_unstale":"2023-12-19T18:03:01.528947+0000","last_undegraded":"2023-12-19T18:03:01.528947+0000","last_fullsized":"2023-12-19T18:03:01.528947+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:27.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524875+0000","last_change":"2023-12-19T18:03:01.516316+0000","last_active":"2023-12-19T18:03:01.524875+0000","last_peered":"2023-12-19T18:03:01.524875+0000","last_clean":"2023-12-19T18:03:01.524875+0000","last_became_active":"2023-12-19T18:03:01.516021+0000","last_became_peered":"2023-12-19T18:03:01.516021+0000","last_unstale":"2023-12-19T18:03:01.524875+0000","last_undegraded":"2023-12-19T18:03:01.524875+0000","last_fullsized":"2023-12-19T18:03:01.524875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528592+0000","last_change":"2023-12-19T18:03:01.522278+0000","last_active":"2023-12-19T18:03:01.528592+0000","last_peered":"2023-12-19T18:03:01.528592+0000","last_clean":"2023-12-19T18:03:01.528592+0000","last_became_active":"2023-12-19T18:03:01.521996+0000","last_became_peered":"2023-12-19T18:03:01.521996+0000","last_unstale":"2023-12-19T18:03:01.528592+0000","last_undegraded":"2023-12-19T18:03:01.528592+0000","last_fullsized":"2023-12-19T18:03:01.528592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529818+0000","last_change":"2023-12-19T18:03:01.522848+0000","last_active":"2023-12-19T18:03:01.529818+0000","last_peered":"2023-12-19T18:03:01.529818+0000","last_clean":"2023-12-19T18:03:01.529818+0000","last_became_active":"2023-12-19T18:03:01.522590+0000","last_became_peered":"2023-12-19T18:03:01.522590+0000","last_unstale":"2023-12-19T18:03:01.529818+0000","last_undegraded":"2023-12-19T18:03:01.529818+0000","last_fullsized":"2023-12-19T18:03:01.529818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:36.817532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530700+0000","last_change":"2023-12-19T18:03:01.031247+0000","last_active":"2023-12-19T18:03:01.530700+0000","last_peered":"2023-12-19T18:03:01.530700+0000","last_clean":"2023-12-19T18:03:01.530700+0000","last_became_active":"2023-12-19T18:03:01.029901+0000","last_became_peered":"2023-12-19T18:03:01.029901+0000","last_unstale":"2023-12-19T18:03:01.530700+0000","last_undegraded":"2023-12-19T18:03:01.530700+0000","last_fullsized":"2023-12-19T18:03:01.530700+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:39.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524851+0000","last_change":"2023-12-19T18:03:01.518433+0000","last_active":"2023-12-19T18:03:01.524851+0000","last_peered":"2023-12-19T18:03:01.524851+0000","last_clean":"2023-12-19T18:03:01.524851+0000","last_became_active":"2023-12-19T18:03:01.518170+0000","last_became_peered":"2023-12-19T18:03:01.518170+0000","last_unstale":"2023-12-19T18:03:01.524851+0000","last_undegraded":"2023-12-19T18:03:01.524851+0000","last_fullsized":"2023-12-19T18:03:01.524851+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:10.478715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528394+0000","last_change":"2023-12-19T18:03:01.043692+0000","last_active":"2023-12-19T18:03:01.528394+0000","last_peered":"2023-12-19T18:03:01.528394+0000","last_clean":"2023-12-19T18:03:01.528394+0000","last_became_active":"2023-12-19T18:03:01.043406+0000","last_became_peered":"2023-12-19T18:03:01.043406+0000","last_unstale":"2023-12-19T18:03:01.528394+0000","last_undegraded":"2023-12-19T18:03:01.528394+0000","last_fullsized":"2023-12-19T18:03:01.528394+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525008+0000","last_change":"2023-12-19T18:03:01.515860+0000","last_active":"2023-12-19T18:03:01.525008+0000","last_peered":"2023-12-19T18:03:01.525008+0000","last_clean":"2023-12-19T18:03:01.525008+0000","last_became_active":"2023-12-19T18:03:01.515586+0000","last_became_peered":"2023-12-19T18:03:01.515586+0000","last_unstale":"2023-12-19T18:03:01.525008+0000","last_undegraded":"2023-12-19T18:03:01.525008+0000","last_fullsized":"2023-12-19T18:03:01.525008+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532808+0000","last_change":"2023-12-19T18:03:01.044240+0000","last_active":"2023-12-19T18:03:01.532808+0000","last_peered":"2023-12-19T18:03:01.532808+0000","last_clean":"2023-12-19T18:03:01.532808+0000","last_became_active":"2023-12-19T18:03:01.043989+0000","last_became_peered":"2023-12-19T18:03:01.043989+0000","last_unstale":"2023-12-19T18:03:01.532808+0000","last_undegraded":"2023-12-19T18:03:01.532808+0000","last_fullsized":"2023-12-19T18:03:01.532808+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.479629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524871+0000","last_change":"2023-12-19T18:03:01.514941+0000","last_active":"2023-12-19T18:03:01.524871+0000","last_peered":"2023-12-19T18:03:01.524871+0000","last_clean":"2023-12-19T18:03:01.524871+0000","last_became_active":"2023-12-19T18:03:01.511917+0000","last_became_peered":"2023-12-19T18:03:01.511917+0000","last_unstale":"2023-12-19T18:03:01.524871+0000","last_undegraded":"2023-12-19T18:03:01.524871+0000","last_fullsized":"2023-12-19T18:03:01.524871+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:52.886192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530719+0000","last_change":"2023-12-19T18:03:01.043134+0000","last_active":"2023-12-19T18:03:01.530719+0000","last_peered":"2023-12-19T18:03:01.530719+0000","last_clean":"2023-12-19T18:03:01.530719+0000","last_became_active":"2023-12-19T18:03:01.042431+0000","last_became_peered":"2023-12-19T18:03:01.042431+0000","last_unstale":"2023-12-19T18:03:01.530719+0000","last_undegraded":"2023-12-19T18:03:01.530719+0000","last_fullsized":"2023-12-19T18:03:01.530719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:32.570496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529172+0000","last_change":"2023-12-19T18:03:01.518227+0000","last_active":"2023-12-19T18:03:01.529172+0000","last_peered":"2023-12-19T18:03:01.529172+0000","last_clean":"2023-12-19T18:03:01.529172+0000","last_became_active":"2023-12-19T18:03:01.517946+0000","last_became_peered":"2023-12-19T18:03:01.517946+0000","last_unstale":"2023-12-19T18:03:01.529172+0000","last_undegraded":"2023-12-19T18:03:01.529172+0000","last_fullsized":"2023-12-19T18:03:01.529172+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.533045+0000","last_change":"2023-12-19T18:03:01.045236+0000","last_active":"2023-12-19T18:03:01.533045+0000","last_peered":"2023-12-19T18:03:01.533045+0000","last_clean":"2023-12-19T18:03:01.533045+0000","last_became_active":"2023-12-19T18:03:01.044907+0000","last_became_peered":"2023-12-19T18:03:01.044907+0000","last_unstale":"2023-12-19T18:03:01.533045+0000","last_undegraded":"2023-12-19T18:03:01.533045+0000","last_fullsized":"2023-12-19T18:03:01.533045+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519111+0000","last_change":"2023-12-19T18:03:01.509590+0000","last_active":"2023-12-19T18:03:01.519111+0000","last_peered":"2023-12-19T18:03:01.519111+0000","last_clean":"2023-12-19T18:03:01.519111+0000","last_became_active":"2023-12-19T18:03:01.509262+0000","last_became_peered":"2023-12-19T18:03:01.509262+0000","last_unstale":"2023-12-19T18:03:01.519111+0000","last_undegraded":"2023-12-19T18:03:01.519111+0000","last_fullsized":"2023-12-19T18:03:01.519111+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.531136+0000","last_change":"2023-12-19T18:03:01.041854+0000","last_active":"2023-12-19T18:03:01.531136+0000","last_peered":"2023-12-19T18:03:01.531136+0000","last_clean":"2023-12-19T18:03:01.531136+0000","last_became_active":"2023-12-19T18:03:01.040426+0000","last_became_peered":"2023-12-19T18:03:01.040426+0000","last_unstale":"2023-12-19T18:03:01.531136+0000","last_undegraded":"2023-12-19T18:03:01.531136+0000","last_fullsized":"2023-12-19T18:03:01.531136+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:25.067419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528829+0000","last_change":"2023-12-19T18:03:01.515644+0000","last_active":"2023-12-19T18:03:01.528829+0000","last_peered":"2023-12-19T18:03:01.528829+0000","last_clean":"2023-12-19T18:03:01.528829+0000","last_became_active":"2023-12-19T18:03:01.512734+0000","last_became_peered":"2023-12-19T18:03:01.512734+0000","last_unstale":"2023-12-19T18:03:01.528829+0000","last_undegraded":"2023-12-19T18:03:01.528829+0000","last_fullsized":"2023-12-19T18:03:01.528829+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:17.957563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.496190+0000","last_change":"2023-12-19T18:03:01.037069+0000","last_active":"2023-12-19T18:03:01.496190+0000","last_peered":"2023-12-19T18:03:01.496190+0000","last_clean":"2023-12-19T18:03:01.496190+0000","last_became_active":"2023-12-19T18:03:01.036794+0000","last_became_peered":"2023-12-19T18:03:01.036794+0000","last_unstale":"2023-12-19T18:03:01.496190+0000","last_undegraded":"2023-12-19T18:03:01.496190+0000","last_fullsized":"2023-12-19T18:03:01.496190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:42.153731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.531078+0000","last_change":"2023-12-19T18:03:01.526473+0000","last_active":"2023-12-19T18:03:01.531078+0000","last_peered":"2023-12-19T18:03:01.531078+0000","last_clean":"2023-12-19T18:03:01.531078+0000","last_became_active":"2023-12-19T18:03:01.526149+0000","last_became_peered":"2023-12-19T18:03:01.526149+0000","last_unstale":"2023-12-19T18:03:01.531078+0000","last_undegraded":"2023-12-19T18:03:01.531078+0000","last_fullsized":"2023-12-19T18:03:01.531078+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:48.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.504573+0000","last_change":"2023-12-19T18:03:01.041603+0000","last_active":"2023-12-19T18:03:01.504573+0000","last_peered":"2023-12-19T18:03:01.504573+0000","last_clean":"2023-12-19T18:03:01.504573+0000","last_became_active":"2023-12-19T18:03:01.040273+0000","last_became_peered":"2023-12-19T18:03:01.040273+0000","last_unstale":"2023-12-19T18:03:01.504573+0000","last_undegraded":"2023-12-19T18:03:01.504573+0000","last_fullsized":"2023-12-19T18:03:01.504573+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:23.457722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.520029+0000","last_change":"2023-12-19T18:03:01.510473+0000","last_active":"2023-12-19T18:03:01.520029+0000","last_peered":"2023-12-19T18:03:01.520029+0000","last_clean":"2023-12-19T18:03:01.520029+0000","last_became_active":"2023-12-19T18:03:01.510147+0000","last_became_peered":"2023-12-19T18:03:01.510147+0000","last_unstale":"2023-12-19T18:03:01.520029+0000","last_undegraded":"2023-12-19T18:03:01.520029+0000","last_fullsized":"2023-12-19T18:03:01.520029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503580+0000","last_change":"2023-12-19T18:03:01.046117+0000","last_active":"2023-12-19T18:03:01.503580+0000","last_peered":"2023-12-19T18:03:01.503580+0000","last_clean":"2023-12-19T18:03:01.503580+0000","last_became_active":"2023-12-19T18:03:01.045799+0000","last_became_peered":"2023-12-19T18:03:01.045799+0000","last_unstale":"2023-12-19T18:03:01.503580+0000","last_undegraded":"2023-12-19T18:03:01.503580+0000","last_fullsized":"2023-12-19T18:03:01.503580+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524797+0000","last_change":"2023-12-19T18:03:01.515473+0000","last_active":"2023-12-19T18:03:01.524797+0000","last_peered":"2023-12-19T18:03:01.524797+0000","last_clean":"2023-12-19T18:03:01.524797+0000","last_became_active":"2023-12-19T18:03:01.512986+0000","last_became_peered":"2023-12-19T18:03:01.512986+0000","last_unstale":"2023-12-19T18:03:01.524797+0000","last_undegraded":"2023-12-19T18:03:01.524797+0000","last_fullsized":"2023-12-19T18:03:01.524797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.497069+0000","last_change":"2023-12-19T18:03:01.049167+0000","last_active":"2023-12-19T18:03:01.497069+0000","last_peered":"2023-12-19T18:03:01.497069+0000","last_clean":"2023-12-19T18:03:01.497069+0000","last_became_active":"2023-12-19T18:03:01.048925+0000","last_became_peered":"2023-12-19T18:03:01.048925+0000","last_unstale":"2023-12-19T18:03:01.497069+0000","last_undegraded":"2023-12-19T18:03:01.497069+0000","last_fullsized":"2023-12-19T18:03:01.497069+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527893+0000","last_change":"2023-12-19T18:03:01.509372+0000","last_active":"2023-12-19T18:03:01.527893+0000","last_peered":"2023-12-19T18:03:01.527893+0000","last_clean":"2023-12-19T18:03:01.527893+0000","last_became_active":"2023-12-19T18:03:01.509107+0000","last_became_peered":"2023-12-19T18:03:01.509107+0000","last_unstale":"2023-12-19T18:03:01.527893+0000","last_undegraded":"2023-12-19T18:03:01.527893+0000","last_fullsized":"2023-12-19T18:03:01.527893+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:02.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530837+0000","last_change":"2023-12-19T18:03:01.035484+0000","last_active":"2023-12-19T18:03:01.530837+0000","last_peered":"2023-12-19T18:03:01.530837+0000","last_clean":"2023-12-19T18:03:01.530837+0000","last_became_active":"2023-12-19T18:03:01.035096+0000","last_became_peered":"2023-12-19T18:03:01.035096+0000","last_unstale":"2023-12-19T18:03:01.530837+0000","last_undegraded":"2023-12-19T18:03:01.530837+0000","last_fullsized":"2023-12-19T18:03:01.530837+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:31:55.570736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525082+0000","last_change":"2023-12-19T18:03:01.517319+0000","last_active":"2023-12-19T18:03:01.525082+0000","last_peered":"2023-12-19T18:03:01.525082+0000","last_clean":"2023-12-19T18:03:01.525082+0000","last_became_active":"2023-12-19T18:03:01.515999+0000","last_became_peered":"2023-12-19T18:03:01.515999+0000","last_unstale":"2023-12-19T18:03:01.525082+0000","last_undegraded":"2023-12-19T18:03:01.525082+0000","last_fullsized":"2023-12-19T18:03:01.525082+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.533411+0000","last_change":"2023-12-19T18:03:01.043052+0000","last_active":"2023-12-19T18:03:01.533411+0000","last_peered":"2023-12-19T18:03:01.533411+0000","last_clean":"2023-12-19T18:03:01.533411+0000","last_became_active":"2023-12-19T18:03:01.042700+0000","last_became_peered":"2023-12-19T18:03:01.042700+0000","last_unstale":"2023-12-19T18:03:01.533411+0000","last_undegraded":"2023-12-19T18:03:01.533411+0000","last_fullsized":"2023-12-19T18:03:01.533411+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:07.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521909+0000","last_change":"2023-12-19T18:03:01.514894+0000","last_active":"2023-12-19T18:03:01.521909+0000","last_peered":"2023-12-19T18:03:01.521909+0000","last_clean":"2023-12-19T18:03:01.521909+0000","last_became_active":"2023-12-19T18:03:01.514612+0000","last_became_peered":"2023-12-19T18:03:01.514612+0000","last_unstale":"2023-12-19T18:03:01.521909+0000","last_undegraded":"2023-12-19T18:03:01.521909+0000","last_fullsized":"2023-12-19T18:03:01.521909+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529676+0000","last_change":"2023-12-19T18:03:01.037229+0000","last_active":"2023-12-19T18:03:01.529676+0000","last_peered":"2023-12-19T18:03:01.529676+0000","last_clean":"2023-12-19T18:03:01.529676+0000","last_became_active":"2023-12-19T18:03:01.036922+0000","last_became_peered":"2023-12-19T18:03:01.036922+0000","last_unstale":"2023-12-19T18:03:01.529676+0000","last_undegraded":"2023-12-19T18:03:01.529676+0000","last_fullsized":"2023-12-19T18:03:01.529676+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:16.787802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528559+0000","last_change":"2023-12-19T18:03:01.514274+0000","last_active":"2023-12-19T18:03:01.528559+0000","last_peered":"2023-12-19T18:03:01.528559+0000","last_clean":"2023-12-19T18:03:01.528559+0000","last_became_active":"2023-12-19T18:03:01.513969+0000","last_became_peered":"2023-12-19T18:03:01.513969+0000","last_unstale":"2023-12-19T18:03:01.528559+0000","last_undegraded":"2023-12-19T18:03:01.528559+0000","last_fullsized":"2023-12-19T18:03:01.528559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.499722+0000","last_change":"2023-12-19T18:03:01.041706+0000","last_active":"2023-12-19T18:03:01.499722+0000","last_peered":"2023-12-19T18:03:01.499722+0000","last_clean":"2023-12-19T18:03:01.499722+0000","last_became_active":"2023-12-19T18:03:01.040042+0000","last_became_peered":"2023-12-19T18:03:01.040042+0000","last_unstale":"2023-12-19T18:03:01.499722+0000","last_undegraded":"2023-12-19T18:03:01.499722+0000","last_fullsized":"2023-12-19T18:03:01.499722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:53.747846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528738+0000","last_change":"2023-12-19T18:03:01.519394+0000","last_active":"2023-12-19T18:03:01.528738+0000","last_peered":"2023-12-19T18:03:01.528738+0000","last_clean":"2023-12-19T18:03:01.528738+0000","last_became_active":"2023-12-19T18:03:01.519108+0000","last_became_peered":"2023-12-19T18:03:01.519108+0000","last_unstale":"2023-12-19T18:03:01.528738+0000","last_undegraded":"2023-12-19T18:03:01.528738+0000","last_fullsized":"2023-12-19T18:03:01.528738+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.500947+0000","last_change":"2023-12-19T18:03:01.041523+0000","last_active":"2023-12-19T18:03:01.500947+0000","last_peered":"2023-12-19T18:03:01.500947+0000","last_clean":"2023-12-19T18:03:01.500947+0000","last_became_active":"2023-12-19T18:03:01.041293+0000","last_became_peered":"2023-12-19T18:03:01.041293+0000","last_unstale":"2023-12-19T18:03:01.500947+0000","last_undegraded":"2023-12-19T18:03:01.500947+0000","last_fullsized":"2023-12-19T18:03:01.500947+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:54.430060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521058+0000","last_change":"2023-12-19T18:03:01.514191+0000","last_active":"2023-12-19T18:03:01.521058+0000","last_peered":"2023-12-19T18:03:01.521058+0000","last_clean":"2023-12-19T18:03:01.521058+0000","last_became_active":"2023-12-19T18:03:01.513939+0000","last_became_peered":"2023-12-19T18:03:01.513939+0000","last_unstale":"2023-12-19T18:03:01.521058+0000","last_undegraded":"2023-12-19T18:03:01.521058+0000","last_fullsized":"2023-12-19T18:03:01.521058+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526652+0000","last_change":"2023-12-19T18:03:01.043501+0000","last_active":"2023-12-19T18:03:01.526652+0000","last_peered":"2023-12-19T18:03:01.526652+0000","last_clean":"2023-12-19T18:03:01.526652+0000","last_became_active":"2023-12-19T18:03:01.042962+0000","last_became_peered":"2023-12-19T18:03:01.042962+0000","last_unstale":"2023-12-19T18:03:01.526652+0000","last_undegraded":"2023-12-19T18:03:01.526652+0000","last_fullsized":"2023-12-19T18:03:01.526652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524563+0000","last_change":"2023-12-19T18:03:01.515905+0000","last_active":"2023-12-19T18:03:01.524563+0000","last_peered":"2023-12-19T18:03:01.524563+0000","last_clean":"2023-12-19T18:03:01.524563+0000","last_became_active":"2023-12-19T18:03:01.515582+0000","last_became_peered":"2023-12-19T18:03:01.515582+0000","last_unstale":"2023-12-19T18:03:01.524563+0000","last_undegraded":"2023-12-19T18:03:01.524563+0000","last_fullsized":"2023-12-19T18:03:01.524563+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526448+0000","last_change":"2023-12-19T18:03:01.044609+0000","last_active":"2023-12-19T18:03:01.526448+0000","last_peered":"2023-12-19T18:03:01.526448+0000","last_clean":"2023-12-19T18:03:01.526448+0000","last_became_active":"2023-12-19T18:03:01.044346+0000","last_became_peered":"2023-12-19T18:03:01.044346+0000","last_unstale":"2023-12-19T18:03:01.526448+0000","last_undegraded":"2023-12-19T18:03:01.526448+0000","last_fullsized":"2023-12-19T18:03:01.526448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525826+0000","last_change":"2023-12-19T18:03:01.518694+0000","last_active":"2023-12-19T18:03:01.525826+0000","last_peered":"2023-12-19T18:03:01.525826+0000","last_clean":"2023-12-19T18:03:01.525826+0000","last_became_active":"2023-12-19T18:03:01.518441+0000","last_became_peered":"2023-12-19T18:03:01.518441+0000","last_unstale":"2023-12-19T18:03:01.525826+0000","last_undegraded":"2023-12-19T18:03:01.525826+0000","last_fullsized":"2023-12-19T18:03:01.525826+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:48.707978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529270+0000","last_change":"2023-12-19T18:03:01.037450+0000","last_active":"2023-12-19T18:03:01.529270+0000","last_peered":"2023-12-19T18:03:01.529270+0000","last_clean":"2023-12-19T18:03:01.529270+0000","last_became_active":"2023-12-19T18:03:01.037175+0000","last_became_peered":"2023-12-19T18:03:01.037175+0000","last_unstale":"2023-12-19T18:03:01.529270+0000","last_undegraded":"2023-12-19T18:03:01.529270+0000","last_fullsized":"2023-12-19T18:03:01.529270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:54.253683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.510887+0000","last_change":"2023-12-19T18:03:01.506907+0000","last_active":"2023-12-19T18:03:01.510887+0000","last_peered":"2023-12-19T18:03:01.510887+0000","last_clean":"2023-12-19T18:03:01.510887+0000","last_became_active":"2023-12-19T18:03:01.505913+0000","last_became_peered":"2023-12-19T18:03:01.505913+0000","last_unstale":"2023-12-19T18:03:01.510887+0000","last_undegraded":"2023-12-19T18:03:01.510887+0000","last_fullsized":"2023-12-19T18:03:01.510887+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.496923+0000","last_change":"2023-12-19T18:03:01.046428+0000","last_active":"2023-12-19T18:03:01.496923+0000","last_peered":"2023-12-19T18:03:01.496923+0000","last_clean":"2023-12-19T18:03:01.496923+0000","last_became_active":"2023-12-19T18:03:01.046121+0000","last_became_peered":"2023-12-19T18:03:01.046121+0000","last_unstale":"2023-12-19T18:03:01.496923+0000","last_undegraded":"2023-12-19T18:03:01.496923+0000","last_fullsized":"2023-12-19T18:03:01.496923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:12.408666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522071+0000","last_change":"2023-12-19T18:03:01.517333+0000","last_active":"2023-12-19T18:03:01.522071+0000","last_peered":"2023-12-19T18:03:01.522071+0000","last_clean":"2023-12-19T18:03:01.522071+0000","last_became_active":"2023-12-19T18:03:01.517092+0000","last_became_peered":"2023-12-19T18:03:01.517092+0000","last_unstale":"2023-12-19T18:03:01.522071+0000","last_undegraded":"2023-12-19T18:03:01.522071+0000","last_fullsized":"2023-12-19T18:03:01.522071+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:35.371295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526569+0000","last_change":"2023-12-19T18:03:01.039131+0000","last_active":"2023-12-19T18:03:01.526569+0000","last_peered":"2023-12-19T18:03:01.526569+0000","last_clean":"2023-12-19T18:03:01.526569+0000","last_became_active":"2023-12-19T18:03:01.038734+0000","last_became_peered":"2023-12-19T18:03:01.038734+0000","last_unstale":"2023-12-19T18:03:01.526569+0000","last_undegraded":"2023-12-19T18:03:01.526569+0000","last_fullsized":"2023-12-19T18:03:01.526569+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:46.564642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.515420+0000","last_change":"2023-12-19T18:03:01.508354+0000","last_active":"2023-12-19T18:03:01.515420+0000","last_peered":"2023-12-19T18:03:01.515420+0000","last_clean":"2023-12-19T18:03:01.515420+0000","last_became_active":"2023-12-19T18:03:01.508038+0000","last_became_peered":"2023-12-19T18:03:01.508038+0000","last_unstale":"2023-12-19T18:03:01.515420+0000","last_undegraded":"2023-12-19T18:03:01.515420+0000","last_fullsized":"2023-12-19T18:03:01.515420+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:49.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.498504+0000","last_change":"2023-12-19T18:03:01.040136+0000","last_active":"2023-12-19T18:03:01.498504+0000","last_peered":"2023-12-19T18:03:01.498504+0000","last_clean":"2023-12-19T18:03:01.498504+0000","last_became_active":"2023-12-19T18:03:01.039868+0000","last_became_peered":"2023-12-19T18:03:01.039868+0000","last_unstale":"2023-12-19T18:03:01.498504+0000","last_undegraded":"2023-12-19T18:03:01.498504+0000","last_fullsized":"2023-12-19T18:03:01.498504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:40.552341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.515506+0000","last_change":"2023-12-19T18:03:01.507780+0000","last_active":"2023-12-19T18:03:01.515506+0000","last_peered":"2023-12-19T18:03:01.515506+0000","last_clean":"2023-12-19T18:03:01.515506+0000","last_became_active":"2023-12-19T18:03:01.507503+0000","last_became_peered":"2023-12-19T18:03:01.507503+0000","last_unstale":"2023-12-19T18:03:01.515506+0000","last_undegraded":"2023-12-19T18:03:01.515506+0000","last_fullsized":"2023-12-19T18:03:01.515506+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:34.035010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.501050+0000","last_change":"2023-12-19T18:03:01.042852+0000","last_active":"2023-12-19T18:03:01.501050+0000","last_peered":"2023-12-19T18:03:01.501050+0000","last_clean":"2023-12-19T18:03:01.501050+0000","last_became_active":"2023-12-19T18:03:01.042591+0000","last_became_peered":"2023-12-19T18:03:01.042591+0000","last_unstale":"2023-12-19T18:03:01.501050+0000","last_undegraded":"2023-12-19T18:03:01.501050+0000","last_fullsized":"2023-12-19T18:03:01.501050+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:36.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528707+0000","last_change":"2023-12-19T18:03:01.522686+0000","last_active":"2023-12-19T18:03:01.528707+0000","last_peered":"2023-12-19T18:03:01.528707+0000","last_clean":"2023-12-19T18:03:01.528707+0000","last_became_active":"2023-12-19T18:03:01.522364+0000","last_became_peered":"2023-12-19T18:03:01.522364+0000","last_unstale":"2023-12-19T18:03:01.528707+0000","last_undegraded":"2023-12-19T18:03:01.528707+0000","last_fullsized":"2023-12-19T18:03:01.528707+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.494973+0000","last_change":"2023-12-19T18:03:01.042245+0000","last_active":"2023-12-19T18:03:01.494973+0000","last_peered":"2023-12-19T18:03:01.494973+0000","last_clean":"2023-12-19T18:03:01.494973+0000","last_became_active":"2023-12-19T18:03:01.041594+0000","last_became_peered":"2023-12-19T18:03:01.041594+0000","last_unstale":"2023-12-19T18:03:01.494973+0000","last_undegraded":"2023-12-19T18:03:01.494973+0000","last_fullsized":"2023-12-19T18:03:01.494973+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:47.506271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532721+0000","last_change":"2023-12-19T18:03:01.530430+0000","last_active":"2023-12-19T18:03:01.532721+0000","last_peered":"2023-12-19T18:03:01.532721+0000","last_clean":"2023-12-19T18:03:01.532721+0000","last_became_active":"2023-12-19T18:03:01.530152+0000","last_became_peered":"2023-12-19T18:03:01.530152+0000","last_unstale":"2023-12-19T18:03:01.532721+0000","last_undegraded":"2023-12-19T18:03:01.532721+0000","last_fullsized":"2023-12-19T18:03:01.532721+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:09.235125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525367+0000","last_change":"2023-12-19T18:03:01.043296+0000","last_active":"2023-12-19T18:03:01.525367+0000","last_peered":"2023-12-19T18:03:01.525367+0000","last_clean":"2023-12-19T18:03:01.525367+0000","last_became_active":"2023-12-19T18:03:01.040391+0000","last_became_peered":"2023-12-19T18:03:01.040391+0000","last_unstale":"2023-12-19T18:03:01.525367+0000","last_undegraded":"2023-12-19T18:03:01.525367+0000","last_fullsized":"2023-12-19T18:03:01.525367+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:48.320418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529244+0000","last_change":"2023-12-19T18:03:01.521630+0000","last_active":"2023-12-19T18:03:01.529244+0000","last_peered":"2023-12-19T18:03:01.529244+0000","last_clean":"2023-12-19T18:03:01.529244+0000","last_became_active":"2023-12-19T18:03:01.521375+0000","last_became_peered":"2023-12-19T18:03:01.521375+0000","last_unstale":"2023-12-19T18:03:01.529244+0000","last_undegraded":"2023-12-19T18:03:01.529244+0000","last_fullsized":"2023-12-19T18:03:01.529244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-12-19T18:03:02.508719+0000","last_change":"2023-12-19T18:03:01.036153+0000","last_active":"2023-12-19T18:03:02.508719+0000","last_peered":"2023-12-19T18:03:02.508719+0000","last_clean":"2023-12-19T18:03:02.508719+0000","last_became_active":"2023-12-19T18:03:01.035798+0000","last_became_peered":"2023-12-19T18:03:01.035798+0000","last_unstale":"2023-12-19T18:03:02.508719+0000","last_undegraded":"2023-12-19T18:03:02.508719+0000","last_fullsized":"2023-12-19T18:03:02.508719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:43.399399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526935+0000","last_change":"2023-12-19T18:03:01.516512+0000","last_active":"2023-12-19T18:03:01.526935+0000","last_peered":"2023-12-19T18:03:01.526935+0000","last_clean":"2023-12-19T18:03:01.526935+0000","last_became_active":"2023-12-19T18:03:01.516230+0000","last_became_peered":"2023-12-19T18:03:01.516230+0000","last_unstale":"2023-12-19T18:03:01.526935+0000","last_undegraded":"2023-12-19T18:03:01.526935+0000","last_fullsized":"2023-12-19T18:03:01.526935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:22.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503824+0000","last_change":"2023-12-19T18:03:01.044483+0000","last_active":"2023-12-19T18:03:01.503824+0000","last_peered":"2023-12-19T18:03:01.503824+0000","last_clean":"2023-12-19T18:03:01.503824+0000","last_became_active":"2023-12-19T18:03:01.043913+0000","last_became_peered":"2023-12-19T18:03:01.043913+0000","last_unstale":"2023-12-19T18:03:01.503824+0000","last_undegraded":"2023-12-19T18:03:01.503824+0000","last_fullsized":"2023-12-19T18:03:01.503824+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519198+0000","last_change":"2023-12-19T18:03:01.512256+0000","last_active":"2023-12-19T18:03:01.519198+0000","last_peered":"2023-12-19T18:03:01.519198+0000","last_clean":"2023-12-19T18:03:01.519198+0000","last_became_active":"2023-12-19T18:03:01.512017+0000","last_became_peered":"2023-12-19T18:03:01.512017+0000","last_unstale":"2023-12-19T18:03:01.519198+0000","last_undegraded":"2023-12-19T18:03:01.519198+0000","last_fullsized":"2023-12-19T18:03:01.519198+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.505492+0000","last_change":"2023-12-19T18:03:01.041437+0000","last_active":"2023-12-19T18:03:01.505492+0000","last_peered":"2023-12-19T18:03:01.505492+0000","last_clean":"2023-12-19T18:03:01.505492+0000","last_became_active":"2023-12-19T18:03:01.041139+0000","last_became_peered":"2023-12-19T18:03:01.041139+0000","last_unstale":"2023-12-19T18:03:01.505492+0000","last_undegraded":"2023-12-19T18:03:01.505492+0000","last_fullsized":"2023-12-19T18:03:01.505492+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:01.261039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524846+0000","last_change":"2023-12-19T18:03:01.518874+0000","last_active":"2023-12-19T18:03:01.524846+0000","last_peered":"2023-12-19T18:03:01.524846+0000","last_clean":"2023-12-19T18:03:01.524846+0000","last_became_active":"2023-12-19T18:03:01.518634+0000","last_became_peered":"2023-12-19T18:03:01.518634+0000","last_unstale":"2023-12-19T18:03:01.524846+0000","last_undegraded":"2023-12-19T18:03:01.524846+0000","last_fullsized":"2023-12-19T18:03:01.524846+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:32:20.489876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.505022+0000","last_change":"2023-12-19T18:03:01.049301+0000","last_active":"2023-12-19T18:03:01.505022+0000","last_peered":"2023-12-19T18:03:01.505022+0000","last_clean":"2023-12-19T18:03:01.505022+0000","last_became_active":"2023-12-19T18:03:01.048995+0000","last_became_peered":"2023-12-19T18:03:01.048995+0000","last_unstale":"2023-12-19T18:03:01.505022+0000","last_undegraded":"2023-12-19T18:03:01.505022+0000","last_fullsized":"2023-12-19T18:03:01.505022+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530017+0000","last_change":"2023-12-19T18:03:01.523203+0000","last_active":"2023-12-19T18:03:01.530017+0000","last_peered":"2023-12-19T18:03:01.530017+0000","last_clean":"2023-12-19T18:03:01.530017+0000","last_became_active":"2023-12-19T18:03:01.522763+0000","last_became_peered":"2023-12-19T18:03:01.522763+0000","last_unstale":"2023-12-19T18:03:01.530017+0000","last_undegraded":"2023-12-19T18:03:01.530017+0000","last_fullsized":"2023-12-19T18:03:01.530017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:26.073083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.504691+0000","last_change":"2023-12-19T18:03:01.042324+0000","last_active":"2023-12-19T18:03:01.504691+0000","last_peered":"2023-12-19T18:03:01.504691+0000","last_clean":"2023-12-19T18:03:01.504691+0000","last_became_active":"2023-12-19T18:03:01.041724+0000","last_became_peered":"2023-12-19T18:03:01.041724+0000","last_unstale":"2023-12-19T18:03:01.504691+0000","last_undegraded":"2023-12-19T18:03:01.504691+0000","last_fullsized":"2023-12-19T18:03:01.504691+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:41:28.074168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524623+0000","last_change":"2023-12-19T18:03:01.515603+0000","last_active":"2023-12-19T18:03:01.524623+0000","last_peered":"2023-12-19T18:03:01.524623+0000","last_clean":"2023-12-19T18:03:01.524623+0000","last_became_active":"2023-12-19T18:03:01.515306+0000","last_became_peered":"2023-12-19T18:03:01.515306+0000","last_unstale":"2023-12-19T18:03:01.524623+0000","last_undegraded":"2023-12-19T18:03:01.524623+0000","last_fullsized":"2023-12-19T18:03:01.524623+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:43.324973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503093+0000","last_change":"2023-12-19T18:03:01.041166+0000","last_active":"2023-12-19T18:03:01.503093+0000","last_peered":"2023-12-19T18:03:01.503093+0000","last_clean":"2023-12-19T18:03:01.503093+0000","last_became_active":"2023-12-19T18:03:01.039307+0000","last_became_peered":"2023-12-19T18:03:01.039307+0000","last_unstale":"2023-12-19T18:03:01.503093+0000","last_undegraded":"2023-12-19T18:03:01.503093+0000","last_fullsized":"2023-12-19T18:03:01.503093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:26.463539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529240+0000","last_change":"2023-12-19T18:03:01.521534+0000","last_active":"2023-12-19T18:03:01.529240+0000","last_peered":"2023-12-19T18:03:01.529240+0000","last_clean":"2023-12-19T18:03:01.529240+0000","last_became_active":"2023-12-19T18:03:01.521276+0000","last_became_peered":"2023-12-19T18:03:01.521276+0000","last_unstale":"2023-12-19T18:03:01.529240+0000","last_undegraded":"2023-12-19T18:03:01.529240+0000","last_fullsized":"2023-12-19T18:03:01.529240+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.495081+0000","last_change":"2023-12-19T18:03:01.036205+0000","last_active":"2023-12-19T18:03:01.495081+0000","last_peered":"2023-12-19T18:03:01.495081+0000","last_clean":"2023-12-19T18:03:01.495081+0000","last_became_active":"2023-12-19T18:03:01.035940+0000","last_became_peered":"2023-12-19T18:03:01.035940+0000","last_unstale":"2023-12-19T18:03:01.495081+0000","last_undegraded":"2023-12-19T18:03:01.495081+0000","last_fullsized":"2023-12-19T18:03:01.495081+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:11.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519948+0000","last_change":"2023-12-19T18:03:01.513336+0000","last_active":"2023-12-19T18:03:01.519948+0000","last_peered":"2023-12-19T18:03:01.519948+0000","last_clean":"2023-12-19T18:03:01.519948+0000","last_became_active":"2023-12-19T18:03:01.512097+0000","last_became_peered":"2023-12-19T18:03:01.512097+0000","last_unstale":"2023-12-19T18:03:01.519948+0000","last_undegraded":"2023-12-19T18:03:01.519948+0000","last_fullsized":"2023-12-19T18:03:01.519948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:45.843330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532039+0000","last_change":"2023-12-19T18:03:01.036635+0000","last_active":"2023-12-19T18:03:01.532039+0000","last_peered":"2023-12-19T18:03:01.532039+0000","last_clean":"2023-12-19T18:03:01.532039+0000","last_became_active":"2023-12-19T18:03:01.036255+0000","last_became_peered":"2023-12-19T18:03:01.036255+0000","last_unstale":"2023-12-19T18:03:01.532039+0000","last_undegraded":"2023-12-19T18:03:01.532039+0000","last_fullsized":"2023-12-19T18:03:01.532039+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:44.837666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.495247+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:03:01.495247+0000","last_peered":"2023-12-19T18:03:01.495247+0000","last_clean":"2023-12-19T18:03:01.495247+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:03:01.495247+0000","last_undegraded":"2023-12-19T18:03:01.495247+0000","last_fullsized":"2023-12-19T18:03:01.495247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2215936,"data_stored":1374240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2150000000000001,"15min":1.117},"min":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.8959999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.276,"15min":1.179},"min":{"1min":0.747,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4770000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.151}]},{"osd":1,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.175,"15min":1.1040000000000001},"min":{"1min":0.63400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.444,"5min":12.625,"15min":12.625},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.169,"15min":1.1379999999999999},"min":{"1min":0.752,"5min":0.60899999999999999,"15min":0.52600000000000002},"max":{"1min":1.3540000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1839999999999999,"15min":1.097},"min":{"1min":0.84499999999999997,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":1.371,"5min":13.041,"15min":13.041},"last":1.353},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.587,"15min":1.288},"min":{"1min":0.86499999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.431,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.113}]},{"osd":3,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.26,"15min":1.171},"min":{"1min":0.82799999999999996,"5min":0.67100000000000004,"15min":0.51600000000000001},"max":{"1min":1.409,"5min":12.917,"15min":12.917},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":1.083,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5860000000000001,"5min":46.375,"15min":46.375},"last":1.2969999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.601,"5min":13.137,"15min":13.137},"last":1.232},{"interface":"front","average":{"1min":1.238,"5min":1.3640000000000001,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4810000000000001,"5min":13.109,"15min":13.109},"last":1.2629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.29,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.492,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3069999999999999,"15min":1.286},"min":{"1min":0.89200000000000002,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":1.522,"5min":13.198,"15min":13.198},"last":1.3220000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.478,"15min":1.4179999999999999},"min":{"1min":0.98299999999999998,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":1.675,"5min":13.442,"15min":13.442},"last":1.421},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4199999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.792,"5min":13.981,"15min":13.981},"last":1.4350000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1609728,"data_stored":783678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.997,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.381,"5min":1.399,"15min":4.5979999999999999},"last":1.129},{"interface":"front","average":{"1min":1.103,"5min":1.04,"15min":1.0740000000000001},"min":{"1min":0.755,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4490000000000001,"5min":1.756,"15min":1.756},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.0900000000000001},"min":{"1min":0.70499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.415,"5min":1.583,"15min":1.621},"last":1.2689999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.131,"15min":1.282},"min":{"1min":0.94699999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.371},{"interface":"front","average":{"1min":1.244,"5min":1.1890000000000001,"15min":1.2170000000000001},"min":{"1min":0.90900000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.673,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.3380000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.2490000000000001},"min":{"1min":0.91200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5529999999999999,"5min":1.651,"15min":4.5380000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.218,"15min":1.29},"min":{"1min":0.83099999999999996,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":4.508},"last":1.419}]},{"osd":4,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.149,"15min":1.137},"min":{"1min":0.76000000000000001,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.5129999999999999,"5min":1.577,"15min":1.8360000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2290000000000001,"15min":1.2390000000000001},"min":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.579,"5min":1.802,"15min":1.899},"last":0.98199999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2569999999999999,"15min":1.2589999999999999},"min":{"1min":0.89400000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2729999999999999,"15min":1.2689999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.724,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.857,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.385,"15min":1.395},"min":{"1min":1.056,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.827,"5min":1.841,"15min":2.2440000000000002},"last":1.4670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1613824,"data_stored":783256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5109999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.60599999999999998},"max":{"1min":1.409,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.73}]},{"osd":1,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.135,"15min":1.113},"min":{"1min":0.78700000000000003,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.3540000000000001,"5min":1.974,"15min":1.974},"last":1.591},{"interface":"front","average":{"1min":1.173,"5min":1.145,"15min":1.179},"min":{"1min":0.77700000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.399,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.347}]},{"osd":2,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.891,"15min":2.9929999999999999},"last":1.397},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.3720000000000001,"5min":2.024,"15min":2.024},"last":1.5229999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.482,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.25,"15min":1.3120000000000001},"min":{"1min":1.079,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.536,"5min":1.829,"15min":3.0350000000000001},"last":1.2190000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1890000000000001,"15min":1.244},"min":{"1min":0.79800000000000004,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.4650000000000001,"5min":3.633,"15min":3.633},"last":1.704},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":1.1830000000000001,"5min":0.78600000000000003,"15min":0.745},"max":{"1min":1.5600000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.323},"min":{"1min":1.0429999999999999,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.609,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.3029999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.296}]},{"osd":7,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3180000000000001,"15min":1.411},"min":{"1min":0.85899999999999999,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.9279999999999999,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.492},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3759999999999999,"15min":1.4870000000000001},"min":{"1min":1.0429999999999999,"5min":0.98099999999999998,"15min":0.82499999999999996},"max":{"1min":1.7350000000000001,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.8280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1617920,"data_stored":784660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.077,"15min":1.1739999999999999},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.458,"5min":1.556,"15min":5.4420000000000002},"last":1.423},{"interface":"front","average":{"1min":1.24,"5min":1.1890000000000001,"15min":1.252},"min":{"1min":0.90400000000000003,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.53,"5min":1.657,"15min":5.5049999999999999},"last":1.3100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1100000000000001,"15min":1.181},"min":{"1min":0.83199999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.5580000000000001,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.161},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.161},"min":{"1min":0.85699999999999998,"5min":0.70999999999999996,"15min":0.66000000000000003},"max":{"1min":1.4319999999999999,"5min":1.5589999999999999,"15min":3.254},"last":1.349}]},{"osd":2,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.1970000000000001},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.4850000000000001,"5min":1.623,"15min":4.593},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.173,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.454,"5min":1.871,"15min":2.3799999999999999},"last":1.534}]},{"osd":3,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1220000000000001,"15min":1.2070000000000001},"min":{"1min":0.90000000000000002,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.3939999999999999,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.044},{"interface":"front","average":{"1min":1.266,"5min":1.2110000000000001,"15min":1.3160000000000001},"min":{"1min":0.93700000000000006,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5409999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.5629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.88600000000000001,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.502,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.46},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.667}]},{"osd":6,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2350000000000001,"15min":1.252},"min":{"1min":0.872,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.5609999999999999,"5min":1.6910000000000001,"15min":2.915},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4019999999999999,"15min":1.4039999999999999},"min":{"1min":1.266,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6200000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.631}]},{"osd":7,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.296,"15min":1.306},"min":{"1min":0.99299999999999999,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.556,"5min":1.907,"15min":2.4340000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.369},"min":{"1min":1.0600000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7,"5min":1.833,"15min":5.6859999999999999},"last":1.5049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1622016,"data_stored":784694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.874},"min":{"1min":0.61399999999999999,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":1.329,"5min":1.6599999999999999,"15min":1.825},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.92100000000000004},"min":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.435},"max":{"1min":1.6299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3859999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.80900000000000005,"5min":0.311,"15min":0.311},"max":{"1min":1.6180000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.91700000000000004}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5680000000000001,"5min":1.679,"15min":2.177},"last":1.204},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.1599999999999999,"15min":1.2010000000000001},"min":{"1min":0.71599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.8520000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1599999999999999,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7070000000000001,"5min":1.7310000000000001,"15min":2.234},"last":1.054},{"interface":"front","average":{"1min":1.357,"5min":1.3109999999999999,"15min":1.302},"min":{"1min":0.873,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.591,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.702}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3340000000000001,"15min":1.369},"min":{"1min":1.0129999999999999,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":1.964,"5min":2.0699999999999998,"15min":2.5419999999999998},"last":1.353},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2729999999999999,"15min":1.3149999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.74299999999999999},"max":{"1min":1.5740000000000001,"5min":1.776,"15min":2.754},"last":1.46}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.345,"15min":1.379},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6859999999999999,"5min":1.946,"15min":2.6880000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.411,"15min":1.444},"min":{"1min":0.98499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.8089999999999999,"5min":2.274,"15min":2.6429999999999998},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.351,"15min":1.3999999999999999},"min":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.77700000000000002},"max":{"1min":1.7909999999999999,"5min":1.9730000000000001,"15min":3.02},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4279999999999999,"15min":1.4630000000000001},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.83099999999999996},"max":{"1min":1.7809999999999999,"5min":2.323,"15min":2.8170000000000002},"last":1.79}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1605632,"data_stored":783096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91900000000000004,"15min":1.119},"min":{"1min":0.65600000000000003,"5min":0.497,"15min":0.29599999999999999},"max":{"1min":1.4710000000000001,"5min":3.9209999999999998,"15min":13.32},"last":0.87},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":1.222},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":3.8149999999999999,"15min":13.206},"last":1.1060000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93799999999999994,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.4079999999999999,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.284},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.70299999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.653,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.337}]},{"osd":3,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92600000000000005,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.4610000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.1619999999999999,"15min":1.1890000000000001},"min":{"1min":0.89900000000000002,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.647,"5min":2.75,"15min":2.75},"last":1.381}]},{"osd":4,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2490000000000001},"min":{"1min":1.01,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4339999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.532},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.278},"min":{"1min":1.0389999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.429,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.4370000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.218,"15min":1.264},"min":{"1min":0.874,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7110000000000001,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.504},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3380000000000001,"15min":1.403},"min":{"1min":1.008,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.571,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.389},"min":{"1min":0.98799999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6359999999999999,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3109999999999999,"15min":1.3380000000000001},"min":{"1min":0.92600000000000005,"5min":0.872,"15min":0.872},"max":{"1min":1.6040000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.413}]},{"osd":7,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.92900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.766,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.95799999999999996,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7,"5min":5.375,"15min":5.375},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1609728,"data_stored":783118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.72599999999999998,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.931},"last":1.103},{"interface":"front","average":{"1min":0.995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.335,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82499999999999996,"15min":0.91600000000000004},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1619999999999999,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.97599999999999998,"15min":1.0609999999999999},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.387,"5min":1.5580000000000001,"15min":3.4199999999999999},"last":1.2949999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.075,"15min":1.1819999999999999},"min":{"1min":0.751,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":3.4950000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1,"5min":0.95499999999999996,"15min":1.0840000000000001},"min":{"1min":0.60299999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4279999999999999,"5min":1.55,"15min":4.2030000000000003},"last":0.93999999999999995}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2789999999999999,"15min":1.345},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8779999999999999,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.56999999999999995},"max":{"1min":1.6299999999999999,"5min":1.681,"15min":2.6960000000000002},"last":0.75900000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.296},"min":{"1min":0.93400000000000005,"5min":0.82999999999999996,"15min":0.69599999999999995},"max":{"1min":1.7130000000000001,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.91100000000000003,"5min":0.83299999999999996,"15min":0.69399999999999995},"max":{"1min":1.915,"5min":1.915,"15min":3.8420000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3240000000000001,"15min":1.4470000000000001},"min":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9930000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.23},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.333,"15min":1.4610000000000001},"min":{"1min":0.997,"5min":0.84499999999999997,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.917,"15min":3.214},"last":1.171}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.359,"15min":1.5069999999999999},"min":{"1min":1.028,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":4.0910000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.337,"15min":1.452},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":4.6390000000000002},"last":1.0629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2199552,"data_stored":1372467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.94499999999999995},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.129,"5min":1.53,"15min":2.2250000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.94599999999999995,"15min":1.077},"min":{"1min":0.80500000000000005,"5min":0.505,"15min":0.499},"max":{"1min":1.4239999999999999,"5min":1.73,"15min":2.3599999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.89200000000000002,"15min":0.94399999999999995},"min":{"1min":0.57899999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2649999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.94199999999999995},"min":{"1min":0.64000000000000001,"5min":0.497,"15min":0.45300000000000001},"max":{"1min":1.1879999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.69199999999999995,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.4630000000000001,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.151,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.609,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.149}]},{"osd":4,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2529999999999999,"15min":1.3200000000000001},"min":{"1min":0.86399999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6459999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.198},{"interface":"front","average":{"1min":1.306,"5min":1.2629999999999999,"15min":1.333},"min":{"1min":0.92800000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.641,"5min":1.738,"15min":2.7799999999999998},"last":1.218}]},{"osd":5,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.2549999999999999},"min":{"1min":0.80800000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":1.758,"15min":2.0579999999999998},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.891,"5min":1.891,"15min":2.0030000000000001},"last":0.93799999999999994}]},{"osd":6,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":2.1000000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.266,"15min":1.373},"min":{"1min":0.97399999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7030000000000001,"5min":1.8300000000000001,"15min":2.3889999999999998},"last":1.022}]},{"osd":7,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.333,"15min":1.4870000000000001},"min":{"1min":1.131,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7829999999999999,"5min":1.9339999999999999,"15min":4.9400000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.3220000000000001,"15min":1.46},"min":{"1min":0.95099999999999996,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.8280000000000001,"5min":1.875,"15min":4.8250000000000002},"last":1.107}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:03:10.912 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:03:11.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0f298700 1 Processor -- start 2023-12-19T18:03:11.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0f298700 1 -- start start 2023-12-19T18:03:11.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0f298700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1a0806ea90 0x7f1a080d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0f298700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080d1820 con 0x7f1a0806fe80 2023-12-19T18:03:11.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0f298700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a080d1b00 con 0x7f1a080b88b0 2023-12-19T18:03:11.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0f298700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a080d1de0 con 0x7f1a0806ea90 2023-12-19T18:03:11.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0ea97700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f1a0806fe80 0x7f1a080b6420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42234/0 (socket says 172.21.15.45:42234) 2023-12-19T18:03:11.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0ea97700 1 -- 172.21.15.45:0/2234487079 learned_addr learned my addr 172.21.15.45:0/2234487079 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:11.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.093+0000 7f1a0e296700 1 --2- 172.21.15.45:0/2234487079 >> v2:172.21.15.73:3300/0 conn(0x7f1a0806ea90 0x7f1a080d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363091229 0 0) 0x7f1a080d1820 con 0x7f1a0806fe80 2023-12-19T18:03:11.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19f40035d0 con 0x7f1a0806fe80 2023-12-19T18:03:11.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941261152 0 0) 0x7f1a080d1b00 con 0x7f1a080b88b0 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a080d1820 con 0x7f1a080b88b0 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0e296700 1 -- 172.21.15.45:0/2234487079 >> v1:172.21.15.73:6789/0 conn(0x7f1a080b88b0 legacy=0x7f1a080b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0e296700 1 -- 172.21.15.45:0/2234487079 >> v1:172.21.15.45:6789/0 conn(0x7f1a0806fe80 legacy=0x7f1a080b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0e296700 1 -- 172.21.15.45:0/2234487079 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080d20c0 con 0x7f1a0806ea90 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0e296700 1 --2- 172.21.15.45:0/2234487079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a080d0f20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009850 tx=0x7f1a04009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e097d6e09ef3480 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04011830 con 0x7f1a0806ea90 2023-12-19T18:03:11.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a04011990 con 0x7f1a0806ea90 2023-12-19T18:03:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0d294700 1 -- 172.21.15.45:0/2234487079 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04011d40 con 0x7f1a0806ea90 2023-12-19T18:03:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 -- 172.21.15.45:0/2234487079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 msgr2=0x7f1a080d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 --2- 172.21.15.45:0/2234487079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a080d0f20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f1a04009850 tx=0x7f1a04009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 -- 172.21.15.45:0/2234487079 shutdown_connections 2023-12-19T18:03:11.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 --2- 172.21.15.45:0/2234487079 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a080d0f20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 -- 172.21.15.45:0/2234487079 >> 172.21.15.45:0/2234487079 conn(0x7f1a080b46d0 msgr2=0x7f1a080b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:11.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 -- 172.21.15.45:0/2234487079 shutdown_connections 2023-12-19T18:03:11.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.097+0000 7f1a0f298700 1 -- 172.21.15.45:0/2234487079 wait complete. 2023-12-19T18:03:11.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 Processor -- start 2023-12-19T18:03:11.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 -- start start 2023-12-19T18:03:11.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a08157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a0806fe80 0x7f1a0815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080b88b0 0x7f1a080c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c71c0 con 0x7f1a080b88b0 2023-12-19T18:03:11.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a081f69f0 con 0x7f1a0806ea90 2023-12-19T18:03:11.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0f298700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080c9590 con 0x7f1a0806fe80 2023-12-19T18:03:11.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0ea97700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080b88b0 0x7f1a080c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0e296700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a08157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0e296700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a08157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:55868/0 (socket says 172.21.15.45:55868) 2023-12-19T18:03:11.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0e296700 1 -- 172.21.15.45:0/3773607703 learned_addr learned my addr 172.21.15.45:0/3773607703 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:11.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.101+0000 7f1a0da95700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a0806fe80 0x7f1a0815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0e296700 1 -- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a0806fe80 msgr2=0x7f1a0815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0e296700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a0806fe80 0x7f1a0815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0e296700 1 -- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080b88b0 msgr2=0x7f1a080c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0e296700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080b88b0 0x7f1a080c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0e296700 1 -- 172.21.15.45:0/3773607703 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a040094b0 con 0x7f1a0806ea90 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0ea97700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080b88b0 0x7f1a080c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:11.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0e296700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a08157470 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1a08072a40 tx=0x7f1a04004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:11.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04019a00 con 0x7f1a0806ea90 2023-12-19T18:03:11.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a0401e070 con 0x7f1a0806ea90 2023-12-19T18:03:11.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a080c6820 con 0x7f1a0806ea90 2023-12-19T18:03:11.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04019dc0 con 0x7f1a0806ea90 2023-12-19T18:03:11.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a080c6de0 con 0x7f1a0806ea90 2023-12-19T18:03:11.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.105+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a080b55a0 con 0x7f1a0806ea90 2023-12-19T18:03:11.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.109+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1a0401a420 con 0x7f1a0806ea90 2023-12-19T18:03:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.109+0000 7f19feffd700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19ec065b20 0x7f19ec067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.109+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1a040841c0 con 0x7f1a0806ea90 2023-12-19T18:03:11.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.109+0000 7f1a0da95700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19ec065b20 0x7f19ec067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.113+0000 7f1a0da95700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19ec065b20 0x7f19ec067fe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f19f8007fd0 tx=0x7f19f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:11.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.117+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1a04051ab0 con 0x7f1a0806ea90 2023-12-19T18:03:11.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.293+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1a080702f0 con 0x7f19ec065b20 2023-12-19T18:03:11.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.305+0000 7f19feffd700 1 -- 172.21.15.45:0/3773607703 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287033 (secure 0 0 0) 0x7f19f80050d0 con 0x7f19ec065b20 2023-12-19T18:03:11.316 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19ec065b20 msgr2=0x7f19ec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19ec065b20 0x7f19ec067fe0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f19f8007fd0 tx=0x7f19f8009040 comp rx=0 tx=0).stop 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 msgr2=0x7f1a08157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a08157470 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1a08072a40 tx=0x7f1a04004770 comp rx=0 tx=0).stop 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 shutdown_connections 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f19ec065b20 0x7f19ec067fe0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1a080b88b0 0x7f1a080c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1a0806fe80 0x7f1a0815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 --2- 172.21.15.45:0/3773607703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a0806ea90 0x7f1a08157470 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 >> 172.21.15.45:0/3773607703 conn(0x7f1a080b46d0 msgr2=0x7f1a080b3690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:11.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 shutdown_connections 2023-12-19T18:03:11.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.313+0000 7f1a0f298700 1 -- 172.21.15.45:0/3773607703 wait complete. 2023-12-19T18:03:11.321 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:03:11.344 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":474,"stamp":"2023-12-19T18:03:10.453476+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262148,"kb_used_data":13764,"kb_used_omap":0,"kb_used_meta":248320,"kb_avail":754712572,"statfs":{"total":773094113280,"available":772825673728,"internally_reserved":0,"allocated":14094336,"data_stored":7449209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":254279680},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":49,"apply_latency_ms":49,"commit_latency_ns":49000000,"apply_latency_ns":49000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.965504"},"pg_stats":[{"pgid":"18.3f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530724+0000","last_change":"2023-12-19T18:03:01.528559+0000","last_active":"2023-12-19T18:03:01.530724+0000","last_peered":"2023-12-19T18:03:01.530724+0000","last_clean":"2023-12-19T18:03:01.530724+0000","last_became_active":"2023-12-19T18:03:01.528053+0000","last_became_peered":"2023-12-19T18:03:01.528053+0000","last_unstale":"2023-12-19T18:03:01.530724+0000","last_undegraded":"2023-12-19T18:03:01.530724+0000","last_fullsized":"2023-12-19T18:03:01.530724+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528837+0000","last_change":"2023-12-19T18:03:01.515763+0000","last_active":"2023-12-19T18:03:01.528837+0000","last_peered":"2023-12-19T18:03:01.528837+0000","last_clean":"2023-12-19T18:03:01.528837+0000","last_became_active":"2023-12-19T18:03:01.515391+0000","last_became_peered":"2023-12-19T18:03:01.515391+0000","last_unstale":"2023-12-19T18:03:01.528837+0000","last_undegraded":"2023-12-19T18:03:01.528837+0000","last_fullsized":"2023-12-19T18:03:01.528837+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:54:53.820748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529918+0000","last_change":"2023-12-19T18:03:01.522348+0000","last_active":"2023-12-19T18:03:01.529918+0000","last_peered":"2023-12-19T18:03:01.529918+0000","last_clean":"2023-12-19T18:03:01.529918+0000","last_became_active":"2023-12-19T18:03:01.522042+0000","last_became_peered":"2023-12-19T18:03:01.522042+0000","last_unstale":"2023-12-19T18:03:01.529918+0000","last_undegraded":"2023-12-19T18:03:01.529918+0000","last_fullsized":"2023-12-19T18:03:01.529918+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:49.326082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.3c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522604+0000","last_change":"2023-12-19T18:03:01.513678+0000","last_active":"2023-12-19T18:03:01.522604+0000","last_peered":"2023-12-19T18:03:01.522604+0000","last_clean":"2023-12-19T18:03:01.522604+0000","last_became_active":"2023-12-19T18:03:01.513401+0000","last_became_peered":"2023-12-19T18:03:01.513401+0000","last_unstale":"2023-12-19T18:03:01.522604+0000","last_undegraded":"2023-12-19T18:03:01.522604+0000","last_fullsized":"2023-12-19T18:03:01.522604+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:09:24.808093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527137+0000","last_change":"2023-12-19T18:03:01.518794+0000","last_active":"2023-12-19T18:03:01.527137+0000","last_peered":"2023-12-19T18:03:01.527137+0000","last_clean":"2023-12-19T18:03:01.527137+0000","last_became_active":"2023-12-19T18:03:01.518534+0000","last_became_peered":"2023-12-19T18:03:01.518534+0000","last_unstale":"2023-12-19T18:03:01.527137+0000","last_undegraded":"2023-12-19T18:03:01.527137+0000","last_fullsized":"2023-12-19T18:03:01.527137+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.3a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.520219+0000","last_change":"2023-12-19T18:03:01.515271+0000","last_active":"2023-12-19T18:03:01.520219+0000","last_peered":"2023-12-19T18:03:01.520219+0000","last_clean":"2023-12-19T18:03:01.520219+0000","last_became_active":"2023-12-19T18:03:01.515009+0000","last_became_peered":"2023-12-19T18:03:01.515009+0000","last_unstale":"2023-12-19T18:03:01.520219+0000","last_undegraded":"2023-12-19T18:03:01.520219+0000","last_fullsized":"2023-12-19T18:03:01.520219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:26:31.507606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.39","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527771+0000","last_change":"2023-12-19T18:03:01.522171+0000","last_active":"2023-12-19T18:03:01.527771+0000","last_peered":"2023-12-19T18:03:01.527771+0000","last_clean":"2023-12-19T18:03:01.527771+0000","last_became_active":"2023-12-19T18:03:01.521093+0000","last_became_peered":"2023-12-19T18:03:01.521093+0000","last_unstale":"2023-12-19T18:03:01.527771+0000","last_undegraded":"2023-12-19T18:03:01.527771+0000","last_fullsized":"2023-12-19T18:03:01.527771+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:10:01.842744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.38","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530628+0000","last_change":"2023-12-19T18:03:01.524263+0000","last_active":"2023-12-19T18:03:01.530628+0000","last_peered":"2023-12-19T18:03:01.530628+0000","last_clean":"2023-12-19T18:03:01.530628+0000","last_became_active":"2023-12-19T18:03:01.523901+0000","last_became_peered":"2023-12-19T18:03:01.523901+0000","last_unstale":"2023-12-19T18:03:01.530628+0000","last_undegraded":"2023-12-19T18:03:01.530628+0000","last_fullsized":"2023-12-19T18:03:01.530628+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:47.570305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.37","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.517954+0000","last_change":"2023-12-19T18:03:01.510715+0000","last_active":"2023-12-19T18:03:01.517954+0000","last_peered":"2023-12-19T18:03:01.517954+0000","last_clean":"2023-12-19T18:03:01.517954+0000","last_became_active":"2023-12-19T18:03:01.510278+0000","last_became_peered":"2023-12-19T18:03:01.510278+0000","last_unstale":"2023-12-19T18:03:01.517954+0000","last_undegraded":"2023-12-19T18:03:01.517954+0000","last_fullsized":"2023-12-19T18:03:01.517954+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:23:05.296698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.36","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529865+0000","last_change":"2023-12-19T18:03:01.525079+0000","last_active":"2023-12-19T18:03:01.529865+0000","last_peered":"2023-12-19T18:03:01.529865+0000","last_clean":"2023-12-19T18:03:01.529865+0000","last_became_active":"2023-12-19T18:03:01.524733+0000","last_became_peered":"2023-12-19T18:03:01.524733+0000","last_unstale":"2023-12-19T18:03:01.529865+0000","last_undegraded":"2023-12-19T18:03:01.529865+0000","last_fullsized":"2023-12-19T18:03:01.529865+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.35","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524580+0000","last_change":"2023-12-19T18:03:01.516482+0000","last_active":"2023-12-19T18:03:01.524580+0000","last_peered":"2023-12-19T18:03:01.524580+0000","last_clean":"2023-12-19T18:03:01.524580+0000","last_became_active":"2023-12-19T18:03:01.516203+0000","last_became_peered":"2023-12-19T18:03:01.516203+0000","last_unstale":"2023-12-19T18:03:01.524580+0000","last_undegraded":"2023-12-19T18:03:01.524580+0000","last_fullsized":"2023-12-19T18:03:01.524580+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.34","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527320+0000","last_change":"2023-12-19T18:03:01.520729+0000","last_active":"2023-12-19T18:03:01.527320+0000","last_peered":"2023-12-19T18:03:01.527320+0000","last_clean":"2023-12-19T18:03:01.527320+0000","last_became_active":"2023-12-19T18:03:01.520331+0000","last_became_peered":"2023-12-19T18:03:01.520331+0000","last_unstale":"2023-12-19T18:03:01.527320+0000","last_undegraded":"2023-12-19T18:03:01.527320+0000","last_fullsized":"2023-12-19T18:03:01.527320+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:38:36.056772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.33","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529261+0000","last_change":"2023-12-19T18:03:01.522128+0000","last_active":"2023-12-19T18:03:01.529261+0000","last_peered":"2023-12-19T18:03:01.529261+0000","last_clean":"2023-12-19T18:03:01.529261+0000","last_became_active":"2023-12-19T18:03:01.521849+0000","last_became_peered":"2023-12-19T18:03:01.521849+0000","last_unstale":"2023-12-19T18:03:01.529261+0000","last_undegraded":"2023-12-19T18:03:01.529261+0000","last_fullsized":"2023-12-19T18:03:01.529261+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.32","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529831+0000","last_change":"2023-12-19T18:03:01.521821+0000","last_active":"2023-12-19T18:03:01.529831+0000","last_peered":"2023-12-19T18:03:01.529831+0000","last_clean":"2023-12-19T18:03:01.529831+0000","last_became_active":"2023-12-19T18:03:01.521471+0000","last_became_peered":"2023-12-19T18:03:01.521471+0000","last_unstale":"2023-12-19T18:03:01.529831+0000","last_undegraded":"2023-12-19T18:03:01.529831+0000","last_fullsized":"2023-12-19T18:03:01.529831+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:24.463386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.31","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524214+0000","last_change":"2023-12-19T18:03:01.514815+0000","last_active":"2023-12-19T18:03:01.524214+0000","last_peered":"2023-12-19T18:03:01.524214+0000","last_clean":"2023-12-19T18:03:01.524214+0000","last_became_active":"2023-12-19T18:03:01.514537+0000","last_became_peered":"2023-12-19T18:03:01.514537+0000","last_unstale":"2023-12-19T18:03:01.524214+0000","last_undegraded":"2023-12-19T18:03:01.524214+0000","last_fullsized":"2023-12-19T18:03:01.524214+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.30","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522052+0000","last_change":"2023-12-19T18:03:01.515786+0000","last_active":"2023-12-19T18:03:01.522052+0000","last_peered":"2023-12-19T18:03:01.522052+0000","last_clean":"2023-12-19T18:03:01.522052+0000","last_became_active":"2023-12-19T18:03:01.515521+0000","last_became_peered":"2023-12-19T18:03:01.515521+0000","last_unstale":"2023-12-19T18:03:01.522052+0000","last_undegraded":"2023-12-19T18:03:01.522052+0000","last_fullsized":"2023-12-19T18:03:01.522052+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:57:12.676472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.2f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529583+0000","last_change":"2023-12-19T18:03:01.522484+0000","last_active":"2023-12-19T18:03:01.529583+0000","last_peered":"2023-12-19T18:03:01.529583+0000","last_clean":"2023-12-19T18:03:01.529583+0000","last_became_active":"2023-12-19T18:03:01.522110+0000","last_became_peered":"2023-12-19T18:03:01.522110+0000","last_unstale":"2023-12-19T18:03:01.529583+0000","last_undegraded":"2023-12-19T18:03:01.529583+0000","last_fullsized":"2023-12-19T18:03:01.529583+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.2e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528270+0000","last_change":"2023-12-19T18:03:01.510928+0000","last_active":"2023-12-19T18:03:01.528270+0000","last_peered":"2023-12-19T18:03:01.528270+0000","last_clean":"2023-12-19T18:03:01.528270+0000","last_became_active":"2023-12-19T18:03:01.510469+0000","last_became_peered":"2023-12-19T18:03:01.510469+0000","last_unstale":"2023-12-19T18:03:01.528270+0000","last_undegraded":"2023-12-19T18:03:01.528270+0000","last_fullsized":"2023-12-19T18:03:01.528270+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:53:10.788082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.2d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526108+0000","last_change":"2023-12-19T18:03:01.522447+0000","last_active":"2023-12-19T18:03:01.526108+0000","last_peered":"2023-12-19T18:03:01.526108+0000","last_clean":"2023-12-19T18:03:01.526108+0000","last_became_active":"2023-12-19T18:03:01.521599+0000","last_became_peered":"2023-12-19T18:03:01.521599+0000","last_unstale":"2023-12-19T18:03:01.526108+0000","last_undegraded":"2023-12-19T18:03:01.526108+0000","last_fullsized":"2023-12-19T18:03:01.526108+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.2c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525374+0000","last_change":"2023-12-19T18:03:01.513609+0000","last_active":"2023-12-19T18:03:01.525374+0000","last_peered":"2023-12-19T18:03:01.525374+0000","last_clean":"2023-12-19T18:03:01.525374+0000","last_became_active":"2023-12-19T18:03:01.513287+0000","last_became_peered":"2023-12-19T18:03:01.513287+0000","last_unstale":"2023-12-19T18:03:01.525374+0000","last_undegraded":"2023-12-19T18:03:01.525374+0000","last_fullsized":"2023-12-19T18:03:01.525374+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:40.944919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.2b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519969+0000","last_change":"2023-12-19T18:03:01.513578+0000","last_active":"2023-12-19T18:03:01.519969+0000","last_peered":"2023-12-19T18:03:01.519969+0000","last_clean":"2023-12-19T18:03:01.519969+0000","last_became_active":"2023-12-19T18:03:01.511971+0000","last_became_peered":"2023-12-19T18:03:01.511971+0000","last_unstale":"2023-12-19T18:03:01.519969+0000","last_undegraded":"2023-12-19T18:03:01.519969+0000","last_fullsized":"2023-12-19T18:03:01.519969+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:57:25.460640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.2a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524478+0000","last_change":"2023-12-19T18:03:01.514110+0000","last_active":"2023-12-19T18:03:01.524478+0000","last_peered":"2023-12-19T18:03:01.524478+0000","last_clean":"2023-12-19T18:03:01.524478+0000","last_became_active":"2023-12-19T18:03:01.513837+0000","last_became_peered":"2023-12-19T18:03:01.513837+0000","last_unstale":"2023-12-19T18:03:01.524478+0000","last_undegraded":"2023-12-19T18:03:01.524478+0000","last_fullsized":"2023-12-19T18:03:01.524478+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.29","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.518191+0000","last_change":"2023-12-19T18:03:01.511423+0000","last_active":"2023-12-19T18:03:01.518191+0000","last_peered":"2023-12-19T18:03:01.518191+0000","last_clean":"2023-12-19T18:03:01.518191+0000","last_became_active":"2023-12-19T18:03:01.511160+0000","last_became_peered":"2023-12-19T18:03:01.511160+0000","last_unstale":"2023-12-19T18:03:01.518191+0000","last_undegraded":"2023-12-19T18:03:01.518191+0000","last_fullsized":"2023-12-19T18:03:01.518191+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:09:23.058292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.28","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528573+0000","last_change":"2023-12-19T18:03:01.522191+0000","last_active":"2023-12-19T18:03:01.528573+0000","last_peered":"2023-12-19T18:03:01.528573+0000","last_clean":"2023-12-19T18:03:01.528573+0000","last_became_active":"2023-12-19T18:03:01.521904+0000","last_became_peered":"2023-12-19T18:03:01.521904+0000","last_unstale":"2023-12-19T18:03:01.528573+0000","last_undegraded":"2023-12-19T18:03:01.528573+0000","last_fullsized":"2023-12-19T18:03:01.528573+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.27","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528541+0000","last_change":"2023-12-19T18:03:01.519293+0000","last_active":"2023-12-19T18:03:01.528541+0000","last_peered":"2023-12-19T18:03:01.528541+0000","last_clean":"2023-12-19T18:03:01.528541+0000","last_became_active":"2023-12-19T18:03:01.517195+0000","last_became_peered":"2023-12-19T18:03:01.517195+0000","last_unstale":"2023-12-19T18:03:01.528541+0000","last_undegraded":"2023-12-19T18:03:01.528541+0000","last_fullsized":"2023-12-19T18:03:01.528541+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:13.414330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.26","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530555+0000","last_change":"2023-12-19T18:03:01.527442+0000","last_active":"2023-12-19T18:03:01.530555+0000","last_peered":"2023-12-19T18:03:01.530555+0000","last_clean":"2023-12-19T18:03:01.530555+0000","last_became_active":"2023-12-19T18:03:01.527114+0000","last_became_peered":"2023-12-19T18:03:01.527114+0000","last_unstale":"2023-12-19T18:03:01.530555+0000","last_undegraded":"2023-12-19T18:03:01.530555+0000","last_fullsized":"2023-12-19T18:03:01.530555+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:48.511935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.25","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521427+0000","last_change":"2023-12-19T18:03:01.511940+0000","last_active":"2023-12-19T18:03:01.521427+0000","last_peered":"2023-12-19T18:03:01.521427+0000","last_clean":"2023-12-19T18:03:01.521427+0000","last_became_active":"2023-12-19T18:03:01.510938+0000","last_became_peered":"2023-12-19T18:03:01.510938+0000","last_unstale":"2023-12-19T18:03:01.521427+0000","last_undegraded":"2023-12-19T18:03:01.521427+0000","last_fullsized":"2023-12-19T18:03:01.521427+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.24","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527301+0000","last_change":"2023-12-19T18:03:01.520569+0000","last_active":"2023-12-19T18:03:01.527301+0000","last_peered":"2023-12-19T18:03:01.527301+0000","last_clean":"2023-12-19T18:03:01.527301+0000","last_became_active":"2023-12-19T18:03:01.519863+0000","last_became_peered":"2023-12-19T18:03:01.519863+0000","last_unstale":"2023-12-19T18:03:01.527301+0000","last_undegraded":"2023-12-19T18:03:01.527301+0000","last_fullsized":"2023-12-19T18:03:01.527301+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:38:50.028439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.23","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525995+0000","last_change":"2023-12-19T18:03:01.511551+0000","last_active":"2023-12-19T18:03:01.525995+0000","last_peered":"2023-12-19T18:03:01.525995+0000","last_clean":"2023-12-19T18:03:01.525995+0000","last_became_active":"2023-12-19T18:03:01.511295+0000","last_became_peered":"2023-12-19T18:03:01.511295+0000","last_unstale":"2023-12-19T18:03:01.525995+0000","last_undegraded":"2023-12-19T18:03:01.525995+0000","last_fullsized":"2023-12-19T18:03:01.525995+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:43.950078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.22","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528947+0000","last_change":"2023-12-19T18:03:01.515786+0000","last_active":"2023-12-19T18:03:01.528947+0000","last_peered":"2023-12-19T18:03:01.528947+0000","last_clean":"2023-12-19T18:03:01.528947+0000","last_became_active":"2023-12-19T18:03:01.515500+0000","last_became_peered":"2023-12-19T18:03:01.515500+0000","last_unstale":"2023-12-19T18:03:01.528947+0000","last_undegraded":"2023-12-19T18:03:01.528947+0000","last_fullsized":"2023-12-19T18:03:01.528947+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:27.469203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.21","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524875+0000","last_change":"2023-12-19T18:03:01.516316+0000","last_active":"2023-12-19T18:03:01.524875+0000","last_peered":"2023-12-19T18:03:01.524875+0000","last_clean":"2023-12-19T18:03:01.524875+0000","last_became_active":"2023-12-19T18:03:01.516021+0000","last_became_peered":"2023-12-19T18:03:01.516021+0000","last_unstale":"2023-12-19T18:03:01.524875+0000","last_undegraded":"2023-12-19T18:03:01.524875+0000","last_fullsized":"2023-12-19T18:03:01.524875+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:08.737145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.20","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528592+0000","last_change":"2023-12-19T18:03:01.522278+0000","last_active":"2023-12-19T18:03:01.528592+0000","last_peered":"2023-12-19T18:03:01.528592+0000","last_clean":"2023-12-19T18:03:01.528592+0000","last_became_active":"2023-12-19T18:03:01.521996+0000","last_became_peered":"2023-12-19T18:03:01.521996+0000","last_unstale":"2023-12-19T18:03:01.528592+0000","last_undegraded":"2023-12-19T18:03:01.528592+0000","last_fullsized":"2023-12-19T18:03:01.528592+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529818+0000","last_change":"2023-12-19T18:03:01.522848+0000","last_active":"2023-12-19T18:03:01.529818+0000","last_peered":"2023-12-19T18:03:01.529818+0000","last_clean":"2023-12-19T18:03:01.529818+0000","last_became_active":"2023-12-19T18:03:01.522590+0000","last_became_peered":"2023-12-19T18:03:01.522590+0000","last_unstale":"2023-12-19T18:03:01.529818+0000","last_undegraded":"2023-12-19T18:03:01.529818+0000","last_fullsized":"2023-12-19T18:03:01.529818+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:56:36.817532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1f","version":"128'4","reported_seq":15,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530700+0000","last_change":"2023-12-19T18:03:01.031247+0000","last_active":"2023-12-19T18:03:01.530700+0000","last_peered":"2023-12-19T18:03:01.530700+0000","last_clean":"2023-12-19T18:03:01.530700+0000","last_became_active":"2023-12-19T18:03:01.029901+0000","last_became_peered":"2023-12-19T18:03:01.029901+0000","last_unstale":"2023-12-19T18:03:01.530700+0000","last_undegraded":"2023-12-19T18:03:01.530700+0000","last_fullsized":"2023-12-19T18:03:01.530700+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:13:39.939255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524851+0000","last_change":"2023-12-19T18:03:01.518433+0000","last_active":"2023-12-19T18:03:01.524851+0000","last_peered":"2023-12-19T18:03:01.524851+0000","last_clean":"2023-12-19T18:03:01.524851+0000","last_became_active":"2023-12-19T18:03:01.518170+0000","last_became_peered":"2023-12-19T18:03:01.518170+0000","last_unstale":"2023-12-19T18:03:01.524851+0000","last_undegraded":"2023-12-19T18:03:01.524851+0000","last_fullsized":"2023-12-19T18:03:01.524851+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:26:10.478715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.1e","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528394+0000","last_change":"2023-12-19T18:03:01.043692+0000","last_active":"2023-12-19T18:03:01.528394+0000","last_peered":"2023-12-19T18:03:01.528394+0000","last_clean":"2023-12-19T18:03:01.528394+0000","last_became_active":"2023-12-19T18:03:01.043406+0000","last_became_peered":"2023-12-19T18:03:01.043406+0000","last_unstale":"2023-12-19T18:03:01.528394+0000","last_undegraded":"2023-12-19T18:03:01.528394+0000","last_fullsized":"2023-12-19T18:03:01.528394+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525008+0000","last_change":"2023-12-19T18:03:01.515860+0000","last_active":"2023-12-19T18:03:01.525008+0000","last_peered":"2023-12-19T18:03:01.525008+0000","last_clean":"2023-12-19T18:03:01.525008+0000","last_became_active":"2023-12-19T18:03:01.515586+0000","last_became_peered":"2023-12-19T18:03:01.515586+0000","last_unstale":"2023-12-19T18:03:01.525008+0000","last_undegraded":"2023-12-19T18:03:01.525008+0000","last_fullsized":"2023-12-19T18:03:01.525008+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1d","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532808+0000","last_change":"2023-12-19T18:03:01.044240+0000","last_active":"2023-12-19T18:03:01.532808+0000","last_peered":"2023-12-19T18:03:01.532808+0000","last_clean":"2023-12-19T18:03:01.532808+0000","last_became_active":"2023-12-19T18:03:01.043989+0000","last_became_peered":"2023-12-19T18:03:01.043989+0000","last_unstale":"2023-12-19T18:03:01.532808+0000","last_undegraded":"2023-12-19T18:03:01.532808+0000","last_fullsized":"2023-12-19T18:03:01.532808+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:00.479629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524871+0000","last_change":"2023-12-19T18:03:01.514941+0000","last_active":"2023-12-19T18:03:01.524871+0000","last_peered":"2023-12-19T18:03:01.524871+0000","last_clean":"2023-12-19T18:03:01.524871+0000","last_became_active":"2023-12-19T18:03:01.511917+0000","last_became_peered":"2023-12-19T18:03:01.511917+0000","last_unstale":"2023-12-19T18:03:01.524871+0000","last_undegraded":"2023-12-19T18:03:01.524871+0000","last_fullsized":"2023-12-19T18:03:01.524871+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:47:52.886192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530719+0000","last_change":"2023-12-19T18:03:01.043134+0000","last_active":"2023-12-19T18:03:01.530719+0000","last_peered":"2023-12-19T18:03:01.530719+0000","last_clean":"2023-12-19T18:03:01.530719+0000","last_became_active":"2023-12-19T18:03:01.042431+0000","last_became_peered":"2023-12-19T18:03:01.042431+0000","last_unstale":"2023-12-19T18:03:01.530719+0000","last_undegraded":"2023-12-19T18:03:01.530719+0000","last_fullsized":"2023-12-19T18:03:01.530719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:12:32.570496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529172+0000","last_change":"2023-12-19T18:03:01.518227+0000","last_active":"2023-12-19T18:03:01.529172+0000","last_peered":"2023-12-19T18:03:01.529172+0000","last_clean":"2023-12-19T18:03:01.529172+0000","last_became_active":"2023-12-19T18:03:01.517946+0000","last_became_peered":"2023-12-19T18:03:01.517946+0000","last_unstale":"2023-12-19T18:03:01.529172+0000","last_undegraded":"2023-12-19T18:03:01.529172+0000","last_fullsized":"2023-12-19T18:03:01.529172+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1b","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.533045+0000","last_change":"2023-12-19T18:03:01.045236+0000","last_active":"2023-12-19T18:03:01.533045+0000","last_peered":"2023-12-19T18:03:01.533045+0000","last_clean":"2023-12-19T18:03:01.533045+0000","last_became_active":"2023-12-19T18:03:01.044907+0000","last_became_peered":"2023-12-19T18:03:01.044907+0000","last_unstale":"2023-12-19T18:03:01.533045+0000","last_undegraded":"2023-12-19T18:03:01.533045+0000","last_fullsized":"2023-12-19T18:03:01.533045+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519111+0000","last_change":"2023-12-19T18:03:01.509590+0000","last_active":"2023-12-19T18:03:01.519111+0000","last_peered":"2023-12-19T18:03:01.519111+0000","last_clean":"2023-12-19T18:03:01.519111+0000","last_became_active":"2023-12-19T18:03:01.509262+0000","last_became_peered":"2023-12-19T18:03:01.509262+0000","last_unstale":"2023-12-19T18:03:01.519111+0000","last_undegraded":"2023-12-19T18:03:01.519111+0000","last_fullsized":"2023-12-19T18:03:01.519111+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.1a","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.531136+0000","last_change":"2023-12-19T18:03:01.041854+0000","last_active":"2023-12-19T18:03:01.531136+0000","last_peered":"2023-12-19T18:03:01.531136+0000","last_clean":"2023-12-19T18:03:01.531136+0000","last_became_active":"2023-12-19T18:03:01.040426+0000","last_became_peered":"2023-12-19T18:03:01.040426+0000","last_unstale":"2023-12-19T18:03:01.531136+0000","last_undegraded":"2023-12-19T18:03:01.531136+0000","last_fullsized":"2023-12-19T18:03:01.531136+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:25.067419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528829+0000","last_change":"2023-12-19T18:03:01.515644+0000","last_active":"2023-12-19T18:03:01.528829+0000","last_peered":"2023-12-19T18:03:01.528829+0000","last_clean":"2023-12-19T18:03:01.528829+0000","last_became_active":"2023-12-19T18:03:01.512734+0000","last_became_peered":"2023-12-19T18:03:01.512734+0000","last_unstale":"2023-12-19T18:03:01.528829+0000","last_undegraded":"2023-12-19T18:03:01.528829+0000","last_fullsized":"2023-12-19T18:03:01.528829+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:36:17.957563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.496190+0000","last_change":"2023-12-19T18:03:01.037069+0000","last_active":"2023-12-19T18:03:01.496190+0000","last_peered":"2023-12-19T18:03:01.496190+0000","last_clean":"2023-12-19T18:03:01.496190+0000","last_became_active":"2023-12-19T18:03:01.036794+0000","last_became_peered":"2023-12-19T18:03:01.036794+0000","last_unstale":"2023-12-19T18:03:01.496190+0000","last_undegraded":"2023-12-19T18:03:01.496190+0000","last_fullsized":"2023-12-19T18:03:01.496190+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:53:42.153731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.531078+0000","last_change":"2023-12-19T18:03:01.526473+0000","last_active":"2023-12-19T18:03:01.531078+0000","last_peered":"2023-12-19T18:03:01.531078+0000","last_clean":"2023-12-19T18:03:01.531078+0000","last_became_active":"2023-12-19T18:03:01.526149+0000","last_became_peered":"2023-12-19T18:03:01.526149+0000","last_unstale":"2023-12-19T18:03:01.531078+0000","last_undegraded":"2023-12-19T18:03:01.531078+0000","last_fullsized":"2023-12-19T18:03:01.531078+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:44:48.994379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.504573+0000","last_change":"2023-12-19T18:03:01.041603+0000","last_active":"2023-12-19T18:03:01.504573+0000","last_peered":"2023-12-19T18:03:01.504573+0000","last_clean":"2023-12-19T18:03:01.504573+0000","last_became_active":"2023-12-19T18:03:01.040273+0000","last_became_peered":"2023-12-19T18:03:01.040273+0000","last_unstale":"2023-12-19T18:03:01.504573+0000","last_undegraded":"2023-12-19T18:03:01.504573+0000","last_fullsized":"2023-12-19T18:03:01.504573+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:49:23.457722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.520029+0000","last_change":"2023-12-19T18:03:01.510473+0000","last_active":"2023-12-19T18:03:01.520029+0000","last_peered":"2023-12-19T18:03:01.520029+0000","last_clean":"2023-12-19T18:03:01.520029+0000","last_became_active":"2023-12-19T18:03:01.510147+0000","last_became_peered":"2023-12-19T18:03:01.510147+0000","last_unstale":"2023-12-19T18:03:01.520029+0000","last_undegraded":"2023-12-19T18:03:01.520029+0000","last_fullsized":"2023-12-19T18:03:01.520029+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503580+0000","last_change":"2023-12-19T18:03:01.046117+0000","last_active":"2023-12-19T18:03:01.503580+0000","last_peered":"2023-12-19T18:03:01.503580+0000","last_clean":"2023-12-19T18:03:01.503580+0000","last_became_active":"2023-12-19T18:03:01.045799+0000","last_became_peered":"2023-12-19T18:03:01.045799+0000","last_unstale":"2023-12-19T18:03:01.503580+0000","last_undegraded":"2023-12-19T18:03:01.503580+0000","last_fullsized":"2023-12-19T18:03:01.503580+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:10:42.944414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524797+0000","last_change":"2023-12-19T18:03:01.515473+0000","last_active":"2023-12-19T18:03:01.524797+0000","last_peered":"2023-12-19T18:03:01.524797+0000","last_clean":"2023-12-19T18:03:01.524797+0000","last_became_active":"2023-12-19T18:03:01.512986+0000","last_became_peered":"2023-12-19T18:03:01.512986+0000","last_unstale":"2023-12-19T18:03:01.524797+0000","last_undegraded":"2023-12-19T18:03:01.524797+0000","last_fullsized":"2023-12-19T18:03:01.524797+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:04:01.485292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.497069+0000","last_change":"2023-12-19T18:03:01.049167+0000","last_active":"2023-12-19T18:03:01.497069+0000","last_peered":"2023-12-19T18:03:01.497069+0000","last_clean":"2023-12-19T18:03:01.497069+0000","last_became_active":"2023-12-19T18:03:01.048925+0000","last_became_peered":"2023-12-19T18:03:01.048925+0000","last_unstale":"2023-12-19T18:03:01.497069+0000","last_undegraded":"2023-12-19T18:03:01.497069+0000","last_fullsized":"2023-12-19T18:03:01.497069+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.527893+0000","last_change":"2023-12-19T18:03:01.509372+0000","last_active":"2023-12-19T18:03:01.527893+0000","last_peered":"2023-12-19T18:03:01.527893+0000","last_clean":"2023-12-19T18:03:01.527893+0000","last_became_active":"2023-12-19T18:03:01.509107+0000","last_became_peered":"2023-12-19T18:03:01.509107+0000","last_unstale":"2023-12-19T18:03:01.527893+0000","last_undegraded":"2023-12-19T18:03:01.527893+0000","last_fullsized":"2023-12-19T18:03:01.527893+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:02.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.15","version":"128'3","reported_seq":14,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530837+0000","last_change":"2023-12-19T18:03:01.035484+0000","last_active":"2023-12-19T18:03:01.530837+0000","last_peered":"2023-12-19T18:03:01.530837+0000","last_clean":"2023-12-19T18:03:01.530837+0000","last_became_active":"2023-12-19T18:03:01.035096+0000","last_became_peered":"2023-12-19T18:03:01.035096+0000","last_unstale":"2023-12-19T18:03:01.530837+0000","last_undegraded":"2023-12-19T18:03:01.530837+0000","last_fullsized":"2023-12-19T18:03:01.530837+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T22:31:55.570736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525082+0000","last_change":"2023-12-19T18:03:01.517319+0000","last_active":"2023-12-19T18:03:01.525082+0000","last_peered":"2023-12-19T18:03:01.525082+0000","last_clean":"2023-12-19T18:03:01.525082+0000","last_became_active":"2023-12-19T18:03:01.515999+0000","last_became_peered":"2023-12-19T18:03:01.515999+0000","last_unstale":"2023-12-19T18:03:01.525082+0000","last_undegraded":"2023-12-19T18:03:01.525082+0000","last_fullsized":"2023-12-19T18:03:01.525082+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.14","version":"128'6","reported_seq":17,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.533411+0000","last_change":"2023-12-19T18:03:01.043052+0000","last_active":"2023-12-19T18:03:01.533411+0000","last_peered":"2023-12-19T18:03:01.533411+0000","last_clean":"2023-12-19T18:03:01.533411+0000","last_became_active":"2023-12-19T18:03:01.042700+0000","last_became_peered":"2023-12-19T18:03:01.042700+0000","last_unstale":"2023-12-19T18:03:01.533411+0000","last_undegraded":"2023-12-19T18:03:01.533411+0000","last_fullsized":"2023-12-19T18:03:01.533411+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:33:07.485446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521909+0000","last_change":"2023-12-19T18:03:01.514894+0000","last_active":"2023-12-19T18:03:01.521909+0000","last_peered":"2023-12-19T18:03:01.521909+0000","last_clean":"2023-12-19T18:03:01.521909+0000","last_became_active":"2023-12-19T18:03:01.514612+0000","last_became_peered":"2023-12-19T18:03:01.514612+0000","last_unstale":"2023-12-19T18:03:01.521909+0000","last_undegraded":"2023-12-19T18:03:01.521909+0000","last_fullsized":"2023-12-19T18:03:01.521909+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.13","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529676+0000","last_change":"2023-12-19T18:03:01.037229+0000","last_active":"2023-12-19T18:03:01.529676+0000","last_peered":"2023-12-19T18:03:01.529676+0000","last_clean":"2023-12-19T18:03:01.529676+0000","last_became_active":"2023-12-19T18:03:01.036922+0000","last_became_peered":"2023-12-19T18:03:01.036922+0000","last_unstale":"2023-12-19T18:03:01.529676+0000","last_undegraded":"2023-12-19T18:03:01.529676+0000","last_fullsized":"2023-12-19T18:03:01.529676+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:42:16.787802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528559+0000","last_change":"2023-12-19T18:03:01.514274+0000","last_active":"2023-12-19T18:03:01.528559+0000","last_peered":"2023-12-19T18:03:01.528559+0000","last_clean":"2023-12-19T18:03:01.528559+0000","last_became_active":"2023-12-19T18:03:01.513969+0000","last_became_peered":"2023-12-19T18:03:01.513969+0000","last_unstale":"2023-12-19T18:03:01.528559+0000","last_undegraded":"2023-12-19T18:03:01.528559+0000","last_fullsized":"2023-12-19T18:03:01.528559+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:12:42.215902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.499722+0000","last_change":"2023-12-19T18:03:01.041706+0000","last_active":"2023-12-19T18:03:01.499722+0000","last_peered":"2023-12-19T18:03:01.499722+0000","last_clean":"2023-12-19T18:03:01.499722+0000","last_became_active":"2023-12-19T18:03:01.040042+0000","last_became_peered":"2023-12-19T18:03:01.040042+0000","last_unstale":"2023-12-19T18:03:01.499722+0000","last_undegraded":"2023-12-19T18:03:01.499722+0000","last_fullsized":"2023-12-19T18:03:01.499722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:01:53.747846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528738+0000","last_change":"2023-12-19T18:03:01.519394+0000","last_active":"2023-12-19T18:03:01.528738+0000","last_peered":"2023-12-19T18:03:01.528738+0000","last_clean":"2023-12-19T18:03:01.528738+0000","last_became_active":"2023-12-19T18:03:01.519108+0000","last_became_peered":"2023-12-19T18:03:01.519108+0000","last_unstale":"2023-12-19T18:03:01.528738+0000","last_undegraded":"2023-12-19T18:03:01.528738+0000","last_fullsized":"2023-12-19T18:03:01.528738+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.500947+0000","last_change":"2023-12-19T18:03:01.041523+0000","last_active":"2023-12-19T18:03:01.500947+0000","last_peered":"2023-12-19T18:03:01.500947+0000","last_clean":"2023-12-19T18:03:01.500947+0000","last_became_active":"2023-12-19T18:03:01.041293+0000","last_became_peered":"2023-12-19T18:03:01.041293+0000","last_unstale":"2023-12-19T18:03:01.500947+0000","last_undegraded":"2023-12-19T18:03:01.500947+0000","last_fullsized":"2023-12-19T18:03:01.500947+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:14:54.430060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.521058+0000","last_change":"2023-12-19T18:03:01.514191+0000","last_active":"2023-12-19T18:03:01.521058+0000","last_peered":"2023-12-19T18:03:01.521058+0000","last_clean":"2023-12-19T18:03:01.521058+0000","last_became_active":"2023-12-19T18:03:01.513939+0000","last_became_peered":"2023-12-19T18:03:01.513939+0000","last_unstale":"2023-12-19T18:03:01.521058+0000","last_undegraded":"2023-12-19T18:03:01.521058+0000","last_fullsized":"2023-12-19T18:03:01.521058+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:41.558005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.f","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526652+0000","last_change":"2023-12-19T18:03:01.043501+0000","last_active":"2023-12-19T18:03:01.526652+0000","last_peered":"2023-12-19T18:03:01.526652+0000","last_clean":"2023-12-19T18:03:01.526652+0000","last_became_active":"2023-12-19T18:03:01.042962+0000","last_became_peered":"2023-12-19T18:03:01.042962+0000","last_unstale":"2023-12-19T18:03:01.526652+0000","last_undegraded":"2023-12-19T18:03:01.526652+0000","last_fullsized":"2023-12-19T18:03:01.526652+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:16:42.234454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524563+0000","last_change":"2023-12-19T18:03:01.515905+0000","last_active":"2023-12-19T18:03:01.524563+0000","last_peered":"2023-12-19T18:03:01.524563+0000","last_clean":"2023-12-19T18:03:01.524563+0000","last_became_active":"2023-12-19T18:03:01.515582+0000","last_became_peered":"2023-12-19T18:03:01.515582+0000","last_unstale":"2023-12-19T18:03:01.524563+0000","last_undegraded":"2023-12-19T18:03:01.524563+0000","last_fullsized":"2023-12-19T18:03:01.524563+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:44.405063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.e","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526448+0000","last_change":"2023-12-19T18:03:01.044609+0000","last_active":"2023-12-19T18:03:01.526448+0000","last_peered":"2023-12-19T18:03:01.526448+0000","last_clean":"2023-12-19T18:03:01.526448+0000","last_became_active":"2023-12-19T18:03:01.044346+0000","last_became_peered":"2023-12-19T18:03:01.044346+0000","last_unstale":"2023-12-19T18:03:01.526448+0000","last_undegraded":"2023-12-19T18:03:01.526448+0000","last_fullsized":"2023-12-19T18:03:01.526448+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:16:20.857309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525826+0000","last_change":"2023-12-19T18:03:01.518694+0000","last_active":"2023-12-19T18:03:01.525826+0000","last_peered":"2023-12-19T18:03:01.525826+0000","last_clean":"2023-12-19T18:03:01.525826+0000","last_became_active":"2023-12-19T18:03:01.518441+0000","last_became_peered":"2023-12-19T18:03:01.518441+0000","last_unstale":"2023-12-19T18:03:01.525826+0000","last_undegraded":"2023-12-19T18:03:01.525826+0000","last_fullsized":"2023-12-19T18:03:01.525826+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:53:48.707978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.d","version":"128'1","reported_seq":12,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529270+0000","last_change":"2023-12-19T18:03:01.037450+0000","last_active":"2023-12-19T18:03:01.529270+0000","last_peered":"2023-12-19T18:03:01.529270+0000","last_clean":"2023-12-19T18:03:01.529270+0000","last_became_active":"2023-12-19T18:03:01.037175+0000","last_became_peered":"2023-12-19T18:03:01.037175+0000","last_unstale":"2023-12-19T18:03:01.529270+0000","last_undegraded":"2023-12-19T18:03:01.529270+0000","last_fullsized":"2023-12-19T18:03:01.529270+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:54.253683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.510887+0000","last_change":"2023-12-19T18:03:01.506907+0000","last_active":"2023-12-19T18:03:01.510887+0000","last_peered":"2023-12-19T18:03:01.510887+0000","last_clean":"2023-12-19T18:03:01.510887+0000","last_became_active":"2023-12-19T18:03:01.505913+0000","last_became_peered":"2023-12-19T18:03:01.505913+0000","last_unstale":"2023-12-19T18:03:01.510887+0000","last_undegraded":"2023-12-19T18:03:01.510887+0000","last_fullsized":"2023-12-19T18:03:01.510887+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.496923+0000","last_change":"2023-12-19T18:03:01.046428+0000","last_active":"2023-12-19T18:03:01.496923+0000","last_peered":"2023-12-19T18:03:01.496923+0000","last_clean":"2023-12-19T18:03:01.496923+0000","last_became_active":"2023-12-19T18:03:01.046121+0000","last_became_peered":"2023-12-19T18:03:01.046121+0000","last_unstale":"2023-12-19T18:03:01.496923+0000","last_undegraded":"2023-12-19T18:03:01.496923+0000","last_fullsized":"2023-12-19T18:03:01.496923+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:55:12.408666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.522071+0000","last_change":"2023-12-19T18:03:01.517333+0000","last_active":"2023-12-19T18:03:01.522071+0000","last_peered":"2023-12-19T18:03:01.522071+0000","last_clean":"2023-12-19T18:03:01.522071+0000","last_became_active":"2023-12-19T18:03:01.517092+0000","last_became_peered":"2023-12-19T18:03:01.517092+0000","last_unstale":"2023-12-19T18:03:01.522071+0000","last_undegraded":"2023-12-19T18:03:01.522071+0000","last_fullsized":"2023-12-19T18:03:01.522071+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:15:35.371295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.b","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526569+0000","last_change":"2023-12-19T18:03:01.039131+0000","last_active":"2023-12-19T18:03:01.526569+0000","last_peered":"2023-12-19T18:03:01.526569+0000","last_clean":"2023-12-19T18:03:01.526569+0000","last_became_active":"2023-12-19T18:03:01.038734+0000","last_became_peered":"2023-12-19T18:03:01.038734+0000","last_unstale":"2023-12-19T18:03:01.526569+0000","last_undegraded":"2023-12-19T18:03:01.526569+0000","last_fullsized":"2023-12-19T18:03:01.526569+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:12:46.564642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.515420+0000","last_change":"2023-12-19T18:03:01.508354+0000","last_active":"2023-12-19T18:03:01.515420+0000","last_peered":"2023-12-19T18:03:01.515420+0000","last_clean":"2023-12-19T18:03:01.515420+0000","last_became_active":"2023-12-19T18:03:01.508038+0000","last_became_peered":"2023-12-19T18:03:01.508038+0000","last_unstale":"2023-12-19T18:03:01.515420+0000","last_undegraded":"2023-12-19T18:03:01.515420+0000","last_fullsized":"2023-12-19T18:03:01.515420+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:34:49.525762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.498504+0000","last_change":"2023-12-19T18:03:01.040136+0000","last_active":"2023-12-19T18:03:01.498504+0000","last_peered":"2023-12-19T18:03:01.498504+0000","last_clean":"2023-12-19T18:03:01.498504+0000","last_became_active":"2023-12-19T18:03:01.039868+0000","last_became_peered":"2023-12-19T18:03:01.039868+0000","last_unstale":"2023-12-19T18:03:01.498504+0000","last_undegraded":"2023-12-19T18:03:01.498504+0000","last_fullsized":"2023-12-19T18:03:01.498504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:03:40.552341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.515506+0000","last_change":"2023-12-19T18:03:01.507780+0000","last_active":"2023-12-19T18:03:01.515506+0000","last_peered":"2023-12-19T18:03:01.515506+0000","last_clean":"2023-12-19T18:03:01.515506+0000","last_became_active":"2023-12-19T18:03:01.507503+0000","last_became_peered":"2023-12-19T18:03:01.507503+0000","last_unstale":"2023-12-19T18:03:01.515506+0000","last_undegraded":"2023-12-19T18:03:01.515506+0000","last_fullsized":"2023-12-19T18:03:01.515506+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T20:07:34.035010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.501050+0000","last_change":"2023-12-19T18:03:01.042852+0000","last_active":"2023-12-19T18:03:01.501050+0000","last_peered":"2023-12-19T18:03:01.501050+0000","last_clean":"2023-12-19T18:03:01.501050+0000","last_became_active":"2023-12-19T18:03:01.042591+0000","last_became_peered":"2023-12-19T18:03:01.042591+0000","last_unstale":"2023-12-19T18:03:01.501050+0000","last_undegraded":"2023-12-19T18:03:01.501050+0000","last_fullsized":"2023-12-19T18:03:01.501050+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:31:36.844616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.528707+0000","last_change":"2023-12-19T18:03:01.522686+0000","last_active":"2023-12-19T18:03:01.528707+0000","last_peered":"2023-12-19T18:03:01.528707+0000","last_clean":"2023-12-19T18:03:01.528707+0000","last_became_active":"2023-12-19T18:03:01.522364+0000","last_became_peered":"2023-12-19T18:03:01.522364+0000","last_unstale":"2023-12-19T18:03:01.528707+0000","last_undegraded":"2023-12-19T18:03:01.528707+0000","last_fullsized":"2023-12-19T18:03:01.528707+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T21:46:55.259347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.494973+0000","last_change":"2023-12-19T18:03:01.042245+0000","last_active":"2023-12-19T18:03:01.494973+0000","last_peered":"2023-12-19T18:03:01.494973+0000","last_clean":"2023-12-19T18:03:01.494973+0000","last_became_active":"2023-12-19T18:03:01.041594+0000","last_became_peered":"2023-12-19T18:03:01.041594+0000","last_unstale":"2023-12-19T18:03:01.494973+0000","last_undegraded":"2023-12-19T18:03:01.494973+0000","last_fullsized":"2023-12-19T18:03:01.494973+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:32:47.506271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532721+0000","last_change":"2023-12-19T18:03:01.530430+0000","last_active":"2023-12-19T18:03:01.532721+0000","last_peered":"2023-12-19T18:03:01.532721+0000","last_clean":"2023-12-19T18:03:01.532721+0000","last_became_active":"2023-12-19T18:03:01.530152+0000","last_became_peered":"2023-12-19T18:03:01.530152+0000","last_unstale":"2023-12-19T18:03:01.532721+0000","last_undegraded":"2023-12-19T18:03:01.532721+0000","last_fullsized":"2023-12-19T18:03:01.532721+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:10:09.235125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.7","version":"128'2","reported_seq":13,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.525367+0000","last_change":"2023-12-19T18:03:01.043296+0000","last_active":"2023-12-19T18:03:01.525367+0000","last_peered":"2023-12-19T18:03:01.525367+0000","last_clean":"2023-12-19T18:03:01.525367+0000","last_became_active":"2023-12-19T18:03:01.040391+0000","last_became_peered":"2023-12-19T18:03:01.040391+0000","last_unstale":"2023-12-19T18:03:01.525367+0000","last_undegraded":"2023-12-19T18:03:01.525367+0000","last_fullsized":"2023-12-19T18:03:01.525367+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:16:48.320418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529244+0000","last_change":"2023-12-19T18:03:01.521630+0000","last_active":"2023-12-19T18:03:01.529244+0000","last_peered":"2023-12-19T18:03:01.529244+0000","last_clean":"2023-12-19T18:03:01.529244+0000","last_became_active":"2023-12-19T18:03:01.521375+0000","last_became_peered":"2023-12-19T18:03:01.521375+0000","last_unstale":"2023-12-19T18:03:01.529244+0000","last_undegraded":"2023-12-19T18:03:01.529244+0000","last_fullsized":"2023-12-19T18:03:01.529244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:12.828854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.6","version":"129'1","reported_seq":12,"reported_epoch":129,"state":"active+clean","last_fresh":"2023-12-19T18:03:02.508719+0000","last_change":"2023-12-19T18:03:01.036153+0000","last_active":"2023-12-19T18:03:02.508719+0000","last_peered":"2023-12-19T18:03:02.508719+0000","last_clean":"2023-12-19T18:03:02.508719+0000","last_became_active":"2023-12-19T18:03:01.035798+0000","last_became_peered":"2023-12-19T18:03:01.035798+0000","last_unstale":"2023-12-19T18:03:02.508719+0000","last_undegraded":"2023-12-19T18:03:02.508719+0000","last_fullsized":"2023-12-19T18:03:02.508719+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:18:43.399399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.526935+0000","last_change":"2023-12-19T18:03:01.516512+0000","last_active":"2023-12-19T18:03:01.526935+0000","last_peered":"2023-12-19T18:03:01.526935+0000","last_clean":"2023-12-19T18:03:01.526935+0000","last_became_active":"2023-12-19T18:03:01.516230+0000","last_became_peered":"2023-12-19T18:03:01.516230+0000","last_unstale":"2023-12-19T18:03:01.526935+0000","last_undegraded":"2023-12-19T18:03:01.526935+0000","last_fullsized":"2023-12-19T18:03:01.526935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:39:22.463712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503824+0000","last_change":"2023-12-19T18:03:01.044483+0000","last_active":"2023-12-19T18:03:01.503824+0000","last_peered":"2023-12-19T18:03:01.503824+0000","last_clean":"2023-12-19T18:03:01.503824+0000","last_became_active":"2023-12-19T18:03:01.043913+0000","last_became_peered":"2023-12-19T18:03:01.043913+0000","last_unstale":"2023-12-19T18:03:01.503824+0000","last_undegraded":"2023-12-19T18:03:01.503824+0000","last_fullsized":"2023-12-19T18:03:01.503824+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:55.855500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519198+0000","last_change":"2023-12-19T18:03:01.512256+0000","last_active":"2023-12-19T18:03:01.519198+0000","last_peered":"2023-12-19T18:03:01.519198+0000","last_clean":"2023-12-19T18:03:01.519198+0000","last_became_active":"2023-12-19T18:03:01.512017+0000","last_became_peered":"2023-12-19T18:03:01.512017+0000","last_unstale":"2023-12-19T18:03:01.519198+0000","last_undegraded":"2023-12-19T18:03:01.519198+0000","last_fullsized":"2023-12-19T18:03:01.519198+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:56.861164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.505492+0000","last_change":"2023-12-19T18:03:01.041437+0000","last_active":"2023-12-19T18:03:01.505492+0000","last_peered":"2023-12-19T18:03:01.505492+0000","last_clean":"2023-12-19T18:03:01.505492+0000","last_became_active":"2023-12-19T18:03:01.041139+0000","last_became_peered":"2023-12-19T18:03:01.041139+0000","last_unstale":"2023-12-19T18:03:01.505492+0000","last_undegraded":"2023-12-19T18:03:01.505492+0000","last_fullsized":"2023-12-19T18:03:01.505492+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:45:01.261039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524846+0000","last_change":"2023-12-19T18:03:01.518874+0000","last_active":"2023-12-19T18:03:01.524846+0000","last_peered":"2023-12-19T18:03:01.524846+0000","last_clean":"2023-12-19T18:03:01.524846+0000","last_became_active":"2023-12-19T18:03:01.518634+0000","last_became_peered":"2023-12-19T18:03:01.518634+0000","last_unstale":"2023-12-19T18:03:01.524846+0000","last_undegraded":"2023-12-19T18:03:01.524846+0000","last_fullsized":"2023-12-19T18:03:01.524846+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T18:32:20.489876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.505022+0000","last_change":"2023-12-19T18:03:01.049301+0000","last_active":"2023-12-19T18:03:01.505022+0000","last_peered":"2023-12-19T18:03:01.505022+0000","last_clean":"2023-12-19T18:03:01.505022+0000","last_became_active":"2023-12-19T18:03:01.048995+0000","last_became_peered":"2023-12-19T18:03:01.048995+0000","last_unstale":"2023-12-19T18:03:01.505022+0000","last_undegraded":"2023-12-19T18:03:01.505022+0000","last_fullsized":"2023-12-19T18:03:01.505022+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:11:56.595353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.530017+0000","last_change":"2023-12-19T18:03:01.523203+0000","last_active":"2023-12-19T18:03:01.530017+0000","last_peered":"2023-12-19T18:03:01.530017+0000","last_clean":"2023-12-19T18:03:01.530017+0000","last_became_active":"2023-12-19T18:03:01.522763+0000","last_became_peered":"2023-12-19T18:03:01.522763+0000","last_unstale":"2023-12-19T18:03:01.530017+0000","last_undegraded":"2023-12-19T18:03:01.530017+0000","last_fullsized":"2023-12-19T18:03:01.530017+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T23:51:26.073083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.504691+0000","last_change":"2023-12-19T18:03:01.042324+0000","last_active":"2023-12-19T18:03:01.504691+0000","last_peered":"2023-12-19T18:03:01.504691+0000","last_clean":"2023-12-19T18:03:01.504691+0000","last_became_active":"2023-12-19T18:03:01.041724+0000","last_became_peered":"2023-12-19T18:03:01.041724+0000","last_unstale":"2023-12-19T18:03:01.504691+0000","last_undegraded":"2023-12-19T18:03:01.504691+0000","last_fullsized":"2023-12-19T18:03:01.504691+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:41:28.074168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.524623+0000","last_change":"2023-12-19T18:03:01.515603+0000","last_active":"2023-12-19T18:03:01.524623+0000","last_peered":"2023-12-19T18:03:01.524623+0000","last_clean":"2023-12-19T18:03:01.524623+0000","last_became_active":"2023-12-19T18:03:01.515306+0000","last_became_peered":"2023-12-19T18:03:01.515306+0000","last_unstale":"2023-12-19T18:03:01.524623+0000","last_undegraded":"2023-12-19T18:03:01.524623+0000","last_fullsized":"2023-12-19T18:03:01.524623+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T02:52:43.324973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.503093+0000","last_change":"2023-12-19T18:03:01.041166+0000","last_active":"2023-12-19T18:03:01.503093+0000","last_peered":"2023-12-19T18:03:01.503093+0000","last_clean":"2023-12-19T18:03:01.503093+0000","last_became_active":"2023-12-19T18:03:01.039307+0000","last_became_peered":"2023-12-19T18:03:01.039307+0000","last_unstale":"2023-12-19T18:03:01.503093+0000","last_undegraded":"2023-12-19T18:03:01.503093+0000","last_fullsized":"2023-12-19T18:03:01.503093+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T00:28:26.463539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.529240+0000","last_change":"2023-12-19T18:03:01.521534+0000","last_active":"2023-12-19T18:03:01.529240+0000","last_peered":"2023-12-19T18:03:01.529240+0000","last_clean":"2023-12-19T18:03:01.529240+0000","last_became_active":"2023-12-19T18:03:01.521276+0000","last_became_peered":"2023-12-19T18:03:01.521276+0000","last_unstale":"2023-12-19T18:03:01.529240+0000","last_undegraded":"2023-12-19T18:03:01.529240+0000","last_fullsized":"2023-12-19T18:03:01.529240+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T01:48:32.817411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":11,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.495081+0000","last_change":"2023-12-19T18:03:01.036205+0000","last_active":"2023-12-19T18:03:01.495081+0000","last_peered":"2023-12-19T18:03:01.495081+0000","last_clean":"2023-12-19T18:03:01.495081+0000","last_became_active":"2023-12-19T18:03:01.035940+0000","last_became_peered":"2023-12-19T18:03:01.035940+0000","last_unstale":"2023-12-19T18:03:01.495081+0000","last_undegraded":"2023-12-19T18:03:01.495081+0000","last_fullsized":"2023-12-19T18:03:01.495081+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-20T19:54:11.823190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":10,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.519948+0000","last_change":"2023-12-19T18:03:01.513336+0000","last_active":"2023-12-19T18:03:01.519948+0000","last_peered":"2023-12-19T18:03:01.519948+0000","last_clean":"2023-12-19T18:03:01.519948+0000","last_became_active":"2023-12-19T18:03:01.512097+0000","last_became_peered":"2023-12-19T18:03:01.512097+0000","last_unstale":"2023-12-19T18:03:01.519948+0000","last_undegraded":"2023-12-19T18:03:01.519948+0000","last_fullsized":"2023-12-19T18:03:01.519948+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:03:01.001712+0000","last_clean_scrub_stamp":"2023-12-19T18:03:01.001712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:45.843330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.10","version":"128'8","reported_seq":19,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.532039+0000","last_change":"2023-12-19T18:03:01.036635+0000","last_active":"2023-12-19T18:03:01.532039+0000","last_peered":"2023-12-19T18:03:01.532039+0000","last_clean":"2023-12-19T18:03:01.532039+0000","last_became_active":"2023-12-19T18:03:01.036255+0000","last_became_peered":"2023-12-19T18:03:01.036255+0000","last_unstale":"2023-12-19T18:03:01.532039+0000","last_undegraded":"2023-12-19T18:03:01.532039+0000","last_fullsized":"2023-12-19T18:03:01.532039+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T18:02:59.996048+0000","last_clean_scrub_stamp":"2023-12-19T18:02:59.996048+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T03:02:44.837666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":278,"reported_epoch":128,"state":"active+clean","last_fresh":"2023-12-19T18:03:01.495247+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:03:01.495247+0000","last_peered":"2023-12-19T18:03:01.495247+0000","last_clean":"2023-12-19T18:03:01.495247+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:03:01.495247+0000","last_undegraded":"2023-12-19T18:03:01.495247+0000","last_fullsized":"2023-12-19T18:03:01.495247+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":18,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":17,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33212,"kb_used_data":2164,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338628,"statfs":{"total":96636764160,"available":96602755072,"internally_reserved":0,"allocated":2215936,"data_stored":1374240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.2150000000000001,"15min":1.117},"min":{"1min":0.68100000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.8959999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.276,"15min":1.179},"min":{"1min":0.747,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4770000000000001,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.151}]},{"osd":1,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.175,"15min":1.1040000000000001},"min":{"1min":0.63400000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.444,"5min":12.625,"15min":12.625},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.071,"5min":1.169,"15min":1.1379999999999999},"min":{"1min":0.752,"5min":0.60899999999999999,"15min":0.52600000000000002},"max":{"1min":1.3540000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1140000000000001,"5min":1.1839999999999999,"15min":1.097},"min":{"1min":0.84499999999999997,"5min":0.64300000000000002,"15min":0.61699999999999999},"max":{"1min":1.371,"5min":13.041,"15min":13.041},"last":1.353},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.587,"15min":1.288},"min":{"1min":0.86499999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.431,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.113}]},{"osd":3,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.26,"15min":1.171},"min":{"1min":0.82799999999999996,"5min":0.67100000000000004,"15min":0.51600000000000001},"max":{"1min":1.409,"5min":12.917,"15min":12.917},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.363,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":1.083,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5860000000000001,"5min":46.375,"15min":46.375},"last":1.2969999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2430000000000001,"15min":1.212},"min":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.601,"5min":13.137,"15min":13.137},"last":1.232},{"interface":"front","average":{"1min":1.238,"5min":1.3640000000000001,"15min":1.3069999999999999},"min":{"1min":0.85399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.4810000000000001,"5min":13.109,"15min":13.109},"last":1.2629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.29,"15min":1.244},"min":{"1min":0.84599999999999997,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.492,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.2170000000000001,"5min":1.3069999999999999,"15min":1.286},"min":{"1min":0.89200000000000002,"5min":0.81000000000000005,"15min":0.63200000000000001},"max":{"1min":1.522,"5min":13.198,"15min":13.198},"last":1.3220000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:52 2023","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.478,"15min":1.4179999999999999},"min":{"1min":0.98299999999999998,"5min":0.86099999999999999,"15min":0.77500000000000002},"max":{"1min":1.675,"5min":13.442,"15min":13.442},"last":1.421},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.4199999999999999,"15min":1.363},"min":{"1min":1.03,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.792,"5min":13.981,"15min":13.981},"last":1.4350000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1609728,"data_stored":783678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.98899999999999999,"5min":0.997,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.381,"5min":1.399,"15min":4.5979999999999999},"last":1.129},{"interface":"front","average":{"1min":1.103,"5min":1.04,"15min":1.0740000000000001},"min":{"1min":0.755,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.4490000000000001,"5min":1.756,"15min":1.756},"last":0.77400000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.107,"15min":1.0900000000000001},"min":{"1min":0.70499999999999996,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.494,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.304},{"interface":"front","average":{"1min":1.1419999999999999,"5min":1.101,"15min":1.1140000000000001},"min":{"1min":0.80300000000000005,"5min":0.59099999999999997,"15min":0.48099999999999998},"max":{"1min":1.415,"5min":1.583,"15min":1.621},"last":1.2689999999999999}]},{"osd":2,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.131,"15min":1.282},"min":{"1min":0.94699999999999995,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.371},{"interface":"front","average":{"1min":1.244,"5min":1.1890000000000001,"15min":1.2170000000000001},"min":{"1min":0.90900000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.673,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.3380000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.1830000000000001,"5min":1.173,"15min":1.2490000000000001},"min":{"1min":0.91200000000000003,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.5529999999999999,"5min":1.651,"15min":4.5380000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.248,"5min":1.218,"15min":1.29},"min":{"1min":0.83099999999999996,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.635,"5min":1.635,"15min":4.508},"last":1.419}]},{"osd":4,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.149,"15min":1.137},"min":{"1min":0.76000000000000001,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.5129999999999999,"5min":1.577,"15min":1.8360000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.2290000000000001,"15min":1.2390000000000001},"min":{"1min":0.73099999999999998,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.579,"5min":1.802,"15min":1.899},"last":0.98199999999999998}]},{"osd":5,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.319,"5min":1.2569999999999999,"15min":1.2589999999999999},"min":{"1min":0.89400000000000002,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.083},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.2729999999999999,"15min":1.2689999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.724,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.1970000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:02:47 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.353,"15min":1.3520000000000001},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.857,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.385,"15min":1.395},"min":{"1min":1.056,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.827,"5min":1.841,"15min":2.2440000000000002},"last":1.4670000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574991,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1576,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1613824,"data_stored":783256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0289999999999999,"15min":1.0049999999999999},"min":{"1min":0.82199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.5109999999999999,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1.0669999999999999,"15min":1.0620000000000001},"min":{"1min":0.70999999999999996,"5min":0.66200000000000003,"15min":0.60599999999999998},"max":{"1min":1.409,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.73}]},{"osd":1,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.135,"15min":1.113},"min":{"1min":0.78700000000000003,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.3540000000000001,"5min":1.974,"15min":1.974},"last":1.591},{"interface":"front","average":{"1min":1.173,"5min":1.145,"15min":1.179},"min":{"1min":0.77700000000000002,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.399,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.347}]},{"osd":2,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1140000000000001,"15min":1.145},"min":{"1min":0.89700000000000002,"5min":0.629,"15min":0.45500000000000002},"max":{"1min":1.4450000000000001,"5min":1.891,"15min":2.9929999999999999},"last":1.397},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.1080000000000001,"15min":1.1339999999999999},"min":{"1min":0.79600000000000004,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.3720000000000001,"5min":2.024,"15min":2.024},"last":1.5229999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.175,"15min":1.2330000000000001},"min":{"1min":0.878,"5min":0.65900000000000003,"15min":0.64500000000000002},"max":{"1min":1.482,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.333,"5min":1.25,"15min":1.3120000000000001},"min":{"1min":1.079,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.536,"5min":1.829,"15min":3.0350000000000001},"last":1.2190000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.1240000000000001,"5min":1.1890000000000001,"15min":1.244},"min":{"1min":0.79800000000000004,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.4650000000000001,"5min":3.633,"15min":3.633},"last":1.704},{"interface":"front","average":{"1min":1.3620000000000001,"5min":1.3009999999999999,"15min":1.3480000000000001},"min":{"1min":1.1830000000000001,"5min":0.78600000000000003,"15min":0.745},"max":{"1min":1.5600000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":0.81899999999999995}]},{"osd":6,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.2490000000000001,"15min":1.323},"min":{"1min":1.0429999999999999,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.609,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.242,"5min":1.248,"15min":1.3029999999999999},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.5600000000000001,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.296}]},{"osd":7,"last update":"Tue Dec 19 18:02:49 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.3180000000000001,"15min":1.411},"min":{"1min":0.85899999999999999,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.9279999999999999,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.492},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.3759999999999999,"15min":1.4870000000000001},"min":{"1min":1.0429999999999999,"5min":0.98099999999999998,"15min":0.82499999999999996},"max":{"1min":1.7350000000000001,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.8280000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1580,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1617920,"data_stored":784660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.077,"15min":1.1739999999999999},"min":{"1min":0.76200000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.458,"5min":1.556,"15min":5.4420000000000002},"last":1.423},{"interface":"front","average":{"1min":1.24,"5min":1.1890000000000001,"15min":1.252},"min":{"1min":0.90400000000000003,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.53,"5min":1.657,"15min":5.5049999999999999},"last":1.3100000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1100000000000001,"15min":1.181},"min":{"1min":0.83199999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.5580000000000001,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.161},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.0580000000000001,"15min":1.161},"min":{"1min":0.85699999999999998,"5min":0.70999999999999996,"15min":0.66000000000000003},"max":{"1min":1.4319999999999999,"5min":1.5589999999999999,"15min":3.254},"last":1.349}]},{"osd":2,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.0820000000000001,"15min":1.1970000000000001},"min":{"1min":0.69799999999999995,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.4850000000000001,"5min":1.623,"15min":4.593},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.1970000000000001,"5min":1.173,"15min":1.2050000000000001},"min":{"1min":0.71599999999999997,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.454,"5min":1.871,"15min":2.3799999999999999},"last":1.534}]},{"osd":3,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1220000000000001,"15min":1.2070000000000001},"min":{"1min":0.90000000000000002,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.3939999999999999,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.044},{"interface":"front","average":{"1min":1.266,"5min":1.2110000000000001,"15min":1.3160000000000001},"min":{"1min":0.93700000000000006,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.5409999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.5629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1910000000000001,"5min":1.1779999999999999,"15min":1.202},"min":{"1min":0.88600000000000001,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.502,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.46},{"interface":"front","average":{"1min":1.161,"5min":1.1779999999999999,"15min":1.1659999999999999},"min":{"1min":0.81999999999999995,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.4970000000000001,"5min":1.8,"15min":2.157},"last":1.667}]},{"osd":6,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2350000000000001,"15min":1.252},"min":{"1min":0.872,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.5609999999999999,"5min":1.6910000000000001,"15min":2.915},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.409,"5min":1.4019999999999999,"15min":1.4039999999999999},"min":{"1min":1.266,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6200000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.631}]},{"osd":7,"last update":"Tue Dec 19 18:02:48 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.296,"15min":1.306},"min":{"1min":0.99299999999999999,"5min":0.66700000000000004,"15min":0.56899999999999995},"max":{"1min":1.556,"5min":1.907,"15min":2.4340000000000002},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.353,"5min":1.363,"15min":1.369},"min":{"1min":1.0600000000000001,"5min":0.69799999999999995,"15min":0.63600000000000001},"max":{"1min":1.7,"5min":1.833,"15min":5.6859999999999999},"last":1.5049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32632,"kb_used_data":1584,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339208,"statfs":{"total":96636764160,"available":96603348992,"internally_reserved":0,"allocated":1622016,"data_stored":784694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.83199999999999996,"15min":0.874},"min":{"1min":0.61399999999999999,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":1.329,"5min":1.6599999999999999,"15min":1.825},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90800000000000003,"15min":0.92100000000000004},"min":{"1min":0.48099999999999998,"5min":0.45900000000000002,"15min":0.435},"max":{"1min":1.6299999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.79700000000000004}]},{"osd":1,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":0.90600000000000003,"15min":0.91000000000000003},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.3859999999999999,"5min":1.7010000000000001,"15min":1.7010000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":1.163,"5min":1.0609999999999999,"15min":1.04},"min":{"1min":0.80900000000000005,"5min":0.311,"15min":0.311},"max":{"1min":1.6180000000000001,"5min":2.1509999999999998,"15min":2.1509999999999998},"last":0.91700000000000004}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.0649999999999999,"15min":1.091},"min":{"1min":0.59099999999999997,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5680000000000001,"5min":1.679,"15min":2.177},"last":1.204},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.1599999999999999,"15min":1.2010000000000001},"min":{"1min":0.71599999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.679,"5min":1.679,"15min":1.8520000000000001},"last":0.98899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":1.1599999999999999,"15min":1.204},"min":{"1min":0.67800000000000005,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.7070000000000001,"5min":1.7310000000000001,"15min":2.234},"last":1.054},{"interface":"front","average":{"1min":1.357,"5min":1.3109999999999999,"15min":1.302},"min":{"1min":0.873,"5min":0.80900000000000005,"15min":0.70299999999999996},"max":{"1min":1.591,"5min":2.9420000000000002,"15min":2.9420000000000002},"last":1.702}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.405,"5min":1.3340000000000001,"15min":1.369},"min":{"1min":1.0129999999999999,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":1.964,"5min":2.0699999999999998,"15min":2.5419999999999998},"last":1.353},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2729999999999999,"15min":1.3149999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.74299999999999999},"max":{"1min":1.5740000000000001,"5min":1.776,"15min":2.754},"last":1.46}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.359,"5min":1.345,"15min":1.379},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":1.6859999999999999,"5min":1.946,"15min":2.6880000000000002},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.504,"5min":1.411,"15min":1.444},"min":{"1min":0.98499999999999999,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.8089999999999999,"5min":2.274,"15min":2.6429999999999998},"last":1.2909999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.351,"15min":1.3999999999999999},"min":{"1min":0.84799999999999998,"5min":0.80900000000000005,"15min":0.77700000000000002},"max":{"1min":1.7909999999999999,"5min":1.9730000000000001,"15min":3.02},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.4279999999999999,"15min":1.4630000000000001},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.83099999999999996},"max":{"1min":1.7809999999999999,"5min":2.323,"15min":2.8170000000000002},"last":1.79}]}]},{"osd":2,"up_from":13,"seq":55834574991,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1568,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1605632,"data_stored":783096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.91900000000000004,"15min":1.119},"min":{"1min":0.65600000000000003,"5min":0.497,"15min":0.29599999999999999},"max":{"1min":1.4710000000000001,"5min":3.9209999999999998,"15min":13.32},"last":0.87},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.98099999999999998,"15min":1.222},"min":{"1min":0.72799999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3,"5min":3.8149999999999999,"15min":13.206},"last":1.1060000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.93799999999999994,"15min":0.91700000000000004},"min":{"1min":0.60499999999999998,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.4079999999999999,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.284},{"interface":"front","average":{"1min":0.97599999999999998,"5min":0.96999999999999997,"15min":0.98499999999999999},"min":{"1min":0.70299999999999996,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.653,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.337}]},{"osd":3,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":0.92600000000000005,"15min":0.95499999999999996},"min":{"1min":0.67600000000000005,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.4610000000000001,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.214,"5min":1.1619999999999999,"15min":1.1890000000000001},"min":{"1min":0.89900000000000002,"5min":0.63100000000000001,"15min":0.504},"max":{"1min":1.647,"5min":2.75,"15min":2.75},"last":1.381}]},{"osd":4,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.258,"15min":1.2490000000000001},"min":{"1min":1.01,"5min":0.81000000000000005,"15min":0.72699999999999998},"max":{"1min":1.4339999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.532},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.274,"15min":1.278},"min":{"1min":1.0389999999999999,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.429,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.4370000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.218,"15min":1.264},"min":{"1min":0.874,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.7110000000000001,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.504},{"interface":"front","average":{"1min":1.3069999999999999,"5min":1.3380000000000001,"15min":1.403},"min":{"1min":1.008,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.571,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.474}]},{"osd":6,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.3879999999999999,"15min":1.389},"min":{"1min":0.98799999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.6359999999999999,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.6299999999999999},{"interface":"front","average":{"1min":1.323,"5min":1.3109999999999999,"15min":1.3380000000000001},"min":{"1min":0.92600000000000005,"5min":0.872,"15min":0.872},"max":{"1min":1.6040000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.413}]},{"osd":7,"last update":"Tue Dec 19 18:02:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.4039999999999999,"15min":1.4299999999999999},"min":{"1min":0.92900000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.766,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.5529999999999999},{"interface":"front","average":{"1min":1.335,"5min":1.367,"15min":1.3839999999999999},"min":{"1min":0.95799999999999996,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.7,"5min":5.375,"15min":5.375},"last":1.0529999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1572,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1609728,"data_stored":783118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.88800000000000001,"15min":0.91300000000000003},"min":{"1min":0.72599999999999998,"5min":0.497,"15min":0.42399999999999999},"max":{"1min":1.5329999999999999,"5min":1.671,"15min":1.931},"last":1.103},{"interface":"front","average":{"1min":0.995,"5min":0.95099999999999996,"15min":0.98299999999999998},"min":{"1min":0.55200000000000005,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.335,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.78800000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.82499999999999996,"15min":0.91600000000000004},"min":{"1min":0.54100000000000004,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.1619999999999999,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0269999999999999,"5min":0.97599999999999998,"15min":1.0609999999999999},"min":{"1min":0.59399999999999997,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.387,"5min":1.5580000000000001,"15min":3.4199999999999999},"last":1.2949999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.075,"15min":1.1819999999999999},"min":{"1min":0.751,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":3.4950000000000001},"last":1.1839999999999999},{"interface":"front","average":{"1min":1,"5min":0.95499999999999996,"15min":1.0840000000000001},"min":{"1min":0.60299999999999998,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.4279999999999999,"5min":1.55,"15min":4.2030000000000003},"last":0.93999999999999995}]},{"osd":4,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.2789999999999999,"15min":1.345},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.8779999999999999,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.226,"5min":1.2250000000000001,"15min":1.3009999999999999},"min":{"1min":0.86599999999999999,"5min":0.82499999999999996,"15min":0.56999999999999995},"max":{"1min":1.6299999999999999,"5min":1.681,"15min":2.6960000000000002},"last":0.75900000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2310000000000001,"5min":1.2090000000000001,"15min":1.296},"min":{"1min":0.93400000000000005,"5min":0.82999999999999996,"15min":0.69599999999999995},"max":{"1min":1.7130000000000001,"5min":1.8009999999999999,"15min":2.9249999999999998},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.91100000000000003,"5min":0.83299999999999996,"15min":0.69399999999999995},"max":{"1min":1.915,"5min":1.915,"15min":3.8420000000000001},"last":1.2490000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":1.3240000000000001,"15min":1.4470000000000001},"min":{"1min":0.85799999999999998,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9930000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.23},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.333,"15min":1.4610000000000001},"min":{"1min":0.997,"5min":0.84499999999999997,"15min":0.72899999999999998},"max":{"1min":1.766,"5min":1.917,"15min":3.214},"last":1.171}]},{"osd":7,"last update":"Tue Dec 19 18:02:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.359,"15min":1.5069999999999999},"min":{"1min":1.028,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.0179999999999998,"5min":2.0179999999999998,"15min":4.0910000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.359,"5min":1.337,"15min":1.452},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.0830000000000002,"5min":2.0830000000000002,"15min":4.6390000000000002},"last":1.0629999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574991,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2148,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2199552,"data_stored":1372467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.86799999999999999,"15min":0.94499999999999995},"min":{"1min":0.54600000000000004,"5min":0.49199999999999999,"15min":0.46700000000000003},"max":{"1min":1.129,"5min":1.53,"15min":2.2250000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":1.0429999999999999,"5min":0.94599999999999995,"15min":1.077},"min":{"1min":0.80500000000000005,"5min":0.505,"15min":0.499},"max":{"1min":1.4239999999999999,"5min":1.73,"15min":2.3599999999999999},"last":0.85399999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":0.80700000000000005,"5min":0.89200000000000002,"15min":0.94399999999999995},"min":{"1min":0.57899999999999996,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.2649999999999999,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.88900000000000001,"15min":0.94199999999999995},"min":{"1min":0.64000000000000001,"5min":0.497,"15min":0.45300000000000001},"max":{"1min":1.1879999999999999,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.73299999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.69199999999999995,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.4630000000000001,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.2230000000000001,"5min":1.151,"15min":1.21},"min":{"1min":0.57599999999999996,"5min":0.56299999999999994,"15min":0.54700000000000004},"max":{"1min":1.609,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.149}]},{"osd":4,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.3080000000000001,"5min":1.2529999999999999,"15min":1.3200000000000001},"min":{"1min":0.86399999999999999,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.6459999999999999,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.198},{"interface":"front","average":{"1min":1.306,"5min":1.2629999999999999,"15min":1.333},"min":{"1min":0.92800000000000005,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.641,"5min":1.738,"15min":2.7799999999999998},"last":1.218}]},{"osd":5,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.204,"15min":1.2549999999999999},"min":{"1min":0.80800000000000005,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":1.758,"5min":1.758,"15min":2.0579999999999998},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2649999999999999,"5min":1.2789999999999999,"15min":1.3},"min":{"1min":0.78300000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.891,"5min":1.891,"15min":2.0030000000000001},"last":0.93799999999999994}]},{"osd":6,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.292,"5min":1.3220000000000001,"15min":1.3839999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.802,"5min":1.802,"15min":2.1000000000000001},"last":1.0469999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.266,"15min":1.373},"min":{"1min":0.97399999999999998,"5min":0.86899999999999999,"15min":0.84999999999999998},"max":{"1min":1.7030000000000001,"5min":1.8300000000000001,"15min":2.3889999999999998},"last":1.022}]},{"osd":7,"last update":"Tue Dec 19 18:02:53 2023","interfaces":[{"interface":"back","average":{"1min":1.4019999999999999,"5min":1.333,"15min":1.4870000000000001},"min":{"1min":1.131,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.7829999999999999,"5min":1.9339999999999999,"15min":4.9400000000000004},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.367,"5min":1.3220000000000001,"15min":1.46},"min":{"1min":0.95099999999999996,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.8280000000000001,"5min":1.875,"15min":4.8250000000000002},"last":1.107}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:03:11.349 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-19T18:03:11.349 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-19T18:03:11.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.577+0000 7fc11d951700 1 Processor -- start 2023-12-19T18:03:11.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.577+0000 7fc11d951700 1 -- start start 2023-12-19T18:03:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11d951700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc11815ade0 0x7fc1180cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11d951700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc1180cc380 0x7fc1180cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11d951700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11815b1c0 con 0x7fc1180cf520 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11d951700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1180b4bb0 con 0x7fc11815ade0 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11d951700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1180ce2f0 con 0x7fc1180cc380 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc11815ade0 0x7fc1180cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc11815ade0 0x7fc1180cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43280/0 (socket says 172.21.15.45:43280) 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 -- 172.21.15.45:0/2532853051 learned_addr learned my addr 172.21.15.45:0/2532853051 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:11.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11d150700 1 --2- 172.21.15.45:0/2532853051 >> v2:172.21.15.73:3300/0 conn(0x7fc1180cc380 0x7fc1180cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 -- 172.21.15.45:0/2532853051 >> v2:172.21.15.73:3300/0 conn(0x7fc1180cc380 msgr2=0x7fc1180cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 --2- 172.21.15.45:0/2532853051 >> v2:172.21.15.73:3300/0 conn(0x7fc1180cc380 0x7fc1180cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 -- 172.21.15.45:0/2532853051 >> v1:172.21.15.73:6789/0 conn(0x7fc1180cf520 legacy=0x7fc1180b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.581+0000 7fc11c94f700 1 -- 172.21.15.45:0/2532853051 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180ceb50 con 0x7fc11815ade0 2023-12-19T18:03:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11c94f700 1 --2- 172.21.15.45:0/2532853051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc1180cefe0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fc1180af150 tx=0x7fc10c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bb1c85bbb24eec server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc1177fe700 1 -- 172.21.15.45:0/2532853051 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011830 con 0x7fc11815ade0 2023-12-19T18:03:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc1177fe700 1 -- 172.21.15.45:0/2532853051 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10c011990 con 0x7fc11815ade0 2023-12-19T18:03:11.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc1177fe700 1 -- 172.21.15.45:0/2532853051 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10c011d20 con 0x7fc11815ade0 2023-12-19T18:03:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 -- 172.21.15.45:0/2532853051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 msgr2=0x7fc1180cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 --2- 172.21.15.45:0/2532853051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc1180cefe0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7fc1180af150 tx=0x7fc10c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 -- 172.21.15.45:0/2532853051 shutdown_connections 2023-12-19T18:03:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 --2- 172.21.15.45:0/2532853051 >> v2:172.21.15.73:3300/0 conn(0x7fc1180cc380 0x7fc1180cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 --2- 172.21.15.45:0/2532853051 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc1180cefe0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 -- 172.21.15.45:0/2532853051 >> 172.21.15.45:0/2532853051 conn(0x7fc1180b14f0 msgr2=0x7fc1180b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 -- 172.21.15.45:0/2532853051 shutdown_connections 2023-12-19T18:03:11.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.585+0000 7fc11d951700 1 -- 172.21.15.45:0/2532853051 wait complete. 2023-12-19T18:03:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 Processor -- start 2023-12-19T18:03:11.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 -- start start 2023-12-19T18:03:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1180cc380 0x7fc1180700f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1180cf520 0x7fc1180cb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc118070a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815c350 con 0x7fc11815ade0 2023-12-19T18:03:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815b6d0 con 0x7fc1180cf520 2023-12-19T18:03:11.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d951700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11815b9b0 con 0x7fc1180cc380 2023-12-19T18:03:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc118070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc118070a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43292/0 (socket says 172.21.15.45:43292) 2023-12-19T18:03:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 -- 172.21.15.45:0/2351609313 learned_addr learned my addr 172.21.15.45:0/2351609313 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11c94f700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1180cc380 0x7fc1180700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc117fff700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1180cf520 0x7fc1180cb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 -- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1180cc380 msgr2=0x7fc1180700f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1180cc380 0x7fc1180700f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 -- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1180cf520 msgr2=0x7fc1180cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1180cf520 0x7fc1180cb2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 -- 172.21.15.45:0/2351609313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c009570 con 0x7fc11815ade0 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.589+0000 7fc11d150700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc118070a70 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fc11000efc0 tx=0x7fc11000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.593+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110009ea0 con 0x7fc11815ade0 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.593+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11000f040 con 0x7fc11815ade0 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.593+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11000ced0 con 0x7fc11815ade0 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.593+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11815bc90 con 0x7fc11815ade0 2023-12-19T18:03:11.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.593+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc118070630 con 0x7fc11815ade0 2023-12-19T18:03:11.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.593+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc118067760 con 0x7fc11815ade0 2023-12-19T18:03:11.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.597+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc110014480 con 0x7fc11815ade0 2023-12-19T18:03:11.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.597+0000 7fc1157fa700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc0fc065ad0 0x7fc0fc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:11.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.597+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc110083ae0 con 0x7fc11815ade0 2023-12-19T18:03:11.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.597+0000 7fc11c94f700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc0fc065ad0 0x7fc0fc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:11.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.597+0000 7fc11c94f700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc0fc065ad0 0x7fc0fc067f90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000c00 tx=0x7fc10c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:11.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.601+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc110051400 con 0x7fc11815ade0 2023-12-19T18:03:11.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.845+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fc1180ce4d0 con 0x7fc11815ade0 2023-12-19T18:03:11.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.857+0000 7fc1157fa700 1 -- 172.21.15.45:0/2351609313 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7fc110018020 con 0x7fc11815ade0 2023-12-19T18:03:11.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc0fc065ad0 msgr2=0x7fc0fc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc0fc065ad0 0x7fc0fc067f90 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fc10c000c00 tx=0x7fc10c008030 comp rx=0 tx=0).stop 2023-12-19T18:03:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 msgr2=0x7fc118070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc118070a70 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7fc11000efc0 tx=0x7fc11000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 shutdown_connections 2023-12-19T18:03:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc0fc065ad0 0x7fc0fc067f90 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc11815ade0 0x7fc118070a70 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc1180cf520 0x7fc1180cb2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 --2- 172.21.15.45:0/2351609313 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc1180cc380 0x7fc1180700f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.861+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 >> 172.21.15.45:0/2351609313 conn(0x7fc1180b14f0 msgr2=0x7fc1180b0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.865+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 shutdown_connections 2023-12-19T18:03:11.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:11.865+0000 7fc11d951700 1 -- 172.21.15.45:0/2351609313 wait complete. 2023-12-19T18:03:11.871 INFO:teuthology.orchestra.run.smithi045.stderr:updated caps for client.0 2023-12-19T18:03:11.892 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:12.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 Processor -- start 2023-12-19T18:03:12.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 -- start start 2023-12-19T18:03:12.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f82d406e140 0x7f82d415df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82d40ce190 0x7f82d4071a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82d415e470 con 0x7f82d4071580 2023-12-19T18:03:12.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d4161a50 con 0x7f82d40ce190 2023-12-19T18:03:12.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d9f99700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82d4071f50 con 0x7f82d406e140 2023-12-19T18:03:12.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82d40ce190 0x7f82d4071a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f82d40ce190 0x7f82d4071a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43296/0 (socket says 172.21.15.45:43296) 2023-12-19T18:03:12.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d3fff700 1 -- 172.21.15.45:0/255689354 learned_addr learned my addr 172.21.15.45:0/255689354 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.065+0000 7f82d37fe700 1 --2- 172.21.15.45:0/255689354 >> v2:172.21.15.73:3300/0 conn(0x7f82d406e140 0x7f82d415df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d3fff700 1 -- 172.21.15.45:0/255689354 >> v2:172.21.15.73:3300/0 conn(0x7f82d406e140 msgr2=0x7f82d415df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d3fff700 1 --2- 172.21.15.45:0/255689354 >> v2:172.21.15.73:3300/0 conn(0x7f82d406e140 0x7f82d415df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d3fff700 1 -- 172.21.15.45:0/255689354 >> v1:172.21.15.45:6789/0 conn(0x7f82d4071580 legacy=0x7f82d406ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d3fff700 1 -- 172.21.15.45:0/255689354 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d40c44e0 con 0x7f82d40ce190 2023-12-19T18:03:12.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d3fff700 1 --2- 172.21.15.45:0/255689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d40ce190 0x7f82d4071a10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f82d406ab80 tx=0x7f82cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9195267167cd1c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d27fc700 1 -- 172.21.15.45:0/255689354 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00e070 con 0x7f82d40ce190 2023-12-19T18:03:12.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d27fc700 1 -- 172.21.15.45:0/255689354 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc00b9c0 con 0x7f82d40ce190 2023-12-19T18:03:12.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d27fc700 1 -- 172.21.15.45:0/255689354 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc00bd70 con 0x7f82d40ce190 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 -- 172.21.15.45:0/255689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d40ce190 msgr2=0x7f82d4071a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 --2- 172.21.15.45:0/255689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d40ce190 0x7f82d4071a10 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f82d406ab80 tx=0x7f82cc00b330 comp rx=0 tx=0).stop 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 -- 172.21.15.45:0/255689354 shutdown_connections 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 --2- 172.21.15.45:0/255689354 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d40ce190 0x7f82d4071a10 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 --2- 172.21.15.45:0/255689354 >> v2:172.21.15.73:3300/0 conn(0x7f82d406e140 0x7f82d415df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 -- 172.21.15.45:0/255689354 >> 172.21.15.45:0/255689354 conn(0x7f82d40cb860 msgr2=0x7f82d40cbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 -- 172.21.15.45:0/255689354 shutdown_connections 2023-12-19T18:03:12.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.069+0000 7f82d9f99700 1 -- 172.21.15.45:0/255689354 wait complete. 2023-12-19T18:03:12.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 Processor -- start 2023-12-19T18:03:12.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 -- start start 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82d406e140 0x7f82d414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 0x7f82d41f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82d40ce190 0x7f82d40c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d41f6af0 con 0x7f82d4071580 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d415b650 con 0x7f82d406e140 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d9f99700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d41f6530 con 0x7f82d40ce190 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 0x7f82d41f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 0x7f82d41f5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43310/0 (socket says 172.21.15.45:43310) 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 -- 172.21.15.45:0/2650432254 learned_addr learned my addr 172.21.15.45:0/2650432254 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d37fe700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82d406e140 0x7f82d414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d3fff700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82d40ce190 0x7f82d40c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 -- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82d40ce190 msgr2=0x7f82d40c6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82d40ce190 0x7f82d40c6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 -- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82d406e140 msgr2=0x7f82d414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82d406e140 0x7f82d414d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 -- 172.21.15.45:0/2650432254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82cc009b30 con 0x7f82d4071580 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d37fe700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82d406e140 0x7f82d414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d3fff700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82d40ce190 0x7f82d40c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.073+0000 7f82d2ffd700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 0x7f82d41f5be0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c500 tx=0x7f82c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.077+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80052d0 con 0x7f82d4071580 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.077+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82c8005430 con 0x7f82d4071580 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.077+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d41f6810 con 0x7f82d4071580 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.077+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c80055a0 con 0x7f82d4071580 2023-12-19T18:03:12.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.077+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d41f6120 con 0x7f82d4071580 2023-12-19T18:03:12.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.077+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d415e2e0 con 0x7f82d4071580 2023-12-19T18:03:12.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.081+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f82c80038e0 con 0x7f82d4071580 2023-12-19T18:03:12.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.081+0000 7f82bbfff700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f82c0065ad0 0x7f82c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.081+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f82c80827a0 con 0x7f82d4071580 2023-12-19T18:03:12.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.081+0000 7f82d37fe700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f82c0065ad0 0x7f82c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.081+0000 7f82d37fe700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f82c0065ad0 0x7f82c0067f90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009a10 tx=0x7f82c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.085+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f82c8050010 con 0x7f82d4071580 2023-12-19T18:03:12.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.305+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f82d415b0d0 con 0x7f82d4071580 2023-12-19T18:03:12.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.305+0000 7f82bbfff700 1 -- 172.21.15.45:0/2650432254 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f82d415b0d0 con 0x7f82d4071580 2023-12-19T18:03:12.311 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:12.311 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":57464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:04.628359+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57470":{"gid":57470,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/3417552399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3417552399},{"type":"v1","addr":"172.21.15.45:6837","nonce":3417552399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f82c0065ad0 msgr2=0x7f82c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f82c0065ad0 0x7f82c0067f90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f82c4009a10 tx=0x7f82c4008040 comp rx=0 tx=0).stop 2023-12-19T18:03:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 msgr2=0x7f82d41f5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 0x7f82d41f5be0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f82c800c500 tx=0x7f82c800c8c0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 shutdown_connections 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f82c0065ad0 0x7f82c0067f90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f82d40ce190 0x7f82d40c6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f82d4071580 0x7f82d41f5be0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 --2- 172.21.15.45:0/2650432254 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82d406e140 0x7f82d414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 >> 172.21.15.45:0/2650432254 conn(0x7f82d40cb860 msgr2=0x7f82d415a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 shutdown_connections 2023-12-19T18:03:12.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.309+0000 7f82d9f99700 1 -- 172.21.15.45:0/2650432254 wait complete. 2023-12-19T18:03:12.317 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 99 2023-12-19T18:03:12.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:04.628359+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57470}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57470': {'gid': 57470, 'name': 'c', 'rank': 0, 'incarnation': 95, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.45:6837/3417552399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 3417552399}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 3417552399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:12.741 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:03:12.741 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T18:03:12.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.925+0000 7fde49e7e700 1 Processor -- start 2023-12-19T18:03:12.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.925+0000 7fde49e7e700 1 -- start start 2023-12-19T18:03:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde49e7e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fde4406ea90 0x7fde440d0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde49e7e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde440b88b0 0x7fde440b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde49e7e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde440b6dd0 con 0x7fde440b6250 2023-12-19T18:03:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde49e7e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde440d1820 con 0x7fde440b88b0 2023-12-19T18:03:12.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde49e7e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde440d1b00 con 0x7fde4406ea90 2023-12-19T18:03:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde3bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fde440b88b0 0x7fde440b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fde4406ea90 0x7fde440d0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fde4406ea90 0x7fde440d0f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:55898/0 (socket says 172.21.15.45:55898) 2023-12-19T18:03:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 -- 172.21.15.45:0/2168792772 learned_addr learned my addr 172.21.15.45:0/2168792772 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 -- 172.21.15.45:0/2168792772 >> v2:172.21.15.45:3300/0 conn(0x7fde440b88b0 msgr2=0x7fde440b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 --2- 172.21.15.45:0/2168792772 >> v2:172.21.15.45:3300/0 conn(0x7fde440b88b0 0x7fde440b5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 -- 172.21.15.45:0/2168792772 >> v1:172.21.15.73:6789/0 conn(0x7fde440b6250 legacy=0x7fde440b66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 -- 172.21.15.45:0/2168792772 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440d1de0 con 0x7fde4406ea90 2023-12-19T18:03:12.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde3bfff700 1 --2- 172.21.15.45:0/2168792772 >> v2:172.21.15.45:3300/0 conn(0x7fde440b88b0 0x7fde440b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:12.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.929+0000 7fde48e7c700 1 --2- 172.21.15.45:0/2168792772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde4406ea90 0x7fde440d0f20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fde440b57b0 tx=0x7fde4000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=702f618faca05d4c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde3b7fe700 1 -- 172.21.15.45:0/2168792772 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000e070 con 0x7fde4406ea90 2023-12-19T18:03:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde3b7fe700 1 -- 172.21.15.45:0/2168792772 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4000b910 con 0x7fde4406ea90 2023-12-19T18:03:12.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde3b7fe700 1 -- 172.21.15.45:0/2168792772 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000bcc0 con 0x7fde4406ea90 2023-12-19T18:03:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 -- 172.21.15.45:0/2168792772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde4406ea90 msgr2=0x7fde440d0f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 --2- 172.21.15.45:0/2168792772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde4406ea90 0x7fde440d0f20 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fde440b57b0 tx=0x7fde4000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 -- 172.21.15.45:0/2168792772 shutdown_connections 2023-12-19T18:03:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 --2- 172.21.15.45:0/2168792772 >> v2:172.21.15.45:3300/0 conn(0x7fde440b88b0 0x7fde440b5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 --2- 172.21.15.45:0/2168792772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde4406ea90 0x7fde440d0f20 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 -- 172.21.15.45:0/2168792772 >> 172.21.15.45:0/2168792772 conn(0x7fde440b46d0 msgr2=0x7fde440b4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 -- 172.21.15.45:0/2168792772 shutdown_connections 2023-12-19T18:03:12.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.933+0000 7fde49e7e700 1 -- 172.21.15.45:0/2168792772 wait complete. 2023-12-19T18:03:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 Processor -- start 2023-12-19T18:03:12.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 -- start start 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde4406ea90 0x7fde440c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde440b6250 0x7fde4414c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 0x7fde440b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440c7600 con 0x7fde440b88b0 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde440ca1f0 con 0x7fde440b6250 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde49e7e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde440c6710 con 0x7fde4406ea90 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde4967d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 0x7fde440b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde4967d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 0x7fde440b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43334/0 (socket says 172.21.15.45:43334) 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde4967d700 1 -- 172.21.15.45:0/4138715108 learned_addr learned my addr 172.21.15.45:0/4138715108 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.937+0000 7fde3bfff700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde440b6250 0x7fde4414c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde48e7c700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde4406ea90 0x7fde440c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde4967d700 1 -- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde4406ea90 msgr2=0x7fde440c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde4967d700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde4406ea90 0x7fde440c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde4967d700 1 -- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde440b6250 msgr2=0x7fde4414c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde4967d700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde440b6250 0x7fde4414c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde4967d700 1 -- 172.21.15.45:0/4138715108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde340094b0 con 0x7fde440b88b0 2023-12-19T18:03:12.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde48e7c700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde4406ea90 0x7fde440c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde4967d700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 0x7fde440b7470 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c390 tx=0x7fde3c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde397fa700 1 -- 172.21.15.45:0/4138715108 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0052d0 con 0x7fde440b88b0 2023-12-19T18:03:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde397fa700 1 -- 172.21.15.45:0/4138715108 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c005430 con 0x7fde440b88b0 2023-12-19T18:03:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde397fa700 1 -- 172.21.15.45:0/4138715108 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c0055a0 con 0x7fde440b88b0 2023-12-19T18:03:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde40009b30 con 0x7fde440b88b0 2023-12-19T18:03:12.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.941+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440c6cd0 con 0x7fde440b88b0 2023-12-19T18:03:12.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.945+0000 7fde397fa700 1 -- 172.21.15.45:0/4138715108 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fde3c0036a0 con 0x7fde440b88b0 2023-12-19T18:03:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.945+0000 7fde397fa700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde30065b00 0x7fde30067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.945+0000 7fde397fa700 1 -- 172.21.15.45:0/4138715108 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde3c0823d0 con 0x7fde440b88b0 2023-12-19T18:03:12.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.945+0000 7fde48e7c700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde30065b00 0x7fde30067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.945+0000 7fde48e7c700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde30065b00 0x7fde30067fc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fde40000f80 tx=0x7fde40009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 Processor -- start 2023-12-19T18:03:12.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 -- start start 2023-12-19T18:03:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a59eb0 0x2a0fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 0x2a5a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a0d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x29815b0 con 0x2a38430 2023-12-19T18:03:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x297ed40 con 0x2a5a7d0 2023-12-19T18:03:12.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x297a630 con 0x2a59eb0 2023-12-19T18:03:12.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde3bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 0x2a5a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde3bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 0x2a5a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43336/0 (socket says 172.21.15.45:43336) 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde3bfff700 1 -- 172.21.15.45:0/3807034619 learned_addr learned my addr 172.21.15.45:0/3807034619 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde48e7c700 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a59eb0 0x2a0fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.949+0000 7fde4967d700 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a0d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde3bfff700 1 -- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a59eb0 msgr2=0x2a0fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde3bfff700 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a59eb0 0x2a0fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde3bfff700 1 -- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 msgr2=0x2a0d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde3bfff700 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a0d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde3bfff700 1 -- 172.21.15.45:0/3807034619 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x27ed960 con 0x2a38430 2023-12-19T18:03:12.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde48e7c700 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a59eb0 0x2a0fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde3bfff700 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 0x2a5a290 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fde34009d90 tx=0x7fde340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a12cf2189a42a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde2a7fc700 1 -- 172.21.15.45:0/3807034619 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34011d10 con 0x2a38430 2023-12-19T18:03:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde2a7fc700 1 -- 172.21.15.45:0/3807034619 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde34011e70 con 0x2a38430 2023-12-19T18:03:12.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde2a7fc700 1 -- 172.21.15.45:0/3807034619 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34004270 con 0x2a38430 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 -- 172.21.15.45:0/3807034619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 msgr2=0x2a5a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 0x2a5a290 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fde34009d90 tx=0x7fde340115a0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 -- 172.21.15.45:0/3807034619 shutdown_connections 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a0d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a38430 0x2a5a290 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 --2- 172.21.15.45:0/3807034619 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a59eb0 0x2a0fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 -- 172.21.15.45:0/3807034619 >> 172.21.15.45:0/3807034619 conn(0x27a24d0 msgr2=0x2a13d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 -- 172.21.15.45:0/3807034619 shutdown_connections 2023-12-19T18:03:12.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 -- 172.21.15.45:0/3807034619 wait complete. 2023-12-19T18:03:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 -- start start 2023-12-19T18:03:12.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.953+0000 7fde4e36d740 1 Processor -- start 2023-12-19T18:03:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2a58c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a59eb0 0x2a3b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 0x2a3b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2937c80 con 0x2a5a7d0 2023-12-19T18:03:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x293db00 con 0x2a59eb0 2023-12-19T18:03:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2826aa0 con 0x2a38430 2023-12-19T18:03:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 10 client.0 _ll_register_callbacks cb 0x2973f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:03:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 0x2a3b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 0x2a3b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43340/0 (socket says 172.21.15.45:43340) 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 -- 172.21.15.45:0/652648945 learned_addr learned my addr 172.21.15.45:0/652648945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde48e7c700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2a58c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde3bfff700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a59eb0 0x2a3b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 -- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 msgr2=0x2a58c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2a58c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 -- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a59eb0 msgr2=0x2a3b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a59eb0 0x2a3b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 -- 172.21.15.45:0/652648945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde340099c0 con 0x2a5a7d0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4967d700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 0x2a3b810 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fde3c05b3d0 tx=0x7fde3c00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f907ae46ea7cbc3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde237fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde237fe700 1 -- 172.21.15.45:0/652648945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c057750 con 0x2a5a7d0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde237fe700 1 -- 172.21.15.45:0/652648945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde3c05b900 con 0x2a5a7d0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x29736b0 con 0x2a5a7d0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde237fe700 1 -- 172.21.15.45:0/652648945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde3c080be0 con 0x2a5a7d0 2023-12-19T18:03:12.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 10 client.9009 fetch_fsmap learned FSMap version 99 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x2940770 con 0x2a5a7d0 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.957+0000 7fde237fe700 1 -- 172.21.15.45:0/652648945 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c07e070 con 0x2a5a7d0 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde237fe700 1 -- 172.21.15.45:0/652648945 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 99) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fde3c052e10 con 0x2a5a7d0 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 10 client.9009 fetch_fsmap finished waiting for FSMap version 99 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 10 client.9009 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 20 client.9009 populate_metadata read hostname 'smithi045' 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a21a40 0x2a6da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 4 client.9009 mds_command: new command op to 57470 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 --> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2935a00 con 0x2a21a40 2023-12-19T18:03:12.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde48e7c700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a21a40 0x2a6da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde48e7c700 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a21a40 0x2a6da90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1816ed5fb219181d server_cookie=d54532c20efd5d54 in_seq=0 out_seq=0 2023-12-19T18:03:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde237fe700 10 client.9009 ms_handle_connect on v2:172.21.15.45:6835/3417552399 2023-12-19T18:03:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde237fe700 1 -- 172.21.15.45:0/652648945 <== mds.0 v2:172.21.15.45:6835/3417552399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x2935a00 con 0x2a21a40 2023-12-19T18:03:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde237fe700 10 client.9009 handle_command_reply: tid=0 2023-12-19T18:03:12.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 client.9009 shutdown 2023-12-19T18:03:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 msgr2=0x2a3b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 0x2a3b810 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fde3c05b3d0 tx=0x7fde3c00a000 comp rx=0 tx=0).stop 2023-12-19T18:03:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 shutdown_connections 2023-12-19T18:03:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a21a40 0x2a6da90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5a7d0 0x2a3b810 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a59eb0 0x2a3b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde237fe700 0 client.9009 ms_handle_reset on v2:172.21.15.45:6835/3417552399 2023-12-19T18:03:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 --2- 172.21.15.45:0/652648945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2a58c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 >> 172.21.15.45:0/652648945 conn(0x27a24d0 msgr2=0x2a36f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 shutdown_connections 2023-12-19T18:03:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.961+0000 7fde4e36d740 1 -- 172.21.15.45:0/652648945 wait complete. 2023-12-19T18:03:12.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.965+0000 7fde4e36d740 20 client.9009 trim_cache size 0 max 16384 2023-12-19T18:03:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 Processor -- start 2023-12-19T18:03:12.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 -- start start 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a38430 0x2a37390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 0x2a572f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a5a7d0 0x2a57830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2a382f0 con 0x2a59eb0 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2975fa0 con 0x2a38430 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2977a30 con 0x2a5a7d0 2023-12-19T18:03:12.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 0x2a572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 0x2a572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43354/0 (socket says 172.21.15.45:43354) 2023-12-19T18:03:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 -- 172.21.15.45:0/1264753862 learned_addr learned my addr 172.21.15.45:0/1264753862 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde48e7c700 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a38430 0x2a37390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde4967d700 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a5a7d0 0x2a57830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 -- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a5a7d0 msgr2=0x2a57830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a5a7d0 0x2a57830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 -- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a38430 msgr2=0x2a37390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a38430 0x2a37390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 -- 172.21.15.45:0/1264753862 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x29269a0 con 0x2a59eb0 2023-12-19T18:03:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde48e7c700 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a38430 0x2a37390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:12.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.985+0000 7fde3bfff700 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 0x2a572f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fde34018000 tx=0x7fde34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=850cf9cf9997b880 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde2affd700 1 -- 172.21.15.45:0/1264753862 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34024070 con 0x2a59eb0 2023-12-19T18:03:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde2affd700 1 -- 172.21.15.45:0/1264753862 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde340097d0 con 0x2a59eb0 2023-12-19T18:03:12.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde2affd700 1 -- 172.21.15.45:0/1264753862 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34004260 con 0x2a59eb0 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 -- 172.21.15.45:0/1264753862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 msgr2=0x2a572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 0x2a572f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fde34018000 tx=0x7fde34016000 comp rx=0 tx=0).stop 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 -- 172.21.15.45:0/1264753862 shutdown_connections 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a5a7d0 0x2a57830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a59eb0 0x2a572f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1264753862 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a38430 0x2a37390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 -- 172.21.15.45:0/1264753862 >> 172.21.15.45:0/1264753862 conn(0x27a24d0 msgr2=0x2a226b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 -- 172.21.15.45:0/1264753862 shutdown_connections 2023-12-19T18:03:12.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 -- 172.21.15.45:0/1264753862 wait complete. 2023-12-19T18:03:12.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 -- start start 2023-12-19T18:03:12.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.989+0000 7fde4e36d740 1 Processor -- start 2023-12-19T18:03:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2aa9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a5f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 0x2a5dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2905480 con 0x2a5d830 2023-12-19T18:03:12.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2948670 con 0x2a5a7d0 2023-12-19T18:03:12.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2977e40 con 0x2a38430 2023-12-19T18:03:12.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 10 client.0 _ll_register_callbacks cb 0x28b3e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 0x2a5dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 0x2a5dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43356/0 (socket says 172.21.15.45:43356) 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 -- 172.21.15.45:0/1634903901 learned_addr learned my addr 172.21.15.45:0/1634903901 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde3bfff700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a5f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde48e7c700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2aa9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 -- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 msgr2=0x2aa9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2aa9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 -- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 msgr2=0x2a5f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a5f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 -- 172.21.15.45:0/1634903901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde440d1de0 con 0x2a5d830 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde48e7c700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2aa9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:12.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4967d700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 0x2a5dc10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0808a0 tx=0x7fde3c056040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a738380b9af0ce8a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:13.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde237fe700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:03:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde237fe700 1 -- 172.21.15.45:0/1634903901 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c080be0 con 0x2a5d830 2023-12-19T18:03:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde237fe700 1 -- 172.21.15.45:0/1634903901 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fde3c05b900 con 0x2a5d830 2023-12-19T18:03:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x2a59370 con 0x2a5d830 2023-12-19T18:03:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde237fe700 1 -- 172.21.15.45:0/1634903901 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=99) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde3c057750 con 0x2a5d830 2023-12-19T18:03:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 10 client.9015 fetch_fsmap learned FSMap version 99 2023-12-19T18:03:13.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=99,monmap=2+}) v3 -- 0x27ed960 con 0x2a5d830 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.993+0000 7fde237fe700 1 -- 172.21.15.45:0/1634903901 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x2a59370 con 0x2a5d830 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde237fe700 1 -- 172.21.15.45:0/1634903901 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 99) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fde3c04f710 con 0x2a5d830 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 10 client.9015 fetch_fsmap finished waiting for FSMap version 99 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 10 client.9015 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 20 client.9015 populate_metadata read hostname 'smithi045' 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a62850 0x2a62c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 4 client.9015 mds_command: new command op to 57470 tid=0[{"prefix": "status"}] 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 --> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fde34011e70 con 0x2a62850 2023-12-19T18:03:13.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde48e7c700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a62850 0x2a62c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde48e7c700 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a62850 0x2a62c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7c4ec9b840354da server_cookie=d32cadabe7cca0d2 in_seq=0 out_seq=0 2023-12-19T18:03:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde237fe700 10 client.9015 ms_handle_connect on v2:172.21.15.45:6835/3417552399 2023-12-19T18:03:13.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde237fe700 1 -- 172.21.15.45:0/1634903901 <== mds.0 v2:172.21.15.45:6835/3417552399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+322 (crc 0 0 0) 0x7fde34011e70 con 0x2a62850 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde237fe700 10 client.9015 handle_command_reply: tid=0 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 client.9015 shutdown 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 msgr2=0x2a5dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 0x2a5dc10 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fde3c0808a0 tx=0x7fde3c056040 comp rx=0 tx=0).stop 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 shutdown_connections 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:6835/3417552399,v1:172.21.15.45:6837/3417552399] conn(0x2a62850 0x2a62c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2a5d830 0x2a5dc10 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2a5a7d0 0x2a5f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde237fe700 0 client.9015 ms_handle_reset on v2:172.21.15.45:6835/3417552399 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 --2- 172.21.15.45:0/1634903901 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2a38430 0x2aa9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 >> 172.21.15.45:0/1634903901 conn(0x27a24d0 msgr2=0x2a36a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 shutdown_connections 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 1 -- 172.21.15.45:0/1634903901 wait complete. 2023-12-19T18:03:13.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:12.997+0000 7fde4e36d740 20 client.9015 trim_cache size 0 max 16384 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 57470, 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 11.512973191, 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 99, 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 129, 2023-12-19T18:03:13.005 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 129, 2023-12-19T18:03:13.006 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 16.689671292 2023-12-19T18:03:13.006 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:03:13.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde30065b00 msgr2=0x7fde30067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde30065b00 0x7fde30067fc0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fde40000f80 tx=0x7fde40009000 comp rx=0 tx=0).stop 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 msgr2=0x7fde440b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 0x7fde440b7470 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c390 tx=0x7fde3c00c6a0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 shutdown_connections 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fde30065b00 0x7fde30067fc0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fde440b88b0 0x7fde440b7470 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde440b6250 0x7fde4414c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 --2- 172.21.15.45:0/4138715108 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fde4406ea90 0x7fde440c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 >> 172.21.15.45:0/4138715108 conn(0x7fde440b46d0 msgr2=0x7fde440b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 shutdown_connections 2023-12-19T18:03:13.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.001+0000 7fde49e7e700 1 -- 172.21.15.45:0/4138715108 wait complete. 2023-12-19T18:03:13.029 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:03:13.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.213+0000 7f290969b700 1 Processor -- start 2023-12-19T18:03:13.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.213+0000 7f290969b700 1 -- start start 2023-12-19T18:03:13.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f290969b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415c870 0x7f29040cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f290969b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f290415cf60 0x7f29040c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f290969b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29040c4e00 0x7f29040c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f290969b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29040c5250 con 0x7f290415cf60 2023-12-19T18:03:13.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f290969b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29040cde10 con 0x7f29040c4e00 2023-12-19T18:03:13.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f290969b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29040ce0f0 con 0x7f290415c870 2023-12-19T18:03:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f28fa7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f290415cf60 0x7f29040c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29040c4e00 0x7f29040c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f29040c4e00 0x7f29040c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:55946/0 (socket says 172.21.15.45:55946) 2023-12-19T18:03:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 -- 172.21.15.45:0/3117511608 learned_addr learned my addr 172.21.15.45:0/3117511608 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:13.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f2902ffd700 1 --2- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415c870 0x7f29040cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 -- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415c870 msgr2=0x7f29040cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 --2- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415c870 0x7f29040cd5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 -- 172.21.15.45:0/3117511608 >> v2:172.21.15.45:3300/0 conn(0x7f290415cf60 msgr2=0x7f29040c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 --2- 172.21.15.45:0/3117511608 >> v2:172.21.15.45:3300/0 conn(0x7f290415cf60 0x7f29040c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f29037fe700 1 -- 172.21.15.45:0/3117511608 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29040ce3d0 con 0x7f29040c4e00 2023-12-19T18:03:13.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.217+0000 7f28fa7fc700 1 --2- 172.21.15.45:0/3117511608 >> v2:172.21.15.45:3300/0 conn(0x7f290415cf60 0x7f29040c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f29037fe700 1 --2- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f29040c3810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f290406c8e0 tx=0x7f28fc009bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9fd5570ddf39c38a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f29027fc700 1 -- 172.21.15.45:0/3117511608 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc005ea0 con 0x7f29040c4e00 2023-12-19T18:03:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f29027fc700 1 -- 172.21.15.45:0/3117511608 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28fc006030 con 0x7f29040c4e00 2023-12-19T18:03:13.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f29027fc700 1 -- 172.21.15.45:0/3117511608 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28fc0063c0 con 0x7f29040c4e00 2023-12-19T18:03:13.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 -- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 msgr2=0x7f29040c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 --2- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f29040c3810 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f290406c8e0 tx=0x7f28fc009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 -- 172.21.15.45:0/3117511608 shutdown_connections 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 --2- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f29040c3810 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 --2- 172.21.15.45:0/3117511608 >> v2:172.21.15.45:3300/0 conn(0x7f290415cf60 0x7f29040c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 --2- 172.21.15.45:0/3117511608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415c870 0x7f29040cd5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 -- 172.21.15.45:0/3117511608 >> 172.21.15.45:0/3117511608 conn(0x7f29040cba40 msgr2=0x7f29040ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 -- 172.21.15.45:0/3117511608 shutdown_connections 2023-12-19T18:03:13.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.221+0000 7f290969b700 1 -- 172.21.15.45:0/3117511608 wait complete. 2023-12-19T18:03:13.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 Processor -- start 2023-12-19T18:03:13.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 -- start start 2023-12-19T18:03:13.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f2904150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 0x7f2904151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415cf60 0x7f29040b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904154d40 con 0x7f290415c870 2023-12-19T18:03:13.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2904151e10 con 0x7f29040c4e00 2023-12-19T18:03:13.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.225+0000 7f290969b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29041520f0 con 0x7f290415cf60 2023-12-19T18:03:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 0x7f2904151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f2904150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fa7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 0x7f2904151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43370/0 (socket says 172.21.15.45:43370) 2023-12-19T18:03:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fa7fc700 1 -- 172.21.15.45:0/2153970907 learned_addr learned my addr 172.21.15.45:0/2153970907 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:13.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f29037fe700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415cf60 0x7f29040b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 -- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415cf60 msgr2=0x7f29040b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415cf60 0x7f29040b3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 -- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 msgr2=0x7f2904151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 0x7f2904151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 -- 172.21.15.45:0/2153970907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0094b0 con 0x7f29040c4e00 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fa7fc700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 0x7f2904151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f29037fe700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415cf60 0x7f29040b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f2902ffd700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f2904150f80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f28f400efc0 tx=0x7f28f400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f400cd10 con 0x7f29040c4e00 2023-12-19T18:03:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28f400f040 con 0x7f29040c4e00 2023-12-19T18:03:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28f40146c0 con 0x7f29040c4e00 2023-12-19T18:03:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28fc009570 con 0x7f29040c4e00 2023-12-19T18:03:13.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.229+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29041526b0 con 0x7f29040c4e00 2023-12-19T18:03:13.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.233+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f290404ed30 con 0x7f29040c4e00 2023-12-19T18:03:13.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.233+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f28f4014820 con 0x7f29040c4e00 2023-12-19T18:03:13.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.233+0000 7f28fbfff700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28e4065b20 0x7f28e4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:13.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.237+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f28f4083e10 con 0x7f29040c4e00 2023-12-19T18:03:13.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.237+0000 7f28fa7fc700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28e4065b20 0x7f28e4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:13.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.237+0000 7f28fa7fc700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28e4065b20 0x7f28e4067fe0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29041514c0 tx=0x7f28ec009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:13.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.241+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f28f4087030 con 0x7f29040c4e00 2023-12-19T18:03:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.453+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f290406d180 con 0x7f29040c4e00 2023-12-19T18:03:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.457+0000 7f28fbfff700 1 -- 172.21.15.45:0/2153970907 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v99) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28f4018070 con 0x7f29040c4e00 2023-12-19T18:03:13.461 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28e4065b20 msgr2=0x7f28e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28e4065b20 0x7f28e4067fe0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f29041514c0 tx=0x7f28ec009240 comp rx=0 tx=0).stop 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 msgr2=0x7f2904150f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f2904150f80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f28f400efc0 tx=0x7f28f400c3a0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 shutdown_connections 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f28e4065b20 0x7f28e4067fe0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f290415cf60 0x7f29040b3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f290415c870 0x7f2904151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 --2- 172.21.15.45:0/2153970907 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f29040c4e00 0x7f2904150f80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:13.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 >> 172.21.15.45:0/2153970907 conn(0x7f29040cba40 msgr2=0x7f29040710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 shutdown_connections 2023-12-19T18:03:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:13.461+0000 7f290969b700 1 -- 172.21.15.45:0/2153970907 wait complete. 2023-12-19T18:03:13.488 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:03:13.489 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:13.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:13.489 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:13.510 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41671sec preferred_lft 41671sec 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:03:13.511 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:03:13.512 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T18:03:13.513 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:13.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:13.514 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:03:13.594 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:03:13.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:13.597 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T18:03:13.657 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T18:03:13.657 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:03:13.657 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T18:03:13.658 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:03:13.658 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T18:03:13.658 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:03:13.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:13.659 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T18:03:13.659 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T18:03:13.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T18:03:13.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T18:03:13.659 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T18:03:13.659 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T18:03:13.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:13.797 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:03:13.816 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:03:13.816 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:03:13.817 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:13.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:13.817 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T18:03:13.904 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T18:03:13.904 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:03:13.904 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:13.966 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:13.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:03:13.966 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:14.028 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:03:14.105 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:03:14.105 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:03:14.181 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:03:14.183 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:03:14.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:14.184 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:03:14.250 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T18:03:14.250 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T18:03:14.300 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:03:14.336 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:03:14.336 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:03:14.415 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:03:14.417 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:03:14.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:14.418 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:03:14.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T18:03:14.441+0000 7f103edd2640 -1 init, newargv = 0x55fc86f64060 newargc=15 2023-12-19T18:03:14.446 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[58775]: starting ceph client 2023-12-19T18:03:14.457 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[58775]: starting fuse 2023-12-19T18:03:14.462 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:03:14.463 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T18:03:14.463 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T18:03:14.464 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:03:14.624 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.58775.asok 2023-12-19T18:03:14.810 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58775.asok 2023-12-19T18:03:14.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:14.811 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58775.asok status 2023-12-19T18:03:15.018 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:03:15.018 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "58775", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 9030, 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T18:03:15.019 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 9030 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 470440842 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 470440842 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.9030 192.168.0.1:0/470440842", 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/470440842", 2023-12-19T18:03:15.020 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T18:03:15.021 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 99, 2023-12-19T18:03:15.021 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 129, 2023-12-19T18:03:15.021 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T18:03:15.021 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T18:03:15.021 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T18:03:15.021 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:03:15.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:15.034 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T18:03:15.034 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:15.052 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T18:03:15.052 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:15.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:15.053 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:15.134 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:03:15.183 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:03:15.259 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.260 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:03:15.261 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T18:03:15.262 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T18:03:15.263 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.264 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T18:03:15.265 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.266 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T18:03:15.267 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.268 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.269 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T18:03:15.270 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T18:03:15.271 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:03:15.271 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.271 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.271 INFO:teuthology.orchestra.run.smithi045.stdout: mds bal merge size = 0 2023-12-19T18:03:15.271 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T18:03:15.272 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:03:15.273 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.274 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T18:03:15.275 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T18:03:15.276 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T18:03:15.277 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.278 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.279 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:03:15.280 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T18:03:15.281 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T18:03:15.282 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T18:03:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T18:03:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:03:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.283 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 0 2023-12-19T18:03:15.294 DEBUG:teuthology.orchestra.run.smithi045:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:03:15.301 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-19T18:03:15.378 INFO:teuthology.orchestra.run.smithi045.stdout:[global] 2023-12-19T18:03:15.378 INFO:teuthology.orchestra.run.smithi045.stdout: chdir = "" 2023-12-19T18:03:15.378 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:03:15.378 INFO:teuthology.orchestra.run.smithi045.stdout: auth supported = cephx 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: filestore xattr use omap = true 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: mon clock drift allowed = 1.000 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: osd crush chooseleaf type = 0 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: auth debug = true 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on old message = true 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: ms die on bug = true 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: mon pg warn max object skew = 0 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.379 INFO:teuthology.orchestra.run.smithi045.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default size = 2 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow primary affinity = true 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd allow pg remap = true 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on no sortbitwise = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon warn on too few osds = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:03:15.380 INFO:teuthology.orchestra.run.smithi045.stdout: mon_allow_pool_size_one = true 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: osd default data pool replay window = 5 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: mon allow pool delete = true 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: mon cluster log file level = debug 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: debug asserts on shutdown = true 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: mon health detail to clog = false 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.381 INFO:teuthology.orchestra.run.smithi045.stdout:[osd] 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd journal size = 100 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub load threshold = 5.0 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd scrub max interval = 600 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd recover clone overlap = true 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd recovery max chunk = 1048576 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug shutdown = true 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug op order = true 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug verify stray on activate = true 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd open classes on start = true 2023-12-19T18:03:15.382 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug pg log writeout = true 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: osd map max advance = 10 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: journal zero on create = true 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: filestore apply finisher threads = 3 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: bdev debug aio = true 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: osd debug misdirected ops = true 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore block size = 96636764160 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: bluestore fsck on mount = True 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluefs = 20 2023-12-19T18:03:15.383 INFO:teuthology.orchestra.run.smithi045.stdout: debug bluestore = 20 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug osd = 20 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug rocksdb = 10 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd full ratio = 0.9 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: osd objectstore = bluestore 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout:[mgr] 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug mgr = 20 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:03:15.384 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mgr/telemetry/nag = false 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout:[mon] 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: debug mon = 20 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: debug paxos = 20 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: debug auth = 20 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon data avail warn = 5 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon mgr mkfs grace = 240 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd reporter subtree level = osd 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon osd prime pg temp = true 2023-12-19T18:03:15.385 INFO:teuthology.orchestra.run.smithi045.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: # 1m isn't quite enough 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:03:15.386 INFO:teuthology.orchestra.run.smithi045.stdout: mon op complaint time = 120 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout:[client] 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: rgw cache enabled = true 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable ops log = true 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: rgw enable usage log = true 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: client mount timeout = 600 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: debug client = 20 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: pid file = "" 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.a] 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.b] 2023-12-19T18:03:15.387 INFO:teuthology.orchestra.run.smithi045.stdout:[mon.c] 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.a] 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.c] 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.b] 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout:[mds.d] 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout:[mds] 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds = 20 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: debug mds balancer = 20 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: debug ms = 1 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug frag = True 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: mds debug scatterstat = False 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: mds op complaint time = 180 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: mds verify scatter = False 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: osd op complaint time = 180 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.388 INFO:teuthology.orchestra.run.smithi045.stdout: mds bal merge size = 0 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi045.stdout: mds bal split size = 10000 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout:[global] 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: chdir = "" 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: auth supported = cephx 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: filestore xattr use omap = true 2023-12-19T18:03:15.389 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: mon clock drift allowed = 1.000 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: osd crush chooseleaf type = 0 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: auth debug = true 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on old message = true 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: ms die on bug = true 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: mon pg warn max object skew = 0 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: # disable pg_autoscaler by default for new pools 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.390 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default size = 2 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow primary affinity = true 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd allow pg remap = true 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on legacy crush tunables = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on crush straw calc version zero = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on no sortbitwise = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on osd down out interval zero = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon warn on too few osds = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: mon_allow_pool_size_one = true 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-19T18:03:15.391 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: osd default data pool replay window = 5 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: mon allow pool delete = true 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: mon cluster log file level = debug 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: debug asserts on shutdown = true 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: mon health detail to clog = false 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: mon host = "172.21.15.45,172.21.15.73,[v2:172.21.15.73:3301,v1:172.21.15.73:6790]" 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: fsid = 4e717d5b-4367-4aa1-b211-e8194442f374 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout:[osd] 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: osd journal size = 100 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub load threshold = 5.0 2023-12-19T18:03:15.392 INFO:teuthology.orchestra.run.smithi073.stdout: osd scrub max interval = 600 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd mclock profile = high_recovery_ops 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd recover clone overlap = true 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd recovery max chunk = 1048576 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug shutdown = true 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug op order = true 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug verify stray on activate = true 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd open classes on start = true 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug pg log writeout = true 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd deep scrub update digest min age = 30 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.393 INFO:teuthology.orchestra.run.smithi073.stdout: osd map max advance = 10 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: journal zero on create = true 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: filestore ondisk finisher threads = 3 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: filestore apply finisher threads = 3 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: bdev debug aio = true 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: osd debug misdirected ops = true 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore block size = 96636764160 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: bluestore fsck on mount = True 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluefs = 20 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: debug bluestore = 20 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: debug osd = 20 2023-12-19T18:03:15.394 INFO:teuthology.orchestra.run.smithi073.stdout: debug rocksdb = 10 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd backfillfull_ratio = 0.85 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd full ratio = 0.9 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd nearfull ratio = 0.8 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: osd failsafe full ratio = 0.95 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: osd objectstore = bluestore 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout:[mgr] 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: debug mgr = 20 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: mgr/telemetry/nag = false 2023-12-19T18:03:15.395 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout:[mon] 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: debug mon = 20 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: debug paxos = 20 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: debug auth = 20 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: mon data avail warn = 5 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: mon mgr mkfs grace = 240 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min pgs per osd = 4 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd reporter subtree level = osd 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: mon osd prime pg temp = true 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: mon reweight min bytes per osd = 10 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: auth mon ticket ttl = 660 # 11m 2023-12-19T18:03:15.396 INFO:teuthology.orchestra.run.smithi073.stdout: auth service ticket ttl = 240 # 4m 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: # don't complain about insecure global_id in the test suite 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: # 1m isn't quite enough 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: mon_down_mkfs_grace = 2m 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: mon_warn_on_filestore_osds = false 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: mon op complaint time = 120 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout:[client] 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: rgw cache enabled = true 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable ops log = true 2023-12-19T18:03:15.397 INFO:teuthology.orchestra.run.smithi073.stdout: rgw enable usage log = true 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: client mount timeout = 600 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: debug client = 20 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: pid file = "" 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.a] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.b] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mon.c] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.a] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.c] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.b] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds.d] 2023-12-19T18:03:15.398 INFO:teuthology.orchestra.run.smithi073.stdout:[mds] 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds = 20 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: debug mds balancer = 20 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: debug ms = 1 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug frag = True 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: mds debug scatterstat = False 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: mds op complaint time = 180 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: mds verify scatter = False 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: osd op complaint time = 180 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: rados mon op timeout = 900 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: rados osd op timeout = 900 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal merge size = 0 2023-12-19T18:03:15.399 INFO:teuthology.orchestra.run.smithi073.stdout: mds bal split size = 10000 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> path = os.path.join("/home/ubuntu/cephtest/mnt.0", "subdir") 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> os.mkdir(path) 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> for n in range(0, 100): 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> open(os.path.join(path, "%s" % n), '"'"'w'"'"').write("%s" % n) 2023-12-19T18:03:15.410 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:03:16.104 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:03:16.105 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:03:16.105 DEBUG:teuthology.orchestra.run.smithi045:> import stat 2023-12-19T18:03:16.105 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:16.105 DEBUG:teuthology.orchestra.run.smithi045:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2023-12-19T18:03:16.105 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:03:16.250 INFO:teuthology.orchestra.run.smithi045.stdout:1099511627776 2023-12-19T18:03:16.435 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:16.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.653+0000 7fed2e4fc700 1 Processor -- start 2023-12-19T18:03:16.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.653+0000 7fed2e4fc700 1 -- start start 2023-12-19T18:03:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed280b2cc0 0x7fed28162280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed281628e0 con 0x7fed281585e0 2023-12-19T18:03:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed280af100 con 0x7fed280b28e0 2023-12-19T18:03:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed280af3e0 con 0x7fed280b2cc0 2023-12-19T18:03:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2ccf9700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fed281585e0 0x7fed28161b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42246/0 (socket says 172.21.15.45:42246) 2023-12-19T18:03:16.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2ccf9700 1 -- 172.21.15.45:0/3367099414 learned_addr learned my addr 172.21.15.45:0/3367099414 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:16.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2dcfb700 1 --2- 172.21.15.45:0/3367099414 >> v2:172.21.15.73:3300/0 conn(0x7fed280b2cc0 0x7fed28162280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:16.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed1ffff700 1 -- 172.21.15.45:0/3367099414 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936737946 0 0) 0x7fed281628e0 con 0x7fed281585e0 2023-12-19T18:03:16.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed1ffff700 1 -- 172.21.15.45:0/3367099414 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed140035d0 con 0x7fed281585e0 2023-12-19T18:03:16.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2dcfb700 1 -- 172.21.15.45:0/3367099414 >> v1:172.21.15.73:6789/0 conn(0x7fed280b28e0 legacy=0x7fed28157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2dcfb700 1 -- 172.21.15.45:0/3367099414 >> v1:172.21.15.45:6789/0 conn(0x7fed281585e0 legacy=0x7fed28161b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.662 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2dcfb700 1 -- 172.21.15.45:0/3367099414 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed280af6c0 con 0x7fed280b2cc0 2023-12-19T18:03:16.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2dcfb700 1 --2- 172.21.15.45:0/3367099414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28162280 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fed20009d90 tx=0x7fed2000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d4456204de8187 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:16.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed1ffff700 1 -- 172.21.15.45:0/3367099414 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e070 con 0x7fed280b2cc0 2023-12-19T18:03:16.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed1ffff700 1 -- 172.21.15.45:0/3367099414 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2000bb20 con 0x7fed280b2cc0 2023-12-19T18:03:16.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed1ffff700 1 -- 172.21.15.45:0/3367099414 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed20012430 con 0x7fed280b2cc0 2023-12-19T18:03:16.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 -- 172.21.15.45:0/3367099414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 msgr2=0x7fed28162280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/3367099414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28162280 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fed20009d90 tx=0x7fed2000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:16.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 -- 172.21.15.45:0/3367099414 shutdown_connections 2023-12-19T18:03:16.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/3367099414 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28162280 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.657+0000 7fed2e4fc700 1 -- 172.21.15.45:0/3367099414 >> 172.21.15.45:0/3367099414 conn(0x7fed2806a130 msgr2=0x7fed2806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:16.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.661+0000 7fed2e4fc700 1 -- 172.21.15.45:0/3367099414 shutdown_connections 2023-12-19T18:03:16.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.661+0000 7fed2e4fc700 1 -- 172.21.15.45:0/3367099414 wait complete. 2023-12-19T18:03:16.667 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.661+0000 7fed2e4fc700 1 Processor -- start 2023-12-19T18:03:16.668 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.661+0000 7fed2e4fc700 1 -- start start 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 0x7fed2815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed281585e0 0x7fed28144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28163a10 con 0x7fed280b28e0 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed28163cf0 con 0x7fed280b2cc0 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed28163fd0 con 0x7fed281585e0 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 0x7fed2815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 0x7fed2815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43374/0 (socket says 172.21.15.45:43374) 2023-12-19T18:03:16.670 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 -- 172.21.15.45:0/1097178833 learned_addr learned my addr 172.21.15.45:0/1097178833 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:16.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2ccf9700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:16.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2dcfb700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed281585e0 0x7fed28144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 -- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed281585e0 msgr2=0x7fed28144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed281585e0 0x7fed28144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 -- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 msgr2=0x7fed28150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 -- 172.21.15.45:0/1097178833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20009a70 con 0x7fed280b28e0 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2d4fa700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 0x7fed2815ac70 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c500 tx=0x7fed2400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:16.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240052d0 con 0x7fed280b28e0 2023-12-19T18:03:16.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed24005430 con 0x7fed280b28e0 2023-12-19T18:03:16.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed281642b0 con 0x7fed280b28e0 2023-12-19T18:03:16.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.665+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed240055a0 con 0x7fed280b28e0 2023-12-19T18:03:16.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.669+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed2815b1b0 con 0x7fed280b28e0 2023-12-19T18:03:16.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.669+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed2815bd50 con 0x7fed280b28e0 2023-12-19T18:03:16.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.673+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed240038e0 con 0x7fed280b28e0 2023-12-19T18:03:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.673+0000 7fed1dffb700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed0c065ad0 0x7fed0c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:16.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.673+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fed240825b0 con 0x7fed280b28e0 2023-12-19T18:03:16.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.673+0000 7fed2ccf9700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed0c065ad0 0x7fed0c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:16.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.673+0000 7fed2ccf9700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed0c065ad0 0x7fed0c067f90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fed280cb880 tx=0x7fed18007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:16.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.677+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fed2404fe30 con 0x7fed280b28e0 2023-12-19T18:03:16.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.893+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed281530b0 con 0x7fed280b28e0 2023-12-19T18:03:16.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed1dffb700 1 -- 172.21.15.45:0/1097178833 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4709 (secure 0 0 0) 0x7fed24053450 con 0x7fed280b28e0 2023-12-19T18:03:16.901 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:16.901 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":57464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:04.628359+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57470":{"gid":57470,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/3417552399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3417552399},{"type":"v1","addr":"172.21.15.45:6837","nonce":3417552399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:16.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed0c065ad0 msgr2=0x7fed0c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed0c065ad0 0x7fed0c067f90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fed280cb880 tx=0x7fed18007de0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 msgr2=0x7fed2815ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:16.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 0x7fed2815ac70 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fed2400c500 tx=0x7fed2400c810 comp rx=0 tx=0).stop 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 shutdown_connections 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed0c065ad0 0x7fed0c067f90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed281585e0 0x7fed28144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed280b2cc0 0x7fed28150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 --2- 172.21.15.45:0/1097178833 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed280b28e0 0x7fed2815ac70 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.897+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 >> 172.21.15.45:0/1097178833 conn(0x7fed2806a130 msgr2=0x7fed2806c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.901+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 shutdown_connections 2023-12-19T18:03:16.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:16.901+0000 7fed2e4fc700 1 -- 172.21.15.45:0/1097178833 wait complete. 2023-12-19T18:03:16.906 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 99 2023-12-19T18:03:16.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:17.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.105+0000 7f2c7f434700 1 Processor -- start 2023-12-19T18:03:17.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.105+0000 7f2c7f434700 1 -- start start 2023-12-19T18:03:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7f434700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2c780cce50 0x7f2c780cd2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7f434700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c7806ce10 0x7f2c7806d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7f434700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c78165240 con 0x7f2c780c1e70 2023-12-19T18:03:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7f434700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c780cd820 con 0x7f2c7806ce10 2023-12-19T18:03:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7f434700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c78161bc0 con 0x7f2c780cce50 2023-12-19T18:03:17.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d9d1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2c7806ce10 0x7f2c7806d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d1d0700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2c780c1e70 0x7f2c780ad660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42254/0 (socket says 172.21.15.45:42254) 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d1d0700 1 -- 172.21.15.45:0/255320014 learned_addr learned my addr 172.21.15.45:0/255320014 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7c9cf700 1 --2- 172.21.15.45:0/255320014 >> v2:172.21.15.73:3300/0 conn(0x7f2c780cce50 0x7f2c780cd2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/255320014 >> v2:172.21.15.73:3300/0 conn(0x7f2c780cce50 msgr2=0x7f2c780cd2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d9d1700 1 --2- 172.21.15.45:0/255320014 >> v2:172.21.15.73:3300/0 conn(0x7f2c780cce50 0x7f2c780cd2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/255320014 >> v1:172.21.15.45:6789/0 conn(0x7f2c780c1e70 legacy=0x7f2c780ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/255320014 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c780c97e0 con 0x7f2c7806ce10 2023-12-19T18:03:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c7d9d1700 1 --2- 172.21.15.45:0/255320014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7806ce10 0x7f2c7806d260 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f2c7806e8a0 tx=0x7f2c7000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ea34ac9ea7b6aa8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.109+0000 7f2c6ffff700 1 -- 172.21.15.45:0/255320014 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c7000e070 con 0x7f2c7806ce10 2023-12-19T18:03:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c6ffff700 1 -- 172.21.15.45:0/255320014 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c7000bb90 con 0x7f2c7806ce10 2023-12-19T18:03:17.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c6ffff700 1 -- 172.21.15.45:0/255320014 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70012430 con 0x7f2c7806ce10 2023-12-19T18:03:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 -- 172.21.15.45:0/255320014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7806ce10 msgr2=0x7f2c7806d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 --2- 172.21.15.45:0/255320014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7806ce10 0x7f2c7806d260 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f2c7806e8a0 tx=0x7f2c7000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 -- 172.21.15.45:0/255320014 shutdown_connections 2023-12-19T18:03:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 --2- 172.21.15.45:0/255320014 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c7806ce10 0x7f2c7806d260 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 --2- 172.21.15.45:0/255320014 >> v2:172.21.15.73:3300/0 conn(0x7f2c780cce50 0x7f2c780cd2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 -- 172.21.15.45:0/255320014 >> 172.21.15.45:0/255320014 conn(0x7f2c7806a870 msgr2=0x7f2c780ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 -- 172.21.15.45:0/255320014 shutdown_connections 2023-12-19T18:03:17.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.113+0000 7f2c7f434700 1 -- 172.21.15.45:0/255320014 wait complete. 2023-12-19T18:03:17.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 Processor -- start 2023-12-19T18:03:17.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 -- start start 2023-12-19T18:03:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c7806ce10 0x7f2c78161d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c780c1e70 0x7f2c780ad8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 0x7f2c7815e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7815f3b0 con 0x7f2c780cce50 2023-12-19T18:03:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c781fa0c0 con 0x7f2c7806ce10 2023-12-19T18:03:17.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7f434700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c78164310 con 0x7f2c780c1e70 2023-12-19T18:03:17.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7d9d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 0x7f2c7815e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7d9d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 0x7f2c7815e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43402/0 (socket says 172.21.15.45:43402) 2023-12-19T18:03:17.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/4096708302 learned_addr learned my addr 172.21.15.45:0/4096708302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:17.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7c9cf700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c780c1e70 0x7f2c780ad8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.117+0000 7f2c7d1d0700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c7806ce10 0x7f2c78161d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c780c1e70 msgr2=0x7f2c780ad8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d9d1700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c780c1e70 0x7f2c780ad8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c7806ce10 msgr2=0x7f2c78161d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d9d1700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c7806ce10 0x7f2c78161d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d9d1700 1 -- 172.21.15.45:0/4096708302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009a70 con 0x7f2c780cce50 2023-12-19T18:03:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d1d0700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c7806ce10 0x7f2c78161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7d9d1700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 0x7f2c7815e7d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000b370 tx=0x7f2c70004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70012430 con 0x7f2c780cce50 2023-12-19T18:03:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c70020070 con 0x7f2c780cce50 2023-12-19T18:03:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c70004280 con 0x7f2c780cce50 2023-12-19T18:03:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c780b38d0 con 0x7f2c780cce50 2023-12-19T18:03:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c780b3e90 con 0x7f2c780cce50 2023-12-19T18:03:17.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.121+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c781fa230 con 0x7f2c780cce50 2023-12-19T18:03:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.125+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2c700043e0 con 0x7f2c780cce50 2023-12-19T18:03:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.129+0000 7f2c6dffb700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c5c065ad0 0x7f2c5c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.129+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2c70022070 con 0x7f2c780cce50 2023-12-19T18:03:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.129+0000 7f2c7d1d0700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c5c065ad0 0x7f2c5c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.129+0000 7f2c7d1d0700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c5c065ad0 0x7f2c5c067f90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2c74007fd0 tx=0x7f2c74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.133+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2c781fa230 con 0x7f2c780cce50 2023-12-19T18:03:17.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.353+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c781fa230 con 0x7f2c780cce50 2023-12-19T18:03:17.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.353+0000 7f2c6dffb700 1 -- 172.21.15.45:0/4096708302 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4709 (secure 0 0 0) 0x7f2c781fa230 con 0x7f2c780cce50 2023-12-19T18:03:17.358 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:17.358 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":99,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":57464,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:04.628359+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57470},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57470":{"gid":57470,"name":"c","rank":0,"incarnation":95,"state":"up:active","state_seq":3,"addr":"172.21.15.45:6837/3417552399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3417552399},{"type":"v1","addr":"172.21.15.45:6837","nonce":3417552399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c5c065ad0 msgr2=0x7f2c5c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c5c065ad0 0x7f2c5c067f90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2c74007fd0 tx=0x7f2c74009040 comp rx=0 tx=0).stop 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 msgr2=0x7f2c7815e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 0x7f2c7815e7d0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000b370 tx=0x7f2c70004af0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 shutdown_connections 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2c5c065ad0 0x7f2c5c067f90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2c780cce50 0x7f2c7815e7d0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2c780c1e70 0x7f2c780ad8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 --2- 172.21.15.45:0/4096708302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2c7806ce10 0x7f2c78161d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 >> 172.21.15.45:0/4096708302 conn(0x7f2c7806a870 msgr2=0x7f2c780af100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 shutdown_connections 2023-12-19T18:03:17.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.357+0000 7f2c7f434700 1 -- 172.21.15.45:0/4096708302 wait complete. 2023-12-19T18:03:17.363 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 99 2023-12-19T18:03:17.382 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json dirfrag split /subdir 0/0 1 2023-12-19T18:03:17.576 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-19T18:03:17.576 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:03:17.576 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:03:17.589 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:17.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.809+0000 7fc3216ee700 1 Processor -- start 2023-12-19T18:03:17.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.809+0000 7fc3216ee700 1 -- start start 2023-12-19T18:03:17.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc3216ee700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc31c0c1e70 0x7fc31c0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc3216ee700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c165240 con 0x7fc31c0cd560 2023-12-19T18:03:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc3216ee700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31c0c97e0 con 0x7fc31c0adba0 2023-12-19T18:03:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc3216ee700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc31c161bc0 con 0x7fc31c0c1e70 2023-12-19T18:03:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31affd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc31c0c1e70 0x7fc31c0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fc31c0cd560 0x7fc31c06ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:42258/0 (socket says 172.21.15.45:42258) 2023-12-19T18:03:17.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31b7fe700 1 -- 172.21.15.45:0/3882950226 learned_addr learned my addr 172.21.15.45:0/3882950226 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:17.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31affd700 1 -- 172.21.15.45:0/3882950226 >> v1:172.21.15.73:6789/0 conn(0x7fc31c0adba0 legacy=0x7fc31c0cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31affd700 1 -- 172.21.15.45:0/3882950226 >> v1:172.21.15.45:6789/0 conn(0x7fc31c0cd560 legacy=0x7fc31c06ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31affd700 1 -- 172.21.15.45:0/3882950226 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc31c165490 con 0x7fc31c0c1e70 2023-12-19T18:03:17.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc319ffb700 1 -- 172.21.15.45:0/3882950226 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635277885 0 0) 0x7fc31c165240 con 0x7fc31c0cd560 2023-12-19T18:03:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.813+0000 7fc31affd700 1 --2- 172.21.15.45:0/3882950226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0ad660 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009850 tx=0x7fc30c009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341ed58e58325f74 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc319ffb700 1 -- 172.21.15.45:0/3882950226 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c011830 con 0x7fc31c0c1e70 2023-12-19T18:03:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc319ffb700 1 -- 172.21.15.45:0/3882950226 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c011990 con 0x7fc31c0c1e70 2023-12-19T18:03:17.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc319ffb700 1 -- 172.21.15.45:0/3882950226 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c011d20 con 0x7fc31c0c1e70 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 -- 172.21.15.45:0/3882950226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0c1e70 msgr2=0x7fc31c0ad660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 --2- 172.21.15.45:0/3882950226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0ad660 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fc30c009850 tx=0x7fc30c009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 -- 172.21.15.45:0/3882950226 shutdown_connections 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 --2- 172.21.15.45:0/3882950226 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0ad660 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 -- 172.21.15.45:0/3882950226 >> 172.21.15.45:0/3882950226 conn(0x7fc31c06a870 msgr2=0x7fc31c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 -- 172.21.15.45:0/3882950226 shutdown_connections 2023-12-19T18:03:17.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.817+0000 7fc3216ee700 1 -- 172.21.15.45:0/3882950226 wait complete. 2023-12-19T18:03:17.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 Processor -- start 2023-12-19T18:03:17.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 -- start start 2023-12-19T18:03:17.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31c0adba0 0x7fc31c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 0x7fc31c0c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0b3580 con 0x7fc31c0cd560 2023-12-19T18:03:17.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c0c8cc0 con 0x7fc31c0c1e70 2023-12-19T18:03:17.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc3216ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc31c14fb30 con 0x7fc31c0adba0 2023-12-19T18:03:17.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 0x7fc31c0c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 0x7fc31c0c23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43432/0 (socket says 172.21.15.45:43432) 2023-12-19T18:03:17.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 -- 172.21.15.45:0/2986510527 learned_addr learned my addr 172.21.15.45:0/2986510527 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:17.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31affd700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31c0adba0 0x7fc31c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31a7fc700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 -- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31c0adba0 msgr2=0x7fc31c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31c0adba0 0x7fc31c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 -- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc31c0c1e70 msgr2=0x7fc31c0c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 -- 172.21.15.45:0/2986510527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c0094b0 con 0x7fc31c0cd560 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31a7fc700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.821+0000 7fc31b7fe700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 0x7fc31c0c23a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc31400cbd0 tx=0x7fc31400cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.825+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31400aac0 con 0x7fc31c0cd560 2023-12-19T18:03:17.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.825+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31400ac40 con 0x7fc31c0cd560 2023-12-19T18:03:17.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.825+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0b2900 con 0x7fc31c0cd560 2023-12-19T18:03:17.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.825+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3140070d0 con 0x7fc31c0cd560 2023-12-19T18:03:17.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.825+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc31c0b2ec0 con 0x7fc31c0cd560 2023-12-19T18:03:17.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.825+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31c0b36c0 con 0x7fc31c0cd560 2023-12-19T18:03:17.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.829+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc314007250 con 0x7fc31c0cd560 2023-12-19T18:03:17.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.829+0000 7fc3037fe700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc308065ad0 0x7fc308067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:17.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.829+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc314082de0 con 0x7fc31c0cd560 2023-12-19T18:03:17.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.829+0000 7fc31affd700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc308065ad0 0x7fc308067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:17.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.829+0000 7fc31affd700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc308065ad0 0x7fc308067f90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0090b0 tx=0x7fc30c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:17.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:17.837+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc31c0b36c0 con 0x7fc31c0cd560 2023-12-19T18:03:18.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.017+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc31c0b36c0 con 0x7fc31c0cd560 2023-12-19T18:03:18.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.017+0000 7fc3037fe700 1 -- 172.21.15.45:0/2986510527 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16268 (secure 0 0 0) 0x7fc31c0b36c0 con 0x7fc31c0cd560 2023-12-19T18:03:18.023 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:18.024 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":129,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:02.485924+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:18.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc308065ad0 msgr2=0x7fc308067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc308065ad0 0x7fc308067f90 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0090b0 tx=0x7fc30c008030 comp rx=0 tx=0).stop 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 msgr2=0x7fc31c0c23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 0x7fc31c0c23a0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fc31400cbd0 tx=0x7fc31400cee0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 shutdown_connections 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc308065ad0 0x7fc308067f90 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc31c0cd560 0x7fc31c0c23a0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc31c0c1e70 0x7fc31c0c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 --2- 172.21.15.45:0/2986510527 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc31c0adba0 0x7fc31c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 >> 172.21.15.45:0/2986510527 conn(0x7fc31c06a870 msgr2=0x7fc31c070d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 shutdown_connections 2023-12-19T18:03:18.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.021+0000 7fc3216ee700 1 -- 172.21.15.45:0/2986510527 wait complete. 2023-12-19T18:03:18.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:02:59.579656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:03:00.531245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:03:18.050 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:03:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.233+0000 7f2d4b42f700 1 Processor -- start 2023-12-19T18:03:18.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.233+0000 7f2d4b42f700 1 -- start start 2023-12-19T18:03:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4b42f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2d4415d0f0 0x7f2d440713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4b42f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4b42f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d440cd700 0x7f2d44070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4b42f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440cc490 con 0x7f2d440cd700 2023-12-19T18:03:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4b42f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d440ccd30 con 0x7f2d4415d0f0 2023-12-19T18:03:18.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4b42f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440ca790 con 0x7f2d440ca020 2023-12-19T18:03:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d440cd700 0x7f2d44070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f2d440cd700 0x7f2d44070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43442/0 (socket says 172.21.15.45:43442) 2023-12-19T18:03:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/577673731 learned_addr learned my addr 172.21.15.45:0/577673731 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4a42d700 1 --2- 172.21.15.45:0/577673731 >> v2:172.21.15.73:3300/0 conn(0x7f2d4415d0f0 0x7f2d440713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d49c2c700 1 --2- 172.21.15.45:0/577673731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/577673731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 msgr2=0x7f2d440cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 --2- 172.21.15.45:0/577673731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/577673731 >> v2:172.21.15.73:3300/0 conn(0x7f2d4415d0f0 msgr2=0x7f2d440713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 --2- 172.21.15.45:0/577673731 >> v2:172.21.15.73:3300/0 conn(0x7f2d4415d0f0 0x7f2d440713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/577673731 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440cc6e0 con 0x7f2d440cd700 2023-12-19T18:03:18.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4ac2e700 1 --2- 172.21.15.45:0/577673731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d440cd700 0x7f2d44070570 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406b140 tx=0x7f2d3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3064dda79a957ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4942b700 1 -- 172.21.15.45:0/577673731 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00e070 con 0x7f2d440cd700 2023-12-19T18:03:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4942b700 1 -- 172.21.15.45:0/577673731 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00b910 con 0x7f2d440cd700 2023-12-19T18:03:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.237+0000 7f2d4942b700 1 -- 172.21.15.45:0/577673731 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c00bcc0 con 0x7f2d440cd700 2023-12-19T18:03:18.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 -- 172.21.15.45:0/577673731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d440cd700 msgr2=0x7f2d44070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/577673731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d440cd700 0x7f2d44070570 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406b140 tx=0x7f2d3c00b330 comp rx=0 tx=0).stop 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 -- 172.21.15.45:0/577673731 shutdown_connections 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/577673731 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d440cd700 0x7f2d44070570 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/577673731 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/577673731 >> v2:172.21.15.73:3300/0 conn(0x7f2d4415d0f0 0x7f2d440713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 -- 172.21.15.45:0/577673731 >> 172.21.15.45:0/577673731 conn(0x7f2d440ce8c0 msgr2=0x7f2d440ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 -- 172.21.15.45:0/577673731 shutdown_connections 2023-12-19T18:03:18.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.241+0000 7f2d4b42f700 1 -- 172.21.15.45:0/577673731 wait complete. 2023-12-19T18:03:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 Processor -- start 2023-12-19T18:03:18.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 -- start start 2023-12-19T18:03:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d440cd700 0x7f2d4414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 0x7f2d4414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415f2a0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415fce0 con 0x7f2d440cd700 2023-12-19T18:03:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4b42f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4415ffc0 con 0x7f2d440ca020 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 0x7f2d4414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 0x7f2d4414de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43450/0 (socket says 172.21.15.45:43450) 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/2318871608 learned_addr learned my addr 172.21.15.45:0/2318871608 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4a42d700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d49c2c700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d440cd700 0x7f2d4414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 msgr2=0x7f2d440ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d440cd700 msgr2=0x7f2d4414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d440cd700 0x7f2d4414d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.245+0000 7f2d4ac2e700 1 -- 172.21.15.45:0/2318871608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009b30 con 0x7f2d4415d0f0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d4ac2e700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 0x7f2d4414de60 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406bf90 tx=0x7f2d3c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0092e0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3c00ce80 con 0x7f2d4415d0f0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3c0044b0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d441602a0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d441f2670 con 0x7f2d4415d0f0 2023-12-19T18:03:18.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.249+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d441607c0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.253+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2d3c004610 con 0x7f2d4415d0f0 2023-12-19T18:03:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.253+0000 7f2d3affd700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d28065ad0 0x7f2d28067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.253+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2d3c0844c0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.253+0000 7f2d4a42d700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d28065ad0 0x7f2d28067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.253+0000 7f2d4a42d700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d28065ad0 0x7f2d28067f90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009b50 tx=0x7f2d40009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:18.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.261+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2d441607c0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.437+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d441607c0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.442 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:03:18.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.437+0000 7f2d3affd700 1 -- 172.21.15.45:0/2318871608 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d441607c0 con 0x7f2d4415d0f0 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d28065ad0 msgr2=0x7f2d28067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d28065ad0 0x7f2d28067f90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d40009b50 tx=0x7f2d40009240 comp rx=0 tx=0).stop 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 msgr2=0x7f2d4414de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 0x7f2d4414de60 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7f2d4406bf90 tx=0x7f2d3c004af0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 shutdown_connections 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2d28065ad0 0x7f2d28067f90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2d4415d0f0 0x7f2d4414de60 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2d440cd700 0x7f2d4414d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 --2- 172.21.15.45:0/2318871608 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2d440ca020 0x7f2d440ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 >> 172.21.15.45:0/2318871608 conn(0x7f2d440ce8c0 msgr2=0x7f2d440c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 shutdown_connections 2023-12-19T18:03:18.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.441+0000 7f2d4b42f700 1 -- 172.21.15.45:0/2318871608 wait complete. 2023-12-19T18:03:18.537 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:03:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.709+0000 7f1f8e87e700 1 Processor -- start 2023-12-19T18:03:18.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.709+0000 7f1f8e87e700 1 -- start start 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8e87e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f880b4720 0x7f1f880b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8e87e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880d1630 0x7f1f880d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8e87e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f880d11a0 con 0x7f1f880b8630 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8e87e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f880b5040 con 0x7f1f880b4720 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8e87e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8815e360 con 0x7f1f880d1630 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8e07d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880d1630 0x7f1f880d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d87c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f1f880b4720 0x7f1f880b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d07b700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f1f880b8630 0x7f1f8815d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:44362/0 (socket says 172.21.15.45:44362) 2023-12-19T18:03:18.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d07b700 1 -- 172.21.15.45:0/2633271551 learned_addr learned my addr 172.21.15.45:0/2633271551 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8c87a700 1 -- 172.21.15.45:0/2633271551 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2307069290 0 0) 0x7f1f880d11a0 con 0x7f1f880b8630 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8c87a700 1 -- 172.21.15.45:0/2633271551 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f740035d0 con 0x7f1f880b8630 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d87c700 1 -- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880d1630 msgr2=0x7f1f880d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d87c700 1 --2- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880d1630 0x7f1f880d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d87c700 1 -- 172.21.15.45:0/2633271551 >> v1:172.21.15.73:6789/0 conn(0x7f1f880b8630 legacy=0x7f1f8815d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d87c700 1 -- 172.21.15.45:0/2633271551 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8815dda0 con 0x7f1f880b4720 2023-12-19T18:03:18.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.713+0000 7f1f8d87c700 1 --2- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f880b4b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009850 tx=0x7f1f84009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616b7932a8178c45 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8c87a700 1 -- 172.21.15.45:0/2633271551 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84011830 con 0x7f1f880b4720 2023-12-19T18:03:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8c87a700 1 -- 172.21.15.45:0/2633271551 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f84011990 con 0x7f1f880b4720 2023-12-19T18:03:18.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8c87a700 1 -- 172.21.15.45:0/2633271551 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f84011d40 con 0x7f1f880b4720 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 -- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 msgr2=0x7f1f880b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f880b4b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f1f84009850 tx=0x7f1f84009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 -- 172.21.15.45:0/2633271551 shutdown_connections 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880d1630 0x7f1f880d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/2633271551 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f880b4b00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 -- 172.21.15.45:0/2633271551 >> 172.21.15.45:0/2633271551 conn(0x7f1f88066320 msgr2=0x7f1f880cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:18.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 -- 172.21.15.45:0/2633271551 shutdown_connections 2023-12-19T18:03:18.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.717+0000 7f1f8e87e700 1 -- 172.21.15.45:0/2633271551 wait complete. 2023-12-19T18:03:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 Processor -- start 2023-12-19T18:03:18.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 -- start start 2023-12-19T18:03:18.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f88151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880b8630 0x7f1f881f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 0x7f1f880c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880cacb0 con 0x7f1f880d1630 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f881f3260 con 0x7f1f880b4720 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e87e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f880ca0a0 con 0x7f1f880b8630 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e07d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 0x7f1f880c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e07d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 0x7f1f880c8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43452/0 (socket says 172.21.15.45:43452) 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e07d700 1 -- 172.21.15.45:0/973999603 learned_addr learned my addr 172.21.15.45:0/973999603 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8d87c700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f88151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8d07b700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880b8630 0x7f1f881f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e07d700 1 -- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880b8630 msgr2=0x7f1f881f2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.721+0000 7f1f8e07d700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880b8630 0x7f1f881f2d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e07d700 1 -- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 msgr2=0x7f1f88151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e07d700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f88151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e07d700 1 -- 172.21.15.45:0/973999603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f840094b0 con 0x7f1f880d1630 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e07d700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 0x7f1f880c8be0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000efc0 tx=0x7f1f8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f80009ea0 con 0x7f1f880d1630 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8000f040 con 0x7f1f880d1630 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8000ced0 con 0x7f1f880d1630 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f880ca380 con 0x7f1f880d1630 2023-12-19T18:03:18.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f880ca940 con 0x7f1f880d1630 2023-12-19T18:03:18.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.725+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f880cae20 con 0x7f1f880d1630 2023-12-19T18:03:18.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.729+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1f80014480 con 0x7f1f880d1630 2023-12-19T18:03:18.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.729+0000 7f1f7e7fc700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f6c065ad0 0x7f1f6c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.729+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1f80083a60 con 0x7f1f880d1630 2023-12-19T18:03:18.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.729+0000 7f1f8d87c700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f6c065ad0 0x7f1f6c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:18.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.733+0000 7f1f8d87c700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f6c065ad0 0x7f1f6c067f90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1f840090b0 tx=0x7f1f8401c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:18.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.733+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f1f80051380 con 0x7f1f880d1630 2023-12-19T18:03:18.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.905+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1f8804ed30 con 0x7f1f880d1630 2023-12-19T18:03:18.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f7e7fc700 1 -- 172.21.15.45:0/973999603 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1f80018020 con 0x7f1f880d1630 2023-12-19T18:03:18.913 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:03:18.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f6c065ad0 msgr2=0x7f1f6c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f6c065ad0 0x7f1f6c067f90 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1f840090b0 tx=0x7f1f8401c040 comp rx=0 tx=0).stop 2023-12-19T18:03:18.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 msgr2=0x7f1f880c8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:18.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 0x7f1f880c8be0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f1f8000efc0 tx=0x7f1f8000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 shutdown_connections 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1f6c065ad0 0x7f1f6c067f90 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1f880d1630 0x7f1f880c8be0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1f880b8630 0x7f1f881f2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 --2- 172.21.15.45:0/973999603 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1f880b4720 0x7f1f88151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 >> 172.21.15.45:0/973999603 conn(0x7f1f88066320 msgr2=0x7f1f880cd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.909+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 shutdown_connections 2023-12-19T18:03:18.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:18.913+0000 7f1f8e87e700 1 -- 172.21.15.45:0/973999603 wait complete. 2023-12-19T18:03:18.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:03:19.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.117+0000 7f65913c3700 1 Processor -- start 2023-12-19T18:03:19.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.117+0000 7f65913c3700 1 -- start start 2023-12-19T18:03:19.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f65913c3700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f658c1558c0 0x7f658c070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f65913c3700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c0c9a70 con 0x7f658c15c310 2023-12-19T18:03:19.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f65913c3700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658c0c9d50 con 0x7f658c1554e0 2023-12-19T18:03:19.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f65913c3700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658c06c730 con 0x7f658c1558c0 2023-12-19T18:03:19.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f6590bc2700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f658c15c310 0x7f658c0ad540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60362/0 (socket says 172.21.15.45:60362) 2023-12-19T18:03:19.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f6590bc2700 1 -- 172.21.15.45:0/250860241 learned_addr learned my addr 172.21.15.45:0/250860241 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658b7fe700 1 --2- 172.21.15.45:0/250860241 >> v2:172.21.15.73:3300/0 conn(0x7f658c1558c0 0x7f658c070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1059553122 0 0) 0x7f658c0c9a70 con 0x7f658c15c310 2023-12-19T18:03:19.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65740035d0 con 0x7f658c15c310 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1866474482 0 0) 0x7f65740035d0 con 0x7f658c15c310 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 >> v2:172.21.15.73:3300/0 conn(0x7f658c1558c0 msgr2=0x7f658c070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 --2- 172.21.15.45:0/250860241 >> v2:172.21.15.73:3300/0 conn(0x7f658c1558c0 0x7f658c070570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 >> v1:172.21.15.73:6789/0 conn(0x7f658c1554e0 legacy=0x7f658c0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0ca030 con 0x7f658c15c310 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f65840019f0 con 0x7f658c15c310 2023-12-19T18:03:19.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 >> v1:172.21.15.45:6789/0 conn(0x7f658c15c310 legacy=0x7f658c0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6574003b00 0x7f6574003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574004870 0x7f6574004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6574005300 0x7f657400ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c06c730 con 0x7f6574005300 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657400c250 con 0x7f6574004870 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657400c410 con 0x7f6574003b00 2023-12-19T18:03:19.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f6590bc2700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6574005300 0x7f657400ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658b7fe700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574004870 0x7f6574004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.121+0000 7f658bfff700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6574003b00 0x7f6574003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 -- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6574003b00 msgr2=0x7f6574003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:19.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f6574003b00 0x7f6574003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 -- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574004870 msgr2=0x7f6574004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574004870 0x7f6574004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 -- 172.21.15.45:0/250860241 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65740035d0 con 0x7f6574005300 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f658b7fe700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574004870 0x7f6574004cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 -- 172.21.15.45:0/250860241 reap_dead start 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f6590bc2700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6574005300 0x7f657400ba30 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f658400a830 tx=0x7f65740058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58ffe84eae10cff server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400a2f0 con 0x7f6574005300 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65840072f0 con 0x7f6574005300 2023-12-19T18:03:19.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f658affd700 1 -- 172.21.15.45:0/250860241 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65840076a0 con 0x7f6574005300 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 -- 172.21.15.45:0/250860241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6574005300 msgr2=0x7f657400ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6574005300 0x7f657400ba30 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f658400a830 tx=0x7f65740058a0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 -- 172.21.15.45:0/250860241 shutdown_connections 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 --2- 172.21.15.45:0/250860241 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f6574005300 0x7f657400ba30 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 -- 172.21.15.45:0/250860241 >> 172.21.15.45:0/250860241 conn(0x7f658c0ce8c0 msgr2=0x7f658c0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 -- 172.21.15.45:0/250860241 shutdown_connections 2023-12-19T18:03:19.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.125+0000 7f65913c3700 1 -- 172.21.15.45:0/250860241 wait complete. 2023-12-19T18:03:19.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 Processor -- start 2023-12-19T18:03:19.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 -- start start 2023-12-19T18:03:19.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574005300 0x7f658c154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 0x7f658c0c8580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f658c0c5990 0x7f658c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c6350 con 0x7f658c0c8120 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c53c0 con 0x7f6574005300 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.129+0000 7f65913c3700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f658c0c4090 con 0x7f658c0c5990 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 0x7f658c0c8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 0x7f658c0c8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51232/0 (socket says 172.21.15.45:51232) 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 -- 172.21.15.45:0/963580367 learned_addr learned my addr 172.21.15.45:0/963580367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658bfff700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574005300 0x7f658c154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f6590bc2700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f658c0c5990 0x7f658c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 -- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f658c0c5990 msgr2=0x7f658c0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f658c0c5990 0x7f658c0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 -- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574005300 msgr2=0x7f658c154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574005300 0x7f658c154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 -- 172.21.15.45:0/963580367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c0c4370 con 0x7f658c0c8120 2023-12-19T18:03:19.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f658b7fe700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 0x7f658c0c8580 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6580011d00 tx=0x7f658000f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:19.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000fa80 con 0x7f658c0c8120 2023-12-19T18:03:19.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658000fbe0 con 0x7f658c0c8120 2023-12-19T18:03:19.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658c0c7920 con 0x7f658c0c8120 2023-12-19T18:03:19.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580004020 con 0x7f658c0c8120 2023-12-19T18:03:19.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658c155130 con 0x7f658c0c8120 2023-12-19T18:03:19.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.133+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658c0c45b0 con 0x7f658c0c8120 2023-12-19T18:03:19.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.137+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f6580004180 con 0x7f658c0c8120 2023-12-19T18:03:19.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.137+0000 7f6588ff9700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6578065ad0 0x7f6578067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.137+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f65800836d0 con 0x7f658c0c8120 2023-12-19T18:03:19.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.137+0000 7f658bfff700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6578065ad0 0x7f6578067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.141+0000 7f658bfff700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6578065ad0 0x7f6578067f90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f657c000c00 tx=0x7f657c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:19.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.141+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f658c0c45b0 con 0x7f658c0c8120 2023-12-19T18:03:19.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f658c04ed30 con 0x7f658c0c8120 2023-12-19T18:03:19.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f6588ff9700 1 -- 172.21.15.45:0/963580367 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7f65800220a0 con 0x7f658c0c8120 2023-12-19T18:03:19.321 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:03:19.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6578065ad0 msgr2=0x7f6578067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6578065ad0 0x7f6578067f90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f657c000c00 tx=0x7f657c009040 comp rx=0 tx=0).stop 2023-12-19T18:03:19.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 msgr2=0x7f658c0c8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 0x7f658c0c8580 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f6580011d00 tx=0x7f658000f520 comp rx=0 tx=0).stop 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 shutdown_connections 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6578065ad0 0x7f6578067f90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f658c0c5990 0x7f658c0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f658c0c8120 0x7f658c0c8580 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.317+0000 7f65913c3700 1 --2- 172.21.15.45:0/963580367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6574005300 0x7f658c154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.321+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 >> 172.21.15.45:0/963580367 conn(0x7f658c0ce8c0 msgr2=0x7f658c070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.321+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 shutdown_connections 2023-12-19T18:03:19.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.321+0000 7f65913c3700 1 -- 172.21.15.45:0/963580367 wait complete. 2023-12-19T18:03:19.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:03:19.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa36de6d700 1 Processor -- start 2023-12-19T18:03:19.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa36de6d700 1 -- start start 2023-12-19T18:03:19.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa36de6d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa3680b46f0 0x7fa3680b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa36de6d700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36815e480 con 0x7fa36815d470 2023-12-19T18:03:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa36de6d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa36815dbe0 con 0x7fa3680d1040 2023-12-19T18:03:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa36de6d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa36815dec0 con 0x7fa3680b46f0 2023-12-19T18:03:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa367fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa36815d470 0x7fa3680b4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60376/0 (socket says 172.21.15.45:60376) 2023-12-19T18:03:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.529+0000 7fa367fff700 1 -- 172.21.15.45:0/832177200 learned_addr learned my addr 172.21.15.45:0/832177200 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:19.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36ce6b700 1 --2- 172.21.15.45:0/832177200 >> v2:172.21.15.73:3300/0 conn(0x7fa3680b46f0 0x7fa3680b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa3677fe700 1 -- 172.21.15.45:0/832177200 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251686338 0 0) 0x7fa36815e480 con 0x7fa36815d470 2023-12-19T18:03:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa3677fe700 1 -- 172.21.15.45:0/832177200 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3580035d0 con 0x7fa36815d470 2023-12-19T18:03:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36ce6b700 1 -- 172.21.15.45:0/832177200 >> v1:172.21.15.73:6789/0 conn(0x7fa3680d1040 legacy=0x7fa368161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36ce6b700 1 -- 172.21.15.45:0/832177200 >> v1:172.21.15.45:6789/0 conn(0x7fa36815d470 legacy=0x7fa3680b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36ce6b700 1 -- 172.21.15.45:0/832177200 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36815e1a0 con 0x7fa3680b46f0 2023-12-19T18:03:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36ce6b700 1 --2- 172.21.15.45:0/832177200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680b46f0 0x7fa3680b8770 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009850 tx=0x7fa35c009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26e25f20941dcc14 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:19.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa3677fe700 1 -- 172.21.15.45:0/832177200 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c011830 con 0x7fa3680b46f0 2023-12-19T18:03:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa3677fe700 1 -- 172.21.15.45:0/832177200 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa35c011990 con 0x7fa3680b46f0 2023-12-19T18:03:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa3677fe700 1 -- 172.21.15.45:0/832177200 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa35c011d40 con 0x7fa3680b46f0 2023-12-19T18:03:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 -- 172.21.15.45:0/832177200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680b46f0 msgr2=0x7fa3680b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 --2- 172.21.15.45:0/832177200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680b46f0 0x7fa3680b8770 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fa35c009850 tx=0x7fa35c009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 -- 172.21.15.45:0/832177200 shutdown_connections 2023-12-19T18:03:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 --2- 172.21.15.45:0/832177200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680b46f0 0x7fa3680b8770 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 -- 172.21.15.45:0/832177200 >> 172.21.15.45:0/832177200 conn(0x7fa368066380 msgr2=0x7fa3680cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 -- 172.21.15.45:0/832177200 shutdown_connections 2023-12-19T18:03:19.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.533+0000 7fa36de6d700 1 -- 172.21.15.45:0/832177200 wait complete. 2023-12-19T18:03:19.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.537+0000 7fa36de6d700 1 Processor -- start 2023-12-19T18:03:19.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.537+0000 7fa36de6d700 1 -- start start 2023-12-19T18:03:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3680b46f0 0x7fa3681587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680d1040 0x7fa36814fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 0x7fa3681e5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa368158d20 con 0x7fa36815d470 2023-12-19T18:03:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3681501d0 con 0x7fa3680d1040 2023-12-19T18:03:19.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa368158f00 con 0x7fa3680b46f0 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 0x7fa3681e5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 0x7fa3681e5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51234/0 (socket says 172.21.15.45:51234) 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 -- 172.21.15.45:0/86164243 learned_addr learned my addr 172.21.15.45:0/86164243 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa367fff700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680d1040 0x7fa36814fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36ce6b700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3680b46f0 0x7fa3681587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 -- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3680b46f0 msgr2=0x7fa3681587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3680b46f0 0x7fa3681587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 -- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680d1040 msgr2=0x7fa36814fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680d1040 0x7fa36814fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 -- 172.21.15.45:0/86164243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa35c0094b0 con 0x7fa36815d470 2023-12-19T18:03:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa367fff700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680d1040 0x7fa36814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36d66c700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 0x7fa3681e5e30 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa36000cc50 tx=0x7fa36000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:19.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360003c20 con 0x7fa36815d470 2023-12-19T18:03:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa360003d80 con 0x7fa36815d470 2023-12-19T18:03:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36000aab0 con 0x7fa36815d470 2023-12-19T18:03:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.541+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3681591e0 con 0x7fa36815d470 2023-12-19T18:03:19.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.545+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa368150850 con 0x7fa36815d470 2023-12-19T18:03:19.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.545+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3681503b0 con 0x7fa36815d470 2023-12-19T18:03:19.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.545+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa36000ac10 con 0x7fa36815d470 2023-12-19T18:03:19.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.549+0000 7fa3657fa700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa34c065b00 0x7fa34c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:19.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.549+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa360083340 con 0x7fa36815d470 2023-12-19T18:03:19.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.549+0000 7fa36ce6b700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa34c065b00 0x7fa34c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:19.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.549+0000 7fa36ce6b700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa34c065b00 0x7fa34c067fc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0090b0 tx=0x7fa35c01c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:19.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.553+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa360050b20 con 0x7fa36815d470 2023-12-19T18:03:19.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.741+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa36804ed30 con 0x7fa36815d470 2023-12-19T18:03:19.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.745+0000 7fa3657fa700 1 -- 172.21.15.45:0/86164243 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa360054140 con 0x7fa36815d470 2023-12-19T18:03:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa34c065b00 msgr2=0x7fa34c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa34c065b00 0x7fa34c067fc0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fa35c0090b0 tx=0x7fa35c01c040 comp rx=0 tx=0).stop 2023-12-19T18:03:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 msgr2=0x7fa3681e5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:19.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 0x7fa3681e5e30 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fa36000cc50 tx=0x7fa36000cf60 comp rx=0 tx=0).stop 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 shutdown_connections 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa34c065b00 0x7fa34c067fc0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa36815d470 0x7fa3681e5e30 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa3680d1040 0x7fa36814fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 --2- 172.21.15.45:0/86164243 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa3680b46f0 0x7fa3681587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 >> 172.21.15.45:0/86164243 conn(0x7fa368066380 msgr2=0x7fa368153470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 shutdown_connections 2023-12-19T18:03:19.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:19.749+0000 7fa36de6d700 1 -- 172.21.15.45:0/86164243 wait complete. 2023-12-19T18:03:19.758 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T18:03:19.778 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:03:19.778 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:03:19.798 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.017+0000 7faa2cf46700 1 Processor -- start 2023-12-19T18:03:20.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.017+0000 7faa2cf46700 1 -- start start 2023-12-19T18:03:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa2cf46700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7faa2815b080 0x7faa280c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa2cf46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa280b05e0 0x7faa280b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa2cf46700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280b0f80 con 0x7faa28070640 2023-12-19T18:03:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa2cf46700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa2815b460 con 0x7faa2815b080 2023-12-19T18:03:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa2cf46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280b2f40 con 0x7faa280b05e0 2023-12-19T18:03:20.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa26d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7faa28070640 0x7faa28070ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60378/0 (socket says 172.21.15.45:60378) 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa26d9d700 1 -- 172.21.15.45:0/3719859295 learned_addr learned my addr 172.21.15.45:0/3719859295 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa25d9b700 1 --2- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa280b05e0 0x7faa280b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.021+0000 7faa2659c700 1 --2- 172.21.15.45:0/3719859295 >> v2:172.21.15.73:3300/0 conn(0x7faa2815b080 0x7faa280c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2659c700 1 -- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa280b05e0 msgr2=0x7faa280b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2659c700 1 --2- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa280b05e0 0x7faa280b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2659c700 1 -- 172.21.15.45:0/3719859295 >> v1:172.21.15.45:6789/0 conn(0x7faa28070640 legacy=0x7faa28070ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2659c700 1 -- 172.21.15.45:0/3719859295 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa280cf5f0 con 0x7faa2815b080 2023-12-19T18:03:20.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2659c700 1 --2- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa2815b080 0x7faa280c9f20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7faa18009850 tx=0x7faa18009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73b6116a1d8c0593 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2559a700 1 -- 172.21.15.45:0/3719859295 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18011830 con 0x7faa2815b080 2023-12-19T18:03:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2559a700 1 -- 172.21.15.45:0/3719859295 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18011990 con 0x7faa2815b080 2023-12-19T18:03:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2559a700 1 -- 172.21.15.45:0/3719859295 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18011d40 con 0x7faa2815b080 2023-12-19T18:03:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 -- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa2815b080 msgr2=0x7faa280c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 --2- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa2815b080 0x7faa280c9f20 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7faa18009850 tx=0x7faa18009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 -- 172.21.15.45:0/3719859295 shutdown_connections 2023-12-19T18:03:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 --2- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa280b05e0 0x7faa280b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 --2- 172.21.15.45:0/3719859295 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa2815b080 0x7faa280c9f20 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 -- 172.21.15.45:0/3719859295 >> 172.21.15.45:0/3719859295 conn(0x7faa2806a870 msgr2=0x7faa280ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 -- 172.21.15.45:0/3719859295 shutdown_connections 2023-12-19T18:03:20.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.025+0000 7faa2cf46700 1 -- 172.21.15.45:0/3719859295 wait complete. 2023-12-19T18:03:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 Processor -- start 2023-12-19T18:03:20.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 -- start start 2023-12-19T18:03:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa28070640 0x7faa2815c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa280b05e0 0x7faa2815c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 0x7faa2815d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280c7e20 con 0x7faa2815b080 2023-12-19T18:03:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280c5b60 con 0x7faa280b05e0 2023-12-19T18:03:20.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2cf46700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815cef0 con 0x7faa28070640 2023-12-19T18:03:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa26d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 0x7faa2815d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa26d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 0x7faa2815d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51248/0 (socket says 172.21.15.45:51248) 2023-12-19T18:03:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa26d9d700 1 -- 172.21.15.45:0/2306014276 learned_addr learned my addr 172.21.15.45:0/2306014276 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2659c700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa28070640 0x7faa2815c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa25d9b700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa280b05e0 0x7faa2815c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2659c700 1 -- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa280b05e0 msgr2=0x7faa2815c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2659c700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa280b05e0 0x7faa2815c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2659c700 1 -- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 msgr2=0x7faa2815d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2659c700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 0x7faa2815d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa2659c700 1 -- 172.21.15.45:0/2306014276 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa180094b0 con 0x7faa28070640 2023-12-19T18:03:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.029+0000 7faa26d9d700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 0x7faa2815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa2659c700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa28070640 0x7faa2815c470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa18016000 tx=0x7faa18004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa180036c0 con 0x7faa28070640 2023-12-19T18:03:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18003840 con 0x7faa28070640 2023-12-19T18:03:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280c5db0 con 0x7faa28070640 2023-12-19T18:03:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18003bf0 con 0x7faa28070640 2023-12-19T18:03:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa280c6370 con 0x7faa28070640 2023-12-19T18:03:20.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa280741d0 con 0x7faa28070640 2023-12-19T18:03:20.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.033+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7faa18003d50 con 0x7faa28070640 2023-12-19T18:03:20.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.037+0000 7faa16ffd700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa08065ad0 0x7faa08067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.037+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7faa18021030 con 0x7faa28070640 2023-12-19T18:03:20.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.037+0000 7faa25d9b700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa08065ad0 0x7faa08067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.037+0000 7faa25d9b700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa08065ad0 0x7faa08067f90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faa280af5e0 tx=0x7faa1c009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.045+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7faa180520b0 con 0x7faa28070640 2023-12-19T18:03:20.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.221+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa2806e4f0 con 0x7faa28070640 2023-12-19T18:03:20.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.225+0000 7faa16ffd700 1 -- 172.21.15.45:0/2306014276 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) v1 ==== 74+0+16268 (secure 0 0 0) 0x7faa180556d0 con 0x7faa28070640 2023-12-19T18:03:20.230 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:20.230 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":129,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:02.485924+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa08065ad0 msgr2=0x7faa08067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa08065ad0 0x7faa08067f90 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faa280af5e0 tx=0x7faa1c009240 comp rx=0 tx=0).stop 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa28070640 msgr2=0x7faa2815c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa28070640 0x7faa2815c470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa18016000 tx=0x7faa18004770 comp rx=0 tx=0).stop 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 shutdown_connections 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7faa08065ad0 0x7faa08067f90 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7faa2815b080 0x7faa2815d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faa280b05e0 0x7faa2815c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 --2- 172.21.15.45:0/2306014276 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7faa28070640 0x7faa2815c470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 >> 172.21.15.45:0/2306014276 conn(0x7faa2806a870 msgr2=0x7faa280ccaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 shutdown_connections 2023-12-19T18:03:20.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.229+0000 7faa2cf46700 1 -- 172.21.15.45:0/2306014276 wait complete. 2023-12-19T18:03:20.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:02:59.579656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:03:00.531245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:03:20.257 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:03:20.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.437+0000 7efe15da8700 1 Processor -- start 2023-12-19T18:03:20.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.437+0000 7efe15da8700 1 -- start start 2023-12-19T18:03:20.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe15da8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe10070570 0x7efe100709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe15da8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 0x7efe100cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe15da8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe10070f10 con 0x7efe10161810 2023-12-19T18:03:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe15da8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe100caca0 con 0x7efe10070570 2023-12-19T18:03:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe15da8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe100ca090 con 0x7efe100ccc80 2023-12-19T18:03:20.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 0x7efe100cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe0ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe10070570 0x7efe100709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 0x7efe100cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:40788/0 (socket says 172.21.15.45:40788) 2023-12-19T18:03:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe0ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efe10070570 0x7efe100709d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:45162/0 (socket says 172.21.15.45:45162) 2023-12-19T18:03:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 -- 172.21.15.45:0/2315724725 learned_addr learned my addr 172.21.15.45:0/2315724725 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:20.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 -- 172.21.15.45:0/2315724725 >> v2:172.21.15.73:3300/0 conn(0x7efe10070570 msgr2=0x7efe100709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 --2- 172.21.15.45:0/2315724725 >> v2:172.21.15.73:3300/0 conn(0x7efe10070570 0x7efe100709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 -- 172.21.15.45:0/2315724725 >> v1:172.21.15.73:6789/0 conn(0x7efe10161810 legacy=0x7efe100c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 -- 172.21.15.45:0/2315724725 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100ca370 con 0x7efe100ccc80 2023-12-19T18:03:20.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.441+0000 7efe155a7700 1 --2- 172.21.15.45:0/2315724725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 0x7efe100cd110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efe08009e50 tx=0x7efe0800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=947c9deb30d78c6e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe0f7fe700 1 -- 172.21.15.45:0/2315724725 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800e070 con 0x7efe100ccc80 2023-12-19T18:03:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe0f7fe700 1 -- 172.21.15.45:0/2315724725 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0800b910 con 0x7efe100ccc80 2023-12-19T18:03:20.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe0f7fe700 1 -- 172.21.15.45:0/2315724725 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0800bcc0 con 0x7efe100ccc80 2023-12-19T18:03:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 -- 172.21.15.45:0/2315724725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 msgr2=0x7efe100cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 --2- 172.21.15.45:0/2315724725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 0x7efe100cd110 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efe08009e50 tx=0x7efe0800b330 comp rx=0 tx=0).stop 2023-12-19T18:03:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 -- 172.21.15.45:0/2315724725 shutdown_connections 2023-12-19T18:03:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 --2- 172.21.15.45:0/2315724725 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe100ccc80 0x7efe100cd110 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 --2- 172.21.15.45:0/2315724725 >> v2:172.21.15.73:3300/0 conn(0x7efe10070570 0x7efe100709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 -- 172.21.15.45:0/2315724725 >> 172.21.15.45:0/2315724725 conn(0x7efe100ce8c0 msgr2=0x7efe100ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 -- 172.21.15.45:0/2315724725 shutdown_connections 2023-12-19T18:03:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.445+0000 7efe15da8700 1 -- 172.21.15.45:0/2315724725 wait complete. 2023-12-19T18:03:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 Processor -- start 2023-12-19T18:03:20.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 -- start start 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe10070570 0x7efe101f7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 0x7efe101fb070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe10161810 0x7efe101f68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe101f6e30 con 0x7efe100ccc80 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe10164ce0 con 0x7efe10161810 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe15da8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe10164a00 con 0x7efe10070570 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 0x7efe101fb070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 0x7efe101fb070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51260/0 (socket says 172.21.15.45:51260) 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe0ffff700 1 -- 172.21.15.45:0/2185350026 learned_addr learned my addr 172.21.15.45:0/2185350026 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:20.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe14da6700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe10070570 0x7efe101f7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.449+0000 7efe155a7700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe10161810 0x7efe101f68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0ffff700 1 -- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe10070570 msgr2=0x7efe101f7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0ffff700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe10070570 0x7efe101f7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0ffff700 1 -- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe10161810 msgr2=0x7efe101f68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0ffff700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe10161810 0x7efe101f68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0ffff700 1 -- 172.21.15.45:0/2185350026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe08009b30 con 0x7efe100ccc80 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe14da6700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe10070570 0x7efe101f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0ffff700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 0x7efe101fb070 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00e9d0 tx=0x7efdfc00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc009720 con 0x7efe100ccc80 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdfc00ee70 con 0x7efe100ccc80 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe101f7080 con 0x7efe100ccc80 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdfc00ca50 con 0x7efe100ccc80 2023-12-19T18:03:20.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe101f7640 con 0x7efe100ccc80 2023-12-19T18:03:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.453+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1004ed30 con 0x7efe100ccc80 2023-12-19T18:03:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.457+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efdfc00cbb0 con 0x7efe100ccc80 2023-12-19T18:03:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.457+0000 7efe0d7fa700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efdf4065ad0 0x7efdf4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.457+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7efdfc083340 con 0x7efe100ccc80 2023-12-19T18:03:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.457+0000 7efe14da6700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efdf4065ad0 0x7efdf4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.461+0000 7efe14da6700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efdf4065ad0 0x7efdf4067f90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efe04000f60 tx=0x7efe04009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.465+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efdfc050b40 con 0x7efe100ccc80 2023-12-19T18:03:20.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.641+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe100cf520 con 0x7efe100ccc80 2023-12-19T18:03:20.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.641+0000 7efe0d7fa700 1 -- 172.21.15.45:0/2185350026 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v129) v1 ==== 93+0+10 (secure 0 0 0) 0x7efdfc00ce60 con 0x7efe100ccc80 2023-12-19T18:03:20.648 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:03:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.645+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efdf4065ad0 msgr2=0x7efdf4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.645+0000 7efe15da8700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efdf4065ad0 0x7efdf4067f90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7efe04000f60 tx=0x7efe04009040 comp rx=0 tx=0).stop 2023-12-19T18:03:20.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.645+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 msgr2=0x7efe101fb070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.645+0000 7efe15da8700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 0x7efe101fb070 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7efdfc00e9d0 tx=0x7efdfc00ece0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 shutdown_connections 2023-12-19T18:03:20.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efdf4065ad0 0x7efdf4067f90 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efe10161810 0x7efe101f68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efe100ccc80 0x7efe101fb070 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 --2- 172.21.15.45:0/2185350026 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efe10070570 0x7efe101f7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 >> 172.21.15.45:0/2185350026 conn(0x7efe100ce8c0 msgr2=0x7efe10160a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 shutdown_connections 2023-12-19T18:03:20.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.649+0000 7efe15da8700 1 -- 172.21.15.45:0/2185350026 wait complete. 2023-12-19T18:03:20.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:03:20.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.849+0000 7fecbaa7b700 1 Processor -- start 2023-12-19T18:03:20.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.849+0000 7fecbaa7b700 1 -- start start 2023-12-19T18:03:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecbaa7b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fecb415aff0 0x7fecb40ae070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecbaa7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb40adb20 0x7fecb40b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecbaa7b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fecb40b05e0 0x7fecb40b0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecbaa7b700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40b0fb0 con 0x7fecb415aff0 2023-12-19T18:03:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecbaa7b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb40b2340 con 0x7fecb40b05e0 2023-12-19T18:03:20.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecbaa7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4071040 con 0x7fecb40adb20 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fecb415aff0 0x7fecb40ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fecb415aff0 0x7fecb40ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51264/0 (socket says 172.21.15.45:51264) 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 -- 172.21.15.45:0/569266075 learned_addr learned my addr 172.21.15.45:0/569266075 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb3fff700 1 --2- 172.21.15.45:0/569266075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb40adb20 0x7fecb40b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb9018700 1 --2- 172.21.15.45:0/569266075 >> v2:172.21.15.73:3300/0 conn(0x7fecb40b05e0 0x7fecb40b0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 -- 172.21.15.45:0/569266075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb40adb20 msgr2=0x7fecb40b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:20.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 --2- 172.21.15.45:0/569266075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb40adb20 0x7fecb40b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 -- 172.21.15.45:0/569266075 >> v2:172.21.15.73:3300/0 conn(0x7fecb40b05e0 msgr2=0x7fecb40b0a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 --2- 172.21.15.45:0/569266075 >> v2:172.21.15.73:3300/0 conn(0x7fecb40b05e0 0x7fecb40b0a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 -- 172.21.15.45:0/569266075 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb415b3d0 con 0x7fecb415aff0 2023-12-19T18:03:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb9018700 1 --2- 172.21.15.45:0/569266075 >> v2:172.21.15.73:3300/0 conn(0x7fecb40b05e0 0x7fecb40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb8817700 1 --2- 172.21.15.45:0/569266075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb415aff0 0x7fecb40ae070 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fecb40c2590 tx=0x7feca8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83785927166b0cac server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.853+0000 7fecb37fe700 1 -- 172.21.15.45:0/569266075 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8011830 con 0x7fecb415aff0 2023-12-19T18:03:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecb37fe700 1 -- 172.21.15.45:0/569266075 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca8011990 con 0x7fecb415aff0 2023-12-19T18:03:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecb37fe700 1 -- 172.21.15.45:0/569266075 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8011d20 con 0x7fecb415aff0 2023-12-19T18:03:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 -- 172.21.15.45:0/569266075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb415aff0 msgr2=0x7fecb40ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/569266075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb415aff0 0x7fecb40ae070 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fecb40c2590 tx=0x7feca8009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 -- 172.21.15.45:0/569266075 shutdown_connections 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/569266075 >> v2:172.21.15.73:3300/0 conn(0x7fecb40b05e0 0x7fecb40b0a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/569266075 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb40adb20 0x7fecb40b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/569266075 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb415aff0 0x7fecb40ae070 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 -- 172.21.15.45:0/569266075 >> 172.21.15.45:0/569266075 conn(0x7fecb40ceb20 msgr2=0x7fecb40cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 -- 172.21.15.45:0/569266075 shutdown_connections 2023-12-19T18:03:20.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.857+0000 7fecbaa7b700 1 -- 172.21.15.45:0/569266075 wait complete. 2023-12-19T18:03:20.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.861+0000 7fecbaa7b700 1 Processor -- start 2023-12-19T18:03:20.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.861+0000 7fecbaa7b700 1 -- start start 2023-12-19T18:03:20.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.861+0000 7fecbaa7b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 0x7fecb415b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecb40b05e0 0x7fecb415bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb415aff0 0x7fecb40c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40c5d70 con 0x7fecb40adb20 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb41f6d20 con 0x7fecb40b05e0 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415c130 con 0x7fecb415aff0 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 0x7fecb415b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 0x7fecb415b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51280/0 (socket says 172.21.15.45:51280) 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 -- 172.21.15.45:0/1082044665 learned_addr learned my addr 172.21.15.45:0/1082044665 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb9018700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb415aff0 0x7fecb40c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb3fff700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecb40b05e0 0x7fecb415bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 -- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb415aff0 msgr2=0x7fecb40c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb415aff0 0x7fecb40c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 -- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecb40b05e0 msgr2=0x7fecb415bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecb40b05e0 0x7fecb415bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:20.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 -- 172.21.15.45:0/1082044665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8009570 con 0x7fecb40adb20 2023-12-19T18:03:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb9018700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb415aff0 0x7fecb40c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb8817700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 0x7fecb415b5c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7feca8014040 tx=0x7feca8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca8004450 con 0x7fecb40adb20 2023-12-19T18:03:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca801e070 con 0x7fecb40adb20 2023-12-19T18:03:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb415c410 con 0x7fecb40adb20 2023-12-19T18:03:20.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca80038e0 con 0x7fecb40adb20 2023-12-19T18:03:20.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.865+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb415c9d0 con 0x7fecb40adb20 2023-12-19T18:03:20.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.869+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb40741d0 con 0x7fecb40adb20 2023-12-19T18:03:20.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.869+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7feca8003a40 con 0x7fecb40adb20 2023-12-19T18:03:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.873+0000 7fecb17fa700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec98065ad0 0x7fec98067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:20.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.873+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7feca8083e60 con 0x7fecb40adb20 2023-12-19T18:03:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.873+0000 7fecb3fff700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec98065ad0 0x7fec98067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:20.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.873+0000 7fecb3fff700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec98065ad0 0x7fec98067f90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fecb4159ec0 tx=0x7feca0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:20.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:20.877+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7feca8051770 con 0x7fecb40adb20 2023-12-19T18:03:21.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.057+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fecb40b03c0 con 0x7fecb40adb20 2023-12-19T18:03:21.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.057+0000 7fecb17fa700 1 -- 172.21.15.45:0/1082044665 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v129) v1 ==== 104+0+11 (secure 0 0 0) 0x7feca8020020 con 0x7fecb40adb20 2023-12-19T18:03:21.063 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:03:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec98065ad0 msgr2=0x7fec98067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec98065ad0 0x7fec98067f90 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fecb4159ec0 tx=0x7feca0009240 comp rx=0 tx=0).stop 2023-12-19T18:03:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 msgr2=0x7fecb415b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 0x7fecb415b5c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7feca8014040 tx=0x7feca8004770 comp rx=0 tx=0).stop 2023-12-19T18:03:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 shutdown_connections 2023-12-19T18:03:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fec98065ad0 0x7fec98067f90 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fecb415aff0 0x7fecb40c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fecb40b05e0 0x7fecb415bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 --2- 172.21.15.45:0/1082044665 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fecb40adb20 0x7fecb415b5c0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 >> 172.21.15.45:0/1082044665 conn(0x7fecb40ceb20 msgr2=0x7fecb40b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 shutdown_connections 2023-12-19T18:03:21.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.061+0000 7fecbaa7b700 1 -- 172.21.15.45:0/1082044665 wait complete. 2023-12-19T18:03:21.088 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.269+0000 7fa3a157d700 1 Processor -- start 2023-12-19T18:03:21.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.269+0000 7fa3a157d700 1 -- start start 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a157d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0b4720 0x7fa39c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a157d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa39c0d1630 0x7fa39c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a157d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa39c0d11a0 con 0x7fa39c0b8630 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a157d700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa39c0b5040 con 0x7fa39c0d1630 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a157d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c15e360 con 0x7fa39c0b4720 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa39c0d1630 0x7fa39c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa39c0d1630 0x7fa39c0d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51294/0 (socket says 172.21.15.45:51294) 2023-12-19T18:03:21.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 -- 172.21.15.45:0/711288295 learned_addr learned my addr 172.21.15.45:0/711288295 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:21.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa39bfff700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0b4720 0x7fa39c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 -- 172.21.15.45:0/711288295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0b4720 msgr2=0x7fa39c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:21.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0b4720 0x7fa39c0b4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 -- 172.21.15.45:0/711288295 >> v1:172.21.15.73:6789/0 conn(0x7fa39c0b8630 legacy=0x7fa39c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa3a0d7c700 1 -- 172.21.15.45:0/711288295 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c15dda0 con 0x7fa39c0d1630 2023-12-19T18:03:21.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.273+0000 7fa39bfff700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0b4720 0x7fa39c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:21.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a0d7c700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0d1630 0x7fa39c0d1aa0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa394009e50 tx=0x7fa39400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9555822bec93502 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa39affd700 1 -- 172.21.15.45:0/711288295 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400e070 con 0x7fa39c0d1630 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa39affd700 1 -- 172.21.15.45:0/711288295 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39400b9c0 con 0x7fa39c0d1630 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa39affd700 1 -- 172.21.15.45:0/711288295 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39400bd70 con 0x7fa39c0d1630 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 -- 172.21.15.45:0/711288295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0d1630 msgr2=0x7fa39c0d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0d1630 0x7fa39c0d1aa0 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fa394009e50 tx=0x7fa39400b330 comp rx=0 tx=0).stop 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 -- 172.21.15.45:0/711288295 shutdown_connections 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0d1630 0x7fa39c0d1aa0 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 --2- 172.21.15.45:0/711288295 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0b4720 0x7fa39c0b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 -- 172.21.15.45:0/711288295 >> 172.21.15.45:0/711288295 conn(0x7fa39c066320 msgr2=0x7fa39c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 -- 172.21.15.45:0/711288295 shutdown_connections 2023-12-19T18:03:21.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.277+0000 7fa3a157d700 1 -- 172.21.15.45:0/711288295 wait complete. 2023-12-19T18:03:21.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.281+0000 7fa3a157d700 1 Processor -- start 2023-12-19T18:03:21.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.281+0000 7fa3a157d700 1 -- start start 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 0x7fa39c15bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa39c0b8630 0x7fa39c1e31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0d1630 0x7fa39c0c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1e4aa0 con 0x7fa39c0b4720 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1e3a00 con 0x7fa39c0b8630 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39c1e3ce0 con 0x7fa39c0d1630 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 0x7fa39c15bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 0x7fa39c15bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51308/0 (socket says 172.21.15.45:51308) 2023-12-19T18:03:21.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 -- 172.21.15.45:0/3781670645 learned_addr learned my addr 172.21.15.45:0/3781670645 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39b7fe700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa39c0b8630 0x7fa39c1e31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a0d7c700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0d1630 0x7fa39c0c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 -- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0d1630 msgr2=0x7fa39c0c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0d1630 0x7fa39c0c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 -- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa39c0b8630 msgr2=0x7fa39c1e31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa39c0b8630 0x7fa39c1e31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 -- 172.21.15.45:0/3781670645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa394009b30 con 0x7fa39c0b4720 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa39bfff700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 0x7fa39c15bd60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00e760 tx=0x7fa38c00eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c004230 con 0x7fa39c0b4720 2023-12-19T18:03:21.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c0043b0 con 0x7fa39c0b4720 2023-12-19T18:03:21.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c0036c0 con 0x7fa39c0b4720 2023-12-19T18:03:21.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa39c1e3fc0 con 0x7fa39c0b4720 2023-12-19T18:03:21.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.285+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa39c1e4580 con 0x7fa39c0b4720 2023-12-19T18:03:21.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.289+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39c1e4740 con 0x7fa39c0b4720 2023-12-19T18:03:21.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.289+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa38c003820 con 0x7fa39c0b4720 2023-12-19T18:03:21.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.289+0000 7fa398ff9700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa388065ad0 0x7fa388067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.289+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa38c082e00 con 0x7fa39c0b4720 2023-12-19T18:03:21.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.293+0000 7fa39b7fe700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa388065ad0 0x7fa388067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.293+0000 7fa39b7fe700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa388065ad0 0x7fa388067f90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0cdc60 tx=0x7fa390009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:21.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.297+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa38c0505e0 con 0x7fa39c0b4720 2023-12-19T18:03:21.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.489+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa39c04ed30 con 0x7fa39c0b4720 2023-12-19T18:03:21.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.489+0000 7fa398ff9700 1 -- 172.21.15.45:0/3781670645 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v129) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa38c053c00 con 0x7fa39c0b4720 2023-12-19T18:03:21.494 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:03:21.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa388065ad0 msgr2=0x7fa388067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa388065ad0 0x7fa388067f90 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0cdc60 tx=0x7fa390009040 comp rx=0 tx=0).stop 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 msgr2=0x7fa39c15bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 0x7fa39c15bd60 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00e760 tx=0x7fa38c00eb20 comp rx=0 tx=0).stop 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 shutdown_connections 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa388065ad0 0x7fa388067f90 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa39c0d1630 0x7fa39c0c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa39c0b8630 0x7fa39c1e31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 --2- 172.21.15.45:0/3781670645 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa39c0b4720 0x7fa39c15bd60 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 >> 172.21.15.45:0/3781670645 conn(0x7fa39c066320 msgr2=0x7fa39c0d2220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:21.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 shutdown_connections 2023-12-19T18:03:21.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.493+0000 7fa3a157d700 1 -- 172.21.15.45:0/3781670645 wait complete. 2023-12-19T18:03:21.517 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:03:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.693+0000 7f0c12b27700 1 Processor -- start 2023-12-19T18:03:21.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12b27700 1 -- start start 2023-12-19T18:03:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12b27700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0c0c0ad750 0x7f0c0c0c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12b27700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c070570 0x7f0c0c0709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12b27700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0c070ef0 con 0x7f0c0c1617f0 2023-12-19T18:03:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12b27700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0c0adbe0 con 0x7f0c0c0ad750 2023-12-19T18:03:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12b27700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c0adde0 con 0x7f0c0c070570 2023-12-19T18:03:21.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c11b25700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7f0c0c1617f0 0x7f0c0c0cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:44942/0 (socket says 172.21.15.45:44942) 2023-12-19T18:03:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c11b25700 1 -- 172.21.15.45:0/176870894 learned_addr learned my addr 172.21.15.45:0/176870894 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c11324700 1 --2- 172.21.15.45:0/176870894 >> v2:172.21.15.73:3300/0 conn(0x7f0c0c0ad750 0x7f0c0c0c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12326700 1 --2- 172.21.15.45:0/176870894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c070570 0x7f0c0c0709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c10b23700 1 -- 172.21.15.45:0/176870894 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097589722 0 0) 0x7f0c0c070ef0 con 0x7f0c0c1617f0 2023-12-19T18:03:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c10b23700 1 -- 172.21.15.45:0/176870894 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf80035d0 con 0x7f0c0c1617f0 2023-12-19T18:03:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12326700 1 -- 172.21.15.45:0/176870894 >> v2:172.21.15.73:3300/0 conn(0x7f0c0c0ad750 msgr2=0x7f0c0c0c8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12326700 1 --2- 172.21.15.45:0/176870894 >> v2:172.21.15.73:3300/0 conn(0x7f0c0c0ad750 0x7f0c0c0c8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12326700 1 -- 172.21.15.45:0/176870894 >> v1:172.21.15.73:6789/0 conn(0x7f0c0c1617f0 legacy=0x7f0c0c0cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.697+0000 7f0c12326700 1 -- 172.21.15.45:0/176870894 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0c0ae0c0 con 0x7f0c0c070570 2023-12-19T18:03:21.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12326700 1 --2- 172.21.15.45:0/176870894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c070570 0x7f0c0c0709b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009850 tx=0x7f0c04009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93cb2c0830453574 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c10b23700 1 -- 172.21.15.45:0/176870894 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011830 con 0x7f0c0c070570 2023-12-19T18:03:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c10b23700 1 -- 172.21.15.45:0/176870894 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c04011990 con 0x7f0c0c070570 2023-12-19T18:03:21.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c10b23700 1 -- 172.21.15.45:0/176870894 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c04011d40 con 0x7f0c0c070570 2023-12-19T18:03:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 -- 172.21.15.45:0/176870894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c070570 msgr2=0x7f0c0c0709b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 --2- 172.21.15.45:0/176870894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c070570 0x7f0c0c0709b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0c04009850 tx=0x7f0c04009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 -- 172.21.15.45:0/176870894 shutdown_connections 2023-12-19T18:03:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 --2- 172.21.15.45:0/176870894 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c070570 0x7f0c0c0709b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 --2- 172.21.15.45:0/176870894 >> v2:172.21.15.73:3300/0 conn(0x7f0c0c0ad750 0x7f0c0c0c8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 -- 172.21.15.45:0/176870894 >> 172.21.15.45:0/176870894 conn(0x7f0c0c0ce8a0 msgr2=0x7f0c0c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 -- 172.21.15.45:0/176870894 shutdown_connections 2023-12-19T18:03:21.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.701+0000 7f0c12b27700 1 -- 172.21.15.45:0/176870894 wait complete. 2023-12-19T18:03:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.705+0000 7f0c12b27700 1 Processor -- start 2023-12-19T18:03:21.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.705+0000 7f0c12b27700 1 -- start start 2023-12-19T18:03:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 0x7f0c0c163770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c0ad750 0x7f0c0c0be9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c0c1617f0 0x7f0c0c0ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c15e1b0 con 0x7f0c0c070570 2023-12-19T18:03:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c14fc50 con 0x7f0c0c1617f0 2023-12-19T18:03:21.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0c14ed60 con 0x7f0c0c0ad750 2023-12-19T18:03:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 0x7f0c0c163770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 0x7f0c0c163770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51318/0 (socket says 172.21.15.45:51318) 2023-12-19T18:03:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 -- 172.21.15.45:0/149823404 learned_addr learned my addr 172.21.15.45:0/149823404 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11324700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c0ad750 0x7f0c0c0be9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12326700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c0c1617f0 0x7f0c0c0ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 -- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c0ad750 msgr2=0x7f0c0c0be9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c0ad750 0x7f0c0c0be9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 -- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c0c1617f0 msgr2=0x7f0c0c0ae300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c0c1617f0 0x7f0c0c0ae300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 -- 172.21.15.45:0/149823404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c040094b0 con 0x7f0c0c070570 2023-12-19T18:03:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c11b25700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 0x7f0c0c163770 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800caa0 tx=0x7f0c0800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08007480 con 0x7f0c0c070570 2023-12-19T18:03:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c080075e0 con 0x7f0c0c070570 2023-12-19T18:03:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0c14f040 con 0x7f0c0c070570 2023-12-19T18:03:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08007970 con 0x7f0c0c070570 2023-12-19T18:03:21.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.709+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0c14f600 con 0x7f0c0c070570 2023-12-19T18:03:21.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.713+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0c04ed30 con 0x7f0c0c070570 2023-12-19T18:03:21.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.717+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0c0801b3b0 con 0x7f0c0c070570 2023-12-19T18:03:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.717+0000 7f0c027fc700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0bf0065ad0 0x7f0bf0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.717+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0c08082c20 con 0x7f0c0c070570 2023-12-19T18:03:21.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.717+0000 7f0c11324700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0bf0065ad0 0x7f0bf0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:21.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.717+0000 7f0c11324700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0bf0065ad0 0x7f0bf0067f90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c161e10 tx=0x7f0bfc009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:21.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.729+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0c08053e90 con 0x7f0c0c070570 2023-12-19T18:03:21.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.921+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c0c0ca670 con 0x7f0c0c070570 2023-12-19T18:03:21.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.921+0000 7f0c027fc700 1 -- 172.21.15.45:0/149823404 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0c08001b60 con 0x7f0c0c070570 2023-12-19T18:03:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0bf0065ad0 msgr2=0x7f0bf0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0bf0065ad0 0x7f0bf0067f90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f0c0c161e10 tx=0x7f0bfc009240 comp rx=0 tx=0).stop 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 msgr2=0x7f0c0c163770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 0x7f0c0c163770 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f0c0800caa0 tx=0x7f0c0800cad0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 shutdown_connections 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0bf0065ad0 0x7f0bf0067f90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0c0c1617f0 0x7f0c0c0ae300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0c0c0ad750 0x7f0c0c0be9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 --2- 172.21.15.45:0/149823404 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0c0c070570 0x7f0c0c163770 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 >> 172.21.15.45:0/149823404 conn(0x7f0c0c0ce8a0 msgr2=0x7f0c0c160e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 shutdown_connections 2023-12-19T18:03:21.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:21.925+0000 7f0c12b27700 1 -- 172.21.15.45:0/149823404 wait complete. 2023-12-19T18:03:21.932 INFO:teuthology.orchestra.run.smithi045.stderr:listed 0 entries 2023-12-19T18:03:21.952 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T18:03:21.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:21.952 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:21.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[58775]: fuse finished with error 0 and tester_r 0 2023-12-19T18:03:21.987 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:03:28.089 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:03:28.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:28.090 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:03:28.111 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json flush journal 2023-12-19T18:03:28.391 INFO:teuthology.orchestra.run.smithi045.stdout:{"message":"","return_code":0} 2023-12-19T18:03:28.391 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2023-12-19T18:03:28.391 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:03:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.569+0000 7fb7df59e700 1 Processor -- start 2023-12-19T18:03:28.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.569+0000 7fb7df59e700 1 -- start start 2023-12-19T18:03:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7df59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e0161c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7df59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0071580 con 0x7fb7e00ce070 2023-12-19T18:03:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7df59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7e0158040 con 0x7fb7e00cd580 2023-12-19T18:03:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7df59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e006c900 con 0x7fb7e00adca0 2023-12-19T18:03:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ded9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fb7e00ce070 0x7fb7e0164190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:60386/0 (socket says 172.21.15.45:60386) 2023-12-19T18:03:28.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ded9d700 1 -- 172.21.15.45:0/1057464489 learned_addr learned my addr 172.21.15.45:0/1057464489 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ddd9b700 1 --2- 172.21.15.45:0/1057464489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e0161c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7dd59a700 1 -- 172.21.15.45:0/1057464489 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 610827200 0 0) 0x7fb7e0071580 con 0x7fb7e00ce070 2023-12-19T18:03:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7dd59a700 1 -- 172.21.15.45:0/1057464489 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c80035d0 con 0x7fb7e00ce070 2023-12-19T18:03:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/1057464489 >> v1:172.21.15.73:6789/0 conn(0x7fb7e00cd580 legacy=0x7fb7e00cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/1057464489 >> v1:172.21.15.45:6789/0 conn(0x7fb7e00ce070 legacy=0x7fb7e0164190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/1057464489 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e015b250 con 0x7fb7e00adca0 2023-12-19T18:03:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7ddd9b700 1 --2- 172.21.15.45:0/1057464489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e0161c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009880 tx=0x7fb7d4009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50cb8b778335d084 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.573+0000 7fb7dd59a700 1 -- 172.21.15.45:0/1057464489 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400f8a0 con 0x7fb7e00adca0 2023-12-19T18:03:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7dd59a700 1 -- 172.21.15.45:0/1057464489 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d400fa00 con 0x7fb7e00adca0 2023-12-19T18:03:28.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7dd59a700 1 -- 172.21.15.45:0/1057464489 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d400fd90 con 0x7fb7e00adca0 2023-12-19T18:03:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 -- 172.21.15.45:0/1057464489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 msgr2=0x7fb7e0161c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 --2- 172.21.15.45:0/1057464489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e0161c40 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009880 tx=0x7fb7d4009b90 comp rx=0 tx=0).stop 2023-12-19T18:03:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 -- 172.21.15.45:0/1057464489 shutdown_connections 2023-12-19T18:03:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 --2- 172.21.15.45:0/1057464489 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e0161c40 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 -- 172.21.15.45:0/1057464489 >> 172.21.15.45:0/1057464489 conn(0x7fb7e00ce8a0 msgr2=0x7fb7e00cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 -- 172.21.15.45:0/1057464489 shutdown_connections 2023-12-19T18:03:28.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 -- 172.21.15.45:0/1057464489 wait complete. 2023-12-19T18:03:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.577+0000 7fb7df59e700 1 Processor -- start 2023-12-19T18:03:28.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 -- start start 2023-12-19T18:03:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e00b1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 0x7fb7e0159820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7e00ce070 0x7fb7e0159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0141830 con 0x7fb7e00cd580 2023-12-19T18:03:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0140bb0 con 0x7fb7e00ce070 2023-12-19T18:03:28.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7df59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e0140e90 con 0x7fb7e00adca0 2023-12-19T18:03:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 0x7fb7e0159820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 0x7fb7e0159820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:51322/0 (socket says 172.21.15.45:51322) 2023-12-19T18:03:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/2930451781 learned_addr learned my addr 172.21.15.45:0/2930451781 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ded9d700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7e00ce070 0x7fb7e0159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7de59c700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e00b1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 msgr2=0x7fb7e00b1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e00b1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7e00ce070 msgr2=0x7fb7e0159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7e00ce070 0x7fb7e0159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 -- 172.21.15.45:0/2930451781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d40094b0 con 0x7fb7e00cd580 2023-12-19T18:03:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ddd9b700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 0x7fb7e0159820 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4000c00 tx=0x7fb7d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.581+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40038c0 con 0x7fb7e00cd580 2023-12-19T18:03:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.585+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4003a40 con 0x7fb7e00cd580 2023-12-19T18:03:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.585+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e0141170 con 0x7fb7e00cd580 2023-12-19T18:03:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.585+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4003df0 con 0x7fb7e00cd580 2023-12-19T18:03:28.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.585+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e00b20e0 con 0x7fb7e00cd580 2023-12-19T18:03:28.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.585+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e0141970 con 0x7fb7e00cd580 2023-12-19T18:03:28.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.585+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb7d402c430 con 0x7fb7e00cd580 2023-12-19T18:03:28.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.589+0000 7fb7ceffd700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb7c0065ad0 0x7fb7c0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.589+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb7d4084700 con 0x7fb7e00cd580 2023-12-19T18:03:28.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.589+0000 7fb7de59c700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb7c0065ad0 0x7fb7c0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.589+0000 7fb7de59c700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb7c0065ad0 0x7fb7c0067f90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0000f60 tx=0x7fb7d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.593+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb7e0141970 con 0x7fb7e00cd580 2023-12-19T18:03:28.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.813+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fb7e0141970 con 0x7fb7e00cd580 2023-12-19T18:03:28.819 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:03:28.813+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:03:28.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.829+0000 7fb7ceffd700 1 -- 172.21.15.45:0/2930451781 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v100) v1 ==== 161+0+0 (secure 0 0 0) 0x7fb7e0141970 con 0x7fb7e00cd580 2023-12-19T18:03:28.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb7c0065ad0 msgr2=0x7fb7c0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb7c0065ad0 0x7fb7c0067f90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0000f60 tx=0x7fb7d0009040 comp rx=0 tx=0).stop 2023-12-19T18:03:28.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 msgr2=0x7fb7e0159820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 0x7fb7e0159820 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4000c00 tx=0x7fb7d4004770 comp rx=0 tx=0).stop 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 shutdown_connections 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb7c0065ad0 0x7fb7c0067f90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7e00ce070 0x7fb7e0159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb7e00cd580 0x7fb7e0159820 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 --2- 172.21.15.45:0/2930451781 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb7e00adca0 0x7fb7e00b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 >> 172.21.15.45:0/2930451781 conn(0x7fb7e00ce8a0 msgr2=0x7fb7e00cd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 shutdown_connections 2023-12-19T18:03:28.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.833+0000 7fb7df59e700 1 -- 172.21.15.45:0/2930451781 wait complete. 2023-12-19T18:03:28.842 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:03:28.862 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.01000000 2023-12-19T18:03:28.927 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T18:03:28.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 Processor -- start 2023-12-19T18:03:28.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 -- start start 2023-12-19T18:03:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b6f4f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b700a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b700ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b6e99250 con 0x5569b7022850 2023-12-19T18:03:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b6e98ef0 con 0x5569b6f7b050 2023-12-19T18:03:28.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1e1831140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569b6e6f240 con 0x5569b6f7b430 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1deb65700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b700a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1deb65700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b700a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38170/0 (socket says 172.21.15.45:38170) 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1deb65700 1 -- 172.21.15.45:0/2481959367 learned_addr learned my addr 172.21.15.45:0/2481959367 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1df366700 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b6f4f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.925+0000 7fb1dfb67700 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b700ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1deb65700 1 -- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 msgr2=0x5569b700ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1deb65700 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b700ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1deb65700 1 -- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 msgr2=0x5569b6f4f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1deb65700 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b6f4f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1deb65700 1 -- 172.21.15.45:0/2481959367 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b6e87470 con 0x5569b7022850 2023-12-19T18:03:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1dfb67700 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b700ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:28.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1deb65700 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b700a6e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800a940 tx=0x7fb1c800ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6fd8f4925a1d73c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1ddb63700 1 -- 172.21.15.45:0/2481959367 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800f050 con 0x5569b7022850 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1ddb63700 1 -- 172.21.15.45:0/2481959367 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8010040 con 0x5569b7022850 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1ddb63700 1 -- 172.21.15.45:0/2481959367 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8008d10 con 0x5569b7022850 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 -- 172.21.15.45:0/2481959367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 msgr2=0x5569b700a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b700a6e0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7fb1c800a940 tx=0x7fb1c800ac50 comp rx=0 tx=0).stop 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 -- 172.21.15.45:0/2481959367 shutdown_connections 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b700ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b700a6e0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 --2- 172.21.15.45:0/2481959367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b6f4f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 -- 172.21.15.45:0/2481959367 >> 172.21.15.45:0/2481959367 conn(0x5569b6f4eb90 msgr2=0x5569b7023ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 -- 172.21.15.45:0/2481959367 shutdown_connections 2023-12-19T18:03:28.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 -- 172.21.15.45:0/2481959367 wait complete. 2023-12-19T18:03:28.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 Processor -- start 2023-12-19T18:03:28.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.929+0000 7fb1e1831140 1 -- start start 2023-12-19T18:03:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b7009cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b7007640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b6f8ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b700a200 con 0x5569b7022850 2023-12-19T18:03:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b6f8f820 con 0x5569b6f7b050 2023-12-19T18:03:28.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5569b6f8fac0 con 0x5569b6f7b430 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b6f8ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b6f8ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38192/0 (socket says 172.21.15.45:38192) 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 -- 172.21.15.45:0/3709873628 learned_addr learned my addr 172.21.15.45:0/3709873628 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1df366700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b7009cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1deb65700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b7007640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 -- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 msgr2=0x5569b7007640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5569b6f7b430 0x5569b7007640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 -- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 msgr2=0x5569b7009cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5569b6f7b050 0x5569b7009cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 -- 172.21.15.45:0/3709873628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c800a5c0 con 0x5569b7022850 2023-12-19T18:03:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dfb67700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b6f8ef10 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x5569b6f33dc0 tx=0x7fb1d8009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dcb61700 1 -- 172.21.15.45:0/3709873628 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8010d70 con 0x5569b7022850 2023-12-19T18:03:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dcb61700 1 -- 172.21.15.45:0/3709873628 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d800e470 con 0x5569b7022850 2023-12-19T18:03:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1dcb61700 1 -- 172.21.15.45:0/3709873628 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d800e820 con 0x5569b7022850 2023-12-19T18:03:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5569b6e7a8b0 con 0x5569b7022850 2023-12-19T18:03:28.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.933+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5569b6e7a310 con 0x5569b7022850 2023-12-19T18:03:28.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1dcb61700 1 -- 172.21.15.45:0/3709873628 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb1d800e980 con 0x5569b7022850 2023-12-19T18:03:28.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1dcb61700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1c0064400 0x7fb1c00668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1dcb61700 1 -- 172.21.15.45:0/3709873628 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fb1d8004040 con 0x5569b7022850 2023-12-19T18:03:28.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1df366700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1c0064400 0x7fb1c00668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1e1831140 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5569b70b73c0 0x5569b6f921c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:28.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:1 17.5 17:a40620de:::10000000000.01000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e130) v8 -- 0x5569b6f90740 con 0x5569b70b73c0 2023-12-19T18:03:28.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.937+0000 7fb1deb65700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5569b70b73c0 0x5569b6f921c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:28.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1df366700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1c0064400 0x7fb1c00668c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x5569b6f50f90 tx=0x7fb1d0008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1deb65700 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5569b70b73c0 0x5569b6f921c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:28.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1deb65700 1 -- 172.21.15.45:0/3709873628 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(1 10000000000.01000000 [omap-get-keys out=560b] v0'0 uv2 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x7fb1c8027240 con 0x5569b70b73c0 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:10_head 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:11_head 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:12_head 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:15_head 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:19_head 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:1_head 2023-12-19T18:03:28.947 INFO:teuthology.orchestra.run.smithi045.stdout:20_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:21_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:27_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:28_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:2_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:31_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:34_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:36_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:38_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:39_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:3_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:42_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:43_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:46_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:4_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:50_head 2023-12-19T18:03:28.948 INFO:teuthology.orchestra.run.smithi045.stdout:52_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:53_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:55_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:59_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:61_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:63_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:64_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:65_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:66_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:69_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:70_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:73_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:74_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:75_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:77_head 2023-12-19T18:03:28.949 INFO:teuthology.orchestra.run.smithi045.stdout:80_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:83_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:84_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:85_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:86_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:87_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:88_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:8_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:90_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:92_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:95_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:96_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:97_head 2023-12-19T18:03:28.950 INFO:teuthology.orchestra.run.smithi045.stdout:9_head 2023-12-19T18:03:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5569b70b73c0 msgr2=0x5569b6f921c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x5569b70b73c0 0x5569b6f921c0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1c0064400 msgr2=0x7fb1c00668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb1c0064400 0x7fb1c00668c0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x5569b6f50f90 tx=0x7fb1d0008000 comp rx=0 tx=0).stop 2023-12-19T18:03:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 msgr2=0x5569b6f8ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:28.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 --2- 172.21.15.45:0/3709873628 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5569b7022850 0x5569b6f8ef10 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x5569b6f33dc0 tx=0x7fb1d8009f80 comp rx=0 tx=0).stop 2023-12-19T18:03:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1dfb67700 1 -- 172.21.15.45:0/3709873628 reap_dead start 2023-12-19T18:03:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 shutdown_connections 2023-12-19T18:03:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 >> 172.21.15.45:0/3709873628 conn(0x5569b6f4eb90 msgr2=0x5569b700a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 shutdown_connections 2023-12-19T18:03:28.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:28.941+0000 7fb1e1831140 1 -- 172.21.15.45:0/3709873628 wait complete. 2023-12-19T18:03:28.954 INFO:tasks.cephfs.test_data_scan:victim_key=21_head 2023-12-19T18:03:28.954 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000000.01000000 21_head 2023-12-19T18:03:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.013+0000 7f1525b2d140 1 Processor -- start 2023-12-19T18:03:29.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.013+0000 7f1525b2d140 1 -- start start 2023-12-19T18:03:29.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b56abd0 0x55b70b566910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 0x55b70b55e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b60f240 0x55b70b6116b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70b4c6ce0 con 0x55b70b60ee60 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70b483250 con 0x55b70b60f240 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b70b482ef0 con 0x55b70b56abd0 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 0x55b70b55e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 0x55b70b55e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38202/0 (socket says 172.21.15.45:38202) 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 -- 172.21.15.45:0/4180052221 learned_addr learned my addr 172.21.15.45:0/4180052221 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1523662700 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b56abd0 0x55b70b566910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1523e63700 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b60f240 0x55b70b6116b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 -- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b56abd0 msgr2=0x55b70b566910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b56abd0 0x55b70b566910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 -- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b60f240 msgr2=0x55b70b6116b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b60f240 0x55b70b6116b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 -- 172.21.15.45:0/4180052221 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1514005d20 con 0x55b70b60ee60 2023-12-19T18:03:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1522e61700 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 0x55b70b55e870 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f1518001d40 tx=0x7f151800b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20076b988e34c7bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1521e5f700 1 -- 172.21.15.45:0/4180052221 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1518014070 con 0x55b70b60ee60 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1521e5f700 1 -- 172.21.15.45:0/4180052221 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1518008030 con 0x55b70b60ee60 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1521e5f700 1 -- 172.21.15.45:0/4180052221 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151800bc00 con 0x55b70b60ee60 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- 172.21.15.45:0/4180052221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 msgr2=0x55b70b55e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 0x55b70b55e870 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f1518001d40 tx=0x7f151800b4c0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- 172.21.15.45:0/4180052221 shutdown_connections 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b60f240 0x55b70b6116b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60ee60 0x55b70b55e870 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4180052221 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b56abd0 0x55b70b566910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- 172.21.15.45:0/4180052221 >> 172.21.15.45:0/4180052221 conn(0x55b70b537fb0 msgr2=0x55b70b5346f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- 172.21.15.45:0/4180052221 shutdown_connections 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- 172.21.15.45:0/4180052221 wait complete. 2023-12-19T18:03:29.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 Processor -- start 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.017+0000 7f1525b2d140 1 -- start start 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b56abd0 0x55b70b6a72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b60ee60 0x55b70b60cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60f240 0x55b70b6a4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70b459240 con 0x55b70b60f240 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70b561a00 con 0x55b70b56abd0 2023-12-19T18:03:29.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b70b561ca0 con 0x55b70b60ee60 2023-12-19T18:03:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60f240 0x55b70b6a4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60f240 0x55b70b6a4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38214/0 (socket says 172.21.15.45:38214) 2023-12-19T18:03:29.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 -- 172.21.15.45:0/4190883023 learned_addr learned my addr 172.21.15.45:0/4190883023 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523662700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b56abd0 0x55b70b6a72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1522e61700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b60ee60 0x55b70b60cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 -- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b60ee60 msgr2=0x55b70b60cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55b70b60ee60 0x55b70b60cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 -- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b56abd0 msgr2=0x55b70b6a72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b70b56abd0 0x55b70b6a72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 -- 172.21.15.45:0/4190883023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f151800a040 con 0x55b70b60f240 2023-12-19T18:03:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1523e63700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60f240 0x55b70b6a4400 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f151c00d440 tx=0x7f151c00d750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1520e5d700 1 -- 172.21.15.45:0/4190883023 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c00dcb0 con 0x55b70b60f240 2023-12-19T18:03:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1520e5d700 1 -- 172.21.15.45:0/4190883023 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f151c00de30 con 0x55b70b60f240 2023-12-19T18:03:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b70b4648b0 con 0x55b70b60f240 2023-12-19T18:03:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1520e5d700 1 -- 172.21.15.45:0/4190883023 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c006310 con 0x55b70b60f240 2023-12-19T18:03:29.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.021+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b70b464310 con 0x55b70b60f240 2023-12-19T18:03:29.031 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.025+0000 7f1520e5d700 1 -- 172.21.15.45:0/4190883023 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f151c004520 con 0x55b70b60f240 2023-12-19T18:03:29.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.025+0000 7f1520e5d700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1510064400 0x7f15100668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1520e5d700 1 -- 172.21.15.45:0/4190883023 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f151c0815a0 con 0x55b70b60f240 2023-12-19T18:03:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1523662700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1510064400 0x7f15100668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b70b6a5de0 0x55b70b6a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:1 17.5 17:a40620de:::10000000000.01000000:head [omap-rm-keys in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130) v8 -- 0x55b70b562bc0 con 0x55b70b6a5de0 2023-12-19T18:03:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1523662700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1510064400 0x7f15100668c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1514000c00 tx=0x7f151400f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1522e61700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b70b6a5de0 0x55b70b6a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.029+0000 7f1522e61700 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b70b6a5de0 0x55b70b6a61f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1522e61700 1 -- 172.21.15.45:0/4190883023 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(1 10000000000.01000000 [omap-rm-keys] v130'3 uv3 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1518016070 con 0x55b70b6a5de0 2023-12-19T18:03:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b70b6a5de0 msgr2=0x55b70b6a61f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55b70b6a5de0 0x55b70b6a61f0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1510064400 msgr2=0x7f15100668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1510064400 0x7f15100668c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1514000c00 tx=0x7f151400f000 comp rx=0 tx=0).stop 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60f240 msgr2=0x55b70b6a4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 --2- 172.21.15.45:0/4190883023 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55b70b60f240 0x55b70b6a4400 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f151c00d440 tx=0x7f151c00d750 comp rx=0 tx=0).stop 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1523e63700 1 -- 172.21.15.45:0/4190883023 reap_dead start 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 shutdown_connections 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 >> 172.21.15.45:0/4190883023 conn(0x55b70b537fb0 msgr2=0x55b70b534530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 shutdown_connections 2023-12-19T18:03:29.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.033+0000 7f1525b2d140 1 -- 172.21.15.45:0/4190883023 wait complete. 2023-12-19T18:03:29.045 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-12-19T18:03:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 Processor -- start 2023-12-19T18:03:29.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 -- start start 2023-12-19T18:03:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8601579a0 0x7fa86006d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa86015b190 0x7fa8600ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa86006ded0 con 0x7fa8600cd6b0 2023-12-19T18:03:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa86006e1b0 con 0x7fa86015b190 2023-12-19T18:03:29.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.221+0000 7fa85ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86015a6b0 con 0x7fa8601579a0 2023-12-19T18:03:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85effd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8601579a0 0x7fa86006d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85e7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa86015b190 0x7fa8600ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85f7fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fa8600cd6b0 0x7fa8600ad540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:39564/0 (socket says 172.21.15.45:39564) 2023-12-19T18:03:29.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85f7fe700 1 -- 172.21.15.45:0/890557898 learned_addr learned my addr 172.21.15.45:0/890557898 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85dffb700 1 -- 172.21.15.45:0/890557898 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542038031 0 0) 0x7fa86006ded0 con 0x7fa8600cd6b0 2023-12-19T18:03:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85dffb700 1 -- 172.21.15.45:0/890557898 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8480035d0 con 0x7fa8600cd6b0 2023-12-19T18:03:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85effd700 1 -- 172.21.15.45:0/890557898 >> v2:172.21.15.73:3300/0 conn(0x7fa86015b190 msgr2=0x7fa8600ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85effd700 1 --2- 172.21.15.45:0/890557898 >> v2:172.21.15.73:3300/0 conn(0x7fa86015b190 0x7fa8600ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85effd700 1 -- 172.21.15.45:0/890557898 >> v1:172.21.15.73:6789/0 conn(0x7fa8600cd6b0 legacy=0x7fa8600ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85effd700 1 -- 172.21.15.45:0/890557898 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86015a990 con 0x7fa8601579a0 2023-12-19T18:03:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85effd700 1 --2- 172.21.15.45:0/890557898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8601579a0 0x7fa86006d6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa850009850 tx=0x7fa850009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3f61328d0f405d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85dffb700 1 -- 172.21.15.45:0/890557898 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850011830 con 0x7fa8601579a0 2023-12-19T18:03:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85dffb700 1 -- 172.21.15.45:0/890557898 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa850011990 con 0x7fa8601579a0 2023-12-19T18:03:29.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.225+0000 7fa85dffb700 1 -- 172.21.15.45:0/890557898 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa850011d40 con 0x7fa8601579a0 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 -- 172.21.15.45:0/890557898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8601579a0 msgr2=0x7fa86006d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 --2- 172.21.15.45:0/890557898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8601579a0 0x7fa86006d6a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa850009850 tx=0x7fa850009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 -- 172.21.15.45:0/890557898 shutdown_connections 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 --2- 172.21.15.45:0/890557898 >> v2:172.21.15.73:3300/0 conn(0x7fa86015b190 0x7fa8600ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 --2- 172.21.15.45:0/890557898 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8601579a0 0x7fa86006d6a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 -- 172.21.15.45:0/890557898 >> 172.21.15.45:0/890557898 conn(0x7fa8600ce8c0 msgr2=0x7fa8600ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 -- 172.21.15.45:0/890557898 shutdown_connections 2023-12-19T18:03:29.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 -- 172.21.15.45:0/890557898 wait complete. 2023-12-19T18:03:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 Processor -- start 2023-12-19T18:03:29.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.229+0000 7fa85ffff700 1 -- start start 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8600cd6b0 0x7fa860150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 0x7fa860155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa86015b190 0x7fa8600b1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860137370 con 0x7fa8601579a0 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa860136760 con 0x7fa86015b190 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa860136a40 con 0x7fa8600cd6b0 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 0x7fa860155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 0x7fa860155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38222/0 (socket says 172.21.15.45:38222) 2023-12-19T18:03:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 -- 172.21.15.45:0/4167000675 learned_addr learned my addr 172.21.15.45:0/4167000675 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85f7fe700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa86015b190 0x7fa8600b1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85effd700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8600cd6b0 0x7fa860150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 -- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8600cd6b0 msgr2=0x7fa860150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8600cd6b0 0x7fa860150de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 -- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa86015b190 msgr2=0x7fa8600b1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa86015b190 0x7fa8600b1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 -- 172.21.15.45:0/4167000675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8500094b0 con 0x7fa8601579a0 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85e7fc700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 0x7fa860155300 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa85400e840 tx=0x7fa85400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540095a0 con 0x7fa8601579a0 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa85400c690 con 0x7fa8601579a0 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa85400ca00 con 0x7fa8601579a0 2023-12-19T18:03:29.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860136d20 con 0x7fa8601579a0 2023-12-19T18:03:29.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.233+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8601376c0 con 0x7fa8601579a0 2023-12-19T18:03:29.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.237+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa86004ed30 con 0x7fa8601579a0 2023-12-19T18:03:29.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.237+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa85400cb60 con 0x7fa8601579a0 2023-12-19T18:03:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.241+0000 7fa847fff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa84c065ad0 0x7fa84c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.241+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fa8540832a0 con 0x7fa8601579a0 2023-12-19T18:03:29.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.241+0000 7fa85effd700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa84c065ad0 0x7fa84c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:29.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.241+0000 7fa85effd700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa84c065ad0 0x7fa84c067f90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa8500090b0 tx=0x7fa850008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:29.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.245+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa854050ab0 con 0x7fa8601579a0 2023-12-19T18:03:29.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.457+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa8600cf660 con 0x7fa8601579a0 2023-12-19T18:03:29.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.837+0000 7fa847fff700 1 -- 172.21.15.45:0/4167000675 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v101) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa8540540d0 con 0x7fa8601579a0 2023-12-19T18:03:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa84c065ad0 msgr2=0x7fa84c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa84c065ad0 0x7fa84c067f90 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa8500090b0 tx=0x7fa850008030 comp rx=0 tx=0).stop 2023-12-19T18:03:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 msgr2=0x7fa860155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 0x7fa860155300 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa85400e840 tx=0x7fa85400ec00 comp rx=0 tx=0).stop 2023-12-19T18:03:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 shutdown_connections 2023-12-19T18:03:29.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa84c065ad0 0x7fa84c067f90 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa86015b190 0x7fa8600b1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa8601579a0 0x7fa860155300 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 --2- 172.21.15.45:0/4167000675 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa8600cd6b0 0x7fa860150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:29.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.841+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 >> 172.21.15.45:0/4167000675 conn(0x7fa8600ce8c0 msgr2=0x7fa8600cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:29.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.845+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 shutdown_connections 2023-12-19T18:03:29.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:29.845+0000 7fa85ffff700 1 -- 172.21.15.45:0/4167000675 wait complete. 2023-12-19T18:03:29.851 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-12-19T18:03:29.875 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:30.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.049+0000 7fed80c64700 1 Processor -- start 2023-12-19T18:03:30.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.049+0000 7fed80c64700 1 -- start start 2023-12-19T18:03:30.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed80c64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 0x7fed7c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:30.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed80c64700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed7c0ce150 0x7fed7c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:30.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed80c64700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed7c15d360 con 0x7fed7c0b88e0 2023-12-19T18:03:30.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed80c64700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed7c0d2950 con 0x7fed7c0ce150 2023-12-19T18:03:30.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed80c64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0d18b0 con 0x7fed7c15cf80 2023-12-19T18:03:30.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 0x7fed7c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:30.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7bfff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fed7c0ce150 0x7fed7c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:30.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 0x7fed7c0d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:54620/0 (socket says 172.21.15.45:54620) 2023-12-19T18:03:30.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 -- 172.21.15.45:0/466019831 learned_addr learned my addr 172.21.15.45:0/466019831 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:30.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7affd700 1 --1- 172.21.15.45:0/466019831 >> v1:172.21.15.73:6789/0 conn(0x7fed7c0b88e0 0x7fed7c0cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:39572/0 (socket says 172.21.15.45:39572) 2023-12-19T18:03:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7a7fc700 1 -- 172.21.15.45:0/466019831 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1358841498 0 0) 0x7fed7c15d360 con 0x7fed7c0b88e0 2023-12-19T18:03:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7a7fc700 1 -- 172.21.15.45:0/466019831 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed640035d0 con 0x7fed7c0b88e0 2023-12-19T18:03:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 -- 172.21.15.45:0/466019831 >> v2:172.21.15.73:3300/0 conn(0x7fed7c0ce150 msgr2=0x7fed7c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 --2- 172.21.15.45:0/466019831 >> v2:172.21.15.73:3300/0 conn(0x7fed7c0ce150 0x7fed7c0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 -- 172.21.15.45:0/466019831 >> v1:172.21.15.73:6789/0 conn(0x7fed7c0b88e0 legacy=0x7fed7c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:30.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 -- 172.21.15.45:0/466019831 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed7c0d1b90 con 0x7fed7c15cf80 2023-12-19T18:03:30.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7b7fe700 1 --2- 172.21.15.45:0/466019831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 0x7fed7c0d1040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009910 tx=0x7fed6c009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2080df57590641 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:30.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7a7fc700 1 -- 172.21.15.45:0/466019831 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011830 con 0x7fed7c15cf80 2023-12-19T18:03:30.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7a7fc700 1 -- 172.21.15.45:0/466019831 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6c011990 con 0x7fed7c15cf80 2023-12-19T18:03:30.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.053+0000 7fed7a7fc700 1 -- 172.21.15.45:0/466019831 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c011d40 con 0x7fed7c15cf80 2023-12-19T18:03:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 -- 172.21.15.45:0/466019831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 msgr2=0x7fed7c0d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 --2- 172.21.15.45:0/466019831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 0x7fed7c0d1040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fed6c009910 tx=0x7fed6c009c20 comp rx=0 tx=0).stop 2023-12-19T18:03:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 -- 172.21.15.45:0/466019831 shutdown_connections 2023-12-19T18:03:30.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 --2- 172.21.15.45:0/466019831 >> v2:172.21.15.73:3300/0 conn(0x7fed7c0ce150 0x7fed7c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 --2- 172.21.15.45:0/466019831 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c15cf80 0x7fed7c0d1040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 -- 172.21.15.45:0/466019831 >> 172.21.15.45:0/466019831 conn(0x7fed7c066380 msgr2=0x7fed7c0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 -- 172.21.15.45:0/466019831 shutdown_connections 2023-12-19T18:03:30.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.057+0000 7fed80c64700 1 -- 172.21.15.45:0/466019831 wait complete. 2023-12-19T18:03:30.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 Processor -- start 2023-12-19T18:03:30.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 -- start start 2023-12-19T18:03:30.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed7c0b88e0 0x7fed7c14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:30.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c0ce150 0x7fed7c0ccae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:30.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 0x7fed7c0b3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:30.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c14e690 con 0x7fed7c15cf80 2023-12-19T18:03:30.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0a9690 con 0x7fed7c0b88e0 2023-12-19T18:03:30.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed80c64700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c0aa4f0 con 0x7fed7c0ce150 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 0x7fed7c0b3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 0x7fed7c0b3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38224/0 (socket says 172.21.15.45:38224) 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 -- 172.21.15.45:0/3746398094 learned_addr learned my addr 172.21.15.45:0/3746398094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7affd700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c0ce150 0x7fed7c0ccae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7b7fe700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed7c0b88e0 0x7fed7c14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 -- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c0ce150 msgr2=0x7fed7c0ccae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c0ce150 0x7fed7c0ccae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 -- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed7c0b88e0 msgr2=0x7fed7c14e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:30.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed7c0b88e0 0x7fed7c14e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.061+0000 7fed7bfff700 1 -- 172.21.15.45:0/3746398094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009570 con 0x7fed7c15cf80 2023-12-19T18:03:30.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed7bfff700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 0x7fed7c0b3a90 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fed7400efc0 tx=0x7fed7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:30.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74009ea0 con 0x7fed7c15cf80 2023-12-19T18:03:30.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7c0cd020 con 0x7fed7c15cf80 2023-12-19T18:03:30.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7400f040 con 0x7fed7c15cf80 2023-12-19T18:03:30.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7400ced0 con 0x7fed7c15cf80 2023-12-19T18:03:30.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7c0a9bc0 con 0x7fed7c15cf80 2023-12-19T18:03:30.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.065+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed7c0aa6a0 con 0x7fed7c15cf80 2023-12-19T18:03:30.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.069+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fed74014480 con 0x7fed7c15cf80 2023-12-19T18:03:30.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.069+0000 7fed63fff700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed68065ad0 0x7fed68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:30.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.069+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fed74083ea0 con 0x7fed7c15cf80 2023-12-19T18:03:30.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.069+0000 7fed7b7fe700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed68065ad0 0x7fed68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:30.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.073+0000 7fed7b7fe700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed68065ad0 0x7fed68067f90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fed6c000c00 tx=0x7fed6c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:30.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.077+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fed7c0aa6a0 con 0x7fed7c15cf80 2023-12-19T18:03:30.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.285+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed7c0679d0 con 0x7fed7c15cf80 2023-12-19T18:03:30.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.285+0000 7fed63fff700 1 -- 172.21.15.45:0/3746398094 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4714 (secure 0 0 0) 0x7fed740515a0 con 0x7fed7c15cf80 2023-12-19T18:03:30.292 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:30.293 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":102,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:29.841193+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57464":{"gid":57464,"name":"b","rank":0,"incarnation":102,"state":"up:replay","state_seq":1,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed68065ad0 msgr2=0x7fed68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed68065ad0 0x7fed68067f90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fed6c000c00 tx=0x7fed6c008030 comp rx=0 tx=0).stop 2023-12-19T18:03:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 msgr2=0x7fed7c0b3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 0x7fed7c0b3a90 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fed7400efc0 tx=0x7fed7400c3a0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 shutdown_connections 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fed68065ad0 0x7fed68067f90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fed7c15cf80 0x7fed7c0b3a90 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fed7c0ce150 0x7fed7c0ccae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 --2- 172.21.15.45:0/3746398094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fed7c0b88e0 0x7fed7c14e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 >> 172.21.15.45:0/3746398094 conn(0x7fed7c066380 msgr2=0x7fed7c0b6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 shutdown_connections 2023-12-19T18:03:30.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:30.289+0000 7fed80c64700 1 -- 172.21.15.45:0/3746398094 wait complete. 2023-12-19T18:03:30.298 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 102 2023-12-19T18:03:30.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:29.841193+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 130, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57464': {'gid': 57464, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/47731566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 47731566}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 47731566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:30.727 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_57464:up:replay 2023-12-19T18:03:31.728 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:31.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.917+0000 7f927d970700 1 Processor -- start 2023-12-19T18:03:31.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.917+0000 7f927d970700 1 -- start start 2023-12-19T18:03:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.917+0000 7f927d970700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f92780cb2e0 0x7f92780b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f927d970700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92780b5fb0 con 0x7f92780b1d00 2023-12-19T18:03:31.924 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f927d970700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927806a920 con 0x7f92780b3420 2023-12-19T18:03:31.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f927d970700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92780cba50 con 0x7f92780cb2e0 2023-12-19T18:03:31.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9276ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f92780b1d00 0x7f927815f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59290/0 (socket says 172.21.15.45:59290) 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9276ffd700 1 -- 172.21.15.45:0/3166601841 learned_addr learned my addr 172.21.15.45:0/3166601841 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f926ffff700 1 --2- 172.21.15.45:0/3166601841 >> v2:172.21.15.73:3300/0 conn(0x7f92780cb2e0 0x7f92780b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2651577055 0 0) 0x7f92780b5fb0 con 0x7f92780b1d00 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92580035d0 con 0x7f92780b1d00 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 35348063 0 0) 0x7f927806a920 con 0x7f92780b3420 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92780b5fb0 con 0x7f92780b3420 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1356720326 0 0) 0x7f92580035d0 con 0x7f92780b1d00 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 >> v2:172.21.15.73:3300/0 conn(0x7f92780cb2e0 msgr2=0x7f92780b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 --2- 172.21.15.45:0/3166601841 >> v2:172.21.15.73:3300/0 conn(0x7f92780cb2e0 0x7f92780b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 >> v1:172.21.15.73:6789/0 conn(0x7f92780b3420 legacy=0x7f927806adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:31.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780b2620 con 0x7f92780b1d00 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f9268001670 con 0x7f92780b1d00 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 >> v1:172.21.15.45:6789/0 conn(0x7f92780b1d00 legacy=0x7f927815f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9258003c20 0x7f9258004020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258004870 0x7f9258004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9258005230 0x7f925800ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780cba50 con 0x7f9258005230 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925800c130 con 0x7f9258004870 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f925800c2f0 con 0x7f9258003c20 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9258005230 0x7f925800ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f926ffff700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258004870 0x7f9258004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9276ffd700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9258003c20 0x7f9258004020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 -- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9258003c20 msgr2=0x7f9258004020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:31.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9258003c20 0x7f9258004020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 -- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258004870 msgr2=0x7f9258004cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258004870 0x7f9258004cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 -- 172.21.15.45:0/3166601841 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580035d0 con 0x7f9258005230 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9276ffd700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f9258003c20 0x7f9258004020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 -- 172.21.15.45:0/3166601841 reap_dead start 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.921+0000 7f9277fff700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9258005230 0x7f925800ba30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f927000c2f0 tx=0x7f92580058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84cfaa3f2827c6fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270001f30 con 0x7f9258005230 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270003a20 con 0x7f9258005230 2023-12-19T18:03:31.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f92767fc700 1 -- 172.21.15.45:0/3166601841 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9270003dd0 con 0x7f9258005230 2023-12-19T18:03:31.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 -- 172.21.15.45:0/3166601841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9258005230 msgr2=0x7f925800ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:31.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9258005230 0x7f925800ba30 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f927000c2f0 tx=0x7f92580058a0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 -- 172.21.15.45:0/3166601841 shutdown_connections 2023-12-19T18:03:31.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 --2- 172.21.15.45:0/3166601841 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f9258005230 0x7f925800ba30 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 -- 172.21.15.45:0/3166601841 >> 172.21.15.45:0/3166601841 conn(0x7f92780ccd00 msgr2=0x7f92780cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:31.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 -- 172.21.15.45:0/3166601841 shutdown_connections 2023-12-19T18:03:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.925+0000 7f927d970700 1 -- 172.21.15.45:0/3166601841 wait complete. 2023-12-19T18:03:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 Processor -- start 2023-12-19T18:03:31.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 -- start start 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258005230 0x7f92780c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92780cefd0 0x7f927815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 0x7f92780b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780b4ee0 con 0x7f92780b4520 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92780c4710 con 0x7f9258005230 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f927d970700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92780cf450 con 0x7f92780cefd0 2023-12-19T18:03:31.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 0x7f92780b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 0x7f92780b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38238/0 (socket says 172.21.15.45:38238) 2023-12-19T18:03:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 -- 172.21.15.45:0/3754498609 learned_addr learned my addr 172.21.15.45:0/3754498609 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9276ffd700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258005230 0x7f92780c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f926ffff700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92780cefd0 0x7f927815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 -- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92780cefd0 msgr2=0x7f927815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:31.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92780cefd0 0x7f927815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 -- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258005230 msgr2=0x7f92780c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258005230 0x7f92780c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 -- 172.21.15.45:0/3754498609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92780c8540 con 0x7f92780b4520 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.929+0000 7f9277fff700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 0x7f92780b49a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f9278067540 tx=0x7f9270001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700052d0 con 0x7f92780b4520 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9270005430 con 0x7f92780b4520 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92700057c0 con 0x7f92780b4520 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92780c8820 con 0x7f92780b4520 2023-12-19T18:03:31.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92780c8de0 con 0x7f92780b4520 2023-12-19T18:03:31.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92780741d0 con 0x7f92780b4520 2023-12-19T18:03:31.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.933+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f927001e470 con 0x7f92780b4520 2023-12-19T18:03:31.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.937+0000 7f9274ff9700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f925c065b00 0x7f925c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:31.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.937+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f92700841a0 con 0x7f92780b4520 2023-12-19T18:03:31.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.937+0000 7f9276ffd700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f925c065b00 0x7f925c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:31.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.937+0000 7f9276ffd700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f925c065b00 0x7f925c067fc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9268000c00 tx=0x7f9268009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:31.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:31.945+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f92700519b0 con 0x7f92780b4520 2023-12-19T18:03:32.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.157+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92780b6200 con 0x7f92780b4520 2023-12-19T18:03:32.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f9274ff9700 1 -- 172.21.15.45:0/3754498609 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4715 (secure 0 0 0) 0x7f9270054fd0 con 0x7f92780b4520 2023-12-19T18:03:32.165 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:32.166 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":104,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":104,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:31.854797+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57464":{"gid":57464,"name":"b","rank":0,"incarnation":102,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f925c065b00 msgr2=0x7f925c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f925c065b00 0x7f925c067fc0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9268000c00 tx=0x7f9268009040 comp rx=0 tx=0).stop 2023-12-19T18:03:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 msgr2=0x7f92780b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 0x7f92780b49a0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f9278067540 tx=0x7f9270001650 comp rx=0 tx=0).stop 2023-12-19T18:03:32.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 shutdown_connections 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f925c065b00 0x7f925c067fc0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f92780b4520 0x7f92780b49a0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f92780cefd0 0x7f927815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 --2- 172.21.15.45:0/3754498609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9258005230 0x7f92780c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 >> 172.21.15.45:0/3754498609 conn(0x7f92780ccd00 msgr2=0x7f927815d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 shutdown_connections 2023-12-19T18:03:32.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:32.161+0000 7f927d970700 1 -- 172.21.15.45:0/3754498609 wait complete. 2023-12-19T18:03:32.171 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 104 2023-12-19T18:03:32.172 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:03:32.178 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:03:32.592 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 104, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:31.854797+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 130, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57464': {'gid': 57464, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:rejoin', 'state_seq': 11, 'addr': '172.21.15.73:6833/47731566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 47731566}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 47731566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:32.592 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_57464:up:rejoin 2023-12-19T18:03:33.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.777+0000 7f5941d05700 1 Processor -- start 2023-12-19T18:03:33.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.777+0000 7f5941d05700 1 -- start start 2023-12-19T18:03:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5941d05700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c15ae80 0x7f593c0b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5941d05700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f593c0b39b0 0x7f593c0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5941d05700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0ad740 con 0x7f593c150e90 2023-12-19T18:03:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5941d05700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c151270 con 0x7f593c0b39b0 2023-12-19T18:03:33.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5941d05700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c15b2e0 con 0x7f593c15ae80 2023-12-19T18:03:33.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5940d03700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f593c150e90 0x7f593c0b2360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59294/0 (socket says 172.21.15.45:59294) 2023-12-19T18:03:33.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5940d03700 1 -- 172.21.15.45:0/625470203 learned_addr learned my addr 172.21.15.45:0/625470203 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:33.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f5941504700 1 --2- 172.21.15.45:0/625470203 >> v2:172.21.15.45:3300/0 conn(0x7f593c0b39b0 0x7f593c0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:33.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.781+0000 7f593bfff700 1 --2- 172.21.15.45:0/625470203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c15ae80 0x7f593c0b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:33.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593b7fe700 1 -- 172.21.15.45:0/625470203 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1105113810 0 0) 0x7f593c0ad740 con 0x7f593c150e90 2023-12-19T18:03:33.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593b7fe700 1 -- 172.21.15.45:0/625470203 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f592c0057e0 con 0x7f593c150e90 2023-12-19T18:03:33.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593bfff700 1 -- 172.21.15.45:0/625470203 >> v2:172.21.15.45:3300/0 conn(0x7f593c0b39b0 msgr2=0x7f593c0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:33.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593bfff700 1 --2- 172.21.15.45:0/625470203 >> v2:172.21.15.45:3300/0 conn(0x7f593c0b39b0 0x7f593c0ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:33.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593bfff700 1 -- 172.21.15.45:0/625470203 >> v1:172.21.15.45:6789/0 conn(0x7f593c150e90 legacy=0x7f593c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:33.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593bfff700 1 -- 172.21.15.45:0/625470203 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c15b470 con 0x7f593c15ae80 2023-12-19T18:03:33.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593bfff700 1 --2- 172.21.15.45:0/625470203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c15ae80 0x7f593c0b3470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5928009850 tx=0x7f5928009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7c1de3ed2c84b7c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:33.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593b7fe700 1 -- 172.21.15.45:0/625470203 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928011830 con 0x7f593c15ae80 2023-12-19T18:03:33.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593b7fe700 1 -- 172.21.15.45:0/625470203 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5928011990 con 0x7f593c15ae80 2023-12-19T18:03:33.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f593b7fe700 1 -- 172.21.15.45:0/625470203 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5928011d40 con 0x7f593c15ae80 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 -- 172.21.15.45:0/625470203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c15ae80 msgr2=0x7f593c0b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 --2- 172.21.15.45:0/625470203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c15ae80 0x7f593c0b3470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5928009850 tx=0x7f5928009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 -- 172.21.15.45:0/625470203 shutdown_connections 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 --2- 172.21.15.45:0/625470203 >> v2:172.21.15.45:3300/0 conn(0x7f593c0b39b0 0x7f593c0ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 --2- 172.21.15.45:0/625470203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c15ae80 0x7f593c0b3470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 -- 172.21.15.45:0/625470203 >> 172.21.15.45:0/625470203 conn(0x7f593c06a130 msgr2=0x7f593c06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:33.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 -- 172.21.15.45:0/625470203 shutdown_connections 2023-12-19T18:03:33.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.785+0000 7f5941d05700 1 -- 172.21.15.45:0/625470203 wait complete. 2023-12-19T18:03:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.789+0000 7f5941d05700 1 Processor -- start 2023-12-19T18:03:33.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.789+0000 7f5941d05700 1 -- start start 2023-12-19T18:03:33.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c0b39b0 0x7f593c15e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:33.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f593c150e90 0x7f593c14f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:33.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 0x7f593c14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:33.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1f2dc0 con 0x7f593c15ae80 2023-12-19T18:03:33.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c13ee10 con 0x7f593c150e90 2023-12-19T18:03:33.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c1f3250 con 0x7f593c0b39b0 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 0x7f593c14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 0x7f593c14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38258/0 (socket says 172.21.15.45:38258) 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 -- 172.21.15.45:0/3709941008 learned_addr learned my addr 172.21.15.45:0/3709941008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5940d03700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c0b39b0 0x7f593c15e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f593bfff700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f593c150e90 0x7f593c14f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 -- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c0b39b0 msgr2=0x7f593c15e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c0b39b0 0x7f593c15e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 -- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f593c150e90 msgr2=0x7f593c14f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f593c150e90 0x7f593c14f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:33.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 -- 172.21.15.45:0/3709941008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280094b0 con 0x7f593c15ae80 2023-12-19T18:03:33.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941504700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 0x7f593c14fb40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f593400efc0 tx=0x7f593400c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:33.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400cad0 con 0x7f593c15ae80 2023-12-19T18:03:33.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593400f040 con 0x7f593c15ae80 2023-12-19T18:03:33.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c1f2490 con 0x7f593c15ae80 2023-12-19T18:03:33.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593400ce70 con 0x7f593c15ae80 2023-12-19T18:03:33.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.793+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c1f2a50 con 0x7f593c15ae80 2023-12-19T18:03:33.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.797+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f593c04ed30 con 0x7f593c15ae80 2023-12-19T18:03:33.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.797+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5934014480 con 0x7f593c15ae80 2023-12-19T18:03:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.801+0000 7f59397fa700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5920065ad0 0x7f5920067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.801+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f5934083ad0 con 0x7f593c15ae80 2023-12-19T18:03:33.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.801+0000 7f5940d03700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5920065ad0 0x7f5920067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:33.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.801+0000 7f5940d03700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5920065ad0 0x7f5920067f90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5930007fd0 tx=0x7f5930007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:33.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:33.805+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5934051300 con 0x7f593c15ae80 2023-12-19T18:03:34.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.017+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f593c14deb0 con 0x7f593c15ae80 2023-12-19T18:03:34.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f59397fa700 1 -- 172.21.15.45:0/3709941008 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 105 v105) v1 ==== 95+0+4715 (secure 0 0 0) 0x7f5934018020 con 0x7f593c15ae80 2023-12-19T18:03:34.025 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:34.025 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":105,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":9117,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":101}],"filesystems":[{"mdsmap":{"epoch":105,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:32.858409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":130,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":57464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_57464":{"gid":57464,"name":"b","rank":0,"incarnation":102,"state":"up:active","state_seq":12,"addr":"172.21.15.73:6833/47731566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":47731566},{"type":"v1","addr":"172.21.15.73:6833","nonce":47731566}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5920065ad0 msgr2=0x7f5920067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5920065ad0 0x7f5920067f90 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5930007fd0 tx=0x7f5930007de0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 msgr2=0x7f593c14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 0x7f593c14fb40 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f593400efc0 tx=0x7f593400c0c0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 shutdown_connections 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5920065ad0 0x7f5920067f90 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f593c15ae80 0x7f593c14fb40 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f593c150e90 0x7f593c14f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 --2- 172.21.15.45:0/3709941008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f593c0b39b0 0x7f593c15e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 >> 172.21.15.45:0/3709941008 conn(0x7f593c06a130 msgr2=0x7f593c0b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 shutdown_connections 2023-12-19T18:03:34.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.021+0000 7f5941d05700 1 -- 172.21.15.45:0/3709941008 wait complete. 2023-12-19T18:03:34.030 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 105 2023-12-19T18:03:34.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 105, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:32.858409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 130, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 57464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_57464': {'gid': 57464, 'name': 'b', 'rank': 0, 'incarnation': 102, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.73:6833/47731566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 47731566}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 47731566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:34.454 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:03:34.455 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-19T18:03:34.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.641+0000 7f18009d1700 1 Processor -- start 2023-12-19T18:03:34.649 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.645+0000 7f18009d1700 1 -- start start 2023-12-19T18:03:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.645+0000 7f18009d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0b8770 0x7f17fc15d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.645+0000 7f18009d1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f17fc0d1040 0x7f17fc0d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.645+0000 7f18009d1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17fc15e480 con 0x7f17fc0b46f0 2023-12-19T18:03:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.645+0000 7f18009d1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc0b8bf0 con 0x7f17fc0d1040 2023-12-19T18:03:34.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.645+0000 7f18009d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc15dbe0 con 0x7f17fc0b8770 2023-12-19T18:03:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f17fc0b46f0 0x7f17fc0b4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59296/0 (socket says 172.21.15.45:59296) 2023-12-19T18:03:34.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fad9d700 1 -- 172.21.15.45:0/2050596285 learned_addr learned my addr 172.21.15.45:0/2050596285 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fb59e700 1 --2- 172.21.15.45:0/2050596285 >> v2:172.21.15.45:3300/0 conn(0x7f17fc0d1040 0x7f17fc0d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fa59c700 1 --2- 172.21.15.45:0/2050596285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0b8770 0x7f17fc15d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17f9d9b700 1 -- 172.21.15.45:0/2050596285 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691902748 0 0) 0x7f17fc15e480 con 0x7f17fc0b46f0 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17f9d9b700 1 -- 172.21.15.45:0/2050596285 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17e40035d0 con 0x7f17fc0b46f0 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fb59e700 1 -- 172.21.15.45:0/2050596285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0b8770 msgr2=0x7f17fc15d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fb59e700 1 --2- 172.21.15.45:0/2050596285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0b8770 0x7f17fc15d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fb59e700 1 -- 172.21.15.45:0/2050596285 >> v1:172.21.15.45:6789/0 conn(0x7f17fc0b46f0 legacy=0x7f17fc0b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fb59e700 1 -- 172.21.15.45:0/2050596285 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc15d9b0 con 0x7f17fc0d1040 2023-12-19T18:03:34.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17fb59e700 1 --2- 172.21.15.45:0/2050596285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0d1040 0x7f17fc0d14d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009d90 tx=0x7f17f400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3095d361367a722c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17f9d9b700 1 -- 172.21.15.45:0/2050596285 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e070 con 0x7f17fc0d1040 2023-12-19T18:03:34.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17f9d9b700 1 -- 172.21.15.45:0/2050596285 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f400bb20 con 0x7f17fc0d1040 2023-12-19T18:03:34.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f17f9d9b700 1 -- 172.21.15.45:0/2050596285 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400be90 con 0x7f17fc0d1040 2023-12-19T18:03:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 -- 172.21.15.45:0/2050596285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0d1040 msgr2=0x7f17fc0d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 --2- 172.21.15.45:0/2050596285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0d1040 0x7f17fc0d14d0 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f17f4009d90 tx=0x7f17f400b330 comp rx=0 tx=0).stop 2023-12-19T18:03:34.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 -- 172.21.15.45:0/2050596285 shutdown_connections 2023-12-19T18:03:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 --2- 172.21.15.45:0/2050596285 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0d1040 0x7f17fc0d14d0 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 --2- 172.21.15.45:0/2050596285 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0b8770 0x7f17fc15d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 -- 172.21.15.45:0/2050596285 >> 172.21.15.45:0/2050596285 conn(0x7f17fc066380 msgr2=0x7f17fc0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.649+0000 7f18009d1700 1 -- 172.21.15.45:0/2050596285 shutdown_connections 2023-12-19T18:03:34.658 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.653+0000 7f18009d1700 1 -- 172.21.15.45:0/2050596285 wait complete. 2023-12-19T18:03:34.660 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 Processor -- start 2023-12-19T18:03:34.661 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 -- start start 2023-12-19T18:03:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 0x7f17fc1531a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0b8770 0x7f17fc15edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0d1040 0x7f17fc159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc15f600 con 0x7f17fc0b46f0 2023-12-19T18:03:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1e68b0 con 0x7f17fc0b8770 2023-12-19T18:03:34.663 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f18009d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1536e0 con 0x7f17fc0d1040 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 0x7f17fc1531a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 0x7f17fc1531a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38274/0 (socket says 172.21.15.45:38274) 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 -- 172.21.15.45:0/2032953209 learned_addr learned my addr 172.21.15.45:0/2032953209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fa59c700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0b8770 0x7f17fc15edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fb59e700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0d1040 0x7f17fc159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 -- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0d1040 msgr2=0x7f17fc159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.664 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0d1040 0x7f17fc159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 -- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0b8770 msgr2=0x7f17fc15edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.657+0000 7f17fad9d700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0b8770 0x7f17fc15edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.665 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f17fad9d700 1 -- 172.21.15.45:0/2032953209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009a70 con 0x7f17fc0b46f0 2023-12-19T18:03:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f17fad9d700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 0x7f17fc1531a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c4f0 tx=0x7f17ec00c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f17e37fe700 1 -- 172.21.15.45:0/2032953209 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec005d90 con 0x7f17fc0b46f0 2023-12-19T18:03:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f17e37fe700 1 -- 172.21.15.45:0/2032953209 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec0070d0 con 0x7f17fc0b46f0 2023-12-19T18:03:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f17e37fe700 1 -- 172.21.15.45:0/2032953209 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec007440 con 0x7f17fc0b46f0 2023-12-19T18:03:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc1e6ac0 con 0x7f17fc0b46f0 2023-12-19T18:03:34.666 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.661+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc1e7080 con 0x7f17fc0b46f0 2023-12-19T18:03:34.669 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.665+0000 7f17e37fe700 1 -- 172.21.15.45:0/2032953209 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f17ec0075a0 con 0x7f17fc0b46f0 2023-12-19T18:03:34.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.665+0000 7f17e37fe700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17e8065ad0 0x7f17e8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.665+0000 7f17e37fe700 1 -- 172.21.15.45:0/2032953209 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f17ec082780 con 0x7f17fc0b46f0 2023-12-19T18:03:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.665+0000 7f17fa59c700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17e8065ad0 0x7f17e8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.665+0000 7f180445f740 1 Processor -- start 2023-12-19T18:03:34.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 -- start start 2023-12-19T18:03:34.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fa59c700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17e8065ad0 0x7f17e8067f90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0b1aa0 tx=0x7f17f0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14d38c0 0x14d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe920 0x14d41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 0x14d4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x14475b0 con 0x14fe390 2023-12-19T18:03:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1444d40 con 0x14d38c0 2023-12-19T18:03:34.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x1440630 con 0x14fe920 2023-12-19T18:03:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 0x14d4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 0x14d4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38284/0 (socket says 172.21.15.45:38284) 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 -- 172.21.15.45:0/1324624378 learned_addr learned my addr 172.21.15.45:0/1324624378 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fad9d700 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14d38c0 0x14d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fa59c700 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe920 0x14d41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 -- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe920 msgr2=0x14d41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe920 0x14d41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 -- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14d38c0 msgr2=0x14d3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14d38c0 0x14d3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 -- 172.21.15.45:0/1324624378 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x12b3960 con 0x14fe390 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fa59c700 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe920 0x14d41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:34.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17fb59e700 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 0x14d4720 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f17f4013000 tx=0x7f17f4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fdf8da09c3cde6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17e0ff9700 1 -- 172.21.15.45:0/1324624378 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4003ac0 con 0x14fe390 2023-12-19T18:03:34.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17e0ff9700 1 -- 172.21.15.45:0/1324624378 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f4003c40 con 0x14fe390 2023-12-19T18:03:34.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.669+0000 7f17e0ff9700 1 -- 172.21.15.45:0/1324624378 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4004040 con 0x14fe390 2023-12-19T18:03:34.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 -- 172.21.15.45:0/1324624378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 msgr2=0x14d4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 0x14d4720 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f17f4013000 tx=0x7f17f4010000 comp rx=0 tx=0).stop 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 -- 172.21.15.45:0/1324624378 shutdown_connections 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14fe390 0x14d4720 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe920 0x14d41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 --2- 172.21.15.45:0/1324624378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14d38c0 0x14d3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 -- 172.21.15.45:0/1324624378 >> 172.21.15.45:0/1324624378 conn(0x12684d0 msgr2=0x14d9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 -- 172.21.15.45:0/1324624378 shutdown_connections 2023-12-19T18:03:34.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 -- 172.21.15.45:0/1324624378 wait complete. 2023-12-19T18:03:34.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 -- start start 2023-12-19T18:03:34.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.673+0000 7f180445f740 1 Processor -- start 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14fd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe390 0x1502160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x15026a0 0x151b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x13fdc80 con 0x14d38c0 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x1403b00 con 0x15026a0 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x12ecaa0 con 0x14fe390 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 10 client.0 _ll_register_callbacks cb 0x1439f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14fd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14fd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38298/0 (socket says 172.21.15.45:38298) 2023-12-19T18:03:34.681 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 -- 172.21.15.45:0/3466955462 learned_addr learned my addr 172.21.15.45:0/3466955462 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fb59e700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x15026a0 0x151b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fa59c700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe390 0x1502160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 -- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe390 msgr2=0x1502160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe390 0x1502160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 -- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x15026a0 msgr2=0x151b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x15026a0 0x151b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 -- 172.21.15.45:0/3466955462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc15d9b0 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fad9d700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14fd660 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0538f0 tx=0x7f17ec054130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcd5e47889eeabf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17d9ffb700 1 -- 172.21.15.45:0/3466955462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec05b890 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17d9ffb700 1 -- 172.21.15.45:0/3466955462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f17ec068dc0 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14396b0 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17d9ffb700 1 -- 172.21.15.45:0/3466955462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17ec054b50 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 10 client.9168 fetch_fsmap learned FSMap version 105 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) v3 -- 0x1406770 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17d9ffb700 1 -- 172.21.15.45:0/3466955462 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14396b0 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17d9ffb700 1 -- 172.21.15.45:0/3466955462 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 105) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f17ec054cb0 con 0x14d38c0 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 10 client.9168 fetch_fsmap finished waiting for FSMap version 105 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 10 client.9168 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:03:34.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 20 client.9168 populate_metadata read hostname 'smithi045' 2023-12-19T18:03:34.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x15319c0 0x1533db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 4 client.9168 mds_command: new command op to 57464 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:03:34.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 --> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x13fba00 con 0x15319c0 2023-12-19T18:03:34.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.677+0000 7f17fa59c700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x15319c0 0x1533db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f17fa59c700 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x15319c0 0x1533db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ae580c8573f895a server_cookie=e9af366fb5848c91 in_seq=0 out_seq=0 2023-12-19T18:03:34.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f17d9ffb700 10 client.9168 ms_handle_connect on v2:172.21.15.73:6832/47731566 2023-12-19T18:03:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f17d9ffb700 1 -- 172.21.15.45:0/3466955462 <== mds.0 v2:172.21.15.73:6832/47731566 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x13fba00 con 0x15319c0 2023-12-19T18:03:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f17d9ffb700 10 client.9168 handle_command_reply: tid=0 2023-12-19T18:03:34.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 client.9168 shutdown 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 msgr2=0x14fd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14fd660 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f17ec0538f0 tx=0x7f17ec054130 comp rx=0 tx=0).stop 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 shutdown_connections 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x15319c0 0x1533db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x15026a0 0x151b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f17d9ffb700 0 client.9168 ms_handle_reset on v2:172.21.15.73:6832/47731566 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14fe390 0x1502160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 --2- 172.21.15.45:0/3466955462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14fd660 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 >> 172.21.15.45:0/3466955462 conn(0x12684d0 msgr2=0x14d64d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 shutdown_connections 2023-12-19T18:03:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.681+0000 7f180445f740 1 -- 172.21.15.45:0/3466955462 wait complete. 2023-12-19T18:03:34.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.685+0000 7f180445f740 20 client.9168 trim_cache size 0 max 16384 2023-12-19T18:03:34.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 Processor -- start 2023-12-19T18:03:34.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 -- start start 2023-12-19T18:03:34.709 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14d8350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x1525a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x15026a0 0x1525f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x14489b0 con 0x14d38c0 2023-12-19T18:03:34.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x140aa40 con 0x14fe390 2023-12-19T18:03:34.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x151b190 con 0x15026a0 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14d8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14d8350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38310/0 (socket says 172.21.15.45:38310) 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 -- 172.21.15.45:0/3995030865 learned_addr learned my addr 172.21.15.45:0/3995030865 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fb59e700 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x15026a0 0x1525f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fa59c700 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x1525a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 -- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x15026a0 msgr2=0x1525f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x15026a0 0x1525f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 -- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 msgr2=0x1525a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x1525a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 -- 172.21.15.45:0/3995030865 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x13ec9a0 con 0x14d38c0 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17fad9d700 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14d8350 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000c00 tx=0x7f17ec055000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a859573a6190365 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17e17fa700 1 -- 172.21.15.45:0/3995030865 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec05b890 con 0x14d38c0 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17e17fa700 1 -- 172.21.15.45:0/3995030865 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ec04ff30 con 0x14d38c0 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.705+0000 7f17e17fa700 1 -- 172.21.15.45:0/3995030865 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ec07adf0 con 0x14d38c0 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 -- 172.21.15.45:0/3995030865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 msgr2=0x14d8350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14d8350 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f17ec000c00 tx=0x7f17ec055000 comp rx=0 tx=0).stop 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 -- 172.21.15.45:0/3995030865 shutdown_connections 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x15026a0 0x1525f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x1525a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 --2- 172.21.15.45:0/3995030865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x14d38c0 0x14d8350 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 -- 172.21.15.45:0/3995030865 >> 172.21.15.45:0/3995030865 conn(0x12684d0 msgr2=0x14fc990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 -- 172.21.15.45:0/3995030865 shutdown_connections 2023-12-19T18:03:34.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 -- 172.21.15.45:0/3995030865 wait complete. 2023-12-19T18:03:34.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 -- start start 2023-12-19T18:03:34.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.709+0000 7f180445f740 1 Processor -- start 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14d38c0 0x1585a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x14fbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 0x14fc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x13de9c0 con 0x15026a0 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x143da30 con 0x14fe390 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x13ef930 con 0x14d38c0 2023-12-19T18:03:34.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 10 client.0 _ll_register_callbacks cb 0x1379e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:03:34.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 0x14fc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 0x14fc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38320/0 (socket says 172.21.15.45:38320) 2023-12-19T18:03:34.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 -- 172.21.15.45:0/1370502669 learned_addr learned my addr 172.21.15.45:0/1370502669 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fad9d700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14d38c0 0x1585a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fa59c700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x14fbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 -- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14d38c0 msgr2=0x1585a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14d38c0 0x1585a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 -- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 msgr2=0x14fbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x14fbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 -- 172.21.15.45:0/1370502669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x1406770 con 0x15026a0 2023-12-19T18:03:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17fb59e700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 0x14fc370 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f17f400b680 tx=0x7f17f4004b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffe9090439186ce server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:03:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17d9ffb700 1 -- 172.21.15.45:0/1370502669 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400b6d0 con 0x15026a0 2023-12-19T18:03:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f17d9ffb700 1 -- 172.21.15.45:0/1370502669 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f17f40046b0 con 0x15026a0 2023-12-19T18:03:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.713+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x14da390 con 0x15026a0 2023-12-19T18:03:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 1 -- 172.21.15.45:0/1370502669 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17f4004870 con 0x15026a0 2023-12-19T18:03:34.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 10 client.9174 fetch_fsmap learned FSMap version 105 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=2+}) v3 -- 0x13e0c70 con 0x15026a0 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 1 -- 172.21.15.45:0/1370502669 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x14da390 con 0x15026a0 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 1 -- 172.21.15.45:0/1370502669 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 105) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f17f402c070 con 0x15026a0 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 10 client.9174 fetch_fsmap finished waiting for FSMap version 105 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 10 client.9174 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 20 client.9174 populate_metadata read hostname 'smithi045' 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x1535030 0x1535410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 4 client.9174 mds_command: new command op to 57464 tid=0[{"prefix": "status"}] 2023-12-19T18:03:34.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 --> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f17f4003c40 con 0x1535030 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17fad9d700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x1535030 0x1535410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17fad9d700 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x1535030 0x1535410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=39ba2d3574f4307a server_cookie=8c5182114520a763 in_seq=0 out_seq=0 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 10 client.9174 ms_handle_connect on v2:172.21.15.73:6832/47731566 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 1 -- 172.21.15.45:0/1370502669 <== mds.0 v2:172.21.15.73:6832/47731566 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+329 (crc 0 0 0) 0x7f17f4003c40 con 0x1535030 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 10 client.9174 handle_command_reply: tid=0 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 client.9174 shutdown 2023-12-19T18:03:34.723 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 msgr2=0x14fc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 0x14fc370 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f17f400b680 tx=0x7f17f4004b60 comp rx=0 tx=0).stop 2023-12-19T18:03:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 shutdown_connections 2023-12-19T18:03:34.724 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:6832/47731566,v1:172.21.15.73:6833/47731566] conn(0x1535030 0x1535410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x15026a0 0x14fc370 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x14fe390 0x14fbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 --2- 172.21.15.45:0/1370502669 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x14d38c0 0x1585a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 >> 172.21.15.45:0/1370502669 conn(0x12684d0 msgr2=0x1527b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f17d9ffb700 0 client.9174 ms_handle_reset on v2:172.21.15.73:6832/47731566 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 shutdown_connections 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.717+0000 7f180445f740 1 -- 172.21.15.45:0/1370502669 wait complete. 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f180445f740 20 client.9174 trim_cache size 0 max 16384 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T18:03:34.725 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 57464, 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.8753428980000004, 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 105, 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 130, 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 130, 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 38.417414123 2023-12-19T18:03:34.726 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:03:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17e8065ad0 msgr2=0x7f17e8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17e8065ad0 0x7f17e8067f90 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0b1aa0 tx=0x7f17f0009240 comp rx=0 tx=0).stop 2023-12-19T18:03:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 msgr2=0x7f17fc1531a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 0x7f17fc1531a0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f17ec00c4f0 tx=0x7f17ec00c800 comp rx=0 tx=0).stop 2023-12-19T18:03:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 shutdown_connections 2023-12-19T18:03:34.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f17e8065ad0 0x7f17e8067f90 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f17fc0d1040 0x7f17fc159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f17fc0b8770 0x7f17fc15edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 --2- 172.21.15.45:0/2032953209 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f17fc0b46f0 0x7f17fc1531a0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 >> 172.21.15.45:0/2032953209 conn(0x7f17fc066380 msgr2=0x7f17fc0b3b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 shutdown_connections 2023-12-19T18:03:34.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.721+0000 7f18009d1700 1 -- 172.21.15.45:0/2032953209 wait complete. 2023-12-19T18:03:34.749 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:03:34.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 Processor -- start 2023-12-19T18:03:34.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 -- start start 2023-12-19T18:03:34.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f12f80b2cc0 0x7f12f8158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12f8161b70 0x7f12f8162000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f81628e0 con 0x7f12f8161b70 2023-12-19T18:03:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12f80af100 con 0x7f12f80b2cc0 2023-12-19T18:03:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.929+0000 7f12fd5b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80af3e0 con 0x7f12f80b28e0 2023-12-19T18:03:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fcdb4700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f12f8161b70 0x7f12f8162000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f8157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:54696/0 (socket says 172.21.15.45:54696) 2023-12-19T18:03:34.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 -- 172.21.15.45:0/3210753355 learned_addr learned my addr 172.21.15.45:0/3210753355 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f77fe700 1 --2- 172.21.15.45:0/3210753355 >> v2:172.21.15.73:3300/0 conn(0x7f12f80b2cc0 0x7f12f8158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 -- 172.21.15.45:0/3210753355 >> v2:172.21.15.73:3300/0 conn(0x7f12f80b2cc0 msgr2=0x7f12f8158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 --2- 172.21.15.45:0/3210753355 >> v2:172.21.15.73:3300/0 conn(0x7f12f80b2cc0 0x7f12f8158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 -- 172.21.15.45:0/3210753355 >> v2:172.21.15.45:3300/0 conn(0x7f12f8161b70 msgr2=0x7f12f8162000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:34.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 --2- 172.21.15.45:0/3210753355 >> v2:172.21.15.45:3300/0 conn(0x7f12f8161b70 0x7f12f8162000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 -- 172.21.15.45:0/3210753355 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f80af6c0 con 0x7f12f80b28e0 2023-12-19T18:03:34.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f7fff700 1 --2- 172.21.15.45:0/3210753355 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f8157ed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f12f806e8b0 tx=0x7f12e8009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12948fa8e4755690 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f6ffd700 1 -- 172.21.15.45:0/3210753355 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011830 con 0x7f12f80b28e0 2023-12-19T18:03:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f6ffd700 1 -- 172.21.15.45:0/3210753355 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e8011990 con 0x7f12f80b28e0 2023-12-19T18:03:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12f6ffd700 1 -- 172.21.15.45:0/3210753355 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e8011d20 con 0x7f12f80b28e0 2023-12-19T18:03:34.939 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 -- 172.21.15.45:0/3210753355 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 msgr2=0x7f12f8157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/3210753355 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f8157ed0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f12f806e8b0 tx=0x7f12e8009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 -- 172.21.15.45:0/3210753355 shutdown_connections 2023-12-19T18:03:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/3210753355 >> v2:172.21.15.45:3300/0 conn(0x7f12f8161b70 0x7f12f8162000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/3210753355 >> v2:172.21.15.73:3300/0 conn(0x7f12f80b2cc0 0x7f12f8158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/3210753355 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f8157ed0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 -- 172.21.15.45:0/3210753355 >> 172.21.15.45:0/3210753355 conn(0x7f12f806a130 msgr2=0x7f12f806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.933+0000 7f12fd5b5700 1 -- 172.21.15.45:0/3210753355 shutdown_connections 2023-12-19T18:03:34.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.937+0000 7f12fd5b5700 1 -- 172.21.15.45:0/3210753355 wait complete. 2023-12-19T18:03:34.943 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.937+0000 7f12fd5b5700 1 Processor -- start 2023-12-19T18:03:34.944 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.937+0000 7f12fd5b5700 1 -- start start 2023-12-19T18:03:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f80c38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f80b2cc0 0x7f12f80ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 0x7f12f81566b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f80ca890 con 0x7f12f8161b70 2023-12-19T18:03:34.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12f81545a0 con 0x7f12f80b2cc0 2023-12-19T18:03:34.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f8141460 con 0x7f12f80b28e0 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 0x7f12f81566b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 0x7f12f81566b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38348/0 (socket says 172.21.15.45:38348) 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 -- 172.21.15.45:0/9280671 learned_addr learned my addr 172.21.15.45:0/9280671 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12f7fff700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f80c38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12f77fe700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f80b2cc0 0x7f12f80ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 -- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 msgr2=0x7f12f80c38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f80c38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 -- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f80b2cc0 msgr2=0x7f12f80ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f80b2cc0 0x7f12f80ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:34.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 -- 172.21.15.45:0/9280671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e8009570 con 0x7f12f8161b70 2023-12-19T18:03:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fcdb4700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 0x7f12f81566b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f12f000efc0 tx=0x7f12f000c0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000cad0 con 0x7f12f8161b70 2023-12-19T18:03:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f000f040 con 0x7f12f8161b70 2023-12-19T18:03:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12f8157090 con 0x7f12f8161b70 2023-12-19T18:03:34.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f000ce70 con 0x7f12f8161b70 2023-12-19T18:03:34.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.941+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12f8153f50 con 0x7f12f8161b70 2023-12-19T18:03:34.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.945+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12f80cf7b0 con 0x7f12f8161b70 2023-12-19T18:03:34.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.945+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12f0014480 con 0x7f12f8161b70 2023-12-19T18:03:34.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.949+0000 7f12f4ff9700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12e4065ad0 0x7f12e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:34.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.949+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f12f0083ad0 con 0x7f12f8161b70 2023-12-19T18:03:34.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.949+0000 7f12f7fff700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12e4065ad0 0x7f12e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:34.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.953+0000 7f12f7fff700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12e4065ad0 0x7f12e4067f90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:34.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:34.957+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f12f0051260 con 0x7f12f8161b70 2023-12-19T18:03:35.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.173+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f12f804ed30 con 0x7f12f8161b70 2023-12-19T18:03:35.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.177+0000 7f12f4ff9700 1 -- 172.21.15.45:0/9280671 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v105) v1 ==== 53+0+73 (secure 0 0 0) 0x7f12f0018060 con 0x7f12f8161b70 2023-12-19T18:03:35.181 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:03:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.177+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12e4065ad0 msgr2=0x7f12e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.177+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12e4065ad0 0x7f12e4067f90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f12e8000c00 tx=0x7f12e8008030 comp rx=0 tx=0).stop 2023-12-19T18:03:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.177+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 msgr2=0x7f12f81566b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:35.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.177+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 0x7f12f81566b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f12f000efc0 tx=0x7f12f000c0c0 comp rx=0 tx=0).stop 2023-12-19T18:03:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 shutdown_connections 2023-12-19T18:03:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f12e4065ad0 0x7f12e4067f90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f12f8161b70 0x7f12f81566b0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f12f80b2cc0 0x7f12f80ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:35.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 --2- 172.21.15.45:0/9280671 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12f80b28e0 0x7f12f80c38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 >> 172.21.15.45:0/9280671 conn(0x7f12f806a130 msgr2=0x7f12f8165550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 shutdown_connections 2023-12-19T18:03:35.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:35.181+0000 7f12fd5b5700 1 -- 172.21.15.45:0/9280671 wait complete. 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:03:35.209 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:35.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.210 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T18:03:35.226 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:03:35.226 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T18:03:35.227 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41650sec preferred_lft 41650sec 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:03:35.228 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T18:03:35.229 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:35.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.230 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:03:35.310 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:03:35.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.313 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T18:03:35.376 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T18:03:35.377 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:03:35.377 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T18:03:35.377 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:03:35.377 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T18:03:35.377 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:03:35.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.377 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T18:03:35.377 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T18:03:35.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T18:03:35.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T18:03:35.378 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T18:03:35.378 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T18:03:35.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.518 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:03:35.535 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:03:35.535 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:03:35.536 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:35.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T18:03:35.618 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T18:03:35.618 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:03:35.618 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:35.684 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:35.684 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:03:35.685 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:35.745 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:03:35.825 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:03:35.825 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:03:35.914 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:03:35.917 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:03:35.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:35.918 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:03:35.977 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T18:03:35.977 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T18:03:36.031 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:03:36.064 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:03:36.065 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:03:36.138 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:03:36.139 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:03:36.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:36.140 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:03:36.179 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T18:03:36.173+0000 7f0e29900640 -1 init, newargv = 0x560dbf57a180 newargc=15 2023-12-19T18:03:36.180 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[59498]: starting ceph client 2023-12-19T18:03:36.191 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[59498]: starting fuse 2023-12-19T18:03:36.195 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:03:36.195 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T18:03:36.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:36.196 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T18:03:36.197 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T18:03:36.198 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T18:03:36.198 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T18:03:36.198 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:36.198 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T18:03:36.198 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:03:36.356 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.59498.asok 2023-12-19T18:03:36.536 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.59498.asok 2023-12-19T18:03:36.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:36.536 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.59498.asok status 2023-12-19T18:03:36.736 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:03:36.736 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T18:03:36.736 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "59498", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 9186, 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 9186 2023-12-19T18:03:36.737 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1811355382 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1811355382 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.9186 192.168.0.1:0/1811355382", 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1811355382", 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T18:03:36.738 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 105, 2023-12-19T18:03:36.739 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 130, 2023-12-19T18:03:36.739 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T18:03:36.739 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T18:03:36.739 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T18:03:36.739 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:03:36.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:36.751 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T18:03:36.752 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:36.769 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T18:03:36.769 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:36.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:36.769 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:36.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:36.846 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2023-12-19T18:03:36.947 INFO:teuthology.orchestra.run.smithi045.stdout:0 2023-12-19T18:03:36.947 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:03:36.947 INFO:teuthology.orchestra.run.smithi045.stdout:10 2023-12-19T18:03:36.947 INFO:teuthology.orchestra.run.smithi045.stdout:11 2023-12-19T18:03:36.947 INFO:teuthology.orchestra.run.smithi045.stdout:12 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:13 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:14 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:15 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:16 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:17 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:18 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:19 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:2 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:20 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:22 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:23 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:24 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:25 2023-12-19T18:03:36.948 INFO:teuthology.orchestra.run.smithi045.stdout:26 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:27 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:28 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:29 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:3 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:30 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:31 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:32 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:33 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:34 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:35 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:36 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:37 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:38 2023-12-19T18:03:36.949 INFO:teuthology.orchestra.run.smithi045.stdout:39 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:4 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:40 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:41 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:42 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:43 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:44 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:45 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:46 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:47 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:48 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:5 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:50 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:51 2023-12-19T18:03:36.950 INFO:teuthology.orchestra.run.smithi045.stdout:52 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:53 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:54 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:55 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:56 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:57 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:58 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:59 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:6 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:60 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:61 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:62 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:63 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:64 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:65 2023-12-19T18:03:36.951 INFO:teuthology.orchestra.run.smithi045.stdout:66 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:67 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:68 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:69 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:7 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:70 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:71 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:72 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:73 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:74 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:75 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:76 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:77 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:78 2023-12-19T18:03:36.952 INFO:teuthology.orchestra.run.smithi045.stdout:79 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:8 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:80 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:81 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:82 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:83 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:84 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:85 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:86 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:87 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:88 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:89 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:9 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:90 2023-12-19T18:03:36.953 INFO:teuthology.orchestra.run.smithi045.stdout:91 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:92 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:93 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:94 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:95 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:96 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:97 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:98 2023-12-19T18:03:36.954 INFO:teuthology.orchestra.run.smithi045.stdout:99 2023-12-19T18:03:36.955 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:03:36.955 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:03:36.974 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:37.002 INFO:tasks.ceph.mds.b.smithi073.stderr:2023-12-19T18:03:37.000+0000 7f6a67410700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:03:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.188+0000 7fb411c20700 1 Processor -- start 2023-12-19T18:03:37.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.188+0000 7fb411c20700 1 -- start start 2023-12-19T18:03:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4040340d0 0x7fb4040eb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb404048330 0x7fb4040eb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb404047de0 0x7fb404005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb40404fca0 con 0x7fb404048330 2023-12-19T18:03:37.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4040503d0 con 0x7fb404047de0 2023-12-19T18:03:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40404ff40 con 0x7fb4040340d0 2023-12-19T18:03:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb404048330 0x7fb4040eb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fb404048330 0x7fb4040eb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38360/0 (socket says 172.21.15.45:38360) 2023-12-19T18:03:37.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 -- 172.21.15.45:0/1618318255 learned_addr learned my addr 172.21.15.45:0/1618318255 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb410c1e700 1 --2- 172.21.15.45:0/1618318255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4040340d0 0x7fb4040eb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb41141f700 1 --2- 172.21.15.45:0/1618318255 >> v2:172.21.15.73:3300/0 conn(0x7fb404047de0 0x7fb404005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 -- 172.21.15.45:0/1618318255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4040340d0 msgr2=0x7fb4040eb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 --2- 172.21.15.45:0/1618318255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4040340d0 0x7fb4040eb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 -- 172.21.15.45:0/1618318255 >> v2:172.21.15.73:3300/0 conn(0x7fb404047de0 msgr2=0x7fb404005fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 --2- 172.21.15.45:0/1618318255 >> v2:172.21.15.73:3300/0 conn(0x7fb404047de0 0x7fb404005fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 -- 172.21.15.45:0/1618318255 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4040ec1e0 con 0x7fb404048330 2023-12-19T18:03:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40bfff700 1 --2- 172.21.15.45:0/1618318255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb4040eb880 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009910 tx=0x7fb3f8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e9ad0387179860 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40b7fe700 1 -- 172.21.15.45:0/1618318255 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f800ba20 con 0x7fb404048330 2023-12-19T18:03:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40b7fe700 1 -- 172.21.15.45:0/1618318255 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3f800bb80 con 0x7fb404048330 2023-12-19T18:03:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb40b7fe700 1 -- 172.21.15.45:0/1618318255 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f8009e60 con 0x7fb404048330 2023-12-19T18:03:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- 172.21.15.45:0/1618318255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 msgr2=0x7fb4040eb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- 172.21.15.45:0/1618318255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb4040eb880 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009910 tx=0x7fb3f8009c20 comp rx=0 tx=0).stop 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- 172.21.15.45:0/1618318255 shutdown_connections 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- 172.21.15.45:0/1618318255 >> v2:172.21.15.73:3300/0 conn(0x7fb404047de0 0x7fb404005fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- 172.21.15.45:0/1618318255 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb4040eb880 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 --2- 172.21.15.45:0/1618318255 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb4040340d0 0x7fb4040eb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- 172.21.15.45:0/1618318255 >> 172.21.15.45:0/1618318255 conn(0x7fb404054c90 msgr2=0x7fb4040550a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.192+0000 7fb411c20700 1 -- 172.21.15.45:0/1618318255 shutdown_connections 2023-12-19T18:03:37.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 -- 172.21.15.45:0/1618318255 wait complete. 2023-12-19T18:03:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 Processor -- start 2023-12-19T18:03:37.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 -- start start 2023-12-19T18:03:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040340d0 0x7fb4040ea570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb404047de0 0x7fb404049970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb404038e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040df8b0 con 0x7fb404048330 2023-12-19T18:03:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40417ccb0 con 0x7fb4040340d0 2023-12-19T18:03:37.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.196+0000 7fb411c20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4040e94d0 con 0x7fb404047de0 2023-12-19T18:03:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb404038e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb404038e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38372/0 (socket says 172.21.15.45:38372) 2023-12-19T18:03:37.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 -- 172.21.15.45:0/4187049825 learned_addr learned my addr 172.21.15.45:0/4187049825 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb410c1e700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040340d0 0x7fb4040ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb40bfff700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb404047de0 0x7fb404049970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 -- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb404047de0 msgr2=0x7fb404049970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb404047de0 0x7fb404049970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 -- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040340d0 msgr2=0x7fb4040ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040340d0 0x7fb4040ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 -- 172.21.15.45:0/4187049825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3f8009570 con 0x7fb404048330 2023-12-19T18:03:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb41141f700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb404038e40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fb40c069ab0 tx=0x7fb40c072720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c072f10 con 0x7fb404048330 2023-12-19T18:03:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb40c073070 con 0x7fb404048330 2023-12-19T18:03:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4040e97b0 con 0x7fb404048330 2023-12-19T18:03:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb40c094480 con 0x7fb404048330 2023-12-19T18:03:37.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.200+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4040e9d70 con 0x7fb404048330 2023-12-19T18:03:37.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.204+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb404005460 con 0x7fb404048330 2023-12-19T18:03:37.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.204+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb40c0945e0 con 0x7fb404048330 2023-12-19T18:03:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.204+0000 7fb4097fa700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3f0065ad0 0x7fb3f0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.204+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fb40c08f070 con 0x7fb404048330 2023-12-19T18:03:37.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.204+0000 7fb410c1e700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3f0065ad0 0x7fb3f0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.208+0000 7fb410c1e700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3f0065ad0 0x7fb3f0067f90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb400007ae0 tx=0x7fb400008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:37.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.212+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb40c0cb300 con 0x7fb404048330 2023-12-19T18:03:37.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.388+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb404052960 con 0x7fb404048330 2023-12-19T18:03:37.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.392+0000 7fb4097fa700 1 -- 172.21.15.45:0/4187049825 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fb40c0ce920 con 0x7fb404048330 2023-12-19T18:03:37.397 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:37.397 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":130,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:28.816230+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3f0065ad0 msgr2=0x7fb3f0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3f0065ad0 0x7fb3f0067f90 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fb400007ae0 tx=0x7fb400008040 comp rx=0 tx=0).stop 2023-12-19T18:03:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 msgr2=0x7fb404038e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb404038e40 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7fb40c069ab0 tx=0x7fb40c072720 comp rx=0 tx=0).stop 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 shutdown_connections 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3f0065ad0 0x7fb3f0067f90 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb404048330 0x7fb404038e40 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb404047de0 0x7fb404049970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 --2- 172.21.15.45:0/4187049825 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb4040340d0 0x7fb4040ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 >> 172.21.15.45:0/4187049825 conn(0x7fb404054c90 msgr2=0x7fb4040354c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 shutdown_connections 2023-12-19T18:03:37.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.396+0000 7fb411c20700 1 -- 172.21.15.45:0/4187049825 wait complete. 2023-12-19T18:03:37.424 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:02:59.579656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:03:00.531245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:03:37.425 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:03:37.606 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.600+0000 7f0e6759e700 1 Processor -- start 2023-12-19T18:03:37.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.600+0000 7f0e6759e700 1 -- start start 2023-12-19T18:03:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e6815d0f0 0x7f0e680713b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0e680ca020 0x7f0e680cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e680cd700 0x7f0e68070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680cc490 con 0x7f0e680cd700 2023-12-19T18:03:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e680ccd30 con 0x7f0e680ca020 2023-12-19T18:03:37.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e680ca790 con 0x7f0e6815d0f0 2023-12-19T18:03:37.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e680cd700 0x7f0e68070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0e680cd700 0x7f0e68070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38382/0 (socket says 172.21.15.45:38382) 2023-12-19T18:03:37.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 -- 172.21.15.45:0/2465819201 learned_addr learned my addr 172.21.15.45:0/2465819201 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e6659c700 1 --2- 172.21.15.45:0/2465819201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e6815d0f0 0x7f0e680713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e5ffff700 1 --2- 172.21.15.45:0/2465819201 >> v2:172.21.15.73:3300/0 conn(0x7f0e680ca020 0x7f0e680cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 -- 172.21.15.45:0/2465819201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e6815d0f0 msgr2=0x7f0e680713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 --2- 172.21.15.45:0/2465819201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e6815d0f0 0x7f0e680713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 -- 172.21.15.45:0/2465819201 >> v2:172.21.15.73:3300/0 conn(0x7f0e680ca020 msgr2=0x7f0e680cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 --2- 172.21.15.45:0/2465819201 >> v2:172.21.15.73:3300/0 conn(0x7f0e680ca020 0x7f0e680cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 -- 172.21.15.45:0/2465819201 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680cc6e0 con 0x7f0e680cd700 2023-12-19T18:03:37.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e5ffff700 1 --2- 172.21.15.45:0/2465819201 >> v2:172.21.15.73:3300/0 conn(0x7f0e680ca020 0x7f0e680cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:03:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e66d9d700 1 --2- 172.21.15.45:0/2465819201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e68070570 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f0e6806bdd0 tx=0x7f0e6000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=770b74f3c62a6ce3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.604+0000 7f0e65d9b700 1 -- 172.21.15.45:0/2465819201 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000e070 con 0x7f0e680cd700 2023-12-19T18:03:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e65d9b700 1 -- 172.21.15.45:0/2465819201 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e6000b9c0 con 0x7f0e680cd700 2023-12-19T18:03:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e65d9b700 1 -- 172.21.15.45:0/2465819201 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e6000bd70 con 0x7f0e680cd700 2023-12-19T18:03:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 -- 172.21.15.45:0/2465819201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 msgr2=0x7f0e68070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.613 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 --2- 172.21.15.45:0/2465819201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e68070570 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f0e6806bdd0 tx=0x7f0e6000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 -- 172.21.15.45:0/2465819201 shutdown_connections 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 --2- 172.21.15.45:0/2465819201 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e68070570 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 --2- 172.21.15.45:0/2465819201 >> v2:172.21.15.73:3300/0 conn(0x7f0e680ca020 0x7f0e680cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 --2- 172.21.15.45:0/2465819201 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e6815d0f0 0x7f0e680713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 -- 172.21.15.45:0/2465819201 >> 172.21.15.45:0/2465819201 conn(0x7f0e680ce8c0 msgr2=0x7f0e680ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 -- 172.21.15.45:0/2465819201 shutdown_connections 2023-12-19T18:03:37.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.608+0000 7f0e6759e700 1 -- 172.21.15.45:0/2465819201 wait complete. 2023-12-19T18:03:37.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 Processor -- start 2023-12-19T18:03:37.617 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 -- start start 2023-12-19T18:03:37.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e680ca020 0x7f0e68149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e681f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e6815d0f0 0x7f0e68147ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e681f6cd0 con 0x7f0e680cd700 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6815d960 con 0x7f0e6815d0f0 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6814aa80 con 0x7f0e680ca020 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e681f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e5ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e681f6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38388/0 (socket says 172.21.15.45:38388) 2023-12-19T18:03:37.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e5ffff700 1 -- 172.21.15.45:0/1244441938 learned_addr learned my addr 172.21.15.45:0/1244441938 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e6659c700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e680ca020 0x7f0e68149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.612+0000 7f0e66d9d700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e6815d0f0 0x7f0e68147ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5ffff700 1 -- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e680ca020 msgr2=0x7f0e68149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5ffff700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e680ca020 0x7f0e68149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5ffff700 1 -- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e6815d0f0 msgr2=0x7f0e68147ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5ffff700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e6815d0f0 0x7f0e68147ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5ffff700 1 -- 172.21.15.45:0/1244441938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e60009b30 con 0x7f0e680cd700 2023-12-19T18:03:37.621 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5ffff700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e681f6790 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c7c0 tx=0x7f0e5000cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:37.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50011800 con 0x7f0e680cd700 2023-12-19T18:03:37.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e50011960 con 0x7f0e680cd700 2023-12-19T18:03:37.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e50011cd0 con 0x7f0e680cd700 2023-12-19T18:03:37.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6814a1e0 con 0x7f0e680cd700 2023-12-19T18:03:37.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6814a7a0 con 0x7f0e680cd700 2023-12-19T18:03:37.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.616+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e680addc0 con 0x7f0e680cd700 2023-12-19T18:03:37.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.620+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0e50021350 con 0x7f0e680cd700 2023-12-19T18:03:37.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.620+0000 7f0e5effd700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0e48065ad0 0x7f0e48067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:37.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.620+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f0e50083140 con 0x7f0e680cd700 2023-12-19T18:03:37.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.624+0000 7f0e6659c700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0e48065ad0 0x7f0e48067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:37.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.624+0000 7f0e6659c700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0e48065ad0 0x7f0e48067f90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0e58007a60 tx=0x7f0e58008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:37.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.628+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0e50050950 con 0x7f0e680cd700 2023-12-19T18:03:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.828+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e6804ed30 con 0x7f0e680cd700 2023-12-19T18:03:37.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.828+0000 7f0e5effd700 1 -- 172.21.15.45:0/1244441938 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e50053f70 con 0x7f0e680cd700 2023-12-19T18:03:37.834 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:03:37.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.828+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0e48065ad0 msgr2=0x7f0e48067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.828+0000 7f0e6759e700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0e48065ad0 0x7f0e48067f90 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0e58007a60 tx=0x7f0e58008040 comp rx=0 tx=0).stop 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.828+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 msgr2=0x7f0e681f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.828+0000 7f0e6759e700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e681f6790 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f0e5000c7c0 tx=0x7f0e5000cad0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 shutdown_connections 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0e48065ad0 0x7f0e48067f90 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0e6815d0f0 0x7f0e68147ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0e680cd700 0x7f0e681f6790 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 --2- 172.21.15.45:0/1244441938 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0e680ca020 0x7f0e68149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 >> 172.21.15.45:0/1244441938 conn(0x7f0e680ce8c0 msgr2=0x7f0e68070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 shutdown_connections 2023-12-19T18:03:37.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:37.832+0000 7f0e6759e700 1 -- 172.21.15.45:0/1244441938 wait complete. 2023-12-19T18:03:37.859 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:03:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.044+0000 7f7482546700 1 Processor -- start 2023-12-19T18:03:38.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.044+0000 7f7482546700 1 -- start start 2023-12-19T18:03:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f7482546700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b5240 0x7f747c0d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f7482546700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0d2910 con 0x7f747c0b1d60 2023-12-19T18:03:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f7482546700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f747c0d2bf0 con 0x7f747c15d3a0 2023-12-19T18:03:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f7482546700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c0d2240 con 0x7f747c0b5240 2023-12-19T18:03:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f7480ae3700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f747c0b1d60 0x7f747c0b60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59312/0 (socket says 172.21.15.45:59312) 2023-12-19T18:03:38.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f7480ae3700 1 -- 172.21.15.45:0/3629764409 learned_addr learned my addr 172.21.15.45:0/3629764409 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:38.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747b7fe700 1 --2- 172.21.15.45:0/3629764409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b5240 0x7f747c0d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747affd700 1 -- 172.21.15.45:0/3629764409 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 855613527 0 0) 0x7f747c0d2910 con 0x7f747c0b1d60 2023-12-19T18:03:38.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747b7fe700 1 -- 172.21.15.45:0/3629764409 >> v1:172.21.15.73:6789/0 conn(0x7f747c15d3a0 legacy=0x7f747c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747b7fe700 1 -- 172.21.15.45:0/3629764409 >> v1:172.21.15.45:6789/0 conn(0x7f747c0b1d60 legacy=0x7f747c0b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747b7fe700 1 -- 172.21.15.45:0/3629764409 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f747c0d1220 con 0x7f747c0b5240 2023-12-19T18:03:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747b7fe700 1 --2- 172.21.15.45:0/3629764409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b5240 0x7f747c0d1d00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7470009800 tx=0x7f7470009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e89ec3ec7c4e4f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747affd700 1 -- 172.21.15.45:0/3629764409 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7470004230 con 0x7f747c0b5240 2023-12-19T18:03:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747affd700 1 -- 172.21.15.45:0/3629764409 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7470004390 con 0x7f747c0b5240 2023-12-19T18:03:38.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.048+0000 7f747affd700 1 -- 172.21.15.45:0/3629764409 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74700036c0 con 0x7f747c0b5240 2023-12-19T18:03:38.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 -- 172.21.15.45:0/3629764409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b5240 msgr2=0x7f747c0d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 --2- 172.21.15.45:0/3629764409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b5240 0x7f747c0d1d00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7470009800 tx=0x7f7470009b10 comp rx=0 tx=0).stop 2023-12-19T18:03:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 -- 172.21.15.45:0/3629764409 shutdown_connections 2023-12-19T18:03:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 --2- 172.21.15.45:0/3629764409 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b5240 0x7f747c0d1d00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 -- 172.21.15.45:0/3629764409 >> 172.21.15.45:0/3629764409 conn(0x7f747c0cfb30 msgr2=0x7f747c0cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 -- 172.21.15.45:0/3629764409 shutdown_connections 2023-12-19T18:03:38.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.052+0000 7f7482546700 1 -- 172.21.15.45:0/3629764409 wait complete. 2023-12-19T18:03:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.056+0000 7f7482546700 1 Processor -- start 2023-12-19T18:03:38.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.056+0000 7f7482546700 1 -- start start 2023-12-19T18:03:38.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b1d60 0x7f747c1551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f747c0b5240 0x7f747c1f5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 0x7f747c1f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c154600 con 0x7f747c15d3a0 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f747c15dbf0 con 0x7f747c0b5240 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f747c15ded0 con 0x7f747c0b1d60 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 0x7f747c1f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f747bfff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b1d60 0x7f747c1551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 0x7f747c1f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38396/0 (socket says 172.21.15.45:38396) 2023-12-19T18:03:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 -- 172.21.15.45:0/3623332132 learned_addr learned my addr 172.21.15.45:0/3623332132 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f747b7fe700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f747c0b5240 0x7f747c1f5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 -- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b1d60 msgr2=0x7f747c1551a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b1d60 0x7f747c1551a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 -- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f747c0b5240 msgr2=0x7f747c1f5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f747c0b5240 0x7f747c1f5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 -- 172.21.15.45:0/3623332132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74700094b0 con 0x7f747c15d3a0 2023-12-19T18:03:38.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7480ae3700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 0x7f747c1f62d0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7474002230 tx=0x7f747400cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747400aac0 con 0x7f747c15d3a0 2023-12-19T18:03:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f747400ac40 con 0x7f747c15d3a0 2023-12-19T18:03:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f747c15e1b0 con 0x7f747c15d3a0 2023-12-19T18:03:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74740070d0 con 0x7f747c15d3a0 2023-12-19T18:03:38.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.060+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f747c15e770 con 0x7f747c15d3a0 2023-12-19T18:03:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.064+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f747c0d2eb0 con 0x7f747c15d3a0 2023-12-19T18:03:38.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.064+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7474007250 con 0x7f747c15d3a0 2023-12-19T18:03:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.068+0000 7f7478ff9700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7468065ad0 0x7f7468067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.068+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f7474082e30 con 0x7f747c15d3a0 2023-12-19T18:03:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.068+0000 7f747bfff700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7468065ad0 0x7f7468067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.068+0000 7f747bfff700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7468065ad0 0x7f7468067f90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f747c15b360 tx=0x7f746c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.076+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7474050530 con 0x7f747c15d3a0 2023-12-19T18:03:38.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.248+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f747c0741d0 con 0x7f747c15d3a0 2023-12-19T18:03:38.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.248+0000 7f7478ff9700 1 -- 172.21.15.45:0/3623332132 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7474053b50 con 0x7f747c15d3a0 2023-12-19T18:03:38.254 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:03:38.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7468065ad0 msgr2=0x7f7468067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7468065ad0 0x7f7468067f90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f747c15b360 tx=0x7f746c009040 comp rx=0 tx=0).stop 2023-12-19T18:03:38.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 msgr2=0x7f747c1f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 0x7f747c1f62d0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f7474002230 tx=0x7f747400cf50 comp rx=0 tx=0).stop 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 shutdown_connections 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7468065ad0 0x7f7468067f90 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f747c15d3a0 0x7f747c1f62d0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f747c0b5240 0x7f747c1f5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 --2- 172.21.15.45:0/3623332132 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f747c0b1d60 0x7f747c1551a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 >> 172.21.15.45:0/3623332132 conn(0x7f747c0cfb30 msgr2=0x7f747c0b7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 shutdown_connections 2023-12-19T18:03:38.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.252+0000 7f7482546700 1 -- 172.21.15.45:0/3623332132 wait complete. 2023-12-19T18:03:38.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.464+0000 7fa570651700 1 Processor -- start 2023-12-19T18:03:38.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.464+0000 7fa570651700 1 -- start start 2023-12-19T18:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa570651700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5680b5240 0x7fa5680d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa570651700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680d2910 con 0x7fa56815d3a0 2023-12-19T18:03:38.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa570651700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680d2bf0 con 0x7fa5680b1d60 2023-12-19T18:03:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa570651700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680d2240 con 0x7fa5680b5240 2023-12-19T18:03:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56e3ed700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa56815d3a0 0x7fa5680b4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:59328/0 (socket says 172.21.15.45:59328) 2023-12-19T18:03:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56dbec700 1 --2- 172.21.15.45:0/1223635922 >> v2:172.21.15.45:3300/0 conn(0x7fa5680b5240 0x7fa5680d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56e3ed700 1 -- 172.21.15.45:0/1223635922 learned_addr learned my addr 172.21.15.45:0/1223635922 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56dbec700 1 -- 172.21.15.45:0/1223635922 >> v1:172.21.15.73:6789/0 conn(0x7fa5680b1d60 legacy=0x7fa5680b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56dbec700 1 -- 172.21.15.45:0/1223635922 >> v1:172.21.15.45:6789/0 conn(0x7fa56815d3a0 legacy=0x7fa5680b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56dbec700 1 -- 172.21.15.45:0/1223635922 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680d1220 con 0x7fa5680b5240 2023-12-19T18:03:38.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56d3eb700 1 -- 172.21.15.45:0/1223635922 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2569450034 0 0) 0x7fa5680d2bf0 con 0x7fa5680b1d60 2023-12-19T18:03:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56dbec700 1 --2- 172.21.15.45:0/1223635922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b5240 0x7fa5680d1d00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fa558009850 tx=0x7fa558009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c090c1e1c084c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56d3eb700 1 -- 172.21.15.45:0/1223635922 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558004230 con 0x7fa5680b5240 2023-12-19T18:03:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56d3eb700 1 -- 172.21.15.45:0/1223635922 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa558004390 con 0x7fa5680b5240 2023-12-19T18:03:38.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa56d3eb700 1 -- 172.21.15.45:0/1223635922 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5580036c0 con 0x7fa5680b5240 2023-12-19T18:03:38.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.468+0000 7fa570651700 1 -- 172.21.15.45:0/1223635922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b5240 msgr2=0x7fa5680d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 --2- 172.21.15.45:0/1223635922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b5240 0x7fa5680d1d00 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fa558009850 tx=0x7fa558009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 -- 172.21.15.45:0/1223635922 shutdown_connections 2023-12-19T18:03:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 --2- 172.21.15.45:0/1223635922 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b5240 0x7fa5680d1d00 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 -- 172.21.15.45:0/1223635922 >> 172.21.15.45:0/1223635922 conn(0x7fa5680cfb30 msgr2=0x7fa5680cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 -- 172.21.15.45:0/1223635922 shutdown_connections 2023-12-19T18:03:38.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 -- 172.21.15.45:0/1223635922 wait complete. 2023-12-19T18:03:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.472+0000 7fa570651700 1 Processor -- start 2023-12-19T18:03:38.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 -- start start 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b1d60 0x7fa5681f3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5680b5240 0x7fa5681503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa56815d3a0 0x7fa5680aa790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56815e8f0 con 0x7fa5680b1d60 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56815eb00 con 0x7fa5680b5240 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa570651700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56815ede0 con 0x7fa56815d3a0 2023-12-19T18:03:38.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56e3ed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b1d60 0x7fa5681f3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56e3ed700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b1d60 0x7fa5681f3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38424/0 (socket says 172.21.15.45:38424) 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56e3ed700 1 -- 172.21.15.45:0/3871890033 learned_addr learned my addr 172.21.15.45:0/3871890033 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56dbec700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5680b5240 0x7fa5681503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56ebee700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa56815d3a0 0x7fa5680aa790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56dbec700 1 -- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa56815d3a0 msgr2=0x7fa5680aa790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.476+0000 7fa56dbec700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa56815d3a0 0x7fa5680aa790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa56dbec700 1 -- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b1d60 msgr2=0x7fa5681f3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa56dbec700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b1d60 0x7fa5681f3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa56dbec700 1 -- 172.21.15.45:0/3871890033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5580094b0 con 0x7fa5680b5240 2023-12-19T18:03:38.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa56dbec700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5680b5240 0x7fa5681503b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa558013000 tx=0x7fa558004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558011630 con 0x7fa5680b5240 2023-12-19T18:03:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580117b0 con 0x7fa5680b5240 2023-12-19T18:03:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558011b60 con 0x7fa5680b5240 2023-12-19T18:03:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56815f0c0 con 0x7fa5680b5240 2023-12-19T18:03:38.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56815f680 con 0x7fa5680b5240 2023-12-19T18:03:38.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.480+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5680d2eb0 con 0x7fa5680b5240 2023-12-19T18:03:38.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.484+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa558018050 con 0x7fa5680b5240 2023-12-19T18:03:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.484+0000 7fa55effd700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa54c065b20 0x7fa54c067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.484+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fa558083e00 con 0x7fa5680b5240 2023-12-19T18:03:38.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.484+0000 7fa56e3ed700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa54c065b20 0x7fa54c067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.488+0000 7fa56e3ed700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa54c065b20 0x7fa54c067fe0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa564000f60 tx=0x7fa564007f50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.492+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa5580517b0 con 0x7fa5680b5240 2023-12-19T18:03:38.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.672+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa56815f870 con 0x7fa5680b5240 2023-12-19T18:03:38.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.672+0000 7fa55effd700 1 -- 172.21.15.45:0/3871890033 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa558054dd0 con 0x7fa5680b5240 2023-12-19T18:03:38.678 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:03:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa54c065b20 msgr2=0x7fa54c067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa54c065b20 0x7fa54c067fe0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa564000f60 tx=0x7fa564007f50 comp rx=0 tx=0).stop 2023-12-19T18:03:38.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5680b5240 msgr2=0x7fa5681503b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5680b5240 0x7fa5681503b0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa558013000 tx=0x7fa558004770 comp rx=0 tx=0).stop 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 shutdown_connections 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa54c065b20 0x7fa54c067fe0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa56815d3a0 0x7fa5680aa790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5680b5240 0x7fa5681503b0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 --2- 172.21.15.45:0/3871890033 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5680b1d60 0x7fa5681f3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 >> 172.21.15.45:0/3871890033 conn(0x7fa5680cfb30 msgr2=0x7fa5680b2cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 shutdown_connections 2023-12-19T18:03:38.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.676+0000 7fa570651700 1 -- 172.21.15.45:0/3871890033 wait complete. 2023-12-19T18:03:38.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:03:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.880+0000 7f23dca20700 1 Processor -- start 2023-12-19T18:03:38.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.880+0000 7f23dca20700 1 -- start start 2023-12-19T18:03:38.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23dca20700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f23d80ce070 0x7f23d8165370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23dca20700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d8071580 con 0x7f23d80adca0 2023-12-19T18:03:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23dca20700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d8158040 con 0x7f23d80cd580 2023-12-19T18:03:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23dca20700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d806c900 con 0x7f23d80ce070 2023-12-19T18:03:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23cffff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f23d80adca0 0x7f23d8161c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41594/0 (socket says 172.21.15.45:41594) 2023-12-19T18:03:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23cffff700 1 -- 172.21.15.45:0/356230936 learned_addr learned my addr 172.21.15.45:0/356230936 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:38.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d7fff700 1 --2- 172.21.15.45:0/356230936 >> v2:172.21.15.73:3300/0 conn(0x7f23d80ce070 0x7f23d8165370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3830498643 0 0) 0x7f23d8071580 con 0x7f23d80adca0 2023-12-19T18:03:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c40057e0 con 0x7f23d80adca0 2023-12-19T18:03:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035977872 0 0) 0x7f23d8158040 con 0x7f23d80cd580 2023-12-19T18:03:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23d8071580 con 0x7f23d80cd580 2023-12-19T18:03:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d7fff700 1 -- 172.21.15.45:0/356230936 >> v1:172.21.15.73:6789/0 conn(0x7f23d80cd580 legacy=0x7f23d80cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d7fff700 1 -- 172.21.15.45:0/356230936 >> v1:172.21.15.45:6789/0 conn(0x7f23d80adca0 legacy=0x7f23d8161c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d7fff700 1 -- 172.21.15.45:0/356230936 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d815b250 con 0x7f23d80ce070 2023-12-19T18:03:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.884+0000 7f23d7fff700 1 --2- 172.21.15.45:0/356230936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80ce070 0x7f23d8165370 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009d90 tx=0x7f23d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5df8235a23d2eea6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d000e070 con 0x7f23d80ce070 2023-12-19T18:03:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d000bb20 con 0x7f23d80ce070 2023-12-19T18:03:38.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23d6ffd700 1 -- 172.21.15.45:0/356230936 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0012430 con 0x7f23d80ce070 2023-12-19T18:03:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 -- 172.21.15.45:0/356230936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80ce070 msgr2=0x7f23d8165370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 --2- 172.21.15.45:0/356230936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80ce070 0x7f23d8165370 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f23d0009d90 tx=0x7f23d000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 -- 172.21.15.45:0/356230936 shutdown_connections 2023-12-19T18:03:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 --2- 172.21.15.45:0/356230936 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80ce070 0x7f23d8165370 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 -- 172.21.15.45:0/356230936 >> 172.21.15.45:0/356230936 conn(0x7f23d80ce8a0 msgr2=0x7f23d80cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 -- 172.21.15.45:0/356230936 shutdown_connections 2023-12-19T18:03:38.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.888+0000 7f23dca20700 1 -- 172.21.15.45:0/356230936 wait complete. 2023-12-19T18:03:38.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 Processor -- start 2023-12-19T18:03:38.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 -- start start 2023-12-19T18:03:38.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80adca0 0x7f23d80c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d80cd580 0x7f23d81f5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 0x7f23d81f3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81f6520 con 0x7f23d80ce070 2023-12-19T18:03:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81f6780 con 0x7f23d80adca0 2023-12-19T18:03:38.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23dca20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81f6a60 con 0x7f23d80cd580 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 0x7f23d81f3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 0x7f23d81f3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38576/0 (socket says 172.21.15.45:38576) 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 -- 172.21.15.45:0/3947157471 learned_addr learned my addr 172.21.15.45:0/3947157471 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d77fe700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80adca0 0x7f23d80c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23cffff700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d80cd580 0x7f23d81f5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 -- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d80cd580 msgr2=0x7f23d81f5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d80cd580 0x7f23d81f5fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 -- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80adca0 msgr2=0x7f23d80c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80adca0 0x7f23d80c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:38.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23d7fff700 1 -- 172.21.15.45:0/3947157471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009a70 con 0x7f23d80ce070 2023-12-19T18:03:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.892+0000 7f23cffff700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d80cd580 0x7f23d81f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23d7fff700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 0x7f23d81f3260 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f23d80b4a10 tx=0x7f23d0004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0012430 con 0x7f23d80ce070 2023-12-19T18:03:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0020070 con 0x7f23d80ce070 2023-12-19T18:03:38.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d81f6d40 con 0x7f23d80ce070 2023-12-19T18:03:38.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d001ba70 con 0x7f23d80ce070 2023-12-19T18:03:38.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d81f29f0 con 0x7f23d80ce070 2023-12-19T18:03:38.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d81f2f80 con 0x7f23d80ce070 2023-12-19T18:03:38.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.896+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f23d001bbd0 con 0x7f23d80ce070 2023-12-19T18:03:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.900+0000 7f23d4ff9700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f23b8065ad0 0x7f23b8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.900+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f23d0022070 con 0x7f23d80ce070 2023-12-19T18:03:38.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.900+0000 7f23d77fe700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f23b8065ad0 0x7f23b8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:38.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.900+0000 7f23d77fe700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f23b8065ad0 0x7f23b8067f90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f23c80011e0 tx=0x7f23c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:38.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:38.908+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f23d81f2f80 con 0x7f23d80ce070 2023-12-19T18:03:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.096+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23d81f2f80 con 0x7f23d80ce070 2023-12-19T18:03:39.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.096+0000 7f23d4ff9700 1 -- 172.21.15.45:0/3947157471 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v130) v1 ==== 80+0+122 (secure 0 0 0) 0x7f23d81f2f80 con 0x7f23d80ce070 2023-12-19T18:03:39.104 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6837/3417552399 2023-12-20T18:03:28.816185+0000 2023-12-19T18:03:39.104 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6835/3417552399 2023-12-20T18:03:28.816185+0000 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f23b8065ad0 msgr2=0x7f23b8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f23b8065ad0 0x7f23b8067f90 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f23c80011e0 tx=0x7f23c8009040 comp rx=0 tx=0).stop 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 msgr2=0x7f23d81f3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 0x7f23d81f3260 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f23d80b4a10 tx=0x7f23d0004af0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 shutdown_connections 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f23b8065ad0 0x7f23b8067f90 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f23d80ce070 0x7f23d81f3260 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f23d80cd580 0x7f23d81f5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 --2- 172.21.15.45:0/3947157471 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f23d80adca0 0x7f23d80c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 >> 172.21.15.45:0/3947157471 conn(0x7f23d80ce8a0 msgr2=0x7f23d8070470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 shutdown_connections 2023-12-19T18:03:39.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.104+0000 7f23dca20700 1 -- 172.21.15.45:0/3947157471 wait complete. 2023-12-19T18:03:39.112 INFO:teuthology.orchestra.run.smithi045.stderr:listed 2 entries 2023-12-19T18:03:39.132 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:03:39.133 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:03:39.149 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.368+0000 7fc2d1ad1700 1 Processor -- start 2023-12-19T18:03:39.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.368+0000 7fc2d1ad1700 1 -- start start 2023-12-19T18:03:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d1ad1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fc2cc06b810 0x7fc2cc0cb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d1ad1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2cc161750 0x7fc2cc0cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d1ad1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2cc0ccf70 con 0x7fc2cc0cdc70 2023-12-19T18:03:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d1ad1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c9fb0 con 0x7fc2cc161750 2023-12-19T18:03:39.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d1ad1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c99f0 con 0x7fc2cc06b810 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2cc161750 0x7fc2cc0cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fc2cc161750 0x7fc2cc0cd730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38586/0 (socket says 172.21.15.45:38586) 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 -- 172.21.15.45:0/2052276777 learned_addr learned my addr 172.21.15.45:0/2052276777 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d0acf700 1 --2- 172.21.15.45:0/2052276777 >> v2:172.21.15.73:3300/0 conn(0x7fc2cc06b810 0x7fc2cc0cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 -- 172.21.15.45:0/2052276777 >> v2:172.21.15.73:3300/0 conn(0x7fc2cc06b810 msgr2=0x7fc2cc0cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 --2- 172.21.15.45:0/2052276777 >> v2:172.21.15.73:3300/0 conn(0x7fc2cc06b810 0x7fc2cc0cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 -- 172.21.15.45:0/2052276777 >> v1:172.21.15.45:6789/0 conn(0x7fc2cc0cdc70 legacy=0x7fc2cc0ce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2cbfff700 1 -- 172.21.15.45:0/2052276777 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2cc0c9cd0 con 0x7fc2cc161750 2023-12-19T18:03:39.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.372+0000 7fc2d0acf700 1 --2- 172.21.15.45:0/2052276777 >> v2:172.21.15.73:3300/0 conn(0x7fc2cc06b810 0x7fc2cc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:03:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2cbfff700 1 --2- 172.21.15.45:0/2052276777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc161750 0x7fc2cc0cd730 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0724b0 tx=0x7fc2b8009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bfd88e65457e47e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2cb7fe700 1 -- 172.21.15.45:0/2052276777 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800b8a0 con 0x7fc2cc161750 2023-12-19T18:03:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2cb7fe700 1 -- 172.21.15.45:0/2052276777 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b800ba00 con 0x7fc2cc161750 2023-12-19T18:03:39.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2cb7fe700 1 -- 172.21.15.45:0/2052276777 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b800bd90 con 0x7fc2cc161750 2023-12-19T18:03:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/2052276777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc161750 msgr2=0x7fc2cc0cd730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/2052276777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc161750 0x7fc2cc0cd730 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0724b0 tx=0x7fc2b8009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/2052276777 shutdown_connections 2023-12-19T18:03:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/2052276777 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc161750 0x7fc2cc0cd730 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/2052276777 >> v2:172.21.15.73:3300/0 conn(0x7fc2cc06b810 0x7fc2cc0cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/2052276777 >> 172.21.15.45:0/2052276777 conn(0x7fc2cc0b0cf0 msgr2=0x7fc2cc0b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/2052276777 shutdown_connections 2023-12-19T18:03:39.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.376+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/2052276777 wait complete. 2023-12-19T18:03:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 Processor -- start 2023-12-19T18:03:39.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 -- start start 2023-12-19T18:03:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 0x7fc2cc1f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2cc0cdc70 0x7fc2cc1f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2cc161750 0x7fc2cc0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc14f4b0 con 0x7fc2cc06b810 2023-12-19T18:03:39.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0c3d80 con 0x7fc2cc0cdc70 2023-12-19T18:03:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d1ad1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2cc0b4880 con 0x7fc2cc161750 2023-12-19T18:03:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d0acf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 0x7fc2cc1f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d0acf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 0x7fc2cc1f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38598/0 (socket says 172.21.15.45:38598) 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d0acf700 1 -- 172.21.15.45:0/62775461 learned_addr learned my addr 172.21.15.45:0/62775461 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2cbfff700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2cc0cdc70 0x7fc2cc1f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.380+0000 7fc2d12d0700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2cc161750 0x7fc2cc0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d0acf700 1 -- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2cc161750 msgr2=0x7fc2cc0b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d0acf700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2cc161750 0x7fc2cc0b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d0acf700 1 -- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2cc0cdc70 msgr2=0x7fc2cc1f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d0acf700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2cc0cdc70 0x7fc2cc1f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d0acf700 1 -- 172.21.15.45:0/62775461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b8009570 con 0x7fc2cc06b810 2023-12-19T18:03:39.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d12d0700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2cc161750 0x7fc2cc0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d0acf700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 0x7fc2cc1f5e70 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c770 tx=0x7fc2c000ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0011800 con 0x7fc2cc06b810 2023-12-19T18:03:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c0011960 con 0x7fc2cc06b810 2023-12-19T18:03:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0011d10 con 0x7fc2cc06b810 2023-12-19T18:03:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2cc0b4b60 con 0x7fc2cc06b810 2023-12-19T18:03:39.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2cc0c4020 con 0x7fc2cc06b810 2023-12-19T18:03:39.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.384+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2cc04ed30 con 0x7fc2cc06b810 2023-12-19T18:03:39.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.388+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fc2c0018360 con 0x7fc2cc06b810 2023-12-19T18:03:39.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.388+0000 7fc2c97fa700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2b0065ad0 0x7fc2b0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.388+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fc2c00833e0 con 0x7fc2cc06b810 2023-12-19T18:03:39.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.388+0000 7fc2cbfff700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2b0065ad0 0x7fc2b0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.388+0000 7fc2cbfff700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2b0065ad0 0x7fc2b0067f90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc161ba0 tx=0x7fc2b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:39.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.396+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fc2c0050b70 con 0x7fc2cc06b810 2023-12-19T18:03:39.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.568+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2cc066360 con 0x7fc2cc06b810 2023-12-19T18:03:39.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.568+0000 7fc2c97fa700 1 -- 172.21.15.45:0/62775461 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v130) v1 ==== 74+0+16397 (secure 0 0 0) 0x7fc2c0054190 con 0x7fc2cc06b810 2023-12-19T18:03:39.577 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:39.577 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":130,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:28.816230+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:39.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2b0065ad0 msgr2=0x7fc2b0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2b0065ad0 0x7fc2b0067f90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc161ba0 tx=0x7fc2b8008030 comp rx=0 tx=0).stop 2023-12-19T18:03:39.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 msgr2=0x7fc2cc1f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 0x7fc2cc1f5e70 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fc2c000c770 tx=0x7fc2c000ca80 comp rx=0 tx=0).stop 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 shutdown_connections 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fc2b0065ad0 0x7fc2b0067f90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fc2cc161750 0x7fc2cc0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2cc0cdc70 0x7fc2cc1f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 --2- 172.21.15.45:0/62775461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fc2cc06b810 0x7fc2cc1f5e70 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 >> 172.21.15.45:0/62775461 conn(0x7fc2cc0b0cf0 msgr2=0x7fc2cc06cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 shutdown_connections 2023-12-19T18:03:39.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.572+0000 7fc2d1ad1700 1 -- 172.21.15.45:0/62775461 wait complete. 2023-12-19T18:03:39.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:02:59.579656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:03:00.531245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:03:39.601 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:03:39.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.804+0000 7fa93f59e700 1 Processor -- start 2023-12-19T18:03:39.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 -- start start 2023-12-19T18:03:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9400cb700 0x7fa9400cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa94006a670 0x7fa940160c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa940160a60 con 0x7fa94006a670 2023-12-19T18:03:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9400afd80 con 0x7fa9400cb700 2023-12-19T18:03:39.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.808+0000 7fa93f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400af100 con 0x7fa9400cf3c0 2023-12-19T18:03:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93dd9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fa9400cb700 0x7fa9400cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93dd9b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:58876/0 (socket says 172.21.15.45:58876) 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93dd9b700 1 -- 172.21.15.45:0/427891370 learned_addr learned my addr 172.21.15.45:0/427891370 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93ed9d700 1 --2- 172.21.15.45:0/427891370 >> v2:172.21.15.45:3300/0 conn(0x7fa94006a670 0x7fa940160c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 -- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 msgr2=0x7fa94006a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 --2- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 -- 172.21.15.45:0/427891370 >> v2:172.21.15.45:3300/0 conn(0x7fa94006a670 msgr2=0x7fa940160c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 --2- 172.21.15.45:0/427891370 >> v2:172.21.15.45:3300/0 conn(0x7fa94006a670 0x7fa940160c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 -- 172.21.15.45:0/427891370 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9400af3e0 con 0x7fa9400cb700 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93ed9d700 1 --2- 172.21.15.45:0/427891370 >> v2:172.21.15.45:3300/0 conn(0x7fa94006a670 0x7fa940160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:39.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93dd9b700 1 --2- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93e59c700 1 --2- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9400cee80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa9400b24e0 tx=0x7fa930009b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982e60e93901e7a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93d59a700 1 -- 172.21.15.45:0/427891370 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011830 con 0x7fa9400cb700 2023-12-19T18:03:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93d59a700 1 -- 172.21.15.45:0/427891370 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa930011990 con 0x7fa9400cb700 2023-12-19T18:03:39.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93d59a700 1 -- 172.21.15.45:0/427891370 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930011d20 con 0x7fa9400cb700 2023-12-19T18:03:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 -- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 msgr2=0x7fa9400cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 --2- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9400cee80 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fa9400b24e0 tx=0x7fa930009b30 comp rx=0 tx=0).stop 2023-12-19T18:03:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 -- 172.21.15.45:0/427891370 shutdown_connections 2023-12-19T18:03:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 --2- 172.21.15.45:0/427891370 >> v2:172.21.15.45:3300/0 conn(0x7fa94006a670 0x7fa940160c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 --2- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 --2- 172.21.15.45:0/427891370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9400cee80 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 -- 172.21.15.45:0/427891370 >> 172.21.15.45:0/427891370 conn(0x7fa940098d50 msgr2=0x7fa9400cf9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 -- 172.21.15.45:0/427891370 shutdown_connections 2023-12-19T18:03:39.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.812+0000 7fa93f59e700 1 -- 172.21.15.45:0/427891370 wait complete. 2023-12-19T18:03:39.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.816+0000 7fa93f59e700 1 Processor -- start 2023-12-19T18:03:39.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.816+0000 7fa93f59e700 1 -- start start 2023-12-19T18:03:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.816+0000 7fa93f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 0x7fa9400c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.816+0000 7fa93f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9401f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.816+0000 7fa93f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa940152fa0 con 0x7fa94006a670 2023-12-19T18:03:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400c90b0 con 0x7fa9400cb700 2023-12-19T18:03:39.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9400c9390 con 0x7fa9400cf3c0 2023-12-19T18:03:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 0x7fa9400c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 0x7fa9400c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38620/0 (socket says 172.21.15.45:38620) 2023-12-19T18:03:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 -- 172.21.15.45:0/4256556408 learned_addr learned my addr 172.21.15.45:0/4256556408 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93ed9d700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93dd9b700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9401f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 -- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 msgr2=0x7fa94006e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 -- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 msgr2=0x7fa9401f22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9401f22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 -- 172.21.15.45:0/4256556408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934009570 con 0x7fa94006a670 2023-12-19T18:03:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93dd9b700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9401f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:39.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93e59c700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 0x7fa9400c8a60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa9300090b0 tx=0x7fa930004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930004510 con 0x7fa94006a670 2023-12-19T18:03:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93001f070 con 0x7fa94006a670 2023-12-19T18:03:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9300094b0 con 0x7fa94006a670 2023-12-19T18:03:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa930003900 con 0x7fa94006a670 2023-12-19T18:03:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.820+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9401f2810 con 0x7fa94006a670 2023-12-19T18:03:39.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.824+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9400c98b0 con 0x7fa94006a670 2023-12-19T18:03:39.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.824+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa930003a60 con 0x7fa94006a670 2023-12-19T18:03:39.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.824+0000 7fa92effd700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa920065b00 0x7fa920067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:39.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.824+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fa930021070 con 0x7fa94006a670 2023-12-19T18:03:39.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.828+0000 7fa93dd9b700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa920065b00 0x7fa920067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:39.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.828+0000 7fa93dd9b700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa920065b00 0x7fa920067fc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa9400aeaa0 tx=0x7fa934008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:39.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:39.832+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa9400c98b0 con 0x7fa94006a670 2023-12-19T18:03:40.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.012+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa940152d70 con 0x7fa94006a670 2023-12-19T18:03:40.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.012+0000 7fa92effd700 1 -- 172.21.15.45:0/4256556408 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v130) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa940152d70 con 0x7fa94006a670 2023-12-19T18:03:40.020 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa920065b00 msgr2=0x7fa920067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa920065b00 0x7fa920067fc0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa9400aeaa0 tx=0x7fa934008040 comp rx=0 tx=0).stop 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 msgr2=0x7fa9400c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 0x7fa9400c8a60 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa9300090b0 tx=0x7fa930004770 comp rx=0 tx=0).stop 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 shutdown_connections 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa920065b00 0x7fa920067fc0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa9400cf3c0 0x7fa94006e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9400cb700 0x7fa9401f22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 --2- 172.21.15.45:0/4256556408 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa94006a670 0x7fa9400c8a60 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 >> 172.21.15.45:0/4256556408 conn(0x7fa940098d50 msgr2=0x7fa940160ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 shutdown_connections 2023-12-19T18:03:40.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.020+0000 7fa93f59e700 1 -- 172.21.15.45:0/4256556408 wait complete. 2023-12-19T18:03:40.048 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.232+0000 7f7c48ad8700 1 Processor -- start 2023-12-19T18:03:40.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.232+0000 7f7c48ad8700 1 -- start start 2023-12-19T18:03:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c48ad8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4415d3a0 0x7f7c440d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c48ad8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 0x7f7c440b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c48ad8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c440d2910 con 0x7f7c440b22b0 2023-12-19T18:03:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c48ad8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c440d2240 con 0x7f7c440b1d60 2023-12-19T18:03:40.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c48ad8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c440d2bf0 con 0x7f7c4415d3a0 2023-12-19T18:03:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c41d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 0x7f7c440b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c4259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4415d3a0 0x7f7c440d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c41d9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 0x7f7c440b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:35740/0 (socket says 172.21.15.45:35740) 2023-12-19T18:03:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c41d9b700 1 -- 172.21.15.45:0/3286212209 learned_addr learned my addr 172.21.15.45:0/3286212209 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:40.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c42d9d700 1 --1- 172.21.15.45:0/3286212209 >> v1:172.21.15.73:6789/0 conn(0x7f7c440b22b0 0x7f7c440b60b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:60270/0 (socket says 172.21.15.45:60270) 2023-12-19T18:03:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c4259c700 1 -- 172.21.15.45:0/3286212209 >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 msgr2=0x7f7c440b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c4259c700 1 --2- 172.21.15.45:0/3286212209 >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 0x7f7c440b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c4259c700 1 -- 172.21.15.45:0/3286212209 >> v1:172.21.15.73:6789/0 conn(0x7f7c440b22b0 legacy=0x7f7c440b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c4259c700 1 -- 172.21.15.45:0/3286212209 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c440d1220 con 0x7f7c4415d3a0 2023-12-19T18:03:40.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c41d9b700 1 --2- 172.21.15.45:0/3286212209 >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 0x7f7c440b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.236+0000 7f7c4259c700 1 --2- 172.21.15.45:0/3286212209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4415d3a0 0x7f7c440d1d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009850 tx=0x7f7c34009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b578a3ad349a9b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c4159a700 1 -- 172.21.15.45:0/3286212209 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34011830 con 0x7f7c4415d3a0 2023-12-19T18:03:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c4159a700 1 -- 172.21.15.45:0/3286212209 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c34011990 con 0x7f7c4415d3a0 2023-12-19T18:03:40.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c4159a700 1 -- 172.21.15.45:0/3286212209 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34011d40 con 0x7f7c4415d3a0 2023-12-19T18:03:40.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 -- 172.21.15.45:0/3286212209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4415d3a0 msgr2=0x7f7c440d1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/3286212209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4415d3a0 0x7f7c440d1d00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7c34009850 tx=0x7f7c34009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 -- 172.21.15.45:0/3286212209 shutdown_connections 2023-12-19T18:03:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/3286212209 >> v2:172.21.15.73:3300/0 conn(0x7f7c440b1d60 0x7f7c440b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/3286212209 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c4415d3a0 0x7f7c440d1d00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 -- 172.21.15.45:0/3286212209 >> 172.21.15.45:0/3286212209 conn(0x7f7c440cfb30 msgr2=0x7f7c440cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 -- 172.21.15.45:0/3286212209 shutdown_connections 2023-12-19T18:03:40.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.240+0000 7f7c48ad8700 1 -- 172.21.15.45:0/3286212209 wait complete. 2023-12-19T18:03:40.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 Processor -- start 2023-12-19T18:03:40.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 -- start start 2023-12-19T18:03:40.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c440b1d60 0x7f7c44148370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b22b0 0x7f7c44155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c4415d3a0 0x7f7c44155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44154830 con 0x7f7c4415d3a0 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44153bb0 con 0x7f7c440b22b0 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c48ad8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c44153e90 con 0x7f7c440b1d60 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c42d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c4415d3a0 0x7f7c44155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c41d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b22b0 0x7f7c44155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c4259c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c440b1d60 0x7f7c44148370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c42d9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c4415d3a0 0x7f7c44155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38622/0 (socket says 172.21.15.45:38622) 2023-12-19T18:03:40.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c42d9d700 1 -- 172.21.15.45:0/1392894488 learned_addr learned my addr 172.21.15.45:0/1392894488 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:40.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c4259c700 1 -- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b22b0 msgr2=0x7f7c44155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c4259c700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b22b0 0x7f7c44155020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c4259c700 1 -- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c4415d3a0 msgr2=0x7f7c44155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c4259c700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c4415d3a0 0x7f7c44155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.244+0000 7f7c4259c700 1 -- 172.21.15.45:0/1392894488 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c38009570 con 0x7f7c440b1d60 2023-12-19T18:03:40.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c4259c700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c440b1d60 0x7f7c44148370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c34016000 tx=0x7f7c34004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:40.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c340036c0 con 0x7f7c440b1d60 2023-12-19T18:03:40.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c3401e070 con 0x7f7c440b1d60 2023-12-19T18:03:40.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c34003a60 con 0x7f7c440b1d60 2023-12-19T18:03:40.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c340094b0 con 0x7f7c440b1d60 2023-12-19T18:03:40.253 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c44154450 con 0x7f7c440b1d60 2023-12-19T18:03:40.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c440d2eb0 con 0x7f7c440b1d60 2023-12-19T18:03:40.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.248+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7c34003bc0 con 0x7f7c440b1d60 2023-12-19T18:03:40.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.252+0000 7f7c32ffd700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c24065b20 0x7f7c24067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.252+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f7c34084250 con 0x7f7c440b1d60 2023-12-19T18:03:40.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.252+0000 7f7c41d9b700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c24065b20 0x7f7c24067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.252+0000 7f7c41d9b700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c24065b20 0x7f7c24067fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7c4415bac0 tx=0x7f7c380092e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:40.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.260+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f7c34051ae0 con 0x7f7c440b1d60 2023-12-19T18:03:40.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.436+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7c44154970 con 0x7f7c440b1d60 2023-12-19T18:03:40.443 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.436+0000 7f7c32ffd700 1 -- 172.21.15.45:0/1392894488 <== mon.2 v2:172.21.15.73:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v130) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7c44154970 con 0x7f7c440b1d60 2023-12-19T18:03:40.443 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:03:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c24065b20 msgr2=0x7f7c24067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c24065b20 0x7f7c24067fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7c4415bac0 tx=0x7f7c380092e0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c440b1d60 msgr2=0x7f7c44148370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c440b1d60 0x7f7c44148370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7c34016000 tx=0x7f7c34004770 comp rx=0 tx=0).stop 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 shutdown_connections 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7c24065b20 0x7f7c24067fe0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7c4415d3a0 0x7f7c44155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c440b22b0 0x7f7c44155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 --2- 172.21.15.45:0/1392894488 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7c440b1d60 0x7f7c44148370 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 >> 172.21.15.45:0/1392894488 conn(0x7f7c440cfb30 msgr2=0x7f7c440cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 shutdown_connections 2023-12-19T18:03:40.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.440+0000 7f7c48ad8700 1 -- 172.21.15.45:0/1392894488 wait complete. 2023-12-19T18:03:40.472 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:03:40.671 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.664+0000 7fa720e34700 1 Processor -- start 2023-12-19T18:03:40.672 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.664+0000 7fa720e34700 1 -- start start 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa720e34700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c0d1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa720e34700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa71c0b5240 0x7fa71c0b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa720e34700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa71c0d2910 con 0x7fa71c0b1d60 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa720e34700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa71c0d2240 con 0x7fa71c0b5240 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa720e34700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0d2bf0 con 0x7fa71c15d3a0 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa719d9b700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fa71c0b1d60 0x7fa71c0b4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41610/0 (socket says 172.21.15.45:41610) 2023-12-19T18:03:40.674 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa719d9b700 1 -- 172.21.15.45:0/4109275572 learned_addr learned my addr 172.21.15.45:0/4109275572 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71ad9d700 1 --2- 172.21.15.45:0/4109275572 >> v2:172.21.15.45:3300/0 conn(0x7fa71c0b5240 0x7fa71c0b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71a59c700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c0d1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347929562 0 0) 0x7fa71c0d2910 con 0x7fa71c0b1d60 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7040035d0 con 0x7fa71c0b1d60 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3950079793 0 0) 0x7fa7040035d0 con 0x7fa71c0b1d60 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 msgr2=0x7fa71c0d1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c0d1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 >> v2:172.21.15.45:3300/0 conn(0x7fa71c0b5240 msgr2=0x7fa71c0b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 --2- 172.21.15.45:0/4109275572 >> v2:172.21.15.45:3300/0 conn(0x7fa71c0b5240 0x7fa71c0b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c0d1220 con 0x7fa71c0b1d60 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fa710001670 con 0x7fa71c0b1d60 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 >> v1:172.21.15.45:6789/0 conn(0x7fa71c0b1d60 legacy=0x7fa71c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa704003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.676 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa704004060 0x7fa704004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704004db0 0x7fa704005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0d2bf0 con 0x7fa704004db0 2023-12-19T18:03:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa70400bac0 con 0x7fa704004060 2023-12-19T18:03:40.677 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.668+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70400bc80 con 0x7fa71c15d3a0 2023-12-19T18:03:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71ad9d700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704004db0 0x7fa704005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa704003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa719d9b700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa704004060 0x7fa704004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 -- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa704004060 msgr2=0x7fa704004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa704004060 0x7fa704004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 -- 172.21.15.45:0/4109275572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704004db0 msgr2=0x7fa704005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:40.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa704004db0 0x7fa704005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 -- 172.21.15.45:0/4109275572 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7040035d0 con 0x7fa71c15d3a0 2023-12-19T18:03:40.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71a59c700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa704003a90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009b70 tx=0x7fa7040058a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba70d59fa1f16caf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:40.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00e6c0 con 0x7fa71c15d3a0 2023-12-19T18:03:40.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa70c00e820 con 0x7fa71c15d3a0 2023-12-19T18:03:40.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71959a700 1 -- 172.21.15.45:0/4109275572 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa70c00eb90 con 0x7fa71c15d3a0 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa720e34700 1 -- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 msgr2=0x7fa704003a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa720e34700 1 --2- 172.21.15.45:0/4109275572 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa704003a90 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa70c009b70 tx=0x7fa7040058a0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa71ad9d700 1 -- 172.21.15.45:0/4109275572 reap_dead start 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa720e34700 1 -- 172.21.15.45:0/4109275572 shutdown_connections 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa720e34700 1 -- 172.21.15.45:0/4109275572 >> 172.21.15.45:0/4109275572 conn(0x7fa71c0cfb30 msgr2=0x7fa71c0cff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa720e34700 1 -- 172.21.15.45:0/4109275572 shutdown_connections 2023-12-19T18:03:40.680 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.672+0000 7fa720e34700 1 -- 172.21.15.45:0/4109275572 wait complete. 2023-12-19T18:03:40.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.676+0000 7fa720e34700 1 Processor -- start 2023-12-19T18:03:40.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.676+0000 7fa720e34700 1 -- start start 2023-12-19T18:03:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c1519d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c15f610 0x7fa71c15fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 0x7fa71c0b8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c0b87d0 con 0x7fa71c0b7de0 2023-12-19T18:03:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c151f10 con 0x7fa71c15f610 2023-12-19T18:03:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa71c154900 con 0x7fa71c15d3a0 2023-12-19T18:03:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 0x7fa71c0b8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 0x7fa71c0b8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38650/0 (socket says 172.21.15.45:38650) 2023-12-19T18:03:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa719d9b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c15f610 0x7fa71c15fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 -- 172.21.15.45:0/2423827270 learned_addr learned my addr 172.21.15.45:0/2423827270 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71a59c700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c1519d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 -- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 msgr2=0x7fa71c1519d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c1519d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 -- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c15f610 msgr2=0x7fa71c15fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c15f610 0x7fa71c15fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 -- 172.21.15.45:0/2423827270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa71c1600d0 con 0x7fa71c0b7de0 2023-12-19T18:03:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa71ad9d700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 0x7fa71c0b8290 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa71c06cbd0 tx=0x7fa714011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400e040 con 0x7fa71c0b7de0 2023-12-19T18:03:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa71400f040 con 0x7fa71c0b7de0 2023-12-19T18:03:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa71400fc40 con 0x7fa71c0b7de0 2023-12-19T18:03:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.680+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa71c1603b0 con 0x7fa71c0b7de0 2023-12-19T18:03:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.684+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa71c154bc0 con 0x7fa71c0b7de0 2023-12-19T18:03:40.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.684+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa71c0d2eb0 con 0x7fa71c0b7de0 2023-12-19T18:03:40.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.684+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa714015430 con 0x7fa71c0b7de0 2023-12-19T18:03:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.684+0000 7fa70affd700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6fc065b00 0x7fa6fc067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.684+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7fa714083660 con 0x7fa71c0b7de0 2023-12-19T18:03:40.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.688+0000 7fa71a59c700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6fc065b00 0x7fa6fc067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:40.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.688+0000 7fa71a59c700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6fc065b00 0x7fa6fc067fc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0090b0 tx=0x7fa70c01e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.692+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa714050e70 con 0x7fa71c0b7de0 2023-12-19T18:03:40.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.876+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa71c0741d0 con 0x7fa71c0b7de0 2023-12-19T18:03:40.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa70affd700 1 -- 172.21.15.45:0/2423827270 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v130) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa714054490 con 0x7fa71c0b7de0 2023-12-19T18:03:40.885 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:03:40.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6fc065b00 msgr2=0x7fa6fc067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6fc065b00 0x7fa6fc067fc0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa70c0090b0 tx=0x7fa70c01e040 comp rx=0 tx=0).stop 2023-12-19T18:03:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 msgr2=0x7fa71c0b8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 0x7fa71c0b8290 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa71c06cbd0 tx=0x7fa714011ed0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 shutdown_connections 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa6fc065b00 0x7fa6fc067fc0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa71c0b7de0 0x7fa71c0b8290 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa71c15f610 0x7fa71c15fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 --2- 172.21.15.45:0/2423827270 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa71c15d3a0 0x7fa71c1519d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.880+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 >> 172.21.15.45:0/2423827270 conn(0x7fa71c0cfb30 msgr2=0x7fa71c0b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.884+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 shutdown_connections 2023-12-19T18:03:40.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:40.884+0000 7fa720e34700 1 -- 172.21.15.45:0/2423827270 wait complete. 2023-12-19T18:03:40.909 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:03:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.076+0000 7f4022caa700 1 Processor -- start 2023-12-19T18:03:41.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.076+0000 7f4022caa700 1 -- start start 2023-12-19T18:03:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.076+0000 7f4022caa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c070a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.076+0000 7f4022caa700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c0705e0 con 0x7f401c0b2090 2023-12-19T18:03:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.076+0000 7f4022caa700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f401c15bc10 con 0x7f401c0b2470 2023-12-19T18:03:41.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.076+0000 7f4022caa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c155980 con 0x7f401c0c87c0 2023-12-19T18:03:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4021ca8700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f401c0b2090 0x7f401c15b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:41612/0 (socket says 172.21.15.45:41612) 2023-12-19T18:03:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4021ca8700 1 -- 172.21.15.45:0/1488427456 learned_addr learned my addr 172.21.15.45:0/1488427456 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:41.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f40224a9700 1 --2- 172.21.15.45:0/1488427456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c070a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455688818 0 0) 0x7f401c0705e0 con 0x7f401c0b2090 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40080035d0 con 0x7f401c0b2090 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211993883 0 0) 0x7f401c15bc10 con 0x7f401c0b2470 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f401c0705e0 con 0x7f401c0b2470 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f40224a9700 1 -- 172.21.15.45:0/1488427456 >> v1:172.21.15.73:6789/0 conn(0x7f401c0b2470 legacy=0x7f401c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f40224a9700 1 -- 172.21.15.45:0/1488427456 >> v1:172.21.15.45:6789/0 conn(0x7f401c0b2090 legacy=0x7f401c15b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f40224a9700 1 -- 172.21.15.45:0/1488427456 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f401c15bef0 con 0x7f401c0c87c0 2023-12-19T18:03:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f40224a9700 1 --2- 172.21.15.45:0/1488427456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c070a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4014009dc0 tx=0x7f401400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341175a67c40ee56 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400e070 con 0x7f401c0c87c0 2023-12-19T18:03:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401400bb20 con 0x7f401c0c87c0 2023-12-19T18:03:41.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4020ca6700 1 -- 172.21.15.45:0/1488427456 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4014012430 con 0x7f401c0c87c0 2023-12-19T18:03:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4022caa700 1 -- 172.21.15.45:0/1488427456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 msgr2=0x7f401c070a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4022caa700 1 --2- 172.21.15.45:0/1488427456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c070a70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4014009dc0 tx=0x7f401400b330 comp rx=0 tx=0).stop 2023-12-19T18:03:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4022caa700 1 -- 172.21.15.45:0/1488427456 shutdown_connections 2023-12-19T18:03:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4022caa700 1 --2- 172.21.15.45:0/1488427456 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c070a70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.080+0000 7f4022caa700 1 -- 172.21.15.45:0/1488427456 >> 172.21.15.45:0/1488427456 conn(0x7f401c0ce910 msgr2=0x7f401c0cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.084+0000 7f4022caa700 1 -- 172.21.15.45:0/1488427456 shutdown_connections 2023-12-19T18:03:41.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.084+0000 7f4022caa700 1 -- 172.21.15.45:0/1488427456 wait complete. 2023-12-19T18:03:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.084+0000 7f4022caa700 1 Processor -- start 2023-12-19T18:03:41.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.084+0000 7f4022caa700 1 -- start start 2023-12-19T18:03:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f401c0b2090 0x7f401c153d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:41.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 0x7f401c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c0c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0c46f0 con 0x7f401c0b2470 2023-12-19T18:03:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401c15ee50 con 0x7f401c0b2090 2023-12-19T18:03:41.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f401c0c8ed0 con 0x7f401c0c87c0 2023-12-19T18:03:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 0x7f401c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 0x7f401c15a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38654/0 (socket says 172.21.15.45:38654) 2023-12-19T18:03:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 -- 172.21.15.45:0/403721940 learned_addr learned my addr 172.21.15.45:0/403721940 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4021ca8700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f401c0b2090 0x7f401c153d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40224a9700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c0c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 -- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 msgr2=0x7f401c0c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c0c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 -- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f401c0b2090 msgr2=0x7f401c153d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f401c0b2090 0x7f401c153d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 -- 172.21.15.45:0/403721940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014009a70 con 0x7f401c0b2470 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40214a7700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 0x7f401c15a290 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c760 tx=0x7f400c00ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0052d0 con 0x7f401c0b2470 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c005450 con 0x7f401c0b2470 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f401c06cd60 con 0x7f401c0b2470 2023-12-19T18:03:41.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c0038e0 con 0x7f401c0b2470 2023-12-19T18:03:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.088+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f401c0c9450 con 0x7f401c0b2470 2023-12-19T18:03:41.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.092+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401c04ed30 con 0x7f401c0b2470 2023-12-19T18:03:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.092+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f400c003a40 con 0x7f401c0b2470 2023-12-19T18:03:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.092+0000 7f40127fc700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4000065ad0 0x7f4000067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.092+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f400c082730 con 0x7f401c0b2470 2023-12-19T18:03:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.092+0000 7f4021ca8700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4000065ad0 0x7f4000067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.096+0000 7f4021ca8700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4000065ad0 0x7f4000067f90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4018000f60 tx=0x7f4018007e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.100+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f400c04ff40 con 0x7f401c0b2470 2023-12-19T18:03:41.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.292+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f401c155090 con 0x7f401c0b2470 2023-12-19T18:03:41.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.292+0000 7f40127fc700 1 -- 172.21.15.45:0/403721940 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v130) v1 ==== 80+0+122 (secure 0 0 0) 0x7f400c053560 con 0x7f401c0b2470 2023-12-19T18:03:41.299 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6837/3417552399 2023-12-20T18:03:28.816185+0000 2023-12-19T18:03:41.299 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6835/3417552399 2023-12-20T18:03:28.816185+0000 2023-12-19T18:03:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4000065ad0 msgr2=0x7f4000067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4000065ad0 0x7f4000067f90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4018000f60 tx=0x7f4018007e00 comp rx=0 tx=0).stop 2023-12-19T18:03:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 msgr2=0x7f401c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:41.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 0x7f401c15a290 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f400c00c760 tx=0x7f400c00ca70 comp rx=0 tx=0).stop 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 shutdown_connections 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4000065ad0 0x7f4000067f90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f401c0c87c0 0x7f401c0c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f401c0b2470 0x7f401c15a290 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 --2- 172.21.15.45:0/403721940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f401c0b2090 0x7f401c153d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 >> 172.21.15.45:0/403721940 conn(0x7f401c0ce910 msgr2=0x7f401c15d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 shutdown_connections 2023-12-19T18:03:41.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:41.296+0000 7f4022caa700 1 -- 172.21.15.45:0/403721940 wait complete. 2023-12-19T18:03:41.305 INFO:teuthology.orchestra.run.smithi045.stderr:listed 2 entries 2023-12-19T18:03:41.323 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T18:03:41.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:41.324 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:41.355 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[59498]: fuse finished with error 0 and tester_r 0 2023-12-19T18:03:41.359 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:03:47.460 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:03:47.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:47.461 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:03:47.483 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:03:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.708+0000 7f5c69745700 1 Processor -- start 2023-12-19T18:03:47.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.708+0000 7f5c69745700 1 -- start start 2023-12-19T18:03:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c69745700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5c641617f0 0x7f5c640ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c69745700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 0x7f5c640cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c69745700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c64070570 0x7f5c640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c69745700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c64070f20 con 0x7f5c64070570 2023-12-19T18:03:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c69745700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c640c9350 con 0x7f5c641617f0 2023-12-19T18:03:47.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c69745700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640adde0 con 0x7f5c640c8ef0 2023-12-19T18:03:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 0x7f5c640cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c63fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5c641617f0 0x7f5c640ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 0x7f5c640cd840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:58966/0 (socket says 172.21.15.45:58966) 2023-12-19T18:03:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 -- 172.21.15.45:0/2477478506 learned_addr learned my addr 172.21.15.45:0/2477478506 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c68f44700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5c64070570 0x7f5c640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.718 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 -- 172.21.15.45:0/2477478506 >> v2:172.21.15.73:3300/0 conn(0x7f5c641617f0 msgr2=0x7f5c640ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 --2- 172.21.15.45:0/2477478506 >> v2:172.21.15.73:3300/0 conn(0x7f5c641617f0 0x7f5c640ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 -- 172.21.15.45:0/2477478506 >> v2:172.21.15.45:3300/0 conn(0x7f5c64070570 msgr2=0x7f5c640709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 --2- 172.21.15.45:0/2477478506 >> v2:172.21.15.45:3300/0 conn(0x7f5c64070570 0x7f5c640709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 -- 172.21.15.45:0/2477478506 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c640ae0c0 con 0x7f5c640c8ef0 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c637fe700 1 --2- 172.21.15.45:0/2477478506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 0x7f5c640cd840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c640c9520 tx=0x7f5c58009bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20472ce9408edac2 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c62ffd700 1 -- 172.21.15.45:0/2477478506 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58004230 con 0x7f5c640c8ef0 2023-12-19T18:03:47.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c62ffd700 1 -- 172.21.15.45:0/2477478506 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58004390 con 0x7f5c640c8ef0 2023-12-19T18:03:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.712+0000 7f5c62ffd700 1 -- 172.21.15.45:0/2477478506 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580036c0 con 0x7f5c640c8ef0 2023-12-19T18:03:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 -- 172.21.15.45:0/2477478506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 msgr2=0x7f5c640cd840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:47.720 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 --2- 172.21.15.45:0/2477478506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 0x7f5c640cd840 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5c640c9520 tx=0x7f5c58009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 -- 172.21.15.45:0/2477478506 shutdown_connections 2023-12-19T18:03:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 --2- 172.21.15.45:0/2477478506 >> v2:172.21.15.45:3300/0 conn(0x7f5c64070570 0x7f5c640709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 --2- 172.21.15.45:0/2477478506 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c640c8ef0 0x7f5c640cd840 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 --2- 172.21.15.45:0/2477478506 >> v2:172.21.15.73:3300/0 conn(0x7f5c641617f0 0x7f5c640ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 -- 172.21.15.45:0/2477478506 >> 172.21.15.45:0/2477478506 conn(0x7f5c640ce8a0 msgr2=0x7f5c640cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:47.721 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 -- 172.21.15.45:0/2477478506 shutdown_connections 2023-12-19T18:03:47.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.716+0000 7f5c69745700 1 -- 172.21.15.45:0/2477478506 wait complete. 2023-12-19T18:03:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 Processor -- start 2023-12-19T18:03:47.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 -- start start 2023-12-19T18:03:47.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 0x7f5c640c8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c640c8ef0 0x7f5c64163c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c641617f0 0x7f5c64153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c64154660 con 0x7f5c64070570 2023-12-19T18:03:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640c78b0 con 0x7f5c640c8ef0 2023-12-19T18:03:47.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c69745700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c640c7b90 con 0x7f5c641617f0 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 0x7f5c640c8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 0x7f5c640c8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38670/0 (socket says 172.21.15.45:38670) 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 -- 172.21.15.45:0/957221545 learned_addr learned my addr 172.21.15.45:0/957221545 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c68f44700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c641617f0 0x7f5c64153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c637fe700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c640c8ef0 0x7f5c64163c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 -- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c641617f0 msgr2=0x7f5c64153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c641617f0 0x7f5c64153930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 -- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c640c8ef0 msgr2=0x7f5c64163c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c640c8ef0 0x7f5c64163c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.728 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.720+0000 7f5c63fff700 1 -- 172.21.15.45:0/957221545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c58009570 con 0x7f5c64070570 2023-12-19T18:03:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c63fff700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 0x7f5c640c8670 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400e9d0 tx=0x7f5c5400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c54009720 con 0x7f5c64070570 2023-12-19T18:03:47.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5400ee70 con 0x7f5c64070570 2023-12-19T18:03:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c640c7e70 con 0x7f5c64070570 2023-12-19T18:03:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5400ca50 con 0x7f5c64070570 2023-12-19T18:03:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c640c8bb0 con 0x7f5c64070570 2023-12-19T18:03:47.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6404ed30 con 0x7f5c64070570 2023-12-19T18:03:47.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.724+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5c5400cbb0 con 0x7f5c64070570 2023-12-19T18:03:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.728+0000 7f5c60ff9700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c50065ad0 0x7f5c50067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:47.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.728+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 6115+0+0 (secure 0 0 0) 0x7f5c540832c0 con 0x7f5c64070570 2023-12-19T18:03:47.734 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.728+0000 7f5c637fe700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c50065ad0 0x7f5c50067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:47.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.728+0000 7f5c637fe700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c50065ad0 0x7f5c50067f90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5c640c9520 tx=0x7f5c58008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:47.740 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.732+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5c54050a40 con 0x7f5c64070570 2023-12-19T18:03:47.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.944+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5c640b4820 con 0x7f5c64070570 2023-12-19T18:03:47.954 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:03:47.948+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:03:47.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.964+0000 7f5c60ff9700 1 -- 172.21.15.45:0/957221545 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v106) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5c5400ce60 con 0x7f5c64070570 2023-12-19T18:03:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c50065ad0 msgr2=0x7f5c50067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c50065ad0 0x7f5c50067f90 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5c640c9520 tx=0x7f5c58008030 comp rx=0 tx=0).stop 2023-12-19T18:03:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 msgr2=0x7f5c640c8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 0x7f5c640c8670 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f5c5400e9d0 tx=0x7f5c5400ece0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 shutdown_connections 2023-12-19T18:03:47.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5c50065ad0 0x7f5c50067f90 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5c641617f0 0x7f5c64153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5c640c8ef0 0x7f5c64163c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 --2- 172.21.15.45:0/957221545 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5c64070570 0x7f5c640c8670 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 >> 172.21.15.45:0/957221545 conn(0x7f5c640ce8a0 msgr2=0x7f5c640c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 shutdown_connections 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:47.968+0000 7f5c69745700 1 -- 172.21.15.45:0/957221545 wait complete. 2023-12-19T18:03:47.978 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:03:47.985 INFO:tasks.ceph.mds.b.smithi073.stderr: -1074> 2023-12-19T18:03:37.000+0000 7f6a67410700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:03:47.999 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents 2023-12-19T18:03:48.037 INFO:tasks.ceph.mds.b.smithi073.stdout:starting mds.b at 2023-12-19T18:03:48.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.056+0000 7f089d692840 1 -- start start 2023-12-19T18:03:48.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.056+0000 7f089d692840 1 Processor -- start 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 0x55f19a7ae580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19a709400 0x55f19a7aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19a709000 0x55f19a7af080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19a73fe00 con 0x55f19a709800 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788a00 con 0x55f19a709000 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788640 con 0x55f19a709400 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 0x55f19a7ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 0x55f19a7ae580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38678/0 (socket says 172.21.15.45:38678) 2023-12-19T18:03:48.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 -- 172.21.15.45:0/4000328638 learned_addr learned my addr 172.21.15.45:0/4000328638 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:48.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089c64f700 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19a709000 0x55f19a7af080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089b64d700 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19a709400 0x55f19a7aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 -- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19a709400 msgr2=0x55f19a7aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19a709400 0x55f19a7aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 -- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19a709000 msgr2=0x55f19a7af080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19a709000 0x55f19a7af080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 -- 172.21.15.45:0/4000328638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19a72ab60 con 0x55f19a709800 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089be4e700 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 0x55f19a7ae580 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x55f19a86f2f0 tx=0x55f19b4f8d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f412b9aa24b96d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f0899649700 1 -- 172.21.15.45:0/4000328638 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f19a739600 con 0x55f19a709800 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f0899649700 1 -- 172.21.15.45:0/4000328638 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f19a754900 con 0x55f19a709800 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f0899649700 1 -- 172.21.15.45:0/4000328638 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f19a7391e0 con 0x55f19a709800 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f19a72a340 con 0x55f19a709800 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55f19a72a000 con 0x55f19a709800 2023-12-19T18:03:48.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f089d692840 4 waiting for MDS map... 2023-12-19T18:03:48.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.060+0000 7f0899649700 1 -- 172.21.15.45:0/4000328638 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x55f19a742c40 con 0x55f19a709800 2023-12-19T18:03:48.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f0899649700 1 -- 172.21.15.45:0/4000328638 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 106) v1 ==== 2573+0+0 (secure 0 0 0) 0x55f19aa16900 con 0x55f19a709800 2023-12-19T18:03:48.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 4 Got MDS map 106 2023-12-19T18:03:48.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 4 datascan.main: Using metadata pool output 2023-12-19T18:03:48.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 4 datascan.main: connecting to RADOS... 2023-12-19T18:03:48.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 Processor -- start 2023-12-19T18:03:48.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 -- start start 2023-12-19T18:03:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7af600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 0x55f19a7afb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0ac00 0x55f19a7b0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788500 con 0x55f19aa0a800 2023-12-19T18:03:48.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19a7883c0 con 0x55f19aa0a400 2023-12-19T18:03:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089d692840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788a00 con 0x55f19aa0ac00 2023-12-19T18:03:48.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089be4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 0x55f19a7afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089be4e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 0x55f19a7afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38692/0 (socket says 172.21.15.45:38692) 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089be4e700 1 -- 172.21.15.45:0/2389657929 learned_addr learned my addr 172.21.15.45:0/2389657929 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089c64f700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.064+0000 7f089b64d700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0ac00 0x55f19a7b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089be4e700 1 -- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0ac00 msgr2=0x55f19a7b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089be4e700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0ac00 0x55f19a7b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089be4e700 1 -- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 msgr2=0x55f19a7af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089be4e700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089be4e700 1 -- 172.21.15.45:0/2389657929 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19a72aea0 con 0x55f19aa0a800 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089c64f700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089b64d700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0ac00 0x55f19a7b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:48.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089be4e700 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 0x55f19a7afb80 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x55f19a86f8f0 tx=0x55f19b4f8b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654f753cf1f80c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f0897645700 1 -- 172.21.15.45:0/2389657929 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f19a738f20 con 0x55f19aa0a800 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f0897645700 1 -- 172.21.15.45:0/2389657929 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f19b4ee780 con 0x55f19aa0a800 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f0897645700 1 -- 172.21.15.45:0/2389657929 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f19a739600 con 0x55f19aa0a800 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- 172.21.15.45:0/2389657929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 msgr2=0x55f19a7afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 0x55f19a7afb80 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x55f19a86f8f0 tx=0x55f19b4f8b40 comp rx=0 tx=0).stop 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- 172.21.15.45:0/2389657929 shutdown_connections 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0ac00 0x55f19a7b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0a800 0x55f19a7afb80 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- 172.21.15.45:0/2389657929 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- 172.21.15.45:0/2389657929 >> 172.21.15.45:0/2389657929 conn(0x55f19a708c00 msgr2=0x55f19a81d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- 172.21.15.45:0/2389657929 shutdown_connections 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- 172.21.15.45:0/2389657929 wait complete. 2023-12-19T18:03:48.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 Processor -- start 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- start start 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7b1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0a800 0x55f19a7b0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 0x55f19a7b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788280 con 0x55f19aa0ac00 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788140 con 0x55f19aa0a400 2023-12-19T18:03:48.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.068+0000 7f089d692840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f19a788000 con 0x55f19aa0a800 2023-12-19T18:03:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 0x55f19a7b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089c64f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7b1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 0x55f19a7b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38702/0 (socket says 172.21.15.45:38702) 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089c64f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7b1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:35830/0 (socket says 172.21.15.45:35830) 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 learned_addr learned my addr 172.21.15.45:0/2338016095 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0a800 0x55f19a7b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0a800 msgr2=0x55f19a7b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19aa0a800 0x55f19a7b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 msgr2=0x55f19a7b1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19aa0a400 0x55f19a7b1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f19a72ab60 con 0x55f19aa0ac00 2023-12-19T18:03:48.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 0x55f19a7b0680 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x55f19aa23410 tx=0x55f19aa24e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f0895e42700 1 -- 172.21.15.45:0/2338016095 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f19a739080 con 0x55f19aa0ac00 2023-12-19T18:03:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f0895e42700 1 -- 172.21.15.45:0/2338016095 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f19a754180 con 0x55f19aa0ac00 2023-12-19T18:03:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f0895e42700 1 -- 172.21.15.45:0/2338016095 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55f19a738f20 con 0x55f19aa0ac00 2023-12-19T18:03:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f19a72a340 con 0x55f19aa0ac00 2023-12-19T18:03:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f19a72a000 con 0x55f19aa0ac00 2023-12-19T18:03:48.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.072+0000 7f089d692840 4 datascan.init: resolving metadata pool 17 2023-12-19T18:03:48.081 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f0895e42700 1 -- 172.21.15.45:0/2338016095 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55f19a766840 con 0x55f19aa0ac00 2023-12-19T18:03:48.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f0895e42700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f19ab66000 0x55f19a7b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f0895e42700 1 -- 172.21.15.45:0/2338016095 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x55f19a742a80 con 0x55f19aa0ac00 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089d692840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089d692840 4 datascan.main: data pool 'cephfs_data' has ID 18 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089d692840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f19ab66000 0x55f19a7b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f19aa0b000 0x55f19a7b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:1 18.0 18:00000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b400 con 0x55f19aa0b000 2023-12-19T18:03:48.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f19aa0b000 0x55f19a7b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f19ab66000 0x55f19a7b1700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55f19a86e870 tx=0x55f19ab70000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.076+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f19aa0b000 0x55f19a7b0100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.084+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(1 [pgnls start_epoch 131 out=81b] v129'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.084+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:2 18.0 18:012cdbc7:::10000000206.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aa0b000 2023-12-19T18:03:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.084+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(2 10000000206.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.084+0000 7f089d692840 10 datascan.operator(): handling object 1099511628294.0 2023-12-19T18:03:48.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.084+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 18.0 18:012cdbc7:::10000000206.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aa0b000 2023-12-19T18:03:48.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.088+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(3 10000000206.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.088+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55f19ab66800 0x55f19a7afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.088+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:4 18.20 18:04000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab66800 2023-12-19T18:03:48.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.088+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55f19ab66800 0x55f19a7afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.088+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55f19ab66800 0x55f19a7afb80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.092+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(4 [pgnls start_epoch 131 out=81b] v129'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.092+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:5 18.20 18:05552577:::1000000020b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab66800 2023-12-19T18:03:48.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.092+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(5 1000000020b.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.092+0000 7f089d692840 10 datascan.operator(): handling object 1099511628299.0 2023-12-19T18:03:48.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.092+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:6 18.20 18:05552577:::1000000020b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67400 con 0x55f19ab66800 2023-12-19T18:03:48.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(6 1000000020b.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55f19ab67800 0x55f19a7af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:7 18.10 18:08000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab67800 2023-12-19T18:03:48.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55f19ab67800 0x55f19a7af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55f19ab67800 0x55f19a7af600 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(7 [pgnls start_epoch 131 out=101b] v129'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.096+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:8 18.10 18:083d5826:::1000000022a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab67800 2023-12-19T18:03:48.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.100+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(8 1000000022a.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.100+0000 7f089d692840 10 datascan.operator(): handling object 1099511628330.0 2023-12-19T18:03:48.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.100+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:9 18.10 18:083d5826:::1000000022a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab67800 2023-12-19T18:03:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(9 1000000022a.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:10 18.10 18:08500202::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67800 2023-12-19T18:03:48.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(10 [pgnls start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:11 18.10 18:08500202:::1000000023e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b400 con 0x55f19ab67800 2023-12-19T18:03:48.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(11 1000000023e.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089d692840 10 datascan.operator(): handling object 1099511628350.0 2023-12-19T18:03:48.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.104+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:12 18.10 18:08500202:::1000000023e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab67800 2023-12-19T18:03:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(12 1000000023e.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 18.10 18:08b99fea::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab67800 2023-12-19T18:03:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(13 [pgnls start_epoch 131 out=101b] v131'16 uv16 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:14 18.10 18:08b99fea:::100000001fd.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab67800 2023-12-19T18:03:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(14 100000001fd.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089d692840 10 datascan.operator(): handling object 1099511628285.0 2023-12-19T18:03:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.108+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:15 18.10 18:08b99fea:::100000001fd.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab67800 2023-12-19T18:03:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(15 100000001fd.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:16 18.10 18:08e6f8ca::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67800 2023-12-19T18:03:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(16 [pgnls start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:17 18.10 18:08e6f8ca:::10000000257.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab67800 2023-12-19T18:03:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(17 10000000257.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089d692840 10 datascan.operator(): handling object 1099511628375.0 2023-12-19T18:03:48.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.112+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 18.10 18:08e6f8ca:::10000000257.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab67800 2023-12-19T18:03:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(18 10000000257.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:19 18.30 18:0c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19aa0b000 2023-12-19T18:03:48.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(19 [pgnls start_epoch 131 out=101b] v129'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:20 18.30 18:0c00cb85:::1000000021d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b400 con 0x55f19aa0b000 2023-12-19T18:03:48.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(20 1000000021d.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089d692840 10 datascan.operator(): handling object 1099511628317.0 2023-12-19T18:03:48.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.116+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:21 18.30 18:0c00cb85:::1000000021d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aa0b000 2023-12-19T18:03:48.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.120+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(21 1000000021d.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.120+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:22 18.30 18:0c28cce1::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b400 con 0x55f19aa0b000 2023-12-19T18:03:48.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.120+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(22 [pgnls start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.120+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:23 18.30 18:0c28cce1:::10000000244.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aa0b000 2023-12-19T18:03:48.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(23 10000000244.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089d692840 10 datascan.operator(): handling object 1099511628356.0 2023-12-19T18:03:48.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:24 18.30 18:0c28cce1:::10000000244.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aa0b000 2023-12-19T18:03:48.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(24 10000000244.00000000 [call] v131'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:25 18.30 18:0cc9e906::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19aa0b000 2023-12-19T18:03:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(25 [pgnls start_epoch 131 out=101b] v131'19 uv19 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:26 18.30 18:0cc9e906:::10000000227.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aa0b000 2023-12-19T18:03:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(26 10000000227.00000000 [stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089d692840 10 datascan.operator(): handling object 1099511628327.0 2023-12-19T18:03:48.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.124+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 18.30 18:0cc9e906:::10000000227.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19aa0b000 2023-12-19T18:03:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(27 10000000227.00000000 [call] v131'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:28 18.30 18:0e3d5a27::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19aa0b000 2023-12-19T18:03:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(28 [pgnls start_epoch 131 out=81b] v131'20 uv20 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 18.30 18:0e3d5a27:::10000000250.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19aa0b000 2023-12-19T18:03:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(29 10000000250.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089d692840 10 datascan.operator(): handling object 1099511628368.0 2023-12-19T18:03:48.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.128+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:30 18.30 18:0e3d5a27:::10000000250.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aa0b000 2023-12-19T18:03:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(30 10000000250.00000000 [call] v131'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:31 18.8 18:10000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19aa0b000 2023-12-19T18:03:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(31 [pgnls start_epoch 131 out=49b] v129'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:32 18.28 18:14000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b400 con 0x55f19ab66800 2023-12-19T18:03:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(32 [pgnls start_epoch 131 out=101b] v129'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:33 18.28 18:14ce3b86:::10000000233.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab66800 2023-12-19T18:03:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(33 10000000233.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089d692840 10 datascan.operator(): handling object 1099511628339.0 2023-12-19T18:03:48.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.132+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:34 18.28 18:14ce3b86:::10000000233.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab66800 2023-12-19T18:03:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.136+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(34 10000000233.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.136+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:35 18.28 18:15246602::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab66800 2023-12-19T18:03:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.140+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(35 [pgnls start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.140+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:36 18.28 18:15246602:::10000000202.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89c00 con 0x55f19ab66800 2023-12-19T18:03:48.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.140+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(36 10000000202.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.140+0000 7f089d692840 10 datascan.operator(): handling object 1099511628290.0 2023-12-19T18:03:48.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.140+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:37 18.28 18:15246602:::10000000202.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab66800 2023-12-19T18:03:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(37 10000000202.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:38 18.28 18:1537fa38::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab66800 2023-12-19T18:03:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(38 [pgnls start_epoch 131 out=101b] v131'16 uv16 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:39 18.28 18:1537fa38:::10000000236.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67400 con 0x55f19ab66800 2023-12-19T18:03:48.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(39 10000000236.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089d692840 10 datascan.operator(): handling object 1099511628342.0 2023-12-19T18:03:48.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.144+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:40 18.28 18:1537fa38:::10000000236.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab66800 2023-12-19T18:03:48.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(40 10000000236.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:41 18.28 18:177a762d::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab66800 2023-12-19T18:03:48.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 13 ==== osd_op_reply(41 [pgnls start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:42 18.28 18:177a762d:::10000000201.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab66800 2023-12-19T18:03:48.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 14 ==== osd_op_reply(42 10000000201.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089d692840 10 datascan.operator(): handling object 1099511628289.0 2023-12-19T18:03:48.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.148+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:43 18.28 18:177a762d:::10000000201.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab66800 2023-12-19T18:03:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.152+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 15 ==== osd_op_reply(43 10000000201.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.152+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55f19aa0b400 0x55f19ab94000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.152+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:44 18.18 18:18000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aa0b400 2023-12-19T18:03:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.152+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55f19aa0b400 0x55f19ab94000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.152+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55f19aa0b400 0x55f19ab94000 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(44 [pgnls start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f0897645700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f19ab67400 0x55f19ab96680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:45 18.38 18:1c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67400 2023-12-19T18:03:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f19ab67400 0x55f19ab96680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f19ab67400 0x55f19ab96680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(45 [pgnls start_epoch 131 out=49b] v129'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:46 18.4 18:20000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19aa0b000 2023-12-19T18:03:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(46 [pgnls start_epoch 131 out=81b] v129'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.160+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:47 18.4 18:2231e764:::10000000220.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19aa0b000 2023-12-19T18:03:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.164+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 18 ==== osd_op_reply(47 10000000220.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.164+0000 7f089d692840 10 datascan.operator(): handling object 1099511628320.0 2023-12-19T18:03:48.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.164+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:48 18.4 18:2231e764:::10000000220.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19aa0b000 2023-12-19T18:03:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.164+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 19 ==== osd_op_reply(48 10000000220.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.164+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:49 18.24 18:24000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89c00 con 0x55f19aa0b000 2023-12-19T18:03:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.168+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 20 ==== osd_op_reply(49 [pgnls start_epoch 131 out=101b] v129'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.168+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:50 18.24 18:242ba651:::10000000234.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19aa0b000 2023-12-19T18:03:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.168+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 21 ==== osd_op_reply(50 10000000234.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.168+0000 7f089d692840 10 datascan.operator(): handling object 1099511628340.0 2023-12-19T18:03:48.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.168+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:51 18.24 18:242ba651:::10000000234.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19aa0b000 2023-12-19T18:03:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 22 ==== osd_op_reply(51 10000000234.00000000 [call] v131'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.177 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:52 18.24 18:25b5fce8::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19aa0b000 2023-12-19T18:03:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 23 ==== osd_op_reply(52 [pgnls start_epoch 131 out=81b] v131'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:53 18.24 18:25b5fce8:::10000000231.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aa0b000 2023-12-19T18:03:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 24 ==== osd_op_reply(53 10000000231.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089d692840 10 datascan.operator(): handling object 1099511628337.0 2023-12-19T18:03:48.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.172+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:54 18.24 18:25b5fce8:::10000000231.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19aa0b000 2023-12-19T18:03:48.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 25 ==== osd_op_reply(54 10000000231.00000000 [call] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:55 18.14 18:28000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab67800 2023-12-19T18:03:48.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(55 [pgnls start_epoch 131 out=101b] v129'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:56 18.14 18:29971f97:::1000000020e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab67800 2023-12-19T18:03:48.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(56 1000000020e.00000000 [stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089d692840 10 datascan.operator(): handling object 1099511628302.0 2023-12-19T18:03:48.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.176+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:57 18.14 18:29971f97:::1000000020e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab67800 2023-12-19T18:03:48.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.180+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(57 1000000020e.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.180+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:58 18.14 18:2ab28be7::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89c00 con 0x55f19ab67800 2023-12-19T18:03:48.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.180+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 16 ==== osd_op_reply(58 [pgnls start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.180+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:59 18.14 18:2ab28be7:::10000000211.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4000 con 0x55f19ab67800 2023-12-19T18:03:48.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 17 ==== osd_op_reply(59 10000000211.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089d692840 10 datascan.operator(): handling object 1099511628305.0 2023-12-19T18:03:48.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:60 18.14 18:2ab28be7:::10000000211.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4400 con 0x55f19ab67800 2023-12-19T18:03:48.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 18 ==== osd_op_reply(60 10000000211.00000000 [call] v131'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:61 18.14 18:2b89f3ba::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19ab67800 2023-12-19T18:03:48.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 19 ==== osd_op_reply(61 [pgnls start_epoch 131 out=81b] v131'19 uv19 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.184+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:62 18.14 18:2b89f3ba:::10000000221.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab67800 2023-12-19T18:03:48.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.188+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 20 ==== osd_op_reply(62 10000000221.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.188+0000 7f089d692840 10 datascan.operator(): handling object 1099511628321.0 2023-12-19T18:03:48.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.188+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:63 18.14 18:2b89f3ba:::10000000221.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19ab67800 2023-12-19T18:03:48.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.188+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 21 ==== osd_op_reply(63 10000000221.00000000 [call] v131'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.188+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:64 18.34 18:2c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19aa0b000 2023-12-19T18:03:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 26 ==== osd_op_reply(64 [pgnls start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:65 18.c 18:30000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab66800 2023-12-19T18:03:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 16 ==== osd_op_reply(65 [pgnls start_epoch 131 out=81b] v129'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:66 18.c 18:30604137:::100000001fc.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19ab66800 2023-12-19T18:03:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 17 ==== osd_op_reply(66 100000001fc.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f089d692840 10 datascan.operator(): handling object 1099511628284.0 2023-12-19T18:03:48.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.192+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:67 18.c 18:30604137:::100000001fc.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19ab66800 2023-12-19T18:03:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.196+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 18 ==== osd_op_reply(67 100000001fc.00000000 [call] v131'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.196+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55f19aba4000 0x55f19ab94580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.196+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:68 18.2c 18:34000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19aba4000 2023-12-19T18:03:48.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.196+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55f19aba4000 0x55f19ab94580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.196+0000 7f089be4e700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55f19aba4000 0x55f19ab94580 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(68 [pgnls start_epoch 131 out=101b] v129'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:69 18.2c 18:35964134:::10000000223.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19aba4000 2023-12-19T18:03:48.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(69 10000000223.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089d692840 10 datascan.operator(): handling object 1099511628323.0 2023-12-19T18:03:48.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:70 18.2c 18:35964134:::10000000223.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aba4000 2023-12-19T18:03:48.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(70 10000000223.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.200+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:71 18.2c 18:37389ade::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19aba4000 2023-12-19T18:03:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.204+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(71 [pgnls start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.204+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:72 18.2c 18:37389ade:::10000000209.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19aba4000 2023-12-19T18:03:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.204+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(72 10000000209.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.204+0000 7f089d692840 10 datascan.operator(): handling object 1099511628297.0 2023-12-19T18:03:48.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.204+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:73 18.2c 18:37389ade:::10000000209.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19aba4000 2023-12-19T18:03:48.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(73 10000000209.00000000 [call] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:74 18.1c 18:38000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19aa0b400 2023-12-19T18:03:48.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(74 [pgnls start_epoch 131 out=49b] v129'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f0897645700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55f19aba4400 0x55f19ab96c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:75 18.3c 18:3c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19aba4400 2023-12-19T18:03:48.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55f19aba4400 0x55f19ab96c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.208+0000 7f089b64d700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55f19aba4400 0x55f19ab96c00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(75 [pgnls start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:76 18.2 18:40000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aba4400 2023-12-19T18:03:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(76 [pgnls start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:77 18.22 18:44000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab67400 2023-12-19T18:03:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(77 [pgnls start_epoch 131 out=101b] v129'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:78 18.22 18:450d4ca5:::1000000024c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89c00 con 0x55f19ab67400 2023-12-19T18:03:48.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(78 1000000024c.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089d692840 10 datascan.operator(): handling object 1099511628364.0 2023-12-19T18:03:48.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.212+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:79 18.22 18:450d4ca5:::1000000024c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab67400 2023-12-19T18:03:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(79 1000000024c.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:80 18.22 18:45b8cac8::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab67400 2023-12-19T18:03:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(80 [pgnls start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:81 18.22 18:45b8cac8:::1000000023d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19ab67400 2023-12-19T18:03:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(81 1000000023d.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089d692840 10 datascan.operator(): handling object 1099511628349.0 2023-12-19T18:03:48.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.216+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:82 18.22 18:45b8cac8:::1000000023d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab67400 2023-12-19T18:03:48.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.220+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(82 1000000023d.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.220+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:83 18.22 18:47efb22f::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab67400 2023-12-19T18:03:48.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.220+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(83 [pgnls start_epoch 131 out=81b] v131'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.220+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:84 18.22 18:47efb22f:::10000000235.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab67400 2023-12-19T18:03:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.224+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(84 10000000235.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.224+0000 7f089d692840 10 datascan.operator(): handling object 1099511628341.0 2023-12-19T18:03:48.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.224+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:85 18.22 18:47efb22f:::10000000235.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19ab67400 2023-12-19T18:03:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.224+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(85 10000000235.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.224+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:86 18.12 18:48000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19aba4000 2023-12-19T18:03:48.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(86 [pgnls start_epoch 131 out=49b] v129'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:87 18.32 18:4c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89c00 con 0x55f19ab67400 2023-12-19T18:03:48.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(87 [pgnls start_epoch 131 out=81b] v129'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:88 18.32 18:4e8c6251:::10000000252.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab67400 2023-12-19T18:03:48.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(88 10000000252.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f089d692840 10 datascan.operator(): handling object 1099511628370.0 2023-12-19T18:03:48.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.228+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:89 18.32 18:4e8c6251:::10000000252.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19ab67400 2023-12-19T18:03:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(89 10000000252.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:90 18.a 18:50000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19ab67400 2023-12-19T18:03:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(90 [pgnls start_epoch 131 out=101b] v129'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:91 18.a 18:52dcfedc:::1000000023f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19ab67400 2023-12-19T18:03:48.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(91 1000000023f.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089d692840 10 datascan.operator(): handling object 1099511628351.0 2023-12-19T18:03:48.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.232+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:92 18.a 18:52dcfedc:::1000000023f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab67400 2023-12-19T18:03:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.236+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(92 1000000023f.00000000 [call] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.236+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:93 18.a 18:53d16f76::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab67400 2023-12-19T18:03:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.236+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 17 ==== osd_op_reply(93 [pgnls start_epoch 131 out=81b] v131'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.236+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:94 18.a 18:53d16f76:::1000000023b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67400 2023-12-19T18:03:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.240+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 18 ==== osd_op_reply(94 1000000023b.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.240+0000 7f089d692840 10 datascan.operator(): handling object 1099511628347.0 2023-12-19T18:03:48.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.240+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:95 18.a 18:53d16f76:::1000000023b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab67400 2023-12-19T18:03:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.240+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 19 ==== osd_op_reply(95 1000000023b.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.240+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f19ab89c00 0x55f19ab94b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.240+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:96 18.2a 18:54000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab89c00 2023-12-19T18:03:48.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f19ab89c00 0x55f19ab94b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089c64f700 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f19ab89c00 0x55f19ab94b00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(96 [pgnls start_epoch 131 out=101b] v129'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:97 18.2a 18:55a6cd83:::1000000020a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab89c00 2023-12-19T18:03:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(97 1000000020a.00000000 [stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089d692840 10 datascan.operator(): handling object 1099511628298.0 2023-12-19T18:03:48.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.244+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:98 18.2a 18:55a6cd83:::1000000020a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab89c00 2023-12-19T18:03:48.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.248+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(98 1000000020a.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.248+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:99 18.2a 18:56889a45::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab89c00 2023-12-19T18:03:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.248+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(99 [pgnls start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.248+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:100 18.2a 18:56889a45:::10000000213.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab89c00 2023-12-19T18:03:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.252+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(100 10000000213.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.252+0000 7f089d692840 10 datascan.operator(): handling object 1099511628307.0 2023-12-19T18:03:48.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.252+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:101 18.2a 18:56889a45:::10000000213.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19ab89c00 2023-12-19T18:03:48.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.252+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(101 10000000213.00000000 [call] v131'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.252+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:102 18.2a 18:576ad4f4::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab89c00 2023-12-19T18:03:48.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.256+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(102 [pgnls start_epoch 131 out=101b] v131'19 uv19 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.256+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:103 18.2a 18:576ad4f4:::10000000245.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19ab89c00 2023-12-19T18:03:48.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.256+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(103 10000000245.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.256+0000 7f089d692840 10 datascan.operator(): handling object 1099511628357.0 2023-12-19T18:03:48.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.256+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:104 18.2a 18:576ad4f4:::10000000245.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19ab89c00 2023-12-19T18:03:48.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(104 10000000245.00000000 [call] v131'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:105 18.2a 18:57fe7535::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19ab89c00 2023-12-19T18:03:48.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(105 [pgnls start_epoch 131 out=81b] v131'20 uv20 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:106 18.2a 18:57fe7535:::100000001f6.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19ab89c00 2023-12-19T18:03:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(106 100000001f6.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089d692840 10 datascan.operator(): handling object 1099511628278.0 2023-12-19T18:03:48.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.260+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:107 18.2a 18:57fe7535:::100000001f6.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab89c00 2023-12-19T18:03:48.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(107 100000001f6.00000000 [call] v131'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:108 18.1a 18:58000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab67400 2023-12-19T18:03:48.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 20 ==== osd_op_reply(108 [pgnls start_epoch 131 out=101b] v129'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:109 18.1a 18:582f7b2d:::10000000226.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67400 2023-12-19T18:03:48.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 21 ==== osd_op_reply(109 10000000226.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089d692840 10 datascan.operator(): handling object 1099511628326.0 2023-12-19T18:03:48.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.264+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:110 18.1a 18:582f7b2d:::10000000226.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab67400 2023-12-19T18:03:48.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.268+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 22 ==== osd_op_reply(110 10000000226.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.268+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:111 18.1a 18:5a2a1294::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab67400 2023-12-19T18:03:48.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.268+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 23 ==== osd_op_reply(111 [pgnls start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.268+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:112 18.1a 18:5a2a1294:::1000000023a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab67400 2023-12-19T18:03:48.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.268+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 24 ==== osd_op_reply(112 1000000023a.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.272+0000 7f089d692840 10 datascan.operator(): handling object 1099511628346.0 2023-12-19T18:03:48.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.272+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:113 18.1a 18:5a2a1294:::1000000023a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab67400 2023-12-19T18:03:48.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.272+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 25 ==== osd_op_reply(113 1000000023a.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.272+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:114 18.3a 18:5c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19aa0b000 2023-12-19T18:03:48.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.272+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 27 ==== osd_op_reply(114 [pgnls start_epoch 131 out=49b] v129'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.280 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.272+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:115 18.6 18:60000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19aba4400 2023-12-19T18:03:48.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.276+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(115 [pgnls start_epoch 131 out=81b] v129'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.276+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:116 18.6 18:614797eb:::10000000228.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aba4400 2023-12-19T18:03:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.276+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(116 10000000228.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.276+0000 7f089d692840 10 datascan.operator(): handling object 1099511628328.0 2023-12-19T18:03:48.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.276+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:117 18.6 18:614797eb:::10000000228.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aba4400 2023-12-19T18:03:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(117 10000000228.00000000 [call] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:118 18.26 18:64000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19aba4000 2023-12-19T18:03:48.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(118 [pgnls start_epoch 131 out=101b] v129'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:119 18.26 18:658f2455:::100000001ff.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19aba4000 2023-12-19T18:03:48.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(119 100000001ff.00000000 [stat out=16b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089d692840 10 datascan.operator(): handling object 1099511628287.0 2023-12-19T18:03:48.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.280+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:120 18.26 18:658f2455:::100000001ff.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aba4000 2023-12-19T18:03:48.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(120 100000001ff.00000000 [call] v131'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:121 18.26 18:65d05a5c::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19aba4000 2023-12-19T18:03:48.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(121 [pgnls start_epoch 131 out=101b] v131'22 uv22 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:122 18.26 18:65d05a5c:::10000000258.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19aba4000 2023-12-19T18:03:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(122 10000000258.00000000 [stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089d692840 10 datascan.operator(): handling object 1099511628376.0 2023-12-19T18:03:48.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.284+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:123 18.26 18:65d05a5c:::10000000258.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19aba4000 2023-12-19T18:03:48.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 13 ==== osd_op_reply(123 10000000258.00000000 [call] v131'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:124 18.26 18:65e03fee::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19aba4000 2023-12-19T18:03:48.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 14 ==== osd_op_reply(124 [pgnls start_epoch 131 out=81b] v131'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:125 18.26 18:65e03fee:::10000000240.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19aba4000 2023-12-19T18:03:48.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 15 ==== osd_op_reply(125 10000000240.00000000 [stat out=16b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089d692840 10 datascan.operator(): handling object 1099511628352.0 2023-12-19T18:03:48.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.288+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:126 18.26 18:65e03fee:::10000000240.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19aba4000 2023-12-19T18:03:48.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.292+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 16 ==== osd_op_reply(126 10000000240.00000000 [call] v131'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.292+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:127 18.16 18:68000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab67400 2023-12-19T18:03:48.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.292+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 26 ==== osd_op_reply(127 [pgnls start_epoch 131 out=49b] v129'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.292+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:128 18.36 18:6c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce000 con 0x55f19aa0b400 2023-12-19T18:03:48.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.292+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(128 [pgnls start_epoch 131 out=101b] v129'23 uv23 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.292+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:129 18.36 18:6cdfec98:::10000000255.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aa0b400 2023-12-19T18:03:48.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(129 10000000255.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089d692840 10 datascan.operator(): handling object 1099511628373.0 2023-12-19T18:03:48.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:130 18.36 18:6cdfec98:::10000000255.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aa0b400 2023-12-19T18:03:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(130 10000000255.00000000 [call] v131'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:131 18.36 18:6ee5e2c4::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19aa0b400 2023-12-19T18:03:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(131 [pgnls start_epoch 131 out=101b] v131'24 uv24 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:132 18.36 18:6ee5e2c4:::100000001f9.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19aa0b400 2023-12-19T18:03:48.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(132 100000001f9.00000000 [stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089d692840 10 datascan.operator(): handling object 1099511628281.0 2023-12-19T18:03:48.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.296+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:133 18.36 18:6ee5e2c4:::100000001f9.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19aa0b400 2023-12-19T18:03:48.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(133 100000001f9.00000000 [call] v131'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.306 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:134 18.36 18:6f746908::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aa0b400 2023-12-19T18:03:48.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(134 [pgnls start_epoch 131 out=101b] v131'25 uv25 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:135 18.36 18:6f746908:::1000000022c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19aa0b400 2023-12-19T18:03:48.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(135 1000000022c.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089d692840 10 datascan.operator(): handling object 1099511628332.0 2023-12-19T18:03:48.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.300+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:136 18.36 18:6f746908:::1000000022c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19aa0b400 2023-12-19T18:03:48.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(136 1000000022c.00000000 [call] v131'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:137 18.36 18:6fe38dc2::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19aa0b400 2023-12-19T18:03:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(137 [pgnls start_epoch 131 out=81b] v131'26 uv26 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:138 18.36 18:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19aa0b400 2023-12-19T18:03:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(138 100000001f7.00000000 [stat out=16b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089d692840 10 datascan.operator(): handling object 1099511628279.0 2023-12-19T18:03:48.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.304+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:139 18.36 18:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19aa0b400 2023-12-19T18:03:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(139 100000001f7.00000000 [call] v131'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:140 18.e 18:70000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19aa0b000 2023-12-19T18:03:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 28 ==== osd_op_reply(140 [pgnls start_epoch 131 out=81b] v129'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:141 18.e 18:71c13145:::1000000022f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aa0b000 2023-12-19T18:03:48.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 29 ==== osd_op_reply(141 1000000022f.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089d692840 10 datascan.operator(): handling object 1099511628335.0 2023-12-19T18:03:48.315 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.308+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:142 18.e 18:71c13145:::1000000022f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce000 con 0x55f19aa0b000 2023-12-19T18:03:48.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 30 ==== osd_op_reply(142 1000000022f.00000000 [call] v131'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:143 18.2e 18:74000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19ab67400 2023-12-19T18:03:48.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 27 ==== osd_op_reply(143 [pgnls start_epoch 131 out=101b] v129'16 uv16 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:144 18.2e 18:74d13cfc:::1000000021c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19ab67400 2023-12-19T18:03:48.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 28 ==== osd_op_reply(144 1000000021c.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089d692840 10 datascan.operator(): handling object 1099511628316.0 2023-12-19T18:03:48.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.312+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:145 18.2e 18:74d13cfc:::1000000021c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19ab67400 2023-12-19T18:03:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 29 ==== osd_op_reply(145 1000000021c.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:146 18.2e 18:7528f44f::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19ab67400 2023-12-19T18:03:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 30 ==== osd_op_reply(146 [pgnls start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:147 18.2e 18:7528f44f:::10000000242.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcfc00 con 0x55f19ab67400 2023-12-19T18:03:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 31 ==== osd_op_reply(147 10000000242.00000000 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089d692840 10 datascan.operator(): handling object 1099511628354.0 2023-12-19T18:03:48.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.316+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:148 18.2e 18:7528f44f:::10000000242.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab67400 2023-12-19T18:03:48.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 32 ==== osd_op_reply(148 10000000242.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:149 18.2e 18:7611a124::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab67400 2023-12-19T18:03:48.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 33 ==== osd_op_reply(149 [pgnls start_epoch 131 out=81b] v131'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:150 18.2e 18:7611a124:::1000000021e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab67400 2023-12-19T18:03:48.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 34 ==== osd_op_reply(150 1000000021e.00000000 [stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089d692840 10 datascan.operator(): handling object 1099511628318.0 2023-12-19T18:03:48.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.320+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:151 18.2e 18:7611a124:::1000000021e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab67400 2023-12-19T18:03:48.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.324+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 35 ==== osd_op_reply(151 1000000021e.00000000 [call] v131'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.324+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:152 18.1e 18:78000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab66800 2023-12-19T18:03:48.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.324+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 19 ==== osd_op_reply(152 [pgnls start_epoch 131 out=101b] v129'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.324+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:153 18.1e 18:789b801b:::1000000020c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab66800 2023-12-19T18:03:48.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.328+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 20 ==== osd_op_reply(153 1000000020c.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.328+0000 7f089d692840 10 datascan.operator(): handling object 1099511628300.0 2023-12-19T18:03:48.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.328+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:154 18.1e 18:789b801b:::1000000020c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19ab66800 2023-12-19T18:03:48.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 21 ==== osd_op_reply(154 1000000020c.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:155 18.1e 18:7a9d9b47::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19ab66800 2023-12-19T18:03:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 22 ==== osd_op_reply(155 [pgnls start_epoch 131 out=101b] v131'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:156 18.1e 18:7a9d9b47:::1000000022b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19ab66800 2023-12-19T18:03:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 23 ==== osd_op_reply(156 1000000022b.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089d692840 10 datascan.operator(): handling object 1099511628331.0 2023-12-19T18:03:48.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.332+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:157 18.1e 18:7a9d9b47:::1000000022b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19ab66800 2023-12-19T18:03:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 24 ==== osd_op_reply(157 1000000022b.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:158 18.1e 18:7ade2fd8::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab66800 2023-12-19T18:03:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 25 ==== osd_op_reply(158 [pgnls start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:159 18.1e 18:7ade2fd8:::1000000024e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab66800 2023-12-19T18:03:48.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 26 ==== osd_op_reply(159 1000000024e.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089d692840 10 datascan.operator(): handling object 1099511628366.0 2023-12-19T18:03:48.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.336+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:160 18.1e 18:7ade2fd8:::1000000024e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab66800 2023-12-19T18:03:48.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 27 ==== osd_op_reply(160 1000000024e.00000000 [call] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.346 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:161 18.3e 18:7c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab67400 2023-12-19T18:03:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 36 ==== osd_op_reply(161 [pgnls start_epoch 131 out=81b] v129'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:162 18.3e 18:7f918703:::10000000229.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab67400 2023-12-19T18:03:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 37 ==== osd_op_reply(162 10000000229.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089d692840 10 datascan.operator(): handling object 1099511628329.0 2023-12-19T18:03:48.347 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.340+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:163 18.3e 18:7f918703:::10000000229.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19ab67400 2023-12-19T18:03:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.344+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 38 ==== osd_op_reply(163 10000000229.00000000 [call] v131'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.344+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:164 18.1 18:80000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19ab67400 2023-12-19T18:03:48.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.344+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 39 ==== osd_op_reply(164 [pgnls start_epoch 131 out=81b] v129'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.344+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:165 18.1 18:805bc955:::10000000224.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19ab67400 2023-12-19T18:03:48.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.348+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 40 ==== osd_op_reply(165 10000000224.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.348+0000 7f089d692840 10 datascan.operator(): handling object 1099511628324.0 2023-12-19T18:03:48.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.348+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:166 18.1 18:805bc955:::10000000224.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19ab67400 2023-12-19T18:03:48.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.348+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 41 ==== osd_op_reply(166 10000000224.00000000 [call] v131'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.348+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:167 18.21 18:84000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcfc00 con 0x55f19ab66800 2023-12-19T18:03:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 28 ==== osd_op_reply(167 [pgnls start_epoch 131 out=49b] v129'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:168 18.11 18:88000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce400 con 0x55f19aa0b400 2023-12-19T18:03:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(168 [pgnls start_epoch 131 out=49b] v129'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.358 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:169 18.31 18:8c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab89c00 2023-12-19T18:03:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(169 [pgnls start_epoch 131 out=101b] v129'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:170 18.31 18:8c51d9b0:::10000000216.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab89c00 2023-12-19T18:03:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(170 10000000216.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089d692840 10 datascan.operator(): handling object 1099511628310.0 2023-12-19T18:03:48.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.352+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:171 18.31 18:8c51d9b0:::10000000216.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19ab89c00 2023-12-19T18:03:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.356+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(171 10000000216.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.356+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:172 18.31 18:8fb7f7b7::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab89c00 2023-12-19T18:03:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.356+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 16 ==== osd_op_reply(172 [pgnls start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.356+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:173 18.31 18:8fb7f7b7:::10000000251.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab89c00 2023-12-19T18:03:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.360+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 17 ==== osd_op_reply(173 10000000251.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.360+0000 7f089d692840 10 datascan.operator(): handling object 1099511628369.0 2023-12-19T18:03:48.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.360+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:174 18.31 18:8fb7f7b7:::10000000251.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab89c00 2023-12-19T18:03:48.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 18 ==== osd_op_reply(174 10000000251.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.368 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:175 18.9 18:90000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab67400 2023-12-19T18:03:48.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 42 ==== osd_op_reply(175 [pgnls start_epoch 131 out=101b] v129'6 uv6 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:176 18.9 18:915bff82:::1000000024d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab67400 2023-12-19T18:03:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 43 ==== osd_op_reply(176 1000000024d.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089d692840 10 datascan.operator(): handling object 1099511628365.0 2023-12-19T18:03:48.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.364+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:177 18.9 18:915bff82:::1000000024d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19ab67400 2023-12-19T18:03:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 44 ==== osd_op_reply(177 1000000024d.00000000 [call] v131'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:178 18.9 18:91e366d7::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19ab67400 2023-12-19T18:03:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 45 ==== osd_op_reply(178 [pgnls start_epoch 131 out=81b] v131'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:179 18.9 18:91e366d7:::10000000230.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19ab67400 2023-12-19T18:03:48.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 46 ==== osd_op_reply(179 10000000230.00000000 [stat out=16b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089d692840 10 datascan.operator(): handling object 1099511628336.0 2023-12-19T18:03:48.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.368+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:180 18.9 18:91e366d7:::10000000230.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19ab67400 2023-12-19T18:03:48.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.372+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 47 ==== osd_op_reply(180 10000000230.00000000 [call] v131'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.372+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:181 18.29 18:94000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aba4400 2023-12-19T18:03:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.372+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(181 [pgnls start_epoch 131 out=101b] v129'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.372+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:182 18.29 18:94c02207:::1000000024a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aba4400 2023-12-19T18:03:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.376+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(182 1000000024a.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.376+0000 7f089d692840 10 datascan.operator(): handling object 1099511628362.0 2023-12-19T18:03:48.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.376+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:183 18.29 18:94c02207:::1000000024a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19aba4400 2023-12-19T18:03:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(183 1000000024a.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:184 18.29 18:95e8e66d::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19aba4400 2023-12-19T18:03:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(184 [pgnls start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:185 18.29 18:95e8e66d:::10000000256.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19aba4400 2023-12-19T18:03:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(185 10000000256.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089d692840 10 datascan.operator(): handling object 1099511628374.0 2023-12-19T18:03:48.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.380+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:186 18.29 18:95e8e66d:::10000000256.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19aba4400 2023-12-19T18:03:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(186 10000000256.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:187 18.29 18:97401066::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aba4400 2023-12-19T18:03:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(187 [pgnls start_epoch 131 out=81b] v131'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:188 18.29 18:97401066:::10000000247.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19aba4400 2023-12-19T18:03:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(188 10000000247.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089d692840 10 datascan.operator(): handling object 1099511628359.0 2023-12-19T18:03:48.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.384+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:189 18.29 18:97401066:::10000000247.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19aba4400 2023-12-19T18:03:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.388+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(189 10000000247.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.388+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:190 18.19 18:98000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19ab89c00 2023-12-19T18:03:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.388+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 19 ==== osd_op_reply(190 [pgnls start_epoch 131 out=101b] v129'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.388+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:191 18.19 18:992a6246:::10000000200.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19ab89c00 2023-12-19T18:03:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.392+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 20 ==== osd_op_reply(191 10000000200.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.392+0000 7f089d692840 10 datascan.operator(): handling object 1099511628288.0 2023-12-19T18:03:48.397 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.392+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:192 18.19 18:992a6246:::10000000200.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19ab89c00 2023-12-19T18:03:48.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.392+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 21 ==== osd_op_reply(192 10000000200.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.392+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:193 18.19 18:997b7129::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcfc00 con 0x55f19ab89c00 2023-12-19T18:03:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 22 ==== osd_op_reply(193 [pgnls start_epoch 131 out=81b] v131'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:194 18.19 18:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19ab89c00 2023-12-19T18:03:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 23 ==== osd_op_reply(194 100000001f8.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089d692840 10 datascan.operator(): handling object 1099511628280.0 2023-12-19T18:03:48.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:195 18.19 18:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19ab89c00 2023-12-19T18:03:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 24 ==== osd_op_reply(195 100000001f8.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.396+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:196 18.39 18:9c000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19aa0b000 2023-12-19T18:03:48.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.400+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 31 ==== osd_op_reply(196 [pgnls start_epoch 131 out=81b] v129'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.400+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:197 18.39 18:9f1351c3:::10000000222.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19aa0b000 2023-12-19T18:03:48.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.400+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 32 ==== osd_op_reply(197 10000000222.00000000 [stat out=16b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.400+0000 7f089d692840 10 datascan.operator(): handling object 1099511628322.0 2023-12-19T18:03:48.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.400+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:198 18.39 18:9f1351c3:::10000000222.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19aa0b000 2023-12-19T18:03:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 33 ==== osd_op_reply(198 10000000222.00000000 [call] v131'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:199 18.5 18:a0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19aa0b400 2023-12-19T18:03:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 16 ==== osd_op_reply(199 [pgnls start_epoch 131 out=101b] v129'9 uv9 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:200 18.5 18:a0beda95:::10000000204.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aa0b400 2023-12-19T18:03:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 17 ==== osd_op_reply(200 10000000204.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089d692840 10 datascan.operator(): handling object 1099511628292.0 2023-12-19T18:03:48.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.404+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:201 18.5 18:a0beda95:::10000000204.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aa0b400 2023-12-19T18:03:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 18 ==== osd_op_reply(201 10000000204.00000000 [call] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:202 18.5 18:a3a50212::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce400 con 0x55f19aa0b400 2023-12-19T18:03:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 19 ==== osd_op_reply(202 [pgnls start_epoch 131 out=81b] v131'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.414 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:203 18.5 18:a3a50212:::10000000254.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce400 con 0x55f19aa0b400 2023-12-19T18:03:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 20 ==== osd_op_reply(203 10000000254.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089d692840 10 datascan.operator(): handling object 1099511628372.0 2023-12-19T18:03:48.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.408+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:204 18.5 18:a3a50212:::10000000254.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aa0b400 2023-12-19T18:03:48.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 21 ==== osd_op_reply(204 10000000254.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:205 18.25 18:a4000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67800 2023-12-19T18:03:48.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 22 ==== osd_op_reply(205 [pgnls start_epoch 131 out=101b] v129'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:206 18.25 18:a53878a9:::10000000237.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19ab67800 2023-12-19T18:03:48.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 23 ==== osd_op_reply(206 10000000237.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089d692840 10 datascan.operator(): handling object 1099511628343.0 2023-12-19T18:03:48.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.412+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:207 18.25 18:a53878a9:::10000000237.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab67800 2023-12-19T18:03:48.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.416+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 24 ==== osd_op_reply(207 10000000237.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.416+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:208 18.25 18:a7ae8a0f::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab67800 2023-12-19T18:03:48.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.416+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 25 ==== osd_op_reply(208 [pgnls start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.416+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:209 18.25 18:a7ae8a0f:::10000000243.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab67800 2023-12-19T18:03:48.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.420+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 26 ==== osd_op_reply(209 10000000243.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.420+0000 7f089d692840 10 datascan.operator(): handling object 1099511628355.0 2023-12-19T18:03:48.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.420+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:210 18.25 18:a7ae8a0f:::10000000243.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab67800 2023-12-19T18:03:48.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.420+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 27 ==== osd_op_reply(210 10000000243.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.420+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:211 18.15 18:a8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab66800 2023-12-19T18:03:48.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.424+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 29 ==== osd_op_reply(211 [pgnls start_epoch 131 out=81b] v129'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.424+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:212 18.15 18:a8e69ea8:::1000000020d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab66800 2023-12-19T18:03:48.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.424+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 30 ==== osd_op_reply(212 1000000020d.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.424+0000 7f089d692840 10 datascan.operator(): handling object 1099511628301.0 2023-12-19T18:03:48.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.424+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:213 18.15 18:a8e69ea8:::1000000020d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab66800 2023-12-19T18:03:48.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.428+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 31 ==== osd_op_reply(213 1000000020d.00000000 [call] v131'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.428+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:214 18.35 18:ac000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19ab89c00 2023-12-19T18:03:48.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.428+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 25 ==== osd_op_reply(214 [pgnls start_epoch 131 out=49b] v129'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.428+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:215 18.d 18:b0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19ab89c00 2023-12-19T18:03:48.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.428+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 26 ==== osd_op_reply(215 [pgnls start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.428+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:216 18.2d 18:b4000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce800 con 0x55f19ab67800 2023-12-19T18:03:48.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.432+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 28 ==== osd_op_reply(216 [pgnls start_epoch 131 out=81b] v129'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.432+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:217 18.2d 18:b79a54f6:::10000000218.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab67800 2023-12-19T18:03:48.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.432+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 29 ==== osd_op_reply(217 10000000218.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.432+0000 7f089d692840 10 datascan.operator(): handling object 1099511628312.0 2023-12-19T18:03:48.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.432+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:218 18.2d 18:b79a54f6:::10000000218.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab67800 2023-12-19T18:03:48.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.432+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.6 v2:172.21.15.73:6816/36537 30 ==== osd_op_reply(218 10000000218.00000000 [call] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19ab67800 2023-12-19T18:03:48.440 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.436+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:219 18.1d 18:b8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19aa0b000 2023-12-19T18:03:48.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.436+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 34 ==== osd_op_reply(219 [pgnls start_epoch 131 out=81b] v129'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.436+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:220 18.1d 18:bab97ecf:::10000000246.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19aa0b000 2023-12-19T18:03:48.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.436+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 35 ==== osd_op_reply(220 10000000246.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.436+0000 7f089d692840 10 datascan.operator(): handling object 1099511628358.0 2023-12-19T18:03:48.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.436+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:221 18.1d 18:bab97ecf:::10000000246.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19aa0b000 2023-12-19T18:03:48.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.0 v2:172.21.15.45:6808/36279 36 ==== osd_op_reply(221 10000000246.00000000 [call] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aa0b000 2023-12-19T18:03:48.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:222 18.3d 18:bc000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab67400 2023-12-19T18:03:48.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 48 ==== osd_op_reply(222 [pgnls start_epoch 131 out=101b] v129'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:223 18.3d 18:bc0c3701:::10000000219.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce000 con 0x55f19ab67400 2023-12-19T18:03:48.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 49 ==== osd_op_reply(223 10000000219.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089d692840 10 datascan.operator(): handling object 1099511628313.0 2023-12-19T18:03:48.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.440+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:224 18.3d 18:bc0c3701:::10000000219.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab67400 2023-12-19T18:03:48.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 50 ==== osd_op_reply(224 10000000219.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:225 18.3d 18:bfcd3380::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab67400 2023-12-19T18:03:48.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 51 ==== osd_op_reply(225 [pgnls start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:226 18.3d 18:bfcd3380:::10000000205.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab67400 2023-12-19T18:03:48.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 52 ==== osd_op_reply(226 10000000205.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089d692840 10 datascan.operator(): handling object 1099511628293.0 2023-12-19T18:03:48.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.444+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:227 18.3d 18:bfcd3380:::10000000205.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab67400 2023-12-19T18:03:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.448+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.3 v2:172.21.15.45:6816/36284 53 ==== osd_op_reply(227 10000000205.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab67400 2023-12-19T18:03:48.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.448+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:228 18.3 18:c0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aa0b400 2023-12-19T18:03:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.448+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 22 ==== osd_op_reply(228 [pgnls start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.448+0000 7f0897645700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:229 18.23 18:c4000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe8000 con 0x55f19aba4000 2023-12-19T18:03:48.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 17 ==== osd_op_reply(229 [pgnls start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:230 18.13 18:c8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9400 con 0x55f19aba4400 2023-12-19T18:03:48.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(230 [pgnls start_epoch 131 out=101b] v129'25 uv25 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:231 18.13 18:c8893608:::1000000023c.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19aba4400 2023-12-19T18:03:48.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(231 1000000023c.00000000 [stat out=16b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f089d692840 10 datascan.operator(): handling object 1099511628348.0 2023-12-19T18:03:48.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.452+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:232 18.13 18:c8893608:::1000000023c.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19aba4400 2023-12-19T18:03:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(232 1000000023c.00000000 [call] v131'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:233 18.13 18:c933d8fa::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19aba4400 2023-12-19T18:03:48.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(233 [pgnls start_epoch 131 out=101b] v131'26 uv26 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:234 18.13 18:c933d8fa:::10000000241.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19aba4400 2023-12-19T18:03:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(234 10000000241.00000000 [stat out=16b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089d692840 10 datascan.operator(): handling object 1099511628353.0 2023-12-19T18:03:48.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.456+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:235 18.13 18:c933d8fa:::10000000241.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19aba4400 2023-12-19T18:03:48.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.460+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(235 10000000241.00000000 [call] v131'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.460+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:236 18.13 18:c9855970::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcfc00 con 0x55f19aba4400 2023-12-19T18:03:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.460+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 21 ==== osd_op_reply(236 [pgnls start_epoch 131 out=101b] v131'27 uv27 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.460+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:237 18.13 18:c9855970:::10000000239.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19aba4400 2023-12-19T18:03:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.464+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 22 ==== osd_op_reply(237 10000000239.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.464+0000 7f089d692840 10 datascan.operator(): handling object 1099511628345.0 2023-12-19T18:03:48.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.464+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:238 18.13 18:c9855970:::10000000239.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19aba4400 2023-12-19T18:03:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.464+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 23 ==== osd_op_reply(238 10000000239.00000000 [call] v131'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.464+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:239 18.13 18:ca8fdbba::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19aba4400 2023-12-19T18:03:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.468+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 24 ==== osd_op_reply(239 [pgnls start_epoch 131 out=101b] v131'28 uv28 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.468+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:240 18.13 18:ca8fdbba:::100000001fb.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19aba4400 2023-12-19T18:03:48.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.468+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 25 ==== osd_op_reply(240 100000001fb.00000000 [stat out=16b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.468+0000 7f089d692840 10 datascan.operator(): handling object 1099511628283.0 2023-12-19T18:03:48.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.468+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:241 18.13 18:ca8fdbba:::100000001fb.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce400 con 0x55f19aba4400 2023-12-19T18:03:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 26 ==== osd_op_reply(241 100000001fb.00000000 [call] v131'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:242 18.13 18:cbcb6224::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19aba4400 2023-12-19T18:03:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 27 ==== osd_op_reply(242 [pgnls start_epoch 131 out=81b] v131'29 uv29 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:243 18.13 18:cbcb6224:::10000000212.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19aba4400 2023-12-19T18:03:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 28 ==== osd_op_reply(243 10000000212.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089d692840 10 datascan.operator(): handling object 1099511628306.0 2023-12-19T18:03:48.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.472+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:244 18.13 18:cbcb6224:::10000000212.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19aba4400 2023-12-19T18:03:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 29 ==== osd_op_reply(244 10000000212.00000000 [call] v131'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:245 18.33 18:cc000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aa0b400 2023-12-19T18:03:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 23 ==== osd_op_reply(245 [pgnls start_epoch 131 out=81b] v129'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:246 18.33 18:cf9e7a4f:::10000000248.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67000 con 0x55f19aa0b400 2023-12-19T18:03:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 24 ==== osd_op_reply(246 10000000248.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089d692840 10 datascan.operator(): handling object 1099511628360.0 2023-12-19T18:03:48.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.476+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:247 18.33 18:cf9e7a4f:::10000000248.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88800 con 0x55f19aa0b400 2023-12-19T18:03:48.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 25 ==== osd_op_reply(247 10000000248.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:248 18.b 18:d0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19ab66800 2023-12-19T18:03:48.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 32 ==== osd_op_reply(248 [pgnls start_epoch 131 out=101b] v129'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:249 18.b 18:d0d26e50:::10000000225.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9400 con 0x55f19ab66800 2023-12-19T18:03:48.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 33 ==== osd_op_reply(249 10000000225.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089d692840 10 datascan.operator(): handling object 1099511628325.0 2023-12-19T18:03:48.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.480+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:250 18.b 18:d0d26e50:::10000000225.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab66800 2023-12-19T18:03:48.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 34 ==== osd_op_reply(250 10000000225.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:251 18.b 18:d2dbd4ac::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcfc00 con 0x55f19ab66800 2023-12-19T18:03:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 35 ==== osd_op_reply(251 [pgnls start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:252 18.b 18:d2dbd4ac:::10000000217.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19ab66800 2023-12-19T18:03:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 36 ==== osd_op_reply(252 10000000217.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089d692840 10 datascan.operator(): handling object 1099511628311.0 2023-12-19T18:03:48.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.484+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:253 18.b 18:d2dbd4ac:::10000000217.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce400 con 0x55f19ab66800 2023-12-19T18:03:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.488+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 37 ==== osd_op_reply(253 10000000217.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.488+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:254 18.b 18:d3eda40d::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19ab66800 2023-12-19T18:03:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.488+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 38 ==== osd_op_reply(254 [pgnls start_epoch 131 out=81b] v131'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.488+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:255 18.b 18:d3eda40d:::1000000020f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19ab66800 2023-12-19T18:03:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.488+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 39 ==== osd_op_reply(255 1000000020f.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.488+0000 7f089d692840 10 datascan.operator(): handling object 1099511628303.0 2023-12-19T18:03:48.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.492+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:256 18.b 18:d3eda40d:::1000000020f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19ab66800 2023-12-19T18:03:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.492+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 40 ==== osd_op_reply(256 1000000020f.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.492+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:257 18.2b 18:d4000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19aba4400 2023-12-19T18:03:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.492+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 30 ==== osd_op_reply(257 [pgnls start_epoch 131 out=101b] v129'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.496+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:258 18.2b 18:d4a58307:::10000000203.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5000 con 0x55f19aba4400 2023-12-19T18:03:48.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.496+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 31 ==== osd_op_reply(258 10000000203.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.496+0000 7f089d692840 10 datascan.operator(): handling object 1099511628291.0 2023-12-19T18:03:48.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.496+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:259 18.2b 18:d4a58307:::10000000203.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5400 con 0x55f19aba4400 2023-12-19T18:03:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.496+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 32 ==== osd_op_reply(259 10000000203.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.496+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:260 18.2b 18:d5ee56ee::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce000 con 0x55f19aba4400 2023-12-19T18:03:48.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.500+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 33 ==== osd_op_reply(260 [pgnls start_epoch 131 out=81b] v131'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.500+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:261 18.2b 18:d5ee56ee:::1000000022d.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcfc00 con 0x55f19aba4400 2023-12-19T18:03:48.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.500+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 34 ==== osd_op_reply(261 1000000022d.00000000 [stat out=16b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.500+0000 7f089d692840 10 datascan.operator(): handling object 1099511628333.0 2023-12-19T18:03:48.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.500+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:262 18.2b 18:d5ee56ee:::1000000022d.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcec00 con 0x55f19aba4400 2023-12-19T18:03:48.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 35 ==== osd_op_reply(262 1000000022d.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:263 18.1b 18:d8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce400 con 0x55f19aa0b400 2023-12-19T18:03:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 26 ==== osd_op_reply(263 [pgnls start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:264 18.3b 18:dc000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9800 con 0x55f19ab89c00 2023-12-19T18:03:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 27 ==== osd_op_reply(264 [pgnls start_epoch 131 out=101b] v129'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:265 18.3b 18:dd50df43:::10000000249.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19ab89c00 2023-12-19T18:03:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 28 ==== osd_op_reply(265 10000000249.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089d692840 10 datascan.operator(): handling object 1099511628361.0 2023-12-19T18:03:48.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.504+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:266 18.3b 18:dd50df43:::10000000249.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19ab89c00 2023-12-19T18:03:48.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 29 ==== osd_op_reply(266 10000000249.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:267 18.3b 18:deccbd37::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19ab89c00 2023-12-19T18:03:48.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 30 ==== osd_op_reply(267 [pgnls start_epoch 131 out=101b] v131'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:268 18.3b 18:deccbd37:::100000001fe.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19ab89c00 2023-12-19T18:03:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 31 ==== osd_op_reply(268 100000001fe.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089d692840 10 datascan.operator(): handling object 1099511628286.0 2023-12-19T18:03:48.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.508+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:269 18.3b 18:deccbd37:::100000001fe.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19ab89c00 2023-12-19T18:03:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.512+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 32 ==== osd_op_reply(269 100000001fe.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.512+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:270 18.3b 18:ded14b84::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9400 con 0x55f19ab89c00 2023-12-19T18:03:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.512+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 33 ==== osd_op_reply(270 [pgnls start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.512+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:271 18.3b 18:ded14b84:::1000000024b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab89c00 2023-12-19T18:03:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.516+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 34 ==== osd_op_reply(271 1000000024b.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.516+0000 7f089d692840 10 datascan.operator(): handling object 1099511628363.0 2023-12-19T18:03:48.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.516+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:272 18.3b 18:ded14b84:::1000000024b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab89c00 2023-12-19T18:03:48.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.516+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 35 ==== osd_op_reply(272 1000000024b.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.516+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:273 18.7 18:e0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19aba4000 2023-12-19T18:03:48.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.520+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 18 ==== osd_op_reply(273 [pgnls start_epoch 131 out=101b] v129'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.520+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:274 18.7 18:e15a914f:::10000000207.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19aba4000 2023-12-19T18:03:48.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.520+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 19 ==== osd_op_reply(274 10000000207.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.520+0000 7f089d692840 10 datascan.operator(): handling object 1099511628295.0 2023-12-19T18:03:48.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.520+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:275 18.7 18:e15a914f:::10000000207.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19aba4000 2023-12-19T18:03:48.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 20 ==== osd_op_reply(275 10000000207.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:276 18.7 18:e2e07930::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00000 con 0x55f19aba4000 2023-12-19T18:03:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 21 ==== osd_op_reply(276 [pgnls start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:277 18.7 18:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00400 con 0x55f19aba4000 2023-12-19T18:03:48.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 22 ==== osd_op_reply(277 10000000001.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089d692840 10 datascan.operator(): handling object 1099511627777.0 2023-12-19T18:03:48.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.524+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:278 18.7 18:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00800 con 0x55f19aba4000 2023-12-19T18:03:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.528+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 23 ==== osd_op_reply(278 10000000001.00000000 [call] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.528+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:279 18.7 18:e37752f2::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00c00 con 0x55f19aba4000 2023-12-19T18:03:48.535 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.528+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 24 ==== osd_op_reply(279 [pgnls start_epoch 131 out=81b] v131'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.528+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:280 18.7 18:e37752f2:::1000000021f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01000 con 0x55f19aba4000 2023-12-19T18:03:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.528+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 25 ==== osd_op_reply(280 1000000021f.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.532+0000 7f089d692840 10 datascan.operator(): handling object 1099511628319.0 2023-12-19T18:03:48.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.532+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:281 18.7 18:e37752f2:::1000000021f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01400 con 0x55f19aba4000 2023-12-19T18:03:48.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.532+0000 7f089be4e700 1 -- 172.21.15.45:0/2338016095 <== osd.2 v2:172.21.15.45:6824/36285 26 ==== osd_op_reply(281 1000000021f.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecb40 con 0x55f19aba4000 2023-12-19T18:03:48.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.532+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:282 18.27 18:e4000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01800 con 0x55f19ab66800 2023-12-19T18:03:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.536+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 41 ==== osd_op_reply(282 [pgnls start_epoch 131 out=101b] v129'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.536+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:283 18.27 18:e40c9c52:::10000000210.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01c00 con 0x55f19ab66800 2023-12-19T18:03:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.536+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 42 ==== osd_op_reply(283 10000000210.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.536+0000 7f089d692840 10 datascan.operator(): handling object 1099511628304.0 2023-12-19T18:03:48.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.536+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:284 18.27 18:e40c9c52:::10000000210.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00000 con 0x55f19ab66800 2023-12-19T18:03:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 43 ==== osd_op_reply(284 10000000210.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:285 18.27 18:e5671758::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00400 con 0x55f19ab66800 2023-12-19T18:03:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 44 ==== osd_op_reply(285 [pgnls start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:286 18.27 18:e5671758:::1000000024f.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab66800 2023-12-19T18:03:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 45 ==== osd_op_reply(286 1000000024f.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089d692840 10 datascan.operator(): handling object 1099511628367.0 2023-12-19T18:03:48.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.540+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:287 18.27 18:e5671758:::1000000024f.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab66800 2023-12-19T18:03:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 46 ==== osd_op_reply(287 1000000024f.00000000 [call] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:288 18.27 18:e5993619::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab66800 2023-12-19T18:03:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 47 ==== osd_op_reply(288 [pgnls start_epoch 131 out=101b] v131'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:289 18.27 18:e5993619:::10000000208.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89800 con 0x55f19ab66800 2023-12-19T18:03:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 48 ==== osd_op_reply(289 10000000208.00000000 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089d692840 10 datascan.operator(): handling object 1099511628296.0 2023-12-19T18:03:48.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.544+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:290 18.27 18:e5993619:::10000000208.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88400 con 0x55f19ab66800 2023-12-19T18:03:48.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 49 ==== osd_op_reply(290 10000000208.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:291 18.27 18:e5a5749e::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe8000 con 0x55f19ab66800 2023-12-19T18:03:48.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 50 ==== osd_op_reply(291 [pgnls start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:292 18.27 18:e5a5749e:::1000000021a.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab67c00 con 0x55f19ab66800 2023-12-19T18:03:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 51 ==== osd_op_reply(292 1000000021a.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089d692840 10 datascan.operator(): handling object 1099511628314.0 2023-12-19T18:03:48.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.548+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:293 18.27 18:e5a5749e:::1000000021a.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4c00 con 0x55f19ab66800 2023-12-19T18:03:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 52 ==== osd_op_reply(293 1000000021a.00000000 [call] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:294 18.27 18:e692fc64::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5800 con 0x55f19ab66800 2023-12-19T18:03:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 53 ==== osd_op_reply(294 [pgnls start_epoch 131 out=81b] v131'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:295 18.27 18:e692fc64:::1000000021b.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba5c00 con 0x55f19ab66800 2023-12-19T18:03:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 54 ==== osd_op_reply(295 1000000021b.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089d692840 10 datascan.operator(): handling object 1099511628315.0 2023-12-19T18:03:48.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.552+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:296 18.27 18:e692fc64:::1000000021b.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abce800 con 0x55f19ab66800 2023-12-19T18:03:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 55 ==== osd_op_reply(296 1000000021b.00000000 [call] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:297 18.17 18:e8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88000 con 0x55f19ab66800 2023-12-19T18:03:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 56 ==== osd_op_reply(297 [pgnls start_epoch 131 out=101b] v129'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:298 18.17 18:eace0b58:::10000000215.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab88c00 con 0x55f19ab66800 2023-12-19T18:03:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 57 ==== osd_op_reply(298 10000000215.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089d692840 10 datascan.operator(): handling object 1099511628309.0 2023-12-19T18:03:48.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.556+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:299 18.17 18:eace0b58:::10000000215.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89000 con 0x55f19ab66800 2023-12-19T18:03:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.560+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 58 ==== osd_op_reply(299 10000000215.00000000 [call] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.560+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:300 18.17 18:eb1b33a4::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab89400 con 0x55f19ab66800 2023-12-19T18:03:48.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.560+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 59 ==== osd_op_reply(300 [pgnls start_epoch 131 out=81b] v131'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.564+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:301 18.17 18:eb1b33a4:::10000000253.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aa0b800 con 0x55f19ab66800 2023-12-19T18:03:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.564+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 60 ==== osd_op_reply(301 10000000253.00000000 [stat out=16b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.564+0000 7f089d692840 10 datascan.operator(): handling object 1099511628371.0 2023-12-19T18:03:48.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.564+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:302 18.17 18:eb1b33a4:::10000000253.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01800 con 0x55f19ab66800 2023-12-19T18:03:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.564+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 61 ==== osd_op_reply(302 10000000253.00000000 [call] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.564+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:303 18.37 18:ec000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01c00 con 0x55f19aba4400 2023-12-19T18:03:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 36 ==== osd_op_reply(303 [pgnls start_epoch 131 out=49b] v129'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:304 18.f 18:f0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9c00 con 0x55f19ab66800 2023-12-19T18:03:48.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 62 ==== osd_op_reply(304 [pgnls start_epoch 131 out=81b] v129'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:305 18.f 18:f25dd5df:::1000000022e.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00000 con 0x55f19ab66800 2023-12-19T18:03:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 63 ==== osd_op_reply(305 1000000022e.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f089d692840 10 datascan.operator(): handling object 1099511628334.0 2023-12-19T18:03:48.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.568+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:306 18.f 18:f25dd5df:::1000000022e.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00400 con 0x55f19ab66800 2023-12-19T18:03:48.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.572+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.5 v2:172.21.15.73:6824/36539 64 ==== osd_op_reply(306 1000000022e.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab66800 2023-12-19T18:03:48.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.572+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:307 18.2f 18:f4000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9800 con 0x55f19aa0b400 2023-12-19T18:03:48.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.572+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.1 v2:172.21.15.45:6800/36282 27 ==== osd_op_reply(307 [pgnls start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aa0b400 2023-12-19T18:03:48.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.572+0000 7f0896e44700 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:308 18.1f 18:f8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19aba4800 con 0x55f19aba4400 2023-12-19T18:03:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.576+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 37 ==== osd_op_reply(308 [pgnls start_epoch 131 out=101b] v129'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.576+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:309 18.1f 18:f87ea8f1:::10000000238.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9400 con 0x55f19aba4400 2023-12-19T18:03:48.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.576+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 38 ==== osd_op_reply(309 10000000238.00000000 [stat out=16b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.576+0000 7f089d692840 10 datascan.operator(): handling object 1099511628344.0 2023-12-19T18:03:48.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.576+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:310 18.1f 18:f87ea8f1:::10000000238.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66400 con 0x55f19aba4400 2023-12-19T18:03:48.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 39 ==== osd_op_reply(310 10000000238.00000000 [call] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:311 18.1f 18:f8e2d5cc::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ab66c00 con 0x55f19aba4400 2023-12-19T18:03:48.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 40 ==== osd_op_reply(311 [pgnls start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:312 18.1f 18:f8e2d5cc:::10000000214.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf000 con 0x55f19aba4400 2023-12-19T18:03:48.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 41 ==== osd_op_reply(312 10000000214.00000000 [stat out=16b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089d692840 10 datascan.operator(): handling object 1099511628308.0 2023-12-19T18:03:48.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.580+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:313 18.1f 18:f8e2d5cc:::10000000214.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf400 con 0x55f19aba4400 2023-12-19T18:03:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 <== osd.7 v2:172.21.15.73:6800/36538 42 ==== osd_op_reply(313 10000000214.00000000 [call] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecfc0 con 0x55f19aba4400 2023-12-19T18:03:48.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:314 18.3f 18:fc000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abcf800 con 0x55f19ab89c00 2023-12-19T18:03:48.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 36 ==== osd_op_reply(314 [pgnls start_epoch 131 out=101b] v129'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:315 18.3f 18:fd83cc12:::10000000232.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01c00 con 0x55f19ab89c00 2023-12-19T18:03:48.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 37 ==== osd_op_reply(315 10000000232.00000000 [stat out=16b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089d692840 10 datascan.operator(): handling object 1099511628338.0 2023-12-19T18:03:48.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.584+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:316 18.3f 18:fd83cc12:::10000000232.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac01800 con 0x55f19ab89c00 2023-12-19T18:03:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.588+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 38 ==== osd_op_reply(316 10000000232.00000000 [call] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.588+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:317 18.3f 18:feb1c803::::head [pgnls start_epoch 131 in=59b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00000 con 0x55f19ab89c00 2023-12-19T18:03:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.588+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 39 ==== osd_op_reply(317 [pgnls start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.592+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:318 18.3f 18:feb1c803:::100000001fa.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19ac00400 con 0x55f19ab89c00 2023-12-19T18:03:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.592+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 40 ==== osd_op_reply(318 100000001fa.00000000 [stat out=16b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.592+0000 7f089d692840 10 datascan.operator(): handling object 1099511628282.0 2023-12-19T18:03:48.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.592+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:319 18.3f 18:feb1c803:::100000001fa.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55f19abe9800 con 0x55f19ab89c00 2023-12-19T18:03:48.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.592+0000 7f089c64f700 1 -- 172.21.15.45:0/2338016095 <== osd.4 v2:172.21.15.73:6805/36536 41 ==== osd_op_reply(319 100000001fa.00000000 [call] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55f19b4ecd80 con 0x55f19ab89c00 2023-12-19T18:03:48.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.592+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f19aa0b000 msgr2=0x55f19a7b0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55f19aa0b000 0x55f19a7b0100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55f19aa0b400 msgr2=0x55f19ab94000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55f19aa0b400 0x55f19ab94000 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55f19aba4000 msgr2=0x55f19ab94580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55f19aba4000 0x55f19ab94580 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f19ab67400 msgr2=0x55f19ab96680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55f19ab67400 0x55f19ab96680 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f19ab89c00 msgr2=0x55f19ab94b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55f19ab89c00 0x55f19ab94b00 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55f19ab66800 msgr2=0x55f19a7afb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55f19ab66800 0x55f19a7afb80 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55f19ab67800 msgr2=0x55f19a7af600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55f19ab67800 0x55f19a7af600 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55f19aba4400 msgr2=0x55f19ab96c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55f19aba4400 0x55f19ab96c00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 reap_dead start 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 reap_dead start 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089b64d700 1 -- 172.21.15.45:0/2338016095 reap_dead start 2023-12-19T18:03:48.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f19ab66000 msgr2=0x55f19a7b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f19ab66000 0x55f19a7b1700 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x55f19a86e870 tx=0x55f19ab70000 comp rx=0 tx=0).stop 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 msgr2=0x55f19a7b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 0x55f19a7b0680 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x55f19aa23410 tx=0x55f19aa24e40 comp rx=0 tx=0).stop 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 shutdown_connections 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55f19ab66000 0x55f19a7b1700 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/2338016095 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19aa0ac00 0x55f19a7b0680 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 >> 172.21.15.45:0/2338016095 conn(0x55f19a708c00 msgr2=0x55f19a81d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 shutdown_connections 2023-12-19T18:03:48.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/2338016095 wait complete. 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 msgr2=0x55f19a7ae580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 0x55f19a7ae580 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x55f19a86f2f0 tx=0x55f19b4f8d20 comp rx=0 tx=0).stop 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 shutdown_connections 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f19a709000 0x55f19a7af080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55f19a709400 0x55f19a7aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 --2- 172.21.15.45:0/4000328638 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55f19a709800 0x55f19a7ae580 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 >> 172.21.15.45:0/4000328638 conn(0x55f19a709c00 msgr2=0x55f19a81d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 shutdown_connections 2023-12-19T18:03:48.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.596+0000 7f089d692840 1 -- 172.21.15.45:0/4000328638 wait complete. 2023-12-19T18:03:48.611 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents'] in time 0:00:00.612209, result: 2023-12-19T18:03:48.611 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes 2023-12-19T18:03:48.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 -- start start 2023-12-19T18:03:48.725 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 Processor -- start 2023-12-19T18:03:48.726 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 0x55782b2da580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782b235400 0x55782b2dab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782b235000 0x55782b2db080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4a00 con 0x55782b235800 2023-12-19T18:03:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4780 con 0x55782b235400 2023-12-19T18:03:48.727 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8de76840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4640 con 0x55782b235000 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 0x55782b2da580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 0x55782b2da580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38710/0 (socket says 172.21.15.45:38710) 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 -- 172.21.15.45:0/1812451484 learned_addr learned my addr 172.21.15.45:0/1812451484 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782b235000 0x55782b2db080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8be31700 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782b235400 0x55782b2dab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 -- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782b235000 msgr2=0x55782b2db080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782b235000 0x55782b2db080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 -- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782b235400 msgr2=0x55782b2dab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782b235400 0x55782b2dab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.729 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8c632700 1 -- 172.21.15.45:0/1812451484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782b256b60 con 0x55782b235800 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.720+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782b235000 0x55782b2db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8c632700 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 0x55782b2da580 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x55782b3433e0 tx=0x55782c02cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5330e21c100e702 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c89e2d700 1 -- 172.21.15.45:0/1812451484 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55782b265600 con 0x55782b235800 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c89e2d700 1 -- 172.21.15.45:0/1812451484 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55782b280480 con 0x55782b235800 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c89e2d700 1 -- 172.21.15.45:0/1812451484 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55782b2651e0 con 0x55782b235800 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782b256340 con 0x55782b235800 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55782b256000 con 0x55782b235800 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 4 waiting for MDS map... 2023-12-19T18:03:48.730 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c89e2d700 1 -- 172.21.15.45:0/1812451484 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x55782b26ec40 con 0x55782b235800 2023-12-19T18:03:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c89e2d700 1 -- 172.21.15.45:0/1812451484 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 106) v1 ==== 2573+0+0 (secure 0 0 0) 0x55782c010000 con 0x55782b235800 2023-12-19T18:03:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 4 Got MDS map 106 2023-12-19T18:03:48.731 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 4 datascan.main: Using metadata pool output 2023-12-19T18:03:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 4 datascan.main: connecting to RADOS... 2023-12-19T18:03:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 1 Processor -- start 2023-12-19T18:03:48.732 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.724+0000 7f5c8de76840 1 -- start start 2023-12-19T18:03:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0be400 0x55782b2db600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0bec00 0x55782b2dc100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b26be00 con 0x55782c0be800 2023-12-19T18:03:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4780 con 0x55782c0bec00 2023-12-19T18:03:48.733 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4500 con 0x55782c0be400 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8ce33700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0be400 0x55782b2db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38712/0 (socket says 172.21.15.45:38712) 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 -- 172.21.15.45:0/4192342501 learned_addr learned my addr 172.21.15.45:0/4192342501 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8be31700 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0bec00 0x55782b2dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 -- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0be400 msgr2=0x55782b2db600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.735 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0be400 0x55782b2db600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 -- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0bec00 msgr2=0x55782b2dc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0bec00 0x55782b2dc100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 -- 172.21.15.45:0/4192342501 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782b256ea0 con 0x55782c0be800 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8c632700 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dbb80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x55782b3437d0 tx=0x55782c02cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1188da5d194d0985 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c87e29700 1 -- 172.21.15.45:0/4192342501 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55782b264f20 con 0x55782c0be800 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c87e29700 1 -- 172.21.15.45:0/4192342501 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55782c02e780 con 0x55782c0be800 2023-12-19T18:03:48.736 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c87e29700 1 -- 172.21.15.45:0/4192342501 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55782b265600 con 0x55782c0be800 2023-12-19T18:03:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- 172.21.15.45:0/4192342501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 msgr2=0x55782b2dbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dbb80 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x55782b3437d0 tx=0x55782c02cf60 comp rx=0 tx=0).stop 2023-12-19T18:03:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- 172.21.15.45:0/4192342501 shutdown_connections 2023-12-19T18:03:48.738 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0bec00 0x55782b2dc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dbb80 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 --2- 172.21.15.45:0/4192342501 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0be400 0x55782b2db600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- 172.21.15.45:0/4192342501 >> 172.21.15.45:0/4192342501 conn(0x55782b234c00 msgr2=0x55782b303800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- 172.21.15.45:0/4192342501 shutdown_connections 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.728+0000 7f5c8de76840 1 -- 172.21.15.45:0/4192342501 wait complete. 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 Processor -- start 2023-12-19T18:03:48.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 -- start start 2023-12-19T18:03:48.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0be400 0x55782b2dd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0bec00 0x55782b2dc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b43c0 con 0x55782c0be800 2023-12-19T18:03:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4280 con 0x55782c0be400 2023-12-19T18:03:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8de76840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x55782b2b4140 con 0x55782c0bec00 2023-12-19T18:03:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dcc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:38726/0 (socket says 172.21.15.45:38726) 2023-12-19T18:03:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 learned_addr learned my addr 172.21.15.45:0/2427410848 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:48.744 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0bec00 0x55782b2dc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0be400 0x55782b2dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0bec00 msgr2=0x55782b2dc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0bec00 0x55782b2dc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0be400 msgr2=0x55782b2dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.732+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0be400 0x55782b2dd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55782b256b60 con 0x55782c0be800 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782c0bec00 0x55782b2dc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782c0be400 0x55782b2dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dcc00 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x55782c0bd470 tx=0x55782c02cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c86626700 1 -- 172.21.15.45:0/2427410848 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55782b2651e0 con 0x55782c0be800 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c86626700 1 -- 172.21.15.45:0/2427410848 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55782c02ea80 con 0x55782c0be800 2023-12-19T18:03:48.745 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c86626700 1 -- 172.21.15.45:0/2427410848 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55782b264dc0 con 0x55782c0be800 2023-12-19T18:03:48.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55782b256340 con 0x55782c0be800 2023-12-19T18:03:48.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55782b257520 con 0x55782c0be800 2023-12-19T18:03:48.746 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c8de76840 4 datascan.init: resolving metadata pool 17 2023-12-19T18:03:48.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.736+0000 7f5c86626700 1 -- 172.21.15.45:0/2427410848 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x55782b292840 con 0x55782c0be800 2023-12-19T18:03:48.747 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c86626700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55782b686000 0x55782b2dd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c86626700 1 -- 172.21.15.45:0/2427410848 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x55782b26ea80 con 0x55782c0be800 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 4 datascan.main: data pool 'cephfs_data' has ID 18 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 4 datascan.main: opening data pool 'cephfs_data' 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55782c0bf000 0x55782b2dc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:1 17.14 17:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf000 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55782b686000 0x55782b2dd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55782c0bf000 0x55782b2dc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55782b686000 0x55782b2dd700 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55782b342090 tx=0x55782b30b380 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55782c0bf000 0x55782b2dc100 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv18 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55782c0bf800 0x55782b2dbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.748 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:2 17.1f 17:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686400 con 0x55782c0bf800 2023-12-19T18:03:48.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.740+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55782c0bf800 0x55782b2dbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55782c0bf800 0x55782b2dbb80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55782b686800 0x55782b2db600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:3 18.0 18:00000000::::head [pgnls-filter start_epoch 131 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782b686800 2023-12-19T18:03:48.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55782b686800 0x55782b2db600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55782b686800 0x55782b2db600 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.744+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.752 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:4 18.0 18:00000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686800 2023-12-19T18:03:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000206.00000000 2023-12-19T18:03:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000206.0 2023-12-19T18:03:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 18.0 18:012cdbc7:::10000000206.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b686800 2023-12-19T18:03:48.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(5 10000000206.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000206 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/17 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=17 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf000 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(6 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.755 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:7 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(7 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.756 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.748+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55782b686400 0x55782b6ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.752+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:8 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686400 2023-12-19T18:03:48.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.752+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55782b686400 0x55782b6ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.758 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.752+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55782b686400 0x55782b6ac580 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.752+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(8 10000000000.01800000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.752+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:03:48.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.752+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 17.1b 17:dcc776e0:::10000000000.01800000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b686400 2023-12-19T18:03:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(9 10000000000.01800000 [create,omap-set-header] v131'6 uv6 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-12-19T18:03:48.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:10 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686400 2023-12-19T18:03:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(10 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=17 frag=1*, r=0 2023-12-19T18:03:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8de76840 20 datascan.read_dentry: 17_head not found in result 2023-12-19T18:03:48.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000206 at 0x0x10000000000/17 with size=2 bytes 2023-12-19T18:03:48.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.756+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:11 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686400 2023-12-19T18:03:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(11 10000000000.01800000 [omap-set-vals] v131'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000206 2023-12-19T18:03:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-12-19T18:03:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-12-19T18:03:48.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:12 17.1f 17:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(12 1.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+30 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-12-19T18:03:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-12-19T18:03:48.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(13 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.760+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:14 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf800 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(14 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 20 datascan.inject_with_backtrace: Dentry 0x0x1/subdir already exists and points to me 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55782b6b4400 0x55782b6acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:15 18.20 18:04000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b6b4400 2023-12-19T18:03:48.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55782b6b4400 0x55782b6acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55782b6b4400 0x55782b6acb00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000020b.00000000 2023-12-19T18:03:48.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000020b.0 2023-12-19T18:03:48.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.764+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:16 18.20 18:05552577:::1000000020b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b6b4400 2023-12-19T18:03:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(16 1000000020b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020b 2023-12-19T18:03:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/22 2023-12-19T18:03:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=22 2023-12-19T18:03:48.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:17 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf000 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(17 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:18 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(18 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:19 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b686400 2023-12-19T18:03:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(19 10000000000.01800000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 7 2023-12-19T18:03:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:20 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(20 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=22 frag=1*, r=0 2023-12-19T18:03:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 20 datascan.read_dentry: 22_head not found in result 2023-12-19T18:03:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020b at 0x0x10000000000/22 with size=2 bytes 2023-12-19T18:03:48.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.768+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:21 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:48.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(21 10000000000.01800000 [omap-set-vals] v131'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x1000000020b 2023-12-19T18:03:48.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:22 18.10 18:08000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:48.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(22 [pgnls-filter start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000022a.00000000 2023-12-19T18:03:48.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000022a.0 2023-12-19T18:03:48.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.772+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:23 18.10 18:083d5826:::1000000022a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf800 2023-12-19T18:03:48.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(23 1000000022a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000022a 2023-12-19T18:03:48.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/53 2023-12-19T18:03:48.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=53 2023-12-19T18:03:48.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:24 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:48.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(24 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:25 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:48.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(25 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:26 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(26 10000000000.01000000 [omap-get-header] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 0 2023-12-19T18:03:48.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.776+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:27 17.5 17:a40620de:::10000000000.01000000:head [create,omap-set-header in=274b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:48.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(27 10000000000.01000000 [create,omap-set-header] v131'5 uv5 ondisk = 0) v8 ==== 206+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: Created dirfrag: 0x0x10000000000 2023-12-19T18:03:48.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:28 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:48.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(28 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=53 frag=0*, r=0 2023-12-19T18:03:48.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8de76840 20 datascan.read_dentry: 53_head not found in result 2023-12-19T18:03:48.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000022a at 0x0x10000000000/53 with size=2 bytes 2023-12-19T18:03:48.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.780+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:29 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:48.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(29 10000000000.01000000 [omap-set-vals] v131'6 uv6 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/53 pointing to 0x0x1000000022a 2023-12-19T18:03:48.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x1/subdir 2023-12-19T18:03:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x1 target_dname=subdir 2023-12-19T18:03:48.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:30 17.1f 17:ff5b34d6:::1.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:48.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(30 1.00000000 [getxattr (30) out=30b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+30 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 4 datascan.get_frag_of: No backtrace on '1.00000000': cannot determine fragtree 2023-12-19T18:03:48.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 20 datascan.inject_with_backtrace: don't know fragment for 0x0x1/subdir, will insert to root 2023-12-19T18:03:48.797 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:31 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(31 1.00000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x1 * 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.784+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf800 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 16 ==== osd_op_reply(32 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 20 datascan.inject_with_backtrace: Dentry 0x0x1/subdir already exists and points to me 2023-12-19T18:03:48.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:33 18.10 18:08500202::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 17 ==== osd_op_reply(33 [pgnls-filter start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000023e.00000000 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000023e.0 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:34 18.10 18:08500202:::1000000023e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 18 ==== osd_op_reply(34 1000000023e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000023e 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/73 2023-12-19T18:03:48.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=73 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf000 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(35 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.788+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:36 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 19 ==== osd_op_reply(36 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:37 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 20 ==== osd_op_reply(37 10000000000.01000000 [omap-get-header out=274b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 6 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:38 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 21 ==== osd_op_reply(38 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=73 frag=0*, r=0 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 20 datascan.read_dentry: 73_head not found in result 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000023e at 0x0x10000000000/73 with size=2 bytes 2023-12-19T18:03:48.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.792+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:39 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 22 ==== osd_op_reply(39 10000000000.01000000 [omap-set-vals] v131'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/73 pointing to 0x0x1000000023e 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:40 18.10 18:08b99fea::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 23 ==== osd_op_reply(40 [pgnls-filter start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001fd.00000000 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001fd.0 2023-12-19T18:03:48.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 18.10 18:08b99fea:::100000001fd.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf800 2023-12-19T18:03:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 24 ==== osd_op_reply(41 100000001fd.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fd 2023-12-19T18:03:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/8 2023-12-19T18:03:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=8 2023-12-19T18:03:48.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.796+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:42 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf000 2023-12-19T18:03:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(42 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:43 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 25 ==== osd_op_reply(43 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:44 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782c0bf800 2023-12-19T18:03:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 26 ==== osd_op_reply(44 10000000000.01000000 [omap-get-header out=274b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 7 2023-12-19T18:03:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:45 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 27 ==== osd_op_reply(45 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv7 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=8 frag=0*, r=0 2023-12-19T18:03:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 20 datascan.read_dentry: 8_head not found in result 2023-12-19T18:03:48.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fd at 0x0x10000000000/8 with size=1 bytes 2023-12-19T18:03:48.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.800+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:46 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 28 ==== osd_op_reply(46 10000000000.01000000 [omap-set-vals] v131'8 uv8 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x100000001fd 2023-12-19T18:03:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:47 18.10 18:08e6f8ca::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:48.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 29 ==== osd_op_reply(47 [pgnls-filter start_epoch 131 out=81b] v131'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000257.00000000 2023-12-19T18:03:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000257.0 2023-12-19T18:03:48.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.804+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:48 18.10 18:08e6f8ca:::10000000257.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7400 con 0x55782c0bf800 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 30 ==== osd_op_reply(48 10000000257.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000257 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/98 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=98 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:49 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf000 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(49 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:50 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf800 2023-12-19T18:03:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 31 ==== osd_op_reply(50 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:51 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b686400 2023-12-19T18:03:48.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(51 10000000000.01800000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 8 2023-12-19T18:03:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.808+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:52 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782b686400 2023-12-19T18:03:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(52 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.816 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=98 frag=1*, r=0 2023-12-19T18:03:48.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8de76840 20 datascan.read_dentry: 98_head not found in result 2023-12-19T18:03:48.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000257 at 0x0x10000000000/98 with size=2 bytes 2023-12-19T18:03:48.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:53 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(53 10000000000.01800000 [omap-set-vals] v131'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/98 pointing to 0x0x10000000257 2023-12-19T18:03:48.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.812+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:54 18.30 18:0c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686800 2023-12-19T18:03:48.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(54 [pgnls-filter start_epoch 131 out=101b] v131'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000021d.00000000 2023-12-19T18:03:48.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000021d.0 2023-12-19T18:03:48.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:55 18.30 18:0c00cb85:::1000000021d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686800 2023-12-19T18:03:48.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(55 1000000021d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000021d 2023-12-19T18:03:48.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/40 2023-12-19T18:03:48.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=40 2023-12-19T18:03:48.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:56 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf000 2023-12-19T18:03:48.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(56 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:57 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 32 ==== osd_op_reply(57 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.816+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:58 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b686400 2023-12-19T18:03:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(58 10000000000.01800000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 9 2023-12-19T18:03:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:59 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(59 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=40 frag=1*, r=0 2023-12-19T18:03:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 20 datascan.read_dentry: 40_head not found in result 2023-12-19T18:03:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000021d at 0x0x10000000000/40 with size=2 bytes 2023-12-19T18:03:48.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.820+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:60 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686400 2023-12-19T18:03:48.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(60 10000000000.01800000 [omap-set-vals] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/40 pointing to 0x0x1000000021d 2023-12-19T18:03:48.829 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:61 18.30 18:0c28cce1::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686800 2023-12-19T18:03:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(61 [pgnls-filter start_epoch 131 out=101b] v131'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000244.00000000 2023-12-19T18:03:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000244.0 2023-12-19T18:03:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:62 18.30 18:0c28cce1:::10000000244.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b686800 2023-12-19T18:03:48.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(62 10000000244.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv19 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000244 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/79 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=79 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:63 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf000 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(63 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:64 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:48.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 33 ==== osd_op_reply(64 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.824+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:65 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b686400 2023-12-19T18:03:48.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(65 10000000000.01800000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 10 2023-12-19T18:03:48.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:66 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:48.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(66 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=79 frag=1*, r=0 2023-12-19T18:03:48.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 20 datascan.read_dentry: 79_head not found in result 2023-12-19T18:03:48.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000244 at 0x0x10000000000/79 with size=2 bytes 2023-12-19T18:03:48.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.828+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:67 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686400 2023-12-19T18:03:48.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 16 ==== osd_op_reply(67 10000000000.01800000 [omap-set-vals] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/79 pointing to 0x0x10000000244 2023-12-19T18:03:48.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:68 18.30 18:0cc9e906::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782b686800 2023-12-19T18:03:48.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(68 [pgnls-filter start_epoch 131 out=101b] v131'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000227.00000000 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000227.0 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:69 18.30 18:0cc9e906:::10000000227.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686800 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(69 10000000227.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv20 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000227 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/50 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=50 2023-12-19T18:03:48.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:70 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf000 2023-12-19T18:03:48.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(70 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:71 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 34 ==== osd_op_reply(71 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.832+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:72 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 35 ==== osd_op_reply(72 10000000000.01000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 8 2023-12-19T18:03:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:73 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:48.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 36 ==== osd_op_reply(73 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=50 frag=0*, r=0 2023-12-19T18:03:48.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 20 datascan.read_dentry: 50_head not found in result 2023-12-19T18:03:48.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000227 at 0x0x10000000000/50 with size=2 bytes 2023-12-19T18:03:48.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.836+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:74 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:48.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 37 ==== osd_op_reply(74 10000000000.01000000 [omap-set-vals] v131'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/50 pointing to 0x0x10000000227 2023-12-19T18:03:48.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:75 18.30 18:0e3d5a27::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b686800 2023-12-19T18:03:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(75 [pgnls-filter start_epoch 131 out=81b] v131'21 uv21 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000250.00000000 2023-12-19T18:03:48.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000250.0 2023-12-19T18:03:48.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:76 18.30 18:0e3d5a27:::10000000250.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782b686800 2023-12-19T18:03:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(76 10000000250.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv21 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000250 2023-12-19T18:03:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/91 2023-12-19T18:03:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=91 2023-12-19T18:03:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:77 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf000 2023-12-19T18:03:48.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(77 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.840+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:78 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 38 ==== osd_op_reply(78 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:79 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782b686400 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 17 ==== osd_op_reply(79 10000000000.01800000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 11 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:80 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7400 con 0x55782b686400 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 18 ==== osd_op_reply(80 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=91 frag=1*, r=0 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 20 datascan.read_dentry: 91_head not found in result 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000250 at 0x0x10000000000/91 with size=2 bytes 2023-12-19T18:03:48.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.844+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:81 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b686400 2023-12-19T18:03:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 19 ==== osd_op_reply(81 10000000000.01800000 [omap-set-vals] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/91 pointing to 0x0x10000000250 2023-12-19T18:03:48.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:82 18.8 18:10000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686800 2023-12-19T18:03:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(82 [pgnls-filter start_epoch 131 out=49b] v129'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:83 18.28 18:14000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b6b4400 2023-12-19T18:03:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(83 [pgnls-filter start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000233.00000000 2023-12-19T18:03:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000233.0 2023-12-19T18:03:48.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:84 18.28 18:14ce3b86:::10000000233.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b6b4400 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(84 10000000233.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000233 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/62 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=62 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.848+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:85 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(85 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:86 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:48.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 39 ==== osd_op_reply(86 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:87 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b686400 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 20 ==== osd_op_reply(87 10000000000.01800000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-12-19T18:03:48.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:88 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b686400 2023-12-19T18:03:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 21 ==== osd_op_reply(88 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=62 frag=1*, r=0 2023-12-19T18:03:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 20 datascan.read_dentry: 62_head not found in result 2023-12-19T18:03:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000233 at 0x0x10000000000/62 with size=2 bytes 2023-12-19T18:03:48.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.852+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:89 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 22 ==== osd_op_reply(89 10000000000.01800000 [omap-set-vals] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/62 pointing to 0x0x10000000233 2023-12-19T18:03:48.862 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:90 18.28 18:15246602::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b6b4400 2023-12-19T18:03:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000202.00000000 2023-12-19T18:03:48.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000202.0 2023-12-19T18:03:48.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:91 18.28 18:15246602:::10000000202.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b6b4400 2023-12-19T18:03:48.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(91 10000000202.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000202 2023-12-19T18:03:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/13 2023-12-19T18:03:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=13 2023-12-19T18:03:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.856+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:92 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(92 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:93 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 40 ==== osd_op_reply(93 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:94 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686400 2023-12-19T18:03:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 23 ==== osd_op_reply(94 10000000000.01800000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 13 2023-12-19T18:03:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:95 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686400 2023-12-19T18:03:48.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 24 ==== osd_op_reply(95 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=13 frag=1*, r=0 2023-12-19T18:03:48.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 20 datascan.read_dentry: 13_head not found in result 2023-12-19T18:03:48.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000202 at 0x0x10000000000/13 with size=2 bytes 2023-12-19T18:03:48.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.860+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:96 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782b686400 2023-12-19T18:03:48.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 25 ==== osd_op_reply(96 10000000000.01800000 [omap-set-vals] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x10000000202 2023-12-19T18:03:48.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:97 18.28 18:1537fa38::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b6b4400 2023-12-19T18:03:48.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(97 [pgnls-filter start_epoch 131 out=101b] v131'18 uv18 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000236.00000000 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000236.0 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.864+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:98 18.28 18:1537fa38:::10000000236.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782b6b4400 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(98 10000000236.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000236 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/65 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=65 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:99 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf000 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(99 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:100 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 41 ==== osd_op_reply(100 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:101 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 42 ==== osd_op_reply(101 10000000000.01000000 [omap-get-header out=274b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 9 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.868+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:102 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 43 ==== osd_op_reply(102 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=65 frag=0*, r=0 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8de76840 20 datascan.read_dentry: 65_head not found in result 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000236 at 0x0x10000000000/65 with size=2 bytes 2023-12-19T18:03:48.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:103 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 44 ==== osd_op_reply(103 10000000000.01000000 [omap-set-vals] v131'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/65 pointing to 0x0x10000000236 2023-12-19T18:03:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.872+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:104 18.28 18:177a762d::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7400 con 0x55782b6b4400 2023-12-19T18:03:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 9 ==== osd_op_reply(104 [pgnls-filter start_epoch 131 out=81b] v131'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000201.00000000 2023-12-19T18:03:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000201.0 2023-12-19T18:03:48.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:105 18.28 18:177a762d:::10000000201.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b6b4400 2023-12-19T18:03:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 10 ==== osd_op_reply(105 10000000201.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000201 2023-12-19T18:03:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/12 2023-12-19T18:03:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=12 2023-12-19T18:03:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:106 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf000 2023-12-19T18:03:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(106 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:107 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 45 ==== osd_op_reply(107 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:108 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 46 ==== osd_op_reply(108 10000000000.01000000 [omap-get-header out=274b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 10 2023-12-19T18:03:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.876+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:109 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 47 ==== osd_op_reply(109 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv10 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=12 frag=0*, r=0 2023-12-19T18:03:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 20 datascan.read_dentry: 12_head not found in result 2023-12-19T18:03:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000201 at 0x0x10000000000/12 with size=2 bytes 2023-12-19T18:03:48.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:110 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:48.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 48 ==== osd_op_reply(110 10000000000.01000000 [omap-set-vals] v131'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x10000000201 2023-12-19T18:03:48.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55782b6c7400 0x55782b6ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.880+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:111 18.18 18:18000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b6c7400 2023-12-19T18:03:48.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55782b6c7400 0x55782b6ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8c632700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55782b6c7400 0x55782b6ac000 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(111 [pgnls-filter start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:48.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:112 18.38 18:1c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf000 2023-12-19T18:03:48.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(112 [pgnls-filter start_epoch 131 out=49b] v129'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:113 18.4 18:20000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea400 con 0x55782b686800 2023-12-19T18:03:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(113 [pgnls-filter start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000220.00000000 2023-12-19T18:03:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000220.0 2023-12-19T18:03:48.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.884+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:114 18.4 18:2231e764:::10000000220.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686800 2023-12-19T18:03:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(114 10000000220.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000220 2023-12-19T18:03:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/43 2023-12-19T18:03:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=43 2023-12-19T18:03:48.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:115 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 17 ==== osd_op_reply(115 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:116 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 49 ==== osd_op_reply(116 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:117 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 50 ==== osd_op_reply(117 10000000000.01000000 [omap-get-header out=274b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 11 2023-12-19T18:03:48.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.888+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:118 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf800 2023-12-19T18:03:48.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 51 ==== osd_op_reply(118 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=43 frag=0*, r=0 2023-12-19T18:03:48.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8de76840 20 datascan.read_dentry: 43_head not found in result 2023-12-19T18:03:48.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000220 at 0x0x10000000000/43 with size=2 bytes 2023-12-19T18:03:48.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:119 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:48.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 52 ==== osd_op_reply(119 10000000000.01000000 [omap-set-vals] v131'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/43 pointing to 0x0x10000000220 2023-12-19T18:03:48.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.892+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:120 18.24 18:24000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b686800 2023-12-19T18:03:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 15 ==== osd_op_reply(120 [pgnls-filter start_epoch 131 out=101b] v131'10 uv10 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000234.00000000 2023-12-19T18:03:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000234.0 2023-12-19T18:03:48.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:121 18.24 18:242ba651:::10000000234.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea400 con 0x55782b686800 2023-12-19T18:03:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 16 ==== osd_op_reply(121 10000000234.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000234 2023-12-19T18:03:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/63 2023-12-19T18:03:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=63 2023-12-19T18:03:48.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:122 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eac00 con 0x55782c0bf000 2023-12-19T18:03:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 18 ==== osd_op_reply(122 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:123 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb000 con 0x55782c0bf800 2023-12-19T18:03:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 53 ==== osd_op_reply(123 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:124 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:48.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 54 ==== osd_op_reply(124 10000000000.01000000 [omap-get-header out=274b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 12 2023-12-19T18:03:48.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.896+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.900+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:125 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:48.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.900+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 55 ==== osd_op_reply(125 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.900+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=63 frag=0*, r=0 2023-12-19T18:03:48.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.900+0000 7f5c8de76840 20 datascan.read_dentry: 63_head not found in result 2023-12-19T18:03:48.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.900+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000234 at 0x0x10000000000/63 with size=2 bytes 2023-12-19T18:03:48.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.900+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:126 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782c0bf800 2023-12-19T18:03:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 56 ==== osd_op_reply(126 10000000000.01000000 [omap-set-vals] v131'13 uv13 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/63 pointing to 0x0x10000000234 2023-12-19T18:03:48.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:127 18.24 18:25b5fce8::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686800 2023-12-19T18:03:48.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 17 ==== osd_op_reply(127 [pgnls-filter start_epoch 131 out=81b] v131'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000231.00000000 2023-12-19T18:03:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000231.0 2023-12-19T18:03:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:128 18.24 18:25b5fce8:::10000000231.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782b686800 2023-12-19T18:03:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 18 ==== osd_op_reply(128 10000000231.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000231 2023-12-19T18:03:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/60 2023-12-19T18:03:48.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=60 2023-12-19T18:03:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:129 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 19 ==== osd_op_reply(129 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:130 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 57 ==== osd_op_reply(130 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.904+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:131 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b686400 2023-12-19T18:03:48.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 26 ==== osd_op_reply(131 10000000000.01800000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 14 2023-12-19T18:03:48.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:132 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:48.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 27 ==== osd_op_reply(132 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=60 frag=1*, r=0 2023-12-19T18:03:48.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 20 datascan.read_dentry: 60_head not found in result 2023-12-19T18:03:48.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000231 at 0x0x10000000000/60 with size=2 bytes 2023-12-19T18:03:48.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.908+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:133 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eac00 con 0x55782b686400 2023-12-19T18:03:48.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 28 ==== osd_op_reply(133 10000000000.01800000 [omap-set-vals] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/60 pointing to 0x0x10000000231 2023-12-19T18:03:48.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:134 18.14 18:28000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb000 con 0x55782c0bf800 2023-12-19T18:03:48.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 58 ==== osd_op_reply(134 [pgnls-filter start_epoch 131 out=101b] v131'20 uv20 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000020e.00000000 2023-12-19T18:03:48.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000020e.0 2023-12-19T18:03:48.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:135 18.14 18:29971f97:::1000000020e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:48.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 59 ==== osd_op_reply(135 1000000020e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020e 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/25 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=25 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:136 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf000 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 20 ==== osd_op_reply(136 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.912+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:137 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf800 2023-12-19T18:03:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 60 ==== osd_op_reply(137 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:138 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686400 2023-12-19T18:03:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 29 ==== osd_op_reply(138 10000000000.01800000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 15 2023-12-19T18:03:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:139 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782b686400 2023-12-19T18:03:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 30 ==== osd_op_reply(139 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=25 frag=1*, r=0 2023-12-19T18:03:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 20 datascan.read_dentry: 25_head not found in result 2023-12-19T18:03:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020e at 0x0x10000000000/25 with size=2 bytes 2023-12-19T18:03:48.923 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.916+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:140 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 31 ==== osd_op_reply(140 10000000000.01800000 [omap-set-vals] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/25 pointing to 0x0x1000000020e 2023-12-19T18:03:48.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:141 18.14 18:2ab28be7::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 61 ==== osd_op_reply(141 [pgnls-filter start_epoch 131 out=101b] v131'20 uv20 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000211.00000000 2023-12-19T18:03:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000211.0 2023-12-19T18:03:48.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:142 18.14 18:2ab28be7:::10000000211.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 62 ==== osd_op_reply(142 10000000211.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv19 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000211 2023-12-19T18:03:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/28 2023-12-19T18:03:48.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.920+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=28 2023-12-19T18:03:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:143 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 21 ==== osd_op_reply(143 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:144 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 63 ==== osd_op_reply(144 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:145 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 64 ==== osd_op_reply(145 10000000000.01000000 [omap-get-header out=274b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 13 2023-12-19T18:03:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:146 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 65 ==== osd_op_reply(146 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv13 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=28 frag=0*, r=0 2023-12-19T18:03:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 20 datascan.read_dentry: 28_head not found in result 2023-12-19T18:03:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000211 at 0x0x10000000000/28 with size=2 bytes 2023-12-19T18:03:48.932 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.924+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:147 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf800 2023-12-19T18:03:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.928+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 66 ==== osd_op_reply(147 10000000000.01000000 [omap-set-vals] v131'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.928+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/28 pointing to 0x0x10000000211 2023-12-19T18:03:48.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.928+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:148 18.14 18:2b89f3ba::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:48.936 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 67 ==== osd_op_reply(148 [pgnls-filter start_epoch 131 out=81b] v131'20 uv20 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000221.00000000 2023-12-19T18:03:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000221.0 2023-12-19T18:03:48.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:149 18.14 18:2b89f3ba:::10000000221.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 68 ==== osd_op_reply(149 10000000221.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv20 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000221 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/44 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=44 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:150 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf000 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 22 ==== osd_op_reply(150 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:151 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 69 ==== osd_op_reply(151 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.940 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.932+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:152 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b686400 2023-12-19T18:03:48.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 32 ==== osd_op_reply(152 10000000000.01800000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-12-19T18:03:48.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:153 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b686400 2023-12-19T18:03:48.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 33 ==== osd_op_reply(153 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=44 frag=1*, r=0 2023-12-19T18:03:48.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 20 datascan.read_dentry: 44_head not found in result 2023-12-19T18:03:48.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000221 at 0x0x10000000000/44 with size=2 bytes 2023-12-19T18:03:48.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.936+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:154 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b686400 2023-12-19T18:03:48.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 34 ==== osd_op_reply(154 10000000000.01800000 [omap-set-vals] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/44 pointing to 0x0x10000000221 2023-12-19T18:03:48.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:155 18.34 18:2c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686800 2023-12-19T18:03:48.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 19 ==== osd_op_reply(155 [pgnls-filter start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:48.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:156 18.c 18:30000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b6b4400 2023-12-19T18:03:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 11 ==== osd_op_reply(156 [pgnls-filter start_epoch 131 out=81b] v131'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001fc.00000000 2023-12-19T18:03:48.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001fc.0 2023-12-19T18:03:48.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.940+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:157 18.c 18:30604137:::100000001fc.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b6b4400 2023-12-19T18:03:48.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 12 ==== osd_op_reply(157 100000001fc.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:48.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fc 2023-12-19T18:03:48.948 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/7 2023-12-19T18:03:48.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=7 2023-12-19T18:03:48.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:158 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf000 2023-12-19T18:03:48.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 23 ==== osd_op_reply(158 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:159 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:48.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 70 ==== osd_op_reply(159 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:160 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686400 2023-12-19T18:03:48.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 35 ==== osd_op_reply(160 10000000000.01800000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.951 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-12-19T18:03:48.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.944+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:161 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:48.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 36 ==== osd_op_reply(161 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=7 frag=1*, r=0 2023-12-19T18:03:48.952 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 20 datascan.read_dentry: 7_head not found in result 2023-12-19T18:03:48.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fc at 0x0x10000000000/7 with size=1 bytes 2023-12-19T18:03:48.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:162 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:48.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 37 ==== osd_op_reply(162 10000000000.01800000 [omap-set-vals] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x100000001fc 2023-12-19T18:03:48.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55782b6eb000 0x55782b6af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.955 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:163 18.2c 18:34000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b6eb000 2023-12-19T18:03:48.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.948+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55782b6eb000 0x55782b6af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8be31700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55782b6eb000 0x55782b6af180 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(163 [pgnls-filter start_epoch 131 out=101b] v131'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782b6eb000 2023-12-19T18:03:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000223.00000000 2023-12-19T18:03:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000223.0 2023-12-19T18:03:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:164 18.2c 18:35964134:::10000000223.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782b6eb000 2023-12-19T18:03:48.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(164 10000000223.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782b6eb000 2023-12-19T18:03:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000223 2023-12-19T18:03:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/46 2023-12-19T18:03:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=46 2023-12-19T18:03:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:165 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf000 2023-12-19T18:03:48.959 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 24 ==== osd_op_reply(165 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:166 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 71 ==== osd_op_reply(166 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.952+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:167 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 72 ==== osd_op_reply(167 10000000000.01000000 [omap-get-header out=274b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 14 2023-12-19T18:03:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:168 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 73 ==== osd_op_reply(168 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=46 frag=0*, r=0 2023-12-19T18:03:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 20 datascan.read_dentry: 46_head not found in result 2023-12-19T18:03:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000223 at 0x0x10000000000/46 with size=2 bytes 2023-12-19T18:03:48.962 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.956+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:169 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 74 ==== osd_op_reply(169 10000000000.01000000 [omap-set-vals] v131'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/46 pointing to 0x0x10000000223 2023-12-19T18:03:48.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:170 18.2c 18:37389ade::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b6eb000 2023-12-19T18:03:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(170 [pgnls-filter start_epoch 131 out=81b] v131'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ab40 con 0x55782b6eb000 2023-12-19T18:03:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000209.00000000 2023-12-19T18:03:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000209.0 2023-12-19T18:03:48.966 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:171 18.2c 18:37389ade:::10000000209.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782b6eb000 2023-12-19T18:03:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(171 10000000209.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782b6eb000 2023-12-19T18:03:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000209 2023-12-19T18:03:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/20 2023-12-19T18:03:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=20 2023-12-19T18:03:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:172 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782c0bf000 2023-12-19T18:03:48.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 25 ==== osd_op_reply(172 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:173 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 75 ==== osd_op_reply(173 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.960+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:174 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 76 ==== osd_op_reply(174 10000000000.01000000 [omap-get-header out=274b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 15 2023-12-19T18:03:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:175 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf800 2023-12-19T18:03:48.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 77 ==== osd_op_reply(175 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv15 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=20 frag=0*, r=0 2023-12-19T18:03:48.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 20 datascan.read_dentry: 20_head not found in result 2023-12-19T18:03:48.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000209 at 0x0x10000000000/20 with size=2 bytes 2023-12-19T18:03:48.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.964+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:176 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:48.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 78 ==== osd_op_reply(176 10000000000.01000000 [omap-set-vals] v131'16 uv16 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000209 2023-12-19T18:03:48.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:177 18.1c 18:38000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b6c7400 2023-12-19T18:03:48.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(177 [pgnls-filter start_epoch 131 out=49b] v129'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:48.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c87628700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55782b6eac00 0x55782b6fc000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:48.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:178 18.3c 18:3c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b6eac00 2023-12-19T18:03:48.974 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55782b6eac00 0x55782b6fc000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:48.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.968+0000 7f5c8ce33700 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55782b6eac00 0x55782b6fc000 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:48.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(178 [pgnls-filter start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:48.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:179 18.2 18:40000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b6eac00 2023-12-19T18:03:48.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(179 [pgnls-filter start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:48.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:180 18.22 18:44000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf000 2023-12-19T18:03:48.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 26 ==== osd_op_reply(180 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000024c.00000000 2023-12-19T18:03:48.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000024c.0 2023-12-19T18:03:48.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:181 18.22 18:450d4ca5:::1000000024c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:48.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 27 ==== osd_op_reply(181 1000000024c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000024c 2023-12-19T18:03:48.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/87 2023-12-19T18:03:48.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=87 2023-12-19T18:03:48.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:182 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf000 2023-12-19T18:03:48.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 28 ==== osd_op_reply(182 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.972+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:183 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:48.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 79 ==== osd_op_reply(183 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.981 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:184 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 80 ==== osd_op_reply(184 10000000000.01000000 [omap-get-header out=274b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 16 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:185 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 81 ==== osd_op_reply(185 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv16 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=87 frag=0*, r=0 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 20 datascan.read_dentry: 87_head not found in result 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000024c at 0x0x10000000000/87 with size=2 bytes 2023-12-19T18:03:48.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.976+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:186 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:48.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 82 ==== osd_op_reply(186 10000000000.01000000 [omap-set-vals] v131'17 uv17 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/87 pointing to 0x0x1000000024c 2023-12-19T18:03:48.985 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:187 18.22 18:45b8cac8::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf000 2023-12-19T18:03:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 29 ==== osd_op_reply(187 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000023d.00000000 2023-12-19T18:03:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000023d.0 2023-12-19T18:03:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:188 18.22 18:45b8cac8:::1000000023d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf000 2023-12-19T18:03:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 30 ==== osd_op_reply(188 1000000023d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000023d 2023-12-19T18:03:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/72 2023-12-19T18:03:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=72 2023-12-19T18:03:48.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:189 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 31 ==== osd_op_reply(189 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:190 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 83 ==== osd_op_reply(190 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:191 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 38 ==== osd_op_reply(191 10000000000.01800000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:48.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.980+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:192 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b686400 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 39 ==== osd_op_reply(192 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=72 frag=1*, r=0 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 20 datascan.read_dentry: 72_head not found in result 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000023d at 0x0x10000000000/72 with size=2 bytes 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:193 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782b686400 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 40 ==== osd_op_reply(193 10000000000.01800000 [omap-set-vals] v131'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:48.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/72 pointing to 0x0x1000000023d 2023-12-19T18:03:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:194 18.22 18:47efb22f::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf000 2023-12-19T18:03:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 32 ==== osd_op_reply(194 [pgnls-filter start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000235.00000000 2023-12-19T18:03:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000235.0 2023-12-19T18:03:48.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:195 18.22 18:47efb22f:::10000000235.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 33 ==== osd_op_reply(195 10000000235.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000235 2023-12-19T18:03:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/64 2023-12-19T18:03:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=64 2023-12-19T18:03:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.984+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:196 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf000 2023-12-19T18:03:48.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 34 ==== osd_op_reply(196 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:197 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 84 ==== osd_op_reply(197 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:48.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:198 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782c0bf800 2023-12-19T18:03:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 85 ==== osd_op_reply(198 10000000000.01000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 17 2023-12-19T18:03:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:48.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:199 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf800 2023-12-19T18:03:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 86 ==== osd_op_reply(199 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=64 frag=0*, r=0 2023-12-19T18:03:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 20 datascan.read_dentry: 64_head not found in result 2023-12-19T18:03:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000235 at 0x0x10000000000/64 with size=2 bytes 2023-12-19T18:03:48.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.988+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:200 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:48.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 87 ==== osd_op_reply(200 10000000000.01000000 [omap-set-vals] v131'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:48.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/64 pointing to 0x0x10000000235 2023-12-19T18:03:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:201 18.12 18:48000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782b6eb000 2023-12-19T18:03:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 5 ==== osd_op_reply(201 [pgnls-filter start_epoch 131 out=49b] v129'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02ab40 con 0x55782b6eb000 2023-12-19T18:03:48.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:202 18.32 18:4c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf000 2023-12-19T18:03:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 35 ==== osd_op_reply(202 [pgnls-filter start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:48.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000252.00000000 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000252.0 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.992+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:203 18.32 18:4e8c6251:::10000000252.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf000 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 36 ==== osd_op_reply(203 10000000252.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000252 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/93 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=93 2023-12-19T18:03:49.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:204 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf000 2023-12-19T18:03:49.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 37 ==== osd_op_reply(204 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:205 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf800 2023-12-19T18:03:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 88 ==== osd_op_reply(205 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:206 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782b686400 2023-12-19T18:03:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 41 ==== osd_op_reply(206 10000000000.01800000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T18:03:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:207 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b686400 2023-12-19T18:03:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 42 ==== osd_op_reply(207 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=93 frag=1*, r=0 2023-12-19T18:03:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 20 datascan.read_dentry: 93_head not found in result 2023-12-19T18:03:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000252 at 0x0x10000000000/93 with size=2 bytes 2023-12-19T18:03:49.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:48.996+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:208 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b686400 2023-12-19T18:03:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.000+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 43 ==== osd_op_reply(208 10000000000.01800000 [omap-set-vals] v131'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.000+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/93 pointing to 0x0x10000000252 2023-12-19T18:03:49.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.000+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:209 18.a 18:50000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf000 2023-12-19T18:03:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 38 ==== osd_op_reply(209 [pgnls-filter start_epoch 131 out=101b] v131'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000023f.00000000 2023-12-19T18:03:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000023f.0 2023-12-19T18:03:49.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:210 18.a 18:52dcfedc:::1000000023f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf000 2023-12-19T18:03:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 39 ==== osd_op_reply(210 1000000023f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000023f 2023-12-19T18:03:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/74 2023-12-19T18:03:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=74 2023-12-19T18:03:49.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:211 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf000 2023-12-19T18:03:49.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 40 ==== osd_op_reply(211 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:212 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 89 ==== osd_op_reply(212 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.004+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:213 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf800 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 90 ==== osd_op_reply(213 10000000000.01000000 [omap-get-header out=274b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 18 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.012 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:214 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782c0bf800 2023-12-19T18:03:49.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 91 ==== osd_op_reply(214 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=74 frag=0*, r=0 2023-12-19T18:03:49.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 20 datascan.read_dentry: 74_head not found in result 2023-12-19T18:03:49.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000023f at 0x0x10000000000/74 with size=2 bytes 2023-12-19T18:03:49.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.008+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:215 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf800 2023-12-19T18:03:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 92 ==== osd_op_reply(215 10000000000.01000000 [omap-set-vals] v131'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.016 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/74 pointing to 0x0x1000000023f 2023-12-19T18:03:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:216 18.a 18:53d16f76::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782c0bf000 2023-12-19T18:03:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 41 ==== osd_op_reply(216 [pgnls-filter start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000023b.00000000 2023-12-19T18:03:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000023b.0 2023-12-19T18:03:49.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:217 18.a 18:53d16f76:::1000000023b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf000 2023-12-19T18:03:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 42 ==== osd_op_reply(217 1000000023b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000023b 2023-12-19T18:03:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/70 2023-12-19T18:03:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=70 2023-12-19T18:03:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:218 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf000 2023-12-19T18:03:49.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 43 ==== osd_op_reply(218 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:219 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 93 ==== osd_op_reply(219 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.012+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:220 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 94 ==== osd_op_reply(220 10000000000.01000000 [omap-get-header out=274b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 19 2023-12-19T18:03:49.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:221 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf800 2023-12-19T18:03:49.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 95 ==== osd_op_reply(221 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=70 frag=0*, r=0 2023-12-19T18:03:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 20 datascan.read_dentry: 70_head not found in result 2023-12-19T18:03:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000023b at 0x0x10000000000/70 with size=2 bytes 2023-12-19T18:03:49.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:222 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 96 ==== osd_op_reply(222 10000000000.01000000 [omap-set-vals] v131'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/70 pointing to 0x0x1000000023b 2023-12-19T18:03:49.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.016+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:223 18.2a 18:54000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.025 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 44 ==== osd_op_reply(223 [pgnls-filter start_epoch 131 out=101b] v131'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000020a.00000000 2023-12-19T18:03:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000020a.0 2023-12-19T18:03:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:224 18.2a 18:55a6cd83:::1000000020a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:49.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 45 ==== osd_op_reply(224 1000000020a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020a 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/21 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=21 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:225 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf000 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 44 ==== osd_op_reply(225 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.027 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:226 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 97 ==== osd_op_reply(226 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.020+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:227 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:49.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 98 ==== osd_op_reply(227 10000000000.01000000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-12-19T18:03:49.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:228 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 99 ==== osd_op_reply(228 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=21 frag=0*, r=0 2023-12-19T18:03:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 20 datascan.read_dentry: 21_head not found in result 2023-12-19T18:03:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020a at 0x0x10000000000/21 with size=2 bytes 2023-12-19T18:03:49.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.024+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:229 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 100 ==== osd_op_reply(229 10000000000.01000000 [omap-set-vals] v131'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x1000000020a 2023-12-19T18:03:49.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:230 18.2a 18:56889a45::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b686400 2023-12-19T18:03:49.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 46 ==== osd_op_reply(230 [pgnls-filter start_epoch 131 out=101b] v131'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000213.00000000 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000213.0 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:231 18.2a 18:56889a45:::10000000213.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782b686400 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 47 ==== osd_op_reply(231 10000000213.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv19 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000213 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/30 2023-12-19T18:03:49.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=30 2023-12-19T18:03:49.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:232 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf000 2023-12-19T18:03:49.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 45 ==== osd_op_reply(232 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.028+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:233 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 101 ==== osd_op_reply(233 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:234 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782b686400 2023-12-19T18:03:49.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 48 ==== osd_op_reply(234 10000000000.01800000 [omap-get-header out=274b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 20 2023-12-19T18:03:49.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:235 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b686400 2023-12-19T18:03:49.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 49 ==== osd_op_reply(235 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv20 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=30 frag=1*, r=0 2023-12-19T18:03:49.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 20 datascan.read_dentry: 30_head not found in result 2023-12-19T18:03:49.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000213 at 0x0x10000000000/30 with size=2 bytes 2023-12-19T18:03:49.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.032+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:236 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782b686400 2023-12-19T18:03:49.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 50 ==== osd_op_reply(236 10000000000.01800000 [omap-set-vals] v131'21 uv21 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/30 pointing to 0x0x10000000213 2023-12-19T18:03:49.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:237 18.2a 18:576ad4f4::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782b686400 2023-12-19T18:03:49.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 51 ==== osd_op_reply(237 [pgnls-filter start_epoch 131 out=101b] v131'21 uv21 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000245.00000000 2023-12-19T18:03:49.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000245.0 2023-12-19T18:03:49.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:238 18.2a 18:576ad4f4:::10000000245.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b686400 2023-12-19T18:03:49.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 52 ==== osd_op_reply(238 10000000245.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv20 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000245 2023-12-19T18:03:49.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/80 2023-12-19T18:03:49.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=80 2023-12-19T18:03:49.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:239 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf000 2023-12-19T18:03:49.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 46 ==== osd_op_reply(239 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.036+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:240 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:49.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 102 ==== osd_op_reply(240 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:241 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:49.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 103 ==== osd_op_reply(241 10000000000.01000000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-12-19T18:03:49.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:242 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:49.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 104 ==== osd_op_reply(242 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=80 frag=0*, r=0 2023-12-19T18:03:49.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 20 datascan.read_dentry: 80_head not found in result 2023-12-19T18:03:49.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000245 at 0x0x10000000000/80 with size=2 bytes 2023-12-19T18:03:49.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.040+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:243 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:49.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 105 ==== osd_op_reply(243 10000000000.01000000 [omap-set-vals] v131'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/80 pointing to 0x0x10000000245 2023-12-19T18:03:49.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:244 18.2a 18:57fe7535::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b686400 2023-12-19T18:03:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 53 ==== osd_op_reply(244 [pgnls-filter start_epoch 131 out=81b] v131'21 uv21 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001f6.00000000 2023-12-19T18:03:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001f6.0 2023-12-19T18:03:49.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:245 18.2a 18:57fe7535:::100000001f6.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b686400 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 54 ==== osd_op_reply(245 100000001f6.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv21 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f6 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/1 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=1 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:246 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 47 ==== osd_op_reply(246 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:247 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 106 ==== osd_op_reply(247 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.044+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:248 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 107 ==== osd_op_reply(248 10000000000.01000000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:249 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:49.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 108 ==== osd_op_reply(249 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=1 frag=0*, r=0 2023-12-19T18:03:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 20 datascan.read_dentry: 1_head not found in result 2023-12-19T18:03:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f6 at 0x0x10000000000/1 with size=1 bytes 2023-12-19T18:03:49.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:250 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 109 ==== osd_op_reply(250 10000000000.01000000 [omap-set-vals] v131'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x100000001f6 2023-12-19T18:03:49.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:251 18.1a 18:58000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf000 2023-12-19T18:03:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 48 ==== osd_op_reply(251 [pgnls-filter start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000226.00000000 2023-12-19T18:03:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.048+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000226.0 2023-12-19T18:03:49.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:252 18.1a 18:582f7b2d:::10000000226.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:49.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 49 ==== osd_op_reply(252 10000000226.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000226 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/49 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=49 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:253 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf000 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 50 ==== osd_op_reply(253 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:254 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:49.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 110 ==== osd_op_reply(254 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:255 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b686400 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 55 ==== osd_op_reply(255 10000000000.01800000 [omap-get-header out=274b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 21 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:256 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b686400 2023-12-19T18:03:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 56 ==== osd_op_reply(256 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv21 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=49 frag=1*, r=0 2023-12-19T18:03:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 20 datascan.read_dentry: 49_head not found in result 2023-12-19T18:03:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000226 at 0x0x10000000000/49 with size=2 bytes 2023-12-19T18:03:49.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.052+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:257 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782b686400 2023-12-19T18:03:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 57 ==== osd_op_reply(257 10000000000.01800000 [omap-set-vals] v131'22 uv22 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/49 pointing to 0x0x10000000226 2023-12-19T18:03:49.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:258 18.1a 18:5a2a1294::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf000 2023-12-19T18:03:49.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 51 ==== osd_op_reply(258 [pgnls-filter start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000023a.00000000 2023-12-19T18:03:49.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000023a.0 2023-12-19T18:03:49.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.056+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:259 18.1a 18:5a2a1294:::1000000023a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf000 2023-12-19T18:03:49.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 52 ==== osd_op_reply(259 1000000023a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000023a 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/69 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=69 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:260 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf000 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 53 ==== osd_op_reply(260 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.065 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:261 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:49.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 111 ==== osd_op_reply(261 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:262 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:49.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 112 ==== osd_op_reply(262 10000000000.01000000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-12-19T18:03:49.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:263 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf800 2023-12-19T18:03:49.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.060+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 113 ==== osd_op_reply(263 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=69 frag=0*, r=0 2023-12-19T18:03:49.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8de76840 20 datascan.read_dentry: 69_head not found in result 2023-12-19T18:03:49.068 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000023a at 0x0x10000000000/69 with size=2 bytes 2023-12-19T18:03:49.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:264 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 114 ==== osd_op_reply(264 10000000000.01000000 [omap-set-vals] v131'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/69 pointing to 0x0x1000000023a 2023-12-19T18:03:49.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.064+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:265 18.3a 18:5c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782b686800 2023-12-19T18:03:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 20 ==== osd_op_reply(265 [pgnls-filter start_epoch 131 out=49b] v129'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:266 18.6 18:60000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b6eac00 2023-12-19T18:03:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(266 [pgnls-filter start_epoch 131 out=81b] v131'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000228.00000000 2023-12-19T18:03:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000228.0 2023-12-19T18:03:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:267 18.6 18:614797eb:::10000000228.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782b6eac00 2023-12-19T18:03:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(267 10000000228.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000228 2023-12-19T18:03:49.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/51 2023-12-19T18:03:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=51 2023-12-19T18:03:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:268 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf000 2023-12-19T18:03:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.068+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 54 ==== osd_op_reply(268 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02ab40 con 0x55782c0bf000 2023-12-19T18:03:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:269 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782c0bf800 2023-12-19T18:03:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 115 ==== osd_op_reply(269 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:270 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b686400 2023-12-19T18:03:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 58 ==== osd_op_reply(270 10000000000.01800000 [omap-get-header out=274b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 22 2023-12-19T18:03:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:271 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 59 ==== osd_op_reply(271 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ab40 con 0x55782b686400 2023-12-19T18:03:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=51 frag=1*, r=0 2023-12-19T18:03:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 20 datascan.read_dentry: 51_head not found in result 2023-12-19T18:03:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000228 at 0x0x10000000000/51 with size=2 bytes 2023-12-19T18:03:49.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.072+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:272 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 60 ==== osd_op_reply(272 10000000000.01800000 [omap-set-vals] v131'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b200 con 0x55782b686400 2023-12-19T18:03:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/51 pointing to 0x0x10000000228 2023-12-19T18:03:49.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:273 18.26 18:64000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b6eb000 2023-12-19T18:03:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 6 ==== osd_op_reply(273 [pgnls-filter start_epoch 131 out=101b] v131'24 uv24 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b200 con 0x55782b6eb000 2023-12-19T18:03:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001ff.00000000 2023-12-19T18:03:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001ff.0 2023-12-19T18:03:49.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:274 18.26 18:658f2455:::100000001ff.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b6eb000 2023-12-19T18:03:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 7 ==== osd_op_reply(274 100000001ff.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv22 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b200 con 0x55782b6eb000 2023-12-19T18:03:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001ff 2023-12-19T18:03:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/10 2023-12-19T18:03:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=10 2023-12-19T18:03:49.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.076+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:275 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf000 2023-12-19T18:03:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 55 ==== osd_op_reply(275 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b200 con 0x55782c0bf000 2023-12-19T18:03:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:276 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 116 ==== osd_op_reply(276 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:277 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf800 2023-12-19T18:03:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 117 ==== osd_op_reply(277 10000000000.01000000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-12-19T18:03:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:278 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 118 ==== osd_op_reply(278 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=10 frag=0*, r=0 2023-12-19T18:03:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 20 datascan.read_dentry: 10_head not found in result 2023-12-19T18:03:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001ff at 0x0x10000000000/10 with size=2 bytes 2023-12-19T18:03:49.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.080+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:279 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf800 2023-12-19T18:03:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 119 ==== osd_op_reply(279 10000000000.01000000 [omap-set-vals] v131'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x100000001ff 2023-12-19T18:03:49.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:280 18.26 18:65d05a5c::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b6eb000 2023-12-19T18:03:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 8 ==== osd_op_reply(280 [pgnls-filter start_epoch 131 out=101b] v131'24 uv24 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b200 con 0x55782b6eb000 2023-12-19T18:03:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000258.00000000 2023-12-19T18:03:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000258.0 2023-12-19T18:03:49.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:281 18.26 18:65d05a5c:::10000000258.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b6eb000 2023-12-19T18:03:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 9 ==== osd_op_reply(281 10000000258.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv23 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b200 con 0x55782b6eb000 2023-12-19T18:03:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000258 2023-12-19T18:03:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/99 2023-12-19T18:03:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=99 2023-12-19T18:03:49.092 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.084+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:282 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf000 2023-12-19T18:03:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 56 ==== osd_op_reply(282 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b200 con 0x55782c0bf000 2023-12-19T18:03:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:283 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 120 ==== osd_op_reply(283 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:284 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 61 ==== osd_op_reply(284 10000000000.01800000 [omap-get-header out=274b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b200 con 0x55782b686400 2023-12-19T18:03:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 23 2023-12-19T18:03:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.095 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:285 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 62 ==== osd_op_reply(285 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b200 con 0x55782b686400 2023-12-19T18:03:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=99 frag=1*, r=0 2023-12-19T18:03:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 20 datascan.read_dentry: 99_head not found in result 2023-12-19T18:03:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000258 at 0x0x10000000000/99 with size=2 bytes 2023-12-19T18:03:49.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.088+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:286 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:49.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 63 ==== osd_op_reply(286 10000000000.01800000 [omap-set-vals] v131'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b200 con 0x55782b686400 2023-12-19T18:03:49.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/99 pointing to 0x0x10000000258 2023-12-19T18:03:49.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:287 18.26 18:65e03fee::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782b6eb000 2023-12-19T18:03:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 10 ==== osd_op_reply(287 [pgnls-filter start_epoch 131 out=81b] v131'24 uv24 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b200 con 0x55782b6eb000 2023-12-19T18:03:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000240.00000000 2023-12-19T18:03:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000240.0 2023-12-19T18:03:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.092+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:288 18.26 18:65e03fee:::10000000240.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b6eb000 2023-12-19T18:03:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 11 ==== osd_op_reply(288 10000000240.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv24 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b200 con 0x55782b6eb000 2023-12-19T18:03:49.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000240 2023-12-19T18:03:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/75 2023-12-19T18:03:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=75 2023-12-19T18:03:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:289 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf000 2023-12-19T18:03:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 57 ==== osd_op_reply(289 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:290 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 121 ==== osd_op_reply(290 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:291 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 122 ==== osd_op_reply(291 10000000000.01000000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-12-19T18:03:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:292 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 123 ==== osd_op_reply(292 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=75 frag=0*, r=0 2023-12-19T18:03:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 20 datascan.read_dentry: 75_head not found in result 2023-12-19T18:03:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000240 at 0x0x10000000000/75 with size=2 bytes 2023-12-19T18:03:49.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.096+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:293 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782c0bf800 2023-12-19T18:03:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.100+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 124 ==== osd_op_reply(293 10000000000.01000000 [omap-set-vals] v131'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.100+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/75 pointing to 0x0x10000000240 2023-12-19T18:03:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.100+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:294 18.16 18:68000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf000 2023-12-19T18:03:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.100+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 58 ==== osd_op_reply(294 [pgnls-filter start_epoch 131 out=49b] v129'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.100+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:295 18.36 18:6c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a000 con 0x55782b6c7400 2023-12-19T18:03:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(295 [pgnls-filter start_epoch 131 out=101b] v131'27 uv27 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000255.00000000 2023-12-19T18:03:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000255.0 2023-12-19T18:03:49.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:296 18.36 18:6cdfec98:::10000000255.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b6c7400 2023-12-19T18:03:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(296 10000000255.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv24 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000255 2023-12-19T18:03:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/96 2023-12-19T18:03:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=96 2023-12-19T18:03:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:297 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf000 2023-12-19T18:03:49.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 59 ==== osd_op_reply(297 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:298 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf800 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 125 ==== osd_op_reply(298 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.104+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:299 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 126 ==== osd_op_reply(299 10000000000.01000000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 26 2023-12-19T18:03:49.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:300 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 127 ==== osd_op_reply(300 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=96 frag=0*, r=0 2023-12-19T18:03:49.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 20 datascan.read_dentry: 96_head not found in result 2023-12-19T18:03:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000255 at 0x0x10000000000/96 with size=2 bytes 2023-12-19T18:03:49.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.108+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:301 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 128 ==== osd_op_reply(301 10000000000.01000000 [omap-set-vals] v131'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/96 pointing to 0x0x10000000255 2023-12-19T18:03:49.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:302 18.36 18:6ee5e2c4::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782b6c7400 2023-12-19T18:03:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(302 [pgnls-filter start_epoch 131 out=101b] v131'27 uv27 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001f9.00000000 2023-12-19T18:03:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001f9.0 2023-12-19T18:03:49.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:303 18.36 18:6ee5e2c4:::100000001f9.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b6c7400 2023-12-19T18:03:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(303 100000001f9.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv25 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f9 2023-12-19T18:03:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/4 2023-12-19T18:03:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=4 2023-12-19T18:03:49.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:304 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf000 2023-12-19T18:03:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 60 ==== osd_op_reply(304 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:305 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 129 ==== osd_op_reply(305 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.112+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:306 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 130 ==== osd_op_reply(306 10000000000.01000000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:307 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 131 ==== osd_op_reply(307 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=4 frag=0*, r=0 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 20 datascan.read_dentry: 4_head not found in result 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f9 at 0x0x10000000000/4 with size=1 bytes 2023-12-19T18:03:49.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.116+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:308 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:49.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 132 ==== osd_op_reply(308 10000000000.01000000 [omap-set-vals] v131'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x100000001f9 2023-12-19T18:03:49.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:309 18.36 18:6f746908::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782b6c7400 2023-12-19T18:03:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(309 [pgnls-filter start_epoch 131 out=101b] v131'27 uv27 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000022c.00000000 2023-12-19T18:03:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000022c.0 2023-12-19T18:03:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:310 18.36 18:6f746908:::1000000022c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782b6c7400 2023-12-19T18:03:49.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(310 1000000022c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv26 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000022c 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/55 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=55 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:311 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782c0bf000 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 61 ==== osd_op_reply(311 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:312 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf800 2023-12-19T18:03:49.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 133 ==== osd_op_reply(312 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.120+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:313 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf800 2023-12-19T18:03:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 134 ==== osd_op_reply(313 10000000000.01000000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 28 2023-12-19T18:03:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:314 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782c0bf800 2023-12-19T18:03:49.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 135 ==== osd_op_reply(314 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=55 frag=0*, r=0 2023-12-19T18:03:49.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 20 datascan.read_dentry: 55_head not found in result 2023-12-19T18:03:49.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000022c at 0x0x10000000000/55 with size=2 bytes 2023-12-19T18:03:49.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.124+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:315 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 136 ==== osd_op_reply(315 10000000000.01000000 [omap-set-vals] v131'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/55 pointing to 0x0x1000000022c 2023-12-19T18:03:49.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:316 18.36 18:6fe38dc2::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b6c7400 2023-12-19T18:03:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 9 ==== osd_op_reply(316 [pgnls-filter start_epoch 131 out=81b] v131'27 uv27 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2023-12-19T18:03:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001f7.0 2023-12-19T18:03:49.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:317 18.36 18:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b6c7400 2023-12-19T18:03:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 10 ==== osd_op_reply(317 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv27 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2023-12-19T18:03:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/2 2023-12-19T18:03:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=2 2023-12-19T18:03:49.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:318 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782c0bf000 2023-12-19T18:03:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 62 ==== osd_op_reply(318 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.128+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:319 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf800 2023-12-19T18:03:49.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 137 ==== osd_op_reply(319 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:320 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 138 ==== osd_op_reply(320 10000000000.01000000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-12-19T18:03:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:321 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 139 ==== osd_op_reply(321 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=2 frag=0*, r=0 2023-12-19T18:03:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 20 datascan.read_dentry: 2_head not found in result 2023-12-19T18:03:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000000/2 with size=1 bytes 2023-12-19T18:03:49.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.132+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:322 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:49.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 140 ==== osd_op_reply(322 10000000000.01000000 [omap-set-vals] v131'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x100000001f7 2023-12-19T18:03:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:323 18.e 18:70000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b686800 2023-12-19T18:03:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 21 ==== osd_op_reply(323 [pgnls-filter start_epoch 131 out=81b] v131'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000022f.00000000 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000022f.0 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:324 18.e 18:71c13145:::1000000022f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686800 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 22 ==== osd_op_reply(324 1000000022f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000022f 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/58 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=58 2023-12-19T18:03:49.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.136+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:325 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf000 2023-12-19T18:03:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 63 ==== osd_op_reply(325 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:326 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 141 ==== osd_op_reply(326 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:327 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686400 2023-12-19T18:03:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 64 ==== osd_op_reply(327 10000000000.01800000 [omap-get-header out=274b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 24 2023-12-19T18:03:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:328 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686400 2023-12-19T18:03:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 65 ==== osd_op_reply(328 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv24 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=58 frag=1*, r=0 2023-12-19T18:03:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 20 datascan.read_dentry: 58_head not found in result 2023-12-19T18:03:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000022f at 0x0x10000000000/58 with size=2 bytes 2023-12-19T18:03:49.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.140+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:329 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:49.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.144+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 66 ==== osd_op_reply(329 10000000000.01800000 [omap-set-vals] v131'25 uv25 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.144+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/58 pointing to 0x0x1000000022f 2023-12-19T18:03:49.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.144+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:330 18.2e 18:74000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf000 2023-12-19T18:03:49.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 64 ==== osd_op_reply(330 [pgnls-filter start_epoch 131 out=101b] v131'19 uv19 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000021c.00000000 2023-12-19T18:03:49.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000021c.0 2023-12-19T18:03:49.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:331 18.2e 18:74d13cfc:::1000000021c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:49.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 65 ==== osd_op_reply(331 1000000021c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000021c 2023-12-19T18:03:49.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/39 2023-12-19T18:03:49.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=39 2023-12-19T18:03:49.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:332 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf000 2023-12-19T18:03:49.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 66 ==== osd_op_reply(332 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:333 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:49.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 142 ==== osd_op_reply(333 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:334 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf800 2023-12-19T18:03:49.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.148+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 143 ==== osd_op_reply(334 10000000000.01000000 [omap-get-header out=274b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 30 2023-12-19T18:03:49.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:335 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:49.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 144 ==== osd_op_reply(335 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=39 frag=0*, r=0 2023-12-19T18:03:49.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 20 datascan.read_dentry: 39_head not found in result 2023-12-19T18:03:49.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000021c at 0x0x10000000000/39 with size=2 bytes 2023-12-19T18:03:49.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.152+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:336 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a000 con 0x55782c0bf800 2023-12-19T18:03:49.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 145 ==== osd_op_reply(336 10000000000.01000000 [omap-set-vals] v131'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/39 pointing to 0x0x1000000021c 2023-12-19T18:03:49.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:337 18.2e 18:7528f44f::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782c0bf000 2023-12-19T18:03:49.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 67 ==== osd_op_reply(337 [pgnls-filter start_epoch 131 out=101b] v131'19 uv19 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000242.00000000 2023-12-19T18:03:49.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000242.0 2023-12-19T18:03:49.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:338 18.2e 18:7528f44f:::10000000242.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782c0bf000 2023-12-19T18:03:49.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 68 ==== osd_op_reply(338 10000000242.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000242 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/77 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=77 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:339 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf000 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 69 ==== osd_op_reply(339 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:340 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf800 2023-12-19T18:03:49.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 146 ==== osd_op_reply(340 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.156+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:341 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782c0bf800 2023-12-19T18:03:49.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 147 ==== osd_op_reply(341 10000000000.01000000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-12-19T18:03:49.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:342 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 148 ==== osd_op_reply(342 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=77 frag=0*, r=0 2023-12-19T18:03:49.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 20 datascan.read_dentry: 77_head not found in result 2023-12-19T18:03:49.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000242 at 0x0x10000000000/77 with size=2 bytes 2023-12-19T18:03:49.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.160+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:343 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:49.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 149 ==== osd_op_reply(343 10000000000.01000000 [omap-set-vals] v131'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/77 pointing to 0x0x10000000242 2023-12-19T18:03:49.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:344 18.2e 18:7611a124::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf000 2023-12-19T18:03:49.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 70 ==== osd_op_reply(344 [pgnls-filter start_epoch 131 out=81b] v131'19 uv19 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000021e.00000000 2023-12-19T18:03:49.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000021e.0 2023-12-19T18:03:49.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:345 18.2e 18:7611a124:::1000000021e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf000 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 71 ==== osd_op_reply(345 1000000021e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv19 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000021e 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/41 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=41 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:346 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf000 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 72 ==== osd_op_reply(346 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.164+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:347 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 150 ==== osd_op_reply(347 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:348 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b686400 2023-12-19T18:03:49.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 67 ==== osd_op_reply(348 10000000000.01800000 [omap-get-header out=274b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 25 2023-12-19T18:03:49.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:349 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 68 ==== osd_op_reply(349 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv25 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=41 frag=1*, r=0 2023-12-19T18:03:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 20 datascan.read_dentry: 41_head not found in result 2023-12-19T18:03:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000021e at 0x0x10000000000/41 with size=2 bytes 2023-12-19T18:03:49.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.168+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:350 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686400 2023-12-19T18:03:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 69 ==== osd_op_reply(350 10000000000.01800000 [omap-set-vals] v131'26 uv26 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/41 pointing to 0x0x1000000021e 2023-12-19T18:03:49.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:351 18.1e 18:78000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b6b4400 2023-12-19T18:03:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 13 ==== osd_op_reply(351 [pgnls-filter start_epoch 131 out=101b] v131'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000020c.00000000 2023-12-19T18:03:49.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000020c.0 2023-12-19T18:03:49.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:352 18.1e 18:789b801b:::1000000020c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782b6b4400 2023-12-19T18:03:49.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 14 ==== osd_op_reply(352 1000000020c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.172+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020c 2023-12-19T18:03:49.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/23 2023-12-19T18:03:49.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=23 2023-12-19T18:03:49.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:353 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782c0bf000 2023-12-19T18:03:49.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 73 ==== osd_op_reply(353 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:354 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf800 2023-12-19T18:03:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 151 ==== osd_op_reply(354 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:355 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b686400 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 70 ==== osd_op_reply(355 10000000000.01800000 [omap-get-header out=274b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 26 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:356 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.176+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 71 ==== osd_op_reply(356 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv26 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=23 frag=1*, r=0 2023-12-19T18:03:49.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 20 datascan.read_dentry: 23_head not found in result 2023-12-19T18:03:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020c at 0x0x10000000000/23 with size=2 bytes 2023-12-19T18:03:49.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:357 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686400 2023-12-19T18:03:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 72 ==== osd_op_reply(357 10000000000.01800000 [omap-set-vals] v131'27 uv27 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x1000000020c 2023-12-19T18:03:49.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:358 18.1e 18:7a9d9b47::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b6b4400 2023-12-19T18:03:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 15 ==== osd_op_reply(358 [pgnls-filter start_epoch 131 out=101b] v131'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000022b.00000000 2023-12-19T18:03:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.180+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000022b.0 2023-12-19T18:03:49.188 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:359 18.1e 18:7a9d9b47:::1000000022b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b6b4400 2023-12-19T18:03:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 16 ==== osd_op_reply(359 1000000022b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000022b 2023-12-19T18:03:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/54 2023-12-19T18:03:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=54 2023-12-19T18:03:49.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:360 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf000 2023-12-19T18:03:49.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 74 ==== osd_op_reply(360 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:361 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:49.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 152 ==== osd_op_reply(361 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.191 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:362 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b686400 2023-12-19T18:03:49.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 73 ==== osd_op_reply(362 10000000000.01800000 [omap-get-header out=274b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 27 2023-12-19T18:03:49.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.184+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:363 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782b686400 2023-12-19T18:03:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 74 ==== osd_op_reply(363 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv27 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=54 frag=1*, r=0 2023-12-19T18:03:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8de76840 20 datascan.read_dentry: 54_head not found in result 2023-12-19T18:03:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000022b at 0x0x10000000000/54 with size=2 bytes 2023-12-19T18:03:49.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:364 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782b686400 2023-12-19T18:03:49.195 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 75 ==== osd_op_reply(364 10000000000.01800000 [omap-set-vals] v131'28 uv28 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/54 pointing to 0x0x1000000022b 2023-12-19T18:03:49.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.188+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:365 18.1e 18:7ade2fd8::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782b6b4400 2023-12-19T18:03:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 17 ==== osd_op_reply(365 [pgnls-filter start_epoch 131 out=81b] v131'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000024e.00000000 2023-12-19T18:03:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000024e.0 2023-12-19T18:03:49.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:366 18.1e 18:7ade2fd8:::1000000024e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782b6b4400 2023-12-19T18:03:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 18 ==== osd_op_reply(366 1000000024e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000024e 2023-12-19T18:03:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/89 2023-12-19T18:03:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=89 2023-12-19T18:03:49.198 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:367 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf000 2023-12-19T18:03:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 75 ==== osd_op_reply(367 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:368 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf800 2023-12-19T18:03:49.201 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 153 ==== osd_op_reply(368 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:369 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b686400 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.192+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 76 ==== osd_op_reply(369 10000000000.01800000 [omap-get-header out=274b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 28 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:370 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 77 ==== osd_op_reply(370 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv28 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=89 frag=1*, r=0 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 20 datascan.read_dentry: 89_head not found in result 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000024e at 0x0x10000000000/89 with size=2 bytes 2023-12-19T18:03:49.202 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.196+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:371 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b686400 2023-12-19T18:03:49.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 78 ==== osd_op_reply(371 10000000000.01800000 [omap-set-vals] v131'29 uv29 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/89 pointing to 0x0x1000000024e 2023-12-19T18:03:49.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:372 18.3e 18:7c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf000 2023-12-19T18:03:49.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 76 ==== osd_op_reply(372 [pgnls-filter start_epoch 131 out=81b] v131'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000229.00000000 2023-12-19T18:03:49.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000229.0 2023-12-19T18:03:49.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:373 18.3e 18:7f918703:::10000000229.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:49.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 77 ==== osd_op_reply(373 10000000229.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000229 2023-12-19T18:03:49.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/52 2023-12-19T18:03:49.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=52 2023-12-19T18:03:49.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:374 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf000 2023-12-19T18:03:49.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 78 ==== osd_op_reply(374 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:375 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 154 ==== osd_op_reply(375 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.200+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:376 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 155 ==== osd_op_reply(376 10000000000.01000000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:377 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf800 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 156 ==== osd_op_reply(377 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=52 frag=0*, r=0 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 20 datascan.read_dentry: 52_head not found in result 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000229 at 0x0x10000000000/52 with size=2 bytes 2023-12-19T18:03:49.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.204+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:378 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 157 ==== osd_op_reply(378 10000000000.01000000 [omap-set-vals] v131'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/52 pointing to 0x0x10000000229 2023-12-19T18:03:49.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:379 18.1 18:80000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf000 2023-12-19T18:03:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 79 ==== osd_op_reply(379 [pgnls-filter start_epoch 131 out=81b] v131'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000224.00000000 2023-12-19T18:03:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000224.0 2023-12-19T18:03:49.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:380 18.1 18:805bc955:::10000000224.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf000 2023-12-19T18:03:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 80 ==== osd_op_reply(380 10000000224.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000224 2023-12-19T18:03:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/47 2023-12-19T18:03:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=47 2023-12-19T18:03:49.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:381 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 81 ==== osd_op_reply(381 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:382 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.208+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 158 ==== osd_op_reply(382 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:383 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782b686400 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 79 ==== osd_op_reply(383 10000000000.01800000 [omap-get-header out=274b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 29 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:384 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a000 con 0x55782b686400 2023-12-19T18:03:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 80 ==== osd_op_reply(384 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv29 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=47 frag=1*, r=0 2023-12-19T18:03:49.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 20 datascan.read_dentry: 47_head not found in result 2023-12-19T18:03:49.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000224 at 0x0x10000000000/47 with size=2 bytes 2023-12-19T18:03:49.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.212+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:385 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782b686400 2023-12-19T18:03:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 81 ==== osd_op_reply(385 10000000000.01800000 [omap-set-vals] v131'30 uv30 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/47 pointing to 0x0x10000000224 2023-12-19T18:03:49.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:386 18.21 18:84000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782b6b4400 2023-12-19T18:03:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 19 ==== osd_op_reply(386 [pgnls-filter start_epoch 131 out=49b] v129'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:387 18.11 18:88000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782b6c7400 2023-12-19T18:03:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 11 ==== osd_op_reply(387 [pgnls-filter start_epoch 131 out=49b] v129'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.216+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:388 18.31 18:8c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782b686400 2023-12-19T18:03:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 82 ==== osd_op_reply(388 [pgnls-filter start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000216.00000000 2023-12-19T18:03:49.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000216.0 2023-12-19T18:03:49.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:389 18.31 18:8c51d9b0:::10000000216.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b686400 2023-12-19T18:03:49.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 83 ==== osd_op_reply(389 10000000216.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000216 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/33 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=33 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:390 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf000 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 82 ==== osd_op_reply(390 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:391 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 159 ==== osd_op_reply(391 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:392 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b686400 2023-12-19T18:03:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 84 ==== osd_op_reply(392 10000000000.01800000 [omap-get-header out=274b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 30 2023-12-19T18:03:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.220+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:393 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 85 ==== osd_op_reply(393 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv30 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=33 frag=1*, r=0 2023-12-19T18:03:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8de76840 20 datascan.read_dentry: 33_head not found in result 2023-12-19T18:03:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000216 at 0x0x10000000000/33 with size=2 bytes 2023-12-19T18:03:49.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:394 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686400 2023-12-19T18:03:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 86 ==== osd_op_reply(394 10000000000.01800000 [omap-set-vals] v131'31 uv31 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/33 pointing to 0x0x10000000216 2023-12-19T18:03:49.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.224+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:395 18.31 18:8fb7f7b7::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b686400 2023-12-19T18:03:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 87 ==== osd_op_reply(395 [pgnls-filter start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000251.00000000 2023-12-19T18:03:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000251.0 2023-12-19T18:03:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:396 18.31 18:8fb7f7b7:::10000000251.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782b686400 2023-12-19T18:03:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 88 ==== osd_op_reply(396 10000000251.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000251 2023-12-19T18:03:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/92 2023-12-19T18:03:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=92 2023-12-19T18:03:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:397 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782c0bf000 2023-12-19T18:03:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 83 ==== osd_op_reply(397 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:398 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782c0bf800 2023-12-19T18:03:49.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 160 ==== osd_op_reply(398 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:399 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf800 2023-12-19T18:03:49.235 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 161 ==== osd_op_reply(399 10000000000.01000000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-12-19T18:03:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.228+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:400 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf800 2023-12-19T18:03:49.236 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 162 ==== osd_op_reply(400 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=92 frag=0*, r=0 2023-12-19T18:03:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8de76840 20 datascan.read_dentry: 92_head not found in result 2023-12-19T18:03:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000251 at 0x0x10000000000/92 with size=2 bytes 2023-12-19T18:03:49.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:401 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf800 2023-12-19T18:03:49.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 163 ==== osd_op_reply(401 10000000000.01000000 [omap-set-vals] v131'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/92 pointing to 0x0x10000000251 2023-12-19T18:03:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.232+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:402 18.9 18:90000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf000 2023-12-19T18:03:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 84 ==== osd_op_reply(402 [pgnls-filter start_epoch 131 out=101b] v131'8 uv8 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000024d.00000000 2023-12-19T18:03:49.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000024d.0 2023-12-19T18:03:49.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:403 18.9 18:915bff82:::1000000024d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf000 2023-12-19T18:03:49.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 85 ==== osd_op_reply(403 1000000024d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000024d 2023-12-19T18:03:49.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/88 2023-12-19T18:03:49.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=88 2023-12-19T18:03:49.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:404 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf000 2023-12-19T18:03:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 86 ==== osd_op_reply(404 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:405 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf800 2023-12-19T18:03:49.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 164 ==== osd_op_reply(405 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:406 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf800 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 165 ==== osd_op_reply(406 10000000000.01000000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:407 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:49.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 166 ==== osd_op_reply(407 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=88 frag=0*, r=0 2023-12-19T18:03:49.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 20 datascan.read_dentry: 88_head not found in result 2023-12-19T18:03:49.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000024d at 0x0x10000000000/88 with size=2 bytes 2023-12-19T18:03:49.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.236+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:408 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 167 ==== osd_op_reply(408 10000000000.01000000 [omap-set-vals] v131'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/88 pointing to 0x0x1000000024d 2023-12-19T18:03:49.247 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:409 18.9 18:91e366d7::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782c0bf000 2023-12-19T18:03:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 87 ==== osd_op_reply(409 [pgnls-filter start_epoch 131 out=81b] v131'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000230.00000000 2023-12-19T18:03:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000230.0 2023-12-19T18:03:49.248 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.240+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:410 18.9 18:91e366d7:::10000000230.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 88 ==== osd_op_reply(410 10000000230.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000230 2023-12-19T18:03:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/59 2023-12-19T18:03:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=59 2023-12-19T18:03:49.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:411 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf000 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 89 ==== osd_op_reply(411 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:412 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 168 ==== osd_op_reply(412 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:413 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 169 ==== osd_op_reply(413 10000000000.01000000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 35 2023-12-19T18:03:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.251 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:414 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf800 2023-12-19T18:03:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 170 ==== osd_op_reply(414 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=59 frag=0*, r=0 2023-12-19T18:03:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 20 datascan.read_dentry: 59_head not found in result 2023-12-19T18:03:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000230 at 0x0x10000000000/59 with size=2 bytes 2023-12-19T18:03:49.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.244+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:415 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.248+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 171 ==== osd_op_reply(415 10000000000.01000000 [omap-set-vals] v131'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.248+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/59 pointing to 0x0x10000000230 2023-12-19T18:03:49.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.248+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:416 18.29 18:94000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b6eac00 2023-12-19T18:03:49.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(416 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000024a.00000000 2023-12-19T18:03:49.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000024a.0 2023-12-19T18:03:49.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:417 18.29 18:94c02207:::1000000024a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b6eac00 2023-12-19T18:03:49.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(417 1000000024a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000024a 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/85 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=85 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:418 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 90 ==== osd_op_reply(418 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:419 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 172 ==== osd_op_reply(419 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:420 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 173 ==== osd_op_reply(420 10000000000.01000000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-12-19T18:03:49.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.260 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.252+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:421 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf800 2023-12-19T18:03:49.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 174 ==== osd_op_reply(421 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=85 frag=0*, r=0 2023-12-19T18:03:49.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8de76840 20 datascan.read_dentry: 85_head not found in result 2023-12-19T18:03:49.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000024a at 0x0x10000000000/85 with size=2 bytes 2023-12-19T18:03:49.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:422 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 175 ==== osd_op_reply(422 10000000000.01000000 [omap-set-vals] v131'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/85 pointing to 0x0x1000000024a 2023-12-19T18:03:49.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.256+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:423 18.29 18:95e8e66d::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b6eac00 2023-12-19T18:03:49.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(423 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000256.00000000 2023-12-19T18:03:49.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000256.0 2023-12-19T18:03:49.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:424 18.29 18:95e8e66d:::10000000256.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b6eac00 2023-12-19T18:03:49.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(424 10000000256.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000256 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/97 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=97 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:425 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf000 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 91 ==== osd_op_reply(425 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:426 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782c0bf800 2023-12-19T18:03:49.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 176 ==== osd_op_reply(426 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:427 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf800 2023-12-19T18:03:49.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 177 ==== osd_op_reply(427 10000000000.01000000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-12-19T18:03:49.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.260+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:428 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782c0bf800 2023-12-19T18:03:49.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 178 ==== osd_op_reply(428 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=97 frag=0*, r=0 2023-12-19T18:03:49.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8de76840 20 datascan.read_dentry: 97_head not found in result 2023-12-19T18:03:49.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000256 at 0x0x10000000000/97 with size=2 bytes 2023-12-19T18:03:49.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:429 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 179 ==== osd_op_reply(429 10000000000.01000000 [omap-set-vals] v131'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/97 pointing to 0x0x10000000256 2023-12-19T18:03:49.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.264+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:430 18.29 18:97401066::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782b6eac00 2023-12-19T18:03:49.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(430 [pgnls-filter start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000247.00000000 2023-12-19T18:03:49.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000247.0 2023-12-19T18:03:49.273 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:431 18.29 18:97401066:::10000000247.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b6eac00 2023-12-19T18:03:49.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(431 10000000247.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000247 2023-12-19T18:03:49.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/82 2023-12-19T18:03:49.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=82 2023-12-19T18:03:49.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:432 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:49.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 92 ==== osd_op_reply(432 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:433 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782c0bf800 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 180 ==== osd_op_reply(433 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.268+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:434 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b686400 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 89 ==== osd_op_reply(434 10000000000.01800000 [omap-get-header out=274b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.276 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 31 2023-12-19T18:03:49.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:435 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782b686400 2023-12-19T18:03:49.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 90 ==== osd_op_reply(435 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv31 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=82 frag=1*, r=0 2023-12-19T18:03:49.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 20 datascan.read_dentry: 82_head not found in result 2023-12-19T18:03:49.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000247 at 0x0x10000000000/82 with size=2 bytes 2023-12-19T18:03:49.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.272+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:436 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b686400 2023-12-19T18:03:49.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 91 ==== osd_op_reply(436 10000000000.01800000 [omap-set-vals] v131'32 uv32 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/82 pointing to 0x0x10000000247 2023-12-19T18:03:49.281 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:437 18.19 18:98000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782b686400 2023-12-19T18:03:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 92 ==== osd_op_reply(437 [pgnls-filter start_epoch 131 out=101b] v131'16 uv16 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000200.00000000 2023-12-19T18:03:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000200.0 2023-12-19T18:03:49.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:438 18.19 18:992a6246:::10000000200.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a000 con 0x55782b686400 2023-12-19T18:03:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 93 ==== osd_op_reply(438 10000000200.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000200 2023-12-19T18:03:49.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/11 2023-12-19T18:03:49.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=11 2023-12-19T18:03:49.284 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:439 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf000 2023-12-19T18:03:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.276+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 93 ==== osd_op_reply(439 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:440 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782c0bf800 2023-12-19T18:03:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 181 ==== osd_op_reply(440 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:441 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782c0bf800 2023-12-19T18:03:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 182 ==== osd_op_reply(441 10000000000.01000000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 38 2023-12-19T18:03:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:442 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 183 ==== osd_op_reply(442 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=11 frag=0*, r=0 2023-12-19T18:03:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 20 datascan.read_dentry: 11_head not found in result 2023-12-19T18:03:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000200 at 0x0x10000000000/11 with size=2 bytes 2023-12-19T18:03:49.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.280+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:443 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:49.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 184 ==== osd_op_reply(443 10000000000.01000000 [omap-set-vals] v131'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x10000000200 2023-12-19T18:03:49.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:444 18.19 18:997b7129::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782b686400 2023-12-19T18:03:49.291 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 94 ==== osd_op_reply(444 [pgnls-filter start_epoch 131 out=81b] v131'16 uv16 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001f8.00000000 2023-12-19T18:03:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001f8.0 2023-12-19T18:03:49.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:445 18.19 18:997b7129:::100000001f8.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b686400 2023-12-19T18:03:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.284+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 95 ==== osd_op_reply(445 100000001f8.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001f8 2023-12-19T18:03:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/3 2023-12-19T18:03:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=3 2023-12-19T18:03:49.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:446 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf000 2023-12-19T18:03:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 94 ==== osd_op_reply(446 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:447 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 185 ==== osd_op_reply(447 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:448 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 186 ==== osd_op_reply(448 10000000000.01000000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-12-19T18:03:49.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:449 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 187 ==== osd_op_reply(449 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=3 frag=0*, r=0 2023-12-19T18:03:49.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 20 datascan.read_dentry: 3_head not found in result 2023-12-19T18:03:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f8 at 0x0x10000000000/3 with size=1 bytes 2023-12-19T18:03:49.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.288+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:450 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782c0bf800 2023-12-19T18:03:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.292+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 188 ==== osd_op_reply(450 10000000000.01000000 [omap-set-vals] v131'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.292+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x100000001f8 2023-12-19T18:03:49.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.292+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:451 18.39 18:9c000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686800 2023-12-19T18:03:49.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 23 ==== osd_op_reply(451 [pgnls-filter start_epoch 131 out=81b] v131'8 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000222.00000000 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000222.0 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:452 18.39 18:9f1351c3:::10000000222.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b686800 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 24 ==== osd_op_reply(452 10000000222.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv8 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000222 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/45 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=45 2023-12-19T18:03:49.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:453 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf000 2023-12-19T18:03:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 95 ==== osd_op_reply(453 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:454 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 189 ==== osd_op_reply(454 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.303 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:455 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782b686400 2023-12-19T18:03:49.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 96 ==== osd_op_reply(455 10000000000.01800000 [omap-get-header out=274b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 32 2023-12-19T18:03:49.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.304 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.296+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:456 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:49.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 97 ==== osd_op_reply(456 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv32 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=45 frag=1*, r=0 2023-12-19T18:03:49.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8de76840 20 datascan.read_dentry: 45_head not found in result 2023-12-19T18:03:49.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000222 at 0x0x10000000000/45 with size=2 bytes 2023-12-19T18:03:49.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:457 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782b686400 2023-12-19T18:03:49.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 98 ==== osd_op_reply(457 10000000000.01800000 [omap-set-vals] v131'33 uv33 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/45 pointing to 0x0x10000000222 2023-12-19T18:03:49.308 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.300+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:458 18.5 18:a0000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782b6c7400 2023-12-19T18:03:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 12 ==== osd_op_reply(458 [pgnls-filter start_epoch 131 out=101b] v131'11 uv11 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000204.00000000 2023-12-19T18:03:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000204.0 2023-12-19T18:03:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:459 18.5 18:a0beda95:::10000000204.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782b6c7400 2023-12-19T18:03:49.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 13 ==== osd_op_reply(459 10000000204.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000204 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/15 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=15 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:460 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf000 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 96 ==== osd_op_reply(460 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:461 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 190 ==== osd_op_reply(461 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:462 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf800 2023-12-19T18:03:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 191 ==== osd_op_reply(462 10000000000.01000000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-12-19T18:03:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.304+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:463 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 192 ==== osd_op_reply(463 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=15 frag=0*, r=0 2023-12-19T18:03:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8de76840 20 datascan.read_dentry: 15_head not found in result 2023-12-19T18:03:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000204 at 0x0x10000000000/15 with size=2 bytes 2023-12-19T18:03:49.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:464 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782c0bf800 2023-12-19T18:03:49.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 193 ==== osd_op_reply(464 10000000000.01000000 [omap-set-vals] v131'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000204 2023-12-19T18:03:49.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.308+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:465 18.5 18:a3a50212::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b6c7400 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 14 ==== osd_op_reply(465 [pgnls-filter start_epoch 131 out=81b] v131'11 uv11 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000254.00000000 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000254.0 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:466 18.5 18:a3a50212:::10000000254.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b6c7400 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 15 ==== osd_op_reply(466 10000000254.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000254 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/95 2023-12-19T18:03:49.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=95 2023-12-19T18:03:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:467 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf000 2023-12-19T18:03:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 97 ==== osd_op_reply(467 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:468 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 194 ==== osd_op_reply(468 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:469 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782c0bf800 2023-12-19T18:03:49.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 195 ==== osd_op_reply(469 10000000000.01000000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 41 2023-12-19T18:03:49.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.312+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:470 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782c0bf800 2023-12-19T18:03:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 196 ==== osd_op_reply(470 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=95 frag=0*, r=0 2023-12-19T18:03:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8de76840 20 datascan.read_dentry: 95_head not found in result 2023-12-19T18:03:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000254 at 0x0x10000000000/95 with size=2 bytes 2023-12-19T18:03:49.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:471 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf800 2023-12-19T18:03:49.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 197 ==== osd_op_reply(471 10000000000.01000000 [omap-set-vals] v131'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/95 pointing to 0x0x10000000254 2023-12-19T18:03:49.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.316+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:472 18.25 18:a4000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782c0bf800 2023-12-19T18:03:49.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 198 ==== osd_op_reply(472 [pgnls-filter start_epoch 131 out=101b] v131'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000237.00000000 2023-12-19T18:03:49.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000237.0 2023-12-19T18:03:49.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:473 18.25 18:a53878a9:::10000000237.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf800 2023-12-19T18:03:49.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 199 ==== osd_op_reply(473 10000000237.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000237 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/66 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=66 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:474 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782c0bf000 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 98 ==== osd_op_reply(474 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.326 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:475 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:49.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 200 ==== osd_op_reply(475 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:476 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 201 ==== osd_op_reply(476 10000000000.01000000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 42 2023-12-19T18:03:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.328 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.320+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:477 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 202 ==== osd_op_reply(477 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=66 frag=0*, r=0 2023-12-19T18:03:49.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8de76840 20 datascan.read_dentry: 66_head not found in result 2023-12-19T18:03:49.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000237 at 0x0x10000000000/66 with size=2 bytes 2023-12-19T18:03:49.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:478 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:49.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 203 ==== osd_op_reply(478 10000000000.01000000 [omap-set-vals] v131'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/66 pointing to 0x0x10000000237 2023-12-19T18:03:49.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.324+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:479 18.25 18:a7ae8a0f::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 204 ==== osd_op_reply(479 [pgnls-filter start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.332 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000243.00000000 2023-12-19T18:03:49.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000243.0 2023-12-19T18:03:49.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:480 18.25 18:a7ae8a0f:::10000000243.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782c0bf800 2023-12-19T18:03:49.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 205 ==== osd_op_reply(480 10000000243.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000243 2023-12-19T18:03:49.333 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/78 2023-12-19T18:03:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=78 2023-12-19T18:03:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:481 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782c0bf000 2023-12-19T18:03:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 99 ==== osd_op_reply(481 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.334 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:482 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf800 2023-12-19T18:03:49.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 206 ==== osd_op_reply(482 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:483 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782b686400 2023-12-19T18:03:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 99 ==== osd_op_reply(483 10000000000.01800000 [omap-get-header out=274b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 33 2023-12-19T18:03:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.328+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:484 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b686400 2023-12-19T18:03:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 100 ==== osd_op_reply(484 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv33 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=78 frag=1*, r=0 2023-12-19T18:03:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8de76840 20 datascan.read_dentry: 78_head not found in result 2023-12-19T18:03:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000243 at 0x0x10000000000/78 with size=2 bytes 2023-12-19T18:03:49.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:485 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b686400 2023-12-19T18:03:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 101 ==== osd_op_reply(485 10000000000.01800000 [omap-set-vals] v131'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/78 pointing to 0x0x10000000243 2023-12-19T18:03:49.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.332+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:486 18.15 18:a8000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782b6b4400 2023-12-19T18:03:49.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 20 ==== osd_op_reply(486 [pgnls-filter start_epoch 131 out=81b] v131'9 uv9 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000020d.00000000 2023-12-19T18:03:49.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000020d.0 2023-12-19T18:03:49.341 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:487 18.15 18:a8e69ea8:::1000000020d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b6b4400 2023-12-19T18:03:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 21 ==== osd_op_reply(487 1000000020d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv9 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020d 2023-12-19T18:03:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/24 2023-12-19T18:03:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=24 2023-12-19T18:03:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:488 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf000 2023-12-19T18:03:49.342 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 100 ==== osd_op_reply(488 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:489 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf800 2023-12-19T18:03:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 207 ==== osd_op_reply(489 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.343 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:490 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b686400 2023-12-19T18:03:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 102 ==== osd_op_reply(490 10000000000.01800000 [omap-get-header out=274b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.336+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 34 2023-12-19T18:03:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.344 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:491 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 103 ==== osd_op_reply(491 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv34 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=24 frag=1*, r=0 2023-12-19T18:03:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8de76840 20 datascan.read_dentry: 24_head not found in result 2023-12-19T18:03:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020d at 0x0x10000000000/24 with size=2 bytes 2023-12-19T18:03:49.345 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.340+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:492 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b686400 2023-12-19T18:03:49.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 104 ==== osd_op_reply(492 10000000000.01800000 [omap-set-vals] v131'35 uv35 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.348 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x1000000020d 2023-12-19T18:03:49.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:493 18.35 18:ac000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b686400 2023-12-19T18:03:49.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 105 ==== osd_op_reply(493 [pgnls-filter start_epoch 131 out=49b] v129'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.349 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:494 18.d 18:b0000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686400 2023-12-19T18:03:49.350 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 106 ==== osd_op_reply(494 [pgnls-filter start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.351 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:495 18.2d 18:b4000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a800 con 0x55782c0bf800 2023-12-19T18:03:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 208 ==== osd_op_reply(495 [pgnls-filter start_epoch 131 out=81b] v131'10 uv10 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000218.00000000 2023-12-19T18:03:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000218.0 2023-12-19T18:03:49.352 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.344+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:496 18.2d 18:b79a54f6:::10000000218.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782c0bf800 2023-12-19T18:03:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 209 ==== osd_op_reply(496 10000000218.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv10 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000218 2023-12-19T18:03:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/35 2023-12-19T18:03:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=35 2023-12-19T18:03:49.353 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:497 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782c0bf000 2023-12-19T18:03:49.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 101 ==== osd_op_reply(497 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.354 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:498 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:49.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 210 ==== osd_op_reply(498 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:499 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 107 ==== osd_op_reply(499 10000000000.01800000 [omap-get-header out=274b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 35 2023-12-19T18:03:49.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.348+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:500 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782b686400 2023-12-19T18:03:49.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 108 ==== osd_op_reply(500 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv35 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=35 frag=1*, r=0 2023-12-19T18:03:49.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8de76840 20 datascan.read_dentry: 35_head not found in result 2023-12-19T18:03:49.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000218 at 0x0x10000000000/35 with size=2 bytes 2023-12-19T18:03:49.357 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:501 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782b686400 2023-12-19T18:03:49.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 109 ==== osd_op_reply(501 10000000000.01800000 [omap-set-vals] v131'36 uv36 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/35 pointing to 0x0x10000000218 2023-12-19T18:03:49.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.352+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:502 18.1d 18:b8000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70fc00 con 0x55782b686800 2023-12-19T18:03:49.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 25 ==== osd_op_reply(502 [pgnls-filter start_epoch 131 out=81b] v131'18 uv18 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000246.00000000 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000246.0 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:503 18.1d 18:bab97ecf:::10000000246.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a000 con 0x55782b686800 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.0 v2:172.21.15.45:6808/36279 26 ==== osd_op_reply(503 10000000246.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv18 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b686800 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000246 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/81 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=81 2023-12-19T18:03:49.362 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:504 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf000 2023-12-19T18:03:49.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 102 ==== osd_op_reply(504 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.363 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:505 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782c0bf800 2023-12-19T18:03:49.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 211 ==== osd_op_reply(505 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.364 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.356+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:506 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782b686400 2023-12-19T18:03:49.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 110 ==== osd_op_reply(506 10000000000.01800000 [omap-get-header out=274b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 36 2023-12-19T18:03:49.365 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:507 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782b686400 2023-12-19T18:03:49.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 111 ==== osd_op_reply(507 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv36 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.366 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=81 frag=1*, r=0 2023-12-19T18:03:49.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 20 datascan.read_dentry: 81_head not found in result 2023-12-19T18:03:49.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000246 at 0x0x10000000000/81 with size=2 bytes 2023-12-19T18:03:49.367 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.360+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:508 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:49.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 112 ==== osd_op_reply(508 10000000000.01800000 [omap-set-vals] v131'37 uv37 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/81 pointing to 0x0x10000000246 2023-12-19T18:03:49.370 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:509 18.3d 18:bc000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 103 ==== osd_op_reply(509 [pgnls-filter start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000219.00000000 2023-12-19T18:03:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000219.0 2023-12-19T18:03:49.371 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.364+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:510 18.3d 18:bc0c3701:::10000000219.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf000 2023-12-19T18:03:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 104 ==== osd_op_reply(510 10000000219.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000219 2023-12-19T18:03:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/36 2023-12-19T18:03:49.372 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=36 2023-12-19T18:03:49.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:511 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf000 2023-12-19T18:03:49.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 105 ==== osd_op_reply(511 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.373 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:512 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782c0bf800 2023-12-19T18:03:49.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 212 ==== osd_op_reply(512 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:513 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:49.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 213 ==== osd_op_reply(513 10000000000.01000000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 43 2023-12-19T18:03:49.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:514 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:49.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 214 ==== osd_op_reply(514 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=36 frag=0*, r=0 2023-12-19T18:03:49.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 20 datascan.read_dentry: 36_head not found in result 2023-12-19T18:03:49.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000219 at 0x0x10000000000/36 with size=2 bytes 2023-12-19T18:03:49.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.368+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:515 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 215 ==== osd_op_reply(515 10000000000.01000000 [omap-set-vals] v131'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/36 pointing to 0x0x10000000219 2023-12-19T18:03:49.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:516 18.3d 18:bfcd3380::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf000 2023-12-19T18:03:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 106 ==== osd_op_reply(516 [pgnls-filter start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000205.00000000 2023-12-19T18:03:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000205.0 2023-12-19T18:03:49.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.372+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:517 18.3d 18:bfcd3380:::10000000205.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782c0bf000 2023-12-19T18:03:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 107 ==== osd_op_reply(517 10000000205.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000205 2023-12-19T18:03:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/16 2023-12-19T18:03:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=16 2023-12-19T18:03:49.381 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:518 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 108 ==== osd_op_reply(518 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.382 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:519 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf800 2023-12-19T18:03:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 216 ==== osd_op_reply(519 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:520 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b686400 2023-12-19T18:03:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 113 ==== osd_op_reply(520 10000000000.01800000 [omap-get-header out=274b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 37 2023-12-19T18:03:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.376+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:521 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782b686400 2023-12-19T18:03:49.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 114 ==== osd_op_reply(521 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv37 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=16 frag=1*, r=0 2023-12-19T18:03:49.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8de76840 20 datascan.read_dentry: 16_head not found in result 2023-12-19T18:03:49.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000205 at 0x0x10000000000/16 with size=2 bytes 2023-12-19T18:03:49.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:522 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782b686400 2023-12-19T18:03:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 115 ==== osd_op_reply(522 10000000000.01800000 [omap-set-vals] v131'38 uv38 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000205 2023-12-19T18:03:49.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.380+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:523 18.3 18:c0000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7000 con 0x55782b6c7400 2023-12-19T18:03:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 16 ==== osd_op_reply(523 [pgnls-filter start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.389 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c87628700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:524 18.23 18:c4000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea400 con 0x55782b6eb000 2023-12-19T18:03:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 12 ==== osd_op_reply(524 [pgnls-filter start_epoch 131 out=49b] v129'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:525 18.13 18:c8000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734000 con 0x55782b6eac00 2023-12-19T18:03:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(525 [pgnls-filter start_epoch 131 out=101b] v131'30 uv30 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000023c.00000000 2023-12-19T18:03:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000023c.0 2023-12-19T18:03:49.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:526 18.13 18:c8893608:::1000000023c.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b6eac00 2023-12-19T18:03:49.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(526 1000000023c.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv26 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.384+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000023c 2023-12-19T18:03:49.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/71 2023-12-19T18:03:49.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=71 2023-12-19T18:03:49.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:527 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf000 2023-12-19T18:03:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 109 ==== osd_op_reply(527 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.393 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:528 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782c0bf800 2023-12-19T18:03:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 217 ==== osd_op_reply(528 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.394 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:529 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b686400 2023-12-19T18:03:49.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 116 ==== osd_op_reply(529 10000000000.01800000 [omap-get-header out=274b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 38 2023-12-19T18:03:49.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.395 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:530 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 117 ==== osd_op_reply(530 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv38 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=71 frag=1*, r=0 2023-12-19T18:03:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 20 datascan.read_dentry: 71_head not found in result 2023-12-19T18:03:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000023c at 0x0x10000000000/71 with size=2 bytes 2023-12-19T18:03:49.396 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.388+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:531 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b686400 2023-12-19T18:03:49.398 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 118 ==== osd_op_reply(531 10000000000.01800000 [omap-set-vals] v131'39 uv39 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/71 pointing to 0x0x1000000023c 2023-12-19T18:03:49.399 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:532 18.13 18:c933d8fa::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b6eac00 2023-12-19T18:03:49.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(532 [pgnls-filter start_epoch 131 out=101b] v131'30 uv30 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000241.00000000 2023-12-19T18:03:49.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000241.0 2023-12-19T18:03:49.400 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.392+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:533 18.13 18:c933d8fa:::10000000241.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782b6eac00 2023-12-19T18:03:49.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(533 10000000241.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv27 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.401 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000241 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/76 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=76 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:534 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782c0bf000 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 110 ==== osd_op_reply(534 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:535 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782c0bf800 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 218 ==== osd_op_reply(535 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.402 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:536 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b686400 2023-12-19T18:03:49.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 119 ==== osd_op_reply(536 10000000000.01800000 [omap-get-header out=274b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 39 2023-12-19T18:03:49.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.396+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:537 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b686400 2023-12-19T18:03:49.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 120 ==== osd_op_reply(537 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv39 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=76 frag=1*, r=0 2023-12-19T18:03:49.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8de76840 20 datascan.read_dentry: 76_head not found in result 2023-12-19T18:03:49.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000241 at 0x0x10000000000/76 with size=2 bytes 2023-12-19T18:03:49.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:538 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b686400 2023-12-19T18:03:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 121 ==== osd_op_reply(538 10000000000.01800000 [omap-set-vals] v131'40 uv40 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/76 pointing to 0x0x10000000241 2023-12-19T18:03:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.400+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:539 18.13 18:c9855970::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782b6eac00 2023-12-19T18:03:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(539 [pgnls-filter start_epoch 131 out=101b] v131'30 uv30 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000239.00000000 2023-12-19T18:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000239.0 2023-12-19T18:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:540 18.13 18:c9855970:::10000000239.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782b6eac00 2023-12-19T18:03:49.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 16 ==== osd_op_reply(540 10000000239.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv28 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000239 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/68 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=68 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:541 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf000 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 111 ==== osd_op_reply(541 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:542 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:49.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 219 ==== osd_op_reply(542 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:543 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734000 con 0x55782b686400 2023-12-19T18:03:49.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.404+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 122 ==== osd_op_reply(543 10000000000.01800000 [omap-get-header out=274b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 40 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:544 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735000 con 0x55782b686400 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 123 ==== osd_op_reply(544 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv40 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=68 frag=1*, r=0 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 20 datascan.read_dentry: 68_head not found in result 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000239 at 0x0x10000000000/68 with size=2 bytes 2023-12-19T18:03:49.413 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:545 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735400 con 0x55782b686400 2023-12-19T18:03:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 124 ==== osd_op_reply(545 10000000000.01800000 [omap-set-vals] v131'41 uv41 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/68 pointing to 0x0x10000000239 2023-12-19T18:03:49.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.408+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:546 18.13 18:ca8fdbba::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735800 con 0x55782b6eac00 2023-12-19T18:03:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 17 ==== osd_op_reply(546 [pgnls-filter start_epoch 131 out=101b] v131'30 uv30 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001fb.00000000 2023-12-19T18:03:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001fb.0 2023-12-19T18:03:49.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:547 18.13 18:ca8fdbba:::100000001fb.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735c00 con 0x55782b6eac00 2023-12-19T18:03:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 18 ==== osd_op_reply(547 100000001fb.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv29 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fb 2023-12-19T18:03:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/6 2023-12-19T18:03:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=6 2023-12-19T18:03:49.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:548 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782c0bf000 2023-12-19T18:03:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 112 ==== osd_op_reply(548 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:549 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf800 2023-12-19T18:03:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 220 ==== osd_op_reply(549 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.412+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:550 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a800 con 0x55782b686400 2023-12-19T18:03:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 125 ==== osd_op_reply(550 10000000000.01800000 [omap-get-header out=274b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 41 2023-12-19T18:03:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:551 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782b686400 2023-12-19T18:03:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 126 ==== osd_op_reply(551 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv41 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=6 frag=1*, r=0 2023-12-19T18:03:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 20 datascan.read_dentry: 6_head not found in result 2023-12-19T18:03:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fb at 0x0x10000000000/6 with size=1 bytes 2023-12-19T18:03:49.422 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:552 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782b686400 2023-12-19T18:03:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.416+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 127 ==== osd_op_reply(552 10000000000.01800000 [omap-set-vals] v131'42 uv42 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x100000001fb 2023-12-19T18:03:49.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:553 18.13 18:cbcb6224::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782b6eac00 2023-12-19T18:03:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 19 ==== osd_op_reply(553 [pgnls-filter start_epoch 131 out=81b] v131'30 uv30 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000212.00000000 2023-12-19T18:03:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000212.0 2023-12-19T18:03:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:554 18.13 18:cbcb6224:::10000000212.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b6eac00 2023-12-19T18:03:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 20 ==== osd_op_reply(554 10000000212.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv30 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000212 2023-12-19T18:03:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/29 2023-12-19T18:03:49.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=29 2023-12-19T18:03:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:555 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf000 2023-12-19T18:03:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 113 ==== osd_op_reply(555 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:556 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782c0bf800 2023-12-19T18:03:49.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 221 ==== osd_op_reply(556 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.420+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:557 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782b686400 2023-12-19T18:03:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 128 ==== osd_op_reply(557 10000000000.01800000 [omap-get-header out=274b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 42 2023-12-19T18:03:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:558 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 129 ==== osd_op_reply(558 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv42 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=29 frag=1*, r=0 2023-12-19T18:03:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 20 datascan.read_dentry: 29_head not found in result 2023-12-19T18:03:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000212 at 0x0x10000000000/29 with size=2 bytes 2023-12-19T18:03:49.430 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.424+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:559 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686400 2023-12-19T18:03:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 130 ==== osd_op_reply(559 10000000000.01800000 [omap-set-vals] v131'43 uv43 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/29 pointing to 0x0x10000000212 2023-12-19T18:03:49.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:560 18.33 18:cc000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5400 con 0x55782b6c7400 2023-12-19T18:03:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 17 ==== osd_op_reply(560 [pgnls-filter start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000248.00000000 2023-12-19T18:03:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000248.0 2023-12-19T18:03:49.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:561 18.33 18:cf9e7a4f:::10000000248.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6000 con 0x55782b6c7400 2023-12-19T18:03:49.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 18 ==== osd_op_reply(561 10000000248.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000248 2023-12-19T18:03:49.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/83 2023-12-19T18:03:49.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=83 2023-12-19T18:03:49.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:562 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782c0bf000 2023-12-19T18:03:49.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 114 ==== osd_op_reply(562 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.428+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:563 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:49.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 222 ==== osd_op_reply(563 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:564 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:49.437 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 223 ==== osd_op_reply(564 10000000000.01000000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 44 2023-12-19T18:03:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:565 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 224 ==== osd_op_reply(565 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=83 frag=0*, r=0 2023-12-19T18:03:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 20 datascan.read_dentry: 83_head not found in result 2023-12-19T18:03:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000248 at 0x0x10000000000/83 with size=2 bytes 2023-12-19T18:03:49.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.432+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:566 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 225 ==== osd_op_reply(566 10000000000.01000000 [omap-set-vals] v131'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/83 pointing to 0x0x10000000248 2023-12-19T18:03:49.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:567 18.b 18:d0000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782b6b4400 2023-12-19T18:03:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 22 ==== osd_op_reply(567 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000225.00000000 2023-12-19T18:03:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000225.0 2023-12-19T18:03:49.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.436+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:568 18.b 18:d0d26e50:::10000000225.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b6b4400 2023-12-19T18:03:49.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 23 ==== osd_op_reply(568 10000000225.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000225 2023-12-19T18:03:49.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/48 2023-12-19T18:03:49.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=48 2023-12-19T18:03:49.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:569 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf000 2023-12-19T18:03:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 115 ==== osd_op_reply(569 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:570 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782c0bf800 2023-12-19T18:03:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 226 ==== osd_op_reply(570 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:571 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782b686400 2023-12-19T18:03:49.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 131 ==== osd_op_reply(571 10000000000.01800000 [omap-get-header out=274b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 43 2023-12-19T18:03:49.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.440+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:572 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782b686400 2023-12-19T18:03:49.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 132 ==== osd_op_reply(572 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv43 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=48 frag=1*, r=0 2023-12-19T18:03:49.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8de76840 20 datascan.read_dentry: 48_head not found in result 2023-12-19T18:03:49.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000225 at 0x0x10000000000/48 with size=2 bytes 2023-12-19T18:03:49.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:573 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a800 con 0x55782b686400 2023-12-19T18:03:49.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 133 ==== osd_op_reply(573 10000000000.01800000 [omap-set-vals] v131'44 uv44 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/48 pointing to 0x0x10000000225 2023-12-19T18:03:49.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.444+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:574 18.b 18:d2dbd4ac::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782b6b4400 2023-12-19T18:03:49.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 24 ==== osd_op_reply(574 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000217.00000000 2023-12-19T18:03:49.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000217.0 2023-12-19T18:03:49.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:575 18.b 18:d2dbd4ac:::10000000217.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782b6b4400 2023-12-19T18:03:49.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 25 ==== osd_op_reply(575 10000000217.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000217 2023-12-19T18:03:49.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/34 2023-12-19T18:03:49.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=34 2023-12-19T18:03:49.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:576 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734000 con 0x55782c0bf000 2023-12-19T18:03:49.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 116 ==== osd_op_reply(576 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:577 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735000 con 0x55782c0bf800 2023-12-19T18:03:49.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.448+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 227 ==== osd_op_reply(577 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:578 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735400 con 0x55782c0bf800 2023-12-19T18:03:49.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 228 ==== osd_op_reply(578 10000000000.01000000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 45 2023-12-19T18:03:49.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:579 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:49.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 229 ==== osd_op_reply(579 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=34 frag=0*, r=0 2023-12-19T18:03:49.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 20 datascan.read_dentry: 34_head not found in result 2023-12-19T18:03:49.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000217 at 0x0x10000000000/34 with size=2 bytes 2023-12-19T18:03:49.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.452+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:580 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf800 2023-12-19T18:03:49.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 230 ==== osd_op_reply(580 10000000000.01000000 [omap-set-vals] v131'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/34 pointing to 0x0x10000000217 2023-12-19T18:03:49.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:581 18.b 18:d3eda40d::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b6b4400 2023-12-19T18:03:49.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 26 ==== osd_op_reply(581 [pgnls-filter start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000020f.00000000 2023-12-19T18:03:49.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000020f.0 2023-12-19T18:03:49.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:582 18.b 18:d3eda40d:::1000000020f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b6b4400 2023-12-19T18:03:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 27 ==== osd_op_reply(582 1000000020f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000020f 2023-12-19T18:03:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/26 2023-12-19T18:03:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=26 2023-12-19T18:03:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.456+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:583 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea400 con 0x55782c0bf000 2023-12-19T18:03:49.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 117 ==== osd_op_reply(583 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:584 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:49.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 231 ==== osd_op_reply(584 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:585 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 134 ==== osd_op_reply(585 10000000000.01800000 [omap-get-header out=274b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 44 2023-12-19T18:03:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:586 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b686400 2023-12-19T18:03:49.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 135 ==== osd_op_reply(586 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv44 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=26 frag=1*, r=0 2023-12-19T18:03:49.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 20 datascan.read_dentry: 26_head not found in result 2023-12-19T18:03:49.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000020f at 0x0x10000000000/26 with size=2 bytes 2023-12-19T18:03:49.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.460+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:587 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782b686400 2023-12-19T18:03:49.470 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 136 ==== osd_op_reply(587 10000000000.01800000 [omap-set-vals] v131'45 uv45 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/26 pointing to 0x0x1000000020f 2023-12-19T18:03:49.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:588 18.2b 18:d4000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782b6eac00 2023-12-19T18:03:49.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 21 ==== osd_op_reply(588 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000203.00000000 2023-12-19T18:03:49.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000203.0 2023-12-19T18:03:49.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.464+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:589 18.2b 18:d4a58307:::10000000203.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782b6eac00 2023-12-19T18:03:49.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 22 ==== osd_op_reply(589 10000000203.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000203 2023-12-19T18:03:49.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/14 2023-12-19T18:03:49.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=14 2023-12-19T18:03:49.473 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:590 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf000 2023-12-19T18:03:49.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 118 ==== osd_op_reply(590 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:591 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782c0bf800 2023-12-19T18:03:49.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 232 ==== osd_op_reply(591 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:592 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782b686400 2023-12-19T18:03:49.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 137 ==== osd_op_reply(592 10000000000.01800000 [omap-get-header out=274b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 45 2023-12-19T18:03:49.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.468+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:593 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782b686400 2023-12-19T18:03:49.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 138 ==== osd_op_reply(593 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv45 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=14 frag=1*, r=0 2023-12-19T18:03:49.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8de76840 20 datascan.read_dentry: 14_head not found in result 2023-12-19T18:03:49.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000203 at 0x0x10000000000/14 with size=2 bytes 2023-12-19T18:03:49.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:594 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b686400 2023-12-19T18:03:49.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 139 ==== osd_op_reply(594 10000000000.01800000 [omap-set-vals] v131'46 uv46 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x10000000203 2023-12-19T18:03:49.480 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.472+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:595 18.2b 18:d5ee56ee::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b6eac00 2023-12-19T18:03:49.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 23 ==== osd_op_reply(595 [pgnls-filter start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.481 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000022d.00000000 2023-12-19T18:03:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000022d.0 2023-12-19T18:03:49.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:596 18.2b 18:d5ee56ee:::1000000022d.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b6eac00 2023-12-19T18:03:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 24 ==== osd_op_reply(596 1000000022d.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000022d 2023-12-19T18:03:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/56 2023-12-19T18:03:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=56 2023-12-19T18:03:49.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:597 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf000 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 119 ==== osd_op_reply(597 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:598 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.476+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 233 ==== osd_op_reply(598 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:599 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782b686400 2023-12-19T18:03:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 140 ==== osd_op_reply(599 10000000000.01800000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 46 2023-12-19T18:03:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:600 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 141 ==== osd_op_reply(600 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=56 frag=1*, r=0 2023-12-19T18:03:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 20 datascan.read_dentry: 56_head not found in result 2023-12-19T18:03:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000022d at 0x0x10000000000/56 with size=2 bytes 2023-12-19T18:03:49.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.480+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:601 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735800 con 0x55782b686400 2023-12-19T18:03:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 142 ==== osd_op_reply(601 10000000000.01800000 [omap-set-vals] v131'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/56 pointing to 0x0x1000000022d 2023-12-19T18:03:49.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:602 18.1b 18:d8000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735c00 con 0x55782b6c7400 2023-12-19T18:03:49.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 19 ==== osd_op_reply(602 [pgnls-filter start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:603 18.3b 18:dc000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734400 con 0x55782b686400 2023-12-19T18:03:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 143 ==== osd_op_reply(603 [pgnls-filter start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000249.00000000 2023-12-19T18:03:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000249.0 2023-12-19T18:03:49.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.484+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:604 18.3b 18:dd50df43:::10000000249.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735000 con 0x55782b686400 2023-12-19T18:03:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 144 ==== osd_op_reply(604 10000000249.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000249 2023-12-19T18:03:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/84 2023-12-19T18:03:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=84 2023-12-19T18:03:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:605 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735400 con 0x55782c0bf000 2023-12-19T18:03:49.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 120 ==== osd_op_reply(605 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:606 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782c0bf800 2023-12-19T18:03:49.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 234 ==== osd_op_reply(606 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:607 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf800 2023-12-19T18:03:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 235 ==== osd_op_reply(607 10000000000.01000000 [omap-get-header out=274b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 46 2023-12-19T18:03:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:608 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782c0bf800 2023-12-19T18:03:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.488+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 236 ==== osd_op_reply(608 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv46 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=84 frag=0*, r=0 2023-12-19T18:03:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8de76840 20 datascan.read_dentry: 84_head not found in result 2023-12-19T18:03:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000249 at 0x0x10000000000/84 with size=2 bytes 2023-12-19T18:03:49.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:609 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf800 2023-12-19T18:03:49.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 237 ==== osd_op_reply(609 10000000000.01000000 [omap-set-vals] v131'47 uv47 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/84 pointing to 0x0x10000000249 2023-12-19T18:03:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.492+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:610 18.3b 18:deccbd37::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686400 2023-12-19T18:03:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 145 ==== osd_op_reply(610 [pgnls-filter start_epoch 131 out=101b] v131'13 uv13 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001fe.00000000 2023-12-19T18:03:49.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001fe.0 2023-12-19T18:03:49.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:611 18.3b 18:deccbd37:::100000001fe.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b686400 2023-12-19T18:03:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 146 ==== osd_op_reply(611 100000001fe.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fe 2023-12-19T18:03:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/9 2023-12-19T18:03:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=9 2023-12-19T18:03:49.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:612 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782c0bf000 2023-12-19T18:03:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 121 ==== osd_op_reply(612 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:613 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf800 2023-12-19T18:03:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 238 ==== osd_op_reply(613 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.503 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.496+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:614 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 239 ==== osd_op_reply(614 10000000000.01000000 [omap-get-header out=274b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 47 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:615 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734000 con 0x55782c0bf800 2023-12-19T18:03:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 240 ==== osd_op_reply(615 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=9 frag=0*, r=0 2023-12-19T18:03:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 20 datascan.read_dentry: 9_head not found in result 2023-12-19T18:03:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fe at 0x0x10000000000/9 with size=1 bytes 2023-12-19T18:03:49.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:616 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735800 con 0x55782c0bf800 2023-12-19T18:03:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 241 ==== osd_op_reply(616 10000000000.01000000 [omap-set-vals] v131'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x100000001fe 2023-12-19T18:03:49.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.500+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:617 18.3b 18:ded14b84::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734400 con 0x55782b686400 2023-12-19T18:03:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 147 ==== osd_op_reply(617 [pgnls-filter start_epoch 131 out=81b] v131'13 uv13 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000024b.00000000 2023-12-19T18:03:49.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000024b.0 2023-12-19T18:03:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:618 18.3b 18:ded14b84:::1000000024b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735000 con 0x55782b686400 2023-12-19T18:03:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 148 ==== osd_op_reply(618 1000000024b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000024b 2023-12-19T18:03:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/86 2023-12-19T18:03:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=86 2023-12-19T18:03:49.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:619 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf000 2023-12-19T18:03:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 122 ==== osd_op_reply(619 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:620 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 242 ==== osd_op_reply(620 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.504+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:621 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782c0bf800 2023-12-19T18:03:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 243 ==== osd_op_reply(621 10000000000.01000000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 48 2023-12-19T18:03:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:622 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 244 ==== osd_op_reply(622 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=86 frag=0*, r=0 2023-12-19T18:03:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 20 datascan.read_dentry: 86_head not found in result 2023-12-19T18:03:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000024b at 0x0x10000000000/86 with size=2 bytes 2023-12-19T18:03:49.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:623 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 245 ==== osd_op_reply(623 10000000000.01000000 [omap-set-vals] v131'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/86 pointing to 0x0x1000000024b 2023-12-19T18:03:49.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.508+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:624 18.7 18:e0000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b6eb000 2023-12-19T18:03:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 13 ==== osd_op_reply(624 [pgnls-filter start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000207.00000000 2023-12-19T18:03:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000207.0 2023-12-19T18:03:49.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:625 18.7 18:e15a914f:::10000000207.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782b6eb000 2023-12-19T18:03:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 14 ==== osd_op_reply(625 10000000207.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000207 2023-12-19T18:03:49.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/18 2023-12-19T18:03:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=18 2023-12-19T18:03:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:626 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 123 ==== osd_op_reply(626 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:627 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 246 ==== osd_op_reply(627 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:628 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea400 con 0x55782b686400 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 149 ==== osd_op_reply(628 10000000000.01800000 [omap-get-header out=274b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 47 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.512+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:629 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 150 ==== osd_op_reply(629 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv47 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=18 frag=1*, r=0 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 20 datascan.read_dentry: 18_head not found in result 2023-12-19T18:03:49.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000207 at 0x0x10000000000/18 with size=2 bytes 2023-12-19T18:03:49.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:630 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b686400 2023-12-19T18:03:49.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 151 ==== osd_op_reply(630 10000000000.01800000 [omap-set-vals] v131'48 uv48 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000207 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:631 18.7 18:e2e07930::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782b6eb000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 15 ==== osd_op_reply(631 [pgnls-filter start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000001.0 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.516+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:632 18.7 18:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782b6eb000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 16 ==== osd_op_reply(632 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/0 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=0 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:633 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a800 con 0x55782c0bf000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 124 ==== osd_op_reply(633 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:634 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 247 ==== osd_op_reply(634 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:635 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b686400 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 152 ==== osd_op_reply(635 10000000000.01800000 [omap-get-header out=274b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 48 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:636 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782b686400 2023-12-19T18:03:49.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 153 ==== osd_op_reply(636 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv48 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=0 frag=1*, r=0 2023-12-19T18:03:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 20 datascan.read_dentry: 0_head not found in result 2023-12-19T18:03:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/0 with size=1 bytes 2023-12-19T18:03:49.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.520+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:637 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782b686400 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 154 ==== osd_op_reply(637 10000000000.01800000 [omap-set-vals] v131'49 uv49 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:638 18.7 18:e37752f2::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754000 con 0x55782b6eb000 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 17 ==== osd_op_reply(638 [pgnls-filter start_epoch 131 out=81b] v131'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000021f.00000000 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000021f.0 2023-12-19T18:03:49.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:639 18.7 18:e37752f2:::1000000021f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754400 con 0x55782b6eb000 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.2 v2:172.21.15.45:6824/36285 18 ==== osd_op_reply(639 1000000021f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b6eb000 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000021f 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/42 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=42 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:640 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754800 con 0x55782c0bf000 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 125 ==== osd_op_reply(640 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:641 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754c00 con 0x55782c0bf800 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 248 ==== osd_op_reply(641 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.524+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:642 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755000 con 0x55782c0bf800 2023-12-19T18:03:49.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 249 ==== osd_op_reply(642 10000000000.01000000 [omap-get-header out=274b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 49 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:643 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755400 con 0x55782c0bf800 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 250 ==== osd_op_reply(643 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=42 frag=0*, r=0 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 20 datascan.read_dentry: 42_head not found in result 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000021f at 0x0x10000000000/42 with size=2 bytes 2023-12-19T18:03:49.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:644 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755800 con 0x55782c0bf800 2023-12-19T18:03:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 251 ==== osd_op_reply(644 10000000000.01000000 [omap-set-vals] v131'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/42 pointing to 0x0x1000000021f 2023-12-19T18:03:49.536 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.528+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:645 18.27 18:e4000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755c00 con 0x55782b6b4400 2023-12-19T18:03:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 28 ==== osd_op_reply(645 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000210.00000000 2023-12-19T18:03:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000210.0 2023-12-19T18:03:49.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:646 18.27 18:e40c9c52:::10000000210.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754c00 con 0x55782b6b4400 2023-12-19T18:03:49.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 29 ==== osd_op_reply(646 10000000210.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000210 2023-12-19T18:03:49.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/27 2023-12-19T18:03:49.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=27 2023-12-19T18:03:49.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:647 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf000 2023-12-19T18:03:49.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 126 ==== osd_op_reply(647 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:648 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:49.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 252 ==== osd_op_reply(648 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.532+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:649 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782c0bf800 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 253 ==== osd_op_reply(649 10000000000.01000000 [omap-get-header out=274b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 50 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:650 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:49.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 254 ==== osd_op_reply(650 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=27 frag=0*, r=0 2023-12-19T18:03:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 20 datascan.read_dentry: 27_head not found in result 2023-12-19T18:03:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000210 at 0x0x10000000000/27 with size=2 bytes 2023-12-19T18:03:49.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:651 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782c0bf800 2023-12-19T18:03:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 255 ==== osd_op_reply(651 10000000000.01000000 [omap-set-vals] v131'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/27 pointing to 0x0x10000000210 2023-12-19T18:03:49.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.536+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:652 18.27 18:e5671758::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b6b4400 2023-12-19T18:03:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 30 ==== osd_op_reply(652 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000024f.00000000 2023-12-19T18:03:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000024f.0 2023-12-19T18:03:49.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:653 18.27 18:e5671758:::1000000024f.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782b6b4400 2023-12-19T18:03:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 31 ==== osd_op_reply(653 1000000024f.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000024f 2023-12-19T18:03:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/90 2023-12-19T18:03:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=90 2023-12-19T18:03:49.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:654 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782c0bf000 2023-12-19T18:03:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 127 ==== osd_op_reply(654 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:655 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782c0bf800 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 256 ==== osd_op_reply(655 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.540+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:656 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 257 ==== osd_op_reply(656 10000000000.01000000 [omap-get-header out=274b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 51 2023-12-19T18:03:49.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:657 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782c0bf800 2023-12-19T18:03:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 258 ==== osd_op_reply(657 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=90 frag=0*, r=0 2023-12-19T18:03:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 20 datascan.read_dentry: 90_head not found in result 2023-12-19T18:03:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000024f at 0x0x10000000000/90 with size=2 bytes 2023-12-19T18:03:49.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.544+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:658 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf800 2023-12-19T18:03:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 259 ==== osd_op_reply(658 10000000000.01000000 [omap-set-vals] v131'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/90 pointing to 0x0x1000000024f 2023-12-19T18:03:49.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:659 18.27 18:e5993619::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782b6b4400 2023-12-19T18:03:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 32 ==== osd_op_reply(659 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000208.00000000 2023-12-19T18:03:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000208.0 2023-12-19T18:03:49.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:660 18.27 18:e5993619:::10000000208.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b6b4400 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 33 ==== osd_op_reply(660 10000000208.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000208 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/19 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=19 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:661 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734000 con 0x55782c0bf000 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 128 ==== osd_op_reply(661 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:662 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735800 con 0x55782c0bf800 2023-12-19T18:03:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 260 ==== osd_op_reply(662 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.548+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:663 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782c0bf800 2023-12-19T18:03:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 261 ==== osd_op_reply(663 10000000000.01000000 [omap-get-header out=274b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 52 2023-12-19T18:03:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:664 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782c0bf800 2023-12-19T18:03:49.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 262 ==== osd_op_reply(664 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=19 frag=0*, r=0 2023-12-19T18:03:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 20 datascan.read_dentry: 19_head not found in result 2023-12-19T18:03:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000208 at 0x0x10000000000/19 with size=2 bytes 2023-12-19T18:03:49.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.552+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:665 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782c0bf800 2023-12-19T18:03:49.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 263 ==== osd_op_reply(665 10000000000.01000000 [omap-set-vals] v131'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000208 2023-12-19T18:03:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:666 18.27 18:e5a5749e::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782b6b4400 2023-12-19T18:03:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 34 ==== osd_op_reply(666 [pgnls-filter start_epoch 131 out=101b] v131'17 uv17 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000021a.00000000 2023-12-19T18:03:49.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000021a.0 2023-12-19T18:03:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:667 18.27 18:e5a5749e:::1000000021a.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782b6b4400 2023-12-19T18:03:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 35 ==== osd_op_reply(667 1000000021a.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv16 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000021a 2023-12-19T18:03:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/37 2023-12-19T18:03:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=37 2023-12-19T18:03:49.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:668 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b000 con 0x55782c0bf000 2023-12-19T18:03:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 129 ==== osd_op_reply(668 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:669 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf800 2023-12-19T18:03:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 264 ==== osd_op_reply(669 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:670 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782b686400 2023-12-19T18:03:49.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.556+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 155 ==== osd_op_reply(670 10000000000.01800000 [omap-get-header out=274b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 49 2023-12-19T18:03:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:671 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b686400 2023-12-19T18:03:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 156 ==== osd_op_reply(671 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv49 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.565 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=37 frag=1*, r=0 2023-12-19T18:03:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 20 datascan.read_dentry: 37_head not found in result 2023-12-19T18:03:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000021a at 0x0x10000000000/37 with size=2 bytes 2023-12-19T18:03:49.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:672 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4800 con 0x55782b686400 2023-12-19T18:03:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 157 ==== osd_op_reply(672 10000000000.01800000 [omap-set-vals] v131'50 uv50 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/37 pointing to 0x0x1000000021a 2023-12-19T18:03:49.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.560+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:673 18.27 18:e692fc64::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b6b4400 2023-12-19T18:03:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 36 ==== osd_op_reply(673 [pgnls-filter start_epoch 131 out=81b] v131'17 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000021b.00000000 2023-12-19T18:03:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000021b.0 2023-12-19T18:03:49.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:674 18.27 18:e692fc64:::1000000021b.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5000 con 0x55782b6b4400 2023-12-19T18:03:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 37 ==== osd_op_reply(674 1000000021b.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv17 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000021b 2023-12-19T18:03:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/38 2023-12-19T18:03:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=38 2023-12-19T18:03:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:675 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4000 con 0x55782c0bf000 2023-12-19T18:03:49.570 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 130 ==== osd_op_reply(675 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:676 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5c00 con 0x55782c0bf800 2023-12-19T18:03:49.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 265 ==== osd_op_reply(676 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:677 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b5800 con 0x55782c0bf800 2023-12-19T18:03:49.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 266 ==== osd_op_reply(677 10000000000.01000000 [omap-get-header out=274b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 53 2023-12-19T18:03:49.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.564+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:678 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754000 con 0x55782c0bf800 2023-12-19T18:03:49.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 267 ==== osd_op_reply(678 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=38 frag=0*, r=0 2023-12-19T18:03:49.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8de76840 20 datascan.read_dentry: 38_head not found in result 2023-12-19T18:03:49.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000021b at 0x0x10000000000/38 with size=2 bytes 2023-12-19T18:03:49.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:679 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754400 con 0x55782c0bf800 2023-12-19T18:03:49.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 268 ==== osd_op_reply(679 10000000000.01000000 [omap-set-vals] v131'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/38 pointing to 0x0x1000000021b 2023-12-19T18:03:49.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.568+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:680 18.17 18:e8000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754800 con 0x55782b6b4400 2023-12-19T18:03:49.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 38 ==== osd_op_reply(680 [pgnls-filter start_epoch 131 out=101b] v131'15 uv15 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000215.00000000 2023-12-19T18:03:49.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000215.0 2023-12-19T18:03:49.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:681 18.17 18:eace0b58:::10000000215.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b400 con 0x55782b6b4400 2023-12-19T18:03:49.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 39 ==== osd_op_reply(681 10000000215.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000215 2023-12-19T18:03:49.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/32 2023-12-19T18:03:49.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=32 2023-12-19T18:03:49.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:682 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71ac00 con 0x55782c0bf000 2023-12-19T18:03:49.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 131 ==== osd_op_reply(682 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:683 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a800 con 0x55782c0bf800 2023-12-19T18:03:49.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 269 ==== osd_op_reply(683 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.572+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:684 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb800 con 0x55782b686400 2023-12-19T18:03:49.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 158 ==== osd_op_reply(684 10000000000.01800000 [omap-get-header out=274b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 50 2023-12-19T18:03:49.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:685 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea400 con 0x55782b686400 2023-12-19T18:03:49.582 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 159 ==== osd_op_reply(685 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv50 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=32 frag=1*, r=0 2023-12-19T18:03:49.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 20 datascan.read_dentry: 32_head not found in result 2023-12-19T18:03:49.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000215 at 0x0x10000000000/32 with size=2 bytes 2023-12-19T18:03:49.583 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.576+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:686 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ebc00 con 0x55782b686400 2023-12-19T18:03:49.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 160 ==== osd_op_reply(686 10000000000.01800000 [omap-set-vals] v131'51 uv51 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/32 pointing to 0x0x10000000215 2023-12-19T18:03:49.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:687 18.17 18:eb1b33a4::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea800 con 0x55782b6b4400 2023-12-19T18:03:49.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 40 ==== osd_op_reply(687 [pgnls-filter start_epoch 131 out=81b] v131'15 uv15 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000253.00000000 2023-12-19T18:03:49.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000253.0 2023-12-19T18:03:49.586 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:688 18.17 18:eb1b33a4:::10000000253.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6c00 con 0x55782b6b4400 2023-12-19T18:03:49.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 41 ==== osd_op_reply(688 10000000253.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv15 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000253 2023-12-19T18:03:49.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/94 2023-12-19T18:03:49.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=94 2023-12-19T18:03:49.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:689 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7c00 con 0x55782c0bf000 2023-12-19T18:03:49.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 132 ==== osd_op_reply(689 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.580+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:690 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687c00 con 0x55782c0bf800 2023-12-19T18:03:49.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 270 ==== osd_op_reply(690 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:691 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735400 con 0x55782b686400 2023-12-19T18:03:49.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 161 ==== osd_op_reply(691 10000000000.01800000 [omap-get-header out=274b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 51 2023-12-19T18:03:49.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:692 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734400 con 0x55782b686400 2023-12-19T18:03:49.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 162 ==== osd_op_reply(692 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv51 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=94 frag=1*, r=0 2023-12-19T18:03:49.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 20 datascan.read_dentry: 94_head not found in result 2023-12-19T18:03:49.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000253 at 0x0x10000000000/94 with size=2 bytes 2023-12-19T18:03:49.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.584+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:693 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735000 con 0x55782b686400 2023-12-19T18:03:49.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 163 ==== osd_op_reply(693 10000000000.01800000 [omap-set-vals] v131'52 uv52 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/94 pointing to 0x0x10000000253 2023-12-19T18:03:49.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:694 18.37 18:ec000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6b4c00 con 0x55782b6eac00 2023-12-19T18:03:49.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 25 ==== osd_op_reply(694 [pgnls-filter start_epoch 131 out=49b] v129'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:695 18.f 18:f0000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734800 con 0x55782b6b4400 2023-12-19T18:03:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 42 ==== osd_op_reply(695 [pgnls-filter start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 1000000022e.00000000 2023-12-19T18:03:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.588+0000 7f5c8de76840 10 datascan.operator(): handling object 1000000022e.0 2023-12-19T18:03:49.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:696 18.f 18:f25dd5df:::1000000022e.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71a400 con 0x55782b6b4400 2023-12-19T18:03:49.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.5 v2:172.21.15.73:6824/36539 43 ==== osd_op_reply(696 1000000022e.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6b4400 2023-12-19T18:03:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x1000000022e 2023-12-19T18:03:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/57 2023-12-19T18:03:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=57 2023-12-19T18:03:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:697 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71b800 con 0x55782c0bf000 2023-12-19T18:03:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 133 ==== osd_op_reply(697 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.598 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:698 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b71bc00 con 0x55782c0bf800 2023-12-19T18:03:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 271 ==== osd_op_reply(698 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:699 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6eb400 con 0x55782b686400 2023-12-19T18:03:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 164 ==== osd_op_reply(699 10000000000.01800000 [omap-get-header out=274b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 52 2023-12-19T18:03:49.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.592+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:700 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6ea000 con 0x55782b686400 2023-12-19T18:03:49.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 165 ==== osd_op_reply(700 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv52 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=57 frag=1*, r=0 2023-12-19T18:03:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 20 datascan.read_dentry: 57_head not found in result 2023-12-19T18:03:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x1000000022e at 0x0x10000000000/57 with size=2 bytes 2023-12-19T18:03:49.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:701 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686400 2023-12-19T18:03:49.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 166 ==== osd_op_reply(701 10000000000.01800000 [omap-set-vals] v131'53 uv53 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/57 pointing to 0x0x1000000022e 2023-12-19T18:03:49.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.596+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:702 18.2f 18:f4000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b735800 con 0x55782b6c7400 2023-12-19T18:03:49.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8c632700 1 -- 172.21.15.45:0/2427410848 <== osd.1 v2:172.21.15.45:6800/36282 20 ==== osd_op_reply(702 [pgnls-filter start_epoch 131 out=49b] v129'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55782c02afc0 con 0x55782b6c7400 2023-12-19T18:03:49.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c87e29700 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:703 18.1f 18:f8000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b734c00 con 0x55782b6eac00 2023-12-19T18:03:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 26 ==== osd_op_reply(703 [pgnls-filter start_epoch 131 out=101b] v131'12 uv12 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000238.00000000 2023-12-19T18:03:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000238.0 2023-12-19T18:03:49.607 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:704 18.1f 18:f87ea8f1:::10000000238.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687400 con 0x55782b6eac00 2023-12-19T18:03:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 27 ==== osd_op_reply(704 10000000238.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv11 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000238 2023-12-19T18:03:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/67 2023-12-19T18:03:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=67 2023-12-19T18:03:49.608 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:705 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782c0bf000 2023-12-19T18:03:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 134 ==== osd_op_reply(705 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.600+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:706 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b686c00 con 0x55782c0bf800 2023-12-19T18:03:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 272 ==== osd_op_reply(706 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.609 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.610 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:707 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 167 ==== osd_op_reply(707 10000000000.01800000 [omap-get-header out=274b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 53 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:708 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b686400 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 168 ==== osd_op_reply(708 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv53 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=67 frag=1*, r=0 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 20 datascan.read_dentry: 67_head not found in result 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000238 at 0x0x10000000000/67 with size=2 bytes 2023-12-19T18:03:49.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.604+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:709 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782b686400 2023-12-19T18:03:49.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 169 ==== osd_op_reply(709 10000000000.01800000 [omap-set-vals] v131'54 uv54 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/67 pointing to 0x0x10000000238 2023-12-19T18:03:49.614 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:710 18.1f 18:f8e2d5cc::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f000 con 0x55782b6eac00 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 28 ==== osd_op_reply(710 [pgnls-filter start_epoch 131 out=81b] v131'12 uv12 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000214.00000000 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000214.0 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:711 18.1f 18:f8e2d5cc:::10000000214.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e800 con 0x55782b6eac00 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.7 v2:172.21.15.73:6800/36538 29 ==== osd_op_reply(711 10000000214.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv12 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02ad80 con 0x55782b6eac00 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000214 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/31 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=31 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.608+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:712 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf000 2023-12-19T18:03:49.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 135 ==== osd_op_reply(712 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:713 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6800 con 0x55782c0bf800 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 273 ==== osd_op_reply(713 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:714 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c6400 con 0x55782c0bf800 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 274 ==== osd_op_reply(714 10000000000.01000000 [omap-get-header out=274b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 54 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:715 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b6c7800 con 0x55782c0bf800 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 275 ==== osd_op_reply(715 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=31 frag=0*, r=0 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 20 datascan.read_dentry: 31_head not found in result 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000214 at 0x0x10000000000/31 with size=2 bytes 2023-12-19T18:03:49.620 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.612+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:716 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755000 con 0x55782c0bf800 2023-12-19T18:03:49.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 276 ==== osd_op_reply(716 10000000000.01000000 [omap-set-vals] v131'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/31 pointing to 0x0x10000000214 2023-12-19T18:03:49.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:717 18.3f 18:fc000000::::head [pgnls-filter start_epoch 131 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755400 con 0x55782b686400 2023-12-19T18:03:49.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 170 ==== osd_op_reply(717 [pgnls-filter start_epoch 131 out=101b] v131'14 uv14 ondisk = 0) v8 ==== 144+0+101 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 10000000232.00000000 2023-12-19T18:03:49.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8de76840 10 datascan.operator(): handling object 10000000232.0 2023-12-19T18:03:49.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.616+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:718 18.3f 18:fd83cc12:::10000000232.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755800 con 0x55782b686400 2023-12-19T18:03:49.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 171 ==== osd_op_reply(718 10000000232.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (90) out=90b,getxattr (30) out=30b,getxattr] v0'0 uv13 ondisk = 0) v8 ==== 416+0+158 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x10000000232 2023-12-19T18:03:49.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/61 2023-12-19T18:03:49.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=61 2023-12-19T18:03:49.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:719 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755c00 con 0x55782c0bf000 2023-12-19T18:03:49.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 136 ==== osd_op_reply(719 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:720 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b754c00 con 0x55782c0bf800 2023-12-19T18:03:49.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 277 ==== osd_op_reply(720 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 0* 2023-12-19T18:03:49.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:721 17.5 17:a40620de:::10000000000.01000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755400 con 0x55782c0bf800 2023-12-19T18:03:49.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 278 ==== osd_op_reply(721 10000000000.01000000 [omap-get-header out=274b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 55 2023-12-19T18:03:49.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 0* 2023-12-19T18:03:49.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.620+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:722 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b755800 con 0x55782c0bf800 2023-12-19T18:03:49.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 279 ==== osd_op_reply(722 10000000000.01000000 [omap-get-vals-by-keys out=4b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01000000 dname=61 frag=0*, r=0 2023-12-19T18:03:49.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8de76840 20 datascan.read_dentry: 61_head not found in result 2023-12-19T18:03:49.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000232 at 0x0x10000000000/61 with size=2 bytes 2023-12-19T18:03:49.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:723 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f400 con 0x55782c0bf800 2023-12-19T18:03:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 280 ==== osd_op_reply(723 10000000000.01000000 [omap-set-vals] v131'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/61 pointing to 0x0x10000000232 2023-12-19T18:03:49.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.624+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:724 18.3f 18:feb1c803::::head [pgnls-filter start_epoch 131 in=105b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70ec00 con 0x55782b686400 2023-12-19T18:03:49.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 172 ==== osd_op_reply(724 [pgnls-filter start_epoch 131 out=81b] v131'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 20 datascan.forall_objects: OSD matched oid 100000001fa.00000000 2023-12-19T18:03:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 10 datascan.operator(): handling object 100000001fa.0 2023-12-19T18:03:49.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:725 18.3f 18:feb1c803:::100000001fa.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e400 con 0x55782b686400 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 173 ==== osd_op_reply(725 100000001fa.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv14 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 10 datascan.inject_with_backtrace: inode: 0x0x100000001fa 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/5 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=5 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:726 17.10 17:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70f800 con 0x55782c0bf000 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.3 v2:172.21.15.45:6816/36284 137 ==== osd_op_reply(726 10000000000.00000000 [getxattr (62) out=62b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+62 (crc 0 0 0) 0x55782c02b440 con 0x55782c0bf000 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 20 datascan.get_frag_of: got backtrace parent 0x1/subdir 2023-12-19T18:03:49.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:727 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=19b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b70e000 con 0x55782c0bf800 2023-12-19T18:03:49.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8ce33700 1 -- 172.21.15.45:0/2427410848 <== osd.6 v2:172.21.15.73:6816/36537 281 ==== osd_op_reply(727 1.00000000 [omap-get-vals-by-keys out=531b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+531 (crc 0 0 0) 0x55782c02ad80 con 0x55782c0bf800 2023-12-19T18:03:49.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 20 datascan.read_dentry: oid=1.00000000 dname=subdir frag=*, r=0 2023-12-19T18:03:49.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 20 datascan.get_frag_of: fast path, fragtree is fragtree_t(*^1) 2023-12-19T18:03:49.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 20 datascan.get_frag_of: frag is 1* 2023-12-19T18:03:49.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.628+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:728 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687800 con 0x55782b686400 2023-12-19T18:03:49.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 174 ==== osd_op_reply(728 10000000000.01800000 [omap-get-header out=274b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 10 datascan.find_or_create_dirfrag: read_version = 54 2023-12-19T18:03:49.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 1* 2023-12-19T18:03:49.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:729 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782b687000 con 0x55782b686400 2023-12-19T18:03:49.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 175 ==== osd_op_reply(729 10000000000.01800000 [omap-get-vals-by-keys out=4b] v0'0 uv54 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 20 datascan.read_dentry: oid=10000000000.01800000 dname=5 frag=1*, r=0 2023-12-19T18:03:49.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 20 datascan.read_dentry: 5_head not found in result 2023-12-19T18:03:49.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001fa at 0x0x10000000000/5 with size=1 bytes 2023-12-19T18:03:49.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.632+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:730 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x55782c0bf400 con 0x55782b686400 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 <== osd.4 v2:172.21.15.73:6805/36536 176 ==== osd_op_reply(730 10000000000.01800000 [omap-set-vals] v131'55 uv55 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55782c02b440 con 0x55782b686400 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x100000001fa 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55782b686800 msgr2=0x55782b2db600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x55782b686800 0x55782b2db600 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55782b6c7400 msgr2=0x55782b6ac000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x55782b6c7400 0x55782b6ac000 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55782b6eb000 msgr2=0x55782b6af180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x55782b6eb000 0x55782b6af180 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55782c0bf000 msgr2=0x55782b2dc100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x55782c0bf000 0x55782b2dc100 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55782b686400 msgr2=0x55782b6ac580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x55782b686400 0x55782b6ac580 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 reap_dead start 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55782b6b4400 msgr2=0x55782b6acb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x55782b6b4400 0x55782b6acb00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55782c0bf800 msgr2=0x55782b2dbb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x55782c0bf800 0x55782b2dbb80 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55782b6eac00 msgr2=0x55782b6fc000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x55782b6eac00 0x55782b6fc000 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 reap_dead start 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55782b686000 msgr2=0x55782b2dd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55782b686000 0x55782b2dd700 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x55782b342090 tx=0x55782b30b380 comp rx=0 tx=0).stop 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8be31700 1 -- 172.21.15.45:0/2427410848 reap_dead start 2023-12-19T18:03:49.643 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 msgr2=0x55782b2dcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dcc00 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x55782c0bd470 tx=0x55782c02cf00 comp rx=0 tx=0).stop 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 shutdown_connections 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x55782b686000 0x55782b2dd700 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/2427410848 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782c0be800 0x55782b2dcc00 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 >> 172.21.15.45:0/2427410848 conn(0x55782b234c00 msgr2=0x55782b303800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 shutdown_connections 2023-12-19T18:03:49.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/2427410848 wait complete. 2023-12-19T18:03:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 msgr2=0x55782b2da580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 0x55782b2da580 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x55782b3433e0 tx=0x55782c02cd20 comp rx=0 tx=0).stop 2023-12-19T18:03:49.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 shutdown_connections 2023-12-19T18:03:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x55782b235000 0x55782b2db080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55782b235400 0x55782b2dab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 --2- 172.21.15.45:0/1812451484 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x55782b235800 0x55782b2da580 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 >> 172.21.15.45:0/1812451484 conn(0x55782b235c00 msgr2=0x55782b303000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 shutdown_connections 2023-12-19T18:03:49.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.636+0000 7f5c8de76840 1 -- 172.21.15.45:0/1812451484 wait complete. 2023-12-19T18:03:49.651 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes'] in time 0:00:01.040111, result: 2023-12-19T18:03:49.652 DEBUG:teuthology.orchestra.run.smithi045:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2023-12-19T18:03:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 -- start start 2023-12-19T18:03:49.757 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 Processor -- start 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 0x5557269d8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555726933400 0x5557269d8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555726933000 0x5557269d9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2a00 con 0x555726933800 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2780 con 0x555726933400 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2640 con 0x555726933000 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 0x5557269d8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.762 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 0x5557269d8580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46924/0 (socket says 172.21.15.45:46924) 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 -- 172.21.15.45:0/76473379 learned_addr learned my addr 172.21.15.45:0/76473379 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d0baa700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555726933000 0x5557269d9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 -- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555726933000 msgr2=0x5557269d9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555726933000 0x5557269d9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78cfba8700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555726933400 0x5557269d8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 -- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555726933400 msgr2=0x5557269d8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555726933400 0x5557269d8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 -- 172.21.15.45:0/76473379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555726954b60 con 0x555726933800 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d0baa700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555726933000 0x5557269d9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78cfba8700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555726933400 0x5557269d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d03a9700 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 0x5557269d8580 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x555726a41350 tx=0x55572771ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5b645016c2ad1c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78cdba4700 1 -- 172.21.15.45:0/76473379 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555726963080 con 0x555726933800 2023-12-19T18:03:49.763 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78cdba4700 1 -- 172.21.15.45:0/76473379 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555727720300 con 0x555726933800 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78cdba4700 1 -- 172.21.15.45:0/76473379 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555726963600 con 0x555726933800 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557269551e0 con 0x555726933800 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.752+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x555726954b60 con 0x555726933800 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 4 waiting for MDS map... 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78cdba4700 1 -- 172.21.15.45:0/76473379 <== mon.0 v2:172.21.15.45:3300/0 4 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x55572696cc40 con 0x555726933800 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78cdba4700 1 -- 172.21.15.45:0/76473379 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 107) v1 ==== 3118+0+0 (secure 0 0 0) 0x555726974f00 con 0x555726933800 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 4 Got MDS map 107 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 4 datascan.main: Using metadata pool output 2023-12-19T18:03:49.764 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 4 datascan.main: connecting to RADOS... 2023-12-19T18:03:49.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 Processor -- start 2023-12-19T18:03:49.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 -- start start 2023-12-19T18:03:49.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 0x5557269d9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc800 0x5557269d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x555726969e00 con 0x5557277bc400 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2780 con 0x5557277bcc00 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.756+0000 7f78d1bed840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2a00 con 0x5557277bc800 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 0x5557269d9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 0x5557269d9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46934/0 (socket says 172.21.15.45:46934) 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 -- 172.21.15.45:0/2911491117 learned_addr learned my addr 172.21.15.45:0/2911491117 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d03a9700 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc800 0x5557269d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78cfba8700 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 -- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc800 msgr2=0x5557269d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc800 0x5557269d9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 -- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 msgr2=0x5557269da100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 -- 172.21.15.45:0/2911491117 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555726954340 con 0x5557277bc400 2023-12-19T18:03:49.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d0baa700 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 0x5557269d9600 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x555726c36660 tx=0x55572771ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c343dd7a2c0297e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78cbba0700 1 -- 172.21.15.45:0/2911491117 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555726963080 con 0x5557277bc400 2023-12-19T18:03:49.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78cbba0700 1 -- 172.21.15.45:0/2911491117 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555727721080 con 0x5557277bc400 2023-12-19T18:03:49.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78cbba0700 1 -- 172.21.15.45:0/2911491117 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555726963600 con 0x5557277bc400 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 -- 172.21.15.45:0/2911491117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 msgr2=0x5557269d9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 0x5557269d9600 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x555726c36660 tx=0x55572771ec00 comp rx=0 tx=0).stop 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 -- 172.21.15.45:0/2911491117 shutdown_connections 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc800 0x5557269d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 --2- 172.21.15.45:0/2911491117 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc400 0x5557269d9600 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 -- 172.21.15.45:0/2911491117 >> 172.21.15.45:0/2911491117 conn(0x555726932c00 msgr2=0x555726a01800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 -- 172.21.15.45:0/2911491117 shutdown_connections 2023-12-19T18:03:49.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 -- 172.21.15.45:0/2911491117 wait complete. 2023-12-19T18:03:49.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.760+0000 7f78d1bed840 1 Processor -- start 2023-12-19T18:03:49.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 -- start start 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc400 0x5557269db180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 0x5557269dac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2500 con 0x5557277bc800 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557269b23c0 con 0x5557277bcc00 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557269b2280 con 0x5557277bc400 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 0x5557269dac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 0x5557269dac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46948/0 (socket says 172.21.15.45:46948) 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 learned_addr learned my addr 172.21.15.45:0/4284509599 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:49.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc400 0x5557269db180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc400 msgr2=0x5557269db180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc400 0x5557269db180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 msgr2=0x5557269da680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5557277bcc00 0x5557269da680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555726954000 con 0x5557277bc800 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x5557277bc400 0x5557269db180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 0x5557269dac00 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x555726c37350 tx=0x55572771ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78ca39d700 1 -- 172.21.15.45:0/4284509599 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5557269631e0 con 0x5557277bc800 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78ca39d700 1 -- 172.21.15.45:0/4284509599 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555727720c00 con 0x5557277bc800 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555726954ea0 con 0x5557277bc800 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78ca39d700 1 -- 172.21.15.45:0/4284509599 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x555726962f20 con 0x5557277bc800 2023-12-19T18:03:49.773 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555726955520 con 0x5557277bc800 2023-12-19T18:03:49.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.764+0000 7f78d1bed840 4 datascan.init: resolving metadata pool 17 2023-12-19T18:03:49.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.768+0000 7f78ca39d700 1 -- 172.21.15.45:0/4284509599 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x555726990840 con 0x5557277bc800 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.768+0000 7f78ca39d700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555726d94000 0x5557269db700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.768+0000 7f78ca39d700 1 -- 172.21.15.45:0/4284509599 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x55572696ca80 con 0x5557277bc800 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78d1bed840 4 datascan.init: found metadata pool 'cephfs_metadata' 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78d1bed840 4 datascan.main: resolving metadata pool 17 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5557277bd000 0x5557269da100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd400 con 0x5557277bd000 2023-12-19T18:03:49.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555726d94000 0x5557269db700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5557277bd000 0x5557269da100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555726d94000 0x5557269db700 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x555726c36660 tx=0x555726c38cc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5557277bd000 0x5557269da100 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== osd_op_reply(1 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5557277bd400 0x555726d9e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.772+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:2 17.10 17:08000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94400 con 0x5557277bd400 2023-12-19T18:03:49.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5557277bd400 0x555726d9e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5557277bd400 0x555726d9e000 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== osd_op_reply(2 [pgnls start_epoch 131 out=177b] v130'12 uv12 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:3 17.8 17:10000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94400 con 0x5557277bd000 2023-12-19T18:03:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== osd_op_reply(3 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555726d94400 0x555726d9e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:4 17.18 17:18000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94800 con 0x555726d94400 2023-12-19T18:03:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.776+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555726d94400 0x555726d9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555726d94400 0x555726d9e580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== osd_op_reply(4 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:5 17.4 17:20000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94800 con 0x555726d94400 2023-12-19T18:03:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== osd_op_reply(5 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:6 17.14 17:28000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94800 con 0x5557277bd400 2023-12-19T18:03:49.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== osd_op_reply(6 [pgnls start_epoch 131 out=149b] v130'27 uv27 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:7 17.c 17:30000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94800 con 0x5557277bd000 2023-12-19T18:03:49.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 3 ==== osd_op_reply(7 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555726d94800 0x555726d9eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.780+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:8 17.1c 17:38000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d94c00 con 0x555726d94800 2023-12-19T18:03:49.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555726d94800 0x555726d9eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555726d94800 0x555726d9eb00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== osd_op_reply(8 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555726d94c00 0x555726d9f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:9 17.2 17:40000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95000 con 0x555726d94c00 2023-12-19T18:03:49.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555726d94c00 0x555726d9f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.784+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555726d94c00 0x555726d9f080 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== osd_op_reply(9 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:10 17.12 17:48000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95000 con 0x5557277bd400 2023-12-19T18:03:49.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 3 ==== osd_op_reply(10 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:11 17.a 17:50000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95000 con 0x5557277bd000 2023-12-19T18:03:49.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 4 ==== osd_op_reply(11 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:12 17.1a 17:58000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95000 con 0x555726d94400 2023-12-19T18:03:49.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 3 ==== osd_op_reply(12 [pgnls start_epoch 131 out=49b] v130'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x555726d95000 0x555726da0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:13 17.6 17:60000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95c00 con 0x555726d95000 2023-12-19T18:03:49.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.788+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x555726d95000 0x555726da0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x555726d95000 0x555726da0100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(13 [pgnls start_epoch 131 out=77b] v130'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78d03a9700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x555726d95c00 0x555726da0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:14 17.16 17:68000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8000 con 0x555726d95c00 2023-12-19T18:03:49.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x555726d95c00 0x555726da0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x555726d95c00 0x555726da0680 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.792+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== osd_op_reply(14 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78cfba8700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555726db8000 0x555726d9f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:49.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:15 17.e 17:70000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726db8000 2023-12-19T18:03:49.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555726db8000 0x555726d9f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:49.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78d0baa700 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555726db8000 0x555726d9f600 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:49.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== osd_op_reply(15 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cd80 con 0x555726db8000 2023-12-19T18:03:49.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:16 17.1e 17:78000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94800 2023-12-19T18:03:49.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== osd_op_reply(16 [pgnls start_epoch 131 out=49b] v130'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:17 17.1 17:80000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94400 2023-12-19T18:03:49.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 4 ==== osd_op_reply(17 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.796+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:18 17.11 17:88000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x5557277bd400 2023-12-19T18:03:49.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 4 ==== osd_op_reply(18 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:19 17.9 17:90000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x5557277bd400 2023-12-19T18:03:49.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 5 ==== osd_op_reply(19 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:20 17.19 17:98000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95c00 2023-12-19T18:03:49.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== osd_op_reply(20 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:21 17.5 17:a0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95000 2023-12-19T18:03:49.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== osd_op_reply(21 [pgnls start_epoch 131 out=81b] v131'56 uv56 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.800+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:22 17.15 17:a8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95c00 2023-12-19T18:03:49.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.804+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 3 ==== osd_op_reply(22 [pgnls start_epoch 131 out=97b] v128'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.804+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:23 17.d 17:b0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x5557277bd000 2023-12-19T18:03:49.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.804+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 5 ==== osd_op_reply(23 [pgnls start_epoch 131 out=74b] v128'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.804+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:24 17.1d 17:b8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x5557277bd000 2023-12-19T18:03:49.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.804+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 6 ==== osd_op_reply(24 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.804+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:25 17.3 17:c0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:49.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== osd_op_reply(25 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.812 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:26 17.13 17:c8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x5557277bd400 2023-12-19T18:03:49.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 6 ==== osd_op_reply(26 [pgnls start_epoch 131 out=98b] v129'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:27 17.b 17:d0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94400 2023-12-19T18:03:49.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 5 ==== osd_op_reply(27 [pgnls start_epoch 131 out=76b] v130'4 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:28 17.1b 17:d8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:49.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 3 ==== osd_op_reply(28 [pgnls start_epoch 131 out=81b] v131'55 uv55 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:29 17.7 17:e0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94400 2023-12-19T18:03:49.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 6 ==== osd_op_reply(29 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.815 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.808+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:30 17.17 17:e8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95000 2023-12-19T18:03:49.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 3 ==== osd_op_reply(30 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.817 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:31 17.f 17:f0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94800 2023-12-19T18:03:49.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 3 ==== osd_op_reply(31 [pgnls start_epoch 131 out=73b] v128'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.818 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:32 17.1f 17:f8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95000 2023-12-19T18:03:49.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 4 ==== osd_op_reply(32 [pgnls start_epoch 131 out=101b] v130'7 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 601.00000000 2023-12-19T18:03:49.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:33 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x5557277bd400 2023-12-19T18:03:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.812+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 7 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 602.00000000 2023-12-19T18:03:49.820 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:34 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x5557277bd400 2023-12-19T18:03:49.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 8 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2023-12-19T18:03:49.821 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:35 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x5557277bd400 2023-12-19T18:03:49.823 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 9 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=50980b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50980 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 600.00000000 2023-12-19T18:03:49.824 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.816+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:36 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 10 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 603.00000000 2023-12-19T18:03:49.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:37 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x5557277bd400 2023-12-19T18:03:49.825 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 11 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 200.00000000 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 200.00000001 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 606.00000000 2023-12-19T18:03:49.826 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:38 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x5557277bd400 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 12 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 607.00000000 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:39 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94800 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 4 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 608.00000000 2023-12-19T18:03:49.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:40 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726db8000 2023-12-19T18:03:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== osd_op_reply(40 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x555726db8000 2023-12-19T18:03:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 10000000000.01000000 2023-12-19T18:03:49.828 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.820+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:41 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95000 2023-12-19T18:03:49.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 5 ==== osd_op_reply(41 10000000000.01000000 [omap-get-vals out=25448b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+25448 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.833 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 604.00000000 2023-12-19T18:03:49.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:42 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d95c00 2023-12-19T18:03:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 4 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 500.00000000 2023-12-19T18:03:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T18:03:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object mds_snaptable 2023-12-19T18:03:49.835 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 605.00000000 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.824+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:43 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x5557277bd000 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 7 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object mds0_inotable 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 100.00000000 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:44 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x5557277bd400 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 13 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 10000000000.01800000 2023-12-19T18:03:49.836 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:45 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94c00 2023-12-19T18:03:49.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 4 ==== osd_op_reply(45 10000000000.01800000 [omap-get-vals out=24452b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+24452 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 609.00000000 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.828+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:46 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d94400 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 7 ==== osd_op_reply(46 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 400.00000000 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 10 datascan.scan_links: step 1: handling object 1.00000000 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:47 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d95000 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=532b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+532 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:48 17.0 17:00000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x5557277bd000 2023-12-19T18:03:49.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 8 ==== osd_op_reply(48 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.832+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:49 17.10 17:08000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 14 ==== osd_op_reply(49 [pgnls start_epoch 131 out=177b] v130'12 uv12 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:50 17.8 17:10000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd000 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 9 ==== osd_op_reply(50 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:51 17.18 17:18000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94400 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 8 ==== osd_op_reply(51 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:52 17.4 17:20000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94400 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 9 ==== osd_op_reply(52 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:53 17.14 17:28000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 15 ==== osd_op_reply(53 [pgnls start_epoch 131 out=149b] v130'27 uv27 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.836+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:54 17.c 17:30000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd000 2023-12-19T18:03:49.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 10 ==== osd_op_reply(54 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:55 17.1c 17:38000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94800 2023-12-19T18:03:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 5 ==== osd_op_reply(55 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:56 17.2 17:40000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94c00 2023-12-19T18:03:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 5 ==== osd_op_reply(56 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:57 17.12 17:48000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 16 ==== osd_op_reply(57 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.840+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:58 17.a 17:50000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd000 2023-12-19T18:03:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 11 ==== osd_op_reply(58 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:59 17.1a 17:58000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94400 2023-12-19T18:03:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 10 ==== osd_op_reply(59 [pgnls start_epoch 131 out=49b] v130'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:60 17.6 17:60000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 7 ==== osd_op_reply(60 [pgnls start_epoch 131 out=77b] v130'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:61 17.16 17:68000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95c00 2023-12-19T18:03:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 5 ==== osd_op_reply(61 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.844+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:62 17.e 17:70000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726db8000 2023-12-19T18:03:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.2 v2:172.21.15.45:6824/36285 3 ==== osd_op_reply(62 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cd80 con 0x555726db8000 2023-12-19T18:03:49.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:63 17.1e 17:78000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94800 2023-12-19T18:03:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 6 ==== osd_op_reply(63 [pgnls start_epoch 131 out=49b] v130'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:64 17.1 17:80000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94400 2023-12-19T18:03:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 11 ==== osd_op_reply(64 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:65 17.11 17:88000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 17 ==== osd_op_reply(65 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.848+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:66 17.9 17:90000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.852+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 18 ==== osd_op_reply(66 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.852+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:67 17.19 17:98000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95c00 2023-12-19T18:03:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.852+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 6 ==== osd_op_reply(67 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.852+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.852+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 8 ==== osd_op_reply(68 [pgnls start_epoch 131 out=81b] v131'56 uv56 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.852+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:69 17.15 17:a8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95c00 2023-12-19T18:03:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 7 ==== osd_op_reply(69 [pgnls start_epoch 131 out=97b] v128'3 uv3 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.860 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:70 17.d 17:b0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd000 2023-12-19T18:03:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 12 ==== osd_op_reply(70 [pgnls start_epoch 131 out=74b] v128'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.861 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:71 17.1d 17:b8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd000 2023-12-19T18:03:49.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 13 ==== osd_op_reply(71 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:72 17.3 17:c0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94c00 2023-12-19T18:03:49.863 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 6 ==== osd_op_reply(72 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.856+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:73 17.13 17:c8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x5557277bd400 2023-12-19T18:03:49.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 19 ==== osd_op_reply(73 [pgnls start_epoch 131 out=98b] v129'3 uv3 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:74 17.b 17:d0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94400 2023-12-19T18:03:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 12 ==== osd_op_reply(74 [pgnls start_epoch 131 out=76b] v130'4 uv3 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:75 17.1b 17:d8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94c00 2023-12-19T18:03:49.866 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 7 ==== osd_op_reply(75 [pgnls start_epoch 131 out=81b] v131'55 uv55 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:76 17.7 17:e0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94400 2023-12-19T18:03:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 13 ==== osd_op_reply(76 [pgnls start_epoch 131 out=73b] v128'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.867 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.860+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:77 17.17 17:e8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 9 ==== osd_op_reply(77 [pgnls start_epoch 131 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:78 17.f 17:f0000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94800 2023-12-19T18:03:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 7 ==== osd_op_reply(78 [pgnls start_epoch 131 out=73b] v128'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:79 17.1f 17:f8000000::::head [pgnls start_epoch 131 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 10 ==== osd_op_reply(79 [pgnls start_epoch 131 out=101b] v130'7 uv6 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 601.00000000 2023-12-19T18:03:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:80 17.10 17:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x5557277bd400 2023-12-19T18:03:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 20 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 602.00000000 2023-12-19T18:03:49.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.864+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:81 17.10 17:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x5557277bd400 2023-12-19T18:03:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.868+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 21 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv6 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.868+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2023-12-19T18:03:49.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.868+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:82 17.10 17:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x5557277bd400 2023-12-19T18:03:49.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.868+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 22 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=50980b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+50980 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.868+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 600.00000000 2023-12-19T18:03:49.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:83 17.10 17:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x5557277bd400 2023-12-19T18:03:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 23 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 603.00000000 2023-12-19T18:03:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:84 17.10 17:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x5557277bd400 2023-12-19T18:03:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 24 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv8 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2023-12-19T18:03:49.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2023-12-19T18:03:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 200.00000000 2023-12-19T18:03:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2023-12-19T18:03:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 200.00000001 2023-12-19T18:03:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2023-12-19T18:03:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 606.00000000 2023-12-19T18:03:49.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:85 17.14 17:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x5557277bd400 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 25 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 607.00000000 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- osd_op(unknown.0.0:86 17.1c 17:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94800 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.1 v2:172.21.15.45:6800/36282 8 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cb40 con 0x555726d94800 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2023-12-19T18:03:49.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 608.00000000 2023-12-19T18:03:49.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.872+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- osd_op(unknown.0.0:87 17.e 17:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726db8000 2023-12-19T18:03:49.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.2 v2:172.21.15.45:6824/36285 4 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cd80 con 0x555726db8000 2023-12-19T18:03:49.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 10000000000.01000000 2023-12-19T18:03:49.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:88 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d95000 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 11 ==== osd_op_reply(88 10000000000.01000000 [omap-get-vals out=25448b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+25448 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001ff for future processing to fix dnfirst 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000200 for future processing to fix dnfirst 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000201 for future processing to fix dnfirst 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000204 for future processing to fix dnfirst 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000208 for future processing to fix dnfirst 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001f6 for future processing to fix dnfirst 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000209 for future processing to fix dnfirst 2023-12-19T18:03:49.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000020a for future processing to fix dnfirst 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000210 for future processing to fix dnfirst 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000211 for future processing to fix dnfirst 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000214 for future processing to fix dnfirst 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000217 for future processing to fix dnfirst 2023-12-19T18:03:49.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000219 for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000021b for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000021c for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001f8 for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000021f for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000220 for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000223 for future processing to fix dnfirst 2023-12-19T18:03:49.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001f9 for future processing to fix dnfirst 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000227 for future processing to fix dnfirst 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000229 for future processing to fix dnfirst 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000022a for future processing to fix dnfirst 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000022c for future processing to fix dnfirst 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000230 for future processing to fix dnfirst 2023-12-19T18:03:49.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000232 for future processing to fix dnfirst 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000234 for future processing to fix dnfirst 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000235 for future processing to fix dnfirst 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000236 for future processing to fix dnfirst 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000237 for future processing to fix dnfirst 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000023a for future processing to fix dnfirst 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000023b for future processing to fix dnfirst 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000023e for future processing to fix dnfirst 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000023f for future processing to fix dnfirst 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000240 for future processing to fix dnfirst 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000242 for future processing to fix dnfirst 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000245 for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000248 for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000249 for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000024a for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000024b for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000024c for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000024d for future processing to fix dnfirst 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001fd for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000024f for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000251 for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000254 for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000255 for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000256 for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001fe for future processing to fix dnfirst 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 604.00000000 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- osd_op(unknown.0.0:89 17.15 17:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95c00 2023-12-19T18:03:49.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.5 v2:172.21.15.73:6824/36539 8 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cb40 con 0x555726d95c00 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 500.00000000 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.876+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object mds_snaptable 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 605.00000000 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:90 17.1d 17:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x5557277bd000 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 14 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object mds0_inotable 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 100.00000000 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:91 17.13 17:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x5557277bd400 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 26 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2023-12-19T18:03:49.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 10000000000.01800000 2023-12-19T18:03:49.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.880+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:92 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94c00 2023-12-19T18:03:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 8 ==== osd_op_reply(92 10000000000.01800000 [omap-get-vals out=24452b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+24452 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000202 for future processing to fix dnfirst 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000203 for future processing to fix dnfirst 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000205 for future processing to fix dnfirst 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000206 for future processing to fix dnfirst 2023-12-19T18:03:49.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000207 for future processing to fix dnfirst 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000020b for future processing to fix dnfirst 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000020c for future processing to fix dnfirst 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000020d for future processing to fix dnfirst 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000020e for future processing to fix dnfirst 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000020f for future processing to fix dnfirst 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000212 for future processing to fix dnfirst 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000213 for future processing to fix dnfirst 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000215 for future processing to fix dnfirst 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000216 for future processing to fix dnfirst 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000218 for future processing to fix dnfirst 2023-12-19T18:03:49.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000021a for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000021d for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000021e for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000221 for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000222 for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000224 for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000225 for future processing to fix dnfirst 2023-12-19T18:03:49.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000226 for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000228 for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000022b for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000022d for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000022e for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000022f for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001fa for future processing to fix dnfirst 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000231 for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000233 for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000238 for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000239 for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001fb for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000023c for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000023d for future processing to fix dnfirst 2023-12-19T18:03:49.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000241 for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000243 for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000244 for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x100000001fc for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000246 for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000247 for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x1000000024e for future processing to fix dnfirst 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000250 for future processing to fix dnfirst 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000252 for future processing to fix dnfirst 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000253 for future processing to fix dnfirst 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000257 for future processing to fix dnfirst 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: injected ino detected 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: adding 0x10000000258 for future processing to fix dnfirst 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 609.00000000 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- osd_op(unknown.0.0:93 17.7 17:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d94400 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.0 v2:172.21.15.45:6808/36279 14 ==== osd_op_reply(93 609.00000000 [omap-get-vals out=5b] v0'0 uv2 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55572771cfc0 con 0x555726d94400 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 400.00000000 2023-12-19T18:03:49.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: step 2: handling object 1.00000000 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:94 17.1f 17:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d95000 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=532b] v0'0 uv6 ondisk = 0) v8 ==== 154+0+532 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: processing 99 dup_primaries, 0 remote_links 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000001 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001f6 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001f7 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001f8 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001f9 2023-12-19T18:03:49.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001fa 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001fb 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001fc 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001fd 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001fe 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x100000001ff 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000200 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000201 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000202 2023-12-19T18:03:49.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000203 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000204 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000205 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000206 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000207 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000208 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000209 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000020b 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000020c 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000020d 2023-12-19T18:03:49.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000020e 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000020f 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000210 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000211 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000212 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000213 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000214 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000215 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000216 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000217 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000218 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000219 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000021a 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000021b 2023-12-19T18:03:49.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000021c 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000021d 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000021e 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000021f 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000220 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000221 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000222 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000223 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000224 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000225 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000226 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000227 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000228 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000229 2023-12-19T18:03:49.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000022a 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000022b 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000022c 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000022d 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000022e 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000022f 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000230 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000231 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000232 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000233 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000234 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000235 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000236 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000237 2023-12-19T18:03:49.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000238 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000239 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000023a 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000023b 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000023c 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000023d 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000023e 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000023f 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000240 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000241 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000242 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000243 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000244 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000245 2023-12-19T18:03:49.918 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000246 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000247 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000248 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000249 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000024a 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000024b 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000024c 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000024d 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000024e 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x1000000024f 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000250 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000251 2023-12-19T18:03:49.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000252 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000253 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000254 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000255 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000256 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000257 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling dup 0x10000000258 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: removing dup dentries from 0 objects 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: processing 0 bad_nlink_inos 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: processing 100 injected_inos 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000001 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:0 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:95 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d94c00 2023-12-19T18:03:49.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.884+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 9 ==== osd_op_reply(95 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv55 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=0 frag=1*, r=0 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:96 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d94c00 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 10 ==== osd_op_reply(96 10000000000.01800000 [omap-set-vals] v131'56 uv56 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/0 pointing to 0x0x10000000001 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001f6 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:1 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:97 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d95000 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.888+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 13 ==== osd_op_reply(97 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=1 frag=0*, r=0 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:98 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95000 2023-12-19T18:03:49.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 14 ==== osd_op_reply(98 10000000000.01000000 [omap-set-vals] v131'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/1 pointing to 0x0x100000001f6 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001f7 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:2 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:99 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d95000 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 15 ==== osd_op_reply(99 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=2 frag=0*, r=0 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.892+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:100 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95000 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 16 ==== osd_op_reply(100 10000000000.01000000 [omap-set-vals] v131'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/2 pointing to 0x0x100000001f7 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001f8 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:3 2023-12-19T18:03:49.922 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:101 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d95000 2023-12-19T18:03:49.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 17 ==== osd_op_reply(101 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=3 frag=0*, r=0 2023-12-19T18:03:49.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.896+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:102 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d95000 2023-12-19T18:03:49.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 18 ==== osd_op_reply(102 10000000000.01000000 [omap-set-vals] v131'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.925 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/3 pointing to 0x0x100000001f8 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001f9 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:4 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:103 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 19 ==== osd_op_reply(103 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=4 frag=0*, r=0 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.900+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:104 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d95000 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 20 ==== osd_op_reply(104 10000000000.01000000 [omap-set-vals] v131'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/4 pointing to 0x0x100000001f9 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001fa 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:5 2023-12-19T18:03:49.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:105 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 11 ==== osd_op_reply(105 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv56 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=5 frag=1*, r=0 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.904+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:106 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 12 ==== osd_op_reply(106 10000000000.01800000 [omap-set-vals] v131'57 uv57 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/5 pointing to 0x0x100000001fa 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001fb 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:6 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:107 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 13 ==== osd_op_reply(107 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv57 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=6 frag=1*, r=0 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.908+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:108 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:49.927 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 14 ==== osd_op_reply(108 10000000000.01800000 [omap-set-vals] v131'58 uv58 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/6 pointing to 0x0x100000001fb 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001fc 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:7 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:109 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d94c00 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 15 ==== osd_op_reply(109 10000000000.01800000 [omap-get-vals-by-keys out=502b] v0'0 uv58 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=7 frag=1*, r=0 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.912+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:110 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 16 ==== osd_op_reply(110 10000000000.01800000 [omap-set-vals] v131'59 uv59 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/7 pointing to 0x0x100000001fc 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001fd 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:8 2023-12-19T18:03:49.928 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:111 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d95000 2023-12-19T18:03:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 21 ==== osd_op_reply(111 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=8 frag=0*, r=0 2023-12-19T18:03:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.929 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.916+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:112 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 22 ==== osd_op_reply(112 10000000000.01000000 [omap-set-vals] v131'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/8 pointing to 0x0x100000001fd 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001fe 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:9 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:113 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=14b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d95000 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 23 ==== osd_op_reply(113 10000000000.01000000 [omap-get-vals-by-keys out=502b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+502 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=9 frag=0*, r=0 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.930 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.920+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:114 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d95000 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 24 ==== osd_op_reply(114 10000000000.01000000 [omap-set-vals] v131'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/9 pointing to 0x0x100000001fe 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x100000001ff 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:10 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:115 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d95000 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 25 ==== osd_op_reply(115 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=10 frag=0*, r=0 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.931 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.924+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:116 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d95000 2023-12-19T18:03:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 26 ==== osd_op_reply(116 10000000000.01000000 [omap-set-vals] v131'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/10 pointing to 0x0x100000001ff 2023-12-19T18:03:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000200 2023-12-19T18:03:49.933 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:11 2023-12-19T18:03:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:117 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d95000 2023-12-19T18:03:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 27 ==== osd_op_reply(117 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=11 frag=0*, r=0 2023-12-19T18:03:49.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.928+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:118 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 28 ==== osd_op_reply(118 10000000000.01000000 [omap-set-vals] v131'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/11 pointing to 0x0x10000000200 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000201 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:12 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:119 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d95000 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 29 ==== osd_op_reply(119 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=12 frag=0*, r=0 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.932+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:120 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 30 ==== osd_op_reply(120 10000000000.01000000 [omap-set-vals] v131'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/12 pointing to 0x0x10000000201 2023-12-19T18:03:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000202 2023-12-19T18:03:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:13 2023-12-19T18:03:49.941 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:121 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d94c00 2023-12-19T18:03:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 17 ==== osd_op_reply(121 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv59 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=13 frag=1*, r=0 2023-12-19T18:03:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.942 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.936+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:122 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d94c00 2023-12-19T18:03:49.945 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 18 ==== osd_op_reply(122 10000000000.01800000 [omap-set-vals] v131'60 uv60 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/13 pointing to 0x0x10000000202 2023-12-19T18:03:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000203 2023-12-19T18:03:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:14 2023-12-19T18:03:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:123 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 19 ==== osd_op_reply(123 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv60 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.946 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=14 frag=1*, r=0 2023-12-19T18:03:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.947 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.940+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:124 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d94c00 2023-12-19T18:03:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 20 ==== osd_op_reply(124 10000000000.01800000 [omap-set-vals] v131'61 uv61 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/14 pointing to 0x0x10000000203 2023-12-19T18:03:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000204 2023-12-19T18:03:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:15 2023-12-19T18:03:49.949 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:125 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d95000 2023-12-19T18:03:49.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 31 ==== osd_op_reply(125 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=15 frag=0*, r=0 2023-12-19T18:03:49.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.950 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.944+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:126 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95000 2023-12-19T18:03:49.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 32 ==== osd_op_reply(126 10000000000.01000000 [omap-set-vals] v131'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/15 pointing to 0x0x10000000204 2023-12-19T18:03:49.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000205 2023-12-19T18:03:49.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:16 2023-12-19T18:03:49.953 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:127 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d94c00 2023-12-19T18:03:49.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 21 ==== osd_op_reply(127 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv61 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=16 frag=1*, r=0 2023-12-19T18:03:49.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.954 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.948+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:128 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:49.956 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 22 ==== osd_op_reply(128 10000000000.01800000 [omap-set-vals] v131'62 uv62 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/16 pointing to 0x0x10000000205 2023-12-19T18:03:49.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000206 2023-12-19T18:03:49.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:17 2023-12-19T18:03:49.957 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:129 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d94c00 2023-12-19T18:03:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 23 ==== osd_op_reply(129 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv62 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=17 frag=1*, r=0 2023-12-19T18:03:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.958 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:130 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d94c00 2023-12-19T18:03:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 24 ==== osd_op_reply(130 10000000000.01800000 [omap-set-vals] v131'63 uv63 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/17 pointing to 0x0x10000000206 2023-12-19T18:03:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000207 2023-12-19T18:03:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:18 2023-12-19T18:03:49.960 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.952+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:131 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 25 ==== osd_op_reply(131 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv63 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=18 frag=1*, r=0 2023-12-19T18:03:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.961 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:132 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d94c00 2023-12-19T18:03:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 26 ==== osd_op_reply(132 10000000000.01800000 [omap-set-vals] v131'64 uv64 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.963 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/18 pointing to 0x0x10000000207 2023-12-19T18:03:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000208 2023-12-19T18:03:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:19 2023-12-19T18:03:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:133 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d95000 2023-12-19T18:03:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 33 ==== osd_op_reply(133 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv66 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=19 frag=0*, r=0 2023-12-19T18:03:49.964 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.956+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:134 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d95000 2023-12-19T18:03:49.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.960+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 34 ==== osd_op_reply(134 10000000000.01000000 [omap-set-vals] v131'67 uv67 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.960+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/19 pointing to 0x0x10000000208 2023-12-19T18:03:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.960+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000209 2023-12-19T18:03:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.960+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:20 2023-12-19T18:03:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.960+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:135 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d95000 2023-12-19T18:03:49.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.960+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 35 ==== osd_op_reply(135 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv67 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=20 frag=0*, r=0 2023-12-19T18:03:49.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:136 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:49.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 36 ==== osd_op_reply(136 10000000000.01000000 [omap-set-vals] v131'68 uv68 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/20 pointing to 0x0x10000000209 2023-12-19T18:03:49.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000020a 2023-12-19T18:03:49.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:21 2023-12-19T18:03:49.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:137 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d95000 2023-12-19T18:03:49.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 37 ==== osd_op_reply(137 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv68 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=21 frag=0*, r=0 2023-12-19T18:03:49.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.972 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.964+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:138 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95000 2023-12-19T18:03:49.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 38 ==== osd_op_reply(138 10000000000.01000000 [omap-set-vals] v131'69 uv69 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/21 pointing to 0x0x1000000020a 2023-12-19T18:03:49.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000020b 2023-12-19T18:03:49.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:22 2023-12-19T18:03:49.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:139 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d94c00 2023-12-19T18:03:49.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 27 ==== osd_op_reply(139 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv64 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=22 frag=1*, r=0 2023-12-19T18:03:49.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.968+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:140 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d94c00 2023-12-19T18:03:49.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 28 ==== osd_op_reply(140 10000000000.01800000 [omap-set-vals] v131'65 uv65 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/22 pointing to 0x0x1000000020b 2023-12-19T18:03:49.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000020c 2023-12-19T18:03:49.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:23 2023-12-19T18:03:49.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:141 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d94c00 2023-12-19T18:03:49.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 29 ==== osd_op_reply(141 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv65 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=23 frag=1*, r=0 2023-12-19T18:03:49.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.972+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:142 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:49.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 30 ==== osd_op_reply(142 10000000000.01800000 [omap-set-vals] v131'66 uv66 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/23 pointing to 0x0x1000000020c 2023-12-19T18:03:49.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000020d 2023-12-19T18:03:49.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:24 2023-12-19T18:03:49.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:143 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94c00 2023-12-19T18:03:49.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 31 ==== osd_op_reply(143 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv66 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=24 frag=1*, r=0 2023-12-19T18:03:49.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.984 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.976+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:144 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d94c00 2023-12-19T18:03:49.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 32 ==== osd_op_reply(144 10000000000.01800000 [omap-set-vals] v131'67 uv67 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.986 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/24 pointing to 0x0x1000000020d 2023-12-19T18:03:49.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000020e 2023-12-19T18:03:49.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:25 2023-12-19T18:03:49.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:145 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d94c00 2023-12-19T18:03:49.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 33 ==== osd_op_reply(145 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv67 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=25 frag=1*, r=0 2023-12-19T18:03:49.987 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.988 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.980+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:146 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d94c00 2023-12-19T18:03:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 34 ==== osd_op_reply(146 10000000000.01800000 [omap-set-vals] v131'68 uv68 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/25 pointing to 0x0x1000000020e 2023-12-19T18:03:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000020f 2023-12-19T18:03:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:26 2023-12-19T18:03:49.990 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:147 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d94c00 2023-12-19T18:03:49.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 35 ==== osd_op_reply(147 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv68 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=26 frag=1*, r=0 2023-12-19T18:03:49.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.984+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:148 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d94c00 2023-12-19T18:03:49.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 36 ==== osd_op_reply(148 10000000000.01800000 [omap-set-vals] v131'69 uv69 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:49.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/26 pointing to 0x0x1000000020f 2023-12-19T18:03:49.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000210 2023-12-19T18:03:49.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:27 2023-12-19T18:03:49.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:149 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d95000 2023-12-19T18:03:49.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 39 ==== osd_op_reply(149 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv69 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=27 frag=0*, r=0 2023-12-19T18:03:49.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:49.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.988+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:150 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d95000 2023-12-19T18:03:49.998 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 40 ==== osd_op_reply(150 10000000000.01000000 [omap-set-vals] v131'70 uv70 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:49.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/27 pointing to 0x0x10000000210 2023-12-19T18:03:49.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000211 2023-12-19T18:03:49.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:28 2023-12-19T18:03:49.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:151 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d95000 2023-12-19T18:03:50.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 41 ==== osd_op_reply(151 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv70 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=28 frag=0*, r=0 2023-12-19T18:03:50.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.992+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:152 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:50.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 42 ==== osd_op_reply(152 10000000000.01000000 [omap-set-vals] v131'71 uv71 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/28 pointing to 0x0x10000000211 2023-12-19T18:03:50.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000212 2023-12-19T18:03:50.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:29 2023-12-19T18:03:50.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:153 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d94c00 2023-12-19T18:03:50.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 37 ==== osd_op_reply(153 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv69 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=29 frag=1*, r=0 2023-12-19T18:03:50.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:49.996+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:154 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d94c00 2023-12-19T18:03:50.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 38 ==== osd_op_reply(154 10000000000.01800000 [omap-set-vals] v131'70 uv70 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/29 pointing to 0x0x10000000212 2023-12-19T18:03:50.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000213 2023-12-19T18:03:50.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:30 2023-12-19T18:03:50.006 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:155 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d94c00 2023-12-19T18:03:50.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 39 ==== osd_op_reply(155 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv70 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=30 frag=1*, r=0 2023-12-19T18:03:50.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.000+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:156 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d94c00 2023-12-19T18:03:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 40 ==== osd_op_reply(156 10000000000.01800000 [omap-set-vals] v131'71 uv71 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/30 pointing to 0x0x10000000213 2023-12-19T18:03:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000214 2023-12-19T18:03:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:31 2023-12-19T18:03:50.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:157 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d95000 2023-12-19T18:03:50.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 43 ==== osd_op_reply(157 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv71 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=31 frag=0*, r=0 2023-12-19T18:03:50.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.011 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.004+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:158 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d95000 2023-12-19T18:03:50.013 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 44 ==== osd_op_reply(158 10000000000.01000000 [omap-set-vals] v131'72 uv72 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/31 pointing to 0x0x10000000214 2023-12-19T18:03:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000215 2023-12-19T18:03:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:32 2023-12-19T18:03:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:159 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:50.014 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 41 ==== osd_op_reply(159 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv71 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=32 frag=1*, r=0 2023-12-19T18:03:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.008+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:160 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94c00 2023-12-19T18:03:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 42 ==== osd_op_reply(160 10000000000.01800000 [omap-set-vals] v131'72 uv72 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/32 pointing to 0x0x10000000215 2023-12-19T18:03:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000216 2023-12-19T18:03:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:33 2023-12-19T18:03:50.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:161 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:50.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 43 ==== osd_op_reply(161 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv72 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=33 frag=1*, r=0 2023-12-19T18:03:50.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.019 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:162 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d94c00 2023-12-19T18:03:50.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 44 ==== osd_op_reply(162 10000000000.01800000 [omap-set-vals] v131'73 uv73 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/33 pointing to 0x0x10000000216 2023-12-19T18:03:50.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000217 2023-12-19T18:03:50.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:34 2023-12-19T18:03:50.020 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.012+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:163 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d95000 2023-12-19T18:03:50.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 45 ==== osd_op_reply(163 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv72 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=34 frag=0*, r=0 2023-12-19T18:03:50.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:164 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d95000 2023-12-19T18:03:50.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 46 ==== osd_op_reply(164 10000000000.01000000 [omap-set-vals] v131'73 uv73 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/34 pointing to 0x0x10000000217 2023-12-19T18:03:50.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000218 2023-12-19T18:03:50.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:35 2023-12-19T18:03:50.023 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:165 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d94c00 2023-12-19T18:03:50.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 45 ==== osd_op_reply(165 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv73 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=35 frag=1*, r=0 2023-12-19T18:03:50.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.024 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.016+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:166 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94c00 2023-12-19T18:03:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 46 ==== osd_op_reply(166 10000000000.01800000 [omap-set-vals] v131'74 uv74 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/35 pointing to 0x0x10000000218 2023-12-19T18:03:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000219 2023-12-19T18:03:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:36 2023-12-19T18:03:50.026 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:167 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d95000 2023-12-19T18:03:50.028 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 47 ==== osd_op_reply(167 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv73 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=36 frag=0*, r=0 2023-12-19T18:03:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.020+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:168 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95000 2023-12-19T18:03:50.029 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 48 ==== osd_op_reply(168 10000000000.01000000 [omap-set-vals] v131'74 uv74 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/36 pointing to 0x0x10000000219 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000021a 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:37 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:169 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d94c00 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 47 ==== osd_op_reply(169 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv74 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=37 frag=1*, r=0 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.030 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:170 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.024+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 48 ==== osd_op_reply(170 10000000000.01800000 [omap-set-vals] v131'75 uv75 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/37 pointing to 0x0x1000000021a 2023-12-19T18:03:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000021b 2023-12-19T18:03:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:38 2023-12-19T18:03:50.032 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:171 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d95000 2023-12-19T18:03:50.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 49 ==== osd_op_reply(171 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv74 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=38 frag=0*, r=0 2023-12-19T18:03:50.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.033 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:172 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d95000 2023-12-19T18:03:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 50 ==== osd_op_reply(172 10000000000.01000000 [omap-set-vals] v131'75 uv75 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/38 pointing to 0x0x1000000021b 2023-12-19T18:03:50.035 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000021c 2023-12-19T18:03:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:39 2023-12-19T18:03:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:173 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d95000 2023-12-19T18:03:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 51 ==== osd_op_reply(173 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv75 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.036 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=39 frag=0*, r=0 2023-12-19T18:03:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.028+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:174 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d95000 2023-12-19T18:03:50.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 52 ==== osd_op_reply(174 10000000000.01000000 [omap-set-vals] v131'76 uv76 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/39 pointing to 0x0x1000000021c 2023-12-19T18:03:50.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000021d 2023-12-19T18:03:50.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:40 2023-12-19T18:03:50.039 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:175 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:50.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 49 ==== osd_op_reply(175 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv75 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=40 frag=1*, r=0 2023-12-19T18:03:50.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.032+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:176 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94c00 2023-12-19T18:03:50.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 50 ==== osd_op_reply(176 10000000000.01800000 [omap-set-vals] v131'76 uv76 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/40 pointing to 0x0x1000000021d 2023-12-19T18:03:50.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000021e 2023-12-19T18:03:50.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:41 2023-12-19T18:03:50.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:177 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d94c00 2023-12-19T18:03:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 51 ==== osd_op_reply(177 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv76 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=41 frag=1*, r=0 2023-12-19T18:03:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.036+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:178 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d94c00 2023-12-19T18:03:50.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 52 ==== osd_op_reply(178 10000000000.01800000 [omap-set-vals] v131'77 uv77 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/41 pointing to 0x0x1000000021e 2023-12-19T18:03:50.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000021f 2023-12-19T18:03:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:42 2023-12-19T18:03:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:179 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d95000 2023-12-19T18:03:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 53 ==== osd_op_reply(179 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv76 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=42 frag=0*, r=0 2023-12-19T18:03:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:180 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d95000 2023-12-19T18:03:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.040+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 54 ==== osd_op_reply(180 10000000000.01000000 [omap-set-vals] v131'77 uv77 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/42 pointing to 0x0x1000000021f 2023-12-19T18:03:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000220 2023-12-19T18:03:50.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:43 2023-12-19T18:03:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:181 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d95000 2023-12-19T18:03:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 55 ==== osd_op_reply(181 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv77 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=43 frag=0*, r=0 2023-12-19T18:03:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:182 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d95000 2023-12-19T18:03:50.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 56 ==== osd_op_reply(182 10000000000.01000000 [omap-set-vals] v131'78 uv78 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/43 pointing to 0x0x10000000220 2023-12-19T18:03:50.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000221 2023-12-19T18:03:50.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:44 2023-12-19T18:03:50.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:183 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d94c00 2023-12-19T18:03:50.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 53 ==== osd_op_reply(183 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv77 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=44 frag=1*, r=0 2023-12-19T18:03:50.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.044+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:184 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d94c00 2023-12-19T18:03:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 54 ==== osd_op_reply(184 10000000000.01800000 [omap-set-vals] v131'78 uv78 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/44 pointing to 0x0x10000000221 2023-12-19T18:03:50.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000222 2023-12-19T18:03:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:45 2023-12-19T18:03:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:185 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 55 ==== osd_op_reply(185 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv78 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=45 frag=1*, r=0 2023-12-19T18:03:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.048+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:186 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d94c00 2023-12-19T18:03:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 56 ==== osd_op_reply(186 10000000000.01800000 [omap-set-vals] v131'79 uv79 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/45 pointing to 0x0x10000000222 2023-12-19T18:03:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000223 2023-12-19T18:03:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:46 2023-12-19T18:03:50.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:187 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d95000 2023-12-19T18:03:50.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 57 ==== osd_op_reply(187 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv78 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=46 frag=0*, r=0 2023-12-19T18:03:50.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:188 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95000 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 58 ==== osd_op_reply(188 10000000000.01000000 [omap-set-vals] v131'79 uv79 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/46 pointing to 0x0x10000000223 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000224 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:47 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.052+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:189 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d94c00 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 57 ==== osd_op_reply(189 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv79 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=47 frag=1*, r=0 2023-12-19T18:03:50.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:190 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94c00 2023-12-19T18:03:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 58 ==== osd_op_reply(190 10000000000.01800000 [omap-set-vals] v131'80 uv80 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/47 pointing to 0x0x10000000224 2023-12-19T18:03:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000225 2023-12-19T18:03:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:48 2023-12-19T18:03:50.063 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:191 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d94c00 2023-12-19T18:03:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 59 ==== osd_op_reply(191 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv80 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=48 frag=1*, r=0 2023-12-19T18:03:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.064 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.056+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:192 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 60 ==== osd_op_reply(192 10000000000.01800000 [omap-set-vals] v131'81 uv81 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/48 pointing to 0x0x10000000225 2023-12-19T18:03:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000226 2023-12-19T18:03:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:49 2023-12-19T18:03:50.066 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:193 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:50.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 61 ==== osd_op_reply(193 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv81 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=49 frag=1*, r=0 2023-12-19T18:03:50.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.060+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:194 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d94c00 2023-12-19T18:03:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 62 ==== osd_op_reply(194 10000000000.01800000 [omap-set-vals] v131'82 uv82 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/49 pointing to 0x0x10000000226 2023-12-19T18:03:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000227 2023-12-19T18:03:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:50 2023-12-19T18:03:50.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:195 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:50.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 59 ==== osd_op_reply(195 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv79 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=50 frag=0*, r=0 2023-12-19T18:03:50.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:196 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d95000 2023-12-19T18:03:50.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 60 ==== osd_op_reply(196 10000000000.01000000 [omap-set-vals] v131'80 uv80 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/50 pointing to 0x0x10000000227 2023-12-19T18:03:50.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000228 2023-12-19T18:03:50.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:51 2023-12-19T18:03:50.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.064+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:197 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d94c00 2023-12-19T18:03:50.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 63 ==== osd_op_reply(197 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv82 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=51 frag=1*, r=0 2023-12-19T18:03:50.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:198 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d94c00 2023-12-19T18:03:50.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 64 ==== osd_op_reply(198 10000000000.01800000 [omap-set-vals] v131'83 uv83 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/51 pointing to 0x0x10000000228 2023-12-19T18:03:50.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000229 2023-12-19T18:03:50.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:52 2023-12-19T18:03:50.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:199 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d95000 2023-12-19T18:03:50.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 61 ==== osd_op_reply(199 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv80 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=52 frag=0*, r=0 2023-12-19T18:03:50.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.068+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:200 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90000 con 0x555726d95000 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 62 ==== osd_op_reply(200 10000000000.01000000 [omap-set-vals] v131'81 uv81 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/52 pointing to 0x0x10000000229 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000022a 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:53 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:201 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90400 con 0x555726d95000 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 63 ==== osd_op_reply(201 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv81 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=53 frag=0*, r=0 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.072+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:202 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90800 con 0x555726d95000 2023-12-19T18:03:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 64 ==== osd_op_reply(202 10000000000.01000000 [omap-set-vals] v131'82 uv82 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/53 pointing to 0x0x1000000022a 2023-12-19T18:03:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000022b 2023-12-19T18:03:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:54 2023-12-19T18:03:50.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:203 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90c00 con 0x555726d94c00 2023-12-19T18:03:50.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 65 ==== osd_op_reply(203 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv83 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=54 frag=1*, r=0 2023-12-19T18:03:50.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.076+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:204 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91000 con 0x555726d94c00 2023-12-19T18:03:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 66 ==== osd_op_reply(204 10000000000.01800000 [omap-set-vals] v131'84 uv84 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/54 pointing to 0x0x1000000022b 2023-12-19T18:03:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000022c 2023-12-19T18:03:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:55 2023-12-19T18:03:50.085 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:205 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91400 con 0x555726d95000 2023-12-19T18:03:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 65 ==== osd_op_reply(205 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv82 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=55 frag=0*, r=0 2023-12-19T18:03:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.086 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:206 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91800 con 0x555726d95000 2023-12-19T18:03:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 66 ==== osd_op_reply(206 10000000000.01000000 [omap-set-vals] v131'83 uv83 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.087 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/55 pointing to 0x0x1000000022c 2023-12-19T18:03:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000022d 2023-12-19T18:03:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:56 2023-12-19T18:03:50.088 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:207 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91c00 con 0x555726d94c00 2023-12-19T18:03:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 67 ==== osd_op_reply(207 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv84 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=56 frag=1*, r=0 2023-12-19T18:03:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.089 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.080+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:208 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90c00 con 0x555726d94c00 2023-12-19T18:03:50.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 68 ==== osd_op_reply(208 10000000000.01800000 [omap-set-vals] v131'85 uv85 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/56 pointing to 0x0x1000000022d 2023-12-19T18:03:50.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000022e 2023-12-19T18:03:50.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:57 2023-12-19T18:03:50.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:209 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91000 con 0x555726d94c00 2023-12-19T18:03:50.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 69 ==== osd_op_reply(209 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv85 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=57 frag=1*, r=0 2023-12-19T18:03:50.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.091 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.084+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:210 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91c00 con 0x555726d94c00 2023-12-19T18:03:50.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 70 ==== osd_op_reply(210 10000000000.01800000 [omap-set-vals] v131'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/57 pointing to 0x0x1000000022e 2023-12-19T18:03:50.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000022f 2023-12-19T18:03:50.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:58 2023-12-19T18:03:50.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:211 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90000 con 0x555726d94c00 2023-12-19T18:03:50.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 71 ==== osd_op_reply(211 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv86 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=58 frag=1*, r=0 2023-12-19T18:03:50.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:212 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90400 con 0x555726d94c00 2023-12-19T18:03:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 72 ==== osd_op_reply(212 10000000000.01800000 [omap-set-vals] v131'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/58 pointing to 0x0x1000000022f 2023-12-19T18:03:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000230 2023-12-19T18:03:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:59 2023-12-19T18:03:50.096 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.088+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:213 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90800 con 0x555726d95000 2023-12-19T18:03:50.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 67 ==== osd_op_reply(213 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv83 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=59 frag=0*, r=0 2023-12-19T18:03:50.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:214 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d95000 2023-12-19T18:03:50.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 68 ==== osd_op_reply(214 10000000000.01000000 [omap-set-vals] v131'84 uv84 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/59 pointing to 0x0x10000000230 2023-12-19T18:03:50.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000231 2023-12-19T18:03:50.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:60 2023-12-19T18:03:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:215 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 73 ==== osd_op_reply(215 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv87 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=60 frag=1*, r=0 2023-12-19T18:03:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.092+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:216 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d94c00 2023-12-19T18:03:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 74 ==== osd_op_reply(216 10000000000.01800000 [omap-set-vals] v131'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/60 pointing to 0x0x10000000231 2023-12-19T18:03:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000232 2023-12-19T18:03:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:61 2023-12-19T18:03:50.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:217 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d95000 2023-12-19T18:03:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 69 ==== osd_op_reply(217 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv84 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=61 frag=0*, r=0 2023-12-19T18:03:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.096+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:218 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 70 ==== osd_op_reply(218 10000000000.01000000 [omap-set-vals] v131'85 uv85 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/61 pointing to 0x0x10000000232 2023-12-19T18:03:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000233 2023-12-19T18:03:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:62 2023-12-19T18:03:50.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:219 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d94c00 2023-12-19T18:03:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 75 ==== osd_op_reply(219 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv88 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=62 frag=1*, r=0 2023-12-19T18:03:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:220 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 76 ==== osd_op_reply(220 10000000000.01800000 [omap-set-vals] v131'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/62 pointing to 0x0x10000000233 2023-12-19T18:03:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000234 2023-12-19T18:03:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:63 2023-12-19T18:03:50.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.100+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:221 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d95000 2023-12-19T18:03:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 71 ==== osd_op_reply(221 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv85 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=63 frag=0*, r=0 2023-12-19T18:03:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:222 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d95000 2023-12-19T18:03:50.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 72 ==== osd_op_reply(222 10000000000.01000000 [omap-set-vals] v131'86 uv86 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/63 pointing to 0x0x10000000234 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000235 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:64 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:223 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d95000 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 73 ==== osd_op_reply(223 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv86 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=64 frag=0*, r=0 2023-12-19T18:03:50.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.104+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:224 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d95000 2023-12-19T18:03:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 74 ==== osd_op_reply(224 10000000000.01000000 [omap-set-vals] v131'87 uv87 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/64 pointing to 0x0x10000000235 2023-12-19T18:03:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000236 2023-12-19T18:03:50.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:65 2023-12-19T18:03:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:225 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d95000 2023-12-19T18:03:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 75 ==== osd_op_reply(225 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv87 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=65 frag=0*, r=0 2023-12-19T18:03:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.108+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:226 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d95000 2023-12-19T18:03:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 76 ==== osd_op_reply(226 10000000000.01000000 [omap-set-vals] v131'88 uv88 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/65 pointing to 0x0x10000000236 2023-12-19T18:03:50.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000237 2023-12-19T18:03:50.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:66 2023-12-19T18:03:50.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:227 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 77 ==== osd_op_reply(227 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv88 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=66 frag=0*, r=0 2023-12-19T18:03:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:228 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d95000 2023-12-19T18:03:50.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 78 ==== osd_op_reply(228 10000000000.01000000 [omap-set-vals] v131'89 uv89 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/66 pointing to 0x0x10000000237 2023-12-19T18:03:50.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000238 2023-12-19T18:03:50.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:67 2023-12-19T18:03:50.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:229 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d94c00 2023-12-19T18:03:50.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 77 ==== osd_op_reply(229 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv89 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=67 frag=1*, r=0 2023-12-19T18:03:50.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.112+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:230 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d94c00 2023-12-19T18:03:50.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 78 ==== osd_op_reply(230 10000000000.01800000 [omap-set-vals] v131'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/67 pointing to 0x0x10000000238 2023-12-19T18:03:50.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000239 2023-12-19T18:03:50.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:68 2023-12-19T18:03:50.123 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:231 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d94c00 2023-12-19T18:03:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 79 ==== osd_op_reply(231 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv90 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=68 frag=1*, r=0 2023-12-19T18:03:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.116+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:232 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d94c00 2023-12-19T18:03:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 80 ==== osd_op_reply(232 10000000000.01800000 [omap-set-vals] v131'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/68 pointing to 0x0x10000000239 2023-12-19T18:03:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000023a 2023-12-19T18:03:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:69 2023-12-19T18:03:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:233 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d95000 2023-12-19T18:03:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 79 ==== osd_op_reply(233 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv89 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=69 frag=0*, r=0 2023-12-19T18:03:50.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:234 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d95000 2023-12-19T18:03:50.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 80 ==== osd_op_reply(234 10000000000.01000000 [omap-set-vals] v131'90 uv90 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/69 pointing to 0x0x1000000023a 2023-12-19T18:03:50.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000023b 2023-12-19T18:03:50.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:70 2023-12-19T18:03:50.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.120+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:235 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:50.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 81 ==== osd_op_reply(235 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv90 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=70 frag=0*, r=0 2023-12-19T18:03:50.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:236 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d95000 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 82 ==== osd_op_reply(236 10000000000.01000000 [omap-set-vals] v131'91 uv91 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/70 pointing to 0x0x1000000023b 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000023c 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:71 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:237 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d94c00 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 81 ==== osd_op_reply(237 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv91 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=71 frag=1*, r=0 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.124+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:238 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d94c00 2023-12-19T18:03:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 82 ==== osd_op_reply(238 10000000000.01800000 [omap-set-vals] v131'92 uv92 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/71 pointing to 0x0x1000000023c 2023-12-19T18:03:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000023d 2023-12-19T18:03:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:72 2023-12-19T18:03:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:239 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d94c00 2023-12-19T18:03:50.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 83 ==== osd_op_reply(239 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv92 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=72 frag=1*, r=0 2023-12-19T18:03:50.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.128+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:240 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d94c00 2023-12-19T18:03:50.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 84 ==== osd_op_reply(240 10000000000.01800000 [omap-set-vals] v131'93 uv93 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/72 pointing to 0x0x1000000023d 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000023e 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:73 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:241 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d95000 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 83 ==== osd_op_reply(241 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv91 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=73 frag=0*, r=0 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.132+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:242 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91400 con 0x555726d95000 2023-12-19T18:03:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 84 ==== osd_op_reply(242 10000000000.01000000 [omap-set-vals] v131'92 uv92 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/73 pointing to 0x0x1000000023e 2023-12-19T18:03:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000023f 2023-12-19T18:03:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:74 2023-12-19T18:03:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:243 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91800 con 0x555726d95000 2023-12-19T18:03:50.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 85 ==== osd_op_reply(243 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv92 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=74 frag=0*, r=0 2023-12-19T18:03:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:244 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90800 con 0x555726d95000 2023-12-19T18:03:50.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 86 ==== osd_op_reply(244 10000000000.01000000 [omap-set-vals] v131'93 uv93 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/74 pointing to 0x0x1000000023f 2023-12-19T18:03:50.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000240 2023-12-19T18:03:50.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:75 2023-12-19T18:03:50.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.136+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:245 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d95000 2023-12-19T18:03:50.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 87 ==== osd_op_reply(245 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv93 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=75 frag=0*, r=0 2023-12-19T18:03:50.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:246 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d95000 2023-12-19T18:03:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 88 ==== osd_op_reply(246 10000000000.01000000 [omap-set-vals] v131'94 uv94 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/75 pointing to 0x0x10000000240 2023-12-19T18:03:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000241 2023-12-19T18:03:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:76 2023-12-19T18:03:50.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:247 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d94c00 2023-12-19T18:03:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 85 ==== osd_op_reply(247 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv93 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=76 frag=1*, r=0 2023-12-19T18:03:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.148 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.140+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:248 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d94c00 2023-12-19T18:03:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 86 ==== osd_op_reply(248 10000000000.01800000 [omap-set-vals] v131'94 uv94 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/76 pointing to 0x0x10000000241 2023-12-19T18:03:50.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000242 2023-12-19T18:03:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:77 2023-12-19T18:03:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:249 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d95000 2023-12-19T18:03:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 89 ==== osd_op_reply(249 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv94 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=77 frag=0*, r=0 2023-12-19T18:03:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.151 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.144+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:250 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d95000 2023-12-19T18:03:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 90 ==== osd_op_reply(250 10000000000.01000000 [omap-set-vals] v131'95 uv95 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/77 pointing to 0x0x10000000242 2023-12-19T18:03:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000243 2023-12-19T18:03:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:78 2023-12-19T18:03:50.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:251 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 87 ==== osd_op_reply(251 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv94 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=78 frag=1*, r=0 2023-12-19T18:03:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.148+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:252 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:50.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 88 ==== osd_op_reply(252 10000000000.01800000 [omap-set-vals] v131'95 uv95 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/78 pointing to 0x0x10000000243 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000244 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:79 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:253 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90c00 con 0x555726d94c00 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 89 ==== osd_op_reply(253 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv95 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=79 frag=1*, r=0 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.152+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:254 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91000 con 0x555726d94c00 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 90 ==== osd_op_reply(254 10000000000.01800000 [omap-set-vals] v131'96 uv96 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/79 pointing to 0x0x10000000244 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000245 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:80 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:255 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91c00 con 0x555726d95000 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 91 ==== osd_op_reply(255 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv95 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=80 frag=0*, r=0 2023-12-19T18:03:50.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.156+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:256 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90000 con 0x555726d95000 2023-12-19T18:03:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 92 ==== osd_op_reply(256 10000000000.01000000 [omap-set-vals] v131'96 uv96 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/80 pointing to 0x0x10000000245 2023-12-19T18:03:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000246 2023-12-19T18:03:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:81 2023-12-19T18:03:50.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:257 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90400 con 0x555726d94c00 2023-12-19T18:03:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 91 ==== osd_op_reply(257 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv96 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=81 frag=1*, r=0 2023-12-19T18:03:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.160+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:258 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91400 con 0x555726d94c00 2023-12-19T18:03:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 92 ==== osd_op_reply(258 10000000000.01800000 [omap-set-vals] v131'97 uv97 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/81 pointing to 0x0x10000000246 2023-12-19T18:03:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000247 2023-12-19T18:03:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:82 2023-12-19T18:03:50.169 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:259 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91800 con 0x555726d94c00 2023-12-19T18:03:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 93 ==== osd_op_reply(259 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv97 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=82 frag=1*, r=0 2023-12-19T18:03:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.164+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:260 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90800 con 0x555726d94c00 2023-12-19T18:03:50.172 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 94 ==== osd_op_reply(260 10000000000.01800000 [omap-set-vals] v131'98 uv98 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/82 pointing to 0x0x10000000247 2023-12-19T18:03:50.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000248 2023-12-19T18:03:50.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:83 2023-12-19T18:03:50.173 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:261 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91c00 con 0x555726d95000 2023-12-19T18:03:50.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 93 ==== osd_op_reply(261 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv96 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=83 frag=0*, r=0 2023-12-19T18:03:50.174 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.175 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:262 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8400 con 0x555726d95000 2023-12-19T18:03:50.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 94 ==== osd_op_reply(262 10000000000.01000000 [omap-set-vals] v131'97 uv97 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/83 pointing to 0x0x10000000248 2023-12-19T18:03:50.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000249 2023-12-19T18:03:50.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:84 2023-12-19T18:03:50.176 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.168+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:263 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8800 con 0x555726d95000 2023-12-19T18:03:50.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 95 ==== osd_op_reply(263 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv97 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=84 frag=0*, r=0 2023-12-19T18:03:50.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:264 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d95000 2023-12-19T18:03:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 96 ==== osd_op_reply(264 10000000000.01000000 [omap-set-vals] v131'98 uv98 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.179 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/84 pointing to 0x0x10000000249 2023-12-19T18:03:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000024a 2023-12-19T18:03:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:85 2023-12-19T18:03:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:265 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d95000 2023-12-19T18:03:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 97 ==== osd_op_reply(265 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv98 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=85 frag=0*, r=0 2023-12-19T18:03:50.180 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.181 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.172+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:266 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x555726d95000 2023-12-19T18:03:50.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 98 ==== osd_op_reply(266 10000000000.01000000 [omap-set-vals] v131'99 uv99 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/85 pointing to 0x0x1000000024a 2023-12-19T18:03:50.182 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000024b 2023-12-19T18:03:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:86 2023-12-19T18:03:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:267 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x555726d95000 2023-12-19T18:03:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 99 ==== osd_op_reply(267 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv99 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=86 frag=0*, r=0 2023-12-19T18:03:50.183 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.184 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.176+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:268 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x555726d95000 2023-12-19T18:03:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 100 ==== osd_op_reply(268 10000000000.01000000 [omap-set-vals] v131'100 uv100 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/86 pointing to 0x0x1000000024b 2023-12-19T18:03:50.185 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000024c 2023-12-19T18:03:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:87 2023-12-19T18:03:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:269 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3800 con 0x555726d95000 2023-12-19T18:03:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 101 ==== osd_op_reply(269 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv100 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=87 frag=0*, r=0 2023-12-19T18:03:50.186 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.187 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.180+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:270 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d95000 2023-12-19T18:03:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 102 ==== osd_op_reply(270 10000000000.01000000 [omap-set-vals] v131'101 uv101 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/87 pointing to 0x0x1000000024c 2023-12-19T18:03:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000024d 2023-12-19T18:03:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:88 2023-12-19T18:03:50.189 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:271 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d95000 2023-12-19T18:03:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 103 ==== osd_op_reply(271 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv101 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=88 frag=0*, r=0 2023-12-19T18:03:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.190 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:272 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90c00 con 0x555726d95000 2023-12-19T18:03:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 104 ==== osd_op_reply(272 10000000000.01000000 [omap-set-vals] v131'102 uv102 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/88 pointing to 0x0x1000000024d 2023-12-19T18:03:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000024e 2023-12-19T18:03:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:89 2023-12-19T18:03:50.192 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.184+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:273 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91000 con 0x555726d94c00 2023-12-19T18:03:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 95 ==== osd_op_reply(273 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv98 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=89 frag=1*, r=0 2023-12-19T18:03:50.193 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.194 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:274 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90400 con 0x555726d94c00 2023-12-19T18:03:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 96 ==== osd_op_reply(274 10000000000.01800000 [omap-set-vals] v131'99 uv99 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/89 pointing to 0x0x1000000024e 2023-12-19T18:03:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x1000000024f 2023-12-19T18:03:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:90 2023-12-19T18:03:50.196 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.188+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:275 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91400 con 0x555726d95000 2023-12-19T18:03:50.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 105 ==== osd_op_reply(275 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv102 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=90 frag=0*, r=0 2023-12-19T18:03:50.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.197 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:276 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91800 con 0x555726d95000 2023-12-19T18:03:50.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 106 ==== osd_op_reply(276 10000000000.01000000 [omap-set-vals] v131'103 uv103 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/90 pointing to 0x0x1000000024f 2023-12-19T18:03:50.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000250 2023-12-19T18:03:50.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:91 2023-12-19T18:03:50.199 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:277 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90800 con 0x555726d94c00 2023-12-19T18:03:50.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 97 ==== osd_op_reply(277 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv99 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=91 frag=1*, r=0 2023-12-19T18:03:50.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.192+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:278 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95400 con 0x555726d94c00 2023-12-19T18:03:50.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 98 ==== osd_op_reply(278 10000000000.01800000 [omap-set-vals] v131'100 uv100 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/91 pointing to 0x0x10000000250 2023-12-19T18:03:50.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000251 2023-12-19T18:03:50.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:92 2023-12-19T18:03:50.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:279 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9400 con 0x555726d95000 2023-12-19T18:03:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 107 ==== osd_op_reply(279 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv103 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=92 frag=0*, r=0 2023-12-19T18:03:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.196+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:280 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9800 con 0x555726d95000 2023-12-19T18:03:50.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 108 ==== osd_op_reply(280 10000000000.01000000 [omap-set-vals] v131'104 uv104 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/92 pointing to 0x0x10000000251 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000252 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:93 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:281 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db8c00 con 0x555726d94c00 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 99 ==== osd_op_reply(281 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv100 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=93 frag=1*, r=0 2023-12-19T18:03:50.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.200+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:282 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9000 con 0x555726d94c00 2023-12-19T18:03:50.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 100 ==== osd_op_reply(282 10000000000.01800000 [omap-set-vals] v131'101 uv101 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/93 pointing to 0x0x10000000252 2023-12-19T18:03:50.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000253 2023-12-19T18:03:50.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:94 2023-12-19T18:03:50.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:283 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726db9c00 con 0x555726d94c00 2023-12-19T18:03:50.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 101 ==== osd_op_reply(283 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv101 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=94 frag=1*, r=0 2023-12-19T18:03:50.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.204+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:284 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3c00 con 0x555726d94c00 2023-12-19T18:03:50.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 102 ==== osd_op_reply(284 10000000000.01800000 [omap-set-vals] v131'102 uv102 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/94 pointing to 0x0x10000000253 2023-12-19T18:03:50.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000254 2023-12-19T18:03:50.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:95 2023-12-19T18:03:50.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:285 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2000 con 0x555726d95000 2023-12-19T18:03:50.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 109 ==== osd_op_reply(285 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv104 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=95 frag=0*, r=0 2023-12-19T18:03:50.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.208+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:286 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90000 con 0x555726d95000 2023-12-19T18:03:50.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 110 ==== osd_op_reply(286 10000000000.01000000 [omap-set-vals] v131'105 uv105 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/95 pointing to 0x0x10000000254 2023-12-19T18:03:50.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000255 2023-12-19T18:03:50.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:96 2023-12-19T18:03:50.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:287 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91c00 con 0x555726d95000 2023-12-19T18:03:50.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 111 ==== osd_op_reply(287 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv105 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=96 frag=0*, r=0 2023-12-19T18:03:50.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.212+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:288 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e90c00 con 0x555726d95000 2023-12-19T18:03:50.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 112 ==== osd_op_reply(288 10000000000.01000000 [omap-set-vals] v131'106 uv106 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/96 pointing to 0x0x10000000255 2023-12-19T18:03:50.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000256 2023-12-19T18:03:50.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:97 2023-12-19T18:03:50.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:289 17.5 17:a40620de:::10000000000.01000000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91400 con 0x555726d95000 2023-12-19T18:03:50.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 113 ==== osd_op_reply(289 10000000000.01000000 [omap-get-vals-by-keys out=503b] v0'0 uv106 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01000000 dname=97 frag=0*, r=0 2023-12-19T18:03:50.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.216+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:290 17.5 17:a40620de:::10000000000.01000000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726e91800 con 0x555726d95000 2023-12-19T18:03:50.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d03a9700 1 -- 172.21.15.45:0/4284509599 <== osd.6 v2:172.21.15.73:6816/36537 114 ==== osd_op_reply(290 10000000000.01000000 [omap-set-vals] v131'107 uv107 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cfc0 con 0x555726d95000 2023-12-19T18:03:50.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/97 pointing to 0x0x10000000256 2023-12-19T18:03:50.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000257 2023-12-19T18:03:50.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:98 2023-12-19T18:03:50.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:291 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x5557277bd800 con 0x555726d94c00 2023-12-19T18:03:50.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 103 ==== osd_op_reply(291 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv102 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=98 frag=1*, r=0 2023-12-19T18:03:50.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.227 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.220+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:292 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726d95800 con 0x555726d94c00 2023-12-19T18:03:50.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 104 ==== osd_op_reply(292 10000000000.01800000 [omap-set-vals] v131'103 uv103 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/98 pointing to 0x0x10000000257 2023-12-19T18:03:50.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 10 datascan.scan_links: handling injected_ino 0x10000000258 2023-12-19T18:03:50.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:99 2023-12-19T18:03:50.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:293 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-get-vals-by-keys in=15b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3000 con 0x555726d94c00 2023-12-19T18:03:50.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 105 ==== osd_op_reply(293 10000000000.01800000 [omap-get-vals-by-keys out=503b] v0'0 uv103 ondisk = 0) v8 ==== 164+0+503 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 20 datascan.read_dentry: oid=10000000000.01800000 dname=99 frag=1*, r=0 2023-12-19T18:03:50.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 20 datascan.scan_links: first is now 2 2023-12-19T18:03:50.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.224+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- osd_op(unknown.0.0:294 17.1b 17:dcc776e0:::10000000000.01800000:head [omap-set-vals in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2400 con 0x555726d94c00 2023-12-19T18:03:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.4 v2:172.21.15.73:6805/36536 106 ==== osd_op_reply(294 10000000000.01800000 [omap-set-vals] v131'104 uv104 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55572771cd80 con 0x555726d94c00 2023-12-19T18:03:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d1bed840 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/99 pointing to 0x0x10000000258 2023-12-19T18:03:50.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d1bed840 10 datascan.scan_links: updating inotable 2023-12-19T18:03:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:295 17.13 17:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2800 con 0x5557277bd400 2023-12-19T18:03:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 27 ==== osd_op_reply(295 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d1bed840 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x10000000259~0xfffffffda7] 2023-12-19T18:03:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d1bed840 10 mds.0.inotable: skip_inos now [0x10000000259~0xfffffffda7] 2023-12-19T18:03:50.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.228+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- osd_op(unknown.0.0:296 17.13 17:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de2c00 con 0x5557277bd400 2023-12-19T18:03:50.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d0baa700 1 -- 172.21.15.45:0/4284509599 <== osd.3 v2:172.21.15.45:6816/36284 28 ==== osd_op_reply(296 mds0_inotable [writefull 0~34] v131'4 uv4 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55572771cd80 con 0x5557277bd400 2023-12-19T18:03:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 10 datascan.scan_links: updating snaptable 2023-12-19T18:03:50.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- osd_op(unknown.0.0:297 17.d 17:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x555726de3400 con 0x5557277bd000 2023-12-19T18:03:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 <== osd.7 v2:172.21.15.73:6800/36538 15 ==== osd_op_reply(297 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55572771cb40 con 0x5557277bd000 2023-12-19T18:03:50.240 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555726d94400 msgr2=0x555726d9e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x555726d94400 0x555726d9e580 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555726d94800 msgr2=0x555726d9eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x555726d94800 0x555726d9eb00 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555726db8000 msgr2=0x555726d9f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x555726db8000 0x555726d9f600 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5557277bd400 msgr2=0x555726d9e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x5557277bd400 0x555726d9e000 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555726d94c00 msgr2=0x555726d9f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x555726d94c00 0x555726d9f080 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x555726d95c00 msgr2=0x555726da0680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x555726d95c00 0x555726da0680 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x555726d95000 msgr2=0x555726da0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x555726d95000 0x555726da0100 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 reap_dead start 2023-12-19T18:03:50.242 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78cfba8700 1 -- 172.21.15.45:0/4284509599 reap_dead start 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5557277bd000 msgr2=0x5557269da100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5557277bd000 0x5557269da100 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555726d94000 msgr2=0x5557269db700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555726d94000 0x5557269db700 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x555726c36660 tx=0x555726c38cc0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 msgr2=0x5557269dac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 0x5557269dac00 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x555726c37350 tx=0x55572771ef00 comp rx=0 tx=0).stop 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 shutdown_connections 2023-12-19T18:03:50.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x555726d94000 0x5557269db700 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x555726d95000 0x555726da0100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x5557277bc800 0x5557269dac00 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 --2- 172.21.15.45:0/4284509599 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x5557277bd000 0x5557269da100 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 >> 172.21.15.45:0/4284509599 conn(0x555726932c00 msgr2=0x555726a01800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 shutdown_connections 2023-12-19T18:03:50.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.232+0000 7f78d1bed840 1 -- 172.21.15.45:0/4284509599 wait complete. 2023-12-19T18:03:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 msgr2=0x5557269d8580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 0x5557269d8580 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x555726a41350 tx=0x55572771ed20 comp rx=0 tx=0).stop 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 shutdown_connections 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x555726933000 0x5557269d9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555726933400 0x5557269d8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 --2- 172.21.15.45:0/76473379 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x555726933800 0x5557269d8580 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 >> 172.21.15.45:0/76473379 conn(0x555726933c00 msgr2=0x555726a01000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 shutdown_connections 2023-12-19T18:03:50.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.236+0000 7f78d1bed840 1 -- 172.21.15.45:0/76473379 wait complete. 2023-12-19T18:03:50.250 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.598460, result: 2023-12-19T18:03:50.250 DEBUG:teuthology.orchestra.run.smithi045:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata listomapkeys 10000000000.01000000 2023-12-19T18:03:50.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 Processor -- start 2023-12-19T18:03:50.374 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 -- start start 2023-12-19T18:03:50.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092df92b80 0x56092e06d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092dfc71d0 0x56092dfc4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.375 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 0x56092df94760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092dee3250 con 0x56092e06ee60 2023-12-19T18:03:50.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092dee2ef0 con 0x56092df92b80 2023-12-19T18:03:50.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a78927140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56092deb9240 con 0x56092dfc71d0 2023-12-19T18:03:50.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 0x56092df94760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 0x56092df94760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46976/0 (socket says 172.21.15.45:46976) 2023-12-19T18:03:50.376 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 -- 172.21.15.45:0/2559586521 learned_addr learned my addr 172.21.15.45:0/2559586521 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a7645c700 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092df92b80 0x56092e06d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a6ffff700 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092dfc71d0 0x56092dfc4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 -- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092dfc71d0 msgr2=0x56092dfc4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092dfc71d0 0x56092dfc4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.377 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 -- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092df92b80 msgr2=0x56092e06d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092df92b80 0x56092e06d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a76c5d700 1 -- 172.21.15.45:0/2559586521 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68005de0 con 0x56092e06ee60 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.368+0000 7f5a7645c700 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092df92b80 0x56092e06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 0x56092df94760 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b750 tx=0x7f5a7000ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85baa133a872481a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a7545a700 1 -- 172.21.15.45:0/2559586521 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70011600 con 0x56092e06ee60 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a7545a700 1 -- 172.21.15.45:0/2559586521 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a70011760 con 0x56092e06ee60 2023-12-19T18:03:50.378 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a7545a700 1 -- 172.21.15.45:0/2559586521 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a70011b10 con 0x56092e06ee60 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 -- 172.21.15.45:0/2559586521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 msgr2=0x56092df94760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 0x56092df94760 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000b750 tx=0x7f5a7000ba60 comp rx=0 tx=0).stop 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 -- 172.21.15.45:0/2559586521 shutdown_connections 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092e06ee60 0x56092df94760 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092dfc71d0 0x56092dfc4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 --2- 172.21.15.45:0/2559586521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092df92b80 0x56092e06d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 -- 172.21.15.45:0/2559586521 >> 172.21.15.45:0/2559586521 conn(0x56092df98b90 msgr2=0x56092e06f990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:50.379 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 -- 172.21.15.45:0/2559586521 shutdown_connections 2023-12-19T18:03:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 -- 172.21.15.45:0/2559586521 wait complete. 2023-12-19T18:03:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 Processor -- start 2023-12-19T18:03:50.380 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 -- start start 2023-12-19T18:03:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092df92b80 0x56092e06f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.372+0000 7f5a78927140 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092dfc71d0 0x56092e05b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.383 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a78927140 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092e06ee60 0x56092e0fab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a78927140 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092e05c140 con 0x56092dfc71d0 2023-12-19T18:03:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a78927140 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092e05c3e0 con 0x56092e06ee60 2023-12-19T18:03:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a78927140 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x56092e05c680 con 0x56092df92b80 2023-12-19T18:03:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092dfc71d0 0x56092e05b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092dfc71d0 0x56092e05b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46980/0 (socket says 172.21.15.45:46980) 2023-12-19T18:03:50.384 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 -- 172.21.15.45:0/2808467683 learned_addr learned my addr 172.21.15.45:0/2808467683 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092e06ee60 0x56092e0fab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a7645c700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092df92b80 0x56092e06f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 -- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092df92b80 msgr2=0x56092e06f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x56092df92b80 0x56092e06f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 -- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092e06ee60 msgr2=0x56092e0fab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.385 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092e06ee60 0x56092e0fab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 -- 172.21.15.45:0/2808467683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7000b3a0 con 0x56092dfc71d0 2023-12-19T18:03:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56092e06ee60 0x56092e0fab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6ffff700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092dfc71d0 0x56092e05b6e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000edd0 tx=0x7f5a6000c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6f7fe700 1 -- 172.21.15.45:0/2808467683 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000cd50 con 0x56092dfc71d0 2023-12-19T18:03:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6f7fe700 1 -- 172.21.15.45:0/2808467683 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a60008030 con 0x56092dfc71d0 2023-12-19T18:03:50.386 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a6f7fe700 1 -- 172.21.15.45:0/2808467683 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a60011650 con 0x56092dfc71d0 2023-12-19T18:03:50.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56092ded1470 con 0x56092dfc71d0 2023-12-19T18:03:50.387 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.376+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56092dec48b0 con 0x56092dfc71d0 2023-12-19T18:03:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.380+0000 7f5a6f7fe700 1 -- 172.21.15.45:0/2808467683 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5a600117b0 con 0x56092dfc71d0 2023-12-19T18:03:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.380+0000 7f5a6f7fe700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a58064400 0x7f5a580668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.388 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.380+0000 7f5a6f7fe700 1 -- 172.21.15.45:0/2808467683 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f5a600822c0 con 0x56092dfc71d0 2023-12-19T18:03:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a7645c700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a58064400 0x7f5a580668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a78927140 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56092e06fe80 0x56092dfdcd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- osd_op(unknown.0.0:1 17.5 17:a40620de:::10000000000.01000000:head [omap-get-keys in=12b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e131) v8 -- 0x56092dfdd2b0 con 0x56092e06fe80 2023-12-19T18:03:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a7645c700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a58064400 0x7f5a580668c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5a68015040 tx=0x7f5a6800f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.390 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56092e06fe80 0x56092dfdcd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.391 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a76c5d700 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56092e06fe80 0x56092dfdcd70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.392 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.384+0000 7f5a76c5d700 1 -- 172.21.15.45:0/2808467683 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== osd_op_reply(1 10000000000.01000000 [omap-get-keys out=560b] v0'0 uv107 ondisk = 0) v8 ==== 164+0+560 (crc 0 0 0) 0x7f5a70017070 con 0x56092e06fe80 2023-12-19T18:03:50.393 INFO:teuthology.orchestra.run.smithi045.stdout:10_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:11_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:12_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:15_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:19_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:1_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:20_head 2023-12-19T18:03:50.394 INFO:teuthology.orchestra.run.smithi045.stdout:21_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:27_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:28_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:2_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:31_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:34_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:36_head 2023-12-19T18:03:50.395 INFO:teuthology.orchestra.run.smithi045.stdout:38_head 2023-12-19T18:03:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:39_head 2023-12-19T18:03:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:3_head 2023-12-19T18:03:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:42_head 2023-12-19T18:03:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:43_head 2023-12-19T18:03:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:46_head 2023-12-19T18:03:50.396 INFO:teuthology.orchestra.run.smithi045.stdout:4_head 2023-12-19T18:03:50.397 INFO:teuthology.orchestra.run.smithi045.stdout:50_head 2023-12-19T18:03:50.397 INFO:teuthology.orchestra.run.smithi045.stdout:52_head 2023-12-19T18:03:50.397 INFO:teuthology.orchestra.run.smithi045.stdout:53_head 2023-12-19T18:03:50.397 INFO:teuthology.orchestra.run.smithi045.stdout:55_head 2023-12-19T18:03:50.397 INFO:teuthology.orchestra.run.smithi045.stdout:59_head 2023-12-19T18:03:50.397 INFO:teuthology.orchestra.run.smithi045.stdout:61_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:63_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:64_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:65_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:66_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:69_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:70_head 2023-12-19T18:03:50.398 INFO:teuthology.orchestra.run.smithi045.stdout:73_head 2023-12-19T18:03:50.399 INFO:teuthology.orchestra.run.smithi045.stdout:74_head 2023-12-19T18:03:50.399 INFO:teuthology.orchestra.run.smithi045.stdout:75_head 2023-12-19T18:03:50.399 INFO:teuthology.orchestra.run.smithi045.stdout:77_head 2023-12-19T18:03:50.399 INFO:teuthology.orchestra.run.smithi045.stdout:80_head 2023-12-19T18:03:50.399 INFO:teuthology.orchestra.run.smithi045.stdout:83_head 2023-12-19T18:03:50.399 INFO:teuthology.orchestra.run.smithi045.stdout:84_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:85_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:86_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:87_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:88_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:8_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:90_head 2023-12-19T18:03:50.400 INFO:teuthology.orchestra.run.smithi045.stdout:92_head 2023-12-19T18:03:50.401 INFO:teuthology.orchestra.run.smithi045.stdout:95_head 2023-12-19T18:03:50.401 INFO:teuthology.orchestra.run.smithi045.stdout:96_head 2023-12-19T18:03:50.401 INFO:teuthology.orchestra.run.smithi045.stdout:97_head 2023-12-19T18:03:50.401 INFO:teuthology.orchestra.run.smithi045.stdout:9_head 2023-12-19T18:03:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56092e06fe80 msgr2=0x56092dfdcd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x56092e06fe80 0x56092dfdcd70 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a58064400 msgr2=0x7f5a580668c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5a58064400 0x7f5a580668c0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f5a68015040 tx=0x7f5a6800f000 comp rx=0 tx=0).stop 2023-12-19T18:03:50.404 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092dfc71d0 msgr2=0x56092e05b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 --2- 172.21.15.45:0/2808467683 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x56092dfc71d0 0x56092e05b6e0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000edd0 tx=0x7f5a6000c530 comp rx=0 tx=0).stop 2023-12-19T18:03:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a76c5d700 1 -- 172.21.15.45:0/2808467683 reap_dead start 2023-12-19T18:03:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 shutdown_connections 2023-12-19T18:03:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 >> 172.21.15.45:0/2808467683 conn(0x56092df98b90 msgr2=0x56092e06d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 shutdown_connections 2023-12-19T18:03:50.405 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.388+0000 7f5a78927140 1 -- 172.21.15.45:0/2808467683 wait complete. 2023-12-19T18:03:50.406 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2023-12-19T18:03:50.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 Processor -- start 2023-12-19T18:03:50.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 -- start start 2023-12-19T18:03:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a2015d110 0x7f8a200c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8a200b0cf0 0x7f8a200ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a200ca030 con 0x7f8a20070660 2023-12-19T18:03:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200cabb0 con 0x7f8a2015d110 2023-12-19T18:03:50.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a256ae700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a200ca310 con 0x7f8a200b0cf0 2023-12-19T18:03:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.580+0000 7f8a1effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a2015d110 0x7f8a200c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8a2015d110 0x7f8a200c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46990/0 (socket says 172.21.15.45:46990) 2023-12-19T18:03:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1f7fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8a200b0cf0 0x7f8a200ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 -- 172.21.15.45:0/2554070148 learned_addr learned my addr 172.21.15.45:0/2554070148 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 -- 172.21.15.45:0/2554070148 >> v2:172.21.15.73:3300/0 conn(0x7f8a200b0cf0 msgr2=0x7f8a200ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:50.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 --2- 172.21.15.45:0/2554070148 >> v2:172.21.15.73:3300/0 conn(0x7f8a200b0cf0 0x7f8a200ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 -- 172.21.15.45:0/2554070148 >> v1:172.21.15.73:6789/0 conn(0x7f8a20070660 legacy=0x7f8a200b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 -- 172.21.15.45:0/2554070148 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a200ca5f0 con 0x7f8a2015d110 2023-12-19T18:03:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1effd700 1 --2- 172.21.15.45:0/2554070148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a2015d110 0x7f8a200c9750 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f8a20070af0 tx=0x7f8a10009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5ff81699b3e89f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1dffb700 1 -- 172.21.15.45:0/2554070148 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10011830 con 0x7f8a2015d110 2023-12-19T18:03:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1dffb700 1 -- 172.21.15.45:0/2554070148 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a10011990 con 0x7f8a2015d110 2023-12-19T18:03:50.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a1dffb700 1 -- 172.21.15.45:0/2554070148 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10011d20 con 0x7f8a2015d110 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 -- 172.21.15.45:0/2554070148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a2015d110 msgr2=0x7f8a200c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 --2- 172.21.15.45:0/2554070148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a2015d110 0x7f8a200c9750 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f8a20070af0 tx=0x7f8a10009bf0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 -- 172.21.15.45:0/2554070148 shutdown_connections 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 --2- 172.21.15.45:0/2554070148 >> v2:172.21.15.73:3300/0 conn(0x7f8a200b0cf0 0x7f8a200ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 --2- 172.21.15.45:0/2554070148 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a2015d110 0x7f8a200c9750 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 -- 172.21.15.45:0/2554070148 >> 172.21.15.45:0/2554070148 conn(0x7f8a200ceb20 msgr2=0x7f8a200cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 -- 172.21.15.45:0/2554070148 shutdown_connections 2023-12-19T18:03:50.592 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.584+0000 7f8a256ae700 1 -- 172.21.15.45:0/2554070148 wait complete. 2023-12-19T18:03:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.588+0000 7f8a256ae700 1 Processor -- start 2023-12-19T18:03:50.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.588+0000 7f8a256ae700 1 -- start start 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a20070660 0x7f8a201f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 0x7f8a200b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a2015d110 0x7f8a200c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200b45c0 con 0x7f8a200b0cf0 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a200b42e0 con 0x7f8a20070660 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a201564a0 con 0x7f8a2015d110 2023-12-19T18:03:50.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 0x7f8a200b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 0x7f8a200b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:46996/0 (socket says 172.21.15.45:46996) 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 -- 172.21.15.45:0/3863363778 learned_addr learned my addr 172.21.15.45:0/3863363778 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1f7fe700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a2015d110 0x7f8a200c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1effd700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a20070660 0x7f8a201f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 -- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a2015d110 msgr2=0x7f8a200c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a2015d110 0x7f8a200c30d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 -- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a20070660 msgr2=0x7f8a201f2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a20070660 0x7f8a201f2340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:50.600 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 -- 172.21.15.45:0/3863363778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009570 con 0x7f8a200b0cf0 2023-12-19T18:03:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a1e7fc700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 0x7f8a200b3840 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c500 tx=0x7f8a1400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140052d0 con 0x7f8a200b0cf0 2023-12-19T18:03:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a14005430 con 0x7f8a200b0cf0 2023-12-19T18:03:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a20156780 con 0x7f8a200b0cf0 2023-12-19T18:03:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.592+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a140055a0 con 0x7f8a200b0cf0 2023-12-19T18:03:50.601 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.596+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a20155cd0 con 0x7f8a200b0cf0 2023-12-19T18:03:50.602 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.596+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a20156300 con 0x7f8a200b0cf0 2023-12-19T18:03:50.603 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.596+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8a140038e0 con 0x7f8a200b0cf0 2023-12-19T18:03:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.596+0000 7f8a077fe700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8a0c065ad0 0x7f8a0c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:50.604 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.600+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f8a140826c0 con 0x7f8a200b0cf0 2023-12-19T18:03:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.600+0000 7f8a1effd700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8a0c065ad0 0x7f8a0c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:50.605 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.600+0000 7f8a1effd700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8a0c065ad0 0x7f8a0c067f90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000c00 tx=0x7f8a10008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:50.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.604+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8a20156300 con 0x7f8a200b0cf0 2023-12-19T18:03:50.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:50.820+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f8a20156300 con 0x7f8a200b0cf0 2023-12-19T18:03:51.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.684+0000 7f8a077fe700 1 -- 172.21.15.45:0/3863363778 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v108) v1 ==== 162+0+0 (secure 0 0 0) 0x7f8a20156300 con 0x7f8a200b0cf0 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.688+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8a0c065ad0 msgr2=0x7f8a0c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.688+0000 7f8a256ae700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8a0c065ad0 0x7f8a0c067f90 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8a10000c00 tx=0x7f8a10008030 comp rx=0 tx=0).stop 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.688+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 msgr2=0x7f8a200b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 0x7f8a200b3840 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f8a1400c500 tx=0x7f8a1400c810 comp rx=0 tx=0).stop 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 shutdown_connections 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8a0c065ad0 0x7f8a0c067f90 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8a2015d110 0x7f8a200c30d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8a200b0cf0 0x7f8a200b3840 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 --2- 172.21.15.45:0/3863363778 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a20070660 0x7f8a201f2340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 >> 172.21.15.45:0/3863363778 conn(0x7f8a200ceb20 msgr2=0x7f8a20070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:51.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 shutdown_connections 2023-12-19T18:03:51.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.692+0000 7f8a256ae700 1 -- 172.21.15.45:0/3863363778 wait complete. 2023-12-19T18:03:51.699 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked joinable; MDS may join as newly active. 2023-12-19T18:03:51.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:51.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 Processor -- start 2023-12-19T18:03:51.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 -- start start 2023-12-19T18:03:51.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f454c0b88e0 0x7f454c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f454c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f454c0ce3a0 con 0x7f454c15cf80 2023-12-19T18:03:51.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f454c15d360 con 0x7f454c0b88e0 2023-12-19T18:03:51.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4552c20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0d2950 con 0x7f454c0cdf80 2023-12-19T18:03:51.903 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4551c1e700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f454c15cf80 0x7f454c0d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55440/0 (socket says 172.21.15.45:55440) 2023-12-19T18:03:51.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4551c1e700 1 -- 172.21.15.45:0/3576934654 learned_addr learned my addr 172.21.15.45:0/3576934654 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:51.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f455241f700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f454c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f455141d700 1 --2- 172.21.15.45:0/3576934654 >> v2:172.21.15.73:3300/0 conn(0x7f454c0b88e0 0x7f454c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2221468067 0 0) 0x7f454c0ce3a0 con 0x7f454c15cf80 2023-12-19T18:03:51.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.896+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45380035d0 con 0x7f454c15cf80 2023-12-19T18:03:51.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224543139 0 0) 0x7f45380035d0 con 0x7f454c15cf80 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 msgr2=0x7f454c0b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f454c0b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 >> v2:172.21.15.73:3300/0 conn(0x7f454c0b88e0 msgr2=0x7f454c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 --2- 172.21.15.45:0/3576934654 >> v2:172.21.15.73:3300/0 conn(0x7f454c0b88e0 0x7f454c0cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c0d18b0 con 0x7f454c15cf80 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f4548001670 con 0x7f454c15cf80 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455241f700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f454c0b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 >> v1:172.21.15.45:6789/0 conn(0x7f454c15cf80 legacy=0x7f454c0d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4538003b00 0x7f4538003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f4538004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f4538005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c15d360 con 0x7f4538004870 2023-12-19T18:03:51.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0d2950 con 0x7f4538003b00 2023-12-19T18:03:51.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453800ba80 con 0x7f454c0cdf80 2023-12-19T18:03:51.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f4538004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4551c1e700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4538003b00 0x7f4538003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455241f700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f4538005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 -- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 msgr2=0x7f4538005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0cdf80 0x7f4538005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 -- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4538003b00 msgr2=0x7f4538003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4538003b00 0x7f4538003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 -- 172.21.15.45:0/3576934654 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4544009a70 con 0x7f4538004870 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f455141d700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f4538004cf0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ba0 tx=0x7f45380058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d7c5838e73eab server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c00e6c0 con 0x7f4538004870 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f453c00e820 con 0x7f4538004870 2023-12-19T18:03:51.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.900+0000 7f4550c1c700 1 -- 172.21.15.45:0/3576934654 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c00eb90 con 0x7f4538004870 2023-12-19T18:03:51.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 -- 172.21.15.45:0/3576934654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 msgr2=0x7f4538004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:51.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 --2- 172.21.15.45:0/3576934654 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f4538004cf0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ba0 tx=0x7f45380058a0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f455241f700 1 -- 172.21.15.45:0/3576934654 reap_dead start 2023-12-19T18:03:51.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 -- 172.21.15.45:0/3576934654 shutdown_connections 2023-12-19T18:03:51.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 -- 172.21.15.45:0/3576934654 >> 172.21.15.45:0/3576934654 conn(0x7f454c066380 msgr2=0x7f454c0cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:51.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 -- 172.21.15.45:0/3576934654 shutdown_connections 2023-12-19T18:03:51.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 -- 172.21.15.45:0/3576934654 wait complete. 2023-12-19T18:03:51.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 Processor -- start 2023-12-19T18:03:51.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.904+0000 7f4552c20700 1 -- start start 2023-12-19T18:03:51.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f454c1f6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0c7f80 0x7f454c0c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f454c0b6db0 0x7f454c0b7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1529b0 con 0x7f4538004870 2023-12-19T18:03:51.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454c0b7770 con 0x7f454c0b6db0 2023-12-19T18:03:51.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f454c1f2410 con 0x7f454c0c7f80 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f454c1f6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f454c1f6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47024/0 (socket says 172.21.15.45:47024) 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 -- 172.21.15.45:0/3615993986 learned_addr learned my addr 172.21.15.45:0/3615993986 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f455141d700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0c7f80 0x7f454c0c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f455241f700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f454c0b6db0 0x7f454c0b7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 -- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0c7f80 msgr2=0x7f454c0c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0c7f80 0x7f454c0c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 -- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f454c0b6db0 msgr2=0x7f454c0b7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:51.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f454c0b6db0 0x7f454c0b7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:51.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 -- 172.21.15.45:0/3615993986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f454c1f26b0 con 0x7f4538004870 2023-12-19T18:03:51.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4551c1e700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f454c1f6150 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f4548001820 tx=0x7f4548007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:51.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548012560 con 0x7f4538004870 2023-12-19T18:03:51.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4548012700 con 0x7f4538004870 2023-12-19T18:03:51.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4548012ab0 con 0x7f4538004870 2023-12-19T18:03:51.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454c1f2990 con 0x7f4538004870 2023-12-19T18:03:51.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.908+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454c0c8a40 con 0x7f4538004870 2023-12-19T18:03:51.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.912+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f454c1f2eb0 con 0x7f4538004870 2023-12-19T18:03:51.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.912+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4548012c10 con 0x7f4538004870 2023-12-19T18:03:51.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.912+0000 7f45427fc700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4530065ad0 0x7f4530067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:51.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.912+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f4548083340 con 0x7f4538004870 2023-12-19T18:03:51.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.916+0000 7f455141d700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4530065ad0 0x7f4530067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:51.921 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.916+0000 7f455141d700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4530065ad0 0x7f4530067f90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f453c0090b0 tx=0x7f453c01f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:51.926 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:51.920+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f454c1f2eb0 con 0x7f4538004870 2023-12-19T18:03:52.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.136+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f454c1f2eb0 con 0x7f4538004870 2023-12-19T18:03:52.142 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.136+0000 7f45427fc700 1 -- 172.21.15.45:0/3615993986 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4717 (secure 0 0 0) 0x7f454c1f2eb0 con 0x7f4538004870 2023-12-19T18:03:52.142 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:52.142 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":109,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:51.690418+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:replay","state_seq":1,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4530065ad0 msgr2=0x7f4530067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4530065ad0 0x7f4530067f90 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f453c0090b0 tx=0x7f453c01f040 comp rx=0 tx=0).stop 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 msgr2=0x7f454c1f6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f454c1f6150 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7f4548001820 tx=0x7f4548007340 comp rx=0 tx=0).stop 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 shutdown_connections 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4530065ad0 0x7f4530067f90 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:52.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f454c0b6db0 0x7f454c0b7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:52.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f454c0c7f80 0x7f454c0c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:52.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 --2- 172.21.15.45:0/3615993986 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4538004870 0x7f454c1f6150 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:52.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 >> 172.21.15.45:0/3615993986 conn(0x7f454c066380 msgr2=0x7f454c06b600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:52.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 shutdown_connections 2023-12-19T18:03:52.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:52.140+0000 7f4552c20700 1 -- 172.21.15.45:0/3615993986 wait complete. 2023-12-19T18:03:52.147 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 109 2023-12-19T18:03:52.567 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:51.690418+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 131, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9117': {'gid': 9117, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.45:6837/3985719686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 3985719686}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 3985719686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:52.568 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9117:up:replay 2023-12-19T18:03:53.569 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 Processor -- start 2023-12-19T18:03:53.766 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 -- start start 2023-12-19T18:03:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2a80b1d00 0x7fd2a815f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:53.767 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2a80cb2e0 0x7fd2a80b20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a80b5fb0 con 0x7fd2a80b3420 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a80cba50 con 0x7fd2a80b1d00 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2ad7ac700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a806a920 con 0x7fd2a80cb2e0 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a6ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2a80b1d00 0x7fd2a815f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd29e7fc700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd2a80cb2e0 0x7fd2a80b20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a7fff700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fd2a80b3420 0x7fd2a806adb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:38148/0 (socket says 172.21.15.45:38148) 2023-12-19T18:03:53.768 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a7fff700 1 -- 172.21.15.45:0/2868314461 learned_addr learned my addr 172.21.15.45:0/2868314461 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:53.769 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a6ffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd2a80b1d00 0x7fd2a815f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47034/0 (socket says 172.21.15.45:47034) 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a67fc700 1 -- 172.21.15.45:0/2868314461 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500880817 0 0) 0x7fd2a80b5fb0 con 0x7fd2a80b3420 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2868314461 >> v2:172.21.15.73:3300/0 conn(0x7fd2a80cb2e0 msgr2=0x7fd2a80b20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a6ffd700 1 --2- 172.21.15.45:0/2868314461 >> v2:172.21.15.73:3300/0 conn(0x7fd2a80cb2e0 0x7fd2a80b20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2868314461 >> v1:172.21.15.73:6789/0 conn(0x7fd2a80b3420 legacy=0x7fd2a806adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.760+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2868314461 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a815f8c0 con 0x7fd2a80b1d00 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2a6ffd700 1 --2- 172.21.15.45:0/2868314461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a815f380 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80cc690 tx=0x7fd298009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ab0551272816be0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:53.770 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2a67fc700 1 -- 172.21.15.45:0/2868314461 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298011830 con 0x7fd2a80b1d00 2023-12-19T18:03:53.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2a67fc700 1 -- 172.21.15.45:0/2868314461 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd298011990 con 0x7fd2a80b1d00 2023-12-19T18:03:53.771 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2a67fc700 1 -- 172.21.15.45:0/2868314461 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298011d20 con 0x7fd2a80b1d00 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2868314461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 msgr2=0x7fd2a815f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2868314461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a815f380 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80cc690 tx=0x7fd298009b30 comp rx=0 tx=0).stop 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2868314461 shutdown_connections 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2868314461 >> v2:172.21.15.73:3300/0 conn(0x7fd2a80cb2e0 0x7fd2a80b20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2868314461 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a815f380 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2868314461 >> 172.21.15.45:0/2868314461 conn(0x7fd2a80ccd00 msgr2=0x7fd2a80cd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2868314461 shutdown_connections 2023-12-19T18:03:53.772 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.764+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2868314461 wait complete. 2023-12-19T18:03:53.774 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.768+0000 7fd2ad7ac700 1 Processor -- start 2023-12-19T18:03:53.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.768+0000 7fd2ad7ac700 1 -- start start 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2a80b3420 0x7fd2a81f03c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2a81f0900 0x7fd2a815d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a81f0ef0 con 0x7fd2a80b1d00 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a81f11d0 con 0x7fd2a80b3420 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a81f14b0 con 0x7fd2a81f0900 2023-12-19T18:03:53.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a8157720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47046/0 (socket says 172.21.15.45:47046) 2023-12-19T18:03:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2419136540 learned_addr learned my addr 172.21.15.45:0/2419136540 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a7fff700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2a81f0900 0x7fd2a815d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd29e7fc700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2a80b3420 0x7fd2a81f03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:53.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2a81f0900 msgr2=0x7fd2a815d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2a81f0900 0x7fd2a815d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2a80b3420 msgr2=0x7fd2a81f03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2a80b3420 0x7fd2a81f03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 -- 172.21.15.45:0/2419136540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2980094b0 con 0x7fd2a80b1d00 2023-12-19T18:03:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2a6ffd700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a8157720 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fd298009fd0 tx=0x7fd298004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:53.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd298004480 con 0x7fd2a80b1d00 2023-12-19T18:03:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29801f070 con 0x7fd2a80b1d00 2023-12-19T18:03:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a81f1790 con 0x7fd2a80b1d00 2023-12-19T18:03:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2980038c0 con 0x7fd2a80b1d00 2023-12-19T18:03:53.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.772+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a80b1930 con 0x7fd2a80b1d00 2023-12-19T18:03:53.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.776+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a81f1cb0 con 0x7fd2a80b1d00 2023-12-19T18:03:53.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.776+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd298021030 con 0x7fd2a80b1d00 2023-12-19T18:03:53.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.780+0000 7fd29ffff700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd288065b00 0x7fd288067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:53.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.780+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fd298084610 con 0x7fd2a80b1d00 2023-12-19T18:03:53.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.780+0000 7fd29e7fc700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd288065b00 0x7fd288067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:53.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.780+0000 7fd29e7fc700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd288065b00 0x7fd288067fc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80c4e60 tx=0x7fd290009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:53.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.784+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd2a81f1cb0 con 0x7fd2a80b1d00 2023-12-19T18:03:54.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.996+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd2a81f1cb0 con 0x7fd2a80b1d00 2023-12-19T18:03:54.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:53.996+0000 7fd29ffff700 1 -- 172.21.15.45:0/2419136540 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+4717 (secure 0 0 0) 0x7fd2a81f1cb0 con 0x7fd2a80b1d00 2023-12-19T18:03:54.004 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:54.004 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":111,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":111,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:53.705889+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:rejoin","state_seq":8,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd288065b00 msgr2=0x7fd288067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd288065b00 0x7fd288067fc0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fd2a80c4e60 tx=0x7fd290009240 comp rx=0 tx=0).stop 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 msgr2=0x7fd2a8157720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a8157720 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fd298009fd0 tx=0x7fd298004770 comp rx=0 tx=0).stop 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 shutdown_connections 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd288065b00 0x7fd288067fc0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd2a81f0900 0x7fd2a815d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:54.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd2a80b3420 0x7fd2a81f03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 --2- 172.21.15.45:0/2419136540 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd2a80b1d00 0x7fd2a8157720 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:54.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 >> 172.21.15.45:0/2419136540 conn(0x7fd2a80ccd00 msgr2=0x7fd2a80d01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:54.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 shutdown_connections 2023-12-19T18:03:54.009 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:54.000+0000 7fd2ad7ac700 1 -- 172.21.15.45:0/2419136540 wait complete. 2023-12-19T18:03:54.010 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 111 2023-12-19T18:03:54.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 111, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:53.705889+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 131, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9117': {'gid': 9117, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:rejoin', 'state_seq': 8, 'addr': '172.21.15.45:6837/3985719686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 3985719686}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 3985719686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:54.432 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9117:up:rejoin 2023-12-19T18:03:54.854 INFO:tasks.ceph.mds.c.smithi045.stderr:2023-12-19T18:03:54.848+0000 7f51c00de700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:03:55.433 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:03:55.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.620+0000 7f76bdb0e700 1 Processor -- start 2023-12-19T18:03:55.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.620+0000 7f76bdb0e700 1 -- start start 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76bdb0e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b8144560 0x7f76b80cedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76bdb0e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76b80aedc0 0x7f76b8070620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76bdb0e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76b80aff70 con 0x7f76b8070b60 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76bdb0e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76b8070fd0 con 0x7f76b80aedc0 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76bdb0e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80b0400 con 0x7f76b8144560 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76b80aedc0 0x7f76b8070620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:55.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76bcb0c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b8144560 0x7f76b80cedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:55.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f76b80aedc0 0x7f76b8070620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:51742/0 (socket says 172.21.15.45:51742) 2023-12-19T18:03:55.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 -- 172.21.15.45:0/959076760 learned_addr learned my addr 172.21.15.45:0/959076760 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:55.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 -- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b8144560 msgr2=0x7f76b80cedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:55.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 --2- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b8144560 0x7f76b80cedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 -- 172.21.15.45:0/959076760 >> v1:172.21.15.73:6789/0 conn(0x7f76b8070b60 legacy=0x7f76b815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:55.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 -- 172.21.15.45:0/959076760 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b80af360 con 0x7f76b80aedc0 2023-12-19T18:03:55.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76affff700 1 --2- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b80aedc0 0x7f76b8070620 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009910 tx=0x7f76a8009c20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8b2799a37d50766 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:55.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76af7fe700 1 -- 172.21.15.45:0/959076760 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8011830 con 0x7f76b80aedc0 2023-12-19T18:03:55.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76af7fe700 1 -- 172.21.15.45:0/959076760 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a8011990 con 0x7f76b80aedc0 2023-12-19T18:03:55.631 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.624+0000 7f76af7fe700 1 -- 172.21.15.45:0/959076760 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8011d40 con 0x7f76b80aedc0 2023-12-19T18:03:55.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 -- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b80aedc0 msgr2=0x7f76b8070620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:55.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b80aedc0 0x7f76b8070620 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f76a8009910 tx=0x7f76a8009c20 comp rx=0 tx=0).stop 2023-12-19T18:03:55.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 -- 172.21.15.45:0/959076760 shutdown_connections 2023-12-19T18:03:55.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b80aedc0 0x7f76b8070620 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/959076760 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b8144560 0x7f76b80cedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 -- 172.21.15.45:0/959076760 >> 172.21.15.45:0/959076760 conn(0x7f76b806a130 msgr2=0x7f76b806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:55.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 -- 172.21.15.45:0/959076760 shutdown_connections 2023-12-19T18:03:55.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 -- 172.21.15.45:0/959076760 wait complete. 2023-12-19T18:03:55.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 Processor -- start 2023-12-19T18:03:55.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.628+0000 7f76bdb0e700 1 -- start start 2023-12-19T18:03:55.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b8070b60 0x7f76b815d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:55.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b80aedc0 0x7f76b813d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:55.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 0x7f76b80cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:55.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b80a7670 con 0x7f76b8144560 2023-12-19T18:03:55.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b813ddf0 con 0x7f76b8070b60 2023-12-19T18:03:55.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b815e3a0 con 0x7f76b80aedc0 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 0x7f76b80cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76affff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b80aedc0 0x7f76b813d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 0x7f76b80cdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47050/0 (socket says 172.21.15.45:47050) 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 -- 172.21.15.45:0/3063813574 learned_addr learned my addr 172.21.15.45:0/3063813574 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bcb0c700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b8070b60 0x7f76b815d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 -- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b80aedc0 msgr2=0x7f76b813d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:55.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b80aedc0 0x7f76b813d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 -- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b8070b60 msgr2=0x7f76b815d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:55.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b8070b60 0x7f76b815d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 -- 172.21.15.45:0/3063813574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009570 con 0x7f76b8144560 2023-12-19T18:03:55.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76affff700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b80aedc0 0x7f76b813d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:55.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bcb0c700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b8070b60 0x7f76b815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bd30d700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 0x7f76b80cdf00 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f76b000cb50 tx=0x7f76b000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b0003c20 con 0x7f76b8144560 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b0003d80 con 0x7f76b8144560 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b815db00 con 0x7f76b8144560 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b000aa20 con 0x7f76b8144560 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.632+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b815e0c0 con 0x7f76b8144560 2023-12-19T18:03:55.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.636+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b80a77b0 con 0x7f76b8144560 2023-12-19T18:03:55.644 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.636+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f76b000ab80 con 0x7f76b8144560 2023-12-19T18:03:55.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.640+0000 7f76ad7fa700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f76a4065b00 0x7f76a4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:55.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.640+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f76b00833e0 con 0x7f76b8144560 2023-12-19T18:03:55.645 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.640+0000 7f76bcb0c700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f76a4065b00 0x7f76a4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:55.646 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.640+0000 7f76bcb0c700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f76a4065b00 0x7f76a4067fc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f76b81f1c50 tx=0x7f76b400f040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:55.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.644+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f76b80a77b0 con 0x7f76b8144560 2023-12-19T18:03:55.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.864+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76b80a77b0 con 0x7f76b8144560 2023-12-19T18:03:55.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.864+0000 7f76ad7fa700 1 -- 172.21.15.45:0/3063813574 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4717 (secure 0 0 0) 0x7f76b80a77b0 con 0x7f76b8144560 2023-12-19T18:03:55.870 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:55.870 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:54.718515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:03:55.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f76a4065b00 msgr2=0x7f76a4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:55.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f76a4065b00 0x7f76a4067fc0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f76b81f1c50 tx=0x7f76b400f040 comp rx=0 tx=0).stop 2023-12-19T18:03:55.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 msgr2=0x7f76b80cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:55.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 0x7f76b80cdf00 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f76b000cb50 tx=0x7f76b000ce60 comp rx=0 tx=0).stop 2023-12-19T18:03:55.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 shutdown_connections 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f76a4065b00 0x7f76a4067fc0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f76b8144560 0x7f76b80cdf00 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f76b80aedc0 0x7f76b813d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 --2- 172.21.15.45:0/3063813574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f76b8070b60 0x7f76b815d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 >> 172.21.15.45:0/3063813574 conn(0x7f76b806a130 msgr2=0x7f76b806df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 shutdown_connections 2023-12-19T18:03:55.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:55.868+0000 7f76bdb0e700 1 -- 172.21.15.45:0/3063813574 wait complete. 2023-12-19T18:03:55.876 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 112 2023-12-19T18:03:56.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-19T18:03:01.480133+0000', 'modified': '2023-12-19T18:03:54.718515+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 131, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9117': {'gid': 9117, 'name': 'c', 'rank': 0, 'incarnation': 109, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.45:6837/3985719686', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.45:6835', 'nonce': 3985719686}, {'type': 'v1', 'addr': '172.21.15.45:6837', 'nonce': 3985719686}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [18], 'metadata_pool': 17, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-19T18:03:56.298 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-19T18:03:56.298 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-19T18:03:56.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 Processor -- start 2023-12-19T18:03:56.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 -- start start 2023-12-19T18:03:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc15d300 0x7f1bbc1619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bbc06e210 0x7f1bbc070570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bbc161f30 con 0x7f1bbc06e650 2023-12-19T18:03:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bbc06d170 con 0x7f1bbc06e210 2023-12-19T18:03:56.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.488+0000 7f1bc14c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc06d450 con 0x7f1bbc15d300 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bbc06e210 0x7f1bbc070570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1bbc06e210 0x7f1bbc070570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47052/0 (socket says 172.21.15.45:47052) 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 -- 172.21.15.45:0/4001397748 learned_addr learned my addr 172.21.15.45:0/4001397748 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/4001397748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc15d300 0x7f1bbc1619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 -- 172.21.15.45:0/4001397748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc15d300 msgr2=0x7f1bbc1619f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/4001397748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc15d300 0x7f1bbc1619f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.497 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 -- 172.21.15.45:0/4001397748 >> v1:172.21.15.73:6789/0 conn(0x7f1bbc06e650 legacy=0x7f1bbc0ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 -- 172.21.15.45:0/4001397748 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc06d730 con 0x7f1bbc06e210 2023-12-19T18:03:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/4001397748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc06e210 0x7f1bbc070570 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009910 tx=0x7f1bb0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b2b877080eeca6 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bb9ffb700 1 -- 172.21.15.45:0/4001397748 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb000ba60 con 0x7f1bbc06e210 2023-12-19T18:03:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bb9ffb700 1 -- 172.21.15.45:0/4001397748 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000bbc0 con 0x7f1bbc06e210 2023-12-19T18:03:56.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bb9ffb700 1 -- 172.21.15.45:0/4001397748 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0009e60 con 0x7f1bbc06e210 2023-12-19T18:03:56.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 -- 172.21.15.45:0/4001397748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc06e210 msgr2=0x7f1bbc070570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/4001397748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc06e210 0x7f1bbc070570 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0009910 tx=0x7f1bb0009c20 comp rx=0 tx=0).stop 2023-12-19T18:03:56.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 -- 172.21.15.45:0/4001397748 shutdown_connections 2023-12-19T18:03:56.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/4001397748 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc06e210 0x7f1bbc070570 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.499 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/4001397748 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc15d300 0x7f1bbc1619f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 -- 172.21.15.45:0/4001397748 >> 172.21.15.45:0/4001397748 conn(0x7f1bbc0ce8a0 msgr2=0x7f1bbc0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 -- 172.21.15.45:0/4001397748 shutdown_connections 2023-12-19T18:03:56.500 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.492+0000 7f1bc14c8700 1 -- 172.21.15.45:0/4001397748 wait complete. 2023-12-19T18:03:56.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.496+0000 7f1bc14c8700 1 Processor -- start 2023-12-19T18:03:56.505 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 -- start start 2023-12-19T18:03:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc06e210 0x7f1bbc0b3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bbc06e650 0x7f1bbc0b23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.506 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 0x7f1bbc0c3860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc160490 con 0x7f1bbc15d300 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0b40b0 con 0x7f1bbc06e650 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bc14c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bbc0b28e0 con 0x7f1bbc06e210 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 0x7f1bbc0c3860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbaffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc06e210 0x7f1bbc0b3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 0x7f1bbc0c3860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47064/0 (socket says 172.21.15.45:47064) 2023-12-19T18:03:56.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/1161265763 learned_addr learned my addr 172.21.15.45:0/1161265763 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bbc06e650 0x7f1bbc0b23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc06e210 msgr2=0x7f1bbc0b3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc06e210 0x7f1bbc0b3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bbc06e650 msgr2=0x7f1bbc0b23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bbc06e650 0x7f1bbc0b23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/1161265763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb0009570 con 0x7f1bbc15d300 2023-12-19T18:03:56.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.500+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bbc06e650 0x7f1bbc0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:56.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.504+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 0x7f1bbc0c3860 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400cbc0 tx=0x7f1bb400ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.504+0000 7f1ba37fe700 1 -- 172.21.15.45:0/1161265763 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4003c20 con 0x7f1bbc15d300 2023-12-19T18:03:56.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.504+0000 7f1ba37fe700 1 -- 172.21.15.45:0/1161265763 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4003d80 con 0x7f1bbc15d300 2023-12-19T18:03:56.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.504+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bbc0b2db0 con 0x7f1bbc15d300 2023-12-19T18:03:56.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.504+0000 7f1ba37fe700 1 -- 172.21.15.45:0/1161265763 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb400aae0 con 0x7f1bbc15d300 2023-12-19T18:03:56.510 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.504+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc0b3370 con 0x7f1bbc15d300 2023-12-19T18:03:56.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.508+0000 7f1ba37fe700 1 -- 172.21.15.45:0/1161265763 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f1bb400ac40 con 0x7f1bbc15d300 2023-12-19T18:03:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.508+0000 7f1ba37fe700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba8065b20 0x7f1ba8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.508+0000 7f1ba37fe700 1 -- 172.21.15.45:0/1161265763 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f1bb4083310 con 0x7f1bbc15d300 2023-12-19T18:03:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.508+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba8065b20 0x7f1ba8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 Processor -- start 2023-12-19T18:03:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 -- start start 2023-12-19T18:03:56.517 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba8065b20 0x7f1ba8067fe0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1bac006b40 tx=0x7f1bac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2250e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x229b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x224e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x21c25b0 con 0x2279430 2023-12-19T18:03:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x21bfd40 con 0x229b7d0 2023-12-19T18:03:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x21bb630 con 0x229aeb0 2023-12-19T18:03:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x229b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.519 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x229b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47072/0 (socket says 172.21.15.45:47072) 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 -- 172.21.15.45:0/1654790175 learned_addr learned my addr 172.21.15.45:0/1654790175 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2250e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x224e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 -- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 msgr2=0x2250e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2250e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 -- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 msgr2=0x224e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x224e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 -- 172.21.15.45:0/1654790175 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x202e960 con 0x2279430 2023-12-19T18:03:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.512+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x229b290 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000b3c0 tx=0x7f1bb0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a0e89b3f8c31fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1ba0ff9700 1 -- 172.21.15.45:0/1654790175 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0020040 con 0x2279430 2023-12-19T18:03:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1ba0ff9700 1 -- 172.21.15.45:0/1654790175 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000b860 con 0x2279430 2023-12-19T18:03:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1ba0ff9700 1 -- 172.21.15.45:0/1654790175 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb0004260 con 0x2279430 2023-12-19T18:03:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 -- 172.21.15.45:0/1654790175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 msgr2=0x229b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x229b290 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000b3c0 tx=0x7f1bb0008030 comp rx=0 tx=0).stop 2023-12-19T18:03:56.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 -- 172.21.15.45:0/1654790175 shutdown_connections 2023-12-19T18:03:56.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x224e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x229b290 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1654790175 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2250e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 -- 172.21.15.45:0/1654790175 >> 172.21.15.45:0/1654790175 conn(0x1fe34d0 msgr2=0x2254d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 -- 172.21.15.45:0/1654790175 shutdown_connections 2023-12-19T18:03:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 -- 172.21.15.45:0/1654790175 wait complete. 2023-12-19T18:03:56.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 -- start start 2023-12-19T18:03:56.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.516+0000 7f1bc475b740 1 Processor -- start 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2279430 0x22530f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2254200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 0x2254b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2178c80 con 0x229b7d0 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x217eb00 con 0x2279430 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2067aa0 con 0x229aeb0 2023-12-19T18:03:56.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bc475b740 10 client.0 _ll_register_callbacks cb 0x21b4f70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:03:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 0x2254b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2279430 0x22530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbaffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2279430 0x22530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:51764/0 (socket says 172.21.15.45:51764) 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbaffd700 1 -- 172.21.15.45:0/2796408959 learned_addr learned my addr 172.21.15.45:0/2796408959 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 0x2254b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47080/0 (socket says 172.21.15.45:47080) 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2254200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 msgr2=0x2254200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2254200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2279430 msgr2=0x22530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2279430 0x22530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 -- 172.21.15.45:0/2796408959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bbc06d730 con 0x229b7d0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 0x2254b40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4081600 tx=0x7f1bb40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877b9fb26c76d79d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.520+0000 7f1b99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1b99ffb700 1 -- 172.21.15.45:0/2796408959 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb40830d0 con 0x229b7d0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1b99ffb700 1 -- 172.21.15.45:0/2796408959 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f1bb40585b0 con 0x229b7d0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x21b46b0 con 0x229b7d0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1b99ffb700 1 -- 172.21.15.45:0/2796408959 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bb405c760 con 0x229b7d0 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 10 client.9336 fetch_fsmap learned FSMap version 112 2023-12-19T18:03:56.529 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x2181770 con 0x229b7d0 2023-12-19T18:03:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1b99ffb700 1 -- 172.21.15.45:0/2796408959 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x21b46b0 con 0x229b7d0 2023-12-19T18:03:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1b99ffb700 1 -- 172.21.15.45:0/2796408959 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 112) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1bb406b070 con 0x229b7d0 2023-12-19T18:03:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 10 client.9336 fetch_fsmap finished waiting for FSMap version 112 2023-12-19T18:03:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 10 client.9336 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T18:03:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 20 client.9336 populate_metadata read hostname 'smithi045' 2023-12-19T18:03:56.530 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x22a5530 0x22af200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 4 client.9336 mds_command: new command op to 9117 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-19T18:03:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 --> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x2176a00 con 0x22a5530 2023-12-19T18:03:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x22a5530 0x22af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x22a5530 0x22af200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc266698a99d137a server_cookie=48142c32a873eea1 in_seq=0 out_seq=0 2023-12-19T18:03:56.531 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.524+0000 7f1b99ffb700 10 client.9336 ms_handle_connect on v2:172.21.15.45:6835/3985719686 2023-12-19T18:03:56.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1b99ffb700 1 -- 172.21.15.45:0/2796408959 <== mds.0 v2:172.21.15.45:6835/3985719686 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x2176a00 con 0x22a5530 2023-12-19T18:03:56.532 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1b99ffb700 10 client.9336 handle_command_reply: tid=0 2023-12-19T18:03:56.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 client.9336 shutdown 2023-12-19T18:03:56.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 msgr2=0x2254b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 0x2254b40 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4081600 tx=0x7f1bb40014a0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.533 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 shutdown_connections 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x22a5530 0x22af200 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229b7d0 0x2254b40 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x2254200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 --2- 172.21.15.45:0/2796408959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x2279430 0x22530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1b99ffb700 0 client.9336 ms_handle_reset on v2:172.21.15.45:6835/3985719686 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 >> 172.21.15.45:0/2796408959 conn(0x1fe34d0 msgr2=0x227bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 shutdown_connections 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 1 -- 172.21.15.45:0/2796408959 wait complete. 2023-12-19T18:03:56.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.528+0000 7f1bc475b740 20 client.9336 trim_cache size 0 max 16384 2023-12-19T18:03:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 Processor -- start 2023-12-19T18:03:56.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 -- start start 2023-12-19T18:03:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2279430 0x2277e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 0x2274bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22750f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x21b8a30 con 0x229aeb0 2023-12-19T18:03:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x216a930 con 0x229b7d0 2023-12-19T18:03:56.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2249c50 con 0x2279430 2023-12-19T18:03:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bba7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 0x2274bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbaffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2279430 0x2277e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22750f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bba7fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 0x2274bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47088/0 (socket says 172.21.15.45:47088) 2023-12-19T18:03:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bba7fc700 1 -- 172.21.15.45:0/1880761793 learned_addr learned my addr 172.21.15.45:0/1880761793 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbb7fe700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22750f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.45:51768/0 (socket says 172.21.15.45:51768) 2023-12-19T18:03:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbaffd700 1 -- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 msgr2=0x22750f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22750f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbaffd700 1 -- 172.21.15.45:0/1880761793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 msgr2=0x2274bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 0x2274bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bbaffd700 1 -- 172.21.15.45:0/1880761793 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x21679a0 con 0x2279430 2023-12-19T18:03:56.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.548+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 0x2274bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:56.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2279430 0x2277e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x2252dc0 tx=0x7f1bac013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fc69f3a12e5bb21 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1ba17fa700 1 -- 172.21.15.45:0/1880761793 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac029e20 con 0x2279430 2023-12-19T18:03:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1ba17fa700 1 -- 172.21.15.45:0/1880761793 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bac029150 con 0x2279430 2023-12-19T18:03:56.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1ba17fa700 1 -- 172.21.15.45:0/1880761793 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0292c0 con 0x2279430 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 -- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2279430 msgr2=0x2277e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2279430 0x2277e10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x2252dc0 tx=0x7f1bac013000 comp rx=0 tx=0).stop 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 -- 172.21.15.45:0/1880761793 shutdown_connections 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22750f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x229aeb0 0x2274bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 --2- 172.21.15.45:0/1880761793 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x2279430 0x2277e10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 -- 172.21.15.45:0/1880761793 >> 172.21.15.45:0/1880761793 conn(0x1fe34d0 msgr2=0x2299be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 -- 172.21.15.45:0/1880761793 shutdown_connections 2023-12-19T18:03:56.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 -- 172.21.15.45:0/1880761793 wait complete. 2023-12-19T18:03:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 -- start start 2023-12-19T18:03:56.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.552+0000 7f1bc475b740 1 Processor -- start 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x22f7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x22a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22a93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x2250aa0 con 0x2279430 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x2270dc0 con 0x229b7d0 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x2271ce0 con 0x229aeb0 2023-12-19T18:03:56.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 10 client.0 _ll_register_callbacks cb 0x20f4e10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-19T18:03:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x22f7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x22f7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47094/0 (socket says 172.21.15.45:47094) 2023-12-19T18:03:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 -- 172.21.15.45:0/510657780 learned_addr learned my addr 172.21.15.45:0/510657780 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbb7fe700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22a93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x22a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 -- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 msgr2=0x22a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x22a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 -- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 msgr2=0x22a93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22a93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 -- 172.21.15.45:0/510657780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x202e960 con 0x2279430 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bbaffd700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x22f7810 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0106b0 tx=0x7f1bac0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220eea1f7a224aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1b99ffb700 10 client.0 ms_handle_connect on v2:172.21.15.45:3300/0 2023-12-19T18:03:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1b99ffb700 1 -- 172.21.15.45:0/510657780 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bac004610 con 0x2279430 2023-12-19T18:03:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1b99ffb700 1 -- 172.21.15.45:0/510657780 <== mon.0 v2:172.21.15.45:3300/0 2 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f1bac005a40 con 0x2279430 2023-12-19T18:03:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1bb000b860 con 0x2279430 2023-12-19T18:03:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1b99ffb700 1 -- 172.21.15.45:0/510657780 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1bac005c00 con 0x2279430 2023-12-19T18:03:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 10 client.9342 fetch_fsmap learned FSMap version 112 2023-12-19T18:03:56.564 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.556+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x7f1bac00e040 con 0x2279430 2023-12-19T18:03:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1b99ffb700 1 -- 172.21.15.45:0/510657780 <== mon.0 v2:172.21.15.45:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb000b860 con 0x2279430 2023-12-19T18:03:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1b99ffb700 1 -- 172.21.15.45:0/510657780 <== mon.0 v2:172.21.15.45:3300/0 5 ==== fsmap(e 112) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1bac022030 con 0x2279430 2023-12-19T18:03:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 10 client.9342 fetch_fsmap finished waiting for FSMap version 112 2023-12-19T18:03:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 10 client.9342 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-19T18:03:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 20 client.9342 populate_metadata read hostname 'smithi045' 2023-12-19T18:03:56.566 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x226fe70 0x2270250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 4 client.9342 mds_command: new command op to 9117 tid=0[{"prefix": "status"}] 2023-12-19T18:03:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 --> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] -- command(tid 0: {"prefix": "status"}) v1 -- 0x203a460 con 0x226fe70 2023-12-19T18:03:56.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x226fe70 0x2270250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bba7fc700 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x226fe70 0x2270250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eca1c5bf2eff9e3 server_cookie=e6cacdcd7df364c6 in_seq=0 out_seq=0 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1b99ffb700 10 client.9342 ms_handle_connect on v2:172.21.15.45:6835/3985719686 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1b99ffb700 1 -- 172.21.15.45:0/510657780 <== mds.0 v2:172.21.15.45:6835/3985719686 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x203a460 con 0x226fe70 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1b99ffb700 10 client.9342 handle_command_reply: tid=0 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 client.9342 shutdown 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 msgr2=0x22f7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x22f7810 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0106b0 tx=0x7f1bac0047e0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 shutdown_connections 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:6835/3985719686,v1:172.21.15.45:6837/3985719686] conn(0x226fe70 0x2270250 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x229b7d0 0x22a93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.568 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1b99ffb700 0 client.9342 ms_handle_reset on v2:172.21.15.45:6835/3985719686 2023-12-19T18:03:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x229aeb0 0x22a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 --2- 172.21.15.45:0/510657780 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x2279430 0x22f7810 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 >> 172.21.15.45:0/510657780 conn(0x1fe34d0 msgr2=0x2278720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.560+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 shutdown_connections 2023-12-19T18:03:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc475b740 1 -- 172.21.15.45:0/510657780 wait complete. 2023-12-19T18:03:56.569 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc475b740 20 client.9342 trim_cache size 0 max 16384 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "cluster_fsid": "4e717d5b-4367-4aa1-b211-e8194442f374", 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "whoami": 0, 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 9117, 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "want_state": "up:active", 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "state": "up:active", 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs", 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "rank_uptime": 4.8681081700000002, 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "mdsmap_epoch": 112, 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch": 131, 2023-12-19T18:03:56.570 INFO:teuthology.orchestra.run.smithi045.stdout: "osdmap_epoch_barrier": 131, 2023-12-19T18:03:56.571 INFO:teuthology.orchestra.run.smithi045.stdout: "uptime": 27.636212701000002 2023-12-19T18:03:56.571 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:03:56.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba8065b20 msgr2=0x7f1ba8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba8065b20 0x7f1ba8067fe0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f1bac006b40 tx=0x7f1bac008040 comp rx=0 tx=0).stop 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 msgr2=0x7f1bbc0c3860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 0x7f1bbc0c3860 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f1bb400cbc0 tx=0x7f1bb400ced0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 shutdown_connections 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f1ba8065b20 0x7f1ba8067fe0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1bbc15d300 0x7f1bbc0c3860 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1bbc06e650 0x7f1bbc0b23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 --2- 172.21.15.45:0/1161265763 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f1bbc06e210 0x7f1bbc0b3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 >> 172.21.15.45:0/1161265763 conn(0x7f1bbc0ce8a0 msgr2=0x7f1bbc15c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 shutdown_connections 2023-12-19T18:03:56.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.564+0000 7f1bc14c8700 1 -- 172.21.15.45:0/1161265763 wait complete. 2023-12-19T18:03:56.593 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-19T18:03:56.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.768+0000 7f0fe1239700 1 Processor -- start 2023-12-19T18:03:56.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fe1239700 1 -- start start 2023-12-19T18:03:56.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fe1239700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0fdc1585e0 0x7f0fdc161b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fe1239700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc1628e0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fe1239700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fdc0af100 con 0x7f0fdc0b2cc0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fe1239700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fdc0af3e0 con 0x7f0fdc1585e0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fdbfff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f0fdc0b28e0 0x7f0fdc157ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55454/0 (socket says 172.21.15.45:55454) 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fdbfff700 1 -- 172.21.15.45:0/3537982558 learned_addr learned my addr 172.21.15.45:0/3537982558 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fd37fe700 1 --2- 172.21.15.45:0/3537982558 >> v2:172.21.15.73:3300/0 conn(0x7f0fdc1585e0 0x7f0fdc161b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fdb7fe700 1 -- 172.21.15.45:0/3537982558 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 681727968 0 0) 0x7f0fdc1628e0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.772+0000 7f0fdb7fe700 1 -- 172.21.15.45:0/3537982558 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fc80035d0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fd37fe700 1 -- 172.21.15.45:0/3537982558 >> v1:172.21.15.73:6789/0 conn(0x7f0fdc0b2cc0 legacy=0x7f0fdc1620b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fdb7fe700 1 -- 172.21.15.45:0/3537982558 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1692669944 0 0) 0x7f0fdc0af100 con 0x7f0fdc0b2cc0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fd37fe700 1 -- 172.21.15.45:0/3537982558 >> v1:172.21.15.45:6789/0 conn(0x7f0fdc0b28e0 legacy=0x7f0fdc157ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fd37fe700 1 -- 172.21.15.45:0/3537982558 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fdc0af6c0 con 0x7f0fdc1585e0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fd37fe700 1 --2- 172.21.15.45:0/3537982558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc1585e0 0x7f0fdc161b70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009850 tx=0x7f0fc4009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cea525533dd9a772 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fdb7fe700 1 -- 172.21.15.45:0/3537982558 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc001670 con 0x7f0fdc1585e0 2023-12-19T18:03:56.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fdb7fe700 1 -- 172.21.15.45:0/3537982558 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc4010590 con 0x7f0fdc1585e0 2023-12-19T18:03:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fdb7fe700 1 -- 172.21.15.45:0/3537982558 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4010940 con 0x7f0fdc1585e0 2023-12-19T18:03:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 -- 172.21.15.45:0/3537982558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc1585e0 msgr2=0x7f0fdc161b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3537982558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc1585e0 0x7f0fdc161b70 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009850 tx=0x7f0fc4009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:56.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 -- 172.21.15.45:0/3537982558 shutdown_connections 2023-12-19T18:03:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3537982558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc1585e0 0x7f0fdc161b70 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 -- 172.21.15.45:0/3537982558 >> 172.21.15.45:0/3537982558 conn(0x7f0fdc06a130 msgr2=0x7f0fdc06a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 -- 172.21.15.45:0/3537982558 shutdown_connections 2023-12-19T18:03:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.776+0000 7f0fe1239700 1 -- 172.21.15.45:0/3537982558 wait complete. 2023-12-19T18:03:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 Processor -- start 2023-12-19T18:03:56.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 -- start start 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 0x7f0fdc144cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc0b2cc0 0x7f0fdc1478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fdc1585e0 0x7f0fdc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0cf130 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc147410 con 0x7f0fdc0b2cc0 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe1239700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fdc0ce8f0 con 0x7f0fdc1585e0 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 0x7f0fdc144cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 0x7f0fdc144cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:47104/0 (socket says 172.21.15.45:47104) 2023-12-19T18:03:56.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fdbfff700 1 -- 172.21.15.45:0/3416075192 learned_addr learned my addr 172.21.15.45:0/3416075192 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:56.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fd37fe700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc0b2cc0 0x7f0fdc1478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.780+0000 7f0fe0a38700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fdc1585e0 0x7f0fdc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fdbfff700 1 -- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fdc1585e0 msgr2=0x7f0fdc0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fdbfff700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fdc1585e0 0x7f0fdc0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fdbfff700 1 -- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc0b2cc0 msgr2=0x7f0fdc1478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fdbfff700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc0b2cc0 0x7f0fdc1478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fdbfff700 1 -- 172.21.15.45:0/3416075192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc40094b0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fd37fe700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc0b2cc0 0x7f0fdc1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fdbfff700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 0x7f0fdc144cf0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00caf0 tx=0x7f0fcc00ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc004a90 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fcc004bf0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fdc1470e0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fcc007e40 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fdc0cee50 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.784+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fdc146f40 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.788+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0fcc0070d0 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.788+0000 7f0fd97fa700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0fbc065ad0 0x7f0fbc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:56.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.788+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f0fcc082570 con 0x7f0fdc0b28e0 2023-12-19T18:03:56.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.788+0000 7f0fd37fe700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0fbc065ad0 0x7f0fbc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:56.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.792+0000 7f0fd37fe700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0fbc065ad0 0x7f0fbc067f90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc158a30 tx=0x7f0fc4008000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:56.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:56.796+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0fdc146f40 con 0x7f0fdc0b28e0 2023-12-19T18:03:57.017 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.012+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0fdc146f40 con 0x7f0fdc0b28e0 2023-12-19T18:03:57.018 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.012+0000 7f0fd97fa700 1 -- 172.21.15.45:0/3416075192 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0fdc146f40 con 0x7f0fdc0b28e0 2023-12-19T18:03:57.018 INFO:teuthology.orchestra.run.smithi045.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-19T18:03:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0fbc065ad0 msgr2=0x7f0fbc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0fbc065ad0 0x7f0fbc067f90 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc158a30 tx=0x7f0fc4008000 comp rx=0 tx=0).stop 2023-12-19T18:03:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 msgr2=0x7f0fdc144cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:57.021 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 0x7f0fdc144cf0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc00caf0 tx=0x7f0fcc00ce00 comp rx=0 tx=0).stop 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 shutdown_connections 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0fbc065ad0 0x7f0fbc067f90 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0fdc1585e0 0x7f0fdc0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fdc0b2cc0 0x7f0fdc1478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 --2- 172.21.15.45:0/3416075192 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0fdc0b28e0 0x7f0fdc144cf0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 >> 172.21.15.45:0/3416075192 conn(0x7f0fdc06a130 msgr2=0x7f0fdc154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 shutdown_connections 2023-12-19T18:03:57.022 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:57.016+0000 7f0fe1239700 1 -- 172.21.15.45:0/3416075192 wait complete. 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi045.front.sepia.ceph.com 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-19T18:03:57.044 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:57.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.045 DEBUG:teuthology.orchestra.run.smithi045:> ip addr 2023-12-19T18:03:57.058 INFO:teuthology.orchestra.run.smithi045.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-19T18:03:57.058 INFO:teuthology.orchestra.run.smithi045.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-19T18:03:57.058 INFO:teuthology.orchestra.run.smithi045.stdout: inet 127.0.0.1/8 scope host lo 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 ::1/128 scope host 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a6 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f0 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:6b:fd:a7 brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp7s0f1 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-19T18:03:57.059 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f0 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.21.15.45/20 brd 172.21.15.255 scope global dynamic ens1f0 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft 41628sec preferred_lft 41628sec 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec4:7aff:febd:12be/64 scope link 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 0c:c4:7a:bd:12:bf brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: altname enp1s0f1 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether 02:42:b9:56:49:be brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-19T18:03:57.060 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::5475:46ff:fe97:98a/64 scope link 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether ee:23:de:68:c3:49 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::ec23:deff:fe68:c349/64 scope link 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: link/ether b6:0c:45:bd:0b:6e brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: inet6 fe80::b40c:45ff:febd:b6e/64 scope link 2023-12-19T18:03:57.061 INFO:teuthology.orchestra.run.smithi045.stdout: valid_lft forever preferred_lft forever 2023-12-19T18:03:57.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.063 DEBUG:teuthology.orchestra.run.smithi045:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-19T18:03:57.144 INFO:teuthology.orchestra.run.smithi045.stdout:1 2023-12-19T18:03:57.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.147 DEBUG:teuthology.orchestra.run.smithi045:> route 2023-12-19T18:03:57.211 INFO:teuthology.orchestra.run.smithi045.stdout:Kernel IP routing table 2023-12-19T18:03:57.211 INFO:teuthology.orchestra.run.smithi045.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-19T18:03:57.212 INFO:teuthology.orchestra.run.smithi045.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2023-12-19T18:03:57.212 INFO:teuthology.orchestra.run.smithi045.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-19T18:03:57.212 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2023-12-19T18:03:57.212 INFO:teuthology.orchestra.run.smithi045.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-19T18:03:57.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.212 DEBUG:teuthology.orchestra.run.smithi045:> (cd / && exec bash -c ' 2023-12-19T18:03:57.212 DEBUG:teuthology.orchestra.run.smithi045:> set -e 2023-12-19T18:03:57.212 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-19T18:03:57.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-19T18:03:57.213 DEBUG:teuthology.orchestra.run.smithi045:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-19T18:03:57.213 DEBUG:teuthology.orchestra.run.smithi045:> ') 2023-12-19T18:03:57.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.354 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:03:57.369 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:03:57.369 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:03:57.370 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:57.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link set brx.0 up 2023-12-19T18:03:57.448 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-19T18:03:57.448 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:03:57.448 DEBUG:teuthology.orchestra.run.smithi045:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:57.513 INFO:teuthology.orchestra.run.smithi045.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-19T18:03:57.513 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-19T18:03:57.514 DEBUG:teuthology.orchestra.run.smithi045:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:57.570 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:03:57.652 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:03:57.652 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:03:57.738 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:03:57.740 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:03:57.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.740 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:03:57.803 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-19T18:03:57.803 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-19T18:03:57.851 DEBUG:teuthology.orchestra.run.smithi045:> sudo modprobe fuse 2023-12-19T18:03:57.889 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-19T18:03:57.889 DEBUG:teuthology.orchestra.run.smithi045:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-19T18:03:57.963 INFO:teuthology.orchestra.run.smithi045.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-19T18:03:57.965 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-19T18:03:57.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:57.966 DEBUG:teuthology.orchestra.run.smithi045:> ls /sys/fs/fuse/connections 2023-12-19T18:03:57.998 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:2023-12-19T18:03:57.992+0000 7f76453c3640 -1 init, newargv = 0x5578ffd3c0f0 newargc=15 2023-12-19T18:03:57.999 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[60182]: starting ceph client 2023-12-19T18:03:58.010 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[60182]: starting fuse 2023-12-19T18:03:58.014 INFO:teuthology.orchestra.run.smithi045.stdout:49 2023-12-19T18:03:58.015 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [49] 2023-12-19T18:03:58.015 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-19T18:03:58.015 DEBUG:teuthology.orchestra.run.smithi045:> import glob 2023-12-19T18:03:58.015 DEBUG:teuthology.orchestra.run.smithi045:> import re 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> import os 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> import subprocess 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> def _find_admin_socket(client_name): 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> files = glob.glob(asok_path) 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> # Given a non-glob path, it better be there 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> if "*" not in asok_path: 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> assert(len(files) == 1) 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> return files[0] 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> for f in files: 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-19T18:03:58.016 DEBUG:teuthology.orchestra.run.smithi045:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> contents = proc_f.read() 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> if mountpoint in contents: 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> return f 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> print(_find_admin_socket("client.0")) 2023-12-19T18:03:58.017 DEBUG:teuthology.orchestra.run.smithi045:> ' 2023-12-19T18:03:58.187 INFO:teuthology.orchestra.run.smithi045.stdout:/var/run/ceph/ceph-client.0.60182.asok 2023-12-19T18:03:58.369 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.60182.asok 2023-12-19T18:03:58.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:58.370 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.60182.asok status 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "metadata": { 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "entity_id": "0", 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "hostname": "smithi045", 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "pid": "60182", 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: "root": "/" 2023-12-19T18:03:58.570 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_count": 0, 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "dentry_pinned_count": 0, 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "id": 9354, 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "inst": { 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "name": { 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "client", 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "num": 9354 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1256646322 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: } 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:58.571 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": { 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "type": "v1", 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addr": "192.168.0.1:0", 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "nonce": 1256646322 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: }, 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "inst_str": "client.9354 192.168.0.1:0/1256646322", 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "addr_str": "192.168.0.1:0/1256646322", 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "inode_count": 1, 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "mds_epoch": 112, 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch": 131, 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "osd_epoch_barrier": 0, 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "blocklisted": false, 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout: "fs_name": "cephfs" 2023-12-19T18:03:58.572 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:03:58.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:58.584 DEBUG:teuthology.orchestra.run.smithi045:> stat --file-system '--printf=%T 2023-12-19T18:03:58.584 DEBUG:teuthology.orchestra.run.smithi045:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:58.602 INFO:teuthology.orchestra.run.smithi045.stdout:fuseblk 2023-12-19T18:03:58.602 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:58.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:58.603 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-19T18:03:58.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:58.682 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls -l subdir/) 2023-12-19T18:03:58.953 INFO:teuthology.orchestra.run.smithi045.stdout:total 50 2023-12-19T18:03:58.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 0 2023-12-19T18:03:58.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 1 2023-12-19T18:03:58.953 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 10 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 11 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 12 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 13 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 14 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 15 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 16 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 17 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 18 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 19 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 2 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 20 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 22 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 23 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 24 2023-12-19T18:03:58.954 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 25 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 26 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 27 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 28 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 29 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 3 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 30 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 31 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 32 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 33 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 34 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 35 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 36 2023-12-19T18:03:58.955 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 37 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 38 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 39 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 4 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 40 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 41 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 42 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 43 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 44 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 45 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 46 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 47 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 48 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 49 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 5 2023-12-19T18:03:58.956 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 50 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 51 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 52 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 53 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 54 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 55 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 56 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 57 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 58 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 59 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 6 2023-12-19T18:03:58.957 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 60 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 61 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 62 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 63 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 64 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 65 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 66 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 67 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 68 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 69 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 7 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 70 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 71 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 72 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 73 2023-12-19T18:03:58.958 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 74 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 75 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 76 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 77 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 78 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 79 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 8 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 80 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 81 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 82 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 83 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 84 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 85 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 86 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 87 2023-12-19T18:03:58.959 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 88 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 89 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 1 Dec 19 18:03 9 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 90 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 91 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 92 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 93 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 94 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 95 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 96 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 97 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 98 2023-12-19T18:03:58.960 INFO:teuthology.orchestra.run.smithi045.stdout:-rw-rw-r-- 1 ubuntu ubuntu 2 Dec 19 18:03 99 2023-12-19T18:03:58.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:03:58.961 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21') 2023-12-19T18:03:59.003 INFO:teuthology.orchestra.run.smithi045.stderr:cat: subdir/21: No such file or directory 2023-12-19T18:03:59.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:03:59.007 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-19T18:03:59.007 DEBUG:teuthology.orchestra.run.smithi045:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:03:59.098 DEBUG:teuthology.orchestra.run.smithi073:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-19T18:03:59.144 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-19T18:03:59.144 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:03:59.144 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:03:59.163 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:03:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 Processor -- start 2023-12-19T18:03:59.406 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 -- start start 2023-12-19T18:03:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f16e80c1e70 0x7f16e80ad660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e80cd560 0x7f16e806ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16e8165240 con 0x7f16e80adba0 2023-12-19T18:03:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e8161bc0 con 0x7f16e80cd560 2023-12-19T18:03:59.408 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.400+0000 7f16ee33c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e80c97e0 con 0x7f16e80c1e70 2023-12-19T18:03:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e80cd560 0x7f16e806ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f16e80cd560 0x7f16e806ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43900/0 (socket says 172.21.15.45:43900) 2023-12-19T18:03:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 -- 172.21.15.45:0/4152721563 learned_addr learned my addr 172.21.15.45:0/4152721563 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16e7fff700 1 --2- 172.21.15.45:0/4152721563 >> v2:172.21.15.73:3300/0 conn(0x7f16e80c1e70 0x7f16e80ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 -- 172.21.15.45:0/4152721563 >> v2:172.21.15.73:3300/0 conn(0x7f16e80c1e70 msgr2=0x7f16e80ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 --2- 172.21.15.45:0/4152721563 >> v2:172.21.15.73:3300/0 conn(0x7f16e80c1e70 0x7f16e80ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 -- 172.21.15.45:0/4152721563 >> v1:172.21.15.73:6789/0 conn(0x7f16e80adba0 legacy=0x7f16e80cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 -- 172.21.15.45:0/4152721563 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e8165490 con 0x7f16e80cd560 2023-12-19T18:03:59.410 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ec8d9700 1 --2- 172.21.15.45:0/4152721563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80cd560 0x7f16e806ce10 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f16e80cf350 tx=0x7f16e000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc5d5308d4918ed server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16e77fe700 1 -- 172.21.15.45:0/4152721563 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000e070 con 0x7f16e80cd560 2023-12-19T18:03:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16e77fe700 1 -- 172.21.15.45:0/4152721563 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16e000b9c0 con 0x7f16e80cd560 2023-12-19T18:03:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16e77fe700 1 -- 172.21.15.45:0/4152721563 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16e000bd70 con 0x7f16e80cd560 2023-12-19T18:03:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 -- 172.21.15.45:0/4152721563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80cd560 msgr2=0x7f16e806ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.411 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 --2- 172.21.15.45:0/4152721563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80cd560 0x7f16e806ce10 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f16e80cf350 tx=0x7f16e000b330 comp rx=0 tx=0).stop 2023-12-19T18:03:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 -- 172.21.15.45:0/4152721563 shutdown_connections 2023-12-19T18:03:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 --2- 172.21.15.45:0/4152721563 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80cd560 0x7f16e806ce10 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 --2- 172.21.15.45:0/4152721563 >> v2:172.21.15.73:3300/0 conn(0x7f16e80c1e70 0x7f16e80ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 -- 172.21.15.45:0/4152721563 >> 172.21.15.45:0/4152721563 conn(0x7f16e806a870 msgr2=0x7f16e80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 -- 172.21.15.45:0/4152721563 shutdown_connections 2023-12-19T18:03:59.412 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.404+0000 7f16ee33c700 1 -- 172.21.15.45:0/4152721563 wait complete. 2023-12-19T18:03:59.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 Processor -- start 2023-12-19T18:03:59.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 -- start start 2023-12-19T18:03:59.418 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 0x7f16e80c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e80c1e70 0x7f16e81f76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e80cd560 0x7f16e815ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e81f7be0 con 0x7f16e80adba0 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80c7c10 con 0x7f16e80c1e70 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ee33c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e80c7370 con 0x7f16e80cd560 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 0x7f16e80c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 0x7f16e80c6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43916/0 (socket says 172.21.15.45:43916) 2023-12-19T18:03:59.419 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 -- 172.21.15.45:0/564352577 learned_addr learned my addr 172.21.15.45:0/564352577 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16ec8d9700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e80cd560 0x7f16e815ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16df7fe700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e80c1e70 0x7f16e81f76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 -- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e80cd560 msgr2=0x7f16e815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e80cd560 0x7f16e815ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 -- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e80c1e70 msgr2=0x7f16e81f76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e80c1e70 0x7f16e81f76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16e7fff700 1 -- 172.21.15.45:0/564352577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e0009b30 con 0x7f16e80adba0 2023-12-19T18:03:59.420 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.412+0000 7f16df7fe700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e80c1e70 0x7f16e81f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:03:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16e7fff700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 0x7f16e80c6ce0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f16d800e760 tx=0x7f16d800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8013610 con 0x7f16e80adba0 2023-12-19T18:03:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d8013770 con 0x7f16e80adba0 2023-12-19T18:03:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e80c7650 con 0x7f16e80adba0 2023-12-19T18:03:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d8013ae0 con 0x7f16e80adba0 2023-12-19T18:03:59.421 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e80c2380 con 0x7f16e80adba0 2023-12-19T18:03:59.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.416+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e80741d0 con 0x7f16e80adba0 2023-12-19T18:03:59.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.420+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f16d8013c40 con 0x7f16e80adba0 2023-12-19T18:03:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.420+0000 7f16e57fa700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065b20 0x7f16c8067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.420+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f16d8082ed0 con 0x7f16e80adba0 2023-12-19T18:03:59.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.420+0000 7f16df7fe700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065b20 0x7f16c8067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.424+0000 7f16df7fe700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065b20 0x7f16c8067fe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f16e80c8b60 tx=0x7f16d0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:59.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.428+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f16d8050710 con 0x7f16e80adba0 2023-12-19T18:03:59.611 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.604+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16e80cf7f0 con 0x7f16e80adba0 2023-12-19T18:03:59.612 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16e57fa700 1 -- 172.21.15.45:0/564352577 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f16d8053d30 con 0x7f16e80adba0 2023-12-19T18:03:59.613 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:03:59.613 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":131,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:47.951495+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6833/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.73:6832/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:03:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065b20 msgr2=0x7f16c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065b20 0x7f16c8067fe0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f16e80c8b60 tx=0x7f16d0009040 comp rx=0 tx=0).stop 2023-12-19T18:03:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 msgr2=0x7f16e80c6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.615 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 0x7f16e80c6ce0 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f16d800e760 tx=0x7f16d800ea70 comp rx=0 tx=0).stop 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 shutdown_connections 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f16c8065b20 0x7f16c8067fe0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f16e80cd560 0x7f16e815ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16e80c1e70 0x7f16e81f76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 --2- 172.21.15.45:0/564352577 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f16e80adba0 0x7f16e80c6ce0 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 >> 172.21.15.45:0/564352577 conn(0x7f16e806a870 msgr2=0x7f16e8163d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 shutdown_connections 2023-12-19T18:03:59.616 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.608+0000 7f16ee33c700 1 -- 172.21.15.45:0/564352577 wait complete. 2023-12-19T18:03:59.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:02:59.579656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:03:00.531245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:03:59.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:03:59.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.832+0000 7fb3ca06d700 1 Processor -- start 2023-12-19T18:03:59.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.832+0000 7fb3ca06d700 1 -- start start 2023-12-19T18:03:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3ca06d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3ca06d700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3c40d1630 0x7fb3c40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3ca06d700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3c40d11a0 con 0x7fb3c40b8630 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3ca06d700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3c40b5040 con 0x7fb3c40d1630 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3ca06d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c415e360 con 0x7fb3c40b4720 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3c986c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fb3c40d1630 0x7fb3c40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3c906b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3c886a700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fb3c40b8630 0x7fb3c415d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:60156/0 (socket says 172.21.15.45:60156) 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.836+0000 7fb3c886a700 1 -- 172.21.15.45:0/2793244113 learned_addr learned my addr 172.21.15.45:0/2793244113 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3c906b700 1 -- 172.21.15.45:0/2793244113 >> v2:172.21.15.73:3300/0 conn(0x7fb3c40d1630 msgr2=0x7fb3c40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3c906b700 1 --2- 172.21.15.45:0/2793244113 >> v2:172.21.15.73:3300/0 conn(0x7fb3c40d1630 0x7fb3c40d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3c906b700 1 -- 172.21.15.45:0/2793244113 >> v1:172.21.15.73:6789/0 conn(0x7fb3c40b8630 legacy=0x7fb3c415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3c906b700 1 -- 172.21.15.45:0/2793244113 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c415dda0 con 0x7fb3c40b4720 2023-12-19T18:03:59.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3c906b700 1 --2- 172.21.15.45:0/2793244113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c40b4b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009850 tx=0x7fb3c0009b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d128303606508fc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:59.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3bbfff700 1 -- 172.21.15.45:0/2793244113 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0011830 con 0x7fb3c40b4720 2023-12-19T18:03:59.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3bbfff700 1 -- 172.21.15.45:0/2793244113 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c0011990 con 0x7fb3c40b4720 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3bbfff700 1 -- 172.21.15.45:0/2793244113 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c0011d40 con 0x7fb3c40b4720 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 -- 172.21.15.45:0/2793244113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 msgr2=0x7fb3c40b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/2793244113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c40b4b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb3c0009850 tx=0x7fb3c0009b60 comp rx=0 tx=0).stop 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 -- 172.21.15.45:0/2793244113 shutdown_connections 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/2793244113 >> v2:172.21.15.73:3300/0 conn(0x7fb3c40d1630 0x7fb3c40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/2793244113 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c40b4b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 -- 172.21.15.45:0/2793244113 >> 172.21.15.45:0/2793244113 conn(0x7fb3c4066320 msgr2=0x7fb3c40cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 -- 172.21.15.45:0/2793244113 shutdown_connections 2023-12-19T18:03:59.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.840+0000 7fb3ca06d700 1 -- 172.21.15.45:0/2793244113 wait complete. 2023-12-19T18:03:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 Processor -- start 2023-12-19T18:03:59.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 -- start start 2023-12-19T18:03:59.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c4147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 0x7fb3c41f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40d1630 0x7fb3c4148260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4145e40 con 0x7fb3c40b8630 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4158710 con 0x7fb3c40d1630 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3ca06d700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3c4147d50 con 0x7fb3c40b4720 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 0x7fb3c41f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 0x7fb3c41f1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43930/0 (socket says 172.21.15.45:43930) 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 -- 172.21.15.45:0/3138620701 learned_addr learned my addr 172.21.15.45:0/3138620701 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c906b700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c4147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c986c700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40d1630 0x7fb3c4148260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 -- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 msgr2=0x7fb3c4147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c4147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 -- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40d1630 msgr2=0x7fb3c4148260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40d1630 0x7fb3c4148260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.844+0000 7fb3c886a700 1 -- 172.21.15.45:0/3138620701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c00094b0 con 0x7fb3c40b8630 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3c886a700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 0x7fb3c41f1f30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400c520 tx=0x7fb3b400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4005d90 con 0x7fb3c40b8630 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40070d0 con 0x7fb3c40b8630 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3c4145230 con 0x7fb3c40b8630 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b4007440 con 0x7fb3c40b8630 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3c41457f0 con 0x7fb3c40b8630 2023-12-19T18:03:59.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.848+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3c4145ff0 con 0x7fb3c40b8630 2023-12-19T18:03:59.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.852+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb3b40075a0 con 0x7fb3c40b8630 2023-12-19T18:03:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.852+0000 7fb3b9ffb700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3a8065ad0 0x7fb3a8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:03:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.852+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fb3b4082600 con 0x7fb3c40b8630 2023-12-19T18:03:59.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.852+0000 7fb3c906b700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3a8065ad0 0x7fb3a8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:03:59.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.852+0000 7fb3c906b700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3a8065ad0 0x7fb3a8067f90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00090b0 tx=0x7fb3c0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:03:59.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:03:59.860+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb3c4145ff0 con 0x7fb3c40b8630 2023-12-19T18:04:00.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.040+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb3c4145ff0 con 0x7fb3c40b8630 2023-12-19T18:04:00.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.040+0000 7fb3b9ffb700 1 -- 172.21.15.45:0/3138620701 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb3c4145ff0 con 0x7fb3c40b8630 2023-12-19T18:04:00.049 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:04:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3a8065ad0 msgr2=0x7fb3a8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3a8065ad0 0x7fb3a8067f90 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fb3c00090b0 tx=0x7fb3c0008030 comp rx=0 tx=0).stop 2023-12-19T18:04:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 msgr2=0x7fb3c41f1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 0x7fb3c41f1f30 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400c520 tx=0x7fb3b400c830 comp rx=0 tx=0).stop 2023-12-19T18:04:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 shutdown_connections 2023-12-19T18:04:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb3a8065ad0 0x7fb3a8067f90 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb3c40d1630 0x7fb3c4148260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fb3c40b8630 0x7fb3c41f1f30 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 --2- 172.21.15.45:0/3138620701 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fb3c40b4720 0x7fb3c4147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 >> 172.21.15.45:0/3138620701 conn(0x7fb3c4066320 msgr2=0x7fb3c40b5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:00.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 shutdown_connections 2023-12-19T18:04:00.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.044+0000 7fb3ca06d700 1 -- 172.21.15.45:0/3138620701 wait complete. 2023-12-19T18:04:00.076 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:04:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.252+0000 7f5d55501700 1 Processor -- start 2023-12-19T18:04:00.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.252+0000 7f5d55501700 1 -- start start 2023-12-19T18:04:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d55501700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5d500b8630 0x7f5d5015d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d55501700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d500d11a0 con 0x7f5d500b4720 2023-12-19T18:04:00.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d55501700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5015e360 con 0x7f5d5015d8b0 2023-12-19T18:04:00.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d55501700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5015dda0 con 0x7f5d500b8630 2023-12-19T18:04:00.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4effd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5d500b4720 0x7f5d500b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55908/0 (socket says 172.21.15.45:55908) 2023-12-19T18:04:00.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4effd700 1 -- 172.21.15.45:0/627902933 learned_addr learned my addr 172.21.15.45:0/627902933 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4e7fc700 1 --2- 172.21.15.45:0/627902933 >> v2:172.21.15.73:3300/0 conn(0x7f5d500b8630 0x7f5d5015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4dffb700 1 -- 172.21.15.45:0/627902933 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 768470844 0 0) 0x7f5d500d11a0 con 0x7f5d500b4720 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4dffb700 1 -- 172.21.15.45:0/627902933 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d380035d0 con 0x7f5d500b4720 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4e7fc700 1 -- 172.21.15.45:0/627902933 >> v1:172.21.15.73:6789/0 conn(0x7f5d5015d8b0 legacy=0x7f5d500d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4dffb700 1 -- 172.21.15.45:0/627902933 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 410578235 0 0) 0x7f5d5015e360 con 0x7f5d5015d8b0 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4e7fc700 1 -- 172.21.15.45:0/627902933 >> v1:172.21.15.45:6789/0 conn(0x7f5d500b4720 legacy=0x7f5d500b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4e7fc700 1 -- 172.21.15.45:0/627902933 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5015e080 con 0x7f5d500b8630 2023-12-19T18:04:00.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.256+0000 7f5d4e7fc700 1 --2- 172.21.15.45:0/627902933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d5015d370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009850 tx=0x7f5d44009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11bcca02bbf241b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:00.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d4dffb700 1 -- 172.21.15.45:0/627902933 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44011830 con 0x7f5d500b8630 2023-12-19T18:04:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d4dffb700 1 -- 172.21.15.45:0/627902933 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d44011990 con 0x7f5d500b8630 2023-12-19T18:04:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d4dffb700 1 -- 172.21.15.45:0/627902933 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d44011d40 con 0x7f5d500b8630 2023-12-19T18:04:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 -- 172.21.15.45:0/627902933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 msgr2=0x7f5d5015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 --2- 172.21.15.45:0/627902933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d5015d370 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f5d44009850 tx=0x7f5d44009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 -- 172.21.15.45:0/627902933 shutdown_connections 2023-12-19T18:04:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 --2- 172.21.15.45:0/627902933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d5015d370 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 -- 172.21.15.45:0/627902933 >> 172.21.15.45:0/627902933 conn(0x7f5d50066320 msgr2=0x7f5d500cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 -- 172.21.15.45:0/627902933 shutdown_connections 2023-12-19T18:04:00.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 -- 172.21.15.45:0/627902933 wait complete. 2023-12-19T18:04:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.260+0000 7f5d55501700 1 Processor -- start 2023-12-19T18:04:00.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 -- start start 2023-12-19T18:04:00.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d500b4720 0x7f5d5015b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d500cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 0x7f5d500d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500cb420 con 0x7f5d5015d8b0 2023-12-19T18:04:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500cb700 con 0x7f5d500b8630 2023-12-19T18:04:00.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d500cb9e0 con 0x7f5d500b4720 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 0x7f5d500d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 0x7f5d500d2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43940/0 (socket says 172.21.15.45:43940) 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 -- 172.21.15.45:0/1395297470 learned_addr learned my addr 172.21.15.45:0/1395297470 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4effd700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d500b4720 0x7f5d5015b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4e7fc700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d500cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 -- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d500b4720 msgr2=0x7f5d5015b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d500b4720 0x7f5d5015b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 -- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 msgr2=0x7f5d500cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d500cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 -- 172.21.15.45:0/1395297470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d440094b0 con 0x7f5d5015d8b0 2023-12-19T18:04:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d4f7fe700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 0x7f5d500d2c80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800cc10 tx=0x7f5d4800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48003e50 con 0x7f5d5015d8b0 2023-12-19T18:04:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d4800a650 con 0x7f5d5015d8b0 2023-12-19T18:04:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d4800aa00 con 0x7f5d5015d8b0 2023-12-19T18:04:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d500cbcc0 con 0x7f5d5015d8b0 2023-12-19T18:04:00.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.264+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d500cca00 con 0x7f5d5015d8b0 2023-12-19T18:04:00.274 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.268+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d500cc1e0 con 0x7f5d5015d8b0 2023-12-19T18:04:00.275 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.268+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5d4800ab60 con 0x7f5d5015d8b0 2023-12-19T18:04:00.277 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.272+0000 7f5d377fe700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d3c065ad0 0x7f5d3c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.272+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f5d48082dd0 con 0x7f5d5015d8b0 2023-12-19T18:04:00.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.272+0000 7f5d4effd700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d3c065ad0 0x7f5d3c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.279 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.272+0000 7f5d4effd700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d3c065ad0 0x7f5d3c067f90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5d40007fd0 tx=0x7f5d40009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:00.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.276+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5d500cc1e0 con 0x7f5d5015d8b0 2023-12-19T18:04:00.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.456+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5d500cc1e0 con 0x7f5d5015d8b0 2023-12-19T18:04:00.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.456+0000 7f5d377fe700 1 -- 172.21.15.45:0/1395297470 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5d48017020 con 0x7f5d5015d8b0 2023-12-19T18:04:00.463 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:04:00.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d3c065ad0 msgr2=0x7f5d3c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d3c065ad0 0x7f5d3c067f90 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f5d40007fd0 tx=0x7f5d40009040 comp rx=0 tx=0).stop 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 msgr2=0x7f5d500d2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 0x7f5d500d2c80 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f5d4800cc10 tx=0x7f5d4800cf20 comp rx=0 tx=0).stop 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 shutdown_connections 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5d3c065ad0 0x7f5d3c067f90 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5d5015d8b0 0x7f5d500d2c80 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d500b8630 0x7f5d500cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 --2- 172.21.15.45:0/1395297470 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5d500b4720 0x7f5d5015b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 >> 172.21.15.45:0/1395297470 conn(0x7f5d50066320 msgr2=0x7f5d500d24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 shutdown_connections 2023-12-19T18:04:00.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.460+0000 7f5d55501700 1 -- 172.21.15.45:0/1395297470 wait complete. 2023-12-19T18:04:00.488 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:04:00.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.684+0000 7efc3b59e700 1 Processor -- start 2023-12-19T18:04:00.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.684+0000 7efc3b59e700 1 -- start start 2023-12-19T18:04:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0d2640 0x7efc3c167630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.693 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3b59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c0d11a0 con 0x7efc3c0b4720 2023-12-19T18:04:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3b59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3c15e360 con 0x7efc3c0b8630 2023-12-19T18:04:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c15dda0 con 0x7efc3c0d2640 2023-12-19T18:04:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3a59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7efc3c0b4720 0x7efc3c0b4b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55918/0 (socket says 172.21.15.45:55918) 2023-12-19T18:04:00.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3a59c700 1 -- 172.21.15.45:0/405652299 learned_addr learned my addr 172.21.15.45:0/405652299 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3ad9d700 1 --2- 172.21.15.45:0/405652299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0d2640 0x7efc3c167630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305501412 0 0) 0x7efc3c0d11a0 con 0x7efc3c0b4720 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc240035d0 con 0x7efc3c0b4720 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3979889898 0 0) 0x7efc3c15e360 con 0x7efc3c0b8630 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc3c0d11a0 con 0x7efc3c0b8630 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3ad9d700 1 -- 172.21.15.45:0/405652299 >> v1:172.21.15.73:6789/0 conn(0x7efc3c0b8630 legacy=0x7efc3c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3ad9d700 1 -- 172.21.15.45:0/405652299 >> v1:172.21.15.45:6789/0 conn(0x7efc3c0b4720 legacy=0x7efc3c0b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3ad9d700 1 -- 172.21.15.45:0/405652299 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc3c15e080 con 0x7efc3c0d2640 2023-12-19T18:04:00.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.688+0000 7efc3ad9d700 1 --2- 172.21.15.45:0/405652299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0d2640 0x7efc3c167630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc34009dc0 tx=0x7efc3400b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21478000b52be714 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:00.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3400e070 con 0x7efc3c0d2640 2023-12-19T18:04:00.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc3400bb20 con 0x7efc3c0d2640 2023-12-19T18:04:00.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3959a700 1 -- 172.21.15.45:0/405652299 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34012430 con 0x7efc3c0d2640 2023-12-19T18:04:00.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 -- 172.21.15.45:0/405652299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0d2640 msgr2=0x7efc3c167630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 --2- 172.21.15.45:0/405652299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0d2640 0x7efc3c167630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7efc34009dc0 tx=0x7efc3400b330 comp rx=0 tx=0).stop 2023-12-19T18:04:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 -- 172.21.15.45:0/405652299 shutdown_connections 2023-12-19T18:04:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 --2- 172.21.15.45:0/405652299 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0d2640 0x7efc3c167630 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 -- 172.21.15.45:0/405652299 >> 172.21.15.45:0/405652299 conn(0x7efc3c066320 msgr2=0x7efc3c0cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 -- 172.21.15.45:0/405652299 shutdown_connections 2023-12-19T18:04:00.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.692+0000 7efc3b59e700 1 -- 172.21.15.45:0/405652299 wait complete. 2023-12-19T18:04:00.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.696+0000 7efc3b59e700 1 Processor -- start 2023-12-19T18:04:00.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.696+0000 7efc3b59e700 1 -- start start 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.696+0000 7efc3b59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0b4720 0x7efc3c1577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0b8630 0x7efc3c153770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc3c0d2640 0x7efc3c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c153cb0 con 0x7efc3c0b8630 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c0c7f10 con 0x7efc3c0d2640 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc3c154500 con 0x7efc3c0b4720 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc39d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0b8630 0x7efc3c153770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc39d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0b8630 0x7efc3c153770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43952/0 (socket says 172.21.15.45:43952) 2023-12-19T18:04:00.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc39d9b700 1 -- 172.21.15.45:0/2854962758 learned_addr learned my addr 172.21.15.45:0/2854962758 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc3c0d2640 0x7efc3c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3a59c700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0b4720 0x7efc3c1577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 -- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0b4720 msgr2=0x7efc3c1577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0b4720 0x7efc3c1577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 -- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0b8630 msgr2=0x7efc3c153770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0b8630 0x7efc3c153770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 -- 172.21.15.45:0/2854962758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34009a70 con 0x7efc3c0d2640 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3ad9d700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc3c0d2640 0x7efc3c158350 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7efc34016000 tx=0x7efc34004af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc34012430 con 0x7efc3c0d2640 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc34020070 con 0x7efc3c0d2640 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc3c154220 con 0x7efc3c0d2640 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc3401ba90 con 0x7efc3c0d2640 2023-12-19T18:04:00.707 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.700+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3c0c7ba0 con 0x7efc3c0d2640 2023-12-19T18:04:00.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.704+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc3c0c8080 con 0x7efc3c0d2640 2023-12-19T18:04:00.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.704+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efc3404a080 con 0x7efc3c0d2640 2023-12-19T18:04:00.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.708+0000 7efc2affd700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc1c065ad0 0x7efc1c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.708+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7efc34048070 con 0x7efc3c0d2640 2023-12-19T18:04:00.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.708+0000 7efc3a59c700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc1c065ad0 0x7efc1c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:00.714 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.708+0000 7efc3a59c700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc1c065ad0 0x7efc1c067f90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7efc2c007fd0 tx=0x7efc2c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:00.719 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.712+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7efc34053300 con 0x7efc3c0d2640 2023-12-19T18:04:00.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.888+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc3c04ed30 con 0x7efc3c0d2640 2023-12-19T18:04:00.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.888+0000 7efc2affd700 1 -- 172.21.15.45:0/2854962758 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc3402c0a0 con 0x7efc3c0d2640 2023-12-19T18:04:00.896 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:04:00.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc1c065ad0 msgr2=0x7efc1c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc1c065ad0 0x7efc1c067f90 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7efc2c007fd0 tx=0x7efc2c007de0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc3c0d2640 msgr2=0x7efc3c158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:00.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc3c0d2640 0x7efc3c158350 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7efc34016000 tx=0x7efc34004af0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 shutdown_connections 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efc1c065ad0 0x7efc1c067f90 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efc3c0d2640 0x7efc3c158350 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efc3c0b8630 0x7efc3c153770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 --2- 172.21.15.45:0/2854962758 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efc3c0b4720 0x7efc3c1577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 >> 172.21.15.45:0/2854962758 conn(0x7efc3c066320 msgr2=0x7efc3c0b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.892+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 shutdown_connections 2023-12-19T18:04:00.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:00.896+0000 7efc3b59e700 1 -- 172.21.15.45:0/2854962758 wait complete. 2023-12-19T18:04:00.924 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-19T18:04:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.092+0000 7f8ef6c8c700 1 Processor -- start 2023-12-19T18:04:01.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.092+0000 7f8ef6c8c700 1 -- start start 2023-12-19T18:04:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef6c8c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ef00b46f0 0x7f8ef00b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef6c8c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ef00d1040 0x7f8ef00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef6c8c700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ef015e480 con 0x7f8ef015d470 2023-12-19T18:04:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef6c8c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef015dbe0 con 0x7f8ef00b46f0 2023-12-19T18:04:01.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef6c8c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ef015dec0 con 0x7f8ef00d1040 2023-12-19T18:04:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ef00b46f0 0x7f8ef00b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef648b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8ef00d1040 0x7f8ef00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8ef00b46f0 0x7f8ef00b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43968/0 (socket says 172.21.15.45:43968) 2023-12-19T18:04:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 -- 172.21.15.45:0/1326407110 learned_addr learned my addr 172.21.15.45:0/1326407110 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:01.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 -- 172.21.15.45:0/1326407110 >> v2:172.21.15.73:3300/0 conn(0x7f8ef00d1040 msgr2=0x7f8ef00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 --2- 172.21.15.45:0/1326407110 >> v2:172.21.15.73:3300/0 conn(0x7f8ef00d1040 0x7f8ef00d14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 -- 172.21.15.45:0/1326407110 >> v1:172.21.15.73:6789/0 conn(0x7f8ef015d470 legacy=0x7f8ef00b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 -- 172.21.15.45:0/1326407110 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef015e1a0 con 0x7f8ef00b46f0 2023-12-19T18:04:01.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef5c8a700 1 --2- 172.21.15.45:0/1326407110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef00b46f0 0x7f8ef00b8770 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00c65a0 tx=0x7f8eec009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8344ae9e17d8f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef4c88700 1 -- 172.21.15.45:0/1326407110 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec011830 con 0x7f8ef00b46f0 2023-12-19T18:04:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef4c88700 1 -- 172.21.15.45:0/1326407110 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eec011990 con 0x7f8ef00b46f0 2023-12-19T18:04:01.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.096+0000 7f8ef4c88700 1 -- 172.21.15.45:0/1326407110 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eec011d20 con 0x7f8ef00b46f0 2023-12-19T18:04:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1326407110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef00b46f0 msgr2=0x7f8ef00b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1326407110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef00b46f0 0x7f8ef00b8770 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00c65a0 tx=0x7f8eec009bf0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1326407110 shutdown_connections 2023-12-19T18:04:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1326407110 >> v2:172.21.15.73:3300/0 conn(0x7f8ef00d1040 0x7f8ef00d14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1326407110 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef00b46f0 0x7f8ef00b8770 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1326407110 >> 172.21.15.45:0/1326407110 conn(0x7f8ef0066380 msgr2=0x7f8ef00cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1326407110 shutdown_connections 2023-12-19T18:04:01.106 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.100+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1326407110 wait complete. 2023-12-19T18:04:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 Processor -- start 2023-12-19T18:04:01.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 -- start start 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ef00b46f0 0x7f8ef015f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ef00d1040 0x7f8ef0158f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 0x7f8ef00b7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef01602b0 con 0x7f8ef015d470 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef00b5e90 con 0x7f8ef00d1040 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef6c8c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef015fcf0 con 0x7f8ef00b46f0 2023-12-19T18:04:01.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 0x7f8ef00b7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 0x7f8ef00b7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43976/0 (socket says 172.21.15.45:43976) 2023-12-19T18:04:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 -- 172.21.15.45:0/1766381918 learned_addr learned my addr 172.21.15.45:0/1766381918 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef5c8a700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ef00b46f0 0x7f8ef015f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef5489700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ef00d1040 0x7f8ef0158f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 -- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ef00b46f0 msgr2=0x7f8ef015f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ef00b46f0 0x7f8ef015f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 -- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ef00d1040 msgr2=0x7f8ef0158f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ef00d1040 0x7f8ef0158f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.104+0000 7f8ef648b700 1 -- 172.21.15.45:0/1766381918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eec009570 con 0x7f8ef015d470 2023-12-19T18:04:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ef648b700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 0x7f8ef00b7670 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800efc0 tx=0x7f8ee800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:01.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8009ea0 con 0x7f8ef015d470 2023-12-19T18:04:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee800f040 con 0x7f8ef015d470 2023-12-19T18:04:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee800ced0 con 0x7f8ef015d470 2023-12-19T18:04:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ef015ffd0 con 0x7f8ef015d470 2023-12-19T18:04:01.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ef00b7bb0 con 0x7f8ef015d470 2023-12-19T18:04:01.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.108+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ef004ed30 con 0x7f8ef015d470 2023-12-19T18:04:01.117 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.112+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8ee8014480 con 0x7f8ef015d470 2023-12-19T18:04:01.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.112+0000 7f8ee67fc700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ed4065b20 0x7f8ed4067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.112+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f8ee8083ce0 con 0x7f8ef015d470 2023-12-19T18:04:01.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.112+0000 7f8ef5c8a700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ed4065b20 0x7f8ed4067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.120 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.116+0000 7f8ef5c8a700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ed4065b20 0x7f8ed4067fe0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:01.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.120+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8ee8051620 con 0x7f8ef015d470 2023-12-19T18:04:01.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.308+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8ef015cfb0 con 0x7f8ef015d470 2023-12-19T18:04:01.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.308+0000 7f8ee67fc700 1 -- 172.21.15.45:0/1766381918 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v131) v1 ==== 80+0+240 (secure 0 0 0) 0x7f8ee8018080 con 0x7f8ef015d470 2023-12-19T18:04:01.314 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6833/47731566 2023-12-20T18:03:47.951444+0000 2023-12-19T18:04:01.314 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6837/3417552399 2023-12-20T18:03:28.816185+0000 2023-12-19T18:04:01.314 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.73:6832/47731566 2023-12-20T18:03:47.951444+0000 2023-12-19T18:04:01.314 INFO:teuthology.orchestra.run.smithi045.stdout:172.21.15.45:6835/3417552399 2023-12-20T18:03:28.816185+0000 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.308+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ed4065b20 msgr2=0x7f8ed4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.308+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ed4065b20 0x7f8ed4067fe0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec008030 comp rx=0 tx=0).stop 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.308+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 msgr2=0x7f8ef00b7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.308+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 0x7f8ef00b7670 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f8ee800efc0 tx=0x7f8ee800c3a0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 shutdown_connections 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8ed4065b20 0x7f8ed4067fe0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8ef015d470 0x7f8ef00b7670 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ef00d1040 0x7f8ef0158f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 --2- 172.21.15.45:0/1766381918 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8ef00b46f0 0x7f8ef015f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 >> 172.21.15.45:0/1766381918 conn(0x7f8ef0066380 msgr2=0x7f8ef00cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:01.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 shutdown_connections 2023-12-19T18:04:01.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.312+0000 7f8ef6c8c700 1 -- 172.21.15.45:0/1766381918 wait complete. 2023-12-19T18:04:01.318 INFO:teuthology.orchestra.run.smithi045.stderr:listed 4 entries 2023-12-19T18:04:01.340 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi045.front.sepia.ceph.com... 2023-12-19T18:04:01.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:01.341 DEBUG:teuthology.orchestra.run.smithi045:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-19T18:04:01.371 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi045.stderr:ceph-fuse[60182]: fuse finished with error 0 and tester_r 0 2023-12-19T18:04:01.375 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:04:01.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:01.375 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-19T18:04:01.556 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:04:01.556 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:01.578 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:04:01.578 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:04:01.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:01.578 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-19T18:04:01.634 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-19T18:04:01.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:04:01.636 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:04:01.636 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:01.656 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:04:01.656 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:04:01.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:01.656 DEBUG:teuthology.orchestra.run.smithi045:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-19T18:04:01.725 INFO:teuthology.orchestra.run.smithi045.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-19T18:04:01.726 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:04:01.727 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:04:01.727 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:01.746 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:04:01.746 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:04:01.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:01.746 DEBUG:teuthology.orchestra.run.smithi073:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-19T18:04:01.806 INFO:teuthology.orchestra.run.smithi073.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-19T18:04:01.806 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:04:01.807 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:04:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 Processor -- start 2023-12-19T18:04:01.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 -- start start 2023-12-19T18:04:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7e815cf50 0x7fe7e80cc870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e815d330 0x7fe7e8161750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7e80c97e0 con 0x7fe7e80b05e0 2023-12-19T18:04:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7e80cac20 con 0x7fe7e815cf50 2023-12-19T18:04:01.991 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7ed53a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8161c90 con 0x7fe7e815d330 2023-12-19T18:04:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7e77fe700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fe7e80b05e0 0x7fe7e80b09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:60200/0 (socket says 172.21.15.45:60200) 2023-12-19T18:04:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7e6ffd700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe7e815cf50 0x7fe7e80cc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7e77fe700 1 -- 172.21.15.45:0/1048013200 learned_addr learned my addr 172.21.15.45:0/1048013200 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:01.992 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.984+0000 7fe7e67fc700 1 --2- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e815d330 0x7fe7e8161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e5ffb700 1 -- 172.21.15.45:0/1048013200 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519655034 0 0) 0x7fe7e80c97e0 con 0x7fe7e80b05e0 2023-12-19T18:04:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e5ffb700 1 -- 172.21.15.45:0/1048013200 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7d00035d0 con 0x7fe7e80b05e0 2023-12-19T18:04:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e6ffd700 1 -- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e815d330 msgr2=0x7fe7e8161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e6ffd700 1 --2- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e815d330 0x7fe7e8161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.993 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e6ffd700 1 -- 172.21.15.45:0/1048013200 >> v1:172.21.15.73:6789/0 conn(0x7fe7e80b05e0 legacy=0x7fe7e80b09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e6ffd700 1 -- 172.21.15.45:0/1048013200 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e80cce50 con 0x7fe7e815cf50 2023-12-19T18:04:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e6ffd700 1 --2- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815cf50 0x7fe7e80cc870 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009850 tx=0x7fe7d8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91dc286e52569c9a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:01.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e5ffb700 1 -- 172.21.15.45:0/1048013200 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8011830 con 0x7fe7e815cf50 2023-12-19T18:04:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e5ffb700 1 -- 172.21.15.45:0/1048013200 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d8011990 con 0x7fe7e815cf50 2023-12-19T18:04:01.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7e5ffb700 1 -- 172.21.15.45:0/1048013200 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d8011d40 con 0x7fe7e815cf50 2023-12-19T18:04:01.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 -- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815cf50 msgr2=0x7fe7e80cc870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815cf50 0x7fe7e80cc870 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8009850 tx=0x7fe7d8009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 -- 172.21.15.45:0/1048013200 shutdown_connections 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e815d330 0x7fe7e8161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/1048013200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815cf50 0x7fe7e80cc870 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 -- 172.21.15.45:0/1048013200 >> 172.21.15.45:0/1048013200 conn(0x7fe7e806a870 msgr2=0x7fe7e80ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 -- 172.21.15.45:0/1048013200 shutdown_connections 2023-12-19T18:04:01.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.988+0000 7fe7ed53a700 1 -- 172.21.15.45:0/1048013200 wait complete. 2023-12-19T18:04:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.992+0000 7fe7ed53a700 1 Processor -- start 2023-12-19T18:04:01.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.992+0000 7fe7ed53a700 1 -- start start 2023-12-19T18:04:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e80b05e0 0x7fe7e81f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 0x7fe7e80c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815d330 0x7fe7e815f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e8160770 con 0x7fe7e815cf50 2023-12-19T18:04:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e815e910 con 0x7fe7e815d330 2023-12-19T18:04:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e81f3910 con 0x7fe7e80b05e0 2023-12-19T18:04:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 0x7fe7e80c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 0x7fe7e80c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43978/0 (socket says 172.21.15.45:43978) 2023-12-19T18:04:02.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 -- 172.21.15.45:0/2971756232 learned_addr learned my addr 172.21.15.45:0/2971756232 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e6ffd700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e80b05e0 0x7fe7e81f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e77fe700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815d330 0x7fe7e815f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.003 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 -- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e80b05e0 msgr2=0x7fe7e81f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e80b05e0 0x7fe7e81f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 -- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815d330 msgr2=0x7fe7e815f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815d330 0x7fe7e815f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 -- 172.21.15.45:0/2971756232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d80094b0 con 0x7fe7e815cf50 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e77fe700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815d330 0x7fe7e815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7e67fc700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 0x7fe7e80c8980 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00e9d0 tx=0x7fe7dc00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc009720 con 0x7fe7e815cf50 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7dc00c850 con 0x7fe7e815cf50 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7dc00cbc0 con 0x7fe7e815cf50 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e815eda0 con 0x7fe7e815cf50 2023-12-19T18:04:02.004 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:01.996+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e815dfe0 con 0x7fe7e815cf50 2023-12-19T18:04:02.005 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.000+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e80741d0 con 0x7fe7e815cf50 2023-12-19T18:04:02.007 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.000+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe7dc00cd20 con 0x7fe7e815cf50 2023-12-19T18:04:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.000+0000 7fe7cf7fe700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7d4065ad0 0x7fe7d4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.004+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fe7dc083550 con 0x7fe7e815cf50 2023-12-19T18:04:02.008 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.004+0000 7fe7e6ffd700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7d4065ad0 0x7fe7d4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.010 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.004+0000 7fe7e6ffd700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7d4065ad0 0x7fe7d4067f90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80090b0 tx=0x7fe7d8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.015 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.008+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe7dc050c00 con 0x7fe7e815cf50 2023-12-19T18:04:02.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.224+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7e80b4780 con 0x7fe7e815cf50 2023-12-19T18:04:02.232 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.224+0000 7fe7cf7fe700 1 -- 172.21.15.45:0/2971756232 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4717 (secure 0 0 0) 0x7fe7dc054220 con 0x7fe7e815cf50 2023-12-19T18:04:02.232 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:02.232 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:54.718515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.228+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7d4065ad0 msgr2=0x7fe7d4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.228+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7d4065ad0 0x7fe7d4067f90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe7d80090b0 tx=0x7fe7d8008030 comp rx=0 tx=0).stop 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.228+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 msgr2=0x7fe7e80c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.228+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 0x7fe7e80c8980 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7fe7dc00e9d0 tx=0x7fe7dc00ed90 comp rx=0 tx=0).stop 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 shutdown_connections 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe7d4065ad0 0x7fe7d4067f90 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7e815d330 0x7fe7e815f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe7e815cf50 0x7fe7e80c8980 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 --2- 172.21.15.45:0/2971756232 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe7e80b05e0 0x7fe7e81f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.237 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 >> 172.21.15.45:0/2971756232 conn(0x7fe7e806a870 msgr2=0x7fe7e806cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:02.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 shutdown_connections 2023-12-19T18:04:02.238 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.232+0000 7fe7ed53a700 1 -- 172.21.15.45:0/2971756232 wait complete. 2023-12-19T18:04:02.239 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 112 2023-12-19T18:04:02.264 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:04:02.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:04:02.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:04:02.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.436+0000 7faddb48c700 1 Processor -- start 2023-12-19T18:04:02.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.436+0000 7faddb48c700 1 -- start start 2023-12-19T18:04:02.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddb48c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fadd415cf80 0x7fadd40d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddb48c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fadd40b88e0 0x7fadd40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddb48c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd40cdf80 0x7fadd406b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddb48c700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd40ce3a0 con 0x7fadd415cf80 2023-12-19T18:04:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddb48c700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadd415d360 con 0x7fadd40b88e0 2023-12-19T18:04:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddb48c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40d2950 con 0x7fadd40cdf80 2023-12-19T18:04:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fadd415cf80 0x7fadd40d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fadd415cf80 0x7fadd40d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:43994/0 (socket says 172.21.15.45:43994) 2023-12-19T18:04:02.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 -- 172.21.15.45:0/1055711945 learned_addr learned my addr 172.21.15.45:0/1055711945 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7faddac8b700 1 --2- 172.21.15.45:0/1055711945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd40cdf80 0x7fadd406b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadd9c89700 1 --2- 172.21.15.45:0/1055711945 >> v2:172.21.15.73:3300/0 conn(0x7fadd40b88e0 0x7fadd40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 -- 172.21.15.45:0/1055711945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd40cdf80 msgr2=0x7fadd406b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 --2- 172.21.15.45:0/1055711945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd40cdf80 0x7fadd406b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 -- 172.21.15.45:0/1055711945 >> v2:172.21.15.73:3300/0 conn(0x7fadd40b88e0 msgr2=0x7fadd40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 --2- 172.21.15.45:0/1055711945 >> v2:172.21.15.73:3300/0 conn(0x7fadd40b88e0 0x7fadd40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 -- 172.21.15.45:0/1055711945 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd40d18b0 con 0x7fadd415cf80 2023-12-19T18:04:02.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadda48a700 1 --2- 172.21.15.45:0/1055711945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd415cf80 0x7fadd40d1040 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fadd40d0f90 tx=0x7fadd0009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3ebb2001e4cf22 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadd9488700 1 -- 172.21.15.45:0/1055711945 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000b8a0 con 0x7fadd415cf80 2023-12-19T18:04:02.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadd9488700 1 -- 172.21.15.45:0/1055711945 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd000ba00 con 0x7fadd415cf80 2023-12-19T18:04:02.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.440+0000 7fadd9488700 1 -- 172.21.15.45:0/1055711945 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd000bd90 con 0x7fadd415cf80 2023-12-19T18:04:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 -- 172.21.15.45:0/1055711945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd415cf80 msgr2=0x7fadd40d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 --2- 172.21.15.45:0/1055711945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd415cf80 0x7fadd40d1040 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7fadd40d0f90 tx=0x7fadd0009bf0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 -- 172.21.15.45:0/1055711945 shutdown_connections 2023-12-19T18:04:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 --2- 172.21.15.45:0/1055711945 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd40cdf80 0x7fadd406b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 --2- 172.21.15.45:0/1055711945 >> v2:172.21.15.73:3300/0 conn(0x7fadd40b88e0 0x7fadd40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 --2- 172.21.15.45:0/1055711945 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd415cf80 0x7fadd40d1040 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 -- 172.21.15.45:0/1055711945 >> 172.21.15.45:0/1055711945 conn(0x7fadd4066380 msgr2=0x7fadd40cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 -- 172.21.15.45:0/1055711945 shutdown_connections 2023-12-19T18:04:02.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.444+0000 7faddb48c700 1 -- 172.21.15.45:0/1055711945 wait complete. 2023-12-19T18:04:02.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 Processor -- start 2023-12-19T18:04:02.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 -- start start 2023-12-19T18:04:02.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 0x7fadd41550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd40cdf80 0x7fadd4152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd415cf80 0x7fadd4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4157800 con 0x7fadd40b88e0 2023-12-19T18:04:02.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4159510 con 0x7fadd40cdf80 2023-12-19T18:04:02.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddb48c700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadd41526d0 con 0x7fadd415cf80 2023-12-19T18:04:02.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 0x7fadd41550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 0x7fadd41550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44008/0 (socket says 172.21.15.45:44008) 2023-12-19T18:04:02.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 -- 172.21.15.45:0/2390161248 learned_addr learned my addr 172.21.15.45:0/2390161248 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:02.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadd9c89700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd40cdf80 0x7fadd4152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7faddac8b700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd415cf80 0x7fadd4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 -- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd415cf80 msgr2=0x7fadd4158bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd415cf80 0x7fadd4158bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 -- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd40cdf80 msgr2=0x7fadd4152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd40cdf80 0x7fadd4152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.448+0000 7fadda48a700 1 -- 172.21.15.45:0/2390161248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009570 con 0x7fadd40b88e0 2023-12-19T18:04:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7fadda48a700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 0x7fadd41550f0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000c00 tx=0x7fadd0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd00038c0 con 0x7fadd40b88e0 2023-12-19T18:04:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd001e070 con 0x7fadd40b88e0 2023-12-19T18:04:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd4154330 con 0x7fadd40b88e0 2023-12-19T18:04:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd0003c80 con 0x7fadd40b88e0 2023-12-19T18:04:02.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd41548f0 con 0x7fadd40b88e0 2023-12-19T18:04:02.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd404ed30 con 0x7fadd40b88e0 2023-12-19T18:04:02.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.452+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fadd0011420 con 0x7fadd40b88e0 2023-12-19T18:04:02.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.456+0000 7fadcaffd700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadb8065ad0 0x7fadb8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.456+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fadd0020070 con 0x7fadd40b88e0 2023-12-19T18:04:02.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.456+0000 7fadd9c89700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadb8065ad0 0x7fadb8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.456+0000 7fadd9c89700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadb8065ad0 0x7fadb8067f90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fadd4159fa0 tx=0x7fadc4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.460+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fadd0052200 con 0x7fadd40b88e0 2023-12-19T18:04:02.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.640+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadd40c95d0 con 0x7fadd40b88e0 2023-12-19T18:04:02.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.644+0000 7fadcaffd700 1 -- 172.21.15.45:0/2390161248 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16523 (secure 0 0 0) 0x7fadd0055820 con 0x7fadd40b88e0 2023-12-19T18:04:02.652 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:02.652 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":131,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:47.951495+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6833/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.73:6832/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:04:02.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadb8065ad0 msgr2=0x7fadb8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadb8065ad0 0x7fadb8067f90 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fadd4159fa0 tx=0x7fadc4008040 comp rx=0 tx=0).stop 2023-12-19T18:04:02.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 msgr2=0x7fadd41550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 0x7fadd41550f0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7fadd0000c00 tx=0x7fadd0004770 comp rx=0 tx=0).stop 2023-12-19T18:04:02.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 shutdown_connections 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadb8065ad0 0x7fadb8067f90 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fadd415cf80 0x7fadd4158bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadd40cdf80 0x7fadd4152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 --2- 172.21.15.45:0/2390161248 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fadd40b88e0 0x7fadd41550f0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 >> 172.21.15.45:0/2390161248 conn(0x7fadd4066380 msgr2=0x7fadd40cf190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 shutdown_connections 2023-12-19T18:04:02.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.648+0000 7faddb48c700 1 -- 172.21.15.45:0/2390161248 wait complete. 2023-12-19T18:04:02.679 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-19T17:51:26.279639+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-19T18:02:59.579656+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '128', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_data', 'create_time': '2023-12-19T18:03:00.531245+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '129', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-19T18:04:02.680 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-19T18:04:02.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.864+0000 7fcdaf234700 1 Processor -- start 2023-12-19T18:04:02.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.864+0000 7fcdaf234700 1 -- start start 2023-12-19T18:04:02.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdaf234700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcda815d110 0x7fcda80c9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdaf234700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fcda8070660 0x7fcda80b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdaf234700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8160d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdaf234700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80cabb0 con 0x7fcda815d110 2023-12-19T18:04:02.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdaf234700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcda80b0f70 con 0x7fcda8070660 2023-12-19T18:04:02.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdaf234700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80ca030 con 0x7fcda80b0b20 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcda815d110 0x7fcda80c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fcda815d110 0x7fcda80c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44010/0 (socket says 172.21.15.45:44010) 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 -- 172.21.15.45:0/1244700079 learned_addr learned my addr 172.21.15.45:0/1244700079 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdad7d1700 1 --2- 172.21.15.45:0/1244700079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8160d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcd9ffff700 1 --2- 172.21.15.45:0/1244700079 >> v2:172.21.15.73:3300/0 conn(0x7fcda8070660 0x7fcda80b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 -- 172.21.15.45:0/1244700079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 msgr2=0x7fcda8160d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 --2- 172.21.15.45:0/1244700079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8160d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 -- 172.21.15.45:0/1244700079 >> v2:172.21.15.73:3300/0 conn(0x7fcda8070660 msgr2=0x7fcda80b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 --2- 172.21.15.45:0/1244700079 >> v2:172.21.15.73:3300/0 conn(0x7fcda8070660 0x7fcda80b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 -- 172.21.15.45:0/1244700079 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda80ca310 con 0x7fcda815d110 2023-12-19T18:04:02.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.868+0000 7fcdacfd0700 1 --2- 172.21.15.45:0/1244700079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda80c9750 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fcda80cea80 tx=0x7fcda4009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74eeae49f02fff94 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcd9f7fe700 1 -- 172.21.15.45:0/1244700079 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4011830 con 0x7fcda815d110 2023-12-19T18:04:02.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcd9f7fe700 1 -- 172.21.15.45:0/1244700079 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda4011990 con 0x7fcda815d110 2023-12-19T18:04:02.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcd9f7fe700 1 -- 172.21.15.45:0/1244700079 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda4011d20 con 0x7fcda815d110 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 -- 172.21.15.45:0/1244700079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 msgr2=0x7fcda80c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 --2- 172.21.15.45:0/1244700079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda80c9750 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fcda80cea80 tx=0x7fcda4009bf0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 -- 172.21.15.45:0/1244700079 shutdown_connections 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 --2- 172.21.15.45:0/1244700079 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8160d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 --2- 172.21.15.45:0/1244700079 >> v2:172.21.15.73:3300/0 conn(0x7fcda8070660 0x7fcda80b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 --2- 172.21.15.45:0/1244700079 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda80c9750 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 -- 172.21.15.45:0/1244700079 >> 172.21.15.45:0/1244700079 conn(0x7fcda80ceb20 msgr2=0x7fcda80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:02.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 -- 172.21.15.45:0/1244700079 shutdown_connections 2023-12-19T18:04:02.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.872+0000 7fcdaf234700 1 -- 172.21.15.45:0/1244700079 wait complete. 2023-12-19T18:04:02.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 Processor -- start 2023-12-19T18:04:02.881 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 -- start start 2023-12-19T18:04:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcda8070660 0x7fcda80b41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda81f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80b46f0 con 0x7fcda815d110 2023-12-19T18:04:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80b1720 con 0x7fcda8070660 2023-12-19T18:04:02.883 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdaf234700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcda80c3170 con 0x7fcda80b0b20 2023-12-19T18:04:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda81f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda81f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44018/0 (socket says 172.21.15.45:44018) 2023-12-19T18:04:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 -- 172.21.15.45:0/3640728639 learned_addr learned my addr 172.21.15.45:0/3640728639 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdacfd0700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcda8070660 0x7fcda80b41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcd9ffff700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 -- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 msgr2=0x7fcda8155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 -- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcda8070660 msgr2=0x7fcda80b41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcda8070660 0x7fcda80b41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.876+0000 7fcdad7d1700 1 -- 172.21.15.45:0/3640728639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4009570 con 0x7fcda815d110 2023-12-19T18:04:02.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcdad7d1700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda81f61d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fcda000efc0 tx=0x7fcda000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0009ea0 con 0x7fcda815d110 2023-12-19T18:04:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda000f040 con 0x7fcda815d110 2023-12-19T18:04:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda80c3450 con 0x7fcda815d110 2023-12-19T18:04:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0014480 con 0x7fcda815d110 2023-12-19T18:04:02.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda80c3a10 con 0x7fcda815d110 2023-12-19T18:04:02.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda80c3ba0 con 0x7fcda815d110 2023-12-19T18:04:02.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.880+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fcda00145e0 con 0x7fcda815d110 2023-12-19T18:04:02.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.884+0000 7fcd9d7fa700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd94065ad0 0x7fcd94067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:02.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.884+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fcda0083c50 con 0x7fcda815d110 2023-12-19T18:04:02.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.884+0000 7fcdacfd0700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd94065ad0 0x7fcd94067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:02.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.884+0000 7fcdacfd0700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd94065ad0 0x7fcd94067f90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000c00 tx=0x7fcda4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:02.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:02.892+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fcda0051380 con 0x7fcda815d110 2023-12-19T18:04:03.069 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.064+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcda80ca8a0 con 0x7fcda815d110 2023-12-19T18:04:03.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.064+0000 7fcd9d7fa700 1 -- 172.21.15.45:0/3640728639 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v131) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcda00180a0 con 0x7fcda815d110 2023-12-19T18:04:03.071 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 1 2023-12-19T18:04:03.075 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd94065ad0 msgr2=0x7fcd94067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd94065ad0 0x7fcd94067f90 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fcda4000c00 tx=0x7fcda4008030 comp rx=0 tx=0).stop 2023-12-19T18:04:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 msgr2=0x7fcda81f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda81f61d0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fcda000efc0 tx=0x7fcda000c3a0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 shutdown_connections 2023-12-19T18:04:03.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fcd94065ad0 0x7fcd94067f90 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fcda815d110 0x7fcda81f61d0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fcda80b0b20 0x7fcda8155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 --2- 172.21.15.45:0/3640728639 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcda8070660 0x7fcda80b41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 >> 172.21.15.45:0/3640728639 conn(0x7fcda80ceb20 msgr2=0x7fcda80cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.068+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 shutdown_connections 2023-12-19T18:04:03.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.072+0000 7fcdaf234700 1 -- 172.21.15.45:0/3640728639 wait complete. 2023-12-19T18:04:03.100 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-19T18:04:03.282 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.276+0000 7f66002b5700 1 Processor -- start 2023-12-19T18:04:03.283 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.276+0000 7f66002b5700 1 -- start start 2023-12-19T18:04:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f66002b5700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f65f8159f20 0x7f65f80b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f66002b5700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f65f80caf60 0x7f65f80adf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f66002b5700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f815a300 con 0x7f65f80cd910 2023-12-19T18:04:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f66002b5700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f80cde80 con 0x7f65f80caf60 2023-12-19T18:04:03.286 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f66002b5700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f80add20 con 0x7f65f8159f20 2023-12-19T18:04:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f65f80caf60 0x7f65f80adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f65f80caf60 0x7f65f80adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44034/0 (socket says 172.21.15.45:44034) 2023-12-19T18:04:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 -- 172.21.15.45:0/1463105136 learned_addr learned my addr 172.21.15.45:0/1463105136 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe051700 1 --2- 172.21.15.45:0/1463105136 >> v2:172.21.15.73:3300/0 conn(0x7f65f8159f20 0x7f65f80b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 -- 172.21.15.45:0/1463105136 >> v2:172.21.15.73:3300/0 conn(0x7f65f8159f20 msgr2=0x7f65f80b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:03.287 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 --2- 172.21.15.45:0/1463105136 >> v2:172.21.15.73:3300/0 conn(0x7f65f8159f20 0x7f65f80b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 -- 172.21.15.45:0/1463105136 >> v1:172.21.15.73:6789/0 conn(0x7f65f80cd910 legacy=0x7f65f80ca850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 -- 172.21.15.45:0/1463105136 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f806db20 con 0x7f65f80caf60 2023-12-19T18:04:03.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.280+0000 7f65fe852700 1 --2- 172.21.15.45:0/1463105136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80caf60 0x7f65f80adf50 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f65f806ec70 tx=0x7f65f000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3177437c5430515 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f65fd04f700 1 -- 172.21.15.45:0/1463105136 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000e070 con 0x7f65f80caf60 2023-12-19T18:04:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f65fd04f700 1 -- 172.21.15.45:0/1463105136 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f000b910 con 0x7f65f80caf60 2023-12-19T18:04:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f65fd04f700 1 -- 172.21.15.45:0/1463105136 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f000bcc0 con 0x7f65f80caf60 2023-12-19T18:04:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 -- 172.21.15.45:0/1463105136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80caf60 msgr2=0x7f65f80adf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 --2- 172.21.15.45:0/1463105136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80caf60 0x7f65f80adf50 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7f65f806ec70 tx=0x7f65f000b330 comp rx=0 tx=0).stop 2023-12-19T18:04:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 -- 172.21.15.45:0/1463105136 shutdown_connections 2023-12-19T18:04:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 --2- 172.21.15.45:0/1463105136 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80caf60 0x7f65f80adf50 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 --2- 172.21.15.45:0/1463105136 >> v2:172.21.15.73:3300/0 conn(0x7f65f8159f20 0x7f65f80b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 -- 172.21.15.45:0/1463105136 >> 172.21.15.45:0/1463105136 conn(0x7f65f80ceb20 msgr2=0x7f65f80cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 -- 172.21.15.45:0/1463105136 shutdown_connections 2023-12-19T18:04:03.290 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 -- 172.21.15.45:0/1463105136 wait complete. 2023-12-19T18:04:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.284+0000 7f66002b5700 1 Processor -- start 2023-12-19T18:04:03.292 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 -- start start 2023-12-19T18:04:03.293 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80caf60 0x7f65f8157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 0x7f65f80c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f65f8159f20 0x7f65f80ab980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81e8080 con 0x7f65f80cd910 2023-12-19T18:04:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f80c8390 con 0x7f65f80caf60 2023-12-19T18:04:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f66002b5700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f81f2e00 con 0x7f65f8159f20 2023-12-19T18:04:03.294 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fd850700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 0x7f65f80c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80caf60 0x7f65f8157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fd850700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 0x7f65f80c7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44042/0 (socket says 172.21.15.45:44042) 2023-12-19T18:04:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fd850700 1 -- 172.21.15.45:0/2196024865 learned_addr learned my addr 172.21.15.45:0/2196024865 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe852700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f65f8159f20 0x7f65f80ab980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 -- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f65f8159f20 msgr2=0x7f65f80ab980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.295 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f65f8159f20 0x7f65f80ab980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 -- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 msgr2=0x7f65f80c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 0x7f65f80c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 -- 172.21.15.45:0/2196024865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f0009b30 con 0x7f65f80caf60 2023-12-19T18:04:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fd850700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 0x7f65f80c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:03.296 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65fe051700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80caf60 0x7f65f8157c00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f65f400e870 tx=0x7f65f400eb80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4013680 con 0x7f65f80caf60 2023-12-19T18:04:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.288+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f40137e0 con 0x7f65f80caf60 2023-12-19T18:04:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.292+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f81f30e0 con 0x7f65f80caf60 2023-12-19T18:04:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.292+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f4013b70 con 0x7f65f80caf60 2023-12-19T18:04:03.297 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.292+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f80c8670 con 0x7f65f80caf60 2023-12-19T18:04:03.298 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.292+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f80cc640 con 0x7f65f80caf60 2023-12-19T18:04:03.300 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.292+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f65f4013cd0 con 0x7f65f80caf60 2023-12-19T18:04:03.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.296+0000 7f65eeffd700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f65dc065ad0 0x7f65dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.296+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f65f40830f0 con 0x7f65f80caf60 2023-12-19T18:04:03.301 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.296+0000 7f65fd850700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f65dc065ad0 0x7f65dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.302 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.296+0000 7f65fd850700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f65dc065ad0 0x7f65dc067f90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f65e8001d30 tx=0x7f65e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:03.307 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.300+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f65f40508d0 con 0x7f65f80caf60 2023-12-19T18:04:03.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.480+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65f80cc640 con 0x7f65f80caf60 2023-12-19T18:04:03.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.480+0000 7f65eeffd700 1 -- 172.21.15.45:0/2196024865 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v131) v1 ==== 104+0+11 (secure 0 0 0) 0x7f65f80cc640 con 0x7f65f80caf60 2023-12-19T18:04:03.487 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 32 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f65dc065ad0 msgr2=0x7f65dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f65dc065ad0 0x7f65dc067f90 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f65e8001d30 tx=0x7f65e8009040 comp rx=0 tx=0).stop 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80caf60 msgr2=0x7f65f8157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80caf60 0x7f65f8157c00 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f65f400e870 tx=0x7f65f400eb80 comp rx=0 tx=0).stop 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 shutdown_connections 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f65dc065ad0 0x7f65dc067f90 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f65f8159f20 0x7f65f80ab980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f65f80cd910 0x7f65f80c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 --2- 172.21.15.45:0/2196024865 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f65f80caf60 0x7f65f8157c00 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 >> 172.21.15.45:0/2196024865 conn(0x7f65f80ceb20 msgr2=0x7f65f80ac640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:03.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 shutdown_connections 2023-12-19T18:04:03.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.484+0000 7f66002b5700 1 -- 172.21.15.45:0/2196024865 wait complete. 2023-12-19T18:04:03.513 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-19T18:04:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.692+0000 7fe8c359e700 1 Processor -- start 2023-12-19T18:04:03.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.692+0000 7fe8c359e700 1 -- start start 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c359e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fe8c40b8630 0x7fe8c415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c359e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c40d11a0 con 0x7fe8c415d8b0 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c359e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c415e360 con 0x7fe8c40b4720 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c359e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c415dda0 con 0x7fe8c40b8630 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c2d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fe8c415d8b0 0x7fe8c40d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55924/0 (socket says 172.21.15.45:55924) 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c2d9d700 1 -- 172.21.15.45:0/1836408918 learned_addr learned my addr 172.21.15.45:0/1836408918 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:03.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c1d9b700 1 --2- 172.21.15.45:0/1836408918 >> v2:172.21.15.73:3300/0 conn(0x7fe8c40b8630 0x7fe8c415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417097139 0 0) 0x7fe8c415e360 con 0x7fe8c40b4720 2023-12-19T18:04:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8ac0035d0 con 0x7fe8c40b4720 2023-12-19T18:04:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976589751 0 0) 0x7fe8c40d11a0 con 0x7fe8c415d8b0 2023-12-19T18:04:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe8c415e360 con 0x7fe8c415d8b0 2023-12-19T18:04:03.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c1d9b700 1 -- 172.21.15.45:0/1836408918 >> v1:172.21.15.73:6789/0 conn(0x7fe8c40b4720 legacy=0x7fe8c40b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c1d9b700 1 -- 172.21.15.45:0/1836408918 >> v1:172.21.15.45:6789/0 conn(0x7fe8c415d8b0 legacy=0x7fe8c40d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c1d9b700 1 -- 172.21.15.45:0/1836408918 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c415e080 con 0x7fe8c40b8630 2023-12-19T18:04:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.696+0000 7fe8c1d9b700 1 --2- 172.21.15.45:0/1836408918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c415d370 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009850 tx=0x7fe8b8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f8e958c35bf9924 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8011830 con 0x7fe8c40b8630 2023-12-19T18:04:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b8011990 con 0x7fe8c40b8630 2023-12-19T18:04:03.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c159a700 1 -- 172.21.15.45:0/1836408918 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b8011d40 con 0x7fe8c40b8630 2023-12-19T18:04:03.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 -- 172.21.15.45:0/1836408918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 msgr2=0x7fe8c415d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 --2- 172.21.15.45:0/1836408918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c415d370 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fe8b8009850 tx=0x7fe8b8009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:03.705 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 -- 172.21.15.45:0/1836408918 shutdown_connections 2023-12-19T18:04:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 --2- 172.21.15.45:0/1836408918 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c415d370 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 -- 172.21.15.45:0/1836408918 >> 172.21.15.45:0/1836408918 conn(0x7fe8c4066320 msgr2=0x7fe8c40cf720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 -- 172.21.15.45:0/1836408918 shutdown_connections 2023-12-19T18:04:03.706 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 -- 172.21.15.45:0/1836408918 wait complete. 2023-12-19T18:04:03.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 Processor -- start 2023-12-19T18:04:03.708 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.700+0000 7fe8c359e700 1 -- start start 2023-12-19T18:04:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 0x7fe8c414af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c41f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8c415d8b0 0x7fe8c40d2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41f6310 con 0x7fe8c40b4720 2023-12-19T18:04:03.710 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41f5d50 con 0x7fe8c40b8630 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c41f6030 con 0x7fe8c415d8b0 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 0x7fe8c414af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 0x7fe8c414af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44048/0 (socket says 172.21.15.45:44048) 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 -- 172.21.15.45:0/303850020 learned_addr learned my addr 172.21.15.45:0/303850020 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c1d9b700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c41f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c2d9d700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8c415d8b0 0x7fe8c40d2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 -- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8c415d8b0 msgr2=0x7fe8c40d2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8c415d8b0 0x7fe8c40d2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 -- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 msgr2=0x7fe8c41f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c41f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 -- 172.21.15.45:0/303850020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b80094b0 con 0x7fe8c40b4720 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c1d9b700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c41f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:03.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c259c700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 0x7fe8c414af90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40010e0 tx=0x7fe8b400ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40052d0 con 0x7fe8c40b4720 2023-12-19T18:04:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c41e33c0 con 0x7fe8c40b4720 2023-12-19T18:04:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b4005430 con 0x7fe8c40b4720 2023-12-19T18:04:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b40055a0 con 0x7fe8c40b4720 2023-12-19T18:04:03.712 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.704+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c414b4d0 con 0x7fe8c40b4720 2023-12-19T18:04:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.708+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c404ed30 con 0x7fe8c40b4720 2023-12-19T18:04:03.713 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.708+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fe8b40038c0 con 0x7fe8c40b4720 2023-12-19T18:04:03.715 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.708+0000 7fe8b2ffd700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8a4065b00 0x7fe8a4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.708+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fe8b4082930 con 0x7fe8c40b4720 2023-12-19T18:04:03.716 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.712+0000 7fe8c1d9b700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8a4065b00 0x7fe8a4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:03.717 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.712+0000 7fe8c1d9b700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8a4065b00 0x7fe8a4067fc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40b8a70 tx=0x7fe8b8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:03.722 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.716+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fe8b4050070 con 0x7fe8c40b4720 2023-12-19T18:04:03.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.892+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8c41e38e0 con 0x7fe8c40b4720 2023-12-19T18:04:03.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8b2ffd700 1 -- 172.21.15.45:0/303850020 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v131) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe8b4053690 con 0x7fe8c40b4720 2023-12-19T18:04:03.901 INFO:teuthology.orchestra.run.smithi045.stdout:pg_num: 64 2023-12-19T18:04:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8a4065b00 msgr2=0x7fe8a4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.904 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8a4065b00 0x7fe8a4067fc0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fe8c40b8a70 tx=0x7fe8b8008030 comp rx=0 tx=0).stop 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 msgr2=0x7fe8c414af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 0x7fe8c414af90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40010e0 tx=0x7fe8b400ca90 comp rx=0 tx=0).stop 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 shutdown_connections 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fe8a4065b00 0x7fe8a4067fc0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fe8c415d8b0 0x7fe8c40d2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.896+0000 7fe8c359e700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe8c40b8630 0x7fe8c41f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.900+0000 7fe8c359e700 1 --2- 172.21.15.45:0/303850020 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fe8c40b4720 0x7fe8c414af90 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.900+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 >> 172.21.15.45:0/303850020 conn(0x7fe8c4066320 msgr2=0x7fe8c40c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.900+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 shutdown_connections 2023-12-19T18:04:03.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:03.900+0000 7fe8c359e700 1 -- 172.21.15.45:0/303850020 wait complete. 2023-12-19T18:04:03.927 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:04:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.092+0000 7f8e29851700 1 Processor -- start 2023-12-19T18:04:04.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.092+0000 7f8e29851700 1 -- start start 2023-12-19T18:04:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.092+0000 7f8e29851700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8e240b22b0 0x7f8e240b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.092+0000 7f8e29851700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e240d11c0 con 0x7f8e2415d370 2023-12-19T18:04:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.092+0000 7f8e29851700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e240d1d40 con 0x7f8e240b50b0 2023-12-19T18:04:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.092+0000 7f8e29851700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e240b5540 con 0x7f8e240b22b0 2023-12-19T18:04:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e22ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f8e2415d370 0x7f8e240d25e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55928/0 (socket says 172.21.15.45:55928) 2023-12-19T18:04:04.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e22ffd700 1 -- 172.21.15.45:0/215434439 learned_addr learned my addr 172.21.15.45:0/215434439 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:04.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e227fc700 1 --2- 172.21.15.45:0/215434439 >> v2:172.21.15.73:3300/0 conn(0x7f8e240b22b0 0x7f8e240b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e21ffb700 1 -- 172.21.15.45:0/215434439 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092379796 0 0) 0x7f8e240d11c0 con 0x7f8e2415d370 2023-12-19T18:04:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e21ffb700 1 -- 172.21.15.45:0/215434439 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e0c0035d0 con 0x7f8e2415d370 2023-12-19T18:04:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e227fc700 1 -- 172.21.15.45:0/215434439 >> v1:172.21.15.73:6789/0 conn(0x7f8e240b50b0 legacy=0x7f8e240b60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e21ffb700 1 -- 172.21.15.45:0/215434439 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1815601351 0 0) 0x7f8e240d1d40 con 0x7f8e240b50b0 2023-12-19T18:04:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e227fc700 1 -- 172.21.15.45:0/215434439 >> v1:172.21.15.45:6789/0 conn(0x7f8e2415d370 legacy=0x7f8e240d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e227fc700 1 -- 172.21.15.45:0/215434439 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e240d1410 con 0x7f8e240b22b0 2023-12-19T18:04:04.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e227fc700 1 --2- 172.21.15.45:0/215434439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b22b0 0x7f8e240b4b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009850 tx=0x7f8e18009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f34797f3f58738d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e21ffb700 1 -- 172.21.15.45:0/215434439 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18011830 con 0x7f8e240b22b0 2023-12-19T18:04:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e21ffb700 1 -- 172.21.15.45:0/215434439 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e18011990 con 0x7f8e240b22b0 2023-12-19T18:04:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e21ffb700 1 -- 172.21.15.45:0/215434439 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18011d40 con 0x7f8e240b22b0 2023-12-19T18:04:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 -- 172.21.15.45:0/215434439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b22b0 msgr2=0x7f8e240b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.103 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 --2- 172.21.15.45:0/215434439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b22b0 0x7f8e240b4b70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f8e18009850 tx=0x7f8e18009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 -- 172.21.15.45:0/215434439 shutdown_connections 2023-12-19T18:04:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 --2- 172.21.15.45:0/215434439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e240b22b0 0x7f8e240b4b70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 -- 172.21.15.45:0/215434439 >> 172.21.15.45:0/215434439 conn(0x7f8e240cfb70 msgr2=0x7f8e240cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 -- 172.21.15.45:0/215434439 shutdown_connections 2023-12-19T18:04:04.104 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.096+0000 7f8e29851700 1 -- 172.21.15.45:0/215434439 wait complete. 2023-12-19T18:04:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.100+0000 7f8e29851700 1 Processor -- start 2023-12-19T18:04:04.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.100+0000 7f8e29851700 1 -- start start 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e240b22b0 0x7f8e24156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 0x7f8e24160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2415d370 0x7f8e240b6d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2415ecf0 con 0x7f8e240b50b0 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240b7260 con 0x7f8e2415d370 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e240b7500 con 0x7f8e240b22b0 2023-12-19T18:04:04.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 0x7f8e24160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 0x7f8e24160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44060/0 (socket says 172.21.15.45:44060) 2023-12-19T18:04:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 -- 172.21.15.45:0/2392354173 learned_addr learned my addr 172.21.15.45:0/2392354173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e22ffd700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e240b22b0 0x7f8e24156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e237fe700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2415d370 0x7f8e240b6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 -- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e240b22b0 msgr2=0x7f8e24156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e240b22b0 0x7f8e24156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 -- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2415d370 msgr2=0x7f8e240b6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2415d370 0x7f8e240b6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 -- 172.21.15.45:0/2392354173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e180094b0 con 0x7f8e240b50b0 2023-12-19T18:04:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e237fe700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2415d370 0x7f8e240b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e227fc700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 0x7f8e24160150 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8e180090b0 tx=0x7f8e18004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.112 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18019ab0 con 0x7f8e240b50b0 2023-12-19T18:04:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e1801e070 con 0x7f8e240b50b0 2023-12-19T18:04:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e18019e70 con 0x7f8e240b50b0 2023-12-19T18:04:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.104+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e240b77e0 con 0x7f8e240b50b0 2023-12-19T18:04:04.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.108+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e240b7da0 con 0x7f8e240b50b0 2023-12-19T18:04:04.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.108+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e240d2ef0 con 0x7f8e240b50b0 2023-12-19T18:04:04.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.108+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8e1802d450 con 0x7f8e240b50b0 2023-12-19T18:04:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.112+0000 7f8e0bfff700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e10065ad0 0x7f8e10067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.112+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f8e18084330 con 0x7f8e240b50b0 2023-12-19T18:04:04.118 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.112+0000 7f8e22ffd700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e10065ad0 0x7f8e10067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.119 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.112+0000 7f8e22ffd700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e10065ad0 0x7f8e10067f90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007fd0 tx=0x7f8e14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.116+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8e18051af0 con 0x7f8e240b50b0 2023-12-19T18:04:04.335 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.328+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e240741d0 con 0x7f8e240b50b0 2023-12-19T18:04:04.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.328+0000 7f8e0bfff700 1 -- 172.21.15.45:0/2392354173 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4717 (secure 0 0 0) 0x7f8e18055110 con 0x7f8e240b50b0 2023-12-19T18:04:04.336 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:04.337 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:54.718515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e10065ad0 msgr2=0x7f8e10067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e10065ad0 0x7f8e10067f90 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f8e14007fd0 tx=0x7f8e14009040 comp rx=0 tx=0).stop 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 msgr2=0x7f8e24160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 0x7f8e24160150 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8e180090b0 tx=0x7f8e18004770 comp rx=0 tx=0).stop 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 shutdown_connections 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8e10065ad0 0x7f8e10067f90 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.339 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8e2415d370 0x7f8e240b6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8e240b50b0 0x7f8e24160150 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 --2- 172.21.15.45:0/2392354173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8e240b22b0 0x7f8e24156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 >> 172.21.15.45:0/2392354173 conn(0x7f8e240cfb70 msgr2=0x7f8e240ca1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 shutdown_connections 2023-12-19T18:04:04.340 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.332+0000 7f8e29851700 1 -- 172.21.15.45:0/2392354173 wait complete. 2023-12-19T18:04:04.345 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 112 2023-12-19T18:04:04.362 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:04:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.532+0000 7ff6c97d2700 1 Processor -- start 2023-12-19T18:04:04.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.532+0000 7ff6c97d2700 1 -- start start 2023-12-19T18:04:04.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c97d2700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff6c4159ef0 0x7ff6c40b53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c97d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c97d2700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7ff6c40cdbf0 0x7ff6c40cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c97d2700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40ce080 con 0x7ff6c4159ef0 2023-12-19T18:04:04.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c97d2700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c415a2d0 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c97d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40ccf70 con 0x7ff6c40b2930 2023-12-19T18:04:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff6c4159ef0 0x7ff6c40b53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7ff6c4159ef0 0x7ff6c40b53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44066/0 (socket says 172.21.15.45:44066) 2023-12-19T18:04:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 -- 172.21.15.45:0/2545447801 learned_addr learned my addr 172.21.15.45:0/2545447801 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c37fe700 1 --2- 172.21.15.45:0/2545447801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c8fd1700 1 --2- 172.21.15.45:0/2545447801 >> v2:172.21.15.73:3300/0 conn(0x7ff6c40cdbf0 0x7ff6c40cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 -- 172.21.15.45:0/2545447801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 msgr2=0x7ff6c40cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 --2- 172.21.15.45:0/2545447801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 -- 172.21.15.45:0/2545447801 >> v2:172.21.15.73:3300/0 conn(0x7ff6c40cdbf0 msgr2=0x7ff6c40cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 --2- 172.21.15.45:0/2545447801 >> v2:172.21.15.73:3300/0 conn(0x7ff6c40cdbf0 0x7ff6c40cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 -- 172.21.15.45:0/2545447801 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40cf630 con 0x7ff6c4159ef0 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c8fd1700 1 --2- 172.21.15.45:0/2545447801 >> v2:172.21.15.73:3300/0 conn(0x7ff6c40cdbf0 0x7ff6c40cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:04.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.536+0000 7ff6c3fff700 1 --2- 172.21.15.45:0/2545447801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c4159ef0 0x7ff6c40b53e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40b1940 tx=0x7ff6b4009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31096005f8d98955 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c2ffd700 1 -- 172.21.15.45:0/2545447801 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4011830 con 0x7ff6c4159ef0 2023-12-19T18:04:04.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c2ffd700 1 -- 172.21.15.45:0/2545447801 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b4011990 con 0x7ff6c4159ef0 2023-12-19T18:04:04.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c2ffd700 1 -- 172.21.15.45:0/2545447801 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4011d40 con 0x7ff6c4159ef0 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2545447801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c4159ef0 msgr2=0x7ff6c40b53e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2545447801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c4159ef0 0x7ff6c40b53e0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40b1940 tx=0x7ff6b4009c20 comp rx=0 tx=0).stop 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2545447801 shutdown_connections 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2545447801 >> v2:172.21.15.73:3300/0 conn(0x7ff6c40cdbf0 0x7ff6c40cfac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2545447801 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2545447801 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c4159ef0 0x7ff6c40b53e0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2545447801 >> 172.21.15.45:0/2545447801 conn(0x7ff6c406f260 msgr2=0x7ff6c406f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2545447801 shutdown_connections 2023-12-19T18:04:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.540+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2545447801 wait complete. 2023-12-19T18:04:04.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 Processor -- start 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 -- start start 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 0x7ff6c40c8420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6c4159ef0 0x7ff6c4152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40c76f0 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40c7260 con 0x7ff6c4159ef0 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c97d2700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40c7940 con 0x7ff6c40b2930 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 0x7ff6c40c8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 0x7ff6c40c8420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44074/0 (socket says 172.21.15.45:44074) 2023-12-19T18:04:04.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 -- 172.21.15.45:0/2778915094 learned_addr learned my addr 172.21.15.45:0/2778915094 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c8fd1700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6c4159ef0 0x7ff6c4152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c3fff700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 -- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 msgr2=0x7ff6c40c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 -- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6c4159ef0 msgr2=0x7ff6c4152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6c4159ef0 0x7ff6c4152680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.544+0000 7ff6c37fe700 1 -- 172.21.15.45:0/2778915094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b4009570 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c37fe700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 0x7ff6c40c8420 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800e870 tx=0x7ff6b800eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8009540 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8013680 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8013a10 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c40c7c20 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c41530d0 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c40c8140 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.548+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7ff6b8013b90 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.552+0000 7ff6c0ff9700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff6b0065ad0 0x7ff6b0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.557 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.552+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7ff6b8083170 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.552+0000 7ff6c3fff700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff6b0065ad0 0x7ff6b0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.559 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.552+0000 7ff6c3fff700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff6b0065ad0 0x7ff6b0067f90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4000c00 tx=0x7ff6b4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.556+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7ff6c40c8140 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.751 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.744+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6c40c8140 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.754 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.748+0000 7ff6c0ff9700 1 -- 172.21.15.45:0/2778915094 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16523 (secure 0 0 0) 0x7ff6c40c8140 con 0x7ff6c40cdbf0 2023-12-19T18:04:04.757 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:04.757 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":131,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:47.951495+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6833/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.73:6832/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff6b0065ad0 msgr2=0x7ff6b0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff6b0065ad0 0x7ff6b0067f90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4000c00 tx=0x7ff6b4008030 comp rx=0 tx=0).stop 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 msgr2=0x7ff6c40c8420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 0x7ff6c40c8420 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7ff6b800e870 tx=0x7ff6b800eb80 comp rx=0 tx=0).stop 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 shutdown_connections 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7ff6b0065ad0 0x7ff6b0067f90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6c4159ef0 0x7ff6c4152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7ff6c40cdbf0 0x7ff6c40c8420 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.759 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 --2- 172.21.15.45:0/2778915094 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7ff6c40b2930 0x7ff6c40c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 >> 172.21.15.45:0/2778915094 conn(0x7ff6c406f260 msgr2=0x7ff6c406a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:04.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 shutdown_connections 2023-12-19T18:04:04.760 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.752+0000 7ff6c97d2700 1 -- 172.21.15.45:0/2778915094 wait complete. 2023-12-19T18:04:04.783 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T18:04:04.784 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:04:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae15351700 1 Processor -- start 2023-12-19T18:04:04.965 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae15351700 1 -- start start 2023-12-19T18:04:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae15351700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae100ce150 0x7fae10167ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae15351700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1015d360 con 0x7fae100b88e0 2023-12-19T18:04:04.967 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae15351700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae100d2950 con 0x7fae1015cf80 2023-12-19T18:04:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae15351700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae100d18b0 con 0x7fae100ce150 2023-12-19T18:04:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae14b50700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fae100ce150 0x7fae10167ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae0f7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fae100b88e0 0x7fae100cda40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55930/0 (socket says 172.21.15.45:55930) 2023-12-19T18:04:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.960+0000 7fae0f7fe700 1 -- 172.21.15.45:0/2843654977 learned_addr learned my addr 172.21.15.45:0/2843654977 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae14b50700 1 -- 172.21.15.45:0/2843654977 >> v1:172.21.15.73:6789/0 conn(0x7fae1015cf80 legacy=0x7fae100d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.968 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae14b50700 1 -- 172.21.15.45:0/2843654977 >> v1:172.21.15.45:6789/0 conn(0x7fae100b88e0 legacy=0x7fae100cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae14b50700 1 -- 172.21.15.45:0/2843654977 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100d1b90 con 0x7fae100ce150 2023-12-19T18:04:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae0effd700 1 -- 172.21.15.45:0/2843654977 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560380276 0 0) 0x7fae100d2950 con 0x7fae1015cf80 2023-12-19T18:04:04.969 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae14b50700 1 --2- 172.21.15.45:0/2843654977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100ce150 0x7fae10167ad0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fae08009d90 tx=0x7fae0800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a2ab539eb1673da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae0effd700 1 -- 172.21.15.45:0/2843654977 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae0800e070 con 0x7fae100ce150 2023-12-19T18:04:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae0effd700 1 -- 172.21.15.45:0/2843654977 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0800bbd0 con 0x7fae100ce150 2023-12-19T18:04:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae0effd700 1 -- 172.21.15.45:0/2843654977 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae08012430 con 0x7fae100ce150 2023-12-19T18:04:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 -- 172.21.15.45:0/2843654977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100ce150 msgr2=0x7fae10167ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.970 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 --2- 172.21.15.45:0/2843654977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100ce150 0x7fae10167ad0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fae08009d90 tx=0x7fae0800b330 comp rx=0 tx=0).stop 2023-12-19T18:04:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 -- 172.21.15.45:0/2843654977 shutdown_connections 2023-12-19T18:04:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 --2- 172.21.15.45:0/2843654977 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100ce150 0x7fae10167ad0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 -- 172.21.15.45:0/2843654977 >> 172.21.15.45:0/2843654977 conn(0x7fae10066380 msgr2=0x7fae100cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 -- 172.21.15.45:0/2843654977 shutdown_connections 2023-12-19T18:04:04.971 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.964+0000 7fae15351700 1 -- 172.21.15.45:0/2843654977 wait complete. 2023-12-19T18:04:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 Processor -- start 2023-12-19T18:04:04.973 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 -- start start 2023-12-19T18:04:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 0x7fae101f1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae100ce150 0x7fae100c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae1015cf80 0x7fae100ca280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10160160 con 0x7fae100b88e0 2023-12-19T18:04:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1015f4e0 con 0x7fae100ce150 2023-12-19T18:04:04.975 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae15351700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1015f7c0 con 0x7fae1015cf80 2023-12-19T18:04:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 0x7fae101f1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 0x7fae101f1a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44096/0 (socket says 172.21.15.45:44096) 2023-12-19T18:04:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 -- 172.21.15.45:0/1398771846 learned_addr learned my addr 172.21.15.45:0/1398771846 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0f7fe700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae100ce150 0x7fae100c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae14b50700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae1015cf80 0x7fae100ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.976 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 -- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae1015cf80 msgr2=0x7fae100ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae1015cf80 0x7fae100ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 -- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae100ce150 msgr2=0x7fae100c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae100ce150 0x7fae100c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.968+0000 7fae0ffff700 1 -- 172.21.15.45:0/1398771846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08009a70 con 0x7fae100b88e0 2023-12-19T18:04:04.977 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae0ffff700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 0x7fae101f1a00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fae0000c450 tx=0x7fae0000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae000054e0 con 0x7fae100b88e0 2023-12-19T18:04:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae000036a0 con 0x7fae100b88e0 2023-12-19T18:04:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1015faa0 con 0x7fae100b88e0 2023-12-19T18:04:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae00003a50 con 0x7fae100b88e0 2023-12-19T18:04:04.978 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae101f1f40 con 0x7fae100b88e0 2023-12-19T18:04:04.979 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.972+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1004ed30 con 0x7fae100b88e0 2023-12-19T18:04:04.980 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.976+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fae00003bb0 con 0x7fae100b88e0 2023-12-19T18:04:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.976+0000 7fae0cff9700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadf8065ad0 0x7fadf8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.976+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7fae00082880 con 0x7fae100b88e0 2023-12-19T18:04:04.982 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.976+0000 7fae0f7fe700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadf8065ad0 0x7fadf8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:04.983 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.976+0000 7fae0f7fe700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadf8065ad0 0x7fadf8067f90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fae1014cf70 tx=0x7fadfc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:04.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:04.984+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fae0004ffc0 con 0x7fae100b88e0 2023-12-19T18:04:05.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.212+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae10146860 con 0x7fae100b88e0 2023-12-19T18:04:05.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.212+0000 7fae0cff9700 1 -- 172.21.15.45:0/1398771846 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4717 (secure 0 0 0) 0x7fae00003e60 con 0x7fae100b88e0 2023-12-19T18:04:05.219 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:05.220 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:54.718515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadf8065ad0 msgr2=0x7fadf8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadf8065ad0 0x7fadf8067f90 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fae1014cf70 tx=0x7fadfc009040 comp rx=0 tx=0).stop 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 msgr2=0x7fae101f1a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 0x7fae101f1a00 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fae0000c450 tx=0x7fae0000c810 comp rx=0 tx=0).stop 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 shutdown_connections 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fadf8065ad0 0x7fadf8067f90 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fae1015cf80 0x7fae100ca280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae100ce150 0x7fae100c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 --2- 172.21.15.45:0/1398771846 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fae100b88e0 0x7fae101f1a00 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 >> 172.21.15.45:0/1398771846 conn(0x7fae10066380 msgr2=0x7fae100cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 shutdown_connections 2023-12-19T18:04:05.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.216+0000 7fae15351700 1 -- 172.21.15.45:0/1398771846 wait complete. 2023-12-19T18:04:05.225 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 112 2023-12-19T18:04:05.246 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:04:05.423 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.416+0000 7f5ba9b3e700 1 Processor -- start 2023-12-19T18:04:05.424 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.416+0000 7f5ba9b3e700 1 -- start start 2023-12-19T18:04:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba9b3e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ba415ce30 0x7f5ba40b2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.425 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba9b3e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f5ba40adfd0 0x7f5ba40ce730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba9b3e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ba4160b30 con 0x7f5ba40cec70 2023-12-19T18:04:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba9b3e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba40cf080 con 0x7f5ba415ce30 2023-12-19T18:04:05.426 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba9b3e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ba4160d80 con 0x7f5ba40adfd0 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba933d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5ba40cec70 0x7f5ba4070620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55936/0 (socket says 172.21.15.45:55936) 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba933d700 1 -- 172.21.15.45:0/3595239969 learned_addr learned my addr 172.21.15.45:0/3595239969 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba8b3c700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5ba415ce30 0x7f5ba40b2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5b9bfff700 1 --2- 172.21.15.45:0/3595239969 >> v2:172.21.15.73:3300/0 conn(0x7f5ba40adfd0 0x7f5ba40ce730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba8b3c700 1 -- 172.21.15.45:0/3595239969 >> v2:172.21.15.73:3300/0 conn(0x7f5ba40adfd0 msgr2=0x7f5ba40ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5b9b7fe700 1 -- 172.21.15.45:0/3595239969 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847254059 0 0) 0x7f5ba4160b30 con 0x7f5ba40cec70 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba8b3c700 1 --2- 172.21.15.45:0/3595239969 >> v2:172.21.15.73:3300/0 conn(0x7f5ba40adfd0 0x7f5ba40ce730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba8b3c700 1 -- 172.21.15.45:0/3595239969 >> v1:172.21.15.45:6789/0 conn(0x7f5ba40cec70 legacy=0x7f5ba4070620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.427 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba8b3c700 1 -- 172.21.15.45:0/3595239969 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba4161060 con 0x7f5ba415ce30 2023-12-19T18:04:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5ba8b3c700 1 --2- 172.21.15.45:0/3595239969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba415ce30 0x7f5ba40b2f20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5ba406e9a0 tx=0x7f5ba0009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75657acfdd2fb0ca server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5b9b7fe700 1 -- 172.21.15.45:0/3595239969 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0011830 con 0x7f5ba415ce30 2023-12-19T18:04:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5b9b7fe700 1 -- 172.21.15.45:0/3595239969 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0011990 con 0x7f5ba415ce30 2023-12-19T18:04:05.428 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.420+0000 7f5b9b7fe700 1 -- 172.21.15.45:0/3595239969 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ba0011d40 con 0x7f5ba415ce30 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3595239969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba415ce30 msgr2=0x7f5ba40b2f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3595239969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba415ce30 0x7f5ba40b2f20 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f5ba406e9a0 tx=0x7f5ba0009b30 comp rx=0 tx=0).stop 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3595239969 shutdown_connections 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3595239969 >> v2:172.21.15.73:3300/0 conn(0x7f5ba40adfd0 0x7f5ba40ce730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3595239969 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba415ce30 0x7f5ba40b2f20 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3595239969 >> 172.21.15.45:0/3595239969 conn(0x7f5ba406a130 msgr2=0x7f5ba406a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3595239969 shutdown_connections 2023-12-19T18:04:05.429 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3595239969 wait complete. 2023-12-19T18:04:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 Processor -- start 2023-12-19T18:04:05.431 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.424+0000 7f5ba9b3e700 1 -- start start 2023-12-19T18:04:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba40adfd0 0x7f5ba415e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 0x7f5ba40b2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba415ce30 0x7f5ba41f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.433 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba4159380 con 0x7f5ba40cec70 2023-12-19T18:04:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415eb60 con 0x7f5ba40adfd0 2023-12-19T18:04:05.434 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba415ee40 con 0x7f5ba415ce30 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 0x7f5ba40b2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 0x7f5ba40b2010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44102/0 (socket says 172.21.15.45:44102) 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 -- 172.21.15.45:0/3422374062 learned_addr learned my addr 172.21.15.45:0/3422374062 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba8b3c700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba40adfd0 0x7f5ba415e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba933d700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba415ce30 0x7f5ba41f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 -- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba415ce30 msgr2=0x7f5ba41f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba415ce30 0x7f5ba41f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 -- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba40adfd0 msgr2=0x7f5ba415e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba40adfd0 0x7f5ba415e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 -- 172.21.15.45:0/3422374062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba00094b0 con 0x7f5ba40cec70 2023-12-19T18:04:05.435 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba8b3c700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba40adfd0 0x7f5ba415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b9bfff700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 0x7f5ba40b2010 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d800 tx=0x7f5b9400dbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b940125f0 con 0x7f5ba40cec70 2023-12-19T18:04:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b94012750 con 0x7f5ba40cec70 2023-12-19T18:04:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b94012ac0 con 0x7f5ba40cec70 2023-12-19T18:04:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ba415f120 con 0x7f5ba40cec70 2023-12-19T18:04:05.436 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.428+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ba415e7a0 con 0x7f5ba40cec70 2023-12-19T18:04:05.438 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.432+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ba404ed30 con 0x7f5ba40cec70 2023-12-19T18:04:05.439 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.432+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5b94012c20 con 0x7f5ba40cec70 2023-12-19T18:04:05.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.436+0000 7f5b997fa700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b90065ad0 0x7f5b90067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.436+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f5b940836f0 con 0x7f5ba40cec70 2023-12-19T18:04:05.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.436+0000 7f5ba8b3c700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b90065ad0 0x7f5b90067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.436+0000 7f5ba8b3c700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b90065ad0 0x7f5b90067f90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00090b0 tx=0x7f5ba001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:05.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.440+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5b94050eb0 con 0x7f5ba40cec70 2023-12-19T18:04:05.673 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.668+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ba4161310 con 0x7f5ba40cec70 2023-12-19T18:04:05.675 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.668+0000 7f5b997fa700 1 -- 172.21.15.45:0/3422374062 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4717 (secure 0 0 0) 0x7f5b94012ed0 con 0x7f5ba40cec70 2023-12-19T18:04:05.675 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:05.675 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":112,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-19T18:03:01.480133+0000","modified":"2023-12-19T18:03:54.718515+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":131,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"c","rank":0,"incarnation":109,"state":"up:active","state_seq":9,"addr":"172.21.15.45:6837/3985719686","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":3985719686},{"type":"v1","addr":"172.21.15.45:6837","nonce":3985719686}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[18],"metadata_pool":17,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b90065ad0 msgr2=0x7f5b90067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b90065ad0 0x7f5b90067f90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f5ba00090b0 tx=0x7f5ba001c040 comp rx=0 tx=0).stop 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 msgr2=0x7f5ba40b2010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 0x7f5ba40b2010 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400d800 tx=0x7f5b9400dbc0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 shutdown_connections 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5b90065ad0 0x7f5b90067f90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5ba415ce30 0x7f5ba41f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5ba40cec70 0x7f5ba40b2010 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 --2- 172.21.15.45:0/3422374062 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ba40adfd0 0x7f5ba415e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 >> 172.21.15.45:0/3422374062 conn(0x7f5ba406a130 msgr2=0x7f5ba406c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:05.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 shutdown_connections 2023-12-19T18:04:05.679 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.672+0000 7f5ba9b3e700 1 -- 172.21.15.45:0/3422374062 wait complete. 2023-12-19T18:04:05.680 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 112 2023-12-19T18:04:05.698 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:04:05.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 Processor -- start 2023-12-19T18:04:05.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 -- start start 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f636c0b05e0 0x7f636c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f636c0b1f30 0x7f636c0b2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636c0b0f80 con 0x7f636c15b080 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c15b460 con 0x7f636c0b05e0 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6373030700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636c0cf5f0 con 0x7f636c0b1f30 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6363fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f636c0b05e0 0x7f636c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6363fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f636c0b05e0 0x7f636c0b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44112/0 (socket says 172.21.15.45:44112) 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f6363fff700 1 -- 172.21.15.45:0/1678009754 learned_addr learned my addr 172.21.15.45:0/1678009754 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.880+0000 7f63715cd700 1 --2- 172.21.15.45:0/1678009754 >> v2:172.21.15.73:3300/0 conn(0x7f636c0b1f30 0x7f636c0b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6363fff700 1 -- 172.21.15.45:0/1678009754 >> v2:172.21.15.73:3300/0 conn(0x7f636c0b1f30 msgr2=0x7f636c0b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6363fff700 1 --2- 172.21.15.45:0/1678009754 >> v2:172.21.15.73:3300/0 conn(0x7f636c0b1f30 0x7f636c0b2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6363fff700 1 -- 172.21.15.45:0/1678009754 >> v1:172.21.15.73:6789/0 conn(0x7f636c15b080 legacy=0x7f636c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:05.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6363fff700 1 -- 172.21.15.45:0/1678009754 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636c06cd90 con 0x7f636c0b05e0 2023-12-19T18:04:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6363fff700 1 --2- 172.21.15.45:0/1678009754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b05e0 0x7f636c0b0a40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f636c0b48d0 tx=0x7f635c009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d41dbb52077685c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f63637fe700 1 -- 172.21.15.45:0/1678009754 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00b8a0 con 0x7f636c0b05e0 2023-12-19T18:04:05.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f63637fe700 1 -- 172.21.15.45:0/1678009754 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c00ba00 con 0x7f636c0b05e0 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f63637fe700 1 -- 172.21.15.45:0/1678009754 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c00bd90 con 0x7f636c0b05e0 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 -- 172.21.15.45:0/1678009754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b05e0 msgr2=0x7f636c0b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 --2- 172.21.15.45:0/1678009754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b05e0 0x7f636c0b0a40 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f636c0b48d0 tx=0x7f635c009bf0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 -- 172.21.15.45:0/1678009754 shutdown_connections 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 --2- 172.21.15.45:0/1678009754 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b05e0 0x7f636c0b0a40 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 --2- 172.21.15.45:0/1678009754 >> v2:172.21.15.73:3300/0 conn(0x7f636c0b1f30 0x7f636c0b2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 -- 172.21.15.45:0/1678009754 >> 172.21.15.45:0/1678009754 conn(0x7f636c06a870 msgr2=0x7f636c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:05.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 -- 172.21.15.45:0/1678009754 shutdown_connections 2023-12-19T18:04:05.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.884+0000 7f6373030700 1 -- 172.21.15.45:0/1678009754 wait complete. 2023-12-19T18:04:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 Processor -- start 2023-12-19T18:04:05.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 -- start start 2023-12-19T18:04:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f636c0b05e0 0x7f636c15c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 0x7f636c14bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f636c15b080 0x7f636c15d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c15cf00 con 0x7f636c0b1f30 2023-12-19T18:04:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f636c15b920 con 0x7f636c0b05e0 2023-12-19T18:04:05.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.888+0000 7f6373030700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636c15bc00 con 0x7f636c15b080 2023-12-19T18:04:05.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 0x7f636c14bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 0x7f636c14bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44124/0 (socket says 172.21.15.45:44124) 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 -- 172.21.15.45:0/1182753419 learned_addr learned my addr 172.21.15.45:0/1182753419 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6370dcc700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f636c0b05e0 0x7f636c15c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f63715cd700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f636c15b080 0x7f636c15d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 -- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f636c15b080 msgr2=0x7f636c15d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f636c15b080 0x7f636c15d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 -- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f636c0b05e0 msgr2=0x7f636c15c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f636c0b05e0 0x7f636c15c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:05.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 -- 172.21.15.45:0/1182753419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c009570 con 0x7f636c0b1f30 2023-12-19T18:04:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6363fff700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 0x7f636c14bf20 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f636c06eb50 tx=0x7f635c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c0036c0 con 0x7f636c0b1f30 2023-12-19T18:04:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f635c01f070 con 0x7f636c0b1f30 2023-12-19T18:04:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f636c15bee0 con 0x7f636c0b1f30 2023-12-19T18:04:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c003a80 con 0x7f636c0b1f30 2023-12-19T18:04:05.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.892+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636c15c4a0 con 0x7f636c0b1f30 2023-12-19T18:04:05.900 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.896+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636c0741d0 con 0x7f636c0b1f30 2023-12-19T18:04:05.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.896+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f635c021030 con 0x7f636c0b1f30 2023-12-19T18:04:05.905 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.900+0000 7f63617fa700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6358065ad0 0x7f6358067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.900+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f635c0849a0 con 0x7f636c0b1f30 2023-12-19T18:04:05.906 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.900+0000 7f6370dcc700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6358065ad0 0x7f6358067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:05.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.900+0000 7f6370dcc700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6358065ad0 0x7f6358067f90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f636c0c8cd0 tx=0x7f6368009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:05.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:05.904+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f635c052330 con 0x7f636c0b1f30 2023-12-19T18:04:06.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.084+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f636c15c690 con 0x7f636c0b1f30 2023-12-19T18:04:06.093 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f63617fa700 1 -- 172.21.15.45:0/1182753419 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v131) v1 ==== 74+0+16523 (secure 0 0 0) 0x7f635c055950 con 0x7f636c0b1f30 2023-12-19T18:04:06.094 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:06.094 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":131,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:03:47.951495+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_metadata","create_time":"2023-12-19T18:02:59.579656+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_data","create_time":"2023-12-19T18:03:00.531245+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.73:6833/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.73:6832/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6358065ad0 msgr2=0x7f6358067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6358065ad0 0x7f6358067f90 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f636c0c8cd0 tx=0x7f6368009040 comp rx=0 tx=0).stop 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 msgr2=0x7f636c14bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 0x7f636c14bf20 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f636c06eb50 tx=0x7f635c004770 comp rx=0 tx=0).stop 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 shutdown_connections 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f6358065ad0 0x7f6358067f90 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f636c15b080 0x7f636c15d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f636c0b1f30 0x7f636c14bf20 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 --2- 172.21.15.45:0/1182753419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f636c0b05e0 0x7f636c15c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.088+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 >> 172.21.15.45:0/1182753419 conn(0x7f636c06a870 msgr2=0x7f636c15a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.092+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 shutdown_connections 2023-12-19T18:04:06.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.092+0000 7f6373030700 1 -- 172.21.15.45:0/1182753419 wait complete. 2023-12-19T18:04:06.118 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-19T18:04:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.300+0000 7f04f490b700 1 Processor -- start 2023-12-19T18:04:06.305 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.300+0000 7f04f490b700 1 -- start start 2023-12-19T18:04:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04f490b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f04f00b8770 0x7f04f015d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04f490b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00d14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04f490b700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f015e480 con 0x7f04f00b46f0 2023-12-19T18:04:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04f490b700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f00b8bf0 con 0x7f04f00b8770 2023-12-19T18:04:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04f490b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f015dbe0 con 0x7f04f00d1040 2023-12-19T18:04:06.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04eed9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f04f00b46f0 0x7f04f00b4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55940/0 (socket says 172.21.15.45:55940) 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04eed9d700 1 -- 172.21.15.45:0/343342946 learned_addr learned my addr 172.21.15.45:0/343342946 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ef59e700 1 --2- 172.21.15.45:0/343342946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00d14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ee59c700 1 --2- 172.21.15.45:0/343342946 >> v2:172.21.15.73:3300/0 conn(0x7f04f00b8770 0x7f04f015d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04edd9b700 1 -- 172.21.15.45:0/343342946 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3293647416 0 0) 0x7f04f015e480 con 0x7f04f00b46f0 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04edd9b700 1 -- 172.21.15.45:0/343342946 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f04d80035d0 con 0x7f04f00b46f0 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ef59e700 1 -- 172.21.15.45:0/343342946 >> v2:172.21.15.73:3300/0 conn(0x7f04f00b8770 msgr2=0x7f04f015d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:06.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ef59e700 1 --2- 172.21.15.45:0/343342946 >> v2:172.21.15.73:3300/0 conn(0x7f04f00b8770 0x7f04f015d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ef59e700 1 -- 172.21.15.45:0/343342946 >> v1:172.21.15.45:6789/0 conn(0x7f04f00b46f0 legacy=0x7f04f00b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ef59e700 1 -- 172.21.15.45:0/343342946 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f015d9b0 con 0x7f04f00d1040 2023-12-19T18:04:06.311 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04ef59e700 1 --2- 172.21.15.45:0/343342946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00d14d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009d90 tx=0x7f04e800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727c70bac5aa04bc server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:06.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04edd9b700 1 -- 172.21.15.45:0/343342946 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e800e070 con 0x7f04f00d1040 2023-12-19T18:04:06.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04edd9b700 1 -- 172.21.15.45:0/343342946 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e800bb20 con 0x7f04f00d1040 2023-12-19T18:04:06.312 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.304+0000 7f04edd9b700 1 -- 172.21.15.45:0/343342946 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e8012430 con 0x7f04f00d1040 2023-12-19T18:04:06.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 -- 172.21.15.45:0/343342946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 msgr2=0x7f04f00d14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 --2- 172.21.15.45:0/343342946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00d14d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f04e8009d90 tx=0x7f04e800b330 comp rx=0 tx=0).stop 2023-12-19T18:04:06.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 -- 172.21.15.45:0/343342946 shutdown_connections 2023-12-19T18:04:06.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 --2- 172.21.15.45:0/343342946 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00d14d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 --2- 172.21.15.45:0/343342946 >> v2:172.21.15.73:3300/0 conn(0x7f04f00b8770 0x7f04f015d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.313 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 -- 172.21.15.45:0/343342946 >> 172.21.15.45:0/343342946 conn(0x7f04f0066380 msgr2=0x7f04f00cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:06.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 -- 172.21.15.45:0/343342946 shutdown_connections 2023-12-19T18:04:06.314 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.308+0000 7f04f490b700 1 -- 172.21.15.45:0/343342946 wait complete. 2023-12-19T18:04:06.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 Processor -- start 2023-12-19T18:04:06.318 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 -- start start 2023-12-19T18:04:06.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 0x7f04f0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04f00b8770 0x7f04f00c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00b7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f01593f0 con 0x7f04f00b46f0 2023-12-19T18:04:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00cbe90 con 0x7f04f00b8770 2023-12-19T18:04:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04f490b700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f00ca440 con 0x7f04f00d1040 2023-12-19T18:04:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 0x7f04f0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 0x7f04f0152cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44128/0 (socket says 172.21.15.45:44128) 2023-12-19T18:04:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04eed9d700 1 -- 172.21.15.45:0/1722475090 learned_addr learned my addr 172.21.15.45:0/1722475090 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:06.320 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04ef59e700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00b7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.321 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.312+0000 7f04ee59c700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04f00b8770 0x7f04f00c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04eed9d700 1 -- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 msgr2=0x7f04f00b7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04eed9d700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00b7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04eed9d700 1 -- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04f00b8770 msgr2=0x7f04f00c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04eed9d700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04f00b8770 0x7f04f00c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04eed9d700 1 -- 172.21.15.45:0/1722475090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e8009a70 con 0x7f04f00b46f0 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04ef59e700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04ee59c700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04f00b8770 0x7f04f00c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04eed9d700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 0x7f04f0152cc0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c700 tx=0x7f04e000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0005d90 con 0x7f04f00b46f0 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e00070d0 con 0x7f04f00b46f0 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0007480 con 0x7f04f00b46f0 2023-12-19T18:04:06.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f00cc100 con 0x7f04f00b46f0 2023-12-19T18:04:06.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f00ca720 con 0x7f04f00b46f0 2023-12-19T18:04:06.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.316+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f00cbcf0 con 0x7f04f00b46f0 2023-12-19T18:04:06.325 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.320+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f04e00075e0 con 0x7f04f00b46f0 2023-12-19T18:04:06.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.320+0000 7f04d77fe700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f04dc065ad0 0x7f04dc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.320+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 6201+0+0 (secure 0 0 0) 0x7f04e0082800 con 0x7f04f00b46f0 2023-12-19T18:04:06.327 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.320+0000 7f04ee59c700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f04dc065ad0 0x7f04dc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.329 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.324+0000 7f04ee59c700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f04dc065ad0 0x7f04dc067f90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f04f01f6f00 tx=0x7f04e4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:06.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.328+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f04f00cbcf0 con 0x7f04f00b46f0 2023-12-19T18:04:06.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.544+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04f00cbcf0 con 0x7f04f00b46f0 2023-12-19T18:04:06.550 INFO:tasks.ceph.mon.a.smithi045.stderr:2023-12-19T18:04:06.544+0000 7f4a6dff4700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-19T18:04:06.567 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.560+0000 7f04d77fe700 1 -- 172.21.15.45:0/1722475090 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v113) v1 ==== 161+0+0 (secure 0 0 0) 0x7f04f00cbcf0 con 0x7f04f00b46f0 2023-12-19T18:04:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f04dc065ad0 msgr2=0x7f04dc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f04dc065ad0 0x7f04dc067f90 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f04f01f6f00 tx=0x7f04e4009240 comp rx=0 tx=0).stop 2023-12-19T18:04:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 msgr2=0x7f04f0152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.571 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 0x7f04f0152cc0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f04e000c700 tx=0x7f04e000ca10 comp rx=0 tx=0).stop 2023-12-19T18:04:06.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 shutdown_connections 2023-12-19T18:04:06.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f04dc065ad0 0x7f04dc067f90 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f04f00d1040 0x7f04f00b7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f04f00b8770 0x7f04f00c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 --2- 172.21.15.45:0/1722475090 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f04f00b46f0 0x7f04f0152cc0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 >> 172.21.15.45:0/1722475090 conn(0x7f04f0066380 msgr2=0x7f04f00ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:06.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 shutdown_connections 2023-12-19T18:04:06.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.564+0000 7f04f490b700 1 -- 172.21.15.45:0/1722475090 wait complete. 2023-12-19T18:04:06.574 INFO:teuthology.orchestra.run.smithi045.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-19T18:04:06.579 INFO:tasks.ceph.mds.c.smithi045.stderr: -2620> 2023-12-19T18:03:54.848+0000 7f51c00de700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-19T18:04:06.599 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-19T18:04:06.640 INFO:tasks.ceph.mds.c.smithi045.stdout:starting mds.c at 2023-12-19T18:04:06.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.772+0000 7f039759e700 1 Processor -- start 2023-12-19T18:04:06.777 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.772+0000 7f039759e700 1 -- start start 2023-12-19T18:04:06.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039759e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f03980713b0 0x7f03980ca020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039759e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0398070570 0x7f03980709c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039759e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03980ca560 con 0x7f039815d0f0 2023-12-19T18:04:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039759e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0398071840 con 0x7f03980713b0 2023-12-19T18:04:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039759e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0398070f00 con 0x7f0398070570 2023-12-19T18:04:06.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039659c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f039815d0f0 0x7f03980cd1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55956/0 (socket says 172.21.15.45:55956) 2023-12-19T18:04:06.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039659c700 1 -- 172.21.15.45:0/185849334 learned_addr learned my addr 172.21.15.45:0/185849334 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:06.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0395d9b700 1 --2- 172.21.15.45:0/185849334 >> v2:172.21.15.45:3300/0 conn(0x7f03980713b0 0x7f03980ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0396d9d700 1 --2- 172.21.15.45:0/185849334 >> v2:172.21.15.73:3300/0 conn(0x7f0398070570 0x7f03980709c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039559a700 1 -- 172.21.15.45:0/185849334 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907942296 0 0) 0x7f03980ca560 con 0x7f039815d0f0 2023-12-19T18:04:06.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0395d9b700 1 -- 172.21.15.45:0/185849334 >> v2:172.21.15.73:3300/0 conn(0x7f0398070570 msgr2=0x7f03980709c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:06.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0395d9b700 1 --2- 172.21.15.45:0/185849334 >> v2:172.21.15.73:3300/0 conn(0x7f0398070570 0x7f03980709c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0395d9b700 1 -- 172.21.15.45:0/185849334 >> v1:172.21.15.45:6789/0 conn(0x7f039815d0f0 legacy=0x7f03980cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0395d9b700 1 -- 172.21.15.45:0/185849334 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03980cc490 con 0x7f03980713b0 2023-12-19T18:04:06.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f0395d9b700 1 --2- 172.21.15.45:0/185849334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f03980ca020 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f03980caa70 tx=0x7f038c009b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d4aaea82f2c2c server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:06.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039559a700 1 -- 172.21.15.45:0/185849334 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011830 con 0x7f03980713b0 2023-12-19T18:04:06.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039559a700 1 -- 172.21.15.45:0/185849334 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c011990 con 0x7f03980713b0 2023-12-19T18:04:06.784 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.776+0000 7f039559a700 1 -- 172.21.15.45:0/185849334 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c011d40 con 0x7f03980713b0 2023-12-19T18:04:06.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 -- 172.21.15.45:0/185849334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 msgr2=0x7f03980ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 --2- 172.21.15.45:0/185849334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f03980ca020 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f03980caa70 tx=0x7f038c009b30 comp rx=0 tx=0).stop 2023-12-19T18:04:06.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 -- 172.21.15.45:0/185849334 shutdown_connections 2023-12-19T18:04:06.785 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 --2- 172.21.15.45:0/185849334 >> v2:172.21.15.73:3300/0 conn(0x7f0398070570 0x7f03980709c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 --2- 172.21.15.45:0/185849334 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f03980ca020 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 -- 172.21.15.45:0/185849334 >> 172.21.15.45:0/185849334 conn(0x7f03980ce8c0 msgr2=0x7f03980ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:06.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 -- 172.21.15.45:0/185849334 shutdown_connections 2023-12-19T18:04:06.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 -- 172.21.15.45:0/185849334 wait complete. 2023-12-19T18:04:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 Processor -- start 2023-12-19T18:04:06.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.780+0000 7f039759e700 1 -- start start 2023-12-19T18:04:06.790 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039759e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398070570 0x7f03980c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039759e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f0398153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039759e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f039815d0f0 0x7f03980ac940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039759e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980c5cb0 con 0x7f03980713b0 2023-12-19T18:04:06.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039759e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03980c6830 con 0x7f0398070570 2023-12-19T18:04:06.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039759e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03981f6740 con 0x7f039815d0f0 2023-12-19T18:04:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f0398153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f0398153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44148/0 (socket says 172.21.15.45:44148) 2023-12-19T18:04:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 -- 172.21.15.45:0/303218308 learned_addr learned my addr 172.21.15.45:0/303218308 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f039659c700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398070570 0x7f03980c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0396d9d700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f039815d0f0 0x7f03980ac940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.793 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 -- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f039815d0f0 msgr2=0x7f03980ac940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f039815d0f0 0x7f03980ac940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 -- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398070570 msgr2=0x7f03980c62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398070570 0x7f03980c62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.784+0000 7f0395d9b700 1 -- 172.21.15.45:0/303218308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c0094b0 con 0x7f03980713b0 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f0395d9b700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f0398153e20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f038c0090b0 tx=0x7f038c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c01aa10 con 0x7f03980713b0 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c01f070 con 0x7f03980713b0 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f038c01add0 con 0x7f03980713b0 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0398154360 con 0x7f03980713b0 2023-12-19T18:04:06.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03980c6a60 con 0x7f03980713b0 2023-12-19T18:04:06.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039804ed30 con 0x7f03980713b0 2023-12-19T18:04:06.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.788+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f038c01b430 con 0x7f03980713b0 2023-12-19T18:04:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.792+0000 7f0386ffd700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0378065ad0 0x7f0378067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.792+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f038c0844d0 con 0x7f03980713b0 2023-12-19T18:04:06.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.792+0000 7f039659c700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0378065ad0 0x7f0378067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:06.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.792+0000 7f039659c700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0378065ad0 0x7f0378067f90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0388000f60 tx=0x7f0388007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:06.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:06.800+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f038c051c40 con 0x7f03980713b0 2023-12-19T18:04:07.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.028+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f03980cf520 con 0x7f03980713b0 2023-12-19T18:04:07.575 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.568+0000 7f0386ffd700 1 -- 172.21.15.45:0/303218308 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v114) v1 ==== 104+0+0 (secure 0 0 0) 0x7f038c006ce0 con 0x7f03980713b0 2023-12-19T18:04:07.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0378065ad0 msgr2=0x7f0378067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0378065ad0 0x7f0378067f90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0388000f60 tx=0x7f0388007e90 comp rx=0 tx=0).stop 2023-12-19T18:04:07.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 msgr2=0x7f0398153e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f0398153e20 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f038c0090b0 tx=0x7f038c004770 comp rx=0 tx=0).stop 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 shutdown_connections 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0378065ad0 0x7f0378067f90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f039815d0f0 0x7f03980ac940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f03980713b0 0x7f0398153e20 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 --2- 172.21.15.45:0/303218308 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0398070570 0x7f03980c62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 >> 172.21.15.45:0/303218308 conn(0x7f03980ce8c0 msgr2=0x7f03980af740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 shutdown_connections 2023-12-19T18:04:07.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.572+0000 7f039759e700 1 -- 172.21.15.45:0/303218308 wait complete. 2023-12-19T18:04:07.605 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-19T18:04:07.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.832+0000 7f5cbccd8700 1 Processor -- start 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.832+0000 7f5cbccd8700 1 -- start start 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cbccd8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb815b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cbccd8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb80b6790 con 0x7f5cb80b63b0 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cbccd8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb815b970 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cbccd8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb815c210 con 0x7f5cb80cbdf0 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb77fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f5cb80b63b0 0x7f5cb815ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:55970/0 (socket says 172.21.15.45:55970) 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb77fe700 1 -- 172.21.15.45:0/2172548118 learned_addr learned my addr 172.21.15.45:0/2172548118 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb6ffd700 1 --2- 172.21.15.45:0/2172548118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb6ffd700 1 -- 172.21.15.45:0/2172548118 >> v1:172.21.15.73:6789/0 conn(0x7f5cb80ce7a0 legacy=0x7f5cb80cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb6ffd700 1 -- 172.21.15.45:0/2172548118 >> v1:172.21.15.45:6789/0 conn(0x7f5cb80b63b0 legacy=0x7f5cb815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb67fc700 1 -- 172.21.15.45:0/2172548118 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441883397 0 0) 0x7f5cb80b6790 con 0x7f5cb80b63b0 2023-12-19T18:04:07.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb6ffd700 1 -- 172.21.15.45:0/2172548118 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb815bc50 con 0x7f5cb80cbdf0 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb6ffd700 1 --2- 172.21.15.45:0/2172548118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb815b220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009800 tx=0x7f5cac009b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=923901bb705fd43b server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb67fc700 1 -- 172.21.15.45:0/2172548118 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac004230 con 0x7f5cb80cbdf0 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb67fc700 1 -- 172.21.15.45:0/2172548118 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cac004390 con 0x7f5cb80cbdf0 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.836+0000 7f5cb67fc700 1 -- 172.21.15.45:0/2172548118 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cac0036c0 con 0x7f5cb80cbdf0 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 -- 172.21.15.45:0/2172548118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 msgr2=0x7f5cb815b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/2172548118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb815b220 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5cac009800 tx=0x7f5cac009b10 comp rx=0 tx=0).stop 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 -- 172.21.15.45:0/2172548118 shutdown_connections 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/2172548118 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb815b220 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.845 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 -- 172.21.15.45:0/2172548118 >> 172.21.15.45:0/2172548118 conn(0x7f5cb806e8a0 msgr2=0x7f5cb806ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 -- 172.21.15.45:0/2172548118 shutdown_connections 2023-12-19T18:04:07.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 -- 172.21.15.45:0/2172548118 wait complete. 2023-12-19T18:04:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 Processor -- start 2023-12-19T18:04:07.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.840+0000 7f5cbccd8700 1 -- start start 2023-12-19T18:04:07.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cb80b63b0 0x7f5cb80c33b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:07.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb8154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:07.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80ce7a0 0x7f5cb81f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:07.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80c5e70 con 0x7f5cb80b63b0 2023-12-19T18:04:07.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80b3470 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb80b3190 con 0x7f5cb80cbdf0 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cb80b63b0 0x7f5cb80c33b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cb80b63b0 0x7f5cb80c33b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:44156/0 (socket says 172.21.15.45:44156) 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb77fe700 1 -- 172.21.15.45:0/278206178 learned_addr learned my addr 172.21.15.45:0/278206178 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80ce7a0 0x7f5cb81f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb6ffd700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb8154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 -- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 msgr2=0x7f5cb8154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb8154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 -- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cb80b63b0 msgr2=0x7f5cb80c33b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cb80b63b0 0x7f5cb80c33b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:07.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 -- 172.21.15.45:0/278206178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cac0094b0 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cb7fff700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80ce7a0 0x7f5cb81f5ce0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000cbe0 tx=0x7f5cb000cef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb0003e50 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb000a690 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb000aa20 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb80c57b0 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.844+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb80b2e20 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.848+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb815d2c0 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.848+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5cb000ab80 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.848+0000 7f5c9ffff700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ca4065ad0 0x7f5ca4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:07.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.848+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 6287+0+0 (secure 0 0 0) 0x7f5cb0082d70 con 0x7f5cb80ce7a0 2023-12-19T18:04:07.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.848+0000 7f5cb77fe700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ca4065ad0 0x7f5ca4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:07.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.852+0000 7f5cb77fe700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ca4065ad0 0x7f5ca4067f90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8000f60 tx=0x7f5ca8007ec0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:07.864 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:07.856+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5cb0087070 con 0x7f5cb80ce7a0 2023-12-19T18:04:08.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.036+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5cb815c860 con 0x7f5cb80ce7a0 2023-12-19T18:04:08.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.832+0000 7f5c9ffff700 1 -- 172.21.15.45:0/278206178 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v133) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5cb00170d0 con 0x7f5cb80ce7a0 2023-12-19T18:04:08.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ca4065ad0 msgr2=0x7f5ca4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ca4065ad0 0x7f5ca4067f90 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8000f60 tx=0x7f5ca8007ec0 comp rx=0 tx=0).stop 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80ce7a0 msgr2=0x7f5cb81f5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80ce7a0 0x7f5cb81f5ce0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f5cb000cbe0 tx=0x7f5cb000cef0 comp rx=0 tx=0).stop 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 shutdown_connections 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5ca4065ad0 0x7f5ca4067f90 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5cb80ce7a0 0x7f5cb81f5ce0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5cb80cbdf0 0x7f5cb8154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 --2- 172.21.15.45:0/278206178 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5cb80b63b0 0x7f5cb80c33b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 >> 172.21.15.45:0/278206178 conn(0x7f5cb806e8a0 msgr2=0x7f5cb81550b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:08.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 shutdown_connections 2023-12-19T18:04:08.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:08.836+0000 7f5cbccd8700 1 -- 172.21.15.45:0/278206178 wait complete. 2023-12-19T18:04:08.844 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_metadata' removed 2023-12-19T18:04:08.863 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-19T18:04:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.040+0000 7f3fe1ae0700 1 Processor -- start 2023-12-19T18:04:09.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.040+0000 7f3fe1ae0700 1 -- start start 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fdc15d5a0 0x7f3fdc0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc0ce790 con 0x7f3fdc15d1c0 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fdc161650 con 0x7f3fdc0ce370 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b6200 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fdc15d5a0 0x7f3fdc0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f3fdc15d5a0 0x7f3fdc0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42332/0 (socket says 172.21.15.45:42332) 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdb7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3fdc15d1c0 0x7f3fdc160f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39128/0 (socket says 172.21.15.45:39128) 2023-12-19T18:04:09.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 -- 172.21.15.45:0/113770920 learned_addr learned my addr 172.21.15.45:0/113770920 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 -- 172.21.15.45:0/113770920 >> v1:172.21.15.73:6789/0 conn(0x7f3fdc0ce370 legacy=0x7f3fdc0d1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 -- 172.21.15.45:0/113770920 >> v1:172.21.15.45:6789/0 conn(0x7f3fdc15d1c0 legacy=0x7f3fdc160f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 -- 172.21.15.45:0/113770920 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc161920 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fdaffd700 1 --2- 172.21.15.45:0/113770920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0cde30 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009910 tx=0x7f3fd0009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9a2539fb9b9d7db server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fda7fc700 1 -- 172.21.15.45:0/113770920 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0004230 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fda7fc700 1 -- 172.21.15.45:0/113770920 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0004390 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fda7fc700 1 -- 172.21.15.45:0/113770920 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0009e60 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.052 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/113770920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 msgr2=0x7f3fdc0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/113770920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0cde30 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0009910 tx=0x7f3fd0009c20 comp rx=0 tx=0).stop 2023-12-19T18:04:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/113770920 shutdown_connections 2023-12-19T18:04:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/113770920 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0cde30 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/113770920 >> 172.21.15.45:0/113770920 conn(0x7f3fdc0cfae0 msgr2=0x7f3fdc0cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/113770920 shutdown_connections 2023-12-19T18:04:09.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.044+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/113770920 wait complete. 2023-12-19T18:04:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 Processor -- start 2023-12-19T18:04:09.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 -- start start 2023-12-19T18:04:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fdc0ce370 0x7f3fdc154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:09.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fdc15d1c0 0x7f3fdc153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc1557d0 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc153ab0 con 0x7f3fdc0ce370 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fe1ae0700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fdc0b5210 con 0x7f3fdc15d1c0 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42338/0 (socket says 172.21.15.45:42338) 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 -- 172.21.15.45:0/3999854622 learned_addr learned my addr 172.21.15.45:0/3999854622 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdaffd700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fdc15d1c0 0x7f3fdc153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdb7fe700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fdc0ce370 0x7f3fdc154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:09.057 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 -- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fdc15d1c0 msgr2=0x7f3fdc153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fdc15d1c0 0x7f3fdc153570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 -- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fdc0ce370 msgr2=0x7f3fdc154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fdc0ce370 0x7f3fdc154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 -- 172.21.15.45:0/3999854622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0009570 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdb7fe700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fdc0ce370 0x7f3fdc154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdaffd700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fdc15d1c0 0x7f3fdc153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.048+0000 7f3fdbfff700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0b4900 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400cc40 tx=0x7f3fd400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd400aba0 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd400ad00 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fdc0b54f0 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd4012660 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.058 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc155460 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fdc155980 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.059 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.052+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3fd40127c0 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.056+0000 7f3fc3fff700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fc8065ad0 0x7f3fc8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.056+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f3fd4083970 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.061 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.056+0000 7f3fdb7fe700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fc8065ad0 0x7f3fc8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:09.062 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.056+0000 7f3fdb7fe700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fc8065ad0 0x7f3fc8067f90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000f60 tx=0x7f3fcc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:09.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.064+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3fdc155980 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.249 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.244+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3fdc155980 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.852 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.848+0000 7f3fc3fff700 1 -- 172.21.15.45:0/3999854622 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v134) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3fdc155980 con 0x7f3fdc15d5a0 2023-12-19T18:04:09.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fc8065ad0 msgr2=0x7f3fc8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:09.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fc8065ad0 0x7f3fc8067f90 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3fcc000f60 tx=0x7f3fcc009040 comp rx=0 tx=0).stop 2023-12-19T18:04:09.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 msgr2=0x7f3fdc0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:09.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0b4900 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f3fd400cc40 tx=0x7f3fd400a060 comp rx=0 tx=0).stop 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 shutdown_connections 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3fc8065ad0 0x7f3fc8067f90 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3fdc15d5a0 0x7f3fdc0b4900 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3fdc15d1c0 0x7f3fdc153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 --2- 172.21.15.45:0/3999854622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3fdc0ce370 0x7f3fdc154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 >> 172.21.15.45:0/3999854622 conn(0x7f3fdc0cfae0 msgr2=0x7f3fdc06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:09.858 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 shutdown_connections 2023-12-19T18:04:09.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:09.852+0000 7f3fe1ae0700 1 -- 172.21.15.45:0/3999854622 wait complete. 2023-12-19T18:04:09.861 INFO:teuthology.orchestra.run.smithi045.stderr:pool 'cephfs_data' removed 2023-12-19T18:04:09.883 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-19T18:04:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.060+0000 7fa558820700 1 Processor -- start 2023-12-19T18:04:10.067 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.060+0000 7fa558820700 1 -- start start 2023-12-19T18:04:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa558820700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa554070570 0x7fa5540709d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa558820700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5540ccc80 0x7fa5540cd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa558820700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa554070f10 con 0x7fa554161810 2023-12-19T18:04:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa558820700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5540caca0 con 0x7fa5540ccc80 2023-12-19T18:04:10.070 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa558820700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540ca090 con 0x7fa554070570 2023-12-19T18:04:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5540ccc80 0x7fa5540cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fa5540ccc80 0x7fa5540cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42350/0 (socket says 172.21.15.45:42350) 2023-12-19T18:04:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 -- 172.21.15.45:0/3494627134 learned_addr learned my addr 172.21.15.45:0/3494627134 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:10.071 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa54bfff700 1 --2- 172.21.15.45:0/3494627134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa554070570 0x7fa5540709d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 -- 172.21.15.45:0/3494627134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa554070570 msgr2=0x7fa5540709d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 --2- 172.21.15.45:0/3494627134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa554070570 0x7fa5540709d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 -- 172.21.15.45:0/3494627134 >> v1:172.21.15.73:6789/0 conn(0x7fa554161810 legacy=0x7fa5540c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 -- 172.21.15.45:0/3494627134 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5540ca370 con 0x7fa5540ccc80 2023-12-19T18:04:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa553fff700 1 --2- 172.21.15.45:0/3494627134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5540ccc80 0x7fa5540cd110 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009e50 tx=0x7fa54c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2166814d1e53ae server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:10.072 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.064+0000 7fa552ffd700 1 -- 172.21.15.45:0/3494627134 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00e070 con 0x7fa5540ccc80 2023-12-19T18:04:10.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa552ffd700 1 -- 172.21.15.45:0/3494627134 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa54c00b9c0 con 0x7fa5540ccc80 2023-12-19T18:04:10.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa552ffd700 1 -- 172.21.15.45:0/3494627134 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c00bd70 con 0x7fa5540ccc80 2023-12-19T18:04:10.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 -- 172.21.15.45:0/3494627134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5540ccc80 msgr2=0x7fa5540cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.073 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 --2- 172.21.15.45:0/3494627134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5540ccc80 0x7fa5540cd110 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7fa54c009e50 tx=0x7fa54c00b330 comp rx=0 tx=0).stop 2023-12-19T18:04:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 -- 172.21.15.45:0/3494627134 shutdown_connections 2023-12-19T18:04:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 --2- 172.21.15.45:0/3494627134 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa5540ccc80 0x7fa5540cd110 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 --2- 172.21.15.45:0/3494627134 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa554070570 0x7fa5540709d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 -- 172.21.15.45:0/3494627134 >> 172.21.15.45:0/3494627134 conn(0x7fa5540ce8c0 msgr2=0x7fa5540ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 -- 172.21.15.45:0/3494627134 shutdown_connections 2023-12-19T18:04:10.074 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 -- 172.21.15.45:0/3494627134 wait complete. 2023-12-19T18:04:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 Processor -- start 2023-12-19T18:04:10.076 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.068+0000 7fa558820700 1 -- start start 2023-12-19T18:04:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 0x7fa55414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5540ccc80 0x7fa5540c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa554161810 0x7fa5540b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55415e4e0 con 0x7fa554070570 2023-12-19T18:04:10.077 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540c8d20 con 0x7fa554161810 2023-12-19T18:04:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5540c8110 con 0x7fa5540ccc80 2023-12-19T18:04:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 0x7fa55414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 0x7fa55414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42364/0 (socket says 172.21.15.45:42364) 2023-12-19T18:04:10.078 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 -- 172.21.15.45:0/533302449 learned_addr learned my addr 172.21.15.45:0/533302449 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa54bfff700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5540ccc80 0x7fa5540c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 -- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5540ccc80 msgr2=0x7fa5540c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5540ccc80 0x7fa5540c78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 -- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa554161810 msgr2=0x7fa5540b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa553fff700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa554161810 0x7fa5540b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa554161810 0x7fa5540b01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.079 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 -- 172.21.15.45:0/533302449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009b30 con 0x7fa554070570 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa54bfff700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5540ccc80 0x7fa5540c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa5537fe700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 0x7fa55414fce0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa54400c500 tx=0x7fa54400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5440052d0 con 0x7fa554070570 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa544005430 con 0x7fa554070570 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5540c83f0 con 0x7fa554070570 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5440055a0 con 0x7fa554070570 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.072+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5540c89b0 con 0x7fa554070570 2023-12-19T18:04:10.080 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.076+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55404ed30 con 0x7fa554070570 2023-12-19T18:04:10.082 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.076+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fa5440038e0 con 0x7fa554070570 2023-12-19T18:04:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.076+0000 7fa550ff9700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa534065b50 0x7fa534068010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.076+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fa544082410 con 0x7fa554070570 2023-12-19T18:04:10.083 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.076+0000 7fa54bfff700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa534065b50 0x7fa534068010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.084 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.080+0000 7fa54bfff700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa534065b50 0x7fa534068010 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa5541f9f10 tx=0x7fa53c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:10.090 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.084+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fa54404ffc0 con 0x7fa554070570 2023-12-19T18:04:10.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.272+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa5540cf520 con 0x7fa554070570 2023-12-19T18:04:10.285 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa550ff9700 1 -- 172.21.15.45:0/533302449 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa5440535e0 con 0x7fa554070570 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa534065b50 msgr2=0x7fa534068010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa534065b50 0x7fa534068010 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa5541f9f10 tx=0x7fa53c008040 comp rx=0 tx=0).stop 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 msgr2=0x7fa55414fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 0x7fa55414fce0 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7fa54400c500 tx=0x7fa54400c8c0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 shutdown_connections 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fa534065b50 0x7fa534068010 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa554161810 0x7fa5540b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fa5540ccc80 0x7fa5540c78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 --2- 172.21.15.45:0/533302449 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fa554070570 0x7fa55414fce0 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 >> 172.21.15.45:0/533302449 conn(0x7fa5540ce8c0 msgr2=0x7fa55406de10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:10.288 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 shutdown_connections 2023-12-19T18:04:10.289 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.280+0000 7fa558820700 1 -- 172.21.15.45:0/533302449 wait complete. 2023-12-19T18:04:10.310 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection' 2023-12-19T18:04:10.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.472+0000 7f4a799f9700 1 Processor -- start 2023-12-19T18:04:10.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.472+0000 7f4a799f9700 1 -- start start 2023-12-19T18:04:10.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a799f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a799f9700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a740ce150 0x7f4a740b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a799f9700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7415d360 con 0x7f4a740b88e0 2023-12-19T18:04:10.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a799f9700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a740d2950 con 0x7f4a740ce150 2023-12-19T18:04:10.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a799f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740d18b0 con 0x7f4a7415cf80 2023-12-19T18:04:10.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a737fe700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f4a740ce150 0x7f4a740b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:57310/0 (socket says 172.21.15.45:57310) 2023-12-19T18:04:10.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 -- 172.21.15.45:0/4033829008 learned_addr learned my addr 172.21.15.45:0/4033829008 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:10.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 -- 172.21.15.45:0/4033829008 >> v2:172.21.15.73:3300/0 conn(0x7f4a740ce150 msgr2=0x7f4a740b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:10.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 --2- 172.21.15.45:0/4033829008 >> v2:172.21.15.73:3300/0 conn(0x7f4a740ce150 0x7f4a740b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 -- 172.21.15.45:0/4033829008 >> v1:172.21.15.73:6789/0 conn(0x7f4a740b88e0 legacy=0x7f4a740cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.476+0000 7f4a72ffd700 1 -- 172.21.15.45:0/4033829008 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a740d1b90 con 0x7f4a7415cf80 2023-12-19T18:04:10.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a72ffd700 1 --2- 172.21.15.45:0/4033829008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740d1040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009910 tx=0x7f4a64009c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f3ce485b08b026e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:10.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a71ffb700 1 -- 172.21.15.45:0/4033829008 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64011830 con 0x7f4a7415cf80 2023-12-19T18:04:10.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a71ffb700 1 -- 172.21.15.45:0/4033829008 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a64011990 con 0x7f4a7415cf80 2023-12-19T18:04:10.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a71ffb700 1 -- 172.21.15.45:0/4033829008 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a64011d40 con 0x7f4a7415cf80 2023-12-19T18:04:10.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 -- 172.21.15.45:0/4033829008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 msgr2=0x7f4a740d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.486 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 --2- 172.21.15.45:0/4033829008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740d1040 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4a64009910 tx=0x7f4a64009c20 comp rx=0 tx=0).stop 2023-12-19T18:04:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 -- 172.21.15.45:0/4033829008 shutdown_connections 2023-12-19T18:04:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 --2- 172.21.15.45:0/4033829008 >> v2:172.21.15.73:3300/0 conn(0x7f4a740ce150 0x7f4a740b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 --2- 172.21.15.45:0/4033829008 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740d1040 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 -- 172.21.15.45:0/4033829008 >> 172.21.15.45:0/4033829008 conn(0x7f4a74066380 msgr2=0x7f4a740cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 -- 172.21.15.45:0/4033829008 shutdown_connections 2023-12-19T18:04:10.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.480+0000 7f4a799f9700 1 -- 172.21.15.45:0/4033829008 wait complete. 2023-12-19T18:04:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 Processor -- start 2023-12-19T18:04:10.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 -- start start 2023-12-19T18:04:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a740b88e0 0x7f4a741542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 0x7f4a74153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74158620 con 0x7f4a740ce150 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a740cd7a0 con 0x7f4a740b88e0 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.484+0000 7f4a799f9700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a74158870 con 0x7f4a7415cf80 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 0x7f4a74153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 0x7f4a74153aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42378/0 (socket says 172.21.15.45:42378) 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a72ffd700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a740b88e0 0x7f4a741542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 -- 172.21.15.45:0/2678105338 learned_addr learned my addr 172.21.15.45:0/2678105338 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:10.493 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a737fe700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 -- 172.21.15.45:0/2678105338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 msgr2=0x7f4a740ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.494 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 -- 172.21.15.45:0/2678105338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a740b88e0 msgr2=0x7f4a741542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a740b88e0 0x7f4a741542b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 -- 172.21.15.45:0/2678105338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a64009570 con 0x7f4a740ce150 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a727fc700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 0x7f4a74153aa0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c500 tx=0x7f4a6800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680052d0 con 0x7f4a740ce150 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a68005430 con 0x7f4a740ce150 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a680055a0 con 0x7f4a740ce150 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a74158b50 con 0x7f4a740ce150 2023-12-19T18:04:10.495 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.488+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a74153fe0 con 0x7f4a740ce150 2023-12-19T18:04:10.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.492+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a74159010 con 0x7f4a740ce150 2023-12-19T18:04:10.498 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.492+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4a680038e0 con 0x7f4a740ce150 2023-12-19T18:04:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.496+0000 7f4a5bfff700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4a60065ad0 0x7f4a60067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:10.501 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.496+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4a68082350 con 0x7f4a740ce150 2023-12-19T18:04:10.502 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.496+0000 7f4a72ffd700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4a60065ad0 0x7f4a60067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:10.504 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.496+0000 7f4a72ffd700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4a60065ad0 0x7f4a60067f90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c00 tx=0x7f4a64008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:10.507 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.500+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4a6804feb0 con 0x7f4a740ce150 2023-12-19T18:04:10.739 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.732+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]} v 0) v1 -- 0x7f4a7404ed30 con 0x7f4a740ce150 2023-12-19T18:04:10.851 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.844+0000 7f4a5bfff700 1 -- 172.21.15.45:0/2678105338 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_data_scan.TestDataScan.test_fragmented_injection"]}]=0 v560) v1 ==== 145+0+0 (secure 0 0 0) 0x7f4a680534d0 con 0x7f4a740ce150 2023-12-19T18:04:10.855 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4a60065ad0 msgr2=0x7f4a60067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4a60065ad0 0x7f4a60067f90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4a64000c00 tx=0x7f4a64008030 comp rx=0 tx=0).stop 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 msgr2=0x7f4a74153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 0x7f4a74153aa0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f4a6800c500 tx=0x7f4a6800c810 comp rx=0 tx=0).stop 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 shutdown_connections 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4a60065ad0 0x7f4a60067f90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4a7415cf80 0x7f4a740ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.856 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4a740ce150 0x7f4a74153aa0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 --2- 172.21.15.45:0/2678105338 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a740b88e0 0x7f4a741542b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:10.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 >> 172.21.15.45:0/2678105338 conn(0x7f4a74066380 msgr2=0x7f4a740b1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:10.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 shutdown_connections 2023-12-19T18:04:10.857 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:10.848+0000 7f4a799f9700 1 -- 172.21.15.45:0/2678105338 wait complete. 2023-12-19T18:04:10.878 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. ... ERROR 2023-12-19T18:04:10.879 INFO:tasks.cephfs_test_runner: 2023-12-19T18:04:10.879 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T18:04:10.879 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_data_scan.py", line 560, in test_fragmented_injection 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"sudo cat subdir/{victim_dentry}", omit_sudo=False).stdout.getvalue().strip() 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/mount.py", line 795, in run_shell_payload 2023-12-19T18:04:10.880 INFO:tasks.cephfs_test_runner: return self.run_shell(**kwargs) 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/mount.py", line 786, in run_shell 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-19T18:04:10.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21')" 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner: 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T18:04:10.882 INFO:tasks.cephfs_test_runner:Ran 5 tests in 696.995s 2023-12-19T18:04:10.883 INFO:tasks.cephfs_test_runner: 2023-12-19T18:04:10.883 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-12-19T18:04:10.883 INFO:tasks.cephfs_test_runner: 2023-12-19T18:04:10.883 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-19T18:04:10.883 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner:That when injecting a dentry into a fragmented directory, we put it in the right fragment. 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/test_data_scan.py", line 560, in test_fragmented_injection 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"sudo cat subdir/{victim_dentry}", omit_sudo=False).stdout.getvalue().strip() 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/mount.py", line 795, in run_shell_payload 2023-12-19T18:04:10.884 INFO:tasks.cephfs_test_runner: return self.run_shell(**kwargs) 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs/mount.py", line 786, in run_shell 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/remote.py", line 523, in run 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 455, in run 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: r.wait() 2023-12-19T18:04:10.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 161, in wait 2023-12-19T18:04:10.886 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-12-19T18:04:10.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-12-19T18:04:10.886 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-12-19T18:04:10.886 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi045 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo cat subdir/21')" 2023-12-19T18:04:10.886 INFO:tasks.cephfs_test_runner: 2023-12-19T18:04:10.887 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T18:04:10.998 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=66c046fe4fd440abba75682732716755 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) 2023-12-19T18:04:10.999 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-19T18:04:11.008 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-19T18:04:11.052 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-19T18:04:11.052 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:04:11.052 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:11.089 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:04:11.089 DEBUG:teuthology.orchestra.run.smithi045:> set -ex 2023-12-19T18:04:11.089 DEBUG:teuthology.orchestra.run.smithi045:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:11.152 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16355412k,nr_inodes=4088853,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=8239 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3276004k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3276004k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-19T18:04:11.152 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:04:11.152 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:11.173 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:04:11.173 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2023-12-19T18:04:11.174 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-19T18:04:11.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,noexec,relatime,size=16352244k,nr_inodes=4088061,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 tmpfs /sys/fs/cgroup tmpfs ro,nosuid,nodev,noexec,mode=755 0 0 cgroup2 /sys/fs/cgroup/unified cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,nosuid,nodev,noexec,relatime,xattr,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,nosuid,nodev,noexec,relatime,hugetlb 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=28,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2419 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,mode=700,uid=1000,gid=1267 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-19T18:04:11.234 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.234 DEBUG:teuthology.orchestra.run.smithi073:> ip netns list 2023-12-19T18:04:11.294 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-19T18:04:11.295 INFO:teuthology.orchestra.run.smithi073.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-19T18:04:11.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.295 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-19T18:04:11.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.372 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-19T18:04:11.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.469 DEBUG:teuthology.orchestra.run.smithi073:> sudo ip link delete ceph-brx 2023-12-19T18:04:11.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.621 DEBUG:teuthology.orchestra.run.smithi045:> ip netns list 2023-12-19T18:04:11.641 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-19T18:04:11.642 INFO:teuthology.orchestra.run.smithi045.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-19T18:04:11.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-19T18:04:11.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.724 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-19T18:04:11.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-19T18:04:11.811 DEBUG:teuthology.orchestra.run.smithi045:> sudo ip link delete ceph-brx 2023-12-19T18:04:12.011 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-19T18:04:12.021 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-19T18:04:12.021 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:04:12.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.196+0000 7fbb8d94f700 1 Processor -- start 2023-12-19T18:04:12.203 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.196+0000 7fbb8d94f700 1 -- start start 2023-12-19T18:04:12.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d94f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb880ca5f0 0x7fbb8815e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d94f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb880caa20 con 0x7fbb880cd090 2023-12-19T18:04:12.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d94f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb8815e590 con 0x7fbb8815d1e0 2023-12-19T18:04:12.205 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d94f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb880b2530 con 0x7fbb880ca5f0 2023-12-19T18:04:12.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb880ca5f0 0x7fbb8815e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fbb880ca5f0 0x7fbb8815e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42388/0 (socket says 172.21.15.45:42388) 2023-12-19T18:04:12.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 -- 172.21.15.45:0/558813437 learned_addr learned my addr 172.21.15.45:0/558813437 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:12.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 -- 172.21.15.45:0/558813437 >> v1:172.21.15.73:6789/0 conn(0x7fbb8815d1e0 legacy=0x7fbb880cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:12.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 -- 172.21.15.45:0/558813437 >> v1:172.21.15.45:6789/0 conn(0x7fbb880cd090 legacy=0x7fbb880cfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 -- 172.21.15.45:0/558813437 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb880b1920 con 0x7fbb880ca5f0 2023-12-19T18:04:12.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb7f7fe700 1 -- 172.21.15.45:0/558813437 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747065985 0 0) 0x7fbb880caa20 con 0x7fbb880cd090 2023-12-19T18:04:12.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d14e700 1 --2- 172.21.15.45:0/558813437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880ca5f0 0x7fbb8815e050 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009910 tx=0x7fbb80009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7857bf78b05a07aa server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:12.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb7f7fe700 1 -- 172.21.15.45:0/558813437 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8000ba60 con 0x7fbb880ca5f0 2023-12-19T18:04:12.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb7f7fe700 1 -- 172.21.15.45:0/558813437 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8000bbc0 con 0x7fbb880ca5f0 2023-12-19T18:04:12.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb7f7fe700 1 -- 172.21.15.45:0/558813437 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb80009e60 con 0x7fbb880ca5f0 2023-12-19T18:04:12.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d94f700 1 -- 172.21.15.45:0/558813437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880ca5f0 msgr2=0x7fbb8815e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.200+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/558813437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880ca5f0 0x7fbb8815e050 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7fbb80009910 tx=0x7fbb80009c20 comp rx=0 tx=0).stop 2023-12-19T18:04:12.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.204+0000 7fbb8d94f700 1 -- 172.21.15.45:0/558813437 shutdown_connections 2023-12-19T18:04:12.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.204+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/558813437 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880ca5f0 0x7fbb8815e050 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.204+0000 7fbb8d94f700 1 -- 172.21.15.45:0/558813437 >> 172.21.15.45:0/558813437 conn(0x7fbb8806f260 msgr2=0x7fbb8806f640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:12.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.204+0000 7fbb8d94f700 1 -- 172.21.15.45:0/558813437 shutdown_connections 2023-12-19T18:04:12.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.204+0000 7fbb8d94f700 1 -- 172.21.15.45:0/558813437 wait complete. 2023-12-19T18:04:12.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 Processor -- start 2023-12-19T18:04:12.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 -- start start 2023-12-19T18:04:12.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb880ca5f0 0x7fbb880c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 0x7fbb88146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb880c6250 0x7fbb880af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88144800 con 0x7fbb880cd090 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb88147a40 con 0x7fbb880c6250 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d94f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb880c4f50 con 0x7fbb880ca5f0 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 0x7fbb88146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb7ffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 0x7fbb88146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42404/0 (socket says 172.21.15.45:42404) 2023-12-19T18:04:12.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb7ffff700 1 -- 172.21.15.45:0/1240530375 learned_addr learned my addr 172.21.15.45:0/1240530375 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8c94d700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb880ca5f0 0x7fbb880c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.208+0000 7fbb8d14e700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb880c6250 0x7fbb880af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7ffff700 1 -- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb880ca5f0 msgr2=0x7fbb880c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7ffff700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb880ca5f0 0x7fbb880c5d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7ffff700 1 -- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb880c6250 msgr2=0x7fbb880af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7ffff700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb880c6250 0x7fbb880af9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7ffff700 1 -- 172.21.15.45:0/1240530375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb80009570 con 0x7fbb880cd090 2023-12-19T18:04:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7ffff700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 0x7fbb88146fd0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c520 tx=0x7fbb7800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb780054e0 con 0x7fbb880cd090 2023-12-19T18:04:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb780036a0 con 0x7fbb880cd090 2023-12-19T18:04:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb78003a10 con 0x7fbb880cd090 2023-12-19T18:04:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb880c5230 con 0x7fbb880cd090 2023-12-19T18:04:12.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb880c57f0 con 0x7fbb880cd090 2023-12-19T18:04:12.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.212+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8804ed30 con 0x7fbb880cd090 2023-12-19T18:04:12.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.216+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fbb78003b70 con 0x7fbb880cd090 2023-12-19T18:04:12.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.216+0000 7fbb7d7fa700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb74065ad0 0x7fbb74067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.216+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fbb78082320 con 0x7fbb880cd090 2023-12-19T18:04:12.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.216+0000 7fbb8c94d700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb74065ad0 0x7fbb74067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.216+0000 7fbb8c94d700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb74065ad0 0x7fbb74067f90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbb840012e0 tx=0x7fbb84009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:12.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.224+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fbb7804fe90 con 0x7fbb880cd090 2023-12-19T18:04:12.403 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.396+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbb880b1ee0 con 0x7fbb74065ad0 2023-12-19T18:04:12.409 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.404+0000 7fbb7d7fa700 1 -- 172.21.15.45:0/1240530375 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47861 (secure 0 0 0) 0x7fbb8400fc20 con 0x7fbb74065ad0 2023-12-19T18:04:12.410 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb74065ad0 msgr2=0x7fbb74067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb74065ad0 0x7fbb74067f90 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbb840012e0 tx=0x7fbb84009040 comp rx=0 tx=0).stop 2023-12-19T18:04:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 msgr2=0x7fbb88146fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.415 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 0x7fbb88146fd0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c520 tx=0x7fbb7800c830 comp rx=0 tx=0).stop 2023-12-19T18:04:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 shutdown_connections 2023-12-19T18:04:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fbb74065ad0 0x7fbb74067f90 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb880c6250 0x7fbb880af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.416 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fbb880cd090 0x7fbb88146fd0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 --2- 172.21.15.45:0/1240530375 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fbb880ca5f0 0x7fbb880c5d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 >> 172.21.15.45:0/1240530375 conn(0x7fbb8806f260 msgr2=0x7fbb8806e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 shutdown_connections 2023-12-19T18:04:12.417 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.408+0000 7fbb8d94f700 1 -- 172.21.15.45:0/1240530375 wait complete. 2023-12-19T18:04:12.418 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:04:12.438 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2023-12-19T18:04:10.475584+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":268020,"kb_used_data":15540,"kb_used_omap":0,"kb_used_meta":252416,"kb_avail":754706700,"statfs":{"total":773094113280,"available":772819660800,"internally_reserved":0,"allocated":15912960,"data_stored":8358559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258473984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-405485,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1515,"num_write":-916,"num_write_kb":-954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002279"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":281,"reported_epoch":130,"state":"active+clean","last_fresh":"2023-12-19T18:03:31.420935+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:03:31.420935+0000","last_peered":"2023-12-19T18:03:31.420935+0000","last_clean":"2023-12-19T18:03:31.420935+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:03:31.420935+0000","last_undegraded":"2023-12-19T18:03:31.420935+0000","last_fullsized":"2023-12-19T18:03:31.420935+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33344,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338496,"statfs":{"total":96636764160,"available":96602619904,"internally_reserved":0,"allocated":2351104,"data_stored":1387180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.228,"15min":1.1259999999999999},"min":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.302,"15min":1.1870000000000001},"min":{"1min":0.71299999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.512,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.004}]},{"osd":1,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.179,"15min":1.099},"min":{"1min":0.63600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4470000000000001,"5min":12.625,"15min":12.625},"last":0.68400000000000005},{"interface":"front","average":{"1min":1.056,"5min":1.1819999999999999,"15min":1.131},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.52600000000000002},"max":{"1min":1.3220000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.88}]},{"osd":2,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1759999999999999,"15min":1.093},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.353,"5min":13.041,"15min":13.041},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.016,"5min":1.5820000000000001,"15min":1.28},"min":{"1min":0.74199999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.278,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.0529999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2569999999999999,"15min":1.167},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":12.917,"15min":12.917},"last":0.75900000000000001},{"interface":"front","average":{"1min":1.244,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":0.90000000000000002,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":46.375,"15min":46.375},"last":1.1559999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2629999999999999,"15min":1.204},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4259999999999999,"5min":13.137,"15min":13.137},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.363,"15min":1.298},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.47499999999999998},"max":{"1min":1.407,"5min":13.109,"15min":13.109},"last":1.135}]},{"osd":5,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.292,"15min":1.238},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5349999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.208},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.333,"15min":1.2809999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.651,"5min":13.198,"15min":13.198},"last":1.1140000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4990000000000001,"15min":1.415},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7929999999999999,"5min":13.442,"15min":13.442},"last":1.1839999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4450000000000001,"15min":1.359},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.52700000000000002},"max":{"1min":1.667,"5min":13.981,"15min":13.981},"last":1.091}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1704,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1744896,"data_stored":796618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0089999999999999,"15min":1.0780000000000001},"min":{"1min":0.69099999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.331,"5min":1.399,"15min":4.5979999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.069},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5860000000000001,"5min":1.756,"15min":1.756},"last":1.026}]},{"osd":1,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.095,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.325,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.302},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.1080000000000001},"min":{"1min":0.77700000000000002,"5min":0.63800000000000001,"15min":0.48099999999999998},"max":{"1min":1.2929999999999999,"5min":1.583,"15min":1.621},"last":0.90300000000000002}]},{"osd":2,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.131,"15min":1.2529999999999999},"min":{"1min":0.77700000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4510000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.079},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1950000000000001,"15min":1.206},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.492,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.129}]},{"osd":3,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1799999999999999,"15min":1.2390000000000001},"min":{"1min":0.85299999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.55,"5min":1.651,"15min":4.5380000000000003},"last":1.208},{"interface":"front","average":{"1min":1.262,"5min":1.224,"15min":1.278},"min":{"1min":0.94299999999999995,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":4.508},"last":0.94199999999999995}]},{"osd":4,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.2330000000000001,"5min":1.577,"15min":1.8360000000000001},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.28,"5min":1.23,"15min":1.238},"min":{"1min":0.90800000000000003,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.6819999999999999,"5min":1.802,"15min":1.899},"last":1.288}]},{"osd":5,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2609999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.579,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.94399999999999995,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.615,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.256}]},{"osd":7,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.357,"5min":1.3779999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.7609999999999999,"5min":1.841,"15min":2.2440000000000002},"last":1.238}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1724,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1765376,"data_stored":796204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.026,"15min":1.004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54600000000000004},"max":{"1min":1.3,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.0609999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.73,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":0.996}]},{"osd":1,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.117},"min":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.591,"5min":1.974,"15min":1.974},"last":1.042},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.84199999999999997,"5min":0.752,"15min":0.65500000000000003},"max":{"1min":1.7709999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.016}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.70999999999999996,"5min":0.65700000000000003,"15min":0.45500000000000002},"max":{"1min":1.397,"5min":1.891,"15min":2.9929999999999999},"last":1.1459999999999999},{"interface":"front","average":{"1min":1.123,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5229999999999999,"5min":2.024,"15min":2.024},"last":1.181}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.2250000000000001},"min":{"1min":0.89200000000000002,"5min":0.75,"15min":0.64500000000000002},"max":{"1min":1.73,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.90900000000000003,"5min":0.73799999999999999,"15min":0.63500000000000001},"max":{"1min":1.6160000000000001,"5min":1.829,"15min":3.0350000000000001},"last":1.266}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.704,"5min":3.633,"15min":3.633},"last":1.407},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3049999999999999,"15min":1.335},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.745},"max":{"1min":1.9370000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.105}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.256,"15min":1.3080000000000001},"min":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.7310000000000001,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":0.875},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.82899999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.802,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.3029999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.333,"15min":1.395},"min":{"1min":0.88,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.992,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.216},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.387,"15min":1.4630000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.82499999999999996},"max":{"1min":1.895,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.373}]}]},{"osd":4,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33136,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338704,"statfs":{"total":96636764160,"available":96602832896,"internally_reserved":0,"allocated":2138112,"data_stored":1200523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0960000000000001,"15min":1.159},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.423,"5min":1.556,"15min":5.4420000000000002},"last":1.0509999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.196,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.52,"5min":1.657,"15min":5.5049999999999999},"last":1.2190000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.75800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4359999999999999,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.105},{"interface":"front","average":{"1min":1.099,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.349,"5min":1.5589999999999999,"15min":3.254},"last":0.96799999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.071,"15min":1.173},"min":{"1min":0.86799999999999999,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.2889999999999999,"5min":1.623,"15min":4.593},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.175,"15min":1.198},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.619,"5min":1.871,"15min":2.3799999999999999},"last":1}]},{"osd":3,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.137,"15min":1.1910000000000001},"min":{"1min":0.73599999999999999,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.504,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.21,"15min":1.294},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.63300000000000001},"max":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.383}]},{"osd":5,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1899999999999999,"15min":1.2010000000000001},"min":{"1min":0.83199999999999996,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.595,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.177,"15min":1.1719999999999999},"min":{"1min":0.73399999999999999,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.157},"last":1.3069999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2330000000000001,"15min":1.248},"min":{"1min":0.85599999999999998,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.482,"5min":1.6910000000000001,"15min":2.915},"last":1.135},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.389,"15min":1.399},"min":{"1min":0.82199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.3500000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.29,"15min":1.306},"min":{"1min":0.80400000000000005,"5min":0.72799999999999998,"15min":0.56899999999999995},"max":{"1min":1.7370000000000001,"5min":1.907,"15min":2.4340000000000002},"last":1.425},{"interface":"front","average":{"1min":1.329,"5min":1.353,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.88500000000000001,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":1.833,"15min":5.6859999999999999},"last":1.738}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33168,"kb_used_data":2120,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338672,"statfs":{"total":96636764160,"available":96602800128,"internally_reserved":0,"allocated":2170880,"data_stored":1200573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.64400000000000002,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.86099999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.93000000000000005,"15min":0.91500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6259999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.94899999999999995}]},{"osd":1,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":0.96399999999999997,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.093,"15min":1.0449999999999999},"min":{"1min":0.65900000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.72499999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.1599999999999999,"15min":1.117},"min":{"1min":0.69399999999999995,"5min":0.59099999999999997,"15min":0.52200000000000002},"max":{"1min":8.9290000000000003,"5min":8.9290000000000003,"15min":8.9290000000000003},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.198,"15min":1.2},"min":{"1min":0.85699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.0169999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1759999999999999,"15min":1.198},"min":{"1min":0.76600000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.698,"5min":1.7310000000000001,"15min":2.234},"last":1.115},{"interface":"front","average":{"1min":1.651,"5min":1.375,"15min":1.321},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.70299999999999996},"max":{"1min":7.1890000000000001,"5min":7.1890000000000001,"15min":7.1890000000000001},"last":1.0629999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.381,"15min":1.371},"min":{"1min":0.94699999999999995,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.284,"15min":1.3069999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7310000000000001,"5min":1.776,"15min":2.754},"last":1.228}]},{"osd":6,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.411,"15min":1.3919999999999999},"min":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":7.4189999999999996,"5min":7.4189999999999996,"15min":7.4189999999999996},"last":1.167},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4379999999999999,"15min":1.4410000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.2}]},{"osd":7,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3700000000000001,"15min":1.3899999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7330000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.506,"15min":1.4830000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.83099999999999996},"max":{"1min":8.8889999999999993,"5min":8.8889999999999993,"15min":8.8889999999999993},"last":1.2509999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1696,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1736704,"data_stored":796034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.91100000000000003,"15min":1.0669999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.29599999999999999},"max":{"1min":1.224,"5min":3.9209999999999998,"15min":13.32},"last":0.92100000000000004},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.1699999999999999},"min":{"1min":0.59699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3100000000000001,"5min":3.8149999999999999,"15min":13.206},"last":1.079}]},{"osd":1,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.94599999999999995,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.284,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.022,"5min":0.98899999999999999,"15min":0.98499999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6950000000000001,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.83699999999999997}]},{"osd":3,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.617,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.88},{"interface":"front","average":{"1min":1.103,"5min":1.161,"15min":1.179},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":2.75,"15min":2.75},"last":1.3899999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2589999999999999,"15min":1.248},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.27},"min":{"1min":0.875,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.4370000000000001,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.4159999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.228,"15min":1.252},"min":{"1min":0.94099999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.504,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.123},{"interface":"front","average":{"1min":1.3,"5min":1.341,"15min":1.3859999999999999},"min":{"1min":0.96999999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.6739999999999999,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.484}]},{"osd":6,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.90500000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.679,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.214},{"interface":"front","average":{"1min":1.224,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.91500000000000004,"15min":0.872},"max":{"1min":1.4850000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.038}]},{"osd":7,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4199999999999999,"15min":1.419},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.627,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.321},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3700000000000001,"15min":1.3779999999999999},"min":{"1min":0.97399999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.698,"5min":5.375,"15min":5.375},"last":1.1679999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575004,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32704,"kb_used_data":1656,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339136,"statfs":{"total":96636764160,"available":96603275264,"internally_reserved":0,"allocated":1695744,"data_stored":796033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.42399999999999999},"max":{"1min":1.387,"5min":1.671,"15min":1.931},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.999,"5min":0.96199999999999997,"15min":0.97799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3240000000000001,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.879}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83499999999999996,"15min":0.89800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.292,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.997,"15min":1.048},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":3.4199999999999999},"last":0.76100000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.109,"15min":1.167},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":3.4950000000000001},"last":1.232},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95799999999999996,"15min":1.0620000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":4.2030000000000003},"last":1.101}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.278,"15min":1.3320000000000001},"min":{"1min":0.871,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.891,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.173},{"interface":"front","average":{"1min":1.232,"5min":1.226,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56999999999999995},"max":{"1min":1.736,"5min":1.736,"15min":2.6960000000000002},"last":1.319}]},{"osd":5,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.69599999999999995},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":2.9249999999999998},"last":1.155},{"interface":"front","average":{"1min":1.381,"5min":1.3180000000000001,"15min":1.3899999999999999},"min":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.69399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":3.8420000000000001},"last":1.421}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.333,"15min":1.425},"min":{"1min":1.0249999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9990000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.4390000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72899999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":3.214},"last":1.2529999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.379,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.254,"5min":2.254,"15min":4.0910000000000002},"last":1.488},{"interface":"front","average":{"1min":1.353,"5min":1.337,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":4.6390000000000002},"last":1.3400000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37400,"kb_used_data":2256,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334440,"statfs":{"total":96636764160,"available":96598466560,"internally_reserved":0,"allocated":2310144,"data_stored":1385394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88900000000000001,"15min":0.93300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46700000000000003},"max":{"1min":1.3740000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.012,"5min":0.97299999999999998,"15min":1.056},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":1.335,"5min":1.73,"15min":2.3599999999999999},"last":0.90400000000000003}]},{"osd":2,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88300000000000001,"15min":0.93000000000000005},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.242,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.93400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.85699999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.95699999999999996,"15min":0.97699999999999998},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.196,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.008},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":1.6100000000000001,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.1060000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.282,"15min":1.3109999999999999},"min":{"1min":0.89400000000000002,"5min":0.79700000000000004,"15min":0.69899999999999995},"max":{"1min":1.645,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.2},{"interface":"front","average":{"1min":1.194,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.85999999999999999,"5min":0.71599999999999997,"15min":0.68999999999999995},"max":{"1min":1.605,"5min":1.738,"15min":2.7799999999999998},"last":1.4039999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.76300000000000001},"max":{"1min":1.421,"5min":1.758,"15min":2.0579999999999998},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.294,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.044}]},{"osd":6,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.1000000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2769999999999999,"15min":1.3540000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.978,"5min":1.978,"15min":2.3889999999999998},"last":1.353}]},{"osd":7,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.454},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":4.9400000000000004},"last":1.397},{"interface":"front","average":{"1min":1.206,"5min":1.321,"15min":1.423},"min":{"1min":0.92100000000000004,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.5309999999999999,"5min":1.875,"15min":4.8250000000000002},"last":1.492}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:04:12.440 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:04:12.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.616+0000 7f0d0cca7700 1 Processor -- start 2023-12-19T18:04:12.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.616+0000 7f0d0cca7700 1 -- start start 2023-12-19T18:04:12.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0cca7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d0815d370 0x7f0d080d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0cca7700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d080b22b0 0x7f0d080b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0cca7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d080b50b0 0x7f0d0806b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0cca7700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080b5540 con 0x7f0d080b50b0 2023-12-19T18:04:12.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0cca7700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d0815d750 con 0x7f0d080b22b0 2023-12-19T18:04:12.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0cca7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080d21d0 con 0x7f0d0815d370 2023-12-19T18:04:12.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d080b50b0 0x7f0d0806b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d0659c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d0815d370 0x7f0d080d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0cfdd9b700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f0d080b22b0 0x7f0d080b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.626 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f0d080b50b0 0x7f0d0806b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42420/0 (socket says 172.21.15.45:42420) 2023-12-19T18:04:12.627 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 -- 172.21.15.45:0/899608947 learned_addr learned my addr 172.21.15.45:0/899608947 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 -- 172.21.15.45:0/899608947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d0815d370 msgr2=0x7f0d080d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 --2- 172.21.15.45:0/899608947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d0815d370 0x7f0d080d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 -- 172.21.15.45:0/899608947 >> v2:172.21.15.73:3300/0 conn(0x7f0d080b22b0 msgr2=0x7f0d080b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 --2- 172.21.15.45:0/899608947 >> v2:172.21.15.73:3300/0 conn(0x7f0d080b22b0 0x7f0d080b4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 -- 172.21.15.45:0/899608947 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d080d11c0 con 0x7f0d080b50b0 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d06d9d700 1 --2- 172.21.15.45:0/899608947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b50b0 0x7f0d0806b860 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f0d08066cf0 tx=0x7f0d00009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a468672ff2fe19b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d05d9b700 1 -- 172.21.15.45:0/899608947 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011830 con 0x7f0d080b50b0 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d05d9b700 1 -- 172.21.15.45:0/899608947 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d00011990 con 0x7f0d080b50b0 2023-12-19T18:04:12.628 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.620+0000 7f0d05d9b700 1 -- 172.21.15.45:0/899608947 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00011d40 con 0x7f0d080b50b0 2023-12-19T18:04:12.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 -- 172.21.15.45:0/899608947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b50b0 msgr2=0x7f0d0806b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.629 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/899608947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b50b0 0x7f0d0806b860 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f0d08066cf0 tx=0x7f0d00009c20 comp rx=0 tx=0).stop 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 -- 172.21.15.45:0/899608947 shutdown_connections 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/899608947 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b50b0 0x7f0d0806b860 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/899608947 >> v2:172.21.15.73:3300/0 conn(0x7f0d080b22b0 0x7f0d080b4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/899608947 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d0815d370 0x7f0d080d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 -- 172.21.15.45:0/899608947 >> 172.21.15.45:0/899608947 conn(0x7f0d080cfb70 msgr2=0x7f0d080cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 -- 172.21.15.45:0/899608947 shutdown_connections 2023-12-19T18:04:12.630 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.624+0000 7f0d0cca7700 1 -- 172.21.15.45:0/899608947 wait complete. 2023-12-19T18:04:12.632 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 Processor -- start 2023-12-19T18:04:12.633 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 -- start start 2023-12-19T18:04:12.634 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 0x7f0d080c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d080b50b0 0x7f0d08146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d0815d370 0x7f0d08148aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080c7160 con 0x7f0d080b22b0 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080b34e0 con 0x7f0d0815d370 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d080b2bb0 con 0x7f0d080b50b0 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 0x7f0d080c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 0x7f0d080c6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42434/0 (socket says 172.21.15.45:42434) 2023-12-19T18:04:12.635 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 -- 172.21.15.45:0/1484805302 learned_addr learned my addr 172.21.15.45:0/1484805302 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:12.636 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d06d9d700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d0815d370 0x7f0d08148aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0cfdd9b700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d080b50b0 0x7f0d08146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 -- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d080b50b0 msgr2=0x7f0d08146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d080b50b0 0x7f0d08146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 -- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d0815d370 msgr2=0x7f0d08148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d0815d370 0x7f0d08148aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 -- 172.21.15.45:0/1484805302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00009570 con 0x7f0d080b22b0 2023-12-19T18:04:12.637 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0cfdd9b700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d080b50b0 0x7f0d08146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d06d9d700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d0815d370 0x7f0d08148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0659c700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 0x7f0d080c6c20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800e9d0 tx=0x7f0cf800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8009720 con 0x7f0d080b22b0 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf800c850 con 0x7f0d080b22b0 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf800cbc0 con 0x7f0d080b22b0 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.628+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d080b2e90 con 0x7f0d080b22b0 2023-12-19T18:04:12.638 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.632+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d08146f90 con 0x7f0d080b22b0 2023-12-19T18:04:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.632+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d080d2ef0 con 0x7f0d080b22b0 2023-12-19T18:04:12.639 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.632+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f0cf800cd20 con 0x7f0d080b22b0 2023-12-19T18:04:12.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.636+0000 7f0cff7fe700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0ce8065ad0 0x7f0ce8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:12.640 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.636+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f0cf8083200 con 0x7f0d080b22b0 2023-12-19T18:04:12.641 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.636+0000 7f0cfdd9b700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0ce8065ad0 0x7f0ce8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:12.642 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.636+0000 7f0cfdd9b700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0ce8065ad0 0x7f0ce8067f90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0d0814d160 tx=0x7f0cf000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:12.648 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.640+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f0cf8050c30 con 0x7f0d080b22b0 2023-12-19T18:04:12.822 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.816+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d080d1410 con 0x7f0ce8065ad0 2023-12-19T18:04:12.827 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.820+0000 7f0cff7fe700 1 -- 172.21.15.45:0/1484805302 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47981 (secure 0 0 0) 0x7f0cf0007d20 con 0x7f0ce8065ad0 2023-12-19T18:04:12.828 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0ce8065ad0 msgr2=0x7f0ce8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0ce8065ad0 0x7f0ce8067f90 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f0d0814d160 tx=0x7f0cf000b040 comp rx=0 tx=0).stop 2023-12-19T18:04:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 msgr2=0x7f0d080c6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:12.830 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 0x7f0d080c6c20 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800e9d0 tx=0x7f0cf800ed90 comp rx=0 tx=0).stop 2023-12-19T18:04:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 shutdown_connections 2023-12-19T18:04:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f0ce8065ad0 0x7f0ce8067f90 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0d0815d370 0x7f0d08148aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f0d080b50b0 0x7f0d08146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.831 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 --2- 172.21.15.45:0/1484805302 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f0d080b22b0 0x7f0d080c6c20 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 >> 172.21.15.45:0/1484805302 conn(0x7f0d080cfb70 msgr2=0x7f0d080d3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 shutdown_connections 2023-12-19T18:04:12.832 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:12.824+0000 7f0d0cca7700 1 -- 172.21.15.45:0/1484805302 wait complete. 2023-12-19T18:04:12.833 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:04:12.855 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2023-12-19T18:04:12.476075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":266816,"kb_used_data":14336,"kb_used_omap":0,"kb_used_meta":252416,"kb_avail":754707904,"statfs":{"total":773094113280,"available":772820893696,"internally_reserved":0,"allocated":14680064,"data_stored":7694584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258473984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-405485,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1515,"num_write":-918,"num_write_kb":-954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002188"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-19T18:04:08.841843+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:04:08.841843+0000","last_peered":"2023-12-19T18:04:08.841843+0000","last_clean":"2023-12-19T18:04:08.841843+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:04:08.841843+0000","last_undegraded":"2023-12-19T18:04:08.841843+0000","last_fullsized":"2023-12-19T18:04:08.841843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2269184,"data_stored":1405477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.228,"15min":1.1259999999999999},"min":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.454},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.302,"15min":1.1870000000000001},"min":{"1min":0.71299999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.512,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.3939999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.179,"15min":1.099},"min":{"1min":0.63600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4470000000000001,"5min":12.625,"15min":12.625},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.1819999999999999,"15min":1.131},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.52600000000000002},"max":{"1min":1.3220000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1759999999999999,"15min":1.093},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.353,"5min":13.041,"15min":13.041},"last":1.048},{"interface":"front","average":{"1min":1.016,"5min":1.5820000000000001,"15min":1.28},"min":{"1min":0.74199999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.278,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.266}]},{"osd":3,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2569999999999999,"15min":1.167},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":12.917,"15min":12.917},"last":1.359},{"interface":"front","average":{"1min":1.244,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":0.90000000000000002,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":46.375,"15min":46.375},"last":1.411}]},{"osd":4,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2629999999999999,"15min":1.204},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4259999999999999,"5min":13.137,"15min":13.137},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.363,"15min":1.298},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.47499999999999998},"max":{"1min":1.407,"5min":13.109,"15min":13.109},"last":1.1599999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.292,"15min":1.238},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5349999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.097},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.333,"15min":1.2809999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.651,"5min":13.198,"15min":13.198},"last":1.077}]},{"osd":6,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4990000000000001,"15min":1.415},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7929999999999999,"5min":13.442,"15min":13.442},"last":1.304},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4450000000000001,"15min":1.359},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.52700000000000002},"max":{"1min":1.667,"5min":13.981,"15min":13.981},"last":1.238}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32776,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1769472,"data_stored":809104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0089999999999999,"15min":1.0780000000000001},"min":{"1min":0.69099999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.331,"5min":1.399,"15min":4.5979999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.069},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5860000000000001,"5min":1.756,"15min":1.756},"last":1.226}]},{"osd":1,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.095,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.325,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.1080000000000001},"min":{"1min":0.77700000000000002,"5min":0.63800000000000001,"15min":0.48099999999999998},"max":{"1min":1.2929999999999999,"5min":1.583,"15min":1.621},"last":1.107}]},{"osd":2,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.131,"15min":1.2529999999999999},"min":{"1min":0.77700000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4510000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1950000000000001,"15min":1.206},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.492,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.3899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1799999999999999,"15min":1.2390000000000001},"min":{"1min":0.85299999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.55,"5min":1.651,"15min":4.5380000000000003},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.224,"15min":1.278},"min":{"1min":0.94299999999999995,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":4.508},"last":1.014}]},{"osd":4,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.2330000000000001,"5min":1.577,"15min":1.8360000000000001},"last":1.3},{"interface":"front","average":{"1min":1.28,"5min":1.23,"15min":1.238},"min":{"1min":0.90800000000000003,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.6819999999999999,"5min":1.802,"15min":1.899},"last":1.603}]},{"osd":5,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2609999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.579,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.94399999999999995,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.615,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.4370000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.73},{"interface":"front","average":{"1min":1.357,"5min":1.3779999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.7609999999999999,"5min":1.841,"15min":2.2440000000000002},"last":1.635}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.026,"15min":1.004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54600000000000004},"max":{"1min":1.3,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.0609999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.73,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.202}]},{"osd":1,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.117},"min":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.591,"5min":1.974,"15min":1.974},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.84199999999999997,"5min":0.752,"15min":0.65500000000000003},"max":{"1min":1.7709999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.137}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.70999999999999996,"5min":0.65700000000000003,"15min":0.45500000000000002},"max":{"1min":1.397,"5min":1.891,"15min":2.9929999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.123,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5229999999999999,"5min":2.024,"15min":2.024},"last":0.70799999999999996}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.2250000000000001},"min":{"1min":0.89200000000000002,"5min":0.75,"15min":0.64500000000000002},"max":{"1min":1.73,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.238},{"interface":"front","average":{"1min":1.3,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.90900000000000003,"5min":0.73799999999999999,"15min":0.63500000000000001},"max":{"1min":1.6160000000000001,"5min":1.829,"15min":3.0350000000000001},"last":1.452}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.704,"5min":3.633,"15min":3.633},"last":1.478},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3049999999999999,"15min":1.335},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.745},"max":{"1min":1.9370000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.2949999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.256,"15min":1.3080000000000001},"min":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.7310000000000001,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.82899999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.802,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.333,"15min":1.395},"min":{"1min":0.88,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.992,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.387,"15min":1.4630000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.82499999999999996},"max":{"1min":1.895,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.343}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0960000000000001,"15min":1.159},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.423,"5min":1.556,"15min":5.4420000000000002},"last":0.995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.196,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.52,"5min":1.657,"15min":5.5049999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.75800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4359999999999999,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.099,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.349,"5min":1.5589999999999999,"15min":3.254},"last":0.88400000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.071,"15min":1.173},"min":{"1min":0.86799999999999999,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.2889999999999999,"5min":1.623,"15min":4.593},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.175,"15min":1.198},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.619,"5min":1.871,"15min":2.3799999999999999},"last":1.038}]},{"osd":3,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.137,"15min":1.1910000000000001},"min":{"1min":0.73599999999999999,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.504,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.21,"15min":1.294},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.63300000000000001},"max":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.121}]},{"osd":5,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1899999999999999,"15min":1.2010000000000001},"min":{"1min":0.83199999999999996,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.595,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.177,"15min":1.1719999999999999},"min":{"1min":0.73399999999999999,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.157},"last":1.498}]},{"osd":6,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2330000000000001,"15min":1.248},"min":{"1min":0.85599999999999998,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.482,"5min":1.6910000000000001,"15min":2.915},"last":1.208},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.389,"15min":1.399},"min":{"1min":0.82199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.2509999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.29,"15min":1.306},"min":{"1min":0.80400000000000005,"5min":0.72799999999999998,"15min":0.56899999999999995},"max":{"1min":1.7370000000000001,"5min":1.907,"15min":2.4340000000000002},"last":1.431},{"interface":"front","average":{"1min":1.329,"5min":1.353,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.88500000000000001,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":1.833,"15min":5.6859999999999999},"last":1.3680000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.64400000000000002,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.93000000000000005,"15min":0.91500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6259999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":0.96399999999999997,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.093,"15min":1.0449999999999999},"min":{"1min":0.65900000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.755}]},{"osd":2,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.1599999999999999,"15min":1.117},"min":{"1min":0.69399999999999995,"5min":0.59099999999999997,"15min":0.52200000000000002},"max":{"1min":8.9290000000000003,"5min":8.9290000000000003,"15min":8.9290000000000003},"last":1.177},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.198,"15min":1.2},"min":{"1min":0.85699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.1539999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1759999999999999,"15min":1.198},"min":{"1min":0.76600000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.698,"5min":1.7310000000000001,"15min":2.234},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.651,"5min":1.375,"15min":1.321},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.70299999999999996},"max":{"1min":7.1890000000000001,"5min":7.1890000000000001,"15min":7.1890000000000001},"last":1.323}]},{"osd":5,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.381,"15min":1.371},"min":{"1min":0.94699999999999995,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.284,"15min":1.3069999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7310000000000001,"5min":1.776,"15min":2.754},"last":1.022}]},{"osd":6,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.411,"15min":1.3919999999999999},"min":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":7.4189999999999996,"5min":7.4189999999999996,"15min":7.4189999999999996},"last":1.097},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4379999999999999,"15min":1.4410000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.0449999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3700000000000001,"15min":1.3899999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7330000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.204},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.506,"15min":1.4830000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.83099999999999996},"max":{"1min":8.8889999999999993,"5min":8.8889999999999993,"15min":8.8889999999999993},"last":1.23}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.91100000000000003,"15min":1.0669999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.29599999999999999},"max":{"1min":1.224,"5min":3.9209999999999998,"15min":13.32},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.1699999999999999},"min":{"1min":0.59699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3100000000000001,"5min":3.8149999999999999,"15min":13.206},"last":1.0920000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.94599999999999995,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.284,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.022,"5min":0.98899999999999999,"15min":0.98499999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6950000000000001,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.617,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.161,"15min":1.179},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":2.75,"15min":2.75},"last":0.74099999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2589999999999999,"15min":1.248},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.27},"min":{"1min":0.875,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.4370000000000001,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.2110000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.228,"15min":1.252},"min":{"1min":0.94099999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.504,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.147},{"interface":"front","average":{"1min":1.3,"5min":1.341,"15min":1.3859999999999999},"min":{"1min":0.96999999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.6739999999999999,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.90500000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.679,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.91500000000000004,"15min":0.872},"max":{"1min":1.4850000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.2370000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4199999999999999,"15min":1.419},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.627,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3700000000000001,"15min":1.3779999999999999},"min":{"1min":0.97399999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.698,"5min":5.375,"15min":5.375},"last":1.331}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.42399999999999999},"max":{"1min":1.387,"5min":1.671,"15min":1.931},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.96199999999999997,"15min":0.97799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3240000000000001,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83499999999999996,"15min":0.89800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.292,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.997,"15min":1.048},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":3.4199999999999999},"last":1.3720000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.109,"15min":1.167},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":3.4950000000000001},"last":1.014},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95799999999999996,"15min":1.0620000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":4.2030000000000003},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.278,"15min":1.3320000000000001},"min":{"1min":0.871,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.891,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.319},{"interface":"front","average":{"1min":1.232,"5min":1.226,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56999999999999995},"max":{"1min":1.736,"5min":1.736,"15min":2.6960000000000002},"last":1.282}]},{"osd":5,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.69599999999999995},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":2.9249999999999998},"last":1.347},{"interface":"front","average":{"1min":1.381,"5min":1.3180000000000001,"15min":1.3899999999999999},"min":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.69399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":3.8420000000000001},"last":1.123}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.333,"15min":1.425},"min":{"1min":1.0249999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9990000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.167},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.4390000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72899999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":3.214},"last":1.403}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.379,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.254,"5min":2.254,"15min":4.0910000000000002},"last":1.244},{"interface":"front","average":{"1min":1.353,"5min":1.337,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":4.6390000000000002},"last":1.452}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1404458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88900000000000001,"15min":0.93300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46700000000000003},"max":{"1min":1.3740000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.753},{"interface":"front","average":{"1min":1.012,"5min":0.97299999999999998,"15min":1.056},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":1.335,"5min":1.73,"15min":2.3599999999999999},"last":0.84799999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88300000000000001,"15min":0.93000000000000005},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.242,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.93400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.995}]},{"osd":3,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.95699999999999996,"15min":0.97699999999999998},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.196,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.024},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":1.6100000000000001,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.282,"15min":1.3109999999999999},"min":{"1min":0.89400000000000002,"5min":0.79700000000000004,"15min":0.69899999999999995},"max":{"1min":1.645,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.85999999999999999,"5min":0.71599999999999997,"15min":0.68999999999999995},"max":{"1min":1.605,"5min":1.738,"15min":2.7799999999999998},"last":1.3089999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.76300000000000001},"max":{"1min":1.421,"5min":1.758,"15min":2.0579999999999998},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.294,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.96799999999999997}]},{"osd":6,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.1000000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2769999999999999,"15min":1.3540000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.978,"5min":1.978,"15min":2.3889999999999998},"last":1.3680000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.454},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":4.9400000000000004},"last":1.268},{"interface":"front","average":{"1min":1.206,"5min":1.321,"15min":1.423},"min":{"1min":0.92100000000000004,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.5309999999999999,"5min":1.875,"15min":4.8250000000000002},"last":1.175}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:04:12.856 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-19T18:04:12.857 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:04:13.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.028+0000 7f2cb7fff700 1 Processor -- start 2023-12-19T18:04:13.034 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.028+0000 7f2cb7fff700 1 -- start start 2023-12-19T18:04:13.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb7fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f2cb80b88e0 0x7f2cb80cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb7fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80ce3d0 con 0x7f2cb815cf80 2023-12-19T18:04:13.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb7fff700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb815d360 con 0x7f2cb80cdf80 2023-12-19T18:04:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb7fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80d2950 con 0x7f2cb80b88e0 2023-12-19T18:04:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb6ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f2cb815cf80 0x7f2cb80d1040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39158/0 (socket says 172.21.15.45:39158) 2023-12-19T18:04:13.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb6ffd700 1 -- 172.21.15.45:0/1880602681 learned_addr learned my addr 172.21.15.45:0/1880602681 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb67fc700 1 --2- 172.21.15.45:0/1880602681 >> v2:172.21.15.73:3300/0 conn(0x7f2cb80b88e0 0x7f2cb80cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4011302422 0 0) 0x7f2ca8001110 con 0x7f2cb815cf80 2023-12-19T18:04:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca00035d0 con 0x7f2cb815cf80 2023-12-19T18:04:13.040 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096591764 0 0) 0x7f2cb815d360 con 0x7f2cb80cdf80 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca8001110 con 0x7f2cb80cdf80 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2419705401 0 0) 0x7f2ca00035d0 con 0x7f2cb815cf80 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 >> v2:172.21.15.73:3300/0 conn(0x7f2cb80b88e0 msgr2=0x7f2cb80cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 --2- 172.21.15.45:0/1880602681 >> v2:172.21.15.73:3300/0 conn(0x7f2cb80b88e0 0x7f2cb80cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 >> v1:172.21.15.73:6789/0 conn(0x7f2cb80cdf80 legacy=0x7f2cb80b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80d18b0 con 0x7f2cb815cf80 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7f2ca8001800 con 0x7f2cb815cf80 2023-12-19T18:04:13.041 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 >> v1:172.21.15.45:6789/0 conn(0x7f2cb815cf80 legacy=0x7f2cb80d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ca0003c90 0x7f2ca0004090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2ca0004cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ca0005280 0x7f2ca000ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80d2950 con 0x7f2ca0005280 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000c1b0 con 0x7f2ca0004870 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca000c370 con 0x7f2ca0003c90 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb77fe700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ca0005280 0x7f2ca000ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb67fc700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2ca0004cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.032+0000 7f2cb6ffd700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ca0003c90 0x7f2ca0004090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb67fc700 1 -- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ca0003c90 msgr2=0x7f2ca0004090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb67fc700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2ca0003c90 0x7f2ca0004090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb67fc700 1 -- 172.21.15.45:0/1880602681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ca0005280 msgr2=0x7f2ca000ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb67fc700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2ca0005280 0x7f2ca000ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb67fc700 1 -- 172.21.15.45:0/1880602681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca00035d0 con 0x7f2ca0004870 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb77fe700 1 -- 172.21.15.45:0/1880602681 reap_dead start 2023-12-19T18:04:13.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb67fc700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2ca0004cf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009b70 tx=0x7f2ca00058a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec9151bebee2162 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00e6c0 con 0x7f2ca0004870 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac00e820 con 0x7f2ca0004870 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb5ffb700 1 -- 172.21.15.45:0/1880602681 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac00eb90 con 0x7f2ca0004870 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 -- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 msgr2=0x7f2ca0004cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2ca0004cf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f2cac009b70 tx=0x7f2ca00058a0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 -- 172.21.15.45:0/1880602681 shutdown_connections 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/1880602681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2ca0004cf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 -- 172.21.15.45:0/1880602681 >> 172.21.15.45:0/1880602681 conn(0x7f2cb8066380 msgr2=0x7f2cb80cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:13.045 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 -- 172.21.15.45:0/1880602681 shutdown_connections 2023-12-19T18:04:13.046 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.036+0000 7f2cb7fff700 1 -- 172.21.15.45:0/1880602681 wait complete. 2023-12-19T18:04:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 Processor -- start 2023-12-19T18:04:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 -- start start 2023-12-19T18:04:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2cb80c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb814d1b0 0x7f2cb8158830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 0x7f2cb81f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.047 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80c6cc0 con 0x7f2cb8158d70 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81591f0 con 0x7f2ca0004870 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb7fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80c7ae0 con 0x7f2cb814d1b0 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 0x7f2cb81f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 0x7f2cb81f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42452/0 (socket says 172.21.15.45:42452) 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 -- 172.21.15.45:0/304502596 learned_addr learned my addr 172.21.15.45:0/304502596 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb67fc700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb814d1b0 0x7f2cb8158830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.048 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb6ffd700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2cb80c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 -- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb814d1b0 msgr2=0x7f2cb8158830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb814d1b0 0x7f2cb8158830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.049 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 -- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 msgr2=0x7f2cb80c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2cb80c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 -- 172.21.15.45:0/304502596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80c6ed0 con 0x7f2cb8158d70 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.040+0000 7f2cb77fe700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 0x7f2cb81f2ce0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80ce8c0 tx=0x7f2cb000d430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.044+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb0003c30 con 0x7f2cb8158d70 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.044+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0003d90 con 0x7f2cb8158d70 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.044+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000da40 con 0x7f2cb8158d70 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.044+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb80c71b0 con 0x7f2cb8158d70 2023-12-19T18:04:13.050 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.044+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb80c7770 con 0x7f2cb8158d70 2023-12-19T18:04:13.051 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.044+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb80c7c50 con 0x7f2cb8158d70 2023-12-19T18:04:13.053 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.048+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2cb000dba0 con 0x7f2cb8158d70 2023-12-19T18:04:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.048+0000 7f2c9f7fe700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ca4065b00 0x7f2ca4067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.054 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.048+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2cb0083240 con 0x7f2cb8158d70 2023-12-19T18:04:13.055 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.048+0000 7f2cb6ffd700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ca4065b00 0x7f2ca4067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.056 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.048+0000 7f2cb6ffd700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ca4065b00 0x7f2ca4067fc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001dd0 tx=0x7f2ca8007aa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:13.060 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.056+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f2cb0050c70 con 0x7f2cb8158d70 2023-12-19T18:04:13.234 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.228+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2cb80c7930 con 0x7f2ca4065b00 2023-12-19T18:04:13.239 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.232+0000 7f2c9f7fe700 1 -- 172.21.15.45:0/304502596 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47981 (secure 0 0 0) 0x7f2cb80c7930 con 0x7f2ca4065b00 2023-12-19T18:04:13.240 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:13.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.236+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ca4065b00 msgr2=0x7f2ca4067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.236+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ca4065b00 0x7f2ca4067fc0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8001dd0 tx=0x7f2ca8007aa0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.236+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 msgr2=0x7f2cb81f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 0x7f2cb81f2ce0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f2cb80ce8c0 tx=0x7f2cb000d430 comp rx=0 tx=0).stop 2023-12-19T18:04:13.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 shutdown_connections 2023-12-19T18:04:13.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f2ca4065b00 0x7f2ca4067fc0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f2cb8158d70 0x7f2cb81f2ce0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2cb814d1b0 0x7f2cb8158830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 --2- 172.21.15.45:0/304502596 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ca0004870 0x7f2cb80c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 >> 172.21.15.45:0/304502596 conn(0x7f2cb8066380 msgr2=0x7f2cb80b2360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:13.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 shutdown_connections 2023-12-19T18:04:13.246 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.240+0000 7f2cb7fff700 1 -- 172.21.15.45:0/304502596 wait complete. 2023-12-19T18:04:13.247 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:04:13.270 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2023-12-19T18:04:12.476075+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":266816,"kb_used_data":14336,"kb_used_omap":0,"kb_used_meta":252416,"kb_avail":754707904,"statfs":{"total":773094113280,"available":772820893696,"internally_reserved":0,"allocated":14680064,"data_stored":7694584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258473984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-405485,"num_objects":-123,"num_object_clones":0,"num_object_copies":-246,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-123,"num_whiteouts":0,"num_read":-1808,"num_read_kb":-1515,"num_write":-918,"num_write_kb":-954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002188"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-19T18:04:08.841843+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:04:08.841843+0000","last_peered":"2023-12-19T18:04:08.841843+0000","last_clean":"2023-12-19T18:04:08.841843+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:04:08.841843+0000","last_undegraded":"2023-12-19T18:04:08.841843+0000","last_fullsized":"2023-12-19T18:04:08.841843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2269184,"data_stored":1405477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.228,"15min":1.1259999999999999},"min":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.454},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.302,"15min":1.1870000000000001},"min":{"1min":0.71299999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.512,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.3939999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.179,"15min":1.099},"min":{"1min":0.63600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4470000000000001,"5min":12.625,"15min":12.625},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.056,"5min":1.1819999999999999,"15min":1.131},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.52600000000000002},"max":{"1min":1.3220000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":1.2030000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1759999999999999,"15min":1.093},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.353,"5min":13.041,"15min":13.041},"last":1.048},{"interface":"front","average":{"1min":1.016,"5min":1.5820000000000001,"15min":1.28},"min":{"1min":0.74199999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.278,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.266}]},{"osd":3,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2569999999999999,"15min":1.167},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":12.917,"15min":12.917},"last":1.359},{"interface":"front","average":{"1min":1.244,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":0.90000000000000002,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":46.375,"15min":46.375},"last":1.411}]},{"osd":4,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2629999999999999,"15min":1.204},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4259999999999999,"5min":13.137,"15min":13.137},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.363,"15min":1.298},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.47499999999999998},"max":{"1min":1.407,"5min":13.109,"15min":13.109},"last":1.1599999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.292,"15min":1.238},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5349999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.097},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.333,"15min":1.2809999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.651,"5min":13.198,"15min":13.198},"last":1.077}]},{"osd":6,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4990000000000001,"15min":1.415},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7929999999999999,"5min":13.442,"15min":13.442},"last":1.304},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4450000000000001,"15min":1.359},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.52700000000000002},"max":{"1min":1.667,"5min":13.981,"15min":13.981},"last":1.238}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32776,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339064,"statfs":{"total":96636764160,"available":96603201536,"internally_reserved":0,"allocated":1769472,"data_stored":809104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0089999999999999,"15min":1.0780000000000001},"min":{"1min":0.69099999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.331,"5min":1.399,"15min":4.5979999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.069},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5860000000000001,"5min":1.756,"15min":1.756},"last":1.226}]},{"osd":1,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.095,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.325,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.1080000000000001},"min":{"1min":0.77700000000000002,"5min":0.63800000000000001,"15min":0.48099999999999998},"max":{"1min":1.2929999999999999,"5min":1.583,"15min":1.621},"last":1.107}]},{"osd":2,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.131,"15min":1.2529999999999999},"min":{"1min":0.77700000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4510000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1950000000000001,"15min":1.206},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.492,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.3899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1799999999999999,"15min":1.2390000000000001},"min":{"1min":0.85299999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.55,"5min":1.651,"15min":4.5380000000000003},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.224,"15min":1.278},"min":{"1min":0.94299999999999995,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":4.508},"last":1.014}]},{"osd":4,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.2330000000000001,"5min":1.577,"15min":1.8360000000000001},"last":1.3},{"interface":"front","average":{"1min":1.28,"5min":1.23,"15min":1.238},"min":{"1min":0.90800000000000003,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.6819999999999999,"5min":1.802,"15min":1.899},"last":1.603}]},{"osd":5,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2609999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.579,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.94399999999999995,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.615,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.4370000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.73},{"interface":"front","average":{"1min":1.357,"5min":1.3779999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.7609999999999999,"5min":1.841,"15min":2.2440000000000002},"last":1.635}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.026,"15min":1.004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54600000000000004},"max":{"1min":1.3,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.83999999999999997},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.0609999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.73,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.202}]},{"osd":1,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.117},"min":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.591,"5min":1.974,"15min":1.974},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.84199999999999997,"5min":0.752,"15min":0.65500000000000003},"max":{"1min":1.7709999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.137}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.70999999999999996,"5min":0.65700000000000003,"15min":0.45500000000000002},"max":{"1min":1.397,"5min":1.891,"15min":2.9929999999999999},"last":0.93799999999999994},{"interface":"front","average":{"1min":1.123,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5229999999999999,"5min":2.024,"15min":2.024},"last":0.70799999999999996}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.2250000000000001},"min":{"1min":0.89200000000000002,"5min":0.75,"15min":0.64500000000000002},"max":{"1min":1.73,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.238},{"interface":"front","average":{"1min":1.3,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.90900000000000003,"5min":0.73799999999999999,"15min":0.63500000000000001},"max":{"1min":1.6160000000000001,"5min":1.829,"15min":3.0350000000000001},"last":1.452}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.704,"5min":3.633,"15min":3.633},"last":1.478},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3049999999999999,"15min":1.335},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.745},"max":{"1min":1.9370000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.2949999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.256,"15min":1.3080000000000001},"min":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.7310000000000001,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.0920000000000001},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.82899999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.802,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":0.81799999999999995}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.333,"15min":1.395},"min":{"1min":0.88,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.992,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.387,"15min":1.4630000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.82499999999999996},"max":{"1min":1.895,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.343}]}]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0960000000000001,"15min":1.159},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.423,"5min":1.556,"15min":5.4420000000000002},"last":0.995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.196,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.52,"5min":1.657,"15min":5.5049999999999999},"last":0.82699999999999996}]},{"osd":1,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.75800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4359999999999999,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.099,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.349,"5min":1.5589999999999999,"15min":3.254},"last":0.88400000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.071,"15min":1.173},"min":{"1min":0.86799999999999999,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.2889999999999999,"5min":1.623,"15min":4.593},"last":0.67400000000000004},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.175,"15min":1.198},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.619,"5min":1.871,"15min":2.3799999999999999},"last":1.038}]},{"osd":3,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.137,"15min":1.1910000000000001},"min":{"1min":0.73599999999999999,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.504,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.21,"15min":1.294},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.63300000000000001},"max":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.121}]},{"osd":5,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1899999999999999,"15min":1.2010000000000001},"min":{"1min":0.83199999999999996,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.595,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.1659999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.177,"15min":1.1719999999999999},"min":{"1min":0.73399999999999999,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.157},"last":1.498}]},{"osd":6,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2330000000000001,"15min":1.248},"min":{"1min":0.85599999999999998,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.482,"5min":1.6910000000000001,"15min":2.915},"last":1.208},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.389,"15min":1.399},"min":{"1min":0.82199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.2509999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.29,"15min":1.306},"min":{"1min":0.80400000000000005,"5min":0.72799999999999998,"15min":0.56899999999999995},"max":{"1min":1.7370000000000001,"5min":1.907,"15min":2.4340000000000002},"last":1.431},{"interface":"front","average":{"1min":1.329,"5min":1.353,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.88500000000000001,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":1.833,"15min":5.6859999999999999},"last":1.3680000000000001}]}]},{"osd":3,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.64400000000000002,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.93000000000000005,"15min":0.91500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6259999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":0.96399999999999997,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.093,"15min":1.0449999999999999},"min":{"1min":0.65900000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.755}]},{"osd":2,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.1599999999999999,"15min":1.117},"min":{"1min":0.69399999999999995,"5min":0.59099999999999997,"15min":0.52200000000000002},"max":{"1min":8.9290000000000003,"5min":8.9290000000000003,"15min":8.9290000000000003},"last":1.177},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.198,"15min":1.2},"min":{"1min":0.85699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.1539999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1759999999999999,"15min":1.198},"min":{"1min":0.76600000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.698,"5min":1.7310000000000001,"15min":2.234},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.651,"5min":1.375,"15min":1.321},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.70299999999999996},"max":{"1min":7.1890000000000001,"5min":7.1890000000000001,"15min":7.1890000000000001},"last":1.323}]},{"osd":5,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.381,"15min":1.371},"min":{"1min":0.94699999999999995,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.284,"15min":1.3069999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7310000000000001,"5min":1.776,"15min":2.754},"last":1.022}]},{"osd":6,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.411,"15min":1.3919999999999999},"min":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":7.4189999999999996,"5min":7.4189999999999996,"15min":7.4189999999999996},"last":1.097},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4379999999999999,"15min":1.4410000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.0449999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3700000000000001,"15min":1.3899999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7330000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.204},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.506,"15min":1.4830000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.83099999999999996},"max":{"1min":8.8889999999999993,"5min":8.8889999999999993,"15min":8.8889999999999993},"last":1.23}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.91100000000000003,"15min":1.0669999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.29599999999999999},"max":{"1min":1.224,"5min":3.9209999999999998,"15min":13.32},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.1699999999999999},"min":{"1min":0.59699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3100000000000001,"5min":3.8149999999999999,"15min":13.206},"last":1.0920000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.94599999999999995,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.284,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.022,"5min":0.98899999999999999,"15min":0.98499999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6950000000000001,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.98099999999999998}]},{"osd":3,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.617,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.161,"15min":1.179},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":2.75,"15min":2.75},"last":0.74099999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2589999999999999,"15min":1.248},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.27},"min":{"1min":0.875,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.4370000000000001,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.2110000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.228,"15min":1.252},"min":{"1min":0.94099999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.504,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.147},{"interface":"front","average":{"1min":1.3,"5min":1.341,"15min":1.3859999999999999},"min":{"1min":0.96999999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.6739999999999999,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.4650000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.90500000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.679,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.2609999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.91500000000000004,"15min":0.872},"max":{"1min":1.4850000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.2370000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4199999999999999,"15min":1.419},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.627,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3700000000000001,"15min":1.3779999999999999},"min":{"1min":0.97399999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.698,"5min":5.375,"15min":5.375},"last":1.331}]}]},{"osd":1,"up_from":13,"seq":55834575005,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.42399999999999999},"max":{"1min":1.387,"5min":1.671,"15min":1.931},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.999,"5min":0.96199999999999997,"15min":0.97799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3240000000000001,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.93100000000000005}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83499999999999996,"15min":0.89800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.292,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.997,"15min":1.048},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":3.4199999999999999},"last":1.3720000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.109,"15min":1.167},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":3.4950000000000001},"last":1.014},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95799999999999996,"15min":1.0620000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":4.2030000000000003},"last":0.77000000000000002}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.278,"15min":1.3320000000000001},"min":{"1min":0.871,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.891,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.319},{"interface":"front","average":{"1min":1.232,"5min":1.226,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56999999999999995},"max":{"1min":1.736,"5min":1.736,"15min":2.6960000000000002},"last":1.282}]},{"osd":5,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.69599999999999995},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":2.9249999999999998},"last":1.347},{"interface":"front","average":{"1min":1.381,"5min":1.3180000000000001,"15min":1.3899999999999999},"min":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.69399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":3.8420000000000001},"last":1.123}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.333,"15min":1.425},"min":{"1min":1.0249999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9990000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.167},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.4390000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72899999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":3.214},"last":1.403}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.379,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.254,"5min":2.254,"15min":4.0910000000000002},"last":1.244},{"interface":"front","average":{"1min":1.353,"5min":1.337,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":4.6390000000000002},"last":1.452}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1404458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88900000000000001,"15min":0.93300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46700000000000003},"max":{"1min":1.3740000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.753},{"interface":"front","average":{"1min":1.012,"5min":0.97299999999999998,"15min":1.056},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":1.335,"5min":1.73,"15min":2.3599999999999999},"last":0.84799999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88300000000000001,"15min":0.93000000000000005},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.242,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.93400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.995}]},{"osd":3,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.95699999999999996,"15min":0.97699999999999998},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.196,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.024},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":1.6100000000000001,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.0149999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.282,"15min":1.3109999999999999},"min":{"1min":0.89400000000000002,"5min":0.79700000000000004,"15min":0.69899999999999995},"max":{"1min":1.645,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.4339999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.85999999999999999,"5min":0.71599999999999997,"15min":0.68999999999999995},"max":{"1min":1.605,"5min":1.738,"15min":2.7799999999999998},"last":1.3089999999999999}]},{"osd":5,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.76300000000000001},"max":{"1min":1.421,"5min":1.758,"15min":2.0579999999999998},"last":1.1160000000000001},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.294,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.96799999999999997}]},{"osd":6,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.1000000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.2769999999999999,"15min":1.3540000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.978,"5min":1.978,"15min":2.3889999999999998},"last":1.3680000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.454},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":4.9400000000000004},"last":1.268},{"interface":"front","average":{"1min":1.206,"5min":1.321,"15min":1.423},"min":{"1min":0.92100000000000004,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.5309999999999999,"5min":1.875,"15min":4.8250000000000002},"last":1.175}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:04:13.272 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-19T18:04:13.448 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.440+0000 7f12952d8700 1 Processor -- start 2023-12-19T18:04:13.449 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 -- start start 2023-12-19T18:04:13.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f129015b080 0x7f12900c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f12900b05e0 0x7f12900b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1290070640 0x7f1290070ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12900b0f80 con 0x7f1290070640 2023-12-19T18:04:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f129015b460 con 0x7f12900b05e0 2023-12-19T18:04:13.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f12952d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12900cf5f0 con 0x7f129015b080 2023-12-19T18:04:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1290070640 0x7f1290070ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f1290070640 0x7f1290070ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42456/0 (socket says 172.21.15.45:42456) 2023-12-19T18:04:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 -- 172.21.15.45:0/3381699902 learned_addr learned my addr 172.21.15.45:0/3381699902 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128e7fc700 1 --2- 172.21.15.45:0/3381699902 >> v2:172.21.15.73:3300/0 conn(0x7f12900b05e0 0x7f12900b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128effd700 1 --2- 172.21.15.45:0/3381699902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f129015b080 0x7f12900c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 -- 172.21.15.45:0/3381699902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f129015b080 msgr2=0x7f12900c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 --2- 172.21.15.45:0/3381699902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f129015b080 0x7f12900c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 -- 172.21.15.45:0/3381699902 >> v2:172.21.15.73:3300/0 conn(0x7f12900b05e0 msgr2=0x7f12900b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 --2- 172.21.15.45:0/3381699902 >> v2:172.21.15.73:3300/0 conn(0x7f12900b05e0 0x7f12900b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.444+0000 7f128f7fe700 1 -- 172.21.15.45:0/3381699902 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129006cd90 con 0x7f1290070640 2023-12-19T18:04:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f128f7fe700 1 --2- 172.21.15.45:0/3381699902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1290070640 0x7f1290070ad0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f12900cea40 tx=0x7f128800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebaf01e02e8feea3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f128dffb700 1 -- 172.21.15.45:0/3381699902 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800e070 con 0x7f1290070640 2023-12-19T18:04:13.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f128dffb700 1 -- 172.21.15.45:0/3381699902 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128800b910 con 0x7f1290070640 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f128dffb700 1 -- 172.21.15.45:0/3381699902 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128800bcc0 con 0x7f1290070640 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 -- 172.21.15.45:0/3381699902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1290070640 msgr2=0x7f1290070ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 --2- 172.21.15.45:0/3381699902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1290070640 0x7f1290070ad0 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f12900cea40 tx=0x7f128800b330 comp rx=0 tx=0).stop 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 -- 172.21.15.45:0/3381699902 shutdown_connections 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 --2- 172.21.15.45:0/3381699902 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f1290070640 0x7f1290070ad0 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 --2- 172.21.15.45:0/3381699902 >> v2:172.21.15.73:3300/0 conn(0x7f12900b05e0 0x7f12900b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 --2- 172.21.15.45:0/3381699902 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f129015b080 0x7f12900c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 -- 172.21.15.45:0/3381699902 >> 172.21.15.45:0/3381699902 conn(0x7f129006a870 msgr2=0x7f12900ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:13.455 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 -- 172.21.15.45:0/3381699902 shutdown_connections 2023-12-19T18:04:13.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.448+0000 7f12952d8700 1 -- 172.21.15.45:0/3381699902 wait complete. 2023-12-19T18:04:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 Processor -- start 2023-12-19T18:04:13.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 -- start start 2023-12-19T18:04:13.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1290070640 0x7f129015d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12900b05e0 0x7f12900cdc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 0x7f12900c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129015ccd0 con 0x7f129015b080 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12900c8200 con 0x7f1290070640 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.452+0000 7f12952d8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129015c610 con 0x7f12900b05e0 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 0x7f12900c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 0x7f12900c7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42460/0 (socket says 172.21.15.45:42460) 2023-12-19T18:04:13.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 -- 172.21.15.45:0/1467896249 learned_addr learned my addr 172.21.15.45:0/1467896249 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128effd700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1290070640 0x7f129015d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128e7fc700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12900b05e0 0x7f12900cdc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 -- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12900b05e0 msgr2=0x7f12900cdc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12900b05e0 0x7f12900cdc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 -- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1290070640 msgr2=0x7f129015d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1290070640 0x7f129015d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 -- 172.21.15.45:0/1467896249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288009b30 con 0x7f129015b080 2023-12-19T18:04:13.463 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f128f7fe700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 0x7f12900c7890 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f129006eb50 tx=0x7f1288004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12880099b0 con 0x7f129015b080 2023-12-19T18:04:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12880092e0 con 0x7f129015b080 2023-12-19T18:04:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129015c8f0 con 0x7f129015b080 2023-12-19T18:04:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1288004470 con 0x7f129015b080 2023-12-19T18:04:13.464 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129015d630 con 0x7f129015b080 2023-12-19T18:04:13.465 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.456+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129015ce10 con 0x7f129015b080 2023-12-19T18:04:13.466 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.460+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f12880045d0 con 0x7f129015b080 2023-12-19T18:04:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.460+0000 7f12777fe700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f127c065ad0 0x7f127c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.460+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f1288084150 con 0x7f129015b080 2023-12-19T18:04:13.468 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.464+0000 7f128effd700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f127c065ad0 0x7f127c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:13.469 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.464+0000 7f128effd700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f127c065ad0 0x7f127c067f90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1280009980 tx=0x7f1280008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:13.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.468+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f129015ce10 con 0x7f129015b080 2023-12-19T18:04:13.651 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.644+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f129015ce10 con 0x7f129015b080 2023-12-19T18:04:13.652 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12777fe700 1 -- 172.21.15.45:0/1467896249 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v134) v1 ==== 74+0+12941 (secure 0 0 0) 0x7f129015ce10 con 0x7f129015b080 2023-12-19T18:04:13.653 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:13.653 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":134,"fsid":"4e717d5b-4367-4aa1-b211-e8194442f374","created":"2023-12-19T17:51:13.530602+0000","modified":"2023-12-19T18:04:09.831074+0000","last_up_change":"2023-12-19T17:51:26.124752+0000","last_in_change":"2023-12-19T17:51:16.760094+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":18,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-19T17:51:26.279639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ee1fa291-3a20-4fbb-94cc-30753db3a968","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6808","nonce":36279},{"type":"v1","addr":"172.21.15.45:6809","nonce":36279}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6810","nonce":36279},{"type":"v1","addr":"172.21.15.45:6811","nonce":36279}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6814","nonce":36279},{"type":"v1","addr":"172.21.15.45:6815","nonce":36279}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6812","nonce":36279},{"type":"v1","addr":"172.21.15.45:6813","nonce":36279}]},"public_addr":"172.21.15.45:6809/36279","cluster_addr":"172.21.15.45:6811/36279","heartbeat_back_addr":"172.21.15.45:6815/36279","heartbeat_front_addr":"172.21.15.45:6813/36279","state":["exists","up"]},{"osd":1,"uuid":"453ae780-7763-4368-92f5-3f568c783a8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6800","nonce":36282},{"type":"v1","addr":"172.21.15.45:6801","nonce":36282}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6802","nonce":36282},{"type":"v1","addr":"172.21.15.45:6803","nonce":36282}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6806","nonce":36282},{"type":"v1","addr":"172.21.15.45:6807","nonce":36282}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6804","nonce":36282},{"type":"v1","addr":"172.21.15.45:6805","nonce":36282}]},"public_addr":"172.21.15.45:6801/36282","cluster_addr":"172.21.15.45:6803/36282","heartbeat_back_addr":"172.21.15.45:6807/36282","heartbeat_front_addr":"172.21.15.45:6805/36282","state":["exists","up"]},{"osd":2,"uuid":"d2e0237f-98c1-4226-a6d5-86853685c5fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6824","nonce":36285},{"type":"v1","addr":"172.21.15.45:6825","nonce":36285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6826","nonce":36285},{"type":"v1","addr":"172.21.15.45:6827","nonce":36285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6830","nonce":36285},{"type":"v1","addr":"172.21.15.45:6831","nonce":36285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6828","nonce":36285},{"type":"v1","addr":"172.21.15.45:6829","nonce":36285}]},"public_addr":"172.21.15.45:6825/36285","cluster_addr":"172.21.15.45:6827/36285","heartbeat_back_addr":"172.21.15.45:6831/36285","heartbeat_front_addr":"172.21.15.45:6829/36285","state":["exists","up"]},{"osd":3,"uuid":"72d07e49-11da-4b3b-8604-ed9fa8c7c140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6816","nonce":36284},{"type":"v1","addr":"172.21.15.45:6817","nonce":36284}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6818","nonce":36284},{"type":"v1","addr":"172.21.15.45:6819","nonce":36284}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6822","nonce":36284},{"type":"v1","addr":"172.21.15.45:6823","nonce":36284}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6820","nonce":36284},{"type":"v1","addr":"172.21.15.45:6821","nonce":36284}]},"public_addr":"172.21.15.45:6817/36284","cluster_addr":"172.21.15.45:6819/36284","heartbeat_back_addr":"172.21.15.45:6823/36284","heartbeat_front_addr":"172.21.15.45:6821/36284","state":["exists","up"]},{"osd":4,"uuid":"be3aba0b-4535-4e27-a8d9-cb8ad4b6efcc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6805","nonce":36536},{"type":"v1","addr":"172.21.15.73:6807","nonce":36536}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6809","nonce":36536},{"type":"v1","addr":"172.21.15.73:6811","nonce":36536}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":36536},{"type":"v1","addr":"172.21.15.73:6815","nonce":36536}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":36536},{"type":"v1","addr":"172.21.15.73:6813","nonce":36536}]},"public_addr":"172.21.15.73:6807/36536","cluster_addr":"172.21.15.73:6811/36536","heartbeat_back_addr":"172.21.15.73:6815/36536","heartbeat_front_addr":"172.21.15.73:6813/36536","state":["exists","up"]},{"osd":5,"uuid":"f2cc4960-3c95-4886-ab16-0f5938ec61aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":36539},{"type":"v1","addr":"172.21.15.73:6825","nonce":36539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":36539},{"type":"v1","addr":"172.21.15.73:6827","nonce":36539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":36539},{"type":"v1","addr":"172.21.15.73:6831","nonce":36539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":36539},{"type":"v1","addr":"172.21.15.73:6829","nonce":36539}]},"public_addr":"172.21.15.73:6825/36539","cluster_addr":"172.21.15.73:6827/36539","heartbeat_back_addr":"172.21.15.73:6831/36539","heartbeat_front_addr":"172.21.15.73:6829/36539","state":["exists","up"]},{"osd":6,"uuid":"65d94490-acb5-4505-a14a-cf9bb597ab69","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":36537},{"type":"v1","addr":"172.21.15.73:6817","nonce":36537}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":36537},{"type":"v1","addr":"172.21.15.73:6819","nonce":36537}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":36537},{"type":"v1","addr":"172.21.15.73:6823","nonce":36537}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":36537},{"type":"v1","addr":"172.21.15.73:6821","nonce":36537}]},"public_addr":"172.21.15.73:6817/36537","cluster_addr":"172.21.15.73:6819/36537","heartbeat_back_addr":"172.21.15.73:6823/36537","heartbeat_front_addr":"172.21.15.73:6821/36537","state":["exists","up"]},{"osd":7,"uuid":"08d75aaa-2503-4a4a-8992-e38f8e8556ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":36538},{"type":"v1","addr":"172.21.15.73:6801","nonce":36538}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":36538},{"type":"v1","addr":"172.21.15.73:6803","nonce":36538}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":36538},{"type":"v1","addr":"172.21.15.73:6810","nonce":36538}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":36538},{"type":"v1","addr":"172.21.15.73:6806","nonce":36538}]},"public_addr":"172.21.15.73:6801/36538","cluster_addr":"172.21.15.73:6803/36538","heartbeat_back_addr":"172.21.15.73:6810/36538","heartbeat_front_addr":"172.21.15.73:6806/36538","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.543873+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.382503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.563725+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.533206+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.273302+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.498168+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.424756+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-19T17:51:22.277504+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.45:6835/3985719686":"2023-12-20T18:04:06.548597+0000","172.21.15.73:6833/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6837/3417552399":"2023-12-20T18:03:28.816185+0000","172.21.15.45:6837/3985719686":"2023-12-20T18:04:06.548597+0000","172.21.15.73:6832/47731566":"2023-12-20T18:03:47.951444+0000","172.21.15.45:6835/3417552399":"2023-12-20T18:03:28.816185+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-19T18:04:13.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f127c065ad0 msgr2=0x7f127c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f127c065ad0 0x7f127c067f90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1280009980 tx=0x7f1280008040 comp rx=0 tx=0).stop 2023-12-19T18:04:13.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 msgr2=0x7f12900c7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 0x7f12900c7890 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f129006eb50 tx=0x7f1288004af0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 shutdown_connections 2023-12-19T18:04:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f127c065ad0 0x7f127c067f90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f129015b080 0x7f12900c7890 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f12900b05e0 0x7f12900cdc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 --2- 172.21.15.45:0/1467896249 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1290070640 0x7f129015d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 >> 172.21.15.45:0/1467896249 conn(0x7f129006a870 msgr2=0x7f12900b4160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 shutdown_connections 2023-12-19T18:04:13.657 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:13.648+0000 7f12952d8700 1 -- 172.21.15.45:0/1467896249 wait complete. 2023-12-19T18:04:14.680 INFO:tasks.ceph:Scrubbing osd.0 2023-12-19T18:04:14.681 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.864+0000 7fd7ef59e700 1 Processor -- start 2023-12-19T18:04:14.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.864+0000 7fd7ef59e700 1 -- start start 2023-12-19T18:04:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7ef59e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7f00ce220 0x7fd7f00b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7ef59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f00b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7ef59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f00cdd90 con 0x7fd7f00d2d30 2023-12-19T18:04:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7ef59e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f00d2970 con 0x7fd7f00ce220 2023-12-19T18:04:14.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7ef59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00cd3f0 con 0x7fd7f00d23b0 2023-12-19T18:04:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7f00ce220 0x7fd7f00b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fd7f00ce220 0x7fd7f00b5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42470/0 (socket says 172.21.15.45:42470) 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 -- 172.21.15.45:0/3485943161 learned_addr learned my addr 172.21.15.45:0/3485943161 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7eed9d700 1 --2- 172.21.15.45:0/3485943161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f00b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 -- 172.21.15.45:0/3485943161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 msgr2=0x7fd7f00b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 --2- 172.21.15.45:0/3485943161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f00b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 -- 172.21.15.45:0/3485943161 >> v1:172.21.15.45:6789/0 conn(0x7fd7f00d2d30 legacy=0x7fd7f00d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 -- 172.21.15.45:0/3485943161 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00cd6d0 con 0x7fd7f00ce220 2023-12-19T18:04:14.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.868+0000 7fd7e5d9b700 1 --2- 172.21.15.45:0/3485943161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00ce220 0x7fd7f00b5ed0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009940 tx=0x7fd7d8009c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b70755f2a91cfa2d server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7edd9b700 1 -- 172.21.15.45:0/3485943161 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800ba20 con 0x7fd7f00ce220 2023-12-19T18:04:14.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7edd9b700 1 -- 172.21.15.45:0/3485943161 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d8009e90 con 0x7fd7f00ce220 2023-12-19T18:04:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7edd9b700 1 -- 172.21.15.45:0/3485943161 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d800bda0 con 0x7fd7f00ce220 2023-12-19T18:04:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 -- 172.21.15.45:0/3485943161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00ce220 msgr2=0x7fd7f00b5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 --2- 172.21.15.45:0/3485943161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00ce220 0x7fd7f00b5ed0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8009940 tx=0x7fd7d8009c50 comp rx=0 tx=0).stop 2023-12-19T18:04:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 -- 172.21.15.45:0/3485943161 shutdown_connections 2023-12-19T18:04:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 --2- 172.21.15.45:0/3485943161 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f00b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 --2- 172.21.15.45:0/3485943161 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00ce220 0x7fd7f00b5ed0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 -- 172.21.15.45:0/3485943161 >> 172.21.15.45:0/3485943161 conn(0x7fd7f0066110 msgr2=0x7fd7f0066520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 -- 172.21.15.45:0/3485943161 shutdown_connections 2023-12-19T18:04:14.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.872+0000 7fd7ef59e700 1 -- 172.21.15.45:0/3485943161 wait complete. 2023-12-19T18:04:14.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 Processor -- start 2023-12-19T18:04:14.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 -- start start 2023-12-19T18:04:14.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7f00ce220 0x7fd7f0155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f01593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00d2d30 0x7fd7f0159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00ccc70 con 0x7fd7f00d2d30 2023-12-19T18:04:14.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0156d90 con 0x7fd7f00ce220 2023-12-19T18:04:14.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ef59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f0157070 con 0x7fd7f00d23b0 2023-12-19T18:04:14.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00d2d30 0x7fd7f0159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7eed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00d2d30 0x7fd7f0159920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42486/0 (socket says 172.21.15.45:42486) 2023-12-19T18:04:14.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7eed9d700 1 -- 172.21.15.45:0/2263794855 learned_addr learned my addr 172.21.15.45:0/2263794855 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:14.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7e5d9b700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f01593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.876+0000 7fd7ee59c700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7f00ce220 0x7fd7f0155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7eed9d700 1 -- 172.21.15.45:0/2263794855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 msgr2=0x7fd7f01593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7eed9d700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd7f00d23b0 0x7fd7f01593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7eed9d700 1 -- 172.21.15.45:0/2263794855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7f00ce220 msgr2=0x7fd7f0155510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7eed9d700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd7f00ce220 0x7fd7f0155510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7eed9d700 1 -- 172.21.15.45:0/2263794855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009570 con 0x7fd7f00d2d30 2023-12-19T18:04:14.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7eed9d700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00d2d30 0x7fd7f0159920 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8007e40 tx=0x7fd7e800e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:14.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e800ed30 con 0x7fd7f00d2d30 2023-12-19T18:04:14.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f0157350 con 0x7fd7f00d2d30 2023-12-19T18:04:14.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8014420 con 0x7fd7f00d2d30 2023-12-19T18:04:14.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80147d0 con 0x7fd7f00d2d30 2023-12-19T18:04:14.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.880+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f0155a50 con 0x7fd7f00d2d30 2023-12-19T18:04:14.889 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.884+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7f00cd9b0 con 0x7fd7f00d2d30 2023-12-19T18:04:14.891 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.884+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd7e8014930 con 0x7fd7f00d2d30 2023-12-19T18:04:14.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e77fe700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7d0065ad0 0x7fd7d0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fd7e80845b0 con 0x7fd7f00d2d30 2023-12-19T18:04:14.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7ee59c700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7d0065ad0 0x7fd7d0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e77fe700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd7d006bf10 0x7fd7d006e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:14.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd7d006ea20 con 0x7fd7d006bf10 2023-12-19T18:04:14.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7e8084920 con 0x7fd7f00d2d30 2023-12-19T18:04:14.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e5d9b700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd7d006bf10 0x7fd7d006e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:14.894 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7ee59c700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7d0065ad0 0x7fd7d0067f90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0007fd0 tx=0x7fd7e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:14.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e5d9b700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd7d006bf10 0x7fd7d006e350 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:14.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.888+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== osd.0 v2:172.21.15.45:6808/36279 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd7d006ea20 con 0x7fd7d006bf10 2023-12-19T18:04:14.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 --> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd7f015d1b0 con 0x7fd7d006bf10 2023-12-19T18:04:14.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7e77fe700 1 -- 172.21.15.45:0/2263794855 <== osd.0 v2:172.21.15.45:6808/36279 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd7d800b9c0 con 0x7fd7d006bf10 2023-12-19T18:04:14.914 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:14.914 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:14.914 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:14.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd7d006bf10 msgr2=0x7fd7d006e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6808/36279,v1:172.21.15.45:6809/36279] conn(0x7fd7d006bf10 0x7fd7d006e350 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7d0065ad0 msgr2=0x7fd7d0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd7d0065ad0 0x7fd7d0067f90 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0007fd0 tx=0x7fd7e0009040 comp rx=0 tx=0).stop 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00d2d30 msgr2=0x7fd7f0159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 --2- 172.21.15.45:0/2263794855 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd7f00d2d30 0x7fd7f0159920 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8007e40 tx=0x7fd7e800e3c0 comp rx=0 tx=0).stop 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7eed9d700 1 -- 172.21.15.45:0/2263794855 reap_dead start 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 shutdown_connections 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 >> 172.21.15.45:0/2263794855 conn(0x7fd7f0066110 msgr2=0x7fd7f00b5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 shutdown_connections 2023-12-19T18:04:14.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:14.908+0000 7fd7ef59e700 1 -- 172.21.15.45:0/2263794855 wait complete. 2023-12-19T18:04:14.936 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-19T18:04:15.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 Processor -- start 2023-12-19T18:04:15.122 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 -- start start 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 0x7fd6180b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fd618160e70 0x7fd6180d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd618160c70 con 0x7fd618160890 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6180d08a0 con 0x7fd618160e70 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd617fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180d1700 con 0x7fd61806bcf0 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd616ffd700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fd618160890 0x7fd61806b5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39186/0 (socket says 172.21.15.45:39186) 2023-12-19T18:04:15.124 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd616ffd700 1 -- 172.21.15.45:0/2823742663 learned_addr learned my addr 172.21.15.45:0/2823742663 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:15.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.116+0000 7fd6167fc700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 0x7fd6180b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 --2- 172.21.15.45:0/2823742663 >> v2:172.21.15.73:3300/0 conn(0x7fd618160e70 0x7fd6180d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 157086964 0 0) 0x7fd618160c70 con 0x7fd618160890 2023-12-19T18:04:15.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6000035d0 con 0x7fd618160890 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2205608001 0 0) 0x7fd6000035d0 con 0x7fd618160890 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 msgr2=0x7fd6180b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 0x7fd6180b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 >> v2:172.21.15.73:3300/0 conn(0x7fd618160e70 msgr2=0x7fd6180d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 --2- 172.21.15.45:0/2823742663 >> v2:172.21.15.73:3300/0 conn(0x7fd618160e70 0x7fd6180d1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 --> v1:172.21.15.45:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6180b6790 con 0x7fd618160890 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 <== mon.0 v1:172.21.15.45:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 321133588 0 0) 0x7fd608001670 con 0x7fd618160890 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 >> v1:172.21.15.45:6789/0 conn(0x7fd618160890 legacy=0x7fd61806b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.127 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd600003a20 0x7fd600003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 0x7fd600004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd600005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180d08a0 con 0x7fd600004db0 2023-12-19T18:04:15.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180d1700 con 0x7fd600003a20 2023-12-19T18:04:15.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60000bab0 con 0x7fd61806bcf0 2023-12-19T18:04:15.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd600005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6167fc700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 0x7fd600004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd616ffd700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd600003a20 0x7fd600003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 -- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 msgr2=0x7fd600004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd61806bcf0 0x7fd600004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 -- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd600003a20 msgr2=0x7fd600003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd600003a20 0x7fd600003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 -- 172.21.15.45:0/2823742663 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6000035d0 con 0x7fd600004db0 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd6177fe700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd600005230 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd610009fc0 tx=0x7fd6000058a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=179dcdb313e0689e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61000ec30 con 0x7fd600004db0 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61000f040 con 0x7fd600004db0 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.120+0000 7fd615ffb700 1 -- 172.21.15.45:0/2823742663 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd610014480 con 0x7fd600004db0 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 -- 172.21.15.45:0/2823742663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 msgr2=0x7fd600005230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 --2- 172.21.15.45:0/2823742663 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd600005230 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fd610009fc0 tx=0x7fd6000058a0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd6177fe700 1 -- 172.21.15.45:0/2823742663 reap_dead start 2023-12-19T18:04:15.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 -- 172.21.15.45:0/2823742663 shutdown_connections 2023-12-19T18:04:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 -- 172.21.15.45:0/2823742663 >> 172.21.15.45:0/2823742663 conn(0x7fd6180d2cd0 msgr2=0x7fd6180d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 -- 172.21.15.45:0/2823742663 shutdown_connections 2023-12-19T18:04:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 -- 172.21.15.45:0/2823742663 wait complete. 2023-12-19T18:04:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 Processor -- start 2023-12-19T18:04:15.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.124+0000 7fd617fff700 1 -- start start 2023-12-19T18:04:15.134 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd61815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd61814f3d0 0x7fd6181f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6180c78c0 0x7fd6180c7d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd61815d340 con 0x7fd600004db0 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6180c8280 con 0x7fd61814f3d0 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6181498f0 con 0x7fd6180c78c0 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd61815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd61815ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42512/0 (socket says 172.21.15.45:42512) 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 -- 172.21.15.45:0/2396426203 learned_addr learned my addr 172.21.15.45:0/2396426203 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:15.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd6177fe700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6180c78c0 0x7fd6180c7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd6167fc700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd61814f3d0 0x7fd6181f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 -- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6180c78c0 msgr2=0x7fd6180c7d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6180c78c0 0x7fd6180c7d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 -- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd61814f3d0 msgr2=0x7fd6181f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd61814f3d0 0x7fd6181f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 -- 172.21.15.45:0/2396426203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61814dbe0 con 0x7fd600004db0 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd6167fc700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd61814f3d0 0x7fd6181f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:15.136 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd616ffd700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd61815ce00 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ead0 tx=0x7fd60800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd608005e70 con 0x7fd600004db0 2023-12-19T18:04:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60800c7e0 con 0x7fd600004db0 2023-12-19T18:04:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd61815cba0 con 0x7fd600004db0 2023-12-19T18:04:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60800cb90 con 0x7fd600004db0 2023-12-19T18:04:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6181f5da0 con 0x7fd600004db0 2023-12-19T18:04:15.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.128+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61804ed30 con 0x7fd600004db0 2023-12-19T18:04:15.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.132+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fd60800ccf0 con 0x7fd600004db0 2023-12-19T18:04:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.132+0000 7fd5ff7fe700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd604065ad0 0x7fd604067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.132+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fd6080838a0 con 0x7fd600004db0 2023-12-19T18:04:15.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.132+0000 7fd6167fc700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd604065ad0 0x7fd604067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.136+0000 7fd6167fc700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd604065ad0 0x7fd604067f90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd6180c97d0 tx=0x7fd60c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.144 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.136+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fd6080513e0 con 0x7fd600004db0 2023-12-19T18:04:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.312+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6180d0dd0 con 0x7fd604065ad0 2023-12-19T18:04:15.319 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.312+0000 7fd5ff7fe700 1 -- 172.21.15.45:0/2396426203 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd60c009740 con 0x7fd604065ad0 2023-12-19T18:04:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd604065ad0 msgr2=0x7fd604067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.322 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd604065ad0 0x7fd604067f90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fd6180c97d0 tx=0x7fd60c008040 comp rx=0 tx=0).stop 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 msgr2=0x7fd61815ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd61815ce00 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fd60800ead0 tx=0x7fd60800ee90 comp rx=0 tx=0).stop 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 shutdown_connections 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fd604065ad0 0x7fd604067f90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fd6180c78c0 0x7fd6180c7d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd61814f3d0 0x7fd6181f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 --2- 172.21.15.45:0/2396426203 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fd600004db0 0x7fd61815ce00 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.323 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 >> 172.21.15.45:0/2396426203 conn(0x7fd6180d2cd0 msgr2=0x7fd6180c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:15.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 shutdown_connections 2023-12-19T18:04:15.324 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.316+0000 7fd617fff700 1 -- 172.21.15.45:0/2396426203 wait complete. 2023-12-19T18:04:15.324 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 0 to deep-scrub 2023-12-19T18:04:15.347 INFO:tasks.ceph:Scrubbing osd.1 2023-12-19T18:04:15.347 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.528+0000 7f00fb597700 1 Processor -- start 2023-12-19T18:04:15.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.528+0000 7f00fb597700 1 -- start start 2023-12-19T18:04:15.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fb597700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f415d1d0 0x7f00f406f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fb597700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00f40ce850 0x7f00f40b20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fb597700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f40cabd0 con 0x7f00f40ca770 2023-12-19T18:04:15.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fb597700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f40cc200 con 0x7f00f40ce850 2023-12-19T18:04:15.537 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fb597700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40b2610 con 0x7f00f415d1d0 2023-12-19T18:04:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00f9d94700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f00f40ca770 0x7f00f40ce140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39194/0 (socket says 172.21.15.45:39194) 2023-12-19T18:04:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00f9d94700 1 -- 172.21.15.45:0/1785257493 learned_addr learned my addr 172.21.15.45:0/1785257493 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fad96700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f00f40ce850 0x7f00f40b20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.538 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fa595700 1 --2- 172.21.15.45:0/1785257493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f415d1d0 0x7f00f406f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00f9593700 1 -- 172.21.15.45:0/1785257493 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139265423 0 0) 0x7f00f40cabd0 con 0x7f00f40ca770 2023-12-19T18:04:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fad96700 1 -- 172.21.15.45:0/1785257493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f415d1d0 msgr2=0x7f00f406f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fad96700 1 --2- 172.21.15.45:0/1785257493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f415d1d0 0x7f00f406f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fad96700 1 -- 172.21.15.45:0/1785257493 >> v1:172.21.15.45:6789/0 conn(0x7f00f40ca770 legacy=0x7f00f40ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fad96700 1 -- 172.21.15.45:0/1785257493 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f406f700 con 0x7f00f40ce850 2023-12-19T18:04:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00fad96700 1 --2- 172.21.15.45:0/1785257493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40b20d0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2122400a1d03d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00f9593700 1 -- 172.21.15.45:0/1785257493 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec00e070 con 0x7f00f40ce850 2023-12-19T18:04:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.532+0000 7f00f9593700 1 -- 172.21.15.45:0/1785257493 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec00bb20 con 0x7f00f40ce850 2023-12-19T18:04:15.540 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00f9593700 1 -- 172.21.15.45:0/1785257493 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec012430 con 0x7f00f40ce850 2023-12-19T18:04:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 -- 172.21.15.45:0/1785257493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 msgr2=0x7f00f40b20d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 --2- 172.21.15.45:0/1785257493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40b20d0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f00ec009d90 tx=0x7f00ec00b330 comp rx=0 tx=0).stop 2023-12-19T18:04:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 -- 172.21.15.45:0/1785257493 shutdown_connections 2023-12-19T18:04:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 --2- 172.21.15.45:0/1785257493 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40b20d0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 --2- 172.21.15.45:0/1785257493 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f415d1d0 0x7f00f406f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 -- 172.21.15.45:0/1785257493 >> 172.21.15.45:0/1785257493 conn(0x7f00f406d850 msgr2=0x7f00f406dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:15.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 -- 172.21.15.45:0/1785257493 shutdown_connections 2023-12-19T18:04:15.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.536+0000 7f00fb597700 1 -- 172.21.15.45:0/1785257493 wait complete. 2023-12-19T18:04:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 Processor -- start 2023-12-19T18:04:15.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 -- start start 2023-12-19T18:04:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f40ca770 0x7f00f414fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00f415d1d0 0x7f00f40ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c8c50 con 0x7f00f40ce850 2023-12-19T18:04:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f41501d0 con 0x7f00f415d1d0 2023-12-19T18:04:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f40c7fd0 con 0x7f00f40ca770 2023-12-19T18:04:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40c9070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42524/0 (socket says 172.21.15.45:42524) 2023-12-19T18:04:15.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 -- 172.21.15.45:0/3528979324 learned_addr learned my addr 172.21.15.45:0/3528979324 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fa595700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f40ca770 0x7f00f414fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.548 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fad96700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00f415d1d0 0x7f00f40ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 -- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f40ca770 msgr2=0x7f00f414fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f00f40ca770 0x7f00f414fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 -- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00f415d1d0 msgr2=0x7f00f40ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00f415d1d0 0x7f00f40ad7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 -- 172.21.15.45:0/3528979324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009a70 con 0x7f00f40ce850 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fad96700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f00f415d1d0 0x7f00f40ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00f9d94700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40c9070 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f00e400c4e0 tx=0x7f00e400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4004ca0 con 0x7f00f40ce850 2023-12-19T18:04:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e4004e20 con 0x7f00f40ce850 2023-12-19T18:04:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.540+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f40c82b0 con 0x7f00f40ce850 2023-12-19T18:04:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.544+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e4007310 con 0x7f00f40ce850 2023-12-19T18:04:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.544+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f40c8870 con 0x7f00f40ce850 2023-12-19T18:04:15.550 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.544+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00f406f9e0 con 0x7f00f40ce850 2023-12-19T18:04:15.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.544+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f00e4007470 con 0x7f00f40ce850 2023-12-19T18:04:15.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00eaffd700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00d8065ad0 0x7f00d8067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f00e4082d30 con 0x7f00f40ce850 2023-12-19T18:04:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00eaffd700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f00d806bf10 0x7f00d806e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00fa595700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00d8065ad0 0x7f00d8067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00d806ea20 con 0x7f00d806bf10 2023-12-19T18:04:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00e4085310 con 0x7f00f40ce850 2023-12-19T18:04:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00fad96700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f00d806bf10 0x7f00d806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00fa595700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00d8065ad0 0x7f00d8067f90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009bf0 tx=0x7f00f0009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.548+0000 7f00fad96700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f00d806bf10 0x7f00d806e350 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.552+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== osd.1 v2:172.21.15.45:6800/36282 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f00d806ea20 con 0x7f00d806bf10 2023-12-19T18:04:15.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 --> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00f415d5b0 con 0x7f00d806bf10 2023-12-19T18:04:15.574 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00eaffd700 1 -- 172.21.15.45:0/3528979324 <== osd.1 v2:172.21.15.45:6800/36282 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f00ec0125e0 con 0x7f00d806bf10 2023-12-19T18:04:15.575 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:15.575 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:15.575 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f00d806bf10 msgr2=0x7f00d806e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6800/36282,v1:172.21.15.45:6801/36282] conn(0x7f00d806bf10 0x7f00d806e350 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00d8065ad0 msgr2=0x7f00d8067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f00d8065ad0 0x7f00d8067f90 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f00f0009bf0 tx=0x7f00f0009240 comp rx=0 tx=0).stop 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 msgr2=0x7f00f40c9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 --2- 172.21.15.45:0/3528979324 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f00f40ce850 0x7f00f40c9070 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f00e400c4e0 tx=0x7f00e400c7f0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fad96700 1 -- 172.21.15.45:0/3528979324 reap_dead start 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 shutdown_connections 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 >> 172.21.15.45:0/3528979324 conn(0x7f00f406d850 msgr2=0x7f00f40c6500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 shutdown_connections 2023-12-19T18:04:15.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.568+0000 7f00fb597700 1 -- 172.21.15.45:0/3528979324 wait complete. 2023-12-19T18:04:15.597 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-19T18:04:15.775 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.768+0000 7f797f59e700 1 Processor -- start 2023-12-19T18:04:15.776 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.768+0000 7f797f59e700 1 -- start start 2023-12-19T18:04:15.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f798015eec0 0x7f79800cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797f59e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79800cd760 con 0x7f79800adb70 2023-12-19T18:04:15.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797f59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79800716e0 con 0x7f7980070570 2023-12-19T18:04:15.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79800ce300 con 0x7f798015eec0 2023-12-19T18:04:15.778 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797e59c700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f79800adb70 0x7f79800cdbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39200/0 (socket says 172.21.15.45:39200) 2023-12-19T18:04:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797e59c700 1 -- 172.21.15.45:0/2790514398 learned_addr learned my addr 172.21.15.45:0/2790514398 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:15.779 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797dd9b700 1 --2- 172.21.15.45:0/2790514398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f798015eec0 0x7f79800cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164201266 0 0) 0x7f79800cd760 con 0x7f79800adb70 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79680035d0 con 0x7f79800adb70 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972363285 0 0) 0x7f79800716e0 con 0x7f7980070570 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79800cd760 con 0x7f7980070570 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797dd9b700 1 -- 172.21.15.45:0/2790514398 >> v1:172.21.15.73:6789/0 conn(0x7f7980070570 legacy=0x7f79800b2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797dd9b700 1 -- 172.21.15.45:0/2790514398 >> v1:172.21.15.45:6789/0 conn(0x7f79800adb70 legacy=0x7f79800cdbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.780 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.772+0000 7f797dd9b700 1 -- 172.21.15.45:0/2790514398 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79800ccb50 con 0x7f798015eec0 2023-12-19T18:04:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797dd9b700 1 --2- 172.21.15.45:0/2790514398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f798015eec0 0x7f79800cc470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7974009880 tx=0x7f7974009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2065efe7073b324e server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011830 con 0x7f798015eec0 2023-12-19T18:04:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7974011990 con 0x7f798015eec0 2023-12-19T18:04:15.781 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797d59a700 1 -- 172.21.15.45:0/2790514398 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7974011d20 con 0x7f798015eec0 2023-12-19T18:04:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 -- 172.21.15.45:0/2790514398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f798015eec0 msgr2=0x7f79800cc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 --2- 172.21.15.45:0/2790514398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f798015eec0 0x7f79800cc470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7974009880 tx=0x7f7974009b90 comp rx=0 tx=0).stop 2023-12-19T18:04:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 -- 172.21.15.45:0/2790514398 shutdown_connections 2023-12-19T18:04:15.782 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 --2- 172.21.15.45:0/2790514398 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f798015eec0 0x7f79800cc470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 -- 172.21.15.45:0/2790514398 >> 172.21.15.45:0/2790514398 conn(0x7f79800ce8a0 msgr2=0x7f79800cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:15.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 -- 172.21.15.45:0/2790514398 shutdown_connections 2023-12-19T18:04:15.783 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.776+0000 7f797f59e700 1 -- 172.21.15.45:0/2790514398 wait complete. 2023-12-19T18:04:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 Processor -- start 2023-12-19T18:04:15.786 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 -- start start 2023-12-19T18:04:15.787 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 0x7f79800c6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 0x7f798014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f798015eec0 0x7f798014dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798014c9e0 con 0x7f79800adb70 2023-12-19T18:04:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798014bd60 con 0x7f798015eec0 2023-12-19T18:04:15.788 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797f59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f798014c040 con 0x7f7980070570 2023-12-19T18:04:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.780+0000 7f797dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 0x7f798014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797e59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 0x7f79800c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797ed9d700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f798015eec0 0x7f798014dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797e59c700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 0x7f79800c6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3301/0 says I am v2:172.21.15.45:57486/0 (socket says 172.21.15.45:57486) 2023-12-19T18:04:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 0x7f798014b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42540/0 (socket says 172.21.15.45:42540) 2023-12-19T18:04:15.789 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797e59c700 1 -- 172.21.15.45:0/551983305 learned_addr learned my addr 172.21.15.45:0/551983305 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 -- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 msgr2=0x7f79800c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 0x7f79800c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 -- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f798015eec0 msgr2=0x7f798014dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f798015eec0 0x7f798014dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 -- 172.21.15.45:0/551983305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79740094b0 con 0x7f79800adb70 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797e59c700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 0x7f79800c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797ed9d700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f798015eec0 0x7f798014dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:15.791 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797dd9b700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 0x7f798014b420 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f7974015000 tx=0x7f7974004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797401a8c0 con 0x7f79800adb70 2023-12-19T18:04:15.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f798014c320 con 0x7f79800adb70 2023-12-19T18:04:15.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f797401e070 con 0x7f79800adb70 2023-12-19T18:04:15.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f797401ac80 con 0x7f79800adb70 2023-12-19T18:04:15.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.784+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7980152020 con 0x7f79800adb70 2023-12-19T18:04:15.792 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.788+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798014cb20 con 0x7f79800adb70 2023-12-19T18:04:15.794 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.788+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f797402c3f0 con 0x7f79800adb70 2023-12-19T18:04:15.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.788+0000 7f796effd700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7960065ad0 0x7f7960067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:15.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.788+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7974083a70 con 0x7f79800adb70 2023-12-19T18:04:15.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.788+0000 7f797e59c700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7960065ad0 0x7f7960067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:15.796 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.792+0000 7f797e59c700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7960065ad0 0x7f7960067f90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7970000f60 tx=0x7f7970009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:15.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.796+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f798014cb20 con 0x7f79800adb70 2023-12-19T18:04:15.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.984+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f79800cd110 con 0x7f7960065ad0 2023-12-19T18:04:15.989 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.984+0000 7f796effd700 1 -- 172.21.15.45:0/551983305 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f797000fa80 con 0x7f7960065ad0 2023-12-19T18:04:15.994 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7960065ad0 msgr2=0x7f7960067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7960065ad0 0x7f7960067f90 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f7970000f60 tx=0x7f7970009040 comp rx=0 tx=0).stop 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 msgr2=0x7f798014b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 0x7f798014b420 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f7974015000 tx=0x7f7974004770 comp rx=0 tx=0).stop 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 shutdown_connections 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7960065ad0 0x7f7960067f90 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f798015eec0 0x7f798014dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.995 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f79800adb70 0x7f798014b420 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 --2- 172.21.15.45:0/551983305 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7980070570 0x7f79800c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:15.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 >> 172.21.15.45:0/551983305 conn(0x7f79800ce8a0 msgr2=0x7f79800cec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:15.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 shutdown_connections 2023-12-19T18:04:15.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:15.988+0000 7f797f59e700 1 -- 172.21.15.45:0/551983305 wait complete. 2023-12-19T18:04:15.996 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 1 to deep-scrub 2023-12-19T18:04:16.015 INFO:tasks.ceph:Scrubbing osd.2 2023-12-19T18:04:16.016 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:16.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.192+0000 7f4297d7f700 1 Processor -- start 2023-12-19T18:04:16.200 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.196+0000 7f4297d7f700 1 -- start start 2023-12-19T18:04:16.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.196+0000 7f4297d7f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f429015b0a0 0x7f42900cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.196+0000 7f4297d7f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900cf350 0x7f42900b3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.196+0000 7f4297d7f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429015b480 con 0x7f42900b6b60 2023-12-19T18:04:16.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.196+0000 7f4297d7f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42900cc5b0 con 0x7f429015b0a0 2023-12-19T18:04:16.204 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.196+0000 7f4297d7f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900d0400 con 0x7f42900cf350 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429531a700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f42900b6b60 0x7f42900b2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39210/0 (socket says 172.21.15.45:39210) 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429531a700 1 -- 172.21.15.45:0/2664734932 learned_addr learned my addr 172.21.15.45:0/2664734932 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4295b1b700 1 --2- 172.21.15.45:0/2664734932 >> v2:172.21.15.73:3300/0 conn(0x7f429015b0a0 0x7f42900cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429631c700 1 --2- 172.21.15.45:0/2664734932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900cf350 0x7f42900b3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4294b19700 1 -- 172.21.15.45:0/2664734932 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 470874779 0 0) 0x7f4280001110 con 0x7f42900b6b60 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4294b19700 1 -- 172.21.15.45:0/2664734932 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f427c0035d0 con 0x7f42900b6b60 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429631c700 1 -- 172.21.15.45:0/2664734932 >> v2:172.21.15.73:3300/0 conn(0x7f429015b0a0 msgr2=0x7f42900cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:16.206 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429631c700 1 --2- 172.21.15.45:0/2664734932 >> v2:172.21.15.73:3300/0 conn(0x7f429015b0a0 0x7f42900cee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429631c700 1 -- 172.21.15.45:0/2664734932 >> v1:172.21.15.45:6789/0 conn(0x7f42900b6b60 legacy=0x7f42900b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429631c700 1 -- 172.21.15.45:0/2664734932 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42900cf7f0 con 0x7f42900cf350 2023-12-19T18:04:16.207 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4295b1b700 1 --2- 172.21.15.45:0/2664734932 >> v2:172.21.15.73:3300/0 conn(0x7f429015b0a0 0x7f42900cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:16.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f429631c700 1 --2- 172.21.15.45:0/2664734932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900cf350 0x7f42900b3ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4288009d90 tx=0x7f428800b330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0c598fed66bcb4a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4294b19700 1 -- 172.21.15.45:0/2664734932 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428800e070 con 0x7f42900cf350 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4294b19700 1 -- 172.21.15.45:0/2664734932 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428800bb20 con 0x7f42900cf350 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4294b19700 1 -- 172.21.15.45:0/2664734932 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288012430 con 0x7f42900cf350 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 -- 172.21.15.45:0/2664734932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900cf350 msgr2=0x7f42900b3ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 --2- 172.21.15.45:0/2664734932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900cf350 0x7f42900b3ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4288009d90 tx=0x7f428800b330 comp rx=0 tx=0).stop 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 -- 172.21.15.45:0/2664734932 shutdown_connections 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 --2- 172.21.15.45:0/2664734932 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900cf350 0x7f42900b3ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 --2- 172.21.15.45:0/2664734932 >> v2:172.21.15.73:3300/0 conn(0x7f429015b0a0 0x7f42900cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 -- 172.21.15.45:0/2664734932 >> 172.21.15.45:0/2664734932 conn(0x7f42900cd830 msgr2=0x7f42900cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:16.209 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.200+0000 7f4297d7f700 1 -- 172.21.15.45:0/2664734932 shutdown_connections 2023-12-19T18:04:16.210 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.204+0000 7f4297d7f700 1 -- 172.21.15.45:0/2664734932 wait complete. 2023-12-19T18:04:16.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.204+0000 7f4297d7f700 1 Processor -- start 2023-12-19T18:04:16.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.204+0000 7f4297d7f700 1 -- start start 2023-12-19T18:04:16.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42900cf350 0x7f42901f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f429015b0a0 0x7f429006cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900c8890 0x7f42901e47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42901f6910 con 0x7f42900cf350 2023-12-19T18:04:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900c8d20 con 0x7f429015b0a0 2023-12-19T18:04:16.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42900c9000 con 0x7f42900c8890 2023-12-19T18:04:16.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42900cf350 0x7f42901f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42900cf350 0x7f42901f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42546/0 (socket says 172.21.15.45:42546) 2023-12-19T18:04:16.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 -- 172.21.15.45:0/2892680476 learned_addr learned my addr 172.21.15.45:0/2892680476 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:16.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f429531a700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f429015b0a0 0x7f429006cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f429631c700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900c8890 0x7f42901e47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 -- 172.21.15.45:0/2892680476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900c8890 msgr2=0x7f42901e47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f42900c8890 0x7f42901e47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 -- 172.21.15.45:0/2892680476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f429015b0a0 msgr2=0x7f429006cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f429015b0a0 0x7f429006cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 -- 172.21.15.45:0/2892680476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0094b0 con 0x7f42900cf350 2023-12-19T18:04:16.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4295b1b700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42900cf350 0x7f42901f63d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f428c00ebe0 tx=0x7f428c009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00c8b0 con 0x7f42900cf350 2023-12-19T18:04:16.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c00ca10 con 0x7f42900cf350 2023-12-19T18:04:16.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00cda0 con 0x7f42900cf350 2023-12-19T18:04:16.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4288009a70 con 0x7f42900cf350 2023-12-19T18:04:16.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.208+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42900c95c0 con 0x7f42900cf350 2023-12-19T18:04:16.218 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.212+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42900cfdb0 con 0x7f42900cf350 2023-12-19T18:04:16.219 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.212+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f428c013470 con 0x7f42900cf350 2023-12-19T18:04:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f42867fc700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4274065ad0 0x7f4274067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f428c083240 con 0x7f42900cf350 2023-12-19T18:04:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f42867fc700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f427406bf10 0x7f427406e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f429531a700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4274065ad0 0x7f4274067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f427406ea20 con 0x7f427406bf10 2023-12-19T18:04:16.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f428c085820 con 0x7f42900cf350 2023-12-19T18:04:16.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f429631c700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f427406bf10 0x7f427406e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f429531a700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4274065ad0 0x7f4274067f90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f42900b54c0 tx=0x7f4280009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f429631c700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f427406bf10 0x7f427406e350 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.216+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== osd.2 v2:172.21.15.45:6824/36285 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f427406ea20 con 0x7f427406bf10 2023-12-19T18:04:16.241 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 --> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f42900cfad0 con 0x7f427406bf10 2023-12-19T18:04:16.243 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f42867fc700 1 -- 172.21.15.45:0/2892680476 <== osd.2 v2:172.21.15.45:6824/36285 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f4288003ba0 con 0x7f427406bf10 2023-12-19T18:04:16.243 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:16.243 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:16.244 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f427406bf10 msgr2=0x7f427406e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6824/36285,v1:172.21.15.45:6825/36285] conn(0x7f427406bf10 0x7f427406e350 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.244 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4274065ad0 msgr2=0x7f4274067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4274065ad0 0x7f4274067f90 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f42900b54c0 tx=0x7f4280009040 comp rx=0 tx=0).stop 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42900cf350 msgr2=0x7f42901f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 --2- 172.21.15.45:0/2892680476 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f42900cf350 0x7f42901f63d0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f428c00ebe0 tx=0x7f428c009e30 comp rx=0 tx=0).stop 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f429631c700 1 -- 172.21.15.45:0/2892680476 reap_dead start 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 shutdown_connections 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 >> 172.21.15.45:0/2892680476 conn(0x7f42900cd830 msgr2=0x7f429014db50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 shutdown_connections 2023-12-19T18:04:16.245 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.236+0000 7f4297d7f700 1 -- 172.21.15.45:0/2892680476 wait complete. 2023-12-19T18:04:16.265 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-19T18:04:16.441 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.436+0000 7f4e8a0d1700 1 Processor -- start 2023-12-19T18:04:16.442 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.436+0000 7f4e8a0d1700 1 -- start start 2023-12-19T18:04:16.444 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e8a0d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e8415d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.445 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e8a0d1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8415e480 con 0x7f4e840b46f0 2023-12-19T18:04:16.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e8a0d1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e8415d9b0 con 0x7f4e840d1040 2023-12-19T18:04:16.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e8a0d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840b8bf0 con 0x7f4e840b8770 2023-12-19T18:04:16.446 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e890cf700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f4e840b46f0 0x7f4e840b4ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39226/0 (socket says 172.21.15.45:39226) 2023-12-19T18:04:16.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e890cf700 1 -- 172.21.15.45:0/3910140306 learned_addr learned my addr 172.21.15.45:0/3910140306 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:16.447 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e888ce700 1 --2- 172.21.15.45:0/3910140306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e8415d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3244548036 0 0) 0x7f4e8415e480 con 0x7f4e840b46f0 2023-12-19T18:04:16.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e700035d0 con 0x7f4e840b46f0 2023-12-19T18:04:16.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1087611932 0 0) 0x7f4e8415d9b0 con 0x7f4e840d1040 2023-12-19T18:04:16.450 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e8415e480 con 0x7f4e840d1040 2023-12-19T18:04:16.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e888ce700 1 -- 172.21.15.45:0/3910140306 >> v1:172.21.15.73:6789/0 conn(0x7f4e840d1040 legacy=0x7f4e84161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e888ce700 1 -- 172.21.15.45:0/3910140306 >> v1:172.21.15.45:6789/0 conn(0x7f4e840b46f0 legacy=0x7f4e840b4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3290979202 0 0) 0x7f4e700035d0 con 0x7f4e840b46f0 2023-12-19T18:04:16.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e888ce700 1 -- 172.21.15.45:0/3910140306 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e8415dbe0 con 0x7f4e840b8770 2023-12-19T18:04:16.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e888ce700 1 --2- 172.21.15.45:0/3910140306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e8415d470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e74009b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3fdf5c9342f101f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80001670 con 0x7f4e840b8770 2023-12-19T18:04:16.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74004030 con 0x7f4e840b8770 2023-12-19T18:04:16.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.440+0000 7f4e7bfff700 1 -- 172.21.15.45:0/3910140306 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e740043c0 con 0x7f4e840b8770 2023-12-19T18:04:16.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/3910140306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 msgr2=0x7f4e8415d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.452 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/3910140306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e8415d470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f4e74009880 tx=0x7f4e74009b90 comp rx=0 tx=0).stop 2023-12-19T18:04:16.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/3910140306 shutdown_connections 2023-12-19T18:04:16.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/3910140306 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e8415d470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/3910140306 >> 172.21.15.45:0/3910140306 conn(0x7f4e84066380 msgr2=0x7f4e840cf6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:16.453 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/3910140306 shutdown_connections 2023-12-19T18:04:16.454 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/3910140306 wait complete. 2023-12-19T18:04:16.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 Processor -- start 2023-12-19T18:04:16.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.444+0000 7f4e8a0d1700 1 -- start start 2023-12-19T18:04:16.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 0x7f4e840b6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.456 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e84157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e840d1040 0x7f4e840c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c85f0 con 0x7f4e840b46f0 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c76f0 con 0x7f4e840d1040 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c7970 con 0x7f4e840b8770 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 0x7f4e840b6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 0x7f4e840b6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42548/0 (socket says 172.21.15.45:42548) 2023-12-19T18:04:16.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 -- 172.21.15.45:0/1402802173 learned_addr learned my addr 172.21.15.45:0/1402802173 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e898d0700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e840d1040 0x7f4e840c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e888ce700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e84157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 -- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 msgr2=0x7f4e84157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e84157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 -- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e840d1040 msgr2=0x7f4e840c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e840d1040 0x7f4e840c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 -- 172.21.15.45:0/1402802173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e740094b0 con 0x7f4e840b46f0 2023-12-19T18:04:16.458 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e890cf700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 0x7f4e840b6f00 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c750 tx=0x7f4e8000ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e80004d00 con 0x7f4e840b46f0 2023-12-19T18:04:16.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e80004e60 con 0x7f4e840b46f0 2023-12-19T18:04:16.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e800072d0 con 0x7f4e840b46f0 2023-12-19T18:04:16.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840c7c50 con 0x7f4e840b46f0 2023-12-19T18:04:16.459 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.448+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e840c8210 con 0x7f4e840b46f0 2023-12-19T18:04:16.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.452+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e840c8910 con 0x7f4e840b46f0 2023-12-19T18:04:16.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.452+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4e80007430 con 0x7f4e840b46f0 2023-12-19T18:04:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.452+0000 7f4e79ffb700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e68065ad0 0x7f4e68067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.452+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4e800829c0 con 0x7f4e840b46f0 2023-12-19T18:04:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.456+0000 7f4e888ce700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e68065ad0 0x7f4e68067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.456+0000 7f4e888ce700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e68065ad0 0x7f4e68067f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4e74000c00 tx=0x7f4e74010000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.467 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.460+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4e800503f0 con 0x7f4e840b46f0 2023-12-19T18:04:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.640+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e8415e1a0 con 0x7f4e68065ad0 2023-12-19T18:04:16.647 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.640+0000 7f4e79ffb700 1 -- 172.21.15.45:0/1402802173 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4e740042c0 con 0x7f4e68065ad0 2023-12-19T18:04:16.653 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.644+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e68065ad0 msgr2=0x7f4e68067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.644+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e68065ad0 0x7f4e68067f90 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f4e74000c00 tx=0x7f4e74010000 comp rx=0 tx=0).stop 2023-12-19T18:04:16.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.644+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 msgr2=0x7f4e840b6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.644+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 0x7f4e840b6f00 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4e8000c750 tx=0x7f4e8000ca60 comp rx=0 tx=0).stop 2023-12-19T18:04:16.654 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 shutdown_connections 2023-12-19T18:04:16.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4e68065ad0 0x7f4e68067f90 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4e840d1040 0x7f4e840c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4e840b8770 0x7f4e84157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.655 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 --2- 172.21.15.45:0/1402802173 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4e840b46f0 0x7f4e840b6f00 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 >> 172.21.15.45:0/1402802173 conn(0x7f4e84066380 msgr2=0x7f4e840b4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:16.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 shutdown_connections 2023-12-19T18:04:16.656 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.648+0000 7f4e8a0d1700 1 -- 172.21.15.45:0/1402802173 wait complete. 2023-12-19T18:04:16.657 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 2 to deep-scrub 2023-12-19T18:04:16.675 INFO:tasks.ceph:Scrubbing osd.3 2023-12-19T18:04:16.675 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:16.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 Processor -- start 2023-12-19T18:04:16.865 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 -- start start 2023-12-19T18:04:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7efd4c06e110 0x7efd4c0ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd4c06d3a0 0x7efd4c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd4c0ca0e0 con 0x7efd4c0caab0 2023-12-19T18:04:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c06e4f0 con 0x7efd4c06d3a0 2023-12-19T18:04:16.868 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.860+0000 7efd519e1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd4c161bb0 con 0x7efd4c06e110 2023-12-19T18:04:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd4c06d3a0 0x7efd4c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7efd4c06d3a0 0x7efd4c0cb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42550/0 (socket says 172.21.15.45:42550) 2023-12-19T18:04:16.869 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 -- 172.21.15.45:0/798892555 learned_addr learned my addr 172.21.15.45:0/798892555 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd509df700 1 --2- 172.21.15.45:0/798892555 >> v2:172.21.15.73:3300/0 conn(0x7efd4c06e110 0x7efd4c0ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 -- 172.21.15.45:0/798892555 >> v2:172.21.15.73:3300/0 conn(0x7efd4c06e110 msgr2=0x7efd4c0ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:16.870 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 --2- 172.21.15.45:0/798892555 >> v2:172.21.15.73:3300/0 conn(0x7efd4c06e110 0x7efd4c0ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 -- 172.21.15.45:0/798892555 >> v1:172.21.15.73:6789/0 conn(0x7efd4c0caab0 legacy=0x7efd4c06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 -- 172.21.15.45:0/798892555 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c0c9a90 con 0x7efd4c06d3a0 2023-12-19T18:04:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd511e0700 1 --2- 172.21.15.45:0/798892555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c06d3a0 0x7efd4c0cb270 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7efd4c071990 tx=0x7efd4400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7eef1c650f73eb server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd437fe700 1 -- 172.21.15.45:0/798892555 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4400e070 con 0x7efd4c06d3a0 2023-12-19T18:04:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd437fe700 1 -- 172.21.15.45:0/798892555 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd4400b910 con 0x7efd4c06d3a0 2023-12-19T18:04:16.871 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd437fe700 1 -- 172.21.15.45:0/798892555 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd4400bcc0 con 0x7efd4c06d3a0 2023-12-19T18:04:16.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd519e1700 1 -- 172.21.15.45:0/798892555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c06d3a0 msgr2=0x7efd4c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd519e1700 1 --2- 172.21.15.45:0/798892555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c06d3a0 0x7efd4c0cb270 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7efd4c071990 tx=0x7efd4400b330 comp rx=0 tx=0).stop 2023-12-19T18:04:16.872 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd519e1700 1 -- 172.21.15.45:0/798892555 shutdown_connections 2023-12-19T18:04:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd519e1700 1 --2- 172.21.15.45:0/798892555 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c06d3a0 0x7efd4c0cb270 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd519e1700 1 --2- 172.21.15.45:0/798892555 >> v2:172.21.15.73:3300/0 conn(0x7efd4c06e110 0x7efd4c0ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.864+0000 7efd519e1700 1 -- 172.21.15.45:0/798892555 >> 172.21.15.45:0/798892555 conn(0x7efd4c06a950 msgr2=0x7efd4c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 -- 172.21.15.45:0/798892555 shutdown_connections 2023-12-19T18:04:16.873 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 -- 172.21.15.45:0/798892555 wait complete. 2023-12-19T18:04:16.874 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 Processor -- start 2023-12-19T18:04:16.875 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 -- start start 2023-12-19T18:04:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4c06e110 0x7efd4c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efd4c0caab0 0x7efd4c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c1542d0 0x7efd4c152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c1600c0 con 0x7efd4c1542d0 2023-12-19T18:04:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c152500 con 0x7efd4c06e110 2023-12-19T18:04:16.876 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.868+0000 7efd519e1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4c155830 con 0x7efd4c0caab0 2023-12-19T18:04:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd511e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c1542d0 0x7efd4c152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd509df700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4c06e110 0x7efd4c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd511e0700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c1542d0 0x7efd4c152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42554/0 (socket says 172.21.15.45:42554) 2023-12-19T18:04:16.877 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd511e0700 1 -- 172.21.15.45:0/184487049 learned_addr learned my addr 172.21.15.45:0/184487049 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efd4c0caab0 0x7efd4c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 -- 172.21.15.45:0/184487049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4c06e110 msgr2=0x7efd4c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.878 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7efd4c06e110 0x7efd4c151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 -- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c1542d0 msgr2=0x7efd4c152e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c1542d0 0x7efd4c152e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 -- 172.21.15.45:0/184487049 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009b30 con 0x7efd4c0caab0 2023-12-19T18:04:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd511e0700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7efd4c1542d0 0x7efd4c152e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-19T18:04:16.879 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd43fff700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efd4c0caab0 0x7efd4c152900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0caf10 tx=0x7efd3c001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== mon.2 v2:172.21.15.73:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0052d0 con 0x7efd4c0caab0 2023-12-19T18:04:16.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== mon.2 v2:172.21.15.73:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd3c005430 con 0x7efd4c0caab0 2023-12-19T18:04:16.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== mon.2 v2:172.21.15.73:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd3c0055a0 con 0x7efd4c0caab0 2023-12-19T18:04:16.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4c154790 con 0x7efd4c0caab0 2023-12-19T18:04:16.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.872+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd4c154d50 con 0x7efd4c0caab0 2023-12-19T18:04:16.880 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.876+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd4c0c9d70 con 0x7efd4c0caab0 2023-12-19T18:04:16.882 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.876+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== mon.2 v2:172.21.15.73:3301/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7efd3c0038e0 con 0x7efd4c0caab0 2023-12-19T18:04:16.884 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.876+0000 7efd417fa700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efd38065ad0 0x7efd38067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.876+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== mon.2 v2:172.21.15.73:3301/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7efd3c082980 con 0x7efd4c0caab0 2023-12-19T18:04:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd509df700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efd38065ad0 0x7efd38067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd417fa700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7efd3806bf10 0x7efd3806e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd3806ea20 con 0x7efd3806bf10 2023-12-19T18:04:16.885 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== mon.2 v2:172.21.15.73:3301/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd3c082cf0 con 0x7efd4c0caab0 2023-12-19T18:04:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd511e0700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7efd3806bf10 0x7efd3806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd509df700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efd38065ad0 0x7efd38067f90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efd48009bf0 tx=0x7efd48009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.886 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd511e0700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7efd3806bf10 0x7efd3806e350 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:16.887 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.880+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== osd.3 v2:172.21.15.45:6816/36284 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7efd3806ea20 con 0x7efd3806bf10 2023-12-19T18:04:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 --> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd4c0741d0 con 0x7efd3806bf10 2023-12-19T18:04:16.917 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd417fa700 1 -- 172.21.15.45:0/184487049 <== osd.3 v2:172.21.15.45:6816/36284 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7efd4c0741d0 con 0x7efd3806bf10 2023-12-19T18:04:16.918 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:16.918 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:16.918 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7efd3806bf10 msgr2=0x7efd3806e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6816/36284,v1:172.21.15.45:6817/36284] conn(0x7efd3806bf10 0x7efd3806e350 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efd38065ad0 msgr2=0x7efd38067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.919 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7efd38065ad0 0x7efd38067f90 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7efd48009bf0 tx=0x7efd48009240 comp rx=0 tx=0).stop 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efd4c0caab0 msgr2=0x7efd4c152900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 --2- 172.21.15.45:0/184487049 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7efd4c0caab0 0x7efd4c152900 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7efd4c0caf10 tx=0x7efd3c001e70 comp rx=0 tx=0).stop 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd511e0700 1 -- 172.21.15.45:0/184487049 reap_dead start 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 shutdown_connections 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 >> 172.21.15.45:0/184487049 conn(0x7efd4c06a950 msgr2=0x7efd4c0af550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 shutdown_connections 2023-12-19T18:04:16.920 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:16.912+0000 7efd519e1700 1 -- 172.21.15.45:0/184487049 wait complete. 2023-12-19T18:04:16.938 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-19T18:04:17.125 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 Processor -- start 2023-12-19T18:04:17.126 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 -- start start 2023-12-19T18:04:17.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e441617f0 0x7f5e440ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e44070570 0x7f5e440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440c9350 con 0x7f5e440c8ef0 2023-12-19T18:04:17.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e44070f20 con 0x7f5e44070570 2023-12-19T18:04:17.128 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e4a5a8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440adde0 con 0x7f5e441617f0 2023-12-19T18:04:17.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.120+0000 7f5e49da7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e44070570 0x7f5e440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.129 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f5e44070570 0x7f5e440709e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42562/0 (socket says 172.21.15.45:42562) 2023-12-19T18:04:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 -- 172.21.15.45:0/270826842 learned_addr learned my addr 172.21.15.45:0/270826842 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e495a6700 1 --2- 172.21.15.45:0/270826842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e441617f0 0x7f5e440ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 -- 172.21.15.45:0/270826842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e441617f0 msgr2=0x7f5e440ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 --2- 172.21.15.45:0/270826842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e441617f0 0x7f5e440ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 -- 172.21.15.45:0/270826842 >> v1:172.21.15.45:6789/0 conn(0x7f5e440c8ef0 legacy=0x7f5e440cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.130 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 -- 172.21.15.45:0/270826842 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440ae0c0 con 0x7f5e44070570 2023-12-19T18:04:17.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e49da7700 1 --2- 172.21.15.45:0/270826842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44070570 0x7f5e440709e0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e50 tx=0x7f5e3c00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecff2b6794fc47a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e3bfff700 1 -- 172.21.15.45:0/270826842 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00e070 con 0x7f5e44070570 2023-12-19T18:04:17.131 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e3bfff700 1 -- 172.21.15.45:0/270826842 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c00b9c0 con 0x7f5e44070570 2023-12-19T18:04:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e3bfff700 1 -- 172.21.15.45:0/270826842 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00bd70 con 0x7f5e44070570 2023-12-19T18:04:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/270826842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44070570 msgr2=0x7f5e440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/270826842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44070570 0x7f5e440709e0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009e50 tx=0x7f5e3c00b330 comp rx=0 tx=0).stop 2023-12-19T18:04:17.132 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/270826842 shutdown_connections 2023-12-19T18:04:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/270826842 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e44070570 0x7f5e440709e0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/270826842 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e441617f0 0x7f5e440ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/270826842 >> 172.21.15.45:0/270826842 conn(0x7f5e440ce8a0 msgr2=0x7f5e440cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/270826842 shutdown_connections 2023-12-19T18:04:17.133 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.124+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/270826842 wait complete. 2023-12-19T18:04:17.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.128+0000 7f5e4a5a8700 1 Processor -- start 2023-12-19T18:04:17.135 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.128+0000 7f5e4a5a8700 1 -- start start 2023-12-19T18:04:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e44070570 0x7f5e44158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e440c8ef0 0x7f5e440b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 0x7f5e441641d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c5ab0 con 0x7f5e441617f0 2023-12-19T18:04:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440b38a0 con 0x7f5e44070570 2023-12-19T18:04:17.137 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440c3290 con 0x7f5e440c8ef0 2023-12-19T18:04:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 0x7f5e441641d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 0x7f5e441641d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42578/0 (socket says 172.21.15.45:42578) 2023-12-19T18:04:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 -- 172.21.15.45:0/3548545229 learned_addr learned my addr 172.21.15.45:0/3548545229 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:17.138 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e495a6700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e44070570 0x7f5e44158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e48da5700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e440c8ef0 0x7f5e440b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 -- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e440c8ef0 msgr2=0x7f5e440b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e440c8ef0 0x7f5e440b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 -- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e44070570 msgr2=0x7f5e44158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e44070570 0x7f5e44158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.139 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 -- 172.21.15.45:0/3548545229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009b30 con 0x7f5e441617f0 2023-12-19T18:04:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e49da7700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 0x7f5e441641d0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f5e4406bf90 tx=0x7f5e3c004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c004800 con 0x7f5e441617f0 2023-12-19T18:04:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c0099b0 con 0x7f5e441617f0 2023-12-19T18:04:17.140 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e44158ca0 con 0x7f5e441617f0 2023-12-19T18:04:17.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c01c680 con 0x7f5e441617f0 2023-12-19T18:04:17.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.132+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e440b2220 con 0x7f5e441617f0 2023-12-19T18:04:17.141 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.136+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e4404ed30 con 0x7f5e441617f0 2023-12-19T18:04:17.143 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.136+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f5e3c01c7e0 con 0x7f5e441617f0 2023-12-19T18:04:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.140+0000 7f5e39ffb700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e28065ad0 0x7f5e28067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.145 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.140+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f5e3c084c10 con 0x7f5e441617f0 2023-12-19T18:04:17.146 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.140+0000 7f5e495a6700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e28065ad0 0x7f5e28067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.147 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.140+0000 7f5e495a6700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e28065ad0 0x7f5e28067f90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007a60 tx=0x7f5e40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.152 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.144+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f5e3c0526d0 con 0x7f5e441617f0 2023-12-19T18:04:17.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.324+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5e4406d430 con 0x7f5e28065ad0 2023-12-19T18:04:17.331 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.324+0000 7f5e39ffb700 1 -- 172.21.15.45:0/3548545229 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5e40010740 con 0x7f5e28065ad0 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e28065ad0 msgr2=0x7f5e28067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e28065ad0 0x7f5e28067f90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5e40007a60 tx=0x7f5e40008040 comp rx=0 tx=0).stop 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 msgr2=0x7f5e441641d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 0x7f5e441641d0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f5e4406bf90 tx=0x7f5e3c004af0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 shutdown_connections 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f5e28065ad0 0x7f5e28067f90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.336 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f5e441617f0 0x7f5e441641d0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f5e440c8ef0 0x7f5e440b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 --2- 172.21.15.45:0/3548545229 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5e44070570 0x7f5e44158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 >> 172.21.15.45:0/3548545229 conn(0x7f5e440ce8a0 msgr2=0x7f5e440cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:17.337 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.328+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 shutdown_connections 2023-12-19T18:04:17.338 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.332+0000 7f5e4a5a8700 1 -- 172.21.15.45:0/3548545229 wait complete. 2023-12-19T18:04:17.338 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 3 to deep-scrub 2023-12-19T18:04:17.358 INFO:tasks.ceph:Scrubbing osd.4 2023-12-19T18:04:17.358 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:17.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.532+0000 7fef830c8700 1 Processor -- start 2023-12-19T18:04:17.539 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.532+0000 7fef830c8700 1 -- start start 2023-12-19T18:04:17.541 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef830c8700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef7c070860 0x7fef7c06c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef830c8700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c0c9850 con 0x7fef7c162340 2023-12-19T18:04:17.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef830c8700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c162c70 con 0x7fef7c070c40 2023-12-19T18:04:17.542 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef830c8700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c162790 con 0x7fef7c070860 2023-12-19T18:04:17.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef80e64700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef7c070860 0x7fef7c06c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef81665700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7fef7c162340 0x7fef7c0ca560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39238/0 (socket says 172.21.15.45:39238) 2023-12-19T18:04:17.543 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef81665700 1 -- 172.21.15.45:0/3950893691 learned_addr learned my addr 172.21.15.45:0/3950893691 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:17.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef80e64700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7fef7c070860 0x7fef7c06c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42590/0 (socket says 172.21.15.45:42590) 2023-12-19T18:04:17.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef7bfff700 1 --1- 172.21.15.45:0/3950893691 >> v1:172.21.15.73:6789/0 conn(0x7fef7c070c40 0x7fef7c161c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:36520/0 (socket says 172.21.15.45:36520) 2023-12-19T18:04:17.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef80e64700 1 -- 172.21.15.45:0/3950893691 >> v1:172.21.15.73:6789/0 conn(0x7fef7c070c40 legacy=0x7fef7c161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef7b7fe700 1 -- 172.21.15.45:0/3950893691 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422592339 0 0) 0x7fef7c0c9850 con 0x7fef7c162340 2023-12-19T18:04:17.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef80e64700 1 -- 172.21.15.45:0/3950893691 >> v1:172.21.15.45:6789/0 conn(0x7fef7c162340 legacy=0x7fef7c0ca560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.544 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef80e64700 1 -- 172.21.15.45:0/3950893691 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c162990 con 0x7fef7c070860 2023-12-19T18:04:17.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.536+0000 7fef80e64700 1 --2- 172.21.15.45:0/3950893691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070860 0x7fef7c06c330 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fef700097d0 tx=0x7fef70009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52c25211dc2c4ab1 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef7b7fe700 1 -- 172.21.15.45:0/3950893691 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70004230 con 0x7fef7c070860 2023-12-19T18:04:17.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef7b7fe700 1 -- 172.21.15.45:0/3950893691 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70004390 con 0x7fef7c070860 2023-12-19T18:04:17.545 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef7b7fe700 1 -- 172.21.15.45:0/3950893691 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef700036c0 con 0x7fef7c070860 2023-12-19T18:04:17.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 -- 172.21.15.45:0/3950893691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070860 msgr2=0x7fef7c06c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.546 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 --2- 172.21.15.45:0/3950893691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070860 0x7fef7c06c330 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fef700097d0 tx=0x7fef70009ae0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 -- 172.21.15.45:0/3950893691 shutdown_connections 2023-12-19T18:04:17.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 --2- 172.21.15.45:0/3950893691 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070860 0x7fef7c06c330 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 -- 172.21.15.45:0/3950893691 >> 172.21.15.45:0/3950893691 conn(0x7fef7c0b0680 msgr2=0x7fef7c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:17.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 -- 172.21.15.45:0/3950893691 shutdown_connections 2023-12-19T18:04:17.547 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.540+0000 7fef830c8700 1 -- 172.21.15.45:0/3950893691 wait complete. 2023-12-19T18:04:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 Processor -- start 2023-12-19T18:04:17.549 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 -- start start 2023-12-19T18:04:17.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c070860 0x7fef7c0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070c40 0x7fef7c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef7c162340 0x7fef7c0b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.551 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1fae00 con 0x7fef7c070c40 2023-12-19T18:04:17.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1fa180 con 0x7fef7c070860 2023-12-19T18:04:17.552 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef830c8700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c1fa460 con 0x7fef7c162340 2023-12-19T18:04:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070c40 0x7fef7c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef7bfff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070c40 0x7fef7c0c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42594/0 (socket says 172.21.15.45:42594) 2023-12-19T18:04:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef7bfff700 1 -- 172.21.15.45:0/2698729588 learned_addr learned my addr 172.21.15.45:0/2698729588 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef80e64700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c070860 0x7fef7c0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.544+0000 7fef81665700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef7c162340 0x7fef7c0b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.553 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef80e64700 1 -- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef7c162340 msgr2=0x7fef7c0b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef80e64700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fef7c162340 0x7fef7c0b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef80e64700 1 -- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070c40 msgr2=0x7fef7c0c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef80e64700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fef7c070c40 0x7fef7c0c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.554 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef80e64700 1 -- 172.21.15.45:0/2698729588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef700094b0 con 0x7fef7c070860 2023-12-19T18:04:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef80e64700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c070860 0x7fef7c0c3f80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0b0610 tx=0x7fef70004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011630 con 0x7fef7c070860 2023-12-19T18:04:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef700117b0 con 0x7fef7c070860 2023-12-19T18:04:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70011b60 con 0x7fef7c070860 2023-12-19T18:04:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c1fa740 con 0x7fef7c070860 2023-12-19T18:04:17.555 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1f9e30 con 0x7fef7c070860 2023-12-19T18:04:17.556 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.548+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef7c0c9a80 con 0x7fef7c070860 2023-12-19T18:04:17.558 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.552+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fef70018050 con 0x7fef7c070860 2023-12-19T18:04:17.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.552+0000 7fef797fa700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fef60065b20 0x7fef60067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.552+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fef700834e0 con 0x7fef7c070860 2023-12-19T18:04:17.560 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.552+0000 7fef797fa700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fef6006bf60 0x7fef6006e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef6006ea70 con 0x7fef6006bf60 2023-12-19T18:04:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef70085ac0 con 0x7fef7c070860 2023-12-19T18:04:17.561 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef7bfff700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fef60065b20 0x7fef60067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef81665700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fef6006bf60 0x7fef6006e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef7bfff700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fef60065b20 0x7fef60067fe0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fef68007cf0 tx=0x7fef68007c60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.562 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef81665700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fef6006bf60 0x7fef6006e3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.563 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.556+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== osd.4 v2:172.21.15.73:6805/36536 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fef6006ea70 con 0x7fef6006bf60 2023-12-19T18:04:17.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.576+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 --> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fef7c071930 con 0x7fef6006bf60 2023-12-19T18:04:17.585 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef797fa700 1 -- 172.21.15.45:0/2698729588 <== osd.4 v2:172.21.15.73:6805/36536 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fef740071c0 con 0x7fef6006bf60 2023-12-19T18:04:17.586 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:17.586 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:17.586 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fef6006bf60 msgr2=0x7fef6006e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:6805/36536,v1:172.21.15.73:6807/36536] conn(0x7fef6006bf60 0x7fef6006e3a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fef60065b20 msgr2=0x7fef60067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fef60065b20 0x7fef60067fe0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fef68007cf0 tx=0x7fef68007c60 comp rx=0 tx=0).stop 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c070860 msgr2=0x7fef7c0c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 --2- 172.21.15.45:0/2698729588 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fef7c070860 0x7fef7c0c3f80 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0b0610 tx=0x7fef70004770 comp rx=0 tx=0).stop 2023-12-19T18:04:17.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef81665700 1 -- 172.21.15.45:0/2698729588 reap_dead start 2023-12-19T18:04:17.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 shutdown_connections 2023-12-19T18:04:17.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 >> 172.21.15.45:0/2698729588 conn(0x7fef7c0b0680 msgr2=0x7fef7c161c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:17.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 shutdown_connections 2023-12-19T18:04:17.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.580+0000 7fef830c8700 1 -- 172.21.15.45:0/2698729588 wait complete. 2023-12-19T18:04:17.611 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-19T18:04:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.788+0000 7f91a94d1700 1 Processor -- start 2023-12-19T18:04:17.795 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.788+0000 7f91a94d1700 1 -- start start 2023-12-19T18:04:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a94d1700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f91a415d020 0x7f91a40b8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a94d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a40b6d90 0x7f91a40cfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a94d1700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91a40b7400 con 0x7f91a40cf720 2023-12-19T18:04:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a94d1700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91a40b8080 con 0x7f91a415d020 2023-12-19T18:04:17.798 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a94d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415d400 con 0x7f91a40b6d90 2023-12-19T18:04:17.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f919b7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f91a40cf720 0x7f91a40d0e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39242/0 (socket says 172.21.15.45:39242) 2023-12-19T18:04:17.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f919b7fe700 1 -- 172.21.15.45:0/3319799106 learned_addr learned my addr 172.21.15.45:0/3319799106 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:17.799 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a3fff700 1 --2- 172.21.15.45:0/3319799106 >> v2:172.21.15.73:3300/0 conn(0x7f91a415d020 0x7f91a40b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a8cd0700 1 --2- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a40b6d90 0x7f91a40cfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a37fe700 1 -- 172.21.15.45:0/3319799106 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226749860 0 0) 0x7f91a40b7400 con 0x7f91a40cf720 2023-12-19T18:04:17.800 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a37fe700 1 -- 172.21.15.45:0/3319799106 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91900035d0 con 0x7f91a40cf720 2023-12-19T18:04:17.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a3fff700 1 -- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a40b6d90 msgr2=0x7f91a40cfb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:17.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a3fff700 1 --2- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a40b6d90 0x7f91a40cfb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a3fff700 1 -- 172.21.15.45:0/3319799106 >> v1:172.21.15.45:6789/0 conn(0x7f91a40cf720 legacy=0x7f91a40d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.792+0000 7f91a3fff700 1 -- 172.21.15.45:0/3319799106 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40b76e0 con 0x7f91a415d020 2023-12-19T18:04:17.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a3fff700 1 --2- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a415d020 0x7f91a40b8650 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9194009880 tx=0x7f9194009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dba5522f16db8206 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.801 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a37fe700 1 -- 172.21.15.45:0/3319799106 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194011830 con 0x7f91a415d020 2023-12-19T18:04:17.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a37fe700 1 -- 172.21.15.45:0/3319799106 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9194011990 con 0x7f91a415d020 2023-12-19T18:04:17.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a37fe700 1 -- 172.21.15.45:0/3319799106 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194011d20 con 0x7f91a415d020 2023-12-19T18:04:17.802 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 -- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a415d020 msgr2=0x7f91a40b8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a415d020 0x7f91a40b8650 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f9194009880 tx=0x7f9194009b90 comp rx=0 tx=0).stop 2023-12-19T18:04:17.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 -- 172.21.15.45:0/3319799106 shutdown_connections 2023-12-19T18:04:17.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a40b6d90 0x7f91a40cfb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3319799106 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a415d020 0x7f91a40b8650 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 -- 172.21.15.45:0/3319799106 >> 172.21.15.45:0/3319799106 conn(0x7f91a40660e0 msgr2=0x7f91a40664f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:17.803 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 -- 172.21.15.45:0/3319799106 shutdown_connections 2023-12-19T18:04:17.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 -- 172.21.15.45:0/3319799106 wait complete. 2023-12-19T18:04:17.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 Processor -- start 2023-12-19T18:04:17.804 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.796+0000 7f91a94d1700 1 -- start start 2023-12-19T18:04:17.805 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 0x7f91a41521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a40cf720 0x7f91a40b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a415d020 0x7f91a40b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a415a6b0 con 0x7f91a40b6d90 2023-12-19T18:04:17.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91a41526e0 con 0x7f91a40cf720 2023-12-19T18:04:17.806 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91a4159aa0 con 0x7f91a415d020 2023-12-19T18:04:17.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 0x7f91a41521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 0x7f91a41521a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42606/0 (socket says 172.21.15.45:42606) 2023-12-19T18:04:17.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 -- 172.21.15.45:0/3341184015 learned_addr learned my addr 172.21.15.45:0/3341184015 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:17.807 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f919b7fe700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a40cf720 0x7f91a40b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a8cd0700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a415d020 0x7f91a40b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 -- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a415d020 msgr2=0x7f91a40b4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a415d020 0x7f91a40b4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 -- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a40cf720 msgr2=0x7f91a40b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a40cf720 0x7f91a40b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 -- 172.21.15.45:0/3341184015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940094b0 con 0x7f91a40b6d90 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a8cd0700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a415d020 0x7f91a40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:17.808 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a3fff700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 0x7f91a41521a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9194009bd0 tx=0x7f9194004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9194004480 con 0x7f91a40b6d90 2023-12-19T18:04:17.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f919401f070 con 0x7f91a40b6d90 2023-12-19T18:04:17.809 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91a4159d80 con 0x7f91a40b6d90 2023-12-19T18:04:17.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91940038e0 con 0x7f91a40b6d90 2023-12-19T18:04:17.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.800+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91a415a340 con 0x7f91a40b6d90 2023-12-19T18:04:17.810 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.804+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91a404ed30 con 0x7f91a40b6d90 2023-12-19T18:04:17.811 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.804+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f9194021030 con 0x7f91a40b6d90 2023-12-19T18:04:17.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.808+0000 7f91a17fa700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9184065ad0 0x7f9184067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:17.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.808+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f9194084460 con 0x7f91a40b6d90 2023-12-19T18:04:17.813 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.808+0000 7f919b7fe700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9184065ad0 0x7f9184067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:17.814 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.808+0000 7f919b7fe700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9184065ad0 0x7f9184067f90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f91a4156080 tx=0x7f918c007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:17.819 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.812+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f9194052040 con 0x7f91a40b6d90 2023-12-19T18:04:17.996 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.988+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f91a40b71e0 con 0x7f9184065ad0 2023-12-19T18:04:17.997 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a17fa700 1 -- 172.21.15.45:0/3341184015 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f918c006bf0 con 0x7f9184065ad0 2023-12-19T18:04:17.999 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9184065ad0 msgr2=0x7f9184067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9184065ad0 0x7f9184067f90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f91a4156080 tx=0x7f918c007de0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 msgr2=0x7f91a41521a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.000 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 0x7f91a41521a0 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f9194009bd0 tx=0x7f9194004770 comp rx=0 tx=0).stop 2023-12-19T18:04:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 shutdown_connections 2023-12-19T18:04:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f9184065ad0 0x7f9184067f90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f91a415d020 0x7f91a40b4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f91a40cf720 0x7f91a40b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 --2- 172.21.15.45:0/3341184015 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f91a40b6d90 0x7f91a41521a0 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.001 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 >> 172.21.15.45:0/3341184015 conn(0x7f91a40660e0 msgr2=0x7f91a40b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 shutdown_connections 2023-12-19T18:04:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:17.992+0000 7f91a94d1700 1 -- 172.21.15.45:0/3341184015 wait complete. 2023-12-19T18:04:18.002 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 4 to deep-scrub 2023-12-19T18:04:18.024 INFO:tasks.ceph:Scrubbing osd.5 2023-12-19T18:04:18.024 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.200+0000 7f769097e700 1 Processor -- start 2023-12-19T18:04:18.208 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.200+0000 7f769097e700 1 -- start start 2023-12-19T18:04:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f769097e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0ce220 0x7f768c0b5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f769097e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f768c0d23b0 0x7f768c0b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.211 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f769097e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f768c0cdd90 con 0x7f768c0d2d30 2023-12-19T18:04:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f769097e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f768c0d2970 con 0x7f768c0d23b0 2023-12-19T18:04:18.212 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f769097e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0cd3f0 con 0x7f768c0ce220 2023-12-19T18:04:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f768ad9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f768c0d2d30 0x7f768c0d3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39252/0 (socket says 172.21.15.45:39252) 2023-12-19T18:04:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f768ad9d700 1 -- 172.21.15.45:0/3784752896 learned_addr learned my addr 172.21.15.45:0/3784752896 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f768b59e700 1 --2- 172.21.15.45:0/3784752896 >> v2:172.21.15.73:3300/0 conn(0x7f768c0d23b0 0x7f768c0b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.204+0000 7f768a59c700 1 --2- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0ce220 0x7f768c0b5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.213 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f7689d9b700 1 -- 172.21.15.45:0/3784752896 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376181121 0 0) 0x7f768c0cdd90 con 0x7f768c0d2d30 2023-12-19T18:04:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f7689d9b700 1 -- 172.21.15.45:0/3784752896 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76740035d0 con 0x7f768c0d2d30 2023-12-19T18:04:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f768b59e700 1 -- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0ce220 msgr2=0x7f768c0b5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f768b59e700 1 --2- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0ce220 0x7f768c0b5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f768b59e700 1 -- 172.21.15.45:0/3784752896 >> v1:172.21.15.45:6789/0 conn(0x7f768c0d2d30 legacy=0x7f768c0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f7689d9b700 1 -- 172.21.15.45:0/3784752896 <== mon.0 v1:172.21.15.45:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2878830029 0 0) 0x7f76740035d0 con 0x7f768c0d2d30 2023-12-19T18:04:18.214 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f768b59e700 1 -- 172.21.15.45:0/3784752896 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f768c0cd6d0 con 0x7f768c0d23b0 2023-12-19T18:04:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f768b59e700 1 --2- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0d23b0 0x7f768c0b1ff0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7684009d90 tx=0x7f768400b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0c8d616ff9efde3 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f7689d9b700 1 -- 172.21.15.45:0/3784752896 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f768400e070 con 0x7f768c0d23b0 2023-12-19T18:04:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f7689d9b700 1 -- 172.21.15.45:0/3784752896 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7684003a40 con 0x7f768c0d23b0 2023-12-19T18:04:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f7689d9b700 1 -- 172.21.15.45:0/3784752896 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f767c001670 con 0x7f768c0d23b0 2023-12-19T18:04:18.215 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 -- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0d23b0 msgr2=0x7f768c0b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 --2- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0d23b0 0x7f768c0b1ff0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7684009d90 tx=0x7f768400b330 comp rx=0 tx=0).stop 2023-12-19T18:04:18.216 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 -- 172.21.15.45:0/3784752896 shutdown_connections 2023-12-19T18:04:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 --2- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0d23b0 0x7f768c0b1ff0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 --2- 172.21.15.45:0/3784752896 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0ce220 0x7f768c0b5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 -- 172.21.15.45:0/3784752896 >> 172.21.15.45:0/3784752896 conn(0x7f768c066110 msgr2=0x7f768c066520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 -- 172.21.15.45:0/3784752896 shutdown_connections 2023-12-19T18:04:18.217 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.208+0000 7f769097e700 1 -- 172.21.15.45:0/3784752896 wait complete. 2023-12-19T18:04:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.212+0000 7f769097e700 1 Processor -- start 2023-12-19T18:04:18.220 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.212+0000 7f769097e700 1 -- start start 2023-12-19T18:04:18.221 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0ce220 0x7f768c15be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f768c0d23b0 0x7f768c0c6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0d2d30 0x7f768c0b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0aaf50 con 0x7f768c0d23b0 2023-12-19T18:04:18.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0c7760 con 0x7f768c0ce220 2023-12-19T18:04:18.222 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f768c0c7a40 con 0x7f768c0d2d30 2023-12-19T18:04:18.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f768c0d23b0 0x7f768c0c6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.223 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f768c0d23b0 0x7f768c0c6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42612/0 (socket says 172.21.15.45:42612) 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 -- 172.21.15.45:0/682579993 learned_addr learned my addr 172.21.15.45:0/682579993 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768ad9d700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0ce220 0x7f768c15be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768b59e700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0d2d30 0x7f768c0b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 -- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0d2d30 msgr2=0x7f768c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f768c0d2d30 0x7f768c0b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 -- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0ce220 msgr2=0x7f768c15be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f768c0ce220 0x7f768c15be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.224 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 -- 172.21.15.45:0/682579993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7684009a70 con 0x7f768c0d23b0 2023-12-19T18:04:18.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f768a59c700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f768c0d23b0 0x7f768c0c6e60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f768000e840 tx=0x7f768000eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.225 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800095a0 con 0x7f768c0d23b0 2023-12-19T18:04:18.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7680013680 con 0x7f768c0d23b0 2023-12-19T18:04:18.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f768c0c7d20 con 0x7f768c0d23b0 2023-12-19T18:04:18.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76800139f0 con 0x7f768c0d23b0 2023-12-19T18:04:18.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.216+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f768c0c73a0 con 0x7f768c0d23b0 2023-12-19T18:04:18.226 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.220+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f768c0b2530 con 0x7f768c0d23b0 2023-12-19T18:04:18.228 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.220+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7680013b50 con 0x7f768c0d23b0 2023-12-19T18:04:18.229 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f76737fe700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7678065ad0 0x7f7678067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7680083240 con 0x7f768c0d23b0 2023-12-19T18:04:18.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f76737fe700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f767806bf10 0x7f767806e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f767806ea20 con 0x7f767806bf10 2023-12-19T18:04:18.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7680083690 con 0x7f768c0d23b0 2023-12-19T18:04:18.230 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f768ad9d700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7678065ad0 0x7f7678067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f768b59e700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f767806bf10 0x7f767806e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f768ad9d700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7678065ad0 0x7f7678067f90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f767c0011e0 tx=0x7f767c007bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.231 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.224+0000 7f768b59e700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f767806bf10 0x7f767806e350 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.233 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.228+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== osd.5 v2:172.21.15.73:6824/36539 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f767806ea20 con 0x7f767806bf10 2023-12-19T18:04:18.250 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.244+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 --> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f768c0c9490 con 0x7f767806bf10 2023-12-19T18:04:18.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.244+0000 7f76737fe700 1 -- 172.21.15.45:0/682579993 <== osd.5 v2:172.21.15.73:6824/36539 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f768c0c9490 con 0x7f767806bf10 2023-12-19T18:04:18.252 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:18.252 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:18.252 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f767806bf10 msgr2=0x7f767806e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.73:6824/36539,v1:172.21.15.73:6825/36539] conn(0x7f767806bf10 0x7f767806e350 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7678065ad0 msgr2=0x7f7678067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7678065ad0 0x7f7678067f90 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f767c0011e0 tx=0x7f767c007bc0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f768c0d23b0 msgr2=0x7f768c0c6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 --2- 172.21.15.45:0/682579993 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f768c0d23b0 0x7f768c0c6e60 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f768000e840 tx=0x7f768000eb50 comp rx=0 tx=0).stop 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f768b59e700 1 -- 172.21.15.45:0/682579993 reap_dead start 2023-12-19T18:04:18.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 shutdown_connections 2023-12-19T18:04:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 >> 172.21.15.45:0/682579993 conn(0x7f768c066110 msgr2=0x7f768c0b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 shutdown_connections 2023-12-19T18:04:18.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.248+0000 7f769097e700 1 -- 172.21.15.45:0/682579993 wait complete. 2023-12-19T18:04:18.280 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-19T18:04:18.471 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.464+0000 7f255e69f700 1 Processor -- start 2023-12-19T18:04:18.472 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.464+0000 7f255e69f700 1 -- start start 2023-12-19T18:04:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255e69f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f25580ad750 0x7f25580c8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255e69f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2558070570 0x7f25580709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255e69f700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2558070ef0 con 0x7f25581617f0 2023-12-19T18:04:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255e69f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25580adbe0 con 0x7f25580ad750 2023-12-19T18:04:18.474 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255e69f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580adde0 con 0x7f2558070570 2023-12-19T18:04:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255d69d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f25581617f0 0x7f25580cd840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:39256/0 (socket says 172.21.15.45:39256) 2023-12-19T18:04:18.475 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255d69d700 1 -- 172.21.15.45:0/993087006 learned_addr learned my addr 172.21.15.45:0/993087006 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255ce9c700 1 --2- 172.21.15.45:0/993087006 >> v2:172.21.15.45:3300/0 conn(0x7f25580ad750 0x7f25580c8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255de9e700 1 --2- 172.21.15.45:0/993087006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2558070570 0x7f25580709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255ce9c700 1 -- 172.21.15.45:0/993087006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2558070570 msgr2=0x7f25580709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255ce9c700 1 --2- 172.21.15.45:0/993087006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2558070570 0x7f25580709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255ce9c700 1 -- 172.21.15.45:0/993087006 >> v1:172.21.15.45:6789/0 conn(0x7f25581617f0 legacy=0x7f25580cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255ce9c700 1 -- 172.21.15.45:0/993087006 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580ae0c0 con 0x7f25580ad750 2023-12-19T18:04:18.476 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f254ffff700 1 -- 172.21.15.45:0/993087006 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037965992 0 0) 0x7f2558070ef0 con 0x7f25581617f0 2023-12-19T18:04:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.468+0000 7f255ce9c700 1 --2- 172.21.15.45:0/993087006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c8ef0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f2548009850 tx=0x7f2548009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2dc0a46acdfc01f server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f254ffff700 1 -- 172.21.15.45:0/993087006 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548011830 con 0x7f25580ad750 2023-12-19T18:04:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f254ffff700 1 -- 172.21.15.45:0/993087006 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548011990 con 0x7f25580ad750 2023-12-19T18:04:18.477 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f254ffff700 1 -- 172.21.15.45:0/993087006 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548011d20 con 0x7f25580ad750 2023-12-19T18:04:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 -- 172.21.15.45:0/993087006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 msgr2=0x7f25580c8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 --2- 172.21.15.45:0/993087006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c8ef0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f2548009850 tx=0x7f2548009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:18.478 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 -- 172.21.15.45:0/993087006 shutdown_connections 2023-12-19T18:04:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 --2- 172.21.15.45:0/993087006 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f2558070570 0x7f25580709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 --2- 172.21.15.45:0/993087006 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c8ef0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 -- 172.21.15.45:0/993087006 >> 172.21.15.45:0/993087006 conn(0x7f25580ce8a0 msgr2=0x7f25580cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 -- 172.21.15.45:0/993087006 shutdown_connections 2023-12-19T18:04:18.479 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.472+0000 7f255e69f700 1 -- 172.21.15.45:0/993087006 wait complete. 2023-12-19T18:04:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 Processor -- start 2023-12-19T18:04:18.482 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 -- start start 2023-12-19T18:04:18.483 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2558070570 0x7f2558152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25581617f0 0x7f25580b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25581532a0 con 0x7f25580ad750 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c32a0 con 0x7f2558070570 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255e69f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25580c8800 con 0x7f25581617f0 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255ce9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.484 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255ce9c700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c92e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:42628/0 (socket says 172.21.15.45:42628) 2023-12-19T18:04:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255ce9c700 1 -- 172.21.15.45:0/2939625824 learned_addr learned my addr 172.21.15.45:0/2939625824 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255d69d700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2558070570 0x7f2558152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.485 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.476+0000 7f255de9e700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25581617f0 0x7f25580b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255ce9c700 1 -- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25581617f0 msgr2=0x7f25580b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255ce9c700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25581617f0 0x7f25580b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255ce9c700 1 -- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2558070570 msgr2=0x7f2558152d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255ce9c700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2558070570 0x7f2558152d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255ce9c700 1 -- 172.21.15.45:0/2939625824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480094b0 con 0x7f25580ad750 2023-12-19T18:04:18.487 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255ce9c700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c92e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2548000c00 tx=0x7f2548004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25480036c0 con 0x7f25580ad750 2023-12-19T18:04:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2548003820 con 0x7f25580ad750 2023-12-19T18:04:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548003bd0 con 0x7f25580ad750 2023-12-19T18:04:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25580c8ae0 con 0x7f25580ad750 2023-12-19T18:04:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25580c3580 con 0x7f25580ad750 2023-12-19T18:04:18.488 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.480+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25580c9000 con 0x7f25580ad750 2023-12-19T18:04:18.489 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.484+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f2548003d30 con 0x7f25580ad750 2023-12-19T18:04:18.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.484+0000 7f254dffb700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f253c065ad0 0x7f253c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.490 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.484+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f2548021030 con 0x7f25580ad750 2023-12-19T18:04:18.491 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.484+0000 7f255d69d700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f253c065ad0 0x7f253c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.492 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.488+0000 7f255d69d700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f253c065ad0 0x7f253c067f90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2554000f60 tx=0x7f2554007e90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.496 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.488+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f25580c9000 con 0x7f25580ad750 2023-12-19T18:04:18.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.672+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f25580c8680 con 0x7f253c065ad0 2023-12-19T18:04:18.678 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.672+0000 7f254dffb700 1 -- 172.21.15.45:0/2939625824 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f25540133f0 con 0x7f253c065ad0 2023-12-19T18:04:18.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f253c065ad0 msgr2=0x7f253c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f253c065ad0 0x7f253c067f90 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2554000f60 tx=0x7f2554007e90 comp rx=0 tx=0).stop 2023-12-19T18:04:18.682 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 msgr2=0x7f25580c92e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c92e0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f2548000c00 tx=0x7f2548004770 comp rx=0 tx=0).stop 2023-12-19T18:04:18.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 shutdown_connections 2023-12-19T18:04:18.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f253c065ad0 0x7f253c067f90 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f25581617f0 0x7f25580b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f25580ad750 0x7f25580c92e0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.683 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 --2- 172.21.15.45:0/2939625824 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2558070570 0x7f2558152d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 >> 172.21.15.45:0/2939625824 conn(0x7f25580ce8a0 msgr2=0x7f25580cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 shutdown_connections 2023-12-19T18:04:18.684 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.676+0000 7f255e69f700 1 -- 172.21.15.45:0/2939625824 wait complete. 2023-12-19T18:04:18.685 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 5 to deep-scrub 2023-12-19T18:04:18.705 INFO:tasks.ceph:Scrubbing osd.6 2023-12-19T18:04:18.705 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.884+0000 7f70c5285700 1 Processor -- start 2023-12-19T18:04:18.890 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.884+0000 7f70c5285700 1 -- start start 2023-12-19T18:04:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70c5285700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f70c006e110 0x7f70c00ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70c5285700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c006d3a0 0x7f70c00cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70c5285700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70c00ca0e0 con 0x7f70c00caab0 2023-12-19T18:04:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70c5285700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70c006e4f0 con 0x7f70c006e110 2023-12-19T18:04:18.893 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70c5285700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c0161bb0 con 0x7f70c006d3a0 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bf7fe700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f70c00caab0 0x7f70c006cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53690/0 (socket says 172.21.15.45:53690) 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bf7fe700 1 -- 172.21.15.45:0/4186669462 learned_addr learned my addr 172.21.15.45:0/4186669462 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bffff700 1 --2- 172.21.15.45:0/4186669462 >> v2:172.21.15.45:3300/0 conn(0x7f70c006e110 0x7f70c00ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70c4a84700 1 --2- 172.21.15.45:0/4186669462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c006d3a0 0x7f70c00cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70beffd700 1 -- 172.21.15.45:0/4186669462 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367371018 0 0) 0x7f70c00ca0e0 con 0x7f70c00caab0 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70beffd700 1 -- 172.21.15.45:0/4186669462 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70a80035d0 con 0x7f70c00caab0 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bffff700 1 -- 172.21.15.45:0/4186669462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c006d3a0 msgr2=0x7f70c00cb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:18.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bffff700 1 --2- 172.21.15.45:0/4186669462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c006d3a0 0x7f70c00cb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bffff700 1 -- 172.21.15.45:0/4186669462 >> v1:172.21.15.45:6789/0 conn(0x7f70c00caab0 legacy=0x7f70c006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bffff700 1 -- 172.21.15.45:0/4186669462 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c00c9a90 con 0x7f70c006e110 2023-12-19T18:04:18.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70bffff700 1 --2- 172.21.15.45:0/4186669462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c00ca570 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009850 tx=0x7f70b0009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73230d5e37faf72a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70beffd700 1 -- 172.21.15.45:0/4186669462 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0011830 con 0x7f70c006e110 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70beffd700 1 -- 172.21.15.45:0/4186669462 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b0011990 con 0x7f70c006e110 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.888+0000 7f70beffd700 1 -- 172.21.15.45:0/4186669462 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0011d40 con 0x7f70c006e110 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 -- 172.21.15.45:0/4186669462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 msgr2=0x7f70c00ca570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 --2- 172.21.15.45:0/4186669462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c00ca570 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009850 tx=0x7f70b0009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 -- 172.21.15.45:0/4186669462 shutdown_connections 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 --2- 172.21.15.45:0/4186669462 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c006d3a0 0x7f70c00cb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.898 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 --2- 172.21.15.45:0/4186669462 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c00ca570 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 -- 172.21.15.45:0/4186669462 >> 172.21.15.45:0/4186669462 conn(0x7f70c006a950 msgr2=0x7f70c00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 -- 172.21.15.45:0/4186669462 shutdown_connections 2023-12-19T18:04:18.899 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.892+0000 7f70c5285700 1 -- 172.21.15.45:0/4186669462 wait complete. 2023-12-19T18:04:18.901 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 Processor -- start 2023-12-19T18:04:18.902 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 -- start start 2023-12-19T18:04:18.907 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c00caab0 0x7f70c014de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c00c8680 0x7f70c00c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c014e3c0 con 0x7f70c006e110 2023-12-19T18:04:18.908 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70c015e8b0 con 0x7f70c00c8680 2023-12-19T18:04:18.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c5285700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70c015eb90 con 0x7f70c00caab0 2023-12-19T18:04:18.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c015f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40546/0 (socket says 172.21.15.45:40546) 2023-12-19T18:04:18.909 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 -- 172.21.15.45:0/1351478186 learned_addr learned my addr 172.21.15.45:0/1351478186 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:18.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bf7fe700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c00caab0 0x7f70c014de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c4a84700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c00c8680 0x7f70c00c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 -- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c00caab0 msgr2=0x7f70c014de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.910 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f70c00caab0 0x7f70c014de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 -- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c00c8680 msgr2=0x7f70c00c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c00c8680 0x7f70c00c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70bffff700 1 -- 172.21.15.45:0/1351478186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00094b0 con 0x7f70c006e110 2023-12-19T18:04:18.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.896+0000 7f70c4a84700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f70c00c8680 0x7f70c00c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:18.911 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70bffff700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c015f950 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f70b00090b0 tx=0x7f70b0004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0004480 con 0x7f70c006e110 2023-12-19T18:04:18.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70b001f070 con 0x7f70c006e110 2023-12-19T18:04:18.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70c015ee70 con 0x7f70c006e110 2023-12-19T18:04:18.912 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0003900 con 0x7f70c006e110 2023-12-19T18:04:18.913 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70c015f430 con 0x7f70c006e110 2023-12-19T18:04:18.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.900+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70c00c9d70 con 0x7f70c006e110 2023-12-19T18:04:18.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.904+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f70b0021030 con 0x7f70c006e110 2023-12-19T18:04:18.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.904+0000 7f70bcff9700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f70ac065b00 0x7f70ac067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.914 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.904+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f70b0084380 con 0x7f70c006e110 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.904+0000 7f70bf7fe700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f70ac065b00 0x7f70ac067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70bcff9700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f70ac06bf40 0x7f70ac06e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70ac06ea50 con 0x7f70ac06bf40 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70b0086960 con 0x7f70c006e110 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70c4a84700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f70ac06bf40 0x7f70ac06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70bf7fe700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f70ac065b00 0x7f70ac067fc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f70c015b3c0 tx=0x7f70b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.915 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70c4a84700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f70ac06bf40 0x7f70ac06e380 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:18.916 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.908+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== osd.6 v2:172.21.15.73:6816/36537 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f70ac06ea50 con 0x7f70ac06bf40 2023-12-19T18:04:18.934 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.928+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 --> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70c00ce0a0 con 0x7f70ac06bf40 2023-12-19T18:04:18.935 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.928+0000 7f70bcff9700 1 -- 172.21.15.45:0/1351478186 <== osd.6 v2:172.21.15.73:6816/36537 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f70c00ce0a0 con 0x7f70ac06bf40 2023-12-19T18:04:18.935 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:18.936 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:18.936 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:18.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.928+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f70ac06bf40 msgr2=0x7f70ac06e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.928+0000 7f70c5285700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.73:6816/36537,v1:172.21.15.73:6817/36537] conn(0x7f70ac06bf40 0x7f70ac06e380 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:18.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f70ac065b00 msgr2=0x7f70ac067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.937 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f70ac065b00 0x7f70ac067fc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f70c015b3c0 tx=0x7f70b4009040 comp rx=0 tx=0).stop 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 msgr2=0x7f70c015f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 --2- 172.21.15.45:0/1351478186 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f70c006e110 0x7f70c015f950 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f70b00090b0 tx=0x7f70b0004770 comp rx=0 tx=0).stop 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c4a84700 1 -- 172.21.15.45:0/1351478186 reap_dead start 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 shutdown_connections 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 >> 172.21.15.45:0/1351478186 conn(0x7f70c006a950 msgr2=0x7f70c00cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 shutdown_connections 2023-12-19T18:04:18.938 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:18.932+0000 7f70c5285700 1 -- 172.21.15.45:0/1351478186 wait complete. 2023-12-19T18:04:18.958 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-19T18:04:19.149 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.144+0000 7fb9ff59e700 1 Processor -- start 2023-12-19T18:04:19.150 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.144+0000 7fb9ff59e700 1 -- start start 2023-12-19T18:04:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9ff59e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba001617f0 0x7fba000ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9ff59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba000cd840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9ff59e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba000c9350 con 0x7fba00070570 2023-12-19T18:04:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9ff59e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba000adde0 con 0x7fba001617f0 2023-12-19T18:04:19.153 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9ff59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000ae0c0 con 0x7fba000c8ef0 2023-12-19T18:04:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fe59c700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7fba001617f0 0x7fba000ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fed9d700 1 --1- >> v1:172.21.15.73:6789/0 conn(0x7fba00070570 0x7fba0006dc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.73:6789/0 says I am v1:172.21.15.45:55314/0 (socket says 172.21.15.45:55314) 2023-12-19T18:04:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fed9d700 1 -- 172.21.15.45:0/503630837 learned_addr learned my addr 172.21.15.45:0/503630837 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:19.154 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9f5d9b700 1 --2- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba000cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fdd9b700 1 -- 172.21.15.45:0/503630837 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4139551165 0 0) 0x7fba000c9350 con 0x7fba00070570 2023-12-19T18:04:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fdd9b700 1 -- 172.21.15.45:0/503630837 --> v1:172.21.15.73:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9e00035d0 con 0x7fba00070570 2023-12-19T18:04:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fe59c700 1 -- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 msgr2=0x7fba000cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fe59c700 1 --2- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba000cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.155 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fe59c700 1 -- 172.21.15.45:0/503630837 >> v1:172.21.15.73:6789/0 conn(0x7fba00070570 legacy=0x7fba0006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fe59c700 1 -- 172.21.15.45:0/503630837 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0006d150 con 0x7fba001617f0 2023-12-19T18:04:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.148+0000 7fb9fe59c700 1 --2- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba001617f0 0x7fba000ad750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009850 tx=0x7fb9f0009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4df32ee9f981edf server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9fdd9b700 1 -- 172.21.15.45:0/503630837 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0011830 con 0x7fba001617f0 2023-12-19T18:04:19.156 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9fdd9b700 1 -- 172.21.15.45:0/503630837 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f0011990 con 0x7fba001617f0 2023-12-19T18:04:19.157 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9fdd9b700 1 -- 172.21.15.45:0/503630837 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f0011d40 con 0x7fba001617f0 2023-12-19T18:04:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 -- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba001617f0 msgr2=0x7fba000ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba001617f0 0x7fba000ad750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fb9f0009850 tx=0x7fb9f0009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 -- 172.21.15.45:0/503630837 shutdown_connections 2023-12-19T18:04:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba000cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/503630837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba001617f0 0x7fba000ad750 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.158 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 -- 172.21.15.45:0/503630837 >> 172.21.15.45:0/503630837 conn(0x7fba000ce8a0 msgr2=0x7fba000cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:19.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 -- 172.21.15.45:0/503630837 shutdown_connections 2023-12-19T18:04:19.159 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.152+0000 7fb9ff59e700 1 -- 172.21.15.45:0/503630837 wait complete. 2023-12-19T18:04:19.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 Processor -- start 2023-12-19T18:04:19.161 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 -- start start 2023-12-19T18:04:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00070570 0x7fba00156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba0015f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.162 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 0x7fba0015faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b3210 con 0x7fba001617f0 2023-12-19T18:04:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba00157370 con 0x7fba00070570 2023-12-19T18:04:19.163 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9ff59e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba000b22b0 con 0x7fba000c8ef0 2023-12-19T18:04:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 0x7fba0015faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 0x7fba0015faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40552/0 (socket says 172.21.15.45:40552) 2023-12-19T18:04:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 -- 172.21.15.45:0/2845646329 learned_addr learned my addr 172.21.15.45:0/2845646329 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fe59c700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00070570 0x7fba00156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9f5d9b700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba0015f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.164 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 -- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 msgr2=0x7fba0015f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba0015f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 -- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00070570 msgr2=0x7fba00156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00070570 0x7fba00156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.165 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.156+0000 7fb9fed9d700 1 -- 172.21.15.45:0/2845646329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f00094b0 con 0x7fba001617f0 2023-12-19T18:04:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9fed9d700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 0x7fba0015faf0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800cb40 tx=0x7fb9f800cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f8007500 con 0x7fba001617f0 2023-12-19T18:04:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f8007660 con 0x7fba001617f0 2023-12-19T18:04:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f80079f0 con 0x7fba001617f0 2023-12-19T18:04:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba000b2590 con 0x7fba001617f0 2023-12-19T18:04:19.166 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba000b2b50 con 0x7fba001617f0 2023-12-19T18:04:19.167 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.160+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba000b0160 con 0x7fba001617f0 2023-12-19T18:04:19.168 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.164+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7fb9f801b3b0 con 0x7fba001617f0 2023-12-19T18:04:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.164+0000 7fb9f77fe700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9e4065ad0 0x7fb9e4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.164+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7fb9f8082980 con 0x7fba001617f0 2023-12-19T18:04:19.170 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.164+0000 7fb9fe59c700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9e4065ad0 0x7fb9e4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.171 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.164+0000 7fb9fe59c700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9e4065ad0 0x7fb9e4067f90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00090b0 tx=0x7fb9f001c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.178 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.172+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7fb9f80504e0 con 0x7fba001617f0 2023-12-19T18:04:19.355 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.348+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fba0006d710 con 0x7fb9e4065ad0 2023-12-19T18:04:19.356 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.348+0000 7fb9f77fe700 1 -- 172.21.15.45:0/2845646329 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb9f0011b00 con 0x7fb9e4065ad0 2023-12-19T18:04:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9e4065ad0 msgr2=0x7fb9e4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9e4065ad0 0x7fb9e4067f90 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fb9f00090b0 tx=0x7fb9f001c040 comp rx=0 tx=0).stop 2023-12-19T18:04:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 msgr2=0x7fba0015faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.359 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 0x7fba0015faf0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fb9f800cb40 tx=0x7fb9f800cb70 comp rx=0 tx=0).stop 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 shutdown_connections 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7fb9e4065ad0 0x7fb9e4067f90 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7fba001617f0 0x7fba0015faf0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7fba000c8ef0 0x7fba0015f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 --2- 172.21.15.45:0/2845646329 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fba00070570 0x7fba00156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 >> 172.21.15.45:0/2845646329 conn(0x7fba000ce8a0 msgr2=0x7fba000cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:19.360 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 shutdown_connections 2023-12-19T18:04:19.361 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.352+0000 7fb9ff59e700 1 -- 172.21.15.45:0/2845646329 wait complete. 2023-12-19T18:04:19.362 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 6 to deep-scrub 2023-12-19T18:04:19.382 INFO:tasks.ceph:Scrubbing osd.7 2023-12-19T18:04:19.382 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-19T18:04:19.572 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.564+0000 7f7add89f700 1 Processor -- start 2023-12-19T18:04:19.573 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.568+0000 7f7add89f700 1 -- start start 2023-12-19T18:04:19.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.568+0000 7f7add89f700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ad815e500 0x7f7ad806fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.576 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.568+0000 7f7add89f700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ad80cabc0 0x7f7ad806a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.568+0000 7f7add89f700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ad80af100 con 0x7f7ad80cb070 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.568+0000 7f7add89f700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad815e8e0 con 0x7f7ad815e500 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.568+0000 7f7add89f700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ad80aeb40 con 0x7f7ad80cabc0 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ad815e500 0x7f7ad806fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7ad7fff700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f7ad80cabc0 0x7f7ad806a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f7ad815e500 0x7f7ad806fa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40568/0 (socket says 172.21.15.45:40568) 2023-12-19T18:04:19.577 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 -- 172.21.15.45:0/3221705381 learned_addr learned my addr 172.21.15.45:0/3221705381 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:19.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 -- 172.21.15.45:0/3221705381 >> v2:172.21.15.73:3300/0 conn(0x7f7ad80cabc0 msgr2=0x7f7ad806a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:19.578 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 --2- 172.21.15.45:0/3221705381 >> v2:172.21.15.73:3300/0 conn(0x7f7ad80cabc0 0x7f7ad806a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 -- 172.21.15.45:0/3221705381 >> v1:172.21.15.73:6789/0 conn(0x7f7ad80cb070 legacy=0x7f7ad80b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 -- 172.21.15.45:0/3221705381 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad80aee20 con 0x7f7ad815e500 2023-12-19T18:04:19.579 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7adc89d700 1 --2- 172.21.15.45:0/3221705381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad815e500 0x7f7ad806fa50 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80b55b0 tx=0x7f7acc009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f04c42cc7ecd33 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7ad77fe700 1 -- 172.21.15.45:0/3221705381 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc011830 con 0x7f7ad815e500 2023-12-19T18:04:19.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7ad77fe700 1 -- 172.21.15.45:0/3221705381 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc011990 con 0x7f7ad815e500 2023-12-19T18:04:19.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7ad77fe700 1 -- 172.21.15.45:0/3221705381 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc011d20 con 0x7f7ad815e500 2023-12-19T18:04:19.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 -- 172.21.15.45:0/3221705381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad815e500 msgr2=0x7f7ad806fa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.580 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 --2- 172.21.15.45:0/3221705381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad815e500 0x7f7ad806fa50 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80b55b0 tx=0x7f7acc009bf0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 -- 172.21.15.45:0/3221705381 shutdown_connections 2023-12-19T18:04:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 --2- 172.21.15.45:0/3221705381 >> v2:172.21.15.73:3300/0 conn(0x7f7ad80cabc0 0x7f7ad806a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 --2- 172.21.15.45:0/3221705381 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad815e500 0x7f7ad806fa50 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 -- 172.21.15.45:0/3221705381 >> 172.21.15.45:0/3221705381 conn(0x7f7ad806d850 msgr2=0x7f7ad806dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 -- 172.21.15.45:0/3221705381 shutdown_connections 2023-12-19T18:04:19.581 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.572+0000 7f7add89f700 1 -- 172.21.15.45:0/3221705381 wait complete. 2023-12-19T18:04:19.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.576+0000 7f7add89f700 1 Processor -- start 2023-12-19T18:04:19.584 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 -- start start 2023-12-19T18:04:19.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ad80cabc0 0x7f7ad8156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad80cb070 0x7f7ad80cf180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ad815e500 0x7f7ad81597c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80ada40 con 0x7f7ad80cb070 2023-12-19T18:04:19.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80ced40 con 0x7f7ad80cabc0 2023-12-19T18:04:19.587 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add89f700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80ad110 con 0x7f7ad815e500 2023-12-19T18:04:19.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad80cb070 0x7f7ad80cf180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad80cb070 0x7f7ad80cf180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40574/0 (socket says 172.21.15.45:40574) 2023-12-19T18:04:19.588 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 -- 172.21.15.45:0/2995066823 learned_addr learned my addr 172.21.15.45:0/2995066823 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:19.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7adc89d700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ad80cabc0 0x7f7ad8156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 -- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ad815e500 msgr2=0x7f7ad81597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add09e700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ad815e500 0x7f7ad81597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.589 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ad815e500 0x7f7ad81597c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 -- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ad80cabc0 msgr2=0x7f7ad8156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ad80cabc0 0x7f7ad8156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7ad7fff700 1 -- 172.21.15.45:0/2995066823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009570 con 0x7f7ad80cb070 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7adc89d700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ad80cabc0 0x7f7ad8156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.580+0000 7f7add09e700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f7ad815e500 0x7f7ad81597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7ad7fff700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad80cb070 0x7f7ad80cf180 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400e840 tx=0x7f7ac400ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40095a0 con 0x7f7ad80cb070 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac400c690 con 0x7f7ad80cb070 2023-12-19T18:04:19.590 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad80ad3f0 con 0x7f7ad80cb070 2023-12-19T18:04:19.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400ca00 con 0x7f7ad80cb070 2023-12-19T18:04:19.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad80cf6c0 con 0x7f7ad80cb070 2023-12-19T18:04:19.591 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.584+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ad80b21a0 con 0x7f7ad80cb070 2023-12-19T18:04:19.593 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f7ac400cb60 con 0x7f7ad80cb070 2023-12-19T18:04:19.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7ad57fa700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7abc065ad0 0x7f7abc067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.594 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f7ac4082ff0 con 0x7f7ad80cb070 2023-12-19T18:04:19.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7adc89d700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7abc065ad0 0x7f7abc067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.595 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7ad57fa700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f7abc06bf10 0x7f7abc06e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7abc06ea20 con 0x7f7abc06bf10 2023-12-19T18:04:19.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ac40855d0 con 0x7f7ad80cb070 2023-12-19T18:04:19.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.588+0000 7f7add09e700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f7abc06bf10 0x7f7abc06e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.596 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.592+0000 7f7adc89d700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7abc065ad0 0x7f7abc067f90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.597 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.592+0000 7f7add09e700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f7abc06bf10 0x7f7abc06e350 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.599 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.592+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== osd.7 v2:172.21.15.73:6800/36538 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f7abc06ea20 con 0x7f7abc06bf10 2023-12-19T18:04:19.618 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 --> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f7ad80b1ec0 con 0x7f7abc06bf10 2023-12-19T18:04:19.619 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7ad57fa700 1 -- 172.21.15.45:0/2995066823 <== osd.7 v2:172.21.15.73:6800/36538 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f7ad0003a40 con 0x7f7abc06bf10 2023-12-19T18:04:19.620 INFO:teuthology.orchestra.run.smithi045.stdout:{ 2023-12-19T18:04:19.620 INFO:teuthology.orchestra.run.smithi045.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-12-19T18:04:19.620 INFO:teuthology.orchestra.run.smithi045.stdout:} 2023-12-19T18:04:19.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f7abc06bf10 msgr2=0x7f7abc06e350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.622 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.73:6800/36538,v1:172.21.15.73:6801/36538] conn(0x7f7abc06bf10 0x7f7abc06e350 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7abc065ad0 msgr2=0x7f7abc067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f7abc065ad0 0x7f7abc067f90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000c00 tx=0x7f7acc008030 comp rx=0 tx=0).stop 2023-12-19T18:04:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad80cb070 msgr2=0x7f7ad80cf180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add89f700 1 --2- 172.21.15.45:0/2995066823 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f7ad80cb070 0x7f7ad80cf180 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400e840 tx=0x7f7ac400ec00 comp rx=0 tx=0).stop 2023-12-19T18:04:19.623 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.612+0000 7f7add09e700 1 -- 172.21.15.45:0/2995066823 reap_dead start 2023-12-19T18:04:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.616+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 shutdown_connections 2023-12-19T18:04:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.616+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 >> 172.21.15.45:0/2995066823 conn(0x7f7ad806d850 msgr2=0x7f7ad815bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:19.624 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.616+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 shutdown_connections 2023-12-19T18:04:19.625 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.616+0000 7f7add89f700 1 -- 172.21.15.45:0/2995066823 wait complete. 2023-12-19T18:04:19.643 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-19T18:04:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.828+0000 7f110cb0e700 1 Processor -- start 2023-12-19T18:04:19.834 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.828+0000 7f110cb0e700 1 -- start start 2023-12-19T18:04:19.837 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f110cb0e700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f110815d300 0x7f11081619f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f110cb0e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1108161f30 con 0x7f110806e680 2023-12-19T18:04:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f110cb0e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110806d170 con 0x7f110806e210 2023-12-19T18:04:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f110cb0e700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f110806d450 con 0x7f110815d300 2023-12-19T18:04:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11077fe700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f110815d300 0x7f11081619f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f1107fff700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f110806e680 0x7f11080ab8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53696/0 (socket says 172.21.15.45:53696) 2023-12-19T18:04:19.838 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f1107fff700 1 -- 172.21.15.45:0/3196484693 learned_addr learned my addr 172.21.15.45:0/3196484693 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:19.839 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11067fc700 1 -- 172.21.15.45:0/3196484693 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3010444175 0 0) 0x7f1108161f30 con 0x7f110806e680 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11067fc700 1 -- 172.21.15.45:0/3196484693 --> v1:172.21.15.45:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f00035d0 con 0x7f110806e680 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11067fc700 1 -- 172.21.15.45:0/3196484693 <== mon.1 v1:172.21.15.73:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 372880354 0 0) 0x7f110806d170 con 0x7f110806e210 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11077fe700 1 -- 172.21.15.45:0/3196484693 >> v1:172.21.15.73:6789/0 conn(0x7f110806e210 legacy=0x7f1108070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11077fe700 1 -- 172.21.15.45:0/3196484693 >> v1:172.21.15.45:6789/0 conn(0x7f110806e680 legacy=0x7f11080ab8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11077fe700 1 -- 172.21.15.45:0/3196484693 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110806d730 con 0x7f110815d300 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11077fe700 1 --2- 172.21.15.45:0/3196484693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110815d300 0x7f11081619f0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009850 tx=0x7f10f8009b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e852a837768385 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11067fc700 1 -- 172.21.15.45:0/3196484693 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8011830 con 0x7f110815d300 2023-12-19T18:04:19.840 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11067fc700 1 -- 172.21.15.45:0/3196484693 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f8011990 con 0x7f110815d300 2023-12-19T18:04:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.832+0000 7f11067fc700 1 -- 172.21.15.45:0/3196484693 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8011d40 con 0x7f110815d300 2023-12-19T18:04:19.841 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 -- 172.21.15.45:0/3196484693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110815d300 msgr2=0x7f11081619f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3196484693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110815d300 0x7f11081619f0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009850 tx=0x7f10f8009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 -- 172.21.15.45:0/3196484693 shutdown_connections 2023-12-19T18:04:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3196484693 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110815d300 0x7f11081619f0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 -- 172.21.15.45:0/3196484693 >> 172.21.15.45:0/3196484693 conn(0x7f11080ce8a0 msgr2=0x7f11080cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 -- 172.21.15.45:0/3196484693 shutdown_connections 2023-12-19T18:04:19.842 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 -- 172.21.15.45:0/3196484693 wait complete. 2023-12-19T18:04:19.843 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 Processor -- start 2023-12-19T18:04:19.844 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.836+0000 7f110cb0e700 1 -- start start 2023-12-19T18:04:19.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f110806e210 0x7f110815bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 0x7f11080b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f110815d300 0x7f1108156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110815c330 con 0x7f110806e680 2023-12-19T18:04:19.846 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110815c060 con 0x7f110815d300 2023-12-19T18:04:19.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11080b1f70 con 0x7f110806e210 2023-12-19T18:04:19.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 0x7f11080b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 0x7f11080b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40590/0 (socket says 172.21.15.45:40590) 2023-12-19T18:04:19.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 -- 172.21.15.45:0/3891508682 learned_addr learned my addr 172.21.15.45:0/3891508682 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:19.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1107fff700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f110815d300 0x7f1108156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.847 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f11077fe700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f110806e210 0x7f110815bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 -- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f110806e210 msgr2=0x7f110815bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f110806e210 0x7f110815bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.848 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 -- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f110815d300 msgr2=0x7f1108156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f110815d300 0x7f1108156970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 -- 172.21.15.45:0/3891508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80094b0 con 0x7f110806e680 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1107fff700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f110815d300 0x7f1108156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f1106ffd700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 0x7f11080b2d30 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0011e0 tx=0x7f10fc00cae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc0054e0 con 0x7f110806e680 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc0036a0 con 0x7f110806e680 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc003a50 con 0x7f110806e680 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11080b2250 con 0x7f110806e680 2023-12-19T18:04:19.849 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.840+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11080b2810 con 0x7f110806e680 2023-12-19T18:04:19.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.844+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11080b2a30 con 0x7f110806e680 2023-12-19T18:04:19.850 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.844+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f10fc003bb0 con 0x7f110806e680 2023-12-19T18:04:19.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.848+0000 7f10effff700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f10f4065ad0 0x7f10f4067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:19.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.848+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f10fc082610 con 0x7f110806e680 2023-12-19T18:04:19.853 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.848+0000 7f11077fe700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f10f4065ad0 0x7f10f4067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:19.854 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.848+0000 7f11077fe700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f10f4065ad0 0x7f10f4067f90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f10f80090b0 tx=0x7f10f801c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:19.859 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:19.852+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f10fc050040 con 0x7f110806e680 2023-12-19T18:04:20.037 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.032+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f110815fdf0 con 0x7f10f4065ad0 2023-12-19T18:04:20.038 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.032+0000 7f10effff700 1 -- 172.21.15.45:0/3891508682 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f110815fdf0 con 0x7f10f4065ad0 2023-12-19T18:04:20.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f10f4065ad0 msgr2=0x7f10f4067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f10f4065ad0 0x7f10f4067f90 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f10f80090b0 tx=0x7f10f801c040 comp rx=0 tx=0).stop 2023-12-19T18:04:20.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 msgr2=0x7f11080b2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.042 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 0x7f11080b2d30 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7f10fc0011e0 tx=0x7f10fc00cae0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 shutdown_connections 2023-12-19T18:04:20.043 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f10f4065ad0 0x7f10f4067f90 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f110815d300 0x7f1108156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f110806e680 0x7f11080b2d30 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 --2- 172.21.15.45:0/3891508682 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f110806e210 0x7f110815bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 >> 172.21.15.45:0/3891508682 conn(0x7f11080ce8a0 msgr2=0x7f11080ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 shutdown_connections 2023-12-19T18:04:20.044 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.036+0000 7f110cb0e700 1 -- 172.21.15.45:0/3891508682 wait complete. 2023-12-19T18:04:20.045 INFO:teuthology.orchestra.run.smithi045.stderr:instructed osd(s) 7 to deep-scrub 2023-12-19T18:04:20.070 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:04:20.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.244+0000 7f3db925e700 1 Processor -- start 2023-12-19T18:04:20.252 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.244+0000 7f3db925e700 1 -- start start 2023-12-19T18:04:20.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db925e700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f3db40b05e0 0x7f3db40b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:20.254 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db925e700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db40b0f80 con 0x7f3db415b080 2023-12-19T18:04:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db925e700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db415b460 con 0x7f3db40b1f30 2023-12-19T18:04:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db925e700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db40cf5f0 con 0x7f3db40b05e0 2023-12-19T18:04:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db2d9d700 1 --1- >> v1:172.21.15.45:6789/0 conn(0x7f3db415b080 0x7f3db40c9f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.45:6789/0 says I am v1:172.21.15.45:53706/0 (socket says 172.21.15.45:53706) 2023-12-19T18:04:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db2d9d700 1 -- 172.21.15.45:0/3585917876 learned_addr learned my addr 172.21.15.45:0/3585917876 (peer_addr_for_me v1:172.21.15.45:0/0) 2023-12-19T18:04:20.255 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db259c700 1 --2- 172.21.15.45:0/3585917876 >> v2:172.21.15.73:3300/0 conn(0x7f3db40b05e0 0x7f3db40b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db259c700 1 -- 172.21.15.45:0/3585917876 >> v1:172.21.15.73:6789/0 conn(0x7f3db40b1f30 legacy=0x7f3db40b2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db259c700 1 -- 172.21.15.45:0/3585917876 >> v1:172.21.15.45:6789/0 conn(0x7f3db415b080 legacy=0x7f3db40c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.256 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db1d9b700 1 -- 172.21.15.45:0/3585917876 <== mon.0 v1:172.21.15.45:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259787361 0 0) 0x7f3db40b0f80 con 0x7f3db415b080 2023-12-19T18:04:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db259c700 1 -- 172.21.15.45:0/3585917876 --> v2:172.21.15.73:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db406cd90 con 0x7f3db40b05e0 2023-12-19T18:04:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db259c700 1 --2- 172.21.15.45:0/3585917876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40b0a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009850 tx=0x7f3da8009b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=543c0faa1561e224 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.248+0000 7f3db1d9b700 1 -- 172.21.15.45:0/3585917876 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8011830 con 0x7f3db40b05e0 2023-12-19T18:04:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db1d9b700 1 -- 172.21.15.45:0/3585917876 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da8011990 con 0x7f3db40b05e0 2023-12-19T18:04:20.257 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db1d9b700 1 -- 172.21.15.45:0/3585917876 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da8011d20 con 0x7f3db40b05e0 2023-12-19T18:04:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 -- 172.21.15.45:0/3585917876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 msgr2=0x7f3db40b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 --2- 172.21.15.45:0/3585917876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40b0a40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f3da8009850 tx=0x7f3da8009b60 comp rx=0 tx=0).stop 2023-12-19T18:04:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 -- 172.21.15.45:0/3585917876 shutdown_connections 2023-12-19T18:04:20.258 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 --2- 172.21.15.45:0/3585917876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40b0a40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 -- 172.21.15.45:0/3585917876 >> 172.21.15.45:0/3585917876 conn(0x7f3db406a870 msgr2=0x7f3db40ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 -- 172.21.15.45:0/3585917876 shutdown_connections 2023-12-19T18:04:20.259 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.252+0000 7f3db925e700 1 -- 172.21.15.45:0/3585917876 wait complete. 2023-12-19T18:04:20.261 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 Processor -- start 2023-12-19T18:04:20.262 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 -- start start 2023-12-19T18:04:20.263 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:20.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db40b1f30 0x7f3db41f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:20.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 0x7f3db4158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:20.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db41f6b80 con 0x7f3db415b080 2023-12-19T18:04:20.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db415c0d0 con 0x7f3db40b05e0 2023-12-19T18:04:20.264 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db925e700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db415b7a0 con 0x7f3db40b1f30 2023-12-19T18:04:20.265 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 0x7f3db4158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db359e700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 0x7f3db4158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40600/0 (socket says 172.21.15.45:40600) 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db359e700 1 -- 172.21.15.45:0/80504703 learned_addr learned my addr 172.21.15.45:0/80504703 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.256+0000 7f3db2d9d700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db259c700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db40b1f30 0x7f3db41f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db359e700 1 -- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db40b1f30 msgr2=0x7f3db41f2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db359e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db40b1f30 0x7f3db41f2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.266 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db359e700 1 -- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 msgr2=0x7f3db40c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db359e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db359e700 1 -- 172.21.15.45:0/80504703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da80094b0 con 0x7f3db415b080 2023-12-19T18:04:20.267 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db359e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 0x7f3db4158cc0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00cc80 tx=0x7f3dac00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac003c20 con 0x7f3db415b080 2023-12-19T18:04:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac003d80 con 0x7f3db415b080 2023-12-19T18:04:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00aaa0 con 0x7f3db415b080 2023-12-19T18:04:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db415ba80 con 0x7f3db415b080 2023-12-19T18:04:20.268 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db40cbde0 con 0x7f3db415b080 2023-12-19T18:04:20.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.260+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db40cbf70 con 0x7f3db415b080 2023-12-19T18:04:20.269 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.264+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f3dac00ac00 con 0x7f3db415b080 2023-12-19T18:04:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.264+0000 7f3d9b7fe700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3da0065ad0 0x7f3da0067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:20.270 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.264+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f3dac082f70 con 0x7f3db415b080 2023-12-19T18:04:20.271 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.264+0000 7f3db2d9d700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3da0065ad0 0x7f3da0067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:20.272 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.264+0000 7f3db2d9d700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3da0065ad0 0x7f3da0067f90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000f60 tx=0x7f3da4004a70 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:20.278 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.272+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f3dac0b40a0 con 0x7f3db415b080 2023-12-19T18:04:20.451 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.444+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3db406d350 con 0x7f3da0065ad0 2023-12-19T18:04:20.457 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3d9b7fe700 1 -- 172.21.15.45:0/80504703 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47932 (secure 0 0 0) 0x7f3da40012a0 con 0x7f3da0065ad0 2023-12-19T18:04:20.458 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3da0065ad0 msgr2=0x7f3da0067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3da0065ad0 0x7f3da0067f90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f3da4000f60 tx=0x7f3da4004a70 comp rx=0 tx=0).stop 2023-12-19T18:04:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 msgr2=0x7f3db4158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 0x7f3db4158cc0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00cc80 tx=0x7f3dac00cf90 comp rx=0 tx=0).stop 2023-12-19T18:04:20.460 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 shutdown_connections 2023-12-19T18:04:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f3da0065ad0 0x7f3da0067f90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f3db415b080 0x7f3db4158cc0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.461 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f3db40b1f30 0x7f3db41f2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 --2- 172.21.15.45:0/80504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3db40b05e0 0x7f3db40c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 >> 172.21.15.45:0/80504703 conn(0x7f3db406a870 msgr2=0x7f3db415a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 shutdown_connections 2023-12-19T18:04:20.462 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:20.452+0000 7f3db925e700 1 -- 172.21.15.45:0/80504703 wait complete. 2023-12-19T18:04:20.463 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:04:20.488 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":513,"stamp":"2023-12-19T18:04:18.477524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":19,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":266724,"kb_used_data":14244,"kb_used_omap":0,"kb_used_meta":252416,"kb_avail":754707996,"statfs":{"total":773094113280,"available":772820987904,"internally_reserved":0,"allocated":14585856,"data_stored":7700589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258473984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-190,"num_objects":-100,"num_object_clones":0,"num_object_copies":-200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-100,"num_whiteouts":0,"num_read":-1100,"num_read_kb":-500,"num_write":-600,"num_write_kb":-100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.645527"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":284,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-19T18:04:08.841843+0000","last_change":"2023-12-19T17:51:28.236004+0000","last_active":"2023-12-19T18:04:08.841843+0000","last_peered":"2023-12-19T18:04:08.841843+0000","last_clean":"2023-12-19T18:04:08.841843+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:04:08.841843+0000","last_undegraded":"2023-12-19T18:04:08.841843+0000","last_fullsized":"2023-12-19T18:04:08.841843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-19T17:51:27.129512+0000","last_clean_scrub_stamp":"2023-12-19T17:51:27.129512+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:30:01.689986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2269184,"data_stored":1405477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.228,"15min":1.1259999999999999},"min":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":0.63200000000000001},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.302,"15min":1.1870000000000001},"min":{"1min":0.71299999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.512,"5min":13.249000000000001,"15min":13.249000000000001},"last":0.76600000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.179,"15min":1.099},"min":{"1min":0.63600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4470000000000001,"5min":12.625,"15min":12.625},"last":1.321},{"interface":"front","average":{"1min":1.056,"5min":1.1819999999999999,"15min":1.131},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.52600000000000002},"max":{"1min":1.3220000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":0.97399999999999998}]},{"osd":2,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1759999999999999,"15min":1.093},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.353,"5min":13.041,"15min":13.041},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.016,"5min":1.5820000000000001,"15min":1.28},"min":{"1min":0.74199999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.278,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.2250000000000001}]},{"osd":3,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2569999999999999,"15min":1.167},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":12.917,"15min":12.917},"last":1.004},{"interface":"front","average":{"1min":1.244,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":0.90000000000000002,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":46.375,"15min":46.375},"last":1.3879999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2629999999999999,"15min":1.204},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4259999999999999,"5min":13.137,"15min":13.137},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.363,"15min":1.298},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.47499999999999998},"max":{"1min":1.407,"5min":13.109,"15min":13.109},"last":1.1220000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.292,"15min":1.238},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5349999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.4530000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.333,"15min":1.2809999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.651,"5min":13.198,"15min":13.198},"last":0.89100000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4990000000000001,"15min":1.415},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7929999999999999,"5min":13.442,"15min":13.442},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4450000000000001,"15min":1.359},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.52700000000000002},"max":{"1min":1.667,"5min":13.981,"15min":13.981},"last":1.0629999999999999}]}]},{"osd":6,"up_from":13,"seq":55834575005,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0089999999999999,"15min":1.0780000000000001},"min":{"1min":0.69099999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.331,"5min":1.399,"15min":4.5979999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.069},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5860000000000001,"5min":1.756,"15min":1.756},"last":1.226}]},{"osd":1,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.095,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.325,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.1080000000000001},"min":{"1min":0.77700000000000002,"5min":0.63800000000000001,"15min":0.48099999999999998},"max":{"1min":1.2929999999999999,"5min":1.583,"15min":1.621},"last":1.107}]},{"osd":2,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.131,"15min":1.2529999999999999},"min":{"1min":0.77700000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4510000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1950000000000001,"15min":1.206},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.492,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.3899999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1799999999999999,"15min":1.2390000000000001},"min":{"1min":0.85299999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.55,"5min":1.651,"15min":4.5380000000000003},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.262,"5min":1.224,"15min":1.278},"min":{"1min":0.94299999999999995,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":4.508},"last":1.014}]},{"osd":4,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.2330000000000001,"5min":1.577,"15min":1.8360000000000001},"last":1.3},{"interface":"front","average":{"1min":1.28,"5min":1.23,"15min":1.238},"min":{"1min":0.90800000000000003,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.6819999999999999,"5min":1.802,"15min":1.899},"last":1.603}]},{"osd":5,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2609999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.579,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.94399999999999995,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.615,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.4370000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.73},{"interface":"front","average":{"1min":1.357,"5min":1.3779999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.7609999999999999,"5min":1.841,"15min":2.2440000000000002},"last":1.635}]}]},{"osd":5,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.026,"15min":1.004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54600000000000004},"max":{"1min":1.3,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.0609999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.73,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":0.64300000000000002}]},{"osd":1,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.117},"min":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.591,"5min":1.974,"15min":1.974},"last":1.607},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.84199999999999997,"5min":0.752,"15min":0.65500000000000003},"max":{"1min":1.7709999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.1160000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.70999999999999996,"5min":0.65700000000000003,"15min":0.45500000000000002},"max":{"1min":1.397,"5min":1.891,"15min":2.9929999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.123,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5229999999999999,"5min":2.024,"15min":2.024},"last":1.544}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.2250000000000001},"min":{"1min":0.89200000000000002,"5min":0.75,"15min":0.64500000000000002},"max":{"1min":1.73,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.90900000000000003,"5min":0.73799999999999999,"15min":0.63500000000000001},"max":{"1min":1.6160000000000001,"5min":1.829,"15min":3.0350000000000001},"last":1.204}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.704,"5min":3.633,"15min":3.633},"last":1.381},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3049999999999999,"15min":1.335},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.745},"max":{"1min":1.9370000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.51}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.256,"15min":1.3080000000000001},"min":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.7310000000000001,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":1.589},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.82899999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.802,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.661}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.333,"15min":1.395},"min":{"1min":0.88,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.992,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.3380000000000001},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.387,"15min":1.4630000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.82499999999999996},"max":{"1min":1.895,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.4219999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0960000000000001,"15min":1.159},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.423,"5min":1.556,"15min":5.4420000000000002},"last":1.125},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.196,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.52,"5min":1.657,"15min":5.5049999999999999},"last":1.2829999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.75800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4359999999999999,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":1.4570000000000001},{"interface":"front","average":{"1min":1.099,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.349,"5min":1.5589999999999999,"15min":3.254},"last":1.0640000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.071,"15min":1.173},"min":{"1min":0.86799999999999999,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.2889999999999999,"5min":1.623,"15min":4.593},"last":1.323},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.175,"15min":1.198},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.619,"5min":1.871,"15min":2.3799999999999999},"last":1.173}]},{"osd":3,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.137,"15min":1.1910000000000001},"min":{"1min":0.73599999999999999,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.504,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.181,"5min":1.21,"15min":1.294},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.63300000000000001},"max":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":5.633},"last":0.88600000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1899999999999999,"15min":1.2010000000000001},"min":{"1min":0.83199999999999996,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.595,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.258,"5min":1.177,"15min":1.1719999999999999},"min":{"1min":0.73399999999999999,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.157},"last":0.95899999999999996}]},{"osd":6,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2330000000000001,"15min":1.248},"min":{"1min":0.85599999999999998,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.482,"5min":1.6910000000000001,"15min":2.915},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.389,"15min":1.399},"min":{"1min":0.82199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.508}]},{"osd":7,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.29,"15min":1.306},"min":{"1min":0.80400000000000005,"5min":0.72799999999999998,"15min":0.56899999999999995},"max":{"1min":1.7370000000000001,"5min":1.907,"15min":2.4340000000000002},"last":1.2150000000000001},{"interface":"front","average":{"1min":1.329,"5min":1.353,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.88500000000000001,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":1.833,"15min":5.6859999999999999},"last":1.415}]}]},{"osd":3,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.64400000000000002,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.93000000000000005,"15min":0.91500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6259999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":0.69899999999999995}]},{"osd":1,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":0.96399999999999997,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":0.93300000000000005},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.093,"15min":1.0449999999999999},"min":{"1min":0.65900000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.755}]},{"osd":2,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.1599999999999999,"15min":1.117},"min":{"1min":0.69399999999999995,"5min":0.59099999999999997,"15min":0.52200000000000002},"max":{"1min":8.9290000000000003,"5min":8.9290000000000003,"15min":8.9290000000000003},"last":1.177},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.198,"15min":1.2},"min":{"1min":0.85699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.1539999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1759999999999999,"15min":1.198},"min":{"1min":0.76600000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.698,"5min":1.7310000000000001,"15min":2.234},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.651,"5min":1.375,"15min":1.321},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.70299999999999996},"max":{"1min":7.1890000000000001,"5min":7.1890000000000001,"15min":7.1890000000000001},"last":1.323}]},{"osd":5,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.381,"15min":1.371},"min":{"1min":0.94699999999999995,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.284,"15min":1.3069999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7310000000000001,"5min":1.776,"15min":2.754},"last":1.022}]},{"osd":6,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.411,"15min":1.3919999999999999},"min":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":7.4189999999999996,"5min":7.4189999999999996,"15min":7.4189999999999996},"last":1.097},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4379999999999999,"15min":1.4410000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.0449999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3700000000000001,"15min":1.3899999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7330000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.204},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.506,"15min":1.4830000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.83099999999999996},"max":{"1min":8.8889999999999993,"5min":8.8889999999999993,"15min":8.8889999999999993},"last":1.23}]}]},{"osd":2,"up_from":13,"seq":55834575005,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.91100000000000003,"15min":1.0669999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.29599999999999999},"max":{"1min":1.224,"5min":3.9209999999999998,"15min":13.32},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.1699999999999999},"min":{"1min":0.59699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3100000000000001,"5min":3.8149999999999999,"15min":13.206},"last":0.97299999999999998}]},{"osd":1,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.94599999999999995,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.284,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.022,"5min":0.98899999999999999,"15min":0.98499999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6950000000000001,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":0.81599999999999995}]},{"osd":3,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.617,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.103,"5min":1.161,"15min":1.179},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":2.75,"15min":2.75},"last":1.25}]},{"osd":4,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2589999999999999,"15min":1.248},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.151},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.27},"min":{"1min":0.875,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.4370000000000001,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.3100000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.228,"15min":1.252},"min":{"1min":0.94099999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.504,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3,"5min":1.341,"15min":1.3859999999999999},"min":{"1min":0.96999999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.6739999999999999,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.3919999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.90500000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.679,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.492},{"interface":"front","average":{"1min":1.224,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.91500000000000004,"15min":0.872},"max":{"1min":1.4850000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.4490000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4199999999999999,"15min":1.419},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.627,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.429},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3700000000000001,"15min":1.3779999999999999},"min":{"1min":0.97399999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.698,"5min":5.375,"15min":5.375},"last":1.5209999999999999}]}]},{"osd":1,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.42399999999999999},"max":{"1min":1.387,"5min":1.671,"15min":1.931},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.96199999999999997,"15min":0.97799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3240000000000001,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":0.81200000000000006}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83499999999999996,"15min":0.89800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.292,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.997,"15min":1.048},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":3.4199999999999999},"last":0.66900000000000004}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.109,"15min":1.167},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":3.4950000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95799999999999996,"15min":1.0620000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":4.2030000000000003},"last":1.206}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.278,"15min":1.3320000000000001},"min":{"1min":0.871,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.891,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.123},{"interface":"front","average":{"1min":1.232,"5min":1.226,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56999999999999995},"max":{"1min":1.736,"5min":1.736,"15min":2.6960000000000002},"last":1.478}]},{"osd":5,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.69599999999999995},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":2.9249999999999998},"last":1.6459999999999999},{"interface":"front","average":{"1min":1.381,"5min":1.3180000000000001,"15min":1.3899999999999999},"min":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.69399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":3.8420000000000001},"last":1.105}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.333,"15min":1.425},"min":{"1min":1.0249999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9990000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.4470000000000001},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.4390000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72899999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":3.214},"last":1.577}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.379,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.254,"5min":2.254,"15min":4.0910000000000002},"last":1.377},{"interface":"front","average":{"1min":1.353,"5min":1.337,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":4.6390000000000002},"last":1.3420000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575005,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1404458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88900000000000001,"15min":0.93300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46700000000000003},"max":{"1min":1.3740000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.012,"5min":0.97299999999999998,"15min":1.056},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":1.335,"5min":1.73,"15min":2.3599999999999999},"last":1.496}]},{"osd":2,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88300000000000001,"15min":0.93000000000000005},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.242,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.93400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":1.607}]},{"osd":3,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.95699999999999996,"15min":0.97699999999999998},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.196,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":1.6100000000000001,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.137}]},{"osd":4,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.282,"15min":1.3109999999999999},"min":{"1min":0.89400000000000002,"5min":0.79700000000000004,"15min":0.69899999999999995},"max":{"1min":1.645,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.85999999999999999,"5min":0.71599999999999997,"15min":0.68999999999999995},"max":{"1min":1.605,"5min":1.738,"15min":2.7799999999999998},"last":1.379}]},{"osd":5,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.76300000000000001},"max":{"1min":1.421,"5min":1.758,"15min":2.0579999999999998},"last":1.169},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.294,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.306}]},{"osd":6,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.1000000000000001},"last":1.071},{"interface":"front","average":{"1min":1.28,"5min":1.2769999999999999,"15min":1.3540000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.978,"5min":1.978,"15min":2.3889999999999998},"last":1.5549999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.454},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":4.9400000000000004},"last":1.6599999999999999},{"interface":"front","average":{"1min":1.206,"5min":1.321,"15min":1.423},"min":{"1min":0.92100000000000004,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.5309999999999999,"5min":1.875,"15min":4.8250000000000002},"last":1.4610000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:04:20.492 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-19T17:51:27.129512+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=17, tm_min=51, tm_sec=27, tm_wday=1, tm_yday=353, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=19, tm_hour=18, tm_min=4, tm_sec=13, tm_wday=1, tm_yday=353, tm_isdst=0) 2023-12-19T18:04:20.492 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-19T18:04:32.394 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:04:32.401 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:04:40.493 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-19T18:04:40.685 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 Processor -- start 2023-12-19T18:04:40.686 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 -- start start 2023-12-19T18:04:40.687 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f627c15b080 0x7f627c0c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f627c0b05e0 0x7f627c0b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f627c0b0f80 con 0x7f627c070640 2023-12-19T18:04:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c15b460 con 0x7f627c0b05e0 2023-12-19T18:04:40.688 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f62816ee700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f627c0b2f40 con 0x7f627c15b080 2023-12-19T18:04:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f6273fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f627c0b05e0 0x7f627c0b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f6273fff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f627c0b05e0 0x7f627c0b0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40040/0 (socket says 172.21.15.45:40040) 2023-12-19T18:04:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.679+0000 7f6273fff700 1 -- 172.21.15.45:0/2001114351 learned_addr learned my addr 172.21.15.45:0/2001114351 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:40.689 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f627affd700 1 --2- 172.21.15.45:0/2001114351 >> v2:172.21.15.73:3300/0 conn(0x7f627c15b080 0x7f627c0c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:40.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f6273fff700 1 -- 172.21.15.45:0/2001114351 >> v2:172.21.15.73:3300/0 conn(0x7f627c15b080 msgr2=0x7f627c0c9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:40.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f6273fff700 1 --2- 172.21.15.45:0/2001114351 >> v2:172.21.15.73:3300/0 conn(0x7f627c15b080 0x7f627c0c9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f6273fff700 1 -- 172.21.15.45:0/2001114351 >> v1:172.21.15.73:6789/0 conn(0x7f627c070640 legacy=0x7f627c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:40.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f6273fff700 1 -- 172.21.15.45:0/2001114351 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c0cf5f0 con 0x7f627c0b05e0 2023-12-19T18:04:40.690 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f6273fff700 1 --2- 172.21.15.45:0/2001114351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0b05e0 0x7f627c0b0a40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f627c0cea10 tx=0x7f6264009bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce2c11e226243da server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:40.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f627a7fc700 1 -- 172.21.15.45:0/2001114351 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400b8a0 con 0x7f627c0b05e0 2023-12-19T18:04:40.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f627a7fc700 1 -- 172.21.15.45:0/2001114351 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f626400ba00 con 0x7f627c0b05e0 2023-12-19T18:04:40.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f627a7fc700 1 -- 172.21.15.45:0/2001114351 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f626400bd90 con 0x7f627c0b05e0 2023-12-19T18:04:40.691 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 -- 172.21.15.45:0/2001114351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0b05e0 msgr2=0x7f627c0b0a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 --2- 172.21.15.45:0/2001114351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0b05e0 0x7f627c0b0a40 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f627c0cea10 tx=0x7f6264009bf0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 -- 172.21.15.45:0/2001114351 shutdown_connections 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 --2- 172.21.15.45:0/2001114351 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c0b05e0 0x7f627c0b0a40 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 --2- 172.21.15.45:0/2001114351 >> v2:172.21.15.73:3300/0 conn(0x7f627c15b080 0x7f627c0c9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 -- 172.21.15.45:0/2001114351 >> 172.21.15.45:0/2001114351 conn(0x7f627c06a870 msgr2=0x7f627c0ceb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 -- 172.21.15.45:0/2001114351 shutdown_connections 2023-12-19T18:04:40.692 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.683+0000 7f62816ee700 1 -- 172.21.15.45:0/2001114351 wait complete. 2023-12-19T18:04:40.694 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 Processor -- start 2023-12-19T18:04:40.695 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 -- start start 2023-12-19T18:04:40.696 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f627c070640 0x7f627c0c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f627c0b05e0 0x7f627c1f3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 0x7f627c15da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c0adc90 con 0x7f627c15b080 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c15c670 con 0x7f627c0b05e0 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.687+0000 7f62816ee700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f627c1f35b0 con 0x7f627c070640 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 0x7f627c15da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:40.697 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 0x7f627c15da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40044/0 (socket says 172.21.15.45:40044) 2023-12-19T18:04:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 -- 172.21.15.45:0/1293601160 learned_addr learned my addr 172.21.15.45:0/1293601160 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627affd700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f627c070640 0x7f627c0c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:40.698 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f6273fff700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f627c0b05e0 0x7f627c1f3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 -- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f627c070640 msgr2=0x7f627c0c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f627c070640 0x7f627c0c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 -- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f627c0b05e0 msgr2=0x7f627c1f3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f627c0b05e0 0x7f627c1f3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.699 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 -- 172.21.15.45:0/1293601160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6264009570 con 0x7f627c15b080 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f627b7fe700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 0x7f627c15da90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f627400cc80 tx=0x7f627400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274003c20 con 0x7f627c15b080 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6274003d80 con 0x7f627c15b080 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627400aaa0 con 0x7f627c15b080 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c15cb00 con 0x7f627c15b080 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c15bd40 con 0x7f627c15b080 2023-12-19T18:04:40.700 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.691+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c15c820 con 0x7f627c15b080 2023-12-19T18:04:40.701 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.695+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f627400ac00 con 0x7f627c15b080 2023-12-19T18:04:40.702 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.695+0000 7f62737fe700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f625c065ad0 0x7f625c067f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:40.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.695+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f6274082f70 con 0x7f627c15b080 2023-12-19T18:04:40.703 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.695+0000 7f627affd700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f625c065ad0 0x7f625c067f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:40.704 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.695+0000 7f627affd700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f625c065ad0 0x7f625c067f90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f627c0c99a0 tx=0x7f626c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:40.711 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.703+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f62740b40a0 con 0x7f627c15b080 2023-12-19T18:04:40.888 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.879+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 --> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f627c06d070 con 0x7f625c065ad0 2023-12-19T18:04:40.892 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62737fe700 1 -- 172.21.15.45:0/1293601160 <== mgr.4104 v2:172.21.15.45:6832/36158 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47871 (secure 0 0 0) 0x7f626c0076f0 con 0x7f625c065ad0 2023-12-19T18:04:40.893 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:40.895 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f625c065ad0 msgr2=0x7f625c067f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f625c065ad0 0x7f625c067f90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f627c0c99a0 tx=0x7f626c008040 comp rx=0 tx=0).stop 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 msgr2=0x7f627c15da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 0x7f627c15da90 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f627400cc80 tx=0x7f627400cf90 comp rx=0 tx=0).stop 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 shutdown_connections 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f625c065ad0 0x7f625c067f90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f627c15b080 0x7f627c15da90 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f627c0b05e0 0x7f627c1f3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 --2- 172.21.15.45:0/1293601160 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f627c070640 0x7f627c0c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:40.896 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 >> 172.21.15.45:0/1293601160 conn(0x7f627c06a870 msgr2=0x7f627c070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 shutdown_connections 2023-12-19T18:04:40.897 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:40.887+0000 7f62816ee700 1 -- 172.21.15.45:0/1293601160 wait complete. 2023-12-19T18:04:40.898 INFO:teuthology.orchestra.run.smithi045.stderr:dumped all 2023-12-19T18:04:40.920 INFO:teuthology.orchestra.run.smithi045.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2023-12-19T18:04:40.483550+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":266724,"kb_used_data":14244,"kb_used_omap":0,"kb_used_meta":252416,"kb_avail":754707996,"statfs":{"total":773094113280,"available":772820987904,"internally_reserved":0,"allocated":14585856,"data_stored":7700589,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":258473984},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"1.0","version":"134'119","reported_seq":298,"reported_epoch":134,"state":"active+clean","last_fresh":"2023-12-19T18:04:24.994258+0000","last_change":"2023-12-19T18:04:24.994456+0000","last_active":"2023-12-19T18:04:24.994258+0000","last_peered":"2023-12-19T18:04:24.994258+0000","last_clean":"2023-12-19T18:04:24.994258+0000","last_became_active":"2023-12-19T17:51:28.234149+0000","last_became_peered":"2023-12-19T17:51:28.234149+0000","last_unstale":"2023-12-19T18:04:24.994258+0000","last_undegraded":"2023-12-19T18:04:24.994258+0000","last_fullsized":"2023-12-19T18:04:24.994258+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"134'119","last_scrub_stamp":"2023-12-19T18:04:24.994226+0000","last_deep_scrub":"134'119","last_deep_scrub_stamp":"2023-12-19T18:04:24.994226+0000","last_clean_scrub_stamp":"2023-12-19T18:04:24.994226+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:08:50.899535+0000","scrub_duration":0.01524908,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2216,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2269184,"data_stored":1405477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1879999999999999,"5min":1.228,"15min":1.1259999999999999},"min":{"1min":0.68200000000000005,"5min":0.66800000000000004,"15min":0.55000000000000004},"max":{"1min":1.5029999999999999,"5min":8.3209999999999997,"15min":8.3209999999999997},"last":1.413},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.302,"15min":1.1870000000000001},"min":{"1min":0.71299999999999997,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.512,"5min":13.249000000000001,"15min":13.249000000000001},"last":1.115}]},{"osd":1,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.179,"15min":1.099},"min":{"1min":0.63600000000000001,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.4470000000000001,"5min":12.625,"15min":12.625},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.1819999999999999,"15min":1.131},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.52600000000000002},"max":{"1min":1.3220000000000001,"5min":13.337999999999999,"15min":13.337999999999999},"last":1.2490000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.014,"5min":1.1759999999999999,"15min":1.093},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.353,"5min":13.041,"15min":13.041},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.016,"5min":1.5820000000000001,"15min":1.28},"min":{"1min":0.74199999999999999,"5min":0.68000000000000005,"15min":0.65300000000000002},"max":{"1min":1.278,"5min":48.889000000000003,"15min":48.889000000000003},"last":1.331}]},{"osd":3,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.2569999999999999,"15min":1.167},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.51600000000000001},"max":{"1min":1.3759999999999999,"5min":12.917,"15min":12.917},"last":1.27},{"interface":"front","average":{"1min":1.244,"5min":1.7050000000000001,"15min":1.371},"min":{"1min":0.90000000000000002,"5min":0.85999999999999999,"15min":0.64200000000000002},"max":{"1min":1.5529999999999999,"5min":46.375,"15min":46.375},"last":1.2110000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.2629999999999999,"15min":1.204},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4259999999999999,"5min":13.137,"15min":13.137},"last":0.95999999999999996},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.363,"15min":1.298},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.47499999999999998},"max":{"1min":1.407,"5min":13.109,"15min":13.109},"last":1.179}]},{"osd":5,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.165,"5min":1.292,"15min":1.238},"min":{"1min":0.66100000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.5349999999999999,"5min":8.2690000000000001,"15min":8.2690000000000001},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.333,"15min":1.2809999999999999},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.651,"5min":13.198,"15min":13.198},"last":1.302}]},{"osd":6,"last update":"Tue Dec 19 18:03:55 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.4990000000000001,"15min":1.415},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.7929999999999999,"5min":13.442,"15min":13.442},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.4450000000000001,"15min":1.359},"min":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.52700000000000002},"max":{"1min":1.667,"5min":13.981,"15min":13.981},"last":1.452}]}]},{"osd":6,"up_from":13,"seq":55834575009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.0089999999999999,"15min":1.0780000000000001},"min":{"1min":0.69099999999999995,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.331,"5min":1.399,"15min":4.5979999999999999},"last":1.069},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.069},"min":{"1min":0.55100000000000005,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.5860000000000001,"5min":1.756,"15min":1.756},"last":1.2490000000000001}]},{"osd":1,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.095,"15min":1.085},"min":{"1min":0.75800000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.325,"5min":1.5469999999999999,"15min":2.2109999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0860000000000001,"15min":1.1080000000000001},"min":{"1min":0.77700000000000002,"5min":0.63800000000000001,"15min":0.48099999999999998},"max":{"1min":1.2929999999999999,"5min":1.583,"15min":1.621},"last":1.3720000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.131,"15min":1.2529999999999999},"min":{"1min":0.77700000000000002,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.4510000000000001,"5min":1.5580000000000001,"15min":8.5470000000000006},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.1950000000000001,"15min":1.206},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.492,"5min":1.7190000000000001,"15min":4.6340000000000003},"last":1.0109999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.2210000000000001,"5min":1.1799999999999999,"15min":1.2390000000000001},"min":{"1min":0.85299999999999998,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.55,"5min":1.651,"15min":4.5380000000000003},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.262,"5min":1.224,"15min":1.278},"min":{"1min":0.94299999999999995,"5min":0.76700000000000002,"15min":0.65300000000000002},"max":{"1min":1.679,"5min":1.679,"15min":4.508},"last":1.1060000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.1240000000000001,"15min":1.1319999999999999},"min":{"1min":0.59999999999999998,"5min":0.58599999999999997,"15min":0.438},"max":{"1min":1.2330000000000001,"5min":1.577,"15min":1.8360000000000001},"last":1.288},{"interface":"front","average":{"1min":1.28,"5min":1.23,"15min":1.238},"min":{"1min":0.90800000000000003,"5min":0.72899999999999998,"15min":0.70299999999999996},"max":{"1min":1.6819999999999999,"5min":1.802,"15min":1.899},"last":1.339}]},{"osd":5,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.26,"5min":1.2609999999999999,"15min":1.2569999999999999},"min":{"1min":0.84099999999999997,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.579,"5min":1.7529999999999999,"15min":2.1400000000000001},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"min":{"1min":0.94399999999999995,"5min":0.68000000000000005,"15min":0.57299999999999995},"max":{"1min":1.615,"5min":1.8320000000000001,"15min":1.9239999999999999},"last":1.2050000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:50 2023","interfaces":[{"interface":"back","average":{"1min":1.3660000000000001,"5min":1.351,"15min":1.3520000000000001},"min":{"1min":0.81000000000000005,"5min":0.80200000000000005,"15min":0.59999999999999998},"max":{"1min":1.6080000000000001,"5min":1.8680000000000001,"15min":1.8680000000000001},"last":1.135},{"interface":"front","average":{"1min":1.357,"5min":1.3779999999999999,"15min":1.3899999999999999},"min":{"1min":0.93700000000000006,"5min":0.89600000000000002,"15min":0.81200000000000006},"max":{"1min":1.7609999999999999,"5min":1.841,"15min":2.2440000000000002},"last":1.167}]}]},{"osd":5,"up_from":13,"seq":55834575009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96999999999999997,"5min":1.026,"15min":1.004},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.54600000000000004},"max":{"1min":1.3,"5min":2.2959999999999998,"15min":2.2959999999999998},"last":1.0269999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0920000000000001,"15min":1.0609999999999999},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.73,"5min":2.5990000000000002,"15min":2.9369999999999998},"last":1.413}]},{"osd":1,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.1459999999999999,"15min":1.117},"min":{"1min":0.68899999999999995,"5min":0.67300000000000004,"15min":0.64500000000000002},"max":{"1min":1.591,"5min":1.974,"15min":1.974},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1659999999999999,"15min":1.1759999999999999},"min":{"1min":0.84199999999999997,"5min":0.752,"15min":0.65500000000000003},"max":{"1min":1.7709999999999999,"5min":2.1379999999999999,"15min":2.1379999999999999},"last":1.1890000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.1180000000000001,"15min":1.1299999999999999},"min":{"1min":0.70999999999999996,"5min":0.65700000000000003,"15min":0.45500000000000002},"max":{"1min":1.397,"5min":1.891,"15min":2.9929999999999999},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.1240000000000001,"15min":1.1279999999999999},"min":{"1min":0.86499999999999999,"5min":0.76100000000000001,"15min":0.52500000000000002},"max":{"1min":1.5229999999999999,"5min":2.024,"15min":2.024},"last":0.92600000000000005}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.236,"5min":1.206,"15min":1.2250000000000001},"min":{"1min":0.89200000000000002,"5min":0.75,"15min":0.64500000000000002},"max":{"1min":1.73,"5min":2.1800000000000002,"15min":2.2410000000000001},"last":1.276},{"interface":"front","average":{"1min":1.3,"5min":1.284,"15min":1.3029999999999999},"min":{"1min":0.90900000000000003,"5min":0.73799999999999999,"15min":0.63500000000000001},"max":{"1min":1.6160000000000001,"5min":1.829,"15min":3.0350000000000001},"last":1.3620000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2,"15min":1.238},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.67100000000000004},"max":{"1min":1.704,"5min":3.633,"15min":3.633},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.3049999999999999,"15min":1.335},"min":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.745},"max":{"1min":1.9370000000000001,"5min":2.4020000000000001,"15min":3.2589999999999999},"last":1.0900000000000001}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.256,"15min":1.3080000000000001},"min":{"1min":0.71099999999999997,"5min":0.64200000000000002,"15min":0.60499999999999998},"max":{"1min":1.7310000000000001,"5min":1.9379999999999999,"15min":3.3010000000000002},"last":0.98099999999999998},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.2629999999999999,"15min":1.2989999999999999},"min":{"1min":0.82899999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":1.802,"5min":2.0739999999999998,"15min":2.3239999999999998},"last":1.1419999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3520000000000001,"5min":1.333,"15min":1.395},"min":{"1min":0.88,"5min":0.85599999999999998,"15min":0.72299999999999998},"max":{"1min":1.992,"5min":2.2200000000000002,"15min":3.1099999999999999},"last":1.1299999999999999},{"interface":"front","average":{"1min":1.3540000000000001,"5min":1.387,"15min":1.4630000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.82499999999999996},"max":{"1min":1.895,"5min":2.5270000000000001,"15min":3.5680000000000001},"last":1.298}]}]},{"osd":4,"up_from":13,"seq":55834575009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.0960000000000001,"15min":1.159},"min":{"1min":0.63100000000000001,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.423,"5min":1.556,"15min":5.4420000000000002},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.1499999999999999,"5min":1.196,"15min":1.236},"min":{"1min":0.75700000000000001,"5min":0.67600000000000005,"15min":0.53500000000000003},"max":{"1min":1.52,"5min":1.657,"15min":5.5049999999999999},"last":1.1579999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.1319999999999999,"15min":1.169},"min":{"1min":0.75800000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.4359999999999999,"5min":1.5920000000000001,"15min":4.6379999999999999},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.099,"5min":1.0760000000000001,"15min":1.1499999999999999},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.349,"5min":1.5589999999999999,"15min":3.254},"last":1.4750000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.05,"5min":1.071,"15min":1.173},"min":{"1min":0.86799999999999999,"5min":0.628,"15min":0.58099999999999996},"max":{"1min":1.2889999999999999,"5min":1.623,"15min":4.593},"last":0.91900000000000004},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.175,"15min":1.198},"min":{"1min":0.90600000000000003,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.619,"5min":1.871,"15min":2.3799999999999999},"last":1.2729999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.149,"5min":1.137,"15min":1.1910000000000001},"min":{"1min":0.73599999999999999,"5min":0.73099999999999998,"15min":0.49199999999999999},"max":{"1min":1.504,"5min":1.7789999999999999,"15min":5.4610000000000003},"last":1.677},{"interface":"front","average":{"1min":1.181,"5min":1.21,"15min":1.294},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.63300000000000001},"max":{"1min":1.5629999999999999,"5min":1.5840000000000001,"15min":5.633},"last":1.214}]},{"osd":5,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.1899999999999999,"15min":1.2010000000000001},"min":{"1min":0.83199999999999996,"5min":0.58599999999999997,"15min":0.52600000000000002},"max":{"1min":1.595,"5min":1.6559999999999999,"15min":2.5649999999999999},"last":1.369},{"interface":"front","average":{"1min":1.258,"5min":1.177,"15min":1.1719999999999999},"min":{"1min":0.73399999999999999,"5min":0.63900000000000001,"15min":0.63800000000000001},"max":{"1min":1.667,"5min":1.667,"15min":2.157},"last":1.7589999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.2150000000000001,"5min":1.2330000000000001,"15min":1.248},"min":{"1min":0.85599999999999998,"5min":0.76100000000000001,"15min":0.54900000000000004},"max":{"1min":1.482,"5min":1.6910000000000001,"15min":2.915},"last":1.323},{"interface":"front","average":{"1min":1.3600000000000001,"5min":1.389,"15min":1.399},"min":{"1min":0.82199999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.6830000000000001,"5min":1.9390000000000001,"15min":2.5299999999999998},"last":1.4410000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:48 2023","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.29,"15min":1.306},"min":{"1min":0.80400000000000005,"5min":0.72799999999999998,"15min":0.56899999999999995},"max":{"1min":1.7370000000000001,"5min":1.907,"15min":2.4340000000000002},"last":1.583},{"interface":"front","average":{"1min":1.329,"5min":1.353,"15min":1.365},"min":{"1min":0.97799999999999998,"5min":0.88500000000000001,"15min":0.63600000000000001},"max":{"1min":1.7330000000000001,"5min":1.833,"15min":5.6859999999999999},"last":1.401}]}]},{"osd":3,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.85699999999999998,"15min":0.876},"min":{"1min":0.64400000000000002,"5min":0.44600000000000001,"15min":0.37},"max":{"1min":3.2719999999999998,"5min":3.2719999999999998,"15min":3.2719999999999998},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.93000000000000005,"15min":0.91500000000000004},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.6259999999999999,"5min":1.7390000000000001,"15min":2.9340000000000002},"last":1.1359999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":0.96399999999999997,"15min":0.92900000000000005},"min":{"1min":0.53900000000000003,"5min":0.438,"15min":0.438},"max":{"1min":7.3789999999999996,"5min":7.3789999999999996,"15min":7.3789999999999996},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.1639999999999999,"5min":1.093,"15min":1.0449999999999999},"min":{"1min":0.65900000000000003,"5min":0.311,"15min":0.311},"max":{"1min":3.3100000000000001,"5min":3.3100000000000001,"15min":3.3100000000000001},"last":0.84199999999999997}]},{"osd":2,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.534,"5min":1.1599999999999999,"15min":1.117},"min":{"1min":0.69399999999999995,"5min":0.59099999999999997,"15min":0.52200000000000002},"max":{"1min":8.9290000000000003,"5min":8.9290000000000003,"15min":8.9290000000000003},"last":1.1779999999999999},{"interface":"front","average":{"1min":1.2849999999999999,"5min":1.198,"15min":1.2},"min":{"1min":0.85699999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":3.2320000000000002,"5min":3.2320000000000002,"15min":3.2320000000000002},"last":1.1919999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":1.1759999999999999,"15min":1.198},"min":{"1min":0.76600000000000001,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.698,"5min":1.7310000000000001,"15min":2.234},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.651,"5min":1.375,"15min":1.321},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.70299999999999996},"max":{"1min":7.1890000000000001,"5min":7.1890000000000001,"15min":7.1890000000000001},"last":1.2250000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.381,"15min":1.371},"min":{"1min":0.94699999999999995,"5min":0.83099999999999996,"15min":0.80200000000000005},"max":{"1min":4.258,"5min":4.258,"15min":4.258},"last":1.282},{"interface":"front","average":{"1min":1.3100000000000001,"5min":1.284,"15min":1.3069999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.7310000000000001,"5min":1.776,"15min":2.754},"last":1.454}]},{"osd":6,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.411,"15min":1.3919999999999999},"min":{"1min":0.84699999999999998,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":7.4189999999999996,"5min":7.4189999999999996,"15min":7.4189999999999996},"last":1.552},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4379999999999999,"15min":1.4410000000000001},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":3.383,"5min":3.383,"15min":3.383},"last":1.3380000000000001}]},{"osd":7,"last update":"Tue Dec 19 18:03:52 2023","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3700000000000001,"15min":1.3899999999999999},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.7330000000000001,"5min":1.9730000000000001,"15min":3.02},"last":1.3200000000000001},{"interface":"front","average":{"1min":1.8480000000000001,"5min":1.506,"15min":1.4830000000000001},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.83099999999999996},"max":{"1min":8.8889999999999993,"5min":8.8889999999999993,"15min":8.8889999999999993},"last":1.484}]}]},{"osd":2,"up_from":13,"seq":55834575009,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.91100000000000003,"15min":1.0669999999999999},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.29599999999999999},"max":{"1min":1.224,"5min":3.9209999999999998,"15min":13.32},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.98399999999999999,"15min":1.1699999999999999},"min":{"1min":0.59699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.3100000000000001,"5min":3.8149999999999999,"15min":13.206},"last":1.1259999999999999}]},{"osd":1,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.94599999999999995,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.55500000000000005,"15min":0.47699999999999998},"max":{"1min":1.284,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":0.82399999999999995},{"interface":"front","average":{"1min":1.022,"5min":0.98899999999999999,"15min":0.98499999999999999},"min":{"1min":0.63300000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.6950000000000001,"5min":3.6579999999999999,"15min":3.6579999999999999},"last":1.4279999999999999}]},{"osd":3,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94599999999999995,"15min":0.95299999999999996},"min":{"1min":0.54900000000000004,"5min":0.48799999999999999,"15min":0.45800000000000002},"max":{"1min":1.617,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":0.79800000000000004},{"interface":"front","average":{"1min":1.103,"5min":1.161,"15min":1.179},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.504},"max":{"1min":1.6479999999999999,"5min":2.75,"15min":2.75},"last":1.1759999999999999}]},{"osd":4,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2250000000000001,"5min":1.2589999999999999,"15min":1.248},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.72699999999999998},"max":{"1min":1.5329999999999999,"5min":3.8359999999999999,"15min":3.8359999999999999},"last":1.252},{"interface":"front","average":{"1min":1.22,"5min":1.286,"15min":1.27},"min":{"1min":0.875,"5min":0.75700000000000001,"15min":0.75700000000000001},"max":{"1min":1.4370000000000001,"5min":8.5990000000000002,"15min":8.5990000000000002},"last":1.224}]},{"osd":5,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1619999999999999,"5min":1.228,"15min":1.252},"min":{"1min":0.94099999999999995,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.504,"5min":5.2480000000000002,"15min":5.2480000000000002},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.3,"5min":1.341,"15min":1.3859999999999999},"min":{"1min":0.96999999999999997,"5min":0.96499999999999997,"15min":0.94599999999999995},"max":{"1min":1.6739999999999999,"5min":3.7999999999999998,"15min":3.7999999999999998},"last":1.3}]},{"osd":6,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4039999999999999,"15min":1.3759999999999999},"min":{"1min":0.90500000000000003,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.679,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":1.28},{"interface":"front","average":{"1min":1.224,"5min":1.3149999999999999,"15min":1.327},"min":{"1min":0.97299999999999998,"5min":0.91500000000000004,"15min":0.872},"max":{"1min":1.4850000000000001,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":1.3779999999999999}]},{"osd":7,"last update":"Tue Dec 19 18:03:45 2023","interfaces":[{"interface":"back","average":{"1min":1.371,"5min":1.4199999999999999,"15min":1.419},"min":{"1min":1.071,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":1.627,"5min":8.4809999999999999,"15min":8.4809999999999999},"last":1.323},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3700000000000001,"15min":1.3779999999999999},"min":{"1min":0.97399999999999998,"5min":0.85499999999999998,"15min":0.80600000000000005},"max":{"1min":1.698,"5min":5.375,"15min":5.375},"last":1.5880000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32684,"kb_used_data":1636,"kb_used_omap":0,"kb_used_meta":31040,"kb_avail":94339156,"statfs":{"total":96636764160,"available":96603295744,"internally_reserved":0,"allocated":1675264,"data_stored":815109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":31784960},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.91700000000000004,"15min":0.90800000000000003},"min":{"1min":0.54600000000000004,"5min":0.54400000000000004,"15min":0.42399999999999999},"max":{"1min":1.387,"5min":1.671,"15min":1.931},"last":1.131},{"interface":"front","average":{"1min":0.999,"5min":0.96199999999999997,"15min":0.97799999999999998},"min":{"1min":0.45200000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.3240000000000001,"5min":1.8540000000000001,"15min":1.9810000000000001},"last":1.157}]},{"osd":2,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":0.84099999999999997,"5min":0.83499999999999996,"15min":0.89800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.292,"5min":1.5069999999999999,"15min":2.0590000000000002},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":0.997,"15min":1.048},"min":{"1min":0.53700000000000003,"5min":0.48299999999999998,"15min":0.42999999999999999},"max":{"1min":1.6459999999999999,"5min":1.6459999999999999,"15min":3.4199999999999999},"last":1.206}]},{"osd":3,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.109,"15min":1.167},"min":{"1min":0.59099999999999997,"5min":0.51900000000000002,"15min":0.46700000000000003},"max":{"1min":1.851,"5min":1.851,"15min":3.4950000000000001},"last":1.087},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.95799999999999996,"15min":1.0620000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":4.2030000000000003},"last":1.3140000000000001}]},{"osd":4,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2969999999999999,"5min":1.278,"15min":1.3320000000000001},"min":{"1min":0.871,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.891,"5min":2.2309999999999999,"15min":4.3869999999999996},"last":1.4650000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.226,"15min":1.2829999999999999},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.56999999999999995},"max":{"1min":1.736,"5min":1.736,"15min":2.6960000000000002},"last":1.474}]},{"osd":5,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.2509999999999999,"5min":1.2270000000000001,"15min":1.2789999999999999},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.69599999999999995},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":2.9249999999999998},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.3180000000000001,"15min":1.3899999999999999},"min":{"1min":0.99299999999999999,"5min":0.90100000000000002,"15min":0.69399999999999995},"max":{"1min":1.962,"5min":1.962,"15min":3.8420000000000001},"last":1.3899999999999999}]},{"osd":6,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.333,"15min":1.425},"min":{"1min":1.0249999999999999,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":1.9990000000000001,"5min":2.1360000000000001,"15min":4.5780000000000003},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.3839999999999999,"5min":1.347,"15min":1.4390000000000001},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.72899999999999998},"max":{"1min":2.0760000000000001,"5min":2.0760000000000001,"15min":3.214},"last":1.55}]},{"osd":7,"last update":"Tue Dec 19 18:03:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.379,"15min":1.4830000000000001},"min":{"1min":1.0069999999999999,"5min":0.83899999999999997,"15min":0.77000000000000002},"max":{"1min":2.254,"5min":2.254,"15min":4.0910000000000002},"last":1.282},{"interface":"front","average":{"1min":1.353,"5min":1.337,"15min":1.431},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":4.6390000000000002},"last":1.506}]}]},{"osd":0,"up_from":13,"seq":55834575009,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37356,"kb_used_data":2212,"kb_used_omap":0,"kb_used_meta":35136,"kb_avail":94334484,"statfs":{"total":96636764160,"available":96598511616,"internally_reserved":0,"allocated":2265088,"data_stored":1404458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":35979264},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.92200000000000004,"5min":0.88900000000000001,"15min":0.93300000000000005},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.46700000000000003},"max":{"1min":1.3740000000000001,"5min":1.53,"15min":2.2250000000000001},"last":0.999},{"interface":"front","average":{"1min":1.012,"5min":0.97299999999999998,"15min":1.056},"min":{"1min":0.627,"5min":0.53400000000000003,"15min":0.499},"max":{"1min":1.335,"5min":1.73,"15min":2.3599999999999999},"last":1.0660000000000001}]},{"osd":2,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.88300000000000001,"15min":0.93000000000000005},"min":{"1min":0.51700000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.242,"5min":1.3859999999999999,"15min":1.6839999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.91800000000000004,"15min":0.93400000000000005},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.45300000000000001},"max":{"1min":1.4490000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"last":0.747}]},{"osd":3,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.95699999999999996,"15min":0.97699999999999998},"min":{"1min":0.63600000000000001,"5min":0.55400000000000005,"15min":0.502},"max":{"1min":1.196,"5min":1.6679999999999999,"15min":3.4399999999999999},"last":1.206},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1859999999999999,"15min":1.1970000000000001},"min":{"1min":0.63900000000000001,"5min":0.57599999999999996,"15min":0.54700000000000004},"max":{"1min":1.6100000000000001,"5min":1.8520000000000001,"15min":2.5369999999999999},"last":1.111}]},{"osd":4,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3129999999999999,"5min":1.282,"15min":1.3109999999999999},"min":{"1min":0.89400000000000002,"5min":0.79700000000000004,"15min":0.69899999999999995},"max":{"1min":1.645,"5min":1.9159999999999999,"15min":1.9159999999999999},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.2729999999999999,"15min":1.3120000000000001},"min":{"1min":0.85999999999999999,"5min":0.71599999999999997,"15min":0.68999999999999995},"max":{"1min":1.605,"5min":1.738,"15min":2.7799999999999998},"last":1.3640000000000001}]},{"osd":5,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.2250000000000001,"15min":1.238},"min":{"1min":0.86399999999999999,"5min":0.80800000000000005,"15min":0.76300000000000001},"max":{"1min":1.421,"5min":1.758,"15min":2.0579999999999998},"last":1.29},{"interface":"front","average":{"1min":1.2669999999999999,"5min":1.294,"15min":1.292},"min":{"1min":0.93300000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.175}]},{"osd":6,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.3440000000000001,"15min":1.3720000000000001},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":2.0720000000000001,"5min":2.0720000000000001,"15min":2.1000000000000001},"last":1.343},{"interface":"front","average":{"1min":1.28,"5min":1.2769999999999999,"15min":1.3540000000000001},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":1.978,"5min":1.978,"15min":2.3889999999999998},"last":1.49}]},{"osd":7,"last update":"Tue Dec 19 18:03:56 2023","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.345,"15min":1.454},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":4.9400000000000004},"last":1.419},{"interface":"front","average":{"1min":1.206,"5min":1.321,"15min":1.423},"min":{"1min":0.92100000000000004,"5min":0.871,"15min":0.76300000000000001},"max":{"1min":1.5309999999999999,"5min":1.875,"15min":4.8250000000000002},"last":1.53}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-19T18:04:40.923 DEBUG:teuthology.orchestra.run.smithi045:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-19T18:04:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.087+0000 7f4bc2305700 1 Processor -- start 2023-12-19T18:04:41.094 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.087+0000 7f4bc2305700 1 -- start start 2023-12-19T18:04:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc2305700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bbc1554e0 0x7f4bbc0c9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.097 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc2305700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc070c80 0x7f4bbc0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc2305700 1 -- --> v1:172.21.15.45:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bbc0c9a70 con 0x7f4bbc1558c0 2023-12-19T18:04:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc2305700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bbc06c730 con 0x7f4bbc1554e0 2023-12-19T18:04:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc2305700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0c9d50 con 0x7f4bbc070c80 2023-12-19T18:04:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bbc1554e0 0x7f4bbc0c9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f4bbc1554e0 0x7f4bbc0c9240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40052/0 (socket says 172.21.15.45:40052) 2023-12-19T18:04:41.098 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 -- 172.21.15.45:0/3255621610 learned_addr learned my addr 172.21.15.45:0/3255621610 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1b04700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc070c80 0x7f4bbc0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 -- 172.21.15.45:0/3255621610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc070c80 msgr2=0x7f4bbc0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:41.099 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc070c80 0x7f4bbc0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 -- 172.21.15.45:0/3255621610 >> v1:172.21.15.45:6789/0 conn(0x7f4bbc1558c0 legacy=0x7f4bbc070570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 -- 172.21.15.45:0/3255621610 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bbc0ca030 con 0x7f4bbc1554e0 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1b04700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc070c80 0x7f4bbc0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bc1303700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc1554e0 0x7f4bbc0c9240 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009910 tx=0x7f4bb8009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a828c635793965a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bb3fff700 1 -- 172.21.15.45:0/3255621610 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb800ba60 con 0x7f4bbc1554e0 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bb3fff700 1 -- 172.21.15.45:0/3255621610 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb800bbc0 con 0x7f4bbc1554e0 2023-12-19T18:04:41.100 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.091+0000 7f4bb3fff700 1 -- 172.21.15.45:0/3255621610 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8009e60 con 0x7f4bbc1554e0 2023-12-19T18:04:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 -- 172.21.15.45:0/3255621610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc1554e0 msgr2=0x7f4bbc0c9240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc1554e0 0x7f4bbc0c9240 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4bb8009910 tx=0x7f4bb8009c20 comp rx=0 tx=0).stop 2023-12-19T18:04:41.101 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 -- 172.21.15.45:0/3255621610 shutdown_connections 2023-12-19T18:04:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc070c80 0x7f4bbc0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3255621610 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc1554e0 0x7f4bbc0c9240 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 -- 172.21.15.45:0/3255621610 >> 172.21.15.45:0/3255621610 conn(0x7f4bbc0ce8c0 msgr2=0x7f4bbc0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 -- 172.21.15.45:0/3255621610 shutdown_connections 2023-12-19T18:04:41.102 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.095+0000 7f4bc2305700 1 -- 172.21.15.45:0/3255621610 wait complete. 2023-12-19T18:04:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 Processor -- start 2023-12-19T18:04:41.105 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 -- start start 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 0x7f4bbc1f5e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc1554e0 0x7f4bbc15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bbc1558c0 0x7f4bbc15a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1f66c0 con 0x7f4bbc070c80 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1f69a0 con 0x7f4bbc1558c0 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc2305700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc1f6c80 con 0x7f4bbc1554e0 2023-12-19T18:04:41.107 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 0x7f4bbc1f5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 0x7f4bbc1f5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40066/0 (socket says 172.21.15.45:40066) 2023-12-19T18:04:41.108 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 -- 172.21.15.45:0/3480548897 learned_addr learned my addr 172.21.15.45:0/3480548897 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc0b02700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc1554e0 0x7f4bbc15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1b04700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bbc1558c0 0x7f4bbc15a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.109 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 -- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc1554e0 msgr2=0x7f4bbc15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc1554e0 0x7f4bbc15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 -- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bbc1558c0 msgr2=0x7f4bbc15a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bbc1558c0 0x7f4bbc15a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc1303700 1 -- 172.21.15.45:0/3480548897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb8009570 con 0x7f4bbc070c80 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.099+0000 7f4bc0b02700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc1554e0 0x7f4bbc15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bc1303700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 0x7f4bbc1f5e90 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc06afe0 tx=0x7f4bb8004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8004610 con 0x7f4bbc070c80 2023-12-19T18:04:41.110 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb801f070 con 0x7f4bbc070c80 2023-12-19T18:04:41.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb8003900 con 0x7f4bbc070c80 2023-12-19T18:04:41.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc0c5990 con 0x7f4bbc070c80 2023-12-19T18:04:41.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc1f63d0 con 0x7f4bbc070c80 2023-12-19T18:04:41.111 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.103+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc04ed30 con 0x7f4bbc070c80 2023-12-19T18:04:41.113 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.107+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f4bb8003a60 con 0x7f4bbc070c80 2023-12-19T18:04:41.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.107+0000 7f4bb1ffb700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4ba0065b20 0x7f4ba0067fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.114 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.107+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f4bb8021070 con 0x7f4bbc070c80 2023-12-19T18:04:41.115 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.107+0000 7f4bc0b02700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4ba0065b20 0x7f4ba0067fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.116 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.107+0000 7f4bc0b02700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4ba0065b20 0x7f4ba0067fe0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0b15e0 tx=0x7f4bac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:41.121 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.115+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f4bb8052450 con 0x7f4bbc070c80 2023-12-19T18:04:41.299 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.291+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f4bbc0cf4f0 con 0x7f4bbc070c80 2023-12-19T18:04:41.309 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.303+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4bb8052450 con 0x7f4bbc070c80 2023-12-19T18:04:41.310 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.303+0000 7f4bb1ffb700 1 -- 172.21.15.45:0/3480548897 <== mon.0 v2:172.21.15.45:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v20)=0 v20) v1 ==== 123+0+0 (secure 0 0 0) 0x7f4bb8055a70 con 0x7f4bbc070c80 2023-12-19T18:04:41.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4ba0065b20 msgr2=0x7f4ba0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4ba0065b20 0x7f4ba0067fe0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc0b15e0 tx=0x7f4bac009040 comp rx=0 tx=0).stop 2023-12-19T18:04:41.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 msgr2=0x7f4bbc1f5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 0x7f4bbc1f5e90 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4bbc06afe0 tx=0x7f4bb8004770 comp rx=0 tx=0).stop 2023-12-19T18:04:41.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 shutdown_connections 2023-12-19T18:04:41.316 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f4ba0065b20 0x7f4ba0067fe0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4bbc1558c0 0x7f4bbc15a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f4bbc1554e0 0x7f4bbc15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 --2- 172.21.15.45:0/3480548897 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f4bbc070c80 0x7f4bbc1f5e90 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 >> 172.21.15.45:0/3480548897 conn(0x7f4bbc0ce8c0 msgr2=0x7f4bbc0ceca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:41.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 shutdown_connections 2023-12-19T18:04:41.317 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.307+0000 7f4bc2305700 1 -- 172.21.15.45:0/3480548897 wait complete. 2023-12-19T18:04:41.335 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-19T18:04:41.335 DEBUG:teuthology.orchestra.run.smithi045:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-19T18:04:41.508 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.499+0000 7f8d91f78700 1 Processor -- start 2023-12-19T18:04:41.509 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d91f78700 1 -- start start 2023-12-19T18:04:41.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d91f78700 1 --2- >> v2:172.21.15.73:3300/0 conn(0x7f8d8c15d370 0x7f8d8c0d25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.511 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d91f78700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d8c0b5280 0x7f8d8c0b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d91f78700 1 -- --> v1:172.21.15.73:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8c0d11c0 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d91f78700 1 -- --> v2:172.21.15.45:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c15d750 con 0x7f8d8c0b5280 2023-12-19T18:04:41.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d91f78700 1 -- --> v2:172.21.15.73:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d8c0d21d0 con 0x7f8d8c15d370 2023-12-19T18:04:41.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d8bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d8c0b5280 0x7f8d8c0b60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.512 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d8bfff700 1 --2- >> v2:172.21.15.45:3300/0 conn(0x7f8d8c0b5280 0x7f8d8c0b60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40074/0 (socket says 172.21.15.45:40074) 2023-12-19T18:04:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d8bfff700 1 -- 172.21.15.45:0/1023357815 learned_addr learned my addr 172.21.15.45:0/1023357815 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.503+0000 7f8d8b7fe700 1 --2- 172.21.15.45:0/1023357815 >> v2:172.21.15.73:3300/0 conn(0x7f8d8c15d370 0x7f8d8c0d25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.513 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8bfff700 1 -- 172.21.15.45:0/1023357815 >> v2:172.21.15.73:3300/0 conn(0x7f8d8c15d370 msgr2=0x7f8d8c0d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-19T18:04:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8bfff700 1 --2- 172.21.15.45:0/1023357815 >> v2:172.21.15.73:3300/0 conn(0x7f8d8c15d370 0x7f8d8c0d25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8bfff700 1 -- 172.21.15.45:0/1023357815 >> v1:172.21.15.73:6789/0 conn(0x7f8d8c0b22b0 legacy=0x7f8d8c0b4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8bfff700 1 -- 172.21.15.45:0/1023357815 --> v2:172.21.15.45:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d8c0d1d40 con 0x7f8d8c0b5280 2023-12-19T18:04:41.514 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8bfff700 1 --2- 172.21.15.45:0/1023357815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b5280 0x7f8d8c0b60f0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0d0880 tx=0x7f8d8400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d3ade7112d9c78a server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8affd700 1 -- 172.21.15.45:0/1023357815 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400e070 con 0x7f8d8c0b5280 2023-12-19T18:04:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8affd700 1 -- 172.21.15.45:0/1023357815 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8d8400b910 con 0x7f8d8c0b5280 2023-12-19T18:04:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d8affd700 1 -- 172.21.15.45:0/1023357815 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d8400bce0 con 0x7f8d8c0b5280 2023-12-19T18:04:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 -- 172.21.15.45:0/1023357815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b5280 msgr2=0x7f8d8c0b60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.515 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1023357815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b5280 0x7f8d8c0b60f0 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0d0880 tx=0x7f8d8400b330 comp rx=0 tx=0).stop 2023-12-19T18:04:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 -- 172.21.15.45:0/1023357815 shutdown_connections 2023-12-19T18:04:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1023357815 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b5280 0x7f8d8c0b60f0 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1023357815 >> v2:172.21.15.73:3300/0 conn(0x7f8d8c15d370 0x7f8d8c0d25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 -- 172.21.15.45:0/1023357815 >> 172.21.15.45:0/1023357815 conn(0x7f8d8c0cfb70 msgr2=0x7f8d8c0cff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 -- 172.21.15.45:0/1023357815 shutdown_connections 2023-12-19T18:04:41.516 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.507+0000 7f8d91f78700 1 -- 172.21.15.45:0/1023357815 wait complete. 2023-12-19T18:04:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 Processor -- start 2023-12-19T18:04:41.518 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 -- start start 2023-12-19T18:04:41.520 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 0x7f8d8c153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 --2- >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d8c0b5280 0x7f8d8c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8c15d370 0x7f8d8c0c90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 -- --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0c7c30 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c153bd0 con 0x7f8d8c15d370 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.511+0000 7f8d91f78700 1 -- --> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c15a6a0 con 0x7f8d8c0b5280 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 0x7f8d8c153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 --2- >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 0x7f8d8c153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.45:3300/0 says I am v2:172.21.15.45:40078/0 (socket says 172.21.15.45:40078) 2023-12-19T18:04:41.521 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 -- 172.21.15.45:0/1553559055 learned_addr learned my addr 172.21.15.45:0/1553559055 (peer_addr_for_me v2:172.21.15.45:0/0) 2023-12-19T18:04:41.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8bfff700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8c15d370 0x7f8d8c0c90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.522 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d83fff700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d8c0b5280 0x7f8d8c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 -- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d8c0b5280 msgr2=0x7f8d8c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d8c0b5280 0x7f8d8c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 -- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8c15d370 msgr2=0x7f8d8c0c90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8c15d370 0x7f8d8c0c90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 -- 172.21.15.45:0/1553559055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d84009b30 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.523 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8bfff700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8c15d370 0x7f8d8c0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-19T18:04:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d8b7fe700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 0x7f8d8c153690 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ec40 tx=0x7f8d7c009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c009740 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f8d7c00c8b0 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c00cc60 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8c1572c0 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.524 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d8c0cb490 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.525 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.515+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d8c0d2ef0 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.526 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.519+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 4 ==== mgrmap(e 5) v1 ==== 85228+0+0 (secure 0 0 0) 0x7f8d7c013470 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.519+0000 7f8d88ff9700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8d6c065b00 0x7f8d6c067fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-19T18:04:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.519+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5435+0+0 (secure 0 0 0) 0x7f8d7c083110 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.527 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.519+0000 7f8d83fff700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8d6c065b00 0x7f8d6c067fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-19T18:04:41.528 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.519+0000 7f8d83fff700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8d6c065b00 0x7f8d6c067fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0b9220 tx=0x7f8d74009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-19T18:04:41.534 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.527+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172167 (secure 0 0 0) 0x7f8d7c050b50 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.735+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 --> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d8c0741d0 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.743 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.735+0000 7f8d88ff9700 1 -- 172.21.15.45:0/1553559055 <== mon.0 v2:172.21.15.45:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+3532 (secure 0 0 0) 0x7f8d7c017de0 con 0x7f8d8c0b22b0 2023-12-19T18:04:41.744 INFO:teuthology.orchestra.run.smithi045.stdout: 2023-12-19T18:04:41.744 INFO:teuthology.orchestra.run.smithi045.stdout:{"epoch":114,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":8859,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6836/1472833361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6834","nonce":1472833361},{"type":"v1","addr":"172.21.15.45:6836","nonce":1472833361}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8865,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/1606116282","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":1606116282},{"type":"v1","addr":"172.21.15.73:6835","nonce":1606116282}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":94},{"gid":8968,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1038392951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1038392951},{"type":"v1","addr":"172.21.15.73:6833","nonce":1038392951}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":9456,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.45:6837/2695016976","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.45:6835","nonce":2695016976},{"type":"v1","addr":"172.21.15.45:6837","nonce":2695016976}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":114}],"filesystems":[]} 2023-12-19T18:04:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8d6c065b00 msgr2=0x7f8d6c067fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8d6c065b00 0x7f8d6c067fc0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c0b9220 tx=0x7f8d74009040 comp rx=0 tx=0).stop 2023-12-19T18:04:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 msgr2=0x7f8d8c153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-19T18:04:41.749 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 0x7f8d8c153690 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00ec40 tx=0x7f8d7c009e00 comp rx=0 tx=0).stop 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 shutdown_connections 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:6832/36158,v1:172.21.15.45:6833/36158] conn(0x7f8d6c065b00 0x7f8d6c067fc0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d8c15d370 0x7f8d8c0c90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.73:3301/0,v1:172.21.15.73:6790/0] conn(0x7f8d8c0b5280 0x7f8d8c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 --2- 172.21.15.45:0/1553559055 >> [v2:172.21.15.45:3300/0,v1:172.21.15.45:6789/0] conn(0x7f8d8c0b22b0 0x7f8d8c153690 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 >> 172.21.15.45:0/1553559055 conn(0x7f8d8c0cfb70 msgr2=0x7f8d8c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 shutdown_connections 2023-12-19T18:04:41.750 INFO:teuthology.orchestra.run.smithi045.stderr:2023-12-19T18:04:41.743+0000 7f8d91f78700 1 -- 172.21.15.45:0/1553559055 wait complete. 2023-12-19T18:04:41.752 INFO:teuthology.orchestra.run.smithi045.stderr:dumped fsmap epoch 114 2023-12-19T18:04:41.770 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-19T18:04:41.771 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-19T18:04:41.771 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-19T18:04:41.771 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:41.791 INFO:tasks.ceph.mds.a:Stopped 2023-12-19T18:04:41.791 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-19T18:04:41.791 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:41.858 INFO:tasks.ceph.mds.c:Stopped 2023-12-19T18:04:41.858 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-19T18:04:41.858 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:41.882 INFO:tasks.ceph.mds.b:Stopped 2023-12-19T18:04:41.882 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-19T18:04:41.882 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:41.944 INFO:tasks.ceph.mds.d:Stopped 2023-12-19T18:04:41.944 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-19T18:04:41.945 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-19T18:04:41.945 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:42.036 INFO:tasks.ceph.osd.0:Stopped 2023-12-19T18:04:42.037 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-19T18:04:42.037 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:42.127 INFO:tasks.ceph.osd.1:Stopped 2023-12-19T18:04:42.127 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-19T18:04:42.127 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:43.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-19T18:04:43.235 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-19T18:04:48.229 INFO:tasks.ceph.osd.2:Stopped 2023-12-19T18:04:48.230 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-19T18:04:48.230 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:48.322 INFO:tasks.ceph.osd.3:Stopped 2023-12-19T18:04:48.322 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-19T18:04:48.322 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:49.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-19T18:04:49.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-19T18:04:49.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-19T18:04:54.424 INFO:tasks.ceph.osd.4:Stopped 2023-12-19T18:04:54.425 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-19T18:04:54.425 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:54.516 INFO:tasks.ceph.osd.5:Stopped 2023-12-19T18:04:54.517 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-19T18:04:54.517 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:04:55.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-19T18:04:55.037 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-19T18:05:00.619 INFO:tasks.ceph.osd.6:Stopped 2023-12-19T18:05:00.620 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-19T18:05:00.620 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:05:00.642 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-19T18:05:00.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-19T18:05:00.705 INFO:tasks.ceph.osd.7:Stopped 2023-12-19T18:05:00.706 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-19T18:05:00.706 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-19T18:05:00.706 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:05:00.770 INFO:tasks.ceph.mgr.y:Stopped 2023-12-19T18:05:00.770 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-19T18:05:00.770 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:05:00.833 INFO:tasks.ceph.mgr.x:Stopped 2023-12-19T18:05:00.834 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-19T18:05:00.834 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-19T18:05:00.834 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:05:00.866 INFO:tasks.ceph.mon.a:Stopped 2023-12-19T18:05:00.867 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-19T18:05:00.867 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:05:00.905 INFO:tasks.ceph.mon.b:Stopped 2023-12-19T18:05:00.905 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-19T18:05:00.905 INFO:teuthology.orchestra.run:waiting for 300 2023-12-19T18:05:00.978 INFO:tasks.ceph.mon.c:Stopped 2023-12-19T18:05:00.979 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-19T18:05:00.979 DEBUG:teuthology.orchestra.run.smithi045:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'bad backtrace' | egrep -v 'object missing on disk' | egrep -v 'error reading table object' | egrep -v 'error reading sessionmap' | egrep -v 'unmatched fragstat' | egrep -v 'unmatched rstat' | egrep -v 'was unreadable, recreating it now' | egrep -v 'Scrub error on inode' | egrep -v 'Metadata damage detected' | egrep -v 'inconsistent rstat on inode' | egrep -v 'Error recovering journal' | head -n 1 2023-12-19T18:05:01.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:05:01.036 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-19T18:05:01.235 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:05:01.235 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-19T18:05:01.442 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:05:01.443 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-19T18:05:01.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:05:01.652 DEBUG:teuthology.orchestra.run.smithi045:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-19T18:05:01.928 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:05:01.929 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-19T18:05:02.276 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:05:02.276 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-19T18:05:02.491 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:05:02.499 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:05:02.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:05:02.563 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-19T18:05:02.822 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:05:02.823 DEBUG:teuthology.orchestra.run.smithi073:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-19T18:05:03.063 INFO:tasks.ceph:Archiving mon data... 2023-12-19T18:05:03.064 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/data/mon.a.tgz 2023-12-19T18:05:03.065 DEBUG:teuthology.orchestra.run.smithi045:> mktemp 2023-12-19T18:05:03.084 INFO:teuthology.orchestra.run.smithi045.stdout:/tmp/tmp.nTtGT5UMBV 2023-12-19T18:05:03.084 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.nTtGT5UMBV 2023-12-19T18:05:03.271 DEBUG:teuthology.orchestra.run.smithi045:> sudo chmod 0666 /tmp/tmp.nTtGT5UMBV 2023-12-19T18:05:03.375 DEBUG:teuthology.orchestra.remote:smithi045:/tmp/tmp.nTtGT5UMBV is 448KB 2023-12-19T18:05:03.451 DEBUG:teuthology.orchestra.run.smithi045:> rm -fr /tmp/tmp.nTtGT5UMBV 2023-12-19T18:05:03.473 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/data/mon.b.tgz 2023-12-19T18:05:03.473 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-19T18:05:03.491 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.LoBX7vAksN 2023-12-19T18:05:03.492 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LoBX7vAksN 2023-12-19T18:05:03.691 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.LoBX7vAksN 2023-12-19T18:05:03.788 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.LoBX7vAksN is 462KB 2023-12-19T18:05:03.874 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.LoBX7vAksN 2023-12-19T18:05:03.894 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/data/mon.c.tgz 2023-12-19T18:05:03.894 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2023-12-19T18:05:03.958 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.uDCajlhzit 2023-12-19T18:05:03.958 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uDCajlhzit 2023-12-19T18:05:04.144 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.uDCajlhzit 2023-12-19T18:05:04.239 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.uDCajlhzit is 462KB 2023-12-19T18:05:04.320 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.uDCajlhzit 2023-12-19T18:05:04.338 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-19T18:05:04.338 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T18:05:04.346 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-19T18:05:04.419 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-19T18:05:04.419 DEBUG:teuthology.orchestra.run.smithi045:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T18:05:04.426 DEBUG:teuthology.orchestra.run.smithi073:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-19T18:05:04.472 INFO:teuthology.orchestra.run.smithi045.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T18:05:04.518 INFO:teuthology.orchestra.run.smithi073.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-19T18:05:04.531 INFO:tasks.ceph:Archiving crash dumps... 2023-12-19T18:05:04.533 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/remote/smithi045/crash 2023-12-19T18:05:04.534 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T18:05:04.571 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/remote/smithi073/crash 2023-12-19T18:05:04.572 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-19T18:05:04.611 INFO:tasks.ceph:Shutting down logrotate 2023-12-19T18:05:04.611 DEBUG:teuthology.orchestra.run.smithi045:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:05:04.623 DEBUG:teuthology.orchestra.run.smithi073:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-19T18:05:04.722 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T18:05:04.756 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-19T18:05:04.790 INFO:tasks.ceph:Compressing logs... 2023-12-19T18:05:04.790 DEBUG:teuthology.orchestra.run.smithi045:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T18:05:04.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T18:05:05.643 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-19T18:05:13.408 INFO:tasks.ceph:Archiving logs... 2023-12-19T18:05:13.409 DEBUG:teuthology.misc:Transferring archived files from smithi045:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/remote/smithi045/log 2023-12-19T18:05:13.410 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T18:05:14.956 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/remote/smithi073/log 2023-12-19T18:05:14.957 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-19T18:05:15.859 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-19T18:05:15.869 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-19T18:05:15.869 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T18:05:15.877 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-19T18:05:16.000 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-19T18:05:16.010 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-19T18:05:16.011 DEBUG:teuthology.orchestra.run.smithi045:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T18:05:16.018 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-19T18:05:16.057 INFO:teuthology.orchestra.run.smithi073.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T18:05:16.057 INFO:teuthology.orchestra.run.smithi073.stdout:============================================================================== 2023-12-19T18:05:16.057 INFO:teuthology.orchestra.run.smithi073.stdout:*hv01.front.sepi 44.4.53.2 2 u 61 64 377 0.115 -0.457 0.295 2023-12-19T18:05:16.058 INFO:teuthology.orchestra.run.smithi073.stdout:+hv02.front.sepi 96.245.170.99 3 u 6 64 377 0.103 -0.779 0.197 2023-12-19T18:05:16.058 INFO:teuthology.orchestra.run.smithi073.stdout:+hv03.front.sepi 74.6.168.72 3 u 3 64 377 0.097 -0.283 0.258 2023-12-19T18:05:16.058 INFO:teuthology.orchestra.run.smithi073.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-12-19T18:05:16.060 INFO:teuthology.orchestra.run.smithi045.stdout: remote refid st t when poll reach delay offset jitter 2023-12-19T18:05:16.060 INFO:teuthology.orchestra.run.smithi045.stdout:============================================================================== 2023-12-19T18:05:16.060 INFO:teuthology.orchestra.run.smithi045.stdout:*hv01.front.sepi 44.4.53.2 2 u 12 64 377 0.100 2.985 0.535 2023-12-19T18:05:16.060 INFO:teuthology.orchestra.run.smithi045.stdout:+hv02.front.sepi 96.245.170.99 3 u 6 64 377 0.098 2.648 0.562 2023-12-19T18:05:16.061 INFO:teuthology.orchestra.run.smithi045.stdout:+hv03.front.sepi 74.6.168.72 3 u 62 64 377 0.107 2.854 0.539 2023-12-19T18:05:16.061 INFO:teuthology.orchestra.run.smithi045.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 0.000 0.000 2023-12-19T18:05:16.061 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-19T18:05:16.071 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-19T18:05:16.071 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-19T18:05:16.094 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-19T18:05:16.128 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-19T18:05:16.161 INFO:teuthology.task.internal:Duration was 1623.297149 seconds 2023-12-19T18:05:16.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-19T18:05:16.195 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-19T18:05:16.195 DEBUG:teuthology.orchestra.run.smithi045:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T18:05:16.203 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-19T18:05:16.375 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-19T18:05:16.375 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi045.front.sepia.ceph.com 2023-12-19T18:05:16.375 DEBUG:teuthology.orchestra.run.smithi045:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T18:05:16.407 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2023-12-19T18:05:16.408 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-19T18:05:16.446 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-19T18:05:16.446 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T18:05:16.458 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-19T18:05:16.554 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-19T18:05:16.554 DEBUG:teuthology.orchestra.run.smithi045:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T18:05:16.561 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-19T18:05:16.677 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-19T18:05:16.687 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-19T18:05:16.687 DEBUG:teuthology.orchestra.run.smithi045:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T18:05:16.726 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-19T18:05:16.768 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-19T18:05:16.778 DEBUG:teuthology.orchestra.run.smithi045:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T18:05:16.786 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-19T18:05:16.820 INFO:teuthology.orchestra.run.smithi045.stdout:kernel.core_pattern = core 2023-12-19T18:05:16.853 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2023-12-19T18:05:16.890 DEBUG:teuthology.orchestra.run.smithi045:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T18:05:16.917 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:05:16.918 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-19T18:05:16.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-19T18:05:16.947 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-19T18:05:16.958 INFO:teuthology.task.internal:Transferring archived files... 2023-12-19T18:05:16.958 DEBUG:teuthology.misc:Transferring archived files from smithi045:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/remote/smithi045 2023-12-19T18:05:16.959 DEBUG:teuthology.orchestra.run.smithi045:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T18:05:17.005 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202/remote/smithi073 2023-12-19T18:05:17.006 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-19T18:05:17.052 INFO:teuthology.task.internal:Removing archive directory... 2023-12-19T18:05:17.053 DEBUG:teuthology.orchestra.run.smithi045:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T18:05:17.060 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-19T18:05:17.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-19T18:05:17.123 INFO:teuthology.task.internal:Not uploading archives. 2023-12-19T18:05:17.124 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-19T18:05:17.149 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-19T18:05:17.150 DEBUG:teuthology.orchestra.run.smithi045:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T18:05:17.158 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-19T18:05:17.173 INFO:teuthology.orchestra.run.smithi045.stdout: 1048609 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 18:05 /home/ubuntu/cephtest 2023-12-19T18:05:17.182 INFO:teuthology.orchestra.run.smithi073.stdout: 1048617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 19 18:05 /home/ubuntu/cephtest 2023-12-19T18:05:17.188 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-19T18:05:17.199 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-19T18:05:17.310 INFO:teuthology.nuke:Checking targets against current locks 2023-12-19T18:05:17.342 DEBUG:teuthology.nuke:shortname: smithi045 2023-12-19T18:05:17.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T18:05:17.385 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi045.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 17:28:18.502995', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-19T18:05:17.397 DEBUG:teuthology.nuke:shortname: smithi073 2023-12-19T18:05:17.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-19T18:05:17.451 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-19_13:22:41-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-testing-default-smithi/7497202', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-19 17:28:18.504699', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-12-19T18:05:17.500 INFO:teuthology.orchestra.console.smithi045:Power off 2023-12-19T18:05:17.501 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T18:05:17.542 INFO:teuthology.orchestra.console.smithi073:Power off 2023-12-19T18:05:17.543 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-19T18:05:17.552 DEBUG:teuthology.orchestra.console.smithi045:power off output: Chassis Power Control: Down/Off 2023-12-19T18:05:17.553 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:17.591 DEBUG:teuthology.orchestra.console.smithi073:power off output: Chassis Power Control: Down/Off 2023-12-19T18:05:17.592 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:17.604 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-19T18:05:17.641 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-19T18:05:21.605 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:21.642 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:21.718 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-19T18:05:21.753 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is on 2023-12-19T18:05:25.719 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:25.754 DEBUG:teuthology.orchestra.console.smithi073:pexpect command: ipmitool -H smithi073.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:25.830 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is on 2023-12-19T18:05:25.866 DEBUG:teuthology.orchestra.console.smithi073:check power output: Chassis Power is off 2023-12-19T18:05:25.967 INFO:teuthology.orchestra.console.smithi073:Power off completed 2023-12-19T18:05:29.833 DEBUG:teuthology.orchestra.console.smithi045:pexpect command: ipmitool -H smithi045.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-19T18:05:29.944 DEBUG:teuthology.orchestra.console.smithi045:check power output: Chassis Power is off 2023-12-19T18:05:30.045 INFO:teuthology.orchestra.console.smithi045:Power off completed 2023-12-19T18:05:30.150 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_20.04} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/data-scan} duration: 1623.2971489429474 failure_reason: 'Test failure: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=66c046fe4fd440abba75682732716755 status: fail success: false 2023-12-19T18:05:30.150 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-19T18:05:30.243 INFO:teuthology.run:FAIL